2023-10-06T02:33:23.912 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T02:33:23.912 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158 --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --verbose --owner scheduled_yuriw@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/orig.config.yaml 2023-10-06T02:33:23.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:33:24.052 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: yweinste@redhat.com first_in_suite: false job_id: '7412158' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFlKdK7qoQ2CKEE+CuhcMFy+Xxfkz4PKl/phQ80HO8UrRf8lRDywwt+Bhb7yX4dA+s1wfKZXinWKrmvqZqlMRSA= smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH6svpMLhYavZsbuLf8eljcztSr4b5/qwmdDaLAog34OCT3/g0G+98OLkPA7efPG+KUqzwQSo5GY11ojrcqxQa4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T02:33:24.052 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T02:33:24.053 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T02:33:24.053 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T02:33:24.055 INFO:teuthology.task.internal:Checking packages... 2023-10-06T02:33:24.078 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T02:33:24.078 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T02:33:24.078 INFO:teuthology.packaging:ref: None 2023-10-06T02:33:24.078 INFO:teuthology.packaging:tag: None 2023-10-06T02:33:24.078 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:33:24.079 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:33:24.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:33:24.219 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.gf1e315a9 2023-10-06T02:33:24.219 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T02:33:24.225 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T02:33:24.225 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T02:33:24.230 INFO:teuthology.task.internal:Saving configuration 2023-10-06T02:33:24.247 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T02:33:24.253 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:33:24.272 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:28:27.738606', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFlKdK7qoQ2CKEE+CuhcMFy+Xxfkz4PKl/phQ80HO8UrRf8lRDywwt+Bhb7yX4dA+s1wfKZXinWKrmvqZqlMRSA='} 2023-10-06T02:33:24.293 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:28:27.736635', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH6svpMLhYavZsbuLf8eljcztSr4b5/qwmdDaLAog34OCT3/g0G+98OLkPA7efPG+KUqzwQSo5GY11ojrcqxQa4='} 2023-10-06T02:33:24.293 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T02:33:24.299 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T02:33:24.299 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T02:33:24.299 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T02:33:24.359 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f28111a5b80>, signals=[15]) 2023-10-06T02:33:24.360 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T02:33:24.367 INFO:teuthology.task.internal:Opening connections... 2023-10-06T02:33:24.367 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:33:24.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:33:24.437 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:33:24.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:33:24.502 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T02:33:24.508 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-10-06T02:33:24.525 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-10-06T02:33:24.525 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-06T02:33:24.581 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T02:33:24.581 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T02:33:24.581 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-10-06T02:33:24.581 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-10-06T02:33:24.581 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T02:33:24.582 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T02:33:24.583 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-06T02:33:24.608 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-10-06T02:33:24.625 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-10-06T02:33:24.625 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-10-06T02:33:24.681 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T02:33:24.681 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T02:33:24.681 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-10-06T02:33:24.681 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-10-06T02:33:24.681 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.4" 2023-10-06T02:33:24.681 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:33:24.681 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T02:33:24.681 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-10-06T02:33:24.681 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T02:33:24.682 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T02:33:24.682 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T02:33:24.682 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:33:24.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:33:24.682 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:33:24.682 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T02:33:24.682 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T02:33:24.682 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T02:33:24.682 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-10-06T02:33:24.707 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T02:33:24.720 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T02:33:24.726 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T02:33:24.726 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:33:24.728 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:33:24.743 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T02:33:24.749 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T02:33:24.749 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:33:24.784 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:33:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T02:33:24.799 INFO:teuthology.orchestra.run.smithi083.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T02:33:24.800 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T02:33:24.844 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T02:33:24.858 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T02:33:24.858 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T02:33:24.858 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T02:33:24.859 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:33:24.859 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:33:24.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:33:24.874 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2023-10-06T02:33:24.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:33:24.875 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-10-06T02:33:24.930 INFO:teuthology.orchestra.run.smithi083.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:33:24.930 INFO:teuthology.task.kernel:Running kernel on smithi083: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:33:24.930 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum install -y kernel 2023-10-06T02:33:24.932 INFO:teuthology.orchestra.run.smithi081.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:33:24.932 INFO:teuthology.task.kernel:Running kernel on smithi081: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:33:24.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2023-10-06T02:33:26.322 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T02:33:26.323 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-10-06T02:33:26.423 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-06T02:33:26.424 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-06T02:33:27.848 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-06T02:33:27.921 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-10-06T02:33:28.368 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 33 MB/s | 16 MB 00:00 2023-10-06T02:33:28.826 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-10-06T02:33:31.646 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-06T02:33:32.085 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 4.9 MB/s | 24 kB 00:00 2023-10-06T02:33:32.357 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T02:33:32.357 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T02:33:32.357 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T02:33:32.502 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-10-06T02:33:32.503 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2023-10-06T02:33:32.503 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-10-06T02:33:32.610 DEBUG:teuthology.orchestra.run.smithi081:> echo no | sudo yum reinstall kernel || true 2023-10-06T02:33:32.811 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T02:33:32.811 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T02:33:32.812 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T02:33:32.953 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-06T02:33:32.953 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-06T02:33:32.957 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2023-10-06T02:33:32.958 INFO:teuthology.orchestra.run.smithi083.stdout:Nothing to do. 2023-10-06T02:33:32.958 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2023-10-06T02:33:33.100 DEBUG:teuthology.orchestra.run.smithi083:> echo no | sudo yum reinstall kernel || true 2023-10-06T02:33:33.247 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:33:31 AM UTC. 2023-10-06T02:33:33.376 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:33:33.377 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:33:33.377 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:33:33.398 INFO:teuthology.orchestra.run.smithi081.stderr:Error: No packages marked for reinstall. 2023-10-06T02:33:33.442 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T02:33:33.443 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-10-06T02:33:33.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum reinstall -y kernel || true 2023-10-06T02:33:33.735 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 02:33:32 AM UTC. 2023-10-06T02:33:33.787 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-06T02:33:33.787 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-06T02:33:33.868 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:33:33.868 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:33:33.869 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:33:33.894 INFO:teuthology.orchestra.run.smithi083.stderr:Error: No packages marked for reinstall. 2023-10-06T02:33:33.944 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum reinstall -y kernel || true 2023-10-06T02:33:34.073 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 02:33:31 AM UTC. 2023-10-06T02:33:34.217 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:33:34.218 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:33:34.218 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:33:34.229 INFO:teuthology.orchestra.run.smithi081.stderr:Error: No packages marked for reinstall. 2023-10-06T02:33:34.279 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:33:34.285 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T02:33:34.285 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-10-06T02:33:34.404 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:34.404 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:34.404 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:34.404 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:33:34.405 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:33:34.405 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T02:33:34.405 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:33:34.405 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:33:34.530 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:34.531 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:34.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2023-10-06T02:33:34.558 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2023-10-06T02:33:34.558 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2023-10-06T02:33:34.559 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.02 2023-10-06T02:33:34.559 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 99.el8_4.1 2023-10-06T02:33:34.559 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2023-10-06T02:33:34.559 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T02:33:34.559 INFO:teuthology.orchestra.run.smithi081.stdout:Group : System Environment/Base 2023-10-06T02:33:34.559 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 9264631 2023-10-06T02:33:34.559 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2023-10-06T02:33:34.559 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T02:33:34.559 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout:Relocations : (not relocatable) 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : Red Hat, Inc. 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : Red Hat, Inc. 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:33:34.560 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:33:34.561 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:33:34.561 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:33:34.561 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2023-10-06T02:33:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:33:34.561 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:33:34.563 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:33:34.563 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:34.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:33:34.564 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:33:32 AM UTC. 2023-10-06T02:33:34.734 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:33:34.735 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:33:34.735 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:33:34.749 INFO:teuthology.orchestra.run.smithi083.stderr:Error: No packages marked for reinstall. 2023-10-06T02:33:34.799 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:33:34.924 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:34.925 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:34.925 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:34.925 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:33:34.925 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:33:34.925 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T02:33:34.926 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:33:34.926 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:33:35.050 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:35.050 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:35.050 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -qi grub2-tools 2023-10-06T02:33:35.077 INFO:teuthology.orchestra.run.smithi083.stdout:Name : grub2-tools 2023-10-06T02:33:35.077 INFO:teuthology.orchestra.run.smithi083.stdout:Epoch : 1 2023-10-06T02:33:35.077 INFO:teuthology.orchestra.run.smithi083.stdout:Version : 2.02 2023-10-06T02:33:35.077 INFO:teuthology.orchestra.run.smithi083.stdout:Release : 99.el8_4.1 2023-10-06T02:33:35.077 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: x86_64 2023-10-06T02:33:35.077 INFO:teuthology.orchestra.run.smithi083.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T02:33:35.077 INFO:teuthology.orchestra.run.smithi083.stdout:Group : System Environment/Base 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Size : 9264631 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:License : GPLv3+ 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Relocations : (not relocatable) 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Packager : Red Hat, Inc. 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Vendor : Red Hat, Inc. 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Summary : Support tools for GRUB. 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout:Description : 2023-10-06T02:33:35.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:33:35.079 INFO:teuthology.orchestra.run.smithi083.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:33:35.079 INFO:teuthology.orchestra.run.smithi083.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:33:35.079 INFO:teuthology.orchestra.run.smithi083.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:33:35.079 INFO:teuthology.orchestra.run.smithi083.stdout:hardware devices. 2023-10-06T02:33:35.079 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:33:35.079 INFO:teuthology.orchestra.run.smithi083.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:33:35.080 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:33:35.080 INFO:teuthology.task.kernel:Updating grub on smithi083 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:35.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:33:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2023-10-06T02:33:36.476 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2023-10-06T02:33:38.137 INFO:teuthology.orchestra.run.smithi081.stderr:done 2023-10-06T02:33:38.139 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-10-06T02:33:38.154 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.0ewkTjyt4t 2023-10-06T02:33:38.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0ewkTjyt4t 2023-10-06T02:33:38.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.0ewkTjyt4t 2023-10-06T02:33:38.376 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.0ewkTjyt4t is 6KB 2023-10-06T02:33:38.423 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.0ewkTjyt4t 2023-10-06T02:33:38.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:33:38.513 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T02:33:38.513 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T02:33:38.513 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T02:33:38.513 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T02:33:38.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:38.588 INFO:teuthology.orchestra.run.smithi083.stderr:done 2023-10-06T02:33:38.590 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T02:33:38.610 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.mgAu2mbPdY 2023-10-06T02:33:38.611 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mgAu2mbPdY 2023-10-06T02:33:38.682 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.mgAu2mbPdY 2023-10-06T02:33:38.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2023-10-06T02:33:38.842 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.mgAu2mbPdY is 6KB 2023-10-06T02:33:38.891 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.mgAu2mbPdY 2023-10-06T02:33:38.904 DEBUG:teuthology.orchestra.run.smithi083:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:33:38.978 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T02:33:38.978 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T02:33:38.978 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T02:33:38.978 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T02:33:38.980 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:33:39.141 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2023-10-06T02:34:08.714 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T02:34:08.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T02:34:08.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:34:09.144 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T02:34:09.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T02:34:09.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:34:27.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-06T02:34:27.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T02:34:36.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T02:34:36.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:34:36.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T02:34:36.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:34:39.164 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-06T02:34:39.642 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T02:34:51.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T02:34:51.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:34:51.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T02:34:51.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:35:23.046 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-06T02:35:23.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T02:35:23.493 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T02:35:23.493 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-10-06T02:35:23.507 INFO:teuthology.orchestra.run.smithi081.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T02:35:23.507 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:35:23.507 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:35:23.507 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T02:35:23.740 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-06T02:35:24.508 DEBUG:teuthology.parallel:result is None 2023-10-06T02:35:25.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T02:35:25.125 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T02:35:25.126 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2023-10-06T02:35:25.434 INFO:teuthology.orchestra.run.smithi083.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T02:35:25.434 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:35:25.434 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:35:25.434 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T02:35:26.435 DEBUG:teuthology.parallel:result is None 2023-10-06T02:35:26.435 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T02:35:26.444 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T02:35:26.444 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:35:26.475 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:35:26.557 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T02:35:26.564 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T02:35:26.578 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T02:35:26.578 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:35:26.580 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:35:26.621 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T02:35:26.632 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T02:35:26.632 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:35:26.659 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:35:26.737 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:35:26.758 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:35:26.914 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:35:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:35:26.935 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T02:35:26.944 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T02:35:26.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:35:26.946 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:35:26.971 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T02:35:27.068 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T02:35:27.068 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:35:27.070 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:35:27.084 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:35:27.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:35:27.348 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:35:27.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:35:27.435 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:35:27.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:35:27.504 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:35:27.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:35:27.621 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:35:27.664 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:35:27.703 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:35:27.703 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:35:27.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-10-06T02:35:27.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2023-10-06T02:35:27.821 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:35:27.859 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:35:28.342 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T02:35:28.351 INFO:teuthology.task.internal:Starting timer... 2023-10-06T02:35:28.351 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T02:35:28.362 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T02:35:28.371 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T02:35:28.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2023-10-06T02:35:28.456 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: [ OK ] 2023-10-06T02:35:28.457 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2023-10-06T02:35:28.535 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: [ OK ] 2023-10-06T02:35:28.537 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T02:35:28.537 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2023-10-06T02:35:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2023-10-06T02:35:28.559 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2023-10-06T02:35:28.577 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2023-10-06T02:35:28.578 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi083.front.sepia.ceph.com': 'permissive'} 2023-10-06T02:35:28.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:35:28.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:35:28.624 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:35:28.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:35:28.648 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T02:35:28.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:35:28.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:35:28.712 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T02:35:28.728 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T02:35:28.733 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T02:35:28.851 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T02:35:28.867 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T02:35:28.868 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi083.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T02:43:34.445 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi083.front.sepia.ceph.com')] 2023-10-06T02:43:34.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T02:43:34.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:43:34.517 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-06T02:43:34.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T02:43:34.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T02:43:34.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:43:34.650 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-06T02:43:34.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T02:43:34.713 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T02:43:34.724 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T02:43:34.725 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:43:34.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:43:34.727 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:43:34.727 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:43:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T02:43:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T02:43:34.782 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T02:43:34.797 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T02:43:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2023-10-06T02:43:34.817 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2023-10-06T02:43:34.828 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2023-10-06T02:43:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T02:43:34.838 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2023-10-06T02:43:34.844 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T02:43:34.852 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T02:43:34.865 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T02:43:34.902 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-10-06T02:43:34.905 INFO:teuthology.orchestra.run.smithi081.stdout:210 Number of sources = 4 2023-10-06T02:43:34.905 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:43:34.905 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-10-06T02:43:34.905 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:43:34.905 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:43:34.905 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:43:34.906 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:43:34.932 INFO:teuthology.orchestra.run.smithi083.stderr:bash: ntpq: command not found 2023-10-06T02:43:34.934 INFO:teuthology.orchestra.run.smithi083.stdout:210 Number of sources = 4 2023-10-06T02:43:34.934 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:43:34.934 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2023-10-06T02:43:34.935 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:43:34.935 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:43:34.935 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:43:34.935 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:43:34.936 INFO:teuthology.run_tasks:Running task install... 2023-10-06T02:43:34.944 DEBUG:teuthology.task.install:project ceph 2023-10-06T02:43:34.944 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T02:43:34.944 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T02:43:34.944 INFO:teuthology.task.install:Using flavor: default 2023-10-06T02:43:34.955 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T02:43:34.956 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T02:43:34.956 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T02:43:34.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:43:34.958 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T02:43:34.958 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:43:35.107 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T02:43:35.108 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T02:43:35.176 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T02:43:35.176 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T02:43:35.215 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T02:43:35.215 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:43:35.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T02:43:35.242 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T02:43:35.242 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T02:43:35.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T02:43:35.350 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T02:43:35.351 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:43:35.351 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T02:43:35.379 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T02:43:35.379 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T02:43:35.386 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T02:43:35.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T02:43:35.449 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2023-10-06T02:43:35.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2023-10-06T02:43:35.520 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T02:43:35.584 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2023-10-06T02:43:35.585 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2023-10-06T02:43:35.839 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-06T02:43:35.975 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T02:43:36.125 INFO:teuthology.orchestra.run.smithi081.stdout:44 files removed 2023-10-06T02:43:36.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T02:43:36.284 INFO:teuthology.orchestra.run.smithi083.stdout:44 files removed 2023-10-06T02:43:36.334 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T02:43:36.524 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-06T02:43:36.684 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T02:43:37.226 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 282 kB/s | 78 kB 00:00 2023-10-06T02:43:37.380 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 276 kB/s | 78 kB 00:00 2023-10-06T02:43:37.569 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-06T02:43:37.606 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 49 kB/s | 9.2 kB 00:00 2023-10-06T02:43:37.822 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 7.8 kB/s | 1.4 kB 00:00 2023-10-06T02:43:37.846 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-10-06T02:43:37.932 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-06T02:43:37.967 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 37 kB/s | 3.5 kB 00:00 2023-10-06T02:43:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 49 MB/s | 16 MB 00:00 2023-10-06T02:43:40.697 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 5.8 MB/s | 16 MB 00:02 2023-10-06T02:43:41.575 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T02:43:41.993 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 113 MB/s | 38 MB 00:00 2023-10-06T02:43:44.011 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-10-06T02:43:44.403 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 123 MB/s | 38 MB 00:00 2023-10-06T02:43:47.474 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 121 MB/s | 33 MB 00:00 2023-10-06T02:43:49.877 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 122 MB/s | 33 MB 00:00 2023-10-06T02:43:55.508 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:43:55.509 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:43:55.519 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T02:43:55.520 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T02:43:55.521 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T02:43:55.522 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T02:43:55.524 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T02:43:55.526 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T02:43:55.527 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T02:43:56.022 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-10-06T02:43:56.034 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================================================== 2023-10-06T02:43:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-10-06T02:43:56.034 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================================================== 2023-10-06T02:43:56.034 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2023-10-06T02:43:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T02:43:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T02:43:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T02:43:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T02:43:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T02:43:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T02:43:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T02:43:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T02:43:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T02:43:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T02:43:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:43:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T02:43:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T02:43:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T02:43:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T02:43:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T02:43:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T02:43:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T02:43:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T02:43:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T02:43:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T02:43:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T02:43:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T02:43:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T02:43:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T02:43:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T02:43:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T02:43:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T02:43:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T02:43:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T02:43:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:43:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T02:43:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T02:43:56.040 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-10-06T02:43:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:43:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T02:43:56.041 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2023-10-06T02:43:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T02:43:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T02:43:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T02:43:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T02:43:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T02:43:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T02:43:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:43:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T02:43:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T02:43:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T02:43:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T02:43:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T02:43:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T02:43:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T02:43:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T02:43:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T02:43:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T02:43:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T02:43:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T02:43:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T02:43:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T02:43:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T02:43:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T02:43:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T02:43:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T02:43:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T02:43:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T02:43:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T02:43:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T02:43:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T02:43:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T02:43:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T02:43:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T02:43:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T02:43:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T02:43:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T02:43:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T02:43:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T02:43:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T02:43:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T02:43:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T02:43:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T02:43:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T02:43:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T02:43:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T02:43:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T02:43:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T02:43:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T02:43:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T02:43:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T02:43:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:43:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T02:43:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T02:43:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T02:43:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T02:43:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T02:43:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T02:43:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T02:43:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T02:43:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T02:43:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T02:43:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T02:43:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T02:43:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T02:43:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T02:43:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T02:43:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T02:43:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:43:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T02:43:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T02:43:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T02:43:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T02:43:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T02:43:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T02:43:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T02:43:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T02:43:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T02:43:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T02:43:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T02:43:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T02:43:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T02:43:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T02:43:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T02:43:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T02:43:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T02:43:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:43:56.056 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-10-06T02:43:56.056 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================================================== 2023-10-06T02:43:56.056 INFO:teuthology.orchestra.run.smithi081.stdout:Install 118 Packages 2023-10-06T02:43:56.056 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 2 Packages 2023-10-06T02:43:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:43:56.057 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 201 M 2023-10-06T02:43:56.057 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-10-06T02:43:56.562 INFO:teuthology.orchestra.run.smithi081.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 40 kB/s | 6.4 kB 00:00 2023-10-06T02:43:56.933 INFO:teuthology.orchestra.run.smithi081.stdout:(2/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 9.7 MB/s | 5.2 MB 00:00 2023-10-06T02:43:56.968 INFO:teuthology.orchestra.run.smithi081.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 4.6 MB/s | 162 kB 00:00 2023-10-06T02:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 12 MB/s | 2.3 MB 00:00 2023-10-06T02:43:57.265 INFO:teuthology.orchestra.run.smithi081.stdout:(5/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.2 MB/s | 876 kB 00:00 2023-10-06T02:43:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 10 MB/s | 1.6 MB 00:00 2023-10-06T02:43:57.729 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:43:57.730 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:43:57.741 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T02:43:57.741 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T02:43:57.742 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T02:43:57.743 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T02:43:57.745 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T02:43:57.747 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T02:43:57.748 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T02:43:58.199 INFO:teuthology.orchestra.run.smithi081.stdout:(7/120): ceph-common-17.2.6-1296.g736ac5ba.el8. 13 MB/s | 23 MB 00:01 2023-10-06T02:43:58.238 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2023-10-06T02:43:58.248 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================================== 2023-10-06T02:43:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2023-10-06T02:43:58.248 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================================== 2023-10-06T02:43:58.248 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2023-10-06T02:43:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T02:43:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T02:43:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T02:43:58.251 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2023-10-06T02:43:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T02:43:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T02:43:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T02:43:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T02:43:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T02:43:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T02:43:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:43:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T02:43:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T02:43:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T02:43:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T02:43:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T02:43:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T02:43:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T02:43:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T02:43:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T02:43:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T02:43:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T02:43:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T02:43:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T02:43:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T02:43:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T02:43:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T02:43:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T02:43:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T02:43:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T02:43:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T02:43:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T02:43:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T02:43:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T02:43:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T02:43:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T02:43:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T02:43:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T02:43:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:43:58.262 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2023-10-06T02:43:58.263 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================================== 2023-10-06T02:43:58.263 INFO:teuthology.orchestra.run.smithi083.stdout:Install 118 Packages 2023-10-06T02:43:58.263 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 2 Packages 2023-10-06T02:43:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:43:58.263 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 201 M 2023-10-06T02:43:58.263 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2023-10-06T02:43:58.585 INFO:teuthology.orchestra.run.smithi083.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-10-06T02:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout:(8/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 12 MB/s | 17 MB 00:01 2023-10-06T02:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 646 kB/s | 24 kB 00:00 2023-10-06T02:43:59.076 INFO:teuthology.orchestra.run.smithi083.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.7 MB/s | 876 kB 00:00 2023-10-06T02:43:59.200 INFO:teuthology.orchestra.run.smithi083.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 1.3 MB/s | 162 kB 00:00 2023-10-06T02:43:59.498 INFO:teuthology.orchestra.run.smithi081.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 13 MB/s | 17 MB 00:01 2023-10-06T02:43:59.550 INFO:teuthology.orchestra.run.smithi081.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 4.8 MB/s | 255 kB 00:00 2023-10-06T02:43:59.596 INFO:teuthology.orchestra.run.smithi081.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 542 kB/s | 25 kB 00:00 2023-10-06T02:43:59.705 INFO:teuthology.orchestra.run.smithi081.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 7.2 MB/s | 797 kB 00:00 2023-10-06T02:43:59.751 INFO:teuthology.orchestra.run.smithi081.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 3.7 MB/s | 174 kB 00:00 2023-10-06T02:43:59.800 INFO:teuthology.orchestra.run.smithi081.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 2.6 MB/s | 130 kB 00:00 2023-10-06T02:43:59.863 INFO:teuthology.orchestra.run.smithi081.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 7.9 MB/s | 507 kB 00:00 2023-10-06T02:43:59.875 INFO:teuthology.orchestra.run.smithi083.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 3.4 MB/s | 2.3 MB 00:00 2023-10-06T02:43:59.990 INFO:teuthology.orchestra.run.smithi083.stdout:(5/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 3.1 MB/s | 5.2 MB 00:01 2023-10-06T02:44:00.136 INFO:teuthology.orchestra.run.smithi081.stdout:(17/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x8 1.4 MB/s | 3.9 MB 00:02 2023-10-06T02:44:00.220 INFO:teuthology.orchestra.run.smithi081.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 532 kB/s | 45 kB 00:00 2023-10-06T02:44:00.390 INFO:teuthology.orchestra.run.smithi081.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 681 kB/s | 115 kB 00:00 2023-10-06T02:44:00.424 INFO:teuthology.orchestra.run.smithi081.stdout:(20/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 9.9 MB/s | 5.6 MB 00:00 2023-10-06T02:44:00.473 INFO:teuthology.orchestra.run.smithi083.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 2.6 MB/s | 1.6 MB 00:00 2023-10-06T02:44:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 5.8 MB/s | 371 kB 00:00 2023-10-06T02:44:00.533 INFO:teuthology.orchestra.run.smithi081.stdout:(22/120): python3-cephfs-17.2.6-1296.g736ac5ba. 1.3 MB/s | 190 kB 00:00 2023-10-06T02:44:00.555 INFO:teuthology.orchestra.run.smithi081.stdout:(23/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 5.2 MB/s | 358 kB 00:00 2023-10-06T02:44:00.615 INFO:teuthology.orchestra.run.smithi081.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.5 MB/s | 90 kB 00:00 2023-10-06T02:44:00.664 INFO:teuthology.orchestra.run.smithi083.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 5.8 MB/s | 3.9 MB 00:00 2023-10-06T02:44:00.667 INFO:teuthology.orchestra.run.smithi081.stdout:(25/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 793 kB/s | 107 kB 00:00 2023-10-06T02:44:01.022 INFO:teuthology.orchestra.run.smithi081.stdout:(26/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 8.5 MB/s | 3.5 MB 00:00 2023-10-06T02:44:01.071 INFO:teuthology.orchestra.run.smithi081.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 474 kB/s | 23 kB 00:00 2023-10-06T02:44:01.124 INFO:teuthology.orchestra.run.smithi081.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 2.2 MB/s | 121 kB 00:00 2023-10-06T02:44:01.241 INFO:teuthology.orchestra.run.smithi081.stdout:(29/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 301 kB/s | 173 kB 00:00 2023-10-06T02:44:01.397 INFO:teuthology.orchestra.run.smithi081.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 6.2 MB/s | 1.7 MB 00:00 2023-10-06T02:44:01.459 INFO:teuthology.orchestra.run.smithi081.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.8 MB/s | 238 kB 00:00 2023-10-06T02:44:01.520 INFO:teuthology.orchestra.run.smithi081.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 771 kB/s | 47 kB 00:00 2023-10-06T02:44:01.579 INFO:teuthology.orchestra.run.smithi081.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 246 kB/s | 14 kB 00:00 2023-10-06T02:44:01.649 INFO:teuthology.orchestra.run.smithi081.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.7 MB/s | 267 kB 00:00 2023-10-06T02:44:01.718 INFO:teuthology.orchestra.run.smithi081.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.1 MB/s | 80 kB 00:00 2023-10-06T02:44:01.783 INFO:teuthology.orchestra.run.smithi081.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 280 kB/s | 18 kB 00:00 2023-10-06T02:44:01.992 INFO:teuthology.orchestra.run.smithi081.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-10-06T02:44:02.029 INFO:teuthology.orchestra.run.smithi081.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.6 MB/s | 59 kB 00:00 2023-10-06T02:44:02.065 INFO:teuthology.orchestra.run.smithi081.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 2.1 MB/s | 75 kB 00:00 2023-10-06T02:44:02.136 INFO:teuthology.orchestra.run.smithi081.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 6.5 MB/s | 476 kB 00:00 2023-10-06T02:44:02.168 INFO:teuthology.orchestra.run.smithi081.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.4 MB/s | 44 kB 00:00 2023-10-06T02:44:02.204 INFO:teuthology.orchestra.run.smithi081.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 5.0 MB/s | 185 kB 00:00 2023-10-06T02:44:02.224 INFO:teuthology.orchestra.run.smithi083.stdout:(8/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el8 11 MB/s | 17 MB 00:01 2023-10-06T02:44:02.236 INFO:teuthology.orchestra.run.smithi081.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.0 MB/s | 33 kB 00:00 2023-10-06T02:44:02.266 INFO:teuthology.orchestra.run.smithi081.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 531 kB/s | 16 kB 00:00 2023-10-06T02:44:02.270 INFO:teuthology.orchestra.run.smithi083.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 532 kB/s | 24 kB 00:00 2023-10-06T02:44:02.302 INFO:teuthology.orchestra.run.smithi081.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.8 MB/s | 173 kB 00:00 2023-10-06T02:44:02.345 INFO:teuthology.orchestra.run.smithi081.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 8.8 MB/s | 384 kB 00:00 2023-10-06T02:44:02.377 INFO:teuthology.orchestra.run.smithi081.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 2.5 MB/s | 81 kB 00:00 2023-10-06T02:44:02.408 INFO:teuthology.orchestra.run.smithi081.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 362 kB/s | 11 kB 00:00 2023-10-06T02:44:02.439 INFO:teuthology.orchestra.run.smithi081.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 574 kB/s | 18 kB 00:00 2023-10-06T02:44:02.509 INFO:teuthology.orchestra.run.smithi081.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 17 MB/s | 1.2 MB 00:00 2023-10-06T02:44:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.5 MB/s | 49 kB 00:00 2023-10-06T02:44:02.572 INFO:teuthology.orchestra.run.smithi081.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.8 MB/s | 59 kB 00:00 2023-10-06T02:44:02.603 INFO:teuthology.orchestra.run.smithi081.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.9 MB/s | 60 kB 00:00 2023-10-06T02:44:02.638 INFO:teuthology.orchestra.run.smithi081.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 8.1 MB/s | 283 kB 00:00 2023-10-06T02:44:02.668 INFO:teuthology.orchestra.run.smithi081.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 508 kB/s | 16 kB 00:00 2023-10-06T02:44:02.700 INFO:teuthology.orchestra.run.smithi081.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.1 MB/s | 34 kB 00:00 2023-10-06T02:44:02.733 INFO:teuthology.orchestra.run.smithi081.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 5.8 MB/s | 196 kB 00:00 2023-10-06T02:44:02.764 INFO:teuthology.orchestra.run.smithi081.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 2.0 MB/s | 64 kB 00:00 2023-10-06T02:44:02.795 INFO:teuthology.orchestra.run.smithi081.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 607 kB/s | 19 kB 00:00 2023-10-06T02:44:02.844 INFO:teuthology.orchestra.run.smithi081.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 496 kB/s | 24 kB 00:00 2023-10-06T02:44:02.875 INFO:teuthology.orchestra.run.smithi081.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 948 kB/s | 29 kB 00:00 2023-10-06T02:44:02.908 INFO:teuthology.orchestra.run.smithi081.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 841 kB/s | 27 kB 00:00 2023-10-06T02:44:02.942 INFO:teuthology.orchestra.run.smithi081.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 7.2 MB/s | 255 kB 00:00 2023-10-06T02:44:02.976 INFO:teuthology.orchestra.run.smithi081.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 7.3 MB/s | 251 kB 00:00 2023-10-06T02:44:03.008 INFO:teuthology.orchestra.run.smithi081.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 1.9 MB/s | 61 kB 00:00 2023-10-06T02:44:03.039 INFO:teuthology.orchestra.run.smithi081.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 2.7 MB/s | 85 kB 00:00 2023-10-06T02:44:03.070 INFO:teuthology.orchestra.run.smithi081.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 748 kB/s | 23 kB 00:00 2023-10-06T02:44:03.143 INFO:teuthology.orchestra.run.smithi081.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 24 MB/s | 1.7 MB 00:00 2023-10-06T02:44:03.147 INFO:teuthology.orchestra.run.smithi081.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-10-06T02:44:03.191 INFO:teuthology.orchestra.run.smithi081.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 426 kB/s | 19 kB 00:00 2023-10-06T02:44:03.217 INFO:teuthology.orchestra.run.smithi081.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.6 MB/s | 43 kB 00:00 2023-10-06T02:44:03.243 INFO:teuthology.orchestra.run.smithi081.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 5.8 MB/s | 155 kB 00:00 2023-10-06T02:44:03.269 INFO:teuthology.orchestra.run.smithi081.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.4 MB/s | 220 kB 00:00 2023-10-06T02:44:03.292 INFO:teuthology.orchestra.run.smithi081.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.1 MB/s | 48 kB 00:00 2023-10-06T02:44:03.316 INFO:teuthology.orchestra.run.smithi081.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 9.3 MB/s | 229 kB 00:00 2023-10-06T02:44:03.338 INFO:teuthology.orchestra.run.smithi081.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 1.9 MB/s | 43 kB 00:00 2023-10-06T02:44:03.384 INFO:teuthology.orchestra.run.smithi081.stdout:(77/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 51 MB/s | 2.3 MB 00:00 2023-10-06T02:44:03.406 INFO:teuthology.orchestra.run.smithi081.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 817 kB/s | 18 kB 00:00 2023-10-06T02:44:03.433 INFO:teuthology.orchestra.run.smithi081.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 22 MB/s | 605 kB 00:00 2023-10-06T02:44:03.456 INFO:teuthology.orchestra.run.smithi081.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 3.6 MB/s | 83 kB 00:00 2023-10-06T02:44:03.478 INFO:teuthology.orchestra.run.smithi081.stdout:(81/120): elfutils-libelf-devel-0.182-3.el8.x86 2.6 MB/s | 59 kB 00:00 2023-10-06T02:44:03.501 INFO:teuthology.orchestra.run.smithi081.stdout:(82/120): libquadmath-8.4.1-1.el8.x86_64.rpm 7.2 MB/s | 169 kB 00:00 2023-10-06T02:44:03.523 INFO:teuthology.orchestra.run.smithi081.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.7 MB/s | 38 kB 00:00 2023-10-06T02:44:03.545 INFO:teuthology.orchestra.run.smithi081.stdout:(84/120): libsepol-devel-2.9-2.el8.x86_64.rpm 3.9 MB/s | 86 kB 00:00 2023-10-06T02:44:03.567 INFO:teuthology.orchestra.run.smithi081.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.6 MB/s | 58 kB 00:00 2023-10-06T02:44:03.589 INFO:teuthology.orchestra.run.smithi081.stdout:(86/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.1 MB/s | 47 kB 00:00 2023-10-06T02:44:03.616 INFO:teuthology.orchestra.run.smithi081.stdout:(87/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 20 MB/s | 559 kB 00:00 2023-10-06T02:44:03.644 INFO:teuthology.orchestra.run.smithi081.stdout:(88/120): libgfortran-8.4.1-1.el8.x86_64.rpm 23 MB/s | 639 kB 00:00 2023-10-06T02:44:03.667 INFO:teuthology.orchestra.run.smithi081.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.0 MB/s | 70 kB 00:00 2023-10-06T02:44:03.692 INFO:teuthology.orchestra.run.smithi081.stdout:(90/120): libselinux-devel-2.9-5.el8.x86_64.rpm 8.2 MB/s | 200 kB 00:00 2023-10-06T02:44:03.714 INFO:teuthology.orchestra.run.smithi081.stdout:(91/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 4.2 MB/s | 97 kB 00:00 2023-10-06T02:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout:(92/120): python3-scipy-1.0.0-20.module+el8.1.0 63 MB/s | 15 MB 00:00 2023-10-06T02:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.3 MB/s | 44 kB 00:00 2023-10-06T02:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.2 MB/s | 27 kB 00:00 2023-10-06T02:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-10-06T02:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 22 MB/s | 320 kB 00:00 2023-10-06T02:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 27 MB/s | 457 kB 00:00 2023-10-06T02:44:04.077 INFO:teuthology.orchestra.run.smithi081.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 77 MB/s | 4.8 MB 00:00 2023-10-06T02:44:04.089 INFO:teuthology.orchestra.run.smithi081.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.1 MB/s | 39 kB 00:00 2023-10-06T02:44:04.108 INFO:teuthology.orchestra.run.smithi081.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 37 MB/s | 688 kB 00:00 2023-10-06T02:44:04.122 INFO:teuthology.orchestra.run.smithi081.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 18 MB/s | 259 kB 00:00 2023-10-06T02:44:04.136 INFO:teuthology.orchestra.run.smithi081.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 17 MB/s | 225 kB 00:00 2023-10-06T02:44:04.148 INFO:teuthology.orchestra.run.smithi081.stdout:(103/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 9.9 MB/s | 126 kB 00:00 2023-10-06T02:44:04.199 INFO:teuthology.orchestra.run.smithi081.stdout:(104/120): python3-numpy-1.14.3-9.el8.x86_64.rp 75 MB/s | 3.7 MB 00:00 2023-10-06T02:44:04.213 INFO:teuthology.orchestra.run.smithi081.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-10-06T02:44:04.229 INFO:teuthology.orchestra.run.smithi081.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 33 MB/s | 538 kB 00:00 2023-10-06T02:44:04.245 INFO:teuthology.orchestra.run.smithi081.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 19 MB/s | 302 kB 00:00 2023-10-06T02:44:04.258 INFO:teuthology.orchestra.run.smithi081.stdout:(108/120): python3-mako-1.0.6-13.el8.noarch.rpm 12 MB/s | 157 kB 00:00 2023-10-06T02:44:04.271 INFO:teuthology.orchestra.run.smithi081.stdout:(109/120): python3-pyasn1-modules-0.3.7-6.el8.n 8.7 MB/s | 110 kB 00:00 2023-10-06T02:44:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:(110/120): librdkafka-0.11.4-1.el8.x86_64.rpm 24 MB/s | 353 kB 00:00 2023-10-06T02:44:04.298 INFO:teuthology.orchestra.run.smithi081.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 1.6 MB/s | 20 kB 00:00 2023-10-06T02:44:04.316 INFO:teuthology.orchestra.run.smithi081.stdout:(112/120): libtool-2.4.6-25.el8.x86_64.rpm 39 MB/s | 709 kB 00:00 2023-10-06T02:44:04.328 INFO:teuthology.orchestra.run.smithi081.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.5 MB/s | 54 kB 00:00 2023-10-06T02:44:04.389 INFO:teuthology.orchestra.run.smithi081.stdout:(114/120): openblas-threads-0.3.12-1.el8.x86_64 78 MB/s | 4.7 MB 00:00 2023-10-06T02:44:04.450 INFO:teuthology.orchestra.run.smithi081.stdout:(115/120): openblas-0.3.12-1.el8.x86_64.rpm 75 MB/s | 4.6 MB 00:00 2023-10-06T02:44:04.470 INFO:teuthology.orchestra.run.smithi081.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 36 MB/s | 713 kB 00:00 2023-10-06T02:44:05.524 INFO:teuthology.orchestra.run.smithi083.stdout:(10/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 3.3 MB/s | 17 MB 00:05 2023-10-06T02:44:05.597 INFO:teuthology.orchestra.run.smithi083.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 3.4 MB/s | 255 kB 00:00 2023-10-06T02:44:05.627 INFO:teuthology.orchestra.run.smithi083.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 840 kB/s | 25 kB 00:00 2023-10-06T02:44:05.705 INFO:teuthology.orchestra.run.smithi081.stdout:(117/120): ceph-test-17.2.6-1296.g736ac5ba.el8. 7.4 MB/s | 52 MB 00:06 2023-10-06T02:44:05.720 INFO:teuthology.orchestra.run.smithi081.stdout:(118/120): librados2-17.2.6-1296.g736ac5ba.el8. 2.8 MB/s | 3.5 MB 00:01 2023-10-06T02:44:05.922 INFO:teuthology.orchestra.run.smithi081.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 17 MB/s | 3.6 MB 00:00 2023-10-06T02:44:06.044 INFO:teuthology.orchestra.run.smithi083.stdout:(13/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 14 MB/s | 52 MB 00:03 2023-10-06T02:44:06.050 INFO:teuthology.orchestra.run.smithi083.stdout:(14/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 1.8 MB/s | 797 kB 00:00 2023-10-06T02:44:06.082 INFO:teuthology.orchestra.run.smithi083.stdout:(15/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 4.5 MB/s | 174 kB 00:00 2023-10-06T02:44:06.093 INFO:teuthology.orchestra.run.smithi083.stdout:(16/120): librados-devel-17.2.6-1296.g736ac5ba. 3.0 MB/s | 130 kB 00:00 2023-10-06T02:44:06.156 INFO:teuthology.orchestra.run.smithi083.stdout:(17/120): libradosstriper1-17.2.6-1296.g736ac5b 6.8 MB/s | 507 kB 00:00 2023-10-06T02:44:06.192 INFO:teuthology.orchestra.run.smithi083.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.2 MB/s | 45 kB 00:00 2023-10-06T02:44:06.230 INFO:teuthology.orchestra.run.smithi083.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 3.0 MB/s | 115 kB 00:00 2023-10-06T02:44:06.268 INFO:teuthology.orchestra.run.smithi083.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 4.9 MB/s | 190 kB 00:00 2023-10-06T02:44:06.309 INFO:teuthology.orchestra.run.smithi083.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 8.8 MB/s | 371 kB 00:00 2023-10-06T02:44:06.352 INFO:teuthology.orchestra.run.smithi083.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 8.2 MB/s | 358 kB 00:00 2023-10-06T02:44:06.390 INFO:teuthology.orchestra.run.smithi083.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 2.8 MB/s | 107 kB 00:00 2023-10-06T02:44:06.427 INFO:teuthology.orchestra.run.smithi083.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.4 MB/s | 90 kB 00:00 2023-10-06T02:44:06.651 INFO:teuthology.orchestra.run.smithi083.stdout:(25/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 15 MB/s | 3.5 MB 00:00 2023-10-06T02:44:06.692 INFO:teuthology.orchestra.run.smithi083.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 4.1 MB/s | 173 kB 00:00 2023-10-06T02:44:06.728 INFO:teuthology.orchestra.run.smithi083.stdout:(27/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 8.7 MB/s | 5.6 MB 00:00 2023-10-06T02:44:06.729 INFO:teuthology.orchestra.run.smithi083.stdout:(28/120): ceph-grafana-dashboards-17.2.6-1296.g 631 kB/s | 23 kB 00:00 2023-10-06T02:44:06.751 INFO:teuthology.orchestra.run.smithi083.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 5.4 MB/s | 121 kB 00:00 2023-10-06T02:44:06.851 INFO:teuthology.orchestra.run.smithi083.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 14 MB/s | 1.7 MB 00:00 2023-10-06T02:44:06.873 INFO:teuthology.orchestra.run.smithi081.stdout:(120/120): ceph-mgr-diskprediction-local-17.2.6 1.3 MB/s | 7.4 MB 00:05 2023-10-06T02:44:06.877 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:44:06.877 INFO:teuthology.orchestra.run.smithi081.stdout:Total 19 MB/s | 201 MB 00:10 2023-10-06T02:44:06.889 INFO:teuthology.orchestra.run.smithi083.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 6.1 MB/s | 238 kB 00:00 2023-10-06T02:44:06.926 INFO:teuthology.orchestra.run.smithi083.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 1.3 MB/s | 47 kB 00:00 2023-10-06T02:44:06.929 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-10-06T02:44:06.962 INFO:teuthology.orchestra.run.smithi083.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 402 kB/s | 14 kB 00:00 2023-10-06T02:44:07.002 INFO:teuthology.orchestra.run.smithi083.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 6.6 MB/s | 267 kB 00:00 2023-10-06T02:44:07.039 INFO:teuthology.orchestra.run.smithi083.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 2.1 MB/s | 80 kB 00:00 2023-10-06T02:44:07.044 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-10-06T02:44:07.044 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-10-06T02:44:07.076 INFO:teuthology.orchestra.run.smithi083.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 496 kB/s | 18 kB 00:00 2023-10-06T02:44:07.325 INFO:teuthology.orchestra.run.smithi083.stdout:(37/120): ceph-common-17.2.6-1296.g736ac5ba.el8 2.6 MB/s | 23 MB 00:08 2023-10-06T02:44:07.536 INFO:teuthology.orchestra.run.smithi083.stdout:(38/120): ceph-mgr-diskprediction-local-17.2.6- 9.4 MB/s | 7.4 MB 00:00 2023-10-06T02:44:07.677 INFO:teuthology.orchestra.run.smithi083.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 531 kB/s | 75 kB 00:00 2023-10-06T02:44:07.802 INFO:teuthology.orchestra.run.smithi083.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2023-10-06T02:44:07.833 INFO:teuthology.orchestra.run.smithi083.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.4 MB/s | 44 kB 00:00 2023-10-06T02:44:07.871 INFO:teuthology.orchestra.run.smithi083.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 4.9 MB/s | 185 kB 00:00 2023-10-06T02:44:07.901 INFO:teuthology.orchestra.run.smithi083.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.1 MB/s | 33 kB 00:00 2023-10-06T02:44:07.931 INFO:teuthology.orchestra.run.smithi083.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 541 kB/s | 16 kB 00:00 2023-10-06T02:44:07.969 INFO:teuthology.orchestra.run.smithi083.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.6 MB/s | 173 kB 00:00 2023-10-06T02:44:08.015 INFO:teuthology.orchestra.run.smithi083.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 8.2 MB/s | 384 kB 00:00 2023-10-06T02:44:08.048 INFO:teuthology.orchestra.run.smithi083.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2023-10-06T02:44:08.078 INFO:teuthology.orchestra.run.smithi083.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 373 kB/s | 11 kB 00:00 2023-10-06T02:44:08.108 INFO:teuthology.orchestra.run.smithi083.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 588 kB/s | 18 kB 00:00 2023-10-06T02:44:08.187 INFO:teuthology.orchestra.run.smithi083.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 15 MB/s | 1.2 MB 00:00 2023-10-06T02:44:08.218 INFO:teuthology.orchestra.run.smithi083.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.6 MB/s | 49 kB 00:00 2023-10-06T02:44:08.248 INFO:teuthology.orchestra.run.smithi083.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.9 MB/s | 59 kB 00:00 2023-10-06T02:44:08.279 INFO:teuthology.orchestra.run.smithi083.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.9 MB/s | 60 kB 00:00 2023-10-06T02:44:08.313 INFO:teuthology.orchestra.run.smithi083.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 8.2 MB/s | 283 kB 00:00 2023-10-06T02:44:08.344 INFO:teuthology.orchestra.run.smithi083.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 509 kB/s | 16 kB 00:00 2023-10-06T02:44:08.374 INFO:teuthology.orchestra.run.smithi083.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.1 MB/s | 34 kB 00:00 2023-10-06T02:44:08.407 INFO:teuthology.orchestra.run.smithi083.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 5.9 MB/s | 196 kB 00:00 2023-10-06T02:44:08.435 INFO:teuthology.orchestra.run.smithi083.stdout:(58/120): liboath-2.6.2-3.el8.x86_64.rpm 53 kB/s | 59 kB 00:01 2023-10-06T02:44:08.438 INFO:teuthology.orchestra.run.smithi083.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 2.1 MB/s | 64 kB 00:00 2023-10-06T02:44:08.468 INFO:teuthology.orchestra.run.smithi083.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 795 kB/s | 24 kB 00:00 2023-10-06T02:44:08.499 INFO:teuthology.orchestra.run.smithi083.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 968 kB/s | 29 kB 00:00 2023-10-06T02:44:08.529 INFO:teuthology.orchestra.run.smithi083.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 916 kB/s | 27 kB 00:00 2023-10-06T02:44:08.563 INFO:teuthology.orchestra.run.smithi083.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 7.4 MB/s | 255 kB 00:00 2023-10-06T02:44:08.596 INFO:teuthology.orchestra.run.smithi083.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 7.3 MB/s | 251 kB 00:00 2023-10-06T02:44:08.627 INFO:teuthology.orchestra.run.smithi083.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 2.0 MB/s | 61 kB 00:00 2023-10-06T02:44:08.658 INFO:teuthology.orchestra.run.smithi083.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 2.7 MB/s | 85 kB 00:00 2023-10-06T02:44:08.688 INFO:teuthology.orchestra.run.smithi083.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 757 kB/s | 23 kB 00:00 2023-10-06T02:44:08.760 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-10-06T02:44:08.764 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-10-06T02:44:08.764 INFO:teuthology.orchestra.run.smithi083.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2023-10-06T02:44:08.768 INFO:teuthology.orchestra.run.smithi083.stdout:(69/120): python3-simplegeneric-0.8.1-17.el8.no 56 kB/s | 19 kB 00:00 2023-10-06T02:44:08.768 INFO:teuthology.orchestra.run.smithi083.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-10-06T02:44:08.808 INFO:teuthology.orchestra.run.smithi083.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-06T02:44:08.818 INFO:teuthology.orchestra.run.smithi083.stdout:(72/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 373 kB/s | 19 kB 00:00 2023-10-06T02:44:08.828 INFO:teuthology.orchestra.run.smithi083.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 7.9 MB/s | 155 kB 00:00 2023-10-06T02:44:08.838 INFO:teuthology.orchestra.run.smithi083.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 11 MB/s | 220 kB 00:00 2023-10-06T02:44:08.846 INFO:teuthology.orchestra.run.smithi083.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.6 MB/s | 48 kB 00:00 2023-10-06T02:44:08.860 INFO:teuthology.orchestra.run.smithi083.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 11 MB/s | 229 kB 00:00 2023-10-06T02:44:08.873 INFO:teuthology.orchestra.run.smithi083.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 1.6 MB/s | 43 kB 00:00 2023-10-06T02:44:08.889 INFO:teuthology.orchestra.run.smithi083.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.1 MB/s | 18 kB 00:00 2023-10-06T02:44:08.909 INFO:teuthology.orchestra.run.smithi083.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 47 MB/s | 2.3 MB 00:00 2023-10-06T02:44:08.916 INFO:teuthology.orchestra.run.smithi083.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-10-06T02:44:08.925 INFO:teuthology.orchestra.run.smithi083.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.0 MB/s | 83 kB 00:00 2023-10-06T02:44:08.934 INFO:teuthology.orchestra.run.smithi083.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.1 MB/s | 59 kB 00:00 2023-10-06T02:44:08.945 INFO:teuthology.orchestra.run.smithi083.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 8.5 MB/s | 169 kB 00:00 2023-10-06T02:44:08.950 INFO:teuthology.orchestra.run.smithi083.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.3 MB/s | 38 kB 00:00 2023-10-06T02:44:08.963 INFO:teuthology.orchestra.run.smithi083.stdout:(85/120): gperftools-libs-2.7-9.el8.x86_64.rpm 162 kB/s | 306 kB 00:01 2023-10-06T02:44:08.965 INFO:teuthology.orchestra.run.smithi083.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.1 MB/s | 86 kB 00:00 2023-10-06T02:44:08.983 INFO:teuthology.orchestra.run.smithi083.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2023-10-06T02:44:08.994 INFO:teuthology.orchestra.run.smithi083.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 19 MB/s | 559 kB 00:00 2023-10-06T02:44:09.002 INFO:teuthology.orchestra.run.smithi083.stdout:(89/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.2 MB/s | 47 kB 00:00 2023-10-06T02:44:09.008 INFO:teuthology.orchestra.run.smithi083.stdout:(90/120): libgfortran-8.4.1-1.el8.x86_64.rpm 25 MB/s | 639 kB 00:00 2023-10-06T02:44:09.012 INFO:teuthology.orchestra.run.smithi083.stdout:(91/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.8 MB/s | 70 kB 00:00 2023-10-06T02:44:09.023 INFO:teuthology.orchestra.run.smithi083.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 9.5 MB/s | 200 kB 00:00 2023-10-06T02:44:09.027 INFO:teuthology.orchestra.run.smithi083.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.2 MB/s | 97 kB 00:00 2023-10-06T02:44:09.042 INFO:teuthology.orchestra.run.smithi083.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.2 MB/s | 44 kB 00:00 2023-10-06T02:44:09.050 INFO:teuthology.orchestra.run.smithi083.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.1 MB/s | 27 kB 00:00 2023-10-06T02:44:09.062 INFO:teuthology.orchestra.run.smithi083.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 8.0 MB/s | 161 kB 00:00 2023-10-06T02:44:09.069 INFO:teuthology.orchestra.run.smithi083.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 17 MB/s | 320 kB 00:00 2023-10-06T02:44:09.085 INFO:teuthology.orchestra.run.smithi083.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 20 MB/s | 457 kB 00:00 2023-10-06T02:44:09.104 INFO:teuthology.orchestra.run.smithi083.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.1 MB/s | 39 kB 00:00 2023-10-06T02:44:09.127 INFO:teuthology.orchestra.run.smithi083.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 29 MB/s | 688 kB 00:00 2023-10-06T02:44:09.155 INFO:teuthology.orchestra.run.smithi083.stdout:(101/120): python3-babel-2.5.1-5.el8.noarch.rpm 56 MB/s | 4.8 MB 00:00 2023-10-06T02:44:09.158 INFO:teuthology.orchestra.run.smithi083.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 8.2 MB/s | 259 kB 00:00 2023-10-06T02:44:09.175 INFO:teuthology.orchestra.run.smithi083.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 11 MB/s | 225 kB 00:00 2023-10-06T02:44:09.187 INFO:teuthology.orchestra.run.smithi083.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 4.4 MB/s | 126 kB 00:00 2023-10-06T02:44:09.295 INFO:teuthology.orchestra.run.smithi083.stdout:(105/120): python3-scipy-1.0.0-20.module+el8.1. 51 MB/s | 15 MB 00:00 2023-10-06T02:44:09.298 INFO:teuthology.orchestra.run.smithi083.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-10-06T02:44:09.316 INFO:teuthology.orchestra.run.smithi083.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 26 MB/s | 538 kB 00:00 2023-10-06T02:44:09.320 INFO:teuthology.orchestra.run.smithi083.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2023-10-06T02:44:09.332 INFO:teuthology.orchestra.run.smithi083.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.4 MB/s | 157 kB 00:00 2023-10-06T02:44:09.343 INFO:teuthology.orchestra.run.smithi083.stdout:(110/120): python3-numpy-1.14.3-9.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-10-06T02:44:09.344 INFO:teuthology.orchestra.run.smithi083.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 4.5 MB/s | 110 kB 00:00 2023-10-06T02:44:09.355 INFO:teuthology.orchestra.run.smithi083.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 15 MB/s | 353 kB 00:00 2023-10-06T02:44:09.360 INFO:teuthology.orchestra.run.smithi083.stdout:(113/120): python3-jsonpointer-1.10-11.el8.noar 1.2 MB/s | 20 kB 00:00 2023-10-06T02:44:09.375 INFO:teuthology.orchestra.run.smithi083.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 23 MB/s | 709 kB 00:00 2023-10-06T02:44:09.387 INFO:teuthology.orchestra.run.smithi083.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.7 MB/s | 54 kB 00:00 2023-10-06T02:44:09.413 INFO:teuthology.orchestra.run.smithi083.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 27 MB/s | 713 kB 00:00 2023-10-06T02:44:09.455 INFO:teuthology.orchestra.run.smithi083.stdout:(117/120): openblas-0.3.12-1.el8.x86_64.rpm 58 MB/s | 4.6 MB 00:00 2023-10-06T02:44:09.468 INFO:teuthology.orchestra.run.smithi083.stdout:(118/120): openblas-threads-0.3.12-1.el8.x86_64 44 MB/s | 4.7 MB 00:00 2023-10-06T02:44:09.814 INFO:teuthology.orchestra.run.smithi083.stdout:(119/120): librados2-17.2.6-1296.g736ac5ba.el8. 8.6 MB/s | 3.5 MB 00:00 2023-10-06T02:44:09.832 INFO:teuthology.orchestra.run.smithi083.stdout:(120/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 9.5 MB/s | 3.6 MB 00:00 2023-10-06T02:44:09.835 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:44:09.835 INFO:teuthology.orchestra.run.smithi083.stdout:Total 17 MB/s | 201 MB 00:11 2023-10-06T02:44:09.882 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2023-10-06T02:44:09.994 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2023-10-06T02:44:09.995 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2023-10-06T02:44:11.743 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2023-10-06T02:44:11.748 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2023-10-06T02:44:13.124 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-10-06T02:44:13.348 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T02:44:13.573 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:44:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:44:13.873 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:44:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:44:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:44:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:44:15.090 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:44:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:44:15.390 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:44:15.514 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:44:15.703 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:44:16.010 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T02:44:16.679 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T02:44:16.686 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2023-10-06T02:44:16.840 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:44:16.924 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T02:44:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:44:17.114 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:44:17.177 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T02:44:17.214 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:44:17.355 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T02:44:17.422 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:44:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:44:17.674 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:44:17.816 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:44:17.842 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:44:17.912 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:44:18.013 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:44:18.094 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T02:44:18.355 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T02:44:18.411 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:44:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T02:44:18.630 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:44:18.743 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:44:18.744 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T02:44:18.864 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:44:18.939 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:44:19.007 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:44:19.037 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:44:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:44:19.243 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:44:19.561 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T02:44:19.708 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:44:19.931 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:44:20.195 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T02:44:20.355 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:44:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:44:20.496 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:44:20.664 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:44:20.725 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T02:44:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:44:21.637 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T02:44:21.676 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T02:44:21.863 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:44:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T02:44:21.964 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:44:22.131 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:44:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T02:44:22.194 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:44:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T02:44:22.387 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T02:44:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T02:44:22.646 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T02:44:22.708 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T02:44:22.895 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T02:44:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T02:44:23.009 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T02:44:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T02:44:23.175 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:44:23.318 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:44:23.372 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:44:23.471 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:44:24.032 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:44:24.221 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:44:24.750 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:44:24.963 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:44:25.488 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:44:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:44:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T02:44:25.925 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T02:44:26.172 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T02:44:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T02:44:26.619 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T02:44:26.748 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T02:44:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T02:44:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T02:44:27.238 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T02:44:27.460 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T02:44:27.461 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T02:44:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T02:44:27.739 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T02:44:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T02:44:27.962 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:44:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T02:44:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T02:44:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T02:44:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T02:44:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T02:44:29.219 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T02:44:29.408 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T02:44:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:44:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:44:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T02:44:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T02:44:30.033 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:44:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T02:44:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T02:44:30.386 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T02:44:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T02:44:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T02:44:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T02:44:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T02:44:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T02:44:31.394 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T02:44:31.521 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T02:44:31.751 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T02:44:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T02:44:32.007 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T02:44:32.059 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T02:44:32.250 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T02:44:32.331 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T02:44:32.456 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T02:44:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T02:44:32.634 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T02:44:32.705 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T02:44:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T02:44:32.893 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T02:44:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T02:44:33.189 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T02:44:33.253 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T02:44:33.394 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T02:44:33.431 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T02:44:33.573 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T02:44:33.610 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T02:44:33.747 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T02:44:33.800 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T02:44:33.974 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T02:44:34.014 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T02:44:34.166 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T02:44:34.186 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:44:34.264 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:44:34.349 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T02:44:34.453 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T02:44:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T02:44:34.623 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T02:44:34.691 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T02:44:34.768 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T02:44:34.941 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T02:44:34.949 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T02:44:35.096 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T02:44:35.134 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T02:44:35.256 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T02:44:35.409 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T02:44:35.431 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T02:44:35.617 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T02:44:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T02:44:35.772 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T02:44:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T02:44:36.075 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T02:44:36.088 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T02:44:36.365 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T02:44:36.602 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T02:44:36.888 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T02:44:37.038 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T02:44:37.248 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T02:44:37.249 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T02:44:37.507 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T02:44:37.544 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T02:44:37.761 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T02:44:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T02:44:37.960 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T02:44:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T02:44:38.168 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T02:44:38.330 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T02:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T02:44:38.536 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T02:44:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T02:44:38.764 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T02:44:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T02:44:38.971 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T02:44:39.121 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T02:44:39.214 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T02:44:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T02:44:39.375 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T02:44:39.607 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T02:44:39.822 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T02:44:40.050 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T02:44:40.322 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T02:44:40.593 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T02:44:40.777 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T02:44:41.041 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T02:44:42.207 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T02:44:42.517 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T02:44:42.771 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T02:44:43.155 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T02:44:43.421 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T02:44:43.759 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T02:44:44.033 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T02:44:44.227 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T02:44:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:44:44.461 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T02:44:44.520 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:44:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:44:45.422 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:44:45.518 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:44:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:44:49.520 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:44:49.760 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:44:50.348 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:44:50.618 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:44:50.709 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:44:50.859 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:45:03.172 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /run 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-10-06T02:45:03.173 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:45:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:45:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:45:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:45:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:45:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:45:06.084 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:45:06.101 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:45:08.612 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:45:08.612 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2023-10-06T02:45:08.612 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2023-10-06T02:45:08.612 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2023-10-06T02:45:08.613 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /run 2023-10-06T02:45:08.613 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2023-10-06T02:45:08.613 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2023-10-06T02:45:08.613 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2023-10-06T02:45:08.613 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2023-10-06T02:45:08.613 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2023-10-06T02:45:08.613 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:45:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:45:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:45:09.156 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T02:45:09.334 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T02:45:09.521 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:45:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:45:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:45:10.504 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:45:10.657 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:45:10.880 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:45:10.937 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:45:11.007 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:45:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:45:11.191 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:45:11.409 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:45:11.573 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:45:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T02:45:11.591 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:45:11.794 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:45:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:45:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:45:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:45:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T02:45:13.860 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:45:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:45:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:45:14.142 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:45:14.282 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:45:14.529 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:45:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:45:14.651 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:45:14.791 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:45:14.871 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T02:45:15.057 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T02:45:15.292 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:45:15.509 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:45:15.764 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:45:16.734 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:45:16.906 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:45:17.005 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:45:17.403 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T02:45:17.598 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:45:17.636 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:45:17.772 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:45:17.783 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:45:19.366 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T02:45:19.573 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:45:19.648 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:45:19.735 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:45:19.839 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:45:19.883 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:45:20.030 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:45:20.378 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:45:20.547 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:45:20.703 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T02:45:21.075 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T02:45:21.266 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T02:45:21.519 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T02:45:21.681 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:45:21.693 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:45:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T02:45:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T02:45:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T02:45:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T02:45:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T02:45:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:45:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:45:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:45:23.007 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:45:23.158 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T02:45:23.158 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:45:23.359 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:45:23.359 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:45:24.162 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:45:24.162 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T02:45:24.162 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T02:45:24.162 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T02:45:24.163 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T02:45:24.164 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T02:45:24.165 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T02:45:24.165 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T02:45:24.175 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T02:45:24.176 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T02:45:24.177 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T02:45:24.178 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T02:45:24.179 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T02:45:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T02:45:24.181 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T02:45:24.182 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T02:45:24.183 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T02:45:25.442 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:45:26.307 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:45:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:39 ago on Fri 06 Oct 2023 02:43:47 AM UTC. 2023-10-06T02:45:26.401 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T02:45:26.786 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T02:45:26.949 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T02:45:27.199 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T02:45:27.354 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:45:27.366 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:45:27.567 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T02:45:27.709 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T02:45:27.895 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T02:45:28.078 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T02:45:28.282 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T02:45:28.308 INFO:teuthology.orchestra.run.smithi081.stdout:Installed products updated. 2023-10-06T02:45:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:28.456 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-10-06T02:45:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.456 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2023-10-06T02:45:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T02:45:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T02:45:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T02:45:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: jq-1.5-12.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T02:45:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T02:45:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T02:45:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T02:45:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T02:45:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T02:45:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T02:45:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T02:45:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T02:45:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T02:45:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T02:45:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T02:45:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T02:45:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T02:45:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T02:45:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-10-06T02:45:28.479 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:45:28.536 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:45:28.703 DEBUG:teuthology.parallel:result is None 2023-10-06T02:45:28.704 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:45:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:45:28.831 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T02:45:28.831 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:45:29.032 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:45:29.032 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:45:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:45:29.905 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T02:45:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T02:45:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T02:45:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:45:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T02:45:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:45:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:45:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T02:45:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T02:45:29.906 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T02:45:29.907 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T02:45:29.908 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T02:45:29.908 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T02:45:29.908 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T02:45:29.908 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T02:45:29.917 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T02:45:29.917 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T02:45:29.917 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T02:45:29.917 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T02:45:29.917 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T02:45:29.918 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T02:45:29.919 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T02:45:29.920 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T02:45:29.921 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T02:45:29.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T02:45:29.923 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T02:45:29.924 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T02:45:29.925 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T02:45:32.074 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:45:32.075 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:01:43 ago on Fri 06 Oct 2023 02:43:49 AM UTC. 2023-10-06T02:45:34.180 INFO:teuthology.orchestra.run.smithi083.stdout:Installed products updated. 2023-10-06T02:45:34.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:34.366 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2023-10-06T02:45:34.366 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.367 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.368 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: jq-1.5-12.el8.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T02:45:34.369 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T02:45:34.370 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T02:45:34.371 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T02:45:34.372 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T02:45:34.373 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T02:45:34.374 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T02:45:34.375 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T02:45:34.376 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T02:45:34.377 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T02:45:34.377 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:34.377 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2023-10-06T02:45:34.626 DEBUG:teuthology.parallel:result is None 2023-10-06T02:45:34.626 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:45:34.773 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T02:45:34.798 INFO:teuthology.orchestra.run.smithi081.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T02:45:34.799 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T02:45:34.799 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T02:45:34.799 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:45:34.943 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T02:45:34.965 INFO:teuthology.orchestra.run.smithi083.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T02:45:34.965 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T02:45:34.966 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T02:45:34.966 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T02:45:34.966 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:34.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:45:35.009 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:35.009 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:45:35.048 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T02:45:35.048 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:35.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:45:35.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:45:35.142 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:35.143 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:45:35.167 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:45:35.230 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T02:45:35.231 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:35.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:45:35.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:45:35.319 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:35.320 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:45:35.344 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:45:35.407 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T02:45:35.408 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:35.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:45:35.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:45:35.496 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:35.496 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:45:35.519 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:45:35.583 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T02:45:35.647 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T02:45:35.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-10-06T02:45:35.649 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2023-10-06T02:45:35.674 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T02:45:35.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:45:35.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:45:35.738 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T02:45:35.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:45:35.777 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:45:35.809 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T02:45:35.809 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T02:45:35.809 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T02:45:35.809 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:35.809 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:45:35.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:45:35.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T02:45:35.989 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:35.989 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:45:36.003 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:45:36.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T02:45:36.144 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T02:45:36.144 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T02:45:36.144 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412158', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFlKdK7qoQ2CKEE+CuhcMFy+Xxfkz4PKl/phQ80HO8UrRf8lRDywwt+Bhb7yX4dA+s1wfKZXinWKrmvqZqlMRSA=', 'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH6svpMLhYavZsbuLf8eljcztSr4b5/qwmdDaLAog34OCT3/g0G+98OLkPA7efPG+KUqzwQSo5GY11ojrcqxQa4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T02:45:36.145 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:45:36.147 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:45:36.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:45:36.202 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:45:36.258 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:36.258 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:45:36.279 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:45:36.279 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2023-10-06T02:45:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:45:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:45:36.334 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 218649 Links: 1 2023-10-06T02:45:36.334 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:45:36.334 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:45:36.334 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-06 02:45:23.798615304 +0000 2023-10-06T02:45:36.334 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-06 02:43:03.530379036 +0000 2023-10-06T02:45:36.334 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-06 02:43:03.530379036 +0000 2023-10-06T02:45:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-06T02:45:36.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:45:36.396 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-06T02:45:36.397 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-06T02:45:36.397 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000228882 s, 2.2 MB/s 2023-10-06T02:45:36.398 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:45:36.453 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2023-10-06T02:45:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:45:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:45:36.509 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 219324 Links: 1 2023-10-06T02:45:36.509 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:45:36.509 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:45:36.509 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-06 02:45:23.798615304 +0000 2023-10-06T02:45:36.509 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-06 02:43:04.033369677 +0000 2023-10-06T02:45:36.509 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-06 02:43:04.033369677 +0000 2023-10-06T02:45:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-06T02:45:36.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:45:36.571 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-06T02:45:36.571 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-06T02:45:36.571 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000220297 s, 2.3 MB/s 2023-10-06T02:45:36.572 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:45:36.628 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2023-10-06T02:45:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:45:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:45:36.683 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 222539 Links: 1 2023-10-06T02:45:36.683 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:45:36.683 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:45:36.683 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-06 02:45:23.798615304 +0000 2023-10-06T02:45:36.683 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-06 02:43:04.531360412 +0000 2023-10-06T02:45:36.684 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-06 02:43:04.531360412 +0000 2023-10-06T02:45:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-06T02:45:36.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:45:36.745 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-06T02:45:36.746 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-06T02:45:36.746 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000251746 s, 2.0 MB/s 2023-10-06T02:45:36.747 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:45:36.802 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2023-10-06T02:45:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:45:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:45:36.858 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 222637 Links: 1 2023-10-06T02:45:36.858 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:45:36.858 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-06 02:45:23.798615304 +0000 2023-10-06T02:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-06 02:43:05.023351258 +0000 2023-10-06T02:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-06 02:43:05.023351258 +0000 2023-10-06T02:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-06T02:45:36.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:45:36.921 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-06T02:45:36.921 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-06T02:45:36.921 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000198357 s, 2.6 MB/s 2023-10-06T02:45:36.922 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:45:36.977 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:36.978 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:36.978 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:45:36.993 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:45:36.994 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2023-10-06T02:45:37.049 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:45:37.049 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:45:37.050 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 219559 Links: 1 2023-10-06T02:45:37.050 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:45:37.050 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:45:37.050 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 02:45:29.516664952 +0000 2023-10-06T02:45:37.050 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 02:43:04.407199093 +0000 2023-10-06T02:45:37.050 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 02:43:04.407199093 +0000 2023-10-06T02:45:37.050 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T02:45:37.050 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:45:37.113 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T02:45:37.113 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T02:45:37.113 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000255169 s, 2.0 MB/s 2023-10-06T02:45:37.114 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:45:37.171 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2023-10-06T02:45:37.227 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:45:37.227 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:45:37.227 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 221419 Links: 1 2023-10-06T02:45:37.227 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:45:37.227 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:45:37.227 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 02:45:29.516664952 +0000 2023-10-06T02:45:37.227 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 02:43:04.916187147 +0000 2023-10-06T02:45:37.228 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 02:43:04.916187147 +0000 2023-10-06T02:45:37.228 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T02:45:37.228 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:45:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T02:45:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T02:45:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000230797 s, 2.2 MB/s 2023-10-06T02:45:37.291 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:45:37.348 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2023-10-06T02:45:37.402 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:45:37.403 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:45:37.403 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 219762 Links: 1 2023-10-06T02:45:37.403 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:45:37.403 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:45:37.403 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 02:45:29.516664952 +0000 2023-10-06T02:45:37.403 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 02:43:05.416175413 +0000 2023-10-06T02:45:37.403 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 02:43:05.416175413 +0000 2023-10-06T02:45:37.403 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T02:45:37.403 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:45:37.465 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T02:45:37.466 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T02:45:37.466 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000293239 s, 1.7 MB/s 2023-10-06T02:45:37.467 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:45:37.522 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2023-10-06T02:45:37.577 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:45:37.578 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:45:37.578 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 218864 Links: 1 2023-10-06T02:45:37.578 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:45:37.578 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:45:37.578 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 02:45:29.516664952 +0000 2023-10-06T02:45:37.578 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 02:43:05.909163842 +0000 2023-10-06T02:45:37.578 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 02:43:05.909163842 +0000 2023-10-06T02:45:37.578 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T02:45:37.578 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:45:37.640 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T02:45:37.640 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T02:45:37.641 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000172196 s, 3.0 MB/s 2023-10-06T02:45:37.641 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:45:37.697 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:37.697 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:45:37.697 INFO:tasks.ceph:Generating config... 2023-10-06T02:45:37.698 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T02:45:37.698 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client] pid file = 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client.0] debug client = 20 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client.1] debug client = 20 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-10-06T02:45:37.699 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-10-06T02:45:37.699 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T02:45:37.699 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T02:45:37.700 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T02:45:37.701 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T02:45:37.701 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-10-06T02:45:37.701 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-10-06T02:45:37.701 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-10-06T02:45:37.701 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T02:45:37.701 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T02:45:37.701 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T02:45:37.701 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T02:45:37.701 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T02:45:37.701 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T02:45:37.701 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T02:45:37.701 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T02:45:37.701 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T02:45:37.702 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T02:45:37.702 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-10-06T02:45:37.702 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T02:45:37.702 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T02:45:37.702 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T02:45:37.702 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-10-06T02:45:37.702 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-10-06T02:45:37.702 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-10-06T02:45:37.702 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T02:45:37.703 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T02:45:37.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T02:45:37.747 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T02:45:37.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T02:45:37.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:45:37.896 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.83'), ('mon.c', '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]')] 2023-10-06T02:45:37.897 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T02:45:37.898 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:37.898 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:45:37.951 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.83 --addv c '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:38.033 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:38.033 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 072ce422-278f-434c-8814-5b3ff2abcdfb 2023-10-06T02:45:38.033 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = octopus 2023-10-06T02:45:38.034 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2023-10-06T02:45:38.034 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 072ce422-278f-434c-8814-5b3ff2abcdfb 2023-10-06T02:45:38.034 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2023-10-06T02:45:38.032903+0000 2023-10-06T02:45:38.034 INFO:teuthology.orchestra.run.smithi081.stdout:created 2023-10-06T02:45:38.032903+0000 2023-10-06T02:45:38.034 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 15 (octopus) 2023-10-06T02:45:38.034 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2023-10-06T02:45:38.034 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2023-10-06T02:45:38.034 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.b 2023-10-06T02:45:38.034 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2023-10-06T02:45:38.035 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T02:45:38.036 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:45:38.090 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 072ce422-278f-434c-8814-5b3ff2abcdfb... 2023-10-06T02:45:38.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:45:38.133 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:45:38.173 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-10-06T02:45:38.173 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-10-06T02:45:38.173 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.174 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:45:38.176 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on skipped message = False 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 072ce422-278f-434c-8814-5b3ff2abcdfb 2023-10-06T02:45:38.177 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-10-06T02:45:38.178 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.179 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T02:45:38.180 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: memstore device bytes = 200000000 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 1.0 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: osd mon report interval = 5 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = memstore 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-10-06T02:45:38.181 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-10-06T02:45:38.182 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:45:38.183 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2023-10-06T02:45:38.184 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull ratio = 0.6 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.7 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.6 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T02:45:38.185 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-10-06T02:45:38.186 INFO:teuthology.orchestra.run.smithi081.stdout: debug objectcacher = 20 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout: debug objecter = 20 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout: debug objectcacher = 20 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout: debug objecter = 20 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2023-10-06T02:45:38.187 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2023-10-06T02:45:38.188 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2023-10-06T02:45:38.188 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2023-10-06T02:45:38.188 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-10-06T02:45:38.188 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-10-06T02:45:38.188 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-10-06T02:45:38.189 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2023-10-06T02:45:38.189 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2023-10-06T02:45:38.190 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:45:38.190 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2023-10-06T02:45:38.190 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.190 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2023-10-06T02:45:38.190 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.190 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2023-10-06T02:45:38.190 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.190 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2023-10-06T02:45:38.191 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2023-10-06T02:45:38.191 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.191 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2023-10-06T02:45:38.192 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2023-10-06T02:45:38.192 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.192 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:45:38.192 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2023-10-06T02:45:38.192 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.192 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:45:38.192 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:45:38.192 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:45:38.193 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2023-10-06T02:45:38.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.194 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:45:38.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.194 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2023-10-06T02:45:38.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.194 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.81,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on skipped message = False 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = 072ce422-278f-434c-8814-5b3ff2abcdfb 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2023-10-06T02:45:38.195 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2023-10-06T02:45:38.196 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: bdev async discard = True 2023-10-06T02:45:38.197 INFO:teuthology.orchestra.run.smithi083.stdout: bdev enable discard = True 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore allocator = bitmap 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 1/20 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 1/20 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 4/10 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: memstore device bytes = 200000000 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2023-10-06T02:45:38.198 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 1.0 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: osd mon report interval = 5 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = memstore 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:45:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2023-10-06T02:45:38.200 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.201 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: mon op complaint time = 120 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull ratio = 0.6 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.7 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.6 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = true 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:45:38.202 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout: client mount timeout = 600 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = "" 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-10-06T02:45:38.203 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout: debug objectcacher = 20 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout: debug objecter = 20 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout: debug objectcacher = 20 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout: debug objecter = 20 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout:[mds] 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds = 20 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T02:45:38.204 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug frag = True 2023-10-06T02:45:38.205 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug scatterstat = True 2023-10-06T02:45:38.205 INFO:teuthology.orchestra.run.smithi083.stdout: mds op complaint time = 180 2023-10-06T02:45:38.205 INFO:teuthology.orchestra.run.smithi083.stdout: mds verify scatter = True 2023-10-06T02:45:38.205 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-10-06T02:45:38.205 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-10-06T02:45:38.205 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-10-06T02:45:38.205 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T02:45:38.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T02:45:38.428 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T02:45:38.428 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:38.428 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T02:45:38.442 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:38.443 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T02:45:38.497 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:45:38.497 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:38.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:45:38.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:45:38.613 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:38.613 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:38.688 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:45:38.688 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:38.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:45:38.689 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:45:38.724 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:38.724 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:38.779 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T02:45:38.779 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T02:45:38.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:45:38.827 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:45:38.829 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:45:38.885 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:45:38.887 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T02:45:38.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:45:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:45:38.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T02:45:38.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:45:39.047 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:45:39.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T02:45:39.074 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:45:39.122 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:45:39.124 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T02:45:39.148 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:45:39.235 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:45:39.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T02:45:39.263 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T02:45:39.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T02:45:39.300 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T02:45:39.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T02:45:39.390 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T02:45:39.402 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T02:45:39.440 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T02:45:39.453 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T02:45:39.530 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T02:45:39.543 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T02:45:39.543 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:45:39.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T02:45:39.568 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:39.568 INFO:tasks.ceph:role: osd.0 2023-10-06T02:45:39.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:45:39.568 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:45:39.639 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:45:39.639 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:45:39.639 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:45:39.640 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-06T02:45:39.640 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:45:39.640 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:45:39.640 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:45:39.640 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:45:39.640 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:45:39.640 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:45:40.085 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-06T02:45:40.087 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-06T02:45:40.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T02:45:40.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T02:45:40.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T02:45:40.323 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:40.323 INFO:tasks.ceph:role: osd.1 2023-10-06T02:45:40.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:45:40.323 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:45:40.394 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:45:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:45:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:45:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-06T02:45:40.395 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:45:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:45:40.395 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:45:40.395 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:45:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:45:40.395 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:45:40.820 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-06T02:45:40.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-06T02:45:40.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T02:45:40.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T02:45:40.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T02:45:41.037 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:41.037 INFO:tasks.ceph:role: osd.2 2023-10-06T02:45:41.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:45:41.038 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:45:41.109 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:45:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:45:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:45:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-06T02:45:41.109 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:45:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:45:41.109 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:45:41.110 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:45:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:45:41.110 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:45:41.555 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-06T02:45:41.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-06T02:45:41.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T02:45:41.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T02:45:41.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T02:45:41.763 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:41.763 INFO:tasks.ceph:role: osd.3 2023-10-06T02:45:41.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:45:41.763 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:45:41.835 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:45:42.280 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-06T02:45:42.282 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-06T02:45:42.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T02:45:42.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T02:45:42.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:42.552+0000 7fd8c75a4540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T02:45:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:42.555+0000 7fd8c75a4540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T02:45:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:42.556+0000 7fd8c75a4540 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-10-06T02:45:42.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T02:45:42.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:42.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:42.678+0000 7f4cf1aad540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T02:45:42.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:42.680+0000 7f4cf1aad540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T02:45:42.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:42.687+0000 7f4cf1aad540 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-10-06T02:45:42.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T02:45:42.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:42.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:42.845+0000 7eff4e3e8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T02:45:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:42.847+0000 7eff4e3e8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T02:45:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:42.854+0000 7eff4e3e8540 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-10-06T02:45:42.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T02:45:42.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:43.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:43.013+0000 7faef3dea540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T02:45:43.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:43.014+0000 7faef3dea540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T02:45:43.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:43.015+0000 7faef3dea540 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-10-06T02:45:43.021 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T02:45:43.087 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T02:45:43.115 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:43.115 INFO:tasks.ceph:role: osd.4 2023-10-06T02:45:43.115 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:45:43.115 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:45:43.190 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:45:43.190 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:45:43.190 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:45:43.190 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T02:45:43.190 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:45:43.190 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:45:43.190 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:45:43.190 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:45:43.191 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:45:43.191 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:45:43.624 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T02:45:43.626 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T02:45:43.626 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T02:45:43.779 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T02:45:43.813 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T02:45:43.879 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:43.879 INFO:tasks.ceph:role: osd.5 2023-10-06T02:45:43.880 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:45:43.880 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:45:43.953 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:45:43.953 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:45:43.954 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:45:43.954 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T02:45:43.954 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:45:43.954 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:45:43.954 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:45:43.954 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:45:43.954 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:45:43.954 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:45:44.379 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T02:45:44.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T02:45:44.382 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T02:45:44.484 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T02:45:44.515 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T02:45:44.582 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:44.583 INFO:tasks.ceph:role: osd.6 2023-10-06T02:45:44.583 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:45:44.583 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:45:44.656 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:45:44.656 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:45:44.656 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:45:44.656 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T02:45:44.656 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:45:44.656 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:45:44.656 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:45:44.656 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:45:44.657 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:45:44.657 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:45:45.100 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T02:45:45.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T02:45:45.102 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T02:45:45.278 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T02:45:45.308 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T02:45:45.373 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:45:45.373 INFO:tasks.ceph:role: osd.7 2023-10-06T02:45:45.373 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:45:45.373 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:45:45.445 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:45:45.445 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:45:45.445 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:45:45.445 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T02:45:45.445 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:45:45.445 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:45:45.445 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:45:45.445 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:45:45.446 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:45:45.446 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:45:45.877 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T02:45:45.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T02:45:45.879 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T02:45:46.041 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T02:45:46.074 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:46.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.172+0000 7f8b1edb8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T02:45:46.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.172+0000 7f8b1edb8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T02:45:46.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.172+0000 7f8b1edb8540 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-10-06T02:45:46.182 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T02:45:46.206 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:46.286 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.285+0000 7feaa10ac540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T02:45:46.286 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.285+0000 7feaa10ac540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T02:45:46.287 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.286+0000 7feaa10ac540 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-10-06T02:45:46.292 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T02:45:46.357 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:46.437 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.436+0000 7fd4a5c58540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T02:45:46.438 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.437+0000 7fd4a5c58540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T02:45:46.438 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.437+0000 7fd4a5c58540 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-10-06T02:45:46.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T02:45:46.510 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:46.589 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.588+0000 7fe75509d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T02:45:46.589 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.588+0000 7fe75509d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T02:45:46.590 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:46.589+0000 7fe75509d540 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-10-06T02:45:46.595 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T02:45:46.660 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T02:45:46.660 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:46.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T02:45:46.690 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:46.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T02:45:46.758 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:46.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T02:45:46.825 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:46.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T02:45:46.893 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:46.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T02:45:46.959 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:46.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T02:45:47.023 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:47.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T02:45:47.088 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:47.088 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T02:45:47.112 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:47.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T02:45:47.177 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:47.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T02:45:47.240 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:47.241 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T02:45:47.305 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:47.305 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T02:45:47.369 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:47.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T02:45:47.433 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:47.433 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T02:45:47.496 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:47.496 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T02:45:47.511 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:47.511 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T02:45:47.566 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:47.566 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T02:45:47.581 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:47.581 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T02:45:47.635 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T02:45:47.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:45:47.638 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:45:47.678 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA== 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw== 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ== 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g== 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q== 2023-10-06T02:45:47.679 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA== 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA== 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg== 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg== 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw== 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ== 2023-10-06T02:45:47.680 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ== 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw== 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg== 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ== 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg== 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2023-10-06T02:45:47.681 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw== 2023-10-06T02:45:47.682 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2023-10-06T02:45:47.682 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog== 2023-10-06T02:45:47.698 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2023-10-06T02:45:47.698 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA== 2023-10-06T02:45:47.698 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-10-06T02:45:47.698 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw== 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ== 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g== 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q== 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA== 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA== 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2023-10-06T02:45:47.699 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg== 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg== 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw== 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ== 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ== 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw== 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2023-10-06T02:45:47.700 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg== 2023-10-06T02:45:47.701 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2023-10-06T02:45:47.701 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ== 2023-10-06T02:45:47.701 INFO:teuthology.orchestra.run.smithi083.stdout:[client.2] 2023-10-06T02:45:47.701 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg== 2023-10-06T02:45:47.701 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2023-10-06T02:45:47.701 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw== 2023-10-06T02:45:47.701 INFO:teuthology.orchestra.run.smithi083.stdout:[client.3] 2023-10-06T02:45:47.701 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog== 2023-10-06T02:45:47.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:45:47.725 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:45:47.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:45:47.793 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:45:47.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:45:47.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:45:47.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:47.897 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:47.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:47.946 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:47.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:47.995 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.081 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:45:48.130 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:45:48.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:45:48.180 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:45:48.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:45:48.232 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:45:48.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.285 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.334 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.384 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.433 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:45:48.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:45:48.482 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:45:48.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:45:48.534 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:45:48.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:45:48.586 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:45:48.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:45:48.640 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:45:48.690 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T02:45:48.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T02:45:48.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:45:48.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T02:45:48.830 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T02:45:48.856 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:45:48.948 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T02:45:48.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T02:45:49.037 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:45:49.179 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T02:45:49.203 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:49.205 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:45:49.258 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T02:45:49.258 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T02:45:49.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T02:45:49.262 INFO:tasks.ceph.mon.a:Started 2023-10-06T02:45:49.262 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T02:45:49.262 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T02:45:49.301 INFO:tasks.ceph.mon.b:Started 2023-10-06T02:45:49.301 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T02:45:49.301 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T02:45:49.304 INFO:tasks.ceph.mon.c:Started 2023-10-06T02:45:49.304 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T02:45:49.304 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T02:45:49.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T02:45:49.306 INFO:tasks.ceph.mgr.y:Started 2023-10-06T02:45:49.306 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T02:45:49.306 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T02:45:49.308 INFO:tasks.ceph.mgr.x:Started 2023-10-06T02:45:49.308 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T02:45:49.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T02:45:49.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.422+0000 7f5afb2f5700 1 Processor -- start 2023-10-06T02:45:49.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.422+0000 7f5afb2f5700 1 -- start start 2023-10-06T02:45:49.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.423+0000 7f5afb2f5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 0x7f5af40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:49.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.423+0000 7f5afb2f5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5af406d650 0x7f5af406da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:49.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.423+0000 7f5afb2f5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af40b0ca0 con 0x7f5af415a2a0 2023-10-06T02:45:49.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.423+0000 7f5afb2f5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af406ea90 con 0x7f5af406d650 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.423+0000 7f5afb2f5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b00d0 con 0x7f5af40cf240 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.423+0000 7f5af9091700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5af415a2a0 0x7f5af40ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41658/0 (socket says 172.21.15.81:41658) 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.423+0000 7f5af9091700 1 -- 172.21.15.81:0/518916922 learned_addr learned my addr 172.21.15.81:0/518916922 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.423+0000 7f5af8890700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 0x7f5af40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.423+0000 7f5af9892700 1 --2- 172.21.15.81:0/518916922 >> v2:172.21.15.83:3300/0 conn(0x7f5af406d650 0x7f5af406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.424+0000 7f5af8890700 1 -- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 msgr2=0x7f5af40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.424+0000 7f5af8890700 1 -- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 msgr2=0x7f5af40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.424+0000 7f5af8890700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 0x7f5af40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.424+0000 7f5af8890700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 0x7f5af40b1130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.424+0000 7f5af9892700 1 -- 172.21.15.81:0/518916922 >> v2:172.21.15.83:3300/0 conn(0x7f5af406d650 msgr2=0x7f5af406da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T02:45:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.424+0000 7f5af9892700 1 -- 172.21.15.81:0/518916922 >> v2:172.21.15.83:3300/0 conn(0x7f5af406d650 msgr2=0x7f5af406da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:45:49.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.424+0000 7f5af9892700 1 --2- 172.21.15.81:0/518916922 >> v2:172.21.15.83:3300/0 conn(0x7f5af406d650 0x7f5af406da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:45:49.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.424+0000 7f5af9892700 1 --2- 172.21.15.81:0/518916922 >> v2:172.21.15.83:3300/0 conn(0x7f5af406d650 0x7f5af406da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:45:49.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.606+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792981952 0 0) 0x7f5af40b0ca0 con 0x7f5af415a2a0 2023-10-06T02:45:49.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae0003570 con 0x7f5af415a2a0 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1320296872 0 0) 0x7f5ae0003570 con 0x7f5af415a2a0 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 msgr2=0x7f5af40b1130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 0x7f5af40b1130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 >> v2:172.21.15.83:3300/0 conn(0x7f5af406d650 msgr2=0x7f5af406da90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 --2- 172.21.15.81:0/518916922 >> v2:172.21.15.83:3300/0 conn(0x7f5af406d650 0x7f5af406da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40b0370 con 0x7f5af415a2a0 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f5ae8001470 con 0x7f5af415a2a0 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 >> v1:172.21.15.81:6789/0 conn(0x7f5af415a2a0 legacy=0x7f5af40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae0003a60 0x7f5ae0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.607+0000 7f5ae7fff700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ae0004810 0x7f5ae0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5ae7fff700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 0x7f5ae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af406ea90 con 0x7f5ae0003a60 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b00d0 con 0x7f5ae0004810 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae000bbc0 con 0x7f5af40cf240 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af9091700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae0003a60 0x7f5ae0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af8890700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ae0004810 0x7f5ae0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af9892700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 0x7f5ae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af9091700 1 -- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 msgr2=0x7f5ae00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af9091700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5af40cf240 0x7f5ae00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af9091700 1 -- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ae0004810 msgr2=0x7f5ae0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af9091700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ae0004810 0x7f5ae0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af9091700 1 -- 172.21.15.81:0/518916922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae0003570 con 0x7f5ae0003a60 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af8890700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ae0004810 0x7f5ae0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:45:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.608+0000 7f5af9091700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae0003a60 0x7f5ae0003e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c3c0 tx=0x7f5ae8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9750a6568270bf42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800cc90 con 0x7f5ae0003a60 2023-10-06T02:45:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae800ce10 con 0x7f5ae0003a60 2023-10-06T02:45:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5ae7fff700 1 -- 172.21.15.81:0/518916922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8005b70 con 0x7f5ae0003a60 2023-10-06T02:45:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5afb2f5700 1 -- 172.21.15.81:0/518916922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae0003a60 msgr2=0x7f5ae0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5afb2f5700 1 --2- 172.21.15.81:0/518916922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae0003a60 0x7f5ae0003e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c3c0 tx=0x7f5ae8001e90 comp rx=0 tx=0).stop 2023-10-06T02:45:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5af9892700 1 -- 172.21.15.81:0/518916922 reap_dead start 2023-10-06T02:45:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5afb2f5700 1 -- 172.21.15.81:0/518916922 shutdown_connections 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5afb2f5700 1 -- 172.21.15.81:0/518916922 >> 172.21.15.81:0/518916922 conn(0x7f5af4067640 msgr2=0x7f5af4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5afb2f5700 1 -- 172.21.15.81:0/518916922 shutdown_connections 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.610+0000 7f5afb2f5700 1 -- 172.21.15.81:0/518916922 wait complete. 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.612+0000 7f5afb2f5700 1 Processor -- start 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.612+0000 7f5afb2f5700 1 -- start start 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5afb2f5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ae0003a60 0x7f5af40b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5afb2f5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5af4155be0 0x7f5af415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5afb2f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af415ed00 0x7f5af416a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5afb2f5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af416b650 con 0x7f5af415ed00 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5afb2f5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af415f170 con 0x7f5af4155be0 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5afb2f5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b3240 con 0x7f5ae0003a60 2023-10-06T02:45:49.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9091700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ae0003a60 0x7f5af40b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9892700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af415ed00 0x7f5af416a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9091700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ae0003a60 0x7f5af40b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:55218/0 (socket says 172.21.15.81:55218) 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af8890700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5af4155be0 0x7f5af415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9892700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af415ed00 0x7f5af416a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49234/0 (socket says 172.21.15.81:49234) 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9091700 1 -- 172.21.15.81:0/961211234 learned_addr learned my addr 172.21.15.81:0/961211234 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9892700 1 -- 172.21.15.81:0/961211234 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ae0003a60 msgr2=0x7f5af40b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9892700 1 --2- 172.21.15.81:0/961211234 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ae0003a60 0x7f5af40b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9892700 1 -- 172.21.15.81:0/961211234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5af4155be0 msgr2=0x7f5af415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9892700 1 --2- 172.21.15.81:0/961211234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5af4155be0 0x7f5af415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9892700 1 -- 172.21.15.81:0/961211234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af416b370 con 0x7f5af415ed00 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9892700 1 --2- 172.21.15.81:0/961211234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af415ed00 0x7f5af416a600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5af406f9c0 tx=0x7f5aec009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:49.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.613+0000 7f5af9091700 1 --2- 172.21.15.81:0/961211234 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ae0003a60 0x7f5af40b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:49.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.614+0000 7f5ae57fa700 1 -- 172.21.15.81:0/961211234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec007e70 con 0x7f5af415ed00 2023-10-06T02:45:49.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.614+0000 7f5ae57fa700 1 -- 172.21.15.81:0/961211234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec00f050 con 0x7f5af415ed00 2023-10-06T02:45:49.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.614+0000 7f5afb2f5700 1 -- 172.21.15.81:0/961211234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af40b2bf0 con 0x7f5af415ed00 2023-10-06T02:45:49.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.614+0000 7f5ae57fa700 1 -- 172.21.15.81:0/961211234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec002e60 con 0x7f5af415ed00 2023-10-06T02:45:49.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.614+0000 7f5afb2f5700 1 -- 172.21.15.81:0/961211234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af416ab40 con 0x7f5af415ed00 2023-10-06T02:45:49.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.614+0000 7f5ae57fa700 1 -- 172.21.15.81:0/961211234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5aec003040 con 0x7f5af415ed00 2023-10-06T02:45:49.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.615+0000 7f5afb2f5700 1 -- 172.21.15.81:0/961211234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af4069e40 con 0x7f5af415ed00 2023-10-06T02:45:49.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.615+0000 7f5ae57fa700 1 -- 172.21.15.81:0/961211234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5aec014620 con 0x7f5af415ed00 2023-10-06T02:45:49.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.617+0000 7f5ae57fa700 1 -- 172.21.15.81:0/961211234 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5aec027480 con 0x7f5af415ed00 2023-10-06T02:45:49.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.691+0000 7f5afb2f5700 1 -- 172.21.15.81:0/961211234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5af40b4100 con 0x7f5af415ed00 2023-10-06T02:45:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.694+0000 7f5ae57fa700 1 -- 172.21.15.81:0/961211234 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5aec027620 con 0x7f5af415ed00 2023-10-06T02:45:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.695+0000 7f5afb2f5700 1 -- 172.21.15.81:0/961211234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af415ed00 msgr2=0x7f5af416a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.695+0000 7f5afb2f5700 1 --2- 172.21.15.81:0/961211234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af415ed00 0x7f5af416a600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5af406f9c0 tx=0x7f5aec009890 comp rx=0 tx=0).stop 2023-10-06T02:45:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.695+0000 7f5afb2f5700 1 -- 172.21.15.81:0/961211234 shutdown_connections 2023-10-06T02:45:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.696+0000 7f5afb2f5700 1 --2- 172.21.15.81:0/961211234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af415ed00 0x7f5af416a600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.696+0000 7f5afb2f5700 1 --2- 172.21.15.81:0/961211234 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ae0003a60 0x7f5af40b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.696+0000 7f5afb2f5700 1 --2- 172.21.15.81:0/961211234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5af4155be0 0x7f5af415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.696+0000 7f5afb2f5700 1 -- 172.21.15.81:0/961211234 >> 172.21.15.81:0/961211234 conn(0x7f5af4067640 msgr2=0x7f5af40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.696+0000 7f5afb2f5700 1 -- 172.21.15.81:0/961211234 shutdown_connections 2023-10-06T02:45:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:49.696+0000 7f5afb2f5700 1 -- 172.21.15.81:0/961211234 wait complete. 2023-10-06T02:45:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2023-10-06T02:45:49.708 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T02:45:49.709 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:49.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T02:45:49.733 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:49.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T02:45:49.797 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:49.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T02:45:49.861 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T02:45:49.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T02:45:49.926 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:49.926 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T02:45:49.950 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:49.951 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T02:45:50.018 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:50.018 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T02:45:50.082 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T02:45:50.082 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T02:45:50.147 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-10-06T02:45:50.299 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.298+0000 7f06a6e1a700 1 Processor -- start 2023-10-06T02:45:50.299 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.298+0000 7f06a6e1a700 1 -- start start 2023-10-06T02:45:50.301 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6e1a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f06a00d0f50 0x7f06a006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.302 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6e1a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.302 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6e1a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a006d990 con 0x7f06a00d0b80 2023-10-06T02:45:50.302 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6e1a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a015a690 con 0x7f06a00d0f50 2023-10-06T02:45:50.302 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6e1a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a00cf2d0 con 0x7f06a006d530 2023-10-06T02:45:50.302 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a5617700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f06a00d0f50 0x7f06a006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.302 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6619700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.302 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a5617700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f06a00d0f50 0x7f06a006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37266/0 (socket says 172.21.15.83:37266) 2023-10-06T02:45:50.302 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a5617700 1 -- 172.21.15.83:0/182144127 learned_addr learned my addr 172.21.15.83:0/182144127 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6619700 1 --2- 172.21.15.83:0/182144127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:48160/0 (socket says 172.21.15.83:48160) 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6619700 1 -- 172.21.15.83:0/182144127 >> v2:172.21.15.83:3300/0 conn(0x7f06a00d0f50 msgr2=0x7f06a006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6619700 1 --2- 172.21.15.83:0/182144127 >> v2:172.21.15.83:3300/0 conn(0x7f06a00d0f50 0x7f06a006cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6619700 1 -- 172.21.15.83:0/182144127 >> v1:172.21.15.83:6789/0 conn(0x7f06a00d0b80 legacy=0x7f06a00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a6619700 1 -- 172.21.15.83:0/182144127 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a00d0480 con 0x7f06a006d530 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a4e16700 1 -- 172.21.15.83:0/182144127 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768371953 0 0) 0x7f06a006d990 con 0x7f06a00d0b80 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.299+0000 7f06a5617700 1 --2- 172.21.15.83:0/182144127 >> v2:172.21.15.83:3300/0 conn(0x7f06a00d0f50 0x7f06a006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a6619700 1 --2- 172.21.15.83:0/182144127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a015b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0698009e60 tx=0x7f0698009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d90bedcdd82696ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a4e16700 1 -- 172.21.15.83:0/182144127 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069800e070 con 0x7f06a006d530 2023-10-06T02:45:50.303 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a4e16700 1 -- 172.21.15.83:0/182144127 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069800bb60 con 0x7f06a006d530 2023-10-06T02:45:50.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a4e16700 1 -- 172.21.15.83:0/182144127 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698012430 con 0x7f06a006d530 2023-10-06T02:45:50.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a6e1a700 1 -- 172.21.15.83:0/182144127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 msgr2=0x7f06a015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a6e1a700 1 --2- 172.21.15.83:0/182144127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a015b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0698009e60 tx=0x7f0698009780 comp rx=0 tx=0).stop 2023-10-06T02:45:50.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a6e1a700 1 -- 172.21.15.83:0/182144127 shutdown_connections 2023-10-06T02:45:50.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a6e1a700 1 --2- 172.21.15.83:0/182144127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a015b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a6e1a700 1 --2- 172.21.15.83:0/182144127 >> v2:172.21.15.83:3300/0 conn(0x7f06a00d0f50 0x7f06a006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a6e1a700 1 -- 172.21.15.83:0/182144127 >> 172.21.15.83:0/182144127 conn(0x7f06a0063230 msgr2=0x7f06a0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:50.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a6e1a700 1 -- 172.21.15.83:0/182144127 shutdown_connections 2023-10-06T02:45:50.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.300+0000 7f06a6e1a700 1 -- 172.21.15.83:0/182144127 wait complete. 2023-10-06T02:45:50.307 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.301+0000 7f06a6e1a700 1 Processor -- start 2023-10-06T02:45:50.307 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.301+0000 7f06a6e1a700 1 -- start start 2023-10-06T02:45:50.307 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a6e1a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a01568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.307 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a6e1a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06a00d0b80 0x7f06a014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.307 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a6e1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00d0f50 0x7f06a016d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a6e1a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0157350 con 0x7f06a00d0f50 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a6e1a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0156e10 con 0x7f06a00d0b80 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a6e1a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0157070 con 0x7f06a006d530 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5617700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06a00d0b80 0x7f06a014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5e18700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a01568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5617700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06a00d0b80 0x7f06a014f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37270/0 (socket says 172.21.15.83:37270) 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5617700 1 -- 172.21.15.83:0/502803497 learned_addr learned my addr 172.21.15.83:0/502803497 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a6619700 1 --2- 172.21.15.83:0/502803497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00d0f50 0x7f06a016d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5617700 1 -- 172.21.15.83:0/502803497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 msgr2=0x7f06a01568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.308 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5617700 1 --2- 172.21.15.83:0/502803497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a01568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5617700 1 -- 172.21.15.83:0/502803497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00d0f50 msgr2=0x7f06a016d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5617700 1 --2- 172.21.15.83:0/502803497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00d0f50 0x7f06a016d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5617700 1 -- 172.21.15.83:0/502803497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900094f0 con 0x7f06a00d0b80 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.302+0000 7f06a5e18700 1 --2- 172.21.15.83:0/502803497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a01568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.303+0000 7f06a5617700 1 --2- 172.21.15.83:0/502803497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06a00d0b80 0x7f06a014f110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f069000ec50 tx=0x7f0690009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.303+0000 7f0695ffb700 1 -- 172.21.15.83:0/502803497 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000c850 con 0x7f06a00d0b80 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.303+0000 7f0695ffb700 1 -- 172.21.15.83:0/502803497 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000c9b0 con 0x7f06a00d0b80 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.303+0000 7f06a6e1a700 1 -- 172.21.15.83:0/502803497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0698009a20 con 0x7f06a00d0b80 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.303+0000 7f0695ffb700 1 -- 172.21.15.83:0/502803497 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000cd30 con 0x7f06a00d0b80 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.303+0000 7f06a6e1a700 1 -- 172.21.15.83:0/502803497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a00b45a0 con 0x7f06a00d0b80 2023-10-06T02:45:50.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.303+0000 7f0695ffb700 1 -- 172.21.15.83:0/502803497 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0690013680 con 0x7f06a00d0b80 2023-10-06T02:45:50.310 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.303+0000 7f0695ffb700 1 -- 172.21.15.83:0/502803497 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f069001c880 con 0x7f06a00d0b80 2023-10-06T02:45:50.310 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.304+0000 7f06a6e1a700 1 -- 172.21.15.83:0/502803497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a00b40f0 con 0x7f06a00d0b80 2023-10-06T02:45:50.310 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.306+0000 7f0695ffb700 1 -- 172.21.15.83:0/502803497 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0690021060 con 0x7f06a00d0b80 2023-10-06T02:45:50.388 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.387+0000 7f06a6e1a700 1 -- 172.21.15.83:0/502803497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f06a00676e0 con 0x7f06a00d0b80 2023-10-06T02:45:50.392 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.391+0000 7f0695ffb700 1 -- 172.21.15.83:0/502803497 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0690017070 con 0x7f06a00d0b80 2023-10-06T02:45:50.392 INFO:teuthology.orchestra.run.smithi083.stdout:0 2023-10-06T02:45:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.392+0000 7f06a6e1a700 1 -- 172.21.15.83:0/502803497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06a00d0b80 msgr2=0x7f06a014f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.392+0000 7f06a6e1a700 1 --2- 172.21.15.83:0/502803497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06a00d0b80 0x7f06a014f110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f069000ec50 tx=0x7f0690009250 comp rx=0 tx=0).stop 2023-10-06T02:45:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.392+0000 7f06a6e1a700 1 -- 172.21.15.83:0/502803497 shutdown_connections 2023-10-06T02:45:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.392+0000 7f06a6e1a700 1 --2- 172.21.15.83:0/502803497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00d0f50 0x7f06a016d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.393 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.392+0000 7f06a6e1a700 1 --2- 172.21.15.83:0/502803497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06a006d530 0x7f06a01568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.394 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.392+0000 7f06a6e1a700 1 --2- 172.21.15.83:0/502803497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06a00d0b80 0x7f06a014f110 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.394 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.392+0000 7f06a6e1a700 1 -- 172.21.15.83:0/502803497 >> 172.21.15.83:0/502803497 conn(0x7f06a0063230 msgr2=0x7f06a0068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:50.394 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.392+0000 7f06a6e1a700 1 -- 172.21.15.83:0/502803497 shutdown_connections 2023-10-06T02:45:50.394 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.392+0000 7f06a6e1a700 1 -- 172.21.15.83:0/502803497 wait complete. 2023-10-06T02:45:50.404 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-10-06T02:45:50.516 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.515+0000 7f9b18b64700 1 Processor -- start 2023-10-06T02:45:50.516 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.515+0000 7f9b18b64700 1 -- start start 2023-10-06T02:45:50.518 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.516+0000 7f9b18b64700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9b14157fe0 0x7f9b140b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.516+0000 7f9b18b64700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b140b2890 con 0x7f9b140cf240 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.516+0000 7f9b18b64700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b140b4070 con 0x7f9b141583b0 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.516+0000 7f9b18b64700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b140b4350 con 0x7f9b14157fe0 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.516+0000 7f9b1259c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9b14157fe0 0x7f9b140b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b1259c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9b14157fe0 0x7f9b140b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55828/0 (socket says 172.21.15.83:55828) 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b1259c700 1 -- 172.21.15.83:0/2490029461 learned_addr learned my addr 172.21.15.83:0/2490029461 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b11d9b700 1 --1- 172.21.15.83:0/2490029461 >> v1:172.21.15.83:6789/0 conn(0x7f9b141583b0 0x7f9b140ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:58554/0 (socket says 172.21.15.83:58554) 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b1259c700 1 -- 172.21.15.83:0/2490029461 >> v1:172.21.15.83:6789/0 conn(0x7f9b141583b0 legacy=0x7f9b140ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b1259c700 1 -- 172.21.15.83:0/2490029461 >> v1:172.21.15.81:6789/0 conn(0x7f9b140cf240 legacy=0x7f9b14158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b1259c700 1 -- 172.21.15.83:0/2490029461 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b140b4630 con 0x7f9b14157fe0 2023-10-06T02:45:50.519 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b1259c700 1 --2- 172.21.15.83:0/2490029461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 0x7f9b140b34c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b040099b0 tx=0x7f9b04009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=615e3654db0a9e0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b1159a700 1 -- 172.21.15.83:0/2490029461 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0400b860 con 0x7f9b14157fe0 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b1159a700 1 -- 172.21.15.83:0/2490029461 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0400b9c0 con 0x7f9b14157fe0 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b1159a700 1 -- 172.21.15.83:0/2490029461 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0400bd60 con 0x7f9b14157fe0 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b18b64700 1 -- 172.21.15.83:0/2490029461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 msgr2=0x7f9b140b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.517+0000 7f9b18b64700 1 --2- 172.21.15.83:0/2490029461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 0x7f9b140b34c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b040099b0 tx=0x7f9b04009250 comp rx=0 tx=0).stop 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.518+0000 7f9b18b64700 1 -- 172.21.15.83:0/2490029461 shutdown_connections 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.518+0000 7f9b18b64700 1 --2- 172.21.15.83:0/2490029461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 0x7f9b140b34c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.518+0000 7f9b18b64700 1 -- 172.21.15.83:0/2490029461 >> 172.21.15.83:0/2490029461 conn(0x7f9b14067640 msgr2=0x7f9b14067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.518+0000 7f9b18b64700 1 -- 172.21.15.83:0/2490029461 shutdown_connections 2023-10-06T02:45:50.520 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.518+0000 7f9b18b64700 1 -- 172.21.15.83:0/2490029461 wait complete. 2023-10-06T02:45:50.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.519+0000 7f9b18b64700 1 Processor -- start 2023-10-06T02:45:50.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.519+0000 7f9b18b64700 1 -- start start 2023-10-06T02:45:50.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.519+0000 7f9b18b64700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b140cf240 0x7f9b14159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.519+0000 7f9b18b64700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 0x7f9b140ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.519+0000 7f9b18b64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b141583b0 0x7f9b14143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.519+0000 7f9b18b64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1415a070 con 0x7f9b141583b0 2023-10-06T02:45:50.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.519+0000 7f9b18b64700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1416c010 con 0x7f9b14157fe0 2023-10-06T02:45:50.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.519+0000 7f9b18b64700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1416c2f0 con 0x7f9b140cf240 2023-10-06T02:45:50.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b11d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 0x7f9b140ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b1259c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b140cf240 0x7f9b14159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b11d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 0x7f9b140ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55832/0 (socket says 172.21.15.83:55832) 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b11d9b700 1 -- 172.21.15.83:0/2754173759 learned_addr learned my addr 172.21.15.83:0/2754173759 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b1259c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b140cf240 0x7f9b14159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:37126/0 (socket says 172.21.15.83:37126) 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b12d9d700 1 --2- 172.21.15.83:0/2754173759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b141583b0 0x7f9b14143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b11d9b700 1 -- 172.21.15.83:0/2754173759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b140cf240 msgr2=0x7f9b14159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b11d9b700 1 --2- 172.21.15.83:0/2754173759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b140cf240 0x7f9b14159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b11d9b700 1 -- 172.21.15.83:0/2754173759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b141583b0 msgr2=0x7f9b14143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b11d9b700 1 --2- 172.21.15.83:0/2754173759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b141583b0 0x7f9b14143330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b11d9b700 1 -- 172.21.15.83:0/2754173759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040094f0 con 0x7f9b14157fe0 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b1259c700 1 --2- 172.21.15.83:0/2754173759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b140cf240 0x7f9b14159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:50.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b11d9b700 1 --2- 172.21.15.83:0/2754173759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 0x7f9b140ce790 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c7c0 tx=0x7f9b08007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:50.525 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b027fc700 1 -- 172.21.15.83:0/2754173759 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08005a70 con 0x7f9b14157fe0 2023-10-06T02:45:50.525 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b027fc700 1 -- 172.21.15.83:0/2754173759 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08005bd0 con 0x7f9b14157fe0 2023-10-06T02:45:50.525 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b18b64700 1 -- 172.21.15.83:0/2754173759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1416c5d0 con 0x7f9b14157fe0 2023-10-06T02:45:50.525 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b027fc700 1 -- 172.21.15.83:0/2754173759 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080070d0 con 0x7f9b14157fe0 2023-10-06T02:45:50.525 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b18b64700 1 -- 172.21.15.83:0/2754173759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1416cb90 con 0x7f9b14157fe0 2023-10-06T02:45:50.525 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b027fc700 1 -- 172.21.15.83:0/2754173759 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9b0801c440 con 0x7f9b14157fe0 2023-10-06T02:45:50.525 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.520+0000 7f9b027fc700 1 -- 172.21.15.83:0/2754173759 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f9b08007700 con 0x7f9b14157fe0 2023-10-06T02:45:50.525 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.521+0000 7f9b18b64700 1 -- 172.21.15.83:0/2754173759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b14069e40 con 0x7f9b14157fe0 2023-10-06T02:45:50.526 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.523+0000 7f9b027fc700 1 -- 172.21.15.83:0/2754173759 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9b08017070 con 0x7f9b14157fe0 2023-10-06T02:45:50.608 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.607+0000 7f9b18b64700 1 -- 172.21.15.83:0/2754173759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f9b140cc6b0 con 0x7f9b14157fe0 2023-10-06T02:45:50.610 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.610+0000 7f9b027fc700 1 -- 172.21.15.83:0/2754173759 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b0801c830 con 0x7f9b14157fe0 2023-10-06T02:45:50.611 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:45:50.612 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.611+0000 7f9b18b64700 1 -- 172.21.15.83:0/2754173759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 msgr2=0x7f9b140ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.612 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.611+0000 7f9b18b64700 1 --2- 172.21.15.83:0/2754173759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 0x7f9b140ce790 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c7c0 tx=0x7f9b08007f70 comp rx=0 tx=0).stop 2023-10-06T02:45:50.612 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.611+0000 7f9b18b64700 1 -- 172.21.15.83:0/2754173759 shutdown_connections 2023-10-06T02:45:50.612 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.611+0000 7f9b18b64700 1 --2- 172.21.15.83:0/2754173759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b141583b0 0x7f9b14143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.612 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.611+0000 7f9b18b64700 1 --2- 172.21.15.83:0/2754173759 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b140cf240 0x7f9b14159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.612 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.611+0000 7f9b18b64700 1 --2- 172.21.15.83:0/2754173759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b14157fe0 0x7f9b140ce790 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.612 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.611+0000 7f9b18b64700 1 -- 172.21.15.83:0/2754173759 >> 172.21.15.83:0/2754173759 conn(0x7f9b14067640 msgr2=0x7f9b1415e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:50.612 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.611+0000 7f9b18b64700 1 -- 172.21.15.83:0/2754173759 shutdown_connections 2023-10-06T02:45:50.613 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.611+0000 7f9b18b64700 1 -- 172.21.15.83:0/2754173759 wait complete. 2023-10-06T02:45:50.623 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-10-06T02:45:50.739 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.738+0000 7ff2618d7700 1 Processor -- start 2023-10-06T02:45:50.740 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.739+0000 7ff2618d7700 1 -- start start 2023-10-06T02:45:50.742 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.739+0000 7ff2618d7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff25c0c7590 0x7ff25c06cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.742 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.739+0000 7ff2618d7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c06df00 con 0x7ff25c0c79e0 2023-10-06T02:45:50.742 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.739+0000 7ff2618d7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c0c9390 con 0x7ff25c157870 2023-10-06T02:45:50.742 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.739+0000 7ff2618d7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c0c9670 con 0x7ff25c0c7590 2023-10-06T02:45:50.742 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.739+0000 7ff25affd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff25c157870 0x7ff25c06e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:58570/0 (socket says 172.21.15.83:58570) 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.739+0000 7ff25affd700 1 -- 172.21.15.83:0/2219684804 learned_addr learned my addr 172.21.15.83:0/2219684804 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff25a7fc700 1 --2- 172.21.15.83:0/2219684804 >> v2:172.21.15.81:3300/0 conn(0x7ff25c0c7590 0x7ff25c06cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff259ffb700 1 -- 172.21.15.83:0/2219684804 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168496794 0 0) 0x7ff25c0c9390 con 0x7ff25c157870 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff259ffb700 1 -- 172.21.15.83:0/2219684804 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff244003570 con 0x7ff25c157870 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff259ffb700 1 -- 172.21.15.83:0/2219684804 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309536378 0 0) 0x7ff25c06df00 con 0x7ff25c0c79e0 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff259ffb700 1 -- 172.21.15.83:0/2219684804 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff25c0c9390 con 0x7ff25c0c79e0 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff25a7fc700 1 -- 172.21.15.83:0/2219684804 >> v1:172.21.15.83:6789/0 conn(0x7ff25c157870 legacy=0x7ff25c06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff259ffb700 1 -- 172.21.15.83:0/2219684804 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243665357 0 0) 0x7ff244003570 con 0x7ff25c157870 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff25a7fc700 1 -- 172.21.15.83:0/2219684804 >> v1:172.21.15.81:6789/0 conn(0x7ff25c0c79e0 legacy=0x7ff25c068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff25a7fc700 1 -- 172.21.15.83:0/2219684804 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c06db90 con 0x7ff25c0c7590 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff25a7fc700 1 --2- 172.21.15.83:0/2219684804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0c7590 0x7ff25c06cba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009860 tx=0x7ff24c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab331a9ea39c9f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:50.743 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff259ffb700 1 -- 172.21.15.83:0/2219684804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250001470 con 0x7ff25c0c7590 2023-10-06T02:45:50.744 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff259ffb700 1 -- 172.21.15.83:0/2219684804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c011420 con 0x7ff25c0c7590 2023-10-06T02:45:50.744 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.740+0000 7ff259ffb700 1 -- 172.21.15.83:0/2219684804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0117c0 con 0x7ff25c0c7590 2023-10-06T02:45:50.744 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.741+0000 7ff2618d7700 1 -- 172.21.15.83:0/2219684804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0c7590 msgr2=0x7ff25c06cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.744 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.741+0000 7ff2618d7700 1 --2- 172.21.15.83:0/2219684804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0c7590 0x7ff25c06cba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009860 tx=0x7ff24c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.744 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.741+0000 7ff2618d7700 1 -- 172.21.15.83:0/2219684804 shutdown_connections 2023-10-06T02:45:50.744 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.741+0000 7ff2618d7700 1 --2- 172.21.15.83:0/2219684804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0c7590 0x7ff25c06cba0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.744 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.741+0000 7ff2618d7700 1 -- 172.21.15.83:0/2219684804 >> 172.21.15.83:0/2219684804 conn(0x7ff25c0c9a60 msgr2=0x7ff25c0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:50.744 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.741+0000 7ff2618d7700 1 -- 172.21.15.83:0/2219684804 shutdown_connections 2023-10-06T02:45:50.744 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.741+0000 7ff2618d7700 1 -- 172.21.15.83:0/2219684804 wait complete. 2023-10-06T02:45:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.742+0000 7ff2618d7700 1 Processor -- start 2023-10-06T02:45:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.742+0000 7ff2618d7700 1 -- start start 2023-10-06T02:45:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff2618d7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff25c0c7590 0x7ff25c152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff2618d7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c157870 0x7ff25c0c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff2618d7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff25c0c6a00 0x7ff25c155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff2618d7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0c6ea0 con 0x7ff25c157870 2023-10-06T02:45:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff2618d7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c16a350 con 0x7ff25c0c7590 2023-10-06T02:45:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff2618d7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c16a630 con 0x7ff25c0c6a00 2023-10-06T02:45:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff25c0c7590 0x7ff25c152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff25c0c7590 0x7ff25c152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55840/0 (socket says 172.21.15.83:55840) 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25affd700 1 -- 172.21.15.83:0/399819879 learned_addr learned my addr 172.21.15.83:0/399819879 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25b7fe700 1 --2- 172.21.15.83:0/399819879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff25c0c6a00 0x7ff25c155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25a7fc700 1 --2- 172.21.15.83:0/399819879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c157870 0x7ff25c0c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25affd700 1 -- 172.21.15.83:0/399819879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff25c0c6a00 msgr2=0x7ff25c155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25affd700 1 --2- 172.21.15.83:0/399819879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff25c0c6a00 0x7ff25c155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25affd700 1 -- 172.21.15.83:0/399819879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c157870 msgr2=0x7ff25c0c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25affd700 1 --2- 172.21.15.83:0/399819879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c157870 0x7ff25c0c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25affd700 1 -- 172.21.15.83:0/399819879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c009420 con 0x7ff25c0c7590 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff25affd700 1 --2- 172.21.15.83:0/399819879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff25c0c7590 0x7ff25c152f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff25000cbc0 tx=0x7ff250001b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.743+0000 7ff242ffd700 1 -- 172.21.15.83:0/399819879 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250007150 con 0x7ff25c0c7590 2023-10-06T02:45:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.744+0000 7ff242ffd700 1 -- 172.21.15.83:0/399819879 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2500072b0 con 0x7ff25c0c7590 2023-10-06T02:45:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.744+0000 7ff2618d7700 1 -- 172.21.15.83:0/399819879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c16a910 con 0x7ff25c0c7590 2023-10-06T02:45:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.744+0000 7ff242ffd700 1 -- 172.21.15.83:0/399819879 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250007670 con 0x7ff25c0c7590 2023-10-06T02:45:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.744+0000 7ff2618d7700 1 -- 172.21.15.83:0/399819879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c16aed0 con 0x7ff25c0c7590 2023-10-06T02:45:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.744+0000 7ff242ffd700 1 -- 172.21.15.83:0/399819879 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff250004cc0 con 0x7ff25c0c7590 2023-10-06T02:45:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.744+0000 7ff242ffd700 1 -- 172.21.15.83:0/399819879 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7ff25000abe0 con 0x7ff25c0c7590 2023-10-06T02:45:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.744+0000 7ff2618d7700 1 -- 172.21.15.83:0/399819879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c0c7ee0 con 0x7ff25c0c7590 2023-10-06T02:45:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.746+0000 7ff242ffd700 1 -- 172.21.15.83:0/399819879 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff250018070 con 0x7ff25c0c7590 2023-10-06T02:45:50.776 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:50.776+0000 7fbdc4542180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:45:50.830 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.829+0000 7ff2618d7700 1 -- 172.21.15.83:0/399819879 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7ff25c16b0f0 con 0x7ff25c0c7590 2023-10-06T02:45:50.833 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.832+0000 7ff242ffd700 1 -- 172.21.15.83:0/399819879 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff25000a5f0 con 0x7ff25c0c7590 2023-10-06T02:45:50.833 INFO:teuthology.orchestra.run.smithi083.stdout:2 2023-10-06T02:45:50.834 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.833+0000 7ff2618d7700 1 -- 172.21.15.83:0/399819879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff25c0c7590 msgr2=0x7ff25c152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.833+0000 7ff2618d7700 1 --2- 172.21.15.83:0/399819879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff25c0c7590 0x7ff25c152f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff25000cbc0 tx=0x7ff250001b50 comp rx=0 tx=0).stop 2023-10-06T02:45:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.833+0000 7ff2618d7700 1 -- 172.21.15.83:0/399819879 shutdown_connections 2023-10-06T02:45:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.833+0000 7ff2618d7700 1 --2- 172.21.15.83:0/399819879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff25c0c6a00 0x7ff25c155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.833+0000 7ff2618d7700 1 --2- 172.21.15.83:0/399819879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff25c0c7590 0x7ff25c152f30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.833+0000 7ff2618d7700 1 --2- 172.21.15.83:0/399819879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c157870 0x7ff25c0c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.833+0000 7ff2618d7700 1 -- 172.21.15.83:0/399819879 >> 172.21.15.83:0/399819879 conn(0x7ff25c0c9a60 msgr2=0x7ff25c06a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.833+0000 7ff2618d7700 1 -- 172.21.15.83:0/399819879 shutdown_connections 2023-10-06T02:45:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.833+0000 7ff2618d7700 1 -- 172.21.15.83:0/399819879 wait complete. 2023-10-06T02:45:50.846 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-10-06T02:45:50.907 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:50.907+0000 7fbdc4542180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:45:50.961 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.960+0000 7f92d3b30700 1 Processor -- start 2023-10-06T02:45:50.961 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.961+0000 7f92d3b30700 1 -- start start 2023-10-06T02:45:50.964 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.961+0000 7f92d3b30700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc1569e0 0x7f92cc0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.964 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.961+0000 7f92d3b30700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92cc156db0 0x7f92cc06e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.964 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.961+0000 7f92d3b30700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92cc0b1d10 0x7f92cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.965 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.961+0000 7f92d3b30700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc0b2290 con 0x7f92cc0b1d10 2023-10-06T02:45:50.965 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.961+0000 7f92d3b30700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc157c00 con 0x7f92cc156db0 2023-10-06T02:45:50.965 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.961+0000 7f92d3b30700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc1572d0 con 0x7f92cc1569e0 2023-10-06T02:45:50.965 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d10cb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92cc156db0 0x7f92cc06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.965 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d18cc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc1569e0 0x7f92cc0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.965 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d10cb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92cc156db0 0x7f92cc06e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55854/0 (socket says 172.21.15.83:55854) 2023-10-06T02:45:50.965 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d10cb700 1 -- 172.21.15.83:0/217889761 learned_addr learned my addr 172.21.15.83:0/217889761 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:50.965 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d20cd700 1 --2- 172.21.15.83:0/217889761 >> v2:172.21.15.81:3300/0 conn(0x7f92cc0b1d10 0x7f92cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.966 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d10cb700 1 -- 172.21.15.83:0/217889761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc1569e0 msgr2=0x7f92cc0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:50.966 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d10cb700 1 --2- 172.21.15.83:0/217889761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc1569e0 0x7f92cc0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.966 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d10cb700 1 -- 172.21.15.83:0/217889761 >> v2:172.21.15.81:3300/0 conn(0x7f92cc0b1d10 msgr2=0x7f92cc06e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:50.966 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d10cb700 1 --2- 172.21.15.83:0/217889761 >> v2:172.21.15.81:3300/0 conn(0x7f92cc0b1d10 0x7f92cc06e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.966 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d10cb700 1 -- 172.21.15.83:0/217889761 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc1575b0 con 0x7f92cc156db0 2023-10-06T02:45:50.966 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d18cc700 1 --2- 172.21.15.83:0/217889761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc1569e0 0x7f92cc0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:50.966 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d10cb700 1 --2- 172.21.15.83:0/217889761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc156db0 0x7f92cc06e230 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0cea80 tx=0x7f92c8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05889e9c82d5db8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:50.966 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d08ca700 1 -- 172.21.15.83:0/217889761 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800b640 con 0x7f92cc156db0 2023-10-06T02:45:50.966 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d08ca700 1 -- 172.21.15.83:0/217889761 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c800b7a0 con 0x7f92cc156db0 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.962+0000 7f92d08ca700 1 -- 172.21.15.83:0/217889761 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800bb60 con 0x7f92cc156db0 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.963+0000 7f92d3b30700 1 -- 172.21.15.83:0/217889761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc156db0 msgr2=0x7f92cc06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.963+0000 7f92d3b30700 1 --2- 172.21.15.83:0/217889761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc156db0 0x7f92cc06e230 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0cea80 tx=0x7f92c8009250 comp rx=0 tx=0).stop 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.963+0000 7f92d3b30700 1 -- 172.21.15.83:0/217889761 shutdown_connections 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.963+0000 7f92d3b30700 1 --2- 172.21.15.83:0/217889761 >> v2:172.21.15.81:3300/0 conn(0x7f92cc0b1d10 0x7f92cc06e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.963+0000 7f92d3b30700 1 --2- 172.21.15.83:0/217889761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc1569e0 0x7f92cc0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.963+0000 7f92d3b30700 1 --2- 172.21.15.83:0/217889761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc156db0 0x7f92cc06e230 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.963+0000 7f92d3b30700 1 -- 172.21.15.83:0/217889761 >> 172.21.15.83:0/217889761 conn(0x7f92cc06cca0 msgr2=0x7f92cc06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.963+0000 7f92d3b30700 1 -- 172.21.15.83:0/217889761 shutdown_connections 2023-10-06T02:45:50.967 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.963+0000 7f92d3b30700 1 -- 172.21.15.83:0/217889761 wait complete. 2023-10-06T02:45:50.970 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.964+0000 7f92d3b30700 1 Processor -- start 2023-10-06T02:45:50.970 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.964+0000 7f92d3b30700 1 -- start start 2023-10-06T02:45:50.970 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d3b30700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc0b1d10 0x7f92cc16a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.970 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d3b30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1569e0 0x7f92cc150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.971 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d3b30700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc156db0 0x7f92cc0afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:50.971 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d3b30700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0adc50 con 0x7f92cc1569e0 2023-10-06T02:45:50.971 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d3b30700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc16acb0 con 0x7f92cc0b1d10 2023-10-06T02:45:50.971 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d3b30700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc16af90 con 0x7f92cc156db0 2023-10-06T02:45:50.973 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d18cc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc0b1d10 0x7f92cc16a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.973 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d18cc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc0b1d10 0x7f92cc16a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55862/0 (socket says 172.21.15.83:55862) 2023-10-06T02:45:50.973 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d18cc700 1 -- 172.21.15.83:0/660992180 learned_addr learned my addr 172.21.15.83:0/660992180 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:50.973 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d20cd700 1 --2- 172.21.15.83:0/660992180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc156db0 0x7f92cc0afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.973 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d10cb700 1 --2- 172.21.15.83:0/660992180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1569e0 0x7f92cc150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:50.973 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d18cc700 1 -- 172.21.15.83:0/660992180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc156db0 msgr2=0x7f92cc0afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.973 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d18cc700 1 --2- 172.21.15.83:0/660992180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc156db0 0x7f92cc0afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.973 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d18cc700 1 -- 172.21.15.83:0/660992180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1569e0 msgr2=0x7f92cc150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d18cc700 1 --2- 172.21.15.83:0/660992180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1569e0 0x7f92cc150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d18cc700 1 -- 172.21.15.83:0/660992180 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0009420 con 0x7f92cc0b1d10 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d18cc700 1 --2- 172.21.15.83:0/660992180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc0b1d10 0x7f92cc16a460 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f92c000ec80 tx=0x7f92c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92bdffb700 1 -- 172.21.15.83:0/660992180 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c000c920 con 0x7f92cc0b1d10 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92bdffb700 1 -- 172.21.15.83:0/660992180 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c000ca80 con 0x7f92cc0b1d10 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92d3b30700 1 -- 172.21.15.83:0/660992180 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c80094f0 con 0x7f92cc0b1d10 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.965+0000 7f92bdffb700 1 -- 172.21.15.83:0/660992180 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c000ce00 con 0x7f92cc0b1d10 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.966+0000 7f92d3b30700 1 -- 172.21.15.83:0/660992180 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc16a9a0 con 0x7f92cc0b1d10 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.966+0000 7f92bdffb700 1 -- 172.21.15.83:0/660992180 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f92c0013900 con 0x7f92cc0b1d10 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.966+0000 7f92bdffb700 1 -- 172.21.15.83:0/660992180 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f92c001cc10 con 0x7f92cc0b1d10 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.966+0000 7f92d3b30700 1 -- 172.21.15.83:0/660992180 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc068900 con 0x7f92cc0b1d10 2023-10-06T02:45:50.974 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:50.968+0000 7f92bdffb700 1 -- 172.21.15.83:0/660992180 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f92c003b6d0 con 0x7f92cc0b1d10 2023-10-06T02:45:50.984 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:50.984+0000 7fbdc4542180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:45:51.053 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.052+0000 7f92d3b30700 1 -- 172.21.15.83:0/660992180 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f92cc157890 con 0x7f92cc0b1d10 2023-10-06T02:45:51.057 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.056+0000 7f92bdffb700 1 -- 172.21.15.83:0/660992180 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f92c002a030 con 0x7f92cc0b1d10 2023-10-06T02:45:51.057 INFO:teuthology.orchestra.run.smithi083.stdout:3 2023-10-06T02:45:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.057+0000 7f92d3b30700 1 -- 172.21.15.83:0/660992180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc0b1d10 msgr2=0x7f92cc16a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.057+0000 7f92d3b30700 1 --2- 172.21.15.83:0/660992180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc0b1d10 0x7f92cc16a460 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f92c000ec80 tx=0x7f92c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.057+0000 7f92d3b30700 1 -- 172.21.15.83:0/660992180 shutdown_connections 2023-10-06T02:45:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.057+0000 7f92d3b30700 1 --2- 172.21.15.83:0/660992180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92cc156db0 0x7f92cc0afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.057+0000 7f92d3b30700 1 --2- 172.21.15.83:0/660992180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92cc0b1d10 0x7f92cc16a460 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.057+0000 7f92d3b30700 1 --2- 172.21.15.83:0/660992180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1569e0 0x7f92cc150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.057+0000 7f92d3b30700 1 -- 172.21.15.83:0/660992180 >> 172.21.15.83:0/660992180 conn(0x7f92cc06cca0 msgr2=0x7f92cc153530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.057+0000 7f92d3b30700 1 -- 172.21.15.83:0/660992180 shutdown_connections 2023-10-06T02:45:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.057+0000 7f92d3b30700 1 -- 172.21.15.83:0/660992180 wait complete. 2023-10-06T02:45:51.069 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-10-06T02:45:51.156 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:51.155+0000 7fc422de9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:45:51.169 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:51.168+0000 7fbdc4542180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:45:51.186 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.185+0000 7f2bef342700 1 Processor -- start 2023-10-06T02:45:51.186 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.185+0000 7f2bef342700 1 -- start start 2023-10-06T02:45:51.188 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bef342700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.188 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bef342700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2be80d02b0 0x7f2be806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.188 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bef342700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be80cf2d0 con 0x7f2be80d0f50 2023-10-06T02:45:51.188 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bef342700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be815a690 con 0x7f2be80d02b0 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bef342700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be806dc00 con 0x7f2be80d0b80 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bee340700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bee340700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:37154/0 (socket says 172.21.15.83:37154) 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bee340700 1 -- 172.21.15.83:0/2082947241 learned_addr learned my addr 172.21.15.83:0/2082947241 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bedb3f700 1 --2- 172.21.15.83:0/2082947241 >> v2:172.21.15.81:3300/0 conn(0x7f2be80d02b0 0x7f2be806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bee340700 1 -- 172.21.15.83:0/2082947241 >> v2:172.21.15.81:3300/0 conn(0x7f2be80d02b0 msgr2=0x7f2be806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bee340700 1 --2- 172.21.15.83:0/2082947241 >> v2:172.21.15.81:3300/0 conn(0x7f2be80d02b0 0x7f2be806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bee340700 1 -- 172.21.15.83:0/2082947241 >> v1:172.21.15.81:6789/0 conn(0x7f2be80d0f50 legacy=0x7f2be815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bed33e700 1 -- 172.21.15.83:0/2082947241 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784396628 0 0) 0x7f2be80cf2d0 con 0x7f2be80d0f50 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bee340700 1 -- 172.21.15.83:0/2082947241 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be80cf570 con 0x7f2be80d0b80 2023-10-06T02:45:51.189 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.186+0000 7f2bee340700 1 --2- 172.21.15.83:0/2082947241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be80cfd70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2be40099b0 tx=0x7f2be4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d048976b5aa0e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:51.190 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bed33e700 1 -- 172.21.15.83:0/2082947241 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4009ea0 con 0x7f2be80d0b80 2023-10-06T02:45:51.190 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bed33e700 1 -- 172.21.15.83:0/2082947241 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be400b860 con 0x7f2be80d0b80 2023-10-06T02:45:51.190 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bed33e700 1 -- 172.21.15.83:0/2082947241 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be400bc00 con 0x7f2be80d0b80 2023-10-06T02:45:51.190 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bef342700 1 -- 172.21.15.83:0/2082947241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 msgr2=0x7f2be80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.190 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bef342700 1 --2- 172.21.15.83:0/2082947241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be80cfd70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2be40099b0 tx=0x7f2be4009250 comp rx=0 tx=0).stop 2023-10-06T02:45:51.190 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bef342700 1 -- 172.21.15.83:0/2082947241 shutdown_connections 2023-10-06T02:45:51.190 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bef342700 1 --2- 172.21.15.83:0/2082947241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be80cfd70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.190 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bef342700 1 --2- 172.21.15.83:0/2082947241 >> v2:172.21.15.81:3300/0 conn(0x7f2be80d02b0 0x7f2be806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.190 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bef342700 1 -- 172.21.15.83:0/2082947241 >> 172.21.15.83:0/2082947241 conn(0x7f2be8063230 msgr2=0x7f2be8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:51.191 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bef342700 1 -- 172.21.15.83:0/2082947241 shutdown_connections 2023-10-06T02:45:51.191 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.187+0000 7f2bef342700 1 -- 172.21.15.83:0/2082947241 wait complete. 2023-10-06T02:45:51.193 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.188+0000 7f2bef342700 1 Processor -- start 2023-10-06T02:45:51.193 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.188+0000 7f2bef342700 1 -- start start 2023-10-06T02:45:51.194 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bef342700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be80d02b0 0x7f2be816e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.194 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bef342700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be8155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.194 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bef342700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be80d0f50 0x7f2be814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.194 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bef342700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be81559a0 con 0x7f2be80d0f50 2023-10-06T02:45:51.194 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bef342700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be816e1e0 con 0x7f2be80d02b0 2023-10-06T02:45:51.194 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bef342700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be81556c0 con 0x7f2be80d0b80 2023-10-06T02:45:51.194 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bedb3f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.194 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bee340700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be80d02b0 0x7f2be816e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bedb3f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be8155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:37170/0 (socket says 172.21.15.83:37170) 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bedb3f700 1 -- 172.21.15.83:0/142306088 learned_addr learned my addr 172.21.15.83:0/142306088 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2beeb41700 1 --2- 172.21.15.83:0/142306088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be80d0f50 0x7f2be814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bedb3f700 1 -- 172.21.15.83:0/142306088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be80d02b0 msgr2=0x7f2be816e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bedb3f700 1 --2- 172.21.15.83:0/142306088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be80d02b0 0x7f2be816e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bedb3f700 1 -- 172.21.15.83:0/142306088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be80d0f50 msgr2=0x7f2be814e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bedb3f700 1 --2- 172.21.15.83:0/142306088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be80d0f50 0x7f2be814e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.189+0000 7f2bedb3f700 1 -- 172.21.15.83:0/142306088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be40094f0 con 0x7f2be80d0b80 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.190+0000 7f2bedb3f700 1 --2- 172.21.15.83:0/142306088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be8155030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800ecb0 tx=0x7f2bd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:51.195 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.190+0000 7f2bde7fc700 1 -- 172.21.15.83:0/142306088 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800c850 con 0x7f2be80d0b80 2023-10-06T02:45:51.196 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.190+0000 7f2bde7fc700 1 -- 172.21.15.83:0/142306088 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd800c9b0 con 0x7f2be80d0b80 2023-10-06T02:45:51.196 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.190+0000 7f2bef342700 1 -- 172.21.15.83:0/142306088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be816db90 con 0x7f2be80d0b80 2023-10-06T02:45:51.196 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.190+0000 7f2bde7fc700 1 -- 172.21.15.83:0/142306088 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800cd50 con 0x7f2be80d0b80 2023-10-06T02:45:51.196 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.190+0000 7f2bef342700 1 -- 172.21.15.83:0/142306088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be814eb00 con 0x7f2be80d0b80 2023-10-06T02:45:51.196 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.190+0000 7f2bde7fc700 1 -- 172.21.15.83:0/142306088 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2bd8005c80 con 0x7f2be80d0b80 2023-10-06T02:45:51.196 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.190+0000 7f2bde7fc700 1 -- 172.21.15.83:0/142306088 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f2bd8006020 con 0x7f2be80d0b80 2023-10-06T02:45:51.196 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.191+0000 7f2bef342700 1 -- 172.21.15.83:0/142306088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be814ed20 con 0x7f2be80d0b80 2023-10-06T02:45:51.196 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.193+0000 7f2bde7fc700 1 -- 172.21.15.83:0/142306088 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2bd8021060 con 0x7f2be80d0b80 2023-10-06T02:45:51.275 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.274+0000 7f2bef342700 1 -- 172.21.15.83:0/142306088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f2be806e3a0 con 0x7f2be80d0b80 2023-10-06T02:45:51.279 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.278+0000 7f2bde7fc700 1 -- 172.21.15.83:0/142306088 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2bd8017070 con 0x7f2be80d0b80 2023-10-06T02:45:51.279 INFO:teuthology.orchestra.run.smithi083.stdout:4 2023-10-06T02:45:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.279+0000 7f2bef342700 1 -- 172.21.15.83:0/142306088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 msgr2=0x7f2be8155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.279+0000 7f2bef342700 1 --2- 172.21.15.83:0/142306088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be8155030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800ecb0 tx=0x7f2bd80091a0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.279+0000 7f2bef342700 1 -- 172.21.15.83:0/142306088 shutdown_connections 2023-10-06T02:45:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.279+0000 7f2bef342700 1 --2- 172.21.15.83:0/142306088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be80d0f50 0x7f2be814e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.279+0000 7f2bef342700 1 --2- 172.21.15.83:0/142306088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be80d02b0 0x7f2be816e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.279+0000 7f2bef342700 1 --2- 172.21.15.83:0/142306088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be80d0b80 0x7f2be8155030 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.279+0000 7f2bef342700 1 -- 172.21.15.83:0/142306088 >> 172.21.15.83:0/142306088 conn(0x7f2be8063230 msgr2=0x7f2be815b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.279+0000 7f2bef342700 1 -- 172.21.15.83:0/142306088 shutdown_connections 2023-10-06T02:45:51.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.279+0000 7f2bef342700 1 -- 172.21.15.83:0/142306088 wait complete. 2023-10-06T02:45:51.292 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-10-06T02:45:51.292 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:51.291+0000 7fc422de9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:45:51.345 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:51.344+0000 7fbdc4542180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:45:51.371 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:51.370+0000 7fc422de9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:45:51.409 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.408+0000 7f6c9bace700 1 Processor -- start 2023-10-06T02:45:51.409 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.408+0000 7f6c9bace700 1 -- start start 2023-10-06T02:45:51.411 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9bace700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6c94157ca0 0x7f6c940cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.411 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9bace700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c9406d120 0x7f6c9406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.411 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9bace700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c940d07c0 con 0x7f6c941578d0 2023-10-06T02:45:51.411 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9bace700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9406da50 con 0x7f6c94157ca0 2023-10-06T02:45:51.411 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9bace700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c940cfbb0 con 0x7f6c9406d120 2023-10-06T02:45:51.411 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9a06b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c9406d120 0x7f6c9406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.411 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9a06b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c9406d120 0x7f6c9406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55866/0 (socket says 172.21.15.83:55866) 2023-10-06T02:45:51.411 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9a06b700 1 -- 172.21.15.83:0/979751866 learned_addr learned my addr 172.21.15.83:0/979751866 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c99069700 1 --2- 172.21.15.83:0/979751866 >> v2:172.21.15.81:3300/0 conn(0x7f6c94157ca0 0x7f6c940cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9a06b700 1 -- 172.21.15.83:0/979751866 >> v2:172.21.15.81:3300/0 conn(0x7f6c94157ca0 msgr2=0x7f6c940cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9a06b700 1 --2- 172.21.15.83:0/979751866 >> v2:172.21.15.81:3300/0 conn(0x7f6c94157ca0 0x7f6c940cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9a06b700 1 -- 172.21.15.83:0/979751866 >> v1:172.21.15.81:6789/0 conn(0x7f6c941578d0 legacy=0x7f6c9415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c98868700 1 -- 172.21.15.83:0/979751866 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386503203 0 0) 0x7f6c940d07c0 con 0x7f6c941578d0 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.409+0000 7f6c9a06b700 1 -- 172.21.15.83:0/979751866 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c940cfe90 con 0x7f6c9406d120 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c9a06b700 1 --2- 172.21.15.83:0/979751866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 0x7f6c9406d510 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c94068300 tx=0x7f6c8c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=796735b0e850dcf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c98868700 1 -- 172.21.15.83:0/979751866 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00e070 con 0x7f6c9406d120 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c98868700 1 -- 172.21.15.83:0/979751866 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c00ba20 con 0x7f6c9406d120 2023-10-06T02:45:51.412 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c98868700 1 -- 172.21.15.83:0/979751866 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0092e0 con 0x7f6c9406d120 2023-10-06T02:45:51.415 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c9bace700 1 -- 172.21.15.83:0/979751866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 msgr2=0x7f6c9406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.415 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c9bace700 1 --2- 172.21.15.83:0/979751866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 0x7f6c9406d510 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c94068300 tx=0x7f6c8c009840 comp rx=0 tx=0).stop 2023-10-06T02:45:51.415 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c9bace700 1 -- 172.21.15.83:0/979751866 shutdown_connections 2023-10-06T02:45:51.415 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c9bace700 1 --2- 172.21.15.83:0/979751866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 0x7f6c9406d510 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.415 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c9bace700 1 --2- 172.21.15.83:0/979751866 >> v2:172.21.15.81:3300/0 conn(0x7f6c94157ca0 0x7f6c940cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.415 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.410+0000 7f6c9bace700 1 -- 172.21.15.83:0/979751866 >> 172.21.15.83:0/979751866 conn(0x7f6c9406bb90 msgr2=0x7f6c9406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:51.415 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.411+0000 7f6c9bace700 1 -- 172.21.15.83:0/979751866 shutdown_connections 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.411+0000 7f6c9bace700 1 -- 172.21.15.83:0/979751866 wait complete. 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.412+0000 7f6c9bace700 1 Processor -- start 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.412+0000 7f6c9bace700 1 -- start start 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.412+0000 7f6c9bace700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 0x7f6c94154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.412+0000 7f6c9bace700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c941578d0 0x7f6c940abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.412+0000 7f6c9bace700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c94157ca0 0x7f6c940ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.412+0000 7f6c9bace700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9416a200 con 0x7f6c94157ca0 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.412+0000 7f6c9bace700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940b4b60 con 0x7f6c9406d120 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.412+0000 7f6c9bace700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940b4e40 con 0x7f6c941578d0 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c99069700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c941578d0 0x7f6c940abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c9986a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 0x7f6c94154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c9986a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 0x7f6c94154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55876/0 (socket says 172.21.15.83:55876) 2023-10-06T02:45:51.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c99069700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c941578d0 0x7f6c940abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:37174/0 (socket says 172.21.15.83:37174) 2023-10-06T02:45:51.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c9986a700 1 -- 172.21.15.83:0/1721509898 learned_addr learned my addr 172.21.15.83:0/1721509898 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:51.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c9a06b700 1 --2- 172.21.15.83:0/1721509898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c94157ca0 0x7f6c940ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c99069700 1 -- 172.21.15.83:0/1721509898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 msgr2=0x7f6c94154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c99069700 1 --2- 172.21.15.83:0/1721509898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 0x7f6c94154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c99069700 1 -- 172.21.15.83:0/1721509898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c94157ca0 msgr2=0x7f6c940ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c99069700 1 --2- 172.21.15.83:0/1721509898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c94157ca0 0x7f6c940ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c99069700 1 -- 172.21.15.83:0/1721509898 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c009ae0 con 0x7f6c941578d0 2023-10-06T02:45:51.418 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c9986a700 1 --2- 172.21.15.83:0/1721509898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 0x7f6c94154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:51.418 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c99069700 1 --2- 172.21.15.83:0/1721509898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c941578d0 0x7f6c940abfa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000e8d0 tx=0x7f6c900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:51.418 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c89ffb700 1 -- 172.21.15.83:0/1721509898 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90013680 con 0x7f6c941578d0 2023-10-06T02:45:51.418 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c89ffb700 1 -- 172.21.15.83:0/1721509898 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900137e0 con 0x7f6c941578d0 2023-10-06T02:45:51.418 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c9bace700 1 -- 172.21.15.83:0/1721509898 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c940b5120 con 0x7f6c941578d0 2023-10-06T02:45:51.418 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.413+0000 7f6c89ffb700 1 -- 172.21.15.83:0/1721509898 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90013b80 con 0x7f6c941578d0 2023-10-06T02:45:51.418 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.414+0000 7f6c9bace700 1 -- 172.21.15.83:0/1721509898 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c94154db0 con 0x7f6c941578d0 2023-10-06T02:45:51.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.415+0000 7f6c89ffb700 1 -- 172.21.15.83:0/1721509898 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6c90005c80 con 0x7f6c941578d0 2023-10-06T02:45:51.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.415+0000 7f6c89ffb700 1 -- 172.21.15.83:0/1721509898 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f6c90006570 con 0x7f6c941578d0 2023-10-06T02:45:51.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.415+0000 7f6c9bace700 1 -- 172.21.15.83:0/1721509898 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9416a370 con 0x7f6c941578d0 2023-10-06T02:45:51.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.417+0000 7f6c89ffb700 1 -- 172.21.15.83:0/1721509898 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6c90021060 con 0x7f6c941578d0 2023-10-06T02:45:51.422 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:51.421+0000 7fbdc4542180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:45:51.500 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.499+0000 7f6c9bace700 1 -- 172.21.15.83:0/1721509898 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7f6c940d0170 con 0x7f6c941578d0 2023-10-06T02:45:51.504 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.503+0000 7f6c89ffb700 1 -- 172.21.15.83:0/1721509898 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6c90017070 con 0x7f6c941578d0 2023-10-06T02:45:51.504 INFO:teuthology.orchestra.run.smithi083.stdout:5 2023-10-06T02:45:51.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.504+0000 7f6c9bace700 1 -- 172.21.15.83:0/1721509898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c941578d0 msgr2=0x7f6c940abfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.504+0000 7f6c9bace700 1 --2- 172.21.15.83:0/1721509898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c941578d0 0x7f6c940abfa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000e8d0 tx=0x7f6c900091a0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.504+0000 7f6c9bace700 1 -- 172.21.15.83:0/1721509898 shutdown_connections 2023-10-06T02:45:51.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.504+0000 7f6c9bace700 1 --2- 172.21.15.83:0/1721509898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c94157ca0 0x7f6c940ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.504+0000 7f6c9bace700 1 --2- 172.21.15.83:0/1721509898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c9406d120 0x7f6c94154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.504+0000 7f6c9bace700 1 --2- 172.21.15.83:0/1721509898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c941578d0 0x7f6c940abfa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.506 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.504+0000 7f6c9bace700 1 -- 172.21.15.83:0/1721509898 >> 172.21.15.83:0/1721509898 conn(0x7f6c9406bb90 msgr2=0x7f6c94156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:51.506 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.504+0000 7f6c9bace700 1 -- 172.21.15.83:0/1721509898 shutdown_connections 2023-10-06T02:45:51.506 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.504+0000 7f6c9bace700 1 -- 172.21.15.83:0/1721509898 wait complete. 2023-10-06T02:45:51.516 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-10-06T02:45:51.557 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:51.556+0000 7fbdc4542180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:45:51.563 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:51.563+0000 7fc422de9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:45:51.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.631+0000 7f8224120700 1 Processor -- start 2023-10-06T02:45:51.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.631+0000 7f8224120700 1 -- start start 2023-10-06T02:45:51.634 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f8224120700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f821c1578d0 0x7f821c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.634 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f8224120700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c157ca0 0x7f821c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f8224120700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0d07c0 con 0x7f821c06d120 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f8224120700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0cfbb0 con 0x7f821c1578d0 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f8224120700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0cfe90 con 0x7f821c157ca0 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f82226bd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f821c06d120 0x7f821c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:58584/0 (socket says 172.21.15.83:58584) 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f82216bb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c157ca0 0x7f821c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f82226bd700 1 -- 172.21.15.83:0/3845477449 learned_addr learned my addr 172.21.15.83:0/3845477449 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f8221ebc700 1 --2- 172.21.15.83:0/3845477449 >> v2:172.21.15.81:3300/0 conn(0x7f821c1578d0 0x7f821c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f8220eba700 1 -- 172.21.15.83:0/3845477449 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321699816 0 0) 0x7f821c0d07c0 con 0x7f821c06d120 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f82216bb700 1 -- 172.21.15.83:0/3845477449 >> v2:172.21.15.81:3300/0 conn(0x7f821c1578d0 msgr2=0x7f821c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f82216bb700 1 --2- 172.21.15.83:0/3845477449 >> v2:172.21.15.81:3300/0 conn(0x7f821c1578d0 0x7f821c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f82216bb700 1 -- 172.21.15.83:0/3845477449 >> v1:172.21.15.83:6789/0 conn(0x7f821c06d120 legacy=0x7f821c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.632+0000 7f82216bb700 1 -- 172.21.15.83:0/3845477449 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0d0170 con 0x7f821c157ca0 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f82216bb700 1 --2- 172.21.15.83:0/3845477449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c157ca0 0x7f821c15af00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f82180098e0 tx=0x7f82180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7ce736dc6e65ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8220eba700 1 -- 172.21.15.83:0/3845477449 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800b640 con 0x7f821c157ca0 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8220eba700 1 -- 172.21.15.83:0/3845477449 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821800b7a0 con 0x7f821c157ca0 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8220eba700 1 -- 172.21.15.83:0/3845477449 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800bb40 con 0x7f821c157ca0 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8224120700 1 -- 172.21.15.83:0/3845477449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c157ca0 msgr2=0x7f821c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8224120700 1 --2- 172.21.15.83:0/3845477449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c157ca0 0x7f821c15af00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f82180098e0 tx=0x7f82180091a0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8224120700 1 -- 172.21.15.83:0/3845477449 shutdown_connections 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8224120700 1 --2- 172.21.15.83:0/3845477449 >> v2:172.21.15.81:3300/0 conn(0x7f821c1578d0 0x7f821c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8224120700 1 --2- 172.21.15.83:0/3845477449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c157ca0 0x7f821c15af00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8224120700 1 -- 172.21.15.83:0/3845477449 >> 172.21.15.83:0/3845477449 conn(0x7f821c06bb90 msgr2=0x7f821c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8224120700 1 -- 172.21.15.83:0/3845477449 shutdown_connections 2023-10-06T02:45:51.636 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.633+0000 7f8224120700 1 -- 172.21.15.83:0/3845477449 wait complete. 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8224120700 1 Processor -- start 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8224120700 1 -- start start 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8224120700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c06d120 0x7f821c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8224120700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c1578d0 0x7f821c069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8224120700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f821c157ca0 0x7f821c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8224120700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c6ad0 con 0x7f821c157ca0 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8224120700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c5ec0 con 0x7f821c1578d0 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8224120700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c61a0 con 0x7f821c06d120 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8221ebc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c06d120 0x7f821c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f82216bb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c1578d0 0x7f821c069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8221ebc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c06d120 0x7f821c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:37186/0 (socket says 172.21.15.83:37186) 2023-10-06T02:45:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f8221ebc700 1 -- 172.21.15.83:0/2865105717 learned_addr learned my addr 172.21.15.83:0/2865105717 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.635+0000 7f82226bd700 1 --2- 172.21.15.83:0/2865105717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f821c157ca0 0x7f821c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8221ebc700 1 -- 172.21.15.83:0/2865105717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c1578d0 msgr2=0x7f821c069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8221ebc700 1 --2- 172.21.15.83:0/2865105717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c1578d0 0x7f821c069cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8221ebc700 1 -- 172.21.15.83:0/2865105717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f821c157ca0 msgr2=0x7f821c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8221ebc700 1 --2- 172.21.15.83:0/2865105717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f821c157ca0 0x7f821c0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8221ebc700 1 -- 172.21.15.83:0/2865105717 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009420 con 0x7f821c06d120 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8221ebc700 1 --2- 172.21.15.83:0/2865105717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c06d120 0x7f821c0caa90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f820c00ec80 tx=0x7f820c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8211ffb700 1 -- 172.21.15.83:0/2865105717 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00c850 con 0x7f821c06d120 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8211ffb700 1 -- 172.21.15.83:0/2865105717 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00c9b0 con 0x7f821c06d120 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8224120700 1 -- 172.21.15.83:0/2865105717 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0c6480 con 0x7f821c06d120 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8211ffb700 1 -- 172.21.15.83:0/2865105717 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00cd50 con 0x7f821c06d120 2023-10-06T02:45:51.640 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8224120700 1 -- 172.21.15.83:0/2865105717 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c0c5b20 con 0x7f821c06d120 2023-10-06T02:45:51.641 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8211ffb700 1 -- 172.21.15.83:0/2865105717 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f820c005c80 con 0x7f821c06d120 2023-10-06T02:45:51.641 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.636+0000 7f8211ffb700 1 -- 172.21.15.83:0/2865105717 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f820c006620 con 0x7f821c06d120 2023-10-06T02:45:51.641 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.637+0000 7f8224120700 1 -- 172.21.15.83:0/2865105717 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c067ac0 con 0x7f821c06d120 2023-10-06T02:45:51.641 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.639+0000 7f8211ffb700 1 -- 172.21.15.83:0/2865105717 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f820c021060 con 0x7f821c06d120 2023-10-06T02:45:51.654 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:51.654+0000 7fbdc4542180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:45:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.722+0000 7f8224120700 1 -- 172.21.15.83:0/2865105717 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f821c0d0450 con 0x7f821c06d120 2023-10-06T02:45:51.730 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.729+0000 7f8211ffb700 1 -- 172.21.15.83:0/2865105717 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f820c017070 con 0x7f821c06d120 2023-10-06T02:45:51.730 INFO:teuthology.orchestra.run.smithi083.stdout:6 2023-10-06T02:45:51.731 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.730+0000 7f8224120700 1 -- 172.21.15.83:0/2865105717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c06d120 msgr2=0x7f821c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.731 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.730+0000 7f8224120700 1 --2- 172.21.15.83:0/2865105717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c06d120 0x7f821c0caa90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f820c00ec80 tx=0x7f820c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.731 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.730+0000 7f8224120700 1 -- 172.21.15.83:0/2865105717 shutdown_connections 2023-10-06T02:45:51.731 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.730+0000 7f8224120700 1 --2- 172.21.15.83:0/2865105717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f821c157ca0 0x7f821c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.731 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.730+0000 7f8224120700 1 --2- 172.21.15.83:0/2865105717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f821c06d120 0x7f821c0caa90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.731 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.730+0000 7f8224120700 1 --2- 172.21.15.83:0/2865105717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c1578d0 0x7f821c069cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.732 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.730+0000 7f8224120700 1 -- 172.21.15.83:0/2865105717 >> 172.21.15.83:0/2865105717 conn(0x7f821c06bb90 msgr2=0x7f821c068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:51.732 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.730+0000 7f8224120700 1 -- 172.21.15.83:0/2865105717 shutdown_connections 2023-10-06T02:45:51.732 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.730+0000 7f8224120700 1 -- 172.21.15.83:0/2865105717 wait complete. 2023-10-06T02:45:51.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-10-06T02:45:51.745 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:51.744+0000 7fc422de9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:45:51.826 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:51.825+0000 7fc422de9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:45:51.859 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.858+0000 7f583d3a4700 1 Processor -- start 2023-10-06T02:45:51.859 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.858+0000 7f583d3a4700 1 -- start start 2023-10-06T02:45:51.862 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f583d3a4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58381578d0 0x7f58380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.862 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f583d3a4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5838157ca0 0x7f583815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.862 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f583d3a4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f583806d120 0x7f583806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.862 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f583d3a4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583806dac0 con 0x7f5838157ca0 2023-10-06T02:45:51.862 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f583d3a4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58380d07c0 con 0x7f583806d120 2023-10-06T02:45:51.862 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f583d3a4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58380cfbb0 con 0x7f58381578d0 2023-10-06T02:45:51.862 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f5836ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58381578d0 0x7f58380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.862 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f58377fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f583806d120 0x7f583806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f5836ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58381578d0 0x7f58380cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:37188/0 (socket says 172.21.15.83:37188) 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f58377fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f583806d120 0x7f583806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55892/0 (socket says 172.21.15.83:55892) 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f5836ffd700 1 -- 172.21.15.83:0/918134011 learned_addr learned my addr 172.21.15.83:0/918134011 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f58367fc700 1 --2- 172.21.15.83:0/918134011 >> v2:172.21.15.81:3300/0 conn(0x7f5838157ca0 0x7f583815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f58377fe700 1 -- 172.21.15.83:0/918134011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58381578d0 msgr2=0x7f58380cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f58377fe700 1 --2- 172.21.15.83:0/918134011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58381578d0 0x7f58380cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f58377fe700 1 -- 172.21.15.83:0/918134011 >> v2:172.21.15.81:3300/0 conn(0x7f5838157ca0 msgr2=0x7f583815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f58377fe700 1 --2- 172.21.15.83:0/918134011 >> v2:172.21.15.81:3300/0 conn(0x7f5838157ca0 0x7f583815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f58377fe700 1 -- 172.21.15.83:0/918134011 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58380cfe90 con 0x7f583806d120 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f5836ffd700 1 --2- 172.21.15.83:0/918134011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58381578d0 0x7f58380cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:51.863 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.859+0000 7f58377fe700 1 --2- 172.21.15.83:0/918134011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f583806d120 0x7f583806d580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f58380b3940 tx=0x7f5830009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c49efc98315d89a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f5835ffb700 1 -- 172.21.15.83:0/918134011 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583000e070 con 0x7f583806d120 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f5835ffb700 1 -- 172.21.15.83:0/918134011 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583000bab0 con 0x7f583806d120 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f5835ffb700 1 -- 172.21.15.83:0/918134011 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583000be70 con 0x7f583806d120 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f583d3a4700 1 -- 172.21.15.83:0/918134011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f583806d120 msgr2=0x7f583806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f583d3a4700 1 --2- 172.21.15.83:0/918134011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f583806d120 0x7f583806d580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f58380b3940 tx=0x7f5830009780 comp rx=0 tx=0).stop 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f583d3a4700 1 -- 172.21.15.83:0/918134011 shutdown_connections 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f583d3a4700 1 --2- 172.21.15.83:0/918134011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f583806d120 0x7f583806d580 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f583d3a4700 1 --2- 172.21.15.83:0/918134011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58381578d0 0x7f58380cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f583d3a4700 1 --2- 172.21.15.83:0/918134011 >> v2:172.21.15.81:3300/0 conn(0x7f5838157ca0 0x7f583815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f583d3a4700 1 -- 172.21.15.83:0/918134011 >> 172.21.15.83:0/918134011 conn(0x7f583806bb90 msgr2=0x7f583806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f583d3a4700 1 -- 172.21.15.83:0/918134011 shutdown_connections 2023-10-06T02:45:51.864 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.860+0000 7f583d3a4700 1 -- 172.21.15.83:0/918134011 wait complete. 2023-10-06T02:45:51.868 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.862+0000 7f583d3a4700 1 Processor -- start 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.862+0000 7f583d3a4700 1 -- start start 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.862+0000 7f583d3a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583806d120 0x7f583814b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.862+0000 7f583d3a4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58381578d0 0x7f5838151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.862+0000 7f583d3a4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5838157ca0 0x7f5838150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.862+0000 7f583d3a4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380b4e00 con 0x7f583806d120 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.862+0000 7f583d3a4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380b41f0 con 0x7f58381578d0 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.862+0000 7f583d3a4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58380b44d0 con 0x7f5838157ca0 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f58367fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58381578d0 0x7f5838151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f58377fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5838157ca0 0x7f5838150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f58367fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58381578d0 0x7f5838151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55904/0 (socket says 172.21.15.83:55904) 2023-10-06T02:45:51.869 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f58367fc700 1 -- 172.21.15.83:0/3485614274 learned_addr learned my addr 172.21.15.83:0/3485614274 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f5836ffd700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583806d120 0x7f583814b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f5836ffd700 1 -- 172.21.15.83:0/3485614274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5838157ca0 msgr2=0x7f5838150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f5836ffd700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5838157ca0 0x7f5838150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f5836ffd700 1 -- 172.21.15.83:0/3485614274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58381578d0 msgr2=0x7f5838151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f5836ffd700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58381578d0 0x7f5838151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f5836ffd700 1 -- 172.21.15.83:0/3485614274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0094f0 con 0x7f583806d120 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f58367fc700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58381578d0 0x7f5838151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f58377fe700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5838157ca0 0x7f5838150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f5836ffd700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583806d120 0x7f583814b9f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f582c006fd0 tx=0x7f582c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f581effd700 1 -- 172.21.15.83:0/3485614274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00c850 con 0x7f583806d120 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f581effd700 1 -- 172.21.15.83:0/3485614274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c00c9b0 con 0x7f583806d120 2023-10-06T02:45:51.870 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f583d3a4700 1 -- 172.21.15.83:0/3485614274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5830009a20 con 0x7f583806d120 2023-10-06T02:45:51.871 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f581effd700 1 -- 172.21.15.83:0/3485614274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00cd30 con 0x7f583806d120 2023-10-06T02:45:51.871 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f583d3a4700 1 -- 172.21.15.83:0/3485614274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58380b4a90 con 0x7f583806d120 2023-10-06T02:45:51.871 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.863+0000 7f581effd700 1 -- 172.21.15.83:0/3485614274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f582c005c80 con 0x7f583806d120 2023-10-06T02:45:51.871 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.864+0000 7f581effd700 1 -- 172.21.15.83:0/3485614274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f582c013680 con 0x7f583806d120 2023-10-06T02:45:51.871 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.864+0000 7f583d3a4700 1 -- 172.21.15.83:0/3485614274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5838067ac0 con 0x7f583806d120 2023-10-06T02:45:51.871 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.866+0000 7f581effd700 1 -- 172.21.15.83:0/3485614274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f582c020060 con 0x7f583806d120 2023-10-06T02:45:51.950 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.950+0000 7f583d3a4700 1 -- 172.21.15.83:0/3485614274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f58380d0170 con 0x7f583806d120 2023-10-06T02:45:51.957 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.957+0000 7f581effd700 1 -- 172.21.15.83:0/3485614274 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f582c028020 con 0x7f583806d120 2023-10-06T02:45:51.958 INFO:teuthology.orchestra.run.smithi083.stdout:7 2023-10-06T02:45:51.959 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.958+0000 7f583d3a4700 1 -- 172.21.15.83:0/3485614274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583806d120 msgr2=0x7f583814b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:51.959 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.958+0000 7f583d3a4700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583806d120 0x7f583814b9f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f582c006fd0 tx=0x7f582c009250 comp rx=0 tx=0).stop 2023-10-06T02:45:51.959 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.958+0000 7f583d3a4700 1 -- 172.21.15.83:0/3485614274 shutdown_connections 2023-10-06T02:45:51.959 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.958+0000 7f583d3a4700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5838157ca0 0x7f5838150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.959 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.958+0000 7f583d3a4700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583806d120 0x7f583814b9f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.959 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.958+0000 7f583d3a4700 1 --2- 172.21.15.83:0/3485614274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58381578d0 0x7f5838151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:51.959 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.958+0000 7f583d3a4700 1 -- 172.21.15.83:0/3485614274 >> 172.21.15.83:0/3485614274 conn(0x7f583806bb90 msgr2=0x7f5838069280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:51.960 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.958+0000 7f583d3a4700 1 -- 172.21.15.83:0/3485614274 shutdown_connections 2023-10-06T02:45:51.960 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T02:45:51.958+0000 7f583d3a4700 1 -- 172.21.15.83:0/3485614274 wait complete. 2023-10-06T02:45:51.966 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:51.965+0000 7fc422de9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:45:51.971 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T02:45:51.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T02:45:51.973 INFO:tasks.ceph.osd.0:Started 2023-10-06T02:45:51.973 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T02:45:51.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T02:45:51.976 INFO:tasks.ceph.osd.1:Started 2023-10-06T02:45:51.976 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T02:45:51.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T02:45:51.978 INFO:tasks.ceph.osd.2:Started 2023-10-06T02:45:51.979 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T02:45:51.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T02:45:51.981 INFO:tasks.ceph.osd.3:Started 2023-10-06T02:45:51.981 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T02:45:51.981 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T02:45:51.984 INFO:tasks.ceph.osd.4:Started 2023-10-06T02:45:51.984 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T02:45:51.984 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T02:45:51.988 INFO:tasks.ceph.osd.5:Started 2023-10-06T02:45:51.988 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T02:45:51.988 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T02:45:51.991 INFO:tasks.ceph.osd.6:Started 2023-10-06T02:45:51.991 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T02:45:51.991 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T02:45:51.994 INFO:tasks.ceph.osd.7:Started 2023-10-06T02:45:51.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:45:52.061 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T02:45:52.061+0000 7f24e094d540 -1 Falling back to public interface 2023-10-06T02:45:52.063 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T02:45:52.062+0000 7efed0840540 -1 Falling back to public interface 2023-10-06T02:45:52.065 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-06T02:45:52.065+0000 7f0413890540 -1 Falling back to public interface 2023-10-06T02:45:52.066 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-06T02:45:52.065+0000 7fceae0ca540 -1 Falling back to public interface 2023-10-06T02:45:52.072 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-06T02:45:52.071+0000 7ff44a922540 -1 Falling back to public interface 2023-10-06T02:45:52.072 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-06T02:45:52.071+0000 7f6d1fcca540 -1 Falling back to public interface 2023-10-06T02:45:52.075 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T02:45:52.074+0000 7f24e094d540 -1 osd.4 0 log_to_monitors true 2023-10-06T02:45:52.075 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T02:45:52.074+0000 7fec2b8e5540 -1 Falling back to public interface 2023-10-06T02:45:52.079 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T02:45:52.078+0000 7efed0840540 -1 osd.5 0 log_to_monitors true 2023-10-06T02:45:52.080 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-06T02:45:52.079+0000 7fceae0ca540 -1 osd.3 0 log_to_monitors true 2023-10-06T02:45:52.080 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-06T02:45:52.079+0000 7f0413890540 -1 osd.2 0 log_to_monitors true 2023-10-06T02:45:52.088 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T02:45:52.087+0000 7f70360e2540 -1 Falling back to public interface 2023-10-06T02:45:52.089 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-06T02:45:52.089+0000 7f6d1fcca540 -1 osd.1 0 log_to_monitors true 2023-10-06T02:45:52.091 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T02:45:52.090+0000 7fec2b8e5540 -1 osd.7 0 log_to_monitors true 2023-10-06T02:45:52.091 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-06T02:45:52.091+0000 7ff44a922540 -1 osd.0 0 log_to_monitors true 2023-10-06T02:45:52.101 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:52.101+0000 7fc422de9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:45:52.102 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T02:45:52.102+0000 7f70360e2540 -1 osd.6 0 log_to_monitors true 2023-10-06T02:45:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.130+0000 7f13b9d62700 1 Processor -- start 2023-10-06T02:45:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.130+0000 7f13b9d62700 1 -- start start 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b9d62700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f13b415a2a0 0x7f13b40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b9d62700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b40b0ca0 con 0x7f13b40ceb30 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b9d62700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b40b00d0 con 0x7f13b406dd60 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b9d62700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b406e160 con 0x7f13b415a2a0 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f13b40ceb30 0x7f13b406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40342/0 (socket says 172.21.15.81:40342) 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b2ffd700 1 -- 172.21.15.81:0/3347224270 learned_addr learned my addr 172.21.15.81:0/3347224270 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b37fe700 1 --2- 172.21.15.81:0/3347224270 >> v2:172.21.15.83:3300/0 conn(0x7f13b415a2a0 0x7f13b40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b27fc700 1 -- 172.21.15.81:0/3347224270 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679531787 0 0) 0x7f13b40b0ca0 con 0x7f13b40ceb30 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b27fc700 1 -- 172.21.15.81:0/3347224270 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f139c003570 con 0x7f13b40ceb30 2023-10-06T02:45:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b37fe700 1 -- 172.21.15.81:0/3347224270 >> v1:172.21.15.83:6789/0 conn(0x7f13b406dd60 legacy=0x7f13b40b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b37fe700 1 -- 172.21.15.81:0/3347224270 >> v1:172.21.15.81:6789/0 conn(0x7f13b40ceb30 legacy=0x7f13b406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b27fc700 1 -- 172.21.15.81:0/3347224270 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266812925 0 0) 0x7f13b40b00d0 con 0x7f13b406dd60 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.131+0000 7f13b37fe700 1 -- 172.21.15.81:0/3347224270 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b40b0370 con 0x7f13b415a2a0 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b37fe700 1 --2- 172.21.15.81:0/3347224270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b415a2a0 0x7f13b40b1130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009e60 tx=0x7f13a4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6b6a7ac489c446 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b27fc700 1 -- 172.21.15.81:0/3347224270 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a400e070 con 0x7f13b415a2a0 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b27fc700 1 -- 172.21.15.81:0/3347224270 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a400bb60 con 0x7f13b415a2a0 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b27fc700 1 -- 172.21.15.81:0/3347224270 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4012430 con 0x7f13b415a2a0 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b9d62700 1 -- 172.21.15.81:0/3347224270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b415a2a0 msgr2=0x7f13b40b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b9d62700 1 --2- 172.21.15.81:0/3347224270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b415a2a0 0x7f13b40b1130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009e60 tx=0x7f13a4009780 comp rx=0 tx=0).stop 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b9d62700 1 -- 172.21.15.81:0/3347224270 shutdown_connections 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b9d62700 1 --2- 172.21.15.81:0/3347224270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b415a2a0 0x7f13b40b1130 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b9d62700 1 -- 172.21.15.81:0/3347224270 >> 172.21.15.81:0/3347224270 conn(0x7f13b4067640 msgr2=0x7f13b4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:52.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b9d62700 1 -- 172.21.15.81:0/3347224270 shutdown_connections 2023-10-06T02:45:52.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.132+0000 7f13b9d62700 1 -- 172.21.15.81:0/3347224270 wait complete. 2023-10-06T02:45:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b9d62700 1 Processor -- start 2023-10-06T02:45:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b9d62700 1 -- start start 2023-10-06T02:45:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b9d62700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b406dd60 0x7f13b41539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b9d62700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b40ceb30 0x7f13b4155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b9d62700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b415a2a0 0x7f13b416a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b9d62700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41562b0 con 0x7f13b415a2a0 2023-10-06T02:45:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b9d62700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b40b3bc0 con 0x7f13b40ceb30 2023-10-06T02:45:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b9d62700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4153ee0 con 0x7f13b406dd60 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b415a2a0 0x7f13b416a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b37fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b406dd60 0x7f13b41539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b40ceb30 0x7f13b4155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b415a2a0 0x7f13b416a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55580/0 (socket says 172.21.15.81:55580) 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b40ceb30 0x7f13b4155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:40592/0 (socket says 172.21.15.81:40592) 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b3fff700 1 -- 172.21.15.81:0/1509998064 learned_addr learned my addr 172.21.15.81:0/1509998064 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.134+0000 7f13b37fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b406dd60 0x7f13b41539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:41430/0 (socket says 172.21.15.81:41430) 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f13b2ffd700 1 -- 172.21.15.81:0/1509998064 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b406dd60 msgr2=0x7f13b41539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f13b2ffd700 1 --2- 172.21.15.81:0/1509998064 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b406dd60 0x7f13b41539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f13b2ffd700 1 -- 172.21.15.81:0/1509998064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b415a2a0 msgr2=0x7f13b416a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f13b2ffd700 1 --2- 172.21.15.81:0/1509998064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b415a2a0 0x7f13b416a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f13b2ffd700 1 -- 172.21.15.81:0/1509998064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4009a20 con 0x7f13b40ceb30 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f13b3fff700 1 --2- 172.21.15.81:0/1509998064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b415a2a0 0x7f13b416a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f13b2ffd700 1 --2- 172.21.15.81:0/1509998064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b40ceb30 0x7f13b4155610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f13a80058d0 tx=0x7f13a8007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f139b7fe700 1 -- 172.21.15.81:0/1509998064 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8005b30 con 0x7f13b40ceb30 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f139b7fe700 1 -- 172.21.15.81:0/1509998064 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a8005cd0 con 0x7f13b40ceb30 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f13b9d62700 1 -- 172.21.15.81:0/1509998064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b4155fd0 con 0x7f13b40ceb30 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f139b7fe700 1 -- 172.21.15.81:0/1509998064 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8007320 con 0x7f13b40ceb30 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f13b9d62700 1 -- 172.21.15.81:0/1509998064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b40b3850 con 0x7f13b40ceb30 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f139b7fe700 1 -- 172.21.15.81:0/1509998064 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f13a801c440 con 0x7f13b40ceb30 2023-10-06T02:45:52.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.135+0000 7f139b7fe700 1 -- 172.21.15.81:0/1509998064 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f13a8005e40 con 0x7f13b40ceb30 2023-10-06T02:45:52.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.136+0000 7f13b9d62700 1 -- 172.21.15.81:0/1509998064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b4069e40 con 0x7f13b40ceb30 2023-10-06T02:45:52.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.138+0000 7f139b7fe700 1 -- 172.21.15.81:0/1509998064 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f13a8021060 con 0x7f13b40ceb30 2023-10-06T02:45:52.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.204+0000 7f13b9d62700 1 -- 172.21.15.81:0/1509998064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13b40b3d00 con 0x7f13b40ceb30 2023-10-06T02:45:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.205+0000 7f139b7fe700 1 -- 172.21.15.81:0/1509998064 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f13a8017070 con 0x7f13b40ceb30 2023-10-06T02:45:52.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:45:52.206 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:45:51.951043+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:45:52.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.205+0000 7f13b9d62700 1 -- 172.21.15.81:0/1509998064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b40ceb30 msgr2=0x7f13b4155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:52.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.205+0000 7f13b9d62700 1 --2- 172.21.15.81:0/1509998064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b40ceb30 0x7f13b4155610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f13a80058d0 tx=0x7f13a8007d10 comp rx=0 tx=0).stop 2023-10-06T02:45:52.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.205+0000 7f13b9d62700 1 -- 172.21.15.81:0/1509998064 shutdown_connections 2023-10-06T02:45:52.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.205+0000 7f13b9d62700 1 --2- 172.21.15.81:0/1509998064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b415a2a0 0x7f13b416a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:52.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.205+0000 7f13b9d62700 1 --2- 172.21.15.81:0/1509998064 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13b406dd60 0x7f13b41539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.205+0000 7f13b9d62700 1 --2- 172.21.15.81:0/1509998064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13b40ceb30 0x7f13b4155610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.205+0000 7f13b9d62700 1 -- 172.21.15.81:0/1509998064 >> 172.21.15.81:0/1509998064 conn(0x7f13b4067640 msgr2=0x7f13b4156cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.206+0000 7f13b9d62700 1 -- 172.21.15.81:0/1509998064 shutdown_connections 2023-10-06T02:45:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:45:52.206+0000 7f13b9d62700 1 -- 172.21.15.81:0/1509998064 wait complete. 2023-10-06T02:45:52.218 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T02:45:52.218 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T02:45:52.613 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:52.612+0000 7fc422de9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:45:52.691 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:52.690+0000 7fc422de9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:45:52.768 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:52.767+0000 7fc422de9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:45:52.833 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:52.832+0000 7fbdc4542180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:45:52.908 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:52.907+0000 7fbdc4542180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:45:52.985 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:52.984+0000 7fbdc4542180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:45:53.024 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:45:53.133 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.132+0000 7ff427205700 1 Processor -- start 2023-10-06T02:45:53.134 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.132+0000 7ff427205700 1 -- start start 2023-10-06T02:45:53.135 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.133+0000 7ff427205700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff4200cae00 0x7ff4200aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:53.135 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.133+0000 7ff427205700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4200cb2a0 0x7ff4200aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:53.135 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.133+0000 7ff427205700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42006d350 con 0x7ff42015daa0 2023-10-06T02:45:53.136 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.133+0000 7ff427205700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4200c9ac0 con 0x7ff4200cae00 2023-10-06T02:45:53.136 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.133+0000 7ff427205700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42006c740 con 0x7ff4200cb2a0 2023-10-06T02:45:53.136 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff41ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff4200cae00 0x7ff4200aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:53.136 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff4257a2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4200cb2a0 0x7ff4200aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:53.136 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff424fa1700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff42015daa0 0x7ff42015de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:39032/0 (socket says 172.21.15.81:39032) 2023-10-06T02:45:53.136 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff4257a2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4200cb2a0 0x7ff4200aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:41434/0 (socket says 172.21.15.81:41434) 2023-10-06T02:45:53.136 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff424fa1700 1 -- 172.21.15.81:0/2259319173 learned_addr learned my addr 172.21.15.81:0/2259319173 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:45:53.137 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff41ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff4200cae00 0x7ff4200aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:40602/0 (socket says 172.21.15.81:40602) 2023-10-06T02:45:53.137 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff4257a2700 1 -- 172.21.15.81:0/2259319173 >> v2:172.21.15.83:3300/0 conn(0x7ff4200cae00 msgr2=0x7ff4200aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:45:53.137 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff4257a2700 1 --2- 172.21.15.81:0/2259319173 >> v2:172.21.15.83:3300/0 conn(0x7ff4200cae00 0x7ff4200aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:53.137 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff4257a2700 1 -- 172.21.15.81:0/2259319173 >> v1:172.21.15.83:6789/0 conn(0x7ff42015daa0 legacy=0x7ff42015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:53.137 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff4257a2700 1 -- 172.21.15.81:0/2259319173 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42006ca20 con 0x7ff4200cb2a0 2023-10-06T02:45:53.138 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff4257a2700 1 --2- 172.21.15.81:0/2259319173 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4200cb2a0 0x7ff4200aadd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff418009e60 tx=0x7ff418009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99200792a724d21b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:53.138 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff41f7fe700 1 -- 172.21.15.81:0/2259319173 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800e070 con 0x7ff4200cb2a0 2023-10-06T02:45:53.138 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff41f7fe700 1 -- 172.21.15.81:0/2259319173 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800bb60 con 0x7ff4200cb2a0 2023-10-06T02:45:53.139 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.134+0000 7ff41f7fe700 1 -- 172.21.15.81:0/2259319173 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418012430 con 0x7ff4200cb2a0 2023-10-06T02:45:53.142 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.135+0000 7ff427205700 1 -- 172.21.15.81:0/2259319173 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4200cb2a0 msgr2=0x7ff4200aadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:53.142 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.135+0000 7ff427205700 1 --2- 172.21.15.81:0/2259319173 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4200cb2a0 0x7ff4200aadd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff418009e60 tx=0x7ff418009780 comp rx=0 tx=0).stop 2023-10-06T02:45:53.142 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.135+0000 7ff427205700 1 -- 172.21.15.81:0/2259319173 shutdown_connections 2023-10-06T02:45:53.142 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.135+0000 7ff427205700 1 --2- 172.21.15.81:0/2259319173 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4200cb2a0 0x7ff4200aadd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:53.142 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.135+0000 7ff427205700 1 --2- 172.21.15.81:0/2259319173 >> v2:172.21.15.83:3300/0 conn(0x7ff4200cae00 0x7ff4200aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:53.143 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.135+0000 7ff427205700 1 -- 172.21.15.81:0/2259319173 >> 172.21.15.81:0/2259319173 conn(0x7ff4200c9ca0 msgr2=0x7ff4200ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:53.143 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.135+0000 7ff427205700 1 -- 172.21.15.81:0/2259319173 shutdown_connections 2023-10-06T02:45:53.143 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.135+0000 7ff427205700 1 -- 172.21.15.81:0/2259319173 wait complete. 2023-10-06T02:45:53.143 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.136+0000 7ff427205700 1 Processor -- start 2023-10-06T02:45:53.143 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.136+0000 7ff427205700 1 -- start start 2023-10-06T02:45:53.143 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff427205700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4200cae00 0x7ff420157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:53.144 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff427205700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4200cb2a0 0x7ff4200c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:53.144 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff427205700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff42015daa0 0x7ff42016d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:45:53.144 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff427205700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4200c52d0 con 0x7ff4200cb2a0 2023-10-06T02:45:53.144 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff427205700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4200c46c0 con 0x7ff4200cae00 2023-10-06T02:45:53.144 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff427205700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4200c49a0 con 0x7ff42015daa0 2023-10-06T02:45:53.144 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff41ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4200cb2a0 0x7ff4200c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:53.145 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff41ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4200cb2a0 0x7ff4200c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55586/0 (socket says 172.21.15.81:55586) 2023-10-06T02:45:53.145 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff41ffff700 1 -- 172.21.15.81:0/214808060 learned_addr learned my addr 172.21.15.81:0/214808060 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:45:53.145 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff424fa1700 1 --2- 172.21.15.81:0/214808060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4200cae00 0x7ff420157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:53.145 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff4257a2700 1 --2- 172.21.15.81:0/214808060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff42015daa0 0x7ff42016d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:45:53.145 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff41ffff700 1 -- 172.21.15.81:0/214808060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff42015daa0 msgr2=0x7ff42016d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:53.145 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff41ffff700 1 --2- 172.21.15.81:0/214808060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff42015daa0 0x7ff42016d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff41ffff700 1 -- 172.21.15.81:0/214808060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4200cae00 msgr2=0x7ff420157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff41ffff700 1 --2- 172.21.15.81:0/214808060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4200cae00 0x7ff420157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff41ffff700 1 -- 172.21.15.81:0/214808060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418009a20 con 0x7ff4200cb2a0 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.137+0000 7ff41ffff700 1 --2- 172.21.15.81:0/214808060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4200cb2a0 0x7ff4200c6c40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e930 tx=0x7ff40c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.138+0000 7ff41cff9700 1 -- 172.21.15.81:0/214808060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c013680 con 0x7ff4200cb2a0 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.138+0000 7ff41cff9700 1 -- 172.21.15.81:0/214808060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0137e0 con 0x7ff4200cb2a0 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.138+0000 7ff427205700 1 -- 172.21.15.81:0/214808060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4200c4c80 con 0x7ff4200cb2a0 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.138+0000 7ff41cff9700 1 -- 172.21.15.81:0/214808060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c013b80 con 0x7ff4200cb2a0 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.138+0000 7ff427205700 1 -- 172.21.15.81:0/214808060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420158340 con 0x7ff4200cb2a0 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.139+0000 7ff41cff9700 1 -- 172.21.15.81:0/214808060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff40c005c80 con 0x7ff4200cb2a0 2023-10-06T02:45:53.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.139+0000 7ff41cff9700 1 -- 172.21.15.81:0/214808060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1879+0+0 (secure 0 0 0) 0x7ff40c00cbb0 con 0x7ff4200cb2a0 2023-10-06T02:45:53.147 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.139+0000 7ff427205700 1 -- 172.21.15.81:0/214808060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4200c5440 con 0x7ff4200cb2a0 2023-10-06T02:45:53.147 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.141+0000 7ff41cff9700 1 -- 172.21.15.81:0/214808060 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff40c021060 con 0x7ff4200cb2a0 2023-10-06T02:45:53.211 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.210+0000 7ff427205700 1 -- 172.21.15.81:0/214808060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4200c5120 con 0x7ff4200cb2a0 2023-10-06T02:45:53.211 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.210+0000 7ff41cff9700 1 -- 172.21.15.81:0/214808060 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7013 (secure 0 0 0) 0x7ff40c017070 con 0x7ff4200cb2a0 2023-10-06T02:45:53.212 INFO:teuthology.misc.health.smithi081.stdout: 2023-10-06T02:45:53.212 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":11,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:45:52.954070+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:45:53.213 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.211+0000 7ff427205700 1 -- 172.21.15.81:0/214808060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4200cb2a0 msgr2=0x7ff4200c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:45:53.213 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.211+0000 7ff427205700 1 --2- 172.21.15.81:0/214808060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4200cb2a0 0x7ff4200c6c40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e930 tx=0x7ff40c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:45:53.213 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.211+0000 7ff427205700 1 -- 172.21.15.81:0/214808060 shutdown_connections 2023-10-06T02:45:53.213 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.211+0000 7ff427205700 1 --2- 172.21.15.81:0/214808060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff42015daa0 0x7ff42016d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:53.213 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.211+0000 7ff427205700 1 --2- 172.21.15.81:0/214808060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4200cae00 0x7ff420157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:53.213 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.211+0000 7ff427205700 1 --2- 172.21.15.81:0/214808060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4200cb2a0 0x7ff4200c6c40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:45:53.213 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.211+0000 7ff427205700 1 -- 172.21.15.81:0/214808060 >> 172.21.15.81:0/214808060 conn(0x7ff4200c9ca0 msgr2=0x7ff4200c7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:45:53.213 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.211+0000 7ff427205700 1 -- 172.21.15.81:0/214808060 shutdown_connections 2023-10-06T02:45:53.214 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:45:53.211+0000 7ff427205700 1 -- 172.21.15.81:0/214808060 wait complete. 2023-10-06T02:45:53.223 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T02:45:53.349 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:53.348+0000 7fc422de9180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T02:45:53.486 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:53.485+0000 7fc422de9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:45:53.561 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:53.560+0000 7fbdc4542180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T02:45:53.578 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:53.577+0000 7fc422de9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:45:53.698 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:53.697+0000 7fbdc4542180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:45:53.781 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:53.781+0000 7fbdc4542180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:45:53.823 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:53.822+0000 7fc422de9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T02:45:53.899 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:53.898+0000 7fc422de9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:45:53.974 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-06T02:45:53.973+0000 7fcea54ed700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T02:45:53.975 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T02:45:53.974+0000 7efec7c63700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T02:45:53.975 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T02:45:53.975+0000 7fec22d08700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T02:45:53.976 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-06T02:45:53.975+0000 7fce9f2e6700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:45:53.976 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T02:45:53.976+0000 7efec1a5c700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:45:53.977 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T02:45:53.976+0000 7fec1cb01700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:45:53.978 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-06T02:45:53.978+0000 7f040acb3700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T02:45:53.980 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-06T02:45:53.979+0000 7f0404aac700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:45:53.980 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-06T02:45:53.979+0000 7f6d170ed700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T02:45:53.981 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-06T02:45:53.980+0000 7ff441d45700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T02:45:53.982 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T02:45:53.981+0000 7f702dd06700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T02:45:53.983 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T02:45:53.981+0000 7f24d7d70700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T02:45:53.983 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T02:45:53.982+0000 7f70272fe700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:45:53.983 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-06T02:45:53.981+0000 7f6d10ee6700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:45:53.984 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T02:45:53.983+0000 7f24d1b69700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:45:53.984 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-06T02:45:53.981+0000 7ff43bb3e700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:45:54.037 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:54.036+0000 7fbdc4542180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T02:45:54.113 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:54.112+0000 7fbdc4542180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:45:54.728 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:54.727+0000 7fc422de9180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T02:45:54.800 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:54.799+0000 7fc422de9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:45:54.874 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:54.873+0000 7fc422de9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:45:54.936 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:54.935+0000 7fbdc4542180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T02:45:55.011 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:55.010+0000 7fc422de9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:45:55.013 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:55.012+0000 7fbdc4542180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:45:55.088 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:55.087+0000 7fbdc4542180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:45:55.095 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:55.095+0000 7fc422de9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:45:55.218 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:55.217+0000 7fbdc4542180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:45:55.246 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:55.245+0000 7fc422de9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:45:55.300 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:55.299+0000 7fbdc4542180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:45:55.321 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:55.320+0000 7fc422de9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:45:55.396 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:55.395+0000 7fc422de9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:45:55.449 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:55.448+0000 7fbdc4542180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:45:55.470 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:55.469+0000 7fc422de9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:45:55.527 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:55.525+0000 7fbdc4542180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:45:55.602 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:55.601+0000 7fbdc4542180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:45:55.676 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T02:45:55.675+0000 7fbdc4542180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:45:56.500 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:56.499+0000 7fc3dc1ed700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T02:45:56.500 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T02:45:56.499+0000 7fc3dc1ed700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T02:46:00.030 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:00.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.144+0000 7fcfa6353700 1 Processor -- start 2023-10-06T02:46:00.146 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.144+0000 7fcfa6353700 1 -- start start 2023-10-06T02:46:00.154 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.144+0000 7fcfa6353700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcfa01578d0 0x7fcfa00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.144+0000 7fcfa6353700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa00d07c0 con 0x7fcfa006d120 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.144+0000 7fcfa6353700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa00cfbb0 con 0x7fcfa0157ca0 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.144+0000 7fcfa6353700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00cfe90 con 0x7fcfa01578d0 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcfa48f0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcfa006d120 0x7fcfa006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40352/0 (socket says 172.21.15.81:40352) 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcfa48f0700 1 -- 172.21.15.81:0/2230531554 learned_addr learned my addr 172.21.15.81:0/2230531554 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960369855 0 0) 0x7fcfa00d07c0 con 0x7fcfa006d120 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9ffff700 1 --2- 172.21.15.81:0/2230531554 >> v2:172.21.15.83:3300/0 conn(0x7fcfa01578d0 0x7fcfa00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf88003570 con 0x7fcfa006d120 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 270095133 0 0) 0x7fcf88003570 con 0x7fcfa006d120 2023-10-06T02:46:00.155 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 >> v2:172.21.15.83:3300/0 conn(0x7fcfa01578d0 msgr2=0x7fcfa00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 --2- 172.21.15.81:0/2230531554 >> v2:172.21.15.83:3300/0 conn(0x7fcfa01578d0 0x7fcfa00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 >> v1:172.21.15.83:6789/0 conn(0x7fcfa0157ca0 legacy=0x7fcfa015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa00d0170 con 0x7fcfa006d120 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fcf980017f0 con 0x7fcfa006d120 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 >> v1:172.21.15.81:6789/0 conn(0x7fcfa006d120 legacy=0x7fcfa006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88003a60 0x7fcf88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf88004810 0x7fcf88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf880051c0 0x7fcf8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00cfe90 con 0x7fcf88003a60 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8800c0d0 con 0x7fcf88004810 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8800c290 con 0x7fcf880051c0 2023-10-06T02:46:00.156 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9ffff700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88003a60 0x7fcf88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.157 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcf9f7fe700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf88004810 0x7fcf88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.157 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.145+0000 7fcfa48f0700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf880051c0 0x7fcf8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.157 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcf9ffff700 1 -- 172.21.15.81:0/2230531554 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf880051c0 msgr2=0x7fcf8800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:00.157 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcf9ffff700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf880051c0 0x7fcf8800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.157 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcf9ffff700 1 -- 172.21.15.81:0/2230531554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf88004810 msgr2=0x7fcf88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:00.157 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcf9ffff700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf88004810 0x7fcf88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.157 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcf9ffff700 1 -- 172.21.15.81:0/2230531554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88003570 con 0x7fcf88003a60 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcfa48f0700 1 -- 172.21.15.81:0/2230531554 reap_dead start 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcf9ffff700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88003a60 0x7fcf88003e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009c00 tx=0x7fcf900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0d6915b8a97072 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000e710 con 0x7fcf88003a60 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9000e870 con 0x7fcf88003a60 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcf9effd700 1 -- 172.21.15.81:0/2230531554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000ec30 con 0x7fcf88003a60 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcfa6353700 1 -- 172.21.15.81:0/2230531554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88003a60 msgr2=0x7fcf88003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcfa6353700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88003a60 0x7fcf88003e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009c00 tx=0x7fcf900091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcfa6353700 1 -- 172.21.15.81:0/2230531554 shutdown_connections 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcfa6353700 1 --2- 172.21.15.81:0/2230531554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88003a60 0x7fcf88003e70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.158 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcfa6353700 1 -- 172.21.15.81:0/2230531554 >> 172.21.15.81:0/2230531554 conn(0x7fcfa006bb90 msgr2=0x7fcfa006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.146+0000 7fcfa6353700 1 -- 172.21.15.81:0/2230531554 shutdown_connections 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.147+0000 7fcfa6353700 1 -- 172.21.15.81:0/2230531554 wait complete. 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.148+0000 7fcfa6353700 1 Processor -- start 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.148+0000 7fcfa6353700 1 -- start start 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.148+0000 7fcfa6353700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf88003a60 0x7fcfa00b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.148+0000 7fcfa6353700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfa016ebb0 0x7fcfa00c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa6353700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa0069ac0 0x7fcfa0069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa6353700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00b6170 con 0x7fcfa0069ac0 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa6353700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa006a470 con 0x7fcf88003a60 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa6353700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa016b970 con 0x7fcfa016ebb0 2023-10-06T02:46:00.159 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa48f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa0069ac0 0x7fcfa0069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa48f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa0069ac0 0x7fcfa0069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55612/0 (socket says 172.21.15.81:55612) 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa48f0700 1 -- 172.21.15.81:0/2035564640 learned_addr learned my addr 172.21.15.81:0/2035564640 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcf9ffff700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf88003a60 0x7fcfa00b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcf9f7fe700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfa016ebb0 0x7fcfa00c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa48f0700 1 -- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfa016ebb0 msgr2=0x7fcfa00c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa48f0700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfa016ebb0 0x7fcfa00c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa48f0700 1 -- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf88003a60 msgr2=0x7fcfa00b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa48f0700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf88003a60 0x7fcfa00b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa48f0700 1 -- 172.21.15.81:0/2035564640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa016b4e0 con 0x7fcfa0069ac0 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa48f0700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa0069ac0 0x7fcfa0069f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0063f70 tx=0x7fcf98001390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:00.160 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcf87fff700 1 -- 172.21.15.81:0/2035564640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98017070 con 0x7fcfa0069ac0 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcf87fff700 1 -- 172.21.15.81:0/2035564640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9800eb60 con 0x7fcfa0069ac0 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcf87fff700 1 -- 172.21.15.81:0/2035564640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98013420 con 0x7fcfa0069ac0 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa016a990 con 0x7fcfa0069ac0 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.149+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa016ae90 con 0x7fcfa0069ac0 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.150+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa016b670 con 0x7fcfa0069ac0 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.150+0000 7fcf87fff700 1 -- 172.21.15.81:0/2035564640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf980137d0 con 0x7fcfa0069ac0 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.151+0000 7fcf87fff700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf8c066f30 0x7fcf8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.151+0000 7fcf87fff700 1 -- 172.21.15.81:0/2035564640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcf98083ff0 con 0x7fcfa0069ac0 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.151+0000 7fcf9ffff700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf8c066f30 0x7fcf8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.161 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.151+0000 7fcf9ffff700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf8c066f30 0x7fcf8c0693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcf900091e0 tx=0x7fcf9001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:00.162 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.155+0000 7fcf87fff700 1 -- 172.21.15.81:0/2035564640 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf98051670 con 0x7fcfa0069ac0 2023-10-06T02:46:00.341 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.339+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfa00d0450 con 0x7fcfa0069ac0 2023-10-06T02:46:00.341 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.339+0000 7fcf87fff700 1 -- 172.21.15.81:0/2035564640 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7fcf98002030 con 0x7fcfa0069ac0 2023-10-06T02:46:00.342 INFO:teuthology.misc.health.smithi081.stdout: 2023-10-06T02:46:00.342 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":16,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:45:57.999604+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:00.344 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf8c066f30 msgr2=0x7fcf8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.345 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf8c066f30 0x7fcf8c0693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcf900091e0 tx=0x7fcf9001a000 comp rx=0 tx=0).stop 2023-10-06T02:46:00.345 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa0069ac0 msgr2=0x7fcfa0069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.345 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa0069ac0 0x7fcfa0069f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0063f70 tx=0x7fcf98001390 comp rx=0 tx=0).stop 2023-10-06T02:46:00.345 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 shutdown_connections 2023-10-06T02:46:00.345 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa0069ac0 0x7fcfa0069f30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.345 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf8c066f30 0x7fcf8c0693e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.346 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf88003a60 0x7fcfa00b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.346 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 --2- 172.21.15.81:0/2035564640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfa016ebb0 0x7fcfa00c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.346 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 >> 172.21.15.81:0/2035564640 conn(0x7fcfa006bb90 msgr2=0x7fcfa0068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:00.346 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 shutdown_connections 2023-10-06T02:46:00.346 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T02:46:00.342+0000 7fcfa6353700 1 -- 172.21.15.81:0/2035564640 wait complete. 2023-10-06T02:46:00.356 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T02:46:00.356 INFO:tasks.ceph:Creating RBD pool 2023-10-06T02:46:00.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T02:46:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.467+0000 7f4c4a8dd700 1 Processor -- start 2023-10-06T02:46:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.467+0000 7f4c4a8dd700 1 -- start start 2023-10-06T02:46:00.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a8dd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4c440d0b80 0x7f4c440cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a8dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c4406d700 0x7f4c4415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a8dd700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c440cf2d0 con 0x7f4c440d02b0 2023-10-06T02:46:00.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a8dd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4415a690 con 0x7f4c440d0b80 2023-10-06T02:46:00.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a8dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4406dc00 con 0x7f4c4406d700 2023-10-06T02:46:00.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a0dc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c4406d700 0x7f4c4415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c498db700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4c440d0b80 0x7f4c440cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a0dc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c4406d700 0x7f4c4415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:48054/0 (socket says 172.21.15.81:48054) 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c498db700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4c440d0b80 0x7f4c440cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:57818/0 (socket says 172.21.15.81:57818) 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a0dc700 1 -- 172.21.15.81:0/4270747617 learned_addr learned my addr 172.21.15.81:0/4270747617 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a0dc700 1 -- 172.21.15.81:0/4270747617 >> v2:172.21.15.83:3300/0 conn(0x7f4c440d0b80 msgr2=0x7f4c440cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a0dc700 1 --2- 172.21.15.81:0/4270747617 >> v2:172.21.15.83:3300/0 conn(0x7f4c440d0b80 0x7f4c440cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a0dc700 1 -- 172.21.15.81:0/4270747617 >> v1:172.21.15.83:6789/0 conn(0x7f4c440d02b0 legacy=0x7f4c4406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c4a0dc700 1 -- 172.21.15.81:0/4270747617 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c440cf570 con 0x7f4c4406d700 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.468+0000 7f4c498db700 1 --2- 172.21.15.81:0/4270747617 >> v2:172.21.15.83:3300/0 conn(0x7f4c440d0b80 0x7f4c440cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c4a0dc700 1 --2- 172.21.15.81:0/4270747617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c4406d700 0x7f4c4415b320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009f20 tx=0x7f4c3c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=606edbc19a813598 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c488d9700 1 -- 172.21.15.81:0/4270747617 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00e070 con 0x7f4c4406d700 2023-10-06T02:46:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c488d9700 1 -- 172.21.15.81:0/4270747617 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c00b9d0 con 0x7f4c4406d700 2023-10-06T02:46:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c488d9700 1 -- 172.21.15.81:0/4270747617 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0092e0 con 0x7f4c4406d700 2023-10-06T02:46:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4270747617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c4406d700 msgr2=0x7f4c4415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c4a8dd700 1 --2- 172.21.15.81:0/4270747617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c4406d700 0x7f4c4415b320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009f20 tx=0x7f4c3c009840 comp rx=0 tx=0).stop 2023-10-06T02:46:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4270747617 shutdown_connections 2023-10-06T02:46:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c4a8dd700 1 --2- 172.21.15.81:0/4270747617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c4406d700 0x7f4c4415b320 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c4a8dd700 1 --2- 172.21.15.81:0/4270747617 >> v2:172.21.15.83:3300/0 conn(0x7f4c440d0b80 0x7f4c440cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4270747617 >> 172.21.15.81:0/4270747617 conn(0x7f4c44063230 msgr2=0x7f4c44063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4270747617 shutdown_connections 2023-10-06T02:46:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.469+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4270747617 wait complete. 2023-10-06T02:46:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.470+0000 7f4c4a8dd700 1 Processor -- start 2023-10-06T02:46:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c4a8dd700 1 -- start start 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c4a8dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4406d700 0x7f4c4414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c4a8dd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c440d02b0 0x7f4c4414cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c4a8dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c440d0b80 0x7f4c4414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c4a8dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4414d5b0 con 0x7f4c4406d700 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c4a8dd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4414d820 con 0x7f4c440d02b0 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c4a8dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4414db00 con 0x7f4c440d0b80 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c498db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4406d700 0x7f4c4414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c498db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4406d700 0x7f4c4414b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57750/0 (socket says 172.21.15.81:57750) 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c498db700 1 -- 172.21.15.81:0/4059043454 learned_addr learned my addr 172.21.15.81:0/4059043454 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c4a0dc700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c440d0b80 0x7f4c4414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.471+0000 7f4c490da700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c440d02b0 0x7f4c4414cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c498db700 1 -- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c440d0b80 msgr2=0x7f4c4414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c498db700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c440d0b80 0x7f4c4414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c498db700 1 -- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c440d02b0 msgr2=0x7f4c4414cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c498db700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c440d02b0 0x7f4c4414cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c498db700 1 -- 172.21.15.81:0/4059043454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40009420 con 0x7f4c4406d700 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c498db700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4406d700 0x7f4c4414b680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000ec80 tx=0x7f4c400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c39ffb700 1 -- 172.21.15.81:0/4059043454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000c850 con 0x7f4c4406d700 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c39ffb700 1 -- 172.21.15.81:0/4059043454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4000c9b0 con 0x7f4c4406d700 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c009ae0 con 0x7f4c4406d700 2023-10-06T02:46:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c39ffb700 1 -- 172.21.15.81:0/4059043454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000cd30 con 0x7f4c4406d700 2023-10-06T02:46:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.472+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4414e0c0 con 0x7f4c4406d700 2023-10-06T02:46:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.473+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c440676e0 con 0x7f4c4406d700 2023-10-06T02:46:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.474+0000 7f4c39ffb700 1 -- 172.21.15.81:0/4059043454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c40013680 con 0x7f4c4406d700 2023-10-06T02:46:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.474+0000 7f4c39ffb700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4c28066f30 0x7f4c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.474+0000 7f4c39ffb700 1 -- 172.21.15.81:0/4059043454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4c40084bb0 con 0x7f4c4406d700 2023-10-06T02:46:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.475+0000 7f4c490da700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4c28066f30 0x7f4c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.475+0000 7f4c490da700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4c28066f30 0x7f4c280693e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c4415ccd0 tx=0x7f4c34007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.478+0000 7f4c39ffb700 1 -- 172.21.15.81:0/4059043454 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c40055c80 con 0x7f4c4406d700 2023-10-06T02:46:00.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:00.661+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f4c44071b10 con 0x7f4c4406d700 2023-10-06T02:46:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.362+0000 7f4c39ffb700 1 -- 172.21.15.81:0/4059043454 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f4c40055810 con 0x7f4c4406d700 2023-10-06T02:46:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4c28066f30 msgr2=0x7f4c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4c28066f30 0x7f4c280693e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c4415ccd0 tx=0x7f4c34007ec0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4406d700 msgr2=0x7f4c4414b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4406d700 0x7f4c4414b680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000ec80 tx=0x7f4c400091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 shutdown_connections 2023-10-06T02:46:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c440d0b80 0x7f4c4414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4406d700 0x7f4c4414b680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4c28066f30 0x7f4c280693e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 --2- 172.21.15.81:0/4059043454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c440d02b0 0x7f4c4414cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 >> 172.21.15.81:0/4059043454 conn(0x7f4c44063230 msgr2=0x7f4c44068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 shutdown_connections 2023-10-06T02:46:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.365+0000 7f4c4a8dd700 1 -- 172.21.15.81:0/4059043454 wait complete. 2023-10-06T02:46:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'rbd' created 2023-10-06T02:46:01.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T02:46:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.493+0000 7ff22edcb700 1 Processor -- start 2023-10-06T02:46:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.493+0000 7ff22edcb700 1 -- start start 2023-10-06T02:46:01.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.494+0000 7ff22edcb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2281577d0 0x7ff2280ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.494+0000 7ff22edcb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff22806e490 0x7ff22806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.494+0000 7ff22edcb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff22806d0e0 0x7ff22815d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.494+0000 7ff22edcb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2280ac790 con 0x7ff2281577d0 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.494+0000 7ff22edcb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22815a320 con 0x7ff22806d0e0 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.494+0000 7ff22edcb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22806d530 con 0x7ff22806e490 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.494+0000 7ff22ddc9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2281577d0 0x7ff2280ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.494+0000 7ff22ddc9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2281577d0 0x7ff2280ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57764/0 (socket says 172.21.15.81:57764) 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.494+0000 7ff22ddc9700 1 -- 172.21.15.81:0/1071971580 learned_addr learned my addr 172.21.15.81:0/1071971580 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22e5ca700 1 --2- 172.21.15.81:0/1071971580 >> v2:172.21.15.83:3300/0 conn(0x7ff22806d0e0 0x7ff22815d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22d5c8700 1 --2- 172.21.15.81:0/1071971580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff22806e490 0x7ff22806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22ddc9700 1 -- 172.21.15.81:0/1071971580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff22806e490 msgr2=0x7ff22806cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22ddc9700 1 --2- 172.21.15.81:0/1071971580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff22806e490 0x7ff22806cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22ddc9700 1 -- 172.21.15.81:0/1071971580 >> v2:172.21.15.83:3300/0 conn(0x7ff22806d0e0 msgr2=0x7ff22815d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22ddc9700 1 --2- 172.21.15.81:0/1071971580 >> v2:172.21.15.83:3300/0 conn(0x7ff22806d0e0 0x7ff22815d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22ddc9700 1 -- 172.21.15.81:0/1071971580 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22815a570 con 0x7ff2281577d0 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22e5ca700 1 --2- 172.21.15.81:0/1071971580 >> v2:172.21.15.83:3300/0 conn(0x7ff22806d0e0 0x7ff22815d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22ddc9700 1 --2- 172.21.15.81:0/1071971580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2281577d0 0x7ff2280ac9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff22806b430 tx=0x7ff224009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6660dd5c2947c1da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22cdc7700 1 -- 172.21.15.81:0/1071971580 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400b860 con 0x7ff2281577d0 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22cdc7700 1 -- 172.21.15.81:0/1071971580 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22400b9c0 con 0x7ff2281577d0 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.495+0000 7ff22cdc7700 1 -- 172.21.15.81:0/1071971580 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400bd60 con 0x7ff2281577d0 2023-10-06T02:46:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.496+0000 7ff22edcb700 1 -- 172.21.15.81:0/1071971580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2281577d0 msgr2=0x7ff2280ac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.496+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1071971580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2281577d0 0x7ff2280ac9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff22806b430 tx=0x7ff224009250 comp rx=0 tx=0).stop 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.496+0000 7ff22edcb700 1 -- 172.21.15.81:0/1071971580 shutdown_connections 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.496+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1071971580 >> v2:172.21.15.83:3300/0 conn(0x7ff22806d0e0 0x7ff22815d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.496+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1071971580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2281577d0 0x7ff2280ac9c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.496+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1071971580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff22806e490 0x7ff22806cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.496+0000 7ff22edcb700 1 -- 172.21.15.81:0/1071971580 >> 172.21.15.81:0/1071971580 conn(0x7ff2280cdb30 msgr2=0x7ff22806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.496+0000 7ff22edcb700 1 -- 172.21.15.81:0/1071971580 shutdown_connections 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.496+0000 7ff22edcb700 1 -- 172.21.15.81:0/1071971580 wait complete. 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.497+0000 7ff22edcb700 1 Processor -- start 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.497+0000 7ff22edcb700 1 -- start start 2023-10-06T02:46:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22edcb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff22806d0e0 0x7ff2280c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22edcb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22806e490 0x7ff228153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22edcb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2281577d0 0x7ff228158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22edcb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22816a8e0 con 0x7ff22806e490 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22edcb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280c3000 con 0x7ff22806d0e0 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22edcb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22816e720 con 0x7ff2281577d0 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22d5c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22806e490 0x7ff228153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22d5c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22806e490 0x7ff228153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57766/0 (socket says 172.21.15.81:57766) 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22d5c8700 1 -- 172.21.15.81:0/1671086512 learned_addr learned my addr 172.21.15.81:0/1671086512 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22e5ca700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2281577d0 0x7ff228158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22ddc9700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff22806d0e0 0x7ff2280c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22d5c8700 1 -- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2281577d0 msgr2=0x7ff228158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22d5c8700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2281577d0 0x7ff228158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22d5c8700 1 -- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff22806d0e0 msgr2=0x7ff2280c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22d5c8700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff22806d0e0 0x7ff2280c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22d5c8700 1 -- 172.21.15.81:0/1671086512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2240094f0 con 0x7ff22806e490 2023-10-06T02:46:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22d5c8700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22806e490 0x7ff228153e90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff21800d890 tx=0x7ff218008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff21dffb700 1 -- 172.21.15.81:0/1671086512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180125f0 con 0x7ff22806e490 2023-10-06T02:46:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff21dffb700 1 -- 172.21.15.81:0/1671086512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff218012750 con 0x7ff22806e490 2023-10-06T02:46:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2280c29b0 con 0x7ff22806e490 2023-10-06T02:46:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.498+0000 7ff21dffb700 1 -- 172.21.15.81:0/1671086512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218012af0 con 0x7ff22806e490 2023-10-06T02:46:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.499+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2281590b0 con 0x7ff22806e490 2023-10-06T02:46:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.500+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2280c2810 con 0x7ff22806e490 2023-10-06T02:46:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.500+0000 7ff21dffb700 1 -- 172.21.15.81:0/1671086512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff21801e460 con 0x7ff22806e490 2023-10-06T02:46:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.500+0000 7ff21dffb700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff20c066f30 0x7ff20c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.500+0000 7ff21dffb700 1 -- 172.21.15.81:0/1671086512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7ff218084880 con 0x7ff22806e490 2023-10-06T02:46:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.500+0000 7ff22ddc9700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff20c066f30 0x7ff20c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.501+0000 7ff22ddc9700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff20c066f30 0x7ff20c0693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff22806b430 tx=0x7ff224017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.505+0000 7ff21dffb700 1 -- 172.21.15.81:0/1671086512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2280c2810 con 0x7ff22806e490 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:01.686+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff2280c2810 con 0x7ff22806e490 2023-10-06T02:46:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.372+0000 7ff21dffb700 1 -- 172.21.15.81:0/1671086512 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff2280c2810 con 0x7ff22806e490 2023-10-06T02:46:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff20c066f30 msgr2=0x7ff20c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff20c066f30 0x7ff20c0693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff22806b430 tx=0x7ff224017000 comp rx=0 tx=0).stop 2023-10-06T02:46:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22806e490 msgr2=0x7ff228153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22806e490 0x7ff228153e90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff21800d890 tx=0x7ff218008040 comp rx=0 tx=0).stop 2023-10-06T02:46:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 shutdown_connections 2023-10-06T02:46:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2281577d0 0x7ff228158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff20c066f30 0x7ff20c0693e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff22806d0e0 0x7ff2280c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 --2- 172.21.15.81:0/1671086512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22806e490 0x7ff228153e90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 >> 172.21.15.81:0/1671086512 conn(0x7ff2280cdb30 msgr2=0x7ff2280aa890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 shutdown_connections 2023-10-06T02:46:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.376+0000 7ff22edcb700 1 -- 172.21.15.81:0/1671086512 wait complete. 2023-10-06T02:46:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T02:46:02.390 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T02:46:02.391 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:46:02.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:46:02.393 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:46:02.393 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:46:02.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:46:02.395 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:46:02.395 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:46:02.395 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:46:02.397 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:46:02.397 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:46:02.398 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:46:02.399 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:46:02.400 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T02:46:02.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:02.467 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:46:02.468 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:46:02.468 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-06T02:46:02.466+0000 7f2d9066d700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2023-10-06T02:46:02.477 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:46:02.477 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:46:02.478 INFO:tasks.ceph.mds.d.smithi083.stderr:2023-10-06T02:46:02.476+0000 7ff92e100700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T02:46:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.520+0000 7f92a747b700 1 Processor -- start 2023-10-06T02:46:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.520+0000 7f92a747b700 1 -- start start 2023-10-06T02:46:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a747b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92a0157860 0x7f92a006dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a747b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a006a020 0x7f92a015a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a747b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a00cbec0 con 0x7f92a00cdb60 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a747b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a00cb9d0 con 0x7f92a0157860 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a747b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a015b2d0 con 0x7f92a006a020 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a6479700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92a0157860 0x7f92a006dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a6479700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92a0157860 0x7f92a006dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57814/0 (socket says 172.21.15.81:57814) 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a6479700 1 -- 172.21.15.81:0/802603599 learned_addr learned my addr 172.21.15.81:0/802603599 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a6479700 1 -- 172.21.15.81:0/802603599 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a006a020 msgr2=0x7f92a015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a6479700 1 --2- 172.21.15.81:0/802603599 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a006a020 0x7f92a015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a6479700 1 -- 172.21.15.81:0/802603599 >> v1:172.21.15.83:6789/0 conn(0x7f92a00cdb60 legacy=0x7f92a00cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a6479700 1 -- 172.21.15.81:0/802603599 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00cc180 con 0x7f92a0157860 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a6479700 1 --2- 172.21.15.81:0/802603599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a0157860 0x7f92a006dfe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f929c0099b0 tx=0x7f929c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b9a86d10dc2b33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.521+0000 7f92a5477700 1 -- 172.21.15.81:0/802603599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c00b820 con 0x7f92a0157860 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a5477700 1 -- 172.21.15.81:0/802603599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c00b980 con 0x7f92a0157860 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a5477700 1 -- 172.21.15.81:0/802603599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c00bd20 con 0x7f92a0157860 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a747b700 1 -- 172.21.15.81:0/802603599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a0157860 msgr2=0x7f92a006dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a747b700 1 --2- 172.21.15.81:0/802603599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a0157860 0x7f92a006dfe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f929c0099b0 tx=0x7f929c009250 comp rx=0 tx=0).stop 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a747b700 1 -- 172.21.15.81:0/802603599 shutdown_connections 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a747b700 1 --2- 172.21.15.81:0/802603599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a0157860 0x7f92a006dfe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a747b700 1 --2- 172.21.15.81:0/802603599 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a006a020 0x7f92a015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a747b700 1 -- 172.21.15.81:0/802603599 >> 172.21.15.81:0/802603599 conn(0x7f92a0063230 msgr2=0x7f92a0063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a747b700 1 -- 172.21.15.81:0/802603599 shutdown_connections 2023-10-06T02:46:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.522+0000 7f92a747b700 1 -- 172.21.15.81:0/802603599 wait complete. 2023-10-06T02:46:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.523+0000 7f92a747b700 1 Processor -- start 2023-10-06T02:46:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.523+0000 7f92a747b700 1 -- start start 2023-10-06T02:46:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a747b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a006a020 0x7f92a00ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a747b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a00cdb60 0x7f92a0147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a747b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92a0157860 0x7f92a00c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a747b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00b0910 con 0x7f92a006a020 2023-10-06T02:46:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a747b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a016a590 con 0x7f92a0157860 2023-10-06T02:46:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a747b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a016a870 con 0x7f92a00cdb60 2023-10-06T02:46:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6479700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a006a020 0x7f92a00ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6479700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a006a020 0x7f92a00ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57826/0 (socket says 172.21.15.81:57826) 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6479700 1 -- 172.21.15.81:0/2613144760 learned_addr learned my addr 172.21.15.81:0/2613144760 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6c7a700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92a0157860 0x7f92a00c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a5c78700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a00cdb60 0x7f92a0147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6479700 1 -- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a00cdb60 msgr2=0x7f92a0147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6479700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a00cdb60 0x7f92a0147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6479700 1 -- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92a0157860 msgr2=0x7f92a00c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6479700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92a0157860 0x7f92a00c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6479700 1 -- 172.21.15.81:0/2613144760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0094f0 con 0x7f92a006a020 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6c7a700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92a0157860 0x7f92a00c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a5c78700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a00cdb60 0x7f92a0147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.524+0000 7f92a6479700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a006a020 0x7f92a00ca350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f929c009290 tx=0x7f929c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.525+0000 7f92967fc700 1 -- 172.21.15.81:0/2613144760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c026480 con 0x7f92a006a020 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.525+0000 7f92967fc700 1 -- 172.21.15.81:0/2613144760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c01f070 con 0x7f92a006a020 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.525+0000 7f92967fc700 1 -- 172.21.15.81:0/2613144760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c026850 con 0x7f92a006a020 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.525+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a016ab50 con 0x7f92a006a020 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.525+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a00ca890 con 0x7f92a006a020 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.525+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a00b0ae0 con 0x7f92a006a020 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.526+0000 7f92967fc700 1 -- 172.21.15.81:0/2613144760 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f929c01a440 con 0x7f92a006a020 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.526+0000 7f92967fc700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.526+0000 7f92967fc700 1 -- 172.21.15.81:0/2613144760 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f929c021070 con 0x7f92a006a020 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.526+0000 7f92a5c78700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.527+0000 7f92a5c78700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9284066f30 0x7f92840693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92900079b0 tx=0x7f9290008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:02.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.531+0000 7f92967fc700 1 -- 172.21.15.81:0/2613144760 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f929c053d90 con 0x7f92a006a020 2023-10-06T02:46:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.715+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92a0071b10 con 0x7f92a006a020 2023-10-06T02:46:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.716+0000 7f92967fc700 1 -- 172.21.15.81:0/2613144760 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13612 (secure 0 0 0) 0x7f929c0573b0 con 0x7f92a006a020 2023-10-06T02:46:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:02.718 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:02.361335+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9284066f30 msgr2=0x7f92840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9284066f30 0x7f92840693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92900079b0 tx=0x7f9290008040 comp rx=0 tx=0).stop 2023-10-06T02:46:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a006a020 msgr2=0x7f92a00ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a006a020 0x7f92a00ca350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f929c009290 tx=0x7f929c016000 comp rx=0 tx=0).stop 2023-10-06T02:46:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 shutdown_connections 2023-10-06T02:46:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92a0157860 0x7f92a00c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a006a020 0x7f92a00ca350 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 --2- 172.21.15.81:0/2613144760 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92a00cdb60 0x7f92a0147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 >> 172.21.15.81:0/2613144760 conn(0x7f92a0063230 msgr2=0x7f92a006e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 shutdown_connections 2023-10-06T02:46:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.718+0000 7f92a747b700 1 -- 172.21.15.81:0/2613144760 wait complete. 2023-10-06T02:46:02.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:46:02.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.846+0000 7f7d1c431700 1 Processor -- start 2023-10-06T02:46:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.846+0000 7f7d1c431700 1 -- start start 2023-10-06T02:46:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.847+0000 7f7d1c431700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d140b3bd0 0x7f7d140ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.847+0000 7f7d1c431700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d141583b0 0x7f7d140cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.847+0000 7f7d1c431700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d140b2890 con 0x7f7d14157fe0 2023-10-06T02:46:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.847+0000 7f7d1c431700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d140b4070 con 0x7f7d140b3bd0 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.847+0000 7f7d1c431700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d140b4350 con 0x7f7d141583b0 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.847+0000 7f7d1a1cd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7d14157fe0 0x7f7d140b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39158/0 (socket says 172.21.15.81:39158) 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.847+0000 7f7d199cc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d140b3bd0 0x7f7d140ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.847+0000 7f7d1a1cd700 1 -- 172.21.15.81:0/3213533780 learned_addr learned my addr 172.21.15.81:0/3213533780 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d1a9ce700 1 --2- 172.21.15.81:0/3213533780 >> v2:172.21.15.83:3300/0 conn(0x7f7d141583b0 0x7f7d140cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d191cb700 1 -- 172.21.15.81:0/3213533780 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371363413 0 0) 0x7f7d140b2890 con 0x7f7d14157fe0 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d191cb700 1 -- 172.21.15.81:0/3213533780 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d00003570 con 0x7f7d14157fe0 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d199cc700 1 -- 172.21.15.81:0/3213533780 >> v2:172.21.15.83:3300/0 conn(0x7f7d141583b0 msgr2=0x7f7d140cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d199cc700 1 --2- 172.21.15.81:0/3213533780 >> v2:172.21.15.83:3300/0 conn(0x7f7d141583b0 0x7f7d140cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d199cc700 1 -- 172.21.15.81:0/3213533780 >> v1:172.21.15.81:6789/0 conn(0x7f7d14157fe0 legacy=0x7f7d140b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d199cc700 1 -- 172.21.15.81:0/3213533780 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d140b4630 con 0x7f7d140b3bd0 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d199cc700 1 --2- 172.21.15.81:0/3213533780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d140b3bd0 0x7f7d140ceb30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d140cc640 tx=0x7f7d040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795517cf9dca16d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d191cb700 1 -- 172.21.15.81:0/3213533780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04011630 con 0x7f7d140b3bd0 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d191cb700 1 -- 172.21.15.81:0/3213533780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d04011790 con 0x7f7d140b3bd0 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d191cb700 1 -- 172.21.15.81:0/3213533780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04011b30 con 0x7f7d140b3bd0 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d1c431700 1 -- 172.21.15.81:0/3213533780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d140b3bd0 msgr2=0x7f7d140ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.848+0000 7f7d1c431700 1 --2- 172.21.15.81:0/3213533780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d140b3bd0 0x7f7d140ceb30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d140cc640 tx=0x7f7d040091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.849+0000 7f7d1c431700 1 -- 172.21.15.81:0/3213533780 shutdown_connections 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.849+0000 7f7d1c431700 1 --2- 172.21.15.81:0/3213533780 >> v2:172.21.15.83:3300/0 conn(0x7f7d141583b0 0x7f7d140cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.849+0000 7f7d1c431700 1 --2- 172.21.15.81:0/3213533780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d140b3bd0 0x7f7d140ceb30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.849+0000 7f7d1c431700 1 -- 172.21.15.81:0/3213533780 >> 172.21.15.81:0/3213533780 conn(0x7f7d14067640 msgr2=0x7f7d14067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.849+0000 7f7d1c431700 1 -- 172.21.15.81:0/3213533780 shutdown_connections 2023-10-06T02:46:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.849+0000 7f7d1c431700 1 -- 172.21.15.81:0/3213533780 wait complete. 2023-10-06T02:46:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.850+0000 7f7d1c431700 1 Processor -- start 2023-10-06T02:46:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.850+0000 7f7d1c431700 1 -- start start 2023-10-06T02:46:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.850+0000 7f7d1c431700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d140b3bd0 0x7f7d14159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.850+0000 7f7d1c431700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d14157fe0 0x7f7d14150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.850+0000 7f7d1c431700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d141583b0 0x7f7d14150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.850+0000 7f7d1c431700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14150dd0 con 0x7f7d14157fe0 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d1c431700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1406d9d0 con 0x7f7d141583b0 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d1c431700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1406dcb0 con 0x7f7d140b3bd0 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d199cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d14157fe0 0x7f7d14150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d199cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d14157fe0 0x7f7d14150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57842/0 (socket says 172.21.15.81:57842) 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d199cc700 1 -- 172.21.15.81:0/4101402754 learned_addr learned my addr 172.21.15.81:0/4101402754 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d1a9ce700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d141583b0 0x7f7d14150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d1a1cd700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d140b3bd0 0x7f7d14159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d199cc700 1 -- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d140b3bd0 msgr2=0x7f7d14159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d199cc700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d140b3bd0 0x7f7d14159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d199cc700 1 -- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d141583b0 msgr2=0x7f7d14150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d199cc700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d141583b0 0x7f7d14150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d199cc700 1 -- 172.21.15.81:0/4101402754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d04009420 con 0x7f7d14157fe0 2023-10-06T02:46:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d1a1cd700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d140b3bd0 0x7f7d14159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d199cc700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d14157fe0 0x7f7d14150350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d04013000 tx=0x7f7d04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d0a7fc700 1 -- 172.21.15.81:0/4101402754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04011b10 con 0x7f7d14157fe0 2023-10-06T02:46:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d0a7fc700 1 -- 172.21.15.81:0/4101402754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d040253f0 con 0x7f7d14157fe0 2023-10-06T02:46:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1406df90 con 0x7f7d14157fe0 2023-10-06T02:46:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d0a7fc700 1 -- 172.21.15.81:0/4101402754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04025790 con 0x7f7d14157fe0 2023-10-06T02:46:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.851+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1406e550 con 0x7f7d14157fe0 2023-10-06T02:46:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.852+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1416a510 con 0x7f7d14157fe0 2023-10-06T02:46:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.852+0000 7f7d0a7fc700 1 -- 172.21.15.81:0/4101402754 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d04025b80 con 0x7f7d14157fe0 2023-10-06T02:46:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.853+0000 7f7d0a7fc700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7cf8066f30 0x7f7cf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.853+0000 7f7d0a7fc700 1 -- 172.21.15.81:0/4101402754 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7d04085ab0 con 0x7f7d14157fe0 2023-10-06T02:46:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.853+0000 7f7d1a1cd700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7cf8066f30 0x7f7cf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.853+0000 7f7d1a1cd700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7cf8066f30 0x7f7cf80693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d100058d0 tx=0x7f7d10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:02.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:02.857+0000 7f7d0a7fc700 1 -- 172.21.15.81:0/4101402754 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d1416a510 con 0x7f7d14157fe0 2023-10-06T02:46:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.036+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d1416a510 con 0x7f7d14157fe0 2023-10-06T02:46:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.036+0000 7f7d0a7fc700 1 -- 172.21.15.81:0/4101402754 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d1416a510 con 0x7f7d14157fe0 2023-10-06T02:46:03.038 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:03.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7cf8066f30 msgr2=0x7f7cf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7cf8066f30 0x7f7cf80693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d100058d0 tx=0x7f7d10009040 comp rx=0 tx=0).stop 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d14157fe0 msgr2=0x7f7d14150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d14157fe0 0x7f7d14150350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d04013000 tx=0x7f7d04017000 comp rx=0 tx=0).stop 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 shutdown_connections 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7cf8066f30 0x7f7cf80693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d141583b0 0x7f7d14150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d140b3bd0 0x7f7d14159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 --2- 172.21.15.81:0/4101402754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d14157fe0 0x7f7d14150350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 >> 172.21.15.81:0/4101402754 conn(0x7f7d14067640 msgr2=0x7f7d14153380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 shutdown_connections 2023-10-06T02:46:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.038+0000 7f7d1c431700 1 -- 172.21.15.81:0/4101402754 wait complete. 2023-10-06T02:46:03.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:03.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.166+0000 7f3e1d379700 1 Processor -- start 2023-10-06T02:46:03.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.166+0000 7f3e1d379700 1 -- start start 2023-10-06T02:46:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.167+0000 7f3e1d379700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 0x7f3e180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.167+0000 7f3e1d379700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e180d07c0 con 0x7f3e1806d120 2023-10-06T02:46:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.167+0000 7f3e1d379700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e180cfbb0 con 0x7f3e18157ca0 2023-10-06T02:46:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.167+0000 7f3e1d379700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180cfe90 con 0x7f3e181578d0 2023-10-06T02:46:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.167+0000 7f3e177fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3e1806d120 0x7f3e1815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39160/0 (socket says 172.21.15.81:39160) 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.167+0000 7f3e177fe700 1 -- 172.21.15.81:0/1099412143 learned_addr learned my addr 172.21.15.81:0/1099412143 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.167+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291819446 0 0) 0x7f3e180d07c0 con 0x7f3e1806d120 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.167+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e04003570 con 0x7f3e1806d120 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.167+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 0x7f3e180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3224408633 0 0) 0x7f3e04003570 con 0x7f3e1806d120 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 msgr2=0x7f3e180cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 0x7f3e180cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 >> v1:172.21.15.83:6789/0 conn(0x7f3e18157ca0 legacy=0x7f3e1815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180d0170 con 0x7f3e1806d120 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f3e100017f0 con 0x7f3e1806d120 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 0x7f3e180cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 >> v1:172.21.15.81:6789/0 conn(0x7f3e1806d120 legacy=0x7f3e1815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e04003a90 0x7f3e04003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e04004810 0x7f3e04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 0x7f3e04005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180cfe90 con 0x7f3e04003a90 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0400bbf0 con 0x7f3e04004810 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0400bdb0 con 0x7f3e181578d0 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e04003a90 0x7f3e04003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e0e7fc700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e04004810 0x7f3e04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e177fe700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 0x7f3e04005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e16ffd700 1 -- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 msgr2=0x7f3e04005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 0x7f3e04005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e16ffd700 1 -- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e04004810 msgr2=0x7f3e04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e04004810 0x7f3e04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e16ffd700 1 -- 172.21.15.81:0/1099412143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04003570 con 0x7f3e04003a90 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e177fe700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e181578d0 0x7f3e04005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e04003a90 0x7f3e04003ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009ba0 tx=0x7f3e08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2092d1ca8bf638c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800c070 con 0x7f3e04003a90 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0800e5e0 con 0x7f3e04003a90 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.168+0000 7f3e167fc700 1 -- 172.21.15.81:0/1099412143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08009510 con 0x7f3e04003a90 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.169+0000 7f3e1d379700 1 -- 172.21.15.81:0/1099412143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e04003a90 msgr2=0x7f3e04003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.169+0000 7f3e1d379700 1 --2- 172.21.15.81:0/1099412143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e04003a90 0x7f3e04003ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009ba0 tx=0x7f3e08008040 comp rx=0 tx=0).stop 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.169+0000 7f3e177fe700 1 -- 172.21.15.81:0/1099412143 reap_dead start 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.169+0000 7f3e1d379700 1 -- 172.21.15.81:0/1099412143 shutdown_connections 2023-10-06T02:46:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.169+0000 7f3e1d379700 1 -- 172.21.15.81:0/1099412143 >> 172.21.15.81:0/1099412143 conn(0x7f3e1806bb90 msgr2=0x7f3e1806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.169+0000 7f3e1d379700 1 -- 172.21.15.81:0/1099412143 shutdown_connections 2023-10-06T02:46:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.169+0000 7f3e1d379700 1 -- 172.21.15.81:0/1099412143 wait complete. 2023-10-06T02:46:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.170+0000 7f3e1d379700 1 Processor -- start 2023-10-06T02:46:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.170+0000 7f3e1d379700 1 -- start start 2023-10-06T02:46:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e1d379700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e04003a90 0x7f3e18151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e1d379700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e1814eb60 0x7f3e1815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e1d379700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1815cd20 0x7f3e1815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e1d379700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1815d190 con 0x7f3e1815cd20 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e1d379700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e18137fe0 con 0x7f3e04003a90 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e1d379700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e18152770 con 0x7f3e1814eb60 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1815cd20 0x7f3e1815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1815cd20 0x7f3e1815da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57858/0 (socket says 172.21.15.81:57858) 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e177fe700 1 -- 172.21.15.81:0/3728459067 learned_addr learned my addr 172.21.15.81:0/3728459067 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e04003a90 0x7f3e18151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e0e7fc700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e1814eb60 0x7f3e1815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e177fe700 1 -- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e1814eb60 msgr2=0x7f3e1815c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e177fe700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e1814eb60 0x7f3e1815c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e177fe700 1 -- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e04003a90 msgr2=0x7f3e18151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e177fe700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e04003a90 0x7f3e18151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e177fe700 1 -- 172.21.15.81:0/3728459067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180b48a0 con 0x7f3e1815cd20 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e0e7fc700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e1814eb60 0x7f3e1815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e177fe700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1815cd20 0x7f3e1815da40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e10000f80 tx=0x7f3e1815b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e0f7fe700 1 -- 172.21.15.81:0/3728459067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10017070 con 0x7f3e1815cd20 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.171+0000 7f3e0f7fe700 1 -- 172.21.15.81:0/3728459067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1000ec90 con 0x7f3e1815cd20 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.172+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e180b4b80 con 0x7f3e1815cd20 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.172+0000 7f3e0f7fe700 1 -- 172.21.15.81:0/3728459067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10004bb0 con 0x7f3e1815cd20 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.172+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e180b5140 con 0x7f3e1815cd20 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.172+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e180b5360 con 0x7f3e1815cd20 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.173+0000 7f3e0f7fe700 1 -- 172.21.15.81:0/3728459067 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e10013420 con 0x7f3e1815cd20 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.173+0000 7f3e0f7fe700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3df8066f60 0x7f3df8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.173+0000 7f3e0f7fe700 1 -- 172.21.15.81:0/3728459067 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3e10084440 con 0x7f3e1815cd20 2023-10-06T02:46:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.173+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3df8066f60 0x7f3df8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.174+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3df8066f60 0x7f3df8069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009960 tx=0x7f3e0801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.177+0000 7f3e0f7fe700 1 -- 172.21.15.81:0/3728459067 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e100518a0 con 0x7f3e1815cd20 2023-10-06T02:46:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.358+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e180d0450 con 0x7f3e1815cd20 2023-10-06T02:46:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.358+0000 7f3e0f7fe700 1 -- 172.21.15.81:0/3728459067 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e10054ec0 con 0x7f3e1815cd20 2023-10-06T02:46:03.360 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3df8066f60 msgr2=0x7f3df8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3df8066f60 0x7f3df8069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009960 tx=0x7f3e0801a000 comp rx=0 tx=0).stop 2023-10-06T02:46:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1815cd20 msgr2=0x7f3e1815da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1815cd20 0x7f3e1815da40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e10000f80 tx=0x7f3e1815b610 comp rx=0 tx=0).stop 2023-10-06T02:46:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 shutdown_connections 2023-10-06T02:46:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1815cd20 0x7f3e1815da40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3df8066f60 0x7f3df8069410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e04003a90 0x7f3e18151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 --2- 172.21.15.81:0/3728459067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3e1814eb60 0x7f3e1815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 >> 172.21.15.81:0/3728459067 conn(0x7f3e1806bb90 msgr2=0x7f3e18156a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 shutdown_connections 2023-10-06T02:46:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.360+0000 7f3e1d379700 1 -- 172.21.15.81:0/3728459067 wait complete. 2023-10-06T02:46:03.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:46:03.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.487+0000 7fd61e437700 1 Processor -- start 2023-10-06T02:46:03.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.487+0000 7fd61e437700 1 -- start start 2023-10-06T02:46:03.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd61e437700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6181578d0 0x7fd6180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd61e437700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd618157ca0 0x7fd61815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd61e437700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd61806d120 0x7fd61806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd61e437700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61806dac0 con 0x7fd61806d120 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd61e437700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6180d07c0 con 0x7fd618157ca0 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd61e437700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180cfbb0 con 0x7fd6181578d0 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd61c9d4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd61806d120 0x7fd61806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd61c9d4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd61806d120 0x7fd61806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57862/0 (socket says 172.21.15.81:57862) 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd61c9d4700 1 -- 172.21.15.81:0/428770842 learned_addr learned my addr 172.21.15.81:0/428770842 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd6177fe700 1 --2- 172.21.15.81:0/428770842 >> v2:172.21.15.83:3300/0 conn(0x7fd618157ca0 0x7fd61815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.488+0000 7fd617fff700 1 --2- 172.21.15.81:0/428770842 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6181578d0 0x7fd6180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.489+0000 7fd61c9d4700 1 -- 172.21.15.81:0/428770842 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6181578d0 msgr2=0x7fd6180cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.489+0000 7fd61c9d4700 1 --2- 172.21.15.81:0/428770842 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6181578d0 0x7fd6180cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.489+0000 7fd61c9d4700 1 -- 172.21.15.81:0/428770842 >> v2:172.21.15.83:3300/0 conn(0x7fd618157ca0 msgr2=0x7fd61815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.489+0000 7fd61c9d4700 1 --2- 172.21.15.81:0/428770842 >> v2:172.21.15.83:3300/0 conn(0x7fd618157ca0 0x7fd61815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.489+0000 7fd61c9d4700 1 -- 172.21.15.81:0/428770842 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6180cfe90 con 0x7fd61806d120 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.489+0000 7fd61c9d4700 1 --2- 172.21.15.81:0/428770842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 0x7fd61806d580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd61806cb70 tx=0x7fd610009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef64daa7cf0ef442 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.489+0000 7fd616ffd700 1 -- 172.21.15.81:0/428770842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61000e070 con 0x7fd61806d120 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.489+0000 7fd616ffd700 1 -- 172.21.15.81:0/428770842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61000b970 con 0x7fd61806d120 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.489+0000 7fd616ffd700 1 -- 172.21.15.81:0/428770842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100092e0 con 0x7fd61806d120 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.490+0000 7fd61e437700 1 -- 172.21.15.81:0/428770842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 msgr2=0x7fd61806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.490+0000 7fd61e437700 1 --2- 172.21.15.81:0/428770842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 0x7fd61806d580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd61806cb70 tx=0x7fd610009840 comp rx=0 tx=0).stop 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.490+0000 7fd61e437700 1 -- 172.21.15.81:0/428770842 shutdown_connections 2023-10-06T02:46:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.490+0000 7fd61e437700 1 --2- 172.21.15.81:0/428770842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 0x7fd61806d580 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.490+0000 7fd61e437700 1 --2- 172.21.15.81:0/428770842 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6181578d0 0x7fd6180cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.490+0000 7fd61e437700 1 --2- 172.21.15.81:0/428770842 >> v2:172.21.15.83:3300/0 conn(0x7fd618157ca0 0x7fd61815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.490+0000 7fd61e437700 1 -- 172.21.15.81:0/428770842 >> 172.21.15.81:0/428770842 conn(0x7fd61806bb90 msgr2=0x7fd61806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.490+0000 7fd61e437700 1 -- 172.21.15.81:0/428770842 shutdown_connections 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.490+0000 7fd61e437700 1 -- 172.21.15.81:0/428770842 wait complete. 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.491+0000 7fd61e437700 1 Processor -- start 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.491+0000 7fd61e437700 1 -- start start 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd61e437700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 0x7fd618154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd61e437700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6181578d0 0x7fd61815ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd61e437700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd618157ca0 0x7fd6180b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd61e437700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd618155050 con 0x7fd61806d120 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd61e437700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd618160520 con 0x7fd6181578d0 2023-10-06T02:46:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd61e437700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61815ef40 con 0x7fd618157ca0 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd617fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 0x7fd618154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd617fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 0x7fd618154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57872/0 (socket says 172.21.15.81:57872) 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd617fff700 1 -- 172.21.15.81:0/2393993495 learned_addr learned my addr 172.21.15.81:0/2393993495 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd6177fe700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6181578d0 0x7fd61815ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd61c9d4700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd618157ca0 0x7fd6180b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd617fff700 1 -- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd618157ca0 msgr2=0x7fd6180b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd617fff700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd618157ca0 0x7fd6180b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd617fff700 1 -- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6181578d0 msgr2=0x7fd61815ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd617fff700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6181578d0 0x7fd61815ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd617fff700 1 -- 172.21.15.81:0/2393993495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610009ae0 con 0x7fd61806d120 2023-10-06T02:46:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd6177fe700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6181578d0 0x7fd61815ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd617fff700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 0x7fd618154b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd60800ec80 tx=0x7fd6080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd5fffff700 1 -- 172.21.15.81:0/2393993495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60800c9d0 con 0x7fd61806d120 2023-10-06T02:46:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd5fffff700 1 -- 172.21.15.81:0/2393993495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60800cb30 con 0x7fd61806d120 2023-10-06T02:46:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61815f220 con 0x7fd61806d120 2023-10-06T02:46:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd5fffff700 1 -- 172.21.15.81:0/2393993495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608013470 con 0x7fd61806d120 2023-10-06T02:46:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.492+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61815f7e0 con 0x7fd61806d120 2023-10-06T02:46:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.494+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61815fe30 con 0x7fd61806d120 2023-10-06T02:46:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.494+0000 7fd5fffff700 1 -- 172.21.15.81:0/2393993495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd608013820 con 0x7fd61806d120 2023-10-06T02:46:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.494+0000 7fd5fffff700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd604066f30 0x7fd6040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.494+0000 7fd5fffff700 1 -- 172.21.15.81:0/2393993495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd6080846d0 con 0x7fd61806d120 2023-10-06T02:46:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.494+0000 7fd6177fe700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd604066f30 0x7fd6040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.495+0000 7fd6177fe700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd604066f30 0x7fd6040693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd6180b6df0 tx=0x7fd60c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.498+0000 7fd5fffff700 1 -- 172.21.15.81:0/2393993495 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd608051b30 con 0x7fd61806d120 2023-10-06T02:46:03.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.723+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6180d0170 con 0x7fd61806d120 2023-10-06T02:46:03.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.724+0000 7fd5fffff700 1 -- 172.21.15.81:0/2393993495 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7fd608017dd0 con 0x7fd61806d120 2023-10-06T02:46:03.726 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:03.726 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/963539092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":963539092},{"type":"v1","addr":"172.21.15.81:6833","nonce":963539092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3218202678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3218202678},{"type":"v1","addr":"172.21.15.81:6835","nonce":3218202678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/913779656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":913779656},{"type":"v1","addr":"172.21.15.83:6836","nonce":913779656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2378748577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2378748577},{"type":"v1","addr":"172.21.15.83:6837","nonce":2378748577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T02:46:03.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd604066f30 msgr2=0x7fd6040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd604066f30 0x7fd6040693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd6180b6df0 tx=0x7fd60c008040 comp rx=0 tx=0).stop 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 msgr2=0x7fd618154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 0x7fd618154b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd60800ec80 tx=0x7fd6080091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 shutdown_connections 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd618157ca0 0x7fd6180b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd61806d120 0x7fd618154b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd604066f30 0x7fd6040693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 --2- 172.21.15.81:0/2393993495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6181578d0 0x7fd61815ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 >> 172.21.15.81:0/2393993495 conn(0x7fd61806bb90 msgr2=0x7fd61815baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 shutdown_connections 2023-10-06T02:46:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.726+0000 7fd61e437700 1 -- 172.21.15.81:0/2393993495 wait complete. 2023-10-06T02:46:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2023-10-06T02:46:03.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.852+0000 7fc5a2888700 1 Processor -- start 2023-10-06T02:46:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.852+0000 7fc5a2888700 1 -- start start 2023-10-06T02:46:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2888700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc59c159b40 0x7fc59c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2888700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc59c068e90 0x7fc59c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2888700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0cee10 con 0x7fc59c159f10 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2888700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0cd040 con 0x7fc59c068e90 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2888700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0cd320 con 0x7fc59c159b40 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2087700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc59c068e90 0x7fc59c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2087700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc59c068e90 0x7fc59c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57882/0 (socket says 172.21.15.81:57882) 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2087700 1 -- 172.21.15.81:0/3264457144 learned_addr learned my addr 172.21.15.81:0/3264457144 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a1886700 1 --2- 172.21.15.81:0/3264457144 >> v2:172.21.15.83:3300/0 conn(0x7fc59c159b40 0x7fc59c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2087700 1 -- 172.21.15.81:0/3264457144 >> v2:172.21.15.83:3300/0 conn(0x7fc59c159b40 msgr2=0x7fc59c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2087700 1 --2- 172.21.15.81:0/3264457144 >> v2:172.21.15.83:3300/0 conn(0x7fc59c159b40 0x7fc59c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2087700 1 -- 172.21.15.81:0/3264457144 >> v1:172.21.15.83:6789/0 conn(0x7fc59c159f10 legacy=0x7fc59c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2087700 1 -- 172.21.15.81:0/3264457144 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c0ce7c0 con 0x7fc59c068e90 2023-10-06T02:46:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a1886700 1 --2- 172.21.15.81:0/3264457144 >> v2:172.21.15.83:3300/0 conn(0x7fc59c159b40 0x7fc59c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.853+0000 7fc5a2087700 1 --2- 172.21.15.81:0/3264457144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 0x7fc59c0cf2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0d0bc0 tx=0x7fc594009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de27128a35e282a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a0884700 1 -- 172.21.15.81:0/3264457144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400e070 con 0x7fc59c068e90 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a0884700 1 -- 172.21.15.81:0/3264457144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400ba10 con 0x7fc59c068e90 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a0884700 1 -- 172.21.15.81:0/3264457144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5940092e0 con 0x7fc59c068e90 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a2888700 1 -- 172.21.15.81:0/3264457144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 msgr2=0x7fc59c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a2888700 1 --2- 172.21.15.81:0/3264457144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 0x7fc59c0cf2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0d0bc0 tx=0x7fc594009840 comp rx=0 tx=0).stop 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a2888700 1 -- 172.21.15.81:0/3264457144 shutdown_connections 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a2888700 1 --2- 172.21.15.81:0/3264457144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 0x7fc59c0cf2a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a2888700 1 --2- 172.21.15.81:0/3264457144 >> v2:172.21.15.83:3300/0 conn(0x7fc59c159b40 0x7fc59c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a2888700 1 -- 172.21.15.81:0/3264457144 >> 172.21.15.81:0/3264457144 conn(0x7fc59c0cd660 msgr2=0x7fc59c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a2888700 1 -- 172.21.15.81:0/3264457144 shutdown_connections 2023-10-06T02:46:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.854+0000 7fc5a2888700 1 -- 172.21.15.81:0/3264457144 wait complete. 2023-10-06T02:46:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.855+0000 7fc5a2888700 1 Processor -- start 2023-10-06T02:46:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.855+0000 7fc5a2888700 1 -- start start 2023-10-06T02:46:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a2888700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 0x7fc59c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a2888700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc59c159b40 0x7fc59c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a2888700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc59c159f10 0x7fc59c15b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a2888700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1564a0 con 0x7fc59c068e90 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a2888700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c15af00 con 0x7fc59c159b40 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a2888700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c15a5d0 con 0x7fc59c159f10 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1886700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 0x7fc59c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1886700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 0x7fc59c1579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57890/0 (socket says 172.21.15.81:57890) 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1886700 1 -- 172.21.15.81:0/856545915 learned_addr learned my addr 172.21.15.81:0/856545915 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a2087700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc59c159f10 0x7fc59c15b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1085700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc59c159b40 0x7fc59c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1886700 1 -- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc59c159f10 msgr2=0x7fc59c15b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1886700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc59c159f10 0x7fc59c15b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1886700 1 -- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc59c159b40 msgr2=0x7fc59c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1886700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc59c159b40 0x7fc59c15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1886700 1 -- 172.21.15.81:0/856545915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594009ae0 con 0x7fc59c068e90 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a2087700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc59c159f10 0x7fc59c15b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1085700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc59c159b40 0x7fc59c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.856+0000 7fc5a1886700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 0x7fc59c1579f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c860 tx=0x7fc598008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.857+0000 7fc591ffb700 1 -- 172.21.15.81:0/856545915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598011600 con 0x7fc59c068e90 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.857+0000 7fc591ffb700 1 -- 172.21.15.81:0/856545915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598011760 con 0x7fc59c068e90 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.857+0000 7fc591ffb700 1 -- 172.21.15.81:0/856545915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598011b00 con 0x7fc59c068e90 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.857+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c15a8b0 con 0x7fc59c068e90 2023-10-06T02:46:03.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.857+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c155f00 con 0x7fc59c068e90 2023-10-06T02:46:03.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.858+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c063e90 con 0x7fc59c068e90 2023-10-06T02:46:03.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.858+0000 7fc591ffb700 1 -- 172.21.15.81:0/856545915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc59800a3e0 con 0x7fc59c068e90 2023-10-06T02:46:03.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.858+0000 7fc591ffb700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc580066f30 0x7fc5800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:03.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.859+0000 7fc591ffb700 1 -- 172.21.15.81:0/856545915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc598084410 con 0x7fc59c068e90 2023-10-06T02:46:03.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.859+0000 7fc5a1085700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc580066f30 0x7fc5800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:03.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.859+0000 7fc5a1085700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc580066f30 0x7fc5800693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc58c006fd0 tx=0x7fc58c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:03.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:03.863+0000 7fc591ffb700 1 -- 172.21.15.81:0/856545915 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc598051870 con 0x7fc59c068e90 2023-10-06T02:46:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.046+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc59c0ceaa0 con 0x7fc59c068e90 2023-10-06T02:46:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.046+0000 7fc591ffb700 1 -- 172.21.15.81:0/856545915 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13599 (secure 0 0 0) 0x7fc598054e90 con 0x7fc59c068e90 2023-10-06T02:46:04.048 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:04.049 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:03.368069+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc580066f30 msgr2=0x7fc5800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc580066f30 0x7fc5800693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc58c006fd0 tx=0x7fc58c008040 comp rx=0 tx=0).stop 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 msgr2=0x7fc59c1579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 0x7fc59c1579f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c860 tx=0x7fc598008040 comp rx=0 tx=0).stop 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 shutdown_connections 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc59c159f10 0x7fc59c15b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59c068e90 0x7fc59c1579f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc580066f30 0x7fc5800693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 --2- 172.21.15.81:0/856545915 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc59c159b40 0x7fc59c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 >> 172.21.15.81:0/856545915 conn(0x7fc59c0cd660 msgr2=0x7fc59c06ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 shutdown_connections 2023-10-06T02:46:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.048+0000 7fc5a2888700 1 -- 172.21.15.81:0/856545915 wait complete. 2023-10-06T02:46:04.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:46:04.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:04.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.176+0000 7fbeae634700 1 Processor -- start 2023-10-06T02:46:04.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.176+0000 7fbeae634700 1 -- start start 2023-10-06T02:46:04.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.176+0000 7fbeae634700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbea81578d0 0x7fbea80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.176+0000 7fbeae634700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 0x7fbea806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.176+0000 7fbeae634700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea80d07c0 con 0x7fbea8157ca0 2023-10-06T02:46:04.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.176+0000 7fbeae634700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea806daa0 con 0x7fbea81578d0 2023-10-06T02:46:04.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.176+0000 7fbeae634700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80cfbb0 con 0x7fbea806d120 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbea81578d0 0x7fbea80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbea8157ca0 0x7fbea815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39166/0 (socket says 172.21.15.81:39166) 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbea81578d0 0x7fbea80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57898/0 (socket says 172.21.15.81:57898) 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea77fe700 1 -- 172.21.15.81:0/3848742767 learned_addr learned my addr 172.21.15.81:0/3848742767 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbeacbd1700 1 --2- 172.21.15.81:0/3848742767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 0x7fbea806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea7fff700 1 -- 172.21.15.81:0/3848742767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 msgr2=0x7fbea806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea7fff700 1 --2- 172.21.15.81:0/3848742767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 0x7fbea806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea7fff700 1 -- 172.21.15.81:0/3848742767 >> v1:172.21.15.81:6789/0 conn(0x7fbea8157ca0 legacy=0x7fbea815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea7fff700 1 -- 172.21.15.81:0/3848742767 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80cfe90 con 0x7fbea81578d0 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3848742767 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773108776 0 0) 0x7fbea80d07c0 con 0x7fbea8157ca0 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea7fff700 1 --2- 172.21.15.81:0/3848742767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 0x7fbea80cf4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0098e0 tx=0x7fbe9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657a7ef70462c8bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3848742767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00b640 con 0x7fbea81578d0 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3848742767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00b7a0 con 0x7fbea81578d0 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.177+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3848742767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00bb40 con 0x7fbea81578d0 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.178+0000 7fbeae634700 1 -- 172.21.15.81:0/3848742767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 msgr2=0x7fbea80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.178+0000 7fbeae634700 1 --2- 172.21.15.81:0/3848742767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 0x7fbea80cf4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0098e0 tx=0x7fbe9c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.178+0000 7fbeae634700 1 -- 172.21.15.81:0/3848742767 shutdown_connections 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.178+0000 7fbeae634700 1 --2- 172.21.15.81:0/3848742767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 0x7fbea806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.178+0000 7fbeae634700 1 --2- 172.21.15.81:0/3848742767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 0x7fbea80cf4f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.178+0000 7fbeae634700 1 -- 172.21.15.81:0/3848742767 >> 172.21.15.81:0/3848742767 conn(0x7fbea806bb90 msgr2=0x7fbea806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.178+0000 7fbeae634700 1 -- 172.21.15.81:0/3848742767 shutdown_connections 2023-10-06T02:46:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.178+0000 7fbeae634700 1 -- 172.21.15.81:0/3848742767 wait complete. 2023-10-06T02:46:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.179+0000 7fbeae634700 1 Processor -- start 2023-10-06T02:46:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.179+0000 7fbeae634700 1 -- start start 2023-10-06T02:46:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbeae634700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 0x7fbea8151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbeae634700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 0x7fbea814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbeae634700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbea8157ca0 0x7fbea80b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbeae634700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80b3ba0 con 0x7fbea81578d0 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbeae634700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80b3e40 con 0x7fbea8157ca0 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbeae634700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8152480 con 0x7fbea806d120 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 0x7fbea814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 0x7fbea814a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57906/0 (socket says 172.21.15.81:57906) 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea77fe700 1 -- 172.21.15.81:0/3183467144 learned_addr learned my addr 172.21.15.81:0/3183467144 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbeacbd1700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbea8157ca0 0x7fbea80b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea77fe700 1 -- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 msgr2=0x7fbea8151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea7fff700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 0x7fbea8151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea77fe700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 0x7fbea8151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea77fe700 1 -- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbea8157ca0 msgr2=0x7fbea80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea77fe700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbea8157ca0 0x7fbea80b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea77fe700 1 -- 172.21.15.81:0/3183467144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c009420 con 0x7fbea81578d0 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbeacbd1700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbea8157ca0 0x7fbea80b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.180+0000 7fbea77fe700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 0x7fbea814a8b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800c5e0 tx=0x7fbe98000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.181+0000 7fbe8ffff700 1 -- 172.21.15.81:0/3183467144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98005b30 con 0x7fbea81578d0 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.181+0000 7fbe8ffff700 1 -- 172.21.15.81:0/3183467144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe98005c90 con 0x7fbea81578d0 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.181+0000 7fbe8ffff700 1 -- 172.21.15.81:0/3183467144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98007300 con 0x7fbea81578d0 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.181+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea8152760 con 0x7fbea81578d0 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.181+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea8152190 con 0x7fbea81578d0 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.182+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea8067ac0 con 0x7fbea81578d0 2023-10-06T02:46:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.182+0000 7fbe8ffff700 1 -- 172.21.15.81:0/3183467144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe980076b0 con 0x7fbea81578d0 2023-10-06T02:46:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.182+0000 7fbe8ffff700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbe94066f30 0x7fbe940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.183+0000 7fbe8ffff700 1 -- 172.21.15.81:0/3183467144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbe98083870 con 0x7fbea81578d0 2023-10-06T02:46:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.183+0000 7fbea7fff700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbe94066f30 0x7fbe940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.183+0000 7fbea7fff700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbe94066f30 0x7fbe940693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c003080 tx=0x7fbe9c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.187+0000 7fbe8ffff700 1 -- 172.21.15.81:0/3183467144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe98050cd0 con 0x7fbea81578d0 2023-10-06T02:46:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.368+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbea80b3f80 con 0x7fbea81578d0 2023-10-06T02:46:04.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.368+0000 7fbe8ffff700 1 -- 172.21.15.81:0/3183467144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe980170a0 con 0x7fbea81578d0 2023-10-06T02:46:04.371 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbe94066f30 msgr2=0x7fbe940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbe94066f30 0x7fbe940693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c003080 tx=0x7fbe9c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 msgr2=0x7fbea814a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 0x7fbea814a8b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800c5e0 tx=0x7fbe98000fe0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 shutdown_connections 2023-10-06T02:46:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbe94066f30 0x7fbe940693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbea8157ca0 0x7fbea80b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbea806d120 0x7fbea8151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 --2- 172.21.15.81:0/3183467144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea81578d0 0x7fbea814a8b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 >> 172.21.15.81:0/3183467144 conn(0x7fbea806bb90 msgr2=0x7fbea8155740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.370+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 shutdown_connections 2023-10-06T02:46:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.371+0000 7fbeae634700 1 -- 172.21.15.81:0/3183467144 wait complete. 2023-10-06T02:46:04.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:04.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.498+0000 7f5ac4da0700 1 Processor -- start 2023-10-06T02:46:04.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.498+0000 7f5ac4da0700 1 -- start start 2023-10-06T02:46:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.499+0000 7f5ac4da0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5ac015a2a0 0x7f5ac00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.499+0000 7f5ac4da0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ac006dd60 0x7f5ac00cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.499+0000 7f5ac4da0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac00b0ca0 con 0x7f5ac00ceb30 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.499+0000 7f5ac4da0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac006e160 con 0x7f5ac015a2a0 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.499+0000 7f5ac4da0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac006ea90 con 0x7f5ac006dd60 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.499+0000 7f5ab5d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ac00ceb30 0x7f5ac006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39170/0 (socket says 172.21.15.81:39170) 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.499+0000 7f5ab5d9b700 1 -- 172.21.15.81:0/1025938166 learned_addr learned my addr 172.21.15.81:0/1025938166 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071237107 0 0) 0x7f5ac00b0ca0 con 0x7f5ac00ceb30 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aac003570 con 0x7f5ac00ceb30 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abe59c700 1 --2- 172.21.15.81:0/1025938166 >> v2:172.21.15.83:3300/0 conn(0x7f5ac015a2a0 0x7f5ac00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abed9d700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ac006dd60 0x7f5ac00cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 894458791 0 0) 0x7f5aac003570 con 0x7f5ac00ceb30 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ac006dd60 msgr2=0x7f5ac00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ac006dd60 0x7f5ac00cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 >> v2:172.21.15.83:3300/0 conn(0x7f5ac015a2a0 msgr2=0x7f5ac00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 --2- 172.21.15.81:0/1025938166 >> v2:172.21.15.83:3300/0 conn(0x7f5ac015a2a0 0x7f5ac00b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac00b00d0 con 0x7f5ac00ceb30 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f5aa8001470 con 0x7f5ac00ceb30 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 >> v1:172.21.15.81:6789/0 conn(0x7f5ac00ceb30 legacy=0x7f5ac006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aac003a60 0x7f5aac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ac006dd60 0x7f5aac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aac004d50 0x7f5aac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac006e160 con 0x7f5aac003a60 2023-10-06T02:46:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac006ea90 con 0x7f5aac004d50 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac00ba60 con 0x7f5ac006dd60 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abe59c700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aac003a60 0x7f5aac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5ab5d9b700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ac006dd60 0x7f5aac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abed9d700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aac004d50 0x7f5aac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abe59c700 1 -- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ac006dd60 msgr2=0x7f5aac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abe59c700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ac006dd60 0x7f5aac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abe59c700 1 -- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aac004d50 msgr2=0x7f5aac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abe59c700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aac004d50 0x7f5aac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abe59c700 1 -- 172.21.15.81:0/1025938166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac003570 con 0x7f5aac003a60 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.500+0000 7f5abe59c700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aac003a60 0x7f5aac003e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009c00 tx=0x7f5ab00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4614e676f4266a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000e6b0 con 0x7f5aac003a60 2023-10-06T02:46:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab000e810 con 0x7f5aac003a60 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5abdd9b700 1 -- 172.21.15.81:0/1025938166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000ebd0 con 0x7f5aac003a60 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1025938166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aac003a60 msgr2=0x7f5aac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5ac4da0700 1 --2- 172.21.15.81:0/1025938166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5aac003a60 0x7f5aac003e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009c00 tx=0x7f5ab00091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5abed9d700 1 -- 172.21.15.81:0/1025938166 reap_dead start 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1025938166 shutdown_connections 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1025938166 >> 172.21.15.81:0/1025938166 conn(0x7f5ac0067640 msgr2=0x7f5ac0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1025938166 shutdown_connections 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.501+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1025938166 wait complete. 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.502+0000 7f5ac4da0700 1 Processor -- start 2023-10-06T02:46:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.502+0000 7f5ac4da0700 1 -- start start 2023-10-06T02:46:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5ac4da0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5aac003a60 0x7f5ac00b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5ac4da0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ac00b4490 0x7f5ac00b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5ac4da0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac0153d60 0x7f5ac01541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5ac4da0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0154710 con 0x7f5ac0153d60 2023-10-06T02:46:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5ac4da0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac015d4e0 con 0x7f5ac00b4490 2023-10-06T02:46:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5ac4da0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac015c8f0 con 0x7f5aac003a60 2023-10-06T02:46:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5abed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac0153d60 0x7f5ac01541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5abed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac0153d60 0x7f5ac01541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57918/0 (socket says 172.21.15.81:57918) 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5abed9d700 1 -- 172.21.15.81:0/1443460318 learned_addr learned my addr 172.21.15.81:0/1443460318 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5ab5d9b700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ac00b4490 0x7f5ac00b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.503+0000 7f5abe59c700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5aac003a60 0x7f5ac00b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5abed9d700 1 -- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5aac003a60 msgr2=0x7f5ac00b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5abed9d700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5aac003a60 0x7f5ac00b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5abed9d700 1 -- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ac00b4490 msgr2=0x7f5ac00b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5abed9d700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ac00b4490 0x7f5ac00b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5abed9d700 1 -- 172.21.15.81:0/1443460318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac015cbb0 con 0x7f5ac0153d60 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5abed9d700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac0153d60 0x7f5ac01541d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ac006b970 tx=0x7f5ab800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5ab6ffd700 1 -- 172.21.15.81:0/1443460318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800e040 con 0x7f5ac0153d60 2023-10-06T02:46:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5ab6ffd700 1 -- 172.21.15.81:0/1443460318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab800f040 con 0x7f5ac0153d60 2023-10-06T02:46:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac015ce90 con 0x7f5ac0153d60 2023-10-06T02:46:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5ab6ffd700 1 -- 172.21.15.81:0/1443460318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800fd10 con 0x7f5ac0153d60 2023-10-06T02:46:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.504+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac00b1b60 con 0x7f5ac0153d60 2023-10-06T02:46:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.505+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac015d690 con 0x7f5ac0153d60 2023-10-06T02:46:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.505+0000 7f5ab6ffd700 1 -- 172.21.15.81:0/1443460318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ab8015640 con 0x7f5ac0153d60 2023-10-06T02:46:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.505+0000 7f5ab6ffd700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5aa0066fb0 0x7f5aa0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.506+0000 7f5ab6ffd700 1 -- 172.21.15.81:0/1443460318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5ab8084ac0 con 0x7f5ac0153d60 2023-10-06T02:46:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.506+0000 7f5abe59c700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5aa0066fb0 0x7f5aa0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.506+0000 7f5abe59c700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5aa0066fb0 0x7f5aa0069460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00091e0 tx=0x7f5ab001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.510+0000 7f5ab6ffd700 1 -- 172.21.15.81:0/1443460318 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ac015d690 con 0x7f5ac0153d60 2023-10-06T02:46:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.693+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ac015d650 con 0x7f5ac0153d60 2023-10-06T02:46:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.694+0000 7f5ab6ffd700 1 -- 172.21.15.81:0/1443460318 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ab8051e80 con 0x7f5ac0153d60 2023-10-06T02:46:04.696 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5aa0066fb0 msgr2=0x7f5aa0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5aa0066fb0 0x7f5aa0069460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00091e0 tx=0x7f5ab001a000 comp rx=0 tx=0).stop 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac0153d60 msgr2=0x7f5ac01541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac0153d60 0x7f5ac01541d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ac006b970 tx=0x7f5ab800b040 comp rx=0 tx=0).stop 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 shutdown_connections 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac0153d60 0x7f5ac01541d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5aac003a60 0x7f5ac00b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5aa0066fb0 0x7f5aa0069460 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 --2- 172.21.15.81:0/1443460318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ac00b4490 0x7f5ac00b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 >> 172.21.15.81:0/1443460318 conn(0x7f5ac0067640 msgr2=0x7f5ac0156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 shutdown_connections 2023-10-06T02:46:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.696+0000 7f5ac4da0700 1 -- 172.21.15.81:0/1443460318 wait complete. 2023-10-06T02:46:04.710 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:46:04.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.821+0000 7ff05dc19700 1 Processor -- start 2023-10-06T02:46:04.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.821+0000 7ff05dc19700 1 -- start start 2023-10-06T02:46:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05dc19700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff058159b40 0x7ff0580cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05dc19700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058068e90 0x7ff0580cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05dc19700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0580cee10 con 0x7ff058159f10 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05dc19700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0580cd040 con 0x7ff058159b40 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05dc19700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580cd320 con 0x7ff058068e90 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05cc17700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff058159b40 0x7ff0580cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05cc17700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff058159b40 0x7ff0580cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57924/0 (socket says 172.21.15.81:57924) 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05cc17700 1 -- 172.21.15.81:0/175464052 learned_addr learned my addr 172.21.15.81:0/175464052 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05d418700 1 --2- 172.21.15.81:0/175464052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058068e90 0x7ff0580cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05cc17700 1 -- 172.21.15.81:0/175464052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058068e90 msgr2=0x7ff0580cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05cc17700 1 --2- 172.21.15.81:0/175464052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058068e90 0x7ff0580cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05cc17700 1 -- 172.21.15.81:0/175464052 >> v1:172.21.15.83:6789/0 conn(0x7ff058159f10 legacy=0x7ff058068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05cc17700 1 -- 172.21.15.81:0/175464052 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580ce7c0 con 0x7ff058159b40 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05d418700 1 --2- 172.21.15.81:0/175464052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058068e90 0x7ff0580cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.822+0000 7ff05cc17700 1 --2- 172.21.15.81:0/175464052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159b40 0x7ff0580cc600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0099b0 tx=0x7ff04c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b55d00950446388 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff0577fe700 1 -- 172.21.15.81:0/175464052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c00b860 con 0x7ff058159b40 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff0577fe700 1 -- 172.21.15.81:0/175464052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c00b9c0 con 0x7ff058159b40 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff0577fe700 1 -- 172.21.15.81:0/175464052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c00bd60 con 0x7ff058159b40 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff05dc19700 1 -- 172.21.15.81:0/175464052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159b40 msgr2=0x7ff0580cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff05dc19700 1 --2- 172.21.15.81:0/175464052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159b40 0x7ff0580cc600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0099b0 tx=0x7ff04c009250 comp rx=0 tx=0).stop 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff05dc19700 1 -- 172.21.15.81:0/175464052 shutdown_connections 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff05dc19700 1 --2- 172.21.15.81:0/175464052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058068e90 0x7ff0580cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff05dc19700 1 --2- 172.21.15.81:0/175464052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159b40 0x7ff0580cc600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff05dc19700 1 -- 172.21.15.81:0/175464052 >> 172.21.15.81:0/175464052 conn(0x7ff0580cd660 msgr2=0x7ff0580cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:04.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff05dc19700 1 -- 172.21.15.81:0/175464052 shutdown_connections 2023-10-06T02:46:04.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.823+0000 7ff05dc19700 1 -- 172.21.15.81:0/175464052 wait complete. 2023-10-06T02:46:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.824+0000 7ff05dc19700 1 Processor -- start 2023-10-06T02:46:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05dc19700 1 -- start start 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05dc19700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff058068e90 0x7ff058157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05dc19700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058159b40 0x7ff0581559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05dc19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159f10 0x7ff05816e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05dc19700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058158b50 con 0x7ff058159f10 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05dc19700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05816e450 con 0x7ff058068e90 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05dc19700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff058158590 con 0x7ff058159b40 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05d418700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159f10 0x7ff05816e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05cc17700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff058068e90 0x7ff058157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05d418700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159f10 0x7ff05816e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57940/0 (socket says 172.21.15.81:57940) 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05d418700 1 -- 172.21.15.81:0/1510778249 learned_addr learned my addr 172.21.15.81:0/1510778249 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff05cc17700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff058068e90 0x7ff058157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:58002/0 (socket says 172.21.15.81:58002) 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.825+0000 7ff057fff700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058159b40 0x7ff0581559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff05d418700 1 -- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058159b40 msgr2=0x7ff0581559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff05d418700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058159b40 0x7ff0581559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff05d418700 1 -- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff058068e90 msgr2=0x7ff058157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff05d418700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff058068e90 0x7ff058157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff05d418700 1 -- 172.21.15.81:0/1510778249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c0094f0 con 0x7ff058159f10 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff05d418700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159f10 0x7ff05816e8e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff05000d150 tx=0x7ff050009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff054ff9700 1 -- 172.21.15.81:0/1510778249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05000dc30 con 0x7ff058159f10 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff054ff9700 1 -- 172.21.15.81:0/1510778249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05000f040 con 0x7ff058159f10 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff058158870 con 0x7ff058159f10 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff054ff9700 1 -- 172.21.15.81:0/1510778249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050015400 con 0x7ff058159f10 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.826+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff058155f20 con 0x7ff058159f10 2023-10-06T02:46:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.827+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05816df40 con 0x7ff058159f10 2023-10-06T02:46:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.827+0000 7ff054ff9700 1 -- 172.21.15.81:0/1510778249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0500157f0 con 0x7ff058159f10 2023-10-06T02:46:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.828+0000 7ff054ff9700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff03c066f30 0x7ff03c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.828+0000 7ff054ff9700 1 -- 172.21.15.81:0/1510778249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff050084a50 con 0x7ff058159f10 2023-10-06T02:46:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.828+0000 7ff05cc17700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff03c066f30 0x7ff03c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.828+0000 7ff05cc17700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff03c066f30 0x7ff03c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0099b0 tx=0x7ff04c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:04.832+0000 7ff054ff9700 1 -- 172.21.15.81:0/1510778249 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff05816df40 con 0x7ff058159f10 2023-10-06T02:46:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.018+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff05816df40 con 0x7ff058159f10 2023-10-06T02:46:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.019+0000 7ff054ff9700 1 -- 172.21.15.81:0/1510778249 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff05816df40 con 0x7ff058159f10 2023-10-06T02:46:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:05.021 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:46:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:46:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:46:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:46:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:46:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:05.022 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:46:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff03c066f30 msgr2=0x7ff03c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff03c066f30 0x7ff03c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0099b0 tx=0x7ff04c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159f10 msgr2=0x7ff05816e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159f10 0x7ff05816e8e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff05000d150 tx=0x7ff050009a50 comp rx=0 tx=0).stop 2023-10-06T02:46:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 shutdown_connections 2023-10-06T02:46:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff058159f10 0x7ff05816e8e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff03c066f30 0x7ff03c0693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff058068e90 0x7ff058157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 --2- 172.21.15.81:0/1510778249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff058159b40 0x7ff0581559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 >> 172.21.15.81:0/1510778249 conn(0x7ff0580cd660 msgr2=0x7ff05806e910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 shutdown_connections 2023-10-06T02:46:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.021+0000 7ff05dc19700 1 -- 172.21.15.81:0/1510778249 wait complete. 2023-10-06T02:46:05.035 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:46:05.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:46:05.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.150+0000 7f363855c700 1 Processor -- start 2023-10-06T02:46:05.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.150+0000 7f363855c700 1 -- start start 2023-10-06T02:46:05.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.151+0000 7f363855c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36301578d0 0x7f36300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.151+0000 7f363855c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f363006d120 0x7f363006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.151+0000 7f363855c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36300d07c0 con 0x7f3630157ca0 2023-10-06T02:46:05.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.151+0000 7f363855c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363006da50 con 0x7f36301578d0 2023-10-06T02:46:05.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.151+0000 7f363855c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36300cfbb0 con 0x7f363006d120 2023-10-06T02:46:05.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.151+0000 7f36362f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36301578d0 0x7f36300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.151+0000 7f36362f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36301578d0 0x7f36300cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57954/0 (socket says 172.21.15.81:57954) 2023-10-06T02:46:05.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.151+0000 7f36362f8700 1 -- 172.21.15.81:0/2652577048 learned_addr learned my addr 172.21.15.81:0/2652577048 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:05.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.151+0000 7f3636af9700 1 --2- 172.21.15.81:0/2652577048 >> v2:172.21.15.83:3300/0 conn(0x7f363006d120 0x7f363006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f36362f8700 1 -- 172.21.15.81:0/2652577048 >> v2:172.21.15.83:3300/0 conn(0x7f363006d120 msgr2=0x7f363006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f36362f8700 1 --2- 172.21.15.81:0/2652577048 >> v2:172.21.15.83:3300/0 conn(0x7f363006d120 0x7f363006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f36362f8700 1 -- 172.21.15.81:0/2652577048 >> v1:172.21.15.83:6789/0 conn(0x7f3630157ca0 legacy=0x7f363015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f36362f8700 1 -- 172.21.15.81:0/2652577048 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300cfe90 con 0x7f36301578d0 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f3636af9700 1 --2- 172.21.15.81:0/2652577048 >> v2:172.21.15.83:3300/0 conn(0x7f363006d120 0x7f363006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f36362f8700 1 --2- 172.21.15.81:0/2652577048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36301578d0 0x7f36300cf4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3630068300 tx=0x7f362c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3dab54ce821e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f36352f6700 1 -- 172.21.15.81:0/2652577048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00e070 con 0x7f36301578d0 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f36352f6700 1 -- 172.21.15.81:0/2652577048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c00ba50 con 0x7f36301578d0 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f36352f6700 1 -- 172.21.15.81:0/2652577048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c0092e0 con 0x7f36301578d0 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f363855c700 1 -- 172.21.15.81:0/2652577048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36301578d0 msgr2=0x7f36300cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f363855c700 1 --2- 172.21.15.81:0/2652577048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36301578d0 0x7f36300cf4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3630068300 tx=0x7f362c009840 comp rx=0 tx=0).stop 2023-10-06T02:46:05.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f363855c700 1 -- 172.21.15.81:0/2652577048 shutdown_connections 2023-10-06T02:46:05.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f363855c700 1 --2- 172.21.15.81:0/2652577048 >> v2:172.21.15.83:3300/0 conn(0x7f363006d120 0x7f363006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f363855c700 1 --2- 172.21.15.81:0/2652577048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36301578d0 0x7f36300cf4f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f363855c700 1 -- 172.21.15.81:0/2652577048 >> 172.21.15.81:0/2652577048 conn(0x7f363006bb90 msgr2=0x7f363006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:05.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f363855c700 1 -- 172.21.15.81:0/2652577048 shutdown_connections 2023-10-06T02:46:05.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.152+0000 7f363855c700 1 -- 172.21.15.81:0/2652577048 wait complete. 2023-10-06T02:46:05.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.153+0000 7f363855c700 1 Processor -- start 2023-10-06T02:46:05.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f363855c700 1 -- start start 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f363855c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363006d120 0x7f36300c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f363855c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36301578d0 0x7f36300ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f363855c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3630157ca0 0x7f36300cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f363855c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300c67b0 con 0x7f3630157ca0 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f363855c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630159910 con 0x7f363006d120 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f363855c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36300c5e80 con 0x7f36301578d0 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f3636af9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3630157ca0 0x7f36300cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f3636af9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3630157ca0 0x7f36300cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57962/0 (socket says 172.21.15.81:57962) 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f3636af9700 1 -- 172.21.15.81:0/3055258503 learned_addr learned my addr 172.21.15.81:0/3055258503 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f3635af7700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36301578d0 0x7f36300ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.154+0000 7f36362f8700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363006d120 0x7f36300c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f3636af9700 1 -- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36301578d0 msgr2=0x7f36300ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f3636af9700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36301578d0 0x7f36300ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f3636af9700 1 -- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363006d120 msgr2=0x7f36300c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f3636af9700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363006d120 0x7f36300c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f3636af9700 1 -- 172.21.15.81:0/3055258503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c009ae0 con 0x7f3630157ca0 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f3636af9700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3630157ca0 0x7f36300cd1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f362800e870 tx=0x7f3628008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f36267fc700 1 -- 172.21.15.81:0/3055258503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3628013410 con 0x7f3630157ca0 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f36267fc700 1 -- 172.21.15.81:0/3055258503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3628013570 con 0x7f3630157ca0 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36300c6160 con 0x7f3630157ca0 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f36267fc700 1 -- 172.21.15.81:0/3055258503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36280138f0 con 0x7f3630157ca0 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.155+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36300c9030 con 0x7f3630157ca0 2023-10-06T02:46:05.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.156+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3630067ac0 con 0x7f3630157ca0 2023-10-06T02:46:05.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.156+0000 7f36267fc700 1 -- 172.21.15.81:0/3055258503 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3628013ca0 con 0x7f3630157ca0 2023-10-06T02:46:05.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.157+0000 7f36267fc700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3614066f30 0x7f36140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.157+0000 7f36267fc700 1 -- 172.21.15.81:0/3055258503 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3628083f60 con 0x7f3630157ca0 2023-10-06T02:46:05.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.157+0000 7f36362f8700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3614066f30 0x7f36140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.157+0000 7f36362f8700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3614066f30 0x7f36140693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f362c009880 tx=0x7f362c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:05.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.161+0000 7f36267fc700 1 -- 172.21.15.81:0/3055258503 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3628054e50 con 0x7f3630157ca0 2023-10-06T02:46:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.342+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f36300d0170 con 0x7f3630157ca0 2023-10-06T02:46:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.489+0000 7f36267fc700 1 -- 172.21.15.81:0/3055258503 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f36280549e0 con 0x7f3630157ca0 2023-10-06T02:46:05.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.492+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3614066f30 msgr2=0x7f36140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.492+0000 7f363855c700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3614066f30 0x7f36140693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f362c009880 tx=0x7f362c018000 comp rx=0 tx=0).stop 2023-10-06T02:46:05.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.492+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3630157ca0 msgr2=0x7f36300cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.492+0000 7f363855c700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3630157ca0 0x7f36300cd1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f362800e870 tx=0x7f3628008040 comp rx=0 tx=0).stop 2023-10-06T02:46:05.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.493+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 shutdown_connections 2023-10-06T02:46:05.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.493+0000 7f363855c700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3630157ca0 0x7f36300cd1c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.493+0000 7f363855c700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3614066f30 0x7f36140693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.493+0000 7f363855c700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f363006d120 0x7f36300c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.493+0000 7f363855c700 1 --2- 172.21.15.81:0/3055258503 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36301578d0 0x7f36300ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.493+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 >> 172.21.15.81:0/3055258503 conn(0x7f363006bb90 msgr2=0x7f363006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:05.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.493+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 shutdown_connections 2023-10-06T02:46:05.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.493+0000 7f363855c700 1 -- 172.21.15.81:0/3055258503 wait complete. 2023-10-06T02:46:05.496 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:46:05.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:46:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.625+0000 7f446ebbf700 1 Processor -- start 2023-10-06T02:46:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.625+0000 7f446ebbf700 1 -- start start 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.626+0000 7f446ebbf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4468158030 0x7f446806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.626+0000 7f446ebbf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f44680af0c0 0x7f4468161d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.626+0000 7f446ebbf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680b13f0 con 0x7f4468158400 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.626+0000 7f446ebbf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446806d070 con 0x7f4468158030 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.626+0000 7f446ebbf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446806d350 con 0x7f44680af0c0 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.626+0000 7f446c95b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4468158030 0x7f446806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.626+0000 7f446c95b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4468158030 0x7f446806ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57966/0 (socket says 172.21.15.81:57966) 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.626+0000 7f446c95b700 1 -- 172.21.15.81:0/859821744 learned_addr learned my addr 172.21.15.81:0/859821744 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.626+0000 7f4467fff700 1 --1- 172.21.15.81:0/859821744 >> v1:172.21.15.81:6789/0 conn(0x7f4468158400 0x7f44680ae9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39176/0 (socket says 172.21.15.81:39176) 2023-10-06T02:46:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446d15c700 1 --2- 172.21.15.81:0/859821744 >> v2:172.21.15.83:3300/0 conn(0x7f44680af0c0 0x7f4468161d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446c95b700 1 -- 172.21.15.81:0/859821744 >> v2:172.21.15.83:3300/0 conn(0x7f44680af0c0 msgr2=0x7f4468161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446c95b700 1 --2- 172.21.15.81:0/859821744 >> v2:172.21.15.83:3300/0 conn(0x7f44680af0c0 0x7f4468161d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446c95b700 1 -- 172.21.15.81:0/859821744 >> v1:172.21.15.81:6789/0 conn(0x7f4468158400 legacy=0x7f44680ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446c95b700 1 -- 172.21.15.81:0/859821744 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680b1080 con 0x7f4468158030 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f44677fe700 1 -- 172.21.15.81:0/859821744 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565316792 0 0) 0x7f44680b13f0 con 0x7f4468158400 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446c95b700 1 --2- 172.21.15.81:0/859821744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 0x7f446806ca70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f446806d8d0 tx=0x7f4458009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8623202cc028d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f44677fe700 1 -- 172.21.15.81:0/859821744 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445800e070 con 0x7f4468158030 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f44677fe700 1 -- 172.21.15.81:0/859821744 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445800ba50 con 0x7f4468158030 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f44677fe700 1 -- 172.21.15.81:0/859821744 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580092e0 con 0x7f4468158030 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446ebbf700 1 -- 172.21.15.81:0/859821744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 msgr2=0x7f446806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446ebbf700 1 --2- 172.21.15.81:0/859821744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 0x7f446806ca70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f446806d8d0 tx=0x7f4458009840 comp rx=0 tx=0).stop 2023-10-06T02:46:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446ebbf700 1 -- 172.21.15.81:0/859821744 shutdown_connections 2023-10-06T02:46:05.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446ebbf700 1 --2- 172.21.15.81:0/859821744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 0x7f446806ca70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446ebbf700 1 --2- 172.21.15.81:0/859821744 >> v2:172.21.15.83:3300/0 conn(0x7f44680af0c0 0x7f4468161d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446ebbf700 1 -- 172.21.15.81:0/859821744 >> 172.21.15.81:0/859821744 conn(0x7f446806e650 msgr2=0x7f44680cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:05.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446ebbf700 1 -- 172.21.15.81:0/859821744 shutdown_connections 2023-10-06T02:46:05.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.627+0000 7f446ebbf700 1 -- 172.21.15.81:0/859821744 wait complete. 2023-10-06T02:46:05.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.628+0000 7f446ebbf700 1 Processor -- start 2023-10-06T02:46:05.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f446ebbf700 1 -- start start 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f446ebbf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44680af0c0 0x7f44681428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f446ebbf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 0x7f4468168de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f446ebbf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4468158400 0x7f44680b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f446ebbf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4468169700 con 0x7f4468158030 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f446ebbf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446816a280 con 0x7f4468158400 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f446ebbf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4468142e00 con 0x7f44680af0c0 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f4467fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 0x7f4468168de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f4467fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 0x7f4468168de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57974/0 (socket says 172.21.15.81:57974) 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.629+0000 7f4467fff700 1 -- 172.21.15.81:0/3618566111 learned_addr learned my addr 172.21.15.81:0/3618566111 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f446c95b700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44680af0c0 0x7f44681428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f446d15c700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4468158400 0x7f44680b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f4467fff700 1 -- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44680af0c0 msgr2=0x7f44681428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f4467fff700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44680af0c0 0x7f44681428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f4467fff700 1 -- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4468158400 msgr2=0x7f44680b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:05.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f4467fff700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4468158400 0x7f44680b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:05.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f4467fff700 1 -- 172.21.15.81:0/3618566111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458009ae0 con 0x7f4468158030 2023-10-06T02:46:05.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f4467fff700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 0x7f4468168de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c5b0 tx=0x7f445c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:05.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f4464ff9700 1 -- 172.21.15.81:0/3618566111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c005a70 con 0x7f4468158030 2023-10-06T02:46:05.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f4464ff9700 1 -- 172.21.15.81:0/3618566111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c005bd0 con 0x7f4468158030 2023-10-06T02:46:05.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4468169950 con 0x7f4468158030 2023-10-06T02:46:05.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f4464ff9700 1 -- 172.21.15.81:0/3618566111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0070d0 con 0x7f4468158030 2023-10-06T02:46:05.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.630+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4468169f10 con 0x7f4468158030 2023-10-06T02:46:05.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.631+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4468068360 con 0x7f4468158030 2023-10-06T02:46:05.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.632+0000 7f4464ff9700 1 -- 172.21.15.81:0/3618566111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f445c007480 con 0x7f4468158030 2023-10-06T02:46:05.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.632+0000 7f4464ff9700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4454066f30 0x7f44540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:05.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.633+0000 7f4464ff9700 1 -- 172.21.15.81:0/3618566111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f445c083c90 con 0x7f4468158030 2023-10-06T02:46:05.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.633+0000 7f446c95b700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4454066f30 0x7f44540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:05.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.633+0000 7f446c95b700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4454066f30 0x7f44540693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4458009ab0 tx=0x7f4458018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:05.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.636+0000 7f4464ff9700 1 -- 172.21.15.81:0/3618566111 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f445c051000 con 0x7f4468158030 2023-10-06T02:46:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:05.819+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f446804bb80 con 0x7f4468158030 2023-10-06T02:46:06.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:46:06.149 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:46:06.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.494+0000 7f4464ff9700 1 -- 172.21.15.81:0/3618566111 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f445c0170d0 con 0x7f4468158030 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.497+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4454066f30 msgr2=0x7f44540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.497+0000 7f446ebbf700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4454066f30 0x7f44540693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4458009ab0 tx=0x7f4458018000 comp rx=0 tx=0).stop 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.497+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 msgr2=0x7f4468168de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.497+0000 7f446ebbf700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 0x7f4468168de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c5b0 tx=0x7f445c001040 comp rx=0 tx=0).stop 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.498+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 shutdown_connections 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.498+0000 7f446ebbf700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4454066f30 0x7f44540693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.498+0000 7f446ebbf700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4468158400 0x7f44680b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.498+0000 7f446ebbf700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44680af0c0 0x7f44681428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.498+0000 7f446ebbf700 1 --2- 172.21.15.81:0/3618566111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4468158030 0x7f4468168de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.498+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 >> 172.21.15.81:0/3618566111 conn(0x7f446806e650 msgr2=0x7f446815aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.499+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 shutdown_connections 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.500+0000 7f446ebbf700 1 -- 172.21.15.81:0/3618566111 wait complete. 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:46:06.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.633+0000 7f85b2431700 1 Processor -- start 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.633+0000 7f85b2431700 1 -- start start 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b2431700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85ac0d0f50 0x7f85ac06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b2431700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f85ac06d530 0x7f85ac15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b2431700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac06d990 con 0x7f85ac0d0b80 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b2431700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac15a690 con 0x7f85ac0d0f50 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b2431700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0cf2d0 con 0x7f85ac06d530 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b0c2e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85ac0d0f50 0x7f85ac06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b0c2e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85ac0d0f50 0x7f85ac06cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57984/0 (socket says 172.21.15.81:57984) 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b0c2e700 1 -- 172.21.15.81:0/1907617462 learned_addr learned my addr 172.21.15.81:0/1907617462 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b1c30700 1 --2- 172.21.15.81:0/1907617462 >> v2:172.21.15.83:3300/0 conn(0x7f85ac06d530 0x7f85ac15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b0c2e700 1 -- 172.21.15.81:0/1907617462 >> v2:172.21.15.83:3300/0 conn(0x7f85ac06d530 msgr2=0x7f85ac15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b0c2e700 1 --2- 172.21.15.81:0/1907617462 >> v2:172.21.15.83:3300/0 conn(0x7f85ac06d530 0x7f85ac15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b0c2e700 1 -- 172.21.15.81:0/1907617462 >> v1:172.21.15.83:6789/0 conn(0x7f85ac0d0b80 legacy=0x7f85ac0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.634+0000 7f85b0c2e700 1 -- 172.21.15.81:0/1907617462 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0d0480 con 0x7f85ac0d0f50 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85b0c2e700 1 --2- 172.21.15.81:0/1907617462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac0d0f50 0x7f85ac06cff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0ce9b0 tx=0x7f859c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecf0856591e145a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85a3fff700 1 -- 172.21.15.81:0/1907617462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c009e70 con 0x7f85ac0d0f50 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85a3fff700 1 -- 172.21.15.81:0/1907617462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c00b860 con 0x7f85ac0d0f50 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85a3fff700 1 -- 172.21.15.81:0/1907617462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c00bc00 con 0x7f85ac0d0f50 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85b2431700 1 -- 172.21.15.81:0/1907617462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac0d0f50 msgr2=0x7f85ac06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85b2431700 1 --2- 172.21.15.81:0/1907617462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac0d0f50 0x7f85ac06cff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0ce9b0 tx=0x7f859c009250 comp rx=0 tx=0).stop 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85b2431700 1 -- 172.21.15.81:0/1907617462 shutdown_connections 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85b2431700 1 --2- 172.21.15.81:0/1907617462 >> v2:172.21.15.83:3300/0 conn(0x7f85ac06d530 0x7f85ac15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85b2431700 1 --2- 172.21.15.81:0/1907617462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac0d0f50 0x7f85ac06cff0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85b2431700 1 -- 172.21.15.81:0/1907617462 >> 172.21.15.81:0/1907617462 conn(0x7f85ac063230 msgr2=0x7f85ac063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85b2431700 1 -- 172.21.15.81:0/1907617462 shutdown_connections 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.635+0000 7f85b2431700 1 -- 172.21.15.81:0/1907617462 wait complete. 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.636+0000 7f85b2431700 1 Processor -- start 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.636+0000 7f85b2431700 1 -- start start 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b2431700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac06d530 0x7f85ac154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b2431700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85ac0d0b80 0x7f85ac0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b2431700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85ac0d0f50 0x7f85ac0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b2431700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac16a820 con 0x7f85ac06d530 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b2431700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1553c0 con 0x7f85ac0d0b80 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b2431700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0ccad0 con 0x7f85ac0d0f50 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b142f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac06d530 0x7f85ac154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b142f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac06d530 0x7f85ac154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57998/0 (socket says 172.21.15.81:57998) 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b142f700 1 -- 172.21.15.81:0/1000189708 learned_addr learned my addr 172.21.15.81:0/1000189708 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b0c2e700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85ac0d0b80 0x7f85ac0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.637+0000 7f85b1c30700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85ac0d0f50 0x7f85ac0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85b142f700 1 -- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85ac0d0f50 msgr2=0x7f85ac0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85b142f700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85ac0d0f50 0x7f85ac0ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85b142f700 1 -- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85ac0d0b80 msgr2=0x7f85ac0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85b142f700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85ac0d0b80 0x7f85ac0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85b142f700 1 -- 172.21.15.81:0/1000189708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c0094f0 con 0x7f85ac06d530 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85b142f700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac06d530 0x7f85ac154e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85a800cb10 tx=0x7f85a80017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85a17fa700 1 -- 172.21.15.81:0/1000189708 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a800ce20 con 0x7f85ac06d530 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85a17fa700 1 -- 172.21.15.81:0/1000189708 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a800a7e0 con 0x7f85ac06d530 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac0ccdb0 con 0x7f85ac06d530 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85a17fa700 1 -- 172.21.15.81:0/1000189708 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a800aba0 con 0x7f85ac06d530 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.638+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac0cd370 con 0x7f85ac06d530 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.639+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac0676e0 con 0x7f85ac06d530 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.639+0000 7f85a17fa700 1 -- 172.21.15.81:0/1000189708 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85a8003030 con 0x7f85ac06d530 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.640+0000 7f85a17fa700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8590066f30 0x7f85900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.640+0000 7f85a17fa700 1 -- 172.21.15.81:0/1000189708 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f85a80845c0 con 0x7f85ac06d530 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.640+0000 7f85b0c2e700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8590066f30 0x7f85900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.640+0000 7f85b0c2e700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8590066f30 0x7f85900693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0ce9b0 tx=0x7f859c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.644+0000 7f85a17fa700 1 -- 172.21.15.81:0/1000189708 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85a8051730 con 0x7f85ac06d530 2023-10-06T02:46:06.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:06.872+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f85ac06dc00 con 0x7f85ac06d530 2023-10-06T02:46:07.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.509+0000 7f85a17fa700 1 -- 172.21.15.81:0/1000189708 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f85a8054d50 con 0x7f85ac06d530 2023-10-06T02:46:07.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8590066f30 msgr2=0x7f85900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8590066f30 0x7f85900693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0ce9b0 tx=0x7f859c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac06d530 msgr2=0x7f85ac154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac06d530 0x7f85ac154e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85a800cb10 tx=0x7f85a80017b0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 shutdown_connections 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85ac0d0f50 0x7f85ac0ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85ac06d530 0x7f85ac154e80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8590066f30 0x7f85900693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 --2- 172.21.15.81:0/1000189708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85ac0d0b80 0x7f85ac0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 >> 172.21.15.81:0/1000189708 conn(0x7f85ac063230 msgr2=0x7f85ac158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 shutdown_connections 2023-10-06T02:46:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.512+0000 7f85b2431700 1 -- 172.21.15.81:0/1000189708 wait complete. 2023-10-06T02:46:07.516 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T02:46:07.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.644+0000 7ff6fc5ac700 1 Processor -- start 2023-10-06T02:46:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.644+0000 7ff6fc5ac700 1 -- start start 2023-10-06T02:46:07.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fc5ac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f41578d0 0x7ff6f40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fc5ac700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f40d07c0 con 0x7ff6f406d120 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fc5ac700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f40cfbb0 con 0x7ff6f4157ca0 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fc5ac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40cfe90 con 0x7ff6f41578d0 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fab49700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff6f406d120 0x7ff6f415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39192/0 (socket says 172.21.15.81:39192) 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fab49700 1 -- 172.21.15.81:0/166148916 learned_addr learned my addr 172.21.15.81:0/166148916 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fa348700 1 --2- 172.21.15.81:0/166148916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f41578d0 0x7ff6f40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6f9346700 1 -- 172.21.15.81:0/166148916 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111727800 0 0) 0x7ff6f40d07c0 con 0x7ff6f406d120 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6f9346700 1 -- 172.21.15.81:0/166148916 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e0003570 con 0x7ff6f406d120 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6f9346700 1 -- 172.21.15.81:0/166148916 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693131375 0 0) 0x7ff6f40cfbb0 con 0x7ff6f4157ca0 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6f9346700 1 -- 172.21.15.81:0/166148916 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f40d07c0 con 0x7ff6f4157ca0 2023-10-06T02:46:07.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6f9346700 1 -- 172.21.15.81:0/166148916 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2415771657 0 0) 0x7ff6e0003570 con 0x7ff6f406d120 2023-10-06T02:46:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fa348700 1 -- 172.21.15.81:0/166148916 >> v1:172.21.15.83:6789/0 conn(0x7ff6f4157ca0 legacy=0x7ff6f415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fa348700 1 -- 172.21.15.81:0/166148916 >> v1:172.21.15.81:6789/0 conn(0x7ff6f406d120 legacy=0x7ff6f415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fa348700 1 -- 172.21.15.81:0/166148916 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f40d0170 con 0x7ff6f41578d0 2023-10-06T02:46:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.645+0000 7ff6fa348700 1 --2- 172.21.15.81:0/166148916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f41578d0 0x7ff6f40cf4f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009910 tx=0x7ff6f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=967ecf7264d1f483 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6f9346700 1 -- 172.21.15.81:0/166148916 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0017f0 con 0x7ff6f41578d0 2023-10-06T02:46:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6f9346700 1 -- 172.21.15.81:0/166148916 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0011420 con 0x7ff6f41578d0 2023-10-06T02:46:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6f9346700 1 -- 172.21.15.81:0/166148916 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00117a0 con 0x7ff6f41578d0 2023-10-06T02:46:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/166148916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f41578d0 msgr2=0x7ff6f40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6fc5ac700 1 --2- 172.21.15.81:0/166148916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f41578d0 0x7ff6f40cf4f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009910 tx=0x7ff6f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/166148916 shutdown_connections 2023-10-06T02:46:07.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6fc5ac700 1 --2- 172.21.15.81:0/166148916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f41578d0 0x7ff6f40cf4f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/166148916 >> 172.21.15.81:0/166148916 conn(0x7ff6f406bb90 msgr2=0x7ff6f406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:07.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/166148916 shutdown_connections 2023-10-06T02:46:07.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.646+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/166148916 wait complete. 2023-10-06T02:46:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.647+0000 7ff6fc5ac700 1 Processor -- start 2023-10-06T02:46:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.647+0000 7ff6fc5ac700 1 -- start start 2023-10-06T02:46:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6fc5ac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f406d120 0x7ff6f40cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6fc5ac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f41578d0 0x7ff6f416b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6fc5ac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f4157ca0 0x7ff6f40c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6fc5ac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40cda80 con 0x7ff6f41578d0 2023-10-06T02:46:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6fc5ac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f41541a0 con 0x7ff6f4157ca0 2023-10-06T02:46:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6fc5ac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40b64f0 con 0x7ff6f406d120 2023-10-06T02:46:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6f9b47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f41578d0 0x7ff6f416b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6f9b47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f41578d0 0x7ff6f416b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58002/0 (socket says 172.21.15.81:58002) 2023-10-06T02:46:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6f9b47700 1 -- 172.21.15.81:0/2971400812 learned_addr learned my addr 172.21.15.81:0/2971400812 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6fab49700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f4157ca0 0x7ff6f40c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6fa348700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f406d120 0x7ff6f40cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6f9b47700 1 -- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f406d120 msgr2=0x7ff6f40cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6f9b47700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f406d120 0x7ff6f40cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6f9b47700 1 -- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f4157ca0 msgr2=0x7ff6f40c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6f9b47700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f4157ca0 0x7ff6f40c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6f9b47700 1 -- 172.21.15.81:0/2971400812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f0009420 con 0x7ff6f41578d0 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.648+0000 7ff6f9b47700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f41578d0 0x7ff6f416b370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400c580 tx=0x7ff6e4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.649+0000 7ff6ea7fc700 1 -- 172.21.15.81:0/2971400812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4010510 con 0x7ff6f41578d0 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.649+0000 7ff6ea7fc700 1 -- 172.21.15.81:0/2971400812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e4010670 con 0x7ff6f41578d0 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.649+0000 7ff6ea7fc700 1 -- 172.21.15.81:0/2971400812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4010a30 con 0x7ff6f41578d0 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.649+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f416b8b0 con 0x7ff6f41578d0 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.649+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f40c7cb0 con 0x7ff6f41578d0 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.650+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f4067ac0 con 0x7ff6f41578d0 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.650+0000 7ff6ea7fc700 1 -- 172.21.15.81:0/2971400812 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6e401b400 con 0x7ff6f41578d0 2023-10-06T02:46:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.650+0000 7ff6ea7fc700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6d8066f30 0x7ff6d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.650+0000 7ff6ea7fc700 1 -- 172.21.15.81:0/2971400812 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6e4084270 con 0x7ff6f41578d0 2023-10-06T02:46:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.650+0000 7ff6fa348700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6d8066f30 0x7ff6d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.651+0000 7ff6fa348700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6d8066f30 0x7ff6d80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00091e0 tx=0x7ff6f0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.655+0000 7ff6ea7fc700 1 -- 172.21.15.81:0/2971400812 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6e4051380 con 0x7ff6f41578d0 2023-10-06T02:46:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.841+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6f40d0450 con 0x7ff6f41578d0 2023-10-06T02:46:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.842+0000 7ff6ea7fc700 1 -- 172.21.15.81:0/2971400812 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16831 (secure 0 0 0) 0x7ff6e40549a0 con 0x7ff6f41578d0 2023-10-06T02:46:07.844 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:06.874223+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:07.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6d8066f30 msgr2=0x7ff6d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6d8066f30 0x7ff6d80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00091e0 tx=0x7ff6f0016000 comp rx=0 tx=0).stop 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f41578d0 msgr2=0x7ff6f416b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f41578d0 0x7ff6f416b370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400c580 tx=0x7ff6e4007e10 comp rx=0 tx=0).stop 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 shutdown_connections 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6d8066f30 0x7ff6d80693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f4157ca0 0x7ff6f40c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f406d120 0x7ff6f40cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 --2- 172.21.15.81:0/2971400812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f41578d0 0x7ff6f416b370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 >> 172.21.15.81:0/2971400812 conn(0x7ff6f406bb90 msgr2=0x7ff6f406d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 shutdown_connections 2023-10-06T02:46:07.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.844+0000 7ff6fc5ac700 1 -- 172.21.15.81:0/2971400812 wait complete. 2023-10-06T02:46:07.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:07.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.970+0000 7f83283a1700 1 Processor -- start 2023-10-06T02:46:07.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.970+0000 7f83283a1700 1 -- start start 2023-10-06T02:46:07.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f83283a1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83201578d0 0x7f83200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f83283a1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8320157ca0 0x7f832015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f83283a1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83200d07c0 con 0x7f832006d120 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f83283a1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83200cfbb0 con 0x7f8320157ca0 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f83283a1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200cfe90 con 0x7f83201578d0 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f832593c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8320157ca0 0x7f832015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f832593c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8320157ca0 0x7f832015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58008/0 (socket says 172.21.15.81:58008) 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f832593c700 1 -- 172.21.15.81:0/3566563504 learned_addr learned my addr 172.21.15.81:0/3566563504 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f832613d700 1 --2- 172.21.15.81:0/3566563504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83201578d0 0x7f83200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f832593c700 1 -- 172.21.15.81:0/3566563504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83201578d0 msgr2=0x7f83200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f832593c700 1 --2- 172.21.15.81:0/3566563504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83201578d0 0x7f83200cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f832593c700 1 -- 172.21.15.81:0/3566563504 >> v1:172.21.15.83:6789/0 conn(0x7f832006d120 legacy=0x7f832015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f832593c700 1 -- 172.21.15.81:0/3566563504 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83200d0170 con 0x7f8320157ca0 2023-10-06T02:46:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.971+0000 7f832593c700 1 --2- 172.21.15.81:0/3566563504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320157ca0 0x7f832015af00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83100099b0 tx=0x7f8310009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3ddbafdb4f602e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f832513b700 1 -- 172.21.15.81:0/3566563504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310009ea0 con 0x7f8320157ca0 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f832513b700 1 -- 172.21.15.81:0/3566563504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000b860 con 0x7f8320157ca0 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f832513b700 1 -- 172.21.15.81:0/3566563504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000bc00 con 0x7f8320157ca0 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f83283a1700 1 -- 172.21.15.81:0/3566563504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320157ca0 msgr2=0x7f832015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f83283a1700 1 --2- 172.21.15.81:0/3566563504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320157ca0 0x7f832015af00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83100099b0 tx=0x7f8310009250 comp rx=0 tx=0).stop 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f83283a1700 1 -- 172.21.15.81:0/3566563504 shutdown_connections 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f83283a1700 1 --2- 172.21.15.81:0/3566563504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83201578d0 0x7f83200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f83283a1700 1 --2- 172.21.15.81:0/3566563504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320157ca0 0x7f832015af00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f83283a1700 1 -- 172.21.15.81:0/3566563504 >> 172.21.15.81:0/3566563504 conn(0x7f832006bb90 msgr2=0x7f832006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f83283a1700 1 -- 172.21.15.81:0/3566563504 shutdown_connections 2023-10-06T02:46:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.972+0000 7f83283a1700 1 -- 172.21.15.81:0/3566563504 wait complete. 2023-10-06T02:46:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.973+0000 7f83283a1700 1 Processor -- start 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.973+0000 7f83283a1700 1 -- start start 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f83283a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f832006d120 0x7f83201591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f83283a1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83201578d0 0x7f832014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f83283a1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8320157ca0 0x7f832014f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f83283a1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832014d550 con 0x7f832006d120 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f83283a1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8320159ba0 con 0x7f83201578d0 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f83283a1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832016a3e0 con 0x7f8320157ca0 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832613d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f832006d120 0x7f83201591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832613d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f832006d120 0x7f83201591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58010/0 (socket says 172.21.15.81:58010) 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832613d700 1 -- 172.21.15.81:0/1125547945 learned_addr learned my addr 172.21.15.81:0/1125547945 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832593c700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83201578d0 0x7f832014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832693e700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8320157ca0 0x7f832014f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832613d700 1 -- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8320157ca0 msgr2=0x7f832014f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832613d700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8320157ca0 0x7f832014f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832613d700 1 -- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83201578d0 msgr2=0x7f832014eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832613d700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83201578d0 0x7f832014eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832613d700 1 -- 172.21.15.81:0/1125547945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100094f0 con 0x7f832006d120 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.974+0000 7f832693e700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8320157ca0 0x7f832014f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.975+0000 7f832613d700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f832006d120 0x7f83201591e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f831c00ecb0 tx=0x7f831c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.975+0000 7f83167fc700 1 -- 172.21.15.81:0/1125547945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00c920 con 0x7f832006d120 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.975+0000 7f83167fc700 1 -- 172.21.15.81:0/1125547945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00ca80 con 0x7f832006d120 2023-10-06T02:46:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.975+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832016a6c0 con 0x7f832006d120 2023-10-06T02:46:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.975+0000 7f83167fc700 1 -- 172.21.15.81:0/1125547945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00ce20 con 0x7f832006d120 2023-10-06T02:46:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.975+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832016ac80 con 0x7f832006d120 2023-10-06T02:46:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.976+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8320067ac0 con 0x7f832006d120 2023-10-06T02:46:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.976+0000 7f83167fc700 1 -- 172.21.15.81:0/1125547945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f831c013680 con 0x7f832006d120 2023-10-06T02:46:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.976+0000 7f83167fc700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.977+0000 7f83167fc700 1 -- 172.21.15.81:0/1125547945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f831c084990 con 0x7f832006d120 2023-10-06T02:46:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.977+0000 7f832593c700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.977+0000 7f832593c700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83100099b0 tx=0x7f8310017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:07.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:07.981+0000 7f83167fc700 1 -- 172.21.15.81:0/1125547945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f831c051aa0 con 0x7f832006d120 2023-10-06T02:46:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.164+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83200d0450 con 0x7f832006d120 2023-10-06T02:46:08.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.165+0000 7f83167fc700 1 -- 172.21.15.81:0/1125547945 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f831c084020 con 0x7f832006d120 2023-10-06T02:46:08.167 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:08.168 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:06.874223+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 msgr2=0x7f83040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83100099b0 tx=0x7f8310017000 comp rx=0 tx=0).stop 2023-10-06T02:46:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f832006d120 msgr2=0x7f83201591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f832006d120 0x7f83201591e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f831c00ecb0 tx=0x7f831c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 shutdown_connections 2023-10-06T02:46:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8320157ca0 0x7f832014f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f832006d120 0x7f83201591e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 --2- 172.21.15.81:0/1125547945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83201578d0 0x7f832014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 >> 172.21.15.81:0/1125547945 conn(0x7f832006bb90 msgr2=0x7f832015a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:08.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 shutdown_connections 2023-10-06T02:46:08.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.167+0000 7f83283a1700 1 -- 172.21.15.81:0/1125547945 wait complete. 2023-10-06T02:46:08.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:46:08.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.296+0000 7f910a3ae700 1 Processor -- start 2023-10-06T02:46:08.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.296+0000 7f910a3ae700 1 -- start start 2023-10-06T02:46:08.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f910a3ae700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041578d0 0x7f91040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:08.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f910a3ae700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9104157ca0 0x7f910415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:08.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f910a3ae700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91040d07c0 con 0x7f910406d120 2023-10-06T02:46:08.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f910a3ae700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91040cfbb0 con 0x7f9104157ca0 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f910a3ae700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91040cfe90 con 0x7f91041578d0 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f9103fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041578d0 0x7f91040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f91037fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9104157ca0 0x7f910415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f910894b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f910406d120 0x7f910415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:40046/0 (socket says 172.21.15.81:40046) 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f910894b700 1 -- 172.21.15.81:0/3401783029 learned_addr learned my addr 172.21.15.81:0/3401783029 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f9103fff700 1 -- 172.21.15.81:0/3401783029 >> v2:172.21.15.83:3300/0 conn(0x7f9104157ca0 msgr2=0x7f910415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f9103fff700 1 --2- 172.21.15.81:0/3401783029 >> v2:172.21.15.83:3300/0 conn(0x7f9104157ca0 0x7f910415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f9103fff700 1 -- 172.21.15.81:0/3401783029 >> v1:172.21.15.83:6789/0 conn(0x7f910406d120 legacy=0x7f910415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f9103fff700 1 -- 172.21.15.81:0/3401783029 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91040d0170 con 0x7f91041578d0 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f91037fe700 1 --2- 172.21.15.81:0/3401783029 >> v2:172.21.15.83:3300/0 conn(0x7f9104157ca0 0x7f910415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:08.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.297+0000 7f9103fff700 1 --2- 172.21.15.81:0/3401783029 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041578d0 0x7f91040cf4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90f40098e0 tx=0x7f90f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d011803519c1119 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f9102ffd700 1 -- 172.21.15.81:0/3401783029 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400b640 con 0x7f91041578d0 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f9102ffd700 1 -- 172.21.15.81:0/3401783029 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f400b7a0 con 0x7f91041578d0 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f9102ffd700 1 -- 172.21.15.81:0/3401783029 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400bb40 con 0x7f91041578d0 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f910a3ae700 1 -- 172.21.15.81:0/3401783029 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041578d0 msgr2=0x7f91040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f910a3ae700 1 --2- 172.21.15.81:0/3401783029 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041578d0 0x7f91040cf4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90f40098e0 tx=0x7f90f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f910a3ae700 1 -- 172.21.15.81:0/3401783029 shutdown_connections 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f910a3ae700 1 --2- 172.21.15.81:0/3401783029 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041578d0 0x7f91040cf4f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f910a3ae700 1 --2- 172.21.15.81:0/3401783029 >> v2:172.21.15.83:3300/0 conn(0x7f9104157ca0 0x7f910415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f910a3ae700 1 -- 172.21.15.81:0/3401783029 >> 172.21.15.81:0/3401783029 conn(0x7f910406bb90 msgr2=0x7f910406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f910a3ae700 1 -- 172.21.15.81:0/3401783029 shutdown_connections 2023-10-06T02:46:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.298+0000 7f910a3ae700 1 -- 172.21.15.81:0/3401783029 wait complete. 2023-10-06T02:46:08.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.299+0000 7f910a3ae700 1 Processor -- start 2023-10-06T02:46:08.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.299+0000 7f910a3ae700 1 -- start start 2023-10-06T02:46:08.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f910a3ae700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f910406d120 0x7f91040af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:08.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f910a3ae700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91041578d0 0x7f910414b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:08.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f910a3ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104157ca0 0x7f91040b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:08.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f910a3ae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91040af7a0 con 0x7f9104157ca0 2023-10-06T02:46:08.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f910a3ae700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91040b1040 con 0x7f91041578d0 2023-10-06T02:46:08.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f910a3ae700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91040b1320 con 0x7f910406d120 2023-10-06T02:46:08.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f910894b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104157ca0 0x7f91040b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:08.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f910894b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104157ca0 0x7f91040b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58024/0 (socket says 172.21.15.81:58024) 2023-10-06T02:46:08.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f910894b700 1 -- 172.21.15.81:0/3231666932 learned_addr learned my addr 172.21.15.81:0/3231666932 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:08.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f91037fe700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91041578d0 0x7f910414b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:08.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.300+0000 7f9103fff700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f910406d120 0x7f91040af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:08.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f910894b700 1 -- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f910406d120 msgr2=0x7f91040af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:08.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f910894b700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f910406d120 0x7f91040af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f910894b700 1 -- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91041578d0 msgr2=0x7f910414b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:08.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f910894b700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91041578d0 0x7f910414b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:08.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f910894b700 1 -- 172.21.15.81:0/3231666932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f8009420 con 0x7f9104157ca0 2023-10-06T02:46:08.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f91037fe700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91041578d0 0x7f910414b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:08.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f910894b700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104157ca0 0x7f91040b20e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00cc40 tx=0x7f90fc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:08.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f90ebfff700 1 -- 172.21.15.81:0/3231666932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00a8b0 con 0x7f9104157ca0 2023-10-06T02:46:08.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f90ebfff700 1 -- 172.21.15.81:0/3231666932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc00aa10 con 0x7f9104157ca0 2023-10-06T02:46:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f4009420 con 0x7f9104157ca0 2023-10-06T02:46:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f90ebfff700 1 -- 172.21.15.81:0/3231666932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00add0 con 0x7f9104157ca0 2023-10-06T02:46:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.301+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91040b18e0 con 0x7f9104157ca0 2023-10-06T02:46:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.302+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9104067ac0 con 0x7f9104157ca0 2023-10-06T02:46:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.302+0000 7f90ebfff700 1 -- 172.21.15.81:0/3231666932 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90fc007300 con 0x7f9104157ca0 2023-10-06T02:46:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.302+0000 7f90ebfff700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90f0066f30 0x7f90f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.303+0000 7f90ebfff700 1 -- 172.21.15.81:0/3231666932 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f90fc084980 con 0x7f9104157ca0 2023-10-06T02:46:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.303+0000 7f9103fff700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90f0066f30 0x7f90f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.303+0000 7f9103fff700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90f0066f30 0x7f90f00693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90f40091e0 tx=0x7f90f4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.307+0000 7f90ebfff700 1 -- 172.21.15.81:0/3231666932 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90fc051bc0 con 0x7f9104157ca0 2023-10-06T02:46:08.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:08.533+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91040d0450 con 0x7f9104157ca0 2023-10-06T02:46:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.522+0000 7f90ebfff700 1 -- 172.21.15.81:0/3231666932 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f90fc0551e0 con 0x7f9104157ca0 2023-10-06T02:46:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.524+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90f0066f30 msgr2=0x7f90f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.524+0000 7f910a3ae700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90f0066f30 0x7f90f00693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90f40091e0 tx=0x7f90f4017000 comp rx=0 tx=0).stop 2023-10-06T02:46:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.524+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104157ca0 msgr2=0x7f91040b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.524+0000 7f910a3ae700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104157ca0 0x7f91040b20e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00cc40 tx=0x7f90fc001a50 comp rx=0 tx=0).stop 2023-10-06T02:46:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.525+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 shutdown_connections 2023-10-06T02:46:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.525+0000 7f910a3ae700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104157ca0 0x7f91040b20e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.525+0000 7f910a3ae700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f910406d120 0x7f91040af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.525+0000 7f910a3ae700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90f0066f30 0x7f90f00693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.525+0000 7f910a3ae700 1 --2- 172.21.15.81:0/3231666932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91041578d0 0x7f910414b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.525+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 >> 172.21.15.81:0/3231666932 conn(0x7f910406bb90 msgr2=0x7f9104156970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.525+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 shutdown_connections 2023-10-06T02:46:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.525+0000 7f910a3ae700 1 -- 172.21.15.81:0/3231666932 wait complete. 2023-10-06T02:46:09.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:46:09.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.656+0000 7f58682bc700 1 Processor -- start 2023-10-06T02:46:09.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.656+0000 7f58682bc700 1 -- start start 2023-10-06T02:46:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.656+0000 7f58682bc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5860068980 0x7f58600ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.656+0000 7f58682bc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.656+0000 7f58682bc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58600c8e20 con 0x7f58600c6fc0 2023-10-06T02:46:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.656+0000 7f58682bc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600c9100 con 0x7f5860068980 2023-10-06T02:46:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.656+0000 7f58682bc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58600c1810 con 0x7f58600c3020 2023-10-06T02:46:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5866859700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5865857700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5860068980 0x7f58600ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5866058700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f58600c6fc0 0x7f58600c7390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:40058/0 (socket says 172.21.15.81:40058) 2023-10-06T02:46:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5866859700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:48350/0 (socket says 172.21.15.81:48350) 2023-10-06T02:46:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5866058700 1 -- 172.21.15.81:0/4005438296 learned_addr learned my addr 172.21.15.81:0/4005438296 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5866859700 1 -- 172.21.15.81:0/4005438296 >> v2:172.21.15.83:3300/0 conn(0x7f5860068980 msgr2=0x7f58600ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5866859700 1 --2- 172.21.15.81:0/4005438296 >> v2:172.21.15.83:3300/0 conn(0x7f5860068980 0x7f58600ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5866859700 1 -- 172.21.15.81:0/4005438296 >> v1:172.21.15.83:6789/0 conn(0x7f58600c6fc0 legacy=0x7f58600c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5866859700 1 -- 172.21.15.81:0/4005438296 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58600c1af0 con 0x7f58600c3020 2023-10-06T02:46:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5865056700 1 -- 172.21.15.81:0/4005438296 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327172651 0 0) 0x7f58600c8e20 con 0x7f58600c6fc0 2023-10-06T02:46:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5865857700 1 --2- 172.21.15.81:0/4005438296 >> v2:172.21.15.83:3300/0 conn(0x7f5860068980 0x7f58600ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5866859700 1 --2- 172.21.15.81:0/4005438296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601618e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f58580098e0 tx=0x7f58580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36faa5fe278d2f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5865056700 1 -- 172.21.15.81:0/4005438296 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800b640 con 0x7f58600c3020 2023-10-06T02:46:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5865056700 1 -- 172.21.15.81:0/4005438296 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585800b7a0 con 0x7f58600c3020 2023-10-06T02:46:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.657+0000 7f5865056700 1 -- 172.21.15.81:0/4005438296 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800bb40 con 0x7f58600c3020 2023-10-06T02:46:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.658+0000 7f58682bc700 1 -- 172.21.15.81:0/4005438296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 msgr2=0x7f58601618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.658+0000 7f58682bc700 1 --2- 172.21.15.81:0/4005438296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601618e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f58580098e0 tx=0x7f58580091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.658+0000 7f58682bc700 1 -- 172.21.15.81:0/4005438296 shutdown_connections 2023-10-06T02:46:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.658+0000 7f58682bc700 1 --2- 172.21.15.81:0/4005438296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601618e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.658+0000 7f58682bc700 1 --2- 172.21.15.81:0/4005438296 >> v2:172.21.15.83:3300/0 conn(0x7f5860068980 0x7f58600ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.658+0000 7f58682bc700 1 -- 172.21.15.81:0/4005438296 >> 172.21.15.81:0/4005438296 conn(0x7f586006c660 msgr2=0x7f58600cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.658+0000 7f58682bc700 1 -- 172.21.15.81:0/4005438296 shutdown_connections 2023-10-06T02:46:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.658+0000 7f58682bc700 1 -- 172.21.15.81:0/4005438296 wait complete. 2023-10-06T02:46:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.659+0000 7f58682bc700 1 Processor -- start 2023-10-06T02:46:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.659+0000 7f58682bc700 1 -- start start 2023-10-06T02:46:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58682bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5860068980 0x7f5860150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58682bc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58682bc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58600c6fc0 0x7f5860154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58682bc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860158fa0 con 0x7f5860068980 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58682bc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58601551f0 con 0x7f58600c6fc0 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58682bc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5860158390 con 0x7f58600c3020 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866058700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5860068980 0x7f5860150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866058700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5860068980 0x7f5860150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58036/0 (socket says 172.21.15.81:58036) 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866058700 1 -- 172.21.15.81:0/3967100309 learned_addr learned my addr 172.21.15.81:0/3967100309 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866859700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58600c6fc0 0x7f5860154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5865857700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866058700 1 -- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 msgr2=0x7f58601543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866058700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866058700 1 -- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58600c6fc0 msgr2=0x7f5860154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866058700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58600c6fc0 0x7f5860154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866058700 1 -- 172.21.15.81:0/3967100309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850009420 con 0x7f5860068980 2023-10-06T02:46:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f5866058700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5860068980 0x7f5860150760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f585c00cca0 tx=0x7f585c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58567fc700 1 -- 172.21.15.81:0/3967100309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00a8d0 con 0x7f5860068980 2023-10-06T02:46:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58567fc700 1 -- 172.21.15.81:0/3967100309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c00aa30 con 0x7f5860068980 2023-10-06T02:46:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5858009420 con 0x7f5860068980 2023-10-06T02:46:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.660+0000 7f58567fc700 1 -- 172.21.15.81:0/3967100309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00adb0 con 0x7f5860068980 2023-10-06T02:46:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.661+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5860158950 con 0x7f5860068980 2023-10-06T02:46:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.661+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58600c6230 con 0x7f5860068980 2023-10-06T02:46:09.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.662+0000 7f58567fc700 1 -- 172.21.15.81:0/3967100309 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f585c007300 con 0x7f5860068980 2023-10-06T02:46:09.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.662+0000 7f58567fc700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5844066f30 0x7f58440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:09.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.662+0000 7f58567fc700 1 -- 172.21.15.81:0/3967100309 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f585c0849f0 con 0x7f5860068980 2023-10-06T02:46:09.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.663+0000 7f5865857700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5844066f30 0x7f58440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:09.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.663+0000 7f5865857700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5844066f30 0x7f58440693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f58601554c0 tx=0x7f58500091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:09.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.667+0000 7f58567fc700 1 -- 172.21.15.81:0/3967100309 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f585c051b80 con 0x7f5860068980 2023-10-06T02:46:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:09.895+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5860158cf0 con 0x7f5860068980 2023-10-06T02:46:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.527+0000 7f58567fc700 1 -- 172.21.15.81:0/3967100309 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f585c0551a0 con 0x7f5860068980 2023-10-06T02:46:10.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5844066f30 msgr2=0x7f58440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5844066f30 0x7f58440693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f58601554c0 tx=0x7f58500091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5860068980 msgr2=0x7f5860150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5860068980 0x7f5860150760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f585c00cca0 tx=0x7f585c001a30 comp rx=0 tx=0).stop 2023-10-06T02:46:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 shutdown_connections 2023-10-06T02:46:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5844066f30 0x7f58440693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58600c6fc0 0x7f5860154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5860068980 0x7f5860150760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 --2- 172.21.15.81:0/3967100309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58600c3020 0x7f58601543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 >> 172.21.15.81:0/3967100309 conn(0x7f586006c660 msgr2=0x7f586006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 shutdown_connections 2023-10-06T02:46:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.530+0000 7f58682bc700 1 -- 172.21.15.81:0/3967100309 wait complete. 2023-10-06T02:46:10.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:46:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.660+0000 7f5a2fa57700 1 Processor -- start 2023-10-06T02:46:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.660+0000 7f5a2fa57700 1 -- start start 2023-10-06T02:46:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.661+0000 7f5a2fa57700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5a28157ca0 0x7f5a280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.661+0000 7f5a2fa57700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a2806d120 0x7f5a2806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.661+0000 7f5a2fa57700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a280d07c0 con 0x7f5a281578d0 2023-10-06T02:46:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.661+0000 7f5a2fa57700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2806daa0 con 0x7f5a28157ca0 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.661+0000 7f5a2fa57700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280cfbb0 con 0x7f5a2806d120 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.661+0000 7f5a2d7f3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5a281578d0 0x7f5a2815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58020/0 (socket says 172.21.15.81:58020) 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.661+0000 7f5a2d7f3700 1 -- 172.21.15.81:0/2911636140 learned_addr learned my addr 172.21.15.81:0/2911636140 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540978848 0 0) 0x7f5a280d07c0 con 0x7f5a281578d0 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2dff4700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a2806d120 0x7f5a2806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2cff2700 1 --2- 172.21.15.81:0/2911636140 >> v2:172.21.15.83:3300/0 conn(0x7f5a28157ca0 0x7f5a280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a14003570 con 0x7f5a281578d0 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2747622532 0 0) 0x7f5a14003570 con 0x7f5a281578d0 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a2806d120 msgr2=0x7f5a2806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a2806d120 0x7f5a2806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 >> v2:172.21.15.83:3300/0 conn(0x7f5a28157ca0 msgr2=0x7f5a280cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 --2- 172.21.15.81:0/2911636140 >> v2:172.21.15.83:3300/0 conn(0x7f5a28157ca0 0x7f5a280cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280cfe90 con 0x7f5a281578d0 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f5a24001470 con 0x7f5a281578d0 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 >> v1:172.21.15.81:6789/0 conn(0x7f5a281578d0 legacy=0x7f5a2815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a2806d120 0x7f5a14003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a14003fa0 0x7f5a14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a14004d50 0x7f5a140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2806daa0 con 0x7f5a14004d50 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280cfbb0 con 0x7f5a14003fa0 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1400ba60 con 0x7f5a2806d120 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2dff4700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a14004d50 0x7f5a140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2cff2700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a14003fa0 0x7f5a14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2d7f3700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a2806d120 0x7f5a14003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2dff4700 1 -- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a2806d120 msgr2=0x7f5a14003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2dff4700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a2806d120 0x7f5a14003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2dff4700 1 -- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a14003fa0 msgr2=0x7f5a14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2dff4700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a14003fa0 0x7f5a14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2dff4700 1 -- 172.21.15.81:0/2911636140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a14003570 con 0x7f5a14004d50 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.662+0000 7f5a2dff4700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a14004d50 0x7f5a140051c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000e210 tx=0x7f5a2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8147452456fdb88e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2000eac0 con 0x7f5a14004d50 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2000f040 con 0x7f5a14004d50 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a1ffff700 1 -- 172.21.15.81:0/2911636140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2000ee70 con 0x7f5a14004d50 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2911636140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a14004d50 msgr2=0x7f5a140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a2fa57700 1 --2- 172.21.15.81:0/2911636140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a14004d50 0x7f5a140051c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000e210 tx=0x7f5a2000b040 comp rx=0 tx=0).stop 2023-10-06T02:46:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a2dff4700 1 -- 172.21.15.81:0/2911636140 reap_dead start 2023-10-06T02:46:10.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2911636140 shutdown_connections 2023-10-06T02:46:10.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2911636140 >> 172.21.15.81:0/2911636140 conn(0x7f5a2806bb90 msgr2=0x7f5a2806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:10.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2911636140 shutdown_connections 2023-10-06T02:46:10.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.663+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2911636140 wait complete. 2023-10-06T02:46:10.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.664+0000 7f5a2fa57700 1 Processor -- start 2023-10-06T02:46:10.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.664+0000 7f5a2fa57700 1 -- start start 2023-10-06T02:46:10.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2fa57700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a14004d50 0x7f5a2816ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:10.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2fa57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a280b16c0 0x7f5a280af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:10.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2fa57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28148410 0x7f5a28148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:10.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2fa57700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28148da0 con 0x7f5a28148410 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2fa57700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280b2740 con 0x7f5a280b16c0 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2fa57700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280b1ea0 con 0x7f5a14004d50 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2dff4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28148410 0x7f5a28148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2dff4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28148410 0x7f5a28148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56588/0 (socket says 172.21.15.81:56588) 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2dff4700 1 -- 172.21.15.81:0/2889059235 learned_addr learned my addr 172.21.15.81:0/2889059235 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2d7f3700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a14004d50 0x7f5a2816ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.665+0000 7f5a2cff2700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a280b16c0 0x7f5a280af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a2dff4700 1 -- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a14004d50 msgr2=0x7f5a2816ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a2dff4700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a14004d50 0x7f5a2816ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a2dff4700 1 -- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a280b16c0 msgr2=0x7f5a280af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a2dff4700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a280b16c0 0x7f5a280af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a2dff4700 1 -- 172.21.15.81:0/2889059235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280b2180 con 0x7f5a28148410 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a2dff4700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28148410 0x7f5a28148860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000afd0 tx=0x7f5a2001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a1d7fa700 1 -- 172.21.15.81:0/2889059235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2001d630 con 0x7f5a28148410 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a1d7fa700 1 -- 172.21.15.81:0/2889059235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2001d7b0 con 0x7f5a28148410 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a280b2460 con 0x7f5a28148410 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a1d7fa700 1 -- 172.21.15.81:0/2889059235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2001dbb0 con 0x7f5a28148410 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.666+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a280b1b30 con 0x7f5a28148410 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.667+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a280aabe0 con 0x7f5a28148410 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.667+0000 7f5a1d7fa700 1 -- 172.21.15.81:0/2889059235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a20003040 con 0x7f5a28148410 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.667+0000 7f5a1d7fa700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5a0c066f60 0x7f5a0c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.668+0000 7f5a1d7fa700 1 -- 172.21.15.81:0/2889059235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a20085e90 con 0x7f5a28148410 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.668+0000 7f5a2d7f3700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5a0c066f60 0x7f5a0c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.668+0000 7f5a2d7f3700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5a0c066f60 0x7f5a0c069410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5a240015a0 tx=0x7f5a24008c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:10.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.672+0000 7f5a1d7fa700 1 -- 172.21.15.81:0/2889059235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a280aabe0 con 0x7f5a28148410 2023-10-06T02:46:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.895+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a280aabe0 con 0x7f5a28148410 2023-10-06T02:46:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.896+0000 7f5a1d7fa700 1 -- 172.21.15.81:0/2889059235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f5a280aabe0 con 0x7f5a28148410 2023-10-06T02:46:10.897 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:10.897 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/963539092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":963539092},{"type":"v1","addr":"172.21.15.81:6833","nonce":963539092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3218202678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3218202678},{"type":"v1","addr":"172.21.15.81:6835","nonce":3218202678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/913779656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":913779656},{"type":"v1","addr":"172.21.15.83:6836","nonce":913779656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:06.874539+0000","modified":"2023-10-06T02:46:10.523436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/2378748577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2378748577},{"type":"v1","addr":"172.21.15.83:6837","nonce":2378748577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:46:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.897+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5a0c066f60 msgr2=0x7f5a0c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.897+0000 7f5a2fa57700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5a0c066f60 0x7f5a0c069410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5a240015a0 tx=0x7f5a24008c30 comp rx=0 tx=0).stop 2023-10-06T02:46:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28148410 msgr2=0x7f5a28148860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28148410 0x7f5a28148860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000afd0 tx=0x7f5a2001a000 comp rx=0 tx=0).stop 2023-10-06T02:46:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 shutdown_connections 2023-10-06T02:46:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28148410 0x7f5a28148860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a14004d50 0x7f5a2816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5a0c066f60 0x7f5a0c069410 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 --2- 172.21.15.81:0/2889059235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a280b16c0 0x7f5a280af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 >> 172.21.15.81:0/2889059235 conn(0x7f5a2806bb90 msgr2=0x7f5a28156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 shutdown_connections 2023-10-06T02:46:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:10.898+0000 7f5a2fa57700 1 -- 172.21.15.81:0/2889059235 wait complete. 2023-10-06T02:46:10.901 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-06T02:46:10.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:11.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.023+0000 7f348a924700 1 Processor -- start 2023-10-06T02:46:11.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.023+0000 7f348a924700 1 -- start start 2023-10-06T02:46:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.024+0000 7f348a924700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f348415a2a0 0x7f34840b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.024+0000 7f348a924700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f348406dd60 0x7f34840cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.024+0000 7f348a924700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34840b0ca0 con 0x7f34840ceb30 2023-10-06T02:46:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.024+0000 7f348a924700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348406e160 con 0x7f348415a2a0 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.024+0000 7f348a924700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348406ea90 con 0x7f348406dd60 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.024+0000 7f3483fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f348415a2a0 0x7f34840b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.024+0000 7f34837fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f34840ceb30 0x7f348406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58030/0 (socket says 172.21.15.81:58030) 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.024+0000 7f3483fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f348415a2a0 0x7f34840b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56604/0 (socket says 172.21.15.81:56604) 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.024+0000 7f34837fe700 1 -- 172.21.15.81:0/1530564239 learned_addr learned my addr 172.21.15.81:0/1530564239 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3488ec1700 1 --2- 172.21.15.81:0/1530564239 >> v2:172.21.15.83:3300/0 conn(0x7f348406dd60 0x7f34840cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3483fff700 1 -- 172.21.15.81:0/1530564239 >> v2:172.21.15.83:3300/0 conn(0x7f348406dd60 msgr2=0x7f34840cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3483fff700 1 --2- 172.21.15.81:0/1530564239 >> v2:172.21.15.83:3300/0 conn(0x7f348406dd60 0x7f34840cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3483fff700 1 -- 172.21.15.81:0/1530564239 >> v1:172.21.15.81:6789/0 conn(0x7f34840ceb30 legacy=0x7f348406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3483fff700 1 -- 172.21.15.81:0/1530564239 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840b00d0 con 0x7f348415a2a0 2023-10-06T02:46:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3482ffd700 1 -- 172.21.15.81:0/1530564239 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481843646 0 0) 0x7f34840b0ca0 con 0x7f34840ceb30 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3483fff700 1 --2- 172.21.15.81:0/1530564239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348415a2a0 0x7f34840b1130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3484069790 tx=0x7f34740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d74bb8d9fcf034 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3482ffd700 1 -- 172.21.15.81:0/1530564239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347400b6b0 con 0x7f348415a2a0 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3482ffd700 1 -- 172.21.15.81:0/1530564239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347400b810 con 0x7f348415a2a0 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f3482ffd700 1 -- 172.21.15.81:0/1530564239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347400bbb0 con 0x7f348415a2a0 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f348a924700 1 -- 172.21.15.81:0/1530564239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348415a2a0 msgr2=0x7f34840b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.025+0000 7f348a924700 1 --2- 172.21.15.81:0/1530564239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348415a2a0 0x7f34840b1130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3484069790 tx=0x7f34740091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.026+0000 7f348a924700 1 -- 172.21.15.81:0/1530564239 shutdown_connections 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.026+0000 7f348a924700 1 --2- 172.21.15.81:0/1530564239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348415a2a0 0x7f34840b1130 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.026+0000 7f348a924700 1 --2- 172.21.15.81:0/1530564239 >> v2:172.21.15.83:3300/0 conn(0x7f348406dd60 0x7f34840cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.026+0000 7f348a924700 1 -- 172.21.15.81:0/1530564239 >> 172.21.15.81:0/1530564239 conn(0x7f3484067640 msgr2=0x7f3484067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.026+0000 7f348a924700 1 -- 172.21.15.81:0/1530564239 shutdown_connections 2023-10-06T02:46:11.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.026+0000 7f348a924700 1 -- 172.21.15.81:0/1530564239 wait complete. 2023-10-06T02:46:11.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.027+0000 7f348a924700 1 Processor -- start 2023-10-06T02:46:11.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.027+0000 7f348a924700 1 -- start start 2023-10-06T02:46:11.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.027+0000 7f348a924700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f348406dd60 0x7f34841536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.027+0000 7f348a924700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ceb30 0x7f348416a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.027+0000 7f348a924700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f348415a2a0 0x7f3484150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f348a924700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484152310 con 0x7f34840ceb30 2023-10-06T02:46:11.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f348a924700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348415e100 con 0x7f348406dd60 2023-10-06T02:46:11.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f348a924700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348416afe0 con 0x7f348415a2a0 2023-10-06T02:46:11.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f34837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ceb30 0x7f348416a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f34837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ceb30 0x7f348416a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56620/0 (socket says 172.21.15.81:56620) 2023-10-06T02:46:11.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f34837fe700 1 -- 172.21.15.81:0/1370378679 learned_addr learned my addr 172.21.15.81:0/1370378679 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f3483fff700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f348406dd60 0x7f34841536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f3488ec1700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f348415a2a0 0x7f3484150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f34837fe700 1 -- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f348415a2a0 msgr2=0x7f3484150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f34837fe700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f348415a2a0 0x7f3484150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f34837fe700 1 -- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f348406dd60 msgr2=0x7f34841536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f34837fe700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f348406dd60 0x7f34841536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f34837fe700 1 -- 172.21.15.81:0/1370378679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474009420 con 0x7f34840ceb30 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f34837fe700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ceb30 0x7f348416a790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f347800c7e0 tx=0x7f3478007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f346bfff700 1 -- 172.21.15.81:0/1370378679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478005b30 con 0x7f34840ceb30 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f346bfff700 1 -- 172.21.15.81:0/1370378679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3478005c90 con 0x7f34840ceb30 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348416b2c0 con 0x7f34840ceb30 2023-10-06T02:46:11.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f346bfff700 1 -- 172.21.15.81:0/1370378679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478007300 con 0x7f34840ceb30 2023-10-06T02:46:11.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.028+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348416acd0 con 0x7f34840ceb30 2023-10-06T02:46:11.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.029+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348416b4b0 con 0x7f34840ceb30 2023-10-06T02:46:11.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.030+0000 7f346bfff700 1 -- 172.21.15.81:0/1370378679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f347801b3b0 con 0x7f34840ceb30 2023-10-06T02:46:11.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.030+0000 7f346bfff700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3470066f30 0x7f34700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.030+0000 7f346bfff700 1 -- 172.21.15.81:0/1370378679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3478083bf0 con 0x7f34840ceb30 2023-10-06T02:46:11.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.030+0000 7f3483fff700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3470066f30 0x7f34700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.030+0000 7f3483fff700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3470066f30 0x7f34700693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34740093f0 tx=0x7f3474017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:11.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.034+0000 7f346bfff700 1 -- 172.21.15.81:0/1370378679 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3478050d00 con 0x7f34840ceb30 2023-10-06T02:46:11.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.218+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f348416b6b0 con 0x7f34840ceb30 2023-10-06T02:46:11.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.219+0000 7f346bfff700 1 -- 172.21.15.81:0/1370378679 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f3478017090 con 0x7f34840ceb30 2023-10-06T02:46:11.220 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:11.220 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3470066f30 msgr2=0x7f34700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3470066f30 0x7f34700693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34740093f0 tx=0x7f3474017000 comp rx=0 tx=0).stop 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ceb30 msgr2=0x7f348416a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ceb30 0x7f348416a790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f347800c7e0 tx=0x7f3478007df0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 shutdown_connections 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f348415a2a0 0x7f3484150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3470066f30 0x7f34700693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f348406dd60 0x7f34841536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 --2- 172.21.15.81:0/1370378679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34840ceb30 0x7f348416a790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 >> 172.21.15.81:0/1370378679 conn(0x7f3484067640 msgr2=0x7f34840adb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 shutdown_connections 2023-10-06T02:46:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.221+0000 7f348a924700 1 -- 172.21.15.81:0/1370378679 wait complete. 2023-10-06T02:46:11.234 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:46:11.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:46:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.347+0000 7fc1bf13c700 1 Processor -- start 2023-10-06T02:46:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.347+0000 7fc1bf13c700 1 -- start start 2023-10-06T02:46:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1bf13c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc1b8159b40 0x7fc1b80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1bf13c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 0x7fc1b80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1bf13c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b80cee10 con 0x7fc1b8159f10 2023-10-06T02:46:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1bf13c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b80cd040 con 0x7fc1b8159b40 2023-10-06T02:46:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1bf13c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80cd320 con 0x7fc1b8068e90 2023-10-06T02:46:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1bd939700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc1b8159f10 0x7fc1b8068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58038/0 (socket says 172.21.15.81:58038) 2023-10-06T02:46:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1bd939700 1 -- 172.21.15.81:0/2134460511 learned_addr learned my addr 172.21.15.81:0/2134460511 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1be13a700 1 --2- 172.21.15.81:0/2134460511 >> v2:172.21.15.83:3300/0 conn(0x7fc1b8159b40 0x7fc1b80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1be93b700 1 --2- 172.21.15.81:0/2134460511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 0x7fc1b80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1bd138700 1 -- 172.21.15.81:0/2134460511 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512500511 0 0) 0x7fc1b80cee10 con 0x7fc1b8159f10 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1bd138700 1 -- 172.21.15.81:0/2134460511 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a0003570 con 0x7fc1b8159f10 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1be93b700 1 -- 172.21.15.81:0/2134460511 >> v2:172.21.15.83:3300/0 conn(0x7fc1b8159b40 msgr2=0x7fc1b80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1be93b700 1 --2- 172.21.15.81:0/2134460511 >> v2:172.21.15.83:3300/0 conn(0x7fc1b8159b40 0x7fc1b80cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1be93b700 1 -- 172.21.15.81:0/2134460511 >> v1:172.21.15.81:6789/0 conn(0x7fc1b8159f10 legacy=0x7fc1b8068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1be93b700 1 -- 172.21.15.81:0/2134460511 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b80ce7c0 con 0x7fc1b8068e90 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1be13a700 1 --2- 172.21.15.81:0/2134460511 >> v2:172.21.15.83:3300/0 conn(0x7fc1b8159b40 0x7fc1b80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.348+0000 7fc1be93b700 1 --2- 172.21.15.81:0/2134460511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 0x7fc1b80cf2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80098e0 tx=0x7fc1a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=123cb388d56b54f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bd138700 1 -- 172.21.15.81:0/2134460511 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8011630 con 0x7fc1b8068e90 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bd138700 1 -- 172.21.15.81:0/2134460511 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a8011790 con 0x7fc1b8068e90 2023-10-06T02:46:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bd138700 1 -- 172.21.15.81:0/2134460511 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8011b10 con 0x7fc1b8068e90 2023-10-06T02:46:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bf13c700 1 -- 172.21.15.81:0/2134460511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 msgr2=0x7fc1b80cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bf13c700 1 --2- 172.21.15.81:0/2134460511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 0x7fc1b80cf2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80098e0 tx=0x7fc1a80091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bf13c700 1 -- 172.21.15.81:0/2134460511 shutdown_connections 2023-10-06T02:46:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bf13c700 1 --2- 172.21.15.81:0/2134460511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 0x7fc1b80cf2a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bf13c700 1 --2- 172.21.15.81:0/2134460511 >> v2:172.21.15.83:3300/0 conn(0x7fc1b8159b40 0x7fc1b80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bf13c700 1 -- 172.21.15.81:0/2134460511 >> 172.21.15.81:0/2134460511 conn(0x7fc1b80cd660 msgr2=0x7fc1b80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bf13c700 1 -- 172.21.15.81:0/2134460511 shutdown_connections 2023-10-06T02:46:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.349+0000 7fc1bf13c700 1 -- 172.21.15.81:0/2134460511 wait complete. 2023-10-06T02:46:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.350+0000 7fc1bf13c700 1 Processor -- start 2023-10-06T02:46:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.350+0000 7fc1bf13c700 1 -- start start 2023-10-06T02:46:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bf13c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 0x7fc1b816a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bf13c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8159b40 0x7fc1b80b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bf13c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b8159f10 0x7fc1b816ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bf13c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b815a720 con 0x7fc1b8159b40 2023-10-06T02:46:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bf13c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80b5fe0 con 0x7fc1b8159f10 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bf13c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80b62c0 con 0x7fc1b8068e90 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bd939700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8159b40 0x7fc1b80b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bd939700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8159b40 0x7fc1b80b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56630/0 (socket says 172.21.15.81:56630) 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bd939700 1 -- 172.21.15.81:0/3945986199 learned_addr learned my addr 172.21.15.81:0/3945986199 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1be13a700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 0x7fc1b816a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bd939700 1 -- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 msgr2=0x7fc1b816a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bd939700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 0x7fc1b816a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bd939700 1 -- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b8159f10 msgr2=0x7fc1b816ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1be93b700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b8159f10 0x7fc1b816ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bd939700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b8159f10 0x7fc1b816ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.351+0000 7fc1bd939700 1 -- 172.21.15.81:0/3945986199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0009a20 con 0x7fc1b8159b40 2023-10-06T02:46:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.352+0000 7fc1bd939700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8159b40 0x7fc1b80b54d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0011e0 tx=0x7fc1ac007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.352+0000 7fc1b67fc700 1 -- 172.21.15.81:0/3945986199 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac005b30 con 0x7fc1b8159b40 2023-10-06T02:46:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.352+0000 7fc1b67fc700 1 -- 172.21.15.81:0/3945986199 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac005c90 con 0x7fc1b8159b40 2023-10-06T02:46:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.352+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a8009420 con 0x7fc1b8159b40 2023-10-06T02:46:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.352+0000 7fc1b67fc700 1 -- 172.21.15.81:0/3945986199 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac007320 con 0x7fc1b8159b40 2023-10-06T02:46:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.352+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b815ac50 con 0x7fc1b8159b40 2023-10-06T02:46:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.353+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b815ae70 con 0x7fc1b8159b40 2023-10-06T02:46:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.353+0000 7fc1b67fc700 1 -- 172.21.15.81:0/3945986199 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1ac007690 con 0x7fc1b8159b40 2023-10-06T02:46:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.353+0000 7fc1b67fc700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc1a4066f30 0x7fc1a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.353+0000 7fc1b67fc700 1 -- 172.21.15.81:0/3945986199 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc1ac083c10 con 0x7fc1b8159b40 2023-10-06T02:46:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.354+0000 7fc1be13a700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc1a4066f30 0x7fc1a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.354+0000 7fc1be13a700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc1a4066f30 0x7fc1a40693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00099f0 tx=0x7fc1b000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:11.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.357+0000 7fc1b67fc700 1 -- 172.21.15.81:0/3945986199 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1ac050d20 con 0x7fc1b8159b40 2023-10-06T02:46:11.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.538+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1b8063e90 con 0x7fc1a4066f30 2023-10-06T02:46:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.547+0000 7fc1b67fc700 1 -- 172.21.15.81:0/3945986199 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275847 (secure 0 0 0) 0x7fc1b8063e90 con 0x7fc1a4066f30 2023-10-06T02:46:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc1a4066f30 msgr2=0x7fc1a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc1a4066f30 0x7fc1a40693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00099f0 tx=0x7fc1b000b040 comp rx=0 tx=0).stop 2023-10-06T02:46:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8159b40 msgr2=0x7fc1b80b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8159b40 0x7fc1b80b54d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0011e0 tx=0x7fc1ac007df0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 shutdown_connections 2023-10-06T02:46:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc1a4066f30 0x7fc1a40693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b8159f10 0x7fc1b816ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b8068e90 0x7fc1b816a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 --2- 172.21.15.81:0/3945986199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8159b40 0x7fc1b80b54d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 >> 172.21.15.81:0/3945986199 conn(0x7fc1b80cd660 msgr2=0x7fc1b80cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 shutdown_connections 2023-10-06T02:46:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.550+0000 7fc1bf13c700 1 -- 172.21.15.81:0/3945986199 wait complete. 2023-10-06T02:46:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:46:11.563 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-06T02:46:11.492341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1690,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560809,"statfs":{"total":1600000000,"available":1598268912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001244"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499660+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:31.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498840+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502959+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497739+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507031+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499150+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497381+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498328+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497012+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.505949+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497757+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:42.409000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498211+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:24.231578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496243+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497226+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.501912+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498882+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502376+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499764+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:26.776913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.506218+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497982+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498553+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496853+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.503946+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499243+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498467+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.506243+0000","last_change":"2023-10-06T02:46:06.506243+0000","last_active":"2023-10-06T02:46:06.506243+0000","last_peered":"2023-10-06T02:46:06.506243+0000","last_clean":"2023-10-06T02:46:06.506243+0000","last_became_active":"2023-10-06T02:46:06.505980+0000","last_became_peered":"2023-10-06T02:46:06.505980+0000","last_unstale":"2023-10-06T02:46:06.506243+0000","last_undegraded":"2023-10-06T02:46:06.506243+0000","last_fullsized":"2023-10-06T02:46:06.506243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494165+0000","last_change":"2023-10-06T02:46:06.494298+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494165+0000","last_undegraded":"2023-10-06T02:46:06.494165+0000","last_fullsized":"2023-10-06T02:46:06.494165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497979+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.494404+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496375+0000","last_change":"2023-10-06T02:46:06.496471+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496375+0000","last_undegraded":"2023-10-06T02:46:06.496375+0000","last_fullsized":"2023-10-06T02:46:06.496375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.501257+0000","last_change":"2023-10-06T02:46:06.501257+0000","last_active":"2023-10-06T02:46:06.501257+0000","last_peered":"2023-10-06T02:46:06.501257+0000","last_clean":"2023-10-06T02:46:06.501257+0000","last_became_active":"2023-10-06T02:46:06.501036+0000","last_became_peered":"2023-10-06T02:46:06.501036+0000","last_unstale":"2023-10-06T02:46:06.501257+0000","last_undegraded":"2023-10-06T02:46:06.501257+0000","last_fullsized":"2023-10-06T02:46:06.501257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495159+0000","last_change":"2023-10-06T02:46:06.495313+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495159+0000","last_undegraded":"2023-10-06T02:46:06.495159+0000","last_fullsized":"2023-10-06T02:46:06.495159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:40.222541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498229+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.506258+0000","last_change":"2023-10-06T02:46:06.506258+0000","last_active":"2023-10-06T02:46:06.506258+0000","last_peered":"2023-10-06T02:46:06.506258+0000","last_clean":"2023-10-06T02:46:06.506258+0000","last_became_active":"2023-10-06T02:46:06.505429+0000","last_became_peered":"2023-10-06T02:46:06.505429+0000","last_unstale":"2023-10-06T02:46:06.506258+0000","last_undegraded":"2023-10-06T02:46:06.506258+0000","last_fullsized":"2023-10-06T02:46:06.506258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.505775+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495545+0000","last_change":"2023-10-06T02:46:06.495688+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495545+0000","last_undegraded":"2023-10-06T02:46:06.495545+0000","last_fullsized":"2023-10-06T02:46:06.495545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:25.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496151+0000","last_change":"2023-10-06T02:46:06.496274+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496151+0000","last_undegraded":"2023-10-06T02:46:06.496151+0000","last_fullsized":"2023-10-06T02:46:06.496151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496860+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495036+0000","last_change":"2023-10-06T02:46:06.495157+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495036+0000","last_undegraded":"2023-10-06T02:46:06.495036+0000","last_fullsized":"2023-10-06T02:46:06.495036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:03.445295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497768+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.493847+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494935+0000","last_change":"2023-10-06T02:46:06.495110+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494935+0000","last_undegraded":"2023-10-06T02:46:06.494935+0000","last_fullsized":"2023-10-06T02:46:06.494935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:25.817132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496301+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495842+0000","last_change":"2023-10-06T02:46:06.495968+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495842+0000","last_undegraded":"2023-10-06T02:46:06.495842+0000","last_fullsized":"2023-10-06T02:46:06.495842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:41.862180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499248+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:14.225910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.498625+0000","last_change":"2023-10-06T02:46:06.498625+0000","last_active":"2023-10-06T02:46:06.498625+0000","last_peered":"2023-10-06T02:46:06.498625+0000","last_clean":"2023-10-06T02:46:06.498625+0000","last_became_active":"2023-10-06T02:46:06.498405+0000","last_became_peered":"2023-10-06T02:46:06.498405+0000","last_unstale":"2023-10-06T02:46:06.498625+0000","last_undegraded":"2023-10-06T02:46:06.498625+0000","last_fullsized":"2023-10-06T02:46:06.498625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.895724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.498022+0000","last_change":"2023-10-06T02:46:06.498022+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.498022+0000","last_undegraded":"2023-10-06T02:46:06.498022+0000","last_fullsized":"2023-10-06T02:46:06.498022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498516+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492166+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:22.807034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500661+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.493549+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502713+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.502791+0000","last_change":"2023-10-06T02:46:06.504972+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.502791+0000","last_undegraded":"2023-10-06T02:46:06.502791+0000","last_fullsized":"2023-10-06T02:46:06.502791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502600+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492118+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497427+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493815+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:46:05.493815+0000","last_peered":"2023-10-06T02:46:05.493815+0000","last_clean":"2023-10-06T02:46:05.493815+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:46:05.493815+0000","last_undegraded":"2023-10-06T02:46:05.493815+0000","last_fullsized":"2023-10-06T02:46:05.493815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495220+0000","last_change":"2023-10-06T02:46:06.495376+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495220+0000","last_undegraded":"2023-10-06T02:46:06.495220+0000","last_fullsized":"2023-10-06T02:46:06.495220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497631+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.491399+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:46:05.491399+0000","last_peered":"2023-10-06T02:46:05.491399+0000","last_clean":"2023-10-06T02:46:05.491399+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:46:05.491399+0000","last_undegraded":"2023-10-06T02:46:05.491399+0000","last_fullsized":"2023-10-06T02:46:05.491399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":6,"reported_epoch":21,"state":"active","last_fresh":"2023-10-06T02:46:06.507983+0000","last_change":"2023-10-06T02:46:06.507924+0000","last_active":"2023-10-06T02:46:06.507983+0000","last_peered":"2023-10-06T02:46:06.507983+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"2023-10-06T02:46:06.507924+0000","last_became_peered":"2023-10-06T02:46:06.507924+0000","last_unstale":"2023-10-06T02:46:06.507983+0000","last_undegraded":"2023-10-06T02:46:06.507983+0000","last_fullsized":"2023-10-06T02:46:06.507983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498936+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493831+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:46:05.493831+0000","last_peered":"2023-10-06T02:46:05.493831+0000","last_clean":"2023-10-06T02:46:05.493831+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:46:05.493831+0000","last_undegraded":"2023-10-06T02:46:05.493831+0000","last_fullsized":"2023-10-06T02:46:05.493831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494495+0000","last_change":"2023-10-06T02:46:06.494627+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494495+0000","last_undegraded":"2023-10-06T02:46:06.494495+0000","last_fullsized":"2023-10-06T02:46:06.494495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497989+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.491370+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:46:05.491370+0000","last_peered":"2023-10-06T02:46:05.491370+0000","last_clean":"2023-10-06T02:46:05.491370+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:46:05.491370+0000","last_undegraded":"2023-10-06T02:46:05.491370+0000","last_fullsized":"2023-10-06T02:46:05.491370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495182+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:46:05.495182+0000","last_peered":"2023-10-06T02:46:05.495182+0000","last_clean":"2023-10-06T02:46:05.495182+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:46:05.495182+0000","last_undegraded":"2023-10-06T02:46:05.495182+0000","last_fullsized":"2023-10-06T02:46:05.495182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.491683+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:27.724543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495279+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:46:05.495279+0000","last_peered":"2023-10-06T02:46:05.495279+0000","last_clean":"2023-10-06T02:46:05.495279+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:46:05.495279+0000","last_undegraded":"2023-10-06T02:46:05.495279+0000","last_fullsized":"2023-10-06T02:46:05.495279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496434+0000","last_change":"2023-10-06T02:46:06.496520+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496434+0000","last_undegraded":"2023-10-06T02:46:06.496434+0000","last_fullsized":"2023-10-06T02:46:06.496434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498137+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495083+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:46:05.495083+0000","last_peered":"2023-10-06T02:46:05.495083+0000","last_clean":"2023-10-06T02:46:05.495083+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:46:05.495083+0000","last_undegraded":"2023-10-06T02:46:05.495083+0000","last_fullsized":"2023-10-06T02:46:05.495083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494164+0000","last_change":"2023-10-06T02:46:06.494271+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494164+0000","last_undegraded":"2023-10-06T02:46:06.494164+0000","last_fullsized":"2023-10-06T02:46:06.494164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499304+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492099+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493701+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:46:05.493701+0000","last_peered":"2023-10-06T02:46:05.493701+0000","last_clean":"2023-10-06T02:46:05.493701+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:46:05.493701+0000","last_undegraded":"2023-10-06T02:46:05.493701+0000","last_fullsized":"2023-10-06T02:46:05.493701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:46:04.193048+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:46:04.193048+0000","last_peered":"2023-10-06T02:46:04.193048+0000","last_clean":"2023-10-06T02:46:04.193048+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:46:04.193048+0000","last_undegraded":"2023-10-06T02:46:04.193048+0000","last_fullsized":"2023-10-06T02:46:04.193048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496610+0000","last_change":"2023-10-06T02:46:06.496726+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496610+0000","last_undegraded":"2023-10-06T02:46:06.496610+0000","last_fullsized":"2023-10-06T02:46:06.496610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500293+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:54.816833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496174+0000","last_change":"2023-10-06T02:46:06.496304+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496174+0000","last_undegraded":"2023-10-06T02:46:06.496174+0000","last_fullsized":"2023-10-06T02:46:06.496174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499068+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:23.809044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495341+0000","last_change":"2023-10-06T02:46:06.495484+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495341+0000","last_undegraded":"2023-10-06T02:46:06.495341+0000","last_fullsized":"2023-10-06T02:46:06.495341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.501013+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495560+0000","last_change":"2023-10-06T02:46:06.495778+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495560+0000","last_undegraded":"2023-10-06T02:46:06.495560+0000","last_fullsized":"2023-10-06T02:46:06.495560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499172+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:27.620523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492447+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496250+0000","last_change":"2023-10-06T02:46:06.496347+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496250+0000","last_undegraded":"2023-10-06T02:46:06.496250+0000","last_fullsized":"2023-10-06T02:46:06.496250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507072+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507399+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500322+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]}],"pool_statfs":[]}} 2023-10-06T02:46:11.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:46:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.715+0000 7f7bd8b07700 1 Processor -- start 2023-10-06T02:46:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.715+0000 7f7bd8b07700 1 -- start start 2023-10-06T02:46:11.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.716+0000 7f7bd8b07700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7bd415a2a0 0x7f7bd40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.716+0000 7f7bd8b07700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd40b0ca0 con 0x7f7bd406dd60 2023-10-06T02:46:11.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.716+0000 7f7bd8b07700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd40b00d0 con 0x7f7bd40ceb30 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.716+0000 7f7bd8b07700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd406e160 con 0x7f7bd415a2a0 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.716+0000 7f7bd2d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7bd406dd60 0x7f7bd40b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58054/0 (socket says 172.21.15.81:58054) 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.716+0000 7f7bd2d9d700 1 -- 172.21.15.81:0/96258865 learned_addr learned my addr 172.21.15.81:0/96258865 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.716+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948725455 0 0) 0x7f7bd40b0ca0 con 0x7f7bd406dd60 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.716+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc0003570 con 0x7f7bd406dd60 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.716+0000 7f7bd259c700 1 --2- 172.21.15.81:0/96258865 >> v2:172.21.15.83:3300/0 conn(0x7f7bd415a2a0 0x7f7bd40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084682603 0 0) 0x7f7bc0003570 con 0x7f7bd406dd60 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 >> v2:172.21.15.83:3300/0 conn(0x7f7bd415a2a0 msgr2=0x7f7bd40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 --2- 172.21.15.81:0/96258865 >> v2:172.21.15.83:3300/0 conn(0x7f7bd415a2a0 0x7f7bd40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 >> v1:172.21.15.83:6789/0 conn(0x7f7bd40ceb30 legacy=0x7f7bd406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40b0370 con 0x7f7bd406dd60 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f7bcc0017f0 con 0x7f7bd406dd60 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 >> v1:172.21.15.81:6789/0 conn(0x7f7bd406dd60 legacy=0x7f7bd40b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc0003a60 0x7f7bc0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bc0004810 0x7f7bc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bc00051c0 0x7f7bc000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd406e160 con 0x7f7bc0003a60 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc000c0d0 con 0x7f7bc0004810 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc000c290 con 0x7f7bc00051c0 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd259c700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc0003a60 0x7f7bc0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bc9d9b700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bc0004810 0x7f7bc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd2d9d700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bc00051c0 0x7f7bc000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd259c700 1 -- 172.21.15.81:0/96258865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bc00051c0 msgr2=0x7f7bc000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd259c700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bc00051c0 0x7f7bc000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd259c700 1 -- 172.21.15.81:0/96258865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bc0004810 msgr2=0x7f7bc0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd259c700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bc0004810 0x7f7bc0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd259c700 1 -- 172.21.15.81:0/96258865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0003570 con 0x7f7bc0003a60 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd2d9d700 1 -- 172.21.15.81:0/96258865 reap_dead start 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd259c700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc0003a60 0x7f7bc0003e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009c00 tx=0x7f7bc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d409cbe1ce2cff51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400e710 con 0x7f7bc0003a60 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc400e870 con 0x7f7bc0003a60 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.717+0000 7f7bd1d9b700 1 -- 172.21.15.81:0/96258865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400ec30 con 0x7f7bc0003a60 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.718+0000 7f7bd8b07700 1 -- 172.21.15.81:0/96258865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc0003a60 msgr2=0x7f7bc0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.718+0000 7f7bd8b07700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc0003a60 0x7f7bc0003e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009c00 tx=0x7f7bc40091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.718+0000 7f7bd8b07700 1 -- 172.21.15.81:0/96258865 shutdown_connections 2023-10-06T02:46:11.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.718+0000 7f7bd8b07700 1 --2- 172.21.15.81:0/96258865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc0003a60 0x7f7bc0003e70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.718+0000 7f7bd8b07700 1 -- 172.21.15.81:0/96258865 >> 172.21.15.81:0/96258865 conn(0x7f7bd4067640 msgr2=0x7f7bd4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:11.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.718+0000 7f7bd8b07700 1 -- 172.21.15.81:0/96258865 shutdown_connections 2023-10-06T02:46:11.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.718+0000 7f7bd8b07700 1 -- 172.21.15.81:0/96258865 wait complete. 2023-10-06T02:46:11.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.719+0000 7f7bd8b07700 1 Processor -- start 2023-10-06T02:46:11.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.719+0000 7f7bd8b07700 1 -- start start 2023-10-06T02:46:11.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd8b07700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bc0003a60 0x7f7bd416e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd8b07700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bd415e9e0 0x7f7bd4151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd8b07700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bd4157d40 0x7f7bd414fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd8b07700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd416e790 con 0x7f7bd415e9e0 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd8b07700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd4152410 con 0x7f7bd4157d40 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd8b07700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd415efa0 con 0x7f7bc0003a60 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bc9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bd415e9e0 0x7f7bd4151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bc9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bd415e9e0 0x7f7bd4151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56646/0 (socket says 172.21.15.81:56646) 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bc9d9b700 1 -- 172.21.15.81:0/4132674657 learned_addr learned my addr 172.21.15.81:0/4132674657 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd259c700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bc0003a60 0x7f7bd416e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd2d9d700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bd4157d40 0x7f7bd414fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bc9d9b700 1 -- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bc0003a60 msgr2=0x7f7bd416e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bc9d9b700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bc0003a60 0x7f7bd416e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bc9d9b700 1 -- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bd4157d40 msgr2=0x7f7bd414fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bc9d9b700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bd4157d40 0x7f7bd414fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bc9d9b700 1 -- 172.21.15.81:0/4132674657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd415f280 con 0x7f7bd415e9e0 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd2d9d700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bd4157d40 0x7f7bd414fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bc9d9b700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bd415e9e0 0x7f7bd4151ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc002950 tx=0x7f7bbc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bcaffd700 1 -- 172.21.15.81:0/4132674657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc002e90 con 0x7f7bd415e9e0 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bcaffd700 1 -- 172.21.15.81:0/4132674657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00f8d0 con 0x7f7bd415e9e0 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.720+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd415f560 con 0x7f7bd415e9e0 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.721+0000 7f7bcaffd700 1 -- 172.21.15.81:0/4132674657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00fc90 con 0x7f7bd415e9e0 2023-10-06T02:46:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.721+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd415cee0 con 0x7f7bd415e9e0 2023-10-06T02:46:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.721+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd4069e40 con 0x7f7bd415e9e0 2023-10-06T02:46:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.722+0000 7f7bcaffd700 1 -- 172.21.15.81:0/4132674657 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bbc006a30 con 0x7f7bd415e9e0 2023-10-06T02:46:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.722+0000 7f7bcaffd700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bb4066f30 0x7f7bb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.722+0000 7f7bcaffd700 1 -- 172.21.15.81:0/4132674657 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7bbc084690 con 0x7f7bd415e9e0 2023-10-06T02:46:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.722+0000 7f7bd259c700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bb4066f30 0x7f7bb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.723+0000 7f7bd259c700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bb4066f30 0x7f7bb40693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40091e0 tx=0x7f7bc401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.726+0000 7f7bcaffd700 1 -- 172.21.15.81:0/4132674657 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bbc0517a0 con 0x7f7bd415e9e0 2023-10-06T02:46:11.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.906+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7bd404bb80 con 0x7f7bb4066f30 2023-10-06T02:46:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.914+0000 7f7bcaffd700 1 -- 172.21.15.81:0/4132674657 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275847 (secure 0 0 0) 0x7f7bd404bb80 con 0x7f7bb4066f30 2023-10-06T02:46:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bb4066f30 msgr2=0x7f7bb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bb4066f30 0x7f7bb40693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40091e0 tx=0x7f7bc401a000 comp rx=0 tx=0).stop 2023-10-06T02:46:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bd415e9e0 msgr2=0x7f7bd4151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bd415e9e0 0x7f7bd4151ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc002950 tx=0x7f7bbc007d30 comp rx=0 tx=0).stop 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 shutdown_connections 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bb4066f30 0x7f7bb40693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bd4157d40 0x7f7bd414fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bc0003a60 0x7f7bd416e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 --2- 172.21.15.81:0/4132674657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bd415e9e0 0x7f7bd4151ed0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 >> 172.21.15.81:0/4132674657 conn(0x7f7bd4067640 msgr2=0x7f7bd40ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 shutdown_connections 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:11.917+0000 7f7bd8b07700 1 -- 172.21.15.81:0/4132674657 wait complete. 2023-10-06T02:46:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:46:11.930 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-06T02:46:11.492341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1690,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560809,"statfs":{"total":1600000000,"available":1598268912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001244"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499660+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:31.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498840+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502959+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497739+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507031+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499150+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497381+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498328+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497012+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.505949+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497757+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:42.409000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498211+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:24.231578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496243+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497226+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.501912+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498882+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502376+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499764+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:26.776913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.506218+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497982+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498553+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496853+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.503946+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499243+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498467+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.506243+0000","last_change":"2023-10-06T02:46:06.506243+0000","last_active":"2023-10-06T02:46:06.506243+0000","last_peered":"2023-10-06T02:46:06.506243+0000","last_clean":"2023-10-06T02:46:06.506243+0000","last_became_active":"2023-10-06T02:46:06.505980+0000","last_became_peered":"2023-10-06T02:46:06.505980+0000","last_unstale":"2023-10-06T02:46:06.506243+0000","last_undegraded":"2023-10-06T02:46:06.506243+0000","last_fullsized":"2023-10-06T02:46:06.506243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494165+0000","last_change":"2023-10-06T02:46:06.494298+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494165+0000","last_undegraded":"2023-10-06T02:46:06.494165+0000","last_fullsized":"2023-10-06T02:46:06.494165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497979+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.494404+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496375+0000","last_change":"2023-10-06T02:46:06.496471+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496375+0000","last_undegraded":"2023-10-06T02:46:06.496375+0000","last_fullsized":"2023-10-06T02:46:06.496375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.501257+0000","last_change":"2023-10-06T02:46:06.501257+0000","last_active":"2023-10-06T02:46:06.501257+0000","last_peered":"2023-10-06T02:46:06.501257+0000","last_clean":"2023-10-06T02:46:06.501257+0000","last_became_active":"2023-10-06T02:46:06.501036+0000","last_became_peered":"2023-10-06T02:46:06.501036+0000","last_unstale":"2023-10-06T02:46:06.501257+0000","last_undegraded":"2023-10-06T02:46:06.501257+0000","last_fullsized":"2023-10-06T02:46:06.501257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495159+0000","last_change":"2023-10-06T02:46:06.495313+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495159+0000","last_undegraded":"2023-10-06T02:46:06.495159+0000","last_fullsized":"2023-10-06T02:46:06.495159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:40.222541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498229+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.506258+0000","last_change":"2023-10-06T02:46:06.506258+0000","last_active":"2023-10-06T02:46:06.506258+0000","last_peered":"2023-10-06T02:46:06.506258+0000","last_clean":"2023-10-06T02:46:06.506258+0000","last_became_active":"2023-10-06T02:46:06.505429+0000","last_became_peered":"2023-10-06T02:46:06.505429+0000","last_unstale":"2023-10-06T02:46:06.506258+0000","last_undegraded":"2023-10-06T02:46:06.506258+0000","last_fullsized":"2023-10-06T02:46:06.506258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.505775+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495545+0000","last_change":"2023-10-06T02:46:06.495688+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495545+0000","last_undegraded":"2023-10-06T02:46:06.495545+0000","last_fullsized":"2023-10-06T02:46:06.495545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:25.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496151+0000","last_change":"2023-10-06T02:46:06.496274+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496151+0000","last_undegraded":"2023-10-06T02:46:06.496151+0000","last_fullsized":"2023-10-06T02:46:06.496151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496860+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495036+0000","last_change":"2023-10-06T02:46:06.495157+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495036+0000","last_undegraded":"2023-10-06T02:46:06.495036+0000","last_fullsized":"2023-10-06T02:46:06.495036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:03.445295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497768+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.493847+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494935+0000","last_change":"2023-10-06T02:46:06.495110+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494935+0000","last_undegraded":"2023-10-06T02:46:06.494935+0000","last_fullsized":"2023-10-06T02:46:06.494935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:25.817132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496301+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495842+0000","last_change":"2023-10-06T02:46:06.495968+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495842+0000","last_undegraded":"2023-10-06T02:46:06.495842+0000","last_fullsized":"2023-10-06T02:46:06.495842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:41.862180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499248+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:14.225910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.498625+0000","last_change":"2023-10-06T02:46:06.498625+0000","last_active":"2023-10-06T02:46:06.498625+0000","last_peered":"2023-10-06T02:46:06.498625+0000","last_clean":"2023-10-06T02:46:06.498625+0000","last_became_active":"2023-10-06T02:46:06.498405+0000","last_became_peered":"2023-10-06T02:46:06.498405+0000","last_unstale":"2023-10-06T02:46:06.498625+0000","last_undegraded":"2023-10-06T02:46:06.498625+0000","last_fullsized":"2023-10-06T02:46:06.498625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.895724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.498022+0000","last_change":"2023-10-06T02:46:06.498022+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.498022+0000","last_undegraded":"2023-10-06T02:46:06.498022+0000","last_fullsized":"2023-10-06T02:46:06.498022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498516+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492166+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:22.807034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500661+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.493549+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502713+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.502791+0000","last_change":"2023-10-06T02:46:06.504972+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.502791+0000","last_undegraded":"2023-10-06T02:46:06.502791+0000","last_fullsized":"2023-10-06T02:46:06.502791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502600+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492118+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497427+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493815+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:46:05.493815+0000","last_peered":"2023-10-06T02:46:05.493815+0000","last_clean":"2023-10-06T02:46:05.493815+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:46:05.493815+0000","last_undegraded":"2023-10-06T02:46:05.493815+0000","last_fullsized":"2023-10-06T02:46:05.493815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495220+0000","last_change":"2023-10-06T02:46:06.495376+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495220+0000","last_undegraded":"2023-10-06T02:46:06.495220+0000","last_fullsized":"2023-10-06T02:46:06.495220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497631+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.491399+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:46:05.491399+0000","last_peered":"2023-10-06T02:46:05.491399+0000","last_clean":"2023-10-06T02:46:05.491399+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:46:05.491399+0000","last_undegraded":"2023-10-06T02:46:05.491399+0000","last_fullsized":"2023-10-06T02:46:05.491399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":6,"reported_epoch":21,"state":"active","last_fresh":"2023-10-06T02:46:06.507983+0000","last_change":"2023-10-06T02:46:06.507924+0000","last_active":"2023-10-06T02:46:06.507983+0000","last_peered":"2023-10-06T02:46:06.507983+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"2023-10-06T02:46:06.507924+0000","last_became_peered":"2023-10-06T02:46:06.507924+0000","last_unstale":"2023-10-06T02:46:06.507983+0000","last_undegraded":"2023-10-06T02:46:06.507983+0000","last_fullsized":"2023-10-06T02:46:06.507983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498936+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493831+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:46:05.493831+0000","last_peered":"2023-10-06T02:46:05.493831+0000","last_clean":"2023-10-06T02:46:05.493831+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:46:05.493831+0000","last_undegraded":"2023-10-06T02:46:05.493831+0000","last_fullsized":"2023-10-06T02:46:05.493831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494495+0000","last_change":"2023-10-06T02:46:06.494627+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494495+0000","last_undegraded":"2023-10-06T02:46:06.494495+0000","last_fullsized":"2023-10-06T02:46:06.494495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497989+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.491370+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:46:05.491370+0000","last_peered":"2023-10-06T02:46:05.491370+0000","last_clean":"2023-10-06T02:46:05.491370+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:46:05.491370+0000","last_undegraded":"2023-10-06T02:46:05.491370+0000","last_fullsized":"2023-10-06T02:46:05.491370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495182+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:46:05.495182+0000","last_peered":"2023-10-06T02:46:05.495182+0000","last_clean":"2023-10-06T02:46:05.495182+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:46:05.495182+0000","last_undegraded":"2023-10-06T02:46:05.495182+0000","last_fullsized":"2023-10-06T02:46:05.495182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.491683+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:27.724543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495279+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:46:05.495279+0000","last_peered":"2023-10-06T02:46:05.495279+0000","last_clean":"2023-10-06T02:46:05.495279+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:46:05.495279+0000","last_undegraded":"2023-10-06T02:46:05.495279+0000","last_fullsized":"2023-10-06T02:46:05.495279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496434+0000","last_change":"2023-10-06T02:46:06.496520+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496434+0000","last_undegraded":"2023-10-06T02:46:06.496434+0000","last_fullsized":"2023-10-06T02:46:06.496434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498137+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495083+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:46:05.495083+0000","last_peered":"2023-10-06T02:46:05.495083+0000","last_clean":"2023-10-06T02:46:05.495083+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:46:05.495083+0000","last_undegraded":"2023-10-06T02:46:05.495083+0000","last_fullsized":"2023-10-06T02:46:05.495083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494164+0000","last_change":"2023-10-06T02:46:06.494271+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494164+0000","last_undegraded":"2023-10-06T02:46:06.494164+0000","last_fullsized":"2023-10-06T02:46:06.494164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499304+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492099+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493701+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:46:05.493701+0000","last_peered":"2023-10-06T02:46:05.493701+0000","last_clean":"2023-10-06T02:46:05.493701+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:46:05.493701+0000","last_undegraded":"2023-10-06T02:46:05.493701+0000","last_fullsized":"2023-10-06T02:46:05.493701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:46:04.193048+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:46:04.193048+0000","last_peered":"2023-10-06T02:46:04.193048+0000","last_clean":"2023-10-06T02:46:04.193048+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:46:04.193048+0000","last_undegraded":"2023-10-06T02:46:04.193048+0000","last_fullsized":"2023-10-06T02:46:04.193048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496610+0000","last_change":"2023-10-06T02:46:06.496726+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496610+0000","last_undegraded":"2023-10-06T02:46:06.496610+0000","last_fullsized":"2023-10-06T02:46:06.496610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500293+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:54.816833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496174+0000","last_change":"2023-10-06T02:46:06.496304+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496174+0000","last_undegraded":"2023-10-06T02:46:06.496174+0000","last_fullsized":"2023-10-06T02:46:06.496174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499068+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:23.809044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495341+0000","last_change":"2023-10-06T02:46:06.495484+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495341+0000","last_undegraded":"2023-10-06T02:46:06.495341+0000","last_fullsized":"2023-10-06T02:46:06.495341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.501013+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495560+0000","last_change":"2023-10-06T02:46:06.495778+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495560+0000","last_undegraded":"2023-10-06T02:46:06.495560+0000","last_fullsized":"2023-10-06T02:46:06.495560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499172+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:27.620523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492447+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496250+0000","last_change":"2023-10-06T02:46:06.496347+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496250+0000","last_undegraded":"2023-10-06T02:46:06.496250+0000","last_fullsized":"2023-10-06T02:46:06.496250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507072+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507399+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500322+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]}],"pool_statfs":[]}} 2023-10-06T02:46:11.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:46:12.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.084+0000 7f8a2759e700 1 Processor -- start 2023-10-06T02:46:12.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.084+0000 7f8a2759e700 1 -- start start 2023-10-06T02:46:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a2759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8a28159bc0 0x7f8a280b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a2759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a280cf060 0x7f8a2806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a2759e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a28067640 con 0x7f8a28159f90 2023-10-06T02:46:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a2759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a280b1e50 con 0x7f8a280cf060 2023-10-06T02:46:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a2759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a28067890 con 0x7f8a28159bc0 2023-10-06T02:46:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a26d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a280cf060 0x7f8a2806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a26d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a280cf060 0x7f8a2806b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56656/0 (socket says 172.21.15.81:56656) 2023-10-06T02:46:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a26d9d700 1 -- 172.21.15.81:0/573883648 learned_addr learned my addr 172.21.15.81:0/573883648 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a2659c700 1 --2- 172.21.15.81:0/573883648 >> v2:172.21.15.83:3300/0 conn(0x7f8a28159bc0 0x7f8a280b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a26d9d700 1 -- 172.21.15.81:0/573883648 >> v2:172.21.15.83:3300/0 conn(0x7f8a28159bc0 msgr2=0x7f8a280b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a26d9d700 1 --2- 172.21.15.81:0/573883648 >> v2:172.21.15.83:3300/0 conn(0x7f8a28159bc0 0x7f8a280b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a26d9d700 1 -- 172.21.15.81:0/573883648 >> v1:172.21.15.83:6789/0 conn(0x7f8a28159f90 legacy=0x7f8a280ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a26d9d700 1 -- 172.21.15.81:0/573883648 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a28067b70 con 0x7f8a280cf060 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a2659c700 1 --2- 172.21.15.81:0/573883648 >> v2:172.21.15.83:3300/0 conn(0x7f8a28159bc0 0x7f8a280b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.085+0000 7f8a26d9d700 1 --2- 172.21.15.81:0/573883648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 0x7f8a2806b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8a280777e0 tx=0x7f8a20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45e528f678718c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a25d9b700 1 -- 172.21.15.81:0/573883648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000b860 con 0x7f8a280cf060 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a25d9b700 1 -- 172.21.15.81:0/573883648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2000b9c0 con 0x7f8a280cf060 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a25d9b700 1 -- 172.21.15.81:0/573883648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000bd60 con 0x7f8a280cf060 2023-10-06T02:46:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a2759e700 1 -- 172.21.15.81:0/573883648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 msgr2=0x7f8a2806b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a2759e700 1 --2- 172.21.15.81:0/573883648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 0x7f8a2806b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8a280777e0 tx=0x7f8a20009250 comp rx=0 tx=0).stop 2023-10-06T02:46:12.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a2759e700 1 -- 172.21.15.81:0/573883648 shutdown_connections 2023-10-06T02:46:12.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a2759e700 1 --2- 172.21.15.81:0/573883648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 0x7f8a2806b0d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a2759e700 1 --2- 172.21.15.81:0/573883648 >> v2:172.21.15.83:3300/0 conn(0x7f8a28159bc0 0x7f8a280b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a2759e700 1 -- 172.21.15.81:0/573883648 >> 172.21.15.81:0/573883648 conn(0x7f8a2806c620 msgr2=0x7f8a2806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:12.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a2759e700 1 -- 172.21.15.81:0/573883648 shutdown_connections 2023-10-06T02:46:12.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.086+0000 7f8a2759e700 1 -- 172.21.15.81:0/573883648 wait complete. 2023-10-06T02:46:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.087+0000 7f8a2759e700 1 Processor -- start 2023-10-06T02:46:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.087+0000 7f8a2759e700 1 -- start start 2023-10-06T02:46:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 0x7f8a280b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a28159bc0 0x7f8a280b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a28159f90 0x7f8a280ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a280c7f00 con 0x7f8a280cf060 2023-10-06T02:46:12.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a280aef60 con 0x7f8a28159f90 2023-10-06T02:46:12.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a280af240 con 0x7f8a28159bc0 2023-10-06T02:46:12.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 0x7f8a280b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 0x7f8a280b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56664/0 (socket says 172.21.15.81:56664) 2023-10-06T02:46:12.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2659c700 1 -- 172.21.15.81:0/2313143907 learned_addr learned my addr 172.21.15.81:0/2313143907 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:12.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a26d9d700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a28159f90 0x7f8a280ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a1dd9b700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a28159bc0 0x7f8a280b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2659c700 1 -- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a28159bc0 msgr2=0x7f8a280b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2659c700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a28159bc0 0x7f8a280b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2659c700 1 -- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a28159f90 msgr2=0x7f8a280ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2659c700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a28159f90 0x7f8a280ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.088+0000 7f8a2659c700 1 -- 172.21.15.81:0/2313143907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a200094f0 con 0x7f8a280cf060 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.089+0000 7f8a2659c700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 0x7f8a280b0190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800d1d0 tx=0x7f8a18009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.089+0000 7f8a1effd700 1 -- 172.21.15.81:0/2313143907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800ddc0 con 0x7f8a280cf060 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.089+0000 7f8a1effd700 1 -- 172.21.15.81:0/2313143907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1800f040 con 0x7f8a280cf060 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.089+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a280af6b0 con 0x7f8a280cf060 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.089+0000 7f8a1effd700 1 -- 172.21.15.81:0/2313143907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18015670 con 0x7f8a280cf060 2023-10-06T02:46:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.089+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a280afc70 con 0x7f8a280cf060 2023-10-06T02:46:12.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.090+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a280affe0 con 0x7f8a280cf060 2023-10-06T02:46:12.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.090+0000 7f8a1effd700 1 -- 172.21.15.81:0/2313143907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a18015a60 con 0x7f8a280cf060 2023-10-06T02:46:12.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.090+0000 7f8a1effd700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8a08066f30 0x7f8a080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.091+0000 7f8a1effd700 1 -- 172.21.15.81:0/2313143907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8a18084ab0 con 0x7f8a280cf060 2023-10-06T02:46:12.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.091+0000 7f8a1dd9b700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8a08066f30 0x7f8a080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.091+0000 7f8a1dd9b700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8a08066f30 0x7f8a080693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a280b0fc0 tx=0x7f8a10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:12.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.095+0000 7f8a1effd700 1 -- 172.21.15.81:0/2313143907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a1804e5a0 con 0x7f8a280cf060 2023-10-06T02:46:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.272+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a28071b10 con 0x7f8a08066f30 2023-10-06T02:46:12.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.280+0000 7f8a1effd700 1 -- 172.21.15.81:0/2313143907 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275847 (secure 0 0 0) 0x7f8a28071b10 con 0x7f8a08066f30 2023-10-06T02:46:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8a08066f30 msgr2=0x7f8a080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8a08066f30 0x7f8a080693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a280b0fc0 tx=0x7f8a10009040 comp rx=0 tx=0).stop 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 msgr2=0x7f8a280b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 0x7f8a280b0190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800d1d0 tx=0x7f8a18009a90 comp rx=0 tx=0).stop 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 shutdown_connections 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8a08066f30 0x7f8a080693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a28159f90 0x7f8a280ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a280cf060 0x7f8a280b0190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 --2- 172.21.15.81:0/2313143907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a28159bc0 0x7f8a280b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 >> 172.21.15.81:0/2313143907 conn(0x7f8a2806c620 msgr2=0x7f8a28155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 shutdown_connections 2023-10-06T02:46:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.283+0000 7f8a2759e700 1 -- 172.21.15.81:0/2313143907 wait complete. 2023-10-06T02:46:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:46:12.296 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-06T02:46:11.492341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1690,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560809,"statfs":{"total":1600000000,"available":1598268912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001244"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499660+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:31.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498840+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502959+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497739+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507031+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499150+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497381+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498328+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497012+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.505949+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497757+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:42.409000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498211+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:24.231578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496243+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497226+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.501912+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498882+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502376+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499764+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:26.776913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.506218+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497982+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498553+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496853+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.503946+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499243+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498467+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.506243+0000","last_change":"2023-10-06T02:46:06.506243+0000","last_active":"2023-10-06T02:46:06.506243+0000","last_peered":"2023-10-06T02:46:06.506243+0000","last_clean":"2023-10-06T02:46:06.506243+0000","last_became_active":"2023-10-06T02:46:06.505980+0000","last_became_peered":"2023-10-06T02:46:06.505980+0000","last_unstale":"2023-10-06T02:46:06.506243+0000","last_undegraded":"2023-10-06T02:46:06.506243+0000","last_fullsized":"2023-10-06T02:46:06.506243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494165+0000","last_change":"2023-10-06T02:46:06.494298+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494165+0000","last_undegraded":"2023-10-06T02:46:06.494165+0000","last_fullsized":"2023-10-06T02:46:06.494165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497979+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.494404+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496375+0000","last_change":"2023-10-06T02:46:06.496471+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496375+0000","last_undegraded":"2023-10-06T02:46:06.496375+0000","last_fullsized":"2023-10-06T02:46:06.496375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.501257+0000","last_change":"2023-10-06T02:46:06.501257+0000","last_active":"2023-10-06T02:46:06.501257+0000","last_peered":"2023-10-06T02:46:06.501257+0000","last_clean":"2023-10-06T02:46:06.501257+0000","last_became_active":"2023-10-06T02:46:06.501036+0000","last_became_peered":"2023-10-06T02:46:06.501036+0000","last_unstale":"2023-10-06T02:46:06.501257+0000","last_undegraded":"2023-10-06T02:46:06.501257+0000","last_fullsized":"2023-10-06T02:46:06.501257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495159+0000","last_change":"2023-10-06T02:46:06.495313+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495159+0000","last_undegraded":"2023-10-06T02:46:06.495159+0000","last_fullsized":"2023-10-06T02:46:06.495159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:40.222541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498229+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.506258+0000","last_change":"2023-10-06T02:46:06.506258+0000","last_active":"2023-10-06T02:46:06.506258+0000","last_peered":"2023-10-06T02:46:06.506258+0000","last_clean":"2023-10-06T02:46:06.506258+0000","last_became_active":"2023-10-06T02:46:06.505429+0000","last_became_peered":"2023-10-06T02:46:06.505429+0000","last_unstale":"2023-10-06T02:46:06.506258+0000","last_undegraded":"2023-10-06T02:46:06.506258+0000","last_fullsized":"2023-10-06T02:46:06.506258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.505775+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495545+0000","last_change":"2023-10-06T02:46:06.495688+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495545+0000","last_undegraded":"2023-10-06T02:46:06.495545+0000","last_fullsized":"2023-10-06T02:46:06.495545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:25.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496151+0000","last_change":"2023-10-06T02:46:06.496274+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496151+0000","last_undegraded":"2023-10-06T02:46:06.496151+0000","last_fullsized":"2023-10-06T02:46:06.496151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496860+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495036+0000","last_change":"2023-10-06T02:46:06.495157+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495036+0000","last_undegraded":"2023-10-06T02:46:06.495036+0000","last_fullsized":"2023-10-06T02:46:06.495036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:03.445295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497768+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.493847+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494935+0000","last_change":"2023-10-06T02:46:06.495110+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494935+0000","last_undegraded":"2023-10-06T02:46:06.494935+0000","last_fullsized":"2023-10-06T02:46:06.494935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:25.817132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496301+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495842+0000","last_change":"2023-10-06T02:46:06.495968+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495842+0000","last_undegraded":"2023-10-06T02:46:06.495842+0000","last_fullsized":"2023-10-06T02:46:06.495842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:41.862180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499248+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:14.225910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.498625+0000","last_change":"2023-10-06T02:46:06.498625+0000","last_active":"2023-10-06T02:46:06.498625+0000","last_peered":"2023-10-06T02:46:06.498625+0000","last_clean":"2023-10-06T02:46:06.498625+0000","last_became_active":"2023-10-06T02:46:06.498405+0000","last_became_peered":"2023-10-06T02:46:06.498405+0000","last_unstale":"2023-10-06T02:46:06.498625+0000","last_undegraded":"2023-10-06T02:46:06.498625+0000","last_fullsized":"2023-10-06T02:46:06.498625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.895724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.498022+0000","last_change":"2023-10-06T02:46:06.498022+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.498022+0000","last_undegraded":"2023-10-06T02:46:06.498022+0000","last_fullsized":"2023-10-06T02:46:06.498022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498516+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492166+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:22.807034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500661+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.493549+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502713+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.502791+0000","last_change":"2023-10-06T02:46:06.504972+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.502791+0000","last_undegraded":"2023-10-06T02:46:06.502791+0000","last_fullsized":"2023-10-06T02:46:06.502791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502600+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492118+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497427+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493815+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:46:05.493815+0000","last_peered":"2023-10-06T02:46:05.493815+0000","last_clean":"2023-10-06T02:46:05.493815+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:46:05.493815+0000","last_undegraded":"2023-10-06T02:46:05.493815+0000","last_fullsized":"2023-10-06T02:46:05.493815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495220+0000","last_change":"2023-10-06T02:46:06.495376+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495220+0000","last_undegraded":"2023-10-06T02:46:06.495220+0000","last_fullsized":"2023-10-06T02:46:06.495220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497631+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.491399+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:46:05.491399+0000","last_peered":"2023-10-06T02:46:05.491399+0000","last_clean":"2023-10-06T02:46:05.491399+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:46:05.491399+0000","last_undegraded":"2023-10-06T02:46:05.491399+0000","last_fullsized":"2023-10-06T02:46:05.491399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":6,"reported_epoch":21,"state":"active","last_fresh":"2023-10-06T02:46:06.507983+0000","last_change":"2023-10-06T02:46:06.507924+0000","last_active":"2023-10-06T02:46:06.507983+0000","last_peered":"2023-10-06T02:46:06.507983+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"2023-10-06T02:46:06.507924+0000","last_became_peered":"2023-10-06T02:46:06.507924+0000","last_unstale":"2023-10-06T02:46:06.507983+0000","last_undegraded":"2023-10-06T02:46:06.507983+0000","last_fullsized":"2023-10-06T02:46:06.507983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498936+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493831+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:46:05.493831+0000","last_peered":"2023-10-06T02:46:05.493831+0000","last_clean":"2023-10-06T02:46:05.493831+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:46:05.493831+0000","last_undegraded":"2023-10-06T02:46:05.493831+0000","last_fullsized":"2023-10-06T02:46:05.493831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494495+0000","last_change":"2023-10-06T02:46:06.494627+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494495+0000","last_undegraded":"2023-10-06T02:46:06.494495+0000","last_fullsized":"2023-10-06T02:46:06.494495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497989+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.491370+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:46:05.491370+0000","last_peered":"2023-10-06T02:46:05.491370+0000","last_clean":"2023-10-06T02:46:05.491370+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:46:05.491370+0000","last_undegraded":"2023-10-06T02:46:05.491370+0000","last_fullsized":"2023-10-06T02:46:05.491370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495182+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:46:05.495182+0000","last_peered":"2023-10-06T02:46:05.495182+0000","last_clean":"2023-10-06T02:46:05.495182+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:46:05.495182+0000","last_undegraded":"2023-10-06T02:46:05.495182+0000","last_fullsized":"2023-10-06T02:46:05.495182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.491683+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:27.724543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495279+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:46:05.495279+0000","last_peered":"2023-10-06T02:46:05.495279+0000","last_clean":"2023-10-06T02:46:05.495279+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:46:05.495279+0000","last_undegraded":"2023-10-06T02:46:05.495279+0000","last_fullsized":"2023-10-06T02:46:05.495279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496434+0000","last_change":"2023-10-06T02:46:06.496520+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496434+0000","last_undegraded":"2023-10-06T02:46:06.496434+0000","last_fullsized":"2023-10-06T02:46:06.496434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498137+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495083+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:46:05.495083+0000","last_peered":"2023-10-06T02:46:05.495083+0000","last_clean":"2023-10-06T02:46:05.495083+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:46:05.495083+0000","last_undegraded":"2023-10-06T02:46:05.495083+0000","last_fullsized":"2023-10-06T02:46:05.495083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494164+0000","last_change":"2023-10-06T02:46:06.494271+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494164+0000","last_undegraded":"2023-10-06T02:46:06.494164+0000","last_fullsized":"2023-10-06T02:46:06.494164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499304+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492099+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493701+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:46:05.493701+0000","last_peered":"2023-10-06T02:46:05.493701+0000","last_clean":"2023-10-06T02:46:05.493701+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:46:05.493701+0000","last_undegraded":"2023-10-06T02:46:05.493701+0000","last_fullsized":"2023-10-06T02:46:05.493701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:46:04.193048+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:46:04.193048+0000","last_peered":"2023-10-06T02:46:04.193048+0000","last_clean":"2023-10-06T02:46:04.193048+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:46:04.193048+0000","last_undegraded":"2023-10-06T02:46:04.193048+0000","last_fullsized":"2023-10-06T02:46:04.193048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496610+0000","last_change":"2023-10-06T02:46:06.496726+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496610+0000","last_undegraded":"2023-10-06T02:46:06.496610+0000","last_fullsized":"2023-10-06T02:46:06.496610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500293+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:54.816833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496174+0000","last_change":"2023-10-06T02:46:06.496304+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496174+0000","last_undegraded":"2023-10-06T02:46:06.496174+0000","last_fullsized":"2023-10-06T02:46:06.496174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499068+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:23.809044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495341+0000","last_change":"2023-10-06T02:46:06.495484+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495341+0000","last_undegraded":"2023-10-06T02:46:06.495341+0000","last_fullsized":"2023-10-06T02:46:06.495341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.501013+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495560+0000","last_change":"2023-10-06T02:46:06.495778+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495560+0000","last_undegraded":"2023-10-06T02:46:06.495560+0000","last_fullsized":"2023-10-06T02:46:06.495560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499172+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:27.620523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492447+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496250+0000","last_change":"2023-10-06T02:46:06.496347+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496250+0000","last_undegraded":"2023-10-06T02:46:06.496250+0000","last_fullsized":"2023-10-06T02:46:06.496250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507072+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507399+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500322+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]}],"pool_statfs":[]}} 2023-10-06T02:46:12.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-10-06T02:46:12.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.499660+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:22:31.231756+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:46:12.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-10-06T02:46:12.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498840+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-10-06T02:46:12.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.502959+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-10-06T02:46:12.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497739+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.507031+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.499150+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497381+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-10-06T02:46:12.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498328+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-10-06T02:46:12.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497012+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-10-06T02:46:12.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.505949+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-10-06T02:46:12.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497757+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:58:42.409000+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:46:12.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-10-06T02:46:12.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498211+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:04:24.231578+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.496243+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497226+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.501912+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498882+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-10-06T02:46:12.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.502376+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-10-06T02:46:12.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.499764+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:37:26.776913+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:46:12.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-10-06T02:46:12.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.506218+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-10-06T02:46:12.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497982+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:46:12.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-10-06T02:46:12.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498553+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-10-06T02:46:12.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-10-06T02:46:12.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.496853+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:46:12.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-10-06T02:46:12.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.503946+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-10-06T02:46:12.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.499243+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-10-06T02:46:12.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498467+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-10-06T02:46:12.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-06T02:46:12.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.494165+0000', 'last_change': '2023-10-06T02:46:06.494298+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.494165+0000', 'last_undegraded': '2023-10-06T02:46:06.494165+0000', 'last_fullsized': '2023-10-06T02:46:06.494165+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-10-06T02:46:12.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497979+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-06T02:46:12.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:05.487581+0000', 'last_change': '2023-10-06T02:46:05.494404+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:05.487581+0000', 'last_undegraded': '2023-10-06T02:46:05.487581+0000', 'last_fullsized': '2023-10-06T02:46:05.487581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:46:12.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-10-06T02:46:12.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-06T02:46:12.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.496375+0000', 'last_change': '2023-10-06T02:46:06.496471+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.496375+0000', 'last_undegraded': '2023-10-06T02:46:06.496375+0000', 'last_fullsized': '2023-10-06T02:46:06.496375+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-10-06T02:46:12.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-10-06T02:46:12.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-06T02:46:12.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.495159+0000', 'last_change': '2023-10-06T02:46:06.495313+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.495159+0000', 'last_undegraded': '2023-10-06T02:46:06.495159+0000', 'last_fullsized': '2023-10-06T02:46:06.495159+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:22:40.222541+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:46:12.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-10-06T02:46:12.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498229+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-10-06T02:46:12.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.505775+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-06T02:46:12.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.495545+0000', 'last_change': '2023-10-06T02:46:06.495688+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.495545+0000', 'last_undegraded': '2023-10-06T02:46:06.495545+0000', 'last_fullsized': '2023-10-06T02:46:06.495545+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:34:25.994414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:46:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-10-06T02:46:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-06T02:46:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.496151+0000', 'last_change': '2023-10-06T02:46:06.496274+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.496151+0000', 'last_undegraded': '2023-10-06T02:46:06.496151+0000', 'last_fullsized': '2023-10-06T02:46:06.496151+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-10-06T02:46:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.496860+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-06T02:46:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.495036+0000', 'last_change': '2023-10-06T02:46:06.495157+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.495036+0000', 'last_undegraded': '2023-10-06T02:46:06.495036+0000', 'last_fullsized': '2023-10-06T02:46:06.495036+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:11:03.445295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:46:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-10-06T02:46:12.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497768+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-06T02:46:12.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:05.487581+0000', 'last_change': '2023-10-06T02:46:05.493847+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:05.487581+0000', 'last_undegraded': '2023-10-06T02:46:05.487581+0000', 'last_fullsized': '2023-10-06T02:46:05.487581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:46:12.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-10-06T02:46:12.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-06T02:46:12.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.494935+0000', 'last_change': '2023-10-06T02:46:06.495110+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.494935+0000', 'last_undegraded': '2023-10-06T02:46:06.494935+0000', 'last_fullsized': '2023-10-06T02:46:06.494935+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:47:25.817132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:46:12.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-10-06T02:46:12.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.496301+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-06T02:46:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.495842+0000', 'last_change': '2023-10-06T02:46:06.495968+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.495842+0000', 'last_undegraded': '2023-10-06T02:46:06.495842+0000', 'last_fullsized': '2023-10-06T02:46:06.495842+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:49:41.862180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:46:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-10-06T02:46:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.499248+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:42:14.225910+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-10-06T02:46:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-06T02:46:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.498022+0000', 'last_change': '2023-10-06T02:46:06.498022+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.498022+0000', 'last_undegraded': '2023-10-06T02:46:06.498022+0000', 'last_fullsized': '2023-10-06T02:46:06.498022+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-10-06T02:46:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498516+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-06T02:46:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:05.487581+0000', 'last_change': '2023-10-06T02:46:05.492166+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:05.487581+0000', 'last_undegraded': '2023-10-06T02:46:05.487581+0000', 'last_fullsized': '2023-10-06T02:46:05.487581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:09:22.807034+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:46:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-10-06T02:46:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.500661+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-06T02:46:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:05.487581+0000', 'last_change': '2023-10-06T02:46:05.493549+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:05.487581+0000', 'last_undegraded': '2023-10-06T02:46:05.487581+0000', 'last_fullsized': '2023-10-06T02:46:05.487581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:46:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-10-06T02:46:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.502713+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-06T02:46:12.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.502791+0000', 'last_change': '2023-10-06T02:46:06.504972+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.502791+0000', 'last_undegraded': '2023-10-06T02:46:06.502791+0000', 'last_fullsized': '2023-10-06T02:46:06.502791+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': ['4', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-10-06T02:46:12.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.502600+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-06T02:46:12.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:05.487581+0000', 'last_change': '2023-10-06T02:46:05.492118+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:05.487581+0000', 'last_undegraded': '2023-10-06T02:46:05.487581+0000', 'last_fullsized': '2023-10-06T02:46:05.487581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:46:12.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-10-06T02:46:12.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497427+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-06T02:46:12.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.495220+0000', 'last_change': '2023-10-06T02:46:06.495376+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.495220+0000', 'last_undegraded': '2023-10-06T02:46:06.495220+0000', 'last_fullsized': '2023-10-06T02:46:06.495220+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-10-06T02:46:12.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497631+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-06T02:46:12.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 21, 'state': 'active', 'last_fresh': '2023-10-06T02:46:06.507983+0000', 'last_change': '2023-10-06T02:46:06.507924+0000', 'last_active': '2023-10-06T02:46:06.507983+0000', 'last_peered': '2023-10-06T02:46:06.507983+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '2023-10-06T02:46:06.507924+0000', 'last_became_peered': '2023-10-06T02:46:06.507924+0000', 'last_unstale': '2023-10-06T02:46:06.507983+0000', 'last_undegraded': '2023-10-06T02:46:06.507983+0000', 'last_fullsized': '2023-10-06T02:46:06.507983+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-10-06T02:46:12.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498936+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-06T02:46:12.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.494495+0000', 'last_change': '2023-10-06T02:46:06.494627+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.494495+0000', 'last_undegraded': '2023-10-06T02:46:06.494495+0000', 'last_fullsized': '2023-10-06T02:46:06.494495+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-10-06T02:46:12.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.497989+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-06T02:46:12.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:05.487581+0000', 'last_change': '2023-10-06T02:46:05.491683+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:05.487581+0000', 'last_undegraded': '2023-10-06T02:46:05.487581+0000', 'last_fullsized': '2023-10-06T02:46:05.487581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:14:27.724543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:46:12.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-10-06T02:46:12.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-06T02:46:12.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.496434+0000', 'last_change': '2023-10-06T02:46:06.496520+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.496434+0000', 'last_undegraded': '2023-10-06T02:46:06.496434+0000', 'last_fullsized': '2023-10-06T02:46:06.496434+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.498137+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.494164+0000', 'last_change': '2023-10-06T02:46:06.494271+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.494164+0000', 'last_undegraded': '2023-10-06T02:46:06.494164+0000', 'last_fullsized': '2023-10-06T02:46:06.494164+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.499304+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:05.487581+0000', 'last_change': '2023-10-06T02:46:05.492099+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:05.487581+0000', 'last_undegraded': '2023-10-06T02:46:05.487581+0000', 'last_fullsized': '2023-10-06T02:46:05.487581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-10-06T02:46:12.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-06T02:46:12.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.496610+0000', 'last_change': '2023-10-06T02:46:06.496726+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.496610+0000', 'last_undegraded': '2023-10-06T02:46:06.496610+0000', 'last_fullsized': '2023-10-06T02:46:06.496610+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-10-06T02:46:12.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.500293+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:30:54.816833+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-06T02:46:12.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.496174+0000', 'last_change': '2023-10-06T02:46:06.496304+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.496174+0000', 'last_undegraded': '2023-10-06T02:46:06.496174+0000', 'last_fullsized': '2023-10-06T02:46:06.496174+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-10-06T02:46:12.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.499068+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:09:23.809044+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:46:12.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-06T02:46:12.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.495341+0000', 'last_change': '2023-10-06T02:46:06.495484+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.495341+0000', 'last_undegraded': '2023-10-06T02:46:06.495341+0000', 'last_fullsized': '2023-10-06T02:46:06.495341+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': ['5', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-10-06T02:46:12.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.501013+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-06T02:46:12.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.495560+0000', 'last_change': '2023-10-06T02:46:06.495778+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.495560+0000', 'last_undegraded': '2023-10-06T02:46:06.495560+0000', 'last_fullsized': '2023-10-06T02:46:06.495560+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': ['5', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:46:12.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-10-06T02:46:12.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.499172+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:17:27.620523+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-06T02:46:12.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:05.487581+0000', 'last_change': '2023-10-06T02:46:05.492447+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:05.487581+0000', 'last_undegraded': '2023-10-06T02:46:05.487581+0000', 'last_fullsized': '2023-10-06T02:46:05.487581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:46:12.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-10-06T02:46:12.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-06T02:46:12.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2023-10-06T02:46:06.496250+0000', 'last_change': '2023-10-06T02:46:06.496347+0000', 'last_active': '2023-10-06T02:46:05.487581+0000', 'last_peered': '2023-10-06T02:46:05.487581+0000', 'last_clean': '2023-10-06T02:46:05.487581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.496250+0000', 'last_undegraded': '2023-10-06T02:46:06.496250+0000', 'last_fullsized': '2023-10-06T02:46:06.496250+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:05.487581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:46:12.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-10-06T02:46:12.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.507072+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-10-06T02:46:12.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-10-06T02:46:12.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-10-06T02:46:12.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.507399+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:46:12.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-10-06T02:46:12.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.489591+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:46:12.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-10-06T02:46:12.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:46:06.489591+0000', 'last_change': '2023-10-06T02:46:06.500322+0000', 'last_active': '2023-10-06T02:46:06.489591+0000', 'last_peered': '2023-10-06T02:46:06.489591+0000', 'last_clean': '2023-10-06T02:46:06.489591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:46:06.489591+0000', 'last_undegraded': '2023-10-06T02:46:06.489591+0000', 'last_fullsized': '2023-10-06T02:46:06.489591+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'last_clean_scrub_stamp': '2023-10-06T02:46:06.489591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:46:12.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:46:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.447+0000 7ff14e491700 1 Processor -- start 2023-10-06T02:46:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.447+0000 7ff14e491700 1 -- start start 2023-10-06T02:46:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff14e491700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1481577e0 0x7ff14815b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff14e491700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff148157bb0 0x7ff1480cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff14e491700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1480cfdd0 con 0x7ff14806d240 2023-10-06T02:46:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff14e491700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1480d00b0 con 0x7ff1481577e0 2023-10-06T02:46:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff14e491700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1480d0390 con 0x7ff148157bb0 2023-10-06T02:46:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff147fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1481577e0 0x7ff14815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff14ca2e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff14806d240 0x7ff14806d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58070/0 (socket says 172.21.15.81:58070) 2023-10-06T02:46:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff14ca2e700 1 -- 172.21.15.81:0/1983971609 learned_addr learned my addr 172.21.15.81:0/1983971609 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff1477fe700 1 --2- 172.21.15.81:0/1983971609 >> v2:172.21.15.83:3300/0 conn(0x7ff148157bb0 0x7ff1480cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff147fff700 1 -- 172.21.15.81:0/1983971609 >> v2:172.21.15.83:3300/0 conn(0x7ff148157bb0 msgr2=0x7ff1480cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff147fff700 1 --2- 172.21.15.81:0/1983971609 >> v2:172.21.15.83:3300/0 conn(0x7ff148157bb0 0x7ff1480cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff147fff700 1 -- 172.21.15.81:0/1983971609 >> v1:172.21.15.81:6789/0 conn(0x7ff14806d240 legacy=0x7ff14806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff146ffd700 1 -- 172.21.15.81:0/1983971609 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563452135 0 0) 0x7ff1480cfdd0 con 0x7ff14806d240 2023-10-06T02:46:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff147fff700 1 -- 172.21.15.81:0/1983971609 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1480d0670 con 0x7ff1481577e0 2023-10-06T02:46:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff147fff700 1 --2- 172.21.15.81:0/1983971609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1481577e0 0x7ff14815b070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1480b6e70 tx=0x7ff1380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d00881d07e5512 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.448+0000 7ff146ffd700 1 -- 172.21.15.81:0/1983971609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800b6b0 con 0x7ff1481577e0 2023-10-06T02:46:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff146ffd700 1 -- 172.21.15.81:0/1983971609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13800b810 con 0x7ff1481577e0 2023-10-06T02:46:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff146ffd700 1 -- 172.21.15.81:0/1983971609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800bbb0 con 0x7ff1481577e0 2023-10-06T02:46:12.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff14e491700 1 -- 172.21.15.81:0/1983971609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1481577e0 msgr2=0x7ff14815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff14e491700 1 --2- 172.21.15.81:0/1983971609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1481577e0 0x7ff14815b070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1480b6e70 tx=0x7ff1380091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff14e491700 1 -- 172.21.15.81:0/1983971609 shutdown_connections 2023-10-06T02:46:12.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff14e491700 1 --2- 172.21.15.81:0/1983971609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1481577e0 0x7ff14815b070 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff14e491700 1 --2- 172.21.15.81:0/1983971609 >> v2:172.21.15.83:3300/0 conn(0x7ff148157bb0 0x7ff1480cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff14e491700 1 -- 172.21.15.81:0/1983971609 >> 172.21.15.81:0/1983971609 conn(0x7ff14806bb90 msgr2=0x7ff14806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:12.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff14e491700 1 -- 172.21.15.81:0/1983971609 shutdown_connections 2023-10-06T02:46:12.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.449+0000 7ff14e491700 1 -- 172.21.15.81:0/1983971609 wait complete. 2023-10-06T02:46:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.450+0000 7ff14e491700 1 Processor -- start 2023-10-06T02:46:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.450+0000 7ff14e491700 1 -- start start 2023-10-06T02:46:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff14e491700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14806d240 0x7ff14816af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff14e491700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1481577e0 0x7ff1481488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff14e491700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff148157bb0 0x7ff1480c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff14e491700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff148148df0 con 0x7ff14806d240 2023-10-06T02:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff14e491700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1480c7fb0 con 0x7ff148157bb0 2023-10-06T02:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff14e491700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1480c7770 con 0x7ff1481577e0 2023-10-06T02:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff147fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14806d240 0x7ff14816af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff147fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14806d240 0x7ff14816af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56680/0 (socket says 172.21.15.81:56680) 2023-10-06T02:46:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff147fff700 1 -- 172.21.15.81:0/3387499811 learned_addr learned my addr 172.21.15.81:0/3387499811 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff147fff700 1 -- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1481577e0 msgr2=0x7ff1481488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff14ca2e700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff148157bb0 0x7ff1480c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff1477fe700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1481577e0 0x7ff1481488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff147fff700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1481577e0 0x7ff1481488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff147fff700 1 -- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff148157bb0 msgr2=0x7ff1480c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff147fff700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff148157bb0 0x7ff1480c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.451+0000 7ff147fff700 1 -- 172.21.15.81:0/3387499811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138009420 con 0x7ff14806d240 2023-10-06T02:46:12.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.452+0000 7ff14ca2e700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff148157bb0 0x7ff1480c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:12.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.452+0000 7ff147fff700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14806d240 0x7ff14816af70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff148067780 tx=0x7ff138017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:12.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.452+0000 7ff12ffff700 1 -- 172.21.15.81:0/3387499811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138011420 con 0x7ff14806d240 2023-10-06T02:46:12.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.452+0000 7ff12ffff700 1 -- 172.21.15.81:0/3387499811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff138011580 con 0x7ff14806d240 2023-10-06T02:46:12.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.452+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1480c79f0 con 0x7ff14806d240 2023-10-06T02:46:12.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.452+0000 7ff12ffff700 1 -- 172.21.15.81:0/3387499811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138011940 con 0x7ff14806d240 2023-10-06T02:46:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.452+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14815c030 con 0x7ff14806d240 2023-10-06T02:46:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.453+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14815be90 con 0x7ff14806d240 2023-10-06T02:46:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.453+0000 7ff12ffff700 1 -- 172.21.15.81:0/3387499811 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff138011d30 con 0x7ff14806d240 2023-10-06T02:46:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.453+0000 7ff12ffff700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff134066f30 0x7ff1340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.453+0000 7ff12ffff700 1 -- 172.21.15.81:0/3387499811 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff1380860f0 con 0x7ff14806d240 2023-10-06T02:46:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.454+0000 7ff1477fe700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff134066f30 0x7ff1340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.454+0000 7ff1477fe700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff134066f30 0x7ff1340693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff14815fc10 tx=0x7ff13c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.458+0000 7ff12ffff700 1 -- 172.21.15.81:0/3387499811 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff14815be90 con 0x7ff14806d240 2023-10-06T02:46:12.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.716+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff14815be90 con 0x7ff14806d240 2023-10-06T02:46:12.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.716+0000 7ff12ffff700 1 -- 172.21.15.81:0/3387499811 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1185 (secure 0 0 0) 0x7ff14815be90 con 0x7ff14806d240 2023-10-06T02:46:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:12.718 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560354,"num_in_osds":8,"osd_in_since":1696560351,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":57},{"state_name":"creating+activating","count":19},{"state_name":"unknown","count":15},{"state_name":"active+clean","count":13},{"state_name":"active","count":1}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":1731088,"bytes_avail":1598268912,"bytes_total":1600000000,"unknown_pgs_ratio":0.1428571492433548,"inactive_pgs_ratio":0.72380954027175903},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4291}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-06T02:45:49.582274+0000","services":{}},"progress_events":{}} 2023-10-06T02:46:12.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff134066f30 msgr2=0x7ff1340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff134066f30 0x7ff1340693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff14815fc10 tx=0x7ff13c008040 comp rx=0 tx=0).stop 2023-10-06T02:46:12.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14806d240 msgr2=0x7ff14816af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14806d240 0x7ff14816af70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff148067780 tx=0x7ff138017000 comp rx=0 tx=0).stop 2023-10-06T02:46:12.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 shutdown_connections 2023-10-06T02:46:12.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff134066f30 0x7ff1340693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff148157bb0 0x7ff1480c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14806d240 0x7ff14816af70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 --2- 172.21.15.81:0/3387499811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1481577e0 0x7ff1481488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 >> 172.21.15.81:0/3387499811 conn(0x7ff14806bb90 msgr2=0x7ff148069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:12.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 shutdown_connections 2023-10-06T02:46:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.718+0000 7ff14e491700 1 -- 172.21.15.81:0/3387499811 wait complete. 2023-10-06T02:46:12.731 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:46:12.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:46:12.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.843+0000 7fc4fd70f700 1 Processor -- start 2023-10-06T02:46:12.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.843+0000 7fc4fd70f700 1 -- start start 2023-10-06T02:46:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4fd70f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4f81578d0 0x7fc4f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4fd70f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc4f8157ca0 0x7fc4f815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4fd70f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f80d07c0 con 0x7fc4f806d120 2023-10-06T02:46:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4fd70f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f80cfbb0 con 0x7fc4f81578d0 2023-10-06T02:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4fd70f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f80cfe90 con 0x7fc4f8157ca0 2023-10-06T02:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4f6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4f81578d0 0x7fc4f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4f77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc4f806d120 0x7fc4f806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58080/0 (socket says 172.21.15.81:58080) 2023-10-06T02:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4f77fe700 1 -- 172.21.15.81:0/2947333499 learned_addr learned my addr 172.21.15.81:0/2947333499 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4f67fc700 1 --2- 172.21.15.81:0/2947333499 >> v2:172.21.15.83:3300/0 conn(0x7fc4f8157ca0 0x7fc4f815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4f6ffd700 1 -- 172.21.15.81:0/2947333499 >> v2:172.21.15.83:3300/0 conn(0x7fc4f8157ca0 msgr2=0x7fc4f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4f6ffd700 1 --2- 172.21.15.81:0/2947333499 >> v2:172.21.15.83:3300/0 conn(0x7fc4f8157ca0 0x7fc4f815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4f6ffd700 1 -- 172.21.15.81:0/2947333499 >> v1:172.21.15.81:6789/0 conn(0x7fc4f806d120 legacy=0x7fc4f806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.844+0000 7fc4f5ffb700 1 -- 172.21.15.81:0/2947333499 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186923924 0 0) 0x7fc4f80d07c0 con 0x7fc4f806d120 2023-10-06T02:46:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4f6ffd700 1 -- 172.21.15.81:0/2947333499 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f80d0170 con 0x7fc4f81578d0 2023-10-06T02:46:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4f6ffd700 1 --2- 172.21.15.81:0/2947333499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f81578d0 0x7fc4f80cf4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8068510 tx=0x7fc4e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac47ee969bfe1c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4f5ffb700 1 -- 172.21.15.81:0/2947333499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800e070 con 0x7fc4f81578d0 2023-10-06T02:46:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4f5ffb700 1 -- 172.21.15.81:0/2947333499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e800bb60 con 0x7fc4f81578d0 2023-10-06T02:46:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4f5ffb700 1 -- 172.21.15.81:0/2947333499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8012430 con 0x7fc4f81578d0 2023-10-06T02:46:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4fd70f700 1 -- 172.21.15.81:0/2947333499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f81578d0 msgr2=0x7fc4f80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4fd70f700 1 --2- 172.21.15.81:0/2947333499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f81578d0 0x7fc4f80cf4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8068510 tx=0x7fc4e8009780 comp rx=0 tx=0).stop 2023-10-06T02:46:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4fd70f700 1 -- 172.21.15.81:0/2947333499 shutdown_connections 2023-10-06T02:46:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4fd70f700 1 --2- 172.21.15.81:0/2947333499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f81578d0 0x7fc4f80cf4f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4fd70f700 1 --2- 172.21.15.81:0/2947333499 >> v2:172.21.15.83:3300/0 conn(0x7fc4f8157ca0 0x7fc4f815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4fd70f700 1 -- 172.21.15.81:0/2947333499 >> 172.21.15.81:0/2947333499 conn(0x7fc4f806bb90 msgr2=0x7fc4f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4fd70f700 1 -- 172.21.15.81:0/2947333499 shutdown_connections 2023-10-06T02:46:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.845+0000 7fc4fd70f700 1 -- 172.21.15.81:0/2947333499 wait complete. 2023-10-06T02:46:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4fd70f700 1 Processor -- start 2023-10-06T02:46:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4fd70f700 1 -- start start 2023-10-06T02:46:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4fd70f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f806d120 0x7fc4f80b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4fd70f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4f81578d0 0x7fc4f80b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4fd70f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f8157ca0 0x7fc4f816a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4fd70f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80b5b10 con 0x7fc4f8157ca0 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4fd70f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80b5270 con 0x7fc4f806d120 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4fd70f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80b5550 con 0x7fc4f81578d0 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4f77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f8157ca0 0x7fc4f816a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4f77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f8157ca0 0x7fc4f816a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56708/0 (socket says 172.21.15.81:56708) 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4f77fe700 1 -- 172.21.15.81:0/1713625362 learned_addr learned my addr 172.21.15.81:0/1713625362 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.847+0000 7fc4f6ffd700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f806d120 0x7fc4f80b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4f67fc700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4f81578d0 0x7fc4f80b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4f77fe700 1 -- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4f81578d0 msgr2=0x7fc4f80b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4f77fe700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4f81578d0 0x7fc4f80b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4f77fe700 1 -- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f806d120 msgr2=0x7fc4f80b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4f77fe700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f806d120 0x7fc4f80b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4f77fe700 1 -- 172.21.15.81:0/1713625362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e8009a20 con 0x7fc4f8157ca0 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4f67fc700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4f81578d0 0x7fc4f80b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4f77fe700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f8157ca0 0x7fc4f816a2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c7e0 tx=0x7fc4f0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4eeffd700 1 -- 172.21.15.81:0/1713625362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0005c00 con 0x7fc4f8157ca0 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4eeffd700 1 -- 172.21.15.81:0/1713625362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f0005d80 con 0x7fc4f8157ca0 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f80b5830 con 0x7fc4f8157ca0 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4eeffd700 1 -- 172.21.15.81:0/1713625362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0007320 con 0x7fc4f8157ca0 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.848+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f816a810 con 0x7fc4f8157ca0 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.849+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f8067ac0 con 0x7fc4f8157ca0 2023-10-06T02:46:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.849+0000 7fc4eeffd700 1 -- 172.21.15.81:0/1713625362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4f001b3b0 con 0x7fc4f8157ca0 2023-10-06T02:46:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.850+0000 7fc4eeffd700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4d8066f30 0x7fc4d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.850+0000 7fc4eeffd700 1 -- 172.21.15.81:0/1713625362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc4f0083b90 con 0x7fc4f8157ca0 2023-10-06T02:46:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.850+0000 7fc4f6ffd700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4d8066f30 0x7fc4d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.850+0000 7fc4f6ffd700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4d8066f30 0x7fc4d80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80099f0 tx=0x7fc4e8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:12.854+0000 7fc4eeffd700 1 -- 172.21.15.81:0/1713625362 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4f0050ca0 con 0x7fc4f8157ca0 2023-10-06T02:46:13.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.032+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4f80d0450 con 0x7fc4d8066f30 2023-10-06T02:46:13.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.041+0000 7fc4eeffd700 1 -- 172.21.15.81:0/1713625362 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275847 (secure 0 0 0) 0x7fc4f80d0450 con 0x7fc4d8066f30 2023-10-06T02:46:13.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:13.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.043+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4d8066f30 msgr2=0x7fc4d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:13.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.043+0000 7fc4fd70f700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4d8066f30 0x7fc4d80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80099f0 tx=0x7fc4e8019000 comp rx=0 tx=0).stop 2023-10-06T02:46:13.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.043+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f8157ca0 msgr2=0x7fc4f816a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:13.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.043+0000 7fc4fd70f700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f8157ca0 0x7fc4f816a2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c7e0 tx=0x7fc4f0007d90 comp rx=0 tx=0).stop 2023-10-06T02:46:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.044+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 shutdown_connections 2023-10-06T02:46:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.044+0000 7fc4fd70f700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f8157ca0 0x7fc4f816a2d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.044+0000 7fc4fd70f700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4d8066f30 0x7fc4d80693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.044+0000 7fc4fd70f700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4f806d120 0x7fc4f80b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.044+0000 7fc4fd70f700 1 --2- 172.21.15.81:0/1713625362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4f81578d0 0x7fc4f80b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.044+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 >> 172.21.15.81:0/1713625362 conn(0x7fc4f806bb90 msgr2=0x7fc4f806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.044+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 shutdown_connections 2023-10-06T02:46:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:13.044+0000 7fc4fd70f700 1 -- 172.21.15.81:0/1713625362 wait complete. 2023-10-06T02:46:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:46:13.056 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-06T02:46:11.492341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1690,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560809,"statfs":{"total":1600000000,"available":1598268912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001244"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499660+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:31.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498840+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502959+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497739+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507031+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499150+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497381+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498328+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497012+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.505949+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497757+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:42.409000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498211+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:24.231578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496243+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497226+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.501912+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498882+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502376+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499764+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:26.776913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.506218+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497982+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498553+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496853+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.503946+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499243+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498467+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:04.447305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.506243+0000","last_change":"2023-10-06T02:46:06.506243+0000","last_active":"2023-10-06T02:46:06.506243+0000","last_peered":"2023-10-06T02:46:06.506243+0000","last_clean":"2023-10-06T02:46:06.506243+0000","last_became_active":"2023-10-06T02:46:06.505980+0000","last_became_peered":"2023-10-06T02:46:06.505980+0000","last_unstale":"2023-10-06T02:46:06.506243+0000","last_undegraded":"2023-10-06T02:46:06.506243+0000","last_fullsized":"2023-10-06T02:46:06.506243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494165+0000","last_change":"2023-10-06T02:46:06.494298+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494165+0000","last_undegraded":"2023-10-06T02:46:06.494165+0000","last_fullsized":"2023-10-06T02:46:06.494165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497979+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.494404+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496375+0000","last_change":"2023-10-06T02:46:06.496471+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496375+0000","last_undegraded":"2023-10-06T02:46:06.496375+0000","last_fullsized":"2023-10-06T02:46:06.496375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.501257+0000","last_change":"2023-10-06T02:46:06.501257+0000","last_active":"2023-10-06T02:46:06.501257+0000","last_peered":"2023-10-06T02:46:06.501257+0000","last_clean":"2023-10-06T02:46:06.501257+0000","last_became_active":"2023-10-06T02:46:06.501036+0000","last_became_peered":"2023-10-06T02:46:06.501036+0000","last_unstale":"2023-10-06T02:46:06.501257+0000","last_undegraded":"2023-10-06T02:46:06.501257+0000","last_fullsized":"2023-10-06T02:46:06.501257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495159+0000","last_change":"2023-10-06T02:46:06.495313+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495159+0000","last_undegraded":"2023-10-06T02:46:06.495159+0000","last_fullsized":"2023-10-06T02:46:06.495159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:40.222541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498229+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.506258+0000","last_change":"2023-10-06T02:46:06.506258+0000","last_active":"2023-10-06T02:46:06.506258+0000","last_peered":"2023-10-06T02:46:06.506258+0000","last_clean":"2023-10-06T02:46:06.506258+0000","last_became_active":"2023-10-06T02:46:06.505429+0000","last_became_peered":"2023-10-06T02:46:06.505429+0000","last_unstale":"2023-10-06T02:46:06.506258+0000","last_undegraded":"2023-10-06T02:46:06.506258+0000","last_fullsized":"2023-10-06T02:46:06.506258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.505775+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495545+0000","last_change":"2023-10-06T02:46:06.495688+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495545+0000","last_undegraded":"2023-10-06T02:46:06.495545+0000","last_fullsized":"2023-10-06T02:46:06.495545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:25.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496151+0000","last_change":"2023-10-06T02:46:06.496274+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496151+0000","last_undegraded":"2023-10-06T02:46:06.496151+0000","last_fullsized":"2023-10-06T02:46:06.496151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496860+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495036+0000","last_change":"2023-10-06T02:46:06.495157+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495036+0000","last_undegraded":"2023-10-06T02:46:06.495036+0000","last_fullsized":"2023-10-06T02:46:06.495036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:03.445295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497768+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.493847+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494935+0000","last_change":"2023-10-06T02:46:06.495110+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494935+0000","last_undegraded":"2023-10-06T02:46:06.494935+0000","last_fullsized":"2023-10-06T02:46:06.494935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:25.817132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.496301+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495842+0000","last_change":"2023-10-06T02:46:06.495968+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495842+0000","last_undegraded":"2023-10-06T02:46:06.495842+0000","last_fullsized":"2023-10-06T02:46:06.495842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:41.862180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499248+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:14.225910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T02:46:06.498625+0000","last_change":"2023-10-06T02:46:06.498625+0000","last_active":"2023-10-06T02:46:06.498625+0000","last_peered":"2023-10-06T02:46:06.498625+0000","last_clean":"2023-10-06T02:46:06.498625+0000","last_became_active":"2023-10-06T02:46:06.498405+0000","last_became_peered":"2023-10-06T02:46:06.498405+0000","last_unstale":"2023-10-06T02:46:06.498625+0000","last_undegraded":"2023-10-06T02:46:06.498625+0000","last_fullsized":"2023-10-06T02:46:06.498625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.895724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.498022+0000","last_change":"2023-10-06T02:46:06.498022+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.498022+0000","last_undegraded":"2023-10-06T02:46:06.498022+0000","last_fullsized":"2023-10-06T02:46:06.498022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498516+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492166+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:22.807034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500661+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.493549+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502713+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.502791+0000","last_change":"2023-10-06T02:46:06.504972+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.502791+0000","last_undegraded":"2023-10-06T02:46:06.502791+0000","last_fullsized":"2023-10-06T02:46:06.502791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.502600+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492118+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:23.229568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497427+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493815+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:46:05.493815+0000","last_peered":"2023-10-06T02:46:05.493815+0000","last_clean":"2023-10-06T02:46:05.493815+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:46:05.493815+0000","last_undegraded":"2023-10-06T02:46:05.493815+0000","last_fullsized":"2023-10-06T02:46:05.493815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495220+0000","last_change":"2023-10-06T02:46:06.495376+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495220+0000","last_undegraded":"2023-10-06T02:46:06.495220+0000","last_fullsized":"2023-10-06T02:46:06.495220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497631+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.491399+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:46:05.491399+0000","last_peered":"2023-10-06T02:46:05.491399+0000","last_clean":"2023-10-06T02:46:05.491399+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:46:05.491399+0000","last_undegraded":"2023-10-06T02:46:05.491399+0000","last_fullsized":"2023-10-06T02:46:05.491399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":6,"reported_epoch":21,"state":"active","last_fresh":"2023-10-06T02:46:06.507983+0000","last_change":"2023-10-06T02:46:06.507924+0000","last_active":"2023-10-06T02:46:06.507983+0000","last_peered":"2023-10-06T02:46:06.507983+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"2023-10-06T02:46:06.507924+0000","last_became_peered":"2023-10-06T02:46:06.507924+0000","last_unstale":"2023-10-06T02:46:06.507983+0000","last_undegraded":"2023-10-06T02:46:06.507983+0000","last_fullsized":"2023-10-06T02:46:06.507983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498936+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:26.996424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493831+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:46:05.493831+0000","last_peered":"2023-10-06T02:46:05.493831+0000","last_clean":"2023-10-06T02:46:05.493831+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:46:05.493831+0000","last_undegraded":"2023-10-06T02:46:05.493831+0000","last_fullsized":"2023-10-06T02:46:05.493831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494495+0000","last_change":"2023-10-06T02:46:06.494627+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494495+0000","last_undegraded":"2023-10-06T02:46:06.494495+0000","last_fullsized":"2023-10-06T02:46:06.494495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.497989+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.491370+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:46:05.491370+0000","last_peered":"2023-10-06T02:46:05.491370+0000","last_clean":"2023-10-06T02:46:05.491370+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:46:05.491370+0000","last_undegraded":"2023-10-06T02:46:05.491370+0000","last_fullsized":"2023-10-06T02:46:05.491370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495182+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:46:05.495182+0000","last_peered":"2023-10-06T02:46:05.495182+0000","last_clean":"2023-10-06T02:46:05.495182+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:46:05.495182+0000","last_undegraded":"2023-10-06T02:46:05.495182+0000","last_fullsized":"2023-10-06T02:46:05.495182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.491683+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:27.724543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495279+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:46:05.495279+0000","last_peered":"2023-10-06T02:46:05.495279+0000","last_clean":"2023-10-06T02:46:05.495279+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:46:05.495279+0000","last_undegraded":"2023-10-06T02:46:05.495279+0000","last_fullsized":"2023-10-06T02:46:05.495279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496434+0000","last_change":"2023-10-06T02:46:06.496520+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496434+0000","last_undegraded":"2023-10-06T02:46:06.496434+0000","last_fullsized":"2023-10-06T02:46:06.496434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.498137+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.495083+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:46:05.495083+0000","last_peered":"2023-10-06T02:46:05.495083+0000","last_clean":"2023-10-06T02:46:05.495083+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:46:05.495083+0000","last_undegraded":"2023-10-06T02:46:05.495083+0000","last_fullsized":"2023-10-06T02:46:05.495083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.494164+0000","last_change":"2023-10-06T02:46:06.494271+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.494164+0000","last_undegraded":"2023-10-06T02:46:06.494164+0000","last_fullsized":"2023-10-06T02:46:06.494164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499304+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492099+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:41.406991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:46:05.493701+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:46:05.493701+0000","last_peered":"2023-10-06T02:46:05.493701+0000","last_clean":"2023-10-06T02:46:05.493701+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:46:05.493701+0000","last_undegraded":"2023-10-06T02:46:05.493701+0000","last_fullsized":"2023-10-06T02:46:05.493701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:46:04.193048+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:46:04.193048+0000","last_peered":"2023-10-06T02:46:04.193048+0000","last_clean":"2023-10-06T02:46:04.193048+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:46:04.193048+0000","last_undegraded":"2023-10-06T02:46:04.193048+0000","last_fullsized":"2023-10-06T02:46:04.193048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496610+0000","last_change":"2023-10-06T02:46:06.496726+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496610+0000","last_undegraded":"2023-10-06T02:46:06.496610+0000","last_fullsized":"2023-10-06T02:46:06.496610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500293+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:54.816833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496174+0000","last_change":"2023-10-06T02:46:06.496304+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496174+0000","last_undegraded":"2023-10-06T02:46:06.496174+0000","last_fullsized":"2023-10-06T02:46:06.496174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499068+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:23.809044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495341+0000","last_change":"2023-10-06T02:46:06.495484+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495341+0000","last_undegraded":"2023-10-06T02:46:06.495341+0000","last_fullsized":"2023-10-06T02:46:06.495341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.501013+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.495560+0000","last_change":"2023-10-06T02:46:06.495778+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.495560+0000","last_undegraded":"2023-10-06T02:46:06.495560+0000","last_fullsized":"2023-10-06T02:46:06.495560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.499172+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:27.620523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:05.487581+0000","last_change":"2023-10-06T02:46:05.492447+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:05.487581+0000","last_undegraded":"2023-10-06T02:46:05.487581+0000","last_fullsized":"2023-10-06T02:46:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":2,"reported_epoch":21,"state":"creating+activating","last_fresh":"2023-10-06T02:46:06.496250+0000","last_change":"2023-10-06T02:46:06.496347+0000","last_active":"2023-10-06T02:46:05.487581+0000","last_peered":"2023-10-06T02:46:05.487581+0000","last_clean":"2023-10-06T02:46:05.487581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.496250+0000","last_undegraded":"2023-10-06T02:46:06.496250+0000","last_fullsized":"2023-10-06T02:46:06.496250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507072+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.507399+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.489591+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:46:06.489591+0000","last_change":"2023-10-06T02:46:06.500322+0000","last_active":"2023-10-06T02:46:06.489591+0000","last_peered":"2023-10-06T02:46:06.489591+0000","last_clean":"2023-10-06T02:46:06.489591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:46:06.489591+0000","last_undegraded":"2023-10-06T02:46:06.489591+0000","last_fullsized":"2023-10-06T02:46:06.489591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:01.211402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]}],"pool_statfs":[]}} 2023-10-06T02:46:13.493 INFO:tasks.ceph.mds.d.smithi083.stderr:2023-10-06T02:46:13.491+0000 7ff9280f4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:46:16.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:46:16.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.194+0000 7f36b87a3700 1 Processor -- start 2023-10-06T02:46:16.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.195+0000 7f36b87a3700 1 -- start start 2023-10-06T02:46:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b87a3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f36b006c190 0x7f36b00b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b87a3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36b00b3170 0x7f36b006a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b87a3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b0069d10 con 0x7f36b0157a60 2023-10-06T02:46:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b87a3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b00b35b0 con 0x7f36b00b3170 2023-10-06T02:46:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b87a3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b015c130 con 0x7f36b006c190 2023-10-06T02:46:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b6d40700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36b00b3170 0x7f36b006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b6d40700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36b00b3170 0x7f36b006a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56718/0 (socket says 172.21.15.81:56718) 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b6d40700 1 -- 172.21.15.81:0/2854718451 learned_addr learned my addr 172.21.15.81:0/2854718451 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b5d3e700 1 --2- 172.21.15.81:0/2854718451 >> v2:172.21.15.83:3300/0 conn(0x7f36b006c190 0x7f36b00b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b6d40700 1 -- 172.21.15.81:0/2854718451 >> v2:172.21.15.83:3300/0 conn(0x7f36b006c190 msgr2=0x7f36b00b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b6d40700 1 --2- 172.21.15.81:0/2854718451 >> v2:172.21.15.83:3300/0 conn(0x7f36b006c190 0x7f36b00b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b6d40700 1 -- 172.21.15.81:0/2854718451 >> v1:172.21.15.83:6789/0 conn(0x7f36b0157a60 legacy=0x7f36b015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b6d40700 1 -- 172.21.15.81:0/2854718451 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b015c410 con 0x7f36b00b3170 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b6d40700 1 --2- 172.21.15.81:0/2854718451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00b3170 0x7f36b006a1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f36b0067e70 tx=0x7f36a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a3c0ef8f12a547 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b553d700 1 -- 172.21.15.81:0/2854718451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0009e70 con 0x7f36b00b3170 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b553d700 1 -- 172.21.15.81:0/2854718451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a000b860 con 0x7f36b00b3170 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.196+0000 7f36b553d700 1 -- 172.21.15.81:0/2854718451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000bc00 con 0x7f36b00b3170 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.197+0000 7f36b87a3700 1 -- 172.21.15.81:0/2854718451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00b3170 msgr2=0x7f36b006a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.197+0000 7f36b87a3700 1 --2- 172.21.15.81:0/2854718451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00b3170 0x7f36b006a1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f36b0067e70 tx=0x7f36a0009250 comp rx=0 tx=0).stop 2023-10-06T02:46:16.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.197+0000 7f36b87a3700 1 -- 172.21.15.81:0/2854718451 shutdown_connections 2023-10-06T02:46:16.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.197+0000 7f36b87a3700 1 --2- 172.21.15.81:0/2854718451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00b3170 0x7f36b006a1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.197+0000 7f36b87a3700 1 --2- 172.21.15.81:0/2854718451 >> v2:172.21.15.83:3300/0 conn(0x7f36b006c190 0x7f36b00b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.197+0000 7f36b87a3700 1 -- 172.21.15.81:0/2854718451 >> 172.21.15.81:0/2854718451 conn(0x7f36b006cca0 msgr2=0x7f36b006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:16.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.197+0000 7f36b87a3700 1 -- 172.21.15.81:0/2854718451 shutdown_connections 2023-10-06T02:46:16.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.197+0000 7f36b87a3700 1 -- 172.21.15.81:0/2854718451 wait complete. 2023-10-06T02:46:16.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.198+0000 7f36b87a3700 1 Processor -- start 2023-10-06T02:46:16.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.198+0000 7f36b87a3700 1 -- start start 2023-10-06T02:46:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b87a3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36b006c190 0x7f36b00cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b87a3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36b00b3170 0x7f36b00a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b87a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0157a60 0x7f36b016a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b87a3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b015a770 con 0x7f36b0157a60 2023-10-06T02:46:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b87a3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b015aa50 con 0x7f36b006c190 2023-10-06T02:46:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b87a3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b015ad30 con 0x7f36b00b3170 2023-10-06T02:46:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b6d40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0157a60 0x7f36b016a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b6d40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0157a60 0x7f36b016a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56728/0 (socket says 172.21.15.81:56728) 2023-10-06T02:46:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b6d40700 1 -- 172.21.15.81:0/3505343208 learned_addr learned my addr 172.21.15.81:0/3505343208 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b5d3e700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36b00b3170 0x7f36b00a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b653f700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36b006c190 0x7f36b00cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b6d40700 1 -- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36b00b3170 msgr2=0x7f36b00a70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b6d40700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36b00b3170 0x7f36b00a70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b6d40700 1 -- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36b006c190 msgr2=0x7f36b00cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b6d40700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36b006c190 0x7f36b00cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b6d40700 1 -- 172.21.15.81:0/3505343208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00094f0 con 0x7f36b0157a60 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b653f700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36b006c190 0x7f36b00cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b6d40700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0157a60 0x7f36b016a950 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009290 tx=0x7f36a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36ae7fc700 1 -- 172.21.15.81:0/3505343208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000baa0 con 0x7f36b0157a60 2023-10-06T02:46:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36ae7fc700 1 -- 172.21.15.81:0/3505343208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0025420 con 0x7f36b0157a60 2023-10-06T02:46:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.199+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b015b010 con 0x7f36b0157a60 2023-10-06T02:46:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.200+0000 7f36ae7fc700 1 -- 172.21.15.81:0/3505343208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000bc00 con 0x7f36b0157a60 2023-10-06T02:46:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.200+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b015a380 con 0x7f36b0157a60 2023-10-06T02:46:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.201+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b015b530 con 0x7f36b0157a60 2023-10-06T02:46:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.201+0000 7f36ae7fc700 1 -- 172.21.15.81:0/3505343208 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36a0023070 con 0x7f36b0157a60 2023-10-06T02:46:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.201+0000 7f36ae7fc700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f369c066f30 0x7f369c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.201+0000 7f36ae7fc700 1 -- 172.21.15.81:0/3505343208 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f36a0085de0 con 0x7f36b0157a60 2023-10-06T02:46:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.201+0000 7f36b653f700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f369c066f30 0x7f369c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.202+0000 7f36b653f700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f369c066f30 0x7f369c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f36a8007fd0 tx=0x7f36a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:16.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.205+0000 7f36ae7fc700 1 -- 172.21.15.81:0/3505343208 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36b015b530 con 0x7f36b0157a60 2023-10-06T02:46:16.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.380+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36b015b530 con 0x7f369c066f30 2023-10-06T02:46:16.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.389+0000 7f36ae7fc700 1 -- 172.21.15.81:0/3505343208 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280699 (secure 0 0 0) 0x7f36b015b530 con 0x7f369c066f30 2023-10-06T02:46:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.391+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f369c066f30 msgr2=0x7f369c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.391+0000 7f36b87a3700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f369c066f30 0x7f369c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f36a8007fd0 tx=0x7f36a8009040 comp rx=0 tx=0).stop 2023-10-06T02:46:16.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.391+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0157a60 msgr2=0x7f36b016a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.391+0000 7f36b87a3700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0157a60 0x7f36b016a950 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009290 tx=0x7f36a0017000 comp rx=0 tx=0).stop 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.391+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 shutdown_connections 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.391+0000 7f36b87a3700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0157a60 0x7f36b016a950 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.391+0000 7f36b87a3700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f369c066f30 0x7f369c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.392+0000 7f36b87a3700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36b006c190 0x7f36b00cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.392+0000 7f36b87a3700 1 --2- 172.21.15.81:0/3505343208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36b00b3170 0x7f36b00a70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.392+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 >> 172.21.15.81:0/3505343208 conn(0x7f36b006cca0 msgr2=0x7f36b00af520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.392+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 shutdown_connections 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.392+0000 7f36b87a3700 1 -- 172.21.15.81:0/3505343208 wait complete. 2023-10-06T02:46:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:46:16.404 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-06T02:46:15.493400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":204,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1854,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560645,"statfs":{"total":1600000000,"available":1598101380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002182"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501882+0000","last_change":"2023-10-06T02:46:07.501507+0000","last_active":"2023-10-06T02:46:07.501882+0000","last_peered":"2023-10-06T02:46:07.501882+0000","last_clean":"2023-10-06T02:46:07.501882+0000","last_became_active":"2023-10-06T02:46:07.501299+0000","last_became_peered":"2023-10-06T02:46:07.501299+0000","last_unstale":"2023-10-06T02:46:07.501882+0000","last_undegraded":"2023-10-06T02:46:07.501882+0000","last_fullsized":"2023-10-06T02:46:07.501882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:36.468540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506841+0000","last_change":"2023-10-06T02:46:07.506605+0000","last_active":"2023-10-06T02:46:07.506841+0000","last_peered":"2023-10-06T02:46:07.506841+0000","last_clean":"2023-10-06T02:46:07.506841+0000","last_became_active":"2023-10-06T02:46:07.506120+0000","last_became_peered":"2023-10-06T02:46:07.506120+0000","last_unstale":"2023-10-06T02:46:07.506841+0000","last_undegraded":"2023-10-06T02:46:07.506841+0000","last_fullsized":"2023-10-06T02:46:07.506841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508824+0000","last_change":"2023-10-06T02:46:07.507719+0000","last_active":"2023-10-06T02:46:07.508824+0000","last_peered":"2023-10-06T02:46:07.508824+0000","last_clean":"2023-10-06T02:46:07.508824+0000","last_became_active":"2023-10-06T02:46:07.507126+0000","last_became_peered":"2023-10-06T02:46:07.507126+0000","last_unstale":"2023-10-06T02:46:07.508824+0000","last_undegraded":"2023-10-06T02:46:07.508824+0000","last_fullsized":"2023-10-06T02:46:07.508824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:59.329640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507847+0000","last_change":"2023-10-06T02:46:07.507785+0000","last_active":"2023-10-06T02:46:07.507847+0000","last_peered":"2023-10-06T02:46:07.507847+0000","last_clean":"2023-10-06T02:46:07.507847+0000","last_became_active":"2023-10-06T02:46:07.507554+0000","last_became_peered":"2023-10-06T02:46:07.507554+0000","last_unstale":"2023-10-06T02:46:07.507847+0000","last_undegraded":"2023-10-06T02:46:07.507847+0000","last_fullsized":"2023-10-06T02:46:07.507847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508846+0000","last_change":"2023-10-06T02:46:07.508747+0000","last_active":"2023-10-06T02:46:07.508846+0000","last_peered":"2023-10-06T02:46:07.508846+0000","last_clean":"2023-10-06T02:46:07.508846+0000","last_became_active":"2023-10-06T02:46:07.508461+0000","last_became_peered":"2023-10-06T02:46:07.508461+0000","last_unstale":"2023-10-06T02:46:07.508846+0000","last_undegraded":"2023-10-06T02:46:07.508846+0000","last_fullsized":"2023-10-06T02:46:07.508846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.512128+0000","last_change":"2023-10-06T02:46:07.512070+0000","last_active":"2023-10-06T02:46:07.512128+0000","last_peered":"2023-10-06T02:46:07.512128+0000","last_clean":"2023-10-06T02:46:07.512128+0000","last_became_active":"2023-10-06T02:46:07.511394+0000","last_became_peered":"2023-10-06T02:46:07.511394+0000","last_unstale":"2023-10-06T02:46:07.512128+0000","last_undegraded":"2023-10-06T02:46:07.512128+0000","last_fullsized":"2023-10-06T02:46:07.512128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:21.300350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509806+0000","last_change":"2023-10-06T02:46:07.509710+0000","last_active":"2023-10-06T02:46:07.509806+0000","last_peered":"2023-10-06T02:46:07.509806+0000","last_clean":"2023-10-06T02:46:07.509806+0000","last_became_active":"2023-10-06T02:46:07.509491+0000","last_became_peered":"2023-10-06T02:46:07.509491+0000","last_unstale":"2023-10-06T02:46:07.509806+0000","last_undegraded":"2023-10-06T02:46:07.509806+0000","last_fullsized":"2023-10-06T02:46:07.509806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504477+0000","last_change":"2023-10-06T02:46:07.504387+0000","last_active":"2023-10-06T02:46:07.504477+0000","last_peered":"2023-10-06T02:46:07.504477+0000","last_clean":"2023-10-06T02:46:07.504477+0000","last_became_active":"2023-10-06T02:46:07.503698+0000","last_became_peered":"2023-10-06T02:46:07.503698+0000","last_unstale":"2023-10-06T02:46:07.504477+0000","last_undegraded":"2023-10-06T02:46:07.504477+0000","last_fullsized":"2023-10-06T02:46:07.504477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508671+0000","last_change":"2023-10-06T02:46:07.508533+0000","last_active":"2023-10-06T02:46:07.508671+0000","last_peered":"2023-10-06T02:46:07.508671+0000","last_clean":"2023-10-06T02:46:07.508671+0000","last_became_active":"2023-10-06T02:46:07.507476+0000","last_became_peered":"2023-10-06T02:46:07.507476+0000","last_unstale":"2023-10-06T02:46:07.508671+0000","last_undegraded":"2023-10-06T02:46:07.508671+0000","last_fullsized":"2023-10-06T02:46:07.508671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509782+0000","last_change":"2023-10-06T02:46:07.509724+0000","last_active":"2023-10-06T02:46:07.509782+0000","last_peered":"2023-10-06T02:46:07.509782+0000","last_clean":"2023-10-06T02:46:07.509782+0000","last_became_active":"2023-10-06T02:46:07.509504+0000","last_became_peered":"2023-10-06T02:46:07.509504+0000","last_unstale":"2023-10-06T02:46:07.509782+0000","last_undegraded":"2023-10-06T02:46:07.509782+0000","last_fullsized":"2023-10-06T02:46:07.509782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.512318+0000","last_change":"2023-10-06T02:46:07.512258+0000","last_active":"2023-10-06T02:46:07.512318+0000","last_peered":"2023-10-06T02:46:07.512318+0000","last_clean":"2023-10-06T02:46:07.512318+0000","last_became_active":"2023-10-06T02:46:07.511640+0000","last_became_peered":"2023-10-06T02:46:07.511640+0000","last_unstale":"2023-10-06T02:46:07.512318+0000","last_undegraded":"2023-10-06T02:46:07.512318+0000","last_fullsized":"2023-10-06T02:46:07.512318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:38.382749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.503952+0000","last_change":"2023-10-06T02:46:07.503917+0000","last_active":"2023-10-06T02:46:07.503952+0000","last_peered":"2023-10-06T02:46:07.503952+0000","last_clean":"2023-10-06T02:46:07.503952+0000","last_became_active":"2023-10-06T02:46:07.503658+0000","last_became_peered":"2023-10-06T02:46:07.503658+0000","last_unstale":"2023-10-06T02:46:07.503952+0000","last_undegraded":"2023-10-06T02:46:07.503952+0000","last_fullsized":"2023-10-06T02:46:07.503952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:27.620523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.498723+0000","last_change":"2023-10-06T02:46:07.498659+0000","last_active":"2023-10-06T02:46:07.498723+0000","last_peered":"2023-10-06T02:46:07.498723+0000","last_clean":"2023-10-06T02:46:07.498723+0000","last_became_active":"2023-10-06T02:46:07.498418+0000","last_became_peered":"2023-10-06T02:46:07.498418+0000","last_unstale":"2023-10-06T02:46:07.498723+0000","last_undegraded":"2023-10-06T02:46:07.498723+0000","last_fullsized":"2023-10-06T02:46:07.498723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.400732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504280+0000","last_change":"2023-10-06T02:46:07.504203+0000","last_active":"2023-10-06T02:46:07.504280+0000","last_peered":"2023-10-06T02:46:07.504280+0000","last_clean":"2023-10-06T02:46:07.504280+0000","last_became_active":"2023-10-06T02:46:07.503939+0000","last_became_peered":"2023-10-06T02:46:07.503939+0000","last_unstale":"2023-10-06T02:46:07.504280+0000","last_undegraded":"2023-10-06T02:46:07.504280+0000","last_fullsized":"2023-10-06T02:46:07.504280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509105+0000","last_change":"2023-10-06T02:46:07.508749+0000","last_active":"2023-10-06T02:46:07.509105+0000","last_peered":"2023-10-06T02:46:07.509105+0000","last_clean":"2023-10-06T02:46:07.509105+0000","last_became_active":"2023-10-06T02:46:07.508535+0000","last_became_peered":"2023-10-06T02:46:07.508535+0000","last_unstale":"2023-10-06T02:46:07.509105+0000","last_undegraded":"2023-10-06T02:46:07.509105+0000","last_fullsized":"2023-10-06T02:46:07.509105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.511904+0000","last_change":"2023-10-06T02:46:07.511846+0000","last_active":"2023-10-06T02:46:07.511904+0000","last_peered":"2023-10-06T02:46:07.511904+0000","last_clean":"2023-10-06T02:46:07.511904+0000","last_became_active":"2023-10-06T02:46:07.511179+0000","last_became_peered":"2023-10-06T02:46:07.511179+0000","last_unstale":"2023-10-06T02:46:07.511904+0000","last_undegraded":"2023-10-06T02:46:07.511904+0000","last_fullsized":"2023-10-06T02:46:07.511904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506260+0000","last_change":"2023-10-06T02:46:07.502822+0000","last_active":"2023-10-06T02:46:07.506260+0000","last_peered":"2023-10-06T02:46:07.506260+0000","last_clean":"2023-10-06T02:46:07.506260+0000","last_became_active":"2023-10-06T02:46:07.502312+0000","last_became_peered":"2023-10-06T02:46:07.502312+0000","last_unstale":"2023-10-06T02:46:07.506260+0000","last_undegraded":"2023-10-06T02:46:07.506260+0000","last_fullsized":"2023-10-06T02:46:07.506260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508843+0000","last_change":"2023-10-06T02:46:07.507876+0000","last_active":"2023-10-06T02:46:07.508843+0000","last_peered":"2023-10-06T02:46:07.508843+0000","last_clean":"2023-10-06T02:46:07.508843+0000","last_became_active":"2023-10-06T02:46:07.507455+0000","last_became_peered":"2023-10-06T02:46:07.507455+0000","last_unstale":"2023-10-06T02:46:07.508843+0000","last_undegraded":"2023-10-06T02:46:07.508843+0000","last_fullsized":"2023-10-06T02:46:07.508843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:43.004719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502434+0000","last_change":"2023-10-06T02:46:07.502391+0000","last_active":"2023-10-06T02:46:07.502434+0000","last_peered":"2023-10-06T02:46:07.502434+0000","last_clean":"2023-10-06T02:46:07.502434+0000","last_became_active":"2023-10-06T02:46:07.502156+0000","last_became_peered":"2023-10-06T02:46:07.502156+0000","last_unstale":"2023-10-06T02:46:07.502434+0000","last_undegraded":"2023-10-06T02:46:07.502434+0000","last_fullsized":"2023-10-06T02:46:07.502434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:50.164650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510768+0000","last_change":"2023-10-06T02:46:07.509968+0000","last_active":"2023-10-06T02:46:07.510768+0000","last_peered":"2023-10-06T02:46:07.510768+0000","last_clean":"2023-10-06T02:46:07.510768+0000","last_became_active":"2023-10-06T02:46:07.509123+0000","last_became_peered":"2023-10-06T02:46:07.509123+0000","last_unstale":"2023-10-06T02:46:07.510768+0000","last_undegraded":"2023-10-06T02:46:07.510768+0000","last_fullsized":"2023-10-06T02:46:07.510768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:06.617615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509085+0000","last_change":"2023-10-06T02:46:07.508219+0000","last_active":"2023-10-06T02:46:07.509085+0000","last_peered":"2023-10-06T02:46:07.509085+0000","last_clean":"2023-10-06T02:46:07.509085+0000","last_became_active":"2023-10-06T02:46:07.507886+0000","last_became_peered":"2023-10-06T02:46:07.507886+0000","last_unstale":"2023-10-06T02:46:07.509085+0000","last_undegraded":"2023-10-06T02:46:07.509085+0000","last_fullsized":"2023-10-06T02:46:07.509085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507819+0000","last_change":"2023-10-06T02:46:07.507747+0000","last_active":"2023-10-06T02:46:07.507819+0000","last_peered":"2023-10-06T02:46:07.507819+0000","last_clean":"2023-10-06T02:46:07.507819+0000","last_became_active":"2023-10-06T02:46:07.507526+0000","last_became_peered":"2023-10-06T02:46:07.507526+0000","last_unstale":"2023-10-06T02:46:07.507819+0000","last_undegraded":"2023-10-06T02:46:07.507819+0000","last_fullsized":"2023-10-06T02:46:07.507819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502938+0000","last_change":"2023-10-06T02:46:07.502872+0000","last_active":"2023-10-06T02:46:07.502938+0000","last_peered":"2023-10-06T02:46:07.502938+0000","last_clean":"2023-10-06T02:46:07.502938+0000","last_became_active":"2023-10-06T02:46:07.502642+0000","last_became_peered":"2023-10-06T02:46:07.502642+0000","last_unstale":"2023-10-06T02:46:07.502938+0000","last_undegraded":"2023-10-06T02:46:07.502938+0000","last_fullsized":"2023-10-06T02:46:07.502938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509119+0000","last_change":"2023-10-06T02:46:07.508930+0000","last_active":"2023-10-06T02:46:07.509119+0000","last_peered":"2023-10-06T02:46:07.509119+0000","last_clean":"2023-10-06T02:46:07.509119+0000","last_became_active":"2023-10-06T02:46:07.508593+0000","last_became_peered":"2023-10-06T02:46:07.508593+0000","last_unstale":"2023-10-06T02:46:07.509119+0000","last_undegraded":"2023-10-06T02:46:07.509119+0000","last_fullsized":"2023-10-06T02:46:07.509119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505687+0000","last_change":"2023-10-06T02:46:07.505613+0000","last_active":"2023-10-06T02:46:07.505687+0000","last_peered":"2023-10-06T02:46:07.505687+0000","last_clean":"2023-10-06T02:46:07.505687+0000","last_became_active":"2023-10-06T02:46:07.504983+0000","last_became_peered":"2023-10-06T02:46:07.504983+0000","last_unstale":"2023-10-06T02:46:07.505687+0000","last_undegraded":"2023-10-06T02:46:07.505687+0000","last_fullsized":"2023-10-06T02:46:07.505687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510949+0000","last_change":"2023-10-06T02:46:07.510879+0000","last_active":"2023-10-06T02:46:07.510949+0000","last_peered":"2023-10-06T02:46:07.510949+0000","last_clean":"2023-10-06T02:46:07.510949+0000","last_became_active":"2023-10-06T02:46:07.510585+0000","last_became_peered":"2023-10-06T02:46:07.510585+0000","last_unstale":"2023-10-06T02:46:07.510949+0000","last_undegraded":"2023-10-06T02:46:07.510949+0000","last_fullsized":"2023-10-06T02:46:07.510949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506452+0000","last_change":"2023-10-06T02:46:07.506341+0000","last_active":"2023-10-06T02:46:07.506452+0000","last_peered":"2023-10-06T02:46:07.506452+0000","last_clean":"2023-10-06T02:46:07.506452+0000","last_became_active":"2023-10-06T02:46:07.504926+0000","last_became_peered":"2023-10-06T02:46:07.504926+0000","last_unstale":"2023-10-06T02:46:07.506452+0000","last_undegraded":"2023-10-06T02:46:07.506452+0000","last_fullsized":"2023-10-06T02:46:07.506452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.514988+0000","last_change":"2023-10-06T02:46:06.506243+0000","last_active":"2023-10-06T02:46:07.514988+0000","last_peered":"2023-10-06T02:46:07.514988+0000","last_clean":"2023-10-06T02:46:07.514988+0000","last_became_active":"2023-10-06T02:46:06.505980+0000","last_became_peered":"2023-10-06T02:46:06.505980+0000","last_unstale":"2023-10-06T02:46:07.514988+0000","last_undegraded":"2023-10-06T02:46:07.514988+0000","last_fullsized":"2023-10-06T02:46:07.514988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501873+0000","last_change":"2023-10-06T02:46:07.501612+0000","last_active":"2023-10-06T02:46:07.501873+0000","last_peered":"2023-10-06T02:46:07.501873+0000","last_clean":"2023-10-06T02:46:07.501873+0000","last_became_active":"2023-10-06T02:46:07.501385+0000","last_became_peered":"2023-10-06T02:46:07.501385+0000","last_unstale":"2023-10-06T02:46:07.501873+0000","last_undegraded":"2023-10-06T02:46:07.501873+0000","last_fullsized":"2023-10-06T02:46:07.501873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:51.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499887+0000","last_change":"2023-10-06T02:46:06.506000+0000","last_active":"2023-10-06T02:46:07.499887+0000","last_peered":"2023-10-06T02:46:07.499887+0000","last_clean":"2023-10-06T02:46:07.499887+0000","last_became_active":"2023-10-06T02:46:06.505763+0000","last_became_peered":"2023-10-06T02:46:06.505763+0000","last_unstale":"2023-10-06T02:46:07.499887+0000","last_undegraded":"2023-10-06T02:46:07.499887+0000","last_fullsized":"2023-10-06T02:46:07.499887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507357+0000","last_change":"2023-10-06T02:46:07.507268+0000","last_active":"2023-10-06T02:46:07.507357+0000","last_peered":"2023-10-06T02:46:07.507357+0000","last_clean":"2023-10-06T02:46:07.507357+0000","last_became_active":"2023-10-06T02:46:07.507051+0000","last_became_peered":"2023-10-06T02:46:07.507051+0000","last_unstale":"2023-10-06T02:46:07.507357+0000","last_undegraded":"2023-10-06T02:46:07.507357+0000","last_fullsized":"2023-10-06T02:46:07.507357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497675+0000","last_change":"2023-10-06T02:46:06.504271+0000","last_active":"2023-10-06T02:46:07.497675+0000","last_peered":"2023-10-06T02:46:07.497675+0000","last_clean":"2023-10-06T02:46:07.497675+0000","last_became_active":"2023-10-06T02:46:06.502572+0000","last_became_peered":"2023-10-06T02:46:06.502572+0000","last_unstale":"2023-10-06T02:46:07.497675+0000","last_undegraded":"2023-10-06T02:46:07.497675+0000","last_fullsized":"2023-10-06T02:46:07.497675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.503491+0000","last_change":"2023-10-06T02:46:07.503446+0000","last_active":"2023-10-06T02:46:07.503491+0000","last_peered":"2023-10-06T02:46:07.503491+0000","last_clean":"2023-10-06T02:46:07.503491+0000","last_became_active":"2023-10-06T02:46:07.503262+0000","last_became_peered":"2023-10-06T02:46:07.503262+0000","last_unstale":"2023-10-06T02:46:07.503491+0000","last_undegraded":"2023-10-06T02:46:07.503491+0000","last_fullsized":"2023-10-06T02:46:07.503491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499431+0000","last_change":"2023-10-06T02:46:06.501875+0000","last_active":"2023-10-06T02:46:07.499431+0000","last_peered":"2023-10-06T02:46:07.499431+0000","last_clean":"2023-10-06T02:46:07.499431+0000","last_became_active":"2023-10-06T02:46:06.501424+0000","last_became_peered":"2023-10-06T02:46:06.501424+0000","last_unstale":"2023-10-06T02:46:07.499431+0000","last_undegraded":"2023-10-06T02:46:07.499431+0000","last_fullsized":"2023-10-06T02:46:07.499431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501890+0000","last_change":"2023-10-06T02:46:07.501817+0000","last_active":"2023-10-06T02:46:07.501890+0000","last_peered":"2023-10-06T02:46:07.501890+0000","last_clean":"2023-10-06T02:46:07.501890+0000","last_became_active":"2023-10-06T02:46:07.501591+0000","last_became_peered":"2023-10-06T02:46:07.501591+0000","last_unstale":"2023-10-06T02:46:07.501890+0000","last_undegraded":"2023-10-06T02:46:07.501890+0000","last_fullsized":"2023-10-06T02:46:07.501890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497426+0000","last_change":"2023-10-06T02:46:06.501257+0000","last_active":"2023-10-06T02:46:07.497426+0000","last_peered":"2023-10-06T02:46:07.497426+0000","last_clean":"2023-10-06T02:46:07.497426+0000","last_became_active":"2023-10-06T02:46:06.501036+0000","last_became_peered":"2023-10-06T02:46:06.501036+0000","last_unstale":"2023-10-06T02:46:07.497426+0000","last_undegraded":"2023-10-06T02:46:07.497426+0000","last_fullsized":"2023-10-06T02:46:07.497426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504480+0000","last_change":"2023-10-06T02:46:07.504425+0000","last_active":"2023-10-06T02:46:07.504480+0000","last_peered":"2023-10-06T02:46:07.504480+0000","last_clean":"2023-10-06T02:46:07.504480+0000","last_became_active":"2023-10-06T02:46:07.504212+0000","last_became_peered":"2023-10-06T02:46:07.504212+0000","last_unstale":"2023-10-06T02:46:07.504480+0000","last_undegraded":"2023-10-06T02:46:07.504480+0000","last_fullsized":"2023-10-06T02:46:07.504480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.517401+0000","last_change":"2023-10-06T02:46:06.503947+0000","last_active":"2023-10-06T02:46:07.517401+0000","last_peered":"2023-10-06T02:46:07.517401+0000","last_clean":"2023-10-06T02:46:07.517401+0000","last_became_active":"2023-10-06T02:46:06.503721+0000","last_became_peered":"2023-10-06T02:46:06.503721+0000","last_unstale":"2023-10-06T02:46:07.517401+0000","last_undegraded":"2023-10-06T02:46:07.517401+0000","last_fullsized":"2023-10-06T02:46:07.517401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:40.222541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510647+0000","last_change":"2023-10-06T02:46:07.510256+0000","last_active":"2023-10-06T02:46:07.510647+0000","last_peered":"2023-10-06T02:46:07.510647+0000","last_clean":"2023-10-06T02:46:07.510647+0000","last_became_active":"2023-10-06T02:46:07.507169+0000","last_became_peered":"2023-10-06T02:46:07.507169+0000","last_unstale":"2023-10-06T02:46:07.510647+0000","last_undegraded":"2023-10-06T02:46:07.510647+0000","last_fullsized":"2023-10-06T02:46:07.510647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.520847+0000","last_change":"2023-10-06T02:46:06.506258+0000","last_active":"2023-10-06T02:46:07.520847+0000","last_peered":"2023-10-06T02:46:07.520847+0000","last_clean":"2023-10-06T02:46:07.520847+0000","last_became_active":"2023-10-06T02:46:06.505429+0000","last_became_peered":"2023-10-06T02:46:06.505429+0000","last_unstale":"2023-10-06T02:46:07.520847+0000","last_undegraded":"2023-10-06T02:46:07.520847+0000","last_fullsized":"2023-10-06T02:46:07.520847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510753+0000","last_change":"2023-10-06T02:46:07.509811+0000","last_active":"2023-10-06T02:46:07.510753+0000","last_peered":"2023-10-06T02:46:07.510753+0000","last_clean":"2023-10-06T02:46:07.510753+0000","last_became_active":"2023-10-06T02:46:07.508799+0000","last_became_peered":"2023-10-06T02:46:07.508799+0000","last_unstale":"2023-10-06T02:46:07.510753+0000","last_undegraded":"2023-10-06T02:46:07.510753+0000","last_fullsized":"2023-10-06T02:46:07.510753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:39.042317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519408+0000","last_change":"2023-10-06T02:46:06.510875+0000","last_active":"2023-10-06T02:46:07.519408+0000","last_peered":"2023-10-06T02:46:07.519408+0000","last_clean":"2023-10-06T02:46:07.519408+0000","last_became_active":"2023-10-06T02:46:06.510700+0000","last_became_peered":"2023-10-06T02:46:06.510700+0000","last_unstale":"2023-10-06T02:46:07.519408+0000","last_undegraded":"2023-10-06T02:46:07.519408+0000","last_fullsized":"2023-10-06T02:46:07.519408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:25.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507028+0000","last_change":"2023-10-06T02:46:07.506952+0000","last_active":"2023-10-06T02:46:07.507028+0000","last_peered":"2023-10-06T02:46:07.507028+0000","last_clean":"2023-10-06T02:46:07.507028+0000","last_became_active":"2023-10-06T02:46:07.505445+0000","last_became_peered":"2023-10-06T02:46:07.505445+0000","last_unstale":"2023-10-06T02:46:07.507028+0000","last_undegraded":"2023-10-06T02:46:07.507028+0000","last_fullsized":"2023-10-06T02:46:07.507028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499345+0000","last_change":"2023-10-06T02:46:06.501179+0000","last_active":"2023-10-06T02:46:07.499345+0000","last_peered":"2023-10-06T02:46:07.499345+0000","last_clean":"2023-10-06T02:46:07.499345+0000","last_became_active":"2023-10-06T02:46:06.500963+0000","last_became_peered":"2023-10-06T02:46:06.500963+0000","last_unstale":"2023-10-06T02:46:07.499345+0000","last_undegraded":"2023-10-06T02:46:07.499345+0000","last_fullsized":"2023-10-06T02:46:07.499345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504650+0000","last_change":"2023-10-06T02:46:07.504555+0000","last_active":"2023-10-06T02:46:07.504650+0000","last_peered":"2023-10-06T02:46:07.504650+0000","last_clean":"2023-10-06T02:46:07.504650+0000","last_became_active":"2023-10-06T02:46:07.504138+0000","last_became_peered":"2023-10-06T02:46:07.504138+0000","last_unstale":"2023-10-06T02:46:07.504650+0000","last_undegraded":"2023-10-06T02:46:07.504650+0000","last_fullsized":"2023-10-06T02:46:07.504650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.503062+0000","last_change":"2023-10-06T02:46:06.505783+0000","last_active":"2023-10-06T02:46:07.503062+0000","last_peered":"2023-10-06T02:46:07.503062+0000","last_clean":"2023-10-06T02:46:07.503062+0000","last_became_active":"2023-10-06T02:46:06.505556+0000","last_became_peered":"2023-10-06T02:46:06.505556+0000","last_unstale":"2023-10-06T02:46:07.503062+0000","last_undegraded":"2023-10-06T02:46:07.503062+0000","last_fullsized":"2023-10-06T02:46:07.503062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:03.445295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506278+0000","last_change":"2023-10-06T02:46:07.502954+0000","last_active":"2023-10-06T02:46:07.506278+0000","last_peered":"2023-10-06T02:46:07.506278+0000","last_clean":"2023-10-06T02:46:07.506278+0000","last_became_active":"2023-10-06T02:46:07.502601+0000","last_became_peered":"2023-10-06T02:46:07.502601+0000","last_unstale":"2023-10-06T02:46:07.506278+0000","last_undegraded":"2023-10-06T02:46:07.506278+0000","last_fullsized":"2023-10-06T02:46:07.506278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.518604+0000","last_change":"2023-10-06T02:46:06.503869+0000","last_active":"2023-10-06T02:46:07.518604+0000","last_peered":"2023-10-06T02:46:07.518604+0000","last_clean":"2023-10-06T02:46:07.518604+0000","last_became_active":"2023-10-06T02:46:06.503648+0000","last_became_peered":"2023-10-06T02:46:06.503648+0000","last_unstale":"2023-10-06T02:46:07.518604+0000","last_undegraded":"2023-10-06T02:46:07.518604+0000","last_fullsized":"2023-10-06T02:46:07.518604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505698+0000","last_change":"2023-10-06T02:46:07.505647+0000","last_active":"2023-10-06T02:46:07.505698+0000","last_peered":"2023-10-06T02:46:07.505698+0000","last_clean":"2023-10-06T02:46:07.505698+0000","last_became_active":"2023-10-06T02:46:07.505306+0000","last_became_peered":"2023-10-06T02:46:07.505306+0000","last_unstale":"2023-10-06T02:46:07.505698+0000","last_undegraded":"2023-10-06T02:46:07.505698+0000","last_fullsized":"2023-10-06T02:46:07.505698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:21.300350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519147+0000","last_change":"2023-10-06T02:46:06.509035+0000","last_active":"2023-10-06T02:46:07.519147+0000","last_peered":"2023-10-06T02:46:07.519147+0000","last_clean":"2023-10-06T02:46:07.519147+0000","last_became_active":"2023-10-06T02:46:06.508828+0000","last_became_peered":"2023-10-06T02:46:06.508828+0000","last_unstale":"2023-10-06T02:46:07.519147+0000","last_undegraded":"2023-10-06T02:46:07.519147+0000","last_fullsized":"2023-10-06T02:46:07.519147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:25.817132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505963+0000","last_change":"2023-10-06T02:46:07.505886+0000","last_active":"2023-10-06T02:46:07.505963+0000","last_peered":"2023-10-06T02:46:07.505963+0000","last_clean":"2023-10-06T02:46:07.505963+0000","last_became_active":"2023-10-06T02:46:07.505418+0000","last_became_peered":"2023-10-06T02:46:07.505418+0000","last_unstale":"2023-10-06T02:46:07.505963+0000","last_undegraded":"2023-10-06T02:46:07.505963+0000","last_fullsized":"2023-10-06T02:46:07.505963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519237+0000","last_change":"2023-10-06T02:46:06.509618+0000","last_active":"2023-10-06T02:46:07.519237+0000","last_peered":"2023-10-06T02:46:07.519237+0000","last_clean":"2023-10-06T02:46:07.519237+0000","last_became_active":"2023-10-06T02:46:06.509377+0000","last_became_peered":"2023-10-06T02:46:06.509377+0000","last_unstale":"2023-10-06T02:46:07.519237+0000","last_undegraded":"2023-10-06T02:46:07.519237+0000","last_fullsized":"2023-10-06T02:46:07.519237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:41.862180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507506+0000","last_change":"2023-10-06T02:46:07.507448+0000","last_active":"2023-10-06T02:46:07.507506+0000","last_peered":"2023-10-06T02:46:07.507506+0000","last_clean":"2023-10-06T02:46:07.507506+0000","last_became_active":"2023-10-06T02:46:07.507221+0000","last_became_peered":"2023-10-06T02:46:07.507221+0000","last_unstale":"2023-10-06T02:46:07.507506+0000","last_undegraded":"2023-10-06T02:46:07.507506+0000","last_fullsized":"2023-10-06T02:46:07.507506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.956040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.517062+0000","last_change":"2023-10-06T02:46:06.498625+0000","last_active":"2023-10-06T02:46:07.517062+0000","last_peered":"2023-10-06T02:46:07.517062+0000","last_clean":"2023-10-06T02:46:07.517062+0000","last_became_active":"2023-10-06T02:46:06.498405+0000","last_became_peered":"2023-10-06T02:46:06.498405+0000","last_unstale":"2023-10-06T02:46:07.517062+0000","last_undegraded":"2023-10-06T02:46:07.517062+0000","last_fullsized":"2023-10-06T02:46:07.517062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.895724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501977+0000","last_change":"2023-10-06T02:46:07.501817+0000","last_active":"2023-10-06T02:46:07.501977+0000","last_peered":"2023-10-06T02:46:07.501977+0000","last_clean":"2023-10-06T02:46:07.501977+0000","last_became_active":"2023-10-06T02:46:07.501615+0000","last_became_peered":"2023-10-06T02:46:07.501615+0000","last_unstale":"2023-10-06T02:46:07.501977+0000","last_undegraded":"2023-10-06T02:46:07.501977+0000","last_fullsized":"2023-10-06T02:46:07.501977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497143+0000","last_change":"2023-10-06T02:46:06.502492+0000","last_active":"2023-10-06T02:46:07.497143+0000","last_peered":"2023-10-06T02:46:07.497143+0000","last_clean":"2023-10-06T02:46:07.497143+0000","last_became_active":"2023-10-06T02:46:06.502172+0000","last_became_peered":"2023-10-06T02:46:06.502172+0000","last_unstale":"2023-10-06T02:46:07.497143+0000","last_undegraded":"2023-10-06T02:46:07.497143+0000","last_fullsized":"2023-10-06T02:46:07.497143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509094+0000","last_change":"2023-10-06T02:46:07.508860+0000","last_active":"2023-10-06T02:46:07.509094+0000","last_peered":"2023-10-06T02:46:07.509094+0000","last_clean":"2023-10-06T02:46:07.509094+0000","last_became_active":"2023-10-06T02:46:07.508363+0000","last_became_peered":"2023-10-06T02:46:07.508363+0000","last_unstale":"2023-10-06T02:46:07.509094+0000","last_undegraded":"2023-10-06T02:46:07.509094+0000","last_fullsized":"2023-10-06T02:46:07.509094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.956040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.517248+0000","last_change":"2023-10-06T02:46:06.505039+0000","last_active":"2023-10-06T02:46:07.517248+0000","last_peered":"2023-10-06T02:46:07.517248+0000","last_clean":"2023-10-06T02:46:07.517248+0000","last_became_active":"2023-10-06T02:46:06.504809+0000","last_became_peered":"2023-10-06T02:46:06.504809+0000","last_unstale":"2023-10-06T02:46:07.517248+0000","last_undegraded":"2023-10-06T02:46:07.517248+0000","last_fullsized":"2023-10-06T02:46:07.517248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505737+0000","last_change":"2023-10-06T02:46:07.504251+0000","last_active":"2023-10-06T02:46:07.505737+0000","last_peered":"2023-10-06T02:46:07.505737+0000","last_clean":"2023-10-06T02:46:07.505737+0000","last_became_active":"2023-10-06T02:46:07.504022+0000","last_became_peered":"2023-10-06T02:46:07.504022+0000","last_unstale":"2023-10-06T02:46:07.505737+0000","last_undegraded":"2023-10-06T02:46:07.505737+0000","last_fullsized":"2023-10-06T02:46:07.505737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:41.875449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500561+0000","last_change":"2023-10-06T02:46:06.508771+0000","last_active":"2023-10-06T02:46:07.500561+0000","last_peered":"2023-10-06T02:46:07.500561+0000","last_clean":"2023-10-06T02:46:07.500561+0000","last_became_active":"2023-10-06T02:46:06.508543+0000","last_became_peered":"2023-10-06T02:46:06.508543+0000","last_unstale":"2023-10-06T02:46:07.500561+0000","last_undegraded":"2023-10-06T02:46:07.500561+0000","last_fullsized":"2023-10-06T02:46:07.500561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:22.807034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506800+0000","last_change":"2023-10-06T02:46:07.506413+0000","last_active":"2023-10-06T02:46:07.506800+0000","last_peered":"2023-10-06T02:46:07.506800+0000","last_clean":"2023-10-06T02:46:07.506800+0000","last_became_active":"2023-10-06T02:46:07.506172+0000","last_became_peered":"2023-10-06T02:46:07.506172+0000","last_unstale":"2023-10-06T02:46:07.506800+0000","last_undegraded":"2023-10-06T02:46:07.506800+0000","last_fullsized":"2023-10-06T02:46:07.506800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505491+0000","last_change":"2023-10-06T02:46:06.511150+0000","last_active":"2023-10-06T02:46:07.505491+0000","last_peered":"2023-10-06T02:46:07.505491+0000","last_clean":"2023-10-06T02:46:07.505491+0000","last_became_active":"2023-10-06T02:46:06.510541+0000","last_became_peered":"2023-10-06T02:46:06.510541+0000","last_unstale":"2023-10-06T02:46:07.505491+0000","last_undegraded":"2023-10-06T02:46:07.505491+0000","last_fullsized":"2023-10-06T02:46:07.505491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510736+0000","last_change":"2023-10-06T02:46:07.509675+0000","last_active":"2023-10-06T02:46:07.510736+0000","last_peered":"2023-10-06T02:46:07.510736+0000","last_clean":"2023-10-06T02:46:07.510736+0000","last_became_active":"2023-10-06T02:46:07.508502+0000","last_became_peered":"2023-10-06T02:46:07.508502+0000","last_unstale":"2023-10-06T02:46:07.510736+0000","last_undegraded":"2023-10-06T02:46:07.510736+0000","last_fullsized":"2023-10-06T02:46:07.510736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:51.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.498073+0000","last_change":"2023-10-06T02:46:06.509235+0000","last_active":"2023-10-06T02:46:07.498073+0000","last_peered":"2023-10-06T02:46:07.498073+0000","last_clean":"2023-10-06T02:46:07.498073+0000","last_became_active":"2023-10-06T02:46:06.508969+0000","last_became_peered":"2023-10-06T02:46:06.508969+0000","last_unstale":"2023-10-06T02:46:07.498073+0000","last_undegraded":"2023-10-06T02:46:07.498073+0000","last_fullsized":"2023-10-06T02:46:07.498073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510187+0000","last_change":"2023-10-06T02:46:07.510137+0000","last_active":"2023-10-06T02:46:07.510187+0000","last_peered":"2023-10-06T02:46:07.510187+0000","last_clean":"2023-10-06T02:46:07.510187+0000","last_became_active":"2023-10-06T02:46:07.509917+0000","last_became_peered":"2023-10-06T02:46:07.509917+0000","last_unstale":"2023-10-06T02:46:07.510187+0000","last_undegraded":"2023-10-06T02:46:07.510187+0000","last_fullsized":"2023-10-06T02:46:07.510187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500321+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:46:07.500321+0000","last_peered":"2023-10-06T02:46:07.500321+0000","last_clean":"2023-10-06T02:46:07.500321+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:46:07.500321+0000","last_undegraded":"2023-10-06T02:46:07.500321+0000","last_fullsized":"2023-10-06T02:46:07.500321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497681+0000","last_change":"2023-10-06T02:46:06.506901+0000","last_active":"2023-10-06T02:46:07.497681+0000","last_peered":"2023-10-06T02:46:07.497681+0000","last_clean":"2023-10-06T02:46:07.497681+0000","last_became_active":"2023-10-06T02:46:06.506678+0000","last_became_peered":"2023-10-06T02:46:06.506678+0000","last_unstale":"2023-10-06T02:46:07.497681+0000","last_undegraded":"2023-10-06T02:46:07.497681+0000","last_fullsized":"2023-10-06T02:46:07.497681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509115+0000","last_change":"2023-10-06T02:46:07.509040+0000","last_active":"2023-10-06T02:46:07.509115+0000","last_peered":"2023-10-06T02:46:07.509115+0000","last_clean":"2023-10-06T02:46:07.509115+0000","last_became_active":"2023-10-06T02:46:07.508418+0000","last_became_peered":"2023-10-06T02:46:07.508418+0000","last_unstale":"2023-10-06T02:46:07.509115+0000","last_undegraded":"2023-10-06T02:46:07.509115+0000","last_fullsized":"2023-10-06T02:46:07.509115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497326+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:46:07.497326+0000","last_peered":"2023-10-06T02:46:07.497326+0000","last_clean":"2023-10-06T02:46:07.497326+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:46:07.497326+0000","last_undegraded":"2023-10-06T02:46:07.497326+0000","last_fullsized":"2023-10-06T02:46:07.497326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502341+0000","last_change":"2023-10-06T02:46:06.508135+0000","last_active":"2023-10-06T02:46:07.502341+0000","last_peered":"2023-10-06T02:46:07.502341+0000","last_clean":"2023-10-06T02:46:07.502341+0000","last_became_active":"2023-10-06T02:46:06.507924+0000","last_became_peered":"2023-10-06T02:46:06.507924+0000","last_unstale":"2023-10-06T02:46:07.502341+0000","last_undegraded":"2023-10-06T02:46:07.502341+0000","last_fullsized":"2023-10-06T02:46:07.502341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507713+0000","last_change":"2023-10-06T02:46:07.507658+0000","last_active":"2023-10-06T02:46:07.507713+0000","last_peered":"2023-10-06T02:46:07.507713+0000","last_clean":"2023-10-06T02:46:07.507713+0000","last_became_active":"2023-10-06T02:46:07.507449+0000","last_became_peered":"2023-10-06T02:46:07.507449+0000","last_unstale":"2023-10-06T02:46:07.507713+0000","last_undegraded":"2023-10-06T02:46:07.507713+0000","last_fullsized":"2023-10-06T02:46:07.507713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.496044+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:46:07.496044+0000","last_peered":"2023-10-06T02:46:07.496044+0000","last_clean":"2023-10-06T02:46:07.496044+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:46:07.496044+0000","last_undegraded":"2023-10-06T02:46:07.496044+0000","last_fullsized":"2023-10-06T02:46:07.496044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500045+0000","last_change":"2023-10-06T02:46:06.505031+0000","last_active":"2023-10-06T02:46:07.500045+0000","last_peered":"2023-10-06T02:46:07.500045+0000","last_clean":"2023-10-06T02:46:07.500045+0000","last_became_active":"2023-10-06T02:46:06.504811+0000","last_became_peered":"2023-10-06T02:46:06.504811+0000","last_unstale":"2023-10-06T02:46:07.500045+0000","last_undegraded":"2023-10-06T02:46:07.500045+0000","last_fullsized":"2023-10-06T02:46:07.500045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509069+0000","last_change":"2023-10-06T02:46:07.508885+0000","last_active":"2023-10-06T02:46:07.509069+0000","last_peered":"2023-10-06T02:46:07.509069+0000","last_clean":"2023-10-06T02:46:07.509069+0000","last_became_active":"2023-10-06T02:46:07.508130+0000","last_became_peered":"2023-10-06T02:46:07.508130+0000","last_unstale":"2023-10-06T02:46:07.509069+0000","last_undegraded":"2023-10-06T02:46:07.509069+0000","last_fullsized":"2023-10-06T02:46:07.509069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497823+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:46:07.497823+0000","last_peered":"2023-10-06T02:46:07.497823+0000","last_clean":"2023-10-06T02:46:07.497823+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:46:07.497823+0000","last_undegraded":"2023-10-06T02:46:07.497823+0000","last_fullsized":"2023-10-06T02:46:07.497823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502521+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:46:07.502521+0000","last_peered":"2023-10-06T02:46:07.502521+0000","last_clean":"2023-10-06T02:46:07.502521+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:46:07.502521+0000","last_undegraded":"2023-10-06T02:46:07.502521+0000","last_fullsized":"2023-10-06T02:46:07.502521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497774+0000","last_change":"2023-10-06T02:46:06.504522+0000","last_active":"2023-10-06T02:46:07.497774+0000","last_peered":"2023-10-06T02:46:07.497774+0000","last_clean":"2023-10-06T02:46:07.497774+0000","last_became_active":"2023-10-06T02:46:06.504244+0000","last_became_peered":"2023-10-06T02:46:06.504244+0000","last_unstale":"2023-10-06T02:46:07.497774+0000","last_undegraded":"2023-10-06T02:46:07.497774+0000","last_fullsized":"2023-10-06T02:46:07.497774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502915+0000","last_change":"2023-10-06T02:46:07.502838+0000","last_active":"2023-10-06T02:46:07.502915+0000","last_peered":"2023-10-06T02:46:07.502915+0000","last_clean":"2023-10-06T02:46:07.502915+0000","last_became_active":"2023-10-06T02:46:07.502571+0000","last_became_peered":"2023-10-06T02:46:07.502571+0000","last_unstale":"2023-10-06T02:46:07.502915+0000","last_undegraded":"2023-10-06T02:46:07.502915+0000","last_fullsized":"2023-10-06T02:46:07.502915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502146+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:46:07.502146+0000","last_peered":"2023-10-06T02:46:07.502146+0000","last_clean":"2023-10-06T02:46:07.502146+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:46:07.502146+0000","last_undegraded":"2023-10-06T02:46:07.502146+0000","last_fullsized":"2023-10-06T02:46:07.502146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500874+0000","last_change":"2023-10-06T02:46:06.509615+0000","last_active":"2023-10-06T02:46:07.500874+0000","last_peered":"2023-10-06T02:46:07.500874+0000","last_clean":"2023-10-06T02:46:07.500874+0000","last_became_active":"2023-10-06T02:46:06.508150+0000","last_became_peered":"2023-10-06T02:46:06.508150+0000","last_unstale":"2023-10-06T02:46:07.500874+0000","last_undegraded":"2023-10-06T02:46:07.500874+0000","last_fullsized":"2023-10-06T02:46:07.500874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508716+0000","last_change":"2023-10-06T02:46:07.508651+0000","last_active":"2023-10-06T02:46:07.508716+0000","last_peered":"2023-10-06T02:46:07.508716+0000","last_clean":"2023-10-06T02:46:07.508716+0000","last_became_active":"2023-10-06T02:46:07.507943+0000","last_became_peered":"2023-10-06T02:46:07.507943+0000","last_unstale":"2023-10-06T02:46:07.508716+0000","last_undegraded":"2023-10-06T02:46:07.508716+0000","last_fullsized":"2023-10-06T02:46:07.508716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502607+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:46:07.502607+0000","last_peered":"2023-10-06T02:46:07.502607+0000","last_clean":"2023-10-06T02:46:07.502607+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:46:07.502607+0000","last_undegraded":"2023-10-06T02:46:07.502607+0000","last_fullsized":"2023-10-06T02:46:07.502607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499607+0000","last_change":"2023-10-06T02:46:06.506734+0000","last_active":"2023-10-06T02:46:07.499607+0000","last_peered":"2023-10-06T02:46:07.499607+0000","last_clean":"2023-10-06T02:46:07.499607+0000","last_became_active":"2023-10-06T02:46:06.506350+0000","last_became_peered":"2023-10-06T02:46:06.506350+0000","last_unstale":"2023-10-06T02:46:07.499607+0000","last_undegraded":"2023-10-06T02:46:07.499607+0000","last_fullsized":"2023-10-06T02:46:07.499607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506313+0000","last_change":"2023-10-06T02:46:07.505004+0000","last_active":"2023-10-06T02:46:07.506313+0000","last_peered":"2023-10-06T02:46:07.506313+0000","last_clean":"2023-10-06T02:46:07.506313+0000","last_became_active":"2023-10-06T02:46:07.504802+0000","last_became_peered":"2023-10-06T02:46:07.504802+0000","last_unstale":"2023-10-06T02:46:07.506313+0000","last_undegraded":"2023-10-06T02:46:07.506313+0000","last_fullsized":"2023-10-06T02:46:07.506313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.516938+0000","last_change":"2023-10-06T02:46:06.506225+0000","last_active":"2023-10-06T02:46:07.516938+0000","last_peered":"2023-10-06T02:46:07.516938+0000","last_clean":"2023-10-06T02:46:07.516938+0000","last_became_active":"2023-10-06T02:46:06.505946+0000","last_became_peered":"2023-10-06T02:46:06.505946+0000","last_unstale":"2023-10-06T02:46:07.516938+0000","last_undegraded":"2023-10-06T02:46:07.516938+0000","last_fullsized":"2023-10-06T02:46:07.516938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499718+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:46:07.499718+0000","last_peered":"2023-10-06T02:46:07.499718+0000","last_clean":"2023-10-06T02:46:07.499718+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:46:07.499718+0000","last_undegraded":"2023-10-06T02:46:07.499718+0000","last_fullsized":"2023-10-06T02:46:07.499718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508060+0000","last_change":"2023-10-06T02:46:07.507383+0000","last_active":"2023-10-06T02:46:07.508060+0000","last_peered":"2023-10-06T02:46:07.508060+0000","last_clean":"2023-10-06T02:46:07.508060+0000","last_became_active":"2023-10-06T02:46:07.506430+0000","last_became_peered":"2023-10-06T02:46:07.506430+0000","last_unstale":"2023-10-06T02:46:07.508060+0000","last_undegraded":"2023-10-06T02:46:07.508060+0000","last_fullsized":"2023-10-06T02:46:07.508060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499726+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:46:07.499726+0000","last_peered":"2023-10-06T02:46:07.499726+0000","last_clean":"2023-10-06T02:46:07.499726+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:46:07.499726+0000","last_undegraded":"2023-10-06T02:46:07.499726+0000","last_fullsized":"2023-10-06T02:46:07.499726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500715+0000","last_change":"2023-10-06T02:46:06.509764+0000","last_active":"2023-10-06T02:46:07.500715+0000","last_peered":"2023-10-06T02:46:07.500715+0000","last_clean":"2023-10-06T02:46:07.500715+0000","last_became_active":"2023-10-06T02:46:06.508422+0000","last_became_peered":"2023-10-06T02:46:06.508422+0000","last_unstale":"2023-10-06T02:46:07.500715+0000","last_undegraded":"2023-10-06T02:46:07.500715+0000","last_fullsized":"2023-10-06T02:46:07.500715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506969+0000","last_change":"2023-10-06T02:46:07.506906+0000","last_active":"2023-10-06T02:46:07.506969+0000","last_peered":"2023-10-06T02:46:07.506969+0000","last_clean":"2023-10-06T02:46:07.506969+0000","last_became_active":"2023-10-06T02:46:07.506307+0000","last_became_peered":"2023-10-06T02:46:07.506307+0000","last_unstale":"2023-10-06T02:46:07.506969+0000","last_undegraded":"2023-10-06T02:46:07.506969+0000","last_fullsized":"2023-10-06T02:46:07.506969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.518794+0000","last_change":"2023-10-06T02:46:06.508208+0000","last_active":"2023-10-06T02:46:07.518794+0000","last_peered":"2023-10-06T02:46:07.518794+0000","last_clean":"2023-10-06T02:46:07.518794+0000","last_became_active":"2023-10-06T02:46:06.508003+0000","last_became_peered":"2023-10-06T02:46:06.508003+0000","last_unstale":"2023-10-06T02:46:07.518794+0000","last_undegraded":"2023-10-06T02:46:07.518794+0000","last_fullsized":"2023-10-06T02:46:07.518794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507486+0000","last_change":"2023-10-06T02:46:07.507427+0000","last_active":"2023-10-06T02:46:07.507486+0000","last_peered":"2023-10-06T02:46:07.507486+0000","last_clean":"2023-10-06T02:46:07.507486+0000","last_became_active":"2023-10-06T02:46:07.507181+0000","last_became_peered":"2023-10-06T02:46:07.507181+0000","last_unstale":"2023-10-06T02:46:07.507486+0000","last_undegraded":"2023-10-06T02:46:07.507486+0000","last_fullsized":"2023-10-06T02:46:07.507486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:14.225910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519129+0000","last_change":"2023-10-06T02:46:06.508400+0000","last_active":"2023-10-06T02:46:07.519129+0000","last_peered":"2023-10-06T02:46:07.519129+0000","last_clean":"2023-10-06T02:46:07.519129+0000","last_became_active":"2023-10-06T02:46:06.508214+0000","last_became_peered":"2023-10-06T02:46:06.508214+0000","last_unstale":"2023-10-06T02:46:07.519129+0000","last_undegraded":"2023-10-06T02:46:07.519129+0000","last_fullsized":"2023-10-06T02:46:07.519129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505770+0000","last_change":"2023-10-06T02:46:07.505375+0000","last_active":"2023-10-06T02:46:07.505770+0000","last_peered":"2023-10-06T02:46:07.505770+0000","last_clean":"2023-10-06T02:46:07.505770+0000","last_became_active":"2023-10-06T02:46:07.505155+0000","last_became_peered":"2023-10-06T02:46:07.505155+0000","last_unstale":"2023-10-06T02:46:07.505770+0000","last_undegraded":"2023-10-06T02:46:07.505770+0000","last_fullsized":"2023-10-06T02:46:07.505770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:12:08.403799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519370+0000","last_change":"2023-10-06T02:46:06.511448+0000","last_active":"2023-10-06T02:46:07.519370+0000","last_peered":"2023-10-06T02:46:07.519370+0000","last_clean":"2023-10-06T02:46:07.519370+0000","last_became_active":"2023-10-06T02:46:06.511215+0000","last_became_peered":"2023-10-06T02:46:06.511215+0000","last_unstale":"2023-10-06T02:46:07.519370+0000","last_undegraded":"2023-10-06T02:46:07.519370+0000","last_fullsized":"2023-10-06T02:46:07.519370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506825+0000","last_change":"2023-10-06T02:46:07.506746+0000","last_active":"2023-10-06T02:46:07.506825+0000","last_peered":"2023-10-06T02:46:07.506825+0000","last_clean":"2023-10-06T02:46:07.506825+0000","last_became_active":"2023-10-06T02:46:07.505974+0000","last_became_peered":"2023-10-06T02:46:07.505974+0000","last_unstale":"2023-10-06T02:46:07.506825+0000","last_undegraded":"2023-10-06T02:46:07.506825+0000","last_fullsized":"2023-10-06T02:46:07.506825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.515971+0000","last_change":"2023-10-06T02:46:06.507072+0000","last_active":"2023-10-06T02:46:07.515971+0000","last_peered":"2023-10-06T02:46:07.515971+0000","last_clean":"2023-10-06T02:46:07.515971+0000","last_became_active":"2023-10-06T02:46:06.506884+0000","last_became_peered":"2023-10-06T02:46:06.506884+0000","last_unstale":"2023-10-06T02:46:07.515971+0000","last_undegraded":"2023-10-06T02:46:07.515971+0000","last_fullsized":"2023-10-06T02:46:07.515971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508043+0000","last_change":"2023-10-06T02:46:07.507192+0000","last_active":"2023-10-06T02:46:07.508043+0000","last_peered":"2023-10-06T02:46:07.508043+0000","last_clean":"2023-10-06T02:46:07.508043+0000","last_became_active":"2023-10-06T02:46:07.505722+0000","last_became_peered":"2023-10-06T02:46:07.505722+0000","last_unstale":"2023-10-06T02:46:07.508043+0000","last_undegraded":"2023-10-06T02:46:07.508043+0000","last_fullsized":"2023-10-06T02:46:07.508043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.518896+0000","last_change":"2023-10-06T02:46:06.503414+0000","last_active":"2023-10-06T02:46:07.518896+0000","last_peered":"2023-10-06T02:46:07.518896+0000","last_clean":"2023-10-06T02:46:07.518896+0000","last_became_active":"2023-10-06T02:46:06.503182+0000","last_became_peered":"2023-10-06T02:46:06.503182+0000","last_unstale":"2023-10-06T02:46:07.518896+0000","last_undegraded":"2023-10-06T02:46:07.518896+0000","last_fullsized":"2023-10-06T02:46:07.518896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510782+0000","last_change":"2023-10-06T02:46:07.510148+0000","last_active":"2023-10-06T02:46:07.510782+0000","last_peered":"2023-10-06T02:46:07.510782+0000","last_clean":"2023-10-06T02:46:07.510782+0000","last_became_active":"2023-10-06T02:46:07.509401+0000","last_became_peered":"2023-10-06T02:46:07.509401+0000","last_unstale":"2023-10-06T02:46:07.510782+0000","last_undegraded":"2023-10-06T02:46:07.510782+0000","last_fullsized":"2023-10-06T02:46:07.510782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:05.528757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502895+0000","last_change":"2023-10-06T02:46:07.502629+0000","last_active":"2023-10-06T02:46:07.502895+0000","last_peered":"2023-10-06T02:46:07.502895+0000","last_clean":"2023-10-06T02:46:07.502895+0000","last_became_active":"2023-10-06T02:46:07.502400+0000","last_became_peered":"2023-10-06T02:46:07.502400+0000","last_unstale":"2023-10-06T02:46:07.502895+0000","last_undegraded":"2023-10-06T02:46:07.502895+0000","last_fullsized":"2023-10-06T02:46:07.502895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505684+0000","last_change":"2023-10-06T02:46:07.505518+0000","last_active":"2023-10-06T02:46:07.505684+0000","last_peered":"2023-10-06T02:46:07.505684+0000","last_clean":"2023-10-06T02:46:07.505684+0000","last_became_active":"2023-10-06T02:46:07.504595+0000","last_became_peered":"2023-10-06T02:46:07.504595+0000","last_unstale":"2023-10-06T02:46:07.505684+0000","last_undegraded":"2023-10-06T02:46:07.505684+0000","last_fullsized":"2023-10-06T02:46:07.505684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:41.875449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510796+0000","last_change":"2023-10-06T02:46:07.510598+0000","last_active":"2023-10-06T02:46:07.510796+0000","last_peered":"2023-10-06T02:46:07.510796+0000","last_clean":"2023-10-06T02:46:07.510796+0000","last_became_active":"2023-10-06T02:46:07.510359+0000","last_became_peered":"2023-10-06T02:46:07.510359+0000","last_unstale":"2023-10-06T02:46:07.510796+0000","last_undegraded":"2023-10-06T02:46:07.510796+0000","last_fullsized":"2023-10-06T02:46:07.510796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:59.513702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508076+0000","last_change":"2023-10-06T02:46:07.507536+0000","last_active":"2023-10-06T02:46:07.508076+0000","last_peered":"2023-10-06T02:46:07.508076+0000","last_clean":"2023-10-06T02:46:07.508076+0000","last_became_active":"2023-10-06T02:46:07.506737+0000","last_became_peered":"2023-10-06T02:46:07.506737+0000","last_unstale":"2023-10-06T02:46:07.508076+0000","last_undegraded":"2023-10-06T02:46:07.508076+0000","last_fullsized":"2023-10-06T02:46:07.508076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.956040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508695+0000","last_change":"2023-10-06T02:46:07.508492+0000","last_active":"2023-10-06T02:46:07.508695+0000","last_peered":"2023-10-06T02:46:07.508695+0000","last_clean":"2023-10-06T02:46:07.508695+0000","last_became_active":"2023-10-06T02:46:07.508271+0000","last_became_peered":"2023-10-06T02:46:07.508271+0000","last_unstale":"2023-10-06T02:46:07.508695+0000","last_undegraded":"2023-10-06T02:46:07.508695+0000","last_fullsized":"2023-10-06T02:46:07.508695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":665,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194647,"statfs":{"total":200000000,"available":199318721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199909249,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195224,"statfs":{"total":200000000,"available":199910217,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]}],"pool_statfs":[]}} 2023-10-06T02:46:16.411 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:46:16.411 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T02:46:16.411 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T02:46:16.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T02:46:16.412 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T02:46:16.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.557+0000 7fef3b739700 1 Processor -- start 2023-10-06T02:46:16.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.558+0000 7fef3b739700 1 -- start start 2023-10-06T02:46:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.558+0000 7fef3b739700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 0x7fef340b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.558+0000 7fef3b739700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fef3406e940 0x7fef340cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.558+0000 7fef3b739700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef340b2290 con 0x7fef34156db0 2023-10-06T02:46:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.558+0000 7fef3b739700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef34157c00 con 0x7fef3406e940 2023-10-06T02:46:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.558+0000 7fef3b739700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef341572d0 con 0x7fef341569e0 2023-10-06T02:46:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.558+0000 7fef38cd4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fef34156db0 0x7fef3406e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58094/0 (socket says 172.21.15.81:58094) 2023-10-06T02:46:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef38cd4700 1 -- 172.21.15.81:0/2424975775 learned_addr learned my addr 172.21.15.81:0/2424975775 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef394d5700 1 --2- 172.21.15.81:0/2424975775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 0x7fef340b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef39cd6700 1 --2- 172.21.15.81:0/2424975775 >> v2:172.21.15.83:3300/0 conn(0x7fef3406e940 0x7fef340cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef2bfff700 1 -- 172.21.15.81:0/2424975775 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566037575 0 0) 0x7fef340b2290 con 0x7fef34156db0 2023-10-06T02:46:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef2bfff700 1 -- 172.21.15.81:0/2424975775 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef20003570 con 0x7fef34156db0 2023-10-06T02:46:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef394d5700 1 -- 172.21.15.81:0/2424975775 >> v2:172.21.15.83:3300/0 conn(0x7fef3406e940 msgr2=0x7fef340cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef394d5700 1 --2- 172.21.15.81:0/2424975775 >> v2:172.21.15.83:3300/0 conn(0x7fef3406e940 0x7fef340cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef394d5700 1 -- 172.21.15.81:0/2424975775 >> v1:172.21.15.81:6789/0 conn(0x7fef34156db0 legacy=0x7fef3406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef394d5700 1 -- 172.21.15.81:0/2424975775 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef341575b0 con 0x7fef341569e0 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef39cd6700 1 --2- 172.21.15.81:0/2424975775 >> v2:172.21.15.83:3300/0 conn(0x7fef3406e940 0x7fef340cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef394d5700 1 --2- 172.21.15.81:0/2424975775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 0x7fef340b17d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef30009e60 tx=0x7fef30009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee1bab5bfcb362f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef2bfff700 1 -- 172.21.15.81:0/2424975775 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000e070 con 0x7fef341569e0 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef2bfff700 1 -- 172.21.15.81:0/2424975775 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3000bab0 con 0x7fef341569e0 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.559+0000 7fef2bfff700 1 -- 172.21.15.81:0/2424975775 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000be70 con 0x7fef341569e0 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.560+0000 7fef3b739700 1 -- 172.21.15.81:0/2424975775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 msgr2=0x7fef340b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.560+0000 7fef3b739700 1 --2- 172.21.15.81:0/2424975775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 0x7fef340b17d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef30009e60 tx=0x7fef30009780 comp rx=0 tx=0).stop 2023-10-06T02:46:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.560+0000 7fef3b739700 1 -- 172.21.15.81:0/2424975775 shutdown_connections 2023-10-06T02:46:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.560+0000 7fef3b739700 1 --2- 172.21.15.81:0/2424975775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 0x7fef340b17d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.560+0000 7fef3b739700 1 --2- 172.21.15.81:0/2424975775 >> v2:172.21.15.83:3300/0 conn(0x7fef3406e940 0x7fef340cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.560+0000 7fef3b739700 1 -- 172.21.15.81:0/2424975775 >> 172.21.15.81:0/2424975775 conn(0x7fef3406cca0 msgr2=0x7fef3406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.560+0000 7fef3b739700 1 -- 172.21.15.81:0/2424975775 shutdown_connections 2023-10-06T02:46:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.560+0000 7fef3b739700 1 -- 172.21.15.81:0/2424975775 wait complete. 2023-10-06T02:46:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.561+0000 7fef3b739700 1 Processor -- start 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.561+0000 7fef3b739700 1 -- start start 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef3b739700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e940 0x7fef3413ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef3b739700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 0x7fef340c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef3b739700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef34156db0 0x7fef341543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef3b739700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef340c4130 con 0x7fef3406e940 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef3b739700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef340c3520 con 0x7fef34156db0 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef3b739700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef340c3800 con 0x7fef341569e0 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef394d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e940 0x7fef3413ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef394d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e940 0x7fef3413ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56736/0 (socket says 172.21.15.81:56736) 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef394d5700 1 -- 172.21.15.81:0/1014400106 learned_addr learned my addr 172.21.15.81:0/1014400106 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef394d5700 1 -- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 msgr2=0x7fef340c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef394d5700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 0x7fef340c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef39cd6700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef34156db0 0x7fef341543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef394d5700 1 -- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef34156db0 msgr2=0x7fef341543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef394d5700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef34156db0 0x7fef341543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef394d5700 1 -- 172.21.15.81:0/1014400106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c009420 con 0x7fef3406e940 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.562+0000 7fef394d5700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e940 0x7fef3413ebd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fef300097c0 tx=0x7fef30019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.563+0000 7fef297fa700 1 -- 172.21.15.81:0/1014400106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30012c30 con 0x7fef3406e940 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.563+0000 7fef297fa700 1 -- 172.21.15.81:0/1014400106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30012d90 con 0x7fef3406e940 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.563+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef30009a20 con 0x7fef3406e940 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.563+0000 7fef297fa700 1 -- 172.21.15.81:0/1014400106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300276c0 con 0x7fef3406e940 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.563+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef340c3dc0 con 0x7fef3406e940 2023-10-06T02:46:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.563+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef34068900 con 0x7fef3406e940 2023-10-06T02:46:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.564+0000 7fef297fa700 1 -- 172.21.15.81:0/1014400106 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef30024070 con 0x7fef3406e940 2023-10-06T02:46:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.564+0000 7fef297fa700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef18066f30 0x7fef180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.564+0000 7fef297fa700 1 -- 172.21.15.81:0/1014400106 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fef30086b70 con 0x7fef3406e940 2023-10-06T02:46:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.564+0000 7fef38cd4700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef18066f30 0x7fef180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.565+0000 7fef38cd4700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef18066f30 0x7fef180693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef240058d0 tx=0x7fef240079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.568+0000 7fef297fa700 1 -- 172.21.15.81:0/1014400106 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef30053d30 con 0x7fef3406e940 2023-10-06T02:46:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.802+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fef34157890 con 0x7fef3406e940 2023-10-06T02:46:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.804+0000 7fef297fa700 1 -- 172.21.15.81:0/1014400106 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+163699 (secure 0 0 0) 0x7fef30057350 con 0x7fef3406e940 2023-10-06T02:46:16.808 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef18066f30 msgr2=0x7fef180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef18066f30 0x7fef180693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef240058d0 tx=0x7fef240079d0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e940 msgr2=0x7fef3413ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e940 0x7fef3413ebd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fef300097c0 tx=0x7fef30019000 comp rx=0 tx=0).stop 2023-10-06T02:46:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 shutdown_connections 2023-10-06T02:46:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef18066f30 0x7fef180693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef34156db0 0x7fef341543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e940 0x7fef3413ebd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 --2- 172.21.15.81:0/1014400106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef341569e0 0x7fef340c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 >> 172.21.15.81:0/1014400106 conn(0x7fef3406cca0 msgr2=0x7fef340c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 shutdown_connections 2023-10-06T02:46:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.807+0000 7fef3b739700 1 -- 172.21.15.81:0/1014400106 wait complete. 2023-10-06T02:46:16.820 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":85757},{"type":"v1","addr":"172.21.15.83:6833","nonce":85757}]},"active_addr":"172.21.15.83:6833/85757","active_change":"2023-10-06T02:45:55.483294+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":2250921818}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3946041143}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":2644776562}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":4229889066}]}]} 2023-10-06T02:46:16.825 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T02:46:16.825 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T02:46:16.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:16.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.937+0000 7fbf4495a700 1 Processor -- start 2023-10-06T02:46:16.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.937+0000 7fbf4495a700 1 -- start start 2023-10-06T02:46:16.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.938+0000 7fbf4495a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbf401569e0 0x7fbf400b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.938+0000 7fbf4495a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbf40156db0 0x7fbf4006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.938+0000 7fbf4495a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400b2290 con 0x7fbf400b1d10 2023-10-06T02:46:16.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.938+0000 7fbf4495a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf40157c00 con 0x7fbf40156db0 2023-10-06T02:46:16.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.938+0000 7fbf4495a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf401572d0 con 0x7fbf401569e0 2023-10-06T02:46:16.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.938+0000 7fbf3dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbf40156db0 0x7fbf4006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.938+0000 7fbf3dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbf40156db0 0x7fbf4006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56752/0 (socket says 172.21.15.81:56752) 2023-10-06T02:46:16.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.938+0000 7fbf3dd9b700 1 -- 172.21.15.81:0/1532725603 learned_addr learned my addr 172.21.15.81:0/1532725603 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3dd9b700 1 -- 172.21.15.81:0/1532725603 >> v2:172.21.15.83:3300/0 conn(0x7fbf401569e0 msgr2=0x7fbf400b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3e59c700 1 --2- 172.21.15.81:0/1532725603 >> v2:172.21.15.83:3300/0 conn(0x7fbf401569e0 0x7fbf400b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3dd9b700 1 --2- 172.21.15.81:0/1532725603 >> v2:172.21.15.83:3300/0 conn(0x7fbf401569e0 0x7fbf400b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3dd9b700 1 -- 172.21.15.81:0/1532725603 >> v1:172.21.15.83:6789/0 conn(0x7fbf400b1d10 legacy=0x7fbf4015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3dd9b700 1 -- 172.21.15.81:0/1532725603 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf401575b0 con 0x7fbf40156db0 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3e59c700 1 --2- 172.21.15.81:0/1532725603 >> v2:172.21.15.83:3300/0 conn(0x7fbf401569e0 0x7fbf400b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3dd9b700 1 --2- 172.21.15.81:0/1532725603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf40156db0 0x7fbf4006e230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006f590 tx=0x7fbf3400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f611e0d04bcf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3d59a700 1 -- 172.21.15.81:0/1532725603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3400dc10 con 0x7fbf40156db0 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3d59a700 1 -- 172.21.15.81:0/1532725603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3400dd70 con 0x7fbf40156db0 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf3d59a700 1 -- 172.21.15.81:0/1532725603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf340106c0 con 0x7fbf40156db0 2023-10-06T02:46:16.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf4495a700 1 -- 172.21.15.81:0/1532725603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf40156db0 msgr2=0x7fbf4006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.939+0000 7fbf4495a700 1 --2- 172.21.15.81:0/1532725603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf40156db0 0x7fbf4006e230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006f590 tx=0x7fbf3400b4f0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.940+0000 7fbf4495a700 1 -- 172.21.15.81:0/1532725603 shutdown_connections 2023-10-06T02:46:16.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.940+0000 7fbf4495a700 1 --2- 172.21.15.81:0/1532725603 >> v2:172.21.15.83:3300/0 conn(0x7fbf401569e0 0x7fbf400b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.940+0000 7fbf4495a700 1 --2- 172.21.15.81:0/1532725603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf40156db0 0x7fbf4006e230 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.940+0000 7fbf4495a700 1 -- 172.21.15.81:0/1532725603 >> 172.21.15.81:0/1532725603 conn(0x7fbf4006cca0 msgr2=0x7fbf4006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:16.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.940+0000 7fbf4495a700 1 -- 172.21.15.81:0/1532725603 shutdown_connections 2023-10-06T02:46:16.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.940+0000 7fbf4495a700 1 -- 172.21.15.81:0/1532725603 wait complete. 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf4495a700 1 Processor -- start 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf4495a700 1 -- start start 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf4495a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400b1d10 0x7fbf400ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf4495a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf401569e0 0x7fbf40166b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf4495a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf40156db0 0x7fbf400a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf4495a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40167050 con 0x7fbf400b1d10 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf4495a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400a70d0 con 0x7fbf401569e0 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf4495a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400a73b0 con 0x7fbf40156db0 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf3e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400b1d10 0x7fbf400ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf3e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400b1d10 0x7fbf400ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56754/0 (socket says 172.21.15.81:56754) 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.941+0000 7fbf3e59c700 1 -- 172.21.15.81:0/3918246323 learned_addr learned my addr 172.21.15.81:0/3918246323 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf3dd9b700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf401569e0 0x7fbf40166b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf3ed9d700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf40156db0 0x7fbf400a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf3e59c700 1 -- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf40156db0 msgr2=0x7fbf400a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf3e59c700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf40156db0 0x7fbf400a8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf3e59c700 1 -- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf401569e0 msgr2=0x7fbf40166b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf3e59c700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf401569e0 0x7fbf40166b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf3e59c700 1 -- 172.21.15.81:0/3918246323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3400b790 con 0x7fbf400b1d10 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf3e59c700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400b1d10 0x7fbf400ac490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c830 tx=0x7fbf30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf2e7fc700 1 -- 172.21.15.81:0/3918246323 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30011600 con 0x7fbf400b1d10 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf2e7fc700 1 -- 172.21.15.81:0/3918246323 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30011760 con 0x7fbf400b1d10 2023-10-06T02:46:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf2e7fc700 1 -- 172.21.15.81:0/3918246323 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30011b20 con 0x7fbf400b1d10 2023-10-06T02:46:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf400a7690 con 0x7fbf400b1d10 2023-10-06T02:46:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.942+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf400a7c50 con 0x7fbf400b1d10 2023-10-06T02:46:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.943+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40068900 con 0x7fbf400b1d10 2023-10-06T02:46:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.943+0000 7fbf2e7fc700 1 -- 172.21.15.81:0/3918246323 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf30018360 con 0x7fbf400b1d10 2023-10-06T02:46:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.944+0000 7fbf2e7fc700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf20066f30 0x7fbf200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.944+0000 7fbf2e7fc700 1 -- 172.21.15.81:0/3918246323 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf30084620 con 0x7fbf400b1d10 2023-10-06T02:46:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.944+0000 7fbf3dd9b700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf20066f30 0x7fbf200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.944+0000 7fbf3dd9b700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf20066f30 0x7fbf200693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006f590 tx=0x7fbf3401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:16.948+0000 7fbf2e7fc700 1 -- 172.21.15.81:0/3918246323 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf30051730 con 0x7fbf400b1d10 2023-10-06T02:46:17.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.134+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf40157890 con 0x7fbf400b1d10 2023-10-06T02:46:17.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.134+0000 7fbf2e7fc700 1 -- 172.21.15.81:0/3918246323 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fbf30054d50 con 0x7fbf400b1d10 2023-10-06T02:46:17.136 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:17.136 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:17.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf20066f30 msgr2=0x7fbf200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf20066f30 0x7fbf200693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006f590 tx=0x7fbf3401a000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400b1d10 msgr2=0x7fbf400ac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400b1d10 0x7fbf400ac490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c830 tx=0x7fbf30008040 comp rx=0 tx=0).stop 2023-10-06T02:46:17.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 shutdown_connections 2023-10-06T02:46:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf40156db0 0x7fbf400a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400b1d10 0x7fbf400ac490 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf20066f30 0x7fbf200693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 --2- 172.21.15.81:0/3918246323 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf401569e0 0x7fbf40166b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 >> 172.21.15.81:0/3918246323 conn(0x7fbf4006cca0 msgr2=0x7fbf400699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.136+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 shutdown_connections 2023-10-06T02:46:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.137+0000 7fbf4495a700 1 -- 172.21.15.81:0/3918246323 wait complete. 2023-10-06T02:46:17.149 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T02:46:17.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.262+0000 7faa4a3c6700 1 Processor -- start 2023-10-06T02:46:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.262+0000 7faa4a3c6700 1 -- start start 2023-10-06T02:46:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa4a3c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 0x7faa440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa4a3c6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa440d07c0 con 0x7faa44157ca0 2023-10-06T02:46:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa4a3c6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa440cfbb0 con 0x7faa441578d0 2023-10-06T02:46:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa4a3c6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa440cfe90 con 0x7faa4406d830 2023-10-06T02:46:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa437fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faa44157ca0 0x7faa4406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58110/0 (socket says 172.21.15.81:58110) 2023-10-06T02:46:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa437fe700 1 -- 172.21.15.81:0/3716917516 learned_addr learned my addr 172.21.15.81:0/3716917516 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa48963700 1 --2- 172.21.15.81:0/3716917516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 0x7faa440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa42ffd700 1 -- 172.21.15.81:0/3716917516 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373317676 0 0) 0x7faa440d07c0 con 0x7faa44157ca0 2023-10-06T02:46:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa42ffd700 1 -- 172.21.15.81:0/3716917516 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa2c003570 con 0x7faa44157ca0 2023-10-06T02:46:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa48963700 1 -- 172.21.15.81:0/3716917516 >> v1:172.21.15.83:6789/0 conn(0x7faa441578d0 legacy=0x7faa4415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa42ffd700 1 -- 172.21.15.81:0/3716917516 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388221024 0 0) 0x7faa440cfbb0 con 0x7faa441578d0 2023-10-06T02:46:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa48963700 1 -- 172.21.15.81:0/3716917516 >> v1:172.21.15.81:6789/0 conn(0x7faa44157ca0 legacy=0x7faa4406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa48963700 1 -- 172.21.15.81:0/3716917516 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa440d0170 con 0x7faa4406d830 2023-10-06T02:46:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa48963700 1 --2- 172.21.15.81:0/3716917516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 0x7faa440cf4f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009e90 tx=0x7faa3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5a833d21564058 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa42ffd700 1 -- 172.21.15.81:0/3716917516 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00e070 con 0x7faa4406d830 2023-10-06T02:46:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa42ffd700 1 -- 172.21.15.81:0/3716917516 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c00bc30 con 0x7faa4406d830 2023-10-06T02:46:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.263+0000 7faa42ffd700 1 -- 172.21.15.81:0/3716917516 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c012430 con 0x7faa4406d830 2023-10-06T02:46:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.264+0000 7faa4a3c6700 1 -- 172.21.15.81:0/3716917516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 msgr2=0x7faa440cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.264+0000 7faa4a3c6700 1 --2- 172.21.15.81:0/3716917516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 0x7faa440cf4f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009e90 tx=0x7faa3c009780 comp rx=0 tx=0).stop 2023-10-06T02:46:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.264+0000 7faa4a3c6700 1 -- 172.21.15.81:0/3716917516 shutdown_connections 2023-10-06T02:46:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.264+0000 7faa4a3c6700 1 --2- 172.21.15.81:0/3716917516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 0x7faa440cf4f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.264+0000 7faa4a3c6700 1 -- 172.21.15.81:0/3716917516 >> 172.21.15.81:0/3716917516 conn(0x7faa4406bb90 msgr2=0x7faa4406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.264+0000 7faa4a3c6700 1 -- 172.21.15.81:0/3716917516 shutdown_connections 2023-10-06T02:46:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.264+0000 7faa4a3c6700 1 -- 172.21.15.81:0/3716917516 wait complete. 2023-10-06T02:46:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.265+0000 7faa4a3c6700 1 Processor -- start 2023-10-06T02:46:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.265+0000 7faa4a3c6700 1 -- start start 2023-10-06T02:46:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa4a3c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 0x7faa4415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa4a3c6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa441578d0 0x7faa441551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa4a3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44157ca0 0x7faa44155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa4a3c6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa44155c70 con 0x7faa44157ca0 2023-10-06T02:46:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa4a3c6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4416a580 con 0x7faa441578d0 2023-10-06T02:46:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa4a3c6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa440b6090 con 0x7faa4406d830 2023-10-06T02:46:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa48963700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44157ca0 0x7faa44155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa48963700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44157ca0 0x7faa44155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56768/0 (socket says 172.21.15.81:56768) 2023-10-06T02:46:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa48963700 1 -- 172.21.15.81:0/4257872974 learned_addr learned my addr 172.21.15.81:0/4257872974 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa437fe700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa441578d0 0x7faa441551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa43fff700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 0x7faa4415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa48963700 1 -- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 msgr2=0x7faa4415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa48963700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 0x7faa4415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.266+0000 7faa48963700 1 -- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa441578d0 msgr2=0x7faa441551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.267+0000 7faa48963700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa441578d0 0x7faa441551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.267+0000 7faa48963700 1 -- 172.21.15.81:0/4257872974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009a20 con 0x7faa44157ca0 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.267+0000 7faa48963700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44157ca0 0x7faa44155730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa4406fe20 tx=0x7faa3c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.267+0000 7faa2bfff700 1 -- 172.21.15.81:0/4257872974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c01b420 con 0x7faa44157ca0 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.267+0000 7faa2bfff700 1 -- 172.21.15.81:0/4257872974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c01b5a0 con 0x7faa44157ca0 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.267+0000 7faa2bfff700 1 -- 172.21.15.81:0/4257872974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c01b960 con 0x7faa44157ca0 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.267+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa440b6370 con 0x7faa44157ca0 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.267+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa440b6930 con 0x7faa44157ca0 2023-10-06T02:46:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.268+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa44067ac0 con 0x7faa44157ca0 2023-10-06T02:46:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.268+0000 7faa2bfff700 1 -- 172.21.15.81:0/4257872974 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa3c01bd10 con 0x7faa44157ca0 2023-10-06T02:46:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.269+0000 7faa2bfff700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa30066f30 0x7faa300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.269+0000 7faa2bfff700 1 -- 172.21.15.81:0/4257872974 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faa3c086480 con 0x7faa44157ca0 2023-10-06T02:46:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.269+0000 7faa43fff700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa30066f30 0x7faa300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.269+0000 7faa43fff700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa30066f30 0x7faa300693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa34003a90 tx=0x7faa34007ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.273+0000 7faa2bfff700 1 -- 172.21.15.81:0/4257872974 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa3c057020 con 0x7faa44157ca0 2023-10-06T02:46:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.454+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa440d0450 con 0x7faa44157ca0 2023-10-06T02:46:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.454+0000 7faa2bfff700 1 -- 172.21.15.81:0/4257872974 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7faa3c056bb0 con 0x7faa44157ca0 2023-10-06T02:46:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:17.456 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:17.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa30066f30 msgr2=0x7faa300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa30066f30 0x7faa300693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa34003a90 tx=0x7faa34007ce0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44157ca0 msgr2=0x7faa44155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44157ca0 0x7faa44155730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa4406fe20 tx=0x7faa3c019000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 shutdown_connections 2023-10-06T02:46:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44157ca0 0x7faa44155730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa4406d830 0x7faa4415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa30066f30 0x7faa300693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 --2- 172.21.15.81:0/4257872974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa441578d0 0x7faa441551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 >> 172.21.15.81:0/4257872974 conn(0x7faa4406bb90 msgr2=0x7faa4406a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 shutdown_connections 2023-10-06T02:46:17.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.456+0000 7faa4a3c6700 1 -- 172.21.15.81:0/4257872974 wait complete. 2023-10-06T02:46:17.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T02:46:17.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T02:46:17.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T02:46:17.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T02:46:17.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T02:46:17.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T02:46:17.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T02:46:17.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T02:46:17.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.666+0000 7f4093384700 1 Processor -- start 2023-10-06T02:46:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.666+0000 7f4093384700 1 -- start start 2023-10-06T02:46:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.668+0000 7f4093384700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f408c156d60 0x7f408c06b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.668+0000 7f4093384700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c06ac50 con 0x7f408c0c8880 2023-10-06T02:46:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.668+0000 7f4093384700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c0c8fd0 con 0x7f408c06ceb0 2023-10-06T02:46:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.668+0000 7f4093384700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c06a400 con 0x7f408c156d60 2023-10-06T02:46:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.668+0000 7f4091921700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f408c0c8880 0x7f408c157840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58114/0 (socket says 172.21.15.81:58114) 2023-10-06T02:46:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.668+0000 7f4091921700 1 -- 172.21.15.81:0/2506212386 learned_addr learned my addr 172.21.15.81:0/2506212386 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.669+0000 7f5f273ec700 1 Processor -- start 2023-10-06T02:46:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4091120700 1 --2- 172.21.15.81:0/2506212386 >> v2:172.21.15.81:3300/0 conn(0x7f408c156d60 0x7f408c06b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129227744 0 0) 0x7f408c06ac50 con 0x7f408c0c8880 2023-10-06T02:46:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4078003570 con 0x7f408c0c8880 2023-10-06T02:46:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 906669008 0 0) 0x7f4078003570 con 0x7f408c0c8880 2023-10-06T02:46:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 >> v2:172.21.15.81:3300/0 conn(0x7f408c156d60 msgr2=0x7f408c06b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 --2- 172.21.15.81:0/2506212386 >> v2:172.21.15.81:3300/0 conn(0x7f408c156d60 0x7f408c06b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 >> v1:172.21.15.83:6789/0 conn(0x7f408c06ceb0 legacy=0x7f408c157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0c8cf0 con 0x7f408c0c8880 2023-10-06T02:46:17.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f40840017f0 con 0x7f408c0c8880 2023-10-06T02:46:17.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 >> v1:172.21.15.81:6789/0 conn(0x7f408c0c8880 legacy=0x7f408c157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 --2- 172.21.15.81:0/2506212386 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4078003a60 0x7f4078003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 --2- 172.21.15.81:0/2506212386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078004810 0x7f4078004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 --2- 172.21.15.81:0/2506212386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 0x7f4078007a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c06a400 con 0x7f4078004810 2023-10-06T02:46:17.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40780080e0 con 0x7f4078005210 2023-10-06T02:46:17.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40780082a0 con 0x7f4078003a60 2023-10-06T02:46:17.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f4091921700 1 --2- 172.21.15.81:0/2506212386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 0x7f4078007a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.670+0000 7f5f273ec700 1 -- start start 2023-10-06T02:46:17.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f5f273ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 0x7f5f200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f5f273ec700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5f2006d120 0x7f5f2006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f5f273ec700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2006dac0 con 0x7f5f201578d0 2023-10-06T02:46:17.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f5f273ec700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f200d07c0 con 0x7f5f2006d120 2023-10-06T02:46:17.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f5f273ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f200cfbb0 con 0x7f5f20157ca0 2023-10-06T02:46:17.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f6ee7160700 1 Processor -- start 2023-10-06T02:46:17.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f6ee7160700 1 -- start start 2023-10-06T02:46:17.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f4091921700 1 -- 172.21.15.81:0/2506212386 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4078003a60 msgr2=0x7f4078003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:17.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f4091921700 1 --2- 172.21.15.81:0/2506212386 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4078003a60 0x7f4078003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f4091921700 1 -- 172.21.15.81:0/2506212386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078004810 msgr2=0x7f4078004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:17.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f4091921700 1 --2- 172.21.15.81:0/2506212386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078004810 0x7f4078004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f4091921700 1 -- 172.21.15.81:0/2506212386 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0c8cf0 con 0x7f4078005210 2023-10-06T02:46:17.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f4091921700 1 -- 172.21.15.81:0/2506212386 reap_dead start 2023-10-06T02:46:17.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f5f24987700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 0x7f5f200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f5f25989700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5f2006d120 0x7f5f2006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f5f25989700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5f2006d120 0x7f5f2006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38866/0 (socket says 172.21.15.81:38866) 2023-10-06T02:46:17.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f5f25989700 1 -- 172.21.15.81:0/1733400945 learned_addr learned my addr 172.21.15.81:0/1733400945 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.671+0000 7f4091120700 1 --2- 172.21.15.81:0/2506212386 >> v2:172.21.15.81:3300/0 conn(0x7f408c156d60 0x7f408c06b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:17.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f5f24987700 1 -- 172.21.15.81:0/1733400945 >> v2:172.21.15.83:3300/0 conn(0x7f5f2006d120 msgr2=0x7f5f2006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f5f24987700 1 --2- 172.21.15.81:0/1733400945 >> v2:172.21.15.83:3300/0 conn(0x7f5f2006d120 0x7f5f2006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f5f24987700 1 -- 172.21.15.81:0/1733400945 >> v1:172.21.15.83:6789/0 conn(0x7f5f201578d0 legacy=0x7f5f2015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f5f24987700 1 -- 172.21.15.81:0/1733400945 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f200cfe90 con 0x7f5f20157ca0 2023-10-06T02:46:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f4091921700 1 --2- 172.21.15.81:0/2506212386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 0x7f4078007a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f408400aa90 tx=0x7f408400a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d25b27d373d78a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400a400 con 0x7f4078005210 2023-10-06T02:46:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408400c5d0 con 0x7f4078005210 2023-10-06T02:46:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f4083fff700 1 -- 172.21.15.81:0/2506212386 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400c990 con 0x7f4078005210 2023-10-06T02:46:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f6ee7160700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 0x7f6ee006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f6ee7160700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ee006e770 0x7f6ee00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f6ee7160700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee00b2290 con 0x7f6ee01569e0 2023-10-06T02:46:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.672+0000 7f6ee7160700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee006ebf0 con 0x7f6ee006e770 2023-10-06T02:46:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f6ee7160700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0157c00 con 0x7f6ee0156db0 2023-10-06T02:46:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f5f24987700 1 --2- 172.21.15.81:0/1733400945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 0x7f5f200cf4f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0098e0 tx=0x7f5f1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bc4fa02d2e2fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f6ee4efc700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6ee01569e0 0x7f6ee00b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55310/0 (socket says 172.21.15.81:55310) 2023-10-06T02:46:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f6ee4efc700 1 -- 172.21.15.81:0/1856429800 learned_addr learned my addr 172.21.15.81:0/1856429800 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:17.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f6edffff700 1 --2- 172.21.15.81:0/1856429800 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 0x7f6ee006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7fdac3d1e700 1 Processor -- start 2023-10-06T02:46:17.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7fe3900c8700 1 Processor -- start 2023-10-06T02:46:17.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f6ee56fd700 1 --2- 172.21.15.81:0/1856429800 >> v2:172.21.15.81:3300/0 conn(0x7f6ee006e770 0x7f6ee00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f5f13fff700 1 -- 172.21.15.81:0/1733400945 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c009e80 con 0x7f5f20157ca0 2023-10-06T02:46:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7fdac3d1e700 1 -- start start 2023-10-06T02:46:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7fe3900c8700 1 -- start start 2023-10-06T02:46:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f4093384700 1 -- 172.21.15.81:0/2506212386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 msgr2=0x7f4078007a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f4093384700 1 --2- 172.21.15.81:0/2506212386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 0x7f4078007a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f408400aa90 tx=0x7f408400a0f0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f5f13fff700 1 -- 172.21.15.81:0/1733400945 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c00b860 con 0x7f5f20157ca0 2023-10-06T02:46:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.673+0000 7f5f13fff700 1 -- 172.21.15.81:0/1733400945 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00bc20 con 0x7f5f20157ca0 2023-10-06T02:46:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f6edffff700 1 -- 172.21.15.81:0/1856429800 >> v2:172.21.15.81:3300/0 conn(0x7f6ee006e770 msgr2=0x7f6ee00cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f6edffff700 1 --2- 172.21.15.81:0/1856429800 >> v2:172.21.15.81:3300/0 conn(0x7f6ee006e770 0x7f6ee00cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f6edffff700 1 -- 172.21.15.81:0/1856429800 >> v1:172.21.15.83:6789/0 conn(0x7f6ee01569e0 legacy=0x7f6ee00b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f6edffff700 1 -- 172.21.15.81:0/1856429800 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee01572d0 con 0x7f6ee0156db0 2023-10-06T02:46:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f4093384700 1 -- 172.21.15.81:0/2506212386 shutdown_connections 2023-10-06T02:46:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f4093384700 1 --2- 172.21.15.81:0/2506212386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 0x7f4078007a40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f4093384700 1 -- 172.21.15.81:0/2506212386 >> 172.21.15.81:0/2506212386 conn(0x7f408c0c9ca0 msgr2=0x7f408c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f5f273ec700 1 -- 172.21.15.81:0/1733400945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 msgr2=0x7f5f200cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f5f273ec700 1 --2- 172.21.15.81:0/1733400945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 0x7f5f200cf4f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0098e0 tx=0x7f5f1c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f6edffff700 1 --2- 172.21.15.81:0/1856429800 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 0x7f6ee006e230 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009e60 tx=0x7f6ed8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e05aa9593ee71cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f5f273ec700 1 -- 172.21.15.81:0/1733400945 shutdown_connections 2023-10-06T02:46:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f5f273ec700 1 --2- 172.21.15.81:0/1733400945 >> v2:172.21.15.83:3300/0 conn(0x7f5f2006d120 0x7f5f2006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f5f273ec700 1 --2- 172.21.15.81:0/1733400945 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 0x7f5f200cf4f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f5f273ec700 1 -- 172.21.15.81:0/1733400945 >> 172.21.15.81:0/1733400945 conn(0x7f5f2006bb90 msgr2=0x7f5f2006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f6edf7fe700 1 -- 172.21.15.81:0/1856429800 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800e070 con 0x7f6ee0156db0 2023-10-06T02:46:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7f6edf7fe700 1 -- 172.21.15.81:0/1856429800 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed800bb20 con 0x7f6ee0156db0 2023-10-06T02:46:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fdac3d1e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdabc15e600 0x7fdabc0c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fdac3d1e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc0cc620 0x7fdabc0cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fdac3d1e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc0ccfc0 con 0x7fdabc15e230 2023-10-06T02:46:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fdac3d1e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc06c520 con 0x7fdabc15e600 2023-10-06T02:46:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fdac3d1e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc06bc30 con 0x7fdabc0cc620 2023-10-06T02:46:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7f4093384700 1 -- 172.21.15.81:0/2506212386 shutdown_connections 2023-10-06T02:46:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fe3900c8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880aedc0 0x7fe3880c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fe3900c8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3880af190 0x7fe388068980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fe3900c8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3880c9120 con 0x7fe3880c2870 2023-10-06T02:46:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fe3900c8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38815e840 con 0x7fe3880af190 2023-10-06T02:46:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.674+0000 7fe3900c8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3880c7620 con 0x7fe3880aedc0 2023-10-06T02:46:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7f4093384700 1 -- 172.21.15.81:0/2506212386 wait complete. 2023-10-06T02:46:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fdac1aba700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fdabc15e230 0x7fdabc069120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55314/0 (socket says 172.21.15.81:55314) 2023-10-06T02:46:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fdac22bb700 1 --2- 172.21.15.81:0/3847713386 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc0cc620 0x7fdabc0cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fdac1aba700 1 -- 172.21.15.81:0/3847713386 learned_addr learned my addr 172.21.15.81:0/3847713386 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fe38de64700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880aedc0 0x7fe3880c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fe38e665700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe3880c2870 0x7fe3880c2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58130/0 (socket says 172.21.15.81:58130) 2023-10-06T02:46:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fe38e665700 1 -- 172.21.15.81:0/1636691313 learned_addr learned my addr 172.21.15.81:0/1636691313 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fdac22bb700 1 -- 172.21.15.81:0/3847713386 >> v2:172.21.15.83:3300/0 conn(0x7fdabc15e600 msgr2=0x7fdabc0c9360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:46:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fdac22bb700 1 --2- 172.21.15.81:0/3847713386 >> v2:172.21.15.83:3300/0 conn(0x7fdabc15e600 0x7fdabc0c9360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fdac22bb700 1 -- 172.21.15.81:0/3847713386 >> v1:172.21.15.83:6789/0 conn(0x7fdabc15e230 legacy=0x7fdabc069120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fdac22bb700 1 -- 172.21.15.81:0/3847713386 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc06bed0 con 0x7fdabc0cc620 2023-10-06T02:46:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fe38de64700 1 -- 172.21.15.81:0/1636691313 >> v2:172.21.15.83:3300/0 conn(0x7fe3880af190 msgr2=0x7fe388068980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:46:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fe38de64700 1 --2- 172.21.15.81:0/1636691313 >> v2:172.21.15.83:3300/0 conn(0x7fe3880af190 0x7fe388068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fe38de64700 1 -- 172.21.15.81:0/1636691313 >> v1:172.21.15.81:6789/0 conn(0x7fe3880c2870 legacy=0x7fe3880c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fe38de64700 1 -- 172.21.15.81:0/1636691313 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3880c23e0 con 0x7fe3880aedc0 2023-10-06T02:46:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fdac22bb700 1 --2- 172.21.15.81:0/3847713386 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc0cc620 0x7fdabc0cca80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009e60 tx=0x7fdab4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=693eb7c98430fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fe38de64700 1 --2- 172.21.15.81:0/1636691313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880aedc0 0x7fe3880c8b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe378009910 tx=0x7fe3780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a846c13dd9590e13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7f6edf7fe700 1 -- 172.21.15.81:0/1856429800 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8012430 con 0x7f6ee0156db0 2023-10-06T02:46:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7f6ee7160700 1 -- 172.21.15.81:0/1856429800 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 msgr2=0x7f6ee006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7f6ee7160700 1 --2- 172.21.15.81:0/1856429800 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 0x7f6ee006e230 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009e60 tx=0x7f6ed8009780 comp rx=0 tx=0).stop 2023-10-06T02:46:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.675+0000 7fdac0ab8700 1 -- 172.21.15.81:0/3847713386 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400e070 con 0x7fdabc0cc620 2023-10-06T02:46:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7fdac0ab8700 1 -- 172.21.15.81:0/3847713386 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab400bbf0 con 0x7fdabc0cc620 2023-10-06T02:46:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7fdac0ab8700 1 -- 172.21.15.81:0/3847713386 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4012430 con 0x7fdabc0cc620 2023-10-06T02:46:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7f5f273ec700 1 -- 172.21.15.81:0/1733400945 shutdown_connections 2023-10-06T02:46:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7f5f273ec700 1 -- 172.21.15.81:0/1733400945 wait complete. 2023-10-06T02:46:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7f4093384700 1 Processor -- start 2023-10-06T02:46:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7f4093384700 1 -- start start 2023-10-06T02:46:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7fdac3d1e700 1 -- 172.21.15.81:0/3847713386 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc0cc620 msgr2=0x7fdabc0cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7fdac3d1e700 1 --2- 172.21.15.81:0/3847713386 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc0cc620 0x7fdabc0cca80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009e60 tx=0x7fdab4009780 comp rx=0 tx=0).stop 2023-10-06T02:46:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7fdac3d1e700 1 -- 172.21.15.81:0/3847713386 shutdown_connections 2023-10-06T02:46:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7fdac3d1e700 1 --2- 172.21.15.81:0/3847713386 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc0cc620 0x7fdabc0cca80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7fdac3d1e700 1 --2- 172.21.15.81:0/3847713386 >> v2:172.21.15.83:3300/0 conn(0x7fdabc15e600 0x7fdabc0c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7fdac3d1e700 1 -- 172.21.15.81:0/3847713386 >> 172.21.15.81:0/3847713386 conn(0x7fdabc0c9ca0 msgr2=0x7fdabc0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7fe38ce62700 1 -- 172.21.15.81:0/1636691313 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378009eb0 con 0x7fe3880aedc0 2023-10-06T02:46:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7fe38ce62700 1 -- 172.21.15.81:0/1636691313 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800b760 con 0x7fe3880aedc0 2023-10-06T02:46:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.676+0000 7fe38ce62700 1 -- 172.21.15.81:0/1636691313 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800bb40 con 0x7fe3880aedc0 2023-10-06T02:46:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7f6ee7160700 1 -- 172.21.15.81:0/1856429800 shutdown_connections 2023-10-06T02:46:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7f6ee7160700 1 --2- 172.21.15.81:0/1856429800 >> v2:172.21.15.81:3300/0 conn(0x7f6ee006e770 0x7f6ee00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7f6ee7160700 1 --2- 172.21.15.81:0/1856429800 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 0x7f6ee006e230 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7f6ee7160700 1 -- 172.21.15.81:0/1856429800 >> 172.21.15.81:0/1856429800 conn(0x7f6ee006cca0 msgr2=0x7f6ee006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7f6ee7160700 1 -- 172.21.15.81:0/1856429800 shutdown_connections 2023-10-06T02:46:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7f1edd6b4700 1 Processor -- start 2023-10-06T02:46:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7f6ee7160700 1 -- 172.21.15.81:0/1856429800 wait complete. 2023-10-06T02:46:17.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7fe3900c8700 1 -- 172.21.15.81:0/1636691313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880aedc0 msgr2=0x7fe3880c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7fe3900c8700 1 --2- 172.21.15.81:0/1636691313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880aedc0 0x7fe3880c8b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe378009910 tx=0x7fe3780091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7fe3900c8700 1 -- 172.21.15.81:0/1636691313 shutdown_connections 2023-10-06T02:46:17.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7fe3900c8700 1 --2- 172.21.15.81:0/1636691313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880aedc0 0x7fe3880c8b20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7fe3900c8700 1 --2- 172.21.15.81:0/1636691313 >> v2:172.21.15.83:3300/0 conn(0x7fe3880af190 0x7fe388068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7fe3900c8700 1 -- 172.21.15.81:0/1636691313 >> 172.21.15.81:0/1636691313 conn(0x7fe38806c660 msgr2=0x7fe3880cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4093384700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 0x7f408c0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4093384700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f408c15c420 0x7f408c1661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4093384700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f408c15b180 0x7f408c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4093384700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c167220 con 0x7f408c15b180 2023-10-06T02:46:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4093384700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0c4510 con 0x7f4078005210 2023-10-06T02:46:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4093384700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c166710 con 0x7f408c15c420 2023-10-06T02:46:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f5f273ec700 1 Processor -- start 2023-10-06T02:46:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f5f273ec700 1 -- start start 2023-10-06T02:46:17.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7fdac3d1e700 1 -- 172.21.15.81:0/3847713386 shutdown_connections 2023-10-06T02:46:17.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7fe3900c8700 1 -- 172.21.15.81:0/1636691313 shutdown_connections 2023-10-06T02:46:17.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.677+0000 7f1edd6b4700 1 -- start start 2023-10-06T02:46:17.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1edd6b4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e170 0x7f1ed80b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1edd6b4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ed815e540 0x7f1ed806d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1edd6b4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ed80cfdd0 0x7f1ed806d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1edd6b4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed80cf940 con 0x7f1ed80cfdd0 2023-10-06T02:46:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1edd6b4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed80cf010 con 0x7f1ed815e540 2023-10-06T02:46:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1edd6b4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80cf2f0 con 0x7f1ed815e170 2023-10-06T02:46:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1ed67fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ed815e540 0x7f1ed806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1ed67fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ed815e540 0x7f1ed806d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38904/0 (socket says 172.21.15.81:38904) 2023-10-06T02:46:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1ed67fc700 1 -- 172.21.15.81:0/2825252493 learned_addr learned my addr 172.21.15.81:0/2825252493 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f409091f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f408c15c420 0x7f408c1661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f6ee7160700 1 Processor -- start 2023-10-06T02:46:17.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f1ed6ffd700 1 --2- 172.21.15.81:0/2825252493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e170 0x7f1ed80b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4091921700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f408c15b180 0x7f408c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4091921700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f408c15b180 0x7f408c15b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56806/0 (socket says 172.21.15.81:56806) 2023-10-06T02:46:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4091921700 1 -- 172.21.15.81:0/693696988 learned_addr learned my addr 172.21.15.81:0/693696988 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7f4091120700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 0x7f408c0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f1ed77fe700 1 --2- 172.21.15.81:0/2825252493 >> v2:172.21.15.81:3300/0 conn(0x7f1ed80cfdd0 0x7f1ed806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f1ed6ffd700 1 -- 172.21.15.81:0/2825252493 >> v2:172.21.15.83:3300/0 conn(0x7f1ed815e540 msgr2=0x7f1ed806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f1ed6ffd700 1 --2- 172.21.15.81:0/2825252493 >> v2:172.21.15.83:3300/0 conn(0x7f1ed815e540 0x7f1ed806d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f1ed6ffd700 1 -- 172.21.15.81:0/2825252493 >> v2:172.21.15.81:3300/0 conn(0x7f1ed80cfdd0 msgr2=0x7f1ed806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f1ed6ffd700 1 --2- 172.21.15.81:0/2825252493 >> v2:172.21.15.81:3300/0 conn(0x7f1ed80cfdd0 0x7f1ed806d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f1ed6ffd700 1 -- 172.21.15.81:0/2825252493 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80cf5d0 con 0x7f1ed815e170 2023-10-06T02:46:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f1ed6ffd700 1 --2- 172.21.15.81:0/2825252493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e170 0x7f1ed80b30a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806cb70 tx=0x7f1ecc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e46add3fb61f2f4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f4091921700 1 -- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f408c15c420 msgr2=0x7f408c1661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f4091921700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f408c15c420 0x7f408c1661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f4091921700 1 -- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 msgr2=0x7f408c0c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f4091921700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4078005210 0x7f408c0c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f4091921700 1 -- 172.21.15.81:0/693696988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c166980 con 0x7f408c15b180 2023-10-06T02:46:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f4091921700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f408c15b180 0x7f408c15b5f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f408c06abc0 tx=0x7f4084016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7fe3900c8700 1 -- 172.21.15.81:0/1636691313 wait complete. 2023-10-06T02:46:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.678+0000 7fdac3d1e700 1 -- 172.21.15.81:0/3847713386 wait complete. 2023-10-06T02:46:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7fdac3d1e700 1 Processor -- start 2023-10-06T02:46:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7fdac3d1e700 1 -- start start 2023-10-06T02:46:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7fe3900c8700 1 Processor -- start 2023-10-06T02:46:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f273ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f2006d120 0x7f5f20151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f273ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 0x7f5f20150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f273ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2016a370 0x7f5f2015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f273ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20151160 con 0x7f5f2016a370 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f273ec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f200b6380 con 0x7f5f2006d120 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f273ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f201520f0 con 0x7f5f20157ca0 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f25188700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f2006d120 0x7f5f20151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f24987700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 0x7f5f20150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f25188700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f2006d120 0x7f5f20151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38906/0 (socket says 172.21.15.81:38906) 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f5f25188700 1 -- 172.21.15.81:0/1684260148 learned_addr learned my addr 172.21.15.81:0/1684260148 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f25188700 1 -- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 msgr2=0x7f5f20150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f25188700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f20157ca0 0x7f5f20150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f25188700 1 -- 172.21.15.81:0/1684260148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2016a370 msgr2=0x7f5f2015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.679+0000 7f6ee7160700 1 -- start start 2023-10-06T02:46:17.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f25188700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2016a370 0x7f5f2015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f25188700 1 -- 172.21.15.81:0/1684260148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c009420 con 0x7f5f2006d120 2023-10-06T02:46:17.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f25188700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f2006d120 0x7f5f20151b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f1401d5a0 tx=0x7f5f14007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee7160700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ee006e770 0x7f6ee00a6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee7160700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee01569e0 0x7f6ee00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee7160700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 0x7f6ee014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee7160700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00afc80 con 0x7f6ee01569e0 2023-10-06T02:46:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee7160700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00aedd0 con 0x7f6ee006e770 2023-10-06T02:46:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee7160700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00af070 con 0x7f6ee0156db0 2023-10-06T02:46:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee56fd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 0x7f6ee014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee4efc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ee006e770 0x7f6ee00a6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee56fd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 0x7f6ee014b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:49026/0 (socket says 172.21.15.81:49026) 2023-10-06T02:46:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee56fd700 1 -- 172.21.15.81:0/3924271391 learned_addr learned my addr 172.21.15.81:0/3924271391 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6edffff700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee01569e0 0x7f6ee00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7fe3900c8700 1 -- start start 2023-10-06T02:46:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f1ed5ffb700 1 -- 172.21.15.81:0/2825252493 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc011630 con 0x7f1ed815e170 2023-10-06T02:46:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee4efc700 1 -- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 msgr2=0x7f6ee014b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee4efc700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ee0156db0 0x7f6ee014b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee4efc700 1 -- 172.21.15.81:0/3924271391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee01569e0 msgr2=0x7f6ee00ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee4efc700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee01569e0 0x7f6ee00ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f6ee4efc700 1 -- 172.21.15.81:0/3924271391 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8009a20 con 0x7f6ee006e770 2023-10-06T02:46:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f1ed5ffb700 1 -- 172.21.15.81:0/2825252493 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc0117b0 con 0x7f1ed815e170 2023-10-06T02:46:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f1ed5ffb700 1 -- 172.21.15.81:0/2825252493 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc011b70 con 0x7f1ed815e170 2023-10-06T02:46:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7f1edd6b4700 1 -- 172.21.15.81:0/2825252493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e170 msgr2=0x7f1ed80b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7f1edd6b4700 1 --2- 172.21.15.81:0/2825252493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e170 0x7f1ed80b30a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806cb70 tx=0x7f1ecc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f117fa700 1 -- 172.21.15.81:0/1684260148 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f140225a0 con 0x7f5f2006d120 2023-10-06T02:46:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f117fa700 1 -- 172.21.15.81:0/1684260148 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f14022720 con 0x7f5f2006d120 2023-10-06T02:46:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f201523d0 con 0x7f5f2006d120 2023-10-06T02:46:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.680+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f20152990 con 0x7f5f2006d120 2023-10-06T02:46:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7f5f117fa700 1 -- 172.21.15.81:0/1684260148 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14022ae0 con 0x7f5f2006d120 2023-10-06T02:46:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f20067ac0 con 0x7f5f2006d120 2023-10-06T02:46:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac3d1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdabc0cc620 0x7fdabc163230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac3d1e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc15e230 0x7fdabc1769e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac3d1e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdabc15e600 0x7fdabc1609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac3d1e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc15e9d0 con 0x7fdabc15e600 2023-10-06T02:46:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac3d1e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0c5620 con 0x7fdabc0cc620 2023-10-06T02:46:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac3d1e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc163770 con 0x7fdabc15e230 2023-10-06T02:46:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac1aba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdabc0cc620 0x7fdabc163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac1aba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdabc0cc620 0x7fdabc163230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38928/0 (socket says 172.21.15.81:38928) 2023-10-06T02:46:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac1aba700 1 -- 172.21.15.81:0/3169377250 learned_addr learned my addr 172.21.15.81:0/3169377250 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe3900c8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3880aedc0 0x7fe3881608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe3900c8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880af190 0x7fe38815be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe3900c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3880c2870 0x7fe38815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe3900c8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38815c8f0 con 0x7fe3880c2870 2023-10-06T02:46:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe3900c8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3880c52c0 con 0x7fe3880aedc0 2023-10-06T02:46:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe3900c8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3880c46b0 con 0x7fe3880af190 2023-10-06T02:46:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38e665700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3880c2870 0x7fe38815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38e665700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3880c2870 0x7fe38815c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56830/0 (socket says 172.21.15.81:56830) 2023-10-06T02:46:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38e665700 1 -- 172.21.15.81:0/2871451404 learned_addr learned my addr 172.21.15.81:0/2871451404 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38d663700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880af190 0x7fe38815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7f1edd6b4700 1 -- 172.21.15.81:0/2825252493 shutdown_connections 2023-10-06T02:46:17.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7f1edd6b4700 1 --2- 172.21.15.81:0/2825252493 >> v2:172.21.15.81:3300/0 conn(0x7f1ed80cfdd0 0x7f1ed806d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7f1edd6b4700 1 --2- 172.21.15.81:0/2825252493 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e170 0x7f1ed80b30a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7f1edd6b4700 1 --2- 172.21.15.81:0/2825252493 >> v2:172.21.15.83:3300/0 conn(0x7f1ed815e540 0x7f1ed806d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7f1edd6b4700 1 -- 172.21.15.81:0/2825252493 >> 172.21.15.81:0/2825252493 conn(0x7f1ed806bb90 msgr2=0x7f1ed806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac12b9700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc15e230 0x7fdabc1769e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38e665700 1 -- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880af190 msgr2=0x7fe38815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38e665700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3880af190 0x7fe38815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38e665700 1 -- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3880aedc0 msgr2=0x7fe3881608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38de64700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3880aedc0 0x7fe3881608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fdac22bb700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdabc15e600 0x7fdabc1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38e665700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3880aedc0 0x7fe3881608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38e665700 1 -- 172.21.15.81:0/2871451404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009420 con 0x7fe3880c2870 2023-10-06T02:46:17.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.681+0000 7fe38de64700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3880aedc0 0x7fe3881608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:17.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7fe38e665700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3880c2870 0x7fe38815c3b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe38000cd80 tx=0x7fe380001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7fdac22bb700 1 -- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc15e230 msgr2=0x7fdabc1769e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7fdac22bb700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc15e230 0x7fdabc1769e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7fdac22bb700 1 -- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdabc0cc620 msgr2=0x7fdabc163230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7fdac22bb700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdabc0cc620 0x7fdabc163230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7fdac22bb700 1 -- 172.21.15.81:0/3169377250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4009a20 con 0x7fdabc15e600 2023-10-06T02:46:17.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7fdac12b9700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdabc15e230 0x7fdabc1769e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:17.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7f6ee4efc700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ee006e770 0x7f6ee00a6640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000c530 tx=0x7f6ed0007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7f1edd6b4700 1 -- 172.21.15.81:0/2825252493 shutdown_connections 2023-10-06T02:46:17.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7f1edd6b4700 1 -- 172.21.15.81:0/2825252493 wait complete. 2023-10-06T02:46:17.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7fdac22bb700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdabc15e600 0x7fdabc1609b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdab4015000 tx=0x7fdab4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7f6edcff9700 1 -- 172.21.15.81:0/3924271391 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0005b30 con 0x7f6ee006e770 2023-10-06T02:46:17.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7f6edcff9700 1 -- 172.21.15.81:0/3924271391 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0005cb0 con 0x7f6ee006e770 2023-10-06T02:46:17.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee00af350 con 0x7f6ee006e770 2023-10-06T02:46:17.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7f6edcff9700 1 -- 172.21.15.81:0/3924271391 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0007320 con 0x7f6ee006e770 2023-10-06T02:46:17.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.682+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee00af910 con 0x7f6ee006e770 2023-10-06T02:46:17.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f5f117fa700 1 -- 172.21.15.81:0/1684260148 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f1402d440 con 0x7f5f2006d120 2023-10-06T02:46:17.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f5f117fa700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f04066f30 0x7f5f040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ee0068900 con 0x7f6ee006e770 2023-10-06T02:46:17.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f5f117fa700 1 -- 172.21.15.81:0/1684260148 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f14094ee0 con 0x7f5f2006d120 2023-10-06T02:46:17.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7fdab1ffb700 1 -- 172.21.15.81:0/3169377250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab401e640 con 0x7fdabc15e600 2023-10-06T02:46:17.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7fdab1ffb700 1 -- 172.21.15.81:0/3169377250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab401e7c0 con 0x7fdabc15e600 2023-10-06T02:46:17.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7fdab1ffb700 1 -- 172.21.15.81:0/3169377250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab401eb80 con 0x7fdabc15e600 2023-10-06T02:46:17.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7fa24ed49700 1 Processor -- start 2023-10-06T02:46:17.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7fdac3d1e700 1 -- 172.21.15.81:0/3169377250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc1772a0 con 0x7fdabc15e600 2023-10-06T02:46:17.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f1edd6b4700 1 Processor -- start 2023-10-06T02:46:17.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f40817fa700 1 -- 172.21.15.81:0/693696988 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400a400 con 0x7f408c15b180 2023-10-06T02:46:17.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f1edd6b4700 1 -- start start 2023-10-06T02:46:17.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f40817fa700 1 -- 172.21.15.81:0/693696988 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40840017b0 con 0x7f408c15b180 2023-10-06T02:46:17.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f40817fa700 1 -- 172.21.15.81:0/693696988 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840020b0 con 0x7f408c15b180 2023-10-06T02:46:17.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f4093384700 1 -- 172.21.15.81:0/693696988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c166c60 con 0x7f408c15b180 2023-10-06T02:46:17.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.684+0000 7fdac3d1e700 1 -- 172.21.15.81:0/3169377250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc177860 con 0x7fdabc15e600 2023-10-06T02:46:17.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.684+0000 7f6edcff9700 1 -- 172.21.15.81:0/3924271391 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ed001b3b0 con 0x7f6ee006e770 2023-10-06T02:46:17.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.684+0000 7f6edcff9700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ecc066f30 0x7f6ecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.684+0000 7f6edcff9700 1 -- 172.21.15.81:0/3924271391 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ed0083ac0 con 0x7f6ee006e770 2023-10-06T02:46:17.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f6edcff9700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f6ecc06f760 0x7f6ecc071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f6edcff9700 1 -- 172.21.15.81:0/3924271391 --> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ecc072220 con 0x7f6ecc06f760 2023-10-06T02:46:17.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f6edcff9700 1 -- 172.21.15.81:0/3924271391 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ed0004ae0 con 0x7f6ee006e770 2023-10-06T02:46:17.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f6edffff700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ecc066f30 0x7f6ecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f6edffff700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ecc066f30 0x7f6ecc0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0157200 tx=0x7f6ed8018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f5f117fa700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7f5f0406f7e0 0x7f5f04071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f5f117fa700 1 -- 172.21.15.81:0/1684260148 --> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f040722a0 con 0x7f5f0406f7e0 2023-10-06T02:46:17.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.683+0000 7f5f117fa700 1 -- 172.21.15.81:0/1684260148 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f14095290 con 0x7f5f2006d120 2023-10-06T02:46:17.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.684+0000 7f5f25989700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7f5f0406f7e0 0x7f5f04071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f5f25989700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7f5f0406f7e0 0x7f5f04071bf0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7f5f117fa700 1 -- 172.21.15.81:0/1684260148 <== osd.1 v2:172.21.15.81:6817/86109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5f040722a0 con 0x7f5f0406f7e0 2023-10-06T02:46:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7fdaa77fe700 1 -- 172.21.15.81:0/3169377250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda9c000fd0 con 0x7fdabc15e600 2023-10-06T02:46:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7fdab1ffb700 1 -- 172.21.15.81:0/3169377250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdab4024070 con 0x7fdabc15e600 2023-10-06T02:46:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.684+0000 7f4093384700 1 -- 172.21.15.81:0/693696988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c0c49a0 con 0x7f408c15b180 2023-10-06T02:46:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.684+0000 7f4076ffd700 1 -- 172.21.15.81:0/693696988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4064000fd0 con 0x7f408c15b180 2023-10-06T02:46:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7f40817fa700 1 -- 172.21.15.81:0/693696988 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f408401eaa0 con 0x7f408c15b180 2023-10-06T02:46:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7f40817fa700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4070067080 0x7f4070069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7f40817fa700 1 -- 172.21.15.81:0/693696988 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4084087290 con 0x7f408c15b180 2023-10-06T02:46:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7f4091120700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4070067080 0x7f4070069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7f40817fa700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f407006f930 0x7f4070071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7f40817fa700 1 -- 172.21.15.81:0/693696988 --> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40700723f0 con 0x7f407006f930 2023-10-06T02:46:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7f40817fa700 1 -- 172.21.15.81:0/693696988 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4084089830 con 0x7f408c15b180 2023-10-06T02:46:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7f409091f700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f407006f930 0x7f4070071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7fe37dffb700 1 -- 172.21.15.81:0/2871451404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000ab30 con 0x7fe3880c2870 2023-10-06T02:46:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7fe37dffb700 1 -- 172.21.15.81:0/2871451404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38000ac90 con 0x7fe3880c2870 2023-10-06T02:46:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7fe37dffb700 1 -- 172.21.15.81:0/2871451404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380007340 con 0x7fe3880c2870 2023-10-06T02:46:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3880c4990 con 0x7fe3880c2870 2023-10-06T02:46:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3880c4f50 con 0x7fe3880c2870 2023-10-06T02:46:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe368000fd0 con 0x7fe3880c2870 2023-10-06T02:46:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7fa24ed49700 1 -- start start 2023-10-06T02:46:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7fa24ed49700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2481578d0 0x7fa2480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7fa24ed49700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa24806d120 0x7fa24806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7fa24ed49700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2480d07c0 con 0x7fa248157ca0 2023-10-06T02:46:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7fa24ed49700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24806daa0 con 0x7fa2481578d0 2023-10-06T02:46:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7fa24ed49700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480cfbb0 con 0x7fa24806d120 2023-10-06T02:46:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7fa247fff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fa248157ca0 0x7fa24815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55320/0 (socket says 172.21.15.81:55320) 2023-10-06T02:46:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7fa247fff700 1 -- 172.21.15.81:0/1714730799 learned_addr learned my addr 172.21.15.81:0/1714730799 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7fa24d2e6700 1 --2- 172.21.15.81:0/1714730799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa24806d120 0x7fa24806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1edd6b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed80cfdd0 0x7f1ed80b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1edd6b4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed815e170 0x7f1ed81484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1edd6b4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e540 0x7f1ed81489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1edd6b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed815f200 con 0x7f1ed80cfdd0 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1edd6b4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed815e910 con 0x7f1ed815e170 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1edd6b4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed815f690 con 0x7f1ed815e540 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e540 0x7f1ed81489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed67fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed815e170 0x7f1ed81484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed67fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed815e170 0x7f1ed81484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38940/0 (socket says 172.21.15.81:38940) 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed67fc700 1 -- 172.21.15.81:0/1494531371 learned_addr learned my addr 172.21.15.81:0/1494531371 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed67fc700 1 -- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e540 msgr2=0x7f1ed81489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed67fc700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e540 0x7f1ed81489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed67fc700 1 -- 172.21.15.81:0/1494531371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed80cfdd0 msgr2=0x7f1ed80b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed67fc700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed80cfdd0 0x7f1ed80b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed67fc700 1 -- 172.21.15.81:0/1494531371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc009420 con 0x7f1ed815e170 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.685+0000 7f1ed77fe700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ed815e540 0x7f1ed81489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7f1ed67fc700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed815e170 0x7f1ed81484a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800e980 tx=0x7f1ec8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7f1ebeffd700 1 -- 172.21.15.81:0/1494531371 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800ee70 con 0x7f1ed815e170 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed8089570 con 0x7f1ed815e170 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed815ee90 con 0x7f1ed815e170 2023-10-06T02:46:17.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7f1ebeffd700 1 -- 172.21.15.81:0/1494531371 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec800c850 con 0x7f1ed815e170 2023-10-06T02:46:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.686+0000 7f1ebeffd700 1 -- 172.21.15.81:0/1494531371 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800cbd0 con 0x7f1ed815e170 2023-10-06T02:46:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.687+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1eb8000fd0 con 0x7f1ed815e170 2023-10-06T02:46:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fdab1ffb700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdaa80670a0 0x7fdaa8069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7f4091120700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4070067080 0x7f4070069530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f407c006f00 tx=0x7f407c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa24cae5700 1 --2- 172.21.15.81:0/1714730799 >> v2:172.21.15.81:3300/0 conn(0x7fa2481578d0 0x7fa2480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa24d2e6700 1 -- 172.21.15.81:0/1714730799 >> v2:172.21.15.81:3300/0 conn(0x7fa2481578d0 msgr2=0x7fa2480cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa24d2e6700 1 --2- 172.21.15.81:0/1714730799 >> v2:172.21.15.81:3300/0 conn(0x7fa2481578d0 0x7fa2480cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa24d2e6700 1 -- 172.21.15.81:0/1714730799 >> v1:172.21.15.83:6789/0 conn(0x7fa248157ca0 legacy=0x7fa24815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa24d2e6700 1 -- 172.21.15.81:0/1714730799 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480cfe90 con 0x7fa24806d120 2023-10-06T02:46:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa24cae5700 1 --2- 172.21.15.81:0/1714730799 >> v2:172.21.15.81:3300/0 conn(0x7fa2481578d0 0x7fa2480cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fdab1ffb700 1 -- 172.21.15.81:0/3169377250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdab4086fe0 con 0x7fdabc15e600 2023-10-06T02:46:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fdab1ffb700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7fdaa806f950 0x7fdaa8071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fdab1ffb700 1 -- 172.21.15.81:0/3169377250 --> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdaa8072410 con 0x7fdaa806f950 2023-10-06T02:46:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fdab1ffb700 1 -- 172.21.15.81:0/3169377250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdab4089620 con 0x7fdabc15e600 2023-10-06T02:46:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa24d2e6700 1 --2- 172.21.15.81:0/1714730799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa24806d120 0x7fa24806d560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0098e0 tx=0x7fa23c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18c52f39902a6e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa2477fe700 1 -- 172.21.15.81:0/1714730799 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c009e80 con 0x7fa24806d120 2023-10-06T02:46:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa2477fe700 1 -- 172.21.15.81:0/1714730799 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c00b860 con 0x7fa24806d120 2023-10-06T02:46:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fa2477fe700 1 -- 172.21.15.81:0/1714730799 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00bbe0 con 0x7fa24806d120 2023-10-06T02:46:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fdac12b9700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7fdaa806f950 0x7fdaa8071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.688+0000 7fdac1aba700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdaa80670a0 0x7fdaa8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7f1ebeffd700 1 -- 172.21.15.81:0/1494531371 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ec8013470 con 0x7f1ed815e170 2023-10-06T02:46:17.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7f409091f700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f407006f930 0x7f4070071d40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7fa24ed49700 1 -- 172.21.15.81:0/1714730799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa24806d120 msgr2=0x7fa24806d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7fa24ed49700 1 --2- 172.21.15.81:0/1714730799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa24806d120 0x7fa24806d560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0098e0 tx=0x7fa23c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7fa24ed49700 1 -- 172.21.15.81:0/1714730799 shutdown_connections 2023-10-06T02:46:17.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7fa24ed49700 1 --2- 172.21.15.81:0/1714730799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa24806d120 0x7fa24806d560 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7fa24ed49700 1 --2- 172.21.15.81:0/1714730799 >> v2:172.21.15.81:3300/0 conn(0x7fa2481578d0 0x7fa2480cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7fa24ed49700 1 -- 172.21.15.81:0/1714730799 >> 172.21.15.81:0/1714730799 conn(0x7fa24806bb90 msgr2=0x7fa24806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7f1ebeffd700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ec4066f30 0x7f1ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7f1ebeffd700 1 -- 172.21.15.81:0/1494531371 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ec80848a0 con 0x7f1ed815e170 2023-10-06T02:46:17.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7f1ed6ffd700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ec4066f30 0x7f1ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7f1ebeffd700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f1ec406f760 0x7f1ec4071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7f1ebeffd700 1 -- 172.21.15.81:0/1494531371 --> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ec4072220 con 0x7f1ec406f760 2023-10-06T02:46:17.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7f1ebeffd700 1 -- 172.21.15.81:0/1494531371 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ec8089240 con 0x7f1ed815e170 2023-10-06T02:46:17.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7fdac1aba700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdaa80670a0 0x7fdaa8069550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdab8007880 tx=0x7fdab8004a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.689+0000 7fdac12b9700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7fdaa806f950 0x7fdaa8071d60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fa24ed49700 1 -- 172.21.15.81:0/1714730799 shutdown_connections 2023-10-06T02:46:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7f1ed77fe700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f1ec406f760 0x7f1ec4071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7f1ed6ffd700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ec4066f30 0x7f1ec40693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806cb70 tx=0x7f1ecc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7f5f24987700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f04066f30 0x7f5f040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7f1ed77fe700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f1ec406f760 0x7f1ec4071b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7f6ee56fd700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f6ecc06f760 0x7f6ecc071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7f40817fa700 1 -- 172.21.15.81:0/693696988 <== osd.4 v2:172.21.15.83:6800/86341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f40700723f0 con 0x7f407006f930 2023-10-06T02:46:17.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fe37dffb700 1 -- 172.21.15.81:0/2871451404 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe380007770 con 0x7fe3880c2870 2023-10-06T02:46:17.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fe37dffb700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe36c067000 0x7fe36c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fe37dffb700 1 -- 172.21.15.81:0/2871451404 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3800855c0 con 0x7fe3880c2870 2023-10-06T02:46:17.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fe38de64700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe36c067000 0x7fe36c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fe37dffb700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7fe36c06f8b0 0x7fe36c071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fe37dffb700 1 -- 172.21.15.81:0/2871451404 --> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe36c072370 con 0x7fe36c06f8b0 2023-10-06T02:46:17.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fe37dffb700 1 -- 172.21.15.81:0/2871451404 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3800859e0 con 0x7fe3880c2870 2023-10-06T02:46:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7f6ee56fd700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f6ecc06f760 0x7f6ecc071b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fe38d663700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7fe36c06f8b0 0x7fe36c071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fdab1ffb700 1 -- 172.21.15.81:0/3169377250 <== osd.2 v2:172.21.15.81:6800/86096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fdaa8072410 con 0x7fdaa806f950 2023-10-06T02:46:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.690+0000 7fa24ed49700 1 -- 172.21.15.81:0/1714730799 wait complete. 2023-10-06T02:46:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.691+0000 7f1ebeffd700 1 -- 172.21.15.81:0/1494531371 <== osd.7 v2:172.21.15.83:6816/86343 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f1ec4072220 con 0x7f1ec406f760 2023-10-06T02:46:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.691+0000 7fe38d663700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7fe36c06f8b0 0x7fe36c071cc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.691+0000 7f6edcff9700 1 -- 172.21.15.81:0/3924271391 <== osd.0 v2:172.21.15.81:6816/86106 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f6ecc072220 con 0x7f6ecc06f760 2023-10-06T02:46:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.691+0000 7f5f24987700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f04066f30 0x7f5f040693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0098e0 tx=0x7f5f1c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.691+0000 7fa24ed49700 1 Processor -- start 2023-10-06T02:46:17.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.691+0000 7fe37dffb700 1 -- 172.21.15.81:0/2871451404 <== osd.5 v2:172.21.15.83:6808/86342 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fe36c072370 con 0x7fe36c06f8b0 2023-10-06T02:46:17.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7fa24ed49700 1 -- start start 2023-10-06T02:46:17.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7fe38de64700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe36c067000 0x7fe36c0694b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe37800a010 tx=0x7fe378016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7fa24ed49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24806d120 0x7fa2480b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7fa24ed49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2481578d0 0x7fa2480ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7fa24ed49700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa248157ca0 0x7fa2480caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7fa24ed49700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480c8da0 con 0x7fa24806d120 2023-10-06T02:46:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7fa24ed49700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480b25f0 con 0x7fa2481578d0 2023-10-06T02:46:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7fa24ed49700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480c8190 con 0x7fa248157ca0 2023-10-06T02:46:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24cae5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24806d120 0x7fa2480b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24d2e6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa248157ca0 0x7fa2480caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24cae5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24806d120 0x7fa2480b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56872/0 (socket says 172.21.15.81:56872) 2023-10-06T02:46:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24cae5700 1 -- 172.21.15.81:0/3364901811 learned_addr learned my addr 172.21.15.81:0/3364901811 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa247fff700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2481578d0 0x7fa2480ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24d2e6700 1 -- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2481578d0 msgr2=0x7fa2480ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24d2e6700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2481578d0 0x7fa2480ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24d2e6700 1 -- 172.21.15.81:0/3364901811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24806d120 msgr2=0x7fa2480b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24d2e6700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24806d120 0x7fa2480b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24d2e6700 1 -- 172.21.15.81:0/3364901811 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c009420 con 0x7fa248157ca0 2023-10-06T02:46:17.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa24d2e6700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa248157ca0 0x7fa2480caf20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa23c016000 tx=0x7fa23c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7fa244ff9700 1 -- 172.21.15.81:0/3364901811 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00baa0 con 0x7fa248157ca0 2023-10-06T02:46:17.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7fa244ff9700 1 -- 172.21.15.81:0/3364901811 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c011420 con 0x7fa248157ca0 2023-10-06T02:46:17.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2480c8470 con 0x7fa248157ca0 2023-10-06T02:46:17.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2480c8a30 con 0x7fa248157ca0 2023-10-06T02:46:17.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7fa244ff9700 1 -- 172.21.15.81:0/3364901811 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0117e0 con 0x7fa248157ca0 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2480ce520 con 0x7fa248157ca0 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.695+0000 7fa244ff9700 1 -- 172.21.15.81:0/3364901811 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa23c023070 con 0x7fa248157ca0 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.695+0000 7fa244ff9700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa234066f30 0x7fa2340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.695+0000 7fa244ff9700 1 -- 172.21.15.81:0/3364901811 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa23c086490 con 0x7fa248157ca0 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.695+0000 7fa24cae5700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa234066f30 0x7fa2340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.696+0000 7fa244ff9700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7fa23406f7e0 0x7fa234071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.696+0000 7fa244ff9700 1 -- 172.21.15.81:0/3364901811 --> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2340722a0 con 0x7fa23406f7e0 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.696+0000 7fa244ff9700 1 -- 172.21.15.81:0/3364901811 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa23c086860 con 0x7fa248157ca0 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.696+0000 7fa247fff700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7fa23406f7e0 0x7fa234071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.696+0000 7fa24cae5700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa234066f30 0x7fa2340693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa238006fd0 tx=0x7fa238008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.696+0000 7fa247fff700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7fa23406f7e0 0x7fa234071bf0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7f4b52394700 1 Processor -- start 2023-10-06T02:46:17.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7f4b52394700 1 -- start start 2023-10-06T02:46:17.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7f4b52394700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4b4c0acf60 0x7f4b4c15f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.692+0000 7f4b52394700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0b0a00 0x7f4b4c161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b52394700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b4c0cdc90 0x7f4b4c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b52394700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c0ad330 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b52394700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c162dc0 con 0x7f4b4c0acf60 2023-10-06T02:46:17.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b52394700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0ce5f0 con 0x7f4b4c0b0a00 2023-10-06T02:46:17.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b50931700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b4c0cdc90 0x7f4b4c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b50931700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b4c0cdc90 0x7f4b4c0ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56876/0 (socket says 172.21.15.81:56876) 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b50931700 1 -- 172.21.15.81:0/1087632464 learned_addr learned my addr 172.21.15.81:0/1087632464 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b4b7fe700 1 --2- 172.21.15.81:0/1087632464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0b0a00 0x7f4b4c161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b4b7fe700 1 -- 172.21.15.81:0/1087632464 >> v2:172.21.15.83:3300/0 conn(0x7f4b4c0acf60 msgr2=0x7f4b4c15f1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b4b7fe700 1 --2- 172.21.15.81:0/1087632464 >> v2:172.21.15.83:3300/0 conn(0x7f4b4c0acf60 0x7f4b4c15f1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b4b7fe700 1 -- 172.21.15.81:0/1087632464 >> v2:172.21.15.81:3300/0 conn(0x7f4b4c0cdc90 msgr2=0x7f4b4c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b4b7fe700 1 --2- 172.21.15.81:0/1087632464 >> v2:172.21.15.81:3300/0 conn(0x7f4b4c0cdc90 0x7f4b4c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b4b7fe700 1 -- 172.21.15.81:0/1087632464 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c162800 con 0x7f4b4c0b0a00 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b50931700 1 --2- 172.21.15.81:0/1087632464 >> v2:172.21.15.81:3300/0 conn(0x7f4b4c0cdc90 0x7f4b4c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:17.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.693+0000 7f4b4b7fe700 1 --2- 172.21.15.81:0/1087632464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0b0a00 0x7f4b4c161eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0b06e0 tx=0x7f4b400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e850e6808d61514 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b4affd700 1 -- 172.21.15.81:0/1087632464 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40011630 con 0x7f4b4c0b0a00 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b4affd700 1 -- 172.21.15.81:0/1087632464 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b400117b0 con 0x7f4b4c0b0a00 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b4affd700 1 -- 172.21.15.81:0/1087632464 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40011b70 con 0x7f4b4c0b0a00 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b52394700 1 -- 172.21.15.81:0/1087632464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0b0a00 msgr2=0x7f4b4c161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b52394700 1 --2- 172.21.15.81:0/1087632464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0b0a00 0x7f4b4c161eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0b06e0 tx=0x7f4b400091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b52394700 1 -- 172.21.15.81:0/1087632464 shutdown_connections 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b52394700 1 --2- 172.21.15.81:0/1087632464 >> v2:172.21.15.81:3300/0 conn(0x7f4b4c0cdc90 0x7f4b4c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b52394700 1 --2- 172.21.15.81:0/1087632464 >> v2:172.21.15.83:3300/0 conn(0x7f4b4c0acf60 0x7f4b4c15f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b52394700 1 --2- 172.21.15.81:0/1087632464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0b0a00 0x7f4b4c161eb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.694+0000 7f4b52394700 1 -- 172.21.15.81:0/1087632464 >> 172.21.15.81:0/1087632464 conn(0x7f4b4c06cca0 msgr2=0x7f4b4c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.697+0000 7f4b52394700 1 -- 172.21.15.81:0/1087632464 shutdown_connections 2023-10-06T02:46:17.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.697+0000 7f4b52394700 1 -- 172.21.15.81:0/1087632464 wait complete. 2023-10-06T02:46:17.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.697+0000 7fa244ff9700 1 -- 172.21.15.81:0/3364901811 <== osd.6 v2:172.21.15.83:6824/86383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fa2340722a0 con 0x7fa23406f7e0 2023-10-06T02:46:17.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.698+0000 7f4b52394700 1 Processor -- start 2023-10-06T02:46:17.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.698+0000 7f4b52394700 1 -- start start 2023-10-06T02:46:17.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b52394700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b4c0b0a00 0x7f4b4c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b52394700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c0cdc90 0x7f4b4c154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b52394700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0cc4f0 0x7f4b4c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b52394700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c155fb0 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b52394700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1553a0 con 0x7f4b4c0b0a00 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b52394700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c155680 con 0x7f4b4c0cc4f0 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c0cdc90 0x7f4b4c154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c0cdc90 0x7f4b4c154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56880/0 (socket says 172.21.15.81:56880) 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4b7fe700 1 -- 172.21.15.81:0/121156838 learned_addr learned my addr 172.21.15.81:0/121156838 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4bfff700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b4c0b0a00 0x7f4b4c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b50931700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0cc4f0 0x7f4b4c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4b7fe700 1 -- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0cc4f0 msgr2=0x7f4b4c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4b7fe700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b4c0cc4f0 0x7f4b4c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4b7fe700 1 -- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b4c0b0a00 msgr2=0x7f4b4c15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4b7fe700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b4c0b0a00 0x7f4b4c15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4b7fe700 1 -- 172.21.15.81:0/121156838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44009ae0 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4bfff700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b4c0b0a00 0x7f4b4c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:17.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.699+0000 7f4b4b7fe700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c0cdc90 0x7f4b4c154990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0ce730 tx=0x7f4b40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.700+0000 7f4b33fff700 1 -- 172.21.15.81:0/121156838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4001f070 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.700+0000 7f4b33fff700 1 -- 172.21.15.81:0/121156838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40000c90 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.700+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b40009420 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.700+0000 7f4b33fff700 1 -- 172.21.15.81:0/121156838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40011b70 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.700+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c155c40 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.700+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b4c068900 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.702+0000 7f4b33fff700 1 -- 172.21.15.81:0/121156838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b40023070 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.703+0000 7f4b33fff700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b38066f30 0x7f4b380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.703+0000 7f4b33fff700 1 -- 172.21.15.81:0/121156838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4b400861b0 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.703+0000 7f4b33fff700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f4b3806f7e0 0x7f4b38071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.703+0000 7f4b33fff700 1 -- 172.21.15.81:0/121156838 --> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b380722a0 con 0x7f4b3806f7e0 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.703+0000 7f4b33fff700 1 -- 172.21.15.81:0/121156838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b40086580 con 0x7f4b4c0cdc90 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.704+0000 7f4b50931700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f4b3806f7e0 0x7f4b38071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.704+0000 7f4b50931700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f4b3806f7e0 0x7f4b38071bf0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.705+0000 7f4b33fff700 1 -- 172.21.15.81:0/121156838 <== osd.3 v2:172.21.15.81:6802/86097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f4b380722a0 con 0x7f4b3806f7e0 2023-10-06T02:46:17.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.712+0000 7f4b4bfff700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b38066f30 0x7f4b380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:17.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.714+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 --> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5f2006dac0 con 0x7f5f0406f7e0 2023-10-06T02:46:17.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.715+0000 7f5f117fa700 1 -- 172.21.15.81:0/1684260148 <== osd.1 v2:172.21.15.81:6817/86109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5f2006dac0 con 0x7f5f0406f7e0 2023-10-06T02:46:17.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.715+0000 7f4b4bfff700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b38066f30 0x7f4b380693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c069450 tx=0x7f4b3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:17.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.718+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 --> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ee01575b0 con 0x7f6ecc06f760 2023-10-06T02:46:17.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6edcff9700 1 -- 172.21.15.81:0/3924271391 <== osd.0 v2:172.21.15.81:6816/86106 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ee01575b0 con 0x7f6ecc06f760 2023-10-06T02:46:17.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f6ecc06f760 msgr2=0x7f6ecc071b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f6ecc06f760 0x7f6ecc071b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ecc066f30 msgr2=0x7f6ecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ecc066f30 0x7f6ecc0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0157200 tx=0x7f6ed8018000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ee006e770 msgr2=0x7f6ee00a6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 --2- 172.21.15.81:0/3924271391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ee006e770 0x7f6ee00a6640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000c530 tx=0x7f6ed0007f90 comp rx=0 tx=0).stop 2023-10-06T02:46:17.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7f5f0406f7e0 msgr2=0x7f5f04071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f5f273ec700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7f5f0406f7e0 0x7f5f04071bf0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.717+0000 7f4076ffd700 1 -- 172.21.15.81:0/693696988 --> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4064002d30 con 0x7f407006f930 2023-10-06T02:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.717+0000 7f40817fa700 1 -- 172.21.15.81:0/693696988 <== osd.4 v2:172.21.15.83:6800/86341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4064002d30 con 0x7f407006f930 2023-10-06T02:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.718+0000 7f4076ffd700 1 -- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f407006f930 msgr2=0x7f4070071d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.718+0000 7f4076ffd700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f407006f930 0x7f4070071d40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee56fd700 1 -- 172.21.15.81:0/3924271391 reap_dead start 2023-10-06T02:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 shutdown_connections 2023-10-06T02:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 >> 172.21.15.81:0/3924271391 conn(0x7f6ee006cca0 msgr2=0x7f6ee0154310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 shutdown_connections 2023-10-06T02:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7f6ee7160700 1 -- 172.21.15.81:0/3924271391 wait complete. 2023-10-06T02:46:17.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.722+0000 7fdaa77fe700 1 -- 172.21.15.81:0/3169377250 --> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda9c002d30 con 0x7fdaa806f950 2023-10-06T02:46:17.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.722+0000 7fdab1ffb700 1 -- 172.21.15.81:0/3169377250 <== osd.2 v2:172.21.15.81:6800/86096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fda9c002d30 con 0x7fdaa806f950 2023-10-06T02:46:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 -- 172.21.15.81:0/3169377250 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7fdaa806f950 msgr2=0x7fdaa8071d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7fdaa806f950 0x7fdaa8071d60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 -- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdaa80670a0 msgr2=0x7fdaa8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdaa80670a0 0x7fdaa8069550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdab8007880 tx=0x7fdab8004a80 comp rx=0 tx=0).stop 2023-10-06T02:46:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 -- 172.21.15.81:0/3169377250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdabc15e600 msgr2=0x7fdabc1609b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 --2- 172.21.15.81:0/3169377250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdabc15e600 0x7fdabc1609b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdab4015000 tx=0x7fdab4018000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdac22bb700 1 -- 172.21.15.81:0/3169377250 reap_dead start 2023-10-06T02:46:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 -- 172.21.15.81:0/3169377250 shutdown_connections 2023-10-06T02:46:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 -- 172.21.15.81:0/3169377250 >> 172.21.15.81:0/3169377250 conn(0x7fdabc0c9ca0 msgr2=0x7fdabc0c27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f4076ffd700 1 -- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4070067080 msgr2=0x7f4070069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f4076ffd700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4070067080 0x7f4070069530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f407c006f00 tx=0x7f407c008040 comp rx=0 tx=0).stop 2023-10-06T02:46:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f4076ffd700 1 -- 172.21.15.81:0/693696988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f408c15b180 msgr2=0x7f408c15b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f4076ffd700 1 --2- 172.21.15.81:0/693696988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f408c15b180 0x7f408c15b5f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f408c06abc0 tx=0x7f4084016000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f4091921700 1 -- 172.21.15.81:0/693696988 reap_dead start 2023-10-06T02:46:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 -- 172.21.15.81:0/3169377250 shutdown_connections 2023-10-06T02:46:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7fdaa77fe700 1 -- 172.21.15.81:0/3169377250 wait complete. 2023-10-06T02:46:17.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f04066f30 msgr2=0x7f5f040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f5f273ec700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f04066f30 0x7f5f040693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0098e0 tx=0x7f5f1c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f2006d120 msgr2=0x7f5f20151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f5f273ec700 1 --2- 172.21.15.81:0/1684260148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f2006d120 0x7f5f20151b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f1401d5a0 tx=0x7f5f14007ef0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.723+0000 7f5f25989700 1 -- 172.21.15.81:0/1684260148 reap_dead start 2023-10-06T02:46:17.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.725+0000 7f4076ffd700 1 -- 172.21.15.81:0/693696988 shutdown_connections 2023-10-06T02:46:17.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.725+0000 7f4076ffd700 1 -- 172.21.15.81:0/693696988 >> 172.21.15.81:0/693696988 conn(0x7f408c0c9ca0 msgr2=0x7f408c0699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.726+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 --> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1eb8002d30 con 0x7f1ec406f760 2023-10-06T02:46:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.719+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 --> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe368002d30 con 0x7fe36c06f8b0 2023-10-06T02:46:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.720+0000 7fe37dffb700 1 -- 172.21.15.81:0/2871451404 <== osd.5 v2:172.21.15.83:6808/86342 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe368002d30 con 0x7fe36c06f8b0 2023-10-06T02:46:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.720+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7fe36c06f8b0 msgr2=0x7fe36c071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.720+0000 7fe3900c8700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7fe36c06f8b0 0x7fe36c071cc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.720+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe36c067000 msgr2=0x7fe36c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.720+0000 7fe3900c8700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe36c067000 0x7fe36c0694b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe37800a010 tx=0x7fe378016000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.720+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3880c2870 msgr2=0x7fe38815c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.720+0000 7fe3900c8700 1 --2- 172.21.15.81:0/2871451404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3880c2870 0x7fe38815c3b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe38000cd80 tx=0x7fe380001b00 comp rx=0 tx=0).stop 2023-10-06T02:46:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.720+0000 7fe38e665700 1 -- 172.21.15.81:0/2871451404 reap_dead start 2023-10-06T02:46:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.721+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 shutdown_connections 2023-10-06T02:46:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.721+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 >> 172.21.15.81:0/2871451404 conn(0x7fe38806c660 msgr2=0x7fe38806d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.721+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 shutdown_connections 2023-10-06T02:46:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.721+0000 7fe3900c8700 1 -- 172.21.15.81:0/2871451404 wait complete. 2023-10-06T02:46:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.727+0000 7f1ebeffd700 1 -- 172.21.15.81:0/1494531371 <== osd.7 v2:172.21.15.83:6816/86343 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1eb8002d30 con 0x7f1ec406f760 2023-10-06T02:46:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.727+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f1ec406f760 msgr2=0x7f1ec4071b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.727+0000 7f1edd6b4700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f1ec406f760 0x7f1ec4071b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.727+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ec4066f30 msgr2=0x7f1ec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.727+0000 7f1edd6b4700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ec4066f30 0x7f1ec40693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806cb70 tx=0x7f1ecc017000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.727+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed815e170 msgr2=0x7f1ed81484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.727+0000 7f1edd6b4700 1 --2- 172.21.15.81:0/1494531371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed815e170 0x7f1ed81484a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800e980 tx=0x7f1ec8009250 comp rx=0 tx=0).stop 2023-10-06T02:46:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.728+0000 7f1ed77fe700 1 -- 172.21.15.81:0/1494531371 reap_dead start 2023-10-06T02:46:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.728+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 shutdown_connections 2023-10-06T02:46:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.728+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 >> 172.21.15.81:0/1494531371 conn(0x7f1ed806bb90 msgr2=0x7f1ed80b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.729+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 shutdown_connections 2023-10-06T02:46:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.729+0000 7f1edd6b4700 1 -- 172.21.15.81:0/1494531371 wait complete. 2023-10-06T02:46:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.730+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 --> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b4c162ae0 con 0x7f4b3806f7e0 2023-10-06T02:46:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b33fff700 1 -- 172.21.15.81:0/121156838 <== osd.3 v2:172.21.15.81:6802/86097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b4c162ae0 con 0x7f4b3806f7e0 2023-10-06T02:46:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f4b3806f7e0 msgr2=0x7f4b38071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f4b3806f7e0 0x7f4b38071bf0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b38066f30 msgr2=0x7f4b380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b38066f30 0x7f4b380693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c069450 tx=0x7f4b3c008040 comp rx=0 tx=0).stop 2023-10-06T02:46:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c0cdc90 msgr2=0x7f4b4c154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 --2- 172.21.15.81:0/121156838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c0cdc90 0x7f4b4c154990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0ce730 tx=0x7f4b40017000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b50931700 1 -- 172.21.15.81:0/121156838 reap_dead start 2023-10-06T02:46:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 shutdown_connections 2023-10-06T02:46:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 >> 172.21.15.81:0/121156838 conn(0x7f4b4c06cca0 msgr2=0x7f4b4c15fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 shutdown_connections 2023-10-06T02:46:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.731+0000 7f4b52394700 1 -- 172.21.15.81:0/121156838 wait complete. 2023-10-06T02:46:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.733+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 shutdown_connections 2023-10-06T02:46:17.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.733+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 >> 172.21.15.81:0/1684260148 conn(0x7f5f2006bb90 msgr2=0x7f5f2006a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.792 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:17.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T02:46:17.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.735+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 shutdown_connections 2023-10-06T02:46:17.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.735+0000 7f5f273ec700 1 -- 172.21.15.81:0/1684260148 wait complete. 2023-10-06T02:46:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.735+0000 7f4076ffd700 1 -- 172.21.15.81:0/693696988 shutdown_connections 2023-10-06T02:46:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.735+0000 7f4076ffd700 1 -- 172.21.15.81:0/693696988 wait complete. 2023-10-06T02:46:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.738+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 --> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa2480d0170 con 0x7fa23406f7e0 2023-10-06T02:46:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.738+0000 7fa244ff9700 1 -- 172.21.15.81:0/3364901811 <== osd.6 v2:172.21.15.83:6824/86383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa2480d0170 con 0x7fa23406f7e0 2023-10-06T02:46:17.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.740+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7fa23406f7e0 msgr2=0x7fa234071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.740+0000 7fa24ed49700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7fa23406f7e0 0x7fa234071bf0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:17.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.740+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa234066f30 msgr2=0x7fa2340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.740+0000 7fa24ed49700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa234066f30 0x7fa2340693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa238006fd0 tx=0x7fa238008040 comp rx=0 tx=0).stop 2023-10-06T02:46:17.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.740+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa248157ca0 msgr2=0x7fa2480caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:17.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.740+0000 7fa24ed49700 1 --2- 172.21.15.81:0/3364901811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa248157ca0 0x7fa2480caf20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa23c016000 tx=0x7fa23c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:17.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.740+0000 7fa24d2e6700 1 -- 172.21.15.81:0/3364901811 reap_dead start 2023-10-06T02:46:17.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.741+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 shutdown_connections 2023-10-06T02:46:17.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.741+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 >> 172.21.15.81:0/3364901811 conn(0x7fa24806bb90 msgr2=0x7fa2480b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:17.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.743+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 shutdown_connections 2023-10-06T02:46:17.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:17.743+0000 7fa24ed49700 1 -- 172.21.15.81:0/3364901811 wait complete. 2023-10-06T02:46:17.797 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:17.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T02:46:17.798 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:17.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T02:46:17.799 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:17.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T02:46:17.800 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:17.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T02:46:17.801 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:17.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T02:46:17.803 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:17.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T02:46:17.804 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:17.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T02:46:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.024+0000 7f5964de0700 1 Processor -- start 2023-10-06T02:46:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.024+0000 7f5964de0700 1 -- start start 2023-10-06T02:46:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.026+0000 7f5964de0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f59600cdc90 0x7f59600ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.026+0000 7f5964de0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59601625c0 con 0x7f59600acf60 2023-10-06T02:46:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.026+0000 7f5964de0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5960162dc0 con 0x7f59600b0a00 2023-10-06T02:46:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.026+0000 7f5964de0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596015f8d0 con 0x7f59600cdc90 2023-10-06T02:46:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.026+0000 7f595dd9b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f59600b0a00 0x7f5960161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55330/0 (socket says 172.21.15.81:55330) 2023-10-06T02:46:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.026+0000 7f595dd9b700 1 -- 172.21.15.81:0/1438666519 learned_addr learned my addr 172.21.15.81:0/1438666519 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.026+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014004708 0 0) 0x7f5960162dc0 con 0x7f59600b0a00 2023-10-06T02:46:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.026+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5948003570 con 0x7f59600b0a00 2023-10-06T02:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 578568779 0 0) 0x7f5948003570 con 0x7f59600b0a00 2023-10-06T02:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 >> v2:172.21.15.83:3300/0 conn(0x7f59600cdc90 msgr2=0x7f59600ce0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 --2- 172.21.15.81:0/1438666519 >> v2:172.21.15.83:3300/0 conn(0x7f59600cdc90 0x7f59600ce0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 >> v1:172.21.15.81:6789/0 conn(0x7f59600acf60 legacy=0x7f596015f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600ce600 con 0x7f59600b0a00 2023-10-06T02:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f5950001470 con 0x7f59600b0a00 2023-10-06T02:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 >> v1:172.21.15.83:6789/0 conn(0x7f59600b0a00 legacy=0x7f5960161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 0x7f5948003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5948004810 0x7f5948004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59480053c0 0x7f594800ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596015f8d0 con 0x7f5948003ae0 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594800c2c0 con 0x7f59480053c0 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594800c480 con 0x7f5948004810 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595dd9b700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5948004810 0x7f5948004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.027+0000 7f595e59c700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 0x7f5948003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595e59c700 1 -- 172.21.15.81:0/1438666519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5948004810 msgr2=0x7f5948004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595e59c700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5948004810 0x7f5948004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595e59c700 1 -- 172.21.15.81:0/1438666519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59480053c0 msgr2=0x7f594800ba80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595e59c700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59480053c0 0x7f594800ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595e59c700 1 -- 172.21.15.81:0/1438666519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600ce600 con 0x7f5948003ae0 2023-10-06T02:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595ed9d700 1 -- 172.21.15.81:0/1438666519 reap_dead start 2023-10-06T02:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595e59c700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 0x7f5948003ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59540017c0 tx=0x7f5954007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cff7276d96abd44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954012400 con 0x7f5948003ae0 2023-10-06T02:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5954012560 con 0x7f5948003ae0 2023-10-06T02:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.028+0000 7f595d59a700 1 -- 172.21.15.81:0/1438666519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954012920 con 0x7f5948003ae0 2023-10-06T02:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.029+0000 7f5964de0700 1 -- 172.21.15.81:0/1438666519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 msgr2=0x7f5948003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.029+0000 7f5964de0700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 0x7f5948003ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59540017c0 tx=0x7f5954007d10 comp rx=0 tx=0).stop 2023-10-06T02:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.029+0000 7f5964de0700 1 -- 172.21.15.81:0/1438666519 shutdown_connections 2023-10-06T02:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.029+0000 7f5964de0700 1 --2- 172.21.15.81:0/1438666519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 0x7f5948003ed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.029+0000 7f5964de0700 1 -- 172.21.15.81:0/1438666519 >> 172.21.15.81:0/1438666519 conn(0x7f596006cca0 msgr2=0x7f596006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.030+0000 7f5964de0700 1 -- 172.21.15.81:0/1438666519 shutdown_connections 2023-10-06T02:46:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.031+0000 7fefb4122700 1 Processor -- start 2023-10-06T02:46:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.031+0000 7f311871b700 1 Processor -- start 2023-10-06T02:46:18.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.030+0000 7f5964de0700 1 -- 172.21.15.81:0/1438666519 wait complete. 2023-10-06T02:46:18.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.031+0000 7f5964de0700 1 Processor -- start 2023-10-06T02:46:18.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.031+0000 7f311871b700 1 -- start start 2023-10-06T02:46:18.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.032+0000 7f311871b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3110155c60 0x7f3110156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.032+0000 7f311871b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100ca550 con 0x7f31100cbc90 2023-10-06T02:46:18.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.032+0000 7f311871b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100cb3b0 con 0x7f31100cb840 2023-10-06T02:46:18.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.032+0000 7f311871b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31100ca7a0 con 0x7f3110155c60 2023-10-06T02:46:18.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.031+0000 7fefb4122700 1 -- start start 2023-10-06T02:46:18.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.032+0000 7fefb4122700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fefac0aedc0 0x7fefac0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.032+0000 7fefb4122700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0c9120 con 0x7fefac0c2870 2023-10-06T02:46:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.032+0000 7fefb4122700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0c7620 con 0x7fefac0af190 2023-10-06T02:46:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.032+0000 7fefb4122700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac15e840 con 0x7fefac0aedc0 2023-10-06T02:46:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f3116cb8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f31100cbc90 0x7f3110159ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58168/0 (socket says 172.21.15.81:58168) 2023-10-06T02:46:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f3116cb8700 1 -- 172.21.15.81:0/3245917084 learned_addr learned my addr 172.21.15.81:0/3245917084 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.031+0000 7f5964de0700 1 -- start start 2023-10-06T02:46:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f5964de0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 0x7f59600ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f5964de0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5960161220 0x7f59600a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f5964de0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59600a6e00 0x7f59600cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f5964de0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600caeb0 con 0x7f5948003ae0 2023-10-06T02:46:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f5964de0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600a7270 con 0x7f5960161220 2023-10-06T02:46:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f5964de0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59600cbcb0 con 0x7f59600a6e00 2023-10-06T02:46:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7fefb26bf700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fefac0c2870 0x7fefac0c2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58156/0 (socket says 172.21.15.81:58156) 2023-10-06T02:46:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7fefb26bf700 1 -- 172.21.15.81:0/289302380 learned_addr learned my addr 172.21.15.81:0/289302380 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f595dd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5960161220 0x7f59600a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7fefb1ebe700 1 --2- 172.21.15.81:0/289302380 >> v2:172.21.15.83:3300/0 conn(0x7fefac0aedc0 0x7fefac0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f595dd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5960161220 0x7f59600a68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38978/0 (socket says 172.21.15.81:38978) 2023-10-06T02:46:18.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f595dd9b700 1 -- 172.21.15.81:0/227315159 learned_addr learned my addr 172.21.15.81:0/227315159 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f595e59c700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 0x7f59600ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f31164b7700 1 --2- 172.21.15.81:0/3245917084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3110155c60 0x7f3110156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f595dd9b700 1 -- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59600a6e00 msgr2=0x7f59600cc140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:46:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f595dd9b700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59600a6e00 0x7f59600cc140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f595dd9b700 1 -- 172.21.15.81:0/227315159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 msgr2=0x7f59600ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f595dd9b700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 0x7f59600ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.033+0000 7f595dd9b700 1 -- 172.21.15.81:0/227315159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600cb0a0 con 0x7f5960161220 2023-10-06T02:46:18.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f31164b7700 1 -- 172.21.15.81:0/3245917084 >> v1:172.21.15.83:6789/0 conn(0x7f31100cb840 legacy=0x7f31100c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f31164b7700 1 -- 172.21.15.81:0/3245917084 >> v1:172.21.15.81:6789/0 conn(0x7f31100cbc90 legacy=0x7f3110159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f31164b7700 1 -- 172.21.15.81:0/3245917084 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100caa80 con 0x7f3110155c60 2023-10-06T02:46:18.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7fefb1ebe700 1 -- 172.21.15.81:0/289302380 >> v1:172.21.15.83:6789/0 conn(0x7fefac0af190 legacy=0x7fefac068980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:18.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7fefb1ebe700 1 -- 172.21.15.81:0/289302380 >> v1:172.21.15.81:6789/0 conn(0x7fefac0c2870 legacy=0x7fefac0c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7fefb1ebe700 1 -- 172.21.15.81:0/289302380 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0c23e0 con 0x7fefac0aedc0 2023-10-06T02:46:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f31164b7700 1 --2- 172.21.15.81:0/3245917084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3110155c60 0x7f3110156030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3104009910 tx=0x7f31040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6522339e3c4e75a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f595dd9b700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5960161220 0x7f59600a68c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f595000ebc0 tx=0x7f5950001d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7fefb1ebe700 1 --2- 172.21.15.81:0/289302380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 0x7fefac0c8b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0098e0 tx=0x7fef9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad354619d4485060 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f31154b5700 1 -- 172.21.15.81:0/3245917084 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104009e50 con 0x7f3110155c60 2023-10-06T02:46:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f31154b5700 1 -- 172.21.15.81:0/3245917084 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310400b860 con 0x7f3110155c60 2023-10-06T02:46:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f31154b5700 1 -- 172.21.15.81:0/3245917084 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400bc00 con 0x7f3110155c60 2023-10-06T02:46:18.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f594e7fc700 1 -- 172.21.15.81:0/227315159 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000c890 con 0x7f5960161220 2023-10-06T02:46:18.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f594e7fc700 1 -- 172.21.15.81:0/227315159 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000ca10 con 0x7f5960161220 2023-10-06T02:46:18.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f594e7fc700 1 -- 172.21.15.81:0/227315159 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000cdd0 con 0x7f5960161220 2023-10-06T02:46:18.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59600cb380 con 0x7f5960161220 2023-10-06T02:46:18.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.034+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59600cb940 con 0x7f5960161220 2023-10-06T02:46:18.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7f311871b700 1 -- 172.21.15.81:0/3245917084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3110155c60 msgr2=0x7f3110156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7f311871b700 1 --2- 172.21.15.81:0/3245917084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3110155c60 0x7f3110156030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3104009910 tx=0x7f31040091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7f311871b700 1 -- 172.21.15.81:0/3245917084 shutdown_connections 2023-10-06T02:46:18.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7f311871b700 1 --2- 172.21.15.81:0/3245917084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3110155c60 0x7f3110156030 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7f311871b700 1 -- 172.21.15.81:0/3245917084 >> 172.21.15.81:0/3245917084 conn(0x7f31100cc980 msgr2=0x7f31100ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7fefb0ebc700 1 -- 172.21.15.81:0/289302380 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c009e80 con 0x7fefac0aedc0 2023-10-06T02:46:18.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7fefb0ebc700 1 -- 172.21.15.81:0/289302380 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c00b820 con 0x7fefac0aedc0 2023-10-06T02:46:18.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7fefb0ebc700 1 -- 172.21.15.81:0/289302380 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00bba0 con 0x7fefac0aedc0 2023-10-06T02:46:18.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7f311871b700 1 -- 172.21.15.81:0/3245917084 shutdown_connections 2023-10-06T02:46:18.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.035+0000 7f311871b700 1 -- 172.21.15.81:0/3245917084 wait complete. 2023-10-06T02:46:18.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.036+0000 7fefb4122700 1 -- 172.21.15.81:0/289302380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 msgr2=0x7fefac0c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.036+0000 7fefb4122700 1 --2- 172.21.15.81:0/289302380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 0x7fefac0c8b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0098e0 tx=0x7fef9c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.036+0000 7fefb4122700 1 -- 172.21.15.81:0/289302380 shutdown_connections 2023-10-06T02:46:18.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.036+0000 7fefb4122700 1 --2- 172.21.15.81:0/289302380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 0x7fefac0c8b20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.036+0000 7fefb4122700 1 -- 172.21.15.81:0/289302380 >> 172.21.15.81:0/289302380 conn(0x7fefac06c660 msgr2=0x7fefac0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.037+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59440052b0 con 0x7f5960161220 2023-10-06T02:46:18.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.036+0000 7fea062ec700 1 Processor -- start 2023-10-06T02:46:18.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.037+0000 7fea062ec700 1 -- start start 2023-10-06T02:46:18.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.037+0000 7f311871b700 1 Processor -- start 2023-10-06T02:46:18.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.037+0000 7f311871b700 1 -- start start 2023-10-06T02:46:18.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f311871b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31100cb840 0x7f311014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f311871b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31100cbc90 0x7f3110157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f311871b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3110155c60 0x7f3110157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f311871b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311014cdb0 con 0x7f31100cbc90 2023-10-06T02:46:18.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f311871b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31100c5230 con 0x7f3110155c60 2023-10-06T02:46:18.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f311871b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31100c6090 con 0x7f31100cb840 2023-10-06T02:46:18.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.037+0000 7fea062ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea00069290 0x7fea000cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea062ec700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea0006ddf0 0x7fea0006e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea062ec700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0006d960 con 0x7fea0016a2b0 2023-10-06T02:46:18.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea062ec700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea000696e0 con 0x7fea0006ddf0 2023-10-06T02:46:18.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea062ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000c8700 con 0x7fea00069290 2023-10-06T02:46:18.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fe9fffff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fea0016a2b0 0x7fea000ca550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55358/0 (socket says 172.21.15.81:55358) 2023-10-06T02:46:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fe9fffff700 1 -- 172.21.15.81:0/3424296449 learned_addr learned my addr 172.21.15.81:0/3424296449 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea04889700 1 --2- 172.21.15.81:0/3424296449 >> v2:172.21.15.81:3300/0 conn(0x7fea0006ddf0 0x7fea0006e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fe9ff7fe700 1 --2- 172.21.15.81:0/3424296449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea00069290 0x7fea000cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea04889700 1 -- 172.21.15.81:0/3424296449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea00069290 msgr2=0x7fea000cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea04889700 1 --2- 172.21.15.81:0/3424296449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea00069290 0x7fea000cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea04889700 1 -- 172.21.15.81:0/3424296449 >> v1:172.21.15.83:6789/0 conn(0x7fea0016a2b0 legacy=0x7fea000ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea04889700 1 -- 172.21.15.81:0/3424296449 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0006d350 con 0x7fea0006ddf0 2023-10-06T02:46:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fea04889700 1 --2- 172.21.15.81:0/3424296449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0006ddf0 0x7fea0006e270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00098e0 tx=0x7fe9f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b3eef3114ab53c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fe9feffd700 1 -- 172.21.15.81:0/3424296449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0009e80 con 0x7fea0006ddf0 2023-10-06T02:46:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7fe9feffd700 1 -- 172.21.15.81:0/3424296449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f000b860 con 0x7fea0006ddf0 2023-10-06T02:46:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fe9feffd700 1 -- 172.21.15.81:0/3424296449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000bbe0 con 0x7fea0006ddf0 2023-10-06T02:46:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.037+0000 7f594e7fc700 1 -- 172.21.15.81:0/227315159 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5950013630 con 0x7f5960161220 2023-10-06T02:46:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f594e7fc700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5940066f30 0x7f59400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f594e7fc700 1 -- 172.21.15.81:0/227315159 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5950084220 con 0x7f5960161220 2023-10-06T02:46:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f595e59c700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5940066f30 0x7f59400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.038+0000 7f595e59c700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5940066f30 0x7f59400693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5954007d50 tx=0x7f5954015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3116cb8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3110155c60 0x7f3110157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fefb4122700 1 -- 172.21.15.81:0/289302380 shutdown_connections 2023-10-06T02:46:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3116cb8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3110155c60 0x7f3110157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38988/0 (socket says 172.21.15.81:38988) 2023-10-06T02:46:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fefb4122700 1 -- 172.21.15.81:0/289302380 wait complete. 2023-10-06T02:46:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3116cb8700 1 -- 172.21.15.81:0/965307059 learned_addr learned my addr 172.21.15.81:0/965307059 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f31164b7700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31100cb840 0x7f311014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3115cb6700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31100cbc90 0x7f3110157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3116cb8700 1 -- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31100cb840 msgr2=0x7f311014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3116cb8700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31100cb840 0x7f311014c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3116cb8700 1 -- 172.21.15.81:0/965307059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31100cbc90 msgr2=0x7f3110157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3116cb8700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31100cbc90 0x7f3110157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3116cb8700 1 -- 172.21.15.81:0/965307059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3104009420 con 0x7f3110155c60 2023-10-06T02:46:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7f3116cb8700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3110155c60 0x7f3110157db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f310000b720 tx=0x7f3100005fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fea062ec700 1 -- 172.21.15.81:0/3424296449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0006ddf0 msgr2=0x7fea0006e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fea062ec700 1 --2- 172.21.15.81:0/3424296449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0006ddf0 0x7fea0006e270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00098e0 tx=0x7fe9f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fea062ec700 1 -- 172.21.15.81:0/3424296449 shutdown_connections 2023-10-06T02:46:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fea062ec700 1 --2- 172.21.15.81:0/3424296449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0006ddf0 0x7fea0006e270 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fea062ec700 1 --2- 172.21.15.81:0/3424296449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea00069290 0x7fea000cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fea062ec700 1 -- 172.21.15.81:0/3424296449 >> 172.21.15.81:0/3424296449 conn(0x7fea000cc980 msgr2=0x7fea000ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fea062ec700 1 -- 172.21.15.81:0/3424296449 shutdown_connections 2023-10-06T02:46:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.039+0000 7fea062ec700 1 -- 172.21.15.81:0/3424296449 wait complete. 2023-10-06T02:46:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.040+0000 7fc4be0df700 1 Processor -- start 2023-10-06T02:46:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.040+0000 7fc4be0df700 1 -- start start 2023-10-06T02:46:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.040+0000 7fefb4122700 1 Processor -- start 2023-10-06T02:46:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.040+0000 7fefb4122700 1 -- start start 2023-10-06T02:46:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7f9c4634f700 1 Processor -- start 2023-10-06T02:46:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7f9c4634f700 1 -- start start 2023-10-06T02:46:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fea062ec700 1 Processor -- start 2023-10-06T02:46:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fea062ec700 1 -- start start 2023-10-06T02:46:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4be0df700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc4b80c8880 0x7fc4b806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4be0df700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4b8157130 0x7fc4b81575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4be0df700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b806ac50 con 0x7fc4b8156d60 2023-10-06T02:46:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4be0df700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b806a400 con 0x7fc4b80c8880 2023-10-06T02:46:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4be0df700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80c8fd0 con 0x7fc4b8157130 2023-10-06T02:46:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4b6ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc4b80c8880 0x7fc4b806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4b6ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc4b80c8880 0x7fc4b806b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38998/0 (socket says 172.21.15.81:38998) 2023-10-06T02:46:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4b6ffd700 1 -- 172.21.15.81:0/353650988 learned_addr learned my addr 172.21.15.81:0/353650988 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fefb4122700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 0x7fefac15f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fefb4122700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefac0af190 0x7fefac16e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fefb4122700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefac0c2870 0x7fefac1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fefb4122700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac16ebe0 con 0x7fefac0af190 2023-10-06T02:46:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fefb4122700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac16eec0 con 0x7fefac0aedc0 2023-10-06T02:46:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fefb4122700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac16f1a0 con 0x7fefac0c2870 2023-10-06T02:46:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4b6ffd700 1 -- 172.21.15.81:0/353650988 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4b8157130 msgr2=0x7fc4b81575d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4b6ffd700 1 --2- 172.21.15.81:0/353650988 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4b8157130 0x7fc4b81575d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4b6ffd700 1 -- 172.21.15.81:0/353650988 >> v1:172.21.15.81:6789/0 conn(0x7fc4b8156d60 legacy=0x7fc4b806ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.041+0000 7fc4b6ffd700 1 -- 172.21.15.81:0/353650988 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80c8cf0 con 0x7fc4b80c8880 2023-10-06T02:46:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb1ebe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 0x7fefac15f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb1ebe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 0x7fefac15f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:39000/0 (socket says 172.21.15.81:39000) 2023-10-06T02:46:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb1ebe700 1 -- 172.21.15.81:0/1160670456 learned_addr learned my addr 172.21.15.81:0/1160670456 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb26bf700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefac0c2870 0x7fefac1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fc4b6ffd700 1 --2- 172.21.15.81:0/353650988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b80c8880 0x7fc4b806b0e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800bc50 tx=0x7fc4a800b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67d52b8998e7a4ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fb2c890f700 1 Processor -- start 2023-10-06T02:46:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb1ebe700 1 -- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefac0c2870 msgr2=0x7fefac1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb1ebe700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefac0c2870 0x7fefac1553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb1ebe700 1 -- 172.21.15.81:0/1160670456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefac0af190 msgr2=0x7fefac16e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb1ebe700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefac0af190 0x7fefac16e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb1ebe700 1 -- 172.21.15.81:0/1160670456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c009420 con 0x7fefac0aedc0 2023-10-06T02:46:18.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fb2c890f700 1 -- start start 2023-10-06T02:46:18.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fea062ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00069290 0x7fea0017f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fea062ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0006ddf0 0x7fea000c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fea062ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0016a2b0 0x7fea000aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fea062ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea000c6920 con 0x7fea00069290 2023-10-06T02:46:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fea062ec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0017ef80 con 0x7fea0006ddf0 2023-10-06T02:46:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fea062ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000c4a30 con 0x7fea0016a2b0 2023-10-06T02:46:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c4634f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c401414f0 0x7f9c400caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c4634f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9c4006d930 0x7f9c40069670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c4634f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c400691e0 con 0x7f9c400cb450 2023-10-06T02:46:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c4634f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c400cba20 con 0x7f9c4006d930 2023-10-06T02:46:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c4634f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c400cbd00 con 0x7f9c401414f0 2023-10-06T02:46:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fe9fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00069290 0x7fea0017f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fea04889700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0016a2b0 0x7fea000aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fe9fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00069290 0x7fea0017f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56936/0 (socket says 172.21.15.81:56936) 2023-10-06T02:46:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fe9fffff700 1 -- 172.21.15.81:0/3188283836 learned_addr learned my addr 172.21.15.81:0/3188283836 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fefb1ebe700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 0x7fefac15f970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0030c0 tx=0x7fef9c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c3ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c401414f0 0x7f9c400caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c3f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9c400cb450 0x7f9c4006d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58180/0 (socket says 172.21.15.81:58180) 2023-10-06T02:46:18.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c3ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c401414f0 0x7f9c400caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:49138/0 (socket says 172.21.15.81:49138) 2023-10-06T02:46:18.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c3f7fe700 1 -- 172.21.15.81:0/2272607983 learned_addr learned my addr 172.21.15.81:0/2272607983 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:18.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7f9c448ec700 1 --2- 172.21.15.81:0/2272607983 >> v2:172.21.15.83:3300/0 conn(0x7f9c4006d930 0x7f9c40069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.042+0000 7fe9ff7fe700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0006ddf0 0x7fea000c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fe9fffff700 1 -- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0016a2b0 msgr2=0x7fea000aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fe9fffff700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0016a2b0 0x7fea000aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fe9fffff700 1 -- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0006ddf0 msgr2=0x7fea000c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fe9fffff700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0006ddf0 0x7fea000c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fe9fffff700 1 -- 172.21.15.81:0/3188283836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f0009420 con 0x7fea00069290 2023-10-06T02:46:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f9c448ec700 1 -- 172.21.15.81:0/2272607983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c401414f0 msgr2=0x7f9c400caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f9c3effd700 1 -- 172.21.15.81:0/2272607983 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189042966 0 0) 0x7f9c400691e0 con 0x7f9c400cb450 2023-10-06T02:46:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f9c448ec700 1 --2- 172.21.15.81:0/2272607983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c401414f0 0x7f9c400caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f9c448ec700 1 -- 172.21.15.81:0/2272607983 >> v1:172.21.15.81:6789/0 conn(0x7f9c400cb450 legacy=0x7f9c4006d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f9c448ec700 1 -- 172.21.15.81:0/2272607983 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c40068e70 con 0x7f9c4006d930 2023-10-06T02:46:18.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fe9ff7fe700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0006ddf0 0x7fea000c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:18.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fe9fffff700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00069290 0x7fea0017f410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800cb40 tx=0x7fe9f8007540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f310e7fc700 1 -- 172.21.15.81:0/965307059 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000f770 con 0x7f3110155c60 2023-10-06T02:46:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fefa1ffb700 1 -- 172.21.15.81:0/1160670456 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00b990 con 0x7fefac0aedc0 2023-10-06T02:46:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac16f480 con 0x7fefac0aedc0 2023-10-06T02:46:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f9c448ec700 1 --2- 172.21.15.81:0/2272607983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4006d930 0x7f9c40069670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c340098e0 tx=0x7f9c340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6d73f4adfaf938 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fc4b67fc700 1 -- 172.21.15.81:0/353650988 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a800be60 con 0x7fc4b80c8880 2023-10-06T02:46:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31100c5480 con 0x7f3110155c60 2023-10-06T02:46:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f310e7fc700 1 -- 172.21.15.81:0/965307059 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000f8f0 con 0x7f3110155c60 2023-10-06T02:46:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fc4b67fc700 1 -- 172.21.15.81:0/353650988 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a800ddc0 con 0x7fc4b80c8880 2023-10-06T02:46:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fc4b67fc700 1 -- 172.21.15.81:0/353650988 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80106a0 con 0x7fc4b80c8880 2023-10-06T02:46:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f310e7fc700 1 -- 172.21.15.81:0/965307059 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000fcb0 con 0x7f3110155c60 2023-10-06T02:46:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31100c5a40 con 0x7f3110155c60 2023-10-06T02:46:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f594e7fc700 1 -- 172.21.15.81:0/227315159 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5950051330 con 0x7f5960161220 2023-10-06T02:46:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac155920 con 0x7fefac0aedc0 2023-10-06T02:46:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f9c3effd700 1 -- 172.21.15.81:0/2272607983 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34009e80 con 0x7f9c4006d930 2023-10-06T02:46:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f9c3effd700 1 -- 172.21.15.81:0/2272607983 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3400b860 con 0x7f9c4006d930 2023-10-06T02:46:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7f9c3effd700 1 -- 172.21.15.81:0/2272607983 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400bbe0 con 0x7f9c4006d930 2023-10-06T02:46:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fb2c890f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb2c415e230 0x7fb2c40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fb2c890f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e600 0x7fb2c4069120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c890f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c406c520 con 0x7fb2c40cc620 2023-10-06T02:46:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c890f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c406bc30 con 0x7fb2c415e230 2023-10-06T02:46:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c890f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c406bed0 con 0x7fb2c415e600 2023-10-06T02:46:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c1d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e600 0x7fb2c4069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c259c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb2c415e230 0x7fb2c40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c1d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e600 0x7fb2c4069120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:49162/0 (socket says 172.21.15.81:49162) 2023-10-06T02:46:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c259c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb2c415e230 0x7fb2c40c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:39028/0 (socket says 172.21.15.81:39028) 2023-10-06T02:46:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c1d9b700 1 -- 172.21.15.81:0/555032299 learned_addr learned my addr 172.21.15.81:0/555032299 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c1d9b700 1 -- 172.21.15.81:0/555032299 >> v2:172.21.15.83:3300/0 conn(0x7fb2c415e230 msgr2=0x7fb2c40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c1d9b700 1 --2- 172.21.15.81:0/555032299 >> v2:172.21.15.83:3300/0 conn(0x7fb2c415e230 0x7fb2c40c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c1d9b700 1 -- 172.21.15.81:0/555032299 >> v1:172.21.15.83:6789/0 conn(0x7fb2c40cc620 legacy=0x7fb2c406c9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c1d9b700 1 -- 172.21.15.81:0/555032299 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c406c1b0 con 0x7fb2c415e600 2023-10-06T02:46:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c1d9b700 1 --2- 172.21.15.81:0/555032299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e600 0x7fb2c4069120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009f20 tx=0x7fb2bc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35921dc0c177170a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fe9e7fff700 1 -- 172.21.15.81:0/3188283836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800a7e0 con 0x7fea00069290 2023-10-06T02:46:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fe9e7fff700 1 -- 172.21.15.81:0/3188283836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f800a940 con 0x7fea00069290 2023-10-06T02:46:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fe9e7fff700 1 -- 172.21.15.81:0/3188283836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800ad00 con 0x7fea00069290 2023-10-06T02:46:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.043+0000 7fefa1ffb700 1 -- 172.21.15.81:0/1160670456 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c020070 con 0x7fefac0aedc0 2023-10-06T02:46:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fefa1ffb700 1 -- 172.21.15.81:0/1160670456 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c01b450 con 0x7fefac0aedc0 2023-10-06T02:46:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7fb2c159a700 1 -- 172.21.15.81:0/555032299 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00e070 con 0x7fb2c415e600 2023-10-06T02:46:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0017e970 con 0x7fea00069290 2023-10-06T02:46:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fb2c159a700 1 -- 172.21.15.81:0/555032299 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc00b990 con 0x7fb2c415e600 2023-10-06T02:46:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fb2c159a700 1 -- 172.21.15.81:0/555032299 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0092e0 con 0x7fb2c415e600 2023-10-06T02:46:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0017ec10 con 0x7fea00069290 2023-10-06T02:46:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fc4be0df700 1 -- 172.21.15.81:0/353650988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b80c8880 msgr2=0x7fc4b806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fc4be0df700 1 --2- 172.21.15.81:0/353650988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b80c8880 0x7fc4b806b0e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800bc50 tx=0x7fc4a800b4f0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31100c6240 con 0x7f3110155c60 2023-10-06T02:46:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fc4be0df700 1 -- 172.21.15.81:0/353650988 shutdown_connections 2023-10-06T02:46:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fc4be0df700 1 --2- 172.21.15.81:0/353650988 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4b8157130 0x7fc4b81575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fc4be0df700 1 --2- 172.21.15.81:0/353650988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b80c8880 0x7fc4b806b0e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fc4be0df700 1 -- 172.21.15.81:0/353650988 >> 172.21.15.81:0/353650988 conn(0x7fc4b80c9ca0 msgr2=0x7fc4b80ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fb2c890f700 1 -- 172.21.15.81:0/555032299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e600 msgr2=0x7fb2c4069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.045+0000 7fb2c890f700 1 --2- 172.21.15.81:0/555032299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e600 0x7fb2c4069120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009f20 tx=0x7fb2bc009840 comp rx=0 tx=0).stop 2023-10-06T02:46:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.046+0000 7fc4be0df700 1 -- 172.21.15.81:0/353650988 shutdown_connections 2023-10-06T02:46:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.046+0000 7f310e7fc700 1 -- 172.21.15.81:0/965307059 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3100010670 con 0x7f3110155c60 2023-10-06T02:46:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7f310e7fc700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f30f80670d0 0x7f30f8069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7f310e7fc700 1 -- 172.21.15.81:0/965307059 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3100084fa0 con 0x7f3110155c60 2023-10-06T02:46:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7f31164b7700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f30f80670d0 0x7f30f8069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7f31164b7700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f30f80670d0 0x7f30f8069580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31040093f0 tx=0x7f3104019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e00052b0 con 0x7fea00069290 2023-10-06T02:46:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7fe9e7fff700 1 -- 172.21.15.81:0/3188283836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9f8012630 con 0x7fea00069290 2023-10-06T02:46:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7fe9e7fff700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec067080 0x7fe9ec069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7fe9e7fff700 1 -- 172.21.15.81:0/3188283836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe9f8084b00 con 0x7fea00069290 2023-10-06T02:46:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7fe9ff7fe700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec067080 0x7fe9ec069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.046+0000 7fefa1ffb700 1 -- 172.21.15.81:0/1160670456 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef9c022030 con 0x7fefac0aedc0 2023-10-06T02:46:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.046+0000 7fefa1ffb700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef90066f30 0x7fef900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.046+0000 7fefa1ffb700 1 -- 172.21.15.81:0/1160670456 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fef9c0865c0 con 0x7fefac0aedc0 2023-10-06T02:46:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.047+0000 7fefb16bd700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef90066f30 0x7fef900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fefb16bd700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef90066f30 0x7fef900693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fefac156250 tx=0x7fefa8006ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fb2c890f700 1 -- 172.21.15.81:0/555032299 shutdown_connections 2023-10-06T02:46:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fb2c890f700 1 --2- 172.21.15.81:0/555032299 >> v2:172.21.15.83:3300/0 conn(0x7fb2c415e230 0x7fb2c40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fb2c890f700 1 --2- 172.21.15.81:0/555032299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e600 0x7fb2c4069120 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fb2c890f700 1 -- 172.21.15.81:0/555032299 >> 172.21.15.81:0/555032299 conn(0x7fb2c40c9ca0 msgr2=0x7fb2c40ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fb2c890f700 1 -- 172.21.15.81:0/555032299 shutdown_connections 2023-10-06T02:46:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fb2c890f700 1 -- 172.21.15.81:0/555032299 wait complete. 2023-10-06T02:46:18.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.046+0000 7fc4be0df700 1 -- 172.21.15.81:0/353650988 wait complete. 2023-10-06T02:46:18.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fc4be0df700 1 Processor -- start 2023-10-06T02:46:18.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fe9ff7fe700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec067080 0x7fe9ec069530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea000c3450 tx=0x7fe9f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.048+0000 7fc4be0df700 1 -- start start 2023-10-06T02:46:18.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7f9c4634f700 1 -- 172.21.15.81:0/2272607983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4006d930 msgr2=0x7f9c40069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.044+0000 7f9c4634f700 1 --2- 172.21.15.81:0/2272607983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4006d930 0x7f9c40069670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c340098e0 tx=0x7f9c340091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4be0df700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4b80c8880 0x7fc4b814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4be0df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b8156d60 0x7fc4b80b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4be0df700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b8157130 0x7fc4b80c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4be0df700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8159570 con 0x7fc4b8156d60 2023-10-06T02:46:18.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4be0df700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8158960 con 0x7fc4b8157130 2023-10-06T02:46:18.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4be0df700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8158c40 con 0x7fc4b80c8880 2023-10-06T02:46:18.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4b6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b8156d60 0x7fc4b80b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4b77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4b80c8880 0x7fc4b814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4b6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b8156d60 0x7fc4b80b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56948/0 (socket says 172.21.15.81:56948) 2023-10-06T02:46:18.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4b6ffd700 1 -- 172.21.15.81:0/3002723299 learned_addr learned my addr 172.21.15.81:0/3002723299 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fc4b7fff700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b8157130 0x7fc4b80c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.049+0000 7fb2c890f700 1 Processor -- start 2023-10-06T02:46:18.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fb2c890f700 1 -- start start 2023-10-06T02:46:18.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7f9c4634f700 1 -- 172.21.15.81:0/2272607983 shutdown_connections 2023-10-06T02:46:18.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7f9c4634f700 1 --2- 172.21.15.81:0/2272607983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c401414f0 0x7f9c400caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7f9c4634f700 1 --2- 172.21.15.81:0/2272607983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c4006d930 0x7f9c40069670 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7f9c4634f700 1 -- 172.21.15.81:0/2272607983 >> 172.21.15.81:0/2272607983 conn(0x7f9c400cc980 msgr2=0x7f9c400ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fc4b6ffd700 1 -- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4b80c8880 msgr2=0x7fc4b814e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fc4b6ffd700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4b80c8880 0x7fc4b814e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fc4b6ffd700 1 -- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b8157130 msgr2=0x7fc4b80c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fc4b6ffd700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b8157130 0x7fc4b80c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fc4b6ffd700 1 -- 172.21.15.81:0/3002723299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a800b790 con 0x7fc4b8156d60 2023-10-06T02:46:18.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fc4b6ffd700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b8156d60 0x7fc4b80b09e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800b530 tx=0x7fc4a801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7f9c4634f700 1 -- 172.21.15.81:0/2272607983 shutdown_connections 2023-10-06T02:46:18.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fb2c890f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2c40cc620 0x7fb2c40b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fb2c890f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e230 0x7fb2c415f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7f9c4634f700 1 -- 172.21.15.81:0/2272607983 wait complete. 2023-10-06T02:46:18.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fb2c890f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c415e600 0x7fb2c4171c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fb2c890f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c415f9d0 con 0x7fb2c415e600 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fb2c890f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c41721c0 con 0x7fb2c40cc620 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.050+0000 7fb2c890f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4154040 con 0x7fb2c415e230 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2c40cc620 0x7fb2c40b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2c40cc620 0x7fb2c40b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:39044/0 (socket says 172.21.15.81:39044) 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c259c700 1 -- 172.21.15.81:0/3443134361 learned_addr learned my addr 172.21.15.81:0/3443134361 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c1d9b700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e230 0x7fb2c415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c2d9d700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c415e600 0x7fb2c4171c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c259c700 1 -- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e230 msgr2=0x7fb2c415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c259c700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e230 0x7fb2c415f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c259c700 1 -- 172.21.15.81:0/3443134361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c415e600 msgr2=0x7fb2c4171c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c259c700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c415e600 0x7fb2c4171c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c259c700 1 -- 172.21.15.81:0/3443134361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc009ae0 con 0x7fb2c40cc620 2023-10-06T02:46:18.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2c259c700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2c40cc620 0x7fb2c40b0da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800ec80 tx=0x7fb2b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2b27fc700 1 -- 172.21.15.81:0/3443134361 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800c850 con 0x7fb2c40cc620 2023-10-06T02:46:18.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2b27fc700 1 -- 172.21.15.81:0/3443134361 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b800c9b0 con 0x7fb2c40cc620 2023-10-06T02:46:18.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.051+0000 7fb2b27fc700 1 -- 172.21.15.81:0/3443134361 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800cd50 con 0x7fb2c40cc620 2023-10-06T02:46:18.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.052+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c41601f0 con 0x7fb2c40cc620 2023-10-06T02:46:18.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.052+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c41607b0 con 0x7fb2c40cc620 2023-10-06T02:46:18.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.052+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c0052b0 con 0x7fefac0aedc0 2023-10-06T02:46:18.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.052+0000 7f9c4634f700 1 Processor -- start 2023-10-06T02:46:18.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.052+0000 7f9c4634f700 1 -- start start 2023-10-06T02:46:18.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.052+0000 7f310e7fc700 1 -- 172.21.15.81:0/965307059 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31100c6240 con 0x7f3110155c60 2023-10-06T02:46:18.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fea85a81700 1 Processor -- start 2023-10-06T02:46:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fea85a81700 1 -- start start 2023-10-06T02:46:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c4634f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4006d930 0x7f9c400c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c4634f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c400cb450 0x7f9c4013f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c4634f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c401414f0 0x7f9c4016c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c4634f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4012dd10 con 0x7f9c4006d930 2023-10-06T02:46:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c4634f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4012eb70 con 0x7f9c401414f0 2023-10-06T02:46:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c4634f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4012df60 con 0x7f9c400cb450 2023-10-06T02:46:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c4068080 con 0x7fb2c40cc620 2023-10-06T02:46:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c448ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c401414f0 0x7f9c4016c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c3f7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c400cb450 0x7f9c4013f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c448ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c401414f0 0x7f9c4016c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:39048/0 (socket says 172.21.15.81:39048) 2023-10-06T02:46:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c448ec700 1 -- 172.21.15.81:0/1945751292 learned_addr learned my addr 172.21.15.81:0/1945751292 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fe9e7fff700 1 -- 172.21.15.81:0/3188283836 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9f8051b70 con 0x7fea00069290 2023-10-06T02:46:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fc49f7fe700 1 -- 172.21.15.81:0/3002723299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80237a0 con 0x7fc4b8156d60 2023-10-06T02:46:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fc49f7fe700 1 -- 172.21.15.81:0/3002723299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a8023900 con 0x7fc4b8156d60 2023-10-06T02:46:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fc4be0df700 1 -- 172.21.15.81:0/3002723299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b8158f20 con 0x7fc4b8156d60 2023-10-06T02:46:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fb2b27fc700 1 -- 172.21.15.81:0/3443134361 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2b8013680 con 0x7fb2c40cc620 2023-10-06T02:46:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fc49f7fe700 1 -- 172.21.15.81:0/3002723299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8023ca0 con 0x7fc4b8156d60 2023-10-06T02:46:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7fc4be0df700 1 -- 172.21.15.81:0/3002723299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b814e790 con 0x7fc4b8156d60 2023-10-06T02:46:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.054+0000 7fb2b27fc700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2a4066fb0 0x7fb2a4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.054+0000 7fb2b27fc700 1 -- 172.21.15.81:0/3443134361 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2b8084920 con 0x7fb2c40cc620 2023-10-06T02:46:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.054+0000 7fea85a81700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fea800aeea0 0x7fea800c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.054+0000 7fea85a81700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea800af270 0x7fea800c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.054+0000 7fea85a81700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea800c7d00 0x7fea800c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.054+0000 7fea85a81700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8006aae0 con 0x7fea800c7d00 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.054+0000 7fea85a81700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea80069ed0 con 0x7fea800aeea0 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.054+0000 7fea85a81700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8006a1b0 con 0x7fea800af270 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea800c7d00 0x7fea800c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea800c7d00 0x7fea800c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56964/0 (socket says 172.21.15.81:56964) 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7ffff700 1 -- 172.21.15.81:0/1460207190 learned_addr learned my addr 172.21.15.81:0/1460207190 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7ffff700 1 -- 172.21.15.81:0/1460207190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea800af270 msgr2=0x7fea800c2e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7ffff700 1 --2- 172.21.15.81:0/1460207190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea800af270 0x7fea800c2e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7ffff700 1 -- 172.21.15.81:0/1460207190 >> v2:172.21.15.83:3300/0 conn(0x7fea800aeea0 msgr2=0x7fea800c2920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7ffff700 1 --2- 172.21.15.81:0/1460207190 >> v2:172.21.15.83:3300/0 conn(0x7fea800aeea0 0x7fea800c2920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7ffff700 1 -- 172.21.15.81:0/1460207190 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8006a490 con 0x7fea800c7d00 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7ffff700 1 --2- 172.21.15.81:0/1460207190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800c7d00 0x7fea800c8140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea8006f710 tx=0x7fea74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e19c346e2974a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7e7fc700 1 -- 172.21.15.81:0/1460207190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400b8f0 con 0x7fea800c7d00 2023-10-06T02:46:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fea7e7fc700 1 -- 172.21.15.81:0/1460207190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7400ba50 con 0x7fea800c7d00 2023-10-06T02:46:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.056+0000 7fea7e7fc700 1 -- 172.21.15.81:0/1460207190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400bdf0 con 0x7fea800c7d00 2023-10-06T02:46:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.056+0000 7fea85a81700 1 -- 172.21.15.81:0/1460207190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800c7d00 msgr2=0x7fea800c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.056+0000 7fea85a81700 1 --2- 172.21.15.81:0/1460207190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800c7d00 0x7fea800c8140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea8006f710 tx=0x7fea74009250 comp rx=0 tx=0).stop 2023-10-06T02:46:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fc49d7fa700 1 -- 172.21.15.81:0/3002723299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b8068080 con 0x7fc4b8156d60 2023-10-06T02:46:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.055+0000 7fc49f7fe700 1 -- 172.21.15.81:0/3002723299 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4a8018730 con 0x7fc4b8156d60 2023-10-06T02:46:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.056+0000 7fc49f7fe700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4a4067000 0x7fc4a40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.056+0000 7fc49f7fe700 1 -- 172.21.15.81:0/3002723299 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc4a8014070 con 0x7fc4b8156d60 2023-10-06T02:46:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.056+0000 7fc4b77fe700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4a4067000 0x7fc4a40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.056+0000 7fc4b77fe700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4a4067000 0x7fc4a40694b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac006fd0 tx=0x7fc4ac0090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.057+0000 7fefa1ffb700 1 -- 172.21.15.81:0/1160670456 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef9c0536d0 con 0x7fefac0aedc0 2023-10-06T02:46:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c448ec700 1 -- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c400cb450 msgr2=0x7f9c4013f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c448ec700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c400cb450 0x7f9c4013f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c448ec700 1 -- 172.21.15.81:0/1945751292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4006d930 msgr2=0x7f9c400c5fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:46:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c448ec700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4006d930 0x7f9c400c5fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.053+0000 7f9c448ec700 1 -- 172.21.15.81:0/1945751292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c34009420 con 0x7f9c401414f0 2023-10-06T02:46:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.060+0000 7fb2c1d9b700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2a4066fb0 0x7fb2a4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.060+0000 7fb2c1d9b700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2a4066fb0 0x7fb2a4069460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009880 tx=0x7fb2bc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.061+0000 7fb2b27fc700 1 -- 172.21.15.81:0/3443134361 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2b8051990 con 0x7fb2c40cc620 2023-10-06T02:46:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.063+0000 7fc49f7fe700 1 -- 172.21.15.81:0/3002723299 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4a80570b0 con 0x7fc4b8156d60 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.064+0000 7f9c448ec700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c401414f0 0x7f9c4016c490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c34013000 tx=0x7f9c34017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.064+0000 7f9c27fff700 1 -- 172.21.15.81:0/1945751292 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34011420 con 0x7f9c401414f0 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.064+0000 7f9c27fff700 1 -- 172.21.15.81:0/1945751292 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c34011580 con 0x7f9c401414f0 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.064+0000 7f9c27fff700 1 -- 172.21.15.81:0/1945751292 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34011940 con 0x7f9c401414f0 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.065+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4012e240 con 0x7f9c401414f0 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.065+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4012e800 con 0x7f9c401414f0 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.067+0000 7f9c27fff700 1 -- 172.21.15.81:0/1945751292 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c34011d30 con 0x7f9c401414f0 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.068+0000 7f9c27fff700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c2c066f30 0x7f9c2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.068+0000 7f9c27fff700 1 -- 172.21.15.81:0/1945751292 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c34085d20 con 0x7f9c401414f0 2023-10-06T02:46:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.068+0000 7f9c3ffff700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c2c066f30 0x7f9c2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.068+0000 7f9c3ffff700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c2c066f30 0x7f9c2c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c400c53b0 tx=0x7f9c38009a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.069+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4012ece0 con 0x7f9c401414f0 2023-10-06T02:46:18.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.074+0000 7f9c27fff700 1 -- 172.21.15.81:0/1945751292 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c34052ed0 con 0x7f9c401414f0 2023-10-06T02:46:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.078+0000 7fea85a81700 1 -- 172.21.15.81:0/1460207190 shutdown_connections 2023-10-06T02:46:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.078+0000 7fea85a81700 1 --2- 172.21.15.81:0/1460207190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800c7d00 0x7fea800c8140 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.078+0000 7fea85a81700 1 --2- 172.21.15.81:0/1460207190 >> v2:172.21.15.83:3300/0 conn(0x7fea800aeea0 0x7fea800c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.078+0000 7fea85a81700 1 --2- 172.21.15.81:0/1460207190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea800af270 0x7fea800c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.078+0000 7fea85a81700 1 -- 172.21.15.81:0/1460207190 >> 172.21.15.81:0/1460207190 conn(0x7fea8006c660 msgr2=0x7fea800cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.078+0000 7fea85a81700 1 -- 172.21.15.81:0/1460207190 shutdown_connections 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.078+0000 7fea85a81700 1 -- 172.21.15.81:0/1460207190 wait complete. 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.080+0000 7fea85a81700 1 Processor -- start 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.080+0000 7fea85a81700 1 -- start start 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.081+0000 7fea85a81700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea800aeea0 0x7fea8016cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.081+0000 7fea85a81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800af270 0x7fea80177210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.081+0000 7fea85a81700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea800c7d00 0x7fea800b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.081+0000 7fea85a81700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea80178220 con 0x7fea800af270 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.081+0000 7fea85a81700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea80178560 con 0x7fea800c7d00 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.081+0000 7fea85a81700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea80177c60 con 0x7fea800aeea0 2023-10-06T02:46:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.082+0000 7fea7effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800af270 0x7fea80177210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.082+0000 7fea7effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800af270 0x7fea80177210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56966/0 (socket says 172.21.15.81:56966) 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.082+0000 7fea7effd700 1 -- 172.21.15.81:0/3736003947 learned_addr learned my addr 172.21.15.81:0/3736003947 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.083+0000 7fea7f7fe700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea800aeea0 0x7fea8016cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.083+0000 7fea7effd700 1 -- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea800aeea0 msgr2=0x7fea8016cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.083+0000 7fea7effd700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea800aeea0 0x7fea8016cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.083+0000 7fea7effd700 1 -- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea800c7d00 msgr2=0x7fea800b1aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.083+0000 7fea7effd700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea800c7d00 0x7fea800b1aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.083+0000 7fea7effd700 1 -- 172.21.15.81:0/3736003947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea740094f0 con 0x7fea800af270 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.084+0000 7fea7effd700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800af270 0x7fea80177210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea7000b600 tx=0x7fea700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.085+0000 7fea6f7fe700 1 -- 172.21.15.81:0/3736003947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7000f510 con 0x7fea800af270 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.085+0000 7fea6f7fe700 1 -- 172.21.15.81:0/3736003947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7000f670 con 0x7fea800af270 2023-10-06T02:46:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.085+0000 7fea6f7fe700 1 -- 172.21.15.81:0/3736003947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7000fa30 con 0x7fea800af270 2023-10-06T02:46:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.085+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea80177f40 con 0x7fea800af270 2023-10-06T02:46:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.085+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8016d4e0 con 0x7fea800af270 2023-10-06T02:46:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.088+0000 7fea6f7fe700 1 -- 172.21.15.81:0/3736003947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea7001a400 con 0x7fea800af270 2023-10-06T02:46:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.088+0000 7fea6f7fe700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea680671e0 0x7fea68069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.088+0000 7fea6f7fe700 1 -- 172.21.15.81:0/3736003947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea700840e0 con 0x7fea800af270 2023-10-06T02:46:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.093+0000 7fea7f7fe700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea680671e0 0x7fea68069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.094+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea640052b0 con 0x7fea800af270 2023-10-06T02:46:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.103+0000 7fea6f7fe700 1 -- 172.21.15.81:0/3736003947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea70051250 con 0x7fea800af270 2023-10-06T02:46:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.104+0000 7fea7f7fe700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea680671e0 0x7fea68069690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea800ae9f0 tx=0x7fea78007420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.428+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9e0005560 con 0x7fea00069290 2023-10-06T02:46:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.429+0000 7fe9e7fff700 1 -- 172.21.15.81:0/3188283836 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9f800ae60 con 0x7fea00069290 2023-10-06T02:46:18.431 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.430+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5944005830 con 0x7f5960161220 2023-10-06T02:46:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.430+0000 7f594e7fc700 1 -- 172.21.15.81:0/227315159 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5950054950 con 0x7f5960161220 2023-10-06T02:46:18.433 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:18.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.432+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec067080 msgr2=0x7fe9ec069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.432+0000 7fea062ec700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec067080 0x7fe9ec069530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea000c3450 tx=0x7fe9f4008040 comp rx=0 tx=0).stop 2023-10-06T02:46:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.432+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00069290 msgr2=0x7fea0017f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.432+0000 7fea062ec700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00069290 0x7fea0017f410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800cb40 tx=0x7fe9f8007540 comp rx=0 tx=0).stop 2023-10-06T02:46:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.433+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 shutdown_connections 2023-10-06T02:46:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.433+0000 7fea062ec700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0016a2b0 0x7fea000aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.433+0000 7fea062ec700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00069290 0x7fea0017f410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.433+0000 7fea062ec700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec067080 0x7fe9ec069530 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.433+0000 7fea062ec700 1 --2- 172.21.15.81:0/3188283836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea0006ddf0 0x7fea000c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.433+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 >> 172.21.15.81:0/3188283836 conn(0x7fea000cc980 msgr2=0x7fea00167950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.433+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 shutdown_connections 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.434+0000 7fea062ec700 1 -- 172.21.15.81:0/3188283836 wait complete. 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.434+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5940066f30 msgr2=0x7f59400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.434+0000 7f5964de0700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5940066f30 0x7f59400693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5954007d50 tx=0x7f5954015000 comp rx=0 tx=0).stop 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.434+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5960161220 msgr2=0x7f59600a68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.434+0000 7f5964de0700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5960161220 0x7f59600a68c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f595000ebc0 tx=0x7f5950001d80 comp rx=0 tx=0).stop 2023-10-06T02:46:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 shutdown_connections 2023-10-06T02:46:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7f5964de0700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59600a6e00 0x7f59600cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7f5964de0700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5948003ae0 0x7f59600ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7f5964de0700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5940066f30 0x7f59400693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7f5964de0700 1 --2- 172.21.15.81:0/227315159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5960161220 0x7f59600a68c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 >> 172.21.15.81:0/227315159 conn(0x7f596006cca0 msgr2=0x7f596006a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 shutdown_connections 2023-10-06T02:46:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7f5964de0700 1 -- 172.21.15.81:0/227315159 wait complete. 2023-10-06T02:46:18.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb2c40c9a20 con 0x7fb2c40cc620 2023-10-06T02:46:18.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.437+0000 7fb2b27fc700 1 -- 172.21.15.81:0/3443134361 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2b8054fb0 con 0x7fb2c40cc620 2023-10-06T02:46:18.440 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:18.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2a4066fb0 msgr2=0x7fb2a4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2a4066fb0 0x7fb2a4069460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009880 tx=0x7fb2bc017000 comp rx=0 tx=0).stop 2023-10-06T02:46:18.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2c40cc620 msgr2=0x7fb2c40b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2c40cc620 0x7fb2c40b0da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800ec80 tx=0x7fb2b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 shutdown_connections 2023-10-06T02:46:18.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c415e600 0x7fb2c4171c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2a4066fb0 0x7fb2a4069460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2c40cc620 0x7fb2c40b0da0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 --2- 172.21.15.81:0/3443134361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2c415e230 0x7fb2c415f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 >> 172.21.15.81:0/3443134361 conn(0x7fb2c40c9ca0 msgr2=0x7fb2c4156880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.440+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 shutdown_connections 2023-10-06T02:46:18.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.441+0000 7fb2c890f700 1 -- 172.21.15.81:0/3443134361 wait complete. 2023-10-06T02:46:18.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.443+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f311006fcc0 con 0x7f3110155c60 2023-10-06T02:46:18.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.443+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fef8c005830 con 0x7fefac0aedc0 2023-10-06T02:46:18.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.444+0000 7f310e7fc700 1 -- 172.21.15.81:0/965307059 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f310001f070 con 0x7f3110155c60 2023-10-06T02:46:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.448+0000 7fefa1ffb700 1 -- 172.21.15.81:0/1160670456 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef9c056cf0 con 0x7fefac0aedc0 2023-10-06T02:46:18.451 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:18.452 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fc49d7fa700 1 -- 172.21.15.81:0/3002723299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc4b804bb80 con 0x7fc4b8156d60 2023-10-06T02:46:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef90066f30 msgr2=0x7fef900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef90066f30 0x7fef900693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fefac156250 tx=0x7fefa8006ce0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 msgr2=0x7fefac15f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 0x7fefac15f970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0030c0 tx=0x7fef9c016000 comp rx=0 tx=0).stop 2023-10-06T02:46:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fc49f7fe700 1 -- 172.21.15.81:0/3002723299 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4a8028090 con 0x7fc4b8156d60 2023-10-06T02:46:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 shutdown_connections 2023-10-06T02:46:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fefac0c2870 0x7fefac1553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef90066f30 0x7fef900693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefac0aedc0 0x7fefac15f970 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 --2- 172.21.15.81:0/1160670456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefac0af190 0x7fefac16e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 >> 172.21.15.81:0/1160670456 conn(0x7fefac06c660 msgr2=0x7fefac1621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 shutdown_connections 2023-10-06T02:46:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.451+0000 7fefb4122700 1 -- 172.21.15.81:0/1160670456 wait complete. 2023-10-06T02:46:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.452+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f30f80670d0 msgr2=0x7f30f8069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.452+0000 7f311871b700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f30f80670d0 0x7f30f8069580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31040093f0 tx=0x7f3104019000 comp rx=0 tx=0).stop 2023-10-06T02:46:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.452+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3110155c60 msgr2=0x7f3110157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.452+0000 7f311871b700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3110155c60 0x7f3110157db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f310000b720 tx=0x7f3100005fe0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.455+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9c400b28c0 con 0x7f9c401414f0 2023-10-06T02:46:18.458 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 -- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4a4067000 msgr2=0x7fc4a40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4a4067000 0x7fc4a40694b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac006fd0 tx=0x7fc4ac0090f0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 -- 172.21.15.81:0/3002723299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b8156d60 msgr2=0x7fc4b80b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b8156d60 0x7fc4b80b09e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800b530 tx=0x7fc4a801a000 comp rx=0 tx=0).stop 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 -- 172.21.15.81:0/3002723299 shutdown_connections 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc4a4067000 0x7fc4a40694b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b8157130 0x7fc4b80c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4b80c8880 0x7fc4b814e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 --2- 172.21.15.81:0/3002723299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b8156d60 0x7fc4b80b09e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 -- 172.21.15.81:0/3002723299 >> 172.21.15.81:0/3002723299 conn(0x7fc4b80c9ca0 msgr2=0x7fc4b8150100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 -- 172.21.15.81:0/3002723299 shutdown_connections 2023-10-06T02:46:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.454+0000 7fc49d7fa700 1 -- 172.21.15.81:0/3002723299 wait complete. 2023-10-06T02:46:18.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-06T02:46:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.456+0000 7f9c27fff700 1 -- 172.21.15.81:0/1945751292 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c34028070 con 0x7f9c401414f0 2023-10-06T02:46:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.456+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 shutdown_connections 2023-10-06T02:46:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.456+0000 7f311871b700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f30f80670d0 0x7f30f8069580 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.456+0000 7f311871b700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3110155c60 0x7f3110157db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.456+0000 7f311871b700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31100cb840 0x7f311014c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.456+0000 7f311871b700 1 --2- 172.21.15.81:0/965307059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31100cbc90 0x7f3110157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.456+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 >> 172.21.15.81:0/965307059 conn(0x7f31100cc980 msgr2=0x7f31100c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.462 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.457+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 shutdown_connections 2023-10-06T02:46:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.457+0000 7f311871b700 1 -- 172.21.15.81:0/965307059 wait complete. 2023-10-06T02:46:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.459+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c2c066f30 msgr2=0x7f9c2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.459+0000 7f9c4634f700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c2c066f30 0x7f9c2c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c400c53b0 tx=0x7f9c38009a10 comp rx=0 tx=0).stop 2023-10-06T02:46:18.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.459+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c401414f0 msgr2=0x7f9c4016c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.459+0000 7f9c4634f700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c401414f0 0x7f9c4016c490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c34013000 tx=0x7f9c34017000 comp rx=0 tx=0).stop 2023-10-06T02:46:18.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-06T02:46:18.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-06T02:46:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.464+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 shutdown_connections 2023-10-06T02:46:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.464+0000 7f9c4634f700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c2c066f30 0x7f9c2c0693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.464+0000 7f9c4634f700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c401414f0 0x7f9c4016c490 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.464+0000 7f9c4634f700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4006d930 0x7f9c400c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.464+0000 7f9c4634f700 1 --2- 172.21.15.81:0/1945751292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c400cb450 0x7f9c4013f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.464+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 >> 172.21.15.81:0/1945751292 conn(0x7f9c400cc980 msgr2=0x7f9c400aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.464+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 shutdown_connections 2023-10-06T02:46:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.464+0000 7f9c4634f700 1 -- 172.21.15.81:0/1945751292 wait complete. 2023-10-06T02:46:18.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-06T02:46:18.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-06T02:46:18.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-06T02:46:18.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.479+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fea64005560 con 0x7fea800af270 2023-10-06T02:46:18.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.479+0000 7fea6f7fe700 1 -- 172.21.15.81:0/3736003947 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea70054870 con 0x7fea800af270 2023-10-06T02:46:18.481 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:18.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea680671e0 msgr2=0x7fea68069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-06T02:46:18.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea680671e0 0x7fea68069690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea800ae9f0 tx=0x7fea78007420 comp rx=0 tx=0).stop 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800af270 msgr2=0x7fea80177210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800af270 0x7fea80177210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea7000b600 tx=0x7fea700091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 shutdown_connections 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea680671e0 0x7fea68069690 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea800c7d00 0x7fea800b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea800aeea0 0x7fea8016cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 --2- 172.21.15.81:0/3736003947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea800af270 0x7fea80177210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 >> 172.21.15.81:0/3736003947 conn(0x7fea8006c660 msgr2=0x7fea800c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 shutdown_connections 2023-10-06T02:46:18.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:18.482+0000 7fea85a81700 1 -- 172.21.15.81:0/3736003947 wait complete. 2023-10-06T02:46:18.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-06T02:46:19.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T02:46:19.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T02:46:19.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T02:46:19.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T02:46:19.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T02:46:19.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T02:46:19.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T02:46:19.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T02:46:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.634+0000 7f90d4023700 1 Processor -- start 2023-10-06T02:46:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.634+0000 7f90d4023700 1 -- start start 2023-10-06T02:46:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.636+0000 7f90d4023700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f90cc156030 0x7f90cc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.636+0000 7f90d4023700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90cc0ca550 con 0x7f90cc155c60 2023-10-06T02:46:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.636+0000 7f90d4023700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90cc0cb3b0 con 0x7f90cc0c8d50 2023-10-06T02:46:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.636+0000 7f90d4023700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc0c9170 con 0x7f90cc156030 2023-10-06T02:46:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.636+0000 7f90d1dbf700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f90cc155c60 0x7f90cc0cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58186/0 (socket says 172.21.15.81:58186) 2023-10-06T02:46:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.636+0000 7f90d1dbf700 1 -- 172.21.15.81:0/4097382899 learned_addr learned my addr 172.21.15.81:0/4097382899 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.637+0000 7f90d15be700 1 --2- 172.21.15.81:0/4097382899 >> v2:172.21.15.83:3300/0 conn(0x7f90cc156030 0x7f90cc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.637+0000 7f90d15be700 1 -- 172.21.15.81:0/4097382899 >> v1:172.21.15.83:6789/0 conn(0x7f90cc0c8d50 legacy=0x7f90cc159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.637+0000 7f90d15be700 1 -- 172.21.15.81:0/4097382899 >> v1:172.21.15.81:6789/0 conn(0x7f90cc155c60 legacy=0x7f90cc0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.637+0000 7f90d15be700 1 -- 172.21.15.81:0/4097382899 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0cbf50 con 0x7f90cc156030 2023-10-06T02:46:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.637+0000 7f90d15be700 1 --2- 172.21.15.81:0/4097382899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90cc156030 0x7f90cc0c8810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f90c400af70 tx=0x7f90c400a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a0363efe11f61c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.638+0000 7f90d0dbd700 1 -- 172.21.15.81:0/4097382899 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400a2e0 con 0x7f90cc156030 2023-10-06T02:46:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.638+0000 7f90d0dbd700 1 -- 172.21.15.81:0/4097382899 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c400ca70 con 0x7f90cc156030 2023-10-06T02:46:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.638+0000 7f90d0dbd700 1 -- 172.21.15.81:0/4097382899 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400ce30 con 0x7f90cc156030 2023-10-06T02:46:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.639+0000 7f90d4023700 1 -- 172.21.15.81:0/4097382899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90cc156030 msgr2=0x7f90cc0c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.639+0000 7f90d4023700 1 --2- 172.21.15.81:0/4097382899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90cc156030 0x7f90cc0c8810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f90c400af70 tx=0x7f90c400a890 comp rx=0 tx=0).stop 2023-10-06T02:46:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.639+0000 7f90d4023700 1 -- 172.21.15.81:0/4097382899 shutdown_connections 2023-10-06T02:46:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.639+0000 7f90d4023700 1 --2- 172.21.15.81:0/4097382899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90cc156030 0x7f90cc0c8810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.639+0000 7f90d4023700 1 -- 172.21.15.81:0/4097382899 >> 172.21.15.81:0/4097382899 conn(0x7f90cc0cc980 msgr2=0x7f90cc0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.639+0000 7f90d4023700 1 -- 172.21.15.81:0/4097382899 shutdown_connections 2023-10-06T02:46:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.639+0000 7f90d4023700 1 -- 172.21.15.81:0/4097382899 wait complete. 2023-10-06T02:46:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.641+0000 7f90d4023700 1 Processor -- start 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.641+0000 7f90d4023700 1 -- start start 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.642+0000 7f90d4023700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90cc0c8d50 0x7f90cc06f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.642+0000 7f90d4023700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90cc155c60 0x7f90cc137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.642+0000 7f90d4023700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90cc156030 0x7f90cc148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.642+0000 7f90d4023700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc149cf0 con 0x7f90cc156030 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.642+0000 7f90d4023700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc137890 con 0x7f90cc0c8d50 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.642+0000 7f90d4023700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0c57a0 con 0x7f90cc155c60 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.643+0000 7f90d25c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90cc156030 0x7f90cc148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.643+0000 7f90d25c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90cc156030 0x7f90cc148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56980/0 (socket says 172.21.15.81:56980) 2023-10-06T02:46:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.643+0000 7f90d25c0700 1 -- 172.21.15.81:0/3195563953 learned_addr learned my addr 172.21.15.81:0/3195563953 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.643+0000 7f90d25c0700 1 -- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90cc155c60 msgr2=0x7f90cc137350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:46:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.643+0000 7f90d25c0700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90cc155c60 0x7f90cc137350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.643+0000 7f90d25c0700 1 -- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90cc0c8d50 msgr2=0x7f90cc06f850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:46:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.643+0000 7f90d25c0700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90cc0c8d50 0x7f90cc06f850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.643+0000 7f90d25c0700 1 -- 172.21.15.81:0/3195563953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c400ab30 con 0x7f90cc156030 2023-10-06T02:46:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.644+0000 7f90d25c0700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90cc156030 0x7f90cc148960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00c490 tx=0x7f90bc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.645+0000 7f90c1ffb700 1 -- 172.21.15.81:0/3195563953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc011590 con 0x7f90cc156030 2023-10-06T02:46:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.645+0000 7f90c1ffb700 1 -- 172.21.15.81:0/3195563953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc0116f0 con 0x7f90cc156030 2023-10-06T02:46:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.645+0000 7f90c1ffb700 1 -- 172.21.15.81:0/3195563953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc011ab0 con 0x7f90cc156030 2023-10-06T02:46:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.645+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90cc148ea0 con 0x7f90cc156030 2023-10-06T02:46:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.645+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc149450 con 0x7f90cc156030 2023-10-06T02:46:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.649+0000 7f90c1ffb700 1 -- 172.21.15.81:0/3195563953 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90bc012420 con 0x7f90cc156030 2023-10-06T02:46:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.649+0000 7f90c1ffb700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90b8067210 0x7f90b80696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.649+0000 7f90c1ffb700 1 -- 172.21.15.81:0/3195563953 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f90bc083ab0 con 0x7f90cc156030 2023-10-06T02:46:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.651+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac0052b0 con 0x7f90cc156030 2023-10-06T02:46:19.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.657+0000 7f90d1dbf700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90b8067210 0x7f90b80696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.660+0000 7f90c1ffb700 1 -- 172.21.15.81:0/3195563953 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90bc04b5a0 con 0x7f90cc156030 2023-10-06T02:46:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.678+0000 7f90d1dbf700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90b8067210 0x7f90b80696c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004890 tx=0x7f90c8005ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.700+0000 7f85c57a6700 1 Processor -- start 2023-10-06T02:46:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.700+0000 7f85c57a6700 1 -- start start 2023-10-06T02:46:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85c57a6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85c0156d60 0x7f85c006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85c57a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c0157130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85c57a6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f85c0157670 0x7f85c00cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85c57a6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c006a400 con 0x7f85c0156d60 2023-10-06T02:46:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85c57a6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c006ac50 con 0x7f85c0157670 2023-10-06T02:46:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85c57a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c8fd0 con 0x7f85c006ceb0 2023-10-06T02:46:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85beffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85c0156d60 0x7f85c006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85beffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85c0156d60 0x7f85c006b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56994/0 (socket says 172.21.15.81:56994) 2023-10-06T02:46:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85beffd700 1 -- 172.21.15.81:0/2132625670 learned_addr learned my addr 172.21.15.81:0/2132625670 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85bf7fe700 1 --2- 172.21.15.81:0/2132625670 >> v2:172.21.15.83:3300/0 conn(0x7f85c0157670 0x7f85c00cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85be7fc700 1 --2- 172.21.15.81:0/2132625670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c0157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85beffd700 1 -- 172.21.15.81:0/2132625670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 msgr2=0x7f85c0157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85beffd700 1 --2- 172.21.15.81:0/2132625670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c0157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85beffd700 1 -- 172.21.15.81:0/2132625670 >> v2:172.21.15.83:3300/0 conn(0x7f85c0157670 msgr2=0x7f85c00cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85beffd700 1 --2- 172.21.15.81:0/2132625670 >> v2:172.21.15.83:3300/0 conn(0x7f85c0157670 0x7f85c00cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85beffd700 1 -- 172.21.15.81:0/2132625670 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00c8cf0 con 0x7f85c0156d60 2023-10-06T02:46:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85be7fc700 1 --2- 172.21.15.81:0/2132625670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c0157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f85beffd700 1 --2- 172.21.15.81:0/2132625670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0156d60 0x7f85c006b0e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85c0067cd0 tx=0x7f85b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7149dfdb905df9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.702+0000 7f77c99ed700 1 Processor -- start 2023-10-06T02:46:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.703+0000 7fd8249a0700 1 Processor -- start 2023-10-06T02:46:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.703+0000 7f77c99ed700 1 -- start start 2023-10-06T02:46:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.703+0000 7fd8249a0700 1 -- start start 2023-10-06T02:46:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd8249a0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd82006d120 0x7fd82006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd8249a0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8200cf660 0x7fd8200cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd8249a0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82006df90 con 0x7fd82015e3c0 2023-10-06T02:46:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd8249a0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8200b3ba0 con 0x7fd82006d120 2023-10-06T02:46:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd8249a0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82015f7b0 con 0x7fd8200cf660 2023-10-06T02:46:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd81ed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8200cf660 0x7fd8200cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd81ed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8200cf660 0x7fd8200cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:49228/0 (socket says 172.21.15.81:49228) 2023-10-06T02:46:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd81ed9d700 1 -- 172.21.15.81:0/3464106113 learned_addr learned my addr 172.21.15.81:0/3464106113 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c99ed700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f77c4159ca0 0x7f77c40690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c99ed700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f77c406a780 0x7f77c40cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c99ed700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c406a2f0 con 0x7f77c415a070 2023-10-06T02:46:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c99ed700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c40c9010 con 0x7f77c406a780 2023-10-06T02:46:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c99ed700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c40696e0 con 0x7f77c4159ca0 2023-10-06T02:46:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c2ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f77c4159ca0 0x7f77c40690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c2ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f77c4159ca0 0x7f77c40690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:39100/0 (socket says 172.21.15.81:39100) 2023-10-06T02:46:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c2ffd700 1 -- 172.21.15.81:0/404100795 learned_addr learned my addr 172.21.15.81:0/404100795 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd81dd9b700 1 --2- 172.21.15.81:0/3464106113 >> v2:172.21.15.81:3300/0 conn(0x7fd82006d120 0x7fd82006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd81ed9d700 1 -- 172.21.15.81:0/3464106113 >> v2:172.21.15.81:3300/0 conn(0x7fd82006d120 msgr2=0x7fd82006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd81ed9d700 1 --2- 172.21.15.81:0/3464106113 >> v2:172.21.15.81:3300/0 conn(0x7fd82006d120 0x7fd82006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd81ed9d700 1 -- 172.21.15.81:0/3464106113 >> v1:172.21.15.81:6789/0 conn(0x7fd82015e3c0 legacy=0x7fd8200cd750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7fd81ed9d700 1 -- 172.21.15.81:0/3464106113 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82006dad0 con 0x7fd8200cf660 2023-10-06T02:46:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c2ffd700 1 -- 172.21.15.81:0/404100795 >> v2:172.21.15.81:3300/0 conn(0x7f77c406a780 msgr2=0x7f77c40cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c2ffd700 1 --2- 172.21.15.81:0/404100795 >> v2:172.21.15.81:3300/0 conn(0x7f77c406a780 0x7f77c40cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c2ffd700 1 -- 172.21.15.81:0/404100795 >> v1:172.21.15.81:6789/0 conn(0x7f77c415a070 legacy=0x7f77c40c8900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.704+0000 7f77c2ffd700 1 -- 172.21.15.81:0/404100795 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c40699c0 con 0x7f77c4159ca0 2023-10-06T02:46:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.705+0000 7fd81ed9d700 1 --2- 172.21.15.81:0/3464106113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8200cf660 0x7fd8200cfaa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd818009f20 tx=0x7fd818009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8aae028d22442f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.705+0000 7f77c2ffd700 1 --2- 172.21.15.81:0/404100795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c4159ca0 0x7f77c40690e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77c406b0c0 tx=0x7f77b4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9394565a9113a895 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.706+0000 7fd81d59a700 1 -- 172.21.15.81:0/3464106113 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81800e070 con 0x7fd8200cf660 2023-10-06T02:46:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.706+0000 7fd81d59a700 1 -- 172.21.15.81:0/3464106113 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81800ba40 con 0x7fd8200cf660 2023-10-06T02:46:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.706+0000 7fd81d59a700 1 -- 172.21.15.81:0/3464106113 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180092e0 con 0x7fd8200cf660 2023-10-06T02:46:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.706+0000 7f77c1ffb700 1 -- 172.21.15.81:0/404100795 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b400b820 con 0x7f77c4159ca0 2023-10-06T02:46:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.706+0000 7f77c1ffb700 1 -- 172.21.15.81:0/404100795 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b400b980 con 0x7f77c4159ca0 2023-10-06T02:46:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.706+0000 7f77c1ffb700 1 -- 172.21.15.81:0/404100795 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b400bd20 con 0x7f77c4159ca0 2023-10-06T02:46:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.706+0000 7fd8249a0700 1 -- 172.21.15.81:0/3464106113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8200cf660 msgr2=0x7fd8200cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.706+0000 7fd8249a0700 1 --2- 172.21.15.81:0/3464106113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8200cf660 0x7fd8200cfaa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd818009f20 tx=0x7fd818009840 comp rx=0 tx=0).stop 2023-10-06T02:46:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7f77c99ed700 1 -- 172.21.15.81:0/404100795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c4159ca0 msgr2=0x7f77c40690e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7f77c99ed700 1 --2- 172.21.15.81:0/404100795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c4159ca0 0x7f77c40690e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77c406b0c0 tx=0x7f77b4009250 comp rx=0 tx=0).stop 2023-10-06T02:46:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7f77c99ed700 1 -- 172.21.15.81:0/404100795 shutdown_connections 2023-10-06T02:46:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7f77c99ed700 1 --2- 172.21.15.81:0/404100795 >> v2:172.21.15.81:3300/0 conn(0x7f77c406a780 0x7f77c40cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7f77c99ed700 1 --2- 172.21.15.81:0/404100795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c4159ca0 0x7f77c40690e0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77c406b0c0 tx=0x7f77b4009250 comp rx=0 tx=0).stop 2023-10-06T02:46:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7f77c99ed700 1 -- 172.21.15.81:0/404100795 >> 172.21.15.81:0/404100795 conn(0x7f77c40cc980 msgr2=0x7f77c40ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7fd8249a0700 1 -- 172.21.15.81:0/3464106113 shutdown_connections 2023-10-06T02:46:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7fd8249a0700 1 --2- 172.21.15.81:0/3464106113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8200cf660 0x7fd8200cfaa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7fd8249a0700 1 --2- 172.21.15.81:0/3464106113 >> v2:172.21.15.81:3300/0 conn(0x7fd82006d120 0x7fd82006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7fd8249a0700 1 -- 172.21.15.81:0/3464106113 >> 172.21.15.81:0/3464106113 conn(0x7fd82006bb90 msgr2=0x7fd82006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:19.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7fd8249a0700 1 -- 172.21.15.81:0/3464106113 shutdown_connections 2023-10-06T02:46:19.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.707+0000 7fd8249a0700 1 -- 172.21.15.81:0/3464106113 wait complete. 2023-10-06T02:46:19.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.708+0000 7fd8249a0700 1 Processor -- start 2023-10-06T02:46:19.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.708+0000 7f85bdffb700 1 -- 172.21.15.81:0/2132625670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0009e70 con 0x7f85c0156d60 2023-10-06T02:46:19.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.708+0000 7f85bdffb700 1 -- 172.21.15.81:0/2132625670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b000b860 con 0x7f85c0156d60 2023-10-06T02:46:19.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.708+0000 7f85bdffb700 1 -- 172.21.15.81:0/2132625670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b000bc00 con 0x7f85c0156d60 2023-10-06T02:46:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.708+0000 7fd16f367700 1 Processor -- start 2023-10-06T02:46:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.708+0000 7fd16f367700 1 -- start start 2023-10-06T02:46:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f85c57a6700 1 -- 172.21.15.81:0/2132625670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0156d60 msgr2=0x7f85c006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2132625670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0156d60 0x7f85c006b0e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85c0067cd0 tx=0x7f85b0009250 comp rx=0 tx=0).stop 2023-10-06T02:46:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f77c99ed700 1 -- 172.21.15.81:0/404100795 shutdown_connections 2023-10-06T02:46:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f85c57a6700 1 -- 172.21.15.81:0/2132625670 shutdown_connections 2023-10-06T02:46:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2132625670 >> v2:172.21.15.83:3300/0 conn(0x7f85c0157670 0x7f85c00cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2132625670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0156d60 0x7f85c006b0e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2132625670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c0157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f85c57a6700 1 -- 172.21.15.81:0/2132625670 >> 172.21.15.81:0/2132625670 conn(0x7f85c00c9ca0 msgr2=0x7f85c00ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f85c57a6700 1 -- 172.21.15.81:0/2132625670 shutdown_connections 2023-10-06T02:46:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7fd16f367700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd168155c60 0x7fd168156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7fd16f367700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1680ca550 con 0x7fd1680c8810 2023-10-06T02:46:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7fd16f367700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1680cb3b0 con 0x7fd1680cd490 2023-10-06T02:46:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7fd16f367700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1680cbf50 con 0x7fd168155c60 2023-10-06T02:46:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7fd16d904700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd1680c8810 0x7fd168159ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58198/0 (socket says 172.21.15.81:58198) 2023-10-06T02:46:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7fd16d904700 1 -- 172.21.15.81:0/904900862 learned_addr learned my addr 172.21.15.81:0/904900862 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7fd16d103700 1 --2- 172.21.15.81:0/904900862 >> v2:172.21.15.83:3300/0 conn(0x7fd168155c60 0x7fd168156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f85c57a6700 1 -- 172.21.15.81:0/2132625670 wait complete. 2023-10-06T02:46:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7fd8249a0700 1 -- start start 2023-10-06T02:46:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd8249a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd82006d120 0x7fd820160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd8249a0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8200cf660 0x7fd8200c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd8249a0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd82015e3c0 0x7fd820149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd8249a0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd820161910 con 0x7fd82006d120 2023-10-06T02:46:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd8249a0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd820162cd0 con 0x7fd8200cf660 2023-10-06T02:46:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd8249a0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd820161350 con 0x7fd82015e3c0 2023-10-06T02:46:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859535459 0 0) 0x7fd1680cb3b0 con 0x7fd1680cd490 2023-10-06T02:46:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd154003570 con 0x7fd1680cd490 2023-10-06T02:46:19.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd81ed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd82015e3c0 0x7fd820149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd81ed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd82015e3c0 0x7fd820149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:49236/0 (socket says 172.21.15.81:49236) 2023-10-06T02:46:19.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd81ed9d700 1 -- 172.21.15.81:0/734250282 learned_addr learned my addr 172.21.15.81:0/734250282 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3657292276 0 0) 0x7fd154003570 con 0x7fd1680cd490 2023-10-06T02:46:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 >> v2:172.21.15.83:3300/0 conn(0x7fd168155c60 msgr2=0x7fd168156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 --2- 172.21.15.81:0/904900862 >> v2:172.21.15.83:3300/0 conn(0x7fd168155c60 0x7fd168156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 >> v1:172.21.15.81:6789/0 conn(0x7fd1680c8810 legacy=0x7fd168159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1680ca7a0 con 0x7fd1680cd490 2023-10-06T02:46:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fd164001470 con 0x7fd1680cd490 2023-10-06T02:46:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 >> v1:172.21.15.83:6789/0 conn(0x7fd1680cd490 legacy=0x7fd1680cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd154003ab0 0x7fd154003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd154004810 0x7fd154004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd81ed9d700 1 -- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8200cf660 msgr2=0x7fd8200c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd81ed9d700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8200cf660 0x7fd8200c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd81ed9d700 1 -- 172.21.15.81:0/734250282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd82006d120 msgr2=0x7fd820160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd81ed9d700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd82006d120 0x7fd820160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd81ed9d700 1 -- 172.21.15.81:0/734250282 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818009ae0 con 0x7fd82015e3c0 2023-10-06T02:46:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1540052e0 0x7fd15400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680cbf50 con 0x7fd154003ab0 2023-10-06T02:46:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15400c1e0 con 0x7fd154004810 2023-10-06T02:46:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15400c3a0 con 0x7fd1540052e0 2023-10-06T02:46:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.710+0000 7fd16d904700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1540052e0 0x7fd15400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd81ed9d700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd82015e3c0 0x7fd820149e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd82015f8f0 tx=0x7fd818017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd16c902700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd154004810 0x7fd154004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd80e7fc700 1 -- 172.21.15.81:0/734250282 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818012e60 con 0x7fd82015e3c0 2023-10-06T02:46:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd80e7fc700 1 -- 172.21.15.81:0/734250282 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8180092e0 con 0x7fd82015e3c0 2023-10-06T02:46:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd820161630 con 0x7fd82015e3c0 2023-10-06T02:46:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.709+0000 7f77c99ed700 1 -- 172.21.15.81:0/404100795 wait complete. 2023-10-06T02:46:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7f77c99ed700 1 Processor -- start 2023-10-06T02:46:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd16c902700 1 -- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1540052e0 msgr2=0x7fd15400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd16c902700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1540052e0 0x7fd15400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd16c902700 1 -- 172.21.15.81:0/904900862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd154003ab0 msgr2=0x7fd154003ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd16c902700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd154003ab0 0x7fd154003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd16c902700 1 -- 172.21.15.81:0/904900862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd154003570 con 0x7fd154004810 2023-10-06T02:46:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7f85c57a6700 1 Processor -- start 2023-10-06T02:46:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8200c6430 con 0x7fd82015e3c0 2023-10-06T02:46:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7fd80e7fc700 1 -- 172.21.15.81:0/734250282 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81801d650 con 0x7fd82015e3c0 2023-10-06T02:46:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7f85c57a6700 1 -- start start 2023-10-06T02:46:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7fd16d904700 1 -- 172.21.15.81:0/904900862 reap_dead start 2023-10-06T02:46:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7fd16c902700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd154004810 0x7fd154004c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd16400c160 tx=0x7fd1680cc090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=765971a07b01bb89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8040052b0 con 0x7fd82015e3c0 2023-10-06T02:46:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.711+0000 7f77c99ed700 1 -- start start 2023-10-06T02:46:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f77c99ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c406a780 0x7f77c4157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f77c99ed700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c40af890 0x7f77c40afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f77c99ed700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77c416b4c0 0x7f77c416b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f77c99ed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40b0b80 con 0x7f77c406a780 2023-10-06T02:46:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f77c99ed700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c415b900 con 0x7f77c40af890 2023-10-06T02:46:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f77c99ed700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c416be50 con 0x7f77c416b4c0 2023-10-06T02:46:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f85c57a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c01435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f85c57a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0156d60 0x7f85c00c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f85c57a6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85c0157670 0x7f85c00c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f85c57a6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0168b40 con 0x7f85c0156d60 2023-10-06T02:46:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f85c57a6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0168e20 con 0x7f85c0157670 2023-10-06T02:46:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f85c57a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0169100 con 0x7f85c006ceb0 2023-10-06T02:46:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7f77c27fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c40af890 0x7f77c40afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f77c27fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c40af890 0x7f77c40afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:39138/0 (socket says 172.21.15.81:39138) 2023-10-06T02:46:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f77c27fc700 1 -- 172.21.15.81:0/3494422896 learned_addr learned my addr 172.21.15.81:0/3494422896 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f77c37fe700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77c416b4c0 0x7f77c416b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f77c2ffd700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c406a780 0x7f77c4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7fd80e7fc700 1 -- 172.21.15.81:0/734250282 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd81801da40 con 0x7fd82015e3c0 2023-10-06T02:46:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.712+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164007a00 con 0x7fd154004810 2023-10-06T02:46:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16400ca50 con 0x7fd154004810 2023-10-06T02:46:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7fd15ffff700 1 -- 172.21.15.81:0/904900862 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400ce10 con 0x7fd154004810 2023-10-06T02:46:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85bf7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85c0157670 0x7f85c00c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85beffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c01435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85beffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c01435b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:49270/0 (socket says 172.21.15.81:49270) 2023-10-06T02:46:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85beffd700 1 -- 172.21.15.81:0/2603848305 learned_addr learned my addr 172.21.15.81:0/2603848305 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85be7fc700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0156d60 0x7f85c00c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7fad2ce0d700 1 Processor -- start 2023-10-06T02:46:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7fad2ce0d700 1 -- start start 2023-10-06T02:46:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f77c27fc700 1 -- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77c416b4c0 msgr2=0x7f77c416b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f77c27fc700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77c416b4c0 0x7f77c416b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f77c27fc700 1 -- 172.21.15.81:0/3494422896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c406a780 msgr2=0x7f77c4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f77c27fc700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c406a780 0x7f77c4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f77c27fc700 1 -- 172.21.15.81:0/3494422896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b40094f0 con 0x7f77c40af890 2023-10-06T02:46:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7fd80e7fc700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd800066f30 0x7fd8000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85beffd700 1 -- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85c0157670 msgr2=0x7f85c00c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85beffd700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85c0157670 0x7f85c00c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85beffd700 1 -- 172.21.15.81:0/2603848305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0156d60 msgr2=0x7f85c00c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85beffd700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0156d60 0x7f85c00c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85beffd700 1 -- 172.21.15.81:0/2603848305 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b00094f0 con 0x7f85c006ceb0 2023-10-06T02:46:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7fd80e7fc700 1 -- 172.21.15.81:0/734250282 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd818085ef0 con 0x7fd82015e3c0 2023-10-06T02:46:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7f85beffd700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c01435b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f85c006ebb0 tx=0x7f85b0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7fd16f367700 1 -- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd154004810 msgr2=0x7fd154004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.713+0000 7fd16f367700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd154004810 0x7fd154004c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd16400c160 tx=0x7fd1680cc090 comp rx=0 tx=0).stop 2023-10-06T02:46:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7f6058b04700 1 Processor -- start 2023-10-06T02:46:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fd16f367700 1 -- 172.21.15.81:0/904900862 shutdown_connections 2023-10-06T02:46:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fd16f367700 1 --2- 172.21.15.81:0/904900862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd154004810 0x7fd154004c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fd16f367700 1 -- 172.21.15.81:0/904900862 >> 172.21.15.81:0/904900862 conn(0x7fd1680cc980 msgr2=0x7fd1680ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7f77c27fc700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c40af890 0x7f77c40afd00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f77b800b5e0 tx=0x7f77b80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7f6058b04700 1 -- start start 2023-10-06T02:46:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fd81e59c700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd800066f30 0x7fd8000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7f77aaffd700 1 -- 172.21.15.81:0/3494422896 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800f510 con 0x7f77c40af890 2023-10-06T02:46:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7f77aaffd700 1 -- 172.21.15.81:0/3494422896 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b800f690 con 0x7f77c40af890 2023-10-06T02:46:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c40b02e0 con 0x7f77c40af890 2023-10-06T02:46:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7f77aaffd700 1 -- 172.21.15.81:0/3494422896 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800fa50 con 0x7f77c40af890 2023-10-06T02:46:19.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c40b08a0 con 0x7f77c40af890 2023-10-06T02:46:19.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fd81e59c700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd800066f30 0x7fd8000693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8140097c0 tx=0x7fd814006ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fd16f367700 1 -- 172.21.15.81:0/904900862 shutdown_connections 2023-10-06T02:46:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fad2ce0d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad28156420 0x7fad280cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fad2ce0d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fad280c71d0 0x7fad280c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fad2ce0d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad280c7b70 con 0x7fad280cc250 2023-10-06T02:46:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fad2ce0d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2806aa10 con 0x7fad28156420 2023-10-06T02:46:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fad2ce0d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad280cb880 con 0x7fad280c71d0 2023-10-06T02:46:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fad2659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad28156420 0x7fad280cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.714+0000 7fad2659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad28156420 0x7fad280cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57032/0 (socket says 172.21.15.81:57032) 2023-10-06T02:46:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7fad2659c700 1 -- 172.21.15.81:0/3687454435 learned_addr learned my addr 172.21.15.81:0/3687454435 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7fd16f367700 1 -- 172.21.15.81:0/904900862 wait complete. 2023-10-06T02:46:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7fde9c032700 1 Processor -- start 2023-10-06T02:46:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7f6058b04700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60540c8880 0x7f605406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7f6058b04700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6054157130 0x7f60541575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7f6058b04700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605406ac50 con 0x7f6054156d60 2023-10-06T02:46:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7f6058b04700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605406a400 con 0x7f6054157130 2023-10-06T02:46:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7f6058b04700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60540c8fd0 con 0x7f60540c8880 2023-10-06T02:46:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7fad2659c700 1 -- 172.21.15.81:0/3687454435 >> v2:172.21.15.83:3300/0 conn(0x7fad280c71d0 msgr2=0x7fad280c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7fad2659c700 1 --2- 172.21.15.81:0/3687454435 >> v2:172.21.15.83:3300/0 conn(0x7fad280c71d0 0x7fad280c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7fad2659c700 1 -- 172.21.15.81:0/3687454435 >> v1:172.21.15.83:6789/0 conn(0x7fad280cc250 legacy=0x7fad28069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7fad2659c700 1 -- 172.21.15.81:0/3687454435 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280cac70 con 0x7fad28156420 2023-10-06T02:46:19.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7f605259c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6054156d60 0x7f605406ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55388/0 (socket says 172.21.15.81:55388) 2023-10-06T02:46:19.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7f605259c700 1 -- 172.21.15.81:0/198865340 learned_addr learned my addr 172.21.15.81:0/198865340 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:19.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7fad2659c700 1 --2- 172.21.15.81:0/3687454435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad28156420 0x7fad280cbd10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad280c3680 tx=0x7fad2000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605a8a242ede057c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7f6052d9d700 1 --2- 172.21.15.81:0/198865340 >> v2:172.21.15.81:3300/0 conn(0x7f6054157130 0x7f60541575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7f6052d9d700 1 -- 172.21.15.81:0/198865340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60540c8880 msgr2=0x7f605406b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:19.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7f6052d9d700 1 --2- 172.21.15.81:0/198865340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60540c8880 0x7f605406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7f6052d9d700 1 -- 172.21.15.81:0/198865340 >> v1:172.21.15.83:6789/0 conn(0x7f6054156d60 legacy=0x7f605406ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7f6052d9d700 1 -- 172.21.15.81:0/198865340 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540c8cf0 con 0x7f6054157130 2023-10-06T02:46:19.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7fad2559a700 1 -- 172.21.15.81:0/3687454435 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20010070 con 0x7fad28156420 2023-10-06T02:46:19.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7fad2559a700 1 -- 172.21.15.81:0/3687454435 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2000dc40 con 0x7fad28156420 2023-10-06T02:46:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7fad2559a700 1 -- 172.21.15.81:0/3687454435 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20016440 con 0x7fad28156420 2023-10-06T02:46:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7f6052d9d700 1 --2- 172.21.15.81:0/198865340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054157130 0x7f60541575d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60440098e0 tx=0x7f60440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8768fea5ded11a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7f605159a700 1 -- 172.21.15.81:0/198865340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044009e80 con 0x7f6054157130 2023-10-06T02:46:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7f605159a700 1 -- 172.21.15.81:0/198865340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604400b860 con 0x7f6054157130 2023-10-06T02:46:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7f605159a700 1 -- 172.21.15.81:0/198865340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604400bc20 con 0x7f6054157130 2023-10-06T02:46:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7fd16f367700 1 Processor -- start 2023-10-06T02:46:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7fde9c032700 1 -- start start 2023-10-06T02:46:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7fde9c032700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fde940c2f80 0x7fde940c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7fde9c032700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940c9120 con 0x7fde940af190 2023-10-06T02:46:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7fde9c032700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940c7620 con 0x7fde940aedc0 2023-10-06T02:46:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.716+0000 7fde9c032700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9415e840 con 0x7fde940c2f80 2023-10-06T02:46:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.715+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c415b6d0 con 0x7f77c40af890 2023-10-06T02:46:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fad2ce0d700 1 -- 172.21.15.81:0/3687454435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad28156420 msgr2=0x7fad280cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fad2ce0d700 1 --2- 172.21.15.81:0/3687454435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad28156420 0x7fad280cbd10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad280c3680 tx=0x7fad2000ba50 comp rx=0 tx=0).stop 2023-10-06T02:46:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fde99dce700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fde940aedc0 0x7fde94068980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55390/0 (socket says 172.21.15.81:55390) 2023-10-06T02:46:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fde99dce700 1 -- 172.21.15.81:0/4004328185 learned_addr learned my addr 172.21.15.81:0/4004328185 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fd16f367700 1 -- start start 2023-10-06T02:46:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fde9a5cf700 1 --2- 172.21.15.81:0/4004328185 >> v2:172.21.15.83:3300/0 conn(0x7fde940c2f80 0x7fde940c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fad2ce0d700 1 -- 172.21.15.81:0/3687454435 shutdown_connections 2023-10-06T02:46:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fad2ce0d700 1 --2- 172.21.15.81:0/3687454435 >> v2:172.21.15.83:3300/0 conn(0x7fad280c71d0 0x7fad280c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fad2ce0d700 1 --2- 172.21.15.81:0/3687454435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad28156420 0x7fad280cbd10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fad2ce0d700 1 -- 172.21.15.81:0/3687454435 >> 172.21.15.81:0/3687454435 conn(0x7fad2806c660 msgr2=0x7fad280cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f6058b04700 1 -- 172.21.15.81:0/198865340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054157130 msgr2=0x7f60541575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f6058b04700 1 --2- 172.21.15.81:0/198865340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054157130 0x7f60541575d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60440098e0 tx=0x7f60440091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fde9a5cf700 1 -- 172.21.15.81:0/4004328185 >> v1:172.21.15.83:6789/0 conn(0x7fde940aedc0 legacy=0x7fde94068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fde9a5cf700 1 -- 172.21.15.81:0/4004328185 >> v1:172.21.15.81:6789/0 conn(0x7fde940af190 legacy=0x7fde940c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fde98dcc700 1 -- 172.21.15.81:0/4004328185 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083701230 0 0) 0x7fde940c9120 con 0x7fde940af190 2023-10-06T02:46:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fad2ce0d700 1 -- 172.21.15.81:0/3687454435 shutdown_connections 2023-10-06T02:46:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fde9a5cf700 1 -- 172.21.15.81:0/4004328185 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940c23e0 con 0x7fde940c2f80 2023-10-06T02:46:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7fad2ce0d700 1 -- 172.21.15.81:0/3687454435 wait complete. 2023-10-06T02:46:19.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f6058b04700 1 -- 172.21.15.81:0/198865340 shutdown_connections 2023-10-06T02:46:19.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f6058b04700 1 --2- 172.21.15.81:0/198865340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054157130 0x7f60541575d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f6058b04700 1 --2- 172.21.15.81:0/198865340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60540c8880 0x7f605406b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f6058b04700 1 -- 172.21.15.81:0/198865340 >> 172.21.15.81:0/198865340 conn(0x7f60540c9ca0 msgr2=0x7f60540ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:19.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f77aaffd700 1 -- 172.21.15.81:0/3494422896 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77b801a400 con 0x7f77c40af890 2023-10-06T02:46:19.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f77aaffd700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f77b0066fb0 0x7f77b0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f77aaffd700 1 -- 172.21.15.81:0/3494422896 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f77b8083f50 con 0x7f77c40af890 2023-10-06T02:46:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fde9a5cf700 1 --2- 172.21.15.81:0/4004328185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde940c2f80 0x7fde940c8b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e60 tx=0x7fde8c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc68b91d4d030d9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.717+0000 7f77c2ffd700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f77b0066fb0 0x7f77b0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7f6058b04700 1 -- 172.21.15.81:0/198865340 shutdown_connections 2023-10-06T02:46:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7f6058b04700 1 -- 172.21.15.81:0/198865340 wait complete. 2023-10-06T02:46:19.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7f77c2ffd700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f77b0066fb0 0x7f77b0069460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77c406b0c0 tx=0x7f77b4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16f367700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd154004810 0x7fd168177b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16f367700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1680c6120 0x7fd1680c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16f367700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168159920 0x7fd168159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16f367700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680c6ad0 con 0x7fd168159920 2023-10-06T02:46:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16f367700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16817a6f0 con 0x7fd1680c6120 2023-10-06T02:46:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16f367700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16817af90 con 0x7fd154004810 2023-10-06T02:46:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16d103700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd154004810 0x7fd168177b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16c902700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1680c6120 0x7fd1680c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16d103700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd154004810 0x7fd168177b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:49292/0 (socket says 172.21.15.81:49292) 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16d103700 1 -- 172.21.15.81:0/1782454557 learned_addr learned my addr 172.21.15.81:0/1782454557 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.718+0000 7fd16d904700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168159920 0x7fd168159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7fd16c902700 1 -- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd154004810 msgr2=0x7fd168177b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7fd16c902700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd154004810 0x7fd168177b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7fd16c902700 1 -- 172.21.15.81:0/1782454557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168159920 msgr2=0x7fd168159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7fd16c902700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168159920 0x7fd168159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7fd16c902700 1 -- 172.21.15.81:0/1782454557 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1681780d0 con 0x7fd1680c6120 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7fd16d904700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168159920 0x7fd168159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7fd16c902700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1680c6120 0x7fd1680c6590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd164013000 tx=0x7fd164017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7fad2ce0d700 1 Processor -- start 2023-10-06T02:46:19.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7fad2ce0d700 1 -- start start 2023-10-06T02:46:19.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7f6058b04700 1 Processor -- start 2023-10-06T02:46:19.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.719+0000 7f6058b04700 1 -- start start 2023-10-06T02:46:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad2ce0d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad280c71d0 0x7fad28142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad2ce0d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad280cc250 0x7fad281591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad2ce0d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad28156420 0x7fad281596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad2ce0d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad28156a40 con 0x7fad280cc250 2023-10-06T02:46:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad2ce0d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad28156ce0 con 0x7fad28156420 2023-10-06T02:46:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad2ce0d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad28156fc0 con 0x7fad280c71d0 2023-10-06T02:46:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad25d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad280cc250 0x7fad281591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad25d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad280cc250 0x7fad281591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57058/0 (socket says 172.21.15.81:57058) 2023-10-06T02:46:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad25d9b700 1 -- 172.21.15.81:0/2466260321 learned_addr learned my addr 172.21.15.81:0/2466260321 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad26d9d700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad28156420 0x7fad281596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad2659c700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad280c71d0 0x7fad28142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6058b04700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60540c8880 0x7f605414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6058b04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054156d60 0x7f605414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6058b04700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6054157130 0x7f60540c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6058b04700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540b10d0 con 0x7f6054156d60 2023-10-06T02:46:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6058b04700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6054156280 con 0x7f60540c8880 2023-10-06T02:46:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6058b04700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605414aae0 con 0x7f6054157130 2023-10-06T02:46:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad25d9b700 1 -- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad280c71d0 msgr2=0x7fad28142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad25d9b700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad280c71d0 0x7fad28142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad25d9b700 1 -- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad28156420 msgr2=0x7fad281596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad25d9b700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad28156420 0x7fad281596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad25d9b700 1 -- 172.21.15.81:0/2466260321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2000bcf0 con 0x7fad280cc250 2023-10-06T02:46:19.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f85a6ffd700 1 -- 172.21.15.81:0/2603848305 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b000b9d0 con 0x7f85c006ceb0 2023-10-06T02:46:19.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6051d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054156d60 0x7f605414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6051d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054156d60 0x7f605414f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57072/0 (socket says 172.21.15.81:57072) 2023-10-06T02:46:19.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6051d9b700 1 -- 172.21.15.81:0/1558322202 learned_addr learned my addr 172.21.15.81:0/1558322202 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c01693e0 con 0x7f85c006ceb0 2023-10-06T02:46:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f85a6ffd700 1 -- 172.21.15.81:0/2603848305 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b000bb30 con 0x7f85c006ceb0 2023-10-06T02:46:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f85a6ffd700 1 -- 172.21.15.81:0/2603848305 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0025650 con 0x7f85c006ceb0 2023-10-06T02:46:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c0143af0 con 0x7f85c006ceb0 2023-10-06T02:46:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad25d9b700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad280cc250 0x7fad281591b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad1800b600 tx=0x7fad180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f6052d9d700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6054157130 0x7f60540c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7f605259c700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60540c8880 0x7f605414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fd80e7fc700 1 -- 172.21.15.81:0/734250282 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd818053000 con 0x7fd82015e3c0 2023-10-06T02:46:19.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7f6051d9b700 1 -- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6054157130 msgr2=0x7f60540c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7f6051d9b700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6054157130 0x7f60540c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7f6051d9b700 1 -- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60540c8880 msgr2=0x7f605414a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7f6051d9b700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60540c8880 0x7f605414a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7f6051d9b700 1 -- 172.21.15.81:0/1558322202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044009420 con 0x7f6054156d60 2023-10-06T02:46:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.720+0000 7fad167fc700 1 -- 172.21.15.81:0/2466260321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800f510 con 0x7fad280cc250 2023-10-06T02:46:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad281572a0 con 0x7fad280cc250 2023-10-06T02:46:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7fad167fc700 1 -- 172.21.15.81:0/2466260321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1800f670 con 0x7fad280cc250 2023-10-06T02:46:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7fad167fc700 1 -- 172.21.15.81:0/2466260321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800fa30 con 0x7fad280cc250 2023-10-06T02:46:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad281428b0 con 0x7fad280cc250 2023-10-06T02:46:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.721+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c0168f60 con 0x7f85c006ceb0 2023-10-06T02:46:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.722+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad281577c0 con 0x7fad280cc250 2023-10-06T02:46:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.722+0000 7f6051d9b700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054156d60 0x7f605414f580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f604800b810 tx=0x7f6048009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.722+0000 7f85a6ffd700 1 -- 172.21.15.81:0/2603848305 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85b0023070 con 0x7f85c006ceb0 2023-10-06T02:46:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.722+0000 7f60427fc700 1 -- 172.21.15.81:0/1558322202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800f510 con 0x7f6054156d60 2023-10-06T02:46:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.722+0000 7f60427fc700 1 -- 172.21.15.81:0/1558322202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800f690 con 0x7f6054156d60 2023-10-06T02:46:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.722+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6054156520 con 0x7f6054156d60 2023-10-06T02:46:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.722+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60540b0d60 con 0x7f6054156d60 2023-10-06T02:46:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7f85a6ffd700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85ac066f30 0x7f85ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7f85a6ffd700 1 -- 172.21.15.81:0/2603848305 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f85b0085a50 con 0x7f85c006ceb0 2023-10-06T02:46:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7f85be7fc700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85ac066f30 0x7f85ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7fad167fc700 1 -- 172.21.15.81:0/2466260321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad18024430 con 0x7fad280cc250 2023-10-06T02:46:19.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7fd15d7fa700 1 -- 172.21.15.81:0/1782454557 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1640129c0 con 0x7fd1680c6120 2023-10-06T02:46:19.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7fd15d7fa700 1 -- 172.21.15.81:0/1782454557 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164021070 con 0x7fd1680c6120 2023-10-06T02:46:19.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7fd15d7fa700 1 -- 172.21.15.81:0/1782454557 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164012b40 con 0x7fd1680c6120 2023-10-06T02:46:19.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16815a710 con 0x7fd1680c6120 2023-10-06T02:46:19.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7f77aaffd700 1 -- 172.21.15.81:0/3494422896 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77c415b6d0 con 0x7f77c40af890 2023-10-06T02:46:19.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.724+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16817ac20 con 0x7fd1680c6120 2023-10-06T02:46:19.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.724+0000 7f60427fc700 1 -- 172.21.15.81:0/1558322202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800fa50 con 0x7f6054156d60 2023-10-06T02:46:19.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.724+0000 7fad167fc700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad08066f30 0x7fad080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.724+0000 7fad167fc700 1 -- 172.21.15.81:0/2466260321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad18084930 con 0x7fad280cc250 2023-10-06T02:46:19.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.724+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16817b120 con 0x7fd1680c6120 2023-10-06T02:46:19.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60380052b0 con 0x7f6054156d60 2023-10-06T02:46:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.726+0000 7f85be7fc700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85ac066f30 0x7f85ac0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85c00c2ea0 tx=0x7f85b4006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.726+0000 7fd15d7fa700 1 -- 172.21.15.81:0/1782454557 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd164030480 con 0x7fd1680c6120 2023-10-06T02:46:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.726+0000 7fd15d7fa700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd14c066f30 0x7fd14c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.726+0000 7fd15d7fa700 1 -- 172.21.15.81:0/1782454557 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd164085dc0 con 0x7fd1680c6120 2023-10-06T02:46:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.726+0000 7fd16d103700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd14c066f30 0x7fd14c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.727+0000 7fd16d103700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd14c066f30 0x7fd14c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd158006fd0 tx=0x7fd158008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.730+0000 7f85a6ffd700 1 -- 172.21.15.81:0/2603848305 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85c0168f60 con 0x7f85c006ceb0 2023-10-06T02:46:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.731+0000 7fad167fc700 1 -- 172.21.15.81:0/2466260321 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad18051d10 con 0x7fad280cc250 2023-10-06T02:46:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.732+0000 7fad2659c700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad08066f30 0x7fad080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.732+0000 7fd15d7fa700 1 -- 172.21.15.81:0/1782454557 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd164052f50 con 0x7fd1680c6120 2023-10-06T02:46:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.732+0000 7fad2659c700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad08066f30 0x7fad080693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad2000ba90 tx=0x7fad2001b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.723+0000 7fde98dcc700 1 -- 172.21.15.81:0/4004328185 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00e070 con 0x7fde940c2f80 2023-10-06T02:46:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7fde98dcc700 1 -- 172.21.15.81:0/4004328185 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c00bc30 con 0x7fde940c2f80 2023-10-06T02:46:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7fde98dcc700 1 -- 172.21.15.81:0/4004328185 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c012430 con 0x7fde940c2f80 2023-10-06T02:46:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7fde9c032700 1 -- 172.21.15.81:0/4004328185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde940c2f80 msgr2=0x7fde940c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7fde9c032700 1 --2- 172.21.15.81:0/4004328185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde940c2f80 0x7fde940c8b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e60 tx=0x7fde8c009780 comp rx=0 tx=0).stop 2023-10-06T02:46:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7fde9c032700 1 -- 172.21.15.81:0/4004328185 shutdown_connections 2023-10-06T02:46:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7fde9c032700 1 --2- 172.21.15.81:0/4004328185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde940c2f80 0x7fde940c8b20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7fde9c032700 1 -- 172.21.15.81:0/4004328185 >> 172.21.15.81:0/4004328185 conn(0x7fde9406c660 msgr2=0x7fde940cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7fde9c032700 1 -- 172.21.15.81:0/4004328185 shutdown_connections 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.725+0000 7fde9c032700 1 -- 172.21.15.81:0/4004328185 wait complete. 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.727+0000 7fde9c032700 1 Processor -- start 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.727+0000 7fde9c032700 1 -- start start 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde9c032700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde940aedc0 0x7fde94088850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde9c032700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde940af190 0x7fde9414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde9c032700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde940c2f80 0x7fde94151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde9c032700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde94164800 con 0x7fde940aedc0 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde9c032700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde94088d90 con 0x7fde940c2f80 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde9c032700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde94163bf0 con 0x7fde940af190 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde99dce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde940aedc0 0x7fde94088850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde99dce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde940aedc0 0x7fde94088850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57084/0 (socket says 172.21.15.81:57084) 2023-10-06T02:46:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde99dce700 1 -- 172.21.15.81:0/1013604415 learned_addr learned my addr 172.21.15.81:0/1013604415 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde995cd700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde940af190 0x7fde9414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde9a5cf700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde940c2f80 0x7fde94151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde99dce700 1 -- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde940af190 msgr2=0x7fde9414d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde99dce700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde940af190 0x7fde9414d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde99dce700 1 -- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde940c2f80 msgr2=0x7fde94151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde99dce700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde940c2f80 0x7fde94151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde99dce700 1 -- 172.21.15.81:0/1013604415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c009a20 con 0x7fde940aedc0 2023-10-06T02:46:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.728+0000 7fde99dce700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde940aedc0 0x7fde94088850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c7c0 tx=0x7fde90007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.733+0000 7f60427fc700 1 -- 172.21.15.81:0/1558322202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6048024430 con 0x7f6054156d60 2023-10-06T02:46:19.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.733+0000 7f60427fc700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6034066f30 0x7f60340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.733+0000 7f60427fc700 1 -- 172.21.15.81:0/1558322202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6048084b70 con 0x7f6054156d60 2023-10-06T02:46:19.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.733+0000 7f605259c700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6034066f30 0x7f60340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.735+0000 7f605259c700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6034066f30 0x7f60340693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f604c0020c0 tx=0x7f604c001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:19.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.740+0000 7f60427fc700 1 -- 172.21.15.81:0/1558322202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6048051de0 con 0x7f6054156d60 2023-10-06T02:46:19.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.743+0000 7fde89ffb700 1 -- 172.21.15.81:0/1013604415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90005b30 con 0x7fde940aedc0 2023-10-06T02:46:19.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.743+0000 7fde89ffb700 1 -- 172.21.15.81:0/1013604415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90005c90 con 0x7fde940aedc0 2023-10-06T02:46:19.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.743+0000 7fde89ffb700 1 -- 172.21.15.81:0/1013604415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90004a80 con 0x7fde940aedc0 2023-10-06T02:46:19.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.744+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde94163ed0 con 0x7fde940aedc0 2023-10-06T02:46:19.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.744+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde94164490 con 0x7fde940aedc0 2023-10-06T02:46:19.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.746+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde94164970 con 0x7fde940aedc0 2023-10-06T02:46:19.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.764+0000 7fde89ffb700 1 -- 172.21.15.81:0/1013604415 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde900070d0 con 0x7fde940aedc0 2023-10-06T02:46:19.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.764+0000 7fde89ffb700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde80067190 0x7fde80069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:19.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.764+0000 7fde89ffb700 1 -- 172.21.15.81:0/1013604415 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fde900845b0 con 0x7fde940aedc0 2023-10-06T02:46:19.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.765+0000 7fde89ffb700 1 -- 172.21.15.81:0/1013604415 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde90084a40 con 0x7fde940aedc0 2023-10-06T02:46:19.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.767+0000 7fde995cd700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde80067190 0x7fde80069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:19.806+0000 7fde995cd700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde80067190 0x7fde80069640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde940c7280 tx=0x7fde84007da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.030+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f90ac005560 con 0x7f90cc156030 2023-10-06T02:46:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.031+0000 7f90c1ffb700 1 -- 172.21.15.81:0/3195563953 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90bc017020 con 0x7f90cc156030 2023-10-06T02:46:20.035 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:20.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90b8067210 msgr2=0x7f90b80696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90b8067210 0x7f90b80696c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004890 tx=0x7f90c8005ba0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90cc156030 msgr2=0x7f90cc148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90cc156030 0x7f90cc148960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00c490 tx=0x7f90bc00c850 comp rx=0 tx=0).stop 2023-10-06T02:46:20.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 shutdown_connections 2023-10-06T02:46:20.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90cc156030 0x7f90cc148960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90b8067210 0x7f90b80696c0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004890 tx=0x7f90c8005ba0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90cc0c8d50 0x7f90cc06f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 --2- 172.21.15.81:0/3195563953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90cc155c60 0x7f90cc137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 >> 172.21.15.81:0/3195563953 conn(0x7f90cc0cc980 msgr2=0x7f90cc0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:20.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 shutdown_connections 2023-10-06T02:46:20.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.041+0000 7f90d4023700 1 -- 172.21.15.81:0/3195563953 wait complete. 2023-10-06T02:46:20.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-06T02:46:20.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.091+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6038005830 con 0x7f6054156d60 2023-10-06T02:46:20.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.091+0000 7f60427fc700 1 -- 172.21.15.81:0/1558322202 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6048055400 con 0x7f6054156d60 2023-10-06T02:46:20.093 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:20.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.093+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6034066f30 msgr2=0x7f60340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.093+0000 7f6058b04700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6034066f30 0x7f60340693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f604c0020c0 tx=0x7f604c001a10 comp rx=0 tx=0).stop 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.093+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054156d60 msgr2=0x7f605414f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.093+0000 7f6058b04700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054156d60 0x7f605414f580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f604800b810 tx=0x7f6048009250 comp rx=0 tx=0).stop 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.094+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 shutdown_connections 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.094+0000 7f6058b04700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6054157130 0x7f60540c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.094+0000 7f6058b04700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6034066f30 0x7f60340693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.094+0000 7f6058b04700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60540c8880 0x7f605414a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.094+0000 7f6058b04700 1 --2- 172.21.15.81:0/1558322202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6054156d60 0x7f605414f580 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.094+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 >> 172.21.15.81:0/1558322202 conn(0x7f60540c9ca0 msgr2=0x7f605414b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:20.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.095+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 shutdown_connections 2023-10-06T02:46:20.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.095+0000 7f6058b04700 1 -- 172.21.15.81:0/1558322202 wait complete. 2023-10-06T02:46:20.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.096+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd804005830 con 0x7fd82015e3c0 2023-10-06T02:46:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.097+0000 7fd80e7fc700 1 -- 172.21.15.81:0/734250282 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd818056620 con 0x7fd82015e3c0 2023-10-06T02:46:20.098 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd800066f30 msgr2=0x7fd8000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd800066f30 0x7fd8000693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8140097c0 tx=0x7fd814006ce0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd82015e3c0 msgr2=0x7fd820149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd82015e3c0 0x7fd820149e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd82015f8f0 tx=0x7fd818017000 comp rx=0 tx=0).stop 2023-10-06T02:46:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 shutdown_connections 2023-10-06T02:46:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd82015e3c0 0x7fd820149e70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd82006d120 0x7fd820160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd800066f30 0x7fd8000693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 --2- 172.21.15.81:0/734250282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8200cf660 0x7fd8200c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 >> 172.21.15.81:0/734250282 conn(0x7fd82006bb90 msgr2=0x7fd8200b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 shutdown_connections 2023-10-06T02:46:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.101+0000 7fd8249a0700 1 -- 172.21.15.81:0/734250282 wait complete. 2023-10-06T02:46:20.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-06T02:46:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.108+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77c415ba40 con 0x7f77c40af890 2023-10-06T02:46:20.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.109+0000 7f77aaffd700 1 -- 172.21.15.81:0/3494422896 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77b8051040 con 0x7f77c40af890 2023-10-06T02:46:20.110 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:20.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.112+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f77b0066fb0 msgr2=0x7f77b0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.112+0000 7f77c99ed700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f77b0066fb0 0x7f77b0069460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77c406b0c0 tx=0x7f77b4016000 comp rx=0 tx=0).stop 2023-10-06T02:46:20.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.112+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c40af890 msgr2=0x7f77c40afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.112+0000 7f77c99ed700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c40af890 0x7f77c40afd00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f77b800b5e0 tx=0x7f77b80090f0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.113+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 shutdown_connections 2023-10-06T02:46:20.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.113+0000 7f77c99ed700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77c416b4c0 0x7f77c416b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.113+0000 7f77c99ed700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c406a780 0x7f77c4157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.113+0000 7f77c99ed700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f77b0066fb0 0x7f77b0069460 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.113+0000 7f77c99ed700 1 --2- 172.21.15.81:0/3494422896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77c40af890 0x7f77c40afd00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.113+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 >> 172.21.15.81:0/3494422896 conn(0x7f77c40cc980 msgr2=0x7f77c40c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.113+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 shutdown_connections 2023-10-06T02:46:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.113+0000 7f77c99ed700 1 -- 172.21.15.81:0/3494422896 wait complete. 2023-10-06T02:46:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.119+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f85c0169240 con 0x7f85c006ceb0 2023-10-06T02:46:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.119+0000 7f85a6ffd700 1 -- 172.21.15.81:0/2603848305 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85c0169240 con 0x7f85c006ceb0 2023-10-06T02:46:20.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-06T02:46:20.121 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.120+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd1680caa80 con 0x7fd1680c6120 2023-10-06T02:46:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.121+0000 7fd15d7fa700 1 -- 172.21.15.81:0/1782454557 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd164002e60 con 0x7fd1680c6120 2023-10-06T02:46:20.122 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.121+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fad281577c0 con 0x7fad280cc250 2023-10-06T02:46:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.122+0000 7fad167fc700 1 -- 172.21.15.81:0/2466260321 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad281577c0 con 0x7fad280cc250 2023-10-06T02:46:20.123 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85ac066f30 msgr2=0x7f85ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85ac066f30 0x7f85ac0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85c00c2ea0 tx=0x7f85b4006f90 comp rx=0 tx=0).stop 2023-10-06T02:46:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 msgr2=0x7f85c01435b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c01435b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f85c006ebb0 tx=0x7f85b0017000 comp rx=0 tx=0).stop 2023-10-06T02:46:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 shutdown_connections 2023-10-06T02:46:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85ac066f30 0x7f85ac0693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85c0157670 0x7f85c00c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85c006ceb0 0x7f85c01435b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 --2- 172.21.15.81:0/2603848305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0156d60 0x7f85c00c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.123+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 >> 172.21.15.81:0/2603848305 conn(0x7f85c00c9ca0 msgr2=0x7f85c00699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 shutdown_connections 2023-10-06T02:46:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd14c066f30 msgr2=0x7fd14c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd14c066f30 0x7fd14c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd158006fd0 tx=0x7fd158008040 comp rx=0 tx=0).stop 2023-10-06T02:46:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1680c6120 msgr2=0x7fd1680c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1680c6120 0x7fd1680c6590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd164013000 tx=0x7fd164017000 comp rx=0 tx=0).stop 2023-10-06T02:46:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7f85c57a6700 1 -- 172.21.15.81:0/2603848305 wait complete. 2023-10-06T02:46:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 shutdown_connections 2023-10-06T02:46:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168159920 0x7fd168159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd154004810 0x7fd168177b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd14c066f30 0x7fd14c0693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 --2- 172.21.15.81:0/1782454557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1680c6120 0x7fd1680c6590 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 >> 172.21.15.81:0/1782454557 conn(0x7fd1680cc980 msgr2=0x7fd1680b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 shutdown_connections 2023-10-06T02:46:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.124+0000 7fd16f367700 1 -- 172.21.15.81:0/1782454557 wait complete. 2023-10-06T02:46:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.125+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad08066f30 msgr2=0x7fad080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.125+0000 7fad2ce0d700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad08066f30 0x7fad080693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad2000ba90 tx=0x7fad2001b000 comp rx=0 tx=0).stop 2023-10-06T02:46:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.125+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad280cc250 msgr2=0x7fad281591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.125+0000 7fad2ce0d700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad280cc250 0x7fad281591b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad1800b600 tx=0x7fad180091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.126+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 shutdown_connections 2023-10-06T02:46:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.126+0000 7fad2ce0d700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad08066f30 0x7fad080693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.126+0000 7fad2ce0d700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad28156420 0x7fad281596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.126+0000 7fad2ce0d700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad280c71d0 0x7fad28142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.126+0000 7fad2ce0d700 1 --2- 172.21.15.81:0/2466260321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad280cc250 0x7fad281591b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.126+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 >> 172.21.15.81:0/2466260321 conn(0x7fad2806c660 msgr2=0x7fad2806d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.126+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 shutdown_connections 2023-10-06T02:46:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.126+0000 7fad2ce0d700 1 -- 172.21.15.81:0/2466260321 wait complete. 2023-10-06T02:46:20.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-06T02:46:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.137+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fde9404bb80 con 0x7fde940aedc0 2023-10-06T02:46:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.138+0000 7fde89ffb700 1 -- 172.21.15.81:0/1013604415 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde90021020 con 0x7fde940aedc0 2023-10-06T02:46:20.139 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-06T02:46:20.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-06T02:46:20.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-06T02:46:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde80067190 msgr2=0x7fde80069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde80067190 0x7fde80069640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde940c7280 tx=0x7fde84007da0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde940aedc0 msgr2=0x7fde94088850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde940aedc0 0x7fde94088850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c7c0 tx=0x7fde90007f70 comp rx=0 tx=0).stop 2023-10-06T02:46:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 shutdown_connections 2023-10-06T02:46:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde80067190 0x7fde80069640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde940c2f80 0x7fde94151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde940aedc0 0x7fde94088850 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 --2- 172.21.15.81:0/1013604415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde940af190 0x7fde9414d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 >> 172.21.15.81:0/1013604415 conn(0x7fde9406c660 msgr2=0x7fde940cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 shutdown_connections 2023-10-06T02:46:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:20.140+0000 7fde9c032700 1 -- 172.21.15.81:0/1013604415 wait complete. 2023-10-06T02:46:20.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-06T02:46:20.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-06T02:46:21.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T02:46:21.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T02:46:21.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T02:46:21.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T02:46:21.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T02:46:21.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T02:46:21.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T02:46:21.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T02:46:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.225+0000 7f9fd0bd2700 1 Processor -- start 2023-10-06T02:46:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.225+0000 7f9fd0bd2700 1 -- start start 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.226+0000 7f9fd0bd2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc1569e0 0x7f9fcc0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.226+0000 7f9fd0bd2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fcc06e940 0x7f9fcc0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.226+0000 7f9fd0bd2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc0b2290 con 0x7f9fcc156db0 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.226+0000 7f9fd0bd2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc157c00 con 0x7f9fcc06e940 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.226+0000 7f9fd0bd2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc1572d0 con 0x7f9fcc1569e0 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.227+0000 7f9fcad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fcc06e940 0x7f9fcc0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.227+0000 7f9fcad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fcc06e940 0x7f9fcc0cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47686/0 (socket says 172.21.15.81:47686) 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.227+0000 7f9fcad9d700 1 -- 172.21.15.81:0/1711224813 learned_addr learned my addr 172.21.15.81:0/1711224813 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.227+0000 7f9fca59c700 1 --2- 172.21.15.81:0/1711224813 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc1569e0 0x7f9fcc0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.227+0000 7f9fcad9d700 1 -- 172.21.15.81:0/1711224813 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc1569e0 msgr2=0x7f9fcc0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.227+0000 7f9fcad9d700 1 --2- 172.21.15.81:0/1711224813 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc1569e0 0x7f9fcc0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.227+0000 7f9fcad9d700 1 -- 172.21.15.81:0/1711224813 >> v1:172.21.15.83:6789/0 conn(0x7f9fcc156db0 legacy=0x7f9fcc06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.227+0000 7f9fcad9d700 1 -- 172.21.15.81:0/1711224813 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc1575b0 con 0x7f9fcc06e940 2023-10-06T02:46:21.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.228+0000 7f9fcad9d700 1 --2- 172.21.15.81:0/1711224813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 0x7f9fcc0cd920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009f20 tx=0x7f9fc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6eaa2ca31241afa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.238+0000 7f9fc959a700 1 -- 172.21.15.81:0/1711224813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400e070 con 0x7f9fcc06e940 2023-10-06T02:46:21.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.238+0000 7f9fc959a700 1 -- 172.21.15.81:0/1711224813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc400b9d0 con 0x7f9fcc06e940 2023-10-06T02:46:21.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.238+0000 7f9fc959a700 1 -- 172.21.15.81:0/1711224813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40092e0 con 0x7f9fcc06e940 2023-10-06T02:46:21.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.239+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1711224813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 msgr2=0x7f9fcc0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.239+0000 7f9fd0bd2700 1 --2- 172.21.15.81:0/1711224813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 0x7f9fcc0cd920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009f20 tx=0x7f9fc4009840 comp rx=0 tx=0).stop 2023-10-06T02:46:21.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.239+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1711224813 shutdown_connections 2023-10-06T02:46:21.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.239+0000 7f9fd0bd2700 1 --2- 172.21.15.81:0/1711224813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 0x7f9fcc0cd920 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.239+0000 7f9fd0bd2700 1 --2- 172.21.15.81:0/1711224813 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc1569e0 0x7f9fcc0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.239+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1711224813 >> 172.21.15.81:0/1711224813 conn(0x7f9fcc06cca0 msgr2=0x7f9fcc06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.240+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1711224813 shutdown_connections 2023-10-06T02:46:21.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.240+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1711224813 wait complete. 2023-10-06T02:46:21.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.241+0000 7f9fd0bd2700 1 Processor -- start 2023-10-06T02:46:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.242+0000 7f9fd0bd2700 1 -- start start 2023-10-06T02:46:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.243+0000 7f9fd0bd2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 0x7f9fcc1773c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.243+0000 7f9fd0bd2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fcc1569e0 0x7f9fcc151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.243+0000 7f9fd0bd2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc156db0 0x7f9fcc0af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.243+0000 7f9fd0bd2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0a6790 con 0x7f9fcc06e940 2023-10-06T02:46:21.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.243+0000 7f9fd0bd2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc159ad0 con 0x7f9fcc1569e0 2023-10-06T02:46:21.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.243+0000 7f9fd0bd2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc159d30 con 0x7f9fcc156db0 2023-10-06T02:46:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.243+0000 7f9fca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 0x7f9fcc1773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.243+0000 7f9fca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 0x7f9fcc1773c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47696/0 (socket says 172.21.15.81:47696) 2023-10-06T02:46:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.243+0000 7f9fca59c700 1 -- 172.21.15.81:0/1854012707 learned_addr learned my addr 172.21.15.81:0/1854012707 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.244+0000 7f9fc9d9b700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fcc1569e0 0x7f9fcc151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.244+0000 7f9fcad9d700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc156db0 0x7f9fcc0af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.244+0000 7f9fc9d9b700 1 -- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc156db0 msgr2=0x7f9fcc0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.244+0000 7f9fc9d9b700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc156db0 0x7f9fcc0af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.244+0000 7f9fc9d9b700 1 -- 172.21.15.81:0/1854012707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 msgr2=0x7f9fcc1773c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.244+0000 7f9fc9d9b700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 0x7f9fcc1773c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.244+0000 7f9fc9d9b700 1 -- 172.21.15.81:0/1854012707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc4009ae0 con 0x7f9fcc1569e0 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.244+0000 7f9fca59c700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 0x7f9fcc1773c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.244+0000 7f9fc9d9b700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fcc1569e0 0x7f9fcc151db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0001eb0 tx=0x7f9fc0007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.245+0000 7f9fba7fc700 1 -- 172.21.15.81:0/1854012707 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0011590 con 0x7f9fcc1569e0 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.245+0000 7f9fba7fc700 1 -- 172.21.15.81:0/1854012707 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc0011710 con 0x7f9fcc1569e0 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.245+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc15a010 con 0x7f9fcc1569e0 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.245+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc15a5d0 con 0x7f9fcc1569e0 2023-10-06T02:46:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.245+0000 7f9fba7fc700 1 -- 172.21.15.81:0/1854012707 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0011ad0 con 0x7f9fcc1569e0 2023-10-06T02:46:21.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.246+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc068900 con 0x7f9fcc1569e0 2023-10-06T02:46:21.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.249+0000 7f9fba7fc700 1 -- 172.21.15.81:0/1854012707 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fc001b3b0 con 0x7f9fcc1569e0 2023-10-06T02:46:21.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.249+0000 7f9fba7fc700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fac067000 0x7f9fac0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.249+0000 7f9fba7fc700 1 -- 172.21.15.81:0/1854012707 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9fc0083a70 con 0x7f9fcc1569e0 2023-10-06T02:46:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.250+0000 7f9fca59c700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fac067000 0x7f9fac0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.251+0000 7f9fca59c700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fac067000 0x7f9fac0694b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009fd0 tx=0x7f9fbc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.254+0000 7f9fba7fc700 1 -- 172.21.15.81:0/1854012707 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fc0050ae0 con 0x7f9fcc1569e0 2023-10-06T02:46:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.275+0000 7f077a10a700 1 Processor -- start 2023-10-06T02:46:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.276+0000 7f077a10a700 1 -- start start 2023-10-06T02:46:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.277+0000 7f077a10a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f077406f580 0x7f07740caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.277+0000 7f077a10a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f950 0x7f0774068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.277+0000 7f077a10a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07740c83a0 0x7f07740690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.277+0000 7f077a10a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077406d220 con 0x7f07740c83a0 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.277+0000 7f077a10a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077406d500 con 0x7f077406f580 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.277+0000 7f077a10a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07740cb7b0 con 0x7f077406f950 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.277+0000 7f07737fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f077406f580 0x7f07740caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f0772ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f950 0x7f0774068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f07737fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f077406f580 0x7f07740caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:46492/0 (socket says 172.21.15.81:46492) 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f07737fe700 1 -- 172.21.15.81:0/2558137818 learned_addr learned my addr 172.21.15.81:0/2558137818 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f0773fff700 1 --2- 172.21.15.81:0/2558137818 >> v2:172.21.15.81:3300/0 conn(0x7f07740c83a0 0x7f07740690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f07737fe700 1 -- 172.21.15.81:0/2558137818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f950 msgr2=0x7f0774068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f07737fe700 1 --2- 172.21.15.81:0/2558137818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f950 0x7f0774068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f07737fe700 1 -- 172.21.15.81:0/2558137818 >> v2:172.21.15.81:3300/0 conn(0x7f07740c83a0 msgr2=0x7f07740690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f07737fe700 1 --2- 172.21.15.81:0/2558137818 >> v2:172.21.15.81:3300/0 conn(0x7f07740c83a0 0x7f07740690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f07737fe700 1 -- 172.21.15.81:0/2558137818 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740cba90 con 0x7f077406f580 2023-10-06T02:46:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f0772ffd700 1 --2- 172.21.15.81:0/2558137818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f950 0x7f0774068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f07737fe700 1 --2- 172.21.15.81:0/2558137818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077406f580 0x7f07740caf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f077406a720 tx=0x7f076400b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e1722984965d32a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.278+0000 7f07727fc700 1 -- 172.21.15.81:0/2558137818 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400be00 con 0x7f077406f580 2023-10-06T02:46:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.279+0000 7f07727fc700 1 -- 172.21.15.81:0/2558137818 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400db60 con 0x7f077406f580 2023-10-06T02:46:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.279+0000 7f07727fc700 1 -- 172.21.15.81:0/2558137818 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640124d0 con 0x7f077406f580 2023-10-06T02:46:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.279+0000 7f077a10a700 1 -- 172.21.15.81:0/2558137818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077406f580 msgr2=0x7f07740caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.279+0000 7f077a10a700 1 --2- 172.21.15.81:0/2558137818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077406f580 0x7f07740caf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f077406a720 tx=0x7f076400b610 comp rx=0 tx=0).stop 2023-10-06T02:46:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.281+0000 7f0773fff700 1 --2- 172.21.15.81:0/2558137818 >> v2:172.21.15.81:3300/0 conn(0x7f07740c83a0 0x7f07740690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.281+0000 7f077a10a700 1 -- 172.21.15.81:0/2558137818 shutdown_connections 2023-10-06T02:46:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.281+0000 7f077a10a700 1 --2- 172.21.15.81:0/2558137818 >> v2:172.21.15.81:3300/0 conn(0x7f07740c83a0 0x7f07740690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.281+0000 7f077a10a700 1 --2- 172.21.15.81:0/2558137818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077406f580 0x7f07740caf30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.281+0000 7f077a10a700 1 --2- 172.21.15.81:0/2558137818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f950 0x7f0774068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.281+0000 7f077a10a700 1 -- 172.21.15.81:0/2558137818 >> 172.21.15.81:0/2558137818 conn(0x7f07740cc980 msgr2=0x7f07740ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.281+0000 7f077a10a700 1 -- 172.21.15.81:0/2558137818 shutdown_connections 2023-10-06T02:46:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.281+0000 7f077a10a700 1 -- 172.21.15.81:0/2558137818 wait complete. 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.283+0000 7f077a10a700 1 Processor -- start 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.283+0000 7f077a10a700 1 -- start start 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.284+0000 7f077a10a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f580 0x7f0774171c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.284+0000 7f077a10a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077406f950 0x7f0774167340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.284+0000 7f077a10a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07740c83a0 0x7f07740afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.284+0000 7f077a10a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0774173b40 con 0x7f07740c83a0 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.284+0000 7f077a10a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0774173570 con 0x7f077406f950 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.284+0000 7f077a10a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07741737f0 con 0x7f077406f580 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f0773fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07740c83a0 0x7f07740afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f0773fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07740c83a0 0x7f07740afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47714/0 (socket says 172.21.15.81:47714) 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f0773fff700 1 -- 172.21.15.81:0/1836333540 learned_addr learned my addr 172.21.15.81:0/1836333540 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f0772ffd700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077406f950 0x7f0774167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f07737fe700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f580 0x7f0774171c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f0773fff700 1 -- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f580 msgr2=0x7f0774171c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f0773fff700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f580 0x7f0774171c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f0773fff700 1 -- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077406f950 msgr2=0x7f0774167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f0773fff700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077406f950 0x7f0774167340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.285+0000 7f0773fff700 1 -- 172.21.15.81:0/1836333540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076400b8b0 con 0x7f07740c83a0 2023-10-06T02:46:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.286+0000 7f0773fff700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07740c83a0 0x7f07740afa80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f076800e8a0 tx=0x7f0768008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.286+0000 7f075b7fe700 1 -- 172.21.15.81:0/1836333540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768013410 con 0x7f07740c83a0 2023-10-06T02:46:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.286+0000 7f075b7fe700 1 -- 172.21.15.81:0/1836333540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768013570 con 0x7f07740c83a0 2023-10-06T02:46:21.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.286+0000 7f075b7fe700 1 -- 172.21.15.81:0/1836333540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680138f0 con 0x7f07740c83a0 2023-10-06T02:46:21.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.286+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0774169bf0 con 0x7f07740c83a0 2023-10-06T02:46:21.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.286+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07740affc0 con 0x7f07740c83a0 2023-10-06T02:46:21.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.289+0000 7f075b7fe700 1 -- 172.21.15.81:0/1836333540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0768013ce0 con 0x7f07740c83a0 2023-10-06T02:46:21.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.290+0000 7f075b7fe700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0760067080 0x7f0760069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.290+0000 7f075b7fe700 1 -- 172.21.15.81:0/1836333540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0768084400 con 0x7f07740c83a0 2023-10-06T02:46:21.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.292+0000 7f07737fe700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0760067080 0x7f0760069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.293+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07540052b0 con 0x7f07740c83a0 2023-10-06T02:46:21.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.302+0000 7f075b7fe700 1 -- 172.21.15.81:0/1836333540 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07680514f0 con 0x7f07740c83a0 2023-10-06T02:46:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.312+0000 7f07737fe700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0760067080 0x7f0760069530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f076400b880 tx=0x7f076401d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.346+0000 7f2f34c44700 1 Processor -- start 2023-10-06T02:46:21.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.346+0000 7f2f34c44700 1 -- start start 2023-10-06T02:46:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.348+0000 7f2f34c44700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f300cd490 0x7f2f300cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.348+0000 7f2f34c44700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2f30155c60 0x7f2f300c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.348+0000 7f2f34c44700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f300ca550 con 0x7f2f30156100 2023-10-06T02:46:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.348+0000 7f2f34c44700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f300cb3b0 con 0x7f2f300cd490 2023-10-06T02:46:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.348+0000 7f2f34c44700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f300ca7a0 con 0x7f2f30155c60 2023-10-06T02:46:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.348+0000 7f2f2e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f300cd490 0x7f2f300cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.348+0000 7f2f2e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f300cd490 0x7f2f300cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47730/0 (socket says 172.21.15.81:47730) 2023-10-06T02:46:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.349+0000 7f2f2e59c700 1 -- 172.21.15.81:0/1672531389 learned_addr learned my addr 172.21.15.81:0/1672531389 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.349+0000 7f2f2e59c700 1 -- 172.21.15.81:0/1672531389 >> v2:172.21.15.83:3300/0 conn(0x7f2f30155c60 msgr2=0x7f2f300c8810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:46:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.349+0000 7f2f2e59c700 1 --2- 172.21.15.81:0/1672531389 >> v2:172.21.15.83:3300/0 conn(0x7f2f30155c60 0x7f2f300c8810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.349+0000 7f2f2e59c700 1 -- 172.21.15.81:0/1672531389 >> v1:172.21.15.83:6789/0 conn(0x7f2f30156100 legacy=0x7f2f30159ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:46:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.349+0000 7f2f2e59c700 1 -- 172.21.15.81:0/1672531389 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300caa80 con 0x7f2f300cd490 2023-10-06T02:46:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.349+0000 7f2f2e59c700 1 --2- 172.21.15.81:0/1672531389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f300cd490 0x7f2f300cb840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f30069020 tx=0x7f2f20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a534a7c9b39be8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.350+0000 7f2f2d59a700 1 -- 172.21.15.81:0/1672531389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000b8b0 con 0x7f2f300cd490 2023-10-06T02:46:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.350+0000 7f2f2d59a700 1 -- 172.21.15.81:0/1672531389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2000ba10 con 0x7f2f300cd490 2023-10-06T02:46:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.350+0000 7f2f2d59a700 1 -- 172.21.15.81:0/1672531389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000bdb0 con 0x7f2f300cd490 2023-10-06T02:46:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.351+0000 7f2f34c44700 1 -- 172.21.15.81:0/1672531389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f300cd490 msgr2=0x7f2f300cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.351+0000 7f2f34c44700 1 --2- 172.21.15.81:0/1672531389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f300cd490 0x7f2f300cb840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f30069020 tx=0x7f2f20009250 comp rx=0 tx=0).stop 2023-10-06T02:46:21.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.351+0000 7f2f34c44700 1 -- 172.21.15.81:0/1672531389 shutdown_connections 2023-10-06T02:46:21.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.351+0000 7f2f34c44700 1 --2- 172.21.15.81:0/1672531389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f300cd490 0x7f2f300cb840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.351+0000 7f2f34c44700 1 --2- 172.21.15.81:0/1672531389 >> v2:172.21.15.83:3300/0 conn(0x7f2f30155c60 0x7f2f300c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.351+0000 7f2f34c44700 1 -- 172.21.15.81:0/1672531389 >> 172.21.15.81:0/1672531389 conn(0x7f2f300cc980 msgr2=0x7f2f300ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.351+0000 7f2f34c44700 1 -- 172.21.15.81:0/1672531389 shutdown_connections 2023-10-06T02:46:21.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.351+0000 7f2f34c44700 1 -- 172.21.15.81:0/1672531389 wait complete. 2023-10-06T02:46:21.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.352+0000 7f5ed482a700 1 Processor -- start 2023-10-06T02:46:21.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.352+0000 7f5ed482a700 1 -- start start 2023-10-06T02:46:21.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.352+0000 7fac53bdc700 1 Processor -- start 2023-10-06T02:46:21.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.352+0000 7fcbe1ab7700 1 Processor -- start 2023-10-06T02:46:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7f2f34c44700 1 Processor -- start 2023-10-06T02:46:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7f5ed482a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5ed0157ab0 0x7f5ed015c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7f5ed482a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ed015c5e0 0x7f5ed006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7f5ed482a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 0x7f5ed006c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7f5ed482a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed015bc10 con 0x7f5ed015c5e0 2023-10-06T02:46:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7f5ed482a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed0158ba0 con 0x7f5ed0157ab0 2023-10-06T02:46:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7f5ed482a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0158e80 con 0x7f5ed0069120 2023-10-06T02:46:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7fcbe1ab7700 1 -- start start 2023-10-06T02:46:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7f2f34c44700 1 -- start start 2023-10-06T02:46:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f5ecdd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ed015c5e0 0x7f5ed006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f5ecdd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ed015c5e0 0x7f5ed006bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47732/0 (socket says 172.21.15.81:47732) 2023-10-06T02:46:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f5ecdd9b700 1 -- 172.21.15.81:0/4111707750 learned_addr learned my addr 172.21.15.81:0/4111707750 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fcbe1ab7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbdc0af190 0x7fcbdc0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fcbe1ab7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0c2870 0x7fcbdc0c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fcbe1ab7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc0c9120 con 0x7fcbdc0aedc0 2023-10-06T02:46:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fcbe1ab7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc15e840 con 0x7fcbdc0af190 2023-10-06T02:46:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fcbe1ab7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0c7620 con 0x7fcbdc0c2870 2023-10-06T02:46:21.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f34c44700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f300cd490 0x7f2f300b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f34c44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f30155c60 0x7f2f3016e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f34c44700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f30156100 0x7f2f300b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f34c44700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300c5d50 con 0x7f2f30155c60 2023-10-06T02:46:21.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f34c44700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300b0790 con 0x7f2f300cd490 2023-10-06T02:46:21.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f34c44700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300c50d0 con 0x7f2f30156100 2023-10-06T02:46:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f2e59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f300cd490 0x7f2f300b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f2e59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f300cd490 0x7f2f300b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:46530/0 (socket says 172.21.15.81:46530) 2023-10-06T02:46:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f2e59c700 1 -- 172.21.15.81:0/1096501361 learned_addr learned my addr 172.21.15.81:0/1096501361 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.353+0000 7fac53bdc700 1 -- start start 2023-10-06T02:46:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fac53bdc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 0x7fac4c156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fac53bdc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac4c0cbc90 0x7fac4c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fac53bdc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c0ca550 con 0x7fac4c0cb840 2023-10-06T02:46:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fac53bdc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c0cb3b0 con 0x7fac4c0cbc90 2023-10-06T02:46:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fac53bdc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0ca7a0 con 0x7fac4c155c60 2023-10-06T02:46:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fcbdb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcbdc0aedc0 0x7fcbdc068980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50230/0 (socket says 172.21.15.81:50230) 2023-10-06T02:46:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7fcbdb7fe700 1 -- 172.21.15.81:0/3999464953 learned_addr learned my addr 172.21.15.81:0/3999464953 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f2f2ed9d700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f30156100 0x7f2f300b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fcbdbfff700 1 --2- 172.21.15.81:0/3999464953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0c2870 0x7fcbdc0c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac52179700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac4c0cbc90 0x7fac4c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac52179700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac4c0cbc90 0x7fac4c159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:46538/0 (socket says 172.21.15.81:46538) 2023-10-06T02:46:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac52179700 1 -- 172.21.15.81:0/102963817 learned_addr learned my addr 172.21.15.81:0/102963817 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f5eced9d700 1 --2- 172.21.15.81:0/4111707750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 0x7f5ed006c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f5ece59c700 1 --2- 172.21.15.81:0/4111707750 >> v2:172.21.15.83:3300/0 conn(0x7f5ed0157ab0 0x7f5ed015c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f5ecdd9b700 1 -- 172.21.15.81:0/4111707750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 msgr2=0x7f5ed006c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f5ecdd9b700 1 --2- 172.21.15.81:0/4111707750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 0x7f5ed006c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.354+0000 7f5ecdd9b700 1 -- 172.21.15.81:0/4111707750 >> v2:172.21.15.83:3300/0 conn(0x7f5ed0157ab0 msgr2=0x7f5ed015c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f5ecdd9b700 1 --2- 172.21.15.81:0/4111707750 >> v2:172.21.15.83:3300/0 conn(0x7f5ed0157ab0 0x7f5ed015c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f5ecdd9b700 1 -- 172.21.15.81:0/4111707750 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0159160 con 0x7f5ed015c5e0 2023-10-06T02:46:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f5ece59c700 1 --2- 172.21.15.81:0/4111707750 >> v2:172.21.15.83:3300/0 conn(0x7f5ed0157ab0 0x7f5ed015c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac51978700 1 --2- 172.21.15.81:0/102963817 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 0x7fac4c156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f2f2e59c700 1 -- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f30156100 msgr2=0x7f2f300b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f2f2e59c700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f30156100 0x7f2f300b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f2f2e59c700 1 -- 172.21.15.81:0/1096501361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f30155c60 msgr2=0x7f2f3016e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f2f2e59c700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f30155c60 0x7f2f3016e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f2f2e59c700 1 -- 172.21.15.81:0/1096501361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200094f0 con 0x7f2f300cd490 2023-10-06T02:46:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fcbd2ffd700 1 --2- 172.21.15.81:0/3999464953 >> v2:172.21.15.81:3300/0 conn(0x7fcbdc0af190 0x7fcbdc0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fcbdbfff700 1 -- 172.21.15.81:0/3999464953 >> v2:172.21.15.81:3300/0 conn(0x7fcbdc0af190 msgr2=0x7fcbdc0c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fcbdbfff700 1 --2- 172.21.15.81:0/3999464953 >> v2:172.21.15.81:3300/0 conn(0x7fcbdc0af190 0x7fcbdc0c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fcbdbfff700 1 -- 172.21.15.81:0/3999464953 >> v1:172.21.15.81:6789/0 conn(0x7fcbdc0aedc0 legacy=0x7fcbdc068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fcbdbfff700 1 -- 172.21.15.81:0/3999464953 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0c23e0 con 0x7fcbdc0c2870 2023-10-06T02:46:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f2f2ed9d700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f30156100 0x7f2f300b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f2f2e59c700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f300cd490 0x7f2f300b0250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f20003080 tx=0x7f2f20016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7f5ecdd9b700 1 --2- 172.21.15.81:0/4111707750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed015c5e0 0x7f5ed006bb90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0068f20 tx=0x7f5ec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9da5b1515bd729c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac52179700 1 -- 172.21.15.81:0/102963817 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 msgr2=0x7fac4c156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac52179700 1 --2- 172.21.15.81:0/102963817 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 0x7fac4c156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac52179700 1 -- 172.21.15.81:0/102963817 >> v1:172.21.15.83:6789/0 conn(0x7fac4c0cb840 legacy=0x7fac4c0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac52179700 1 -- 172.21.15.81:0/102963817 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0caa80 con 0x7fac4c0cbc90 2023-10-06T02:46:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac51978700 1 --2- 172.21.15.81:0/102963817 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 0x7fac4c156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac52179700 1 --2- 172.21.15.81:0/102963817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c0cbc90 0x7fac4c159ac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac4400d1a0 tx=0x7fac44007690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14b37255cf6165bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fa09afa7700 1 Processor -- start 2023-10-06T02:46:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fa09afa7700 1 -- start start 2023-10-06T02:46:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fac50976700 1 -- 172.21.15.81:0/102963817 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44010070 con 0x7fac4c0cbc90 2023-10-06T02:46:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.355+0000 7fcbdbfff700 1 --2- 172.21.15.81:0/3999464953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0c2870 0x7fcbdc0c2d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40098e0 tx=0x7fcbd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1e527bcef99af4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7fac50976700 1 -- 172.21.15.81:0/102963817 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4400dc70 con 0x7fac4c0cbc90 2023-10-06T02:46:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7fac50976700 1 -- 172.21.15.81:0/102963817 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44007b40 con 0x7fac4c0cbc90 2023-10-06T02:46:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7f2f1e7fc700 1 -- 172.21.15.81:0/1096501361 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20011d50 con 0x7f2f300cd490 2023-10-06T02:46:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7f2f1e7fc700 1 -- 172.21.15.81:0/1096501361 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f20020070 con 0x7f2f300cd490 2023-10-06T02:46:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7fcbdaffd700 1 -- 172.21.15.81:0/3999464953 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400b640 con 0x7fcbdc0c2870 2023-10-06T02:46:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7f2f1e7fc700 1 -- 172.21.15.81:0/1096501361 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2001b6a0 con 0x7f2f300cd490 2023-10-06T02:46:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f300c53b0 con 0x7f2f300cd490 2023-10-06T02:46:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7fcbdaffd700 1 -- 172.21.15.81:0/3999464953 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd400b7a0 con 0x7fcbdc0c2870 2023-10-06T02:46:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7fcbdaffd700 1 -- 172.21.15.81:0/3999464953 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400bb60 con 0x7fcbdc0c2870 2023-10-06T02:46:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f300c5970 con 0x7f2f300cd490 2023-10-06T02:46:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7fa09afa7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa094155c60 0x7fa094156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.356+0000 7fa09afa7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa0940cb840 0x7fa0940c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa09afa7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0940ca550 con 0x7fa0940cbc90 2023-10-06T02:46:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa09afa7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0940cb3b0 con 0x7fa0940cb840 2023-10-06T02:46:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa09afa7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940ca7a0 con 0x7fa094155c60 2023-10-06T02:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3999464953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0c2870 msgr2=0x7fcbdc0c2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fcbe1ab7700 1 --2- 172.21.15.81:0/3999464953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0c2870 0x7fcbdc0c2d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40098e0 tx=0x7fcbd40091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7f5ecd59a700 1 -- 172.21.15.81:0/4111707750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0014b70 con 0x7f5ed015c5e0 2023-10-06T02:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa08bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa0940cb840 0x7fa0940c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7f5ecd59a700 1 -- 172.21.15.81:0/4111707750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0014cd0 con 0x7f5ed015c5e0 2023-10-06T02:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7f5ecd59a700 1 -- 172.21.15.81:0/4111707750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000b860 con 0x7f5ed015c5e0 2023-10-06T02:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3999464953 shutdown_connections 2023-10-06T02:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fcbe1ab7700 1 --2- 172.21.15.81:0/3999464953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0c2870 0x7fcbdc0c2d10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fcbe1ab7700 1 --2- 172.21.15.81:0/3999464953 >> v2:172.21.15.81:3300/0 conn(0x7fcbdc0af190 0x7fcbdc0c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3999464953 >> 172.21.15.81:0/3999464953 conn(0x7fcbdc06c660 msgr2=0x7fcbdc0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa08bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa0940cb840 0x7fa0940c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47772/0 (socket says 172.21.15.81:47772) 2023-10-06T02:46:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa08bfff700 1 -- 172.21.15.81:0/1872728172 learned_addr learned my addr 172.21.15.81:0/1872728172 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa098d43700 1 --2- 172.21.15.81:0/1872728172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa094155c60 0x7fa094156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f300c5e90 con 0x7f2f300cd490 2023-10-06T02:46:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa08bfff700 1 -- 172.21.15.81:0/1872728172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa094155c60 msgr2=0x7fa094156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa08bfff700 1 --2- 172.21.15.81:0/1872728172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa094155c60 0x7fa094156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa08bfff700 1 -- 172.21.15.81:0/1872728172 >> v1:172.21.15.81:6789/0 conn(0x7fa0940cbc90 legacy=0x7fa094159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa08bfff700 1 -- 172.21.15.81:0/1872728172 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0940caa80 con 0x7fa0940cb840 2023-10-06T02:46:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fa08bfff700 1 --2- 172.21.15.81:0/1872728172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940cb840 0x7fa0940c8810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0099b0 tx=0x7fa07c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1419a904f1eb80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fac53bdc700 1 -- 172.21.15.81:0/102963817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c0cbc90 msgr2=0x7fac4c159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.357+0000 7fac53bdc700 1 --2- 172.21.15.81:0/102963817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c0cbc90 0x7fac4c159ac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac4400d1a0 tx=0x7fac44007690 comp rx=0 tx=0).stop 2023-10-06T02:46:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fa093fff700 1 -- 172.21.15.81:0/1872728172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00b820 con 0x7fa0940cb840 2023-10-06T02:46:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fa093fff700 1 -- 172.21.15.81:0/1872728172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c00b980 con 0x7fa0940cb840 2023-10-06T02:46:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fa093fff700 1 -- 172.21.15.81:0/1872728172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00bd20 con 0x7fa0940cb840 2023-10-06T02:46:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f5ed482a700 1 -- 172.21.15.81:0/4111707750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed015c5e0 msgr2=0x7f5ed006bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fac53bdc700 1 -- 172.21.15.81:0/102963817 shutdown_connections 2023-10-06T02:46:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fac53bdc700 1 --2- 172.21.15.81:0/102963817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c0cbc90 0x7fac4c159ac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f5ed482a700 1 --2- 172.21.15.81:0/4111707750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed015c5e0 0x7f5ed006bb90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0068f20 tx=0x7f5ec0009250 comp rx=0 tx=0).stop 2023-10-06T02:46:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fac53bdc700 1 --2- 172.21.15.81:0/102963817 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 0x7fac4c156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fac53bdc700 1 -- 172.21.15.81:0/102963817 >> 172.21.15.81:0/102963817 conn(0x7fac4c0cc980 msgr2=0x7fac4c0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3999464953 shutdown_connections 2023-10-06T02:46:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3999464953 wait complete. 2023-10-06T02:46:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f2f1e7fc700 1 -- 172.21.15.81:0/1096501361 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f20022030 con 0x7f2f300cd490 2023-10-06T02:46:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fac53bdc700 1 -- 172.21.15.81:0/102963817 shutdown_connections 2023-10-06T02:46:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f5ed482a700 1 -- 172.21.15.81:0/4111707750 shutdown_connections 2023-10-06T02:46:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f5ed482a700 1 --2- 172.21.15.81:0/4111707750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 0x7f5ed006c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f5ed482a700 1 --2- 172.21.15.81:0/4111707750 >> v2:172.21.15.83:3300/0 conn(0x7f5ed0157ab0 0x7f5ed015c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f5ed482a700 1 --2- 172.21.15.81:0/4111707750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed015c5e0 0x7f5ed006bb90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f5ed482a700 1 -- 172.21.15.81:0/4111707750 >> 172.21.15.81:0/4111707750 conn(0x7f5ed00c9ca0 msgr2=0x7f5ed00ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f5ed482a700 1 -- 172.21.15.81:0/4111707750 shutdown_connections 2023-10-06T02:46:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7fa09afa7700 1 -- 172.21.15.81:0/1872728172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940cb840 msgr2=0x7fa0940c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7fa09afa7700 1 --2- 172.21.15.81:0/1872728172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940cb840 0x7fa0940c8810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0099b0 tx=0x7fa07c009250 comp rx=0 tx=0).stop 2023-10-06T02:46:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f2f1e7fc700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f10067080 0x7f2f10069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f2f1e7fc700 1 -- 172.21.15.81:0/1096501361 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2f20086650 con 0x7f2f300cd490 2023-10-06T02:46:21.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7f501e15f700 1 Processor -- start 2023-10-06T02:46:21.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7fa09afa7700 1 -- 172.21.15.81:0/1872728172 shutdown_connections 2023-10-06T02:46:21.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7fa09afa7700 1 --2- 172.21.15.81:0/1872728172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa094155c60 0x7fa094156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7fa09afa7700 1 --2- 172.21.15.81:0/1872728172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940cb840 0x7fa0940c8810 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7fa09afa7700 1 -- 172.21.15.81:0/1872728172 >> 172.21.15.81:0/1872728172 conn(0x7fa0940cc980 msgr2=0x7fa0940ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7fa09afa7700 1 -- 172.21.15.81:0/1872728172 shutdown_connections 2023-10-06T02:46:21.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7fcbe1ab7700 1 Processor -- start 2023-10-06T02:46:21.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7fa09afa7700 1 -- 172.21.15.81:0/1872728172 wait complete. 2023-10-06T02:46:21.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f2f2dd9b700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f10067080 0x7f2f10069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7fac53bdc700 1 -- 172.21.15.81:0/102963817 wait complete. 2023-10-06T02:46:21.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7fac53bdc700 1 Processor -- start 2023-10-06T02:46:21.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.358+0000 7f5ed482a700 1 -- 172.21.15.81:0/4111707750 wait complete. 2023-10-06T02:46:21.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f5ed482a700 1 Processor -- start 2023-10-06T02:46:21.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7fa09afa7700 1 Processor -- start 2023-10-06T02:46:21.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.359+0000 7f501e15f700 1 -- start start 2023-10-06T02:46:21.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7fa09afa7700 1 -- start start 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f501e15f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f501815e170 0x7f50180b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f501e15f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018167f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f501e15f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50180cf940 con 0x7f501815e540 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f501e15f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50180cf010 con 0x7f501815e170 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f501e15f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50180cf2f0 con 0x7f501806d830 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f50177fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f501815e170 0x7f50180b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f50177fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f501815e170 0x7f50180b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47784/0 (socket says 172.21.15.81:47784) 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f50177fe700 1 -- 172.21.15.81:0/3702342752 learned_addr learned my addr 172.21.15.81:0/3702342752 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f5017fff700 1 --2- 172.21.15.81:0/3702342752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018167f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f50177fe700 1 -- 172.21.15.81:0/3702342752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 msgr2=0x7f5018167f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f50177fe700 1 --2- 172.21.15.81:0/3702342752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018167f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f50177fe700 1 -- 172.21.15.81:0/3702342752 >> v1:172.21.15.83:6789/0 conn(0x7f501815e540 legacy=0x7f501806d120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:46:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f50177fe700 1 -- 172.21.15.81:0/3702342752 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50180cf5d0 con 0x7f501815e170 2023-10-06T02:46:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7fcbe1ab7700 1 -- start start 2023-10-06T02:46:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fcbe1ab7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbdc0aedc0 0x7fcbdc1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fcbe1ab7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0af190 0x7fcbdc0c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fcbe1ab7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbdc0c2870 0x7fcbdc069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fcbe1ab7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc160ab0 con 0x7fcbdc0c2870 2023-10-06T02:46:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fcbe1ab7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc160d90 con 0x7fcbdc0aedc0 2023-10-06T02:46:21.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fcbe1ab7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc161070 con 0x7fcbdc0af190 2023-10-06T02:46:21.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f2f2dd9b700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f10067080 0x7f2f10069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f300b1500 tx=0x7f2f28009370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7f5ed482a700 1 -- start start 2023-10-06T02:46:21.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f50177fe700 1 --2- 172.21.15.81:0/3702342752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501815e170 0x7f50180b30a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f50080099b0 tx=0x7f5008009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbd225701423825 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fa09afa7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940cb840 0x7fa094169180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fa09afa7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940cbc90 0x7fa094145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fa09afa7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa094155c60 0x7fa094154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fa09afa7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094145840 con 0x7fa0940cbc90 2023-10-06T02:46:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fa09afa7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094169710 con 0x7fa094155c60 2023-10-06T02:46:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fa09afa7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09416a290 con 0x7fa0940cb840 2023-10-06T02:46:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f5ed482a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 0x7f5ed00c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f5ed482a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ed0157ab0 0x7f5ed0149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f5ed482a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed015c5e0 0x7f5ed0157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7f5ed482a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00b2120 con 0x7f5ed015c5e0 2023-10-06T02:46:21.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ed482a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00b29b0 con 0x7f5ed0157ab0 2023-10-06T02:46:21.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ed482a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00b2e40 con 0x7f5ed0069120 2023-10-06T02:46:21.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa098d43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940cb840 0x7fa094169180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ecdd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ed0157ab0 0x7f5ed0149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ecdd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ed0157ab0 0x7f5ed0149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:46554/0 (socket says 172.21.15.81:46554) 2023-10-06T02:46:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ecdd9b700 1 -- 172.21.15.81:0/2503370124 learned_addr learned my addr 172.21.15.81:0/2503370124 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ece59c700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 0x7f5ed00c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbdc0aedc0 0x7fcbdc1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbdc0aedc0 0x7fcbdc1543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:46584/0 (socket says 172.21.15.81:46584) 2023-10-06T02:46:21.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbdc0c2870 0x7fcbdc069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdb7fe700 1 -- 172.21.15.81:0/3303473027 learned_addr learned my addr 172.21.15.81:0/3303473027 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa098d43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940cb840 0x7fa094169180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:36818/0 (socket says 172.21.15.81:36818) 2023-10-06T02:46:21.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa098d43700 1 -- 172.21.15.81:0/3779446809 learned_addr learned my addr 172.21.15.81:0/3779446809 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa099544700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa094155c60 0x7fa094154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5eced9d700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed015c5e0 0x7f5ed0157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa08bfff700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940cbc90 0x7fa094145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ece59c700 1 -- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ed0157ab0 msgr2=0x7f5ed0149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ece59c700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ed0157ab0 0x7f5ed0149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ece59c700 1 -- 172.21.15.81:0/2503370124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed015c5e0 msgr2=0x7f5ed0157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ece59c700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed015c5e0 0x7f5ed0157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ece59c700 1 -- 172.21.15.81:0/2503370124 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec00094f0 con 0x7f5ed0069120 2023-10-06T02:46:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdbfff700 1 -- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0af190 msgr2=0x7fcbdc0c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdbfff700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0af190 0x7fcbdc0c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdbfff700 1 -- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbdc0aedc0 msgr2=0x7fcbdc1543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdbfff700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbdc0aedc0 0x7fcbdc1543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdbfff700 1 -- 172.21.15.81:0/3303473027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4009420 con 0x7fcbdc0c2870 2023-10-06T02:46:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fcbdb7fe700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbdc0aedc0 0x7fcbdc1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fcbdbfff700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbdc0c2870 0x7fcbdc069360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4016000 tx=0x7fcbd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fcbd3fff700 1 -- 172.21.15.81:0/3303473027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400ba60 con 0x7fcbdc0c2870 2023-10-06T02:46:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc161350 con 0x7fcbdc0c2870 2023-10-06T02:46:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc1607a0 con 0x7fcbdc0c2870 2023-10-06T02:46:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fcbd3fff700 1 -- 172.21.15.81:0/3303473027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4011420 con 0x7fcbdc0c2870 2023-10-06T02:46:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fcbd3fff700 1 -- 172.21.15.81:0/3303473027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40117e0 con 0x7fcbdc0c2870 2023-10-06T02:46:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.364+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc00052b0 con 0x7fcbdc0c2870 2023-10-06T02:46:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.364+0000 7f2f1e7fc700 1 -- 172.21.15.81:0/1096501361 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f300c5e90 con 0x7f2f300cd490 2023-10-06T02:46:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f5ece59c700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 0x7f5ed00c8a60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8006fd0 tx=0x7f5eb8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7f5ecdd9b700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ed0157ab0 0x7f5ed0149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.360+0000 7fac53bdc700 1 -- start start 2023-10-06T02:46:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac53bdc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4c0cb840 0x7fac4c1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac53bdc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c0cbc90 0x7fac4c156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac53bdc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 0x7fac4c179e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac53bdc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c178dc0 con 0x7fac4c0cb840 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac53bdc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c1790a0 con 0x7fac4c0cbc90 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac53bdc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c179380 con 0x7fac4c155c60 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac51978700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4c0cb840 0x7fac4c1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac51978700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4c0cb840 0x7fac4c1553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47792/0 (socket says 172.21.15.81:47792) 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac51978700 1 -- 172.21.15.81:0/1160158569 learned_addr learned my addr 172.21.15.81:0/1160158569 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac51177700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c0cbc90 0x7fac4c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.361+0000 7fac52179700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 0x7fac4c179e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fac51978700 1 -- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 msgr2=0x7fac4c179e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fac51978700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 0x7fac4c179e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fac51978700 1 -- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c0cbc90 msgr2=0x7fac4c156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fac51978700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c0cbc90 0x7fac4c156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fac51978700 1 -- 172.21.15.81:0/1160158569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4400be70 con 0x7fac4c0cb840 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fac51978700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4c0cb840 0x7fac4c1553a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fac4800e8d0 tx=0x7fac48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fac41ffb700 1 -- 172.21.15.81:0/1160158569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48035630 con 0x7fac4c0cb840 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fac41ffb700 1 -- 172.21.15.81:0/1160158569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac48035790 con 0x7fac4c0cb840 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fac41ffb700 1 -- 172.21.15.81:0/1160158569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48035b30 con 0x7fac4c0cb840 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f50167fc700 1 -- 172.21.15.81:0/3702342752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008009ea0 con 0x7f501815e170 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f50167fc700 1 -- 172.21.15.81:0/3702342752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500800b820 con 0x7f501815e170 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7f50167fc700 1 -- 172.21.15.81:0/3702342752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500800bbc0 con 0x7f501815e170 2023-10-06T02:46:21.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7f501e15f700 1 -- 172.21.15.81:0/3702342752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501815e170 msgr2=0x7f50180b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7f501e15f700 1 --2- 172.21.15.81:0/3702342752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501815e170 0x7f50180b30a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f50080099b0 tx=0x7f5008009250 comp rx=0 tx=0).stop 2023-10-06T02:46:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa098d43700 1 -- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa094155c60 msgr2=0x7fa094154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa098d43700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa094155c60 0x7fa094154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa098d43700 1 -- 172.21.15.81:0/3779446809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940cbc90 msgr2=0x7fa094145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa098d43700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940cbc90 0x7fa094145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.362+0000 7fa098d43700 1 -- 172.21.15.81:0/3779446809 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0094f0 con 0x7fa0940cb840 2023-10-06T02:46:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fa098d43700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940cb840 0x7fa094169180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa084009fa0 tx=0x7fa084009880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fa0917fa700 1 -- 172.21.15.81:0/3779446809 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400ebc0 con 0x7fa0940cb840 2023-10-06T02:46:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fa0917fa700 1 -- 172.21.15.81:0/3779446809 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08400ed20 con 0x7fa0940cb840 2023-10-06T02:46:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.363+0000 7fa0917fa700 1 -- 172.21.15.81:0/3779446809 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084014670 con 0x7fa0940cb840 2023-10-06T02:46:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.364+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa094154a60 con 0x7fa0940cb840 2023-10-06T02:46:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.364+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa094169c40 con 0x7fa0940cb840 2023-10-06T02:46:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c179660 con 0x7fac4c0cb840 2023-10-06T02:46:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7f5ec67fc700 1 -- 172.21.15.81:0/2503370124 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8013410 con 0x7f5ed0069120 2023-10-06T02:46:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7f5ec67fc700 1 -- 172.21.15.81:0/2503370124 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb8013570 con 0x7f5ed0069120 2023-10-06T02:46:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7f5ec67fc700 1 -- 172.21.15.81:0/2503370124 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80138f0 con 0x7f5ed0069120 2023-10-06T02:46:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c1558e0 con 0x7fac4c0cb840 2023-10-06T02:46:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed0153300 con 0x7f5ed0069120 2023-10-06T02:46:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed00b2640 con 0x7f5ed0069120 2023-10-06T02:46:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7fcbd3fff700 1 -- 172.21.15.81:0/3303473027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbd4023070 con 0x7fcbdc0c2870 2023-10-06T02:46:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.366+0000 7fcbd3fff700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcbbc066fb0 0x7fcbbc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.366+0000 7fcbd3fff700 1 -- 172.21.15.81:0/3303473027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcbd4085cf0 con 0x7fcbdc0c2870 2023-10-06T02:46:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.366+0000 7fa0917fa700 1 -- 172.21.15.81:0/3779446809 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0840149e0 con 0x7fa0940cb840 2023-10-06T02:46:21.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.366+0000 7fcbdb7fe700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcbbc066fb0 0x7fcbbc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.366+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c0aeab0 con 0x7fac4c0cb840 2023-10-06T02:46:21.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7f501e15f700 1 -- 172.21.15.81:0/3702342752 shutdown_connections 2023-10-06T02:46:21.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7f501e15f700 1 --2- 172.21.15.81:0/3702342752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018167f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7f501e15f700 1 --2- 172.21.15.81:0/3702342752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501815e170 0x7f50180b30a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.365+0000 7f501e15f700 1 -- 172.21.15.81:0/3702342752 >> 172.21.15.81:0/3702342752 conn(0x7f501806bb90 msgr2=0x7f501806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.367+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed00b2c90 con 0x7f5ed0069120 2023-10-06T02:46:21.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.367+0000 7fa0917fa700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa074066f30 0x7fa0740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.367+0000 7fa0917fa700 1 -- 172.21.15.81:0/3779446809 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa084084cd0 con 0x7fa0940cb840 2023-10-06T02:46:21.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.367+0000 7fa08bfff700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa074066f30 0x7fa0740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.367+0000 7fcbdb7fe700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcbbc066fb0 0x7fcbbc069460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc002230 tx=0x7fcbcc001ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.368+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa094067bc0 con 0x7fa0940cb840 2023-10-06T02:46:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.368+0000 7fa08bfff700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa074066f30 0x7fa0740693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0099b0 tx=0x7fa07c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.368+0000 7f501e15f700 1 -- 172.21.15.81:0/3702342752 shutdown_connections 2023-10-06T02:46:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.368+0000 7f501e15f700 1 -- 172.21.15.81:0/3702342752 wait complete. 2023-10-06T02:46:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.368+0000 7fac41ffb700 1 -- 172.21.15.81:0/1160158569 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac48047430 con 0x7fac4c0cb840 2023-10-06T02:46:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.368+0000 7fac41ffb700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac30067000 0x7fac300694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.369+0000 7fac51177700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac30067000 0x7fac300694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.368+0000 7f5ec67fc700 1 -- 172.21.15.81:0/2503370124 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5eb8013ce0 con 0x7f5ed0069120 2023-10-06T02:46:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.368+0000 7f5ec67fc700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5eb0067080 0x7f5eb0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.369+0000 7f5ec67fc700 1 -- 172.21.15.81:0/2503370124 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5eb80846e0 con 0x7f5ed0069120 2023-10-06T02:46:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.369+0000 7f5ecdd9b700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5eb0067080 0x7f5eb0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.369+0000 7fac51177700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac30067000 0x7fac300694b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0aea60 tx=0x7fac3c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.369+0000 7f5ecdd9b700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5eb0067080 0x7f5eb0069530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00c3c20 tx=0x7f5ec001c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.370+0000 7f501e15f700 1 Processor -- start 2023-10-06T02:46:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.370+0000 7f501e15f700 1 -- start start 2023-10-06T02:46:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f501e15f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f501e15f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501815e170 0x7f501814e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f501e15f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f501815e540 0x7f501814eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f501e15f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501814fdd0 con 0x7f501815e170 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f501e15f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5018152220 con 0x7f501815e540 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f501e15f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501814f1c0 con 0x7f501806d830 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f50177fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f50177fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:36846/0 (socket says 172.21.15.81:36846) 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f50177fe700 1 -- 172.21.15.81:0/3676854382 learned_addr learned my addr 172.21.15.81:0/3676854382 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f5016ffd700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501815e170 0x7f501814e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.371+0000 7f5017fff700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f501815e540 0x7f501814eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.372+0000 7f50177fe700 1 -- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f501815e540 msgr2=0x7f501814eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.372+0000 7f50177fe700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f501815e540 0x7f501814eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.372+0000 7f50177fe700 1 -- 172.21.15.81:0/3676854382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501815e170 msgr2=0x7f501814e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.372+0000 7f50177fe700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501815e170 0x7f501814e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.372+0000 7f50177fe700 1 -- 172.21.15.81:0/3676854382 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080094f0 con 0x7f501806d830 2023-10-06T02:46:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.372+0000 7f5ec67fc700 1 -- 172.21.15.81:0/2503370124 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5eb8051850 con 0x7f5ed0069120 2023-10-06T02:46:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.372+0000 7f50177fe700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018151ce0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5008009290 tx=0x7f5008016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.375+0000 7fac41ffb700 1 -- 172.21.15.81:0/1160158569 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fac48077fe0 con 0x7fac4c0cb840 2023-10-06T02:46:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.375+0000 7fcbd3fff700 1 -- 172.21.15.81:0/3303473027 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbd4052d60 con 0x7fcbdc0c2870 2023-10-06T02:46:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.376+0000 7f50077fe700 1 -- 172.21.15.81:0/3676854382 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50080119d0 con 0x7f501806d830 2023-10-06T02:46:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.376+0000 7f50077fe700 1 -- 172.21.15.81:0/3676854382 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5008020070 con 0x7f501806d830 2023-10-06T02:46:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.376+0000 7f50077fe700 1 -- 172.21.15.81:0/3676854382 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008011dc0 con 0x7f501806d830 2023-10-06T02:46:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.376+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501814f4a0 con 0x7f501806d830 2023-10-06T02:46:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.376+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501814fa60 con 0x7f501806d830 2023-10-06T02:46:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.377+0000 7fa0917fa700 1 -- 172.21.15.81:0/3779446809 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa084051de0 con 0x7fa0940cb840 2023-10-06T02:46:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.377+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5018067ac0 con 0x7f501806d830 2023-10-06T02:46:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.378+0000 7f50077fe700 1 -- 172.21.15.81:0/3676854382 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5008022030 con 0x7f501806d830 2023-10-06T02:46:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.378+0000 7f50077fe700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ffc066f00 0x7f4ffc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.378+0000 7f50077fe700 1 -- 172.21.15.81:0/3676854382 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f50080862b0 con 0x7f501806d830 2023-10-06T02:46:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.378+0000 7f5016ffd700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ffc066f00 0x7f4ffc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.379+0000 7f5016ffd700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ffc066f00 0x7f4ffc0693b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5018169020 tx=0x7f500c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.383+0000 7f50077fe700 1 -- 172.21.15.81:0/3676854382 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50080533c0 con 0x7f501806d830 2023-10-06T02:46:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.384+0000 7fac41ffb700 1 -- 172.21.15.81:0/1160158569 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac480776b0 con 0x7fac4c0cb840 2023-10-06T02:46:21.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.639+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fcc157890 con 0x7f9fcc1569e0 2023-10-06T02:46:21.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.639+0000 7f9fba7fc700 1 -- 172.21.15.81:0/1854012707 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fc0017070 con 0x7f9fcc1569e0 2023-10-06T02:46:21.652 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fac067000 msgr2=0x7f9fac0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fac067000 0x7f9fac0694b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009fd0 tx=0x7f9fbc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fcc1569e0 msgr2=0x7f9fcc151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fcc1569e0 0x7f9fcc151db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0001eb0 tx=0x7f9fc0007ec0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 shutdown_connections 2023-10-06T02:46:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fcc156db0 0x7f9fcc0af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06e940 0x7f9fcc1773c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fac067000 0x7f9fac0694b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 --2- 172.21.15.81:0/1854012707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fcc1569e0 0x7f9fcc151db0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 >> 172.21.15.81:0/1854012707 conn(0x7f9fcc06cca0 msgr2=0x7f9fcc0b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 shutdown_connections 2023-10-06T02:46:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.660+0000 7f9fd0bd2700 1 -- 172.21.15.81:0/1854012707 wait complete. 2023-10-06T02:46:21.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-06T02:46:21.679 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.689+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0754005560 con 0x7f07740c83a0 2023-10-06T02:46:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.689+0000 7f075b7fe700 1 -- 172.21.15.81:0/1836333540 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0768020020 con 0x7f07740c83a0 2023-10-06T02:46:21.691 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.692+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0760067080 msgr2=0x7f0760069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.692+0000 7f077a10a700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0760067080 0x7f0760069530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f076400b880 tx=0x7f076401d000 comp rx=0 tx=0).stop 2023-10-06T02:46:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.692+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07740c83a0 msgr2=0x7f07740afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.692+0000 7f077a10a700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07740c83a0 0x7f07740afa80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f076800e8a0 tx=0x7f0768008040 comp rx=0 tx=0).stop 2023-10-06T02:46:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.693+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 shutdown_connections 2023-10-06T02:46:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.693+0000 7f077a10a700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07740c83a0 0x7f07740afa80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.693+0000 7f077a10a700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f077406f580 0x7f0774171c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.693+0000 7f077a10a700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0760067080 0x7f0760069530 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.693+0000 7f077a10a700 1 --2- 172.21.15.81:0/1836333540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f077406f950 0x7f0774167340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.693+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 >> 172.21.15.81:0/1836333540 conn(0x7f07740cc980 msgr2=0x7f07740c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.693+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 shutdown_connections 2023-10-06T02:46:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.693+0000 7f077a10a700 1 -- 172.21.15.81:0/1836333540 wait complete. 2023-10-06T02:46:21.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-06T02:46:21.712 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.723+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcbc0005560 con 0x7fcbdc0c2870 2023-10-06T02:46:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.724+0000 7fcbd3fff700 1 -- 172.21.15.81:0/3303473027 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbd4015020 con 0x7fcbdc0c2870 2023-10-06T02:46:21.727 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:21.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.730+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcbbc066fb0 msgr2=0x7fcbbc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.730+0000 7fcbe1ab7700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcbbc066fb0 0x7fcbbc069460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc002230 tx=0x7fcbcc001ad0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.730+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbdc0c2870 msgr2=0x7fcbdc069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.730+0000 7fcbe1ab7700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbdc0c2870 0x7fcbdc069360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4016000 tx=0x7fcbd4017000 comp rx=0 tx=0).stop 2023-10-06T02:46:21.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.730+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5ed00cd010 con 0x7f5ed0069120 2023-10-06T02:46:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.731+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 shutdown_connections 2023-10-06T02:46:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.731+0000 7fcbe1ab7700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbdc0c2870 0x7fcbdc069360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.731+0000 7fcbe1ab7700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcbbc066fb0 0x7fcbbc069460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.731+0000 7fcbe1ab7700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbdc0aedc0 0x7fcbdc1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.731+0000 7fcbe1ab7700 1 --2- 172.21.15.81:0/3303473027 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbdc0af190 0x7fcbdc0c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.731+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 >> 172.21.15.81:0/3303473027 conn(0x7fcbdc06c660 msgr2=0x7fcbdc0c99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.731+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 shutdown_connections 2023-10-06T02:46:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.731+0000 7fcbe1ab7700 1 -- 172.21.15.81:0/3303473027 wait complete. 2023-10-06T02:46:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.732+0000 7f5ec67fc700 1 -- 172.21.15.81:0/2503370124 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5eb8020020 con 0x7f5ed0069120 2023-10-06T02:46:21.733 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.735+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5eb0067080 msgr2=0x7f5eb0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.735+0000 7f5ed482a700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5eb0067080 0x7f5eb0069530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00c3c20 tx=0x7f5ec001c000 comp rx=0 tx=0).stop 2023-10-06T02:46:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.735+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 msgr2=0x7f5ed00c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.735+0000 7f5ed482a700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 0x7f5ed00c8a60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8006fd0 tx=0x7f5eb8008040 comp rx=0 tx=0).stop 2023-10-06T02:46:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.736+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 shutdown_connections 2023-10-06T02:46:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.736+0000 7f5ed482a700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed015c5e0 0x7f5ed0157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.736+0000 7f5ed482a700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ed0069120 0x7f5ed00c8a60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.736+0000 7f5ed482a700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5eb0067080 0x7f5eb0069530 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.736+0000 7f5ed482a700 1 --2- 172.21.15.81:0/2503370124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ed0157ab0 0x7f5ed0149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.736+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 >> 172.21.15.81:0/2503370124 conn(0x7f5ed00c9ca0 msgr2=0x7f5ed0156d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.736+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 shutdown_connections 2023-10-06T02:46:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.736+0000 7f5ed482a700 1 -- 172.21.15.81:0/2503370124 wait complete. 2023-10-06T02:46:21.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.738+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f300c5e90 con 0x7f2f300cd490 2023-10-06T02:46:21.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.738+0000 7f2f1e7fc700 1 -- 172.21.15.81:0/1096501361 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f300c5e90 con 0x7f2f300cd490 2023-10-06T02:46:21.739 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.742+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f10067080 msgr2=0x7f2f10069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.742+0000 7f2f34c44700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f10067080 0x7f2f10069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f300b1500 tx=0x7f2f28009370 comp rx=0 tx=0).stop 2023-10-06T02:46:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.742+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f300cd490 msgr2=0x7f2f300b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.742+0000 7f2f34c44700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f300cd490 0x7f2f300b0250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f20003080 tx=0x7f2f20016000 comp rx=0 tx=0).stop 2023-10-06T02:46:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.743+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 shutdown_connections 2023-10-06T02:46:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.743+0000 7f2f34c44700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f30156100 0x7f2f300b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.743+0000 7f2f34c44700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f10067080 0x7f2f10069530 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.743+0000 7f2f34c44700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f300cd490 0x7f2f300b0250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.743+0000 7f2f34c44700 1 --2- 172.21.15.81:0/1096501361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f30155c60 0x7f2f3016e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.743+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 >> 172.21.15.81:0/1096501361 conn(0x7f2f300cc980 msgr2=0x7f2f300c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.743+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 shutdown_connections 2023-10-06T02:46:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.743+0000 7f2f34c44700 1 -- 172.21.15.81:0/1096501361 wait complete. 2023-10-06T02:46:21.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-06T02:46:21.750 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:21.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-06T02:46:21.755 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:21.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-06T02:46:21.762 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:21.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.771+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5018067ac0 con 0x7f501806d830 2023-10-06T02:46:21.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.772+0000 7f50077fe700 1 -- 172.21.15.81:0/3676854382 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50080569e0 con 0x7f501806d830 2023-10-06T02:46:21.773 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:21.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fac4c0cad60 con 0x7fac4c0cb840 2023-10-06T02:46:21.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7fac41ffb700 1 -- 172.21.15.81:0/1160158569 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fac48042020 con 0x7fac4c0cb840 2023-10-06T02:46:21.776 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:21.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ffc066f00 msgr2=0x7f4ffc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ffc066f00 0x7f4ffc0693b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5018169020 tx=0x7f500c009060 comp rx=0 tx=0).stop 2023-10-06T02:46:21.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 msgr2=0x7f5018151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018151ce0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5008009290 tx=0x7f5008016000 comp rx=0 tx=0).stop 2023-10-06T02:46:21.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 shutdown_connections 2023-10-06T02:46:21.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ffc066f00 0x7f4ffc0693b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f501815e540 0x7f501814eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f501806d830 0x7f5018151ce0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 --2- 172.21.15.81:0/3676854382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501815e170 0x7f501814e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 >> 172.21.15.81:0/3676854382 conn(0x7f501806bb90 msgr2=0x7f50180b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 shutdown_connections 2023-10-06T02:46:21.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.775+0000 7f501e15f700 1 -- 172.21.15.81:0/3676854382 wait complete. 2023-10-06T02:46:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac30067000 msgr2=0x7fac300694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac30067000 0x7fac300694b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0aea60 tx=0x7fac3c009060 comp rx=0 tx=0).stop 2023-10-06T02:46:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4c0cb840 msgr2=0x7fac4c1553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4c0cb840 0x7fac4c1553a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fac4800e8d0 tx=0x7fac48008040 comp rx=0 tx=0).stop 2023-10-06T02:46:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 shutdown_connections 2023-10-06T02:46:21.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c155c60 0x7fac4c179e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4c0cb840 0x7fac4c1553a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac30067000 0x7fac300694b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 --2- 172.21.15.81:0/1160158569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c0cbc90 0x7fac4c156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 >> 172.21.15.81:0/1160158569 conn(0x7fac4c0cc980 msgr2=0x7fac4c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 shutdown_connections 2023-10-06T02:46:21.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.777+0000 7fac53bdc700 1 -- 172.21.15.81:0/1160158569 wait complete. 2023-10-06T02:46:21.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.778+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa0940cad60 con 0x7fa0940cb840 2023-10-06T02:46:21.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.778+0000 7fa0917fa700 1 -- 172.21.15.81:0/3779446809 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0840099c0 con 0x7fa0940cb840 2023-10-06T02:46:21.782 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-06T02:46:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa074066f30 msgr2=0x7fa0740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa074066f30 0x7fa0740693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0099b0 tx=0x7fa07c016000 comp rx=0 tx=0).stop 2023-10-06T02:46:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940cb840 msgr2=0x7fa094169180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940cb840 0x7fa094169180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa084009fa0 tx=0x7fa084009880 comp rx=0 tx=0).stop 2023-10-06T02:46:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 shutdown_connections 2023-10-06T02:46:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa074066f30 0x7fa0740693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa094155c60 0x7fa094154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940cb840 0x7fa094169180 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 --2- 172.21.15.81:0/3779446809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940cbc90 0x7fa094145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 >> 172.21.15.81:0/3779446809 conn(0x7fa0940cc980 msgr2=0x7fa0940c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 shutdown_connections 2023-10-06T02:46:21.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.781+0000 7fa09afa7700 1 -- 172.21.15.81:0/3779446809 wait complete. 2023-10-06T02:46:21.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-06T02:46:21.791 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:21.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-06T02:46:21.793 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:21.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-06T02:46:21.796 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:21.796 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T02:46:21.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:46:21.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.949+0000 7fd846526700 1 Processor -- start 2023-10-06T02:46:21.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.949+0000 7fd846526700 1 -- start start 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.950+0000 7fd846526700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd840157a60 0x7fd84015b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.950+0000 7fd846526700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd84006c190 0x7fd8400b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.950+0000 7fd846526700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd840069d10 con 0x7fd8400b3170 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.950+0000 7fd846526700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8400b35b0 con 0x7fd840157a60 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.950+0000 7fd846526700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84015c130 con 0x7fd84006c190 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.950+0000 7fd83ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd840157a60 0x7fd84015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.950+0000 7fd844ac3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd8400b3170 0x7fd84006a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50252/0 (socket says 172.21.15.81:50252) 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.950+0000 7fd844ac3700 1 -- 172.21.15.81:0/3772974865 learned_addr learned my addr 172.21.15.81:0/3772974865 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83f7fe700 1 --2- 172.21.15.81:0/3772974865 >> v2:172.21.15.83:3300/0 conn(0x7fd84006c190 0x7fd8400b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83ffff700 1 -- 172.21.15.81:0/3772974865 >> v2:172.21.15.83:3300/0 conn(0x7fd84006c190 msgr2=0x7fd8400b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83ffff700 1 --2- 172.21.15.81:0/3772974865 >> v2:172.21.15.83:3300/0 conn(0x7fd84006c190 0x7fd8400b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83ffff700 1 -- 172.21.15.81:0/3772974865 >> v1:172.21.15.81:6789/0 conn(0x7fd8400b3170 legacy=0x7fd84006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83ffff700 1 -- 172.21.15.81:0/3772974865 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84015c410 con 0x7fd840157a60 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83effd700 1 -- 172.21.15.81:0/3772974865 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282146379 0 0) 0x7fd840069d10 con 0x7fd8400b3170 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83ffff700 1 --2- 172.21.15.81:0/3772974865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd840157a60 0x7fd84015b8e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd840067e70 tx=0x7fd8300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9e3a5e139db666 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83effd700 1 -- 172.21.15.81:0/3772974865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000b6b0 con 0x7fd840157a60 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83effd700 1 -- 172.21.15.81:0/3772974865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000b810 con 0x7fd840157a60 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd83effd700 1 -- 172.21.15.81:0/3772974865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000bbb0 con 0x7fd840157a60 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd846526700 1 -- 172.21.15.81:0/3772974865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd840157a60 msgr2=0x7fd84015b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd846526700 1 --2- 172.21.15.81:0/3772974865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd840157a60 0x7fd84015b8e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd840067e70 tx=0x7fd8300091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd846526700 1 -- 172.21.15.81:0/3772974865 shutdown_connections 2023-10-06T02:46:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd846526700 1 --2- 172.21.15.81:0/3772974865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd840157a60 0x7fd84015b8e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd846526700 1 --2- 172.21.15.81:0/3772974865 >> v2:172.21.15.83:3300/0 conn(0x7fd84006c190 0x7fd8400b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd846526700 1 -- 172.21.15.81:0/3772974865 >> 172.21.15.81:0/3772974865 conn(0x7fd84006cca0 msgr2=0x7fd84006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd846526700 1 -- 172.21.15.81:0/3772974865 shutdown_connections 2023-10-06T02:46:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.951+0000 7fd846526700 1 -- 172.21.15.81:0/3772974865 wait complete. 2023-10-06T02:46:21.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.952+0000 7fd846526700 1 Processor -- start 2023-10-06T02:46:21.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.953+0000 7fd846526700 1 -- start start 2023-10-06T02:46:21.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.953+0000 7fd846526700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84006c190 0x7fd8400ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.953+0000 7fd846526700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8400b3170 0x7fd8400cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.953+0000 7fd846526700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd840157a60 0x7fd8401508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.953+0000 7fd846526700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400cd650 con 0x7fd8400b3170 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.953+0000 7fd846526700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400cca40 con 0x7fd84006c190 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.953+0000 7fd846526700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400ccd20 con 0x7fd840157a60 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.953+0000 7fd83f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8400b3170 0x7fd8400cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd83f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8400b3170 0x7fd8400cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47860/0 (socket says 172.21.15.81:47860) 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd83f7fe700 1 -- 172.21.15.81:0/360792636 learned_addr learned my addr 172.21.15.81:0/360792636 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd83ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84006c190 0x7fd8400ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd844ac3700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd840157a60 0x7fd8401508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd83f7fe700 1 -- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd840157a60 msgr2=0x7fd8401508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd83f7fe700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd840157a60 0x7fd8401508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd83f7fe700 1 -- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84006c190 msgr2=0x7fd8400ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd83f7fe700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84006c190 0x7fd8400ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd83f7fe700 1 -- 172.21.15.81:0/360792636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830009420 con 0x7fd8400b3170 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd844ac3700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd840157a60 0x7fd8401508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd83f7fe700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8400b3170 0x7fd8400cc180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd83400c7d0 tx=0x7fd834008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd827fff700 1 -- 172.21.15.81:0/360792636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834011600 con 0x7fd8400b3170 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd827fff700 1 -- 172.21.15.81:0/360792636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834011760 con 0x7fd8400b3170 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd827fff700 1 -- 172.21.15.81:0/360792636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834011b20 con 0x7fd8400b3170 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8400cd000 con 0x7fd8400b3170 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.954+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8400cc6c0 con 0x7fd8400b3170 2023-10-06T02:46:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.955+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8400cd4a0 con 0x7fd8400b3170 2023-10-06T02:46:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.956+0000 7fd827fff700 1 -- 172.21.15.81:0/360792636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd834018350 con 0x7fd8400b3170 2023-10-06T02:46:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.956+0000 7fd827fff700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd82c066f30 0x7fd82c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.956+0000 7fd827fff700 1 -- 172.21.15.81:0/360792636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd834084610 con 0x7fd8400b3170 2023-10-06T02:46:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.956+0000 7fd83ffff700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd82c066f30 0x7fd82c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.956+0000 7fd83ffff700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd82c066f30 0x7fd82c0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8300093f0 tx=0x7fd830017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:21.960+0000 7fd827fff700 1 -- 172.21.15.81:0/360792636 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd834051720 con 0x7fd8400b3170 2023-10-06T02:46:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.138+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8400cd790 con 0x7fd82c066f30 2023-10-06T02:46:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.146+0000 7fd827fff700 1 -- 172.21.15.81:0/360792636 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280714 (secure 0 0 0) 0x7fd8400cd790 con 0x7fd82c066f30 2023-10-06T02:46:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd82c066f30 msgr2=0x7fd82c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd82c066f30 0x7fd82c0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8300093f0 tx=0x7fd830017000 comp rx=0 tx=0).stop 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8400b3170 msgr2=0x7fd8400cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8400b3170 0x7fd8400cc180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd83400c7d0 tx=0x7fd834008040 comp rx=0 tx=0).stop 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 shutdown_connections 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd840157a60 0x7fd8401508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd82c066f30 0x7fd82c0693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84006c190 0x7fd8400ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 --2- 172.21.15.81:0/360792636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8400b3170 0x7fd8400cc180 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 >> 172.21.15.81:0/360792636 conn(0x7fd84006cca0 msgr2=0x7fd84015c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 shutdown_connections 2023-10-06T02:46:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.149+0000 7fd846526700 1 -- 172.21.15.81:0/360792636 wait complete. 2023-10-06T02:46:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:46:22.162 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-06T02:46:21.495005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1854,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560645,"statfs":{"total":1600000000,"available":1598101380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003124"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501882+0000","last_change":"2023-10-06T02:46:07.501507+0000","last_active":"2023-10-06T02:46:07.501882+0000","last_peered":"2023-10-06T02:46:07.501882+0000","last_clean":"2023-10-06T02:46:07.501882+0000","last_became_active":"2023-10-06T02:46:07.501299+0000","last_became_peered":"2023-10-06T02:46:07.501299+0000","last_unstale":"2023-10-06T02:46:07.501882+0000","last_undegraded":"2023-10-06T02:46:07.501882+0000","last_fullsized":"2023-10-06T02:46:07.501882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:36.468540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506841+0000","last_change":"2023-10-06T02:46:07.506605+0000","last_active":"2023-10-06T02:46:07.506841+0000","last_peered":"2023-10-06T02:46:07.506841+0000","last_clean":"2023-10-06T02:46:07.506841+0000","last_became_active":"2023-10-06T02:46:07.506120+0000","last_became_peered":"2023-10-06T02:46:07.506120+0000","last_unstale":"2023-10-06T02:46:07.506841+0000","last_undegraded":"2023-10-06T02:46:07.506841+0000","last_fullsized":"2023-10-06T02:46:07.506841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508824+0000","last_change":"2023-10-06T02:46:07.507719+0000","last_active":"2023-10-06T02:46:07.508824+0000","last_peered":"2023-10-06T02:46:07.508824+0000","last_clean":"2023-10-06T02:46:07.508824+0000","last_became_active":"2023-10-06T02:46:07.507126+0000","last_became_peered":"2023-10-06T02:46:07.507126+0000","last_unstale":"2023-10-06T02:46:07.508824+0000","last_undegraded":"2023-10-06T02:46:07.508824+0000","last_fullsized":"2023-10-06T02:46:07.508824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:59.329640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507847+0000","last_change":"2023-10-06T02:46:07.507785+0000","last_active":"2023-10-06T02:46:07.507847+0000","last_peered":"2023-10-06T02:46:07.507847+0000","last_clean":"2023-10-06T02:46:07.507847+0000","last_became_active":"2023-10-06T02:46:07.507554+0000","last_became_peered":"2023-10-06T02:46:07.507554+0000","last_unstale":"2023-10-06T02:46:07.507847+0000","last_undegraded":"2023-10-06T02:46:07.507847+0000","last_fullsized":"2023-10-06T02:46:07.507847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508846+0000","last_change":"2023-10-06T02:46:07.508747+0000","last_active":"2023-10-06T02:46:07.508846+0000","last_peered":"2023-10-06T02:46:07.508846+0000","last_clean":"2023-10-06T02:46:07.508846+0000","last_became_active":"2023-10-06T02:46:07.508461+0000","last_became_peered":"2023-10-06T02:46:07.508461+0000","last_unstale":"2023-10-06T02:46:07.508846+0000","last_undegraded":"2023-10-06T02:46:07.508846+0000","last_fullsized":"2023-10-06T02:46:07.508846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.512128+0000","last_change":"2023-10-06T02:46:07.512070+0000","last_active":"2023-10-06T02:46:07.512128+0000","last_peered":"2023-10-06T02:46:07.512128+0000","last_clean":"2023-10-06T02:46:07.512128+0000","last_became_active":"2023-10-06T02:46:07.511394+0000","last_became_peered":"2023-10-06T02:46:07.511394+0000","last_unstale":"2023-10-06T02:46:07.512128+0000","last_undegraded":"2023-10-06T02:46:07.512128+0000","last_fullsized":"2023-10-06T02:46:07.512128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:21.300350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509806+0000","last_change":"2023-10-06T02:46:07.509710+0000","last_active":"2023-10-06T02:46:07.509806+0000","last_peered":"2023-10-06T02:46:07.509806+0000","last_clean":"2023-10-06T02:46:07.509806+0000","last_became_active":"2023-10-06T02:46:07.509491+0000","last_became_peered":"2023-10-06T02:46:07.509491+0000","last_unstale":"2023-10-06T02:46:07.509806+0000","last_undegraded":"2023-10-06T02:46:07.509806+0000","last_fullsized":"2023-10-06T02:46:07.509806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504477+0000","last_change":"2023-10-06T02:46:07.504387+0000","last_active":"2023-10-06T02:46:07.504477+0000","last_peered":"2023-10-06T02:46:07.504477+0000","last_clean":"2023-10-06T02:46:07.504477+0000","last_became_active":"2023-10-06T02:46:07.503698+0000","last_became_peered":"2023-10-06T02:46:07.503698+0000","last_unstale":"2023-10-06T02:46:07.504477+0000","last_undegraded":"2023-10-06T02:46:07.504477+0000","last_fullsized":"2023-10-06T02:46:07.504477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508671+0000","last_change":"2023-10-06T02:46:07.508533+0000","last_active":"2023-10-06T02:46:07.508671+0000","last_peered":"2023-10-06T02:46:07.508671+0000","last_clean":"2023-10-06T02:46:07.508671+0000","last_became_active":"2023-10-06T02:46:07.507476+0000","last_became_peered":"2023-10-06T02:46:07.507476+0000","last_unstale":"2023-10-06T02:46:07.508671+0000","last_undegraded":"2023-10-06T02:46:07.508671+0000","last_fullsized":"2023-10-06T02:46:07.508671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509782+0000","last_change":"2023-10-06T02:46:07.509724+0000","last_active":"2023-10-06T02:46:07.509782+0000","last_peered":"2023-10-06T02:46:07.509782+0000","last_clean":"2023-10-06T02:46:07.509782+0000","last_became_active":"2023-10-06T02:46:07.509504+0000","last_became_peered":"2023-10-06T02:46:07.509504+0000","last_unstale":"2023-10-06T02:46:07.509782+0000","last_undegraded":"2023-10-06T02:46:07.509782+0000","last_fullsized":"2023-10-06T02:46:07.509782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.512318+0000","last_change":"2023-10-06T02:46:07.512258+0000","last_active":"2023-10-06T02:46:07.512318+0000","last_peered":"2023-10-06T02:46:07.512318+0000","last_clean":"2023-10-06T02:46:07.512318+0000","last_became_active":"2023-10-06T02:46:07.511640+0000","last_became_peered":"2023-10-06T02:46:07.511640+0000","last_unstale":"2023-10-06T02:46:07.512318+0000","last_undegraded":"2023-10-06T02:46:07.512318+0000","last_fullsized":"2023-10-06T02:46:07.512318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:38.382749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.503952+0000","last_change":"2023-10-06T02:46:07.503917+0000","last_active":"2023-10-06T02:46:07.503952+0000","last_peered":"2023-10-06T02:46:07.503952+0000","last_clean":"2023-10-06T02:46:07.503952+0000","last_became_active":"2023-10-06T02:46:07.503658+0000","last_became_peered":"2023-10-06T02:46:07.503658+0000","last_unstale":"2023-10-06T02:46:07.503952+0000","last_undegraded":"2023-10-06T02:46:07.503952+0000","last_fullsized":"2023-10-06T02:46:07.503952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:27.620523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.498723+0000","last_change":"2023-10-06T02:46:07.498659+0000","last_active":"2023-10-06T02:46:07.498723+0000","last_peered":"2023-10-06T02:46:07.498723+0000","last_clean":"2023-10-06T02:46:07.498723+0000","last_became_active":"2023-10-06T02:46:07.498418+0000","last_became_peered":"2023-10-06T02:46:07.498418+0000","last_unstale":"2023-10-06T02:46:07.498723+0000","last_undegraded":"2023-10-06T02:46:07.498723+0000","last_fullsized":"2023-10-06T02:46:07.498723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.400732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504280+0000","last_change":"2023-10-06T02:46:07.504203+0000","last_active":"2023-10-06T02:46:07.504280+0000","last_peered":"2023-10-06T02:46:07.504280+0000","last_clean":"2023-10-06T02:46:07.504280+0000","last_became_active":"2023-10-06T02:46:07.503939+0000","last_became_peered":"2023-10-06T02:46:07.503939+0000","last_unstale":"2023-10-06T02:46:07.504280+0000","last_undegraded":"2023-10-06T02:46:07.504280+0000","last_fullsized":"2023-10-06T02:46:07.504280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509105+0000","last_change":"2023-10-06T02:46:07.508749+0000","last_active":"2023-10-06T02:46:07.509105+0000","last_peered":"2023-10-06T02:46:07.509105+0000","last_clean":"2023-10-06T02:46:07.509105+0000","last_became_active":"2023-10-06T02:46:07.508535+0000","last_became_peered":"2023-10-06T02:46:07.508535+0000","last_unstale":"2023-10-06T02:46:07.509105+0000","last_undegraded":"2023-10-06T02:46:07.509105+0000","last_fullsized":"2023-10-06T02:46:07.509105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.511904+0000","last_change":"2023-10-06T02:46:07.511846+0000","last_active":"2023-10-06T02:46:07.511904+0000","last_peered":"2023-10-06T02:46:07.511904+0000","last_clean":"2023-10-06T02:46:07.511904+0000","last_became_active":"2023-10-06T02:46:07.511179+0000","last_became_peered":"2023-10-06T02:46:07.511179+0000","last_unstale":"2023-10-06T02:46:07.511904+0000","last_undegraded":"2023-10-06T02:46:07.511904+0000","last_fullsized":"2023-10-06T02:46:07.511904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506260+0000","last_change":"2023-10-06T02:46:07.502822+0000","last_active":"2023-10-06T02:46:07.506260+0000","last_peered":"2023-10-06T02:46:07.506260+0000","last_clean":"2023-10-06T02:46:07.506260+0000","last_became_active":"2023-10-06T02:46:07.502312+0000","last_became_peered":"2023-10-06T02:46:07.502312+0000","last_unstale":"2023-10-06T02:46:07.506260+0000","last_undegraded":"2023-10-06T02:46:07.506260+0000","last_fullsized":"2023-10-06T02:46:07.506260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508843+0000","last_change":"2023-10-06T02:46:07.507876+0000","last_active":"2023-10-06T02:46:07.508843+0000","last_peered":"2023-10-06T02:46:07.508843+0000","last_clean":"2023-10-06T02:46:07.508843+0000","last_became_active":"2023-10-06T02:46:07.507455+0000","last_became_peered":"2023-10-06T02:46:07.507455+0000","last_unstale":"2023-10-06T02:46:07.508843+0000","last_undegraded":"2023-10-06T02:46:07.508843+0000","last_fullsized":"2023-10-06T02:46:07.508843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:43.004719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502434+0000","last_change":"2023-10-06T02:46:07.502391+0000","last_active":"2023-10-06T02:46:07.502434+0000","last_peered":"2023-10-06T02:46:07.502434+0000","last_clean":"2023-10-06T02:46:07.502434+0000","last_became_active":"2023-10-06T02:46:07.502156+0000","last_became_peered":"2023-10-06T02:46:07.502156+0000","last_unstale":"2023-10-06T02:46:07.502434+0000","last_undegraded":"2023-10-06T02:46:07.502434+0000","last_fullsized":"2023-10-06T02:46:07.502434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:50.164650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510768+0000","last_change":"2023-10-06T02:46:07.509968+0000","last_active":"2023-10-06T02:46:07.510768+0000","last_peered":"2023-10-06T02:46:07.510768+0000","last_clean":"2023-10-06T02:46:07.510768+0000","last_became_active":"2023-10-06T02:46:07.509123+0000","last_became_peered":"2023-10-06T02:46:07.509123+0000","last_unstale":"2023-10-06T02:46:07.510768+0000","last_undegraded":"2023-10-06T02:46:07.510768+0000","last_fullsized":"2023-10-06T02:46:07.510768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:06.617615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509085+0000","last_change":"2023-10-06T02:46:07.508219+0000","last_active":"2023-10-06T02:46:07.509085+0000","last_peered":"2023-10-06T02:46:07.509085+0000","last_clean":"2023-10-06T02:46:07.509085+0000","last_became_active":"2023-10-06T02:46:07.507886+0000","last_became_peered":"2023-10-06T02:46:07.507886+0000","last_unstale":"2023-10-06T02:46:07.509085+0000","last_undegraded":"2023-10-06T02:46:07.509085+0000","last_fullsized":"2023-10-06T02:46:07.509085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507819+0000","last_change":"2023-10-06T02:46:07.507747+0000","last_active":"2023-10-06T02:46:07.507819+0000","last_peered":"2023-10-06T02:46:07.507819+0000","last_clean":"2023-10-06T02:46:07.507819+0000","last_became_active":"2023-10-06T02:46:07.507526+0000","last_became_peered":"2023-10-06T02:46:07.507526+0000","last_unstale":"2023-10-06T02:46:07.507819+0000","last_undegraded":"2023-10-06T02:46:07.507819+0000","last_fullsized":"2023-10-06T02:46:07.507819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502938+0000","last_change":"2023-10-06T02:46:07.502872+0000","last_active":"2023-10-06T02:46:07.502938+0000","last_peered":"2023-10-06T02:46:07.502938+0000","last_clean":"2023-10-06T02:46:07.502938+0000","last_became_active":"2023-10-06T02:46:07.502642+0000","last_became_peered":"2023-10-06T02:46:07.502642+0000","last_unstale":"2023-10-06T02:46:07.502938+0000","last_undegraded":"2023-10-06T02:46:07.502938+0000","last_fullsized":"2023-10-06T02:46:07.502938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509119+0000","last_change":"2023-10-06T02:46:07.508930+0000","last_active":"2023-10-06T02:46:07.509119+0000","last_peered":"2023-10-06T02:46:07.509119+0000","last_clean":"2023-10-06T02:46:07.509119+0000","last_became_active":"2023-10-06T02:46:07.508593+0000","last_became_peered":"2023-10-06T02:46:07.508593+0000","last_unstale":"2023-10-06T02:46:07.509119+0000","last_undegraded":"2023-10-06T02:46:07.509119+0000","last_fullsized":"2023-10-06T02:46:07.509119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505687+0000","last_change":"2023-10-06T02:46:07.505613+0000","last_active":"2023-10-06T02:46:07.505687+0000","last_peered":"2023-10-06T02:46:07.505687+0000","last_clean":"2023-10-06T02:46:07.505687+0000","last_became_active":"2023-10-06T02:46:07.504983+0000","last_became_peered":"2023-10-06T02:46:07.504983+0000","last_unstale":"2023-10-06T02:46:07.505687+0000","last_undegraded":"2023-10-06T02:46:07.505687+0000","last_fullsized":"2023-10-06T02:46:07.505687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510949+0000","last_change":"2023-10-06T02:46:07.510879+0000","last_active":"2023-10-06T02:46:07.510949+0000","last_peered":"2023-10-06T02:46:07.510949+0000","last_clean":"2023-10-06T02:46:07.510949+0000","last_became_active":"2023-10-06T02:46:07.510585+0000","last_became_peered":"2023-10-06T02:46:07.510585+0000","last_unstale":"2023-10-06T02:46:07.510949+0000","last_undegraded":"2023-10-06T02:46:07.510949+0000","last_fullsized":"2023-10-06T02:46:07.510949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506452+0000","last_change":"2023-10-06T02:46:07.506341+0000","last_active":"2023-10-06T02:46:07.506452+0000","last_peered":"2023-10-06T02:46:07.506452+0000","last_clean":"2023-10-06T02:46:07.506452+0000","last_became_active":"2023-10-06T02:46:07.504926+0000","last_became_peered":"2023-10-06T02:46:07.504926+0000","last_unstale":"2023-10-06T02:46:07.506452+0000","last_undegraded":"2023-10-06T02:46:07.506452+0000","last_fullsized":"2023-10-06T02:46:07.506452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.514988+0000","last_change":"2023-10-06T02:46:06.506243+0000","last_active":"2023-10-06T02:46:07.514988+0000","last_peered":"2023-10-06T02:46:07.514988+0000","last_clean":"2023-10-06T02:46:07.514988+0000","last_became_active":"2023-10-06T02:46:06.505980+0000","last_became_peered":"2023-10-06T02:46:06.505980+0000","last_unstale":"2023-10-06T02:46:07.514988+0000","last_undegraded":"2023-10-06T02:46:07.514988+0000","last_fullsized":"2023-10-06T02:46:07.514988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501873+0000","last_change":"2023-10-06T02:46:07.501612+0000","last_active":"2023-10-06T02:46:07.501873+0000","last_peered":"2023-10-06T02:46:07.501873+0000","last_clean":"2023-10-06T02:46:07.501873+0000","last_became_active":"2023-10-06T02:46:07.501385+0000","last_became_peered":"2023-10-06T02:46:07.501385+0000","last_unstale":"2023-10-06T02:46:07.501873+0000","last_undegraded":"2023-10-06T02:46:07.501873+0000","last_fullsized":"2023-10-06T02:46:07.501873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:51.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499887+0000","last_change":"2023-10-06T02:46:06.506000+0000","last_active":"2023-10-06T02:46:07.499887+0000","last_peered":"2023-10-06T02:46:07.499887+0000","last_clean":"2023-10-06T02:46:07.499887+0000","last_became_active":"2023-10-06T02:46:06.505763+0000","last_became_peered":"2023-10-06T02:46:06.505763+0000","last_unstale":"2023-10-06T02:46:07.499887+0000","last_undegraded":"2023-10-06T02:46:07.499887+0000","last_fullsized":"2023-10-06T02:46:07.499887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507357+0000","last_change":"2023-10-06T02:46:07.507268+0000","last_active":"2023-10-06T02:46:07.507357+0000","last_peered":"2023-10-06T02:46:07.507357+0000","last_clean":"2023-10-06T02:46:07.507357+0000","last_became_active":"2023-10-06T02:46:07.507051+0000","last_became_peered":"2023-10-06T02:46:07.507051+0000","last_unstale":"2023-10-06T02:46:07.507357+0000","last_undegraded":"2023-10-06T02:46:07.507357+0000","last_fullsized":"2023-10-06T02:46:07.507357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497675+0000","last_change":"2023-10-06T02:46:06.504271+0000","last_active":"2023-10-06T02:46:07.497675+0000","last_peered":"2023-10-06T02:46:07.497675+0000","last_clean":"2023-10-06T02:46:07.497675+0000","last_became_active":"2023-10-06T02:46:06.502572+0000","last_became_peered":"2023-10-06T02:46:06.502572+0000","last_unstale":"2023-10-06T02:46:07.497675+0000","last_undegraded":"2023-10-06T02:46:07.497675+0000","last_fullsized":"2023-10-06T02:46:07.497675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.503491+0000","last_change":"2023-10-06T02:46:07.503446+0000","last_active":"2023-10-06T02:46:07.503491+0000","last_peered":"2023-10-06T02:46:07.503491+0000","last_clean":"2023-10-06T02:46:07.503491+0000","last_became_active":"2023-10-06T02:46:07.503262+0000","last_became_peered":"2023-10-06T02:46:07.503262+0000","last_unstale":"2023-10-06T02:46:07.503491+0000","last_undegraded":"2023-10-06T02:46:07.503491+0000","last_fullsized":"2023-10-06T02:46:07.503491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499431+0000","last_change":"2023-10-06T02:46:06.501875+0000","last_active":"2023-10-06T02:46:07.499431+0000","last_peered":"2023-10-06T02:46:07.499431+0000","last_clean":"2023-10-06T02:46:07.499431+0000","last_became_active":"2023-10-06T02:46:06.501424+0000","last_became_peered":"2023-10-06T02:46:06.501424+0000","last_unstale":"2023-10-06T02:46:07.499431+0000","last_undegraded":"2023-10-06T02:46:07.499431+0000","last_fullsized":"2023-10-06T02:46:07.499431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501890+0000","last_change":"2023-10-06T02:46:07.501817+0000","last_active":"2023-10-06T02:46:07.501890+0000","last_peered":"2023-10-06T02:46:07.501890+0000","last_clean":"2023-10-06T02:46:07.501890+0000","last_became_active":"2023-10-06T02:46:07.501591+0000","last_became_peered":"2023-10-06T02:46:07.501591+0000","last_unstale":"2023-10-06T02:46:07.501890+0000","last_undegraded":"2023-10-06T02:46:07.501890+0000","last_fullsized":"2023-10-06T02:46:07.501890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497426+0000","last_change":"2023-10-06T02:46:06.501257+0000","last_active":"2023-10-06T02:46:07.497426+0000","last_peered":"2023-10-06T02:46:07.497426+0000","last_clean":"2023-10-06T02:46:07.497426+0000","last_became_active":"2023-10-06T02:46:06.501036+0000","last_became_peered":"2023-10-06T02:46:06.501036+0000","last_unstale":"2023-10-06T02:46:07.497426+0000","last_undegraded":"2023-10-06T02:46:07.497426+0000","last_fullsized":"2023-10-06T02:46:07.497426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504480+0000","last_change":"2023-10-06T02:46:07.504425+0000","last_active":"2023-10-06T02:46:07.504480+0000","last_peered":"2023-10-06T02:46:07.504480+0000","last_clean":"2023-10-06T02:46:07.504480+0000","last_became_active":"2023-10-06T02:46:07.504212+0000","last_became_peered":"2023-10-06T02:46:07.504212+0000","last_unstale":"2023-10-06T02:46:07.504480+0000","last_undegraded":"2023-10-06T02:46:07.504480+0000","last_fullsized":"2023-10-06T02:46:07.504480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.517401+0000","last_change":"2023-10-06T02:46:06.503947+0000","last_active":"2023-10-06T02:46:07.517401+0000","last_peered":"2023-10-06T02:46:07.517401+0000","last_clean":"2023-10-06T02:46:07.517401+0000","last_became_active":"2023-10-06T02:46:06.503721+0000","last_became_peered":"2023-10-06T02:46:06.503721+0000","last_unstale":"2023-10-06T02:46:07.517401+0000","last_undegraded":"2023-10-06T02:46:07.517401+0000","last_fullsized":"2023-10-06T02:46:07.517401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:40.222541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510647+0000","last_change":"2023-10-06T02:46:07.510256+0000","last_active":"2023-10-06T02:46:07.510647+0000","last_peered":"2023-10-06T02:46:07.510647+0000","last_clean":"2023-10-06T02:46:07.510647+0000","last_became_active":"2023-10-06T02:46:07.507169+0000","last_became_peered":"2023-10-06T02:46:07.507169+0000","last_unstale":"2023-10-06T02:46:07.510647+0000","last_undegraded":"2023-10-06T02:46:07.510647+0000","last_fullsized":"2023-10-06T02:46:07.510647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.520847+0000","last_change":"2023-10-06T02:46:06.506258+0000","last_active":"2023-10-06T02:46:07.520847+0000","last_peered":"2023-10-06T02:46:07.520847+0000","last_clean":"2023-10-06T02:46:07.520847+0000","last_became_active":"2023-10-06T02:46:06.505429+0000","last_became_peered":"2023-10-06T02:46:06.505429+0000","last_unstale":"2023-10-06T02:46:07.520847+0000","last_undegraded":"2023-10-06T02:46:07.520847+0000","last_fullsized":"2023-10-06T02:46:07.520847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510753+0000","last_change":"2023-10-06T02:46:07.509811+0000","last_active":"2023-10-06T02:46:07.510753+0000","last_peered":"2023-10-06T02:46:07.510753+0000","last_clean":"2023-10-06T02:46:07.510753+0000","last_became_active":"2023-10-06T02:46:07.508799+0000","last_became_peered":"2023-10-06T02:46:07.508799+0000","last_unstale":"2023-10-06T02:46:07.510753+0000","last_undegraded":"2023-10-06T02:46:07.510753+0000","last_fullsized":"2023-10-06T02:46:07.510753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:39.042317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519408+0000","last_change":"2023-10-06T02:46:06.510875+0000","last_active":"2023-10-06T02:46:07.519408+0000","last_peered":"2023-10-06T02:46:07.519408+0000","last_clean":"2023-10-06T02:46:07.519408+0000","last_became_active":"2023-10-06T02:46:06.510700+0000","last_became_peered":"2023-10-06T02:46:06.510700+0000","last_unstale":"2023-10-06T02:46:07.519408+0000","last_undegraded":"2023-10-06T02:46:07.519408+0000","last_fullsized":"2023-10-06T02:46:07.519408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:25.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507028+0000","last_change":"2023-10-06T02:46:07.506952+0000","last_active":"2023-10-06T02:46:07.507028+0000","last_peered":"2023-10-06T02:46:07.507028+0000","last_clean":"2023-10-06T02:46:07.507028+0000","last_became_active":"2023-10-06T02:46:07.505445+0000","last_became_peered":"2023-10-06T02:46:07.505445+0000","last_unstale":"2023-10-06T02:46:07.507028+0000","last_undegraded":"2023-10-06T02:46:07.507028+0000","last_fullsized":"2023-10-06T02:46:07.507028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499345+0000","last_change":"2023-10-06T02:46:06.501179+0000","last_active":"2023-10-06T02:46:07.499345+0000","last_peered":"2023-10-06T02:46:07.499345+0000","last_clean":"2023-10-06T02:46:07.499345+0000","last_became_active":"2023-10-06T02:46:06.500963+0000","last_became_peered":"2023-10-06T02:46:06.500963+0000","last_unstale":"2023-10-06T02:46:07.499345+0000","last_undegraded":"2023-10-06T02:46:07.499345+0000","last_fullsized":"2023-10-06T02:46:07.499345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504650+0000","last_change":"2023-10-06T02:46:07.504555+0000","last_active":"2023-10-06T02:46:07.504650+0000","last_peered":"2023-10-06T02:46:07.504650+0000","last_clean":"2023-10-06T02:46:07.504650+0000","last_became_active":"2023-10-06T02:46:07.504138+0000","last_became_peered":"2023-10-06T02:46:07.504138+0000","last_unstale":"2023-10-06T02:46:07.504650+0000","last_undegraded":"2023-10-06T02:46:07.504650+0000","last_fullsized":"2023-10-06T02:46:07.504650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.503062+0000","last_change":"2023-10-06T02:46:06.505783+0000","last_active":"2023-10-06T02:46:07.503062+0000","last_peered":"2023-10-06T02:46:07.503062+0000","last_clean":"2023-10-06T02:46:07.503062+0000","last_became_active":"2023-10-06T02:46:06.505556+0000","last_became_peered":"2023-10-06T02:46:06.505556+0000","last_unstale":"2023-10-06T02:46:07.503062+0000","last_undegraded":"2023-10-06T02:46:07.503062+0000","last_fullsized":"2023-10-06T02:46:07.503062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:03.445295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506278+0000","last_change":"2023-10-06T02:46:07.502954+0000","last_active":"2023-10-06T02:46:07.506278+0000","last_peered":"2023-10-06T02:46:07.506278+0000","last_clean":"2023-10-06T02:46:07.506278+0000","last_became_active":"2023-10-06T02:46:07.502601+0000","last_became_peered":"2023-10-06T02:46:07.502601+0000","last_unstale":"2023-10-06T02:46:07.506278+0000","last_undegraded":"2023-10-06T02:46:07.506278+0000","last_fullsized":"2023-10-06T02:46:07.506278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.518604+0000","last_change":"2023-10-06T02:46:06.503869+0000","last_active":"2023-10-06T02:46:07.518604+0000","last_peered":"2023-10-06T02:46:07.518604+0000","last_clean":"2023-10-06T02:46:07.518604+0000","last_became_active":"2023-10-06T02:46:06.503648+0000","last_became_peered":"2023-10-06T02:46:06.503648+0000","last_unstale":"2023-10-06T02:46:07.518604+0000","last_undegraded":"2023-10-06T02:46:07.518604+0000","last_fullsized":"2023-10-06T02:46:07.518604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505698+0000","last_change":"2023-10-06T02:46:07.505647+0000","last_active":"2023-10-06T02:46:07.505698+0000","last_peered":"2023-10-06T02:46:07.505698+0000","last_clean":"2023-10-06T02:46:07.505698+0000","last_became_active":"2023-10-06T02:46:07.505306+0000","last_became_peered":"2023-10-06T02:46:07.505306+0000","last_unstale":"2023-10-06T02:46:07.505698+0000","last_undegraded":"2023-10-06T02:46:07.505698+0000","last_fullsized":"2023-10-06T02:46:07.505698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:21.300350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519147+0000","last_change":"2023-10-06T02:46:06.509035+0000","last_active":"2023-10-06T02:46:07.519147+0000","last_peered":"2023-10-06T02:46:07.519147+0000","last_clean":"2023-10-06T02:46:07.519147+0000","last_became_active":"2023-10-06T02:46:06.508828+0000","last_became_peered":"2023-10-06T02:46:06.508828+0000","last_unstale":"2023-10-06T02:46:07.519147+0000","last_undegraded":"2023-10-06T02:46:07.519147+0000","last_fullsized":"2023-10-06T02:46:07.519147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:25.817132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505963+0000","last_change":"2023-10-06T02:46:07.505886+0000","last_active":"2023-10-06T02:46:07.505963+0000","last_peered":"2023-10-06T02:46:07.505963+0000","last_clean":"2023-10-06T02:46:07.505963+0000","last_became_active":"2023-10-06T02:46:07.505418+0000","last_became_peered":"2023-10-06T02:46:07.505418+0000","last_unstale":"2023-10-06T02:46:07.505963+0000","last_undegraded":"2023-10-06T02:46:07.505963+0000","last_fullsized":"2023-10-06T02:46:07.505963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519237+0000","last_change":"2023-10-06T02:46:06.509618+0000","last_active":"2023-10-06T02:46:07.519237+0000","last_peered":"2023-10-06T02:46:07.519237+0000","last_clean":"2023-10-06T02:46:07.519237+0000","last_became_active":"2023-10-06T02:46:06.509377+0000","last_became_peered":"2023-10-06T02:46:06.509377+0000","last_unstale":"2023-10-06T02:46:07.519237+0000","last_undegraded":"2023-10-06T02:46:07.519237+0000","last_fullsized":"2023-10-06T02:46:07.519237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:41.862180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507506+0000","last_change":"2023-10-06T02:46:07.507448+0000","last_active":"2023-10-06T02:46:07.507506+0000","last_peered":"2023-10-06T02:46:07.507506+0000","last_clean":"2023-10-06T02:46:07.507506+0000","last_became_active":"2023-10-06T02:46:07.507221+0000","last_became_peered":"2023-10-06T02:46:07.507221+0000","last_unstale":"2023-10-06T02:46:07.507506+0000","last_undegraded":"2023-10-06T02:46:07.507506+0000","last_fullsized":"2023-10-06T02:46:07.507506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.956040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.517062+0000","last_change":"2023-10-06T02:46:06.498625+0000","last_active":"2023-10-06T02:46:07.517062+0000","last_peered":"2023-10-06T02:46:07.517062+0000","last_clean":"2023-10-06T02:46:07.517062+0000","last_became_active":"2023-10-06T02:46:06.498405+0000","last_became_peered":"2023-10-06T02:46:06.498405+0000","last_unstale":"2023-10-06T02:46:07.517062+0000","last_undegraded":"2023-10-06T02:46:07.517062+0000","last_fullsized":"2023-10-06T02:46:07.517062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.895724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501977+0000","last_change":"2023-10-06T02:46:07.501817+0000","last_active":"2023-10-06T02:46:07.501977+0000","last_peered":"2023-10-06T02:46:07.501977+0000","last_clean":"2023-10-06T02:46:07.501977+0000","last_became_active":"2023-10-06T02:46:07.501615+0000","last_became_peered":"2023-10-06T02:46:07.501615+0000","last_unstale":"2023-10-06T02:46:07.501977+0000","last_undegraded":"2023-10-06T02:46:07.501977+0000","last_fullsized":"2023-10-06T02:46:07.501977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497143+0000","last_change":"2023-10-06T02:46:06.502492+0000","last_active":"2023-10-06T02:46:07.497143+0000","last_peered":"2023-10-06T02:46:07.497143+0000","last_clean":"2023-10-06T02:46:07.497143+0000","last_became_active":"2023-10-06T02:46:06.502172+0000","last_became_peered":"2023-10-06T02:46:06.502172+0000","last_unstale":"2023-10-06T02:46:07.497143+0000","last_undegraded":"2023-10-06T02:46:07.497143+0000","last_fullsized":"2023-10-06T02:46:07.497143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509094+0000","last_change":"2023-10-06T02:46:07.508860+0000","last_active":"2023-10-06T02:46:07.509094+0000","last_peered":"2023-10-06T02:46:07.509094+0000","last_clean":"2023-10-06T02:46:07.509094+0000","last_became_active":"2023-10-06T02:46:07.508363+0000","last_became_peered":"2023-10-06T02:46:07.508363+0000","last_unstale":"2023-10-06T02:46:07.509094+0000","last_undegraded":"2023-10-06T02:46:07.509094+0000","last_fullsized":"2023-10-06T02:46:07.509094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.956040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.517248+0000","last_change":"2023-10-06T02:46:06.505039+0000","last_active":"2023-10-06T02:46:07.517248+0000","last_peered":"2023-10-06T02:46:07.517248+0000","last_clean":"2023-10-06T02:46:07.517248+0000","last_became_active":"2023-10-06T02:46:06.504809+0000","last_became_peered":"2023-10-06T02:46:06.504809+0000","last_unstale":"2023-10-06T02:46:07.517248+0000","last_undegraded":"2023-10-06T02:46:07.517248+0000","last_fullsized":"2023-10-06T02:46:07.517248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505737+0000","last_change":"2023-10-06T02:46:07.504251+0000","last_active":"2023-10-06T02:46:07.505737+0000","last_peered":"2023-10-06T02:46:07.505737+0000","last_clean":"2023-10-06T02:46:07.505737+0000","last_became_active":"2023-10-06T02:46:07.504022+0000","last_became_peered":"2023-10-06T02:46:07.504022+0000","last_unstale":"2023-10-06T02:46:07.505737+0000","last_undegraded":"2023-10-06T02:46:07.505737+0000","last_fullsized":"2023-10-06T02:46:07.505737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:41.875449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500561+0000","last_change":"2023-10-06T02:46:06.508771+0000","last_active":"2023-10-06T02:46:07.500561+0000","last_peered":"2023-10-06T02:46:07.500561+0000","last_clean":"2023-10-06T02:46:07.500561+0000","last_became_active":"2023-10-06T02:46:06.508543+0000","last_became_peered":"2023-10-06T02:46:06.508543+0000","last_unstale":"2023-10-06T02:46:07.500561+0000","last_undegraded":"2023-10-06T02:46:07.500561+0000","last_fullsized":"2023-10-06T02:46:07.500561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:22.807034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506800+0000","last_change":"2023-10-06T02:46:07.506413+0000","last_active":"2023-10-06T02:46:07.506800+0000","last_peered":"2023-10-06T02:46:07.506800+0000","last_clean":"2023-10-06T02:46:07.506800+0000","last_became_active":"2023-10-06T02:46:07.506172+0000","last_became_peered":"2023-10-06T02:46:07.506172+0000","last_unstale":"2023-10-06T02:46:07.506800+0000","last_undegraded":"2023-10-06T02:46:07.506800+0000","last_fullsized":"2023-10-06T02:46:07.506800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505491+0000","last_change":"2023-10-06T02:46:06.511150+0000","last_active":"2023-10-06T02:46:07.505491+0000","last_peered":"2023-10-06T02:46:07.505491+0000","last_clean":"2023-10-06T02:46:07.505491+0000","last_became_active":"2023-10-06T02:46:06.510541+0000","last_became_peered":"2023-10-06T02:46:06.510541+0000","last_unstale":"2023-10-06T02:46:07.505491+0000","last_undegraded":"2023-10-06T02:46:07.505491+0000","last_fullsized":"2023-10-06T02:46:07.505491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510736+0000","last_change":"2023-10-06T02:46:07.509675+0000","last_active":"2023-10-06T02:46:07.510736+0000","last_peered":"2023-10-06T02:46:07.510736+0000","last_clean":"2023-10-06T02:46:07.510736+0000","last_became_active":"2023-10-06T02:46:07.508502+0000","last_became_peered":"2023-10-06T02:46:07.508502+0000","last_unstale":"2023-10-06T02:46:07.510736+0000","last_undegraded":"2023-10-06T02:46:07.510736+0000","last_fullsized":"2023-10-06T02:46:07.510736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:51.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.498073+0000","last_change":"2023-10-06T02:46:06.509235+0000","last_active":"2023-10-06T02:46:07.498073+0000","last_peered":"2023-10-06T02:46:07.498073+0000","last_clean":"2023-10-06T02:46:07.498073+0000","last_became_active":"2023-10-06T02:46:06.508969+0000","last_became_peered":"2023-10-06T02:46:06.508969+0000","last_unstale":"2023-10-06T02:46:07.498073+0000","last_undegraded":"2023-10-06T02:46:07.498073+0000","last_fullsized":"2023-10-06T02:46:07.498073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510187+0000","last_change":"2023-10-06T02:46:07.510137+0000","last_active":"2023-10-06T02:46:07.510187+0000","last_peered":"2023-10-06T02:46:07.510187+0000","last_clean":"2023-10-06T02:46:07.510187+0000","last_became_active":"2023-10-06T02:46:07.509917+0000","last_became_peered":"2023-10-06T02:46:07.509917+0000","last_unstale":"2023-10-06T02:46:07.510187+0000","last_undegraded":"2023-10-06T02:46:07.510187+0000","last_fullsized":"2023-10-06T02:46:07.510187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500321+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:46:07.500321+0000","last_peered":"2023-10-06T02:46:07.500321+0000","last_clean":"2023-10-06T02:46:07.500321+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:46:07.500321+0000","last_undegraded":"2023-10-06T02:46:07.500321+0000","last_fullsized":"2023-10-06T02:46:07.500321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497681+0000","last_change":"2023-10-06T02:46:06.506901+0000","last_active":"2023-10-06T02:46:07.497681+0000","last_peered":"2023-10-06T02:46:07.497681+0000","last_clean":"2023-10-06T02:46:07.497681+0000","last_became_active":"2023-10-06T02:46:06.506678+0000","last_became_peered":"2023-10-06T02:46:06.506678+0000","last_unstale":"2023-10-06T02:46:07.497681+0000","last_undegraded":"2023-10-06T02:46:07.497681+0000","last_fullsized":"2023-10-06T02:46:07.497681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509115+0000","last_change":"2023-10-06T02:46:07.509040+0000","last_active":"2023-10-06T02:46:07.509115+0000","last_peered":"2023-10-06T02:46:07.509115+0000","last_clean":"2023-10-06T02:46:07.509115+0000","last_became_active":"2023-10-06T02:46:07.508418+0000","last_became_peered":"2023-10-06T02:46:07.508418+0000","last_unstale":"2023-10-06T02:46:07.509115+0000","last_undegraded":"2023-10-06T02:46:07.509115+0000","last_fullsized":"2023-10-06T02:46:07.509115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497326+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:46:07.497326+0000","last_peered":"2023-10-06T02:46:07.497326+0000","last_clean":"2023-10-06T02:46:07.497326+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:46:07.497326+0000","last_undegraded":"2023-10-06T02:46:07.497326+0000","last_fullsized":"2023-10-06T02:46:07.497326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502341+0000","last_change":"2023-10-06T02:46:06.508135+0000","last_active":"2023-10-06T02:46:07.502341+0000","last_peered":"2023-10-06T02:46:07.502341+0000","last_clean":"2023-10-06T02:46:07.502341+0000","last_became_active":"2023-10-06T02:46:06.507924+0000","last_became_peered":"2023-10-06T02:46:06.507924+0000","last_unstale":"2023-10-06T02:46:07.502341+0000","last_undegraded":"2023-10-06T02:46:07.502341+0000","last_fullsized":"2023-10-06T02:46:07.502341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507713+0000","last_change":"2023-10-06T02:46:07.507658+0000","last_active":"2023-10-06T02:46:07.507713+0000","last_peered":"2023-10-06T02:46:07.507713+0000","last_clean":"2023-10-06T02:46:07.507713+0000","last_became_active":"2023-10-06T02:46:07.507449+0000","last_became_peered":"2023-10-06T02:46:07.507449+0000","last_unstale":"2023-10-06T02:46:07.507713+0000","last_undegraded":"2023-10-06T02:46:07.507713+0000","last_fullsized":"2023-10-06T02:46:07.507713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.496044+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:46:07.496044+0000","last_peered":"2023-10-06T02:46:07.496044+0000","last_clean":"2023-10-06T02:46:07.496044+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:46:07.496044+0000","last_undegraded":"2023-10-06T02:46:07.496044+0000","last_fullsized":"2023-10-06T02:46:07.496044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500045+0000","last_change":"2023-10-06T02:46:06.505031+0000","last_active":"2023-10-06T02:46:07.500045+0000","last_peered":"2023-10-06T02:46:07.500045+0000","last_clean":"2023-10-06T02:46:07.500045+0000","last_became_active":"2023-10-06T02:46:06.504811+0000","last_became_peered":"2023-10-06T02:46:06.504811+0000","last_unstale":"2023-10-06T02:46:07.500045+0000","last_undegraded":"2023-10-06T02:46:07.500045+0000","last_fullsized":"2023-10-06T02:46:07.500045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509069+0000","last_change":"2023-10-06T02:46:07.508885+0000","last_active":"2023-10-06T02:46:07.509069+0000","last_peered":"2023-10-06T02:46:07.509069+0000","last_clean":"2023-10-06T02:46:07.509069+0000","last_became_active":"2023-10-06T02:46:07.508130+0000","last_became_peered":"2023-10-06T02:46:07.508130+0000","last_unstale":"2023-10-06T02:46:07.509069+0000","last_undegraded":"2023-10-06T02:46:07.509069+0000","last_fullsized":"2023-10-06T02:46:07.509069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497823+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:46:07.497823+0000","last_peered":"2023-10-06T02:46:07.497823+0000","last_clean":"2023-10-06T02:46:07.497823+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:46:07.497823+0000","last_undegraded":"2023-10-06T02:46:07.497823+0000","last_fullsized":"2023-10-06T02:46:07.497823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502521+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:46:07.502521+0000","last_peered":"2023-10-06T02:46:07.502521+0000","last_clean":"2023-10-06T02:46:07.502521+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:46:07.502521+0000","last_undegraded":"2023-10-06T02:46:07.502521+0000","last_fullsized":"2023-10-06T02:46:07.502521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497774+0000","last_change":"2023-10-06T02:46:06.504522+0000","last_active":"2023-10-06T02:46:07.497774+0000","last_peered":"2023-10-06T02:46:07.497774+0000","last_clean":"2023-10-06T02:46:07.497774+0000","last_became_active":"2023-10-06T02:46:06.504244+0000","last_became_peered":"2023-10-06T02:46:06.504244+0000","last_unstale":"2023-10-06T02:46:07.497774+0000","last_undegraded":"2023-10-06T02:46:07.497774+0000","last_fullsized":"2023-10-06T02:46:07.497774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502915+0000","last_change":"2023-10-06T02:46:07.502838+0000","last_active":"2023-10-06T02:46:07.502915+0000","last_peered":"2023-10-06T02:46:07.502915+0000","last_clean":"2023-10-06T02:46:07.502915+0000","last_became_active":"2023-10-06T02:46:07.502571+0000","last_became_peered":"2023-10-06T02:46:07.502571+0000","last_unstale":"2023-10-06T02:46:07.502915+0000","last_undegraded":"2023-10-06T02:46:07.502915+0000","last_fullsized":"2023-10-06T02:46:07.502915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502146+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:46:07.502146+0000","last_peered":"2023-10-06T02:46:07.502146+0000","last_clean":"2023-10-06T02:46:07.502146+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:46:07.502146+0000","last_undegraded":"2023-10-06T02:46:07.502146+0000","last_fullsized":"2023-10-06T02:46:07.502146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500874+0000","last_change":"2023-10-06T02:46:06.509615+0000","last_active":"2023-10-06T02:46:07.500874+0000","last_peered":"2023-10-06T02:46:07.500874+0000","last_clean":"2023-10-06T02:46:07.500874+0000","last_became_active":"2023-10-06T02:46:06.508150+0000","last_became_peered":"2023-10-06T02:46:06.508150+0000","last_unstale":"2023-10-06T02:46:07.500874+0000","last_undegraded":"2023-10-06T02:46:07.500874+0000","last_fullsized":"2023-10-06T02:46:07.500874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508716+0000","last_change":"2023-10-06T02:46:07.508651+0000","last_active":"2023-10-06T02:46:07.508716+0000","last_peered":"2023-10-06T02:46:07.508716+0000","last_clean":"2023-10-06T02:46:07.508716+0000","last_became_active":"2023-10-06T02:46:07.507943+0000","last_became_peered":"2023-10-06T02:46:07.507943+0000","last_unstale":"2023-10-06T02:46:07.508716+0000","last_undegraded":"2023-10-06T02:46:07.508716+0000","last_fullsized":"2023-10-06T02:46:07.508716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502607+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:46:07.502607+0000","last_peered":"2023-10-06T02:46:07.502607+0000","last_clean":"2023-10-06T02:46:07.502607+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:46:07.502607+0000","last_undegraded":"2023-10-06T02:46:07.502607+0000","last_fullsized":"2023-10-06T02:46:07.502607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499607+0000","last_change":"2023-10-06T02:46:06.506734+0000","last_active":"2023-10-06T02:46:07.499607+0000","last_peered":"2023-10-06T02:46:07.499607+0000","last_clean":"2023-10-06T02:46:07.499607+0000","last_became_active":"2023-10-06T02:46:06.506350+0000","last_became_peered":"2023-10-06T02:46:06.506350+0000","last_unstale":"2023-10-06T02:46:07.499607+0000","last_undegraded":"2023-10-06T02:46:07.499607+0000","last_fullsized":"2023-10-06T02:46:07.499607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506313+0000","last_change":"2023-10-06T02:46:07.505004+0000","last_active":"2023-10-06T02:46:07.506313+0000","last_peered":"2023-10-06T02:46:07.506313+0000","last_clean":"2023-10-06T02:46:07.506313+0000","last_became_active":"2023-10-06T02:46:07.504802+0000","last_became_peered":"2023-10-06T02:46:07.504802+0000","last_unstale":"2023-10-06T02:46:07.506313+0000","last_undegraded":"2023-10-06T02:46:07.506313+0000","last_fullsized":"2023-10-06T02:46:07.506313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.516938+0000","last_change":"2023-10-06T02:46:06.506225+0000","last_active":"2023-10-06T02:46:07.516938+0000","last_peered":"2023-10-06T02:46:07.516938+0000","last_clean":"2023-10-06T02:46:07.516938+0000","last_became_active":"2023-10-06T02:46:06.505946+0000","last_became_peered":"2023-10-06T02:46:06.505946+0000","last_unstale":"2023-10-06T02:46:07.516938+0000","last_undegraded":"2023-10-06T02:46:07.516938+0000","last_fullsized":"2023-10-06T02:46:07.516938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499718+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:46:07.499718+0000","last_peered":"2023-10-06T02:46:07.499718+0000","last_clean":"2023-10-06T02:46:07.499718+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:46:07.499718+0000","last_undegraded":"2023-10-06T02:46:07.499718+0000","last_fullsized":"2023-10-06T02:46:07.499718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508060+0000","last_change":"2023-10-06T02:46:07.507383+0000","last_active":"2023-10-06T02:46:07.508060+0000","last_peered":"2023-10-06T02:46:07.508060+0000","last_clean":"2023-10-06T02:46:07.508060+0000","last_became_active":"2023-10-06T02:46:07.506430+0000","last_became_peered":"2023-10-06T02:46:07.506430+0000","last_unstale":"2023-10-06T02:46:07.508060+0000","last_undegraded":"2023-10-06T02:46:07.508060+0000","last_fullsized":"2023-10-06T02:46:07.508060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499726+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:46:07.499726+0000","last_peered":"2023-10-06T02:46:07.499726+0000","last_clean":"2023-10-06T02:46:07.499726+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:46:07.499726+0000","last_undegraded":"2023-10-06T02:46:07.499726+0000","last_fullsized":"2023-10-06T02:46:07.499726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:46:10.685815+0000","last_change":"2023-10-06T02:46:06.509764+0000","last_active":"2023-10-06T02:46:10.685815+0000","last_peered":"2023-10-06T02:46:10.685815+0000","last_clean":"2023-10-06T02:46:10.685815+0000","last_became_active":"2023-10-06T02:46:06.508422+0000","last_became_peered":"2023-10-06T02:46:06.508422+0000","last_unstale":"2023-10-06T02:46:10.685815+0000","last_undegraded":"2023-10-06T02:46:10.685815+0000","last_fullsized":"2023-10-06T02:46:10.685815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506969+0000","last_change":"2023-10-06T02:46:07.506906+0000","last_active":"2023-10-06T02:46:07.506969+0000","last_peered":"2023-10-06T02:46:07.506969+0000","last_clean":"2023-10-06T02:46:07.506969+0000","last_became_active":"2023-10-06T02:46:07.506307+0000","last_became_peered":"2023-10-06T02:46:07.506307+0000","last_unstale":"2023-10-06T02:46:07.506969+0000","last_undegraded":"2023-10-06T02:46:07.506969+0000","last_fullsized":"2023-10-06T02:46:07.506969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.518794+0000","last_change":"2023-10-06T02:46:06.508208+0000","last_active":"2023-10-06T02:46:07.518794+0000","last_peered":"2023-10-06T02:46:07.518794+0000","last_clean":"2023-10-06T02:46:07.518794+0000","last_became_active":"2023-10-06T02:46:06.508003+0000","last_became_peered":"2023-10-06T02:46:06.508003+0000","last_unstale":"2023-10-06T02:46:07.518794+0000","last_undegraded":"2023-10-06T02:46:07.518794+0000","last_fullsized":"2023-10-06T02:46:07.518794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507486+0000","last_change":"2023-10-06T02:46:07.507427+0000","last_active":"2023-10-06T02:46:07.507486+0000","last_peered":"2023-10-06T02:46:07.507486+0000","last_clean":"2023-10-06T02:46:07.507486+0000","last_became_active":"2023-10-06T02:46:07.507181+0000","last_became_peered":"2023-10-06T02:46:07.507181+0000","last_unstale":"2023-10-06T02:46:07.507486+0000","last_undegraded":"2023-10-06T02:46:07.507486+0000","last_fullsized":"2023-10-06T02:46:07.507486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:14.225910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519129+0000","last_change":"2023-10-06T02:46:06.508400+0000","last_active":"2023-10-06T02:46:07.519129+0000","last_peered":"2023-10-06T02:46:07.519129+0000","last_clean":"2023-10-06T02:46:07.519129+0000","last_became_active":"2023-10-06T02:46:06.508214+0000","last_became_peered":"2023-10-06T02:46:06.508214+0000","last_unstale":"2023-10-06T02:46:07.519129+0000","last_undegraded":"2023-10-06T02:46:07.519129+0000","last_fullsized":"2023-10-06T02:46:07.519129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505770+0000","last_change":"2023-10-06T02:46:07.505375+0000","last_active":"2023-10-06T02:46:07.505770+0000","last_peered":"2023-10-06T02:46:07.505770+0000","last_clean":"2023-10-06T02:46:07.505770+0000","last_became_active":"2023-10-06T02:46:07.505155+0000","last_became_peered":"2023-10-06T02:46:07.505155+0000","last_unstale":"2023-10-06T02:46:07.505770+0000","last_undegraded":"2023-10-06T02:46:07.505770+0000","last_fullsized":"2023-10-06T02:46:07.505770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:12:08.403799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519370+0000","last_change":"2023-10-06T02:46:06.511448+0000","last_active":"2023-10-06T02:46:07.519370+0000","last_peered":"2023-10-06T02:46:07.519370+0000","last_clean":"2023-10-06T02:46:07.519370+0000","last_became_active":"2023-10-06T02:46:06.511215+0000","last_became_peered":"2023-10-06T02:46:06.511215+0000","last_unstale":"2023-10-06T02:46:07.519370+0000","last_undegraded":"2023-10-06T02:46:07.519370+0000","last_fullsized":"2023-10-06T02:46:07.519370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506825+0000","last_change":"2023-10-06T02:46:07.506746+0000","last_active":"2023-10-06T02:46:07.506825+0000","last_peered":"2023-10-06T02:46:07.506825+0000","last_clean":"2023-10-06T02:46:07.506825+0000","last_became_active":"2023-10-06T02:46:07.505974+0000","last_became_peered":"2023-10-06T02:46:07.505974+0000","last_unstale":"2023-10-06T02:46:07.506825+0000","last_undegraded":"2023-10-06T02:46:07.506825+0000","last_fullsized":"2023-10-06T02:46:07.506825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.515971+0000","last_change":"2023-10-06T02:46:06.507072+0000","last_active":"2023-10-06T02:46:07.515971+0000","last_peered":"2023-10-06T02:46:07.515971+0000","last_clean":"2023-10-06T02:46:07.515971+0000","last_became_active":"2023-10-06T02:46:06.506884+0000","last_became_peered":"2023-10-06T02:46:06.506884+0000","last_unstale":"2023-10-06T02:46:07.515971+0000","last_undegraded":"2023-10-06T02:46:07.515971+0000","last_fullsized":"2023-10-06T02:46:07.515971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508043+0000","last_change":"2023-10-06T02:46:07.507192+0000","last_active":"2023-10-06T02:46:07.508043+0000","last_peered":"2023-10-06T02:46:07.508043+0000","last_clean":"2023-10-06T02:46:07.508043+0000","last_became_active":"2023-10-06T02:46:07.505722+0000","last_became_peered":"2023-10-06T02:46:07.505722+0000","last_unstale":"2023-10-06T02:46:07.508043+0000","last_undegraded":"2023-10-06T02:46:07.508043+0000","last_fullsized":"2023-10-06T02:46:07.508043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.518896+0000","last_change":"2023-10-06T02:46:06.503414+0000","last_active":"2023-10-06T02:46:07.518896+0000","last_peered":"2023-10-06T02:46:07.518896+0000","last_clean":"2023-10-06T02:46:07.518896+0000","last_became_active":"2023-10-06T02:46:06.503182+0000","last_became_peered":"2023-10-06T02:46:06.503182+0000","last_unstale":"2023-10-06T02:46:07.518896+0000","last_undegraded":"2023-10-06T02:46:07.518896+0000","last_fullsized":"2023-10-06T02:46:07.518896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510782+0000","last_change":"2023-10-06T02:46:07.510148+0000","last_active":"2023-10-06T02:46:07.510782+0000","last_peered":"2023-10-06T02:46:07.510782+0000","last_clean":"2023-10-06T02:46:07.510782+0000","last_became_active":"2023-10-06T02:46:07.509401+0000","last_became_peered":"2023-10-06T02:46:07.509401+0000","last_unstale":"2023-10-06T02:46:07.510782+0000","last_undegraded":"2023-10-06T02:46:07.510782+0000","last_fullsized":"2023-10-06T02:46:07.510782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:05.528757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502895+0000","last_change":"2023-10-06T02:46:07.502629+0000","last_active":"2023-10-06T02:46:07.502895+0000","last_peered":"2023-10-06T02:46:07.502895+0000","last_clean":"2023-10-06T02:46:07.502895+0000","last_became_active":"2023-10-06T02:46:07.502400+0000","last_became_peered":"2023-10-06T02:46:07.502400+0000","last_unstale":"2023-10-06T02:46:07.502895+0000","last_undegraded":"2023-10-06T02:46:07.502895+0000","last_fullsized":"2023-10-06T02:46:07.502895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505684+0000","last_change":"2023-10-06T02:46:07.505518+0000","last_active":"2023-10-06T02:46:07.505684+0000","last_peered":"2023-10-06T02:46:07.505684+0000","last_clean":"2023-10-06T02:46:07.505684+0000","last_became_active":"2023-10-06T02:46:07.504595+0000","last_became_peered":"2023-10-06T02:46:07.504595+0000","last_unstale":"2023-10-06T02:46:07.505684+0000","last_undegraded":"2023-10-06T02:46:07.505684+0000","last_fullsized":"2023-10-06T02:46:07.505684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:41.875449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510796+0000","last_change":"2023-10-06T02:46:07.510598+0000","last_active":"2023-10-06T02:46:07.510796+0000","last_peered":"2023-10-06T02:46:07.510796+0000","last_clean":"2023-10-06T02:46:07.510796+0000","last_became_active":"2023-10-06T02:46:07.510359+0000","last_became_peered":"2023-10-06T02:46:07.510359+0000","last_unstale":"2023-10-06T02:46:07.510796+0000","last_undegraded":"2023-10-06T02:46:07.510796+0000","last_fullsized":"2023-10-06T02:46:07.510796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:59.513702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508076+0000","last_change":"2023-10-06T02:46:07.507536+0000","last_active":"2023-10-06T02:46:07.508076+0000","last_peered":"2023-10-06T02:46:07.508076+0000","last_clean":"2023-10-06T02:46:07.508076+0000","last_became_active":"2023-10-06T02:46:07.506737+0000","last_became_peered":"2023-10-06T02:46:07.506737+0000","last_unstale":"2023-10-06T02:46:07.508076+0000","last_undegraded":"2023-10-06T02:46:07.508076+0000","last_fullsized":"2023-10-06T02:46:07.508076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.956040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508695+0000","last_change":"2023-10-06T02:46:07.508492+0000","last_active":"2023-10-06T02:46:07.508695+0000","last_peered":"2023-10-06T02:46:07.508695+0000","last_clean":"2023-10-06T02:46:07.508695+0000","last_became_active":"2023-10-06T02:46:07.508271+0000","last_became_peered":"2023-10-06T02:46:07.508271+0000","last_unstale":"2023-10-06T02:46:07.508695+0000","last_undegraded":"2023-10-06T02:46:07.508695+0000","last_fullsized":"2023-10-06T02:46:07.508695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":665,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194647,"statfs":{"total":200000000,"available":199318721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199909249,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195224,"statfs":{"total":200000000,"available":199910217,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]}],"pool_statfs":[]}} 2023-10-06T02:46:22.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:46:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.315+0000 7fd44277c700 1 Processor -- start 2023-10-06T02:46:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.315+0000 7fd44277c700 1 -- start start 2023-10-06T02:46:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.316+0000 7fd44277c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c1578d0 0x7fd43c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.316+0000 7fd44277c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd43c06d120 0x7fd43c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.316+0000 7fd44277c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c06dac0 con 0x7fd43c157ca0 2023-10-06T02:46:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.316+0000 7fd44277c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0d07c0 con 0x7fd43c06d120 2023-10-06T02:46:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.316+0000 7fd44277c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0cfbb0 con 0x7fd43c1578d0 2023-10-06T02:46:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.316+0000 7fd440d19700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd43c06d120 0x7fd43c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.316+0000 7fd43b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd43c157ca0 0x7fd43c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50254/0 (socket says 172.21.15.81:50254) 2023-10-06T02:46:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.316+0000 7fd43b7fe700 1 -- 172.21.15.81:0/4144036913 learned_addr learned my addr 172.21.15.81:0/4144036913 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.316+0000 7fd43bfff700 1 --2- 172.21.15.81:0/4144036913 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c1578d0 0x7fd43c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd440d19700 1 -- 172.21.15.81:0/4144036913 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c1578d0 msgr2=0x7fd43c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd440d19700 1 --2- 172.21.15.81:0/4144036913 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c1578d0 0x7fd43c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd440d19700 1 -- 172.21.15.81:0/4144036913 >> v1:172.21.15.81:6789/0 conn(0x7fd43c157ca0 legacy=0x7fd43c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd440d19700 1 -- 172.21.15.81:0/4144036913 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0cfe90 con 0x7fd43c06d120 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd440d19700 1 --2- 172.21.15.81:0/4144036913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 0x7fd43c06d580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd434009e60 tx=0x7fd434009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e4a2f8f38044ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd43affd700 1 -- 172.21.15.81:0/4144036913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400e070 con 0x7fd43c06d120 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd43affd700 1 -- 172.21.15.81:0/4144036913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400bc30 con 0x7fd43c06d120 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd43affd700 1 -- 172.21.15.81:0/4144036913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434012430 con 0x7fd43c06d120 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd44277c700 1 -- 172.21.15.81:0/4144036913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 msgr2=0x7fd43c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd44277c700 1 --2- 172.21.15.81:0/4144036913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 0x7fd43c06d580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd434009e60 tx=0x7fd434009780 comp rx=0 tx=0).stop 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd44277c700 1 -- 172.21.15.81:0/4144036913 shutdown_connections 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd44277c700 1 --2- 172.21.15.81:0/4144036913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 0x7fd43c06d580 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd44277c700 1 --2- 172.21.15.81:0/4144036913 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c1578d0 0x7fd43c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd44277c700 1 -- 172.21.15.81:0/4144036913 >> 172.21.15.81:0/4144036913 conn(0x7fd43c06bb90 msgr2=0x7fd43c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd44277c700 1 -- 172.21.15.81:0/4144036913 shutdown_connections 2023-10-06T02:46:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.317+0000 7fd44277c700 1 -- 172.21.15.81:0/4144036913 wait complete. 2023-10-06T02:46:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.318+0000 7fd44277c700 1 Processor -- start 2023-10-06T02:46:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd44277c700 1 -- start start 2023-10-06T02:46:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd44277c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 0x7fd43c154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd44277c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd43c1578d0 0x7fd43c0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd44277c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c157ca0 0x7fd43c0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd44277c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0c6490 con 0x7fd43c06d120 2023-10-06T02:46:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd44277c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0c6770 con 0x7fd43c1578d0 2023-10-06T02:46:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd44277c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0c6a50 con 0x7fd43c157ca0 2023-10-06T02:46:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd43bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 0x7fd43c154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd43bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 0x7fd43c154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47878/0 (socket says 172.21.15.81:47878) 2023-10-06T02:46:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.319+0000 7fd43bfff700 1 -- 172.21.15.81:0/3749057041 learned_addr learned my addr 172.21.15.81:0/3749057041 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd43b7fe700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd43c1578d0 0x7fd43c0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd440d19700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c157ca0 0x7fd43c0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd43bfff700 1 -- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c157ca0 msgr2=0x7fd43c0cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd43bfff700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c157ca0 0x7fd43c0cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd43bfff700 1 -- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd43c1578d0 msgr2=0x7fd43c0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd43bfff700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd43c1578d0 0x7fd43c0c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd43bfff700 1 -- 172.21.15.81:0/3749057041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434009a20 con 0x7fd43c06d120 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd43bfff700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 0x7fd43c154780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00d890 tx=0x7fd42c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd423fff700 1 -- 172.21.15.81:0/3749057041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0125f0 con 0x7fd43c06d120 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd423fff700 1 -- 172.21.15.81:0/3749057041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c012750 con 0x7fd43c06d120 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c0c6d30 con 0x7fd43c06d120 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd423fff700 1 -- 172.21.15.81:0/3749057041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c012af0 con 0x7fd43c06d120 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.320+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c154cc0 con 0x7fd43c06d120 2023-10-06T02:46:22.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.321+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c0b3ba0 con 0x7fd43c06d120 2023-10-06T02:46:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.321+0000 7fd423fff700 1 -- 172.21.15.81:0/3749057041 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd42c01e460 con 0x7fd43c06d120 2023-10-06T02:46:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.322+0000 7fd423fff700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd428066f30 0x7fd4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.322+0000 7fd423fff700 1 -- 172.21.15.81:0/3749057041 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd42c084bc0 con 0x7fd43c06d120 2023-10-06T02:46:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.322+0000 7fd43b7fe700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd428066f30 0x7fd4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.322+0000 7fd43b7fe700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd428066f30 0x7fd4280693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd43c159090 tx=0x7fd430009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.326+0000 7fd423fff700 1 -- 172.21.15.81:0/3749057041 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd42c051cd0 con 0x7fd43c06d120 2023-10-06T02:46:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.507+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd43c0d0170 con 0x7fd428066f30 2023-10-06T02:46:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.516+0000 7fd423fff700 1 -- 172.21.15.81:0/3749057041 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280714 (secure 0 0 0) 0x7fd43c0d0170 con 0x7fd428066f30 2023-10-06T02:46:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd428066f30 msgr2=0x7fd4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd428066f30 0x7fd4280693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd43c159090 tx=0x7fd430009040 comp rx=0 tx=0).stop 2023-10-06T02:46:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 msgr2=0x7fd43c154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 0x7fd43c154780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00d890 tx=0x7fd42c008040 comp rx=0 tx=0).stop 2023-10-06T02:46:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 shutdown_connections 2023-10-06T02:46:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd43c157ca0 0x7fd43c0cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c06d120 0x7fd43c154780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd428066f30 0x7fd4280693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 --2- 172.21.15.81:0/3749057041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd43c1578d0 0x7fd43c0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 >> 172.21.15.81:0/3749057041 conn(0x7fd43c06bb90 msgr2=0x7fd43c156630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 shutdown_connections 2023-10-06T02:46:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.519+0000 7fd44277c700 1 -- 172.21.15.81:0/3749057041 wait complete. 2023-10-06T02:46:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:46:22.532 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-06T02:46:21.495005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1854,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560645,"statfs":{"total":1600000000,"available":1598101380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003124"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501882+0000","last_change":"2023-10-06T02:46:07.501507+0000","last_active":"2023-10-06T02:46:07.501882+0000","last_peered":"2023-10-06T02:46:07.501882+0000","last_clean":"2023-10-06T02:46:07.501882+0000","last_became_active":"2023-10-06T02:46:07.501299+0000","last_became_peered":"2023-10-06T02:46:07.501299+0000","last_unstale":"2023-10-06T02:46:07.501882+0000","last_undegraded":"2023-10-06T02:46:07.501882+0000","last_fullsized":"2023-10-06T02:46:07.501882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:36.468540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506841+0000","last_change":"2023-10-06T02:46:07.506605+0000","last_active":"2023-10-06T02:46:07.506841+0000","last_peered":"2023-10-06T02:46:07.506841+0000","last_clean":"2023-10-06T02:46:07.506841+0000","last_became_active":"2023-10-06T02:46:07.506120+0000","last_became_peered":"2023-10-06T02:46:07.506120+0000","last_unstale":"2023-10-06T02:46:07.506841+0000","last_undegraded":"2023-10-06T02:46:07.506841+0000","last_fullsized":"2023-10-06T02:46:07.506841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508824+0000","last_change":"2023-10-06T02:46:07.507719+0000","last_active":"2023-10-06T02:46:07.508824+0000","last_peered":"2023-10-06T02:46:07.508824+0000","last_clean":"2023-10-06T02:46:07.508824+0000","last_became_active":"2023-10-06T02:46:07.507126+0000","last_became_peered":"2023-10-06T02:46:07.507126+0000","last_unstale":"2023-10-06T02:46:07.508824+0000","last_undegraded":"2023-10-06T02:46:07.508824+0000","last_fullsized":"2023-10-06T02:46:07.508824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:59.329640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507847+0000","last_change":"2023-10-06T02:46:07.507785+0000","last_active":"2023-10-06T02:46:07.507847+0000","last_peered":"2023-10-06T02:46:07.507847+0000","last_clean":"2023-10-06T02:46:07.507847+0000","last_became_active":"2023-10-06T02:46:07.507554+0000","last_became_peered":"2023-10-06T02:46:07.507554+0000","last_unstale":"2023-10-06T02:46:07.507847+0000","last_undegraded":"2023-10-06T02:46:07.507847+0000","last_fullsized":"2023-10-06T02:46:07.507847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508846+0000","last_change":"2023-10-06T02:46:07.508747+0000","last_active":"2023-10-06T02:46:07.508846+0000","last_peered":"2023-10-06T02:46:07.508846+0000","last_clean":"2023-10-06T02:46:07.508846+0000","last_became_active":"2023-10-06T02:46:07.508461+0000","last_became_peered":"2023-10-06T02:46:07.508461+0000","last_unstale":"2023-10-06T02:46:07.508846+0000","last_undegraded":"2023-10-06T02:46:07.508846+0000","last_fullsized":"2023-10-06T02:46:07.508846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.512128+0000","last_change":"2023-10-06T02:46:07.512070+0000","last_active":"2023-10-06T02:46:07.512128+0000","last_peered":"2023-10-06T02:46:07.512128+0000","last_clean":"2023-10-06T02:46:07.512128+0000","last_became_active":"2023-10-06T02:46:07.511394+0000","last_became_peered":"2023-10-06T02:46:07.511394+0000","last_unstale":"2023-10-06T02:46:07.512128+0000","last_undegraded":"2023-10-06T02:46:07.512128+0000","last_fullsized":"2023-10-06T02:46:07.512128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:21.300350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509806+0000","last_change":"2023-10-06T02:46:07.509710+0000","last_active":"2023-10-06T02:46:07.509806+0000","last_peered":"2023-10-06T02:46:07.509806+0000","last_clean":"2023-10-06T02:46:07.509806+0000","last_became_active":"2023-10-06T02:46:07.509491+0000","last_became_peered":"2023-10-06T02:46:07.509491+0000","last_unstale":"2023-10-06T02:46:07.509806+0000","last_undegraded":"2023-10-06T02:46:07.509806+0000","last_fullsized":"2023-10-06T02:46:07.509806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504477+0000","last_change":"2023-10-06T02:46:07.504387+0000","last_active":"2023-10-06T02:46:07.504477+0000","last_peered":"2023-10-06T02:46:07.504477+0000","last_clean":"2023-10-06T02:46:07.504477+0000","last_became_active":"2023-10-06T02:46:07.503698+0000","last_became_peered":"2023-10-06T02:46:07.503698+0000","last_unstale":"2023-10-06T02:46:07.504477+0000","last_undegraded":"2023-10-06T02:46:07.504477+0000","last_fullsized":"2023-10-06T02:46:07.504477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508671+0000","last_change":"2023-10-06T02:46:07.508533+0000","last_active":"2023-10-06T02:46:07.508671+0000","last_peered":"2023-10-06T02:46:07.508671+0000","last_clean":"2023-10-06T02:46:07.508671+0000","last_became_active":"2023-10-06T02:46:07.507476+0000","last_became_peered":"2023-10-06T02:46:07.507476+0000","last_unstale":"2023-10-06T02:46:07.508671+0000","last_undegraded":"2023-10-06T02:46:07.508671+0000","last_fullsized":"2023-10-06T02:46:07.508671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509782+0000","last_change":"2023-10-06T02:46:07.509724+0000","last_active":"2023-10-06T02:46:07.509782+0000","last_peered":"2023-10-06T02:46:07.509782+0000","last_clean":"2023-10-06T02:46:07.509782+0000","last_became_active":"2023-10-06T02:46:07.509504+0000","last_became_peered":"2023-10-06T02:46:07.509504+0000","last_unstale":"2023-10-06T02:46:07.509782+0000","last_undegraded":"2023-10-06T02:46:07.509782+0000","last_fullsized":"2023-10-06T02:46:07.509782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.512318+0000","last_change":"2023-10-06T02:46:07.512258+0000","last_active":"2023-10-06T02:46:07.512318+0000","last_peered":"2023-10-06T02:46:07.512318+0000","last_clean":"2023-10-06T02:46:07.512318+0000","last_became_active":"2023-10-06T02:46:07.511640+0000","last_became_peered":"2023-10-06T02:46:07.511640+0000","last_unstale":"2023-10-06T02:46:07.512318+0000","last_undegraded":"2023-10-06T02:46:07.512318+0000","last_fullsized":"2023-10-06T02:46:07.512318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:38.382749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.503952+0000","last_change":"2023-10-06T02:46:07.503917+0000","last_active":"2023-10-06T02:46:07.503952+0000","last_peered":"2023-10-06T02:46:07.503952+0000","last_clean":"2023-10-06T02:46:07.503952+0000","last_became_active":"2023-10-06T02:46:07.503658+0000","last_became_peered":"2023-10-06T02:46:07.503658+0000","last_unstale":"2023-10-06T02:46:07.503952+0000","last_undegraded":"2023-10-06T02:46:07.503952+0000","last_fullsized":"2023-10-06T02:46:07.503952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:27.620523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.498723+0000","last_change":"2023-10-06T02:46:07.498659+0000","last_active":"2023-10-06T02:46:07.498723+0000","last_peered":"2023-10-06T02:46:07.498723+0000","last_clean":"2023-10-06T02:46:07.498723+0000","last_became_active":"2023-10-06T02:46:07.498418+0000","last_became_peered":"2023-10-06T02:46:07.498418+0000","last_unstale":"2023-10-06T02:46:07.498723+0000","last_undegraded":"2023-10-06T02:46:07.498723+0000","last_fullsized":"2023-10-06T02:46:07.498723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.400732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504280+0000","last_change":"2023-10-06T02:46:07.504203+0000","last_active":"2023-10-06T02:46:07.504280+0000","last_peered":"2023-10-06T02:46:07.504280+0000","last_clean":"2023-10-06T02:46:07.504280+0000","last_became_active":"2023-10-06T02:46:07.503939+0000","last_became_peered":"2023-10-06T02:46:07.503939+0000","last_unstale":"2023-10-06T02:46:07.504280+0000","last_undegraded":"2023-10-06T02:46:07.504280+0000","last_fullsized":"2023-10-06T02:46:07.504280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509105+0000","last_change":"2023-10-06T02:46:07.508749+0000","last_active":"2023-10-06T02:46:07.509105+0000","last_peered":"2023-10-06T02:46:07.509105+0000","last_clean":"2023-10-06T02:46:07.509105+0000","last_became_active":"2023-10-06T02:46:07.508535+0000","last_became_peered":"2023-10-06T02:46:07.508535+0000","last_unstale":"2023-10-06T02:46:07.509105+0000","last_undegraded":"2023-10-06T02:46:07.509105+0000","last_fullsized":"2023-10-06T02:46:07.509105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.511904+0000","last_change":"2023-10-06T02:46:07.511846+0000","last_active":"2023-10-06T02:46:07.511904+0000","last_peered":"2023-10-06T02:46:07.511904+0000","last_clean":"2023-10-06T02:46:07.511904+0000","last_became_active":"2023-10-06T02:46:07.511179+0000","last_became_peered":"2023-10-06T02:46:07.511179+0000","last_unstale":"2023-10-06T02:46:07.511904+0000","last_undegraded":"2023-10-06T02:46:07.511904+0000","last_fullsized":"2023-10-06T02:46:07.511904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506260+0000","last_change":"2023-10-06T02:46:07.502822+0000","last_active":"2023-10-06T02:46:07.506260+0000","last_peered":"2023-10-06T02:46:07.506260+0000","last_clean":"2023-10-06T02:46:07.506260+0000","last_became_active":"2023-10-06T02:46:07.502312+0000","last_became_peered":"2023-10-06T02:46:07.502312+0000","last_unstale":"2023-10-06T02:46:07.506260+0000","last_undegraded":"2023-10-06T02:46:07.506260+0000","last_fullsized":"2023-10-06T02:46:07.506260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508843+0000","last_change":"2023-10-06T02:46:07.507876+0000","last_active":"2023-10-06T02:46:07.508843+0000","last_peered":"2023-10-06T02:46:07.508843+0000","last_clean":"2023-10-06T02:46:07.508843+0000","last_became_active":"2023-10-06T02:46:07.507455+0000","last_became_peered":"2023-10-06T02:46:07.507455+0000","last_unstale":"2023-10-06T02:46:07.508843+0000","last_undegraded":"2023-10-06T02:46:07.508843+0000","last_fullsized":"2023-10-06T02:46:07.508843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:43.004719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502434+0000","last_change":"2023-10-06T02:46:07.502391+0000","last_active":"2023-10-06T02:46:07.502434+0000","last_peered":"2023-10-06T02:46:07.502434+0000","last_clean":"2023-10-06T02:46:07.502434+0000","last_became_active":"2023-10-06T02:46:07.502156+0000","last_became_peered":"2023-10-06T02:46:07.502156+0000","last_unstale":"2023-10-06T02:46:07.502434+0000","last_undegraded":"2023-10-06T02:46:07.502434+0000","last_fullsized":"2023-10-06T02:46:07.502434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:50.164650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510768+0000","last_change":"2023-10-06T02:46:07.509968+0000","last_active":"2023-10-06T02:46:07.510768+0000","last_peered":"2023-10-06T02:46:07.510768+0000","last_clean":"2023-10-06T02:46:07.510768+0000","last_became_active":"2023-10-06T02:46:07.509123+0000","last_became_peered":"2023-10-06T02:46:07.509123+0000","last_unstale":"2023-10-06T02:46:07.510768+0000","last_undegraded":"2023-10-06T02:46:07.510768+0000","last_fullsized":"2023-10-06T02:46:07.510768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:06.617615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509085+0000","last_change":"2023-10-06T02:46:07.508219+0000","last_active":"2023-10-06T02:46:07.509085+0000","last_peered":"2023-10-06T02:46:07.509085+0000","last_clean":"2023-10-06T02:46:07.509085+0000","last_became_active":"2023-10-06T02:46:07.507886+0000","last_became_peered":"2023-10-06T02:46:07.507886+0000","last_unstale":"2023-10-06T02:46:07.509085+0000","last_undegraded":"2023-10-06T02:46:07.509085+0000","last_fullsized":"2023-10-06T02:46:07.509085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507819+0000","last_change":"2023-10-06T02:46:07.507747+0000","last_active":"2023-10-06T02:46:07.507819+0000","last_peered":"2023-10-06T02:46:07.507819+0000","last_clean":"2023-10-06T02:46:07.507819+0000","last_became_active":"2023-10-06T02:46:07.507526+0000","last_became_peered":"2023-10-06T02:46:07.507526+0000","last_unstale":"2023-10-06T02:46:07.507819+0000","last_undegraded":"2023-10-06T02:46:07.507819+0000","last_fullsized":"2023-10-06T02:46:07.507819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502938+0000","last_change":"2023-10-06T02:46:07.502872+0000","last_active":"2023-10-06T02:46:07.502938+0000","last_peered":"2023-10-06T02:46:07.502938+0000","last_clean":"2023-10-06T02:46:07.502938+0000","last_became_active":"2023-10-06T02:46:07.502642+0000","last_became_peered":"2023-10-06T02:46:07.502642+0000","last_unstale":"2023-10-06T02:46:07.502938+0000","last_undegraded":"2023-10-06T02:46:07.502938+0000","last_fullsized":"2023-10-06T02:46:07.502938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509119+0000","last_change":"2023-10-06T02:46:07.508930+0000","last_active":"2023-10-06T02:46:07.509119+0000","last_peered":"2023-10-06T02:46:07.509119+0000","last_clean":"2023-10-06T02:46:07.509119+0000","last_became_active":"2023-10-06T02:46:07.508593+0000","last_became_peered":"2023-10-06T02:46:07.508593+0000","last_unstale":"2023-10-06T02:46:07.509119+0000","last_undegraded":"2023-10-06T02:46:07.509119+0000","last_fullsized":"2023-10-06T02:46:07.509119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505687+0000","last_change":"2023-10-06T02:46:07.505613+0000","last_active":"2023-10-06T02:46:07.505687+0000","last_peered":"2023-10-06T02:46:07.505687+0000","last_clean":"2023-10-06T02:46:07.505687+0000","last_became_active":"2023-10-06T02:46:07.504983+0000","last_became_peered":"2023-10-06T02:46:07.504983+0000","last_unstale":"2023-10-06T02:46:07.505687+0000","last_undegraded":"2023-10-06T02:46:07.505687+0000","last_fullsized":"2023-10-06T02:46:07.505687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510949+0000","last_change":"2023-10-06T02:46:07.510879+0000","last_active":"2023-10-06T02:46:07.510949+0000","last_peered":"2023-10-06T02:46:07.510949+0000","last_clean":"2023-10-06T02:46:07.510949+0000","last_became_active":"2023-10-06T02:46:07.510585+0000","last_became_peered":"2023-10-06T02:46:07.510585+0000","last_unstale":"2023-10-06T02:46:07.510949+0000","last_undegraded":"2023-10-06T02:46:07.510949+0000","last_fullsized":"2023-10-06T02:46:07.510949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506452+0000","last_change":"2023-10-06T02:46:07.506341+0000","last_active":"2023-10-06T02:46:07.506452+0000","last_peered":"2023-10-06T02:46:07.506452+0000","last_clean":"2023-10-06T02:46:07.506452+0000","last_became_active":"2023-10-06T02:46:07.504926+0000","last_became_peered":"2023-10-06T02:46:07.504926+0000","last_unstale":"2023-10-06T02:46:07.506452+0000","last_undegraded":"2023-10-06T02:46:07.506452+0000","last_fullsized":"2023-10-06T02:46:07.506452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.514988+0000","last_change":"2023-10-06T02:46:06.506243+0000","last_active":"2023-10-06T02:46:07.514988+0000","last_peered":"2023-10-06T02:46:07.514988+0000","last_clean":"2023-10-06T02:46:07.514988+0000","last_became_active":"2023-10-06T02:46:06.505980+0000","last_became_peered":"2023-10-06T02:46:06.505980+0000","last_unstale":"2023-10-06T02:46:07.514988+0000","last_undegraded":"2023-10-06T02:46:07.514988+0000","last_fullsized":"2023-10-06T02:46:07.514988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501873+0000","last_change":"2023-10-06T02:46:07.501612+0000","last_active":"2023-10-06T02:46:07.501873+0000","last_peered":"2023-10-06T02:46:07.501873+0000","last_clean":"2023-10-06T02:46:07.501873+0000","last_became_active":"2023-10-06T02:46:07.501385+0000","last_became_peered":"2023-10-06T02:46:07.501385+0000","last_unstale":"2023-10-06T02:46:07.501873+0000","last_undegraded":"2023-10-06T02:46:07.501873+0000","last_fullsized":"2023-10-06T02:46:07.501873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:51.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499887+0000","last_change":"2023-10-06T02:46:06.506000+0000","last_active":"2023-10-06T02:46:07.499887+0000","last_peered":"2023-10-06T02:46:07.499887+0000","last_clean":"2023-10-06T02:46:07.499887+0000","last_became_active":"2023-10-06T02:46:06.505763+0000","last_became_peered":"2023-10-06T02:46:06.505763+0000","last_unstale":"2023-10-06T02:46:07.499887+0000","last_undegraded":"2023-10-06T02:46:07.499887+0000","last_fullsized":"2023-10-06T02:46:07.499887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507357+0000","last_change":"2023-10-06T02:46:07.507268+0000","last_active":"2023-10-06T02:46:07.507357+0000","last_peered":"2023-10-06T02:46:07.507357+0000","last_clean":"2023-10-06T02:46:07.507357+0000","last_became_active":"2023-10-06T02:46:07.507051+0000","last_became_peered":"2023-10-06T02:46:07.507051+0000","last_unstale":"2023-10-06T02:46:07.507357+0000","last_undegraded":"2023-10-06T02:46:07.507357+0000","last_fullsized":"2023-10-06T02:46:07.507357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497675+0000","last_change":"2023-10-06T02:46:06.504271+0000","last_active":"2023-10-06T02:46:07.497675+0000","last_peered":"2023-10-06T02:46:07.497675+0000","last_clean":"2023-10-06T02:46:07.497675+0000","last_became_active":"2023-10-06T02:46:06.502572+0000","last_became_peered":"2023-10-06T02:46:06.502572+0000","last_unstale":"2023-10-06T02:46:07.497675+0000","last_undegraded":"2023-10-06T02:46:07.497675+0000","last_fullsized":"2023-10-06T02:46:07.497675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.503491+0000","last_change":"2023-10-06T02:46:07.503446+0000","last_active":"2023-10-06T02:46:07.503491+0000","last_peered":"2023-10-06T02:46:07.503491+0000","last_clean":"2023-10-06T02:46:07.503491+0000","last_became_active":"2023-10-06T02:46:07.503262+0000","last_became_peered":"2023-10-06T02:46:07.503262+0000","last_unstale":"2023-10-06T02:46:07.503491+0000","last_undegraded":"2023-10-06T02:46:07.503491+0000","last_fullsized":"2023-10-06T02:46:07.503491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:24.508665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499431+0000","last_change":"2023-10-06T02:46:06.501875+0000","last_active":"2023-10-06T02:46:07.499431+0000","last_peered":"2023-10-06T02:46:07.499431+0000","last_clean":"2023-10-06T02:46:07.499431+0000","last_became_active":"2023-10-06T02:46:06.501424+0000","last_became_peered":"2023-10-06T02:46:06.501424+0000","last_unstale":"2023-10-06T02:46:07.499431+0000","last_undegraded":"2023-10-06T02:46:07.499431+0000","last_fullsized":"2023-10-06T02:46:07.499431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501890+0000","last_change":"2023-10-06T02:46:07.501817+0000","last_active":"2023-10-06T02:46:07.501890+0000","last_peered":"2023-10-06T02:46:07.501890+0000","last_clean":"2023-10-06T02:46:07.501890+0000","last_became_active":"2023-10-06T02:46:07.501591+0000","last_became_peered":"2023-10-06T02:46:07.501591+0000","last_unstale":"2023-10-06T02:46:07.501890+0000","last_undegraded":"2023-10-06T02:46:07.501890+0000","last_fullsized":"2023-10-06T02:46:07.501890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497426+0000","last_change":"2023-10-06T02:46:06.501257+0000","last_active":"2023-10-06T02:46:07.497426+0000","last_peered":"2023-10-06T02:46:07.497426+0000","last_clean":"2023-10-06T02:46:07.497426+0000","last_became_active":"2023-10-06T02:46:06.501036+0000","last_became_peered":"2023-10-06T02:46:06.501036+0000","last_unstale":"2023-10-06T02:46:07.497426+0000","last_undegraded":"2023-10-06T02:46:07.497426+0000","last_fullsized":"2023-10-06T02:46:07.497426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504480+0000","last_change":"2023-10-06T02:46:07.504425+0000","last_active":"2023-10-06T02:46:07.504480+0000","last_peered":"2023-10-06T02:46:07.504480+0000","last_clean":"2023-10-06T02:46:07.504480+0000","last_became_active":"2023-10-06T02:46:07.504212+0000","last_became_peered":"2023-10-06T02:46:07.504212+0000","last_unstale":"2023-10-06T02:46:07.504480+0000","last_undegraded":"2023-10-06T02:46:07.504480+0000","last_fullsized":"2023-10-06T02:46:07.504480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.517401+0000","last_change":"2023-10-06T02:46:06.503947+0000","last_active":"2023-10-06T02:46:07.517401+0000","last_peered":"2023-10-06T02:46:07.517401+0000","last_clean":"2023-10-06T02:46:07.517401+0000","last_became_active":"2023-10-06T02:46:06.503721+0000","last_became_peered":"2023-10-06T02:46:06.503721+0000","last_unstale":"2023-10-06T02:46:07.517401+0000","last_undegraded":"2023-10-06T02:46:07.517401+0000","last_fullsized":"2023-10-06T02:46:07.517401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:40.222541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510647+0000","last_change":"2023-10-06T02:46:07.510256+0000","last_active":"2023-10-06T02:46:07.510647+0000","last_peered":"2023-10-06T02:46:07.510647+0000","last_clean":"2023-10-06T02:46:07.510647+0000","last_became_active":"2023-10-06T02:46:07.507169+0000","last_became_peered":"2023-10-06T02:46:07.507169+0000","last_unstale":"2023-10-06T02:46:07.510647+0000","last_undegraded":"2023-10-06T02:46:07.510647+0000","last_fullsized":"2023-10-06T02:46:07.510647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.520847+0000","last_change":"2023-10-06T02:46:06.506258+0000","last_active":"2023-10-06T02:46:07.520847+0000","last_peered":"2023-10-06T02:46:07.520847+0000","last_clean":"2023-10-06T02:46:07.520847+0000","last_became_active":"2023-10-06T02:46:06.505429+0000","last_became_peered":"2023-10-06T02:46:06.505429+0000","last_unstale":"2023-10-06T02:46:07.520847+0000","last_undegraded":"2023-10-06T02:46:07.520847+0000","last_fullsized":"2023-10-06T02:46:07.520847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510753+0000","last_change":"2023-10-06T02:46:07.509811+0000","last_active":"2023-10-06T02:46:07.510753+0000","last_peered":"2023-10-06T02:46:07.510753+0000","last_clean":"2023-10-06T02:46:07.510753+0000","last_became_active":"2023-10-06T02:46:07.508799+0000","last_became_peered":"2023-10-06T02:46:07.508799+0000","last_unstale":"2023-10-06T02:46:07.510753+0000","last_undegraded":"2023-10-06T02:46:07.510753+0000","last_fullsized":"2023-10-06T02:46:07.510753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:39.042317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519408+0000","last_change":"2023-10-06T02:46:06.510875+0000","last_active":"2023-10-06T02:46:07.519408+0000","last_peered":"2023-10-06T02:46:07.519408+0000","last_clean":"2023-10-06T02:46:07.519408+0000","last_became_active":"2023-10-06T02:46:06.510700+0000","last_became_peered":"2023-10-06T02:46:06.510700+0000","last_unstale":"2023-10-06T02:46:07.519408+0000","last_undegraded":"2023-10-06T02:46:07.519408+0000","last_fullsized":"2023-10-06T02:46:07.519408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:25.994414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507028+0000","last_change":"2023-10-06T02:46:07.506952+0000","last_active":"2023-10-06T02:46:07.507028+0000","last_peered":"2023-10-06T02:46:07.507028+0000","last_clean":"2023-10-06T02:46:07.507028+0000","last_became_active":"2023-10-06T02:46:07.505445+0000","last_became_peered":"2023-10-06T02:46:07.505445+0000","last_unstale":"2023-10-06T02:46:07.507028+0000","last_undegraded":"2023-10-06T02:46:07.507028+0000","last_fullsized":"2023-10-06T02:46:07.507028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499345+0000","last_change":"2023-10-06T02:46:06.501179+0000","last_active":"2023-10-06T02:46:07.499345+0000","last_peered":"2023-10-06T02:46:07.499345+0000","last_clean":"2023-10-06T02:46:07.499345+0000","last_became_active":"2023-10-06T02:46:06.500963+0000","last_became_peered":"2023-10-06T02:46:06.500963+0000","last_unstale":"2023-10-06T02:46:07.499345+0000","last_undegraded":"2023-10-06T02:46:07.499345+0000","last_fullsized":"2023-10-06T02:46:07.499345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.504650+0000","last_change":"2023-10-06T02:46:07.504555+0000","last_active":"2023-10-06T02:46:07.504650+0000","last_peered":"2023-10-06T02:46:07.504650+0000","last_clean":"2023-10-06T02:46:07.504650+0000","last_became_active":"2023-10-06T02:46:07.504138+0000","last_became_peered":"2023-10-06T02:46:07.504138+0000","last_unstale":"2023-10-06T02:46:07.504650+0000","last_undegraded":"2023-10-06T02:46:07.504650+0000","last_fullsized":"2023-10-06T02:46:07.504650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.503062+0000","last_change":"2023-10-06T02:46:06.505783+0000","last_active":"2023-10-06T02:46:07.503062+0000","last_peered":"2023-10-06T02:46:07.503062+0000","last_clean":"2023-10-06T02:46:07.503062+0000","last_became_active":"2023-10-06T02:46:06.505556+0000","last_became_peered":"2023-10-06T02:46:06.505556+0000","last_unstale":"2023-10-06T02:46:07.503062+0000","last_undegraded":"2023-10-06T02:46:07.503062+0000","last_fullsized":"2023-10-06T02:46:07.503062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:03.445295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506278+0000","last_change":"2023-10-06T02:46:07.502954+0000","last_active":"2023-10-06T02:46:07.506278+0000","last_peered":"2023-10-06T02:46:07.506278+0000","last_clean":"2023-10-06T02:46:07.506278+0000","last_became_active":"2023-10-06T02:46:07.502601+0000","last_became_peered":"2023-10-06T02:46:07.502601+0000","last_unstale":"2023-10-06T02:46:07.506278+0000","last_undegraded":"2023-10-06T02:46:07.506278+0000","last_fullsized":"2023-10-06T02:46:07.506278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.518604+0000","last_change":"2023-10-06T02:46:06.503869+0000","last_active":"2023-10-06T02:46:07.518604+0000","last_peered":"2023-10-06T02:46:07.518604+0000","last_clean":"2023-10-06T02:46:07.518604+0000","last_became_active":"2023-10-06T02:46:06.503648+0000","last_became_peered":"2023-10-06T02:46:06.503648+0000","last_unstale":"2023-10-06T02:46:07.518604+0000","last_undegraded":"2023-10-06T02:46:07.518604+0000","last_fullsized":"2023-10-06T02:46:07.518604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:30.229746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505698+0000","last_change":"2023-10-06T02:46:07.505647+0000","last_active":"2023-10-06T02:46:07.505698+0000","last_peered":"2023-10-06T02:46:07.505698+0000","last_clean":"2023-10-06T02:46:07.505698+0000","last_became_active":"2023-10-06T02:46:07.505306+0000","last_became_peered":"2023-10-06T02:46:07.505306+0000","last_unstale":"2023-10-06T02:46:07.505698+0000","last_undegraded":"2023-10-06T02:46:07.505698+0000","last_fullsized":"2023-10-06T02:46:07.505698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:21.300350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519147+0000","last_change":"2023-10-06T02:46:06.509035+0000","last_active":"2023-10-06T02:46:07.519147+0000","last_peered":"2023-10-06T02:46:07.519147+0000","last_clean":"2023-10-06T02:46:07.519147+0000","last_became_active":"2023-10-06T02:46:06.508828+0000","last_became_peered":"2023-10-06T02:46:06.508828+0000","last_unstale":"2023-10-06T02:46:07.519147+0000","last_undegraded":"2023-10-06T02:46:07.519147+0000","last_fullsized":"2023-10-06T02:46:07.519147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:25.817132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505963+0000","last_change":"2023-10-06T02:46:07.505886+0000","last_active":"2023-10-06T02:46:07.505963+0000","last_peered":"2023-10-06T02:46:07.505963+0000","last_clean":"2023-10-06T02:46:07.505963+0000","last_became_active":"2023-10-06T02:46:07.505418+0000","last_became_peered":"2023-10-06T02:46:07.505418+0000","last_unstale":"2023-10-06T02:46:07.505963+0000","last_undegraded":"2023-10-06T02:46:07.505963+0000","last_fullsized":"2023-10-06T02:46:07.505963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519237+0000","last_change":"2023-10-06T02:46:06.509618+0000","last_active":"2023-10-06T02:46:07.519237+0000","last_peered":"2023-10-06T02:46:07.519237+0000","last_clean":"2023-10-06T02:46:07.519237+0000","last_became_active":"2023-10-06T02:46:06.509377+0000","last_became_peered":"2023-10-06T02:46:06.509377+0000","last_unstale":"2023-10-06T02:46:07.519237+0000","last_undegraded":"2023-10-06T02:46:07.519237+0000","last_fullsized":"2023-10-06T02:46:07.519237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:41.862180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507506+0000","last_change":"2023-10-06T02:46:07.507448+0000","last_active":"2023-10-06T02:46:07.507506+0000","last_peered":"2023-10-06T02:46:07.507506+0000","last_clean":"2023-10-06T02:46:07.507506+0000","last_became_active":"2023-10-06T02:46:07.507221+0000","last_became_peered":"2023-10-06T02:46:07.507221+0000","last_unstale":"2023-10-06T02:46:07.507506+0000","last_undegraded":"2023-10-06T02:46:07.507506+0000","last_fullsized":"2023-10-06T02:46:07.507506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.956040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.517062+0000","last_change":"2023-10-06T02:46:06.498625+0000","last_active":"2023-10-06T02:46:07.517062+0000","last_peered":"2023-10-06T02:46:07.517062+0000","last_clean":"2023-10-06T02:46:07.517062+0000","last_became_active":"2023-10-06T02:46:06.498405+0000","last_became_peered":"2023-10-06T02:46:06.498405+0000","last_unstale":"2023-10-06T02:46:07.517062+0000","last_undegraded":"2023-10-06T02:46:07.517062+0000","last_fullsized":"2023-10-06T02:46:07.517062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.895724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.501977+0000","last_change":"2023-10-06T02:46:07.501817+0000","last_active":"2023-10-06T02:46:07.501977+0000","last_peered":"2023-10-06T02:46:07.501977+0000","last_clean":"2023-10-06T02:46:07.501977+0000","last_became_active":"2023-10-06T02:46:07.501615+0000","last_became_peered":"2023-10-06T02:46:07.501615+0000","last_unstale":"2023-10-06T02:46:07.501977+0000","last_undegraded":"2023-10-06T02:46:07.501977+0000","last_fullsized":"2023-10-06T02:46:07.501977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:41.224551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497143+0000","last_change":"2023-10-06T02:46:06.502492+0000","last_active":"2023-10-06T02:46:07.497143+0000","last_peered":"2023-10-06T02:46:07.497143+0000","last_clean":"2023-10-06T02:46:07.497143+0000","last_became_active":"2023-10-06T02:46:06.502172+0000","last_became_peered":"2023-10-06T02:46:06.502172+0000","last_unstale":"2023-10-06T02:46:07.497143+0000","last_undegraded":"2023-10-06T02:46:07.497143+0000","last_fullsized":"2023-10-06T02:46:07.497143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:13.223900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509094+0000","last_change":"2023-10-06T02:46:07.508860+0000","last_active":"2023-10-06T02:46:07.509094+0000","last_peered":"2023-10-06T02:46:07.509094+0000","last_clean":"2023-10-06T02:46:07.509094+0000","last_became_active":"2023-10-06T02:46:07.508363+0000","last_became_peered":"2023-10-06T02:46:07.508363+0000","last_unstale":"2023-10-06T02:46:07.509094+0000","last_undegraded":"2023-10-06T02:46:07.509094+0000","last_fullsized":"2023-10-06T02:46:07.509094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.956040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.517248+0000","last_change":"2023-10-06T02:46:06.505039+0000","last_active":"2023-10-06T02:46:07.517248+0000","last_peered":"2023-10-06T02:46:07.517248+0000","last_clean":"2023-10-06T02:46:07.517248+0000","last_became_active":"2023-10-06T02:46:06.504809+0000","last_became_peered":"2023-10-06T02:46:06.504809+0000","last_unstale":"2023-10-06T02:46:07.517248+0000","last_undegraded":"2023-10-06T02:46:07.517248+0000","last_fullsized":"2023-10-06T02:46:07.517248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505737+0000","last_change":"2023-10-06T02:46:07.504251+0000","last_active":"2023-10-06T02:46:07.505737+0000","last_peered":"2023-10-06T02:46:07.505737+0000","last_clean":"2023-10-06T02:46:07.505737+0000","last_became_active":"2023-10-06T02:46:07.504022+0000","last_became_peered":"2023-10-06T02:46:07.504022+0000","last_unstale":"2023-10-06T02:46:07.505737+0000","last_undegraded":"2023-10-06T02:46:07.505737+0000","last_fullsized":"2023-10-06T02:46:07.505737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:41.875449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500561+0000","last_change":"2023-10-06T02:46:06.508771+0000","last_active":"2023-10-06T02:46:07.500561+0000","last_peered":"2023-10-06T02:46:07.500561+0000","last_clean":"2023-10-06T02:46:07.500561+0000","last_became_active":"2023-10-06T02:46:06.508543+0000","last_became_peered":"2023-10-06T02:46:06.508543+0000","last_unstale":"2023-10-06T02:46:07.500561+0000","last_undegraded":"2023-10-06T02:46:07.500561+0000","last_fullsized":"2023-10-06T02:46:07.500561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:22.807034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506800+0000","last_change":"2023-10-06T02:46:07.506413+0000","last_active":"2023-10-06T02:46:07.506800+0000","last_peered":"2023-10-06T02:46:07.506800+0000","last_clean":"2023-10-06T02:46:07.506800+0000","last_became_active":"2023-10-06T02:46:07.506172+0000","last_became_peered":"2023-10-06T02:46:07.506172+0000","last_unstale":"2023-10-06T02:46:07.506800+0000","last_undegraded":"2023-10-06T02:46:07.506800+0000","last_fullsized":"2023-10-06T02:46:07.506800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505491+0000","last_change":"2023-10-06T02:46:06.511150+0000","last_active":"2023-10-06T02:46:07.505491+0000","last_peered":"2023-10-06T02:46:07.505491+0000","last_clean":"2023-10-06T02:46:07.505491+0000","last_became_active":"2023-10-06T02:46:06.510541+0000","last_became_peered":"2023-10-06T02:46:06.510541+0000","last_unstale":"2023-10-06T02:46:07.505491+0000","last_undegraded":"2023-10-06T02:46:07.505491+0000","last_fullsized":"2023-10-06T02:46:07.505491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510736+0000","last_change":"2023-10-06T02:46:07.509675+0000","last_active":"2023-10-06T02:46:07.510736+0000","last_peered":"2023-10-06T02:46:07.510736+0000","last_clean":"2023-10-06T02:46:07.510736+0000","last_became_active":"2023-10-06T02:46:07.508502+0000","last_became_peered":"2023-10-06T02:46:07.508502+0000","last_unstale":"2023-10-06T02:46:07.510736+0000","last_undegraded":"2023-10-06T02:46:07.510736+0000","last_fullsized":"2023-10-06T02:46:07.510736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:51.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.498073+0000","last_change":"2023-10-06T02:46:06.509235+0000","last_active":"2023-10-06T02:46:07.498073+0000","last_peered":"2023-10-06T02:46:07.498073+0000","last_clean":"2023-10-06T02:46:07.498073+0000","last_became_active":"2023-10-06T02:46:06.508969+0000","last_became_peered":"2023-10-06T02:46:06.508969+0000","last_unstale":"2023-10-06T02:46:07.498073+0000","last_undegraded":"2023-10-06T02:46:07.498073+0000","last_fullsized":"2023-10-06T02:46:07.498073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510187+0000","last_change":"2023-10-06T02:46:07.510137+0000","last_active":"2023-10-06T02:46:07.510187+0000","last_peered":"2023-10-06T02:46:07.510187+0000","last_clean":"2023-10-06T02:46:07.510187+0000","last_became_active":"2023-10-06T02:46:07.509917+0000","last_became_peered":"2023-10-06T02:46:07.509917+0000","last_unstale":"2023-10-06T02:46:07.510187+0000","last_undegraded":"2023-10-06T02:46:07.510187+0000","last_fullsized":"2023-10-06T02:46:07.510187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500321+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:46:07.500321+0000","last_peered":"2023-10-06T02:46:07.500321+0000","last_clean":"2023-10-06T02:46:07.500321+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:46:07.500321+0000","last_undegraded":"2023-10-06T02:46:07.500321+0000","last_fullsized":"2023-10-06T02:46:07.500321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497681+0000","last_change":"2023-10-06T02:46:06.506901+0000","last_active":"2023-10-06T02:46:07.497681+0000","last_peered":"2023-10-06T02:46:07.497681+0000","last_clean":"2023-10-06T02:46:07.497681+0000","last_became_active":"2023-10-06T02:46:06.506678+0000","last_became_peered":"2023-10-06T02:46:06.506678+0000","last_unstale":"2023-10-06T02:46:07.497681+0000","last_undegraded":"2023-10-06T02:46:07.497681+0000","last_fullsized":"2023-10-06T02:46:07.497681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509115+0000","last_change":"2023-10-06T02:46:07.509040+0000","last_active":"2023-10-06T02:46:07.509115+0000","last_peered":"2023-10-06T02:46:07.509115+0000","last_clean":"2023-10-06T02:46:07.509115+0000","last_became_active":"2023-10-06T02:46:07.508418+0000","last_became_peered":"2023-10-06T02:46:07.508418+0000","last_unstale":"2023-10-06T02:46:07.509115+0000","last_undegraded":"2023-10-06T02:46:07.509115+0000","last_fullsized":"2023-10-06T02:46:07.509115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:37.959042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497326+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:46:07.497326+0000","last_peered":"2023-10-06T02:46:07.497326+0000","last_clean":"2023-10-06T02:46:07.497326+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:46:07.497326+0000","last_undegraded":"2023-10-06T02:46:07.497326+0000","last_fullsized":"2023-10-06T02:46:07.497326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502341+0000","last_change":"2023-10-06T02:46:06.508135+0000","last_active":"2023-10-06T02:46:07.502341+0000","last_peered":"2023-10-06T02:46:07.502341+0000","last_clean":"2023-10-06T02:46:07.502341+0000","last_became_active":"2023-10-06T02:46:06.507924+0000","last_became_peered":"2023-10-06T02:46:06.507924+0000","last_unstale":"2023-10-06T02:46:07.502341+0000","last_undegraded":"2023-10-06T02:46:07.502341+0000","last_fullsized":"2023-10-06T02:46:07.502341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507713+0000","last_change":"2023-10-06T02:46:07.507658+0000","last_active":"2023-10-06T02:46:07.507713+0000","last_peered":"2023-10-06T02:46:07.507713+0000","last_clean":"2023-10-06T02:46:07.507713+0000","last_became_active":"2023-10-06T02:46:07.507449+0000","last_became_peered":"2023-10-06T02:46:07.507449+0000","last_unstale":"2023-10-06T02:46:07.507713+0000","last_undegraded":"2023-10-06T02:46:07.507713+0000","last_fullsized":"2023-10-06T02:46:07.507713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:30.773573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.496044+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:46:07.496044+0000","last_peered":"2023-10-06T02:46:07.496044+0000","last_clean":"2023-10-06T02:46:07.496044+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:46:07.496044+0000","last_undegraded":"2023-10-06T02:46:07.496044+0000","last_fullsized":"2023-10-06T02:46:07.496044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500045+0000","last_change":"2023-10-06T02:46:06.505031+0000","last_active":"2023-10-06T02:46:07.500045+0000","last_peered":"2023-10-06T02:46:07.500045+0000","last_clean":"2023-10-06T02:46:07.500045+0000","last_became_active":"2023-10-06T02:46:06.504811+0000","last_became_peered":"2023-10-06T02:46:06.504811+0000","last_unstale":"2023-10-06T02:46:07.500045+0000","last_undegraded":"2023-10-06T02:46:07.500045+0000","last_fullsized":"2023-10-06T02:46:07.500045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.509069+0000","last_change":"2023-10-06T02:46:07.508885+0000","last_active":"2023-10-06T02:46:07.509069+0000","last_peered":"2023-10-06T02:46:07.509069+0000","last_clean":"2023-10-06T02:46:07.509069+0000","last_became_active":"2023-10-06T02:46:07.508130+0000","last_became_peered":"2023-10-06T02:46:07.508130+0000","last_unstale":"2023-10-06T02:46:07.509069+0000","last_undegraded":"2023-10-06T02:46:07.509069+0000","last_fullsized":"2023-10-06T02:46:07.509069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497823+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:46:07.497823+0000","last_peered":"2023-10-06T02:46:07.497823+0000","last_clean":"2023-10-06T02:46:07.497823+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:46:07.497823+0000","last_undegraded":"2023-10-06T02:46:07.497823+0000","last_fullsized":"2023-10-06T02:46:07.497823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502521+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:46:07.502521+0000","last_peered":"2023-10-06T02:46:07.502521+0000","last_clean":"2023-10-06T02:46:07.502521+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:46:07.502521+0000","last_undegraded":"2023-10-06T02:46:07.502521+0000","last_fullsized":"2023-10-06T02:46:07.502521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.497774+0000","last_change":"2023-10-06T02:46:06.504522+0000","last_active":"2023-10-06T02:46:07.497774+0000","last_peered":"2023-10-06T02:46:07.497774+0000","last_clean":"2023-10-06T02:46:07.497774+0000","last_became_active":"2023-10-06T02:46:06.504244+0000","last_became_peered":"2023-10-06T02:46:06.504244+0000","last_unstale":"2023-10-06T02:46:07.497774+0000","last_undegraded":"2023-10-06T02:46:07.497774+0000","last_fullsized":"2023-10-06T02:46:07.497774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502915+0000","last_change":"2023-10-06T02:46:07.502838+0000","last_active":"2023-10-06T02:46:07.502915+0000","last_peered":"2023-10-06T02:46:07.502915+0000","last_clean":"2023-10-06T02:46:07.502915+0000","last_became_active":"2023-10-06T02:46:07.502571+0000","last_became_peered":"2023-10-06T02:46:07.502571+0000","last_unstale":"2023-10-06T02:46:07.502915+0000","last_undegraded":"2023-10-06T02:46:07.502915+0000","last_fullsized":"2023-10-06T02:46:07.502915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:42.864190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502146+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:46:07.502146+0000","last_peered":"2023-10-06T02:46:07.502146+0000","last_clean":"2023-10-06T02:46:07.502146+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:46:07.502146+0000","last_undegraded":"2023-10-06T02:46:07.502146+0000","last_fullsized":"2023-10-06T02:46:07.502146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.500874+0000","last_change":"2023-10-06T02:46:06.509615+0000","last_active":"2023-10-06T02:46:07.500874+0000","last_peered":"2023-10-06T02:46:07.500874+0000","last_clean":"2023-10-06T02:46:07.500874+0000","last_became_active":"2023-10-06T02:46:06.508150+0000","last_became_peered":"2023-10-06T02:46:06.508150+0000","last_unstale":"2023-10-06T02:46:07.500874+0000","last_undegraded":"2023-10-06T02:46:07.500874+0000","last_fullsized":"2023-10-06T02:46:07.500874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508716+0000","last_change":"2023-10-06T02:46:07.508651+0000","last_active":"2023-10-06T02:46:07.508716+0000","last_peered":"2023-10-06T02:46:07.508716+0000","last_clean":"2023-10-06T02:46:07.508716+0000","last_became_active":"2023-10-06T02:46:07.507943+0000","last_became_peered":"2023-10-06T02:46:07.507943+0000","last_unstale":"2023-10-06T02:46:07.508716+0000","last_undegraded":"2023-10-06T02:46:07.508716+0000","last_fullsized":"2023-10-06T02:46:07.508716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:10.549839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502607+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:46:07.502607+0000","last_peered":"2023-10-06T02:46:07.502607+0000","last_clean":"2023-10-06T02:46:07.502607+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:46:07.502607+0000","last_undegraded":"2023-10-06T02:46:07.502607+0000","last_fullsized":"2023-10-06T02:46:07.502607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499607+0000","last_change":"2023-10-06T02:46:06.506734+0000","last_active":"2023-10-06T02:46:07.499607+0000","last_peered":"2023-10-06T02:46:07.499607+0000","last_clean":"2023-10-06T02:46:07.499607+0000","last_became_active":"2023-10-06T02:46:06.506350+0000","last_became_peered":"2023-10-06T02:46:06.506350+0000","last_unstale":"2023-10-06T02:46:07.499607+0000","last_undegraded":"2023-10-06T02:46:07.499607+0000","last_fullsized":"2023-10-06T02:46:07.499607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506313+0000","last_change":"2023-10-06T02:46:07.505004+0000","last_active":"2023-10-06T02:46:07.506313+0000","last_peered":"2023-10-06T02:46:07.506313+0000","last_clean":"2023-10-06T02:46:07.506313+0000","last_became_active":"2023-10-06T02:46:07.504802+0000","last_became_peered":"2023-10-06T02:46:07.504802+0000","last_unstale":"2023-10-06T02:46:07.506313+0000","last_undegraded":"2023-10-06T02:46:07.506313+0000","last_fullsized":"2023-10-06T02:46:07.506313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:39.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.516938+0000","last_change":"2023-10-06T02:46:06.506225+0000","last_active":"2023-10-06T02:46:07.516938+0000","last_peered":"2023-10-06T02:46:07.516938+0000","last_clean":"2023-10-06T02:46:07.516938+0000","last_became_active":"2023-10-06T02:46:06.505946+0000","last_became_peered":"2023-10-06T02:46:06.505946+0000","last_unstale":"2023-10-06T02:46:07.516938+0000","last_undegraded":"2023-10-06T02:46:07.516938+0000","last_fullsized":"2023-10-06T02:46:07.516938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499718+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:46:07.499718+0000","last_peered":"2023-10-06T02:46:07.499718+0000","last_clean":"2023-10-06T02:46:07.499718+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:46:07.499718+0000","last_undegraded":"2023-10-06T02:46:07.499718+0000","last_fullsized":"2023-10-06T02:46:07.499718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508060+0000","last_change":"2023-10-06T02:46:07.507383+0000","last_active":"2023-10-06T02:46:07.508060+0000","last_peered":"2023-10-06T02:46:07.508060+0000","last_clean":"2023-10-06T02:46:07.508060+0000","last_became_active":"2023-10-06T02:46:07.506430+0000","last_became_peered":"2023-10-06T02:46:07.506430+0000","last_unstale":"2023-10-06T02:46:07.508060+0000","last_undegraded":"2023-10-06T02:46:07.508060+0000","last_fullsized":"2023-10-06T02:46:07.508060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:28.847424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.499726+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:46:07.499726+0000","last_peered":"2023-10-06T02:46:07.499726+0000","last_clean":"2023-10-06T02:46:07.499726+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:46:07.499726+0000","last_undegraded":"2023-10-06T02:46:07.499726+0000","last_fullsized":"2023-10-06T02:46:07.499726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T02:46:10.685815+0000","last_change":"2023-10-06T02:46:06.509764+0000","last_active":"2023-10-06T02:46:10.685815+0000","last_peered":"2023-10-06T02:46:10.685815+0000","last_clean":"2023-10-06T02:46:10.685815+0000","last_became_active":"2023-10-06T02:46:06.508422+0000","last_became_peered":"2023-10-06T02:46:06.508422+0000","last_unstale":"2023-10-06T02:46:10.685815+0000","last_undegraded":"2023-10-06T02:46:10.685815+0000","last_fullsized":"2023-10-06T02:46:10.685815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:35.466530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506969+0000","last_change":"2023-10-06T02:46:07.506906+0000","last_active":"2023-10-06T02:46:07.506969+0000","last_peered":"2023-10-06T02:46:07.506969+0000","last_clean":"2023-10-06T02:46:07.506969+0000","last_became_active":"2023-10-06T02:46:07.506307+0000","last_became_peered":"2023-10-06T02:46:07.506307+0000","last_unstale":"2023-10-06T02:46:07.506969+0000","last_undegraded":"2023-10-06T02:46:07.506969+0000","last_fullsized":"2023-10-06T02:46:07.506969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.518794+0000","last_change":"2023-10-06T02:46:06.508208+0000","last_active":"2023-10-06T02:46:07.518794+0000","last_peered":"2023-10-06T02:46:07.518794+0000","last_clean":"2023-10-06T02:46:07.518794+0000","last_became_active":"2023-10-06T02:46:06.508003+0000","last_became_peered":"2023-10-06T02:46:06.508003+0000","last_unstale":"2023-10-06T02:46:07.518794+0000","last_undegraded":"2023-10-06T02:46:07.518794+0000","last_fullsized":"2023-10-06T02:46:07.518794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:04.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.507486+0000","last_change":"2023-10-06T02:46:07.507427+0000","last_active":"2023-10-06T02:46:07.507486+0000","last_peered":"2023-10-06T02:46:07.507486+0000","last_clean":"2023-10-06T02:46:07.507486+0000","last_became_active":"2023-10-06T02:46:07.507181+0000","last_became_peered":"2023-10-06T02:46:07.507181+0000","last_unstale":"2023-10-06T02:46:07.507486+0000","last_undegraded":"2023-10-06T02:46:07.507486+0000","last_fullsized":"2023-10-06T02:46:07.507486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:14.225910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519129+0000","last_change":"2023-10-06T02:46:06.508400+0000","last_active":"2023-10-06T02:46:07.519129+0000","last_peered":"2023-10-06T02:46:07.519129+0000","last_clean":"2023-10-06T02:46:07.519129+0000","last_became_active":"2023-10-06T02:46:06.508214+0000","last_became_peered":"2023-10-06T02:46:06.508214+0000","last_unstale":"2023-10-06T02:46:07.519129+0000","last_undegraded":"2023-10-06T02:46:07.519129+0000","last_fullsized":"2023-10-06T02:46:07.519129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:26.618513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505770+0000","last_change":"2023-10-06T02:46:07.505375+0000","last_active":"2023-10-06T02:46:07.505770+0000","last_peered":"2023-10-06T02:46:07.505770+0000","last_clean":"2023-10-06T02:46:07.505770+0000","last_became_active":"2023-10-06T02:46:07.505155+0000","last_became_peered":"2023-10-06T02:46:07.505155+0000","last_unstale":"2023-10-06T02:46:07.505770+0000","last_undegraded":"2023-10-06T02:46:07.505770+0000","last_fullsized":"2023-10-06T02:46:07.505770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:12:08.403799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.519370+0000","last_change":"2023-10-06T02:46:06.511448+0000","last_active":"2023-10-06T02:46:07.519370+0000","last_peered":"2023-10-06T02:46:07.519370+0000","last_clean":"2023-10-06T02:46:07.519370+0000","last_became_active":"2023-10-06T02:46:06.511215+0000","last_became_peered":"2023-10-06T02:46:06.511215+0000","last_unstale":"2023-10-06T02:46:07.519370+0000","last_undegraded":"2023-10-06T02:46:07.519370+0000","last_fullsized":"2023-10-06T02:46:07.519370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.506825+0000","last_change":"2023-10-06T02:46:07.506746+0000","last_active":"2023-10-06T02:46:07.506825+0000","last_peered":"2023-10-06T02:46:07.506825+0000","last_clean":"2023-10-06T02:46:07.506825+0000","last_became_active":"2023-10-06T02:46:07.505974+0000","last_became_peered":"2023-10-06T02:46:07.505974+0000","last_unstale":"2023-10-06T02:46:07.506825+0000","last_undegraded":"2023-10-06T02:46:07.506825+0000","last_fullsized":"2023-10-06T02:46:07.506825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:45.352280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.515971+0000","last_change":"2023-10-06T02:46:06.507072+0000","last_active":"2023-10-06T02:46:07.515971+0000","last_peered":"2023-10-06T02:46:07.515971+0000","last_clean":"2023-10-06T02:46:07.515971+0000","last_became_active":"2023-10-06T02:46:06.506884+0000","last_became_peered":"2023-10-06T02:46:06.506884+0000","last_unstale":"2023-10-06T02:46:07.515971+0000","last_undegraded":"2023-10-06T02:46:07.515971+0000","last_fullsized":"2023-10-06T02:46:07.515971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:49.162640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508043+0000","last_change":"2023-10-06T02:46:07.507192+0000","last_active":"2023-10-06T02:46:07.508043+0000","last_peered":"2023-10-06T02:46:07.508043+0000","last_clean":"2023-10-06T02:46:07.508043+0000","last_became_active":"2023-10-06T02:46:07.505722+0000","last_became_peered":"2023-10-06T02:46:07.505722+0000","last_unstale":"2023-10-06T02:46:07.508043+0000","last_undegraded":"2023-10-06T02:46:07.508043+0000","last_fullsized":"2023-10-06T02:46:07.508043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:41.417168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.518896+0000","last_change":"2023-10-06T02:46:06.503414+0000","last_active":"2023-10-06T02:46:07.518896+0000","last_peered":"2023-10-06T02:46:07.518896+0000","last_clean":"2023-10-06T02:46:07.518896+0000","last_became_active":"2023-10-06T02:46:06.503182+0000","last_became_peered":"2023-10-06T02:46:06.503182+0000","last_unstale":"2023-10-06T02:46:07.518896+0000","last_undegraded":"2023-10-06T02:46:07.518896+0000","last_fullsized":"2023-10-06T02:46:07.518896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:05.487581+0000","last_clean_scrub_stamp":"2023-10-06T02:46:05.487581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:25.774903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510782+0000","last_change":"2023-10-06T02:46:07.510148+0000","last_active":"2023-10-06T02:46:07.510782+0000","last_peered":"2023-10-06T02:46:07.510782+0000","last_clean":"2023-10-06T02:46:07.510782+0000","last_became_active":"2023-10-06T02:46:07.509401+0000","last_became_peered":"2023-10-06T02:46:07.509401+0000","last_unstale":"2023-10-06T02:46:07.510782+0000","last_undegraded":"2023-10-06T02:46:07.510782+0000","last_fullsized":"2023-10-06T02:46:07.510782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:05.528757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.502895+0000","last_change":"2023-10-06T02:46:07.502629+0000","last_active":"2023-10-06T02:46:07.502895+0000","last_peered":"2023-10-06T02:46:07.502895+0000","last_clean":"2023-10-06T02:46:07.502895+0000","last_became_active":"2023-10-06T02:46:07.502400+0000","last_became_peered":"2023-10-06T02:46:07.502400+0000","last_unstale":"2023-10-06T02:46:07.502895+0000","last_undegraded":"2023-10-06T02:46:07.502895+0000","last_fullsized":"2023-10-06T02:46:07.502895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:00.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.505684+0000","last_change":"2023-10-06T02:46:07.505518+0000","last_active":"2023-10-06T02:46:07.505684+0000","last_peered":"2023-10-06T02:46:07.505684+0000","last_clean":"2023-10-06T02:46:07.505684+0000","last_became_active":"2023-10-06T02:46:07.504595+0000","last_became_peered":"2023-10-06T02:46:07.504595+0000","last_unstale":"2023-10-06T02:46:07.505684+0000","last_undegraded":"2023-10-06T02:46:07.505684+0000","last_fullsized":"2023-10-06T02:46:07.505684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:41.875449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.510796+0000","last_change":"2023-10-06T02:46:07.510598+0000","last_active":"2023-10-06T02:46:07.510796+0000","last_peered":"2023-10-06T02:46:07.510796+0000","last_clean":"2023-10-06T02:46:07.510796+0000","last_became_active":"2023-10-06T02:46:07.510359+0000","last_became_peered":"2023-10-06T02:46:07.510359+0000","last_unstale":"2023-10-06T02:46:07.510796+0000","last_undegraded":"2023-10-06T02:46:07.510796+0000","last_fullsized":"2023-10-06T02:46:07.510796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:59.513702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508076+0000","last_change":"2023-10-06T02:46:07.507536+0000","last_active":"2023-10-06T02:46:07.508076+0000","last_peered":"2023-10-06T02:46:07.508076+0000","last_clean":"2023-10-06T02:46:07.508076+0000","last_became_active":"2023-10-06T02:46:07.506737+0000","last_became_peered":"2023-10-06T02:46:07.506737+0000","last_unstale":"2023-10-06T02:46:07.508076+0000","last_undegraded":"2023-10-06T02:46:07.508076+0000","last_fullsized":"2023-10-06T02:46:07.508076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.956040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T02:46:07.508695+0000","last_change":"2023-10-06T02:46:07.508492+0000","last_active":"2023-10-06T02:46:07.508695+0000","last_peered":"2023-10-06T02:46:07.508695+0000","last_clean":"2023-10-06T02:46:07.508695+0000","last_became_active":"2023-10-06T02:46:07.508271+0000","last_became_peered":"2023-10-06T02:46:07.508271+0000","last_unstale":"2023-10-06T02:46:07.508695+0000","last_undegraded":"2023-10-06T02:46:07.508695+0000","last_fullsized":"2023-10-06T02:46:07.508695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:06.489591+0000","last_clean_scrub_stamp":"2023-10-06T02:46:06.489591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:26.938301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":665,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194647,"statfs":{"total":200000000,"available":199318721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199909249,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195224,"statfs":{"total":200000000,"available":199910217,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]}],"pool_statfs":[]}} 2023-10-06T02:46:22.539 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T02:46:22.539 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T02:46:22.539 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T02:46:22.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T02:46:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.684+0000 7f3f433ea700 1 Processor -- start 2023-10-06T02:46:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.684+0000 7f3f433ea700 1 -- start start 2023-10-06T02:46:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f433ea700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 0x7f3f3c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f433ea700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f3c0ccca0 0x7f3f3c0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f433ea700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3c0cd100 con 0x7f3f3c0b1070 2023-10-06T02:46:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f433ea700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c15ca70 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f433ea700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c158450 con 0x7f3f3c15c290 2023-10-06T02:46:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f41987700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f3c0ccca0 0x7f3f3c0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f41987700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f3c0ccca0 0x7f3f3c0cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47888/0 (socket says 172.21.15.81:47888) 2023-10-06T02:46:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f41987700 1 -- 172.21.15.81:0/511932332 learned_addr learned my addr 172.21.15.81:0/511932332 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f40985700 1 --2- 172.21.15.81:0/511932332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 0x7f3f3c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f41987700 1 -- 172.21.15.81:0/511932332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 msgr2=0x7f3f3c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f41987700 1 --2- 172.21.15.81:0/511932332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 0x7f3f3c0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f41987700 1 -- 172.21.15.81:0/511932332 >> v1:172.21.15.83:6789/0 conn(0x7f3f3c0b1070 legacy=0x7f3f3c15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.685+0000 7f3f41987700 1 -- 172.21.15.81:0/511932332 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c0cd370 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f41987700 1 --2- 172.21.15.81:0/511932332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 0x7f3f3c0cebc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009f20 tx=0x7f3f34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6768fca89dd8c19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f33fff700 1 -- 172.21.15.81:0/511932332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3400e070 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f33fff700 1 -- 172.21.15.81:0/511932332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3400b9d0 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f33fff700 1 -- 172.21.15.81:0/511932332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f340092e0 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f433ea700 1 -- 172.21.15.81:0/511932332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 msgr2=0x7f3f3c0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f433ea700 1 --2- 172.21.15.81:0/511932332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 0x7f3f3c0cebc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009f20 tx=0x7f3f34009840 comp rx=0 tx=0).stop 2023-10-06T02:46:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f433ea700 1 -- 172.21.15.81:0/511932332 shutdown_connections 2023-10-06T02:46:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f433ea700 1 --2- 172.21.15.81:0/511932332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 0x7f3f3c0cebc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f433ea700 1 --2- 172.21.15.81:0/511932332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 0x7f3f3c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f433ea700 1 -- 172.21.15.81:0/511932332 >> 172.21.15.81:0/511932332 conn(0x7f3f3c067640 msgr2=0x7f3f3c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f433ea700 1 -- 172.21.15.81:0/511932332 shutdown_connections 2023-10-06T02:46:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.686+0000 7f3f433ea700 1 -- 172.21.15.81:0/511932332 wait complete. 2023-10-06T02:46:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.687+0000 7f3f433ea700 1 Processor -- start 2023-10-06T02:46:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.687+0000 7f3f433ea700 1 -- start start 2023-10-06T02:46:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f433ea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f3c0b1070 0x7f3f3c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f433ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 0x7f3f3c1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f433ea700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 0x7f3f3c0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f433ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0c7e80 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f433ea700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c14f2f0 con 0x7f3f3c0b1070 2023-10-06T02:46:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f433ea700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c159d40 con 0x7f3f3c15c290 2023-10-06T02:46:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f40985700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 0x7f3f3c1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f40985700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 0x7f3f3c1592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47890/0 (socket says 172.21.15.81:47890) 2023-10-06T02:46:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f40985700 1 -- 172.21.15.81:0/2005614575 learned_addr learned my addr 172.21.15.81:0/2005614575 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f41186700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f3c0b1070 0x7f3f3c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.688+0000 7f3f41987700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 0x7f3f3c0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f40985700 1 -- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 msgr2=0x7f3f3c0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f40985700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 0x7f3f3c0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f40985700 1 -- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f3c0b1070 msgr2=0x7f3f3c14edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f40985700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f3c0b1070 0x7f3f3c14edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f40985700 1 -- 172.21.15.81:0/2005614575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34009ae0 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f40985700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 0x7f3f3c1592c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00e960 tx=0x7f3f2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f317fa700 1 -- 172.21.15.81:0/2005614575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c013680 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f317fa700 1 -- 172.21.15.81:0/2005614575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c0137e0 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f317fa700 1 -- 172.21.15.81:0/2005614575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c013b80 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c0c7550 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.689+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c0c7b10 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.690+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c0c8030 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.690+0000 7f3f317fa700 1 -- 172.21.15.81:0/2005614575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f2c0123d0 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.691+0000 7f3f317fa700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f20066f30 0x7f3f200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.691+0000 7f3f317fa700 1 -- 172.21.15.81:0/2005614575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f2c084750 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.691+0000 7f3f41186700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f20066f30 0x7f3f200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.691+0000 7f3f41186700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f20066f30 0x7f3f200693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f38003a80 tx=0x7f3f38007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.695+0000 7f3f317fa700 1 -- 172.21.15.81:0/2005614575 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f3c0c8030 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.917+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3f3c0c8030 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.918+0000 7f3f317fa700 1 -- 172.21.15.81:0/2005614575 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3f3c0c8030 con 0x7f3f3c0ccca0 2023-10-06T02:46:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:22.919 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T02:46:22.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f20066f30 msgr2=0x7f3f200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f20066f30 0x7f3f200693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f38003a80 tx=0x7f3f38007ec0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 msgr2=0x7f3f3c1592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 0x7f3f3c1592c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00e960 tx=0x7f3f2c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 shutdown_connections 2023-10-06T02:46:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f3c15c290 0x7f3f3c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f20066f30 0x7f3f200693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f3c0b1070 0x7f3f3c14edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 --2- 172.21.15.81:0/2005614575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3c0ccca0 0x7f3f3c1592c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 >> 172.21.15.81:0/2005614575 conn(0x7f3f3c067640 msgr2=0x7f3f3c0c39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 shutdown_connections 2023-10-06T02:46:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:22.920+0000 7f3f433ea700 1 -- 172.21.15.81:0/2005614575 wait complete. 2023-10-06T02:46:22.933 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T02:46:22.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.045+0000 7f9c86622700 1 Processor -- start 2023-10-06T02:46:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.045+0000 7f9c86622700 1 -- start start 2023-10-06T02:46:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.046+0000 7f9c86622700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9c801569e0 0x7f9c800b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.046+0000 7f9c86622700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c80156db0 0x7f9c8006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.046+0000 7f9c86622700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c800b2290 con 0x7f9c800b1d10 2023-10-06T02:46:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.046+0000 7f9c86622700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c80157c00 con 0x7f9c80156db0 2023-10-06T02:46:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.046+0000 7f9c86622700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c801572d0 con 0x7f9c801569e0 2023-10-06T02:46:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.046+0000 7f9c7f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c80156db0 0x7f9c8006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.046+0000 7f9c84bbf700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9c800b1d10 0x7f9c8015a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50266/0 (socket says 172.21.15.81:50266) 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.046+0000 7f9c84bbf700 1 -- 172.21.15.81:0/2013375051 learned_addr learned my addr 172.21.15.81:0/2013375051 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7ffff700 1 --2- 172.21.15.81:0/2013375051 >> v2:172.21.15.83:3300/0 conn(0x7f9c801569e0 0x7f9c800b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7f7fe700 1 -- 172.21.15.81:0/2013375051 >> v2:172.21.15.83:3300/0 conn(0x7f9c801569e0 msgr2=0x7f9c800b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7f7fe700 1 --2- 172.21.15.81:0/2013375051 >> v2:172.21.15.83:3300/0 conn(0x7f9c801569e0 0x7f9c800b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7f7fe700 1 -- 172.21.15.81:0/2013375051 >> v1:172.21.15.81:6789/0 conn(0x7f9c800b1d10 legacy=0x7f9c8015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7f7fe700 1 -- 172.21.15.81:0/2013375051 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c801575b0 con 0x7f9c80156db0 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7effd700 1 -- 172.21.15.81:0/2013375051 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535720590 0 0) 0x7f9c800b2290 con 0x7f9c800b1d10 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7ffff700 1 --2- 172.21.15.81:0/2013375051 >> v2:172.21.15.83:3300/0 conn(0x7f9c801569e0 0x7f9c800b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7f7fe700 1 --2- 172.21.15.81:0/2013375051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 0x7f9c8006e230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c8006f590 tx=0x7f9c740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be969cd729ce6d7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7effd700 1 -- 172.21.15.81:0/2013375051 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400b6b0 con 0x7f9c80156db0 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7effd700 1 -- 172.21.15.81:0/2013375051 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7400b810 con 0x7f9c80156db0 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c7effd700 1 -- 172.21.15.81:0/2013375051 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400bbb0 con 0x7f9c80156db0 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c86622700 1 -- 172.21.15.81:0/2013375051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 msgr2=0x7f9c8006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c86622700 1 --2- 172.21.15.81:0/2013375051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 0x7f9c8006e230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c8006f590 tx=0x7f9c740091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c86622700 1 -- 172.21.15.81:0/2013375051 shutdown_connections 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c86622700 1 --2- 172.21.15.81:0/2013375051 >> v2:172.21.15.83:3300/0 conn(0x7f9c801569e0 0x7f9c800b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c86622700 1 --2- 172.21.15.81:0/2013375051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 0x7f9c8006e230 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.047+0000 7f9c86622700 1 -- 172.21.15.81:0/2013375051 >> 172.21.15.81:0/2013375051 conn(0x7f9c8006cca0 msgr2=0x7f9c8006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.048+0000 7f9c86622700 1 -- 172.21.15.81:0/2013375051 shutdown_connections 2023-10-06T02:46:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.048+0000 7f9c86622700 1 -- 172.21.15.81:0/2013375051 wait complete. 2023-10-06T02:46:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.049+0000 7f9c86622700 1 Processor -- start 2023-10-06T02:46:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.049+0000 7f9c86622700 1 -- start start 2023-10-06T02:46:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.049+0000 7f9c86622700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c800b1d10 0x7f9c800c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.049+0000 7f9c86622700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c801569e0 0x7f9c8016e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.049+0000 7f9c86622700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 0x7f9c80149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.049+0000 7f9c86622700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800c8070 con 0x7f9c80156db0 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.049+0000 7f9c86622700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800c7460 con 0x7f9c800b1d10 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.049+0000 7f9c86622700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800c7740 con 0x7f9c801569e0 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c84bbf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 0x7f9c80149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c84bbf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 0x7f9c80149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47896/0 (socket says 172.21.15.81:47896) 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c84bbf700 1 -- 172.21.15.81:0/1715061865 learned_addr learned my addr 172.21.15.81:0/1715061865 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c7ffff700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c800b1d10 0x7f9c800c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c7f7fe700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c801569e0 0x7f9c8016e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c84bbf700 1 -- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c801569e0 msgr2=0x7f9c8016e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c84bbf700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c801569e0 0x7f9c8016e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c84bbf700 1 -- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c800b1d10 msgr2=0x7f9c800c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c84bbf700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c800b1d10 0x7f9c800c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c84bbf700 1 -- 172.21.15.81:0/1715061865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74009420 con 0x7f9c80156db0 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c84bbf700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 0x7f9c80149b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800cc90 tx=0x7f9c78001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c67fff700 1 -- 172.21.15.81:0/1715061865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800a8b0 con 0x7f9c80156db0 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c67fff700 1 -- 172.21.15.81:0/1715061865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7800aa10 con 0x7f9c80156db0 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c67fff700 1 -- 172.21.15.81:0/1715061865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800add0 con 0x7f9c80156db0 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c800c7a20 con 0x7f9c80156db0 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.050+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c80147340 con 0x7f9c80156db0 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.051+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c80068900 con 0x7f9c80156db0 2023-10-06T02:46:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.052+0000 7f9c67fff700 1 -- 172.21.15.81:0/1715061865 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c78007300 con 0x7f9c80156db0 2023-10-06T02:46:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.052+0000 7f9c67fff700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c6c066f30 0x7f9c6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.052+0000 7f9c67fff700 1 -- 172.21.15.81:0/1715061865 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c780849b0 con 0x7f9c80156db0 2023-10-06T02:46:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.052+0000 7f9c7ffff700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c6c066f30 0x7f9c6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.053+0000 7f9c7ffff700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c6c066f30 0x7f9c6c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c70006f00 tx=0x7f9c70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.056+0000 7f9c67fff700 1 -- 172.21.15.81:0/1715061865 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c78051b40 con 0x7f9c80156db0 2023-10-06T02:46:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.239+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c80157890 con 0x7f9c80156db0 2023-10-06T02:46:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.240+0000 7f9c67fff700 1 -- 172.21.15.81:0/1715061865 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f9c78055160 con 0x7f9c80156db0 2023-10-06T02:46:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:23.241 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:23.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c6c066f30 msgr2=0x7f9c6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c6c066f30 0x7f9c6c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c70006f00 tx=0x7f9c70008040 comp rx=0 tx=0).stop 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 msgr2=0x7f9c80149b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 0x7f9c80149b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800cc90 tx=0x7f9c78001a80 comp rx=0 tx=0).stop 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 shutdown_connections 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80156db0 0x7f9c80149b60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c6c066f30 0x7f9c6c0693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c800b1d10 0x7f9c800c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 --2- 172.21.15.81:0/1715061865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c801569e0 0x7f9c8016e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 >> 172.21.15.81:0/1715061865 conn(0x7f9c8006cca0 msgr2=0x7f9c800afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 shutdown_connections 2023-10-06T02:46:23.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.242+0000 7f9c86622700 1 -- 172.21.15.81:0/1715061865 wait complete. 2023-10-06T02:46:23.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:46:05.360665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:46:05.837671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:46:23.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.372+0000 7f795197e700 1 Processor -- start 2023-10-06T02:46:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.372+0000 7f795197e700 1 -- start start 2023-10-06T02:46:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f795197e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f794c157ca0 0x7f794c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f795197e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0d07c0 con 0x7f794c06d120 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f795197e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0cfbb0 con 0x7f794c1578d0 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f795197e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0cfe90 con 0x7f794c157ca0 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f794b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f794c06d120 0x7f794c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50280/0 (socket says 172.21.15.81:50280) 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f794b7fe700 1 -- 172.21.15.81:0/840670113 learned_addr learned my addr 172.21.15.81:0/840670113 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f79427fc700 1 --2- 172.21.15.81:0/840670113 >> v2:172.21.15.83:3300/0 conn(0x7f794c157ca0 0x7f794c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f794a7fc700 1 -- 172.21.15.81:0/840670113 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772620505 0 0) 0x7f794c0d07c0 con 0x7f794c06d120 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f794a7fc700 1 -- 172.21.15.81:0/840670113 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7938003570 con 0x7f794c06d120 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f794a7fc700 1 -- 172.21.15.81:0/840670113 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006425144 0 0) 0x7f794c0cfbb0 con 0x7f794c1578d0 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f794a7fc700 1 -- 172.21.15.81:0/840670113 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f794c0d07c0 con 0x7f794c1578d0 2023-10-06T02:46:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f79427fc700 1 -- 172.21.15.81:0/840670113 >> v1:172.21.15.83:6789/0 conn(0x7f794c1578d0 legacy=0x7f794c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f79427fc700 1 -- 172.21.15.81:0/840670113 >> v1:172.21.15.81:6789/0 conn(0x7f794c06d120 legacy=0x7f794c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f79427fc700 1 -- 172.21.15.81:0/840670113 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0d0170 con 0x7f794c157ca0 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f79427fc700 1 --2- 172.21.15.81:0/840670113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 0x7f794c0cf4f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79340098e0 tx=0x7f79340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9beb74130e77b1f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f794a7fc700 1 -- 172.21.15.81:0/840670113 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934011630 con 0x7f794c157ca0 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.373+0000 7f794a7fc700 1 -- 172.21.15.81:0/840670113 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934011790 con 0x7f794c157ca0 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.374+0000 7f794a7fc700 1 -- 172.21.15.81:0/840670113 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934011b30 con 0x7f794c157ca0 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.374+0000 7f795197e700 1 -- 172.21.15.81:0/840670113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 msgr2=0x7f794c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.374+0000 7f795197e700 1 --2- 172.21.15.81:0/840670113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 0x7f794c0cf4f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79340098e0 tx=0x7f79340091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.374+0000 7f795197e700 1 -- 172.21.15.81:0/840670113 shutdown_connections 2023-10-06T02:46:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.374+0000 7f795197e700 1 --2- 172.21.15.81:0/840670113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 0x7f794c0cf4f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.374+0000 7f795197e700 1 -- 172.21.15.81:0/840670113 >> 172.21.15.81:0/840670113 conn(0x7f794c06bb90 msgr2=0x7f794c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.374+0000 7f795197e700 1 -- 172.21.15.81:0/840670113 shutdown_connections 2023-10-06T02:46:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.374+0000 7f795197e700 1 -- 172.21.15.81:0/840670113 wait complete. 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.375+0000 7f795197e700 1 Processor -- start 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.375+0000 7f795197e700 1 -- start start 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f795197e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f794c06d120 0x7f794c14ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f795197e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c1578d0 0x7f794c14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f795197e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 0x7f794c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f795197e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c151800 con 0x7f794c1578d0 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f795197e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c150f10 con 0x7f794c157ca0 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f795197e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c1511b0 con 0x7f794c06d120 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f79427fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c1578d0 0x7f794c14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f79427fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c1578d0 0x7f794c14d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47906/0 (socket says 172.21.15.81:47906) 2023-10-06T02:46:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f79427fc700 1 -- 172.21.15.81:0/1702207406 learned_addr learned my addr 172.21.15.81:0/1702207406 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f794b7fe700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 0x7f794c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f794affd700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f794c06d120 0x7f794c14ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f79427fc700 1 -- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f794c06d120 msgr2=0x7f794c14ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f79427fc700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f794c06d120 0x7f794c14ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f79427fc700 1 -- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 msgr2=0x7f794c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f79427fc700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 0x7f794c153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f79427fc700 1 -- 172.21.15.81:0/1702207406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7934009420 con 0x7f794c1578d0 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f794b7fe700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 0x7f794c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.376+0000 7f79427fc700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c1578d0 0x7f794c14d080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7934013000 tx=0x7f7934017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.377+0000 7f79437fe700 1 -- 172.21.15.81:0/1702207406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793401f070 con 0x7f794c1578d0 2023-10-06T02:46:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.377+0000 7f79437fe700 1 -- 172.21.15.81:0/1702207406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934000c90 con 0x7f794c1578d0 2023-10-06T02:46:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.377+0000 7f79437fe700 1 -- 172.21.15.81:0/1702207406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934025420 con 0x7f794c1578d0 2023-10-06T02:46:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.377+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c151490 con 0x7f794c1578d0 2023-10-06T02:46:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.377+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c14f1d0 con 0x7f794c1578d0 2023-10-06T02:46:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.377+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c067ac0 con 0x7f794c1578d0 2023-10-06T02:46:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.378+0000 7f79437fe700 1 -- 172.21.15.81:0/1702207406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7934023070 con 0x7f794c1578d0 2023-10-06T02:46:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.378+0000 7f79437fe700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f792c066f30 0x7f792c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.378+0000 7f79437fe700 1 -- 172.21.15.81:0/1702207406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f79340859c0 con 0x7f794c1578d0 2023-10-06T02:46:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.378+0000 7f794affd700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f792c066f30 0x7f792c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.379+0000 7f794affd700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f792c066f30 0x7f792c0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f793c003870 tx=0x7f793c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.383+0000 7f79437fe700 1 -- 172.21.15.81:0/1702207406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7934052ad0 con 0x7f794c1578d0 2023-10-06T02:46:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.570+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f794c0d0450 con 0x7f794c1578d0 2023-10-06T02:46:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.570+0000 7f79437fe700 1 -- 172.21.15.81:0/1702207406 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79340150a0 con 0x7f794c1578d0 2023-10-06T02:46:23.572 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f792c066f30 msgr2=0x7f792c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f792c066f30 0x7f792c0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f793c003870 tx=0x7f793c009040 comp rx=0 tx=0).stop 2023-10-06T02:46:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c1578d0 msgr2=0x7f794c14d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c1578d0 0x7f794c14d080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7934013000 tx=0x7f7934017000 comp rx=0 tx=0).stop 2023-10-06T02:46:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 shutdown_connections 2023-10-06T02:46:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f792c066f30 0x7f792c0693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f794c157ca0 0x7f794c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f794c06d120 0x7f794c14ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 --2- 172.21.15.81:0/1702207406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c1578d0 0x7f794c14d080 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 >> 172.21.15.81:0/1702207406 conn(0x7f794c06bb90 msgr2=0x7f794c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:23.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 shutdown_connections 2023-10-06T02:46:23.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.572+0000 7f795197e700 1 -- 172.21.15.81:0/1702207406 wait complete. 2023-10-06T02:46:23.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.701+0000 7f3516abf700 1 Processor -- start 2023-10-06T02:46:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.701+0000 7f3516abf700 1 -- start start 2023-10-06T02:46:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.702+0000 7f3516abf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35101569e0 0x7f35100b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.702+0000 7f3516abf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3510156db0 0x7f351006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.702+0000 7f3516abf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35100b2290 con 0x7f35100b1d10 2023-10-06T02:46:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.702+0000 7f3516abf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3510157c00 con 0x7f3510156db0 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.702+0000 7f3516abf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35101572d0 con 0x7f35101569e0 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.702+0000 7f351505c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f35100b1d10 0x7f351015a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50296/0 (socket says 172.21.15.81:50296) 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.702+0000 7f351505c700 1 -- 172.21.15.81:0/2729635072 learned_addr learned my addr 172.21.15.81:0/2729635072 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f351485b700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35101569e0 0x7f35100b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f3507fff700 1 --2- 172.21.15.81:0/2729635072 >> v2:172.21.15.83:3300/0 conn(0x7f3510156db0 0x7f351006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051183289 0 0) 0x7f35100b2290 con 0x7f35100b1d10 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34f8003570 con 0x7f35100b1d10 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 176195645 0 0) 0x7f34f8003570 con 0x7f35100b1d10 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35101569e0 msgr2=0x7f35100b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35101569e0 0x7f35100b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 >> v2:172.21.15.83:3300/0 conn(0x7f3510156db0 msgr2=0x7f351006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 --2- 172.21.15.81:0/2729635072 >> v2:172.21.15.83:3300/0 conn(0x7f3510156db0 0x7f351006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35101575b0 con 0x7f35100b1d10 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f3508001470 con 0x7f35100b1d10 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 >> v1:172.21.15.81:6789/0 conn(0x7f35100b1d10 legacy=0x7f351015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35101569e0 0x7f34f8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34f8003fe0 0x7f34f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f8004d50 0x7f34f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3510157c00 con 0x7f34f8004d50 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101572d0 con 0x7f34f8003fe0 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f800ba90 con 0x7f35101569e0 2023-10-06T02:46:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f351505c700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f8004d50 0x7f34f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f3507fff700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34f8003fe0 0x7f34f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f351485b700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35101569e0 0x7f34f8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f351505c700 1 -- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35101569e0 msgr2=0x7f34f8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f351505c700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35101569e0 0x7f34f8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f351505c700 1 -- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34f8003fe0 msgr2=0x7f34f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f351505c700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34f8003fe0 0x7f34f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f351505c700 1 -- 172.21.15.81:0/2729635072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8003570 con 0x7f34f8004d50 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.703+0000 7f351505c700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f8004d50 0x7f34f80051c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f350800c3c0 tx=0x7f3508001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1f7dd87281e349 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350800cc30 con 0x7f34f8004d50 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350800cdb0 con 0x7f34f8004d50 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f35077fe700 1 -- 172.21.15.81:0/2729635072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508005b70 con 0x7f34f8004d50 2023-10-06T02:46:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f3516abf700 1 -- 172.21.15.81:0/2729635072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f8004d50 msgr2=0x7f34f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f3516abf700 1 --2- 172.21.15.81:0/2729635072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f8004d50 0x7f34f80051c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f350800c3c0 tx=0x7f3508001e90 comp rx=0 tx=0).stop 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f351505c700 1 -- 172.21.15.81:0/2729635072 reap_dead start 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f3516abf700 1 -- 172.21.15.81:0/2729635072 shutdown_connections 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f3516abf700 1 -- 172.21.15.81:0/2729635072 >> 172.21.15.81:0/2729635072 conn(0x7f351006cca0 msgr2=0x7f351006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f3516abf700 1 -- 172.21.15.81:0/2729635072 shutdown_connections 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.704+0000 7f3516abf700 1 -- 172.21.15.81:0/2729635072 wait complete. 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.705+0000 7f3516abf700 1 Processor -- start 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.705+0000 7f3516abf700 1 -- start start 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3516abf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35100afcc0 0x7f35100c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3516abf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35100b0090 0x7f351006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3516abf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f351006c0d0 0x7f35100c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3516abf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351006c570 con 0x7f35100b0090 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3516abf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101696d0 con 0x7f351006c0d0 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3516abf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35100c7dd0 con 0x7f35100afcc0 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3507fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35100b0090 0x7f351006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3507fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35100b0090 0x7f351006bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47926/0 (socket says 172.21.15.81:47926) 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3507fff700 1 -- 172.21.15.81:0/1689225144 learned_addr learned my addr 172.21.15.81:0/1689225144 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f351505c700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f351006c0d0 0x7f35100c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f351485b700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35100afcc0 0x7f35100c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3507fff700 1 -- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35100afcc0 msgr2=0x7f35100c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3507fff700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35100afcc0 0x7f35100c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3507fff700 1 -- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f351006c0d0 msgr2=0x7f35100c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3507fff700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f351006c0d0 0x7f35100c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f3507fff700 1 -- 172.21.15.81:0/1689225144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510168ac0 con 0x7f35100b0090 2023-10-06T02:46:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.706+0000 7f351485b700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35100afcc0 0x7f35100c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.707+0000 7f3507fff700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35100b0090 0x7f351006bb90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3500009fd0 tx=0x7f35000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.707+0000 7f3504ff9700 1 -- 172.21.15.81:0/1689225144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000f940 con 0x7f35100b0090 2023-10-06T02:46:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.707+0000 7f3504ff9700 1 -- 172.21.15.81:0/1689225144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000faa0 con 0x7f35100b0090 2023-10-06T02:46:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.707+0000 7f3504ff9700 1 -- 172.21.15.81:0/1689225144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000fe20 con 0x7f35100b0090 2023-10-06T02:46:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.707+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3510168da0 con 0x7f35100b0090 2023-10-06T02:46:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.707+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3510169360 con 0x7f35100b0090 2023-10-06T02:46:23.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.708+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3510068900 con 0x7f35100b0090 2023-10-06T02:46:23.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.708+0000 7f3504ff9700 1 -- 172.21.15.81:0/1689225144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3500014650 con 0x7f35100b0090 2023-10-06T02:46:23.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.708+0000 7f3504ff9700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34fc066f30 0x7f34fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:23.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.708+0000 7f3504ff9700 1 -- 172.21.15.81:0/1689225144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3500018030 con 0x7f35100b0090 2023-10-06T02:46:23.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.709+0000 7f351485b700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34fc066f30 0x7f34fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:23.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.709+0000 7f351485b700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34fc066f30 0x7f34fc0693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f350c009fd0 tx=0x7f350c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:23.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.713+0000 7f3504ff9700 1 -- 172.21.15.81:0/1689225144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3500052140 con 0x7f35100b0090 2023-10-06T02:46:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.897+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3510157890 con 0x7f35100b0090 2023-10-06T02:46:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.897+0000 7f3504ff9700 1 -- 172.21.15.81:0/1689225144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35000220a0 con 0x7f35100b0090 2023-10-06T02:46:23.899 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34fc066f30 msgr2=0x7f34fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34fc066f30 0x7f34fc0693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f350c009fd0 tx=0x7f350c00b040 comp rx=0 tx=0).stop 2023-10-06T02:46:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35100b0090 msgr2=0x7f351006bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35100b0090 0x7f351006bb90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3500009fd0 tx=0x7f35000091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 shutdown_connections 2023-10-06T02:46:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34fc066f30 0x7f34fc0693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f351006c0d0 0x7f35100c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35100afcc0 0x7f35100c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 --2- 172.21.15.81:0/1689225144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35100b0090 0x7f351006bb90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 >> 172.21.15.81:0/1689225144 conn(0x7f351006cca0 msgr2=0x7f351006a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.899+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 shutdown_connections 2023-10-06T02:46:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:23.900+0000 7f3516abf700 1 -- 172.21.15.81:0/1689225144 wait complete. 2023-10-06T02:46:23.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:46:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.029+0000 7f71ca676700 1 Processor -- start 2023-10-06T02:46:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.029+0000 7f71ca676700 1 -- start start 2023-10-06T02:46:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71ca676700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71c415daa0 0x7f71c415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71ca676700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 0x7f71c4159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71ca676700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c406d350 con 0x7f71c40cb2a0 2023-10-06T02:46:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71ca676700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40c9ac0 con 0x7f71c415daa0 2023-10-06T02:46:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71ca676700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c415e3b0 con 0x7f71c40cae00 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71c415daa0 0x7f71c415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c8c13700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f71c40cb2a0 0x7f71c4159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50308/0 (socket says 172.21.15.81:50308) 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71c415daa0 0x7f71c415de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47930/0 (socket says 172.21.15.81:47930) 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c8c13700 1 -- 172.21.15.81:0/23261656 learned_addr learned my addr 172.21.15.81:0/23261656 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c37fe700 1 --2- 172.21.15.81:0/23261656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 0x7f71c4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c3fff700 1 -- 172.21.15.81:0/23261656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 msgr2=0x7f71c4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c3fff700 1 --2- 172.21.15.81:0/23261656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 0x7f71c4159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c3fff700 1 -- 172.21.15.81:0/23261656 >> v1:172.21.15.81:6789/0 conn(0x7f71c40cb2a0 legacy=0x7f71c4159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c3fff700 1 -- 172.21.15.81:0/23261656 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c406c740 con 0x7f71c415daa0 2023-10-06T02:46:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.030+0000 7f71c2ffd700 1 -- 172.21.15.81:0/23261656 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288073188 0 0) 0x7f71c406d350 con 0x7f71c40cb2a0 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71c3fff700 1 --2- 172.21.15.81:0/23261656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c415daa0 0x7f71c415de70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71b40098e0 tx=0x7f71b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37c0d64fcb9e734 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71c2ffd700 1 -- 172.21.15.81:0/23261656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400b640 con 0x7f71c415daa0 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71c2ffd700 1 -- 172.21.15.81:0/23261656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b400b7a0 con 0x7f71c415daa0 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71c2ffd700 1 -- 172.21.15.81:0/23261656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400bb40 con 0x7f71c415daa0 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71ca676700 1 -- 172.21.15.81:0/23261656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c415daa0 msgr2=0x7f71c415de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71ca676700 1 --2- 172.21.15.81:0/23261656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c415daa0 0x7f71c415de70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71b40098e0 tx=0x7f71b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71ca676700 1 -- 172.21.15.81:0/23261656 shutdown_connections 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71ca676700 1 --2- 172.21.15.81:0/23261656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c415daa0 0x7f71c415de70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71ca676700 1 --2- 172.21.15.81:0/23261656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 0x7f71c4159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71ca676700 1 -- 172.21.15.81:0/23261656 >> 172.21.15.81:0/23261656 conn(0x7f71c40c9ca0 msgr2=0x7f71c40ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71ca676700 1 -- 172.21.15.81:0/23261656 shutdown_connections 2023-10-06T02:46:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.031+0000 7f71ca676700 1 -- 172.21.15.81:0/23261656 wait complete. 2023-10-06T02:46:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.032+0000 7f71ca676700 1 Processor -- start 2023-10-06T02:46:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71ca676700 1 -- start start 2023-10-06T02:46:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71ca676700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 0x7f71c4158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71ca676700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c40cb2a0 0x7f71c40c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71ca676700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c415daa0 0x7f71c40692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71ca676700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c41585d0 con 0x7f71c40cb2a0 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71ca676700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c416a650 con 0x7f71c415daa0 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71ca676700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c416a930 con 0x7f71c40cae00 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c40cb2a0 0x7f71c40c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c40cb2a0 0x7f71c40c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47936/0 (socket says 172.21.15.81:47936) 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71c37fe700 1 -- 172.21.15.81:0/689481208 learned_addr learned my addr 172.21.15.81:0/689481208 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71c3fff700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 0x7f71c4158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.033+0000 7f71c8c13700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c415daa0 0x7f71c40692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71c37fe700 1 -- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 msgr2=0x7f71c4158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71c37fe700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 0x7f71c4158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71c37fe700 1 -- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c415daa0 msgr2=0x7f71c40692c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71c37fe700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c415daa0 0x7f71c40692c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71c37fe700 1 -- 172.21.15.81:0/689481208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b4009420 con 0x7f71c40cb2a0 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71c37fe700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c40cb2a0 0x7f71c40c6ae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71b800ec80 tx=0x7f71b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71abfff700 1 -- 172.21.15.81:0/689481208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b800c850 con 0x7f71c40cb2a0 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71abfff700 1 -- 172.21.15.81:0/689481208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b800c9b0 con 0x7f71c40cb2a0 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71abfff700 1 -- 172.21.15.81:0/689481208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b800cd50 con 0x7f71c40cb2a0 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c416ac10 con 0x7f71c40cb2a0 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.034+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40c7020 con 0x7f71c40cb2a0 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.035+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4068080 con 0x7f71c40cb2a0 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.035+0000 7f71abfff700 1 -- 172.21.15.81:0/689481208 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71b8013680 con 0x7f71c40cb2a0 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.035+0000 7f71abfff700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71b0066f60 0x7f71b0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.036+0000 7f71abfff700 1 -- 172.21.15.81:0/689481208 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71b8084870 con 0x7f71c40cb2a0 2023-10-06T02:46:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.036+0000 7f71c3fff700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71b0066f60 0x7f71b0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.036+0000 7f71c3fff700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71b0066f60 0x7f71b0069410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71b40093f0 tx=0x7f71b4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.040+0000 7f71abfff700 1 -- 172.21.15.81:0/689481208 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71b8051980 con 0x7f71c40cb2a0 2023-10-06T02:46:24.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.220+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71c406b240 con 0x7f71c40cb2a0 2023-10-06T02:46:24.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.220+0000 7f71abfff700 1 -- 172.21.15.81:0/689481208 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71b8054fa0 con 0x7f71c40cb2a0 2023-10-06T02:46:24.222 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71b0066f60 msgr2=0x7f71b0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71b0066f60 0x7f71b0069410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71b40093f0 tx=0x7f71b4017000 comp rx=0 tx=0).stop 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c40cb2a0 msgr2=0x7f71c40c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c40cb2a0 0x7f71c40c6ae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71b800ec80 tx=0x7f71b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 shutdown_connections 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71b0066f60 0x7f71b0069410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c415daa0 0x7f71c40692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c40cae00 0x7f71c4158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 --2- 172.21.15.81:0/689481208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c40cb2a0 0x7f71c40c6ae0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 >> 172.21.15.81:0/689481208 conn(0x7f71c40c9ca0 msgr2=0x7f71c406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:24.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 shutdown_connections 2023-10-06T02:46:24.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.222+0000 7f71ca676700 1 -- 172.21.15.81:0/689481208 wait complete. 2023-10-06T02:46:24.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.350+0000 7fb777183700 1 Processor -- start 2023-10-06T02:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.351+0000 7fb777183700 1 -- start start 2023-10-06T02:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.351+0000 7fb777183700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb770157a60 0x7fb77015b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.351+0000 7fb777183700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb77006c190 0x7fb7700b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.351+0000 7fb777183700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb7700b3170 0x7fb77006a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.351+0000 7fb777183700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7700b35d0 con 0x7fb770157a60 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.351+0000 7fb777183700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb770069d10 con 0x7fb7700b3170 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.351+0000 7fb777183700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77015c130 con 0x7fb77006c190 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb774f1f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb770157a60 0x7fb77015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb774f1f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb770157a60 0x7fb77015b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47948/0 (socket says 172.21.15.81:47948) 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb774f1f700 1 -- 172.21.15.81:0/2722223239 learned_addr learned my addr 172.21.15.81:0/2722223239 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb775720700 1 --2- 172.21.15.81:0/2722223239 >> v2:172.21.15.83:3300/0 conn(0x7fb7700b3170 0x7fb77006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb76ffff700 1 --2- 172.21.15.81:0/2722223239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb77006c190 0x7fb7700b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb774f1f700 1 -- 172.21.15.81:0/2722223239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb77006c190 msgr2=0x7fb7700b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb774f1f700 1 --2- 172.21.15.81:0/2722223239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb77006c190 0x7fb7700b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb774f1f700 1 -- 172.21.15.81:0/2722223239 >> v2:172.21.15.83:3300/0 conn(0x7fb7700b3170 msgr2=0x7fb77006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb774f1f700 1 --2- 172.21.15.81:0/2722223239 >> v2:172.21.15.83:3300/0 conn(0x7fb7700b3170 0x7fb77006a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb774f1f700 1 -- 172.21.15.81:0/2722223239 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77015c410 con 0x7fb770157a60 2023-10-06T02:46:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb76ffff700 1 --2- 172.21.15.81:0/2722223239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb77006c190 0x7fb7700b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb774f1f700 1 --2- 172.21.15.81:0/2722223239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770157a60 0x7fb77015b8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ca270 tx=0x7fb764009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c874d593bbb252 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb76f7fe700 1 -- 172.21.15.81:0/2722223239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764009e70 con 0x7fb770157a60 2023-10-06T02:46:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb76f7fe700 1 -- 172.21.15.81:0/2722223239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76400b860 con 0x7fb770157a60 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.352+0000 7fb76f7fe700 1 -- 172.21.15.81:0/2722223239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76400bc00 con 0x7fb770157a60 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.353+0000 7fb777183700 1 -- 172.21.15.81:0/2722223239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770157a60 msgr2=0x7fb77015b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.353+0000 7fb777183700 1 --2- 172.21.15.81:0/2722223239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770157a60 0x7fb77015b8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ca270 tx=0x7fb764009250 comp rx=0 tx=0).stop 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.353+0000 7fb777183700 1 -- 172.21.15.81:0/2722223239 shutdown_connections 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.353+0000 7fb777183700 1 --2- 172.21.15.81:0/2722223239 >> v2:172.21.15.83:3300/0 conn(0x7fb7700b3170 0x7fb77006a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.353+0000 7fb777183700 1 --2- 172.21.15.81:0/2722223239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770157a60 0x7fb77015b8e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.353+0000 7fb777183700 1 --2- 172.21.15.81:0/2722223239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb77006c190 0x7fb7700b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.353+0000 7fb777183700 1 -- 172.21.15.81:0/2722223239 >> 172.21.15.81:0/2722223239 conn(0x7fb77006cca0 msgr2=0x7fb77006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.353+0000 7fb777183700 1 -- 172.21.15.81:0/2722223239 shutdown_connections 2023-10-06T02:46:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.353+0000 7fb777183700 1 -- 172.21.15.81:0/2722223239 wait complete. 2023-10-06T02:46:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.354+0000 7fb777183700 1 Processor -- start 2023-10-06T02:46:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.354+0000 7fb777183700 1 -- start start 2023-10-06T02:46:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb777183700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb77006c190 0x7fb7700ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb777183700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700b3170 0x7fb7700af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb777183700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb770157a60 0x7fb7700cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb777183700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77014f0a0 con 0x7fb7700b3170 2023-10-06T02:46:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb777183700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700acad0 con 0x7fb77006c190 2023-10-06T02:46:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb777183700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700b13f0 con 0x7fb770157a60 2023-10-06T02:46:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700b3170 0x7fb7700af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700b3170 0x7fb7700af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47956/0 (socket says 172.21.15.81:47956) 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76ffff700 1 -- 172.21.15.81:0/2223394454 learned_addr learned my addr 172.21.15.81:0/2223394454 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb774f1f700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb77006c190 0x7fb7700ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb775720700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb770157a60 0x7fb7700cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76ffff700 1 -- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb770157a60 msgr2=0x7fb7700cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76ffff700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb770157a60 0x7fb7700cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76ffff700 1 -- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb77006c190 msgr2=0x7fb7700ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76ffff700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb77006c190 0x7fb7700ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76ffff700 1 -- 172.21.15.81:0/2223394454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640094f0 con 0x7fb7700b3170 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb774f1f700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb77006c190 0x7fb7700ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76ffff700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700b3170 0x7fb7700af2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00e8d0 tx=0x7fb75c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76cff9700 1 -- 172.21.15.81:0/2223394454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00ee70 con 0x7fb7700b3170 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76cff9700 1 -- 172.21.15.81:0/2223394454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c00c580 con 0x7fb7700b3170 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7700af830 con 0x7fb7700b3170 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb76cff9700 1 -- 172.21.15.81:0/2223394454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00c920 con 0x7fb7700b3170 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.355+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7700b0ac0 con 0x7fb7700b3170 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.356+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700b15a0 con 0x7fb7700b3170 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.357+0000 7fb76cff9700 1 -- 172.21.15.81:0/2223394454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb75c00cd10 con 0x7fb7700b3170 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.357+0000 7fb76cff9700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb754066f30 0x7fb7540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.357+0000 7fb76cff9700 1 -- 172.21.15.81:0/2223394454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb75c0843f0 con 0x7fb7700b3170 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.357+0000 7fb774f1f700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb754066f30 0x7fb7540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.358+0000 7fb774f1f700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb754066f30 0x7fb7540693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ca270 tx=0x7fb764017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:24.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.361+0000 7fb76cff9700 1 -- 172.21.15.81:0/2223394454 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7700b15a0 con 0x7fb7700b3170 2023-10-06T02:46:24.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.542+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7700b1560 con 0x7fb7700b3170 2023-10-06T02:46:24.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.542+0000 7fb76cff9700 1 -- 172.21.15.81:0/2223394454 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb75c051500 con 0x7fb7700b3170 2023-10-06T02:46:24.544 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:46:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb754066f30 msgr2=0x7fb7540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb754066f30 0x7fb7540693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ca270 tx=0x7fb764017000 comp rx=0 tx=0).stop 2023-10-06T02:46:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700b3170 msgr2=0x7fb7700af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700b3170 0x7fb7700af2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00e8d0 tx=0x7fb75c008040 comp rx=0 tx=0).stop 2023-10-06T02:46:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 shutdown_connections 2023-10-06T02:46:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb770157a60 0x7fb7700cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb754066f30 0x7fb7540693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb77006c190 0x7fb7700ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 --2- 172.21.15.81:0/2223394454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700b3170 0x7fb7700af2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 >> 172.21.15.81:0/2223394454 conn(0x7fb77006cca0 msgr2=0x7fb7701562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 shutdown_connections 2023-10-06T02:46:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.544+0000 7fb777183700 1 -- 172.21.15.81:0/2223394454 wait complete. 2023-10-06T02:46:24.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:46:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.673+0000 7f1c05e0c700 1 Processor -- start 2023-10-06T02:46:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.673+0000 7f1c05e0c700 1 -- start start 2023-10-06T02:46:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.674+0000 7f1c05e0c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1c00159b40 0x7f1c000cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.674+0000 7f1c05e0c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c000cee10 con 0x7f1c00068e90 2023-10-06T02:46:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.674+0000 7f1c05e0c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c000cd040 con 0x7f1c00159f10 2023-10-06T02:46:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.674+0000 7f1c05e0c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c000cd320 con 0x7f1c00159b40 2023-10-06T02:46:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.674+0000 7f1c0560b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c00068e90 0x7f1c000cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50310/0 (socket says 172.21.15.81:50310) 2023-10-06T02:46:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.674+0000 7f1c0560b700 1 -- 172.21.15.81:0/526162133 learned_addr learned my addr 172.21.15.81:0/526162133 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.674+0000 7f1c04e0a700 1 --2- 172.21.15.81:0/526162133 >> v2:172.21.15.83:3300/0 conn(0x7f1c00159b40 0x7f1c000cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.674+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540719395 0 0) 0x7f1c000cee10 con 0x7f1c00068e90 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.674+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be8003570 con 0x7f1c00068e90 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2226711273 0 0) 0x7f1be8003570 con 0x7f1c00068e90 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 >> v2:172.21.15.83:3300/0 conn(0x7f1c00159b40 msgr2=0x7f1c000cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 --2- 172.21.15.81:0/526162133 >> v2:172.21.15.83:3300/0 conn(0x7f1c00159b40 0x7f1c000cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 >> v1:172.21.15.83:6789/0 conn(0x7f1c00159f10 legacy=0x7f1c00068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c000ce7c0 con 0x7f1c00068e90 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f1bf80017f0 con 0x7f1c00068e90 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 >> v1:172.21.15.81:6789/0 conn(0x7f1c00068e90 legacy=0x7f1c000cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be8003a60 0x7f1be8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1be8004810 0x7f1be8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1be800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000cd320 con 0x7f1be80051c0 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be800c0d0 con 0x7f1be8003a60 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be800c290 con 0x7f1be8004810 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1c0560b700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1be800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1c04e0a700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be8003a60 0x7f1be8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf7fff700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1be8004810 0x7f1be8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1c0560b700 1 -- 172.21.15.81:0/526162133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1be8004810 msgr2=0x7f1be8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1c0560b700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1be8004810 0x7f1be8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1c0560b700 1 -- 172.21.15.81:0/526162133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be8003a60 msgr2=0x7f1be8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1c0560b700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be8003a60 0x7f1be8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1c0560b700 1 -- 172.21.15.81:0/526162133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8003570 con 0x7f1be80051c0 2023-10-06T02:46:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1c0560b700 1 -- 172.21.15.81:0/526162133 reap_dead start 2023-10-06T02:46:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1c0560b700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1be800ba60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800a900 tx=0x7f1bf80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deb52d7316f05a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80070d0 con 0x7f1be80051c0 2023-10-06T02:46:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf8007230 con 0x7f1be80051c0 2023-10-06T02:46:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.675+0000 7f1bf77fe700 1 -- 172.21.15.81:0/526162133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80075d0 con 0x7f1be80051c0 2023-10-06T02:46:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.676+0000 7f1c05e0c700 1 -- 172.21.15.81:0/526162133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 msgr2=0x7f1be800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.676+0000 7f1c05e0c700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1be800ba60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800a900 tx=0x7f1bf80021d0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.676+0000 7f1c05e0c700 1 -- 172.21.15.81:0/526162133 shutdown_connections 2023-10-06T02:46:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.676+0000 7f1c05e0c700 1 --2- 172.21.15.81:0/526162133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1be800ba60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.676+0000 7f1c05e0c700 1 -- 172.21.15.81:0/526162133 >> 172.21.15.81:0/526162133 conn(0x7f1c000cd660 msgr2=0x7f1c000cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.676+0000 7f1c05e0c700 1 -- 172.21.15.81:0/526162133 shutdown_connections 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.676+0000 7f1c05e0c700 1 -- 172.21.15.81:0/526162133 wait complete. 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.677+0000 7f1c05e0c700 1 Processor -- start 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.677+0000 7f1c05e0c700 1 -- start start 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c05e0c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1c0015f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c05e0c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0016acd0 0x7f1c00169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c05e0c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1c001609a0 0x7f1c0006da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c05e0c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0015d660 con 0x7f1be80051c0 2023-10-06T02:46:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c05e0c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00160510 con 0x7f1c0016acd0 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c05e0c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0015f900 con 0x7f1c001609a0 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c04e0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1c0015f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c04e0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1c0015f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47978/0 (socket says 172.21.15.81:47978) 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c04e0a700 1 -- 172.21.15.81:0/784836929 learned_addr learned my addr 172.21.15.81:0/784836929 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1bf7fff700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0016acd0 0x7f1c00169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c0560b700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1c001609a0 0x7f1c0006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c04e0a700 1 -- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1c001609a0 msgr2=0x7f1c0006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c04e0a700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1c001609a0 0x7f1c0006da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c04e0a700 1 -- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0016acd0 msgr2=0x7f1c00169b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c04e0a700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0016acd0 0x7f1c00169b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c04e0a700 1 -- 172.21.15.81:0/784836929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0015fbe0 con 0x7f1be80051c0 2023-10-06T02:46:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.678+0000 7f1c04e0a700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1c0015f300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc006ac0 tx=0x7f1bfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.679+0000 7f1bf4ff9700 1 -- 172.21.15.81:0/784836929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00f940 con 0x7f1be80051c0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.679+0000 7f1bf4ff9700 1 -- 172.21.15.81:0/784836929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00faa0 con 0x7f1be80051c0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.679+0000 7f1bf4ff9700 1 -- 172.21.15.81:0/784836929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00fe20 con 0x7f1be80051c0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.679+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0015fec0 con 0x7f1be80051c0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.679+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0016a090 con 0x7f1be80051c0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.679+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c00063e90 con 0x7f1be80051c0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.680+0000 7f1bf4ff9700 1 -- 172.21.15.81:0/784836929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bfc014650 con 0x7f1be80051c0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.680+0000 7f1bf4ff9700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bec066f30 0x7f1bec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.680+0000 7f1bf4ff9700 1 -- 172.21.15.81:0/784836929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1bfc018030 con 0x7f1be80051c0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.681+0000 7f1bf7fff700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bec066f30 0x7f1bec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.681+0000 7f1bf7fff700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bec066f30 0x7f1bec0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c000b63a0 tx=0x7f1bf0007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:24.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.685+0000 7f1bf4ff9700 1 -- 172.21.15.81:0/784836929 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bfc052160 con 0x7f1be80051c0 2023-10-06T02:46:24.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.908+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c000ceaa0 con 0x7f1be80051c0 2023-10-06T02:46:24.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.909+0000 7f1bf4ff9700 1 -- 172.21.15.81:0/784836929 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f1bfc022090 con 0x7f1be80051c0 2023-10-06T02:46:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:24.910 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/963539092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":963539092},{"type":"v1","addr":"172.21.15.81:6833","nonce":963539092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3218202678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3218202678},{"type":"v1","addr":"172.21.15.81:6835","nonce":3218202678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/913779656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":913779656},{"type":"v1","addr":"172.21.15.83:6836","nonce":913779656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:06.874539+0000","modified":"2023-10-06T02:46:10.523436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/2378748577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2378748577},{"type":"v1","addr":"172.21.15.83:6837","nonce":2378748577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bec066f30 msgr2=0x7f1bec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bec066f30 0x7f1bec0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c000b63a0 tx=0x7f1bf0007d30 comp rx=0 tx=0).stop 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 msgr2=0x7f1c0015f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1c0015f300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc006ac0 tx=0x7f1bfc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 shutdown_connections 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1c001609a0 0x7f1c0006da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80051c0 0x7f1c0015f300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bec066f30 0x7f1bec0693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 --2- 172.21.15.81:0/784836929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c0016acd0 0x7f1c00169b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 >> 172.21.15.81:0/784836929 conn(0x7f1c000cd660 msgr2=0x7f1c000b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 shutdown_connections 2023-10-06T02:46:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:24.911+0000 7f1c05e0c700 1 -- 172.21.15.81:0/784836929 wait complete. 2023-10-06T02:46:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-06T02:46:24.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:25.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.038+0000 7fb648a9c700 1 Processor -- start 2023-10-06T02:46:25.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.038+0000 7fb648a9c700 1 -- start start 2023-10-06T02:46:25.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb648a9c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb6441578d0 0x7fb6440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb648a9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb644157ca0 0x7fb64415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb648a9c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440d07c0 con 0x7fb64406d120 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb648a9c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6440cfbb0 con 0x7fb644157ca0 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb648a9c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6440cfe90 con 0x7fb6441578d0 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb63bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb644157ca0 0x7fb64415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb642d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb64406d120 0x7fb64406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50322/0 (socket says 172.21.15.81:50322) 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb642d9d700 1 -- 172.21.15.81:0/3920856147 learned_addr learned my addr 172.21.15.81:0/3920856147 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb64259c700 1 --2- 172.21.15.81:0/3920856147 >> v2:172.21.15.83:3300/0 conn(0x7fb6441578d0 0x7fb6440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb63bfff700 1 -- 172.21.15.81:0/3920856147 >> v2:172.21.15.83:3300/0 conn(0x7fb6441578d0 msgr2=0x7fb6440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb63bfff700 1 --2- 172.21.15.81:0/3920856147 >> v2:172.21.15.83:3300/0 conn(0x7fb6441578d0 0x7fb6440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb63bfff700 1 -- 172.21.15.81:0/3920856147 >> v1:172.21.15.81:6789/0 conn(0x7fb64406d120 legacy=0x7fb64406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb641d9b700 1 -- 172.21.15.81:0/3920856147 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232419313 0 0) 0x7fb6440d07c0 con 0x7fb64406d120 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb63bfff700 1 -- 172.21.15.81:0/3920856147 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440d0170 con 0x7fb644157ca0 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb63bfff700 1 --2- 172.21.15.81:0/3920856147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb644157ca0 0x7fb64415af00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6440646b0 tx=0x7fb62c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01b86edde04412a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb641d9b700 1 -- 172.21.15.81:0/3920856147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00b6b0 con 0x7fb644157ca0 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb641d9b700 1 -- 172.21.15.81:0/3920856147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c00b810 con 0x7fb644157ca0 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.039+0000 7fb641d9b700 1 -- 172.21.15.81:0/3920856147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00bbb0 con 0x7fb644157ca0 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.040+0000 7fb648a9c700 1 -- 172.21.15.81:0/3920856147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb644157ca0 msgr2=0x7fb64415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.040+0000 7fb648a9c700 1 --2- 172.21.15.81:0/3920856147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb644157ca0 0x7fb64415af00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6440646b0 tx=0x7fb62c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.040+0000 7fb648a9c700 1 -- 172.21.15.81:0/3920856147 shutdown_connections 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.040+0000 7fb648a9c700 1 --2- 172.21.15.81:0/3920856147 >> v2:172.21.15.83:3300/0 conn(0x7fb6441578d0 0x7fb6440cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.040+0000 7fb648a9c700 1 --2- 172.21.15.81:0/3920856147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb644157ca0 0x7fb64415af00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.040+0000 7fb648a9c700 1 -- 172.21.15.81:0/3920856147 >> 172.21.15.81:0/3920856147 conn(0x7fb64406bb90 msgr2=0x7fb64406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:25.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.040+0000 7fb648a9c700 1 -- 172.21.15.81:0/3920856147 shutdown_connections 2023-10-06T02:46:25.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.040+0000 7fb648a9c700 1 -- 172.21.15.81:0/3920856147 wait complete. 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.041+0000 7fb648a9c700 1 Processor -- start 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.041+0000 7fb648a9c700 1 -- start start 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb648a9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64406d120 0x7fb6440c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb648a9c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6441578d0 0x7fb6440c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb648a9c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb644157ca0 0x7fb6441433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb648a9c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440c7560 con 0x7fb64406d120 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb648a9c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440c6060 con 0x7fb6441578d0 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb648a9c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6441438f0 con 0x7fb644157ca0 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb64259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64406d120 0x7fb6440c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb64259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64406d120 0x7fb6440c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48000/0 (socket says 172.21.15.81:48000) 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb64259c700 1 -- 172.21.15.81:0/2425390261 learned_addr learned my addr 172.21.15.81:0/2425390261 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb64259c700 1 -- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb644157ca0 msgr2=0x7fb6441433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb64259c700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb644157ca0 0x7fb6441433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb64259c700 1 -- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6441578d0 msgr2=0x7fb6440c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb64259c700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6441578d0 0x7fb6440c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb64259c700 1 -- 172.21.15.81:0/2425390261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c009420 con 0x7fb64406d120 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb64259c700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64406d120 0x7fb6440c6370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d8c0 tx=0x7fb634008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb63a7fc700 1 -- 172.21.15.81:0/2425390261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63400de60 con 0x7fb64406d120 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb63a7fc700 1 -- 172.21.15.81:0/2425390261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63400b780 con 0x7fb64406d120 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6440c6950 con 0x7fb64406d120 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb63a7fc700 1 -- 172.21.15.81:0/2425390261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63400bb20 con 0x7fb64406d120 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.042+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440c6f10 con 0x7fb64406d120 2023-10-06T02:46:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.043+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb644067ac0 con 0x7fb64406d120 2023-10-06T02:46:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.044+0000 7fb63a7fc700 1 -- 172.21.15.81:0/2425390261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb63401e460 con 0x7fb64406d120 2023-10-06T02:46:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.044+0000 7fb63a7fc700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb624066f30 0x7fb6240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.044+0000 7fb63a7fc700 1 -- 172.21.15.81:0/2425390261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb634084d30 con 0x7fb64406d120 2023-10-06T02:46:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.044+0000 7fb63bfff700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb624066f30 0x7fb6240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.045+0000 7fb63bfff700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb624066f30 0x7fb6240693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6441580c0 tx=0x7fb62c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.048+0000 7fb63a7fc700 1 -- 172.21.15.81:0/2425390261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb634051e40 con 0x7fb64406d120 2023-10-06T02:46:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.231+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6440d0450 con 0x7fb64406d120 2023-10-06T02:46:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.232+0000 7fb63a7fc700 1 -- 172.21.15.81:0/2425390261 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fb634055460 con 0x7fb64406d120 2023-10-06T02:46:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:25.234 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:25.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb624066f30 msgr2=0x7fb6240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb624066f30 0x7fb6240693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6441580c0 tx=0x7fb62c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:25.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64406d120 msgr2=0x7fb6440c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64406d120 0x7fb6440c6370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d8c0 tx=0x7fb634008040 comp rx=0 tx=0).stop 2023-10-06T02:46:25.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 shutdown_connections 2023-10-06T02:46:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb644157ca0 0x7fb6441433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64406d120 0x7fb6440c6370 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb624066f30 0x7fb6240693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 --2- 172.21.15.81:0/2425390261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6441578d0 0x7fb6440c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 >> 172.21.15.81:0/2425390261 conn(0x7fb64406bb90 msgr2=0x7fb64406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 shutdown_connections 2023-10-06T02:46:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.234+0000 7fb648a9c700 1 -- 172.21.15.81:0/2425390261 wait complete. 2023-10-06T02:46:25.247 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:46:05.360665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:46:05.837671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:46:25.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.363+0000 7faf3ea1d700 1 Processor -- start 2023-10-06T02:46:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.363+0000 7faf3ea1d700 1 -- start start 2023-10-06T02:46:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3ea1d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf380b43c0 0x7faf380cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3ea1d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 0x7faf380ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3ea1d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf380cadb0 con 0x7faf380cd030 2023-10-06T02:46:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3ea1d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf380cc250 con 0x7faf380b43c0 2023-10-06T02:46:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3ea1d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf380cf000 con 0x7faf380cddd0 2023-10-06T02:46:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3da1b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf380b43c0 0x7faf380cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3da1b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf380b43c0 0x7faf380cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48006/0 (socket says 172.21.15.81:48006) 2023-10-06T02:46:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3da1b700 1 -- 172.21.15.81:0/2930813776 learned_addr learned my addr 172.21.15.81:0/2930813776 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3d21a700 1 --2- 172.21.15.81:0/2930813776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 0x7faf380ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3da1b700 1 -- 172.21.15.81:0/2930813776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 msgr2=0x7faf380ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3da1b700 1 --2- 172.21.15.81:0/2930813776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 0x7faf380ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3da1b700 1 -- 172.21.15.81:0/2930813776 >> v1:172.21.15.83:6789/0 conn(0x7faf380cd030 legacy=0x7faf3815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3da1b700 1 -- 172.21.15.81:0/2930813776 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf380cf2e0 con 0x7faf380b43c0 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3da1b700 1 --2- 172.21.15.81:0/2930813776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380b43c0 0x7faf380cc5b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faf300099b0 tx=0x7faf30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecee2b825d202064 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.364+0000 7faf3ca19700 1 -- 172.21.15.81:0/2930813776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3000b860 con 0x7faf380b43c0 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ca19700 1 -- 172.21.15.81:0/2930813776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3000b9c0 con 0x7faf380b43c0 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ca19700 1 -- 172.21.15.81:0/2930813776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3000bd60 con 0x7faf380b43c0 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ea1d700 1 -- 172.21.15.81:0/2930813776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380b43c0 msgr2=0x7faf380cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ea1d700 1 --2- 172.21.15.81:0/2930813776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380b43c0 0x7faf380cc5b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faf300099b0 tx=0x7faf30009250 comp rx=0 tx=0).stop 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ea1d700 1 -- 172.21.15.81:0/2930813776 shutdown_connections 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ea1d700 1 --2- 172.21.15.81:0/2930813776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380b43c0 0x7faf380cc5b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ea1d700 1 --2- 172.21.15.81:0/2930813776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 0x7faf380ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ea1d700 1 -- 172.21.15.81:0/2930813776 >> 172.21.15.81:0/2930813776 conn(0x7faf38068110 msgr2=0x7faf3806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ea1d700 1 -- 172.21.15.81:0/2930813776 shutdown_connections 2023-10-06T02:46:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.365+0000 7faf3ea1d700 1 -- 172.21.15.81:0/2930813776 wait complete. 2023-10-06T02:46:25.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.366+0000 7faf3ea1d700 1 Processor -- start 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.366+0000 7faf3ea1d700 1 -- start start 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3ea1d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf380b43c0 0x7faf38169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3ea1d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380cd030 0x7faf3816be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3ea1d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 0x7faf381544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3ea1d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3816c660 con 0x7faf380cd030 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3ea1d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3816c940 con 0x7faf380b43c0 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3ea1d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3815a1e0 con 0x7faf380cddd0 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3d21a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380cd030 0x7faf3816be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3d21a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380cd030 0x7faf3816be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48014/0 (socket says 172.21.15.81:48014) 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3d21a700 1 -- 172.21.15.81:0/4240185007 learned_addr learned my addr 172.21.15.81:0/4240185007 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3da1b700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf380b43c0 0x7faf38169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3e21c700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 0x7faf381544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3d21a700 1 -- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 msgr2=0x7faf381544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3d21a700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 0x7faf381544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3d21a700 1 -- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf380b43c0 msgr2=0x7faf38169400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3d21a700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf380b43c0 0x7faf38169400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3d21a700 1 -- 172.21.15.81:0/4240185007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300094f0 con 0x7faf380cd030 2023-10-06T02:46:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.367+0000 7faf3d21a700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380cd030 0x7faf3816be30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faf2c007f60 tx=0x7faf2c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.368+0000 7faf35ffb700 1 -- 172.21.15.81:0/4240185007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00eb90 con 0x7faf380cd030 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.368+0000 7faf35ffb700 1 -- 172.21.15.81:0/4240185007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00ed10 con 0x7faf380cd030 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.368+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3815a4c0 con 0x7faf380cd030 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.368+0000 7faf35ffb700 1 -- 172.21.15.81:0/4240185007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c014670 con 0x7faf380cd030 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.368+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf38154a10 con 0x7faf380cd030 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.369+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3815a6e0 con 0x7faf380cd030 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.369+0000 7faf35ffb700 1 -- 172.21.15.81:0/4240185007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf2c0149e0 con 0x7faf380cd030 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.369+0000 7faf35ffb700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.369+0000 7faf35ffb700 1 -- 172.21.15.81:0/4240185007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faf2c084d20 con 0x7faf380cd030 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.370+0000 7faf3da1b700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.370+0000 7faf3da1b700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf24066f30 0x7faf240693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf300099b0 tx=0x7faf30017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.374+0000 7faf35ffb700 1 -- 172.21.15.81:0/4240185007 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf2c051d90 con 0x7faf380cd030 2023-10-06T02:46:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.554+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf3806a470 con 0x7faf380cd030 2023-10-06T02:46:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.554+0000 7faf35ffb700 1 -- 172.21.15.81:0/4240185007 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf2c0553b0 con 0x7faf380cd030 2023-10-06T02:46:25.556 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:25.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf24066f30 msgr2=0x7faf240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf24066f30 0x7faf240693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf300099b0 tx=0x7faf30017000 comp rx=0 tx=0).stop 2023-10-06T02:46:25.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380cd030 msgr2=0x7faf3816be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380cd030 0x7faf3816be30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faf2c007f60 tx=0x7faf2c009860 comp rx=0 tx=0).stop 2023-10-06T02:46:25.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 shutdown_connections 2023-10-06T02:46:25.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf380cddd0 0x7faf381544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf380b43c0 0x7faf38169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 --2- 172.21.15.81:0/4240185007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf380cd030 0x7faf3816be30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 >> 172.21.15.81:0/4240185007 conn(0x7faf38068110 msgr2=0x7faf380b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:25.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 shutdown_connections 2023-10-06T02:46:25.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.556+0000 7faf3ea1d700 1 -- 172.21.15.81:0/4240185007 wait complete. 2023-10-06T02:46:25.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.686+0000 7fba50842700 1 Processor -- start 2023-10-06T02:46:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.686+0000 7fba50842700 1 -- start start 2023-10-06T02:46:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba50842700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fba4c1578d0 0x7fba4c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba50842700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba4c06d120 0x7fba4c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba50842700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0d07c0 con 0x7fba4c157ca0 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba50842700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4c06da50 con 0x7fba4c06d120 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba50842700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4c0cfbb0 con 0x7fba4c1578d0 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba4ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba4c06d120 0x7fba4c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba4ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba4c06d120 0x7fba4c06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48016/0 (socket says 172.21.15.81:48016) 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba49d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fba4c157ca0 0x7fba4c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50334/0 (socket says 172.21.15.81:50334) 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba4ad9d700 1 -- 172.21.15.81:0/292282512 learned_addr learned my addr 172.21.15.81:0/292282512 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.687+0000 7fba4a59c700 1 --2- 172.21.15.81:0/292282512 >> v2:172.21.15.83:3300/0 conn(0x7fba4c1578d0 0x7fba4c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4ad9d700 1 -- 172.21.15.81:0/292282512 >> v2:172.21.15.83:3300/0 conn(0x7fba4c1578d0 msgr2=0x7fba4c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4ad9d700 1 --2- 172.21.15.81:0/292282512 >> v2:172.21.15.83:3300/0 conn(0x7fba4c1578d0 0x7fba4c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4ad9d700 1 -- 172.21.15.81:0/292282512 >> v1:172.21.15.81:6789/0 conn(0x7fba4c157ca0 legacy=0x7fba4c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4ad9d700 1 -- 172.21.15.81:0/292282512 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c0cfe90 con 0x7fba4c06d120 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4959a700 1 -- 172.21.15.81:0/292282512 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253119851 0 0) 0x7fba4c0d07c0 con 0x7fba4c157ca0 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4a59c700 1 --2- 172.21.15.81:0/292282512 >> v2:172.21.15.83:3300/0 conn(0x7fba4c1578d0 0x7fba4c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4ad9d700 1 --2- 172.21.15.81:0/292282512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c06d120 0x7fba4c06d510 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0646b0 tx=0x7fba44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c122d08ca60aca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4959a700 1 -- 172.21.15.81:0/292282512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4400e070 con 0x7fba4c06d120 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4959a700 1 -- 172.21.15.81:0/292282512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4400ba50 con 0x7fba4c06d120 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba4959a700 1 -- 172.21.15.81:0/292282512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba440092e0 con 0x7fba4c06d120 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba50842700 1 -- 172.21.15.81:0/292282512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c06d120 msgr2=0x7fba4c06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.688+0000 7fba50842700 1 --2- 172.21.15.81:0/292282512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c06d120 0x7fba4c06d510 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0646b0 tx=0x7fba44009840 comp rx=0 tx=0).stop 2023-10-06T02:46:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.689+0000 7fba50842700 1 -- 172.21.15.81:0/292282512 shutdown_connections 2023-10-06T02:46:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.689+0000 7fba50842700 1 --2- 172.21.15.81:0/292282512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c06d120 0x7fba4c06d510 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.689+0000 7fba50842700 1 --2- 172.21.15.81:0/292282512 >> v2:172.21.15.83:3300/0 conn(0x7fba4c1578d0 0x7fba4c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.689+0000 7fba50842700 1 -- 172.21.15.81:0/292282512 >> 172.21.15.81:0/292282512 conn(0x7fba4c06bb90 msgr2=0x7fba4c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.689+0000 7fba50842700 1 -- 172.21.15.81:0/292282512 shutdown_connections 2023-10-06T02:46:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.689+0000 7fba50842700 1 -- 172.21.15.81:0/292282512 wait complete. 2023-10-06T02:46:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba50842700 1 Processor -- start 2023-10-06T02:46:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba50842700 1 -- start start 2023-10-06T02:46:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba50842700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c06d120 0x7fba4c1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba50842700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1578d0 0x7fba4c158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba50842700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157ca0 0x7fba4c0c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba50842700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c155170 con 0x7fba4c1578d0 2023-10-06T02:46:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba50842700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c155a10 con 0x7fba4c06d120 2023-10-06T02:46:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba50842700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c154f20 con 0x7fba4c157ca0 2023-10-06T02:46:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba49d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1578d0 0x7fba4c158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba49d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1578d0 0x7fba4c158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48026/0 (socket says 172.21.15.81:48026) 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.690+0000 7fba49d9b700 1 -- 172.21.15.81:0/2304806491 learned_addr learned my addr 172.21.15.81:0/2304806491 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba4a59c700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c06d120 0x7fba4c1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba4ad9d700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157ca0 0x7fba4c0c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba49d9b700 1 -- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157ca0 msgr2=0x7fba4c0c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba49d9b700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157ca0 0x7fba4c0c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba49d9b700 1 -- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c06d120 msgr2=0x7fba4c1549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba49d9b700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c06d120 0x7fba4c1549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba49d9b700 1 -- 172.21.15.81:0/2304806491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44009ae0 con 0x7fba4c1578d0 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba49d9b700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1578d0 0x7fba4c158e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c510 tx=0x7fba4000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba3a7fc700 1 -- 172.21.15.81:0/2304806491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba40005a70 con 0x7fba4c1578d0 2023-10-06T02:46:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba3a7fc700 1 -- 172.21.15.81:0/2304806491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba40005bf0 con 0x7fba4c1578d0 2023-10-06T02:46:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c1597f0 con 0x7fba4c1578d0 2023-10-06T02:46:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba3a7fc700 1 -- 172.21.15.81:0/2304806491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba400070d0 con 0x7fba4c1578d0 2023-10-06T02:46:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.691+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c1556a0 con 0x7fba4c1578d0 2023-10-06T02:46:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.692+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c155bc0 con 0x7fba4c1578d0 2023-10-06T02:46:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.692+0000 7fba3a7fc700 1 -- 172.21.15.81:0/2304806491 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba40007480 con 0x7fba4c1578d0 2023-10-06T02:46:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.693+0000 7fba3a7fc700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba2c066f30 0x7fba2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.693+0000 7fba3a7fc700 1 -- 172.21.15.81:0/2304806491 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fba40083a20 con 0x7fba4c1578d0 2023-10-06T02:46:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.693+0000 7fba4a59c700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba2c066f30 0x7fba2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:25.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.693+0000 7fba4a59c700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba2c066f30 0x7fba2c0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba4c15f810 tx=0x7fba3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:25.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.697+0000 7fba3a7fc700 1 -- 172.21.15.81:0/2304806491 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba4c155bc0 con 0x7fba4c1578d0 2023-10-06T02:46:25.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.880+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba4c155b80 con 0x7fba4c1578d0 2023-10-06T02:46:25.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.880+0000 7fba3a7fc700 1 -- 172.21.15.81:0/2304806491 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fba40017020 con 0x7fba4c1578d0 2023-10-06T02:46:25.882 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba2c066f30 msgr2=0x7fba2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba2c066f30 0x7fba2c0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba4c15f810 tx=0x7fba3c008040 comp rx=0 tx=0).stop 2023-10-06T02:46:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1578d0 msgr2=0x7fba4c158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1578d0 0x7fba4c158e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c510 tx=0x7fba4000c820 comp rx=0 tx=0).stop 2023-10-06T02:46:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 shutdown_connections 2023-10-06T02:46:25.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157ca0 0x7fba4c0c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba2c066f30 0x7fba2c0693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c06d120 0x7fba4c1549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 --2- 172.21.15.81:0/2304806491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1578d0 0x7fba4c158e80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:25.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 >> 172.21.15.81:0/2304806491 conn(0x7fba4c06bb90 msgr2=0x7fba4c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:25.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 shutdown_connections 2023-10-06T02:46:25.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:25.882+0000 7fba50842700 1 -- 172.21.15.81:0/2304806491 wait complete. 2023-10-06T02:46:25.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:46:26.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.011+0000 7f8d7b59e700 1 Processor -- start 2023-10-06T02:46:26.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.011+0000 7f8d7b59e700 1 -- start start 2023-10-06T02:46:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.012+0000 7f8d7b59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8d7c0d0f50 0x7f8d7c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.012+0000 7f8d7b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c06d990 con 0x7f8d7c0d0b80 2023-10-06T02:46:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.012+0000 7f8d7b59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c0cf2d0 con 0x7f8d7c06d530 2023-10-06T02:46:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.012+0000 7f8d7b59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c15a690 con 0x7f8d7c0d0f50 2023-10-06T02:46:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.012+0000 7f8d7a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8d7c0d0b80 0x7f8d7c0cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50346/0 (socket says 172.21.15.81:50346) 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.012+0000 7f8d7a59c700 1 -- 172.21.15.81:0/3099993264 learned_addr learned my addr 172.21.15.81:0/3099993264 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.012+0000 7f8d79d9b700 1 --2- 172.21.15.81:0/3099993264 >> v2:172.21.15.83:3300/0 conn(0x7f8d7c0d0f50 0x7f8d7c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.012+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393216207 0 0) 0x7f8d7c06d990 con 0x7f8d7c0d0b80 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.012+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d68003570 con 0x7f8d7c0d0b80 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2005861092 0 0) 0x7f8d68003570 con 0x7f8d7c0d0b80 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 >> v2:172.21.15.83:3300/0 conn(0x7f8d7c0d0f50 msgr2=0x7f8d7c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 --2- 172.21.15.81:0/3099993264 >> v2:172.21.15.83:3300/0 conn(0x7f8d7c0d0f50 0x7f8d7c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 >> v1:172.21.15.83:6789/0 conn(0x7f8d7c06d530 legacy=0x7f8d7c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0d0480 con 0x7f8d7c0d0b80 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f8d6c0017f0 con 0x7f8d7c0d0b80 2023-10-06T02:46:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 >> v1:172.21.15.81:6789/0 conn(0x7f8d7c0d0b80 legacy=0x7f8d7c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d68003a60 0x7f8d68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d680051c0 0x7f8d6800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c15a690 con 0x7f8d68004810 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6800c0d0 con 0x7f8d680051c0 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6800c290 con 0x7f8d68003a60 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d79d9b700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7a59c700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d68003a60 0x7f8d68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7ad9d700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d680051c0 0x7f8d6800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d79d9b700 1 -- 172.21.15.81:0/3099993264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d68003a60 msgr2=0x7f8d68003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d79d9b700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d68003a60 0x7f8d68003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d79d9b700 1 -- 172.21.15.81:0/3099993264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d680051c0 msgr2=0x7f8d6800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d79d9b700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d680051c0 0x7f8d6800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d79d9b700 1 -- 172.21.15.81:0/3099993264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d68003570 con 0x7f8d68004810 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7ad9d700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d680051c0 0x7f8d6800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7ad9d700 1 -- 172.21.15.81:0/3099993264 reap_dead start 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d79d9b700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d68004c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009c00 tx=0x7f8d640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358cdaa68e9b21db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6400e710 con 0x7f8d68004810 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6400e870 con 0x7f8d68004810 2023-10-06T02:46:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.013+0000 7f8d7959a700 1 -- 172.21.15.81:0/3099993264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6400ec30 con 0x7f8d68004810 2023-10-06T02:46:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.014+0000 7f8d7b59e700 1 -- 172.21.15.81:0/3099993264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 msgr2=0x7f8d68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.014+0000 7f8d7b59e700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d68004c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009c00 tx=0x7f8d640091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.014+0000 7f8d7b59e700 1 -- 172.21.15.81:0/3099993264 shutdown_connections 2023-10-06T02:46:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.014+0000 7f8d7b59e700 1 --2- 172.21.15.81:0/3099993264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d68004c80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.014+0000 7f8d7b59e700 1 -- 172.21.15.81:0/3099993264 >> 172.21.15.81:0/3099993264 conn(0x7f8d7c063230 msgr2=0x7f8d7c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.014+0000 7f8d7b59e700 1 -- 172.21.15.81:0/3099993264 shutdown_connections 2023-10-06T02:46:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.014+0000 7f8d7b59e700 1 -- 172.21.15.81:0/3099993264 wait complete. 2023-10-06T02:46:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.015+0000 7f8d7b59e700 1 Processor -- start 2023-10-06T02:46:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.015+0000 7f8d7b59e700 1 -- start start 2023-10-06T02:46:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d7c16a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d7c0cd550 0x7f8d7c15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d7c16e100 0x7f8d7c16e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c16b3e0 con 0x7f8d68004810 2023-10-06T02:46:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cd9c0 con 0x7f8d7c16e100 2023-10-06T02:46:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c16ab40 con 0x7f8d7c0cd550 2023-10-06T02:46:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d7c16a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d7c16a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48042/0 (socket says 172.21.15.81:48042) 2023-10-06T02:46:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7a59c700 1 -- 172.21.15.81:0/2104295249 learned_addr learned my addr 172.21.15.81:0/2104295249 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7ad9d700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d7c16e100 0x7f8d7c16e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d79d9b700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d7c0cd550 0x7f8d7c15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7a59c700 1 -- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d7c0cd550 msgr2=0x7f8d7c15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7a59c700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d7c0cd550 0x7f8d7c15cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7a59c700 1 -- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d7c16e100 msgr2=0x7f8d7c16e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7a59c700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d7c16e100 0x7f8d7c16e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7a59c700 1 -- 172.21.15.81:0/2104295249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c16ae20 con 0x7f8d68004810 2023-10-06T02:46:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7a59c700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d7c16a4f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c001f80 tx=0x7f8d7c0cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d727fc700 1 -- 172.21.15.81:0/2104295249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00ae10 con 0x7f8d68004810 2023-10-06T02:46:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d727fc700 1 -- 172.21.15.81:0/2104295249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c0133f0 con 0x7f8d68004810 2023-10-06T02:46:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d727fc700 1 -- 172.21.15.81:0/2104295249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0137b0 con 0x7f8d68004810 2023-10-06T02:46:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c16b100 con 0x7f8d68004810 2023-10-06T02:46:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.016+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c15d290 con 0x7f8d68004810 2023-10-06T02:46:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.017+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c15d4b0 con 0x7f8d68004810 2023-10-06T02:46:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.018+0000 7f8d727fc700 1 -- 172.21.15.81:0/2104295249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d6c013ba0 con 0x7f8d68004810 2023-10-06T02:46:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.018+0000 7f8d727fc700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d5c066fb0 0x7f8d5c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.018+0000 7f8d727fc700 1 -- 172.21.15.81:0/2104295249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d6c085650 con 0x7f8d68004810 2023-10-06T02:46:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.018+0000 7f8d79d9b700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d5c066fb0 0x7f8d5c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.019+0000 7f8d79d9b700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d5c066fb0 0x7f8d5c069460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8d640091e0 tx=0x7f8d6401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.022+0000 7f8d727fc700 1 -- 172.21.15.81:0/2104295249 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d6c0526c0 con 0x7f8d68004810 2023-10-06T02:46:26.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.201+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d7c06c960 con 0x7f8d68004810 2023-10-06T02:46:26.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.201+0000 7f8d727fc700 1 -- 172.21.15.81:0/2104295249 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d6c055ce0 con 0x7f8d68004810 2023-10-06T02:46:26.203 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:46:26.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d5c066fb0 msgr2=0x7f8d5c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d5c066fb0 0x7f8d5c069460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8d640091e0 tx=0x7f8d6401a000 comp rx=0 tx=0).stop 2023-10-06T02:46:26.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 msgr2=0x7f8d7c16a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d7c16a4f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c001f80 tx=0x7f8d7c0cf460 comp rx=0 tx=0).stop 2023-10-06T02:46:26.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 shutdown_connections 2023-10-06T02:46:26.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d5c066fb0 0x7f8d5c069460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d7c16e100 0x7f8d7c16e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d68004810 0x7f8d7c16a4f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 --2- 172.21.15.81:0/2104295249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d7c0cd550 0x7f8d7c15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 >> 172.21.15.81:0/2104295249 conn(0x7f8d7c063230 msgr2=0x7f8d7c0b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:26.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 shutdown_connections 2023-10-06T02:46:26.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.203+0000 7f8d7b59e700 1 -- 172.21.15.81:0/2104295249 wait complete. 2023-10-06T02:46:26.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:46:26.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.331+0000 7fc30017a700 1 Processor -- start 2023-10-06T02:46:26.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.332+0000 7fc30017a700 1 -- start start 2023-10-06T02:46:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.332+0000 7fc30017a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2f8157a60 0x7fc2f815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.332+0000 7fc30017a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f806c190 0x7fc2f80b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc30017a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80b35d0 con 0x7fc2f80b3170 2023-10-06T02:46:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc30017a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f8069d10 con 0x7fc2f8157a60 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc30017a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f815c130 con 0x7fc2f806c190 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fdf16700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2f8157a60 0x7fc2f815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fe717700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc2f80b3170 0x7fc2f806a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50358/0 (socket says 172.21.15.81:50358) 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fe717700 1 -- 172.21.15.81:0/2353029546 learned_addr learned my addr 172.21.15.81:0/2353029546 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fd715700 1 --2- 172.21.15.81:0/2353029546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f806c190 0x7fc2f80b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fdf16700 1 -- 172.21.15.81:0/2353029546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f806c190 msgr2=0x7fc2f80b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fdf16700 1 --2- 172.21.15.81:0/2353029546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f806c190 0x7fc2f80b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fdf16700 1 -- 172.21.15.81:0/2353029546 >> v1:172.21.15.81:6789/0 conn(0x7fc2f80b3170 legacy=0x7fc2f806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fcf14700 1 -- 172.21.15.81:0/2353029546 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702808944 0 0) 0x7fc2f0001490 con 0x7fc2f80b3170 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fdf16700 1 -- 172.21.15.81:0/2353029546 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f815c410 con 0x7fc2f8157a60 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fd715700 1 --2- 172.21.15.81:0/2353029546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f806c190 0x7fc2f80b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fdf16700 1 --2- 172.21.15.81:0/2353029546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f8157a60 0x7fc2f815b8e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40098e0 tx=0x7fc2f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e00afe52636c046 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fcf14700 1 -- 172.21.15.81:0/2353029546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4009e80 con 0x7fc2f8157a60 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fcf14700 1 -- 172.21.15.81:0/2353029546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400b860 con 0x7fc2f8157a60 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.333+0000 7fc2fcf14700 1 -- 172.21.15.81:0/2353029546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400bbe0 con 0x7fc2f8157a60 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.334+0000 7fc30017a700 1 -- 172.21.15.81:0/2353029546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f8157a60 msgr2=0x7fc2f815b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.334+0000 7fc30017a700 1 --2- 172.21.15.81:0/2353029546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f8157a60 0x7fc2f815b8e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40098e0 tx=0x7fc2f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.334+0000 7fc30017a700 1 -- 172.21.15.81:0/2353029546 shutdown_connections 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.334+0000 7fc30017a700 1 --2- 172.21.15.81:0/2353029546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f8157a60 0x7fc2f815b8e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.334+0000 7fc30017a700 1 --2- 172.21.15.81:0/2353029546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f806c190 0x7fc2f80b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.334+0000 7fc30017a700 1 -- 172.21.15.81:0/2353029546 >> 172.21.15.81:0/2353029546 conn(0x7fc2f806cca0 msgr2=0x7fc2f806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.334+0000 7fc30017a700 1 -- 172.21.15.81:0/2353029546 shutdown_connections 2023-10-06T02:46:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.334+0000 7fc30017a700 1 -- 172.21.15.81:0/2353029546 wait complete. 2023-10-06T02:46:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.335+0000 7fc30017a700 1 Processor -- start 2023-10-06T02:46:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.335+0000 7fc30017a700 1 -- start start 2023-10-06T02:46:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc30017a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f806c190 0x7fc2f80b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc30017a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f80b3170 0x7fc2f80af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc30017a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f8157a60 0x7fc2f8151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc30017a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f816b2f0 con 0x7fc2f80b3170 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc30017a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f816a6e0 con 0x7fc2f806c190 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc30017a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f816a9c0 con 0x7fc2f8157a60 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fd715700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f80b3170 0x7fc2f80af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fd715700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f80b3170 0x7fc2f80af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48066/0 (socket says 172.21.15.81:48066) 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fd715700 1 -- 172.21.15.81:0/2238236523 learned_addr learned my addr 172.21.15.81:0/2238236523 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fdf16700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f806c190 0x7fc2f80b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fe717700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f8157a60 0x7fc2f8151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fd715700 1 -- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f8157a60 msgr2=0x7fc2f8151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fd715700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f8157a60 0x7fc2f8151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fd715700 1 -- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f806c190 msgr2=0x7fc2f80b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fd715700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f806c190 0x7fc2f80b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fd715700 1 -- 172.21.15.81:0/2238236523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4009420 con 0x7fc2f80b3170 2023-10-06T02:46:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fe717700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f8157a60 0x7fc2f8151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2fd715700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f80b3170 0x7fc2f80af740 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800c850 tx=0x7fc2e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2edffb700 1 -- 172.21.15.81:0/2238236523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8011600 con 0x7fc2f80b3170 2023-10-06T02:46:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2edffb700 1 -- 172.21.15.81:0/2238236523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8011760 con 0x7fc2f80b3170 2023-10-06T02:46:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f816aca0 con 0x7fc2f80b3170 2023-10-06T02:46:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.336+0000 7fc2edffb700 1 -- 172.21.15.81:0/2238236523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8011b20 con 0x7fc2f80b3170 2023-10-06T02:46:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.337+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f80b2920 con 0x7fc2f80b3170 2023-10-06T02:46:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.337+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f816b140 con 0x7fc2f80b3170 2023-10-06T02:46:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.338+0000 7fc2edffb700 1 -- 172.21.15.81:0/2238236523 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2e8018350 con 0x7fc2f80b3170 2023-10-06T02:46:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.338+0000 7fc2edffb700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc2dc066f30 0x7fc2dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.338+0000 7fc2edffb700 1 -- 172.21.15.81:0/2238236523 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc2e80845b0 con 0x7fc2f80b3170 2023-10-06T02:46:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.338+0000 7fc2fdf16700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc2dc066f30 0x7fc2dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.339+0000 7fc2fdf16700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc2dc066f30 0x7fc2dc0693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40091e0 tx=0x7fc2f4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.342+0000 7fc2edffb700 1 -- 172.21.15.81:0/2238236523 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2e8055150 con 0x7fc2f80b3170 2023-10-06T02:46:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.524+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2f815c6f0 con 0x7fc2f80b3170 2023-10-06T02:46:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.524+0000 7fc2edffb700 1 -- 172.21.15.81:0/2238236523 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2e8054ce0 con 0x7fc2f80b3170 2023-10-06T02:46:26.525 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:46:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc2dc066f30 msgr2=0x7fc2dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc2dc066f30 0x7fc2dc0693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40091e0 tx=0x7fc2f4017000 comp rx=0 tx=0).stop 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f80b3170 msgr2=0x7fc2f80af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f80b3170 0x7fc2f80af740 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800c850 tx=0x7fc2e8008040 comp rx=0 tx=0).stop 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 shutdown_connections 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2f8157a60 0x7fc2f8151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc2dc066f30 0x7fc2dc0693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f806c190 0x7fc2f80b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 --2- 172.21.15.81:0/2238236523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f80b3170 0x7fc2f80af740 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 >> 172.21.15.81:0/2238236523 conn(0x7fc2f806cca0 msgr2=0x7fc2f8154530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 shutdown_connections 2023-10-06T02:46:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.526+0000 7fc30017a700 1 -- 172.21.15.81:0/2238236523 wait complete. 2023-10-06T02:46:26.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:46:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.653+0000 7f909b037700 1 Processor -- start 2023-10-06T02:46:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.653+0000 7f909b037700 1 -- start start 2023-10-06T02:46:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f909b037700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90941578d0 0x7f90940cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f909b037700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90940d07c0 con 0x7f909406d120 2023-10-06T02:46:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f909b037700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90940cfbb0 con 0x7f9094157ca0 2023-10-06T02:46:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f909b037700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90940cfe90 con 0x7f90941578d0 2023-10-06T02:46:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90995d4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f909406d120 0x7f909415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50372/0 (socket says 172.21.15.81:50372) 2023-10-06T02:46:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90995d4700 1 -- 172.21.15.81:0/235237819 learned_addr learned my addr 172.21.15.81:0/235237819 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597544724 0 0) 0x7f90940d07c0 con 0x7f909406d120 2023-10-06T02:46:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f9098dd3700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90941578d0 0x7f90940cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9084003570 con 0x7f909406d120 2023-10-06T02:46:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 715082329 0 0) 0x7f9084003570 con 0x7f909406d120 2023-10-06T02:46:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90941578d0 msgr2=0x7f90940cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90941578d0 0x7f90940cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 >> v1:172.21.15.83:6789/0 conn(0x7f9094157ca0 legacy=0x7f909415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90940d0170 con 0x7f909406d120 2023-10-06T02:46:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f9098dd3700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90941578d0 0x7f90940cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f908c0017f0 con 0x7f909406d120 2023-10-06T02:46:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 >> v1:172.21.15.81:6789/0 conn(0x7f909406d120 legacy=0x7f909415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9084003a90 0x7f9084003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9084004810 0x7f9084004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90941578d0 0x7f9084005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90940cfe90 con 0x7f9084003a90 2023-10-06T02:46:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908400bbf0 con 0x7f9084004810 2023-10-06T02:46:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908400bdb0 con 0x7f90941578d0 2023-10-06T02:46:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.654+0000 7f9098dd3700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9084003a90 0x7f9084003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f9093fff700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9084004810 0x7f9084004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f90995d4700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90941578d0 0x7f9084005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f9098dd3700 1 -- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90941578d0 msgr2=0x7f9084005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f9098dd3700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90941578d0 0x7f9084005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f9098dd3700 1 -- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9084004810 msgr2=0x7f9084004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f9098dd3700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9084004810 0x7f9084004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f9098dd3700 1 -- 172.21.15.81:0/235237819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084003570 con 0x7f9084003a90 2023-10-06T02:46:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f9098dd3700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9084003a90 0x7f9084003ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9088009ba0 tx=0x7f9088008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a1d3eaf23a40c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800c070 con 0x7f9084003a90 2023-10-06T02:46:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908800e5e0 con 0x7f9084003a90 2023-10-06T02:46:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f90937fe700 1 -- 172.21.15.81:0/235237819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088009510 con 0x7f9084003a90 2023-10-06T02:46:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f909b037700 1 -- 172.21.15.81:0/235237819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9084003a90 msgr2=0x7f9084003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.655+0000 7f909b037700 1 --2- 172.21.15.81:0/235237819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9084003a90 0x7f9084003ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9088009ba0 tx=0x7f9088008040 comp rx=0 tx=0).stop 2023-10-06T02:46:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.656+0000 7f90995d4700 1 -- 172.21.15.81:0/235237819 reap_dead start 2023-10-06T02:46:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.656+0000 7f909b037700 1 -- 172.21.15.81:0/235237819 shutdown_connections 2023-10-06T02:46:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.656+0000 7f909b037700 1 -- 172.21.15.81:0/235237819 >> 172.21.15.81:0/235237819 conn(0x7f909406bb90 msgr2=0x7f909406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.656+0000 7f909b037700 1 -- 172.21.15.81:0/235237819 shutdown_connections 2023-10-06T02:46:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.656+0000 7f909b037700 1 -- 172.21.15.81:0/235237819 wait complete. 2023-10-06T02:46:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.657+0000 7f909b037700 1 Processor -- start 2023-10-06T02:46:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.657+0000 7f909b037700 1 -- start start 2023-10-06T02:46:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f909b037700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9084003a90 0x7f90941533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f909b037700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094158fe0 0x7f90940c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f909b037700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90940c67a0 0x7f90940c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f909b037700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90940c8850 con 0x7f9094158fe0 2023-10-06T02:46:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f909b037700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90940c6310 con 0x7f90940c67a0 2023-10-06T02:46:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f909b037700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9094159450 con 0x7f9084003a90 2023-10-06T02:46:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9093fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094158fe0 0x7f90940c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9093fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094158fe0 0x7f90940c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48084/0 (socket says 172.21.15.81:48084) 2023-10-06T02:46:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9093fff700 1 -- 172.21.15.81:0/563385014 learned_addr learned my addr 172.21.15.81:0/563385014 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f90995d4700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90940c67a0 0x7f90940c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9098dd3700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9084003a90 0x7f90941533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9093fff700 1 -- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9084003a90 msgr2=0x7f90941533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9093fff700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9084003a90 0x7f90941533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9093fff700 1 -- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90940c67a0 msgr2=0x7f90940c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9093fff700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90940c67a0 0x7f90940c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9093fff700 1 -- 172.21.15.81:0/563385014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90940c8570 con 0x7f9094158fe0 2023-10-06T02:46:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9093fff700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094158fe0 0x7f90940c7d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9080002950 tx=0x7f9080007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9090ff9700 1 -- 172.21.15.81:0/563385014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080002e90 con 0x7f9094158fe0 2023-10-06T02:46:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9090ff9700 1 -- 172.21.15.81:0/563385014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908000f8d0 con 0x7f9094158fe0 2023-10-06T02:46:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90940c5cc0 con 0x7f9094158fe0 2023-10-06T02:46:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f9090ff9700 1 -- 172.21.15.81:0/563385014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000fc90 con 0x7f9094158fe0 2023-10-06T02:46:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.658+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90940c8250 con 0x7f9094158fe0 2023-10-06T02:46:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.659+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90940c5b20 con 0x7f9094158fe0 2023-10-06T02:46:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.660+0000 7f9090ff9700 1 -- 172.21.15.81:0/563385014 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9080006a30 con 0x7f9094158fe0 2023-10-06T02:46:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.660+0000 7f9090ff9700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9078066f30 0x7f90780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.660+0000 7f9090ff9700 1 -- 172.21.15.81:0/563385014 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9080084690 con 0x7f9094158fe0 2023-10-06T02:46:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.660+0000 7f9098dd3700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9078066f30 0x7f90780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.661+0000 7f9098dd3700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9078066f30 0x7f90780693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9088009960 tx=0x7f908801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.664+0000 7f9090ff9700 1 -- 172.21.15.81:0/563385014 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90940c5b20 con 0x7f9094158fe0 2023-10-06T02:46:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.887+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90940c5b20 con 0x7f9094158fe0 2023-10-06T02:46:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.887+0000 7f9090ff9700 1 -- 172.21.15.81:0/563385014 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f90940c5b20 con 0x7f9094158fe0 2023-10-06T02:46:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:26.889 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/963539092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":963539092},{"type":"v1","addr":"172.21.15.81:6833","nonce":963539092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3218202678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3218202678},{"type":"v1","addr":"172.21.15.81:6835","nonce":3218202678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/913779656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":913779656},{"type":"v1","addr":"172.21.15.83:6836","nonce":913779656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:06.874539+0000","modified":"2023-10-06T02:46:10.523436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/2378748577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2378748577},{"type":"v1","addr":"172.21.15.83:6837","nonce":2378748577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:46:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9078066f30 msgr2=0x7f90780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9078066f30 0x7f90780693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9088009960 tx=0x7f908801a000 comp rx=0 tx=0).stop 2023-10-06T02:46:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094158fe0 msgr2=0x7f90940c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094158fe0 0x7f90940c7d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9080002950 tx=0x7f9080007d30 comp rx=0 tx=0).stop 2023-10-06T02:46:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 shutdown_connections 2023-10-06T02:46:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9078066f30 0x7f90780693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90940c67a0 0x7f90940c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9084003a90 0x7f90941533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 --2- 172.21.15.81:0/563385014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094158fe0 0x7f90940c7d10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.889+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 >> 172.21.15.81:0/563385014 conn(0x7f909406bb90 msgr2=0x7f9094154600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.890+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 shutdown_connections 2023-10-06T02:46:26.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:26.890+0000 7f909b037700 1 -- 172.21.15.81:0/563385014 wait complete. 2023-10-06T02:46:26.894 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-06T02:46:26.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.016+0000 7fb4d8aed700 1 Processor -- start 2023-10-06T02:46:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.016+0000 7fb4d8aed700 1 -- start start 2023-10-06T02:46:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d8aed700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb4d4157fe0 0x7fb4d40b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d8aed700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d41583b0 0x7fb4d40b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d8aed700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d40b2890 con 0x7fb4d40ceb30 2023-10-06T02:46:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d8aed700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40b4070 con 0x7fb4d4157fe0 2023-10-06T02:46:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d8aed700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40b4350 con 0x7fb4d41583b0 2023-10-06T02:46:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d2d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb4d40ceb30 0x7fb4d40cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50388/0 (socket says 172.21.15.81:50388) 2023-10-06T02:46:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d2d9d700 1 -- 172.21.15.81:0/2405906605 learned_addr learned my addr 172.21.15.81:0/2405906605 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d259c700 1 --2- 172.21.15.81:0/2405906605 >> v2:172.21.15.83:3300/0 conn(0x7fb4d4157fe0 0x7fb4d40b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4cbfff700 1 --2- 172.21.15.81:0/2405906605 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d41583b0 0x7fb4d40b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d1d9b700 1 -- 172.21.15.81:0/2405906605 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592527865 0 0) 0x7fb4d40b2890 con 0x7fb4d40ceb30 2023-10-06T02:46:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d1d9b700 1 -- 172.21.15.81:0/2405906605 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c0003570 con 0x7fb4d40ceb30 2023-10-06T02:46:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d259c700 1 -- 172.21.15.81:0/2405906605 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d41583b0 msgr2=0x7fb4d40b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d259c700 1 --2- 172.21.15.81:0/2405906605 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d41583b0 0x7fb4d40b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d259c700 1 -- 172.21.15.81:0/2405906605 >> v1:172.21.15.81:6789/0 conn(0x7fb4d40ceb30 legacy=0x7fb4d40cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d1d9b700 1 -- 172.21.15.81:0/2405906605 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2294476415 0 0) 0x7fb4c0003570 con 0x7fb4d40ceb30 2023-10-06T02:46:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d259c700 1 -- 172.21.15.81:0/2405906605 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40b4630 con 0x7fb4d4157fe0 2023-10-06T02:46:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.017+0000 7fb4d259c700 1 --2- 172.21.15.81:0/2405906605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4d4157fe0 0x7fb4d40b34c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40098e0 tx=0x7fb4c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e009052d60453df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d1d9b700 1 -- 172.21.15.81:0/2405906605 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc0017f0 con 0x7fb4d4157fe0 2023-10-06T02:46:27.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d1d9b700 1 -- 172.21.15.81:0/2405906605 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c4011420 con 0x7fb4d4157fe0 2023-10-06T02:46:27.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d1d9b700 1 -- 172.21.15.81:0/2405906605 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40117c0 con 0x7fb4d4157fe0 2023-10-06T02:46:27.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d8aed700 1 -- 172.21.15.81:0/2405906605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4d4157fe0 msgr2=0x7fb4d40b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d8aed700 1 --2- 172.21.15.81:0/2405906605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4d4157fe0 0x7fb4d40b34c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40098e0 tx=0x7fb4c40091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d8aed700 1 -- 172.21.15.81:0/2405906605 shutdown_connections 2023-10-06T02:46:27.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d8aed700 1 --2- 172.21.15.81:0/2405906605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4d4157fe0 0x7fb4d40b34c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d8aed700 1 --2- 172.21.15.81:0/2405906605 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d41583b0 0x7fb4d40b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d8aed700 1 -- 172.21.15.81:0/2405906605 >> 172.21.15.81:0/2405906605 conn(0x7fb4d4067640 msgr2=0x7fb4d4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d8aed700 1 -- 172.21.15.81:0/2405906605 shutdown_connections 2023-10-06T02:46:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.018+0000 7fb4d8aed700 1 -- 172.21.15.81:0/2405906605 wait complete. 2023-10-06T02:46:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.019+0000 7fb4d8aed700 1 Processor -- start 2023-10-06T02:46:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.019+0000 7fb4d8aed700 1 -- start start 2023-10-06T02:46:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4d8aed700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d40ceb30 0x7fb4d4152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4d8aed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4d4157fe0 0x7fb4d40c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4d8aed700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4d41583b0 0x7fb4d406e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4d8aed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d406dd40 con 0x7fb4d4157fe0 2023-10-06T02:46:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4d8aed700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d406d130 con 0x7fb4d41583b0 2023-10-06T02:46:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4d8aed700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d406d410 con 0x7fb4d40ceb30 2023-10-06T02:46:27.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4d4157fe0 0x7fb4d40c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4d4157fe0 0x7fb4d40c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48092/0 (socket says 172.21.15.81:48092) 2023-10-06T02:46:27.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4cbfff700 1 -- 172.21.15.81:0/232150956 learned_addr learned my addr 172.21.15.81:0/232150956 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:27.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4d2d9d700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4d41583b0 0x7fb4d406e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4d259c700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d40ceb30 0x7fb4d4152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4cbfff700 1 -- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d40ceb30 msgr2=0x7fb4d4152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4cbfff700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d40ceb30 0x7fb4d4152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4cbfff700 1 -- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4d41583b0 msgr2=0x7fb4d406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4cbfff700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4d41583b0 0x7fb4d406e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4cbfff700 1 -- 172.21.15.81:0/232150956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c4009420 con 0x7fb4d4157fe0 2023-10-06T02:46:27.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.020+0000 7fb4cbfff700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4d4157fe0 0x7fb4d40c9570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00ec80 tx=0x7fb4bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:27.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.021+0000 7fb4ca7fc700 1 -- 172.21.15.81:0/232150956 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc00c9d0 con 0x7fb4d4157fe0 2023-10-06T02:46:27.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.021+0000 7fb4ca7fc700 1 -- 172.21.15.81:0/232150956 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc00cb30 con 0x7fb4d4157fe0 2023-10-06T02:46:27.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.021+0000 7fb4ca7fc700 1 -- 172.21.15.81:0/232150956 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc013470 con 0x7fb4d4157fe0 2023-10-06T02:46:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.021+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d406d6f0 con 0x7fb4d4157fe0 2023-10-06T02:46:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.021+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d4153200 con 0x7fb4d4157fe0 2023-10-06T02:46:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.022+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d406def0 con 0x7fb4d4157fe0 2023-10-06T02:46:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.022+0000 7fb4ca7fc700 1 -- 172.21.15.81:0/232150956 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4bc013820 con 0x7fb4d4157fe0 2023-10-06T02:46:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.022+0000 7fb4ca7fc700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb4b4066f30 0x7fb4b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.022+0000 7fb4ca7fc700 1 -- 172.21.15.81:0/232150956 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb4bc084a00 con 0x7fb4d4157fe0 2023-10-06T02:46:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.022+0000 7fb4d259c700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb4b4066f30 0x7fb4b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.023+0000 7fb4d259c700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb4b4066f30 0x7fb4b40693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40098e0 tx=0x7fb4c4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.026+0000 7fb4ca7fc700 1 -- 172.21.15.81:0/232150956 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4d406def0 con 0x7fb4d4157fe0 2023-10-06T02:46:27.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.210+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4d406de80 con 0x7fb4d4157fe0 2023-10-06T02:46:27.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.211+0000 7fb4ca7fc700 1 -- 172.21.15.81:0/232150956 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fb4bc051b10 con 0x7fb4d4157fe0 2023-10-06T02:46:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:27.213 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb4b4066f30 msgr2=0x7fb4b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb4b4066f30 0x7fb4b40693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40098e0 tx=0x7fb4c4016000 comp rx=0 tx=0).stop 2023-10-06T02:46:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4d4157fe0 msgr2=0x7fb4d40c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4d4157fe0 0x7fb4d40c9570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00ec80 tx=0x7fb4bc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 shutdown_connections 2023-10-06T02:46:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb4b4066f30 0x7fb4b40693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4d41583b0 0x7fb4d406e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4d40ceb30 0x7fb4d4152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 --2- 172.21.15.81:0/232150956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4d4157fe0 0x7fb4d40c9570 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 >> 172.21.15.81:0/232150956 conn(0x7fb4d4067640 msgr2=0x7fb4d40cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 shutdown_connections 2023-10-06T02:46:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.213+0000 7fb4d8aed700 1 -- 172.21.15.81:0/232150956 wait complete. 2023-10-06T02:46:27.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:46:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.338+0000 7fd7eb59e700 1 Processor -- start 2023-10-06T02:46:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.338+0000 7fd7eb59e700 1 -- start start 2023-10-06T02:46:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7eb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd7ec159f10 0x7fd7ec068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7eb59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd7ec068cc0 0x7fd7ec0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7eb59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec069120 con 0x7fd7ec159b40 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7eb59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec0cee10 con 0x7fd7ec159f10 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7eb59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec0cd040 con 0x7fd7ec068cc0 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e9d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd7ec159f10 0x7fd7ec068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e9d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd7ec159f10 0x7fd7ec068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48100/0 (socket says 172.21.15.81:48100) 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e9d9b700 1 -- 172.21.15.81:0/249562632 learned_addr learned my addr 172.21.15.81:0/249562632 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7ead9d700 1 --2- 172.21.15.81:0/249562632 >> v2:172.21.15.83:3300/0 conn(0x7fd7ec068cc0 0x7fd7ec0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e9d9b700 1 -- 172.21.15.81:0/249562632 >> v2:172.21.15.83:3300/0 conn(0x7fd7ec068cc0 msgr2=0x7fd7ec0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e9d9b700 1 --2- 172.21.15.81:0/249562632 >> v2:172.21.15.83:3300/0 conn(0x7fd7ec068cc0 0x7fd7ec0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e9d9b700 1 -- 172.21.15.81:0/249562632 >> v1:172.21.15.83:6789/0 conn(0x7fd7ec159b40 legacy=0x7fd7ec0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e9d9b700 1 -- 172.21.15.81:0/249562632 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0cd320 con 0x7fd7ec159f10 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e9d9b700 1 --2- 172.21.15.81:0/249562632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec159f10 0x7fd7ec068780 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0cae10 tx=0x7fd7d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938c58ecf8155e66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e959a700 1 -- 172.21.15.81:0/249562632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4009e70 con 0x7fd7ec159f10 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e959a700 1 -- 172.21.15.81:0/249562632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d400b860 con 0x7fd7ec159f10 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.339+0000 7fd7e959a700 1 -- 172.21.15.81:0/249562632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d400bc00 con 0x7fd7ec159f10 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.340+0000 7fd7eb59e700 1 -- 172.21.15.81:0/249562632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec159f10 msgr2=0x7fd7ec068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.340+0000 7fd7eb59e700 1 --2- 172.21.15.81:0/249562632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec159f10 0x7fd7ec068780 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0cae10 tx=0x7fd7d4009250 comp rx=0 tx=0).stop 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.340+0000 7fd7eb59e700 1 -- 172.21.15.81:0/249562632 shutdown_connections 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.340+0000 7fd7eb59e700 1 --2- 172.21.15.81:0/249562632 >> v2:172.21.15.83:3300/0 conn(0x7fd7ec068cc0 0x7fd7ec0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.340+0000 7fd7eb59e700 1 --2- 172.21.15.81:0/249562632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec159f10 0x7fd7ec068780 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.340+0000 7fd7eb59e700 1 -- 172.21.15.81:0/249562632 >> 172.21.15.81:0/249562632 conn(0x7fd7ec0cd660 msgr2=0x7fd7ec0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.340+0000 7fd7eb59e700 1 -- 172.21.15.81:0/249562632 shutdown_connections 2023-10-06T02:46:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.340+0000 7fd7eb59e700 1 -- 172.21.15.81:0/249562632 wait complete. 2023-10-06T02:46:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.341+0000 7fd7eb59e700 1 Processor -- start 2023-10-06T02:46:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.341+0000 7fd7eb59e700 1 -- start start 2023-10-06T02:46:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7eb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec068cc0 0x7fd7ec158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7eb59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec159b40 0x7fd7ec15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7eb59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7ec159f10 0x7fd7ec0c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7eb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec15f290 con 0x7fd7ec068cc0 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7eb59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec15bfc0 con 0x7fd7ec159b40 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7eb59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec15b0d0 con 0x7fd7ec159f10 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7ea59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec068cc0 0x7fd7ec158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7ea59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec068cc0 0x7fd7ec158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48106/0 (socket says 172.21.15.81:48106) 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7ea59c700 1 -- 172.21.15.81:0/391215469 learned_addr learned my addr 172.21.15.81:0/391215469 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7e9d9b700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec159b40 0x7fd7ec15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7ea59c700 1 -- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7ec159f10 msgr2=0x7fd7ec0c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7ea59c700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7ec159f10 0x7fd7ec0c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7ea59c700 1 -- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec159b40 msgr2=0x7fd7ec15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7ea59c700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec159b40 0x7fd7ec15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7ea59c700 1 -- 172.21.15.81:0/391215469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40094f0 con 0x7fd7ec068cc0 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7ea59c700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec068cc0 0x7fd7ec158ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400c590 tx=0x7fd7e400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7e27fc700 1 -- 172.21.15.81:0/391215469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4011590 con 0x7fd7ec068cc0 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7e27fc700 1 -- 172.21.15.81:0/391215469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e40116f0 con 0x7fd7ec068cc0 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec15b3b0 con 0x7fd7ec068cc0 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7e27fc700 1 -- 172.21.15.81:0/391215469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4011ab0 con 0x7fd7ec068cc0 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.342+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec15b970 con 0x7fd7ec068cc0 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.343+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec159000 con 0x7fd7ec068cc0 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.344+0000 7fd7e27fc700 1 -- 172.21.15.81:0/391215469 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7e401b3b0 con 0x7fd7ec068cc0 2023-10-06T02:46:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.344+0000 7fd7e27fc700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd7cc066f30 0x7fd7cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.344+0000 7fd7e27fc700 1 -- 172.21.15.81:0/391215469 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd7e4083ac0 con 0x7fd7ec068cc0 2023-10-06T02:46:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.344+0000 7fd7e9d9b700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd7cc066f30 0x7fd7cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.345+0000 7fd7e9d9b700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd7cc066f30 0x7fd7cc0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0cae10 tx=0x7fd7d4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.348+0000 7fd7e27fc700 1 -- 172.21.15.81:0/391215469 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7e4050bd0 con 0x7fd7ec068cc0 2023-10-06T02:46:27.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.572+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7ec069120 con 0x7fd7ec068cc0 2023-10-06T02:46:27.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.573+0000 7fd7e27fc700 1 -- 172.21.15.81:0/391215469 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fd7ec069120 con 0x7fd7ec068cc0 2023-10-06T02:46:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:27.576 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/963539092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":963539092},{"type":"v1","addr":"172.21.15.81:6833","nonce":963539092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3218202678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3218202678},{"type":"v1","addr":"172.21.15.81:6835","nonce":3218202678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/913779656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":913779656},{"type":"v1","addr":"172.21.15.83:6836","nonce":913779656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:06.874539+0000","modified":"2023-10-06T02:46:10.523436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/2378748577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2378748577},{"type":"v1","addr":"172.21.15.83:6837","nonce":2378748577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:46:27.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd7cc066f30 msgr2=0x7fd7cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd7cc066f30 0x7fd7cc0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0cae10 tx=0x7fd7d4017000 comp rx=0 tx=0).stop 2023-10-06T02:46:27.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec068cc0 msgr2=0x7fd7ec158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec068cc0 0x7fd7ec158ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400c590 tx=0x7fd7e400c950 comp rx=0 tx=0).stop 2023-10-06T02:46:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 shutdown_connections 2023-10-06T02:46:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7ec159f10 0x7fd7ec0c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ec068cc0 0x7fd7ec158ac0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd7cc066f30 0x7fd7cc0693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 --2- 172.21.15.81:0/391215469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec159b40 0x7fd7ec15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 >> 172.21.15.81:0/391215469 conn(0x7fd7ec0cd660 msgr2=0x7fd7ec0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 shutdown_connections 2023-10-06T02:46:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:27.575+0000 7fd7eb59e700 1 -- 172.21.15.81:0/391215469 wait complete. 2023-10-06T02:46:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-06T02:46:27.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:46:06.874539+0000', 'modified': '2023-10-06T02:46:10.523436+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6837/2378748577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6835', 'nonce': 2378748577}, {'type': 'v1', 'addr': '172.21.15.83:6837', 'nonce': 2378748577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:46:27.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:46:27.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T02:46:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.106+0000 7f1bd6b9d700 1 Processor -- start 2023-10-06T02:46:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.106+0000 7f1bd6b9d700 1 -- start start 2023-10-06T02:46:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bd6b9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1bd01578d0 0x7f1bd00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bd6b9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0157ca0 0x7f1bd015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bd6b9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd00d07c0 con 0x7f1bd006d120 2023-10-06T02:46:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bd6b9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd00cfbb0 con 0x7f1bd01578d0 2023-10-06T02:46:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bd6b9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00cfe90 con 0x7f1bd0157ca0 2023-10-06T02:46:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bd513a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1bd006d120 0x7f1bd015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50396/0 (socket says 172.21.15.81:50396) 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bd513a700 1 -- 172.21.15.81:0/234280882 learned_addr learned my addr 172.21.15.81:0/234280882 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bd4939700 1 --2- 172.21.15.81:0/234280882 >> v2:172.21.15.83:3300/0 conn(0x7f1bd01578d0 0x7f1bd00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663518706 0 0) 0x7f1bd00d07c0 con 0x7f1bd006d120 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bb8003570 con 0x7f1bd006d120 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.107+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0157ca0 0x7f1bd015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2661070594 0 0) 0x7f1bb8003570 con 0x7f1bd006d120 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0157ca0 msgr2=0x7f1bd015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0157ca0 0x7f1bd015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 >> v2:172.21.15.83:3300/0 conn(0x7f1bd01578d0 msgr2=0x7f1bd00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 --2- 172.21.15.81:0/234280882 >> v2:172.21.15.83:3300/0 conn(0x7f1bd01578d0 0x7f1bd00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00d0170 con 0x7f1bd006d120 2023-10-06T02:46:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f1bc80017f0 con 0x7f1bd006d120 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 >> v1:172.21.15.81:6789/0 conn(0x7f1bd006d120 legacy=0x7f1bd015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb8003a60 0x7f1bb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0157ca0 0x7f1bb8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb8004d50 0x7f1bb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00cfbb0 con 0x7f1bb8004d50 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00cfe90 con 0x7f1bb8003a60 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb800ba60 con 0x7f1bd0157ca0 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bd513a700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb8004d50 0x7f1bb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bd4939700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb8003a60 0x7f1bb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0157ca0 0x7f1bb8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bd513a700 1 -- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0157ca0 msgr2=0x7f1bb8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bd513a700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0157ca0 0x7f1bb8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bd513a700 1 -- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb8003a60 msgr2=0x7f1bb8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bd513a700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb8003a60 0x7f1bb8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bd513a700 1 -- 172.21.15.81:0/234280882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8003570 con 0x7f1bb8004d50 2023-10-06T02:46:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bd513a700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb8004d50 0x7f1bb80051c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800a970 tx=0x7f1bd00d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1de6acdbaf613c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80070d0 con 0x7f1bb8004d50 2023-10-06T02:46:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc8007230 con 0x7f1bb8004d50 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.108+0000 7f1bc77fe700 1 -- 172.21.15.81:0/234280882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80075f0 con 0x7f1bb8004d50 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.109+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/234280882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb8004d50 msgr2=0x7f1bb80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.109+0000 7f1bd6b9d700 1 --2- 172.21.15.81:0/234280882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb8004d50 0x7f1bb80051c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800a970 tx=0x7f1bd00d0730 comp rx=0 tx=0).stop 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.109+0000 7f1bd513a700 1 -- 172.21.15.81:0/234280882 reap_dead start 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.109+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/234280882 shutdown_connections 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.109+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/234280882 >> 172.21.15.81:0/234280882 conn(0x7f1bd006bb90 msgr2=0x7f1bd006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.109+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/234280882 shutdown_connections 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.109+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/234280882 wait complete. 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.110+0000 7f1bd6b9d700 1 Processor -- start 2023-10-06T02:46:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.110+0000 7f1bd6b9d700 1 -- start start 2023-10-06T02:46:28.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bd6b9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bb8004d50 0x7f1bd0145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bd6b9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00c7a60 0x7f1bd015c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bd6b9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd015cab0 0x7f1bd00b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bd6b9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd016b3b0 con 0x7f1bd00c7a60 2023-10-06T02:46:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bd6b9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd015cf20 con 0x7f1bd015cab0 2023-10-06T02:46:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bd6b9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00c7680 con 0x7f1bb8004d50 2023-10-06T02:46:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bc7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00c7a60 0x7f1bd015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bc7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00c7a60 0x7f1bd015c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48122/0 (socket says 172.21.15.81:48122) 2023-10-06T02:46:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bc7fff700 1 -- 172.21.15.81:0/2133883063 learned_addr learned my addr 172.21.15.81:0/2133883063 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bd513a700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd015cab0 0x7f1bd00b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bd4939700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bb8004d50 0x7f1bd0145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bc7fff700 1 -- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bb8004d50 msgr2=0x7f1bd0145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bb8004d50 0x7f1bd0145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bc7fff700 1 -- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd015cab0 msgr2=0x7f1bd00b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd015cab0 0x7f1bd00b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bc7fff700 1 -- 172.21.15.81:0/2133883063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd016a7a0 con 0x7f1bd00c7a60 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.111+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00c7a60 0x7f1bd015c570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0011b10 tx=0x7f1bc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.112+0000 7f1bc4ff9700 1 -- 172.21.15.81:0/2133883063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000f940 con 0x7f1bd00c7a60 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.112+0000 7f1bc4ff9700 1 -- 172.21.15.81:0/2133883063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc000faa0 con 0x7f1bd00c7a60 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.112+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/2133883063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd016aa80 con 0x7f1bd00c7a60 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.112+0000 7f1bc4ff9700 1 -- 172.21.15.81:0/2133883063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000fe20 con 0x7f1bd00c7a60 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.112+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/2133883063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd016b040 con 0x7f1bd00c7a60 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.113+0000 7f1bc4ff9700 1 -- 172.21.15.81:0/2133883063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bc0014650 con 0x7f1bd00c7a60 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.113+0000 7f1bc4ff9700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.113+0000 7f1bc4ff9700 1 -- 172.21.15.81:0/2133883063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1bc0018030 con 0x7f1bd00c7a60 2023-10-06T02:46:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.114+0000 7f1bd4939700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.114+0000 7f1bd4939700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc006f00 tx=0x7f1bcc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.115+0000 7f1bdfe95b80 1 Processor -- start 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.115+0000 7f1bdfe95b80 1 -- start start 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c36840 0x55e1f7c36c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 0x55e1f7c87050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7b8da70 con 0x55e1f7c37cc0 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7b8b270 con 0x55e1f7c36840 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7b87060 con 0x55e1f7c86c00 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bc7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bc7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c866c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48134/0 (socket says 172.21.15.81:48134) 2023-10-06T02:46:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bc7fff700 1 -- 172.21.15.81:0/1658202370 learned_addr learned my addr 172.21.15.81:0/1658202370 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bc7fff700 1 -- 172.21.15.81:0/1658202370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 msgr2=0x55e1f7c87050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bd4939700 1 --2- 172.21.15.81:0/1658202370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c36840 0x55e1f7c36c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/1658202370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 0x55e1f7c87050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bc7fff700 1 -- 172.21.15.81:0/1658202370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c36840 msgr2=0x55e1f7c36c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/1658202370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c36840 0x55e1f7c36c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bc7fff700 1 -- 172.21.15.81:0/1658202370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f7a21270 con 0x55e1f7c37cc0 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bd4939700 1 --2- 172.21.15.81:0/1658202370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c36840 0x55e1f7c36c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.116+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/1658202370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c866c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00522a0 tx=0x7f1bc0083270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7a031674dace7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bb5ffb700 1 -- 172.21.15.81:0/1658202370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0055e20 con 0x55e1f7c37cc0 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bb5ffb700 1 -- 172.21.15.81:0/1658202370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc005b0f0 con 0x55e1f7c37cc0 2023-10-06T02:46:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bb5ffb700 1 -- 172.21.15.81:0/1658202370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc006c180 con 0x55e1f7c37cc0 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/1658202370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c37cc0 msgr2=0x55e1f7c866c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/1658202370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c866c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00522a0 tx=0x7f1bc0083270 comp rx=0 tx=0).stop 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/1658202370 shutdown_connections 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/1658202370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 0x55e1f7c87050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/1658202370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c36840 0x55e1f7c36c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/1658202370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c866c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/1658202370 >> 172.21.15.81:0/1658202370 conn(0x55e1f7c38160 msgr2=0x55e1f7c38530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/1658202370 shutdown_connections 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.117+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/1658202370 wait complete. 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.118+0000 7f1bdfe95b80 1 -- start start 2023-10-06T02:46:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.118+0000 7f1bdfe95b80 1 Processor -- start 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c36840 0x55e1f7c83740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c74a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 0x55e1f7c76570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7b32890 con 0x55e1f7c36840 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7b4dea0 con 0x55e1f7c37cc0 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7a09e30 con 0x55e1f7c86c00 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bdfe95b80 10 client.0 _ll_register_callbacks cb 0x55e1f7bf9e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd4939700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c36840 0x55e1f7c83740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd4939700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c36840 0x55e1f7c83740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48144/0 (socket says 172.21.15.81:48144) 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd4939700 1 -- 172.21.15.81:0/3744573911 learned_addr learned my addr 172.21.15.81:0/3744573911 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c74a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd513a700 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 0x55e1f7c76570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd4939700 1 -- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 msgr2=0x55e1f7c76570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd4939700 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 0x55e1f7c76570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd4939700 1 -- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 msgr2=0x55e1f7c74a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd4939700 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c74a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd4939700 1 -- 172.21.15.81:0/3744573911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd016b040 con 0x55e1f7c36840 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd513a700 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 0x55e1f7c76570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bd4939700 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c36840 0x55e1f7c83740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc015ad0 tx=0x7f1bcc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aada1644fc7d40a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1baeffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:46:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1baeffd700 1 -- 172.21.15.81:0/3744573911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc022640 con 0x55e1f7c36840 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1baeffd700 1 -- 172.21.15.81:0/3744573911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1bcc0227a0 con 0x55e1f7c36840 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/3744573911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1f7c2b940 con 0x55e1f7c36840 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1baeffd700 1 -- 172.21.15.81:0/3744573911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bcc022b70 con 0x55e1f7c36840 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.119+0000 7f1bdfe95b80 10 client.4734 fetch_fsmap learned FSMap version 8 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/3744573911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e1f79c3fe0 con 0x55e1f7c36840 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1baeffd700 1 -- 172.21.15.81:0/3744573911 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e1f7c2b940 con 0x55e1f7c36840 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1baeffd700 1 -- 172.21.15.81:0/3744573911 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1bcc022cd0 con 0x55e1f7c36840 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1bdfe95b80 10 client.4734 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1bdfe95b80 10 client.4734 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:46:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1bdfe95b80 20 client.4734 populate_metadata read hostname 'smithi081' 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] conn(0x55e1f7c76b30 0x55e1f7c7aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1bdfe95b80 4 client.4734 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/3744573911 --> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1f7c08870 con 0x55e1f7c76b30 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] conn(0x55e1f7c76b30 0x55e1f7c7aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1baeffd700 10 client.4734 ms_handle_connect on v2:172.21.15.83:6835/2378748577 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.120+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] conn(0x55e1f7c76b30 0x55e1f7c7aae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a63abf5e1e66ab server_cookie=c84eadbca9a90bf1 in_seq=0 out_seq=0 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1baeffd700 1 -- 172.21.15.81:0/3744573911 <== mds.0 v2:172.21.15.83:6835/2378748577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e1f7c08870 con 0x55e1f7c76b30 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1baeffd700 10 client.4734 handle_command_reply: tid=0 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1bdfe95b80 1 client.4734 shutdown 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/3744573911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c36840 msgr2=0x55e1f7c83740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c36840 0x55e1f7c83740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc015ad0 tx=0x7f1bcc01c000 comp rx=0 tx=0).stop 2023-10-06T02:46:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/3744573911 shutdown_connections 2023-10-06T02:46:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c86c00 0x55e1f7c76570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c36840 0x55e1f7c83740 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] conn(0x55e1f7c76b30 0x55e1f7c7aae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/3744573911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c74a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1baeffd700 0 client.4734 ms_handle_reset on v2:172.21.15.83:6835/2378748577 2023-10-06T02:46:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.121+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/3744573911 >> 172.21.15.81:0/3744573911 conn(0x55e1f7c38160 msgr2=0x55e1f7c33120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.122+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/3744573911 shutdown_connections 2023-10-06T02:46:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.122+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/3744573911 wait complete. 2023-10-06T02:46:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.122+0000 7f1bdfe95b80 20 client.4734 trim_cache size 0 max 16384 2023-10-06T02:46:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.138+0000 7f1bdfe95b80 1 Processor -- start 2023-10-06T02:46:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.138+0000 7f1bdfe95b80 1 -- start start 2023-10-06T02:46:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 0x55e1f7c7c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c83900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7c77370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7c600f0 con 0x55e1f7c86c00 2023-10-06T02:46:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7c832d0 con 0x55e1f7c37cc0 2023-10-06T02:46:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7c356e0 con 0x55e1f7c36840 2023-10-06T02:46:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd513a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7c77370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd513a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7c77370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48156/0 (socket says 172.21.15.81:48156) 2023-10-06T02:46:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd513a700 1 -- 172.21.15.81:0/2982078427 learned_addr learned my addr 172.21.15.81:0/2982078427 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd4939700 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 0x55e1f7c7c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c83900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd513a700 1 -- 172.21.15.81:0/2982078427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 msgr2=0x55e1f7c7c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd513a700 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 0x55e1f7c7c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd513a700 1 -- 172.21.15.81:0/2982078427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 msgr2=0x55e1f7c83900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd513a700 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c83900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd513a700 1 -- 172.21.15.81:0/2982078427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f7b55780 con 0x55e1f7c86c00 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c83900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bd513a700 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7c77370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8012000 tx=0x7f1bc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c45327334d21ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bb67fc700 1 -- 172.21.15.81:0/2982078427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8023070 con 0x55e1f7c86c00 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bb67fc700 1 -- 172.21.15.81:0/2982078427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc80017b0 con 0x55e1f7c86c00 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.139+0000 7f1bb67fc700 1 -- 172.21.15.81:0/2982078427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80070d0 con 0x55e1f7c86c00 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2982078427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 msgr2=0x55e1f7c77370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7c77370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8012000 tx=0x7f1bc8016000 comp rx=0 tx=0).stop 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2982078427 shutdown_connections 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7c77370 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 0x55e1f7c7c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2982078427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c83900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2982078427 >> 172.21.15.81:0/2982078427 conn(0x55e1f7c38160 msgr2=0x55e1f7c8f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2982078427 shutdown_connections 2023-10-06T02:46:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2982078427 wait complete. 2023-10-06T02:46:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.140+0000 7f1bdfe95b80 1 -- start start 2023-10-06T02:46:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.141+0000 7f1bdfe95b80 1 Processor -- start 2023-10-06T02:46:28.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 0x55e1f7ce3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c8f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7cc8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7c8fc30 con 0x55e1f7c86c00 2023-10-06T02:46:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7c5e7b0 con 0x55e1f7c37cc0 2023-10-06T02:46:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1f7c5ea90 con 0x55e1f7c36840 2023-10-06T02:46:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 10 client.0 _ll_register_callbacks cb 0x55e1f7bf9e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:46:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd513a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7cc8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd513a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7cc8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48172/0 (socket says 172.21.15.81:48172) 2023-10-06T02:46:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd513a700 1 -- 172.21.15.81:0/2649313363 learned_addr learned my addr 172.21.15.81:0/2649313363 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd4939700 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 0x55e1f7ce3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bc7fff700 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c8f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd513a700 1 -- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 msgr2=0x55e1f7ce3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd513a700 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 0x55e1f7ce3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd513a700 1 -- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 msgr2=0x55e1f7c8f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd513a700 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c8f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd513a700 1 -- 172.21.15.81:0/2649313363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb8003570 con 0x55e1f7c86c00 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bd513a700 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7cc8900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8004730 tx=0x7f1bc8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6fb491b7b15669 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1baeffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:46:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1baeffd700 1 -- 172.21.15.81:0/2649313363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc802e070 con 0x55e1f7c86c00 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1baeffd700 1 -- 172.21.15.81:0/2649313363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1bc80075b0 con 0x55e1f7c86c00 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2649313363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1bc005b0f0 con 0x55e1f7c86c00 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1baeffd700 1 -- 172.21.15.81:0/2649313363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bc80070d0 con 0x55e1f7c86c00 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 10 client.4740 fetch_fsmap learned FSMap version 8 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2649313363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e1f7b3c470 con 0x55e1f7c86c00 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.142+0000 7f1baeffd700 1 -- 172.21.15.81:0/2649313363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc005b0f0 con 0x55e1f7c86c00 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1baeffd700 1 -- 172.21.15.81:0/2649313363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1bc800a9a0 con 0x55e1f7c86c00 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 10 client.4740 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 10 client.4740 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:46:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 20 client.4740 populate_metadata read hostname 'smithi081' 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] conn(0x55e1f7c84150 0x55e1f7c84520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 4 client.4740 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2649313363 --> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e1f7b29e00 con 0x55e1f7c84150 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bd4939700 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] conn(0x55e1f7c84150 0x55e1f7c84520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1baeffd700 10 client.4740 ms_handle_connect on v2:172.21.15.83:6835/2378748577 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bd4939700 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] conn(0x55e1f7c84150 0x55e1f7c84520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1a5ebd201a6083d server_cookie=441c3c4f2307284c in_seq=0 out_seq=0 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1baeffd700 1 -- 172.21.15.81:0/2649313363 <== mds.0 v2:172.21.15.83:6835/2378748577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e1f7b29e00 con 0x55e1f7c84150 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1baeffd700 10 client.4740 handle_command_reply: tid=0 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 client.4740 shutdown 2023-10-06T02:46:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2649313363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 msgr2=0x55e1f7cc8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7cc8900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8004730 tx=0x7f1bc8023000 comp rx=0 tx=0).stop 2023-10-06T02:46:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2649313363 shutdown_connections 2023-10-06T02:46:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1f7c86c00 0x55e1f7cc8900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e1f7c36840 0x55e1f7ce3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:6835/2378748577,v1:172.21.15.83:6837/2378748577] conn(0x55e1f7c84150 0x55e1f7c84520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 --2- 172.21.15.81:0/2649313363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1f7c37cc0 0x55e1f7c8f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1baeffd700 0 client.4740 ms_handle_reset on v2:172.21.15.83:6835/2378748577 2023-10-06T02:46:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.143+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2649313363 >> 172.21.15.81:0/2649313363 conn(0x55e1f7c38160 msgr2=0x55e1f7c7c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2649313363 shutdown_connections 2023-10-06T02:46:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bdfe95b80 1 -- 172.21.15.81:0/2649313363 wait complete. 2023-10-06T02:46:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bdfe95b80 20 client.4740 trim_cache size 0 max 16384 2023-10-06T02:46:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:46:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:46:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:46:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4291, 2023-10-06T02:46:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:46:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:46:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:46:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 20.634698915000001, 2023-10-06T02:46:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 8, 2023-10-06T02:46:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 23, 2023-10-06T02:46:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 23, 2023-10-06T02:46:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 25.665347058999998 2023-10-06T02:46:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:46:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 msgr2=0x7f1bbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc006f00 tx=0x7f1bcc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/2133883063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00c7a60 msgr2=0x7f1bd015c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00c7a60 0x7f1bd015c570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0011b10 tx=0x7f1bc00091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/2133883063 shutdown_connections 2023-10-06T02:46:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd015cab0 0x7f1bd00b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bb8004d50 0x7f1bd0145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 --2- 172.21.15.81:0/2133883063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00c7a60 0x7f1bd015c570 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/2133883063 >> 172.21.15.81:0/2133883063 conn(0x7f1bd006bb90 msgr2=0x7f1bd0156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/2133883063 shutdown_connections 2023-10-06T02:46:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.144+0000 7f1bd6b9d700 1 -- 172.21.15.81:0/2133883063 wait complete. 2023-10-06T02:46:28.162 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T02:46:28.183 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T02:46:28.183 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T02:46:28.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.183 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:46:28.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-06T02:46:28.266 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-10-06T02:46:28.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:46:28.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.268 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:46:28.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-06T02:46:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-10-06T02:46:28.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:46:28.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.389 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:46:28.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.407 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T02:46:28.479 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T02:46:28.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:46:28.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.481 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:46:28.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.537 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T02:46:28.605 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T02:46:28.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:46:28.607 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-06T02:46:28.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:46:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.720+0000 7f1038c0a700 1 Processor -- start 2023-10-06T02:46:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.720+0000 7f1038c0a700 1 -- start start 2023-10-06T02:46:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.721+0000 7f1038c0a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f103406dd60 0x7f10340b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.721+0000 7f1038c0a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10340b0ca0 con 0x7f10340cf240 2023-10-06T02:46:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.721+0000 7f1038c0a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10340b00d0 con 0x7f103415a2a0 2023-10-06T02:46:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.721+0000 7f1038c0a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103406ea90 con 0x7f103406dd60 2023-10-06T02:46:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.721+0000 7f1032d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f103406dd60 0x7f10340b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.721+0000 7f1031d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f10340cf240 0x7f103406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50402/0 (socket says 172.21.15.81:50402) 2023-10-06T02:46:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.721+0000 7f1032d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f103406dd60 0x7f10340b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48184/0 (socket says 172.21.15.81:48184) 2023-10-06T02:46:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.721+0000 7f1031d9b700 1 -- 172.21.15.81:0/1458552998 learned_addr learned my addr 172.21.15.81:0/1458552998 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f1032d9d700 1 -- 172.21.15.81:0/1458552998 >> v1:172.21.15.83:6789/0 conn(0x7f103415a2a0 legacy=0x7f10340ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f1032d9d700 1 -- 172.21.15.81:0/1458552998 >> v1:172.21.15.81:6789/0 conn(0x7f10340cf240 legacy=0x7f103406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f103159a700 1 -- 172.21.15.81:0/1458552998 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071217715 0 0) 0x7f10340b0ca0 con 0x7f10340cf240 2023-10-06T02:46:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f1032d9d700 1 -- 172.21.15.81:0/1458552998 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340b0370 con 0x7f103406dd60 2023-10-06T02:46:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f1032d9d700 1 --2- 172.21.15.81:0/1458552998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103406dd60 0x7f10340b1130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f102c0098e0 tx=0x7f102c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9873ae9d467925 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f103159a700 1 -- 172.21.15.81:0/1458552998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c009e80 con 0x7f103406dd60 2023-10-06T02:46:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f103159a700 1 -- 172.21.15.81:0/1458552998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c00b860 con 0x7f103406dd60 2023-10-06T02:46:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f103159a700 1 -- 172.21.15.81:0/1458552998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c00bbe0 con 0x7f103406dd60 2023-10-06T02:46:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f1038c0a700 1 -- 172.21.15.81:0/1458552998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103406dd60 msgr2=0x7f10340b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f1038c0a700 1 --2- 172.21.15.81:0/1458552998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103406dd60 0x7f10340b1130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f102c0098e0 tx=0x7f102c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f1038c0a700 1 -- 172.21.15.81:0/1458552998 shutdown_connections 2023-10-06T02:46:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.722+0000 7f1038c0a700 1 --2- 172.21.15.81:0/1458552998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103406dd60 0x7f10340b1130 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.723+0000 7f1038c0a700 1 -- 172.21.15.81:0/1458552998 >> 172.21.15.81:0/1458552998 conn(0x7f1034067640 msgr2=0x7f1034067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.723+0000 7f1038c0a700 1 -- 172.21.15.81:0/1458552998 shutdown_connections 2023-10-06T02:46:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.723+0000 7f1038c0a700 1 -- 172.21.15.81:0/1458552998 wait complete. 2023-10-06T02:46:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1038c0a700 1 Processor -- start 2023-10-06T02:46:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1038c0a700 1 -- start start 2023-10-06T02:46:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1038c0a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103406dd60 0x7f103416bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1038c0a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10340cf240 0x7f103415e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1038c0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103415a2a0 0x7f1034155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1038c0a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103416a970 con 0x7f103415a2a0 2023-10-06T02:46:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1038c0a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103415eb60 con 0x7f103406dd60 2023-10-06T02:46:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1038c0a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103415ee00 con 0x7f10340cf240 2023-10-06T02:46:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1032d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103415a2a0 0x7f1034155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1032d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103415a2a0 0x7f1034155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48190/0 (socket says 172.21.15.81:48190) 2023-10-06T02:46:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1032d9d700 1 -- 172.21.15.81:0/936879327 learned_addr learned my addr 172.21.15.81:0/936879327 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f103259c700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103406dd60 0x7f103416bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.724+0000 7f1031d9b700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10340cf240 0x7f103415e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f1032d9d700 1 -- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10340cf240 msgr2=0x7f103415e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f1032d9d700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10340cf240 0x7f103415e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f1032d9d700 1 -- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103406dd60 msgr2=0x7f103416bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f1032d9d700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103406dd60 0x7f103416bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f1032d9d700 1 -- 172.21.15.81:0/936879327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c009420 con 0x7f103415a2a0 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f1031d9b700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10340cf240 0x7f103415e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f1032d9d700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103415a2a0 0x7f1034155290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f103406f990 tx=0x7f102c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f102a7fc700 1 -- 172.21.15.81:0/936879327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c01f070 con 0x7f103415a2a0 2023-10-06T02:46:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f102a7fc700 1 -- 172.21.15.81:0/936879327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c011420 con 0x7f103415a2a0 2023-10-06T02:46:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103415f0e0 con 0x7f103415a2a0 2023-10-06T02:46:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f102a7fc700 1 -- 172.21.15.81:0/936879327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0117e0 con 0x7f103415a2a0 2023-10-06T02:46:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.725+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103415f6a0 con 0x7f103415a2a0 2023-10-06T02:46:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.726+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1034064650 con 0x7f103415a2a0 2023-10-06T02:46:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.726+0000 7f102a7fc700 1 -- 172.21.15.81:0/936879327 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f102c011b50 con 0x7f103415a2a0 2023-10-06T02:46:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.727+0000 7f102a7fc700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1014066f30 0x7f10140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.727+0000 7f102a7fc700 1 -- 172.21.15.81:0/936879327 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f102c085e00 con 0x7f103415a2a0 2023-10-06T02:46:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.727+0000 7f103259c700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1014066f30 0x7f10140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.727+0000 7f103259c700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1014066f30 0x7f10140693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1024007fd0 tx=0x7f1024001650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.731+0000 7f102a7fc700 1 -- 172.21.15.81:0/936879327 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1034064650 con 0x7f103415a2a0 2023-10-06T02:46:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.953+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1034064650 con 0x7f103415a2a0 2023-10-06T02:46:28.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.954+0000 7f102a7fc700 1 -- 172.21.15.81:0/936879327 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1034064650 con 0x7f103415a2a0 2023-10-06T02:46:28.955 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:46:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1014066f30 msgr2=0x7f10140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1014066f30 0x7f10140693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1024007fd0 tx=0x7f1024001650 comp rx=0 tx=0).stop 2023-10-06T02:46:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103415a2a0 msgr2=0x7f1034155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103415a2a0 0x7f1034155290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f103406f990 tx=0x7f102c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 shutdown_connections 2023-10-06T02:46:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103415a2a0 0x7f1034155290 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1014066f30 0x7f10140693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103406dd60 0x7f103416bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 --2- 172.21.15.81:0/936879327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10340cf240 0x7f103415e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 >> 172.21.15.81:0/936879327 conn(0x7f1034067640 msgr2=0x7f1034156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.955+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 shutdown_connections 2023-10-06T02:46:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:28.956+0000 7f1038c0a700 1 -- 172.21.15.81:0/936879327 wait complete. 2023-10-06T02:46:28.970 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:46:28.971 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:46:28.971 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:46:28.971 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:46:28.971 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:46:28.971 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:46:28.972 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:46:28.972 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:46:28.972 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:46:28.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.972 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:46:28.987 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:28.988 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:46:28.988 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:46:28.988 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:28.988 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:46:28.988 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:28.988 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:28.988 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:28.988 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:46:28.988 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:28.989 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:28.989 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:46:28.989 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:28.989 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:28.989 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:46:28.989 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:28.990 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:46:28.990 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42528sec preferred_lft 42528sec 2023-10-06T02:46:28.990 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:46:28.990 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:28.990 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:46:28.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:28.991 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:46:28.991 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:46:28.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:46:28.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-10-06T02:46:28.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-10-06T02:46:28.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:46:28.991 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:46:29.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:29.159 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:46:29.199 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:46:29.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:29.200 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:46:29.271 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:46:29.271 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:46:29.272 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:46:29.272 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:46:29.272 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:46:29.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:29.272 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:46:29.273 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:46:29.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:46:29.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:46:29.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:46:29.273 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:46:29.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:29.539 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:46:29.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:29.554 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-10-06T02:46:29.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:29.609 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:46:29.609 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:46:29.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:46:29.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T02:46:29.609 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:46:29.699 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T02:46:29.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:29.699 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:46:29.699 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:46:29.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T02:46:29.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:46:29.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T02:46:29.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T02:46:29.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T02:46:29.701 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:46:29.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:29.914 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:46:29.914 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:46:29.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:46:29.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:46:29.914 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:46:30.006 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:46:30.006 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:46:30.021 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:46:30.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:46:30.021 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:46:30.075 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:46:30.075 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:46:30.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:30.161 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:30.162 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:30.250 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:30.250 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:30.250 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:46:30.250 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:46:30.251 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:46:30.251 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:46:30.251 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:46:30.251 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:46:30.272 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:30.272 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:46:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:46:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:46:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:46:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:46:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:46:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:46:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:46:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:46:30.275 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:46:30.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:30.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:46:30.300 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-06T02:46:30.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:46:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.453+0000 7f59e29ca700 1 Processor -- start 2023-10-06T02:46:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.453+0000 7f59e29ca700 1 -- start start 2023-10-06T02:46:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.454+0000 7f59e29ca700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59dc1578d0 0x7f59dc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.454+0000 7f59e29ca700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0d07c0 con 0x7f59dc157ca0 2023-10-06T02:46:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.454+0000 7f59e29ca700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0cfbb0 con 0x7f59dc06d120 2023-10-06T02:46:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.454+0000 7f59e29ca700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0cfe90 con 0x7f59dc1578d0 2023-10-06T02:46:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.454+0000 7f59dbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59dc1578d0 0x7f59dc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.454+0000 7f59dbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59dc1578d0 0x7f59dc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60256/0 (socket says 172.21.15.81:60256) 2023-10-06T02:46:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.454+0000 7f59db7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f59dc157ca0 0x7f59dc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33850/0 (socket says 172.21.15.81:33850) 2023-10-06T02:46:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.454+0000 7f59dbfff700 1 -- 172.21.15.81:0/1121152066 learned_addr learned my addr 172.21.15.81:0/1121152066 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59dbfff700 1 -- 172.21.15.81:0/1121152066 >> v1:172.21.15.83:6789/0 conn(0x7f59dc06d120 legacy=0x7f59dc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59dbfff700 1 -- 172.21.15.81:0/1121152066 >> v1:172.21.15.81:6789/0 conn(0x7f59dc157ca0 legacy=0x7f59dc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59dbfff700 1 -- 172.21.15.81:0/1121152066 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0d0170 con 0x7f59dc1578d0 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59daffd700 1 -- 172.21.15.81:0/1121152066 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359701525 0 0) 0x7f59dc0d07c0 con 0x7f59dc157ca0 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59dbfff700 1 --2- 172.21.15.81:0/1121152066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 0x7f59dc0cf4f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0099b0 tx=0x7f59cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4612bc27db62d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59daffd700 1 -- 172.21.15.81:0/1121152066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00b820 con 0x7f59dc1578d0 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59daffd700 1 -- 172.21.15.81:0/1121152066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc00b980 con 0x7f59dc1578d0 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59daffd700 1 -- 172.21.15.81:0/1121152066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00bd20 con 0x7f59dc1578d0 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59e29ca700 1 -- 172.21.15.81:0/1121152066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 msgr2=0x7f59dc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59e29ca700 1 --2- 172.21.15.81:0/1121152066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 0x7f59dc0cf4f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0099b0 tx=0x7f59cc009250 comp rx=0 tx=0).stop 2023-10-06T02:46:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59e29ca700 1 -- 172.21.15.81:0/1121152066 shutdown_connections 2023-10-06T02:46:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59e29ca700 1 --2- 172.21.15.81:0/1121152066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 0x7f59dc0cf4f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59e29ca700 1 -- 172.21.15.81:0/1121152066 >> 172.21.15.81:0/1121152066 conn(0x7f59dc06bb90 msgr2=0x7f59dc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59e29ca700 1 -- 172.21.15.81:0/1121152066 shutdown_connections 2023-10-06T02:46:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.455+0000 7f59e29ca700 1 -- 172.21.15.81:0/1121152066 wait complete. 2023-10-06T02:46:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.457+0000 7f59e29ca700 1 Processor -- start 2023-10-06T02:46:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.457+0000 7f59e29ca700 1 -- start start 2023-10-06T02:46:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.457+0000 7f59e29ca700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59dc06d120 0x7f59dc0c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.457+0000 7f59e29ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 0x7f59dc154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.457+0000 7f59e29ca700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59dc157ca0 0x7f59dc156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.457+0000 7f59e29ca700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0c9710 con 0x7f59dc1578d0 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.457+0000 7f59e29ca700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0c8a90 con 0x7f59dc06d120 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.457+0000 7f59e29ca700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0c8d70 con 0x7f59dc157ca0 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59db7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 0x7f59dc154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59db7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 0x7f59dc154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60266/0 (socket says 172.21.15.81:60266) 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59db7fe700 1 -- 172.21.15.81:0/2055955709 learned_addr learned my addr 172.21.15.81:0/2055955709 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59dbfff700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59dc06d120 0x7f59dc0c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59e0f67700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59dc157ca0 0x7f59dc156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59db7fe700 1 -- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59dc157ca0 msgr2=0x7f59dc156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59db7fe700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59dc157ca0 0x7f59dc156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59db7fe700 1 -- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59dc06d120 msgr2=0x7f59dc0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59db7fe700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59dc06d120 0x7f59dc0c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59db7fe700 1 -- 172.21.15.81:0/2055955709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc0094f0 con 0x7f59dc1578d0 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59e0f67700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59dc157ca0 0x7f59dc156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59db7fe700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 0x7f59dc154e40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59d000c510 tx=0x7f59d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59c3fff700 1 -- 172.21.15.81:0/2055955709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0005a70 con 0x7f59dc1578d0 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59c3fff700 1 -- 172.21.15.81:0/2055955709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0005bf0 con 0x7f59dc1578d0 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc0c9050 con 0x7f59dc1578d0 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59c3fff700 1 -- 172.21.15.81:0/2055955709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00070d0 con 0x7f59dc1578d0 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.458+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc0c6cc0 con 0x7f59dc1578d0 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.459+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc0c9850 con 0x7f59dc1578d0 2023-10-06T02:46:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.460+0000 7f59c3fff700 1 -- 172.21.15.81:0/2055955709 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59d0007440 con 0x7f59dc1578d0 2023-10-06T02:46:30.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.460+0000 7f59c3fff700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59c8066f30 0x7f59c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:30.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.460+0000 7f59c3fff700 1 -- 172.21.15.81:0/2055955709 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f59d0083b00 con 0x7f59dc1578d0 2023-10-06T02:46:30.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.461+0000 7f59dbfff700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59c8066f30 0x7f59c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:30.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.461+0000 7f59dbfff700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59c8066f30 0x7f59c80693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0099b0 tx=0x7f59cc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.465+0000 7f59c3fff700 1 -- 172.21.15.81:0/2055955709 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59dc0c9850 con 0x7f59dc1578d0 2023-10-06T02:46:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.695+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f59dc0c9850 con 0x7f59dc1578d0 2023-10-06T02:46:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.695+0000 7f59c3fff700 1 -- 172.21.15.81:0/2055955709 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f59dc0c9850 con 0x7f59dc1578d0 2023-10-06T02:46:30.696 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:46:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59c8066f30 msgr2=0x7f59c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59c8066f30 0x7f59c80693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0099b0 tx=0x7f59cc016000 comp rx=0 tx=0).stop 2023-10-06T02:46:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 msgr2=0x7f59dc154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 0x7f59dc154e40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59d000c510 tx=0x7f59d000c8d0 comp rx=0 tx=0).stop 2023-10-06T02:46:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 shutdown_connections 2023-10-06T02:46:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59dc157ca0 0x7f59dc156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59c8066f30 0x7f59c80693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59dc06d120 0x7f59dc0c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 --2- 172.21.15.81:0/2055955709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc1578d0 0x7f59dc154e40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 >> 172.21.15.81:0/2055955709 conn(0x7f59dc06bb90 msgr2=0x7f59dc15a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 shutdown_connections 2023-10-06T02:46:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:30.697+0000 7f59e29ca700 1 -- 172.21.15.81:0/2055955709 wait complete. 2023-10-06T02:46:30.710 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:46:30.710 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:46:30.711 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:46:30.711 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T02:46:30.711 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T02:46:30.711 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:46:30.711 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:46:30.711 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:46:30.711 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T02:46:30.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:30.711 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:46:30.726 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:46:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:46:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:46:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:30.727 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:46:30.727 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:46:30.728 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:30.728 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:46:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:46:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42526sec preferred_lft 42526sec 2023-10-06T02:46:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:46:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:30.730 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:46:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:46:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:30.731 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:46:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:46:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link tentative 2023-10-06T02:46:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:30.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:30.732 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:46:30.790 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:46:30.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:30.791 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:46:30.846 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:46:30.847 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:46:30.847 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:46:30.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:46:30.847 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:46:30.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:30.847 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:46:30.847 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:46:30.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:46:30.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:46:30.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:46:30.848 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:46:30.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:30.947 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:46:30.961 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:46:30.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:30.962 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-10-06T02:46:31.015 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T02:46:31.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:31.016 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:46:31.016 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:46:31.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:46:31.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T02:46:31.016 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:46:31.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:31.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T02:46:31.136 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:46:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:46:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:46:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:31.136 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:46:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether c6:70:f9:5f:5e:7d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:46:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:46:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c470:f9ff:fe5f:5e7d/64 scope link tentative 2023-10-06T02:46:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:31.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:31.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T02:46:31.231 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:31.231 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:46:31.231 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:46:31.231 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:31.231 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:46:31.231 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:31.231 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:46:31.231 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether c6:70:f9:5f:5e:7d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:46:31.232 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:46:31.232 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:31.232 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c470:f9ff:fe5f:5e7d/64 scope link tentative 2023-10-06T02:46:31.232 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:31.240 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T02:46:31.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:31.240 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:46:31.241 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:46:31.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T02:46:31.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T02:46:31.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T02:46:31.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T02:46:31.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T02:46:31.241 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:46:31.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:31.452 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:46:31.452 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:46:31.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2023-10-06T02:46:31.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T02:46:31.452 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:46:31.532 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:46:31.532 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T02:46:31.547 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T02:46:31.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:46:31.547 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T02:46:31.601 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-06T02:46:31.601 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:46:31.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:31.682 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:31.682 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:31.701 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:31.701 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:31.701 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:46:31.702 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 2@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:46:31.702 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:46:31.702 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:46:31.702 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:46:31.702 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:46:31.722 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:31.722 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:31.722 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:46:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 2@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:46:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:46:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:46:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:46:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:46:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:46:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:46:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:46:31.724 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:46:31.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:31.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T02:46:31.789 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-06T02:46:31.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:46:31.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.943+0000 7f6a20bbc700 1 Processor -- start 2023-10-06T02:46:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.943+0000 7f6a20bbc700 1 -- start start 2023-10-06T02:46:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.944+0000 7f6a20bbc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6a1c0b3bd0 0x7f6a1c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.944+0000 7f6a20bbc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c0b2890 con 0x7f6a1c157fe0 2023-10-06T02:46:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.944+0000 7f6a20bbc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c0b4070 con 0x7f6a1c1583b0 2023-10-06T02:46:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.944+0000 7f6a20bbc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c0b4350 con 0x7f6a1c0b3bd0 2023-10-06T02:46:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.944+0000 7f6a1a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6a1c157fe0 0x7f6a1c0b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33864/0 (socket says 172.21.15.81:33864) 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.944+0000 7f6a1a59c700 1 -- 172.21.15.81:0/1529753887 learned_addr learned my addr 172.21.15.81:0/1529753887 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a19d9b700 1 --2- 172.21.15.81:0/1529753887 >> v2:172.21.15.83:3300/0 conn(0x7f6a1c0b3bd0 0x7f6a1c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497405688 0 0) 0x7f6a1c0b2890 con 0x7f6a1c157fe0 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a04003570 con 0x7f6a1c157fe0 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212880741 0 0) 0x7f6a04003570 con 0x7f6a1c157fe0 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 >> v2:172.21.15.83:3300/0 conn(0x7f6a1c0b3bd0 msgr2=0x7f6a1c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 --2- 172.21.15.81:0/1529753887 >> v2:172.21.15.83:3300/0 conn(0x7f6a1c0b3bd0 0x7f6a1c0ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 >> v1:172.21.15.83:6789/0 conn(0x7f6a1c1583b0 legacy=0x7f6a1c158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c0b4630 con 0x7f6a1c157fe0 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f6a0c0017f0 con 0x7f6a1c157fe0 2023-10-06T02:46:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 >> v1:172.21.15.81:6789/0 conn(0x7f6a1c157fe0 legacy=0x7f6a1c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a04003a60 0x7f6a04003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a04004810 0x7f6a04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a0400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0b4350 con 0x7f6a040051c0 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0400c160 con 0x7f6a04004810 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0400c320 con 0x7f6a04003a60 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1ad9d700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a0400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1a59c700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a04003a60 0x7f6a04003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a19d9b700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a04004810 0x7f6a04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1ad9d700 1 -- 172.21.15.81:0/1529753887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a04003a60 msgr2=0x7f6a04003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1ad9d700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a04003a60 0x7f6a04003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1ad9d700 1 -- 172.21.15.81:0/1529753887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a04004810 msgr2=0x7f6a04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1ad9d700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a04004810 0x7f6a04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1ad9d700 1 -- 172.21.15.81:0/1529753887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04003570 con 0x7f6a040051c0 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.945+0000 7f6a1ad9d700 1 -- 172.21.15.81:0/1529753887 reap_dead start 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a1ad9d700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a0400ba60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a140018e0 tx=0x7f6a14007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5b01c45a397162 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14012420 con 0x7f6a040051c0 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14012580 con 0x7f6a040051c0 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a1959a700 1 -- 172.21.15.81:0/1529753887 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14012920 con 0x7f6a040051c0 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a20bbc700 1 -- 172.21.15.81:0/1529753887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 msgr2=0x7f6a0400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a20bbc700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a0400ba60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a140018e0 tx=0x7f6a14007d30 comp rx=0 tx=0).stop 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a20bbc700 1 -- 172.21.15.81:0/1529753887 shutdown_connections 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a20bbc700 1 --2- 172.21.15.81:0/1529753887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a0400ba60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a20bbc700 1 -- 172.21.15.81:0/1529753887 >> 172.21.15.81:0/1529753887 conn(0x7f6a1c067640 msgr2=0x7f6a1c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:31.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a20bbc700 1 -- 172.21.15.81:0/1529753887 shutdown_connections 2023-10-06T02:46:31.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.946+0000 7f6a20bbc700 1 -- 172.21.15.81:0/1529753887 wait complete. 2023-10-06T02:46:31.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.947+0000 7f6a20bbc700 1 Processor -- start 2023-10-06T02:46:31.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.947+0000 7f6a20bbc700 1 -- start start 2023-10-06T02:46:31.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a20bbc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a1c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a20bbc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a1c0c6500 0x7f6a1c0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a20bbc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a1c159fc0 0x7f6a1c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a20bbc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0c6eb0 con 0x7f6a040051c0 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a20bbc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0c4900 con 0x7f6a1c0c6500 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a20bbc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0c3cf0 con 0x7f6a1c159fc0 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a1a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a1c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a1a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a1c13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60282/0 (socket says 172.21.15.81:60282) 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a1a59c700 1 -- 172.21.15.81:0/4101981810 learned_addr learned my addr 172.21.15.81:0/4101981810 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a19d9b700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a1c0c6500 0x7f6a1c0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:31.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a1ad9d700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a1c159fc0 0x7f6a1c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a1a59c700 1 -- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a1c159fc0 msgr2=0x7f6a1c15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a1a59c700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a1c159fc0 0x7f6a1c15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a1a59c700 1 -- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a1c0c6500 msgr2=0x7f6a1c0c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a1a59c700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a1c0c6500 0x7f6a1c0c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.948+0000 7f6a1a59c700 1 -- 172.21.15.81:0/4101981810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c0c3fd0 con 0x7f6a040051c0 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.949+0000 7f6a1a59c700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a1c13f420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c001920 tx=0x7f6a0c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.949+0000 7f6a0a7fc700 1 -- 172.21.15.81:0/4101981810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00ac30 con 0x7f6a040051c0 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.949+0000 7f6a0a7fc700 1 -- 172.21.15.81:0/4101981810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c00adb0 con 0x7f6a040051c0 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.949+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c0c42b0 con 0x7f6a040051c0 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.949+0000 7f6a0a7fc700 1 -- 172.21.15.81:0/4101981810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c013640 con 0x7f6a040051c0 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.949+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c15a970 con 0x7f6a040051c0 2023-10-06T02:46:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.950+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c064650 con 0x7f6a040051c0 2023-10-06T02:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.950+0000 7f6a0a7fc700 1 -- 172.21.15.81:0/4101981810 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a0c0139b0 con 0x7f6a040051c0 2023-10-06T02:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.950+0000 7f6a0a7fc700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f69fc066f60 0x7f69fc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.950+0000 7f6a0a7fc700 1 -- 172.21.15.81:0/4101981810 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a0c085280 con 0x7f6a040051c0 2023-10-06T02:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.951+0000 7f6a19d9b700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f69fc066f60 0x7f69fc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.951+0000 7f6a19d9b700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f69fc066f60 0x7f69fc069410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c15ad30 tx=0x7f6a100091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:31.955+0000 7f6a0a7fc700 1 -- 172.21.15.81:0/4101981810 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a1c064650 con 0x7f6a040051c0 2023-10-06T02:46:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.179+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a1c064650 con 0x7f6a040051c0 2023-10-06T02:46:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.179+0000 7f6a0a7fc700 1 -- 172.21.15.81:0/4101981810 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a1c064650 con 0x7f6a040051c0 2023-10-06T02:46:32.180 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:46:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f69fc066f60 msgr2=0x7f69fc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f69fc066f60 0x7f69fc069410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c15ad30 tx=0x7f6a100091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 msgr2=0x7f6a1c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a1c13f420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c001920 tx=0x7f6a0c0021d0 comp rx=0 tx=0).stop 2023-10-06T02:46:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 shutdown_connections 2023-10-06T02:46:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a1c159fc0 0x7f6a1c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040051c0 0x7f6a1c13f420 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f69fc066f60 0x7f69fc069410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:32.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 --2- 172.21.15.81:0/4101981810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a1c0c6500 0x7f6a1c0c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:32.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 >> 172.21.15.81:0/4101981810 conn(0x7f6a1c067640 msgr2=0x7f6a1c1538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:32.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 shutdown_connections 2023-10-06T02:46:32.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:32.181+0000 7f6a20bbc700 1 -- 172.21.15.81:0/4101981810 wait complete. 2023-10-06T02:46:32.194 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:46:32.194 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:46:32.194 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:46:32.194 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:46:32.194 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:46:32.194 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:46:32.194 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:46:32.194 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:46:32.195 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:46:32.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:32.195 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:46:32.214 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:32.214 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:46:32.215 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:46:32.215 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:32.215 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:46:32.215 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:32.215 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:32.215 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:32.216 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:46:32.216 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:32.216 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:32.216 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:46:32.216 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:32.217 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:32.217 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:46:32.217 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:32.217 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:46:32.217 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42524sec preferred_lft 42524sec 2023-10-06T02:46:32.217 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:46:32.218 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:32.218 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:46:32.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:32.219 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:46:32.219 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:46:32.219 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:46:32.219 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2023-10-06T02:46:32.219 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2023-10-06T02:46:32.219 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:46:32.219 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:46:32.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:32.385 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:46:32.427 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:46:32.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:32.429 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:46:32.506 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:46:32.506 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:46:32.506 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:46:32.506 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:46:32.506 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:46:32.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:32.507 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:46:32.507 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:46:32.507 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:46:32.507 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:46:32.507 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:46:32.507 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:46:32.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:32.743 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:46:32.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:32.758 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-10-06T02:46:32.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:32.812 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:46:32.813 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:46:32.813 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:46:32.813 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T02:46:32.813 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:46:32.902 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T02:46:32.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:32.902 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:46:32.902 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:46:32.902 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T02:46:32.902 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:46:32.903 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T02:46:32.903 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T02:46:32.903 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T02:46:32.903 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:46:33.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:33.080 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:46:33.080 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:46:33.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:46:33.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:46:33.080 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:46:33.172 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:46:33.172 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:46:33.186 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:46:33.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:46:33.187 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:46:33.241 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:46:33.241 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:46:33.241 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:33.333 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:33.333 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:33.416 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:33.416 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:33.416 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:46:33.416 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:46:33.416 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:46:33.416 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:46:33.416 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:46:33.416 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:46:33.436 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:46:33.437 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:46:33.439 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:46:33.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:33.439 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:46:33.463 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-06T02:46:33.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:46:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.581+0000 7ff11959c700 1 Processor -- start 2023-10-06T02:46:33.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.581+0000 7ff11959c700 1 -- start start 2023-10-06T02:46:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff11959c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff1140ce5c0 0x7ff1140aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff11959c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ac570 0x7ff11406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff11959c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11415dfb0 con 0x7ff1140ce1f0 2023-10-06T02:46:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff11959c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1140acec0 con 0x7ff1140ce5c0 2023-10-06T02:46:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff11959c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140ad1a0 con 0x7ff1140ac570 2023-10-06T02:46:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff1127fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff1140ce5c0 0x7ff1140aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff1137fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ac570 0x7ff11406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff1137fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ac570 0x7ff11406e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:38936/0 (socket says 172.21.15.81:38936) 2023-10-06T02:46:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff1127fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff1140ce5c0 0x7ff1140aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:41222/0 (socket says 172.21.15.81:41222) 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff1137fe700 1 -- 172.21.15.81:0/2874777457 learned_addr learned my addr 172.21.15.81:0/2874777457 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.582+0000 7ff112ffd700 1 --1- 172.21.15.81:0/2874777457 >> v1:172.21.15.83:6789/0 conn(0x7ff1140ce1f0 0x7ff11415e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:59234/0 (socket says 172.21.15.81:59234) 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff1127fc700 1 -- 172.21.15.81:0/2874777457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ac570 msgr2=0x7ff11406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff1127fc700 1 --2- 172.21.15.81:0/2874777457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ac570 0x7ff11406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff1127fc700 1 -- 172.21.15.81:0/2874777457 >> v1:172.21.15.83:6789/0 conn(0x7ff1140ce1f0 legacy=0x7ff11415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff111ffb700 1 -- 172.21.15.81:0/2874777457 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062594633 0 0) 0x7ff11415dfb0 con 0x7ff1140ce1f0 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff1127fc700 1 -- 172.21.15.81:0/2874777457 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11415dc40 con 0x7ff1140ce5c0 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff1137fe700 1 --2- 172.21.15.81:0/2874777457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ac570 0x7ff11406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff1127fc700 1 --2- 172.21.15.81:0/2874777457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1140ce5c0 0x7ff1140aacf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1080098e0 tx=0x7ff1080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfe94ff01d5ca330 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff111ffb700 1 -- 172.21.15.81:0/2874777457 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800b640 con 0x7ff1140ce5c0 2023-10-06T02:46:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff111ffb700 1 -- 172.21.15.81:0/2874777457 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10800b7a0 con 0x7ff1140ce5c0 2023-10-06T02:46:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff111ffb700 1 -- 172.21.15.81:0/2874777457 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800bb40 con 0x7ff1140ce5c0 2023-10-06T02:46:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff11959c700 1 -- 172.21.15.81:0/2874777457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1140ce5c0 msgr2=0x7ff1140aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff11959c700 1 --2- 172.21.15.81:0/2874777457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1140ce5c0 0x7ff1140aacf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1080098e0 tx=0x7ff1080091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff11959c700 1 -- 172.21.15.81:0/2874777457 shutdown_connections 2023-10-06T02:46:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff11959c700 1 --2- 172.21.15.81:0/2874777457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ac570 0x7ff11406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff11959c700 1 --2- 172.21.15.81:0/2874777457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1140ce5c0 0x7ff1140aacf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.583+0000 7ff11959c700 1 -- 172.21.15.81:0/2874777457 >> 172.21.15.81:0/2874777457 conn(0x7ff11406cca0 msgr2=0x7ff11406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.584+0000 7ff11959c700 1 -- 172.21.15.81:0/2874777457 shutdown_connections 2023-10-06T02:46:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.584+0000 7ff11959c700 1 -- 172.21.15.81:0/2874777457 wait complete. 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.585+0000 7ff11959c700 1 Processor -- start 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.585+0000 7ff11959c700 1 -- start start 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.585+0000 7ff11959c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1140ac570 0x7ff1140c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.585+0000 7ff11959c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1140ce1f0 0x7ff1140c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.585+0000 7ff11959c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ce5c0 0x7ff114159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.585+0000 7ff11959c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11416aab0 con 0x7ff1140ce1f0 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.585+0000 7ff11959c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11415d120 con 0x7ff1140ac570 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.585+0000 7ff11959c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140c37d0 con 0x7ff1140ce5c0 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1127fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1140ce1f0 0x7ff1140c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1127fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1140ce1f0 0x7ff1140c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60296/0 (socket says 172.21.15.81:60296) 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1127fc700 1 -- 172.21.15.81:0/2319779448 learned_addr learned my addr 172.21.15.81:0/2319779448 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1137fe700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ce5c0 0x7ff114159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff112ffd700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1140ac570 0x7ff1140c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1127fc700 1 -- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ce5c0 msgr2=0x7ff114159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1127fc700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ce5c0 0x7ff114159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1127fc700 1 -- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1140ac570 msgr2=0x7ff1140c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1127fc700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1140ac570 0x7ff1140c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1127fc700 1 -- 172.21.15.81:0/2319779448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0094f0 con 0x7ff1140ce1f0 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff1127fc700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1140ce1f0 0x7ff1140c49e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff1080093f0 tx=0x7ff108017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff0faffd700 1 -- 172.21.15.81:0/2319779448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800bb20 con 0x7ff1140ce1f0 2023-10-06T02:46:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff0faffd700 1 -- 172.21.15.81:0/2319779448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff108000c90 con 0x7ff1140ce1f0 2023-10-06T02:46:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff108009420 con 0x7ff1140ce1f0 2023-10-06T02:46:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff0faffd700 1 -- 172.21.15.81:0/2319779448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108011670 con 0x7ff1140ce1f0 2023-10-06T02:46:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.586+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1140c34f0 con 0x7ff1140ce1f0 2023-10-06T02:46:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.587+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff114068900 con 0x7ff1140ce1f0 2023-10-06T02:46:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.587+0000 7ff0faffd700 1 -- 172.21.15.81:0/2319779448 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff108011a20 con 0x7ff1140ce1f0 2023-10-06T02:46:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.588+0000 7ff0faffd700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff100066f30 0x7ff1000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.588+0000 7ff0faffd700 1 -- 172.21.15.81:0/2319779448 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff108085be0 con 0x7ff1140ce1f0 2023-10-06T02:46:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.588+0000 7ff112ffd700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff100066f30 0x7ff1000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.588+0000 7ff112ffd700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff100066f30 0x7ff1000693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff104001560 tx=0x7ff104001b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.592+0000 7ff0faffd700 1 -- 172.21.15.81:0/2319779448 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff108052cf0 con 0x7ff1140ce1f0 2023-10-06T02:46:33.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.818+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff1140aca10 con 0x7ff1140ce1f0 2023-10-06T02:46:33.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.818+0000 7ff0faffd700 1 -- 172.21.15.81:0/2319779448 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff108056310 con 0x7ff1140ce1f0 2023-10-06T02:46:33.819 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:46:33.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff100066f30 msgr2=0x7ff1000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:33.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff100066f30 0x7ff1000693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff104001560 tx=0x7ff104001b00 comp rx=0 tx=0).stop 2023-10-06T02:46:33.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1140ce1f0 msgr2=0x7ff1140c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:33.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1140ce1f0 0x7ff1140c49e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff1080093f0 tx=0x7ff108017000 comp rx=0 tx=0).stop 2023-10-06T02:46:33.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 shutdown_connections 2023-10-06T02:46:33.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1140ce5c0 0x7ff114159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff100066f30 0x7ff1000693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1140ac570 0x7ff1140c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 --2- 172.21.15.81:0/2319779448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1140ce1f0 0x7ff1140c49e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:33.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 >> 172.21.15.81:0/2319779448 conn(0x7ff11406cca0 msgr2=0x7ff11406e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:33.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 shutdown_connections 2023-10-06T02:46:33.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:33.820+0000 7ff11959c700 1 -- 172.21.15.81:0/2319779448 wait complete. 2023-10-06T02:46:33.833 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:46:33.833 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:46:33.833 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:46:33.833 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T02:46:33.833 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T02:46:33.833 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:46:33.834 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:46:33.834 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:46:33.834 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T02:46:33.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:33.834 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:46:33.850 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42523sec preferred_lft 42523sec 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:46:33.851 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:46:33.852 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:33.852 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:46:33.852 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:33.852 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:46:33.852 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:46:33.852 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link tentative 2023-10-06T02:46:33.852 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:33.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:33.853 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:46:33.914 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:46:33.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:33.915 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:46:33.972 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:46:33.972 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:46:33.972 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:46:33.972 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:46:33.972 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:46:33.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:33.973 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:46:33.973 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:46:33.973 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:46:33.973 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:46:33.973 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:46:33.973 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:46:34.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:34.072 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:46:34.086 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:46:34.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:34.087 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-10-06T02:46:34.141 INFO:teuthology.orchestra.run.smithi083.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T02:46:34.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:34.141 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:46:34.141 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:46:34.141 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:46:34.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T02:46:34.142 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:46:34.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:34.229 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 1e:69:a1:b2:b2:a2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:46:34.268 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:34.269 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::1c69:a1ff:feb2:b2a2/64 scope link tentative 2023-10-06T02:46:34.269 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:34.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:34.280 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T02:46:34.356 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:46:34.356 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:46:34.356 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:46:34.356 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:34.356 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:46:34.356 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:34.356 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:46:34.356 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 1e:69:a1:b2:b2:a2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:46:34.356 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:46:34.357 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:34.357 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::1c69:a1ff:feb2:b2a2/64 scope link tentative 2023-10-06T02:46:34.357 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:46:34.368 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T02:46:34.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:34.369 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:46:34.369 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:46:34.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T02:46:34.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T02:46:34.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T02:46:34.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T02:46:34.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T02:46:34.369 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:46:34.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:34.587 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:46:34.587 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:46:34.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.1 up 2023-10-06T02:46:34.588 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T02:46:34.588 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:46:34.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:46:34.667 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T02:46:34.682 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T02:46:34.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:46:34.682 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T02:46:34.737 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-06T02:46:34.737 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:46:34.737 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:34.818 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:34.819 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:34.837 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:34.837 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:34.838 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:46:34.838 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 3@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:46:34.838 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:46:34.838 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:46:34.838 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:46:34.838 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:46:34.858 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:46:34.858 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:46:34.858 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:46:34.858 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 3@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:46:34.858 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:46:34.858 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:46:34.859 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:46:34.859 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:46:34.859 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:46:34.859 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:46:34.859 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:46:34.860 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:46:34.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:34.860 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T02:46:34.924 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T02:46:34.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.060+0000 7f4d6c4fd700 1 Processor -- start 2023-10-06T02:46:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.060+0000 7f4d6c4fd700 1 -- start start 2023-10-06T02:46:35.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.061+0000 7f4d6c4fd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d64157ca0 0x7f4d640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.061+0000 7f4d6c4fd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d6406d120 0x7f4d6406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.061+0000 7f4d6c4fd700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d640d07c0 con 0x7f4d641578d0 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.061+0000 7f4d6c4fd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6406da50 con 0x7f4d64157ca0 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.061+0000 7f4d6c4fd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d640cfbb0 con 0x7f4d6406d120 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.061+0000 7f4d69a98700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d64157ca0 0x7f4d640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.061+0000 7f4d69a98700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d64157ca0 0x7f4d640cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60300/0 (socket says 172.21.15.81:60300) 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.061+0000 7f4d69a98700 1 -- 172.21.15.81:0/3824174503 learned_addr learned my addr 172.21.15.81:0/3824174503 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.061+0000 7f4d6aa9a700 1 --2- 172.21.15.81:0/3824174503 >> v2:172.21.15.83:3300/0 conn(0x7f4d6406d120 0x7f4d6406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d69a98700 1 -- 172.21.15.81:0/3824174503 >> v2:172.21.15.83:3300/0 conn(0x7f4d6406d120 msgr2=0x7f4d6406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d69a98700 1 --2- 172.21.15.81:0/3824174503 >> v2:172.21.15.83:3300/0 conn(0x7f4d6406d120 0x7f4d6406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d69a98700 1 -- 172.21.15.81:0/3824174503 >> v1:172.21.15.83:6789/0 conn(0x7f4d641578d0 legacy=0x7f4d6415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d69a98700 1 -- 172.21.15.81:0/3824174503 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640cfe90 con 0x7f4d64157ca0 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d69a98700 1 --2- 172.21.15.81:0/3824174503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 0x7f4d640cf4f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d64068300 tx=0x7f4d54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb7275c9c181118 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d69297700 1 -- 172.21.15.81:0/3824174503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54009e70 con 0x7f4d64157ca0 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d69297700 1 -- 172.21.15.81:0/3824174503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5400b860 con 0x7f4d64157ca0 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d69297700 1 -- 172.21.15.81:0/3824174503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400bc00 con 0x7f4d64157ca0 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/3824174503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 msgr2=0x7f4d640cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d6c4fd700 1 --2- 172.21.15.81:0/3824174503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 0x7f4d640cf4f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d64068300 tx=0x7f4d54009250 comp rx=0 tx=0).stop 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/3824174503 shutdown_connections 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d6c4fd700 1 --2- 172.21.15.81:0/3824174503 >> v2:172.21.15.83:3300/0 conn(0x7f4d6406d120 0x7f4d6406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d6c4fd700 1 --2- 172.21.15.81:0/3824174503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 0x7f4d640cf4f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/3824174503 >> 172.21.15.81:0/3824174503 conn(0x7f4d6406bb90 msgr2=0x7f4d6406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/3824174503 shutdown_connections 2023-10-06T02:46:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.062+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/3824174503 wait complete. 2023-10-06T02:46:35.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.063+0000 7f4d6c4fd700 1 Processor -- start 2023-10-06T02:46:35.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6c4fd700 1 -- start start 2023-10-06T02:46:35.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6c4fd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d6406d120 0x7f4d64153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6c4fd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d641578d0 0x7f4d640b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6c4fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 0x7f4d6415c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6c4fd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640adde0 con 0x7f4d64157ca0 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6c4fd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6416dfd0 con 0x7f4d641578d0 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6c4fd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640b2700 con 0x7f4d6406d120 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6aa9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 0x7f4d6415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6aa9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 0x7f4d6415c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60306/0 (socket says 172.21.15.81:60306) 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6aa9a700 1 -- 172.21.15.81:0/911614298 learned_addr learned my addr 172.21.15.81:0/911614298 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d69a98700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d641578d0 0x7f4d640b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.064+0000 7f4d6a299700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d6406d120 0x7f4d64153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d6aa9a700 1 -- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d6406d120 msgr2=0x7f4d64153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d6aa9a700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d6406d120 0x7f4d64153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d6aa9a700 1 -- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d641578d0 msgr2=0x7f4d640b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d6aa9a700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d641578d0 0x7f4d640b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d6aa9a700 1 -- 172.21.15.81:0/911614298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540094f0 con 0x7f4d64157ca0 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d6aa9a700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 0x7f4d6415c820 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00ea50 tx=0x7f4d5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d5a7fc700 1 -- 172.21.15.81:0/911614298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00ee90 con 0x7f4d64157ca0 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d5a7fc700 1 -- 172.21.15.81:0/911614298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00c850 con 0x7f4d64157ca0 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6416d980 con 0x7f4d64157ca0 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d5a7fc700 1 -- 172.21.15.81:0/911614298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00cc10 con 0x7f4d64157ca0 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.065+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d640b22f0 con 0x7f4d64157ca0 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.066+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6416d7e0 con 0x7f4d64157ca0 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.066+0000 7f4d5a7fc700 1 -- 172.21.15.81:0/911614298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d5c013470 con 0x7f4d64157ca0 2023-10-06T02:46:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.067+0000 7f4d5a7fc700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4d48066f30 0x7f4d480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.067+0000 7f4d5a7fc700 1 -- 172.21.15.81:0/911614298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4d5c084980 con 0x7f4d64157ca0 2023-10-06T02:46:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.067+0000 7f4d6a299700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4d48066f30 0x7f4d480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.067+0000 7f4d6a299700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4d48066f30 0x7f4d480693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4d60007fd0 tx=0x7f4d600016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:35.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.071+0000 7f4d5a7fc700 1 -- 172.21.15.81:0/911614298 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d6416d7e0 con 0x7f4d64157ca0 2023-10-06T02:46:35.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.255+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d6416d7e0 con 0x7f4d64157ca0 2023-10-06T02:46:35.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.256+0000 7f4d5a7fc700 1 -- 172.21.15.81:0/911614298 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f4d6416d7e0 con 0x7f4d64157ca0 2023-10-06T02:46:35.257 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:35.257 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4d48066f30 msgr2=0x7f4d480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4d48066f30 0x7f4d480693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4d60007fd0 tx=0x7f4d600016f0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 msgr2=0x7f4d6415c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 0x7f4d6415c820 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00ea50 tx=0x7f4d5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 shutdown_connections 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d64157ca0 0x7f4d6415c820 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d6406d120 0x7f4d64153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4d48066f30 0x7f4d480693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 --2- 172.21.15.81:0/911614298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d641578d0 0x7f4d640b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 >> 172.21.15.81:0/911614298 conn(0x7f4d6406bb90 msgr2=0x7f4d64154960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 shutdown_connections 2023-10-06T02:46:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.258+0000 7f4d6c4fd700 1 -- 172.21.15.81:0/911614298 wait complete. 2023-10-06T02:46:35.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:46:05.360665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:46:05.837671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:46:35.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:35.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.388+0000 7f5eeb024700 1 Processor -- start 2023-10-06T02:46:35.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.388+0000 7f5eeb024700 1 -- start start 2023-10-06T02:46:35.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eeb024700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee406d700 0x7f5ee415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eeb024700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee40cf2d0 con 0x7f5ee40d0b80 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eeb024700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee40d0480 con 0x7f5ee40d0f50 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eeb024700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee415a690 con 0x7f5ee406d700 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eea022700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ee40d0b80 0x7f5ee40cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33876/0 (socket says 172.21.15.81:33876) 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eea022700 1 -- 172.21.15.81:0/2970611785 learned_addr learned my addr 172.21.15.81:0/2970611785 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eea823700 1 --2- 172.21.15.81:0/2970611785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee406d700 0x7f5ee415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5ee9020700 1 -- 172.21.15.81:0/2970611785 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138243674 0 0) 0x7f5ee40cf2d0 con 0x7f5ee40d0b80 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5ee9020700 1 -- 172.21.15.81:0/2970611785 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed0003570 con 0x7f5ee40d0b80 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5ee9020700 1 -- 172.21.15.81:0/2970611785 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945653790 0 0) 0x7f5ee40d0480 con 0x7f5ee40d0f50 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5ee9020700 1 -- 172.21.15.81:0/2970611785 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee40cf2d0 con 0x7f5ee40d0f50 2023-10-06T02:46:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eea823700 1 -- 172.21.15.81:0/2970611785 >> v1:172.21.15.83:6789/0 conn(0x7f5ee40d0f50 legacy=0x7f5ee406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eea823700 1 -- 172.21.15.81:0/2970611785 >> v1:172.21.15.81:6789/0 conn(0x7f5ee40d0b80 legacy=0x7f5ee40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5ee9020700 1 -- 172.21.15.81:0/2970611785 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1421539749 0 0) 0x7f5ed0003570 con 0x7f5ee40d0b80 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.389+0000 7f5eea823700 1 -- 172.21.15.81:0/2970611785 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee406dc00 con 0x7f5ee406d700 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5eea823700 1 --2- 172.21.15.81:0/2970611785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee406d700 0x7f5ee415b320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009910 tx=0x7f5ee00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34788daa5b57ebe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5ee9020700 1 -- 172.21.15.81:0/2970611785 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0017f0 con 0x7f5ee406d700 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5ee9020700 1 -- 172.21.15.81:0/2970611785 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee0011420 con 0x7f5ee406d700 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5ee9020700 1 -- 172.21.15.81:0/2970611785 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00117c0 con 0x7f5ee406d700 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5eeb024700 1 -- 172.21.15.81:0/2970611785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee406d700 msgr2=0x7f5ee415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5eeb024700 1 --2- 172.21.15.81:0/2970611785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee406d700 0x7f5ee415b320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009910 tx=0x7f5ee00091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5eeb024700 1 -- 172.21.15.81:0/2970611785 shutdown_connections 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5eeb024700 1 --2- 172.21.15.81:0/2970611785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee406d700 0x7f5ee415b320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5eeb024700 1 -- 172.21.15.81:0/2970611785 >> 172.21.15.81:0/2970611785 conn(0x7f5ee4063230 msgr2=0x7f5ee4063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5eeb024700 1 -- 172.21.15.81:0/2970611785 shutdown_connections 2023-10-06T02:46:35.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.390+0000 7f5eeb024700 1 -- 172.21.15.81:0/2970611785 wait complete. 2023-10-06T02:46:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.391+0000 7f5eeb024700 1 Processor -- start 2023-10-06T02:46:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.391+0000 7f5eeb024700 1 -- start start 2023-10-06T02:46:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eeb024700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406d700 0x7f5ee4153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eeb024700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ee40d0b80 0x7f5ee40b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eeb024700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee40d0f50 0x7f5ee414fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eeb024700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40b5750 con 0x7f5ee406d700 2023-10-06T02:46:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eeb024700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40b4b40 con 0x7f5ee40d0b80 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eeb024700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40b4e20 con 0x7f5ee40d0f50 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eea022700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406d700 0x7f5ee4153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eea022700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406d700 0x7f5ee4153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60322/0 (socket says 172.21.15.81:60322) 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eea022700 1 -- 172.21.15.81:0/1261019459 learned_addr learned my addr 172.21.15.81:0/1261019459 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eea823700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee40d0f50 0x7f5ee414fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5ee9821700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ee40d0b80 0x7f5ee40b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eea022700 1 -- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee40d0f50 msgr2=0x7f5ee414fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eea022700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee40d0f50 0x7f5ee414fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eea022700 1 -- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ee40d0b80 msgr2=0x7f5ee40b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eea022700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ee40d0b80 0x7f5ee40b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.392+0000 7f5eea022700 1 -- 172.21.15.81:0/1261019459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0009420 con 0x7f5ee406d700 2023-10-06T02:46:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.393+0000 7f5eea022700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406d700 0x7f5ee4153120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00cca0 tx=0x7f5edc007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.393+0000 7f5eda7fc700 1 -- 172.21.15.81:0/1261019459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc004dc0 con 0x7f5ee406d700 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.393+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee40b5100 con 0x7f5ee406d700 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.393+0000 7f5eda7fc700 1 -- 172.21.15.81:0/1261019459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc00a920 con 0x7f5ee406d700 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.393+0000 7f5eda7fc700 1 -- 172.21.15.81:0/1261019459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00ace0 con 0x7f5ee406d700 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.393+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee40b4830 con 0x7f5ee406d700 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.394+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee40676e0 con 0x7f5ee406d700 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.394+0000 7f5eda7fc700 1 -- 172.21.15.81:0/1261019459 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5edc007360 con 0x7f5ee406d700 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.394+0000 7f5eda7fc700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ec8066f30 0x7f5ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.394+0000 7f5eda7fc700 1 -- 172.21.15.81:0/1261019459 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5edc083f40 con 0x7f5ee406d700 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.394+0000 7f5ee9821700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ec8066f30 0x7f5ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.395+0000 7f5ee9821700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ec8066f30 0x7f5ec80693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40b6620 tx=0x7f5ed4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.398+0000 7f5eda7fc700 1 -- 172.21.15.81:0/1261019459 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5edc051050 con 0x7f5ee406d700 2023-10-06T02:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.578+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ee40cf570 con 0x7f5ee406d700 2023-10-06T02:46:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.579+0000 7f5eda7fc700 1 -- 172.21.15.81:0/1261019459 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5edc0180a0 con 0x7f5ee406d700 2023-10-06T02:46:35.580 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ec8066f30 msgr2=0x7f5ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ec8066f30 0x7f5ec80693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40b6620 tx=0x7f5ed4009040 comp rx=0 tx=0).stop 2023-10-06T02:46:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406d700 msgr2=0x7f5ee4153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406d700 0x7f5ee4153120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00cca0 tx=0x7f5edc007da0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 shutdown_connections 2023-10-06T02:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ee40d0f50 0x7f5ee414fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406d700 0x7f5ee4153120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ec8066f30 0x7f5ec80693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 --2- 172.21.15.81:0/1261019459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ee40d0b80 0x7f5ee40b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 >> 172.21.15.81:0/1261019459 conn(0x7f5ee4063230 msgr2=0x7f5ee41519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 shutdown_connections 2023-10-06T02:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.581+0000 7f5eeb024700 1 -- 172.21.15.81:0/1261019459 wait complete. 2023-10-06T02:46:35.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.710+0000 7fcb777c3700 1 Processor -- start 2023-10-06T02:46:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.710+0000 7fcb777c3700 1 -- start start 2023-10-06T02:46:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb777c3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb70157ca0 0x7fcb700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb777c3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcb7006d120 0x7fcb7006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb777c3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb700d07c0 con 0x7fcb701578d0 2023-10-06T02:46:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb777c3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7006da50 con 0x7fcb70157ca0 2023-10-06T02:46:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb777c3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700cfbb0 con 0x7fcb7006d120 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb74d5e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb70157ca0 0x7fcb700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb74d5e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb70157ca0 0x7fcb700cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60338/0 (socket says 172.21.15.81:60338) 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb74d5e700 1 -- 172.21.15.81:0/3526109050 learned_addr learned my addr 172.21.15.81:0/3526109050 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb75d60700 1 --2- 172.21.15.81:0/3526109050 >> v2:172.21.15.83:3300/0 conn(0x7fcb7006d120 0x7fcb7006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb74d5e700 1 -- 172.21.15.81:0/3526109050 >> v2:172.21.15.83:3300/0 conn(0x7fcb7006d120 msgr2=0x7fcb7006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb74d5e700 1 --2- 172.21.15.81:0/3526109050 >> v2:172.21.15.83:3300/0 conn(0x7fcb7006d120 0x7fcb7006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb74d5e700 1 -- 172.21.15.81:0/3526109050 >> v1:172.21.15.83:6789/0 conn(0x7fcb701578d0 legacy=0x7fcb7015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb74d5e700 1 -- 172.21.15.81:0/3526109050 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700cfe90 con 0x7fcb70157ca0 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb74d5e700 1 --2- 172.21.15.81:0/3526109050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70157ca0 0x7fcb700cf4f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcb70068300 tx=0x7fcb60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852c48b12801ea4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb67fff700 1 -- 172.21.15.81:0/3526109050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000b820 con 0x7fcb70157ca0 2023-10-06T02:46:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb67fff700 1 -- 172.21.15.81:0/3526109050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6000b980 con 0x7fcb70157ca0 2023-10-06T02:46:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.711+0000 7fcb67fff700 1 -- 172.21.15.81:0/3526109050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000bd20 con 0x7fcb70157ca0 2023-10-06T02:46:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.712+0000 7fcb777c3700 1 -- 172.21.15.81:0/3526109050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70157ca0 msgr2=0x7fcb700cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.712+0000 7fcb777c3700 1 --2- 172.21.15.81:0/3526109050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70157ca0 0x7fcb700cf4f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcb70068300 tx=0x7fcb60009250 comp rx=0 tx=0).stop 2023-10-06T02:46:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.712+0000 7fcb777c3700 1 -- 172.21.15.81:0/3526109050 shutdown_connections 2023-10-06T02:46:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.712+0000 7fcb777c3700 1 --2- 172.21.15.81:0/3526109050 >> v2:172.21.15.83:3300/0 conn(0x7fcb7006d120 0x7fcb7006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.712+0000 7fcb777c3700 1 --2- 172.21.15.81:0/3526109050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70157ca0 0x7fcb700cf4f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.712+0000 7fcb777c3700 1 -- 172.21.15.81:0/3526109050 >> 172.21.15.81:0/3526109050 conn(0x7fcb7006bb90 msgr2=0x7fcb7006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.712+0000 7fcb777c3700 1 -- 172.21.15.81:0/3526109050 shutdown_connections 2023-10-06T02:46:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.712+0000 7fcb777c3700 1 -- 172.21.15.81:0/3526109050 wait complete. 2023-10-06T02:46:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.713+0000 7fcb777c3700 1 Processor -- start 2023-10-06T02:46:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.713+0000 7fcb777c3700 1 -- start start 2023-10-06T02:46:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb777c3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb7006d120 0x7fcb7015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb777c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb701578d0 0x7fcb7015e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb777c3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb70157ca0 0x7fcb701484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb777c3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700c8180 con 0x7fcb701578d0 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb777c3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700c7570 con 0x7fcb70157ca0 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb777c3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700c7850 con 0x7fcb7006d120 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb74d5e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb701578d0 0x7fcb7015e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb74d5e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb701578d0 0x7fcb7015e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60352/0 (socket says 172.21.15.81:60352) 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb74d5e700 1 -- 172.21.15.81:0/1712943006 learned_addr learned my addr 172.21.15.81:0/1712943006 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb7555f700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb7006d120 0x7fcb7015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb75d60700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb70157ca0 0x7fcb701484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb74d5e700 1 -- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb7006d120 msgr2=0x7fcb7015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb74d5e700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb7006d120 0x7fcb7015dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb74d5e700 1 -- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb70157ca0 msgr2=0x7fcb701484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb74d5e700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb70157ca0 0x7fcb701484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb74d5e700 1 -- 172.21.15.81:0/1712943006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb600094f0 con 0x7fcb701578d0 2023-10-06T02:46:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb7555f700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb7006d120 0x7fcb7015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.714+0000 7fcb75d60700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb70157ca0 0x7fcb701484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.715+0000 7fcb74d5e700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb701578d0 0x7fcb7015e260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcb600030c0 tx=0x7fcb60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.715+0000 7fcb657fa700 1 -- 172.21.15.81:0/1712943006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60011e60 con 0x7fcb701578d0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.715+0000 7fcb657fa700 1 -- 172.21.15.81:0/1712943006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb60020070 con 0x7fcb701578d0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.715+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb700c7b30 con 0x7fcb701578d0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.715+0000 7fcb657fa700 1 -- 172.21.15.81:0/1712943006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6001b6a0 con 0x7fcb701578d0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.715+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb700c8610 con 0x7fcb701578d0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.716+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb70067ac0 con 0x7fcb701578d0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.716+0000 7fcb657fa700 1 -- 172.21.15.81:0/1712943006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb60022030 con 0x7fcb701578d0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.716+0000 7fcb657fa700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb54066f30 0x7fcb540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.716+0000 7fcb657fa700 1 -- 172.21.15.81:0/1712943006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb60086630 con 0x7fcb701578d0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.717+0000 7fcb7555f700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb54066f30 0x7fcb540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.717+0000 7fcb7555f700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb54066f30 0x7fcb540693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c002880 tx=0x7fcb6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.721+0000 7fcb657fa700 1 -- 172.21.15.81:0/1712943006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb60053740 con 0x7fcb701578d0 2023-10-06T02:46:35.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.900+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb700d0170 con 0x7fcb701578d0 2023-10-06T02:46:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.901+0000 7fcb657fa700 1 -- 172.21.15.81:0/1712943006 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb60056d60 con 0x7fcb701578d0 2023-10-06T02:46:35.902 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb54066f30 msgr2=0x7fcb540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb54066f30 0x7fcb540693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c002880 tx=0x7fcb6c009040 comp rx=0 tx=0).stop 2023-10-06T02:46:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb701578d0 msgr2=0x7fcb7015e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb701578d0 0x7fcb7015e260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcb600030c0 tx=0x7fcb60016000 comp rx=0 tx=0).stop 2023-10-06T02:46:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 shutdown_connections 2023-10-06T02:46:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb54066f30 0x7fcb540693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb70157ca0 0x7fcb701484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb7006d120 0x7fcb7015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 --2- 172.21.15.81:0/1712943006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb701578d0 0x7fcb7015e260 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:35.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 >> 172.21.15.81:0/1712943006 conn(0x7fcb7006bb90 msgr2=0x7fcb70154930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:35.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 shutdown_connections 2023-10-06T02:46:35.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:35.903+0000 7fcb777c3700 1 -- 172.21.15.81:0/1712943006 wait complete. 2023-10-06T02:46:35.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:46:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.031+0000 7f589fb8f700 1 Processor -- start 2023-10-06T02:46:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.031+0000 7f589fb8f700 1 -- start start 2023-10-06T02:46:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.032+0000 7f589fb8f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5898157ca0 0x7f58980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.032+0000 7f589fb8f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f589806d120 0x7f589806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.032+0000 7f589fb8f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589806dac0 con 0x7f58981578d0 2023-10-06T02:46:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.032+0000 7f589fb8f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58980d07c0 con 0x7f589806d120 2023-10-06T02:46:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.032+0000 7f589fb8f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980cfbb0 con 0x7f5898157ca0 2023-10-06T02:46:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.032+0000 7f589d92b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f58981578d0 0x7f589815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33882/0 (socket says 172.21.15.81:33882) 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.032+0000 7f589d92b700 1 -- 172.21.15.81:0/3096317381 learned_addr learned my addr 172.21.15.81:0/3096317381 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589e12c700 1 --2- 172.21.15.81:0/3096317381 >> v2:172.21.15.83:3300/0 conn(0x7f589806d120 0x7f589806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589d12a700 1 --2- 172.21.15.81:0/3096317381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5898157ca0 0x7f58980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589c929700 1 -- 172.21.15.81:0/3096317381 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074114583 0 0) 0x7f5894001490 con 0x7f58981578d0 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589c929700 1 -- 172.21.15.81:0/3096317381 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5884003570 con 0x7f58981578d0 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589c929700 1 -- 172.21.15.81:0/3096317381 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3162831781 0 0) 0x7f5884003570 con 0x7f58981578d0 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589e12c700 1 -- 172.21.15.81:0/3096317381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5898157ca0 msgr2=0x7f58980cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589e12c700 1 --2- 172.21.15.81:0/3096317381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5898157ca0 0x7f58980cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589e12c700 1 -- 172.21.15.81:0/3096317381 >> v1:172.21.15.81:6789/0 conn(0x7f58981578d0 legacy=0x7f589815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589e12c700 1 -- 172.21.15.81:0/3096317381 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980cfe90 con 0x7f589806d120 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589e12c700 1 --2- 172.21.15.81:0/3096317381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589806d120 0x7f589806d580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58900098e0 tx=0x7f58900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e5001eb94550d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589c929700 1 -- 172.21.15.81:0/3096317381 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894001980 con 0x7f589806d120 2023-10-06T02:46:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589c929700 1 -- 172.21.15.81:0/3096317381 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890011420 con 0x7f589806d120 2023-10-06T02:46:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.033+0000 7f589c929700 1 -- 172.21.15.81:0/3096317381 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58900117a0 con 0x7f589806d120 2023-10-06T02:46:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.034+0000 7f589fb8f700 1 -- 172.21.15.81:0/3096317381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589806d120 msgr2=0x7f589806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.034+0000 7f589fb8f700 1 --2- 172.21.15.81:0/3096317381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589806d120 0x7f589806d580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58900098e0 tx=0x7f58900091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.034+0000 7f589fb8f700 1 -- 172.21.15.81:0/3096317381 shutdown_connections 2023-10-06T02:46:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.034+0000 7f589fb8f700 1 --2- 172.21.15.81:0/3096317381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589806d120 0x7f589806d580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.034+0000 7f589fb8f700 1 --2- 172.21.15.81:0/3096317381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5898157ca0 0x7f58980cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.034+0000 7f589fb8f700 1 -- 172.21.15.81:0/3096317381 >> 172.21.15.81:0/3096317381 conn(0x7f589806bb90 msgr2=0x7f589806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.034+0000 7f589fb8f700 1 -- 172.21.15.81:0/3096317381 shutdown_connections 2023-10-06T02:46:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.034+0000 7f589fb8f700 1 -- 172.21.15.81:0/3096317381 wait complete. 2023-10-06T02:46:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.035+0000 7f589fb8f700 1 Processor -- start 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.035+0000 7f589fb8f700 1 -- start start 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589fb8f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589806d120 0x7f5898154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589fb8f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58981578d0 0x7f58980ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589fb8f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5898157ca0 0x7f58980aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589fb8f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58980ad380 con 0x7f5898157ca0 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589fb8f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58980b40b0 con 0x7f589806d120 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589fb8f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980acdc0 con 0x7f58981578d0 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589e12c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5898157ca0 0x7f58980aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589e12c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5898157ca0 0x7f58980aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60366/0 (socket says 172.21.15.81:60366) 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589e12c700 1 -- 172.21.15.81:0/475286647 learned_addr learned my addr 172.21.15.81:0/475286647 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589d92b700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589806d120 0x7f5898154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589d12a700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58981578d0 0x7f58980ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589e12c700 1 -- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58981578d0 msgr2=0x7f58980ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589e12c700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58981578d0 0x7f58980ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589e12c700 1 -- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589806d120 msgr2=0x7f5898154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589e12c700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589806d120 0x7f5898154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589e12c700 1 -- 172.21.15.81:0/475286647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009420 con 0x7f5898157ca0 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589e12c700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5898157ca0 0x7f58980aa890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f589806fe20 tx=0x7f5890016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f588dffb700 1 -- 172.21.15.81:0/475286647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589001ccf0 con 0x7f5898157ca0 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f588dffb700 1 -- 172.21.15.81:0/475286647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589001ce50 con 0x7f5898157ca0 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58980ad0a0 con 0x7f5898157ca0 2023-10-06T02:46:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.036+0000 7f588dffb700 1 -- 172.21.15.81:0/475286647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589001a680 con 0x7f5898157ca0 2023-10-06T02:46:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.037+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589816a310 con 0x7f5898157ca0 2023-10-06T02:46:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.037+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58980b3ba0 con 0x7f5898157ca0 2023-10-06T02:46:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.038+0000 7f588dffb700 1 -- 172.21.15.81:0/475286647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f589001a9f0 con 0x7f5898157ca0 2023-10-06T02:46:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.038+0000 7f588dffb700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f587c066f30 0x7f587c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.038+0000 7f588dffb700 1 -- 172.21.15.81:0/475286647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5890086110 con 0x7f5898157ca0 2023-10-06T02:46:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.038+0000 7f589d92b700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f587c066f30 0x7f587c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.039+0000 7f589d92b700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f587c066f30 0x7f587c0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5894007fd0 tx=0x7f5894001740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.042+0000 7f588dffb700 1 -- 172.21.15.81:0/475286647 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58980b3ba0 con 0x7f5898157ca0 2023-10-06T02:46:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.223+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58980b3ba0 con 0x7f5898157ca0 2023-10-06T02:46:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.224+0000 7f588dffb700 1 -- 172.21.15.81:0/475286647 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f58980b3ba0 con 0x7f5898157ca0 2023-10-06T02:46:36.225 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:46:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f587c066f30 msgr2=0x7f587c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f587c066f30 0x7f587c0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5894007fd0 tx=0x7f5894001740 comp rx=0 tx=0).stop 2023-10-06T02:46:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5898157ca0 msgr2=0x7f58980aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5898157ca0 0x7f58980aa890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f589806fe20 tx=0x7f5890016000 comp rx=0 tx=0).stop 2023-10-06T02:46:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 shutdown_connections 2023-10-06T02:46:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5898157ca0 0x7f58980aa890 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f587c066f30 0x7f587c0693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589806d120 0x7f5898154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 --2- 172.21.15.81:0/475286647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58981578d0 0x7f58980ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 >> 172.21.15.81:0/475286647 conn(0x7f589806bb90 msgr2=0x7f5898069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 shutdown_connections 2023-10-06T02:46:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.226+0000 7f589fb8f700 1 -- 172.21.15.81:0/475286647 wait complete. 2023-10-06T02:46:36.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:46:36.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:46:36.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:46:36.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.395+0000 7f3ecbf7c700 1 Processor -- start 2023-10-06T02:46:36.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.395+0000 7f3ecbf7c700 1 -- start start 2023-10-06T02:46:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.396+0000 7f3ecbf7c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ec4157ca0 0x7f3ec40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.396+0000 7f3ecbf7c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3ec406d120 0x7f3ec406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.396+0000 7f3ecbf7c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec406dac0 con 0x7f3ec41578d0 2023-10-06T02:46:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.396+0000 7f3ecbf7c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec40d07c0 con 0x7f3ec406d120 2023-10-06T02:46:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.396+0000 7f3ecbf7c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40cfbb0 con 0x7f3ec4157ca0 2023-10-06T02:46:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.396+0000 7f3ec9d18700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3ec41578d0 0x7f3ec415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33896/0 (socket says 172.21.15.81:33896) 2023-10-06T02:46:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.396+0000 7f3ec9d18700 1 -- 172.21.15.81:0/977249327 learned_addr learned my addr 172.21.15.81:0/977249327 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.396+0000 7f3ec9517700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ec4157ca0 0x7f3ec40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.396+0000 7f3eca519700 1 --2- 172.21.15.81:0/977249327 >> v2:172.21.15.83:3300/0 conn(0x7f3ec406d120 0x7f3ec406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592976928 0 0) 0x7f3ec0001110 con 0x7f3ec41578d0 2023-10-06T02:46:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb0003570 con 0x7f3ec41578d0 2023-10-06T02:46:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1501441161 0 0) 0x7f3eb0003570 con 0x7f3ec41578d0 2023-10-06T02:46:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ec4157ca0 msgr2=0x7f3ec40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ec4157ca0 0x7f3ec40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 >> v2:172.21.15.83:3300/0 conn(0x7f3ec406d120 msgr2=0x7f3ec406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 --2- 172.21.15.81:0/977249327 >> v2:172.21.15.83:3300/0 conn(0x7f3ec406d120 0x7f3ec406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec40cfe90 con 0x7f3ec41578d0 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f3ec0001600 con 0x7f3ec41578d0 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 >> v1:172.21.15.81:6789/0 conn(0x7f3ec41578d0 legacy=0x7f3ec415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eb0003a60 0x7f3eb0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb0004810 0x7f3eb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ec4157ca0 0x7f3eb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40d07c0 con 0x7f3eb0004810 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40cfbb0 con 0x7f3eb0003a60 2023-10-06T02:46:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb000ba60 con 0x7f3ec4157ca0 2023-10-06T02:46:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec9517700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb0004810 0x7f3eb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec9d18700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eb0003a60 0x7f3eb0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3eca519700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ec4157ca0 0x7f3eb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec9517700 1 -- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ec4157ca0 msgr2=0x7f3eb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec9517700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ec4157ca0 0x7f3eb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec9517700 1 -- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eb0003a60 msgr2=0x7f3eb0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec9517700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eb0003a60 0x7f3eb0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec9517700 1 -- 172.21.15.81:0/977249327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb0003570 con 0x7f3eb0004810 2023-10-06T02:46:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3eca519700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ec4157ca0 0x7f3eb00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec9517700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb0004810 0x7f3eb0004c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009c30 tx=0x7f3eb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648251ac3d784f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.397+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400e710 con 0x7f3eb0004810 2023-10-06T02:46:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.398+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb400e870 con 0x7f3eb0004810 2023-10-06T02:46:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.398+0000 7f3ec8d16700 1 -- 172.21.15.81:0/977249327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400ec30 con 0x7f3eb0004810 2023-10-06T02:46:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.398+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/977249327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb0004810 msgr2=0x7f3eb0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.398+0000 7f3ecbf7c700 1 --2- 172.21.15.81:0/977249327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb0004810 0x7f3eb0004c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009c30 tx=0x7f3eb40091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.398+0000 7f3eca519700 1 -- 172.21.15.81:0/977249327 reap_dead start 2023-10-06T02:46:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.398+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/977249327 shutdown_connections 2023-10-06T02:46:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.398+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/977249327 >> 172.21.15.81:0/977249327 conn(0x7f3ec406bb90 msgr2=0x7f3ec406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.398+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/977249327 shutdown_connections 2023-10-06T02:46:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.398+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/977249327 wait complete. 2023-10-06T02:46:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.399+0000 7f3ecbf7c700 1 Processor -- start 2023-10-06T02:46:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.399+0000 7f3ecbf7c700 1 -- start start 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3ecbf7c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eb0004810 0x7f3ec40c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3ecbf7c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ec40ca900 0x7f3ec40cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3ecbf7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec40cca00 0x7f3ec40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3ecbf7c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec416a9a0 con 0x7f3ec40cca00 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3ecbf7c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40cb2b0 con 0x7f3ec40ca900 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3ecbf7c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40c8250 con 0x7f3eb0004810 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3eca519700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec40cca00 0x7f3ec40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3eca519700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec40cca00 0x7f3ec40ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60384/0 (socket says 172.21.15.81:60384) 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3eca519700 1 -- 172.21.15.81:0/555413483 learned_addr learned my addr 172.21.15.81:0/555413483 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3ec9517700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ec40ca900 0x7f3ec40cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3ec9d18700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eb0004810 0x7f3ec40c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3eca519700 1 -- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eb0004810 msgr2=0x7f3ec40c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3eca519700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eb0004810 0x7f3ec40c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3eca519700 1 -- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ec40ca900 msgr2=0x7f3ec40cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3eca519700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ec40ca900 0x7f3ec40cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.400+0000 7f3eca519700 1 -- 172.21.15.81:0/555413483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec40cdca0 con 0x7f3ec40cca00 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.401+0000 7f3eca519700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec40cca00 0x7f3ec40ccea0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4068300 tx=0x7f3ebc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.401+0000 7f3eb9ffb700 1 -- 172.21.15.81:0/555413483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00e050 con 0x7f3ec40cca00 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.401+0000 7f3eb9ffb700 1 -- 172.21.15.81:0/555413483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc00f040 con 0x7f3ec40cca00 2023-10-06T02:46:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.401+0000 7f3eb9ffb700 1 -- 172.21.15.81:0/555413483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc010e20 con 0x7f3ec40cca00 2023-10-06T02:46:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.401+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec40c5f30 con 0x7f3ec40cca00 2023-10-06T02:46:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.401+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec40cd9c0 con 0x7f3ec40cca00 2023-10-06T02:46:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.402+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec40c60c0 con 0x7f3ec40cca00 2023-10-06T02:46:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.402+0000 7f3eb9ffb700 1 -- 172.21.15.81:0/555413483 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ebc003020 con 0x7f3ec40cca00 2023-10-06T02:46:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.403+0000 7f3eb9ffb700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ea8066fb0 0x7f3ea8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.403+0000 7f3eb9ffb700 1 -- 172.21.15.81:0/555413483 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ebc084990 con 0x7f3ec40cca00 2023-10-06T02:46:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.403+0000 7f3ec9d18700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ea8066fb0 0x7f3ea8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.403+0000 7f3ec9d18700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ea8066fb0 0x7f3ea8069460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00017b0 tx=0x7f3ec40d0730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.407+0000 7f3eb9ffb700 1 -- 172.21.15.81:0/555413483 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ebc051ac0 con 0x7f3ec40cca00 2023-10-06T02:46:36.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.589+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ec40d0170 con 0x7f3ec40cca00 2023-10-06T02:46:36.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.590+0000 7f3eb9ffb700 1 -- 172.21.15.81:0/555413483 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ebc01a0a0 con 0x7f3ec40cca00 2023-10-06T02:46:36.591 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:46:36.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ea8066fb0 msgr2=0x7f3ea8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ea8066fb0 0x7f3ea8069460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00017b0 tx=0x7f3ec40d0730 comp rx=0 tx=0).stop 2023-10-06T02:46:36.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec40cca00 msgr2=0x7f3ec40ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec40cca00 0x7f3ec40ccea0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4068300 tx=0x7f3ebc00b040 comp rx=0 tx=0).stop 2023-10-06T02:46:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 shutdown_connections 2023-10-06T02:46:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec40cca00 0x7f3ec40ccea0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eb0004810 0x7f3ec40c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ea8066fb0 0x7f3ea8069460 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 --2- 172.21.15.81:0/555413483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ec40ca900 0x7f3ec40cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 >> 172.21.15.81:0/555413483 conn(0x7f3ec406bb90 msgr2=0x7f3ec4069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 shutdown_connections 2023-10-06T02:46:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.592+0000 7f3ecbf7c700 1 -- 172.21.15.81:0/555413483 wait complete. 2023-10-06T02:46:36.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:36.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.717+0000 7fe6ef64b700 1 Processor -- start 2023-10-06T02:46:36.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.717+0000 7fe6ef64b700 1 -- start start 2023-10-06T02:46:36.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.718+0000 7fe6ef64b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe6e81578d0 0x7fe6e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.718+0000 7fe6ef64b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e8157ca0 0x7fe6e815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.718+0000 7fe6ef64b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e80d07c0 con 0x7fe6e806d120 2023-10-06T02:46:36.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.718+0000 7fe6ef64b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e80cfbb0 con 0x7fe6e81578d0 2023-10-06T02:46:36.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.718+0000 7fe6ef64b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80cfe90 con 0x7fe6e8157ca0 2023-10-06T02:46:36.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.718+0000 7fe6edbe8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe6e806d120 0x7fe6e815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33902/0 (socket says 172.21.15.81:33902) 2023-10-06T02:46:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.718+0000 7fe6edbe8700 1 -- 172.21.15.81:0/1108751926 learned_addr learned my addr 172.21.15.81:0/1108751926 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.718+0000 7fe6ed3e7700 1 --2- 172.21.15.81:0/1108751926 >> v2:172.21.15.83:3300/0 conn(0x7fe6e81578d0 0x7fe6e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.718+0000 7fe6ecbe6700 1 --2- 172.21.15.81:0/1108751926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e8157ca0 0x7fe6e815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6dffff700 1 -- 172.21.15.81:0/1108751926 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8180496 0 0) 0x7fe6e80d07c0 con 0x7fe6e806d120 2023-10-06T02:46:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6dffff700 1 -- 172.21.15.81:0/1108751926 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d4003570 con 0x7fe6e806d120 2023-10-06T02:46:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6ed3e7700 1 -- 172.21.15.81:0/1108751926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e8157ca0 msgr2=0x7fe6e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6ed3e7700 1 --2- 172.21.15.81:0/1108751926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e8157ca0 0x7fe6e815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6ed3e7700 1 -- 172.21.15.81:0/1108751926 >> v1:172.21.15.81:6789/0 conn(0x7fe6e806d120 legacy=0x7fe6e815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6ed3e7700 1 -- 172.21.15.81:0/1108751926 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e80d0170 con 0x7fe6e81578d0 2023-10-06T02:46:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6ed3e7700 1 --2- 172.21.15.81:0/1108751926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6e81578d0 0x7fe6e80cf4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009e60 tx=0x7fe6e4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b528bd42b6a2c562 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6dffff700 1 -- 172.21.15.81:0/1108751926 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400e070 con 0x7fe6e81578d0 2023-10-06T02:46:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6dffff700 1 -- 172.21.15.81:0/1108751926 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e400bab0 con 0x7fe6e81578d0 2023-10-06T02:46:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.719+0000 7fe6dffff700 1 -- 172.21.15.81:0/1108751926 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400be70 con 0x7fe6e81578d0 2023-10-06T02:46:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.720+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1108751926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6e81578d0 msgr2=0x7fe6e80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.720+0000 7fe6ef64b700 1 --2- 172.21.15.81:0/1108751926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6e81578d0 0x7fe6e80cf4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009e60 tx=0x7fe6e4009780 comp rx=0 tx=0).stop 2023-10-06T02:46:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.720+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1108751926 shutdown_connections 2023-10-06T02:46:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.720+0000 7fe6ef64b700 1 --2- 172.21.15.81:0/1108751926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6e81578d0 0x7fe6e80cf4f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.720+0000 7fe6ef64b700 1 --2- 172.21.15.81:0/1108751926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e8157ca0 0x7fe6e815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.720+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1108751926 >> 172.21.15.81:0/1108751926 conn(0x7fe6e806bb90 msgr2=0x7fe6e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.720+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1108751926 shutdown_connections 2023-10-06T02:46:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.720+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1108751926 wait complete. 2023-10-06T02:46:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.721+0000 7fe6ef64b700 1 Processor -- start 2023-10-06T02:46:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.721+0000 7fe6ef64b700 1 -- start start 2023-10-06T02:46:36.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ef64b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e806d120 0x7fe6e8153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ef64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e81578d0 0x7fe6e80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ef64b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6e8157ca0 0x7fe6e80c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ef64b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80b49b0 con 0x7fe6e81578d0 2023-10-06T02:46:36.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ef64b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8155af0 con 0x7fe6e8157ca0 2023-10-06T02:46:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ef64b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e81539b0 con 0x7fe6e806d120 2023-10-06T02:46:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ecbe6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e81578d0 0x7fe6e80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ecbe6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e81578d0 0x7fe6e80c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60388/0 (socket says 172.21.15.81:60388) 2023-10-06T02:46:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ecbe6700 1 -- 172.21.15.81:0/1505641870 learned_addr learned my addr 172.21.15.81:0/1505641870 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ed3e7700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e806d120 0x7fe6e8153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6edbe8700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6e8157ca0 0x7fe6e80c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ecbe6700 1 -- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e806d120 msgr2=0x7fe6e8153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ecbe6700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e806d120 0x7fe6e8153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ecbe6700 1 -- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6e8157ca0 msgr2=0x7fe6e80c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ecbe6700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6e8157ca0 0x7fe6e80c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ecbe6700 1 -- 172.21.15.81:0/1505641870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e4009a20 con 0x7fe6e81578d0 2023-10-06T02:46:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ecbe6700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e81578d0 0x7fe6e80c5b20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800e930 tx=0x7fe6d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6dd7fa700 1 -- 172.21.15.81:0/1505641870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8013680 con 0x7fe6e81578d0 2023-10-06T02:46:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6dd7fa700 1 -- 172.21.15.81:0/1505641870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d80137e0 con 0x7fe6e81578d0 2023-10-06T02:46:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e80b43a0 con 0x7fe6e81578d0 2023-10-06T02:46:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6dd7fa700 1 -- 172.21.15.81:0/1505641870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8013b80 con 0x7fe6e81578d0 2023-10-06T02:46:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.722+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e80b4640 con 0x7fe6e81578d0 2023-10-06T02:46:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.723+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e8067ac0 con 0x7fe6e81578d0 2023-10-06T02:46:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.724+0000 7fe6dd7fa700 1 -- 172.21.15.81:0/1505641870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6d800c3e0 con 0x7fe6e81578d0 2023-10-06T02:46:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.724+0000 7fe6dd7fa700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6cc066f30 0x7fe6cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.724+0000 7fe6dd7fa700 1 -- 172.21.15.81:0/1505641870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe6d8084740 con 0x7fe6e81578d0 2023-10-06T02:46:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.724+0000 7fe6ed3e7700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6cc066f30 0x7fe6cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.725+0000 7fe6ed3e7700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6cc066f30 0x7fe6cc0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40097c0 tx=0x7fe6e4019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.728+0000 7fe6dd7fa700 1 -- 172.21.15.81:0/1505641870 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6d8051850 con 0x7fe6e81578d0 2023-10-06T02:46:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.910+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6e80d0450 con 0x7fe6e81578d0 2023-10-06T02:46:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.911+0000 7fe6dd7fa700 1 -- 172.21.15.81:0/1505641870 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fe6d8054e70 con 0x7fe6e81578d0 2023-10-06T02:46:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:36.912 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6cc066f30 msgr2=0x7fe6cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6cc066f30 0x7fe6cc0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40097c0 tx=0x7fe6e4019000 comp rx=0 tx=0).stop 2023-10-06T02:46:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e81578d0 msgr2=0x7fe6e80c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e81578d0 0x7fe6e80c5b20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800e930 tx=0x7fe6d80091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 shutdown_connections 2023-10-06T02:46:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6cc066f30 0x7fe6cc0693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6e8157ca0 0x7fe6e80c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6e806d120 0x7fe6e8153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 --2- 172.21.15.81:0/1505641870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e81578d0 0x7fe6e80c5b20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 >> 172.21.15.81:0/1505641870 conn(0x7fe6e806bb90 msgr2=0x7fe6e8156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 shutdown_connections 2023-10-06T02:46:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:36.913+0000 7fe6ef64b700 1 -- 172.21.15.81:0/1505641870 wait complete. 2023-10-06T02:46:36.926 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:46:05.360665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:46:05.837671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:46:36.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.043+0000 7f4a26078700 1 Processor -- start 2023-10-06T02:46:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.043+0000 7f4a26078700 1 -- start start 2023-10-06T02:46:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.044+0000 7f4a26078700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20157ca0 0x7f4a200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.044+0000 7f4a26078700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a200d07c0 con 0x7f4a201578d0 2023-10-06T02:46:37.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.044+0000 7f4a26078700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a200cfbb0 con 0x7f4a2006d120 2023-10-06T02:46:37.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.044+0000 7f4a26078700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200cfe90 con 0x7f4a20157ca0 2023-10-06T02:46:37.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.044+0000 7f4a1f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4a201578d0 0x7f4a2015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33914/0 (socket says 172.21.15.81:33914) 2023-10-06T02:46:37.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.044+0000 7f4a1f7fe700 1 -- 172.21.15.81:0/2113487151 learned_addr learned my addr 172.21.15.81:0/2113487151 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:37.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.044+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489385636 0 0) 0x7f4a200d07c0 con 0x7f4a201578d0 2023-10-06T02:46:37.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.044+0000 7f4a1effd700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20157ca0 0x7f4a200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.044+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a08003570 con 0x7f4a201578d0 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4043397885 0 0) 0x7f4a08003570 con 0x7f4a201578d0 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20157ca0 msgr2=0x7f4a200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20157ca0 0x7f4a200cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 >> v1:172.21.15.83:6789/0 conn(0x7f4a2006d120 legacy=0x7f4a2015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200d0170 con 0x7f4a201578d0 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f4a100017f0 con 0x7f4a201578d0 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 >> v1:172.21.15.81:6789/0 conn(0x7f4a201578d0 legacy=0x7f4a2015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a08003a90 0x7f4a08003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20157ca0 0x7f4a08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a08004da0 0x7f4a080051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200cfe90 con 0x7f4a08004da0 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0800bc20 con 0x7f4a08003a90 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0800bde0 con 0x7f4a20157ca0 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1ffff700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a08004da0 0x7f4a080051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1f7fe700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a08003a90 0x7f4a08003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1effd700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20157ca0 0x7f4a08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1ffff700 1 -- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20157ca0 msgr2=0x7f4a08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1ffff700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20157ca0 0x7f4a08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1ffff700 1 -- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a08003a90 msgr2=0x7f4a08003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1ffff700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a08003a90 0x7f4a08003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1ffff700 1 -- 172.21.15.81:0/2113487151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08003570 con 0x7f4a08004da0 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1ffff700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a08004da0 0x7f4a080051f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4a18001880 tx=0x7f4a18007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab888ed176913a33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18012420 con 0x7f4a08004da0 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18012580 con 0x7f4a08004da0 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.045+0000 7f4a1e7fc700 1 -- 172.21.15.81:0/2113487151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18012920 con 0x7f4a08004da0 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.046+0000 7f4a26078700 1 -- 172.21.15.81:0/2113487151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a08004da0 msgr2=0x7f4a080051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.046+0000 7f4a26078700 1 --2- 172.21.15.81:0/2113487151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a08004da0 0x7f4a080051f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4a18001880 tx=0x7f4a18007d30 comp rx=0 tx=0).stop 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.046+0000 7f4a1ffff700 1 -- 172.21.15.81:0/2113487151 reap_dead start 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.046+0000 7f4a26078700 1 -- 172.21.15.81:0/2113487151 shutdown_connections 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.046+0000 7f4a26078700 1 -- 172.21.15.81:0/2113487151 >> 172.21.15.81:0/2113487151 conn(0x7f4a2006bb90 msgr2=0x7f4a2006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.046+0000 7f4a26078700 1 -- 172.21.15.81:0/2113487151 shutdown_connections 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.046+0000 7f4a26078700 1 -- 172.21.15.81:0/2113487151 wait complete. 2023-10-06T02:46:37.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.047+0000 7f4a26078700 1 Processor -- start 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.047+0000 7f4a26078700 1 -- start start 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a26078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153c90 0x7f4a20154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a26078700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a20154060 0x7f4a200b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a26078700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20154530 0x7f4a20069630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a26078700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200b41b0 con 0x7f4a20153c90 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a26078700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200b3ba0 con 0x7f4a20154060 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a26078700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200b5320 con 0x7f4a20154530 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a1f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153c90 0x7f4a20154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a1f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153c90 0x7f4a20154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60412/0 (socket says 172.21.15.81:60412) 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a1f7fe700 1 -- 172.21.15.81:0/2179729141 learned_addr learned my addr 172.21.15.81:0/2179729141 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a1f7fe700 1 -- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20154530 msgr2=0x7f4a20069630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a1f7fe700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20154530 0x7f4a20069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a1f7fe700 1 -- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a20154060 msgr2=0x7f4a200b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a1f7fe700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a20154060 0x7f4a200b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a1f7fe700 1 -- 172.21.15.81:0/2179729141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200b5600 con 0x7f4a20153c90 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.048+0000 7f4a1f7fe700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153c90 0x7f4a20154a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000a3e0 tx=0x7f4a2015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.049+0000 7f4a077fe700 1 -- 172.21.15.81:0/2179729141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10013600 con 0x7f4a20153c90 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.049+0000 7f4a077fe700 1 -- 172.21.15.81:0/2179729141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10013780 con 0x7f4a20153c90 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.049+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a200b3e40 con 0x7f4a20153c90 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.049+0000 7f4a077fe700 1 -- 172.21.15.81:0/2179729141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10013b80 con 0x7f4a20153c90 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.049+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a200b4b80 con 0x7f4a20153c90 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.049+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a20067ac0 con 0x7f4a20153c90 2023-10-06T02:46:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.050+0000 7f4a077fe700 1 -- 172.21.15.81:0/2179729141 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a1001c400 con 0x7f4a20153c90 2023-10-06T02:46:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.050+0000 7f4a077fe700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a0c066f30 0x7f4a0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.050+0000 7f4a077fe700 1 -- 172.21.15.81:0/2179729141 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a100857a0 con 0x7f4a20153c90 2023-10-06T02:46:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.050+0000 7f4a1effd700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a0c066f30 0x7f4a0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.051+0000 7f4a1effd700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a0c066f30 0x7f4a0c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400b2d0 tx=0x7f4a14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:37.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.054+0000 7f4a077fe700 1 -- 172.21.15.81:0/2179729141 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a100528b0 con 0x7f4a20153c90 2023-10-06T02:46:37.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.236+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a200d0450 con 0x7f4a20153c90 2023-10-06T02:46:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.237+0000 7f4a077fe700 1 -- 172.21.15.81:0/2179729141 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a10055ed0 con 0x7f4a20153c90 2023-10-06T02:46:37.238 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a0c066f30 msgr2=0x7f4a0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a0c066f30 0x7f4a0c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400b2d0 tx=0x7f4a14008040 comp rx=0 tx=0).stop 2023-10-06T02:46:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153c90 msgr2=0x7f4a20154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153c90 0x7f4a20154a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000a3e0 tx=0x7f4a2015b610 comp rx=0 tx=0).stop 2023-10-06T02:46:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 shutdown_connections 2023-10-06T02:46:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a20154530 0x7f4a20069630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153c90 0x7f4a20154a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a0c066f30 0x7f4a0c0693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 --2- 172.21.15.81:0/2179729141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a20154060 0x7f4a200b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 >> 172.21.15.81:0/2179729141 conn(0x7f4a2006bb90 msgr2=0x7f4a20068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 shutdown_connections 2023-10-06T02:46:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.239+0000 7f4a26078700 1 -- 172.21.15.81:0/2179729141 wait complete. 2023-10-06T02:46:37.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:37.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.368+0000 7ffa22247700 1 Processor -- start 2023-10-06T02:46:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.368+0000 7ffa22247700 1 -- start start 2023-10-06T02:46:37.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.369+0000 7ffa22247700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c157ca0 0x7ffa1c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.369+0000 7ffa22247700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c0d07c0 con 0x7ffa1c1578d0 2023-10-06T02:46:37.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.369+0000 7ffa22247700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c0cfbb0 con 0x7ffa1c06d120 2023-10-06T02:46:37.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.369+0000 7ffa22247700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0cfe90 con 0x7ffa1c157ca0 2023-10-06T02:46:37.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.369+0000 7ffa1b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffa1c1578d0 0x7ffa1c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33930/0 (socket says 172.21.15.81:33930) 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.369+0000 7ffa1b7fe700 1 -- 172.21.15.81:0/1448245253 learned_addr learned my addr 172.21.15.81:0/1448245253 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.369+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231899842 0 0) 0x7ffa1c0d07c0 con 0x7ffa1c1578d0 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.369+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa04003570 con 0x7ffa1c1578d0 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1affd700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c157ca0 0x7ffa1c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2670973021 0 0) 0x7ffa04003570 con 0x7ffa1c1578d0 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c157ca0 msgr2=0x7ffa1c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c157ca0 0x7ffa1c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 >> v1:172.21.15.83:6789/0 conn(0x7ffa1c06d120 legacy=0x7ffa1c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0d0170 con 0x7ffa1c1578d0 2023-10-06T02:46:37.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7ffa0c0017f0 con 0x7ffa1c1578d0 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1affd700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c157ca0 0x7ffa1c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 >> v1:172.21.15.81:6789/0 conn(0x7ffa1c1578d0 legacy=0x7ffa1c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa04003a90 0x7ffa04003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa04004810 0x7ffa04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c157ca0 0x7ffa04005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0cfe90 con 0x7ffa04003a90 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0400bbf0 con 0x7ffa04004810 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0400bdb0 con 0x7ffa1c157ca0 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1b7fe700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa04003a90 0x7ffa04003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1affd700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa04004810 0x7ffa04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1bfff700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c157ca0 0x7ffa04005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1b7fe700 1 -- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c157ca0 msgr2=0x7ffa04005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1b7fe700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c157ca0 0x7ffa04005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1b7fe700 1 -- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa04004810 msgr2=0x7ffa04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1b7fe700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa04004810 0x7ffa04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1b7fe700 1 -- 172.21.15.81:0/1448245253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04003570 con 0x7ffa04003a90 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1b7fe700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa04003a90 0x7ffa04003ea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00a900 tx=0x7ffa1c15b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13914f0103bbe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0070d0 con 0x7ffa04003a90 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c007230 con 0x7ffa04003a90 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.370+0000 7ffa1a7fc700 1 -- 172.21.15.81:0/1448245253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0075f0 con 0x7ffa04003a90 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.371+0000 7ffa22247700 1 -- 172.21.15.81:0/1448245253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa04003a90 msgr2=0x7ffa04003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.371+0000 7ffa22247700 1 --2- 172.21.15.81:0/1448245253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa04003a90 0x7ffa04003ea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00a900 tx=0x7ffa1c15b610 comp rx=0 tx=0).stop 2023-10-06T02:46:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.371+0000 7ffa1bfff700 1 -- 172.21.15.81:0/1448245253 reap_dead start 2023-10-06T02:46:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.371+0000 7ffa22247700 1 -- 172.21.15.81:0/1448245253 shutdown_connections 2023-10-06T02:46:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.371+0000 7ffa22247700 1 -- 172.21.15.81:0/1448245253 >> 172.21.15.81:0/1448245253 conn(0x7ffa1c06bb90 msgr2=0x7ffa1c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.371+0000 7ffa22247700 1 -- 172.21.15.81:0/1448245253 shutdown_connections 2023-10-06T02:46:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.371+0000 7ffa22247700 1 -- 172.21.15.81:0/1448245253 wait complete. 2023-10-06T02:46:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.372+0000 7ffa22247700 1 Processor -- start 2023-10-06T02:46:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.372+0000 7ffa22247700 1 -- start start 2023-10-06T02:46:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa22247700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa04003a90 0x7ffa1c0acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa22247700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa1c0b6050 0x7ffa1c0b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa22247700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c0b3c50 0x7ffa1c0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa22247700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c16a650 con 0x7ffa1c0b6050 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa22247700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0b6a00 con 0x7ffa04003a90 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa22247700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0b49d0 con 0x7ffa1c0b3c50 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa1c0b6050 0x7ffa1c0b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa1c0b6050 0x7ffa1c0b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60428/0 (socket says 172.21.15.81:60428) 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1affd700 1 -- 172.21.15.81:0/2313606014 learned_addr learned my addr 172.21.15.81:0/2313606014 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1b7fe700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa04003a90 0x7ffa1c0acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1bfff700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c0b3c50 0x7ffa1c0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1affd700 1 -- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c0b3c50 msgr2=0x7ffa1c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1affd700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c0b3c50 0x7ffa1c0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1affd700 1 -- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa04003a90 msgr2=0x7ffa1c0acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1affd700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa04003a90 0x7ffa1c0acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.373+0000 7ffa1affd700 1 -- 172.21.15.81:0/2313606014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0b4cb0 con 0x7ffa1c0b6050 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.374+0000 7ffa1affd700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa1c0b6050 0x7ffa1c0b64c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa100119c0 tx=0x7ffa10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.374+0000 7ffa037fe700 1 -- 172.21.15.81:0/2313606014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1000c070 con 0x7ffa1c0b6050 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.374+0000 7ffa037fe700 1 -- 172.21.15.81:0/2313606014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1000f670 con 0x7ffa1c0b6050 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.374+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c0b4f90 con 0x7ffa1c0b6050 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.374+0000 7ffa037fe700 1 -- 172.21.15.81:0/2313606014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1000fa30 con 0x7ffa1c0b6050 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.374+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c0ad180 con 0x7ffa1c0b6050 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.375+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c16a7c0 con 0x7ffa1c0b6050 2023-10-06T02:46:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.375+0000 7ffa037fe700 1 -- 172.21.15.81:0/2313606014 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa10015460 con 0x7ffa1c0b6050 2023-10-06T02:46:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.375+0000 7ffa037fe700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffa08066f30 0x7ffa080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.375+0000 7ffa037fe700 1 -- 172.21.15.81:0/2313606014 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffa100847b0 con 0x7ffa1c0b6050 2023-10-06T02:46:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.376+0000 7ffa1b7fe700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffa08066f30 0x7ffa080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.376+0000 7ffa1b7fe700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffa08066f30 0x7ffa080693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00a3f0 tx=0x7ffa0c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.380+0000 7ffa037fe700 1 -- 172.21.15.81:0/2313606014 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa1c16a7c0 con 0x7ffa1c0b6050 2023-10-06T02:46:37.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.559+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffa1c16a790 con 0x7ffa1c0b6050 2023-10-06T02:46:37.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.559+0000 7ffa037fe700 1 -- 172.21.15.81:0/2313606014 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffa100518c0 con 0x7ffa1c0b6050 2023-10-06T02:46:37.561 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:37.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffa08066f30 msgr2=0x7ffa080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffa08066f30 0x7ffa080693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00a3f0 tx=0x7ffa0c016000 comp rx=0 tx=0).stop 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa1c0b6050 msgr2=0x7ffa1c0b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa1c0b6050 0x7ffa1c0b64c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa100119c0 tx=0x7ffa10008040 comp rx=0 tx=0).stop 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 shutdown_connections 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa1c0b3c50 0x7ffa1c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffa08066f30 0x7ffa080693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa04003a90 0x7ffa1c0acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 --2- 172.21.15.81:0/2313606014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa1c0b6050 0x7ffa1c0b64c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 >> 172.21.15.81:0/2313606014 conn(0x7ffa1c06bb90 msgr2=0x7ffa1c156830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 shutdown_connections 2023-10-06T02:46:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.561+0000 7ffa22247700 1 -- 172.21.15.81:0/2313606014 wait complete. 2023-10-06T02:46:37.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:46:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.691+0000 7fc823981700 1 Processor -- start 2023-10-06T02:46:37.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.691+0000 7fc823981700 1 -- start start 2023-10-06T02:46:37.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.692+0000 7fc823981700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 0x7fc81c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.692+0000 7fc823981700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc81c06dd60 0x7fc81c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.692+0000 7fc823981700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c0cf4e0 con 0x7fc81c0ceb30 2023-10-06T02:46:37.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.692+0000 7fc823981700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c06ea90 con 0x7fc81c06dd60 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.692+0000 7fc823981700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0b0ca0 con 0x7fc81c15a2a0 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.692+0000 7fc821f1e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc81c06dd60 0x7fc81c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.692+0000 7fc820f1c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc81c0ceb30 0x7fc81c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33942/0 (socket says 172.21.15.81:33942) 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc820f1c700 1 -- 172.21.15.81:0/4000588855 learned_addr learned my addr 172.21.15.81:0/4000588855 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc821f1e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc81c06dd60 0x7fc81c0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60434/0 (socket says 172.21.15.81:60434) 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc82171d700 1 --2- 172.21.15.81:0/4000588855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 0x7fc81c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc821f1e700 1 -- 172.21.15.81:0/4000588855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 msgr2=0x7fc81c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc821f1e700 1 --2- 172.21.15.81:0/4000588855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 0x7fc81c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc821f1e700 1 -- 172.21.15.81:0/4000588855 >> v1:172.21.15.81:6789/0 conn(0x7fc81c0ceb30 legacy=0x7fc81c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc821f1e700 1 -- 172.21.15.81:0/4000588855 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0b00d0 con 0x7fc81c06dd60 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc82171d700 1 --2- 172.21.15.81:0/4000588855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 0x7fc81c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc821f1e700 1 --2- 172.21.15.81:0/4000588855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c06dd60 0x7fc81c0cefa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc8140098e0 tx=0x7fc8140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efca6ce0e63e6424 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc81bfff700 1 -- 172.21.15.81:0/4000588855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814009e80 con 0x7fc81c06dd60 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc81bfff700 1 -- 172.21.15.81:0/4000588855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81400b860 con 0x7fc81c06dd60 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.693+0000 7fc81bfff700 1 -- 172.21.15.81:0/4000588855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81400bbe0 con 0x7fc81c06dd60 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.694+0000 7fc823981700 1 -- 172.21.15.81:0/4000588855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c06dd60 msgr2=0x7fc81c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.694+0000 7fc823981700 1 --2- 172.21.15.81:0/4000588855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c06dd60 0x7fc81c0cefa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc8140098e0 tx=0x7fc8140091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.694+0000 7fc823981700 1 -- 172.21.15.81:0/4000588855 shutdown_connections 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.694+0000 7fc823981700 1 --2- 172.21.15.81:0/4000588855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c06dd60 0x7fc81c0cefa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.694+0000 7fc823981700 1 --2- 172.21.15.81:0/4000588855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 0x7fc81c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.694+0000 7fc823981700 1 -- 172.21.15.81:0/4000588855 >> 172.21.15.81:0/4000588855 conn(0x7fc81c067640 msgr2=0x7fc81c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.694+0000 7fc823981700 1 -- 172.21.15.81:0/4000588855 shutdown_connections 2023-10-06T02:46:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.694+0000 7fc823981700 1 -- 172.21.15.81:0/4000588855 wait complete. 2023-10-06T02:46:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.695+0000 7fc823981700 1 Processor -- start 2023-10-06T02:46:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.695+0000 7fc823981700 1 -- start start 2023-10-06T02:46:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc823981700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc81c06dd60 0x7fc81c151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc823981700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c0ceb30 0x7fc81c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc823981700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 0x7fc81c16e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc823981700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0b3800 con 0x7fc81c0ceb30 2023-10-06T02:46:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc823981700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c152200 con 0x7fc81c06dd60 2023-10-06T02:46:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc823981700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c16ea70 con 0x7fc81c15a2a0 2023-10-06T02:46:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc820f1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c0ceb30 0x7fc81c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc820f1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c0ceb30 0x7fc81c0b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60436/0 (socket says 172.21.15.81:60436) 2023-10-06T02:46:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc820f1c700 1 -- 172.21.15.81:0/3570081863 learned_addr learned my addr 172.21.15.81:0/3570081863 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc821f1e700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 0x7fc81c16e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc82171d700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc81c06dd60 0x7fc81c151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc820f1c700 1 -- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 msgr2=0x7fc81c16e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc820f1c700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 0x7fc81c16e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc820f1c700 1 -- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc81c06dd60 msgr2=0x7fc81c151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc820f1c700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc81c06dd60 0x7fc81c151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc820f1c700 1 -- 172.21.15.81:0/3570081863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814009420 con 0x7fc81c0ceb30 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc820f1c700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c0ceb30 0x7fc81c0b3c90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c7f0 tx=0x7fc810007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc8197fa700 1 -- 172.21.15.81:0/3570081863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810005b30 con 0x7fc81c0ceb30 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc8197fa700 1 -- 172.21.15.81:0/3570081863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810005cb0 con 0x7fc81c0ceb30 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c16ed50 con 0x7fc81c0ceb30 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc8197fa700 1 -- 172.21.15.81:0/3570081863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810004a80 con 0x7fc81c0ceb30 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.696+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c0b41d0 con 0x7fc81c0ceb30 2023-10-06T02:46:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.697+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c16ef90 con 0x7fc81c0ceb30 2023-10-06T02:46:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.698+0000 7fc8197fa700 1 -- 172.21.15.81:0/3570081863 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8100070f0 con 0x7fc81c0ceb30 2023-10-06T02:46:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.698+0000 7fc8197fa700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc808066f30 0x7fc8080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.698+0000 7fc8197fa700 1 -- 172.21.15.81:0/3570081863 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc810083ad0 con 0x7fc81c0ceb30 2023-10-06T02:46:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.698+0000 7fc82171d700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc808066f30 0x7fc8080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.699+0000 7fc82171d700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc808066f30 0x7fc8080693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc80c007600 tx=0x7fc80c009850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.702+0000 7fc8197fa700 1 -- 172.21.15.81:0/3570081863 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc81c16ef90 con 0x7fc81c0ceb30 2023-10-06T02:46:37.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.880+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc81c0b32f0 con 0x7fc81c0ceb30 2023-10-06T02:46:37.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.880+0000 7fc8197fa700 1 -- 172.21.15.81:0/3570081863 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc81c0b32f0 con 0x7fc81c0ceb30 2023-10-06T02:46:37.881 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:46:37.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc808066f30 msgr2=0x7fc8080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc808066f30 0x7fc8080693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc80c007600 tx=0x7fc80c009850 comp rx=0 tx=0).stop 2023-10-06T02:46:37.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c0ceb30 msgr2=0x7fc81c0b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c0ceb30 0x7fc81c0b3c90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c7f0 tx=0x7fc810007f70 comp rx=0 tx=0).stop 2023-10-06T02:46:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 shutdown_connections 2023-10-06T02:46:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c15a2a0 0x7fc81c16e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc808066f30 0x7fc8080693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc81c06dd60 0x7fc81c151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 --2- 172.21.15.81:0/3570081863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81c0ceb30 0x7fc81c0b3c90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 >> 172.21.15.81:0/3570081863 conn(0x7fc81c067640 msgr2=0x7fc81c15fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 shutdown_connections 2023-10-06T02:46:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:37.882+0000 7fc823981700 1 -- 172.21.15.81:0/3570081863 wait complete. 2023-10-06T02:46:37.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:46:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.011+0000 7f7ecb478700 1 Processor -- start 2023-10-06T02:46:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.011+0000 7f7ecb478700 1 -- start start 2023-10-06T02:46:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ecb478700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7ec4157ca0 0x7f7ec40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ecb478700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ec406d120 0x7f7ec406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ecb478700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec40d07c0 con 0x7f7ec41578d0 2023-10-06T02:46:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ecb478700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec406da50 con 0x7f7ec406d120 2023-10-06T02:46:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ecb478700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec40cfbb0 con 0x7f7ec4157ca0 2023-10-06T02:46:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ec9a15700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ec406d120 0x7f7ec406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ec9a15700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ec406d120 0x7f7ec406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60448/0 (socket says 172.21.15.81:60448) 2023-10-06T02:46:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ec9a15700 1 -- 172.21.15.81:0/3220956106 learned_addr learned my addr 172.21.15.81:0/3220956106 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ec8a13700 1 --2- 172.21.15.81:0/3220956106 >> v2:172.21.15.83:3300/0 conn(0x7f7ec4157ca0 0x7f7ec40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ec9a15700 1 -- 172.21.15.81:0/3220956106 >> v2:172.21.15.83:3300/0 conn(0x7f7ec4157ca0 msgr2=0x7f7ec40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ec9a15700 1 --2- 172.21.15.81:0/3220956106 >> v2:172.21.15.83:3300/0 conn(0x7f7ec4157ca0 0x7f7ec40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ec9a15700 1 -- 172.21.15.81:0/3220956106 >> v1:172.21.15.83:6789/0 conn(0x7f7ec41578d0 legacy=0x7f7ec415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ec9a15700 1 -- 172.21.15.81:0/3220956106 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40cfe90 con 0x7f7ec406d120 2023-10-06T02:46:38.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ec9a15700 1 --2- 172.21.15.81:0/3220956106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec406d120 0x7f7ec406d510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4068510 tx=0x7f7ebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24eee588ecb86e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ebbfff700 1 -- 172.21.15.81:0/3220956106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc00b820 con 0x7f7ec406d120 2023-10-06T02:46:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ebbfff700 1 -- 172.21.15.81:0/3220956106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc00b980 con 0x7f7ec406d120 2023-10-06T02:46:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.012+0000 7f7ebbfff700 1 -- 172.21.15.81:0/3220956106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc00bd20 con 0x7f7ec406d120 2023-10-06T02:46:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.013+0000 7f7ecb478700 1 -- 172.21.15.81:0/3220956106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec406d120 msgr2=0x7f7ec406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.013+0000 7f7ecb478700 1 --2- 172.21.15.81:0/3220956106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec406d120 0x7f7ec406d510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4068510 tx=0x7f7ebc009250 comp rx=0 tx=0).stop 2023-10-06T02:46:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.013+0000 7f7ecb478700 1 -- 172.21.15.81:0/3220956106 shutdown_connections 2023-10-06T02:46:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.013+0000 7f7ecb478700 1 --2- 172.21.15.81:0/3220956106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec406d120 0x7f7ec406d510 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.013+0000 7f7ecb478700 1 --2- 172.21.15.81:0/3220956106 >> v2:172.21.15.83:3300/0 conn(0x7f7ec4157ca0 0x7f7ec40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.013+0000 7f7ecb478700 1 -- 172.21.15.81:0/3220956106 >> 172.21.15.81:0/3220956106 conn(0x7f7ec406bb90 msgr2=0x7f7ec406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.013+0000 7f7ecb478700 1 -- 172.21.15.81:0/3220956106 shutdown_connections 2023-10-06T02:46:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.013+0000 7f7ecb478700 1 -- 172.21.15.81:0/3220956106 wait complete. 2023-10-06T02:46:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.014+0000 7f7ecb478700 1 Processor -- start 2023-10-06T02:46:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.014+0000 7f7ecb478700 1 -- start start 2023-10-06T02:46:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ecb478700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ec406d120 0x7f7ec40aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ecb478700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ec41578d0 0x7f7ec40ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ecb478700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4157ca0 0x7f7ec40ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ecb478700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec416d870 con 0x7f7ec4157ca0 2023-10-06T02:46:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ecb478700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec416dac0 con 0x7f7ec41578d0 2023-10-06T02:46:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ecb478700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec416dda0 con 0x7f7ec406d120 2023-10-06T02:46:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec9a15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4157ca0 0x7f7ec40ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec9a15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4157ca0 0x7f7ec40ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60456/0 (socket says 172.21.15.81:60456) 2023-10-06T02:46:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec9a15700 1 -- 172.21.15.81:0/2111778799 learned_addr learned my addr 172.21.15.81:0/2111778799 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec8a13700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ec41578d0 0x7f7ec40ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec9214700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ec406d120 0x7f7ec40aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec9a15700 1 -- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ec406d120 msgr2=0x7f7ec40aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec9a15700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ec406d120 0x7f7ec40aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec9a15700 1 -- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ec41578d0 msgr2=0x7f7ec40ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec9a15700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ec41578d0 0x7f7ec40ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec9a15700 1 -- 172.21.15.81:0/2111778799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc0094f0 con 0x7f7ec4157ca0 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.015+0000 7f7ec8a13700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ec41578d0 0x7f7ec40ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.016+0000 7f7ec9a15700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4157ca0 0x7f7ec40ac8e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009290 tx=0x7f7ebc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.016+0000 7f7eb97fa700 1 -- 172.21.15.81:0/2111778799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc01b520 con 0x7f7ec4157ca0 2023-10-06T02:46:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.016+0000 7f7eb97fa700 1 -- 172.21.15.81:0/2111778799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc020070 con 0x7f7ec4157ca0 2023-10-06T02:46:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.016+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec416e080 con 0x7f7ec4157ca0 2023-10-06T02:46:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.016+0000 7f7eb97fa700 1 -- 172.21.15.81:0/2111778799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc01b8f0 con 0x7f7ec4157ca0 2023-10-06T02:46:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.016+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec416e640 con 0x7f7ec4157ca0 2023-10-06T02:46:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.017+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec4067ac0 con 0x7f7ec4157ca0 2023-10-06T02:46:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.017+0000 7f7eb97fa700 1 -- 172.21.15.81:0/2111778799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ebc022030 con 0x7f7ec4157ca0 2023-10-06T02:46:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.017+0000 7f7eb97fa700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ea8066f30 0x7f7ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.017+0000 7f7eb97fa700 1 -- 172.21.15.81:0/2111778799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ebc086810 con 0x7f7ec4157ca0 2023-10-06T02:46:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.018+0000 7f7ec9214700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ea8066f30 0x7f7ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.018+0000 7f7ec9214700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ea8066f30 0x7f7ea80693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0007fd0 tx=0x7f7ec0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.021+0000 7f7eb97fa700 1 -- 172.21.15.81:0/2111778799 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ebc053920 con 0x7f7ec4157ca0 2023-10-06T02:46:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.202+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ec40d0170 con 0x7f7ec4157ca0 2023-10-06T02:46:38.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.202+0000 7f7eb97fa700 1 -- 172.21.15.81:0/2111778799 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ebc056f40 con 0x7f7ec4157ca0 2023-10-06T02:46:38.206 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:46:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.204+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ea8066f30 msgr2=0x7f7ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.204+0000 7f7ecb478700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ea8066f30 0x7f7ea80693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0007fd0 tx=0x7f7ec0009040 comp rx=0 tx=0).stop 2023-10-06T02:46:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.204+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4157ca0 msgr2=0x7f7ec40ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.204+0000 7f7ecb478700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4157ca0 0x7f7ec40ac8e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009290 tx=0x7f7ebc016000 comp rx=0 tx=0).stop 2023-10-06T02:46:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.205+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 shutdown_connections 2023-10-06T02:46:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.205+0000 7f7ecb478700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4157ca0 0x7f7ec40ac8e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.205+0000 7f7ecb478700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ec406d120 0x7f7ec40aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.205+0000 7f7ecb478700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ea8066f30 0x7f7ea80693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.205+0000 7f7ecb478700 1 --2- 172.21.15.81:0/2111778799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ec41578d0 0x7f7ec40ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.205+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 >> 172.21.15.81:0/2111778799 conn(0x7f7ec406bb90 msgr2=0x7f7ec41583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.205+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 shutdown_connections 2023-10-06T02:46:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.205+0000 7f7ecb478700 1 -- 172.21.15.81:0/2111778799 wait complete. 2023-10-06T02:46:38.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:38.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.330+0000 7fa3c006e700 1 Processor -- start 2023-10-06T02:46:38.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.330+0000 7fa3c006e700 1 -- start start 2023-10-06T02:46:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.331+0000 7fa3c006e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3b81578d0 0x7fa3b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.331+0000 7fa3c006e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3b8157ca0 0x7fa3b815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.331+0000 7fa3c006e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa3b806d120 0x7fa3b806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.331+0000 7fa3c006e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b806dac0 con 0x7fa3b81578d0 2023-10-06T02:46:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.331+0000 7fa3c006e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b80d07c0 con 0x7fa3b806d120 2023-10-06T02:46:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.331+0000 7fa3c006e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80cfbb0 con 0x7fa3b8157ca0 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.331+0000 7fa3bde0a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3b81578d0 0x7fa3b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.331+0000 7fa3bde0a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3b81578d0 0x7fa3b80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60462/0 (socket says 172.21.15.81:60462) 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.331+0000 7fa3bde0a700 1 -- 172.21.15.81:0/2139046225 learned_addr learned my addr 172.21.15.81:0/2139046225 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3be60b700 1 --2- 172.21.15.81:0/2139046225 >> v2:172.21.15.83:3300/0 conn(0x7fa3b806d120 0x7fa3b806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3bde0a700 1 -- 172.21.15.81:0/2139046225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3b8157ca0 msgr2=0x7fa3b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3bde0a700 1 --2- 172.21.15.81:0/2139046225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3b8157ca0 0x7fa3b815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3bde0a700 1 -- 172.21.15.81:0/2139046225 >> v2:172.21.15.83:3300/0 conn(0x7fa3b806d120 msgr2=0x7fa3b806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3bde0a700 1 --2- 172.21.15.81:0/2139046225 >> v2:172.21.15.83:3300/0 conn(0x7fa3b806d120 0x7fa3b806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3bde0a700 1 -- 172.21.15.81:0/2139046225 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b80cfe90 con 0x7fa3b81578d0 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3bde0a700 1 --2- 172.21.15.81:0/2139046225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b81578d0 0x7fa3b80cf4f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80b3940 tx=0x7fa3b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c753d917868d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3bce08700 1 -- 172.21.15.81:0/2139046225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400e070 con 0x7fa3b81578d0 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3bce08700 1 -- 172.21.15.81:0/2139046225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b400ba50 con 0x7fa3b81578d0 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3bce08700 1 -- 172.21.15.81:0/2139046225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40092e0 con 0x7fa3b81578d0 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3c006e700 1 -- 172.21.15.81:0/2139046225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b81578d0 msgr2=0x7fa3b80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.332+0000 7fa3c006e700 1 --2- 172.21.15.81:0/2139046225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b81578d0 0x7fa3b80cf4f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80b3940 tx=0x7fa3b4009840 comp rx=0 tx=0).stop 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.333+0000 7fa3c006e700 1 -- 172.21.15.81:0/2139046225 shutdown_connections 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.333+0000 7fa3c006e700 1 --2- 172.21.15.81:0/2139046225 >> v2:172.21.15.83:3300/0 conn(0x7fa3b806d120 0x7fa3b806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.333+0000 7fa3c006e700 1 --2- 172.21.15.81:0/2139046225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b81578d0 0x7fa3b80cf4f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.333+0000 7fa3c006e700 1 --2- 172.21.15.81:0/2139046225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3b8157ca0 0x7fa3b815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.333+0000 7fa3c006e700 1 -- 172.21.15.81:0/2139046225 >> 172.21.15.81:0/2139046225 conn(0x7fa3b806bb90 msgr2=0x7fa3b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.333+0000 7fa3c006e700 1 -- 172.21.15.81:0/2139046225 shutdown_connections 2023-10-06T02:46:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.333+0000 7fa3c006e700 1 -- 172.21.15.81:0/2139046225 wait complete. 2023-10-06T02:46:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.334+0000 7fa3c006e700 1 Processor -- start 2023-10-06T02:46:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.334+0000 7fa3c006e700 1 -- start start 2023-10-06T02:46:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.334+0000 7fa3c006e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3b806d120 0x7fa3b80c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.334+0000 7fa3c006e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3b81578d0 0x7fa3b816e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.334+0000 7fa3c006e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b8157ca0 0x7fa3b816e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.334+0000 7fa3c006e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80c7d80 con 0x7fa3b8157ca0 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.334+0000 7fa3c006e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80c5bc0 con 0x7fa3b81578d0 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.334+0000 7fa3c006e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b816ec80 con 0x7fa3b806d120 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3be60b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b8157ca0 0x7fa3b816e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3be60b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b8157ca0 0x7fa3b816e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60466/0 (socket says 172.21.15.81:60466) 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3be60b700 1 -- 172.21.15.81:0/1545191787 learned_addr learned my addr 172.21.15.81:0/1545191787 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3bd609700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3b81578d0 0x7fa3b816e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3bde0a700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3b806d120 0x7fa3b80c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3be60b700 1 -- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3b806d120 msgr2=0x7fa3b80c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3be60b700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3b806d120 0x7fa3b80c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3be60b700 1 -- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3b81578d0 msgr2=0x7fa3b816e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3be60b700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3b81578d0 0x7fa3b816e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3be60b700 1 -- 172.21.15.81:0/1545191787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b4009ae0 con 0x7fa3b8157ca0 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3be60b700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b8157ca0 0x7fa3b816e5e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c880 tx=0x7fa3b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3adffb700 1 -- 172.21.15.81:0/1545191787 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0011600 con 0x7fa3b8157ca0 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3adffb700 1 -- 172.21.15.81:0/1545191787 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b0011760 con 0x7fa3b8157ca0 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b80c5e60 con 0x7fa3b8157ca0 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3adffb700 1 -- 172.21.15.81:0/1545191787 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0011ae0 con 0x7fa3b8157ca0 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.335+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b816ef60 con 0x7fa3b8157ca0 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.336+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b80c6380 con 0x7fa3b8157ca0 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.337+0000 7fa3adffb700 1 -- 172.21.15.81:0/1545191787 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3b00193f0 con 0x7fa3b8157ca0 2023-10-06T02:46:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.337+0000 7fa3adffb700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa39c066f30 0x7fa39c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.337+0000 7fa3adffb700 1 -- 172.21.15.81:0/1545191787 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa3b0084a80 con 0x7fa3b8157ca0 2023-10-06T02:46:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.337+0000 7fa3bde0a700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa39c066f30 0x7fa39c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.338+0000 7fa3bde0a700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa39c066f30 0x7fa39c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009880 tx=0x7fa3b4018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.341+0000 7fa3adffb700 1 -- 172.21.15.81:0/1545191787 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3b80c6380 con 0x7fa3b8157ca0 2023-10-06T02:46:38.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.526+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3b80c6380 con 0x7fa3b8157ca0 2023-10-06T02:46:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.527+0000 7fa3adffb700 1 -- 172.21.15.81:0/1545191787 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fa3b80c6380 con 0x7fa3b8157ca0 2023-10-06T02:46:38.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:38.529 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa39c066f30 msgr2=0x7fa39c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa39c066f30 0x7fa39c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009880 tx=0x7fa3b4018000 comp rx=0 tx=0).stop 2023-10-06T02:46:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b8157ca0 msgr2=0x7fa3b816e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b8157ca0 0x7fa3b816e5e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c880 tx=0x7fa3b0008040 comp rx=0 tx=0).stop 2023-10-06T02:46:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 shutdown_connections 2023-10-06T02:46:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b8157ca0 0x7fa3b816e5e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3b806d120 0x7fa3b80c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa39c066f30 0x7fa39c0693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 --2- 172.21.15.81:0/1545191787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3b81578d0 0x7fa3b816e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 >> 172.21.15.81:0/1545191787 conn(0x7fa3b806bb90 msgr2=0x7fa3b8155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 shutdown_connections 2023-10-06T02:46:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.529+0000 7fa3c006e700 1 -- 172.21.15.81:0/1545191787 wait complete. 2023-10-06T02:46:38.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:46:05.360665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:46:05.837671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:46:38.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.659+0000 7f0188db1700 1 Processor -- start 2023-10-06T02:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.659+0000 7f0188db1700 1 -- start start 2023-10-06T02:46:38.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0188db1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0184156db0 0x7f018406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0188db1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f018406e770 0x7f01840cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0188db1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01840b2290 con 0x7f01841569e0 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0188db1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018406ebf0 con 0x7f018406e770 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0188db1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0184157c00 con 0x7f0184156db0 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0182d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f018406e770 0x7f01840cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0182d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f018406e770 0x7f01840cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60474/0 (socket says 172.21.15.81:60474) 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0182d9d700 1 -- 172.21.15.81:0/2486743563 learned_addr learned my addr 172.21.15.81:0/2486743563 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0182d9d700 1 -- 172.21.15.81:0/2486743563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0184156db0 msgr2=0x7f018406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0182d9d700 1 --2- 172.21.15.81:0/2486743563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0184156db0 0x7f018406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0182d9d700 1 -- 172.21.15.81:0/2486743563 >> v1:172.21.15.83:6789/0 conn(0x7f01841569e0 legacy=0x7f01840b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.660+0000 7f0182d9d700 1 -- 172.21.15.81:0/2486743563 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01841572d0 con 0x7f018406e770 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0182d9d700 1 --2- 172.21.15.81:0/2486743563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018406e770 0x7f01840cd920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f017c009f20 tx=0x7f017c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadaa55465d1db60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0181d9b700 1 -- 172.21.15.81:0/2486743563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00e070 con 0x7f018406e770 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0181d9b700 1 -- 172.21.15.81:0/2486743563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c00ba40 con 0x7f018406e770 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0181d9b700 1 -- 172.21.15.81:0/2486743563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0092e0 con 0x7f018406e770 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0188db1700 1 -- 172.21.15.81:0/2486743563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018406e770 msgr2=0x7f01840cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0188db1700 1 --2- 172.21.15.81:0/2486743563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018406e770 0x7f01840cd920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f017c009f20 tx=0x7f017c009840 comp rx=0 tx=0).stop 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0188db1700 1 -- 172.21.15.81:0/2486743563 shutdown_connections 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0188db1700 1 --2- 172.21.15.81:0/2486743563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018406e770 0x7f01840cd920 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0188db1700 1 --2- 172.21.15.81:0/2486743563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0184156db0 0x7f018406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0188db1700 1 -- 172.21.15.81:0/2486743563 >> 172.21.15.81:0/2486743563 conn(0x7f018406cca0 msgr2=0x7f018406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0188db1700 1 -- 172.21.15.81:0/2486743563 shutdown_connections 2023-10-06T02:46:38.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.661+0000 7f0188db1700 1 -- 172.21.15.81:0/2486743563 wait complete. 2023-10-06T02:46:38.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.662+0000 7f0188db1700 1 Processor -- start 2023-10-06T02:46:38.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.662+0000 7f0188db1700 1 -- start start 2023-10-06T02:46:38.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0188db1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f018406e770 0x7f0184152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0188db1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01841569e0 0x7f0184159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0188db1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184156db0 0x7f018406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0188db1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0184158090 con 0x7f0184156db0 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0188db1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018415a4d0 con 0x7f018406e770 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0188db1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018415a7b0 con 0x7f01841569e0 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0182d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184156db0 0x7f018406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0182d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184156db0 0x7f018406bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60480/0 (socket says 172.21.15.81:60480) 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0182d9d700 1 -- 172.21.15.81:0/1868791691 learned_addr learned my addr 172.21.15.81:0/1868791691 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f0179d9b700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01841569e0 0x7f0184159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.663+0000 7f018259c700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f018406e770 0x7f0184152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f0182d9d700 1 -- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01841569e0 msgr2=0x7f0184159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f0182d9d700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01841569e0 0x7f0184159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f0182d9d700 1 -- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f018406e770 msgr2=0x7f0184152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f0182d9d700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f018406e770 0x7f0184152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f0182d9d700 1 -- 172.21.15.81:0/1868791691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c009ae0 con 0x7f0184156db0 2023-10-06T02:46:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f0182d9d700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184156db0 0x7f018406bb90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0184071450 tx=0x7f017c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f017affd700 1 -- 172.21.15.81:0/1868791691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00beb0 con 0x7f0184156db0 2023-10-06T02:46:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f017affd700 1 -- 172.21.15.81:0/1868791691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c0094e0 con 0x7f0184156db0 2023-10-06T02:46:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018415aa90 con 0x7f0184156db0 2023-10-06T02:46:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f017affd700 1 -- 172.21.15.81:0/1868791691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c01e430 con 0x7f0184156db0 2023-10-06T02:46:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.664+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018416a980 con 0x7f0184156db0 2023-10-06T02:46:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.665+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0184068900 con 0x7f0184156db0 2023-10-06T02:46:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.665+0000 7f017affd700 1 -- 172.21.15.81:0/1868791691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f017c01e860 con 0x7f0184156db0 2023-10-06T02:46:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.666+0000 7f017affd700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0164066f30 0x7f01640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.666+0000 7f017affd700 1 -- 172.21.15.81:0/1868791691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f017c0861b0 con 0x7f0184156db0 2023-10-06T02:46:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.666+0000 7f018259c700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0164066f30 0x7f01640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.666+0000 7f018259c700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0164066f30 0x7f01640693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01840cd100 tx=0x7f01740090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.670+0000 7f017affd700 1 -- 172.21.15.81:0/1868791691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f017c053220 con 0x7f0184156db0 2023-10-06T02:46:38.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.852+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01841575b0 con 0x7f0184156db0 2023-10-06T02:46:38.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.852+0000 7f017affd700 1 -- 172.21.15.81:0/1868791691 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f017c056840 con 0x7f0184156db0 2023-10-06T02:46:38.854 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0164066f30 msgr2=0x7f01640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0164066f30 0x7f01640693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01840cd100 tx=0x7f01740090f0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184156db0 msgr2=0x7f018406bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184156db0 0x7f018406bb90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0184071450 tx=0x7f017c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 shutdown_connections 2023-10-06T02:46:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184156db0 0x7f018406bb90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0164066f30 0x7f01640693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f018406e770 0x7f0184152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 --2- 172.21.15.81:0/1868791691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01841569e0 0x7f0184159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 >> 172.21.15.81:0/1868791691 conn(0x7f018406cca0 msgr2=0x7f0184154d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:38.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 shutdown_connections 2023-10-06T02:46:38.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.854+0000 7f0188db1700 1 -- 172.21.15.81:0/1868791691 wait complete. 2023-10-06T02:46:38.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.982+0000 7fcb263bd700 1 Processor -- start 2023-10-06T02:46:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.982+0000 7fcb263bd700 1 -- start start 2023-10-06T02:46:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb263bd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb201578d0 0x7fcb200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb263bd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcb2006d120 0x7fcb2006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb263bd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2006dac0 con 0x7fcb20157ca0 2023-10-06T02:46:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb263bd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb200d07c0 con 0x7fcb2006d120 2023-10-06T02:46:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb263bd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200cfbb0 con 0x7fcb201578d0 2023-10-06T02:46:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcb20157ca0 0x7fcb2015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33956/0 (socket says 172.21.15.81:33956) 2023-10-06T02:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1f7fe700 1 -- 172.21.15.81:0/957127382 learned_addr learned my addr 172.21.15.81:0/957127382 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb2495a700 1 --2- 172.21.15.81:0/957127382 >> v2:172.21.15.83:3300/0 conn(0x7fcb2006d120 0x7fcb2006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1ffff700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb201578d0 0x7fcb200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548583101 0 0) 0x7fcb14001110 con 0x7fcb20157ca0 2023-10-06T02:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb08003570 con 0x7fcb20157ca0 2023-10-06T02:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1150615923 0 0) 0x7fcb08003570 con 0x7fcb20157ca0 2023-10-06T02:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb201578d0 msgr2=0x7fcb200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb201578d0 0x7fcb200cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 >> v2:172.21.15.83:3300/0 conn(0x7fcb2006d120 msgr2=0x7fcb2006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 --2- 172.21.15.81:0/957127382 >> v2:172.21.15.83:3300/0 conn(0x7fcb2006d120 0x7fcb2006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb200cfe90 con 0x7fcb20157ca0 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fcb14001600 con 0x7fcb20157ca0 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.983+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 >> v1:172.21.15.81:6789/0 conn(0x7fcb20157ca0 legacy=0x7fcb2015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1effd700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb08003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1effd700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb201578d0 0x7fcb08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1effd700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb08004d50 0x7fcb080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200d07c0 con 0x7fcb08003a60 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200cfbb0 con 0x7fcb08004d50 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0800ba60 con 0x7fcb201578d0 2023-10-06T02:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1ffff700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb08003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1f7fe700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb201578d0 0x7fcb08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb2495a700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb08004d50 0x7fcb080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1ffff700 1 -- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb201578d0 msgr2=0x7fcb08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1ffff700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb201578d0 0x7fcb08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1ffff700 1 -- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb08004d50 msgr2=0x7fcb080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1ffff700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb08004d50 0x7fcb080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1ffff700 1 -- 172.21.15.81:0/957127382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08003570 con 0x7fcb08003a60 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb2495a700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb08004d50 0x7fcb080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1ffff700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb08003e70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009c00 tx=0x7fcb100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b4113f92e0d6df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000e6b0 con 0x7fcb08003a60 2023-10-06T02:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1000e810 con 0x7fcb08003a60 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.984+0000 7fcb1effd700 1 -- 172.21.15.81:0/957127382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000ebd0 con 0x7fcb08003a60 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.985+0000 7fcb263bd700 1 -- 172.21.15.81:0/957127382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 msgr2=0x7fcb08003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.985+0000 7fcb263bd700 1 --2- 172.21.15.81:0/957127382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb08003e70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009c00 tx=0x7fcb100091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.985+0000 7fcb2495a700 1 -- 172.21.15.81:0/957127382 reap_dead start 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.985+0000 7fcb263bd700 1 -- 172.21.15.81:0/957127382 shutdown_connections 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.985+0000 7fcb263bd700 1 -- 172.21.15.81:0/957127382 >> 172.21.15.81:0/957127382 conn(0x7fcb2006bb90 msgr2=0x7fcb2006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.985+0000 7fcb263bd700 1 -- 172.21.15.81:0/957127382 shutdown_connections 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.985+0000 7fcb263bd700 1 -- 172.21.15.81:0/957127382 wait complete. 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.986+0000 7fcb263bd700 1 Processor -- start 2023-10-06T02:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.986+0000 7fcb263bd700 1 -- start start 2023-10-06T02:46:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb263bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb200ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb263bd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb200b6210 0x7fcb200ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb263bd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb200aca60 0x7fcb200b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb263bd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200ad390 con 0x7fcb08003a60 2023-10-06T02:46:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb263bd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200abb10 con 0x7fcb200b6210 2023-10-06T02:46:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb263bd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200b3ba0 con 0x7fcb200aca60 2023-10-06T02:46:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb200ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb200ab5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60498/0 (socket says 172.21.15.81:60498) 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1ffff700 1 -- 172.21.15.81:0/3416609293 learned_addr learned my addr 172.21.15.81:0/3416609293 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1f7fe700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb200b6210 0x7fcb200ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1ffff700 1 -- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb200aca60 msgr2=0x7fcb200b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb2495a700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb200aca60 0x7fcb200b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1ffff700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb200aca60 0x7fcb200b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1ffff700 1 -- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb200b6210 msgr2=0x7fcb200ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1ffff700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb200b6210 0x7fcb200ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1ffff700 1 -- 172.21.15.81:0/3416609293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb200b4720 con 0x7fcb08003a60 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1f7fe700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb200b6210 0x7fcb200ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb2495a700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb200aca60 0x7fcb200b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb1ffff700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb200ab5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000e4b0 tx=0x7fcb1001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb07fff700 1 -- 172.21.15.81:0/3416609293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10022070 con 0x7fcb08003a60 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb07fff700 1 -- 172.21.15.81:0/3416609293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1000e980 con 0x7fcb08003a60 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb07fff700 1 -- 172.21.15.81:0/3416609293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10027470 con 0x7fcb08003a60 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb200aceb0 con 0x7fcb08003a60 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.987+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb200b40d0 con 0x7fcb08003a60 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.988+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb20067ac0 con 0x7fcb08003a60 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.989+0000 7fcb07fff700 1 -- 172.21.15.81:0/3416609293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb1001c450 con 0x7fcb08003a60 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.989+0000 7fcb07fff700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb0c066f30 0x7fcb0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.989+0000 7fcb07fff700 1 -- 172.21.15.81:0/3416609293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb10086230 con 0x7fcb08003a60 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.989+0000 7fcb1f7fe700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb0c066f30 0x7fcb0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.990+0000 7fcb1f7fe700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb0c066f30 0x7fcb0c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb14000c00 tx=0x7fcb14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:38.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:38.993+0000 7fcb07fff700 1 -- 172.21.15.81:0/3416609293 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb10053400 con 0x7fcb08003a60 2023-10-06T02:46:39.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.174+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb200d0170 con 0x7fcb08003a60 2023-10-06T02:46:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.175+0000 7fcb07fff700 1 -- 172.21.15.81:0/3416609293 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb10017020 con 0x7fcb08003a60 2023-10-06T02:46:39.176 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:39.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb0c066f30 msgr2=0x7fcb0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb0c066f30 0x7fcb0c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb14000c00 tx=0x7fcb14009040 comp rx=0 tx=0).stop 2023-10-06T02:46:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 msgr2=0x7fcb200ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb200ab5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000e4b0 tx=0x7fcb1001a000 comp rx=0 tx=0).stop 2023-10-06T02:46:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 shutdown_connections 2023-10-06T02:46:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb200aca60 0x7fcb200b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb08003a60 0x7fcb200ab5d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb0c066f30 0x7fcb0c0693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 --2- 172.21.15.81:0/3416609293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb200b6210 0x7fcb200ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 >> 172.21.15.81:0/3416609293 conn(0x7fcb2006bb90 msgr2=0x7fcb20156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:39.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.176+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 shutdown_connections 2023-10-06T02:46:39.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.177+0000 7fcb263bd700 1 -- 172.21.15.81:0/3416609293 wait complete. 2023-10-06T02:46:39.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:46:39.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.305+0000 7f5833fff700 1 Processor -- start 2023-10-06T02:46:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.305+0000 7f5833fff700 1 -- start start 2023-10-06T02:46:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f5833fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58340d0b80 0x7f58340cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f5833fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f583406d700 0x7f583415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f5833fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58340cf2d0 con 0x7f58340d02b0 2023-10-06T02:46:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f5833fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583415a690 con 0x7f583406d700 2023-10-06T02:46:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f5833fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583406dc00 con 0x7f58340d0b80 2023-10-06T02:46:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f58327fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f58340d02b0 0x7f583406cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33958/0 (socket says 172.21.15.81:33958) 2023-10-06T02:46:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f58327fc700 1 -- 172.21.15.81:0/802434268 learned_addr learned my addr 172.21.15.81:0/802434268 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f58337fe700 1 --2- 172.21.15.81:0/802434268 >> v2:172.21.15.83:3300/0 conn(0x7f583406d700 0x7f583415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f5832ffd700 1 --2- 172.21.15.81:0/802434268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58340d0b80 0x7f58340cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f5831ffb700 1 -- 172.21.15.81:0/802434268 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005012885 0 0) 0x7f58340cf2d0 con 0x7f58340d02b0 2023-10-06T02:46:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f5831ffb700 1 -- 172.21.15.81:0/802434268 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f581c003570 con 0x7f58340d02b0 2023-10-06T02:46:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f58337fe700 1 -- 172.21.15.81:0/802434268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58340d0b80 msgr2=0x7f58340cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.306+0000 7f58337fe700 1 --2- 172.21.15.81:0/802434268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58340d0b80 0x7f58340cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f58337fe700 1 -- 172.21.15.81:0/802434268 >> v1:172.21.15.81:6789/0 conn(0x7f58340d02b0 legacy=0x7f583406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f58337fe700 1 -- 172.21.15.81:0/802434268 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58340cf570 con 0x7f583406d700 2023-10-06T02:46:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f58337fe700 1 --2- 172.21.15.81:0/802434268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f583406d700 0x7f583415b320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f582c009e60 tx=0x7f582c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7231bf5277822a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5831ffb700 1 -- 172.21.15.81:0/802434268 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00e070 con 0x7f583406d700 2023-10-06T02:46:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5831ffb700 1 -- 172.21.15.81:0/802434268 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c00bab0 con 0x7f583406d700 2023-10-06T02:46:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5831ffb700 1 -- 172.21.15.81:0/802434268 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00be30 con 0x7f583406d700 2023-10-06T02:46:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5833fff700 1 -- 172.21.15.81:0/802434268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f583406d700 msgr2=0x7f583415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5833fff700 1 --2- 172.21.15.81:0/802434268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f583406d700 0x7f583415b320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f582c009e60 tx=0x7f582c009780 comp rx=0 tx=0).stop 2023-10-06T02:46:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5833fff700 1 -- 172.21.15.81:0/802434268 shutdown_connections 2023-10-06T02:46:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5833fff700 1 --2- 172.21.15.81:0/802434268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58340d0b80 0x7f58340cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5833fff700 1 --2- 172.21.15.81:0/802434268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f583406d700 0x7f583415b320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5833fff700 1 -- 172.21.15.81:0/802434268 >> 172.21.15.81:0/802434268 conn(0x7f5834063230 msgr2=0x7f5834063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5833fff700 1 -- 172.21.15.81:0/802434268 shutdown_connections 2023-10-06T02:46:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.307+0000 7f5833fff700 1 -- 172.21.15.81:0/802434268 wait complete. 2023-10-06T02:46:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.309+0000 7f5833fff700 1 Processor -- start 2023-10-06T02:46:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.309+0000 7f5833fff700 1 -- start start 2023-10-06T02:46:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.309+0000 7f5833fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583406d700 0x7f58341555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.309+0000 7f5833fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58340d02b0 0x7f58340b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.309+0000 7f5833fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58340d0b80 0x7f58340b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.309+0000 7f5833fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58340cd770 con 0x7f58340d0b80 2023-10-06T02:46:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.309+0000 7f5833fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583416a910 con 0x7f58340d02b0 2023-10-06T02:46:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.309+0000 7f5833fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58340c62a0 con 0x7f583406d700 2023-10-06T02:46:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58340d0b80 0x7f58340b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58340d0b80 0x7f58340b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60510/0 (socket says 172.21.15.81:60510) 2023-10-06T02:46:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58337fe700 1 -- 172.21.15.81:0/3987598660 learned_addr learned my addr 172.21.15.81:0/3987598660 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f5832ffd700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583406d700 0x7f58341555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58327fc700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58340d02b0 0x7f58340b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58337fe700 1 -- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583406d700 msgr2=0x7f58341555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58337fe700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583406d700 0x7f58341555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58337fe700 1 -- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58340d02b0 msgr2=0x7f58340b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58337fe700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58340d02b0 0x7f58340b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58337fe700 1 -- 172.21.15.81:0/3987598660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c009a20 con 0x7f58340d0b80 2023-10-06T02:46:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f58337fe700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58340d0b80 0x7f58340b5b20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f583406fcc0 tx=0x7f582c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f581affd700 1 -- 172.21.15.81:0/3987598660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c012e10 con 0x7f58340d0b80 2023-10-06T02:46:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f581affd700 1 -- 172.21.15.81:0/3987598660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c027470 con 0x7f58340d0b80 2023-10-06T02:46:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f581affd700 1 -- 172.21.15.81:0/3987598660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c027830 con 0x7f58340d0b80 2023-10-06T02:46:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583416a630 con 0x7f58340d0b80 2023-10-06T02:46:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.310+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58340c5f30 con 0x7f58340d0b80 2023-10-06T02:46:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.311+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58340c6450 con 0x7f58340d0b80 2023-10-06T02:46:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.311+0000 7f581affd700 1 -- 172.21.15.81:0/3987598660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f582c024070 con 0x7f58340d0b80 2023-10-06T02:46:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.312+0000 7f581affd700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5820066f30 0x7f58200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.312+0000 7f581affd700 1 -- 172.21.15.81:0/3987598660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f582c086be0 con 0x7f58340d0b80 2023-10-06T02:46:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.312+0000 7f5832ffd700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5820066f30 0x7f58200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.313+0000 7f5832ffd700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5820066f30 0x7f58200693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5824009d10 tx=0x7f58240091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.316+0000 7f581affd700 1 -- 172.21.15.81:0/3987598660 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58340c6450 con 0x7f58340d0b80 2023-10-06T02:46:39.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.500+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5834067730 con 0x7f58340d0b80 2023-10-06T02:46:39.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.500+0000 7f581affd700 1 -- 172.21.15.81:0/3987598660 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f582c02c020 con 0x7f58340d0b80 2023-10-06T02:46:39.502 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:46:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5820066f30 msgr2=0x7f58200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5820066f30 0x7f58200693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5824009d10 tx=0x7f58240091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58340d0b80 msgr2=0x7f58340b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58340d0b80 0x7f58340b5b20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f583406fcc0 tx=0x7f582c019000 comp rx=0 tx=0).stop 2023-10-06T02:46:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 shutdown_connections 2023-10-06T02:46:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58340d0b80 0x7f58340b5b20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583406d700 0x7f58341555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5820066f30 0x7f58200693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 --2- 172.21.15.81:0/3987598660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58340d02b0 0x7f58340b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 >> 172.21.15.81:0/3987598660 conn(0x7f5834063230 msgr2=0x7f583415d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 shutdown_connections 2023-10-06T02:46:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.503+0000 7f5833fff700 1 -- 172.21.15.81:0/3987598660 wait complete. 2023-10-06T02:46:39.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:46:39.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.634+0000 7f87a3428700 1 Processor -- start 2023-10-06T02:46:39.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.634+0000 7f87a3428700 1 -- start start 2023-10-06T02:46:39.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a3428700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 0x7f879c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a3428700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f879c156d50 0x7f879c0c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a3428700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c0af930 con 0x7f879c156980 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a3428700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c0c9f50 con 0x7f879c156d50 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a3428700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0ca160 con 0x7f879c0b1d00 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a2c27700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f879c156d50 0x7f879c0c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a2426700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f879c156980 0x7f879c0b15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33960/0 (socket says 172.21.15.81:33960) 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a2426700 1 -- 172.21.15.81:0/3394063974 learned_addr learned my addr 172.21.15.81:0/3394063974 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a1c25700 1 --2- 172.21.15.81:0/3394063974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 0x7f879c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a2c27700 1 -- 172.21.15.81:0/3394063974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 msgr2=0x7f879c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a2c27700 1 --2- 172.21.15.81:0/3394063974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 0x7f879c0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a2c27700 1 -- 172.21.15.81:0/3394063974 >> v1:172.21.15.81:6789/0 conn(0x7f879c156980 legacy=0x7f879c0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a2c27700 1 -- 172.21.15.81:0/3394063974 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c0ca440 con 0x7f879c156d50 2023-10-06T02:46:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a1424700 1 -- 172.21.15.81:0/3394063974 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979627011 0 0) 0x7f879c0af930 con 0x7f879c156980 2023-10-06T02:46:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.635+0000 7f87a2c27700 1 --2- 172.21.15.81:0/3394063974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 0x7f879c0c9a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8794009e60 tx=0x7f8794009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d37f7b9f5f31f92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a1424700 1 -- 172.21.15.81:0/3394063974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400e070 con 0x7f879c156d50 2023-10-06T02:46:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a1424700 1 -- 172.21.15.81:0/3394063974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879400bc30 con 0x7f879c156d50 2023-10-06T02:46:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a1424700 1 -- 172.21.15.81:0/3394063974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794012430 con 0x7f879c156d50 2023-10-06T02:46:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a3428700 1 -- 172.21.15.81:0/3394063974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 msgr2=0x7f879c0c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a3428700 1 --2- 172.21.15.81:0/3394063974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 0x7f879c0c9a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8794009e60 tx=0x7f8794009780 comp rx=0 tx=0).stop 2023-10-06T02:46:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a3428700 1 -- 172.21.15.81:0/3394063974 shutdown_connections 2023-10-06T02:46:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a3428700 1 --2- 172.21.15.81:0/3394063974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 0x7f879c0c9a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a3428700 1 --2- 172.21.15.81:0/3394063974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 0x7f879c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a3428700 1 -- 172.21.15.81:0/3394063974 >> 172.21.15.81:0/3394063974 conn(0x7f879c06bb90 msgr2=0x7f879c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a3428700 1 -- 172.21.15.81:0/3394063974 shutdown_connections 2023-10-06T02:46:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.636+0000 7f87a3428700 1 -- 172.21.15.81:0/3394063974 wait complete. 2023-10-06T02:46:39.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.637+0000 7f87a3428700 1 Processor -- start 2023-10-06T02:46:39.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.637+0000 7f87a3428700 1 -- start start 2023-10-06T02:46:39.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a3428700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 0x7f879c13e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a3428700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879c156980 0x7f879c143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a3428700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 0x7f879c143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a3428700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c14ae30 con 0x7f879c156d50 2023-10-06T02:46:39.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a3428700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c16b230 con 0x7f879c156980 2023-10-06T02:46:39.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a3428700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c16b510 con 0x7f879c0b1d00 2023-10-06T02:46:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a2c27700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 0x7f879c143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a2c27700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 0x7f879c143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60526/0 (socket says 172.21.15.81:60526) 2023-10-06T02:46:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a2c27700 1 -- 172.21.15.81:0/923089037 learned_addr learned my addr 172.21.15.81:0/923089037 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a2426700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 0x7f879c13e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a1c25700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879c156980 0x7f879c143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a2c27700 1 -- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 msgr2=0x7f879c13e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a2c27700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 0x7f879c13e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a2c27700 1 -- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879c156980 msgr2=0x7f879c143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a2c27700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879c156980 0x7f879c143550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a2c27700 1 -- 172.21.15.81:0/923089037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794009a20 con 0x7f879c156d50 2023-10-06T02:46:39.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.638+0000 7f87a1c25700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879c156980 0x7f879c143550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:39.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.639+0000 7f87a2c27700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 0x7f879c143a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8794013000 tx=0x7f8794019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:39.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.639+0000 7f87927fc700 1 -- 172.21.15.81:0/923089037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794012e50 con 0x7f879c156d50 2023-10-06T02:46:39.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.639+0000 7f87927fc700 1 -- 172.21.15.81:0/923089037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879401d630 con 0x7f879c156d50 2023-10-06T02:46:39.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.639+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c16b7f0 con 0x7f879c156d50 2023-10-06T02:46:39.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.639+0000 7f87927fc700 1 -- 172.21.15.81:0/923089037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879401d9f0 con 0x7f879c156d50 2023-10-06T02:46:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.639+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c13eba0 con 0x7f879c156d50 2023-10-06T02:46:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.640+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c0676e0 con 0x7f879c156d50 2023-10-06T02:46:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.641+0000 7f87927fc700 1 -- 172.21.15.81:0/923089037 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8794024070 con 0x7f879c156d50 2023-10-06T02:46:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.641+0000 7f87927fc700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8780066f30 0x7f87800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.641+0000 7f87927fc700 1 -- 172.21.15.81:0/923089037 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8794086f40 con 0x7f879c156d50 2023-10-06T02:46:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.641+0000 7f87a2426700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8780066f30 0x7f87800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.642+0000 7f87a2426700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8780066f30 0x7f87800693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f87980011e0 tx=0x7f8798009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:39.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.645+0000 7f87927fc700 1 -- 172.21.15.81:0/923089037 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8794054050 con 0x7f879c156d50 2023-10-06T02:46:39.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.826+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f879c071b10 con 0x7f879c156d50 2023-10-06T02:46:39.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.827+0000 7f87927fc700 1 -- 172.21.15.81:0/923089037 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f879402c0a0 con 0x7f879c156d50 2023-10-06T02:46:39.828 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:46:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8780066f30 msgr2=0x7f87800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8780066f30 0x7f87800693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f87980011e0 tx=0x7f8798009040 comp rx=0 tx=0).stop 2023-10-06T02:46:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 msgr2=0x7f879c143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 0x7f879c143a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8794013000 tx=0x7f8794019000 comp rx=0 tx=0).stop 2023-10-06T02:46:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 shutdown_connections 2023-10-06T02:46:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f879c156d50 0x7f879c143a90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f879c0b1d00 0x7f879c13e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8780066f30 0x7f87800693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 --2- 172.21.15.81:0/923089037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879c156980 0x7f879c143550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 >> 172.21.15.81:0/923089037 conn(0x7f879c06bb90 msgr2=0x7f879c0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 shutdown_connections 2023-10-06T02:46:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.829+0000 7f87a3428700 1 -- 172.21.15.81:0/923089037 wait complete. 2023-10-06T02:46:39.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.955+0000 7fe4f72cb700 1 Processor -- start 2023-10-06T02:46:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.956+0000 7fe4f72cb700 1 -- start start 2023-10-06T02:46:39.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.956+0000 7fe4f72cb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe4f00cf240 0x7fe4f00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.956+0000 7fe4f72cb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f00b0ca0 con 0x7fe4f006d650 2023-10-06T02:46:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.956+0000 7fe4f72cb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f00b00d0 con 0x7fe4f015a2a0 2023-10-06T02:46:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.956+0000 7fe4f72cb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f006ea90 con 0x7fe4f00cf240 2023-10-06T02:46:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4f5868700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe4f006d650 0x7fe4f006da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33970/0 (socket says 172.21.15.81:33970) 2023-10-06T02:46:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4f5868700 1 -- 172.21.15.81:0/3236186150 learned_addr learned my addr 172.21.15.81:0/3236186150 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4f4866700 1 --2- 172.21.15.81:0/3236186150 >> v2:172.21.15.83:3300/0 conn(0x7fe4f00cf240 0x7fe4f00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4e7fff700 1 -- 172.21.15.81:0/3236186150 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929785987 0 0) 0x7fe4f00b0ca0 con 0x7fe4f006d650 2023-10-06T02:46:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4e7fff700 1 -- 172.21.15.81:0/3236186150 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4dc003570 con 0x7fe4f006d650 2023-10-06T02:46:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4e7fff700 1 -- 172.21.15.81:0/3236186150 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336203899 0 0) 0x7fe4f00b00d0 con 0x7fe4f015a2a0 2023-10-06T02:46:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4e7fff700 1 -- 172.21.15.81:0/3236186150 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f00b0ca0 con 0x7fe4f015a2a0 2023-10-06T02:46:39.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4f4866700 1 -- 172.21.15.81:0/3236186150 >> v1:172.21.15.83:6789/0 conn(0x7fe4f015a2a0 legacy=0x7fe4f00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4e7fff700 1 -- 172.21.15.81:0/3236186150 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1635584987 0 0) 0x7fe4dc003570 con 0x7fe4f006d650 2023-10-06T02:46:39.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4f4866700 1 -- 172.21.15.81:0/3236186150 >> v1:172.21.15.81:6789/0 conn(0x7fe4f006d650 legacy=0x7fe4f006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4f4866700 1 -- 172.21.15.81:0/3236186150 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f00b0370 con 0x7fe4f00cf240 2023-10-06T02:46:39.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4f4866700 1 --2- 172.21.15.81:0/3236186150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f00cf240 0x7fe4f00b1130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00098e0 tx=0x7fe4e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f9f48d42651339c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:39.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4e7fff700 1 -- 172.21.15.81:0/3236186150 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80017f0 con 0x7fe4f00cf240 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.957+0000 7fe4e7fff700 1 -- 172.21.15.81:0/3236186150 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0011420 con 0x7fe4f00cf240 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.958+0000 7fe4e7fff700 1 -- 172.21.15.81:0/3236186150 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00117c0 con 0x7fe4f00cf240 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.958+0000 7fe4f72cb700 1 -- 172.21.15.81:0/3236186150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f00cf240 msgr2=0x7fe4f00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.958+0000 7fe4f72cb700 1 --2- 172.21.15.81:0/3236186150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f00cf240 0x7fe4f00b1130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00098e0 tx=0x7fe4e00091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.958+0000 7fe4f72cb700 1 -- 172.21.15.81:0/3236186150 shutdown_connections 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.958+0000 7fe4f72cb700 1 --2- 172.21.15.81:0/3236186150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f00cf240 0x7fe4f00b1130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.958+0000 7fe4f72cb700 1 -- 172.21.15.81:0/3236186150 >> 172.21.15.81:0/3236186150 conn(0x7fe4f0067640 msgr2=0x7fe4f0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.958+0000 7fe4f72cb700 1 -- 172.21.15.81:0/3236186150 shutdown_connections 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.958+0000 7fe4f72cb700 1 -- 172.21.15.81:0/3236186150 wait complete. 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.959+0000 7fe4f72cb700 1 Processor -- start 2023-10-06T02:46:39.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.959+0000 7fe4f72cb700 1 -- start start 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f72cb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4f006d650 0x7fe4f0144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f72cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00cf240 0x7fe4f015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f72cb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f015a2a0 0x7fe4f015f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f72cb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00b3720 con 0x7fe4f00cf240 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f72cb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f015de80 con 0x7fe4f015a2a0 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f72cb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00b2b10 con 0x7fe4f006d650 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f4866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00cf240 0x7fe4f015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f4866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00cf240 0x7fe4f015d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60540/0 (socket says 172.21.15.81:60540) 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f4866700 1 -- 172.21.15.81:0/2190910491 learned_addr learned my addr 172.21.15.81:0/2190910491 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f5067700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4f006d650 0x7fe4f0144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f5868700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f015a2a0 0x7fe4f015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f4866700 1 -- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4f006d650 msgr2=0x7fe4f0144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f4866700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4f006d650 0x7fe4f0144160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f4866700 1 -- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f015a2a0 msgr2=0x7fe4f015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.960+0000 7fe4f4866700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f015a2a0 0x7fe4f015f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.961+0000 7fe4f4866700 1 -- 172.21.15.81:0/2190910491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0009420 con 0x7fe4f00cf240 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.961+0000 7fe4f4866700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00cf240 0x7fe4f015d940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0002000 tx=0x7fe4e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.961+0000 7fe4e57fa700 1 -- 172.21.15.81:0/2190910491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e001cc90 con 0x7fe4f00cf240 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.961+0000 7fe4e57fa700 1 -- 172.21.15.81:0/2190910491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e001cdf0 con 0x7fe4f00cf240 2023-10-06T02:46:39.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.961+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f00b2df0 con 0x7fe4f00cf240 2023-10-06T02:46:39.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.961+0000 7fe4e57fa700 1 -- 172.21.15.81:0/2190910491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e001a6a0 con 0x7fe4f00cf240 2023-10-06T02:46:39.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.961+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f00b33b0 con 0x7fe4f00cf240 2023-10-06T02:46:39.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.962+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f0069e40 con 0x7fe4f00cf240 2023-10-06T02:46:39.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.962+0000 7fe4e57fa700 1 -- 172.21.15.81:0/2190910491 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4e001aa50 con 0x7fe4f00cf240 2023-10-06T02:46:39.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.963+0000 7fe4e57fa700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe4d4066f30 0x7fe4d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:39.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.963+0000 7fe4e57fa700 1 -- 172.21.15.81:0/2190910491 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe4e0085ee0 con 0x7fe4f00cf240 2023-10-06T02:46:39.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.963+0000 7fe4f5067700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe4d4066f30 0x7fe4d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:39.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.963+0000 7fe4f5067700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe4d4066f30 0x7fe4d40693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0154ff0 tx=0x7fe4ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:39.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:39.967+0000 7fe4e57fa700 1 -- 172.21.15.81:0/2190910491 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4e0052ff0 con 0x7fe4f00cf240 2023-10-06T02:46:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.151+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4f00b3860 con 0x7fe4f00cf240 2023-10-06T02:46:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.152+0000 7fe4e57fa700 1 -- 172.21.15.81:0/2190910491 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fe4e0056610 con 0x7fe4f00cf240 2023-10-06T02:46:40.153 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:40.153 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe4d4066f30 msgr2=0x7fe4d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe4d4066f30 0x7fe4d40693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0154ff0 tx=0x7fe4ec009040 comp rx=0 tx=0).stop 2023-10-06T02:46:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00cf240 msgr2=0x7fe4f015d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00cf240 0x7fe4f015d940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0002000 tx=0x7fe4e0016000 comp rx=0 tx=0).stop 2023-10-06T02:46:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 shutdown_connections 2023-10-06T02:46:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe4d4066f30 0x7fe4d40693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f015a2a0 0x7fe4f015f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe4f006d650 0x7fe4f0144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 --2- 172.21.15.81:0/2190910491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00cf240 0x7fe4f015d940 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 >> 172.21.15.81:0/2190910491 conn(0x7fe4f0067640 msgr2=0x7fe4f00ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 shutdown_connections 2023-10-06T02:46:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.154+0000 7fe4f72cb700 1 -- 172.21.15.81:0/2190910491 wait complete. 2023-10-06T02:46:40.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:46:05.360665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:46:05.837671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:46:40.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:40.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.283+0000 7f5b0d2ee700 1 Processor -- start 2023-10-06T02:46:40.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.283+0000 7f5b0d2ee700 1 -- start start 2023-10-06T02:46:40.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b0d2ee700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b08159d40 0x7f5b080d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b0d2ee700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 0x7f5b080b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b0d2ee700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5b080cb390 0x7f5b080b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b0d2ee700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b080ce290 con 0x7f5b08159d40 2023-10-06T02:46:40.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b0d2ee700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b080cda30 con 0x7f5b080cb390 2023-10-06T02:46:40.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b0d2ee700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080cdcd0 con 0x7f5b0815a110 2023-10-06T02:46:40.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b06ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b08159d40 0x7f5b080d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b06ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b08159d40 0x7f5b080d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60542/0 (socket says 172.21.15.81:60542) 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b06ffd700 1 -- 172.21.15.81:0/3345952638 learned_addr learned my addr 172.21.15.81:0/3345952638 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5afe7fc700 1 --2- 172.21.15.81:0/3345952638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 0x7f5b080b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b077fe700 1 --2- 172.21.15.81:0/3345952638 >> v2:172.21.15.83:3300/0 conn(0x7f5b080cb390 0x7f5b080b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b06ffd700 1 -- 172.21.15.81:0/3345952638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 msgr2=0x7f5b080b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b06ffd700 1 --2- 172.21.15.81:0/3345952638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 0x7f5b080b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b06ffd700 1 -- 172.21.15.81:0/3345952638 >> v2:172.21.15.83:3300/0 conn(0x7f5b080cb390 msgr2=0x7f5b080b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b06ffd700 1 --2- 172.21.15.81:0/3345952638 >> v2:172.21.15.83:3300/0 conn(0x7f5b080cb390 0x7f5b080b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.284+0000 7f5b06ffd700 1 -- 172.21.15.81:0/3345952638 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080cdfb0 con 0x7f5b08159d40 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b06ffd700 1 --2- 172.21.15.81:0/3345952638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b08159d40 0x7f5b080d06d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5b080cffb0 tx=0x7f5af8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23de414f19aaf5ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b067fc700 1 -- 172.21.15.81:0/3345952638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800b860 con 0x7f5b08159d40 2023-10-06T02:46:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b067fc700 1 -- 172.21.15.81:0/3345952638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af800b9c0 con 0x7f5b08159d40 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b067fc700 1 -- 172.21.15.81:0/3345952638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800bd60 con 0x7f5b08159d40 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/3345952638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b08159d40 msgr2=0x7f5b080d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/3345952638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b08159d40 0x7f5b080d06d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5b080cffb0 tx=0x7f5af8009250 comp rx=0 tx=0).stop 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/3345952638 shutdown_connections 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/3345952638 >> v2:172.21.15.83:3300/0 conn(0x7f5b080cb390 0x7f5b080b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/3345952638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b08159d40 0x7f5b080d06d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/3345952638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 0x7f5b080b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/3345952638 >> 172.21.15.81:0/3345952638 conn(0x7f5b0806bb90 msgr2=0x7f5b0806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/3345952638 shutdown_connections 2023-10-06T02:46:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.285+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/3345952638 wait complete. 2023-10-06T02:46:40.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.286+0000 7f5b0d2ee700 1 Processor -- start 2023-10-06T02:46:40.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b0d2ee700 1 -- start start 2023-10-06T02:46:40.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b0d2ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b080cb390 0x7f5b08069020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b0d2ee700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b08159d40 0x7f5b080b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b0d2ee700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 0x7f5b080c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b0d2ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b08069560 con 0x7f5b080cb390 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b0d2ee700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b08069bf0 con 0x7f5b08159d40 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b0d2ee700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080c9580 con 0x7f5b0815a110 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b06ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b080cb390 0x7f5b08069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b06ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b080cb390 0x7f5b08069020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60546/0 (socket says 172.21.15.81:60546) 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b06ffd700 1 -- 172.21.15.81:0/1709556172 learned_addr learned my addr 172.21.15.81:0/1709556172 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5b077fe700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 0x7f5b080c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.287+0000 7f5afe7fc700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b08159d40 0x7f5b080b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5b06ffd700 1 -- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 msgr2=0x7f5b080c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5b06ffd700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 0x7f5b080c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5b06ffd700 1 -- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b08159d40 msgr2=0x7f5b080b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5b06ffd700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b08159d40 0x7f5b080b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5b06ffd700 1 -- 172.21.15.81:0/1709556172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80094f0 con 0x7f5b080cb390 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5b06ffd700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b080cb390 0x7f5b08069020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b0806aff0 tx=0x7f5af8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5aff7fe700 1 -- 172.21.15.81:0/1709556172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8011dc0 con 0x7f5b080cb390 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5aff7fe700 1 -- 172.21.15.81:0/1709556172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af8024440 con 0x7f5b080cb390 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b080c9860 con 0x7f5b080cb390 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5aff7fe700 1 -- 172.21.15.81:0/1709556172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8024800 con 0x7f5b080cb390 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.288+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b080c9e20 con 0x7f5b080cb390 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.289+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b08067d30 con 0x7f5b080cb390 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.289+0000 7f5aff7fe700 1 -- 172.21.15.81:0/1709556172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5af801a420 con 0x7f5b080cb390 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.290+0000 7f5aff7fe700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ae8066f30 0x7f5ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.290+0000 7f5aff7fe700 1 -- 172.21.15.81:0/1709556172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5af80864f0 con 0x7f5b080cb390 2023-10-06T02:46:40.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.290+0000 7f5afe7fc700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ae8066f30 0x7f5ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.290+0000 7f5afe7fc700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ae8066f30 0x7f5ae80693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b0814e0f0 tx=0x7f5af0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:40.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.294+0000 7f5aff7fe700 1 -- 172.21.15.81:0/1709556172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5af8053680 con 0x7f5b080cb390 2023-10-06T02:46:40.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.476+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b080cb900 con 0x7f5b080cb390 2023-10-06T02:46:40.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.477+0000 7f5aff7fe700 1 -- 172.21.15.81:0/1709556172 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5af8056ca0 con 0x7f5b080cb390 2023-10-06T02:46:40.478 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:40.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ae8066f30 msgr2=0x7f5ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ae8066f30 0x7f5ae80693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b0814e0f0 tx=0x7f5af0008040 comp rx=0 tx=0).stop 2023-10-06T02:46:40.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b080cb390 msgr2=0x7f5b08069020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b080cb390 0x7f5b08069020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b0806aff0 tx=0x7f5af8017000 comp rx=0 tx=0).stop 2023-10-06T02:46:40.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 shutdown_connections 2023-10-06T02:46:40.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b0815a110 0x7f5b080c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b080cb390 0x7f5b08069020 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5ae8066f30 0x7f5ae80693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 --2- 172.21.15.81:0/1709556172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b08159d40 0x7f5b080b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 >> 172.21.15.81:0/1709556172 conn(0x7f5b0806bb90 msgr2=0x7f5b081574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:40.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 shutdown_connections 2023-10-06T02:46:40.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.479+0000 7f5b0d2ee700 1 -- 172.21.15.81:0/1709556172 wait complete. 2023-10-06T02:46:40.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.608+0000 7fef28a71700 1 Processor -- start 2023-10-06T02:46:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.608+0000 7fef28a71700 1 -- start start 2023-10-06T02:46:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.608+0000 7fef28a71700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef241578d0 0x7fef240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.608+0000 7fef28a71700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fef2406d120 0x7fef2406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.608+0000 7fef28a71700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240d07c0 con 0x7fef24157ca0 2023-10-06T02:46:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.608+0000 7fef28a71700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2406da50 con 0x7fef241578d0 2023-10-06T02:46:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.608+0000 7fef28a71700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240cfbb0 con 0x7fef2406d120 2023-10-06T02:46:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.608+0000 7fef2259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef241578d0 0x7fef240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef19d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fef24157ca0 0x7fef2415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45558/0 (socket says 172.21.15.81:45558) 2023-10-06T02:46:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef2259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef241578d0 0x7fef240cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43900/0 (socket says 172.21.15.81:43900) 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef19d9b700 1 -- 172.21.15.81:0/3782991212 learned_addr learned my addr 172.21.15.81:0/3782991212 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef2259c700 1 -- 172.21.15.81:0/3782991212 >> v2:172.21.15.83:3300/0 conn(0x7fef2406d120 msgr2=0x7fef2406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef22d9d700 1 --2- 172.21.15.81:0/3782991212 >> v2:172.21.15.83:3300/0 conn(0x7fef2406d120 0x7fef2406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef2259c700 1 --2- 172.21.15.81:0/3782991212 >> v2:172.21.15.83:3300/0 conn(0x7fef2406d120 0x7fef2406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef2259c700 1 -- 172.21.15.81:0/3782991212 >> v1:172.21.15.81:6789/0 conn(0x7fef24157ca0 legacy=0x7fef2415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef21d9b700 1 -- 172.21.15.81:0/3782991212 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584257597 0 0) 0x7fef240d07c0 con 0x7fef24157ca0 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef2259c700 1 -- 172.21.15.81:0/3782991212 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240cfe90 con 0x7fef241578d0 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef2259c700 1 --2- 172.21.15.81:0/3782991212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 0x7fef240cf4f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef24068300 tx=0x7fef140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565a049d06630b8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef21d9b700 1 -- 172.21.15.81:0/3782991212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1400b6b0 con 0x7fef241578d0 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef21d9b700 1 -- 172.21.15.81:0/3782991212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1400b810 con 0x7fef241578d0 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.609+0000 7fef21d9b700 1 -- 172.21.15.81:0/3782991212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1400bbb0 con 0x7fef241578d0 2023-10-06T02:46:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.610+0000 7fef28a71700 1 -- 172.21.15.81:0/3782991212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 msgr2=0x7fef240cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.610+0000 7fef28a71700 1 --2- 172.21.15.81:0/3782991212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 0x7fef240cf4f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef24068300 tx=0x7fef140091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.610+0000 7fef28a71700 1 -- 172.21.15.81:0/3782991212 shutdown_connections 2023-10-06T02:46:40.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.610+0000 7fef28a71700 1 --2- 172.21.15.81:0/3782991212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 0x7fef240cf4f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.610+0000 7fef28a71700 1 --2- 172.21.15.81:0/3782991212 >> v2:172.21.15.83:3300/0 conn(0x7fef2406d120 0x7fef2406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.610+0000 7fef28a71700 1 -- 172.21.15.81:0/3782991212 >> 172.21.15.81:0/3782991212 conn(0x7fef2406bb90 msgr2=0x7fef2406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:40.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.610+0000 7fef28a71700 1 -- 172.21.15.81:0/3782991212 shutdown_connections 2023-10-06T02:46:40.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.610+0000 7fef28a71700 1 -- 172.21.15.81:0/3782991212 wait complete. 2023-10-06T02:46:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.611+0000 7fef28a71700 1 Processor -- start 2023-10-06T02:46:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.611+0000 7fef28a71700 1 -- start start 2023-10-06T02:46:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef28a71700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef2406d120 0x7fef2416a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef28a71700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 0x7fef24147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef28a71700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef24157ca0 0x7fef2416deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef28a71700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef241470d0 con 0x7fef241578d0 2023-10-06T02:46:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef28a71700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240cc9f0 con 0x7fef2406d120 2023-10-06T02:46:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef28a71700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2416a730 con 0x7fef24157ca0 2023-10-06T02:46:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef19d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 0x7fef24147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef19d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 0x7fef24147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43902/0 (socket says 172.21.15.81:43902) 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef19d9b700 1 -- 172.21.15.81:0/2534557320 learned_addr learned my addr 172.21.15.81:0/2534557320 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef2259c700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef2406d120 0x7fef2416a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef22d9d700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef24157ca0 0x7fef2416deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef19d9b700 1 -- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef24157ca0 msgr2=0x7fef2416deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef19d9b700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef24157ca0 0x7fef2416deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef19d9b700 1 -- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef2406d120 msgr2=0x7fef2416a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef19d9b700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef2406d120 0x7fef2416a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef19d9b700 1 -- 172.21.15.81:0/2534557320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14009420 con 0x7fef241578d0 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef19d9b700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 0x7fef24147630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c5e0 tx=0x7fef0c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.612+0000 7fef1affd700 1 -- 172.21.15.81:0/2534557320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c005b30 con 0x7fef241578d0 2023-10-06T02:46:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.613+0000 7fef1affd700 1 -- 172.21.15.81:0/2534557320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c005c90 con 0x7fef241578d0 2023-10-06T02:46:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.613+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240cbde0 con 0x7fef241578d0 2023-10-06T02:46:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.613+0000 7fef1affd700 1 -- 172.21.15.81:0/2534557320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c007300 con 0x7fef241578d0 2023-10-06T02:46:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.613+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef240cc3a0 con 0x7fef241578d0 2023-10-06T02:46:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.614+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef240ccb60 con 0x7fef241578d0 2023-10-06T02:46:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.614+0000 7fef1affd700 1 -- 172.21.15.81:0/2534557320 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef0c0076b0 con 0x7fef241578d0 2023-10-06T02:46:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.614+0000 7fef1affd700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066f30 0x7fef040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.614+0000 7fef1affd700 1 -- 172.21.15.81:0/2534557320 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fef0c083a60 con 0x7fef241578d0 2023-10-06T02:46:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.614+0000 7fef2259c700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066f30 0x7fef040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.615+0000 7fef2259c700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066f30 0x7fef040693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef140093f0 tx=0x7fef14017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:40.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.618+0000 7fef1affd700 1 -- 172.21.15.81:0/2534557320 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef0c050b70 con 0x7fef241578d0 2023-10-06T02:46:40.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.800+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fef240d0170 con 0x7fef241578d0 2023-10-06T02:46:40.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.800+0000 7fef1affd700 1 -- 172.21.15.81:0/2534557320 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fef0c0170a0 con 0x7fef241578d0 2023-10-06T02:46:40.802 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:40.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066f30 msgr2=0x7fef040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066f30 0x7fef040693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef140093f0 tx=0x7fef14017000 comp rx=0 tx=0).stop 2023-10-06T02:46:40.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 msgr2=0x7fef24147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 0x7fef24147630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c5e0 tx=0x7fef0c000fe0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 shutdown_connections 2023-10-06T02:46:40.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef24157ca0 0x7fef2416deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066f30 0x7fef040693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef2406d120 0x7fef2416a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 --2- 172.21.15.81:0/2534557320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef241578d0 0x7fef24147630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 >> 172.21.15.81:0/2534557320 conn(0x7fef2406bb90 msgr2=0x7fef24068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:40.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 shutdown_connections 2023-10-06T02:46:40.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.802+0000 7fef28a71700 1 -- 172.21.15.81:0/2534557320 wait complete. 2023-10-06T02:46:40.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:46:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.931+0000 7f6cad744700 1 Processor -- start 2023-10-06T02:46:40.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.931+0000 7f6cad744700 1 -- start start 2023-10-06T02:46:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.932+0000 7f6cad744700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6ca806dd60 0x7f6ca80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.932+0000 7f6cad744700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80b0ca0 con 0x7f6ca80cf240 2023-10-06T02:46:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.932+0000 7f6cad744700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80b00d0 con 0x7f6ca815a2a0 2023-10-06T02:46:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.932+0000 7f6cad744700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca806ea90 con 0x7f6ca806dd60 2023-10-06T02:46:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.932+0000 7f6c9e7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6ca80cf240 0x7f6ca806d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45574/0 (socket says 172.21.15.81:45574) 2023-10-06T02:46:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.932+0000 7f6c9e7fc700 1 -- 172.21.15.81:0/519420029 learned_addr learned my addr 172.21.15.81:0/519420029 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.932+0000 7f6ca77fe700 1 --2- 172.21.15.81:0/519420029 >> v2:172.21.15.83:3300/0 conn(0x7f6ca806dd60 0x7f6ca80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca67fc700 1 -- 172.21.15.81:0/519420029 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952949882 0 0) 0x7f6ca80b0ca0 con 0x7f6ca80cf240 2023-10-06T02:46:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca67fc700 1 -- 172.21.15.81:0/519420029 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c94003570 con 0x7f6ca80cf240 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca77fe700 1 -- 172.21.15.81:0/519420029 >> v1:172.21.15.83:6789/0 conn(0x7f6ca815a2a0 legacy=0x7f6ca80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca77fe700 1 -- 172.21.15.81:0/519420029 >> v1:172.21.15.81:6789/0 conn(0x7f6ca80cf240 legacy=0x7f6ca806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca67fc700 1 -- 172.21.15.81:0/519420029 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3962425323 0 0) 0x7f6c94003570 con 0x7f6ca80cf240 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca77fe700 1 -- 172.21.15.81:0/519420029 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80b0370 con 0x7f6ca806dd60 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca77fe700 1 --2- 172.21.15.81:0/519420029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 0x7f6ca80b1130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009e60 tx=0x7f6ca0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c58e11154dd20a33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca67fc700 1 -- 172.21.15.81:0/519420029 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000e070 con 0x7f6ca806dd60 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca67fc700 1 -- 172.21.15.81:0/519420029 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca000b850 con 0x7f6ca806dd60 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.933+0000 7f6ca67fc700 1 -- 172.21.15.81:0/519420029 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90001470 con 0x7f6ca806dd60 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.934+0000 7f6cad744700 1 -- 172.21.15.81:0/519420029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 msgr2=0x7f6ca80b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.934+0000 7f6cad744700 1 --2- 172.21.15.81:0/519420029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 0x7f6ca80b1130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009e60 tx=0x7f6ca0009780 comp rx=0 tx=0).stop 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.934+0000 7f6cad744700 1 -- 172.21.15.81:0/519420029 shutdown_connections 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.934+0000 7f6cad744700 1 --2- 172.21.15.81:0/519420029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 0x7f6ca80b1130 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.934+0000 7f6cad744700 1 -- 172.21.15.81:0/519420029 >> 172.21.15.81:0/519420029 conn(0x7f6ca8067640 msgr2=0x7f6ca8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:40.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.934+0000 7f6cad744700 1 -- 172.21.15.81:0/519420029 shutdown_connections 2023-10-06T02:46:40.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.934+0000 7f6cad744700 1 -- 172.21.15.81:0/519420029 wait complete. 2023-10-06T02:46:40.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.935+0000 7f6cad744700 1 Processor -- start 2023-10-06T02:46:40.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.935+0000 7f6cad744700 1 -- start start 2023-10-06T02:46:40.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6cad744700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 0x7f6ca8148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6cad744700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca80cf240 0x7f6ca816d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6cad744700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ca815a2a0 0x7f6ca8155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6cad744700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca815cd10 con 0x7f6ca80cf240 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6cad744700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca816e000 con 0x7f6ca806dd60 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6cad744700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca816e2e0 con 0x7f6ca815a2a0 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca80cf240 0x7f6ca816d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca80cf240 0x7f6ca816d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43918/0 (socket says 172.21.15.81:43918) 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9e7fc700 1 -- 172.21.15.81:0/1693557133 learned_addr learned my addr 172.21.15.81:0/1693557133 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6ca6ffd700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 0x7f6ca8148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6ca77fe700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ca815a2a0 0x7f6ca8155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9e7fc700 1 -- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ca815a2a0 msgr2=0x7f6ca8155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9e7fc700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ca815a2a0 0x7f6ca8155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9e7fc700 1 -- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 msgr2=0x7f6ca8148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9e7fc700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 0x7f6ca8148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:40.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9e7fc700 1 -- 172.21.15.81:0/1693557133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0009a20 con 0x7f6ca80cf240 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6ca6ffd700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 0x7f6ca8148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9e7fc700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca80cf240 0x7f6ca816d720 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6c900011e0 tx=0x7f6c90001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9f7fe700 1 -- 172.21.15.81:0/1693557133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90005b10 con 0x7f6ca80cf240 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9f7fe700 1 -- 172.21.15.81:0/1693557133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90005c90 con 0x7f6ca80cf240 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca815c9a0 con 0x7f6ca80cf240 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6c9f7fe700 1 -- 172.21.15.81:0/1693557133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90007340 con 0x7f6ca80cf240 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.936+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca816dc60 con 0x7f6ca80cf240 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.937+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca815ce80 con 0x7f6ca80cf240 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.938+0000 7f6c9f7fe700 1 -- 172.21.15.81:0/1693557133 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c9000a420 con 0x7f6ca80cf240 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.938+0000 7f6c9f7fe700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c88066f30 0x7f6c880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.938+0000 7f6c9f7fe700 1 -- 172.21.15.81:0/1693557133 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6c900844c0 con 0x7f6ca80cf240 2023-10-06T02:46:40.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.938+0000 7f6ca6ffd700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c88066f30 0x7f6c880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:40.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.939+0000 7f6ca6ffd700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c88066f30 0x7f6c880693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007fd0 tx=0x7f6c98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:40.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:40.942+0000 7f6c9f7fe700 1 -- 172.21.15.81:0/1693557133 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c900515d0 con 0x7f6ca80cf240 2023-10-06T02:46:41.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.126+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ca804bb80 con 0x7f6ca80cf240 2023-10-06T02:46:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.127+0000 7f6c9f7fe700 1 -- 172.21.15.81:0/1693557133 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c90054bf0 con 0x7f6ca80cf240 2023-10-06T02:46:41.128 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:46:41.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.128+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c88066f30 msgr2=0x7f6c880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.128+0000 7f6cad744700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c88066f30 0x7f6c880693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007fd0 tx=0x7f6c98009040 comp rx=0 tx=0).stop 2023-10-06T02:46:41.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.128+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca80cf240 msgr2=0x7f6ca816d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.128+0000 7f6cad744700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca80cf240 0x7f6ca816d720 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6c900011e0 tx=0x7f6c90001a10 comp rx=0 tx=0).stop 2023-10-06T02:46:41.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.129+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 shutdown_connections 2023-10-06T02:46:41.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.129+0000 7f6cad744700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ca815a2a0 0x7f6ca8155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.129+0000 7f6cad744700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c88066f30 0x7f6c880693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.129+0000 7f6cad744700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ca806dd60 0x7f6ca8148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.129+0000 7f6cad744700 1 --2- 172.21.15.81:0/1693557133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca80cf240 0x7f6ca816d720 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.129+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 >> 172.21.15.81:0/1693557133 conn(0x7f6ca8067640 msgr2=0x7f6ca80ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:41.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.129+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 shutdown_connections 2023-10-06T02:46:41.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.129+0000 7f6cad744700 1 -- 172.21.15.81:0/1693557133 wait complete. 2023-10-06T02:46:41.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:46:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.256+0000 7fdc32528700 1 Processor -- start 2023-10-06T02:46:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.256+0000 7fdc32528700 1 -- start start 2023-10-06T02:46:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.257+0000 7fdc32528700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 0x7fdc2c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.257+0000 7fdc32528700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdc2c06d120 0x7fdc2c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.257+0000 7fdc32528700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c06dac0 con 0x7fdc2c1578d0 2023-10-06T02:46:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.257+0000 7fdc32528700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c0d07c0 con 0x7fdc2c06d120 2023-10-06T02:46:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.257+0000 7fdc32528700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0cfbb0 con 0x7fdc2c157ca0 2023-10-06T02:46:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.257+0000 7fdc2bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdc2c1578d0 0x7fdc2c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45582/0 (socket says 172.21.15.81:45582) 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.257+0000 7fdc2bfff700 1 -- 172.21.15.81:0/1434361694 learned_addr learned my addr 172.21.15.81:0/1434361694 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc30ac5700 1 --2- 172.21.15.81:0/1434361694 >> v2:172.21.15.83:3300/0 conn(0x7fdc2c06d120 0x7fdc2c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc2b7fe700 1 --2- 172.21.15.81:0/1434361694 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 0x7fdc2c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc2affd700 1 -- 172.21.15.81:0/1434361694 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874010513 0 0) 0x7fdc1c001110 con 0x7fdc2c1578d0 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc2affd700 1 -- 172.21.15.81:0/1434361694 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc14003570 con 0x7fdc2c1578d0 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc2affd700 1 -- 172.21.15.81:0/1434361694 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1820806585 0 0) 0x7fdc14003570 con 0x7fdc2c1578d0 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc30ac5700 1 -- 172.21.15.81:0/1434361694 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 msgr2=0x7fdc2c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc30ac5700 1 --2- 172.21.15.81:0/1434361694 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 0x7fdc2c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc30ac5700 1 -- 172.21.15.81:0/1434361694 >> v1:172.21.15.81:6789/0 conn(0x7fdc2c1578d0 legacy=0x7fdc2c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc30ac5700 1 -- 172.21.15.81:0/1434361694 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c0cfe90 con 0x7fdc2c06d120 2023-10-06T02:46:41.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc30ac5700 1 --2- 172.21.15.81:0/1434361694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc2c06d120 0x7fdc2c06d580 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009e60 tx=0x7fdc24009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a772c08e9fb74da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc2affd700 1 -- 172.21.15.81:0/1434361694 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400e070 con 0x7fdc2c06d120 2023-10-06T02:46:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc2affd700 1 -- 172.21.15.81:0/1434361694 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2400b7a0 con 0x7fdc2c06d120 2023-10-06T02:46:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.258+0000 7fdc2affd700 1 -- 172.21.15.81:0/1434361694 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c001600 con 0x7fdc2c06d120 2023-10-06T02:46:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.259+0000 7fdc32528700 1 -- 172.21.15.81:0/1434361694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc2c06d120 msgr2=0x7fdc2c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.259+0000 7fdc32528700 1 --2- 172.21.15.81:0/1434361694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc2c06d120 0x7fdc2c06d580 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009e60 tx=0x7fdc24009780 comp rx=0 tx=0).stop 2023-10-06T02:46:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.259+0000 7fdc32528700 1 -- 172.21.15.81:0/1434361694 shutdown_connections 2023-10-06T02:46:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.259+0000 7fdc32528700 1 --2- 172.21.15.81:0/1434361694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc2c06d120 0x7fdc2c06d580 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.259+0000 7fdc32528700 1 --2- 172.21.15.81:0/1434361694 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 0x7fdc2c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.259+0000 7fdc32528700 1 -- 172.21.15.81:0/1434361694 >> 172.21.15.81:0/1434361694 conn(0x7fdc2c06bb90 msgr2=0x7fdc2c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:41.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.259+0000 7fdc32528700 1 -- 172.21.15.81:0/1434361694 shutdown_connections 2023-10-06T02:46:41.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.259+0000 7fdc32528700 1 -- 172.21.15.81:0/1434361694 wait complete. 2023-10-06T02:46:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.260+0000 7fdc32528700 1 Processor -- start 2023-10-06T02:46:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.260+0000 7fdc32528700 1 -- start start 2023-10-06T02:46:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc32528700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c06d120 0x7fdc2c0ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc32528700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc2c1578d0 0x7fdc2c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc32528700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 0x7fdc2c169e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc32528700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b4d10 con 0x7fdc2c06d120 2023-10-06T02:46:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc32528700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b4ff0 con 0x7fdc2c1578d0 2023-10-06T02:46:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc32528700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b52d0 con 0x7fdc2c157ca0 2023-10-06T02:46:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c06d120 0x7fdc2c0ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c06d120 0x7fdc2c0ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43932/0 (socket says 172.21.15.81:43932) 2023-10-06T02:46:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2bfff700 1 -- 172.21.15.81:0/3077018860 learned_addr learned my addr 172.21.15.81:0/3077018860 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2bfff700 1 -- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 msgr2=0x7fdc2c169e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2b7fe700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc2c1578d0 0x7fdc2c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc30ac5700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 0x7fdc2c169e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2bfff700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 0x7fdc2c169e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2bfff700 1 -- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc2c1578d0 msgr2=0x7fdc2c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2bfff700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc2c1578d0 0x7fdc2c0b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2bfff700 1 -- 172.21.15.81:0/3077018860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc24009a20 con 0x7fdc2c06d120 2023-10-06T02:46:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc2bfff700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c06d120 0x7fdc2c0ad080 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00cb90 tx=0x7fdc1c001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc13fff700 1 -- 172.21.15.81:0/3077018860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c007e90 con 0x7fdc2c06d120 2023-10-06T02:46:41.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc13fff700 1 -- 172.21.15.81:0/3077018860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c007360 con 0x7fdc2c06d120 2023-10-06T02:46:41.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2c0b55b0 con 0x7fdc2c06d120 2023-10-06T02:46:41.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.261+0000 7fdc13fff700 1 -- 172.21.15.81:0/3077018860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c004830 con 0x7fdc2c06d120 2023-10-06T02:46:41.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.262+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c0ad5c0 con 0x7fdc2c06d120 2023-10-06T02:46:41.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.262+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2c067ac0 con 0x7fdc2c06d120 2023-10-06T02:46:41.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.263+0000 7fdc13fff700 1 -- 172.21.15.81:0/3077018860 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc1c004c20 con 0x7fdc2c06d120 2023-10-06T02:46:41.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.263+0000 7fdc13fff700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc18066f30 0x7fdc180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.263+0000 7fdc13fff700 1 -- 172.21.15.81:0/3077018860 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc1c083e40 con 0x7fdc2c06d120 2023-10-06T02:46:41.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.263+0000 7fdc2b7fe700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc18066f30 0x7fdc180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.264+0000 7fdc2b7fe700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc18066f30 0x7fdc180693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdc20006f00 tx=0x7fdc20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:41.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.267+0000 7fdc13fff700 1 -- 172.21.15.81:0/3077018860 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc1c050fd0 con 0x7fdc2c06d120 2023-10-06T02:46:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.447+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc2c06dac0 con 0x7fdc2c06d120 2023-10-06T02:46:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.448+0000 7fdc13fff700 1 -- 172.21.15.81:0/3077018860 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc2c06dac0 con 0x7fdc2c06d120 2023-10-06T02:46:41.449 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:46:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.449+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc18066f30 msgr2=0x7fdc180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.449+0000 7fdc32528700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc18066f30 0x7fdc180693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdc20006f00 tx=0x7fdc20008040 comp rx=0 tx=0).stop 2023-10-06T02:46:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.449+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c06d120 msgr2=0x7fdc2c0ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.449+0000 7fdc32528700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c06d120 0x7fdc2c0ad080 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00cb90 tx=0x7fdc1c001450 comp rx=0 tx=0).stop 2023-10-06T02:46:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.450+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 shutdown_connections 2023-10-06T02:46:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.450+0000 7fdc32528700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc2c157ca0 0x7fdc2c169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.450+0000 7fdc32528700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c06d120 0x7fdc2c0ad080 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.450+0000 7fdc32528700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc18066f30 0x7fdc180693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.450+0000 7fdc32528700 1 --2- 172.21.15.81:0/3077018860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc2c1578d0 0x7fdc2c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.450+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 >> 172.21.15.81:0/3077018860 conn(0x7fdc2c06bb90 msgr2=0x7fdc2c155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.450+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 shutdown_connections 2023-10-06T02:46:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.450+0000 7fdc32528700 1 -- 172.21.15.81:0/3077018860 wait complete. 2023-10-06T02:46:41.501 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-06T02:46:41.501 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-06T02:46:41.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-06T02:46:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.616+0000 7f81259b2700 1 Processor -- start 2023-10-06T02:46:41.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.616+0000 7f81259b2700 1 -- start start 2023-10-06T02:46:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f81259b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8120157ca0 0x7f81200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f81259b2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f812006d120 0x7f812006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f81259b2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812006dac0 con 0x7f81201578d0 2023-10-06T02:46:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f81259b2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81200d07c0 con 0x7f812006d120 2023-10-06T02:46:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f81259b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200cfbb0 con 0x7f8120157ca0 2023-10-06T02:46:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f811f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f812006d120 0x7f812006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f811f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f812006d120 0x7f812006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43934/0 (socket says 172.21.15.81:43934) 2023-10-06T02:46:41.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f811f7fe700 1 -- 172.21.15.81:0/1418180756 learned_addr learned my addr 172.21.15.81:0/1418180756 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f81167fc700 1 --2- 172.21.15.81:0/1418180756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8120157ca0 0x7f81200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f811f7fe700 1 -- 172.21.15.81:0/1418180756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8120157ca0 msgr2=0x7f81200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f811f7fe700 1 --2- 172.21.15.81:0/1418180756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8120157ca0 0x7f81200cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f811f7fe700 1 -- 172.21.15.81:0/1418180756 >> v1:172.21.15.83:6789/0 conn(0x7f81201578d0 legacy=0x7f812015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f811f7fe700 1 -- 172.21.15.81:0/1418180756 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200cfe90 con 0x7f812006d120 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f81167fc700 1 --2- 172.21.15.81:0/1418180756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8120157ca0 0x7f81200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.617+0000 7f811f7fe700 1 --2- 172.21.15.81:0/1418180756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f812006d120 0x7f812006d580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8118009f20 tx=0x7f8118009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6338966fa35838c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f811e7fc700 1 -- 172.21.15.81:0/1418180756 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811800e070 con 0x7f812006d120 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f811e7fc700 1 -- 172.21.15.81:0/1418180756 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811800ba40 con 0x7f812006d120 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f811e7fc700 1 -- 172.21.15.81:0/1418180756 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81180092e0 con 0x7f812006d120 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f81259b2700 1 -- 172.21.15.81:0/1418180756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f812006d120 msgr2=0x7f812006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f81259b2700 1 --2- 172.21.15.81:0/1418180756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f812006d120 0x7f812006d580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8118009f20 tx=0x7f8118009840 comp rx=0 tx=0).stop 2023-10-06T02:46:41.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f81259b2700 1 -- 172.21.15.81:0/1418180756 shutdown_connections 2023-10-06T02:46:41.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f81259b2700 1 --2- 172.21.15.81:0/1418180756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f812006d120 0x7f812006d580 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f81259b2700 1 --2- 172.21.15.81:0/1418180756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8120157ca0 0x7f81200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f81259b2700 1 -- 172.21.15.81:0/1418180756 >> 172.21.15.81:0/1418180756 conn(0x7f812006bb90 msgr2=0x7f812006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:41.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f81259b2700 1 -- 172.21.15.81:0/1418180756 shutdown_connections 2023-10-06T02:46:41.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.618+0000 7f81259b2700 1 -- 172.21.15.81:0/1418180756 wait complete. 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.619+0000 7f81259b2700 1 Processor -- start 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.619+0000 7f81259b2700 1 -- start start 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f81259b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f812006d120 0x7f8120154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f81259b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81201578d0 0x7f81200abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f81259b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8120157ca0 0x7f81200ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f81259b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8120154ea0 con 0x7f8120157ca0 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f81259b2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81200aac50 con 0x7f81201578d0 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f81259b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200abab0 con 0x7f812006d120 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f811f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8120157ca0 0x7f81200ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f811f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8120157ca0 0x7f81200ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43940/0 (socket says 172.21.15.81:43940) 2023-10-06T02:46:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f811f7fe700 1 -- 172.21.15.81:0/1147924230 learned_addr learned my addr 172.21.15.81:0/1147924230 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f81167fc700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81201578d0 0x7f81200abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.620+0000 7f811effd700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f812006d120 0x7f8120154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f811f7fe700 1 -- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f812006d120 msgr2=0x7f8120154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f811f7fe700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f812006d120 0x7f8120154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f811f7fe700 1 -- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81201578d0 msgr2=0x7f81200abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f811f7fe700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81201578d0 0x7f81200abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f811f7fe700 1 -- 172.21.15.81:0/1147924230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118009ae0 con 0x7f8120157ca0 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f811f7fe700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8120157ca0 0x7f81200ad680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8118009880 tx=0x7f8118017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f81177fe700 1 -- 172.21.15.81:0/1147924230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118012e60 con 0x7f8120157ca0 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f81177fe700 1 -- 172.21.15.81:0/1147924230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811801d420 con 0x7f8120157ca0 2023-10-06T02:46:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81200aaea0 con 0x7f8120157ca0 2023-10-06T02:46:41.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f81177fe700 1 -- 172.21.15.81:0/1147924230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811801d7c0 con 0x7f8120157ca0 2023-10-06T02:46:41.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.621+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81200ab460 con 0x7f8120157ca0 2023-10-06T02:46:41.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.622+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8120067ac0 con 0x7f8120157ca0 2023-10-06T02:46:41.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.622+0000 7f81177fe700 1 -- 172.21.15.81:0/1147924230 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f811801db70 con 0x7f8120157ca0 2023-10-06T02:46:41.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.623+0000 7f81177fe700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8100066f30 0x7f81000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.623+0000 7f81177fe700 1 -- 172.21.15.81:0/1147924230 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8118085eb0 con 0x7f8120157ca0 2023-10-06T02:46:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.623+0000 7f811effd700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8100066f30 0x7f81000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.623+0000 7f811effd700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8100066f30 0x7f81000693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8110006fd0 tx=0x7f8110008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.627+0000 7f81177fe700 1 -- 172.21.15.81:0/1147924230 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8118052fc0 con 0x7f8120157ca0 2023-10-06T02:46:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:41.884+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f812006dac0 con 0x7f8120157ca0 2023-10-06T02:46:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.635+0000 7f81177fe700 1 -- 172.21.15.81:0/1147924230 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v50) v1 ==== 133+0+0 (secure 0 0 0) 0x7f812006dac0 con 0x7f8120157ca0 2023-10-06T02:46:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8100066f30 msgr2=0x7f81000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8100066f30 0x7f81000693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8110006fd0 tx=0x7f8110008040 comp rx=0 tx=0).stop 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8120157ca0 msgr2=0x7f81200ad680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8120157ca0 0x7f81200ad680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8118009880 tx=0x7f8118017000 comp rx=0 tx=0).stop 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 shutdown_connections 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8120157ca0 0x7f81200ad680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f812006d120 0x7f8120154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8100066f30 0x7f81000693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 --2- 172.21.15.81:0/1147924230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81201578d0 0x7f81200abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 >> 172.21.15.81:0/1147924230 conn(0x7f812006bb90 msgr2=0x7f8120069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 shutdown_connections 2023-10-06T02:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.637+0000 7f81259b2700 1 -- 172.21.15.81:0/1147924230 wait complete. 2023-10-06T02:46:42.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-06T02:46:42.779 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-06T02:46:42.779 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-06T02:46:42.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:46:42.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.894+0000 7f6038300700 1 Processor -- start 2023-10-06T02:46:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.894+0000 7f6038300700 1 -- start start 2023-10-06T02:46:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.895+0000 7f6038300700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60301578d0 0x7f60300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.895+0000 7f6038300700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f603006d120 0x7f603006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.895+0000 7f6038300700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60300d07c0 con 0x7f6030157ca0 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.895+0000 7f6038300700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603006da50 con 0x7f60301578d0 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.895+0000 7f6038300700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60300cfbb0 con 0x7f603006d120 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603609c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60301578d0 0x7f60300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603589b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6030157ca0 0x7f603015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45588/0 (socket says 172.21.15.81:45588) 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603589b700 1 -- 172.21.15.81:0/2053980684 learned_addr learned my addr 172.21.15.81:0/2053980684 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603689d700 1 --2- 172.21.15.81:0/2053980684 >> v2:172.21.15.83:3300/0 conn(0x7f603006d120 0x7f603006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603609c700 1 -- 172.21.15.81:0/2053980684 >> v2:172.21.15.83:3300/0 conn(0x7f603006d120 msgr2=0x7f603006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603609c700 1 --2- 172.21.15.81:0/2053980684 >> v2:172.21.15.83:3300/0 conn(0x7f603006d120 0x7f603006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603609c700 1 -- 172.21.15.81:0/2053980684 >> v1:172.21.15.81:6789/0 conn(0x7f6030157ca0 legacy=0x7f603015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603509a700 1 -- 172.21.15.81:0/2053980684 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266020103 0 0) 0x7f60300d07c0 con 0x7f6030157ca0 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603609c700 1 -- 172.21.15.81:0/2053980684 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60300cfe90 con 0x7f60301578d0 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603609c700 1 --2- 172.21.15.81:0/2053980684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60301578d0 0x7f60300cf4f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6030068300 tx=0x7f602c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc25f678503e96c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603509a700 1 -- 172.21.15.81:0/2053980684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c00e070 con 0x7f60301578d0 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603509a700 1 -- 172.21.15.81:0/2053980684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c00bc30 con 0x7f60301578d0 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.896+0000 7f603509a700 1 -- 172.21.15.81:0/2053980684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c012430 con 0x7f60301578d0 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.897+0000 7f6038300700 1 -- 172.21.15.81:0/2053980684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60301578d0 msgr2=0x7f60300cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.897+0000 7f6038300700 1 --2- 172.21.15.81:0/2053980684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60301578d0 0x7f60300cf4f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6030068300 tx=0x7f602c009780 comp rx=0 tx=0).stop 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.897+0000 7f6038300700 1 -- 172.21.15.81:0/2053980684 shutdown_connections 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.897+0000 7f6038300700 1 --2- 172.21.15.81:0/2053980684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60301578d0 0x7f60300cf4f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.897+0000 7f6038300700 1 --2- 172.21.15.81:0/2053980684 >> v2:172.21.15.83:3300/0 conn(0x7f603006d120 0x7f603006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.897+0000 7f6038300700 1 -- 172.21.15.81:0/2053980684 >> 172.21.15.81:0/2053980684 conn(0x7f603006bb90 msgr2=0x7f603006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.897+0000 7f6038300700 1 -- 172.21.15.81:0/2053980684 shutdown_connections 2023-10-06T02:46:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.897+0000 7f6038300700 1 -- 172.21.15.81:0/2053980684 wait complete. 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.898+0000 7f6038300700 1 Processor -- start 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.898+0000 7f6038300700 1 -- start start 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f6038300700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603006d120 0x7f60300ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f6038300700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60301578d0 0x7f60300ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f6038300700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6030157ca0 0x7f60301595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f6038300700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300ace80 con 0x7f603006d120 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f6038300700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300ab7b0 con 0x7f60301578d0 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f6038300700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60300ac270 con 0x7f6030157ca0 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f603609c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603006d120 0x7f60300ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f603609c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603006d120 0x7f60300ab270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43950/0 (socket says 172.21.15.81:43950) 2023-10-06T02:46:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f603609c700 1 -- 172.21.15.81:0/2061888197 learned_addr learned my addr 172.21.15.81:0/2061888197 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f603609c700 1 -- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6030157ca0 msgr2=0x7f60301595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f603609c700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6030157ca0 0x7f60301595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f603609c700 1 -- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60301578d0 msgr2=0x7f60300ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f603609c700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60301578d0 0x7f60300ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f603609c700 1 -- 172.21.15.81:0/2061888197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c009a20 con 0x7f603006d120 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f603609c700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603006d120 0x7f60300ab270 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f602c0099f0 tx=0x7f602c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f60267fc700 1 -- 172.21.15.81:0/2061888197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c001090 con 0x7f603006d120 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f60267fc700 1 -- 172.21.15.81:0/2061888197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c01d630 con 0x7f603006d120 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60300ac550 con 0x7f603006d120 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f60267fc700 1 -- 172.21.15.81:0/2061888197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c01d9f0 con 0x7f603006d120 2023-10-06T02:46:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.899+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60300acb90 con 0x7f603006d120 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.901+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60300ad160 con 0x7f603006d120 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.901+0000 7f60267fc700 1 -- 172.21.15.81:0/2061888197 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f602c024070 con 0x7f603006d120 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.901+0000 7f60267fc700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6014066f30 0x7f60140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.901+0000 7f60267fc700 1 -- 172.21.15.81:0/2061888197 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f602c086e60 con 0x7f603006d120 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.901+0000 7f603589b700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6014066f30 0x7f60140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.902+0000 7f603589b700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6014066f30 0x7f60140693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f603006c620 tx=0x7f6020007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:42.905+0000 7f60267fc700 1 -- 172.21.15.81:0/2061888197 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f602c053f70 con 0x7f603006d120 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.087+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f60300d0170 con 0x7f603006d120 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.091+0000 7f60267fc700 1 -- 172.21.15.81:0/2061888197 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f602c057590 con 0x7f603006d120 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6014066f30 msgr2=0x7f60140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6014066f30 0x7f60140693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f603006c620 tx=0x7f6020007bd0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603006d120 msgr2=0x7f60300ab270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603006d120 0x7f60300ab270 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f602c0099f0 tx=0x7f602c019000 comp rx=0 tx=0).stop 2023-10-06T02:46:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 shutdown_connections 2023-10-06T02:46:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6030157ca0 0x7f60301595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603006d120 0x7f60300ab270 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6014066f30 0x7f60140693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 --2- 172.21.15.81:0/2061888197 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60301578d0 0x7f60300ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 >> 172.21.15.81:0/2061888197 conn(0x7f603006bb90 msgr2=0x7f6030068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.093+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 shutdown_connections 2023-10-06T02:46:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:43.094+0000 7f6038300700 1 -- 172.21.15.81:0/2061888197 wait complete. 2023-10-06T02:46:43.317 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:46:43.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:46:43.354 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:46:43.396 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:46:43.396 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:46:43.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:46:43.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T02:46:43.431 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:46:43.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:43.431 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:46:43.486 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:46:43.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:46:43.486 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T02:46:43.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:46:43.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:43.531 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:46:43.587 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T02:46:43.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:46:43.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T02:46:43.622 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:46:43.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:43.622 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:46:43.678 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T02:46:44.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:46:44.081 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T02:46:44.124 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:46:44.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:46:44.180 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:46:44.197 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:46:44.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:46:44.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.311+0000 7efea73fe700 1 Processor -- start 2023-10-06T02:46:44.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.311+0000 7efea73fe700 1 -- start start 2023-10-06T02:46:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.312+0000 7efea73fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efea006c2a0 0x7efea006a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.312+0000 7efea73fe700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea015bc10 con 0x7efea0069120 2023-10-06T02:46:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.312+0000 7efea73fe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea015c7b0 con 0x7efea0157ab0 2023-10-06T02:46:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.312+0000 7efea73fe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea0158ba0 con 0x7efea006c2a0 2023-10-06T02:46:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.312+0000 7efea4999700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efea0069120 0x7efea006bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45590/0 (socket says 172.21.15.81:45590) 2023-10-06T02:46:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.312+0000 7efea4999700 1 -- 172.21.15.81:0/1688288700 learned_addr learned my addr 172.21.15.81:0/1688288700 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea599b700 1 --2- 172.21.15.81:0/1688288700 >> v2:172.21.15.83:3300/0 conn(0x7efea006c2a0 0x7efea006a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625549373 0 0) 0x7efea015bc10 con 0x7efea0069120 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe88003570 con 0x7efea0069120 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2513267532 0 0) 0x7efe88003570 con 0x7efea0069120 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 >> v2:172.21.15.83:3300/0 conn(0x7efea006c2a0 msgr2=0x7efea006a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 --2- 172.21.15.81:0/1688288700 >> v2:172.21.15.83:3300/0 conn(0x7efea006c2a0 0x7efea006a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 >> v1:172.21.15.83:6789/0 conn(0x7efea0157ab0 legacy=0x7efea015c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0158e80 con 0x7efea0069120 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7efe94001470 con 0x7efea0069120 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 >> v1:172.21.15.81:6789/0 conn(0x7efea0069120 legacy=0x7efea006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe88003a60 0x7efe88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88004810 0x7efe88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe880051c0 0x7efe8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea0158ba0 con 0x7efe88004810 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8800c0d0 con 0x7efe88003a60 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8800c290 con 0x7efe880051c0 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea4999700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88004810 0x7efe88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea519a700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe88003a60 0x7efe88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea599b700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe880051c0 0x7efe8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea4999700 1 -- 172.21.15.81:0/1688288700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe880051c0 msgr2=0x7efe8800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea4999700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe880051c0 0x7efe8800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea4999700 1 -- 172.21.15.81:0/1688288700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe88003a60 msgr2=0x7efe88003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea4999700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe88003a60 0x7efe88003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea599b700 1 -- 172.21.15.81:0/1688288700 reap_dead start 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea4999700 1 -- 172.21.15.81:0/1688288700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe88003570 con 0x7efe88004810 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.313+0000 7efea4999700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88004810 0x7efe88004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efe9400c3c0 tx=0x7efe94001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34571bd7b4824f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400cc10 con 0x7efe88004810 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9400cd70 con 0x7efe88004810 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efe9ffff700 1 -- 172.21.15.81:0/1688288700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94005b50 con 0x7efe88004810 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efea73fe700 1 -- 172.21.15.81:0/1688288700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88004810 msgr2=0x7efe88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efea73fe700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88004810 0x7efe88004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efe9400c3c0 tx=0x7efe94001e50 comp rx=0 tx=0).stop 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efea73fe700 1 -- 172.21.15.81:0/1688288700 shutdown_connections 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efea73fe700 1 --2- 172.21.15.81:0/1688288700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88004810 0x7efe88004c80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efea73fe700 1 -- 172.21.15.81:0/1688288700 >> 172.21.15.81:0/1688288700 conn(0x7efea00c9ca0 msgr2=0x7efea00ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efea73fe700 1 -- 172.21.15.81:0/1688288700 shutdown_connections 2023-10-06T02:46:44.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.314+0000 7efea73fe700 1 -- 172.21.15.81:0/1688288700 wait complete. 2023-10-06T02:46:44.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.315+0000 7efea73fe700 1 Processor -- start 2023-10-06T02:46:44.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.315+0000 7efea73fe700 1 -- start start 2023-10-06T02:46:44.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea73fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88004810 0x7efea0168270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:44.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea73fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0152e10 0x7efea00c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:44.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea73fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea00c4820 0x7efea00c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea73fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00b0df0 con 0x7efea0152e10 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea73fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00b27b0 con 0x7efea00c4820 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea73fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea00b2a50 con 0x7efe88004810 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea4999700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0152e10 0x7efea00c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea4999700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0152e10 0x7efea00c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43972/0 (socket says 172.21.15.81:43972) 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea4999700 1 -- 172.21.15.81:0/1166640436 learned_addr learned my addr 172.21.15.81:0/1166640436 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea519a700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88004810 0x7efea0168270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.316+0000 7efea599b700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea00c4820 0x7efea00c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efea4999700 1 -- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88004810 msgr2=0x7efea0168270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efea4999700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88004810 0x7efea0168270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efea4999700 1 -- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea00c4820 msgr2=0x7efea00c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efea4999700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea00c4820 0x7efea00c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efea4999700 1 -- 172.21.15.81:0/1166640436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00b0a80 con 0x7efea0152e10 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efea4999700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0152e10 0x7efea00c42e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efe94007cd0 tx=0x7efe94015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efe9d7fa700 1 -- 172.21.15.81:0/1166640436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400cc10 con 0x7efea0152e10 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efe9d7fa700 1 -- 172.21.15.81:0/1166640436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe94004e50 con 0x7efea0152e10 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea00c38b0 con 0x7efea0152e10 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efe9d7fa700 1 -- 172.21.15.81:0/1166640436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400cee0 con 0x7efea0152e10 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.317+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea00b2d30 con 0x7efea0152e10 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.318+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea00b0f60 con 0x7efea0152e10 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.318+0000 7efe9d7fa700 1 -- 172.21.15.81:0/1166640436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe94007590 con 0x7efea0152e10 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.319+0000 7efe9d7fa700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe8c066f30 0x7efe8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:44.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.319+0000 7efe9d7fa700 1 -- 172.21.15.81:0/1166640436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efe94084d50 con 0x7efea0152e10 2023-10-06T02:46:44.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.319+0000 7efea519a700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe8c066f30 0x7efe8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:44.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.319+0000 7efea519a700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe8c066f30 0x7efe8c0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efea01575e0 tx=0x7efe98007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:44.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.323+0000 7efe9d7fa700 1 -- 172.21.15.81:0/1166640436 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe94088030 con 0x7efea0152e10 2023-10-06T02:46:44.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.548+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efea0159160 con 0x7efea0152e10 2023-10-06T02:46:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.548+0000 7efe9d7fa700 1 -- 172.21.15.81:0/1166640436 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7efe94024090 con 0x7efea0152e10 2023-10-06T02:46:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:44.811 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/963539092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":963539092},{"type":"v1","addr":"172.21.15.81:6833","nonce":963539092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3218202678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3218202678},{"type":"v1","addr":"172.21.15.81:6835","nonce":3218202678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/913779656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":913779656},{"type":"v1","addr":"172.21.15.83:6836","nonce":913779656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:06.874539+0000","modified":"2023-10-06T02:46:10.523436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/2378748577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2378748577},{"type":"v1","addr":"172.21.15.83:6837","nonce":2378748577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:46:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe8c066f30 msgr2=0x7efe8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe8c066f30 0x7efe8c0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efea01575e0 tx=0x7efe98007d30 comp rx=0 tx=0).stop 2023-10-06T02:46:44.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0152e10 msgr2=0x7efea00c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:44.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0152e10 0x7efea00c42e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efe94007cd0 tx=0x7efe94015000 comp rx=0 tx=0).stop 2023-10-06T02:46:44.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 shutdown_connections 2023-10-06T02:46:44.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe8c066f30 0x7efe8c0693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea00c4820 0x7efea00c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88004810 0x7efea0168270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 --2- 172.21.15.81:0/1166640436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0152e10 0x7efea00c42e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:44.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 >> 172.21.15.81:0/1166640436 conn(0x7efea00c9ca0 msgr2=0x7efea0156a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:44.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 shutdown_connections 2023-10-06T02:46:44.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:44.551+0000 7efea73fe700 1 -- 172.21.15.81:0/1166640436 wait complete. 2023-10-06T02:46:44.895 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-06T02:46:44.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.008+0000 7f2c4604c700 1 Processor -- start 2023-10-06T02:46:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.008+0000 7f2c4604c700 1 -- start start 2023-10-06T02:46:45.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.009+0000 7f2c4604c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c401578d0 0x7f2c400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.009+0000 7f2c4604c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 0x7f2c4015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.009+0000 7f2c4604c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c400d07c0 con 0x7f2c4006d120 2023-10-06T02:46:45.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.009+0000 7f2c4604c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c400cfbb0 con 0x7f2c401578d0 2023-10-06T02:46:45.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.009+0000 7f2c4604c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400cfe90 con 0x7f2c40157ca0 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.009+0000 7f2c3f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c401578d0 0x7f2c400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.009+0000 7f2c3f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c401578d0 0x7f2c400cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43978/0 (socket says 172.21.15.81:43978) 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.009+0000 7f2c3f7fe700 1 -- 172.21.15.81:0/3269579494 learned_addr learned my addr 172.21.15.81:0/3269579494 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3effd700 1 --2- 172.21.15.81:0/3269579494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 0x7f2c4015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3f7fe700 1 -- 172.21.15.81:0/3269579494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 msgr2=0x7f2c4015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3f7fe700 1 --2- 172.21.15.81:0/3269579494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 0x7f2c4015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3f7fe700 1 -- 172.21.15.81:0/3269579494 >> v1:172.21.15.83:6789/0 conn(0x7f2c4006d120 legacy=0x7f2c4015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3f7fe700 1 -- 172.21.15.81:0/3269579494 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c400d0170 con 0x7f2c401578d0 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3effd700 1 --2- 172.21.15.81:0/3269579494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 0x7f2c4015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3f7fe700 1 --2- 172.21.15.81:0/3269579494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401578d0 0x7f2c400cf4f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009f20 tx=0x7f2c30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4775b7da651d448f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3e7fc700 1 -- 172.21.15.81:0/3269579494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000e070 con 0x7f2c401578d0 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3e7fc700 1 -- 172.21.15.81:0/3269579494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3000ba80 con 0x7f2c401578d0 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c3e7fc700 1 -- 172.21.15.81:0/3269579494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300092e0 con 0x7f2c401578d0 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c4604c700 1 -- 172.21.15.81:0/3269579494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401578d0 msgr2=0x7f2c400cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.010+0000 7f2c4604c700 1 --2- 172.21.15.81:0/3269579494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401578d0 0x7f2c400cf4f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009f20 tx=0x7f2c30009840 comp rx=0 tx=0).stop 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.011+0000 7f2c4604c700 1 -- 172.21.15.81:0/3269579494 shutdown_connections 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.011+0000 7f2c4604c700 1 --2- 172.21.15.81:0/3269579494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401578d0 0x7f2c400cf4f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.011+0000 7f2c4604c700 1 --2- 172.21.15.81:0/3269579494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 0x7f2c4015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.011+0000 7f2c4604c700 1 -- 172.21.15.81:0/3269579494 >> 172.21.15.81:0/3269579494 conn(0x7f2c4006bb90 msgr2=0x7f2c4006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.011+0000 7f2c4604c700 1 -- 172.21.15.81:0/3269579494 shutdown_connections 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.011+0000 7f2c4604c700 1 -- 172.21.15.81:0/3269579494 wait complete. 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.012+0000 7f2c4604c700 1 Processor -- start 2023-10-06T02:46:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.012+0000 7f2c4604c700 1 -- start start 2023-10-06T02:46:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c4604c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c4006d120 0x7f2c4014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c4604c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c401578d0 0x7f2c40069260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c4604c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 0x7f2c400697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c4604c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400b5fd0 con 0x7f2c4006d120 2023-10-06T02:46:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c4604c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400b4f30 con 0x7f2c401578d0 2023-10-06T02:46:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c4604c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400b5210 con 0x7f2c40157ca0 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c4006d120 0x7f2c4014cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c4006d120 0x7f2c4014cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43988/0 (socket says 172.21.15.81:43988) 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3f7fe700 1 -- 172.21.15.81:0/3735177898 learned_addr learned my addr 172.21.15.81:0/3735177898 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3effd700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c401578d0 0x7f2c40069260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3ffff700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 0x7f2c400697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3f7fe700 1 -- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 msgr2=0x7f2c400697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3f7fe700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 0x7f2c400697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3f7fe700 1 -- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c401578d0 msgr2=0x7f2c40069260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3f7fe700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c401578d0 0x7f2c40069260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3f7fe700 1 -- 172.21.15.81:0/3735177898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30009ae0 con 0x7f2c4006d120 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3effd700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c401578d0 0x7f2c40069260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c3f7fe700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c4006d120 0x7f2c4014cc90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000b6c0 tx=0x7f2c30018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c277fe700 1 -- 172.21.15.81:0/3735177898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30008bb0 con 0x7f2c4006d120 2023-10-06T02:46:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c277fe700 1 -- 172.21.15.81:0/3735177898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c30008d10 con 0x7f2c4006d120 2023-10-06T02:46:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c277fe700 1 -- 172.21.15.81:0/3735177898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300266b0 con 0x7f2c4006d120 2023-10-06T02:46:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c400b54f0 con 0x7f2c4006d120 2023-10-06T02:46:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.013+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c400b5ab0 con 0x7f2c4006d120 2023-10-06T02:46:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.014+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c40067ac0 con 0x7f2c4006d120 2023-10-06T02:46:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.015+0000 7f2c277fe700 1 -- 172.21.15.81:0/3735177898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c30003040 con 0x7f2c4006d120 2023-10-06T02:46:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.015+0000 7f2c277fe700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.015+0000 7f2c277fe700 1 -- 172.21.15.81:0/3735177898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2c30086520 con 0x7f2c4006d120 2023-10-06T02:46:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.015+0000 7f2c3effd700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.016+0000 7f2c3effd700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2c400b2c00 tx=0x7f2c34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.019+0000 7f2c277fe700 1 -- 172.21.15.81:0/3735177898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c30053630 con 0x7f2c4006d120 2023-10-06T02:46:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.202+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c400d0450 con 0x7f2c4006d120 2023-10-06T02:46:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.203+0000 7f2c277fe700 1 -- 172.21.15.81:0/3735177898 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f2c30056c50 con 0x7f2c4006d120 2023-10-06T02:46:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:45.693 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 msgr2=0x7f2c2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2c400b2c00 tx=0x7f2c34008040 comp rx=0 tx=0).stop 2023-10-06T02:46:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c4006d120 msgr2=0x7f2c4014cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c4006d120 0x7f2c4014cc90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000b6c0 tx=0x7f2c30018000 comp rx=0 tx=0).stop 2023-10-06T02:46:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 shutdown_connections 2023-10-06T02:46:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c40157ca0 0x7f2c400697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c4006d120 0x7f2c4014cc90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 --2- 172.21.15.81:0/3735177898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c401578d0 0x7f2c40069260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 >> 172.21.15.81:0/3735177898 conn(0x7f2c4006bb90 msgr2=0x7f2c40070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 shutdown_connections 2023-10-06T02:46:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.205+0000 7f2c4604c700 1 -- 172.21.15.81:0/3735177898 wait complete. 2023-10-06T02:46:45.778 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:46:05.360665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:46:05.837671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:46:45.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:45.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.895+0000 7f3852980700 1 Processor -- start 2023-10-06T02:46:45.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.895+0000 7f3852980700 1 -- start start 2023-10-06T02:46:45.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.895+0000 7f3852980700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f384c1578d0 0x7f384c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.895+0000 7f3852980700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c157ca0 0x7f384c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.895+0000 7f3852980700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c0d07c0 con 0x7f384c06d120 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.895+0000 7f3852980700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c0cfbb0 con 0x7f384c1578d0 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.895+0000 7f3852980700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0cfe90 con 0x7f384c157ca0 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f384c1578d0 0x7f384c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f3850f1d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f384c06d120 0x7f384c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45594/0 (socket says 172.21.15.81:45594) 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f3850f1d700 1 -- 172.21.15.81:0/807827474 learned_addr learned my addr 172.21.15.81:0/807827474 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f384c1578d0 0x7f384c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44004/0 (socket says 172.21.15.81:44004) 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384b7fe700 1 --2- 172.21.15.81:0/807827474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c157ca0 0x7f384c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384bfff700 1 -- 172.21.15.81:0/807827474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c157ca0 msgr2=0x7f384c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384bfff700 1 --2- 172.21.15.81:0/807827474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c157ca0 0x7f384c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384bfff700 1 -- 172.21.15.81:0/807827474 >> v1:172.21.15.81:6789/0 conn(0x7f384c06d120 legacy=0x7f384c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384affd700 1 -- 172.21.15.81:0/807827474 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938219227 0 0) 0x7f384c0d07c0 con 0x7f384c06d120 2023-10-06T02:46:45.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384bfff700 1 -- 172.21.15.81:0/807827474 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c0d0170 con 0x7f384c1578d0 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384b7fe700 1 --2- 172.21.15.81:0/807827474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c157ca0 0x7f384c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384bfff700 1 --2- 172.21.15.81:0/807827474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 0x7f384c0cf4f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f383c0098e0 tx=0x7f383c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc43acbb8d1e2ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384affd700 1 -- 172.21.15.81:0/807827474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c009e80 con 0x7f384c1578d0 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384affd700 1 -- 172.21.15.81:0/807827474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00b860 con 0x7f384c1578d0 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.896+0000 7f384affd700 1 -- 172.21.15.81:0/807827474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00bbe0 con 0x7f384c1578d0 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.897+0000 7f3852980700 1 -- 172.21.15.81:0/807827474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 msgr2=0x7f384c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.897+0000 7f3852980700 1 --2- 172.21.15.81:0/807827474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 0x7f384c0cf4f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f383c0098e0 tx=0x7f383c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.897+0000 7f3852980700 1 -- 172.21.15.81:0/807827474 shutdown_connections 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.897+0000 7f3852980700 1 --2- 172.21.15.81:0/807827474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 0x7f384c0cf4f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.897+0000 7f3852980700 1 --2- 172.21.15.81:0/807827474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c157ca0 0x7f384c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.897+0000 7f3852980700 1 -- 172.21.15.81:0/807827474 >> 172.21.15.81:0/807827474 conn(0x7f384c06bb90 msgr2=0x7f384c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.897+0000 7f3852980700 1 -- 172.21.15.81:0/807827474 shutdown_connections 2023-10-06T02:46:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.897+0000 7f3852980700 1 -- 172.21.15.81:0/807827474 wait complete. 2023-10-06T02:46:45.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.898+0000 7f3852980700 1 Processor -- start 2023-10-06T02:46:45.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.898+0000 7f3852980700 1 -- start start 2023-10-06T02:46:45.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f3852980700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c06d120 0x7f384c149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f3852980700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 0x7f384c0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f3852980700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f384c157ca0 0x7f384c0ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f3852980700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0ab270 con 0x7f384c1578d0 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f3852980700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0ac590 con 0x7f384c157ca0 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f3852980700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0ab4f0 con 0x7f384c06d120 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 0x7f384c0ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 0x7f384c0ad0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44016/0 (socket says 172.21.15.81:44016) 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384b7fe700 1 -- 172.21.15.81:0/458952921 learned_addr learned my addr 172.21.15.81:0/458952921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f3850f1d700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f384c157ca0 0x7f384c0ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384b7fe700 1 -- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c06d120 msgr2=0x7f384c149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384bfff700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c06d120 0x7f384c149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384b7fe700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c06d120 0x7f384c149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384b7fe700 1 -- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f384c157ca0 msgr2=0x7f384c0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384b7fe700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f384c157ca0 0x7f384c0ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384b7fe700 1 -- 172.21.15.81:0/458952921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c009420 con 0x7f384c1578d0 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f3850f1d700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f384c157ca0 0x7f384c0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.899+0000 7f384b7fe700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 0x7f384c0ad0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f384000c850 tx=0x7f3840008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.900+0000 7f3833fff700 1 -- 172.21.15.81:0/458952921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840011600 con 0x7f384c1578d0 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.900+0000 7f3833fff700 1 -- 172.21.15.81:0/458952921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840011760 con 0x7f384c1578d0 2023-10-06T02:46:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.900+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c0ab7d0 con 0x7f384c1578d0 2023-10-06T02:46:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.900+0000 7f3833fff700 1 -- 172.21.15.81:0/458952921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840011b00 con 0x7f384c1578d0 2023-10-06T02:46:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.900+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c0abd90 con 0x7f384c1578d0 2023-10-06T02:46:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.900+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c067ac0 con 0x7f384c1578d0 2023-10-06T02:46:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.901+0000 7f3833fff700 1 -- 172.21.15.81:0/458952921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38400073b0 con 0x7f384c1578d0 2023-10-06T02:46:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.901+0000 7f3833fff700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3838066f30 0x7f38380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.901+0000 7f3833fff700 1 -- 172.21.15.81:0/458952921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3840084670 con 0x7f384c1578d0 2023-10-06T02:46:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.902+0000 7f384bfff700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3838066f30 0x7f38380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.902+0000 7f384bfff700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3838066f30 0x7f38380693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f383c003080 tx=0x7f383c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:45.906+0000 7f3833fff700 1 -- 172.21.15.81:0/458952921 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3840051780 con 0x7f384c1578d0 2023-10-06T02:46:46.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.086+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f384c0d0450 con 0x7f384c1578d0 2023-10-06T02:46:46.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.086+0000 7f3833fff700 1 -- 172.21.15.81:0/458952921 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3840054da0 con 0x7f384c1578d0 2023-10-06T02:46:46.087 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:46.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3838066f30 msgr2=0x7f38380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3838066f30 0x7f38380693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f383c003080 tx=0x7f383c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 msgr2=0x7f384c0ad0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 0x7f384c0ad0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f384000c850 tx=0x7f3840008040 comp rx=0 tx=0).stop 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 shutdown_connections 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3838066f30 0x7f38380693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f384c157ca0 0x7f384c0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f384c06d120 0x7f384c149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 --2- 172.21.15.81:0/458952921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c1578d0 0x7f384c0ad0a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 >> 172.21.15.81:0/458952921 conn(0x7f384c06bb90 msgr2=0x7f384c068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 shutdown_connections 2023-10-06T02:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.088+0000 7f3852980700 1 -- 172.21.15.81:0/458952921 wait complete. 2023-10-06T02:46:46.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.216+0000 7feeb638d700 1 Processor -- start 2023-10-06T02:46:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.216+0000 7feeb638d700 1 -- start start 2023-10-06T02:46:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb638d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7feeb0159cb0 0x7feeb00ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb638d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feeb006e4e0 0x7feeb00ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb638d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00aaf40 con 0x7feeb015a080 2023-10-06T02:46:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb638d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb006c570 con 0x7feeb006e4e0 2023-10-06T02:46:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb638d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00aa930 con 0x7feeb0159cb0 2023-10-06T02:46:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb4b8a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feeb006e4e0 0x7feeb00ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb5b8c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feeb015a080 0x7feeb00ab3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45596/0 (socket says 172.21.15.81:45596) 2023-10-06T02:46:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb5b8c700 1 -- 172.21.15.81:0/703481865 learned_addr learned my addr 172.21.15.81:0/703481865 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb538b700 1 --2- 172.21.15.81:0/703481865 >> v2:172.21.15.83:3300/0 conn(0x7feeb0159cb0 0x7feeb00ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb4b8a700 1 -- 172.21.15.81:0/703481865 >> v2:172.21.15.83:3300/0 conn(0x7feeb0159cb0 msgr2=0x7feeb00ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb4b8a700 1 --2- 172.21.15.81:0/703481865 >> v2:172.21.15.83:3300/0 conn(0x7feeb0159cb0 0x7feeb00ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb4b8a700 1 -- 172.21.15.81:0/703481865 >> v1:172.21.15.81:6789/0 conn(0x7feeb015a080 legacy=0x7feeb00ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeaffff700 1 -- 172.21.15.81:0/703481865 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432863234 0 0) 0x7feeb00aaf40 con 0x7feeb015a080 2023-10-06T02:46:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb4b8a700 1 -- 172.21.15.81:0/703481865 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb006e970 con 0x7feeb006e4e0 2023-10-06T02:46:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.217+0000 7feeb4b8a700 1 --2- 172.21.15.81:0/703481865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb006e4e0 0x7feeb00ceeb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feeb0064440 tx=0x7feea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e42043ba773a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeaffff700 1 -- 172.21.15.81:0/703481865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400b6b0 con 0x7feeb006e4e0 2023-10-06T02:46:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeaffff700 1 -- 172.21.15.81:0/703481865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400b810 con 0x7feeb006e4e0 2023-10-06T02:46:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeaffff700 1 -- 172.21.15.81:0/703481865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400bbb0 con 0x7feeb006e4e0 2023-10-06T02:46:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeb638d700 1 -- 172.21.15.81:0/703481865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb006e4e0 msgr2=0x7feeb00ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeb638d700 1 --2- 172.21.15.81:0/703481865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb006e4e0 0x7feeb00ceeb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feeb0064440 tx=0x7feea40091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeb638d700 1 -- 172.21.15.81:0/703481865 shutdown_connections 2023-10-06T02:46:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeb638d700 1 --2- 172.21.15.81:0/703481865 >> v2:172.21.15.83:3300/0 conn(0x7feeb0159cb0 0x7feeb00ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeb638d700 1 --2- 172.21.15.81:0/703481865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb006e4e0 0x7feeb00ceeb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeb638d700 1 -- 172.21.15.81:0/703481865 >> 172.21.15.81:0/703481865 conn(0x7feeb0068110 msgr2=0x7feeb006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeb638d700 1 -- 172.21.15.81:0/703481865 shutdown_connections 2023-10-06T02:46:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.218+0000 7feeb638d700 1 -- 172.21.15.81:0/703481865 wait complete. 2023-10-06T02:46:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.219+0000 7feeb638d700 1 Processor -- start 2023-10-06T02:46:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.219+0000 7feeb638d700 1 -- start start 2023-10-06T02:46:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb638d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb006e4e0 0x7feeb013e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb638d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0159cb0 0x7feeb00cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb638d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feeb015a080 0x7feeb00c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb638d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c8fe0 con 0x7feeb0159cb0 2023-10-06T02:46:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb638d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c7ef0 con 0x7feeb006e4e0 2023-10-06T02:46:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb638d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c81d0 con 0x7feeb015a080 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb4b8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0159cb0 0x7feeb00cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb4b8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0159cb0 0x7feeb00cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44038/0 (socket says 172.21.15.81:44038) 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb4b8a700 1 -- 172.21.15.81:0/990505300 learned_addr learned my addr 172.21.15.81:0/990505300 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb538b700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb006e4e0 0x7feeb013e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.220+0000 7feeb5b8c700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feeb015a080 0x7feeb00c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feeb4b8a700 1 -- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feeb015a080 msgr2=0x7feeb00c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feeb4b8a700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feeb015a080 0x7feeb00c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feeb4b8a700 1 -- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb006e4e0 msgr2=0x7feeb013e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feeb4b8a700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb006e4e0 0x7feeb013e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feeb4b8a700 1 -- 172.21.15.81:0/990505300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4009420 con 0x7feeb0159cb0 2023-10-06T02:46:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feeb4b8a700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0159cb0 0x7feeb00cb610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feeb00632d0 tx=0x7feea4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:46.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feead7fa700 1 -- 172.21.15.81:0/990505300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400bb90 con 0x7feeb0159cb0 2023-10-06T02:46:46.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feead7fa700 1 -- 172.21.15.81:0/990505300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4011420 con 0x7feeb0159cb0 2023-10-06T02:46:46.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb00c84b0 con 0x7feeb0159cb0 2023-10-06T02:46:46.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feead7fa700 1 -- 172.21.15.81:0/990505300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40117c0 con 0x7feeb0159cb0 2023-10-06T02:46:46.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.221+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb013e8b0 con 0x7feeb0159cb0 2023-10-06T02:46:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.222+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb00c9150 con 0x7feeb0159cb0 2023-10-06T02:46:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.222+0000 7feead7fa700 1 -- 172.21.15.81:0/990505300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feea4011bb0 con 0x7feeb0159cb0 2023-10-06T02:46:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.223+0000 7feead7fa700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee9c066f30 0x7fee9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.223+0000 7feead7fa700 1 -- 172.21.15.81:0/990505300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feea4085eb0 con 0x7feeb0159cb0 2023-10-06T02:46:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.223+0000 7feeb538b700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee9c066f30 0x7fee9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.223+0000 7feeb538b700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee9c066f30 0x7fee9c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feea8009fd0 tx=0x7feea8009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.227+0000 7feead7fa700 1 -- 172.21.15.81:0/990505300 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feea4052fc0 con 0x7feeb0159cb0 2023-10-06T02:46:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.410+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feeb00aabd0 con 0x7feeb0159cb0 2023-10-06T02:46:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.410+0000 7feead7fa700 1 -- 172.21.15.81:0/990505300 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7feea4011e60 con 0x7feeb0159cb0 2023-10-06T02:46:46.411 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:46.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.412+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee9c066f30 msgr2=0x7fee9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.412+0000 7feeb638d700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee9c066f30 0x7fee9c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feea8009fd0 tx=0x7feea8009880 comp rx=0 tx=0).stop 2023-10-06T02:46:46.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.412+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0159cb0 msgr2=0x7feeb00cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.412+0000 7feeb638d700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0159cb0 0x7feeb00cb610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feeb00632d0 tx=0x7feea4017000 comp rx=0 tx=0).stop 2023-10-06T02:46:46.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.413+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 shutdown_connections 2023-10-06T02:46:46.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.413+0000 7feeb638d700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feeb015a080 0x7feeb00c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.413+0000 7feeb638d700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee9c066f30 0x7fee9c0693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.413+0000 7feeb638d700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeb006e4e0 0x7feeb013e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.413+0000 7feeb638d700 1 --2- 172.21.15.81:0/990505300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0159cb0 0x7feeb00cb610 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.413+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 >> 172.21.15.81:0/990505300 conn(0x7feeb0068110 msgr2=0x7feeb014f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:46.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.413+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 shutdown_connections 2023-10-06T02:46:46.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.413+0000 7feeb638d700 1 -- 172.21.15.81:0/990505300 wait complete. 2023-10-06T02:46:46.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.543+0000 7f365b995700 1 Processor -- start 2023-10-06T02:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.543+0000 7f365b995700 1 -- start start 2023-10-06T02:46:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f365b995700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36541578d0 0x7f36540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f365b995700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f365406d120 0x7f365406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f365b995700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36540d07c0 con 0x7f3654157ca0 2023-10-06T02:46:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f365b995700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365406da50 con 0x7f36541578d0 2023-10-06T02:46:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f365b995700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36540cfbb0 con 0x7f365406d120 2023-10-06T02:46:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f3659731700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36541578d0 0x7f36540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f3659731700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36541578d0 0x7f36540cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44046/0 (socket says 172.21.15.81:44046) 2023-10-06T02:46:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f3659731700 1 -- 172.21.15.81:0/2582663067 learned_addr learned my addr 172.21.15.81:0/2582663067 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f3659f32700 1 --2- 172.21.15.81:0/2582663067 >> v2:172.21.15.83:3300/0 conn(0x7f365406d120 0x7f365406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f3659731700 1 -- 172.21.15.81:0/2582663067 >> v2:172.21.15.83:3300/0 conn(0x7f365406d120 msgr2=0x7f365406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f3659731700 1 --2- 172.21.15.81:0/2582663067 >> v2:172.21.15.83:3300/0 conn(0x7f365406d120 0x7f365406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f3659731700 1 -- 172.21.15.81:0/2582663067 >> v1:172.21.15.83:6789/0 conn(0x7f3654157ca0 legacy=0x7f365415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f3659731700 1 -- 172.21.15.81:0/2582663067 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36540cfe90 con 0x7f36541578d0 2023-10-06T02:46:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f3659731700 1 --2- 172.21.15.81:0/2582663067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36541578d0 0x7f36540cf4f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3654068300 tx=0x7f3650009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950406ca22a5b8c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f364bfff700 1 -- 172.21.15.81:0/2582663067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650009e70 con 0x7f36541578d0 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f364bfff700 1 -- 172.21.15.81:0/2582663067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365000b860 con 0x7f36541578d0 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.544+0000 7f364bfff700 1 -- 172.21.15.81:0/2582663067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365000bc00 con 0x7f36541578d0 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.545+0000 7f365b995700 1 -- 172.21.15.81:0/2582663067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36541578d0 msgr2=0x7f36540cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.545+0000 7f365b995700 1 --2- 172.21.15.81:0/2582663067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36541578d0 0x7f36540cf4f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3654068300 tx=0x7f3650009250 comp rx=0 tx=0).stop 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.545+0000 7f365b995700 1 -- 172.21.15.81:0/2582663067 shutdown_connections 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.545+0000 7f365b995700 1 --2- 172.21.15.81:0/2582663067 >> v2:172.21.15.83:3300/0 conn(0x7f365406d120 0x7f365406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.545+0000 7f365b995700 1 --2- 172.21.15.81:0/2582663067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36541578d0 0x7f36540cf4f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.545+0000 7f365b995700 1 -- 172.21.15.81:0/2582663067 >> 172.21.15.81:0/2582663067 conn(0x7f365406bb90 msgr2=0x7f365406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.545+0000 7f365b995700 1 -- 172.21.15.81:0/2582663067 shutdown_connections 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.545+0000 7f365b995700 1 -- 172.21.15.81:0/2582663067 wait complete. 2023-10-06T02:46:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.546+0000 7f365b995700 1 Processor -- start 2023-10-06T02:46:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.546+0000 7f365b995700 1 -- start start 2023-10-06T02:46:46.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f365b995700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f365406d120 0x7f365413ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f365b995700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36541578d0 0x7f3654068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f365b995700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3654157ca0 0x7f3654068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f365b995700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36541514b0 con 0x7f3654157ca0 2023-10-06T02:46:46.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f365b995700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3654151790 con 0x7f36541578d0 2023-10-06T02:46:46.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f365b995700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3654151a70 con 0x7f365406d120 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3659f32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3654157ca0 0x7f3654068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3659f32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3654157ca0 0x7f3654068dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44062/0 (socket says 172.21.15.81:44062) 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3659f32700 1 -- 172.21.15.81:0/656473875 learned_addr learned my addr 172.21.15.81:0/656473875 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3659731700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f365406d120 0x7f365413ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3658f30700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36541578d0 0x7f3654068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3659f32700 1 -- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f365406d120 msgr2=0x7f365413ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3659f32700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f365406d120 0x7f365413ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3659f32700 1 -- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36541578d0 msgr2=0x7f3654068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3659f32700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36541578d0 0x7f3654068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.547+0000 7f3659f32700 1 -- 172.21.15.81:0/656473875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500094f0 con 0x7f3654157ca0 2023-10-06T02:46:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.548+0000 7f3659f32700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3654157ca0 0x7f3654068dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f364c009e90 tx=0x7f364c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.548+0000 7f36497fa700 1 -- 172.21.15.81:0/656473875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c00cb70 con 0x7f3654157ca0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.548+0000 7f36497fa700 1 -- 172.21.15.81:0/656473875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c00f040 con 0x7f3654157ca0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.548+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3654151d50 con 0x7f3654157ca0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.548+0000 7f36497fa700 1 -- 172.21.15.81:0/656473875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c014480 con 0x7f3654157ca0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.548+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365414fe70 con 0x7f3654157ca0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.549+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3654151f70 con 0x7f3654157ca0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.549+0000 7f36497fa700 1 -- 172.21.15.81:0/656473875 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f364c014830 con 0x7f3654157ca0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.549+0000 7f36497fa700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3638066f30 0x7f36380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.550+0000 7f36497fa700 1 -- 172.21.15.81:0/656473875 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f364c085060 con 0x7f3654157ca0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.550+0000 7f3659731700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3638066f30 0x7f36380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.550+0000 7f3659731700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3638066f30 0x7f36380693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3654068300 tx=0x7f3650017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.554+0000 7f36497fa700 1 -- 172.21.15.81:0/656473875 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f364c052170 con 0x7f3654157ca0 2023-10-06T02:46:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.735+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36540d0170 con 0x7f3654157ca0 2023-10-06T02:46:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.735+0000 7f36497fa700 1 -- 172.21.15.81:0/656473875 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f364c055790 con 0x7f3654157ca0 2023-10-06T02:46:46.737 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3638066f30 msgr2=0x7f36380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3638066f30 0x7f36380693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3654068300 tx=0x7f3650017000 comp rx=0 tx=0).stop 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3654157ca0 msgr2=0x7f3654068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3654157ca0 0x7f3654068dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f364c009e90 tx=0x7f364c00b040 comp rx=0 tx=0).stop 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 shutdown_connections 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3654157ca0 0x7f3654068dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f365406d120 0x7f365413ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3638066f30 0x7f36380693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 --2- 172.21.15.81:0/656473875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36541578d0 0x7f3654068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 >> 172.21.15.81:0/656473875 conn(0x7f365406bb90 msgr2=0x7f365415cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 shutdown_connections 2023-10-06T02:46:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.737+0000 7f365b995700 1 -- 172.21.15.81:0/656473875 wait complete. 2023-10-06T02:46:46.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:46:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.866+0000 7fe2b4a68700 1 Processor -- start 2023-10-06T02:46:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.866+0000 7fe2b4a68700 1 -- start start 2023-10-06T02:46:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2b4a68700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 0x7fe2b00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2b4a68700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe2b006d120 0x7fe2b006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2b4a68700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b006dac0 con 0x7fe2b0157ca0 2023-10-06T02:46:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2b4a68700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00d07c0 con 0x7fe2b006d120 2023-10-06T02:46:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2b4a68700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00cfbb0 con 0x7fe2b01578d0 2023-10-06T02:46:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2aed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe2b006d120 0x7fe2b006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2aed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe2b006d120 0x7fe2b006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44074/0 (socket says 172.21.15.81:44074) 2023-10-06T02:46:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2aed9d700 1 -- 172.21.15.81:0/2110036363 learned_addr learned my addr 172.21.15.81:0/2110036363 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2ae59c700 1 --2- 172.21.15.81:0/2110036363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 0x7fe2b00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2aed9d700 1 -- 172.21.15.81:0/2110036363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 msgr2=0x7fe2b00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2aed9d700 1 --2- 172.21.15.81:0/2110036363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 0x7fe2b00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2aed9d700 1 -- 172.21.15.81:0/2110036363 >> v1:172.21.15.83:6789/0 conn(0x7fe2b0157ca0 legacy=0x7fe2b015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2aed9d700 1 -- 172.21.15.81:0/2110036363 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00cfe90 con 0x7fe2b006d120 2023-10-06T02:46:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.867+0000 7fe2ae59c700 1 --2- 172.21.15.81:0/2110036363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 0x7fe2b00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2aed9d700 1 --2- 172.21.15.81:0/2110036363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b006d120 0x7fe2b006d580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009f20 tx=0x7fe2a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be39ef532239b8f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2add9b700 1 -- 172.21.15.81:0/2110036363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800e070 con 0x7fe2b006d120 2023-10-06T02:46:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2add9b700 1 -- 172.21.15.81:0/2110036363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a800ba80 con 0x7fe2b006d120 2023-10-06T02:46:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2add9b700 1 -- 172.21.15.81:0/2110036363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80092e0 con 0x7fe2b006d120 2023-10-06T02:46:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2b4a68700 1 -- 172.21.15.81:0/2110036363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b006d120 msgr2=0x7fe2b006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2b4a68700 1 --2- 172.21.15.81:0/2110036363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b006d120 0x7fe2b006d580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009f20 tx=0x7fe2a8009840 comp rx=0 tx=0).stop 2023-10-06T02:46:46.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2b4a68700 1 -- 172.21.15.81:0/2110036363 shutdown_connections 2023-10-06T02:46:46.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2b4a68700 1 --2- 172.21.15.81:0/2110036363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b006d120 0x7fe2b006d580 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2b4a68700 1 --2- 172.21.15.81:0/2110036363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 0x7fe2b00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2b4a68700 1 -- 172.21.15.81:0/2110036363 >> 172.21.15.81:0/2110036363 conn(0x7fe2b006bb90 msgr2=0x7fe2b006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:46.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2b4a68700 1 -- 172.21.15.81:0/2110036363 shutdown_connections 2023-10-06T02:46:46.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.868+0000 7fe2b4a68700 1 -- 172.21.15.81:0/2110036363 wait complete. 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.869+0000 7fe2b4a68700 1 Processor -- start 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.869+0000 7fe2b4a68700 1 -- start start 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2b4a68700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2b006d120 0x7fe2b00c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2b4a68700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 0x7fe2b0159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2b4a68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b0157ca0 0x7fe2b0148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2b4a68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00c7970 con 0x7fe2b0157ca0 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2b4a68700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00c6d60 con 0x7fe2b006d120 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2b4a68700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00c7040 con 0x7fe2b01578d0 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2aed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b0157ca0 0x7fe2b0148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2aed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b0157ca0 0x7fe2b0148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44082/0 (socket says 172.21.15.81:44082) 2023-10-06T02:46:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2aed9d700 1 -- 172.21.15.81:0/755480176 learned_addr learned my addr 172.21.15.81:0/755480176 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2ae59c700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2b006d120 0x7fe2b00c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.870+0000 7fe2a5d9b700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 0x7fe2b0159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2aed9d700 1 -- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 msgr2=0x7fe2b0159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2aed9d700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 0x7fe2b0159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2aed9d700 1 -- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2b006d120 msgr2=0x7fe2b00c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2aed9d700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2b006d120 0x7fe2b00c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2aed9d700 1 -- 172.21.15.81:0/755480176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8009ae0 con 0x7fe2b0157ca0 2023-10-06T02:46:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2aed9d700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b0157ca0 0x7fe2b0148540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2b006fe20 tx=0x7fe2a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2a6ffd700 1 -- 172.21.15.81:0/755480176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80032f0 con 0x7fe2b0157ca0 2023-10-06T02:46:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2a6ffd700 1 -- 172.21.15.81:0/755480176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a8008d20 con 0x7fe2b0157ca0 2023-10-06T02:46:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b00c7320 con 0x7fe2b0157ca0 2023-10-06T02:46:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2a6ffd700 1 -- 172.21.15.81:0/755480176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80266b0 con 0x7fe2b0157ca0 2023-10-06T02:46:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.871+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b00c6af0 con 0x7fe2b0157ca0 2023-10-06T02:46:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.872+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b00c7b20 con 0x7fe2b0157ca0 2023-10-06T02:46:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.872+0000 7fe2a6ffd700 1 -- 172.21.15.81:0/755480176 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2a8003040 con 0x7fe2b0157ca0 2023-10-06T02:46:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.873+0000 7fe2a6ffd700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe290066f30 0x7fe2900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.873+0000 7fe2a6ffd700 1 -- 172.21.15.81:0/755480176 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2a8086620 con 0x7fe2b0157ca0 2023-10-06T02:46:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.873+0000 7fe2ae59c700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe290066f30 0x7fe2900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.873+0000 7fe2ae59c700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe290066f30 0x7fe2900693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0006f00 tx=0x7fe2a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:46.877+0000 7fe2a6ffd700 1 -- 172.21.15.81:0/755480176 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2a80537e0 con 0x7fe2b0157ca0 2023-10-06T02:46:47.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.058+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2b00c7e60 con 0x7fe2b0157ca0 2023-10-06T02:46:47.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.058+0000 7fe2a6ffd700 1 -- 172.21.15.81:0/755480176 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2a8056e00 con 0x7fe2b0157ca0 2023-10-06T02:46:47.060 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:46:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe290066f30 msgr2=0x7fe2900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe290066f30 0x7fe2900693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0006f00 tx=0x7fe2a0008040 comp rx=0 tx=0).stop 2023-10-06T02:46:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b0157ca0 msgr2=0x7fe2b0148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b0157ca0 0x7fe2b0148540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2b006fe20 tx=0x7fe2a8018000 comp rx=0 tx=0).stop 2023-10-06T02:46:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 shutdown_connections 2023-10-06T02:46:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b0157ca0 0x7fe2b0148540 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe290066f30 0x7fe2900693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2b006d120 0x7fe2b00c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 --2- 172.21.15.81:0/755480176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2b01578d0 0x7fe2b0159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 >> 172.21.15.81:0/755480176 conn(0x7fe2b006bb90 msgr2=0x7fe2b0070750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 shutdown_connections 2023-10-06T02:46:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.060+0000 7fe2b4a68700 1 -- 172.21.15.81:0/755480176 wait complete. 2023-10-06T02:46:47.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:46:47.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.186+0000 7f6f1eaec700 1 Processor -- start 2023-10-06T02:46:47.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.186+0000 7f6f1eaec700 1 -- start start 2023-10-06T02:46:47.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1eaec700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f18157a20 0x7f6f180af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1eaec700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6f180afc60 0x7f6f180cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1eaec700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1806c380 con 0x7f6f180ce0a0 2023-10-06T02:46:47.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1eaec700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f180b0450 con 0x7f6f18157a20 2023-10-06T02:46:47.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1eaec700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f180ce520 con 0x7f6f180afc60 2023-10-06T02:46:47.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1daea700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f18157a20 0x7f6f180af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1e2eb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6f180ce0a0 0x7f6f180698d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45612/0 (socket says 172.21.15.81:45612) 2023-10-06T02:46:47.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1e2eb700 1 -- 172.21.15.81:0/457716617 learned_addr learned my addr 172.21.15.81:0/457716617 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:47.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1d2e9700 1 --2- 172.21.15.81:0/457716617 >> v2:172.21.15.83:3300/0 conn(0x7f6f180afc60 0x7f6f180cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1daea700 1 -- 172.21.15.81:0/457716617 >> v2:172.21.15.83:3300/0 conn(0x7f6f180afc60 msgr2=0x7f6f180cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1daea700 1 --2- 172.21.15.81:0/457716617 >> v2:172.21.15.83:3300/0 conn(0x7f6f180afc60 0x7f6f180cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1daea700 1 -- 172.21.15.81:0/457716617 >> v1:172.21.15.81:6789/0 conn(0x7f6f180ce0a0 legacy=0x7f6f180698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.187+0000 7f6f1daea700 1 -- 172.21.15.81:0/457716617 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180b0170 con 0x7f6f18157a20 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1daea700 1 --2- 172.21.15.81:0/457716617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f18157a20 0x7f6f180af720 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f18063d90 tx=0x7f6f14009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fe1c09a5cfaba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1cae8700 1 -- 172.21.15.81:0/457716617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1400e070 con 0x7f6f18157a20 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1cae8700 1 -- 172.21.15.81:0/457716617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1400bb20 con 0x7f6f18157a20 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1cae8700 1 -- 172.21.15.81:0/457716617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14012430 con 0x7f6f18157a20 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1eaec700 1 -- 172.21.15.81:0/457716617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f18157a20 msgr2=0x7f6f180af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1eaec700 1 --2- 172.21.15.81:0/457716617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f18157a20 0x7f6f180af720 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f18063d90 tx=0x7f6f14009780 comp rx=0 tx=0).stop 2023-10-06T02:46:47.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1eaec700 1 -- 172.21.15.81:0/457716617 shutdown_connections 2023-10-06T02:46:47.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1eaec700 1 --2- 172.21.15.81:0/457716617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f18157a20 0x7f6f180af720 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1eaec700 1 --2- 172.21.15.81:0/457716617 >> v2:172.21.15.83:3300/0 conn(0x7f6f180afc60 0x7f6f180cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1eaec700 1 -- 172.21.15.81:0/457716617 >> 172.21.15.81:0/457716617 conn(0x7f6f18063230 msgr2=0x7f6f18063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:47.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1eaec700 1 -- 172.21.15.81:0/457716617 shutdown_connections 2023-10-06T02:46:47.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.188+0000 7f6f1eaec700 1 -- 172.21.15.81:0/457716617 wait complete. 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.189+0000 7f6f1eaec700 1 Processor -- start 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1eaec700 1 -- start start 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1eaec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f180afc60 0x7f6f180c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1eaec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f180ce0a0 0x7f6f18142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1eaec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f18157a20 0x7f6f180c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1eaec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18143220 con 0x7f6f180ce0a0 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1eaec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18168380 con 0x7f6f180afc60 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1eaec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180c7330 con 0x7f6f18157a20 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1d2e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f180ce0a0 0x7f6f18142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1d2e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f180ce0a0 0x7f6f18142ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44100/0 (socket says 172.21.15.81:44100) 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.190+0000 7f6f1d2e9700 1 -- 172.21.15.81:0/2901454380 learned_addr learned my addr 172.21.15.81:0/2901454380 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1daea700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f180afc60 0x7f6f180c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1e2eb700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f18157a20 0x7f6f180c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1d2e9700 1 -- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f18157a20 msgr2=0x7f6f180c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1d2e9700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f18157a20 0x7f6f180c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1d2e9700 1 -- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f180afc60 msgr2=0x7f6f180c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1d2e9700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f180afc60 0x7f6f180c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1d2e9700 1 -- 172.21.15.81:0/2901454380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f14009a20 con 0x7f6f180ce0a0 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1e2eb700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f18157a20 0x7f6f180c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1d2e9700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f180ce0a0 0x7f6f18142ce0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800ecb0 tx=0x7f6f080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f0dffb700 1 -- 172.21.15.81:0/2901454380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800c9d0 con 0x7f6f180ce0a0 2023-10-06T02:46:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f0dffb700 1 -- 172.21.15.81:0/2901454380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0800cb30 con 0x7f6f180ce0a0 2023-10-06T02:46:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f180c6720 con 0x7f6f180ce0a0 2023-10-06T02:46:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f0dffb700 1 -- 172.21.15.81:0/2901454380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800ced0 con 0x7f6f180ce0a0 2023-10-06T02:46:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.191+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f180c6ce0 con 0x7f6f180ce0a0 2023-10-06T02:46:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.192+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f180690d0 con 0x7f6f180ce0a0 2023-10-06T02:46:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.192+0000 7f6f0dffb700 1 -- 172.21.15.81:0/2901454380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f08013680 con 0x7f6f180ce0a0 2023-10-06T02:46:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.193+0000 7f6f0dffb700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6efc066f30 0x7f6efc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.193+0000 7f6f0dffb700 1 -- 172.21.15.81:0/2901454380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f080849f0 con 0x7f6f180ce0a0 2023-10-06T02:46:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.193+0000 7f6f1daea700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6efc066f30 0x7f6efc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.194+0000 7f6f1daea700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6efc066f30 0x7f6efc0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009de0 tx=0x7f6f14019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:47.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.197+0000 7f6f0dffb700 1 -- 172.21.15.81:0/2901454380 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f08051b00 con 0x7f6f180ce0a0 2023-10-06T02:46:47.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.420+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f180c74f0 con 0x7f6f180ce0a0 2023-10-06T02:46:47.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.420+0000 7f6f0dffb700 1 -- 172.21.15.81:0/2901454380 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f6f08055120 con 0x7f6f180ce0a0 2023-10-06T02:46:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/963539092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":963539092},{"type":"v1","addr":"172.21.15.81:6833","nonce":963539092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3218202678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3218202678},{"type":"v1","addr":"172.21.15.81:6835","nonce":3218202678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/913779656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":913779656},{"type":"v1","addr":"172.21.15.83:6836","nonce":913779656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:06.874539+0000","modified":"2023-10-06T02:46:10.523436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/2378748577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2378748577},{"type":"v1","addr":"172.21.15.83:6837","nonce":2378748577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:46:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6efc066f30 msgr2=0x7f6efc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6efc066f30 0x7f6efc0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009de0 tx=0x7f6f14019000 comp rx=0 tx=0).stop 2023-10-06T02:46:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f180ce0a0 msgr2=0x7f6f18142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f180ce0a0 0x7f6f18142ce0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800ecb0 tx=0x7f6f080091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 shutdown_connections 2023-10-06T02:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f18157a20 0x7f6f180c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6efc066f30 0x7f6efc0693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f180afc60 0x7f6f180c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 --2- 172.21.15.81:0/2901454380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f180ce0a0 0x7f6f18142ce0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 >> 172.21.15.81:0/2901454380 conn(0x7f6f18063230 msgr2=0x7f6f1815a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 shutdown_connections 2023-10-06T02:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.422+0000 7f6f1eaec700 1 -- 172.21.15.81:0/2901454380 wait complete. 2023-10-06T02:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-06T02:46:47.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.551+0000 7f1e8f59e700 1 Processor -- start 2023-10-06T02:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.551+0000 7f1e8f59e700 1 -- start start 2023-10-06T02:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.552+0000 7f1e8f59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1e90157a90 0x7f1e900adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.552+0000 7f1e8f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e90157e60 0x7f1e900af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.552+0000 7f1e8f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e900aee30 con 0x7f1e900ad700 2023-10-06T02:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.552+0000 7f1e8f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e900ae260 con 0x7f1e90157e60 2023-10-06T02:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.552+0000 7f1e8f59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e900ae500 con 0x7f1e90157a90 2023-10-06T02:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.552+0000 7f1e8ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e90157e60 0x7f1e900af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.552+0000 7f1e8ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e90157e60 0x7f1e900af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44102/0 (socket says 172.21.15.81:44102) 2023-10-06T02:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.552+0000 7f1e85d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1e900ad700 0x7f1e900b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45628/0 (socket says 172.21.15.81:45628) 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.552+0000 7f1e8ed9d700 1 -- 172.21.15.81:0/1347075641 learned_addr learned my addr 172.21.15.81:0/1347075641 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8e59c700 1 --2- 172.21.15.81:0/1347075641 >> v2:172.21.15.83:3300/0 conn(0x7f1e90157a90 0x7f1e900adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8ed9d700 1 -- 172.21.15.81:0/1347075641 >> v2:172.21.15.83:3300/0 conn(0x7f1e90157a90 msgr2=0x7f1e900adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8ed9d700 1 --2- 172.21.15.81:0/1347075641 >> v2:172.21.15.83:3300/0 conn(0x7f1e90157a90 0x7f1e900adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8ed9d700 1 -- 172.21.15.81:0/1347075641 >> v1:172.21.15.81:6789/0 conn(0x7f1e900ad700 legacy=0x7f1e900b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8dd9b700 1 -- 172.21.15.81:0/1347075641 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482438404 0 0) 0x7f1e900aee30 con 0x7f1e900ad700 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8ed9d700 1 -- 172.21.15.81:0/1347075641 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e900ae7e0 con 0x7f1e90157e60 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8ed9d700 1 --2- 172.21.15.81:0/1347075641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157e60 0x7f1e900af2c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e90071e00 tx=0x7f1e88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f437025ebf87dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8dd9b700 1 -- 172.21.15.81:0/1347075641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800e070 con 0x7f1e90157e60 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8dd9b700 1 -- 172.21.15.81:0/1347075641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8800ba50 con 0x7f1e90157e60 2023-10-06T02:46:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8dd9b700 1 -- 172.21.15.81:0/1347075641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880092e0 con 0x7f1e90157e60 2023-10-06T02:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8f59e700 1 -- 172.21.15.81:0/1347075641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157e60 msgr2=0x7f1e900af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8f59e700 1 --2- 172.21.15.81:0/1347075641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157e60 0x7f1e900af2c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e90071e00 tx=0x7f1e88009840 comp rx=0 tx=0).stop 2023-10-06T02:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8f59e700 1 -- 172.21.15.81:0/1347075641 shutdown_connections 2023-10-06T02:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8f59e700 1 --2- 172.21.15.81:0/1347075641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157e60 0x7f1e900af2c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8f59e700 1 --2- 172.21.15.81:0/1347075641 >> v2:172.21.15.83:3300/0 conn(0x7f1e90157a90 0x7f1e900adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8f59e700 1 -- 172.21.15.81:0/1347075641 >> 172.21.15.81:0/1347075641 conn(0x7f1e900680c0 msgr2=0x7f1e9006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8f59e700 1 -- 172.21.15.81:0/1347075641 shutdown_connections 2023-10-06T02:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.553+0000 7f1e8f59e700 1 -- 172.21.15.81:0/1347075641 wait complete. 2023-10-06T02:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e8f59e700 1 Processor -- start 2023-10-06T02:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e8f59e700 1 -- start start 2023-10-06T02:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e8f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e900ad700 0x7f1e9014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e8f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157a90 0x7f1e9006e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e8f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90157e60 0x7f1e90155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e8f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900cdac0 con 0x7f1e90157a90 2023-10-06T02:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e8f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900ce920 con 0x7f1e90157e60 2023-10-06T02:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e8f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900cedb0 con 0x7f1e900ad700 2023-10-06T02:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e85d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157a90 0x7f1e9006e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e85d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157a90 0x7f1e9006e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44118/0 (socket says 172.21.15.81:44118) 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.555+0000 7f1e85d9b700 1 -- 172.21.15.81:0/869314443 learned_addr learned my addr 172.21.15.81:0/869314443 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e8ed9d700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90157e60 0x7f1e90155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e8e59c700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e900ad700 0x7f1e9014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e85d9b700 1 -- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e900ad700 msgr2=0x7f1e9014d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e85d9b700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e900ad700 0x7f1e9014d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e85d9b700 1 -- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90157e60 msgr2=0x7f1e90155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e85d9b700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90157e60 0x7f1e90155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e85d9b700 1 -- 172.21.15.81:0/869314443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88009ae0 con 0x7f1e90157a90 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e8ed9d700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90157e60 0x7f1e90155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e85d9b700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157a90 0x7f1e9006e270 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800c5b0 tx=0x7f1e78001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e86ffd700 1 -- 172.21.15.81:0/869314443 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78005a70 con 0x7f1e90157a90 2023-10-06T02:46:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e86ffd700 1 -- 172.21.15.81:0/869314443 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e78005bd0 con 0x7f1e90157a90 2023-10-06T02:46:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e900cdd10 con 0x7f1e90157a90 2023-10-06T02:46:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e86ffd700 1 -- 172.21.15.81:0/869314443 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e780070d0 con 0x7f1e90157a90 2023-10-06T02:46:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.556+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e900ce2d0 con 0x7f1e90157a90 2023-10-06T02:46:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.557+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e900cea90 con 0x7f1e90157a90 2023-10-06T02:46:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.557+0000 7f1e86ffd700 1 -- 172.21.15.81:0/869314443 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e78007480 con 0x7f1e90157a90 2023-10-06T02:46:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.558+0000 7f1e86ffd700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e70066f30 0x7f1e700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.558+0000 7f1e86ffd700 1 -- 172.21.15.81:0/869314443 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1e78083bb0 con 0x7f1e90157a90 2023-10-06T02:46:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.558+0000 7f1e8e59c700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e70066f30 0x7f1e700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.558+0000 7f1e8e59c700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e70066f30 0x7f1e700693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e80006fd0 tx=0x7f1e80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.562+0000 7f1e86ffd700 1 -- 172.21.15.81:0/869314443 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e78050cc0 con 0x7f1e90157a90 2023-10-06T02:46:47.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.744+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e9006bc10 con 0x7f1e90157a90 2023-10-06T02:46:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.745+0000 7f1e86ffd700 1 -- 172.21.15.81:0/869314443 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f1e78017020 con 0x7f1e90157a90 2023-10-06T02:46:47.747 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:47.747 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.747+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e70066f30 msgr2=0x7f1e700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.747+0000 7f1e8f59e700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e70066f30 0x7f1e700693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e80006fd0 tx=0x7f1e80008040 comp rx=0 tx=0).stop 2023-10-06T02:46:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.747+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157a90 msgr2=0x7f1e9006e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.747+0000 7f1e8f59e700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157a90 0x7f1e9006e270 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800c5b0 tx=0x7f1e78001040 comp rx=0 tx=0).stop 2023-10-06T02:46:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.748+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 shutdown_connections 2023-10-06T02:46:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.748+0000 7f1e8f59e700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e70066f30 0x7f1e700693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.748+0000 7f1e8f59e700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90157e60 0x7f1e90155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.748+0000 7f1e8f59e700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e900ad700 0x7f1e9014d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.748+0000 7f1e8f59e700 1 --2- 172.21.15.81:0/869314443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90157a90 0x7f1e9006e270 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.748+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 >> 172.21.15.81:0/869314443 conn(0x7f1e900680c0 msgr2=0x7f1e900b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.748+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 shutdown_connections 2023-10-06T02:46:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.748+0000 7f1e8f59e700 1 -- 172.21.15.81:0/869314443 wait complete. 2023-10-06T02:46:47.761 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:46:47.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:46:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.873+0000 7f0e9f1e6700 1 Processor -- start 2023-10-06T02:46:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.873+0000 7f0e9f1e6700 1 -- start start 2023-10-06T02:46:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.874+0000 7f0e9f1e6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0e98157ca0 0x7f0e980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.874+0000 7f0e9f1e6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980d07c0 con 0x7f0e981578d0 2023-10-06T02:46:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.874+0000 7f0e9f1e6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980cfbb0 con 0x7f0e9806d120 2023-10-06T02:46:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.874+0000 7f0e9f1e6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980cfe90 con 0x7f0e98157ca0 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.874+0000 7f0e9cf82700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0e981578d0 0x7f0e9815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45632/0 (socket says 172.21.15.81:45632) 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.874+0000 7f0e9cf82700 1 -- 172.21.15.81:0/5811354 learned_addr learned my addr 172.21.15.81:0/5811354 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.874+0000 7f0e8ffff700 1 --2- 172.21.15.81:0/5811354 >> v2:172.21.15.83:3300/0 conn(0x7f0e98157ca0 0x7f0e980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.874+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167914638 0 0) 0x7f0e980d07c0 con 0x7f0e981578d0 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.874+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e80003570 con 0x7f0e981578d0 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120040425 0 0) 0x7f0e980cfbb0 con 0x7f0e9806d120 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e980d07c0 con 0x7f0e9806d120 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2501855492 0 0) 0x7f0e80003570 con 0x7f0e981578d0 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 >> v2:172.21.15.83:3300/0 conn(0x7f0e98157ca0 msgr2=0x7f0e980cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 --2- 172.21.15.81:0/5811354 >> v2:172.21.15.83:3300/0 conn(0x7f0e98157ca0 0x7f0e980cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 >> v1:172.21.15.83:6789/0 conn(0x7f0e9806d120 legacy=0x7f0e9806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980d0170 con 0x7f0e981578d0 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f0e940017f0 con 0x7f0e981578d0 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 >> v1:172.21.15.81:6789/0 conn(0x7f0e981578d0 legacy=0x7f0e9815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e80003c40 0x7f0e80004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e80004810 0x7f0e80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e80005210 0x7f0e8000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cfe90 con 0x7f0e80005210 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8000c130 con 0x7f0e80004810 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8000c2c0 con 0x7f0e80003c40 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e9d783700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e80005210 0x7f0e8000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e9cf82700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e80003c40 0x7f0e80004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8ffff700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e80004810 0x7f0e80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e9d783700 1 -- 172.21.15.81:0/5811354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e80003c40 msgr2=0x7f0e80004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e9d783700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e80003c40 0x7f0e80004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e9d783700 1 -- 172.21.15.81:0/5811354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e80004810 msgr2=0x7f0e80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e9d783700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e80004810 0x7f0e80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e9d783700 1 -- 172.21.15.81:0/5811354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80003570 con 0x7f0e80005210 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e9d783700 1 -- 172.21.15.81:0/5811354 reap_dead start 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e9d783700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e80005210 0x7f0e8000ba60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0e90001a40 tx=0x7f0e90007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7d937148c22066 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000c590 con 0x7f0e80005210 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000c6f0 con 0x7f0e80005210 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.875+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/5811354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000ca90 con 0x7f0e80005210 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.876+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/5811354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e80005210 msgr2=0x7f0e8000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.876+0000 7f0e9f1e6700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e80005210 0x7f0e8000ba60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0e90001a40 tx=0x7f0e90007d30 comp rx=0 tx=0).stop 2023-10-06T02:46:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.876+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/5811354 shutdown_connections 2023-10-06T02:46:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.876+0000 7f0e9f1e6700 1 --2- 172.21.15.81:0/5811354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e80005210 0x7f0e8000ba60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.876+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/5811354 >> 172.21.15.81:0/5811354 conn(0x7f0e9806bb90 msgr2=0x7f0e9806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.876+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/5811354 shutdown_connections 2023-10-06T02:46:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.876+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/5811354 wait complete. 2023-10-06T02:46:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.877+0000 7f0e9f1e6700 1 Processor -- start 2023-10-06T02:46:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.877+0000 7f0e9f1e6700 1 -- start start 2023-10-06T02:46:47.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e9f1e6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e80005210 0x7f0e980c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e9f1e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e980c9510 0x7f0e980ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e9f1e6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e9814ba90 0x7f0e980c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e9f1e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cba50 con 0x7f0e980c9510 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e9f1e6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980c8b40 con 0x7f0e9814ba90 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e9f1e6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cd7d0 con 0x7f0e80005210 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e8ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e980c9510 0x7f0e980ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e8ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e980c9510 0x7f0e980ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44128/0 (socket says 172.21.15.81:44128) 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e8ffff700 1 -- 172.21.15.81:0/978192068 learned_addr learned my addr 172.21.15.81:0/978192068 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e9d783700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e9814ba90 0x7f0e980c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e9cf82700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e80005210 0x7f0e980c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e8ffff700 1 -- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e80005210 msgr2=0x7f0e980c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e8ffff700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e80005210 0x7f0e980c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e8ffff700 1 -- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e9814ba90 msgr2=0x7f0e980c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e8ffff700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e9814ba90 0x7f0e980c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.878+0000 7f0e8ffff700 1 -- 172.21.15.81:0/978192068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980c8210 con 0x7f0e980c9510 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.879+0000 7f0e8ffff700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e980c9510 0x7f0e980ccce0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009fd0 tx=0x7f0e880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.879+0000 7f0e8cff9700 1 -- 172.21.15.81:0/978192068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8800f730 con 0x7f0e980c9510 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.879+0000 7f0e8cff9700 1 -- 172.21.15.81:0/978192068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8800f890 con 0x7f0e980c9510 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.879+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e980c84f0 con 0x7f0e980c9510 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.879+0000 7f0e8cff9700 1 -- 172.21.15.81:0/978192068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8800fc10 con 0x7f0e980c9510 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.879+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e980c7ab0 con 0x7f0e980c9510 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.880+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e98067ac0 con 0x7f0e980c9510 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.880+0000 7f0e8cff9700 1 -- 172.21.15.81:0/978192068 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e88014440 con 0x7f0e980c9510 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.880+0000 7f0e8cff9700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e84066f30 0x7f0e840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.881+0000 7f0e8cff9700 1 -- 172.21.15.81:0/978192068 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e88018030 con 0x7f0e980c9510 2023-10-06T02:46:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.881+0000 7f0e9cf82700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e84066f30 0x7f0e840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.881+0000 7f0e9cf82700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e84066f30 0x7f0e840693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e940021b0 tx=0x7f0e94006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:47.885+0000 7f0e8cff9700 1 -- 172.21.15.81:0/978192068 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e88055a80 con 0x7f0e980c9510 2023-10-06T02:46:48.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.113+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e980c8c80 con 0x7f0e980c9510 2023-10-06T02:46:48.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.113+0000 7f0e8cff9700 1 -- 172.21.15.81:0/978192068 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f0e88022090 con 0x7f0e980c9510 2023-10-06T02:46:48.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:48.115 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/963539092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":963539092},{"type":"v1","addr":"172.21.15.81:6833","nonce":963539092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3218202678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3218202678},{"type":"v1","addr":"172.21.15.81:6835","nonce":3218202678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/913779656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":913779656},{"type":"v1","addr":"172.21.15.83:6836","nonce":913779656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:06.874539+0000","modified":"2023-10-06T02:46:10.523436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/2378748577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2378748577},{"type":"v1","addr":"172.21.15.83:6837","nonce":2378748577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:46:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.115+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e84066f30 msgr2=0x7f0e840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.115+0000 7f0e9f1e6700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e84066f30 0x7f0e840693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e940021b0 tx=0x7f0e94006040 comp rx=0 tx=0).stop 2023-10-06T02:46:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.115+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e980c9510 msgr2=0x7f0e980ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.115+0000 7f0e9f1e6700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e980c9510 0x7f0e980ccce0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009fd0 tx=0x7f0e880091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.115+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 shutdown_connections 2023-10-06T02:46:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.115+0000 7f0e9f1e6700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e84066f30 0x7f0e840693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.115+0000 7f0e9f1e6700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e9814ba90 0x7f0e980c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.116+0000 7f0e9f1e6700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e80005210 0x7f0e980c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.116+0000 7f0e9f1e6700 1 --2- 172.21.15.81:0/978192068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e980c9510 0x7f0e980ccce0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.116+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 >> 172.21.15.81:0/978192068 conn(0x7f0e9806bb90 msgr2=0x7f0e9815a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.116+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 shutdown_connections 2023-10-06T02:46:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.116+0000 7f0e9f1e6700 1 -- 172.21.15.81:0/978192068 wait complete. 2023-10-06T02:46:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-06T02:46:48.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:46:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.241+0000 7f4f62783700 1 Processor -- start 2023-10-06T02:46:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.241+0000 7f4f62783700 1 -- start start 2023-10-06T02:46:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f62783700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4f5c1578d0 0x7f4f5c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f62783700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 0x7f4f5c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f62783700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f5c06d120 0x7f4f5c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f62783700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c06dac0 con 0x7f4f5c06d120 2023-10-06T02:46:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f62783700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c0d07c0 con 0x7f4f5c1578d0 2023-10-06T02:46:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f62783700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0cfbb0 con 0x7f4f5c157ca0 2023-10-06T02:46:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f60d20700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f5c06d120 0x7f4f5c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f60d20700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f5c06d120 0x7f4f5c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44142/0 (socket says 172.21.15.81:44142) 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f60d20700 1 -- 172.21.15.81:0/2973437463 learned_addr learned my addr 172.21.15.81:0/2973437463 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f5b7fe700 1 --2- 172.21.15.81:0/2973437463 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 0x7f4f5c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f5bfff700 1 --2- 172.21.15.81:0/2973437463 >> v2:172.21.15.83:3300/0 conn(0x7f4f5c1578d0 0x7f4f5c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.242+0000 7f4f60d20700 1 -- 172.21.15.81:0/2973437463 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 msgr2=0x7f4f5c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f60d20700 1 --2- 172.21.15.81:0/2973437463 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 0x7f4f5c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f60d20700 1 -- 172.21.15.81:0/2973437463 >> v2:172.21.15.83:3300/0 conn(0x7f4f5c1578d0 msgr2=0x7f4f5c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f60d20700 1 --2- 172.21.15.81:0/2973437463 >> v2:172.21.15.83:3300/0 conn(0x7f4f5c1578d0 0x7f4f5c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f60d20700 1 -- 172.21.15.81:0/2973437463 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0cfe90 con 0x7f4f5c06d120 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f5bfff700 1 --2- 172.21.15.81:0/2973437463 >> v2:172.21.15.83:3300/0 conn(0x7f4f5c1578d0 0x7f4f5c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f60d20700 1 --2- 172.21.15.81:0/2973437463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 0x7f4f5c06d580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0646b0 tx=0x7f4f54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5d213678f0629 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f5affd700 1 -- 172.21.15.81:0/2973437463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5400e070 con 0x7f4f5c06d120 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f5affd700 1 -- 172.21.15.81:0/2973437463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5400ba50 con 0x7f4f5c06d120 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f5affd700 1 -- 172.21.15.81:0/2973437463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540092e0 con 0x7f4f5c06d120 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f62783700 1 -- 172.21.15.81:0/2973437463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 msgr2=0x7f4f5c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f62783700 1 --2- 172.21.15.81:0/2973437463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 0x7f4f5c06d580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0646b0 tx=0x7f4f54009840 comp rx=0 tx=0).stop 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f62783700 1 -- 172.21.15.81:0/2973437463 shutdown_connections 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f62783700 1 --2- 172.21.15.81:0/2973437463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 0x7f4f5c06d580 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f62783700 1 --2- 172.21.15.81:0/2973437463 >> v2:172.21.15.83:3300/0 conn(0x7f4f5c1578d0 0x7f4f5c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f62783700 1 --2- 172.21.15.81:0/2973437463 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 0x7f4f5c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f62783700 1 -- 172.21.15.81:0/2973437463 >> 172.21.15.81:0/2973437463 conn(0x7f4f5c06bb90 msgr2=0x7f4f5c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f62783700 1 -- 172.21.15.81:0/2973437463 shutdown_connections 2023-10-06T02:46:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.243+0000 7f4f62783700 1 -- 172.21.15.81:0/2973437463 wait complete. 2023-10-06T02:46:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.244+0000 7f4f62783700 1 Processor -- start 2023-10-06T02:46:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f62783700 1 -- start start 2023-10-06T02:46:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f62783700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 0x7f4f5c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f62783700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f5c1578d0 0x7f4f5c16e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f62783700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 0x7f4f5c13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f62783700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c155a70 con 0x7f4f5c06d120 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f62783700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c140400 con 0x7f4f5c1578d0 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f62783700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0b4160 con 0x7f4f5c157ca0 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f5bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 0x7f4f5c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f5bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 0x7f4f5c155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44150/0 (socket says 172.21.15.81:44150) 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f5bfff700 1 -- 172.21.15.81:0/1112871638 learned_addr learned my addr 172.21.15.81:0/1112871638 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f5b7fe700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f5c1578d0 0x7f4f5c16e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.245+0000 7f4f60d20700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 0x7f4f5c13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f5bfff700 1 -- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 msgr2=0x7f4f5c13fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f5bfff700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 0x7f4f5c13fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f5bfff700 1 -- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f5c1578d0 msgr2=0x7f4f5c16e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f5bfff700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f5c1578d0 0x7f4f5c16e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f5bfff700 1 -- 172.21.15.81:0/1112871638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f54009ae0 con 0x7f4f5c06d120 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f5bfff700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 0x7f4f5c155f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e8d0 tx=0x7f4f4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f43fff700 1 -- 172.21.15.81:0/1112871638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c013410 con 0x7f4f5c06d120 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f43fff700 1 -- 172.21.15.81:0/1112871638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c013570 con 0x7f4f5c06d120 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f43fff700 1 -- 172.21.15.81:0/1112871638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c013910 con 0x7f4f5c06d120 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c155140 con 0x7f4f5c06d120 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.246+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c155700 con 0x7f4f5c06d120 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.247+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c155d50 con 0x7f4f5c06d120 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.247+0000 7f4f43fff700 1 -- 172.21.15.81:0/1112871638 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f4c013d40 con 0x7f4f5c06d120 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.248+0000 7f4f43fff700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f48066f30 0x7f4f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.248+0000 7f4f43fff700 1 -- 172.21.15.81:0/1112871638 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f4c084390 con 0x7f4f5c06d120 2023-10-06T02:46:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.248+0000 7f4f5b7fe700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f48066f30 0x7f4f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.248+0000 7f4f5b7fe700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f48066f30 0x7f4f480693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c06a2b0 tx=0x7f4f50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.252+0000 7f4f43fff700 1 -- 172.21.15.81:0/1112871638 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f4c0514a0 con 0x7f4f5c06d120 2023-10-06T02:46:48.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.479+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f5c0d0170 con 0x7f4f5c06d120 2023-10-06T02:46:48.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.479+0000 7f4f43fff700 1 -- 172.21.15.81:0/1112871638 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f4f4c054ac0 con 0x7f4f5c06d120 2023-10-06T02:46:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:48.481 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/963539092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":963539092},{"type":"v1","addr":"172.21.15.81:6833","nonce":963539092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3218202678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3218202678},{"type":"v1","addr":"172.21.15.81:6835","nonce":3218202678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/913779656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":913779656},{"type":"v1","addr":"172.21.15.83:6836","nonce":913779656}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:06.874539+0000","modified":"2023-10-06T02:46:10.523436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/2378748577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2378748577},{"type":"v1","addr":"172.21.15.83:6837","nonce":2378748577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:46:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f48066f30 msgr2=0x7f4f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f48066f30 0x7f4f480693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c06a2b0 tx=0x7f4f50008040 comp rx=0 tx=0).stop 2023-10-06T02:46:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 msgr2=0x7f4f5c155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 0x7f4f5c155f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e8d0 tx=0x7f4f4c008040 comp rx=0 tx=0).stop 2023-10-06T02:46:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 shutdown_connections 2023-10-06T02:46:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f5c157ca0 0x7f4f5c13fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c06d120 0x7f4f5c155f00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f48066f30 0x7f4f480693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 --2- 172.21.15.81:0/1112871638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f5c1578d0 0x7f4f5c16e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 >> 172.21.15.81:0/1112871638 conn(0x7f4f5c06bb90 msgr2=0x7f4f5c06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 shutdown_connections 2023-10-06T02:46:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.482+0000 7f4f62783700 1 -- 172.21.15.81:0/1112871638 wait complete. 2023-10-06T02:46:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-06T02:46:48.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:48.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.608+0000 7fe82f59e700 1 Processor -- start 2023-10-06T02:46:48.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.608+0000 7fe82f59e700 1 -- start start 2023-10-06T02:46:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82f59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe830157860 0x7fe83006dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe83006a020 0x7fe83015a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82f59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8300cbec0 con 0x7fe8300cdb60 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8300cb9d0 con 0x7fe83006a020 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82f59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83015b2d0 con 0x7fe830157860 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe83006a020 0x7fe83015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe83006a020 0x7fe83015a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44162/0 (socket says 172.21.15.81:44162) 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82dd9b700 1 -- 172.21.15.81:0/2497501378 learned_addr learned my addr 172.21.15.81:0/2497501378 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82e59c700 1 --2- 172.21.15.81:0/2497501378 >> v2:172.21.15.83:3300/0 conn(0x7fe830157860 0x7fe83006dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82dd9b700 1 -- 172.21.15.81:0/2497501378 >> v2:172.21.15.83:3300/0 conn(0x7fe830157860 msgr2=0x7fe83006dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82dd9b700 1 --2- 172.21.15.81:0/2497501378 >> v2:172.21.15.83:3300/0 conn(0x7fe830157860 0x7fe83006dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82dd9b700 1 -- 172.21.15.81:0/2497501378 >> v1:172.21.15.83:6789/0 conn(0x7fe8300cdb60 legacy=0x7fe8300cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.609+0000 7fe82dd9b700 1 -- 172.21.15.81:0/2497501378 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8300cc180 con 0x7fe83006a020 2023-10-06T02:46:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82dd9b700 1 --2- 172.21.15.81:0/2497501378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe83006a020 0x7fe83015a300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe830068620 tx=0x7fe818009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b1903d60258209 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82d59a700 1 -- 172.21.15.81:0/2497501378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818009ea0 con 0x7fe83006a020 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82d59a700 1 -- 172.21.15.81:0/2497501378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81800b820 con 0x7fe83006a020 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82d59a700 1 -- 172.21.15.81:0/2497501378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800bbc0 con 0x7fe83006a020 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82f59e700 1 -- 172.21.15.81:0/2497501378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe83006a020 msgr2=0x7fe83015a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82f59e700 1 --2- 172.21.15.81:0/2497501378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe83006a020 0x7fe83015a300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe830068620 tx=0x7fe818009250 comp rx=0 tx=0).stop 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82f59e700 1 -- 172.21.15.81:0/2497501378 shutdown_connections 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82f59e700 1 --2- 172.21.15.81:0/2497501378 >> v2:172.21.15.83:3300/0 conn(0x7fe830157860 0x7fe83006dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82f59e700 1 --2- 172.21.15.81:0/2497501378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe83006a020 0x7fe83015a300 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82f59e700 1 -- 172.21.15.81:0/2497501378 >> 172.21.15.81:0/2497501378 conn(0x7fe830063230 msgr2=0x7fe830063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82f59e700 1 -- 172.21.15.81:0/2497501378 shutdown_connections 2023-10-06T02:46:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.610+0000 7fe82f59e700 1 -- 172.21.15.81:0/2497501378 wait complete. 2023-10-06T02:46:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.611+0000 7fe82f59e700 1 Processor -- start 2023-10-06T02:46:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.611+0000 7fe82f59e700 1 -- start start 2023-10-06T02:46:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe83006a020 0x7fe830151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8300cdb60 0x7fe8300c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe830157860 0x7fe830156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830154e90 con 0x7fe8300cdb60 2023-10-06T02:46:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830151dc0 con 0x7fe830157860 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe830155c90 con 0x7fe83006a020 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8300cdb60 0x7fe8300c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8300cdb60 0x7fe8300c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44178/0 (socket says 172.21.15.81:44178) 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82dd9b700 1 -- 172.21.15.81:0/154940167 learned_addr learned my addr 172.21.15.81:0/154940167 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82ed9d700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe830157860 0x7fe830156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.612+0000 7fe82e59c700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe83006a020 0x7fe830151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe82dd9b700 1 -- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe83006a020 msgr2=0x7fe830151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe82dd9b700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe83006a020 0x7fe830151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe82dd9b700 1 -- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe830157860 msgr2=0x7fe830156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe82dd9b700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe830157860 0x7fe830156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe82dd9b700 1 -- 172.21.15.81:0/154940167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180094f0 con 0x7fe8300cdb60 2023-10-06T02:46:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe82dd9b700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8300cdb60 0x7fe8300c7bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe8180094c0 tx=0x7fe818017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe8267fc700 1 -- 172.21.15.81:0/154940167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818000d10 con 0x7fe8300cdb60 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe8267fc700 1 -- 172.21.15.81:0/154940167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81800bba0 con 0x7fe8300cdb60 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8300b01d0 con 0x7fe8300cdb60 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe8267fc700 1 -- 172.21.15.81:0/154940167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818011690 con 0x7fe8300cdb60 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.613+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe830155360 con 0x7fe8300cdb60 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.614+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8300690d0 con 0x7fe8300cdb60 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.614+0000 7fe8267fc700 1 -- 172.21.15.81:0/154940167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe818011a80 con 0x7fe8300cdb60 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.614+0000 7fe8267fc700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe810066f30 0x7fe8100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.615+0000 7fe8267fc700 1 -- 172.21.15.81:0/154940167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe818085ed0 con 0x7fe8300cdb60 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.615+0000 7fe82e59c700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe810066f30 0x7fe8100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.615+0000 7fe82e59c700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe810066f30 0x7fe8100693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe828009d10 tx=0x7fe8280091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.619+0000 7fe8267fc700 1 -- 172.21.15.81:0/154940167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe818052fe0 con 0x7fe8300cdb60 2023-10-06T02:46:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.801+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe830155dd0 con 0x7fe8300cdb60 2023-10-06T02:46:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.802+0000 7fe8267fc700 1 -- 172.21.15.81:0/154940167 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fe818015090 con 0x7fe8300cdb60 2023-10-06T02:46:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:48.803 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:08.494751+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:05.360665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:05.837671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.803+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe810066f30 msgr2=0x7fe8100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.803+0000 7fe82f59e700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe810066f30 0x7fe8100693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe828009d10 tx=0x7fe8280091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.803+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8300cdb60 msgr2=0x7fe8300c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.803+0000 7fe82f59e700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8300cdb60 0x7fe8300c7bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe8180094c0 tx=0x7fe818017000 comp rx=0 tx=0).stop 2023-10-06T02:46:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.803+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 shutdown_connections 2023-10-06T02:46:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.803+0000 7fe82f59e700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe810066f30 0x7fe8100693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.804+0000 7fe82f59e700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe830157860 0x7fe830156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.804+0000 7fe82f59e700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe83006a020 0x7fe830151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.804+0000 7fe82f59e700 1 --2- 172.21.15.81:0/154940167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8300cdb60 0x7fe8300c7bb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.804+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 >> 172.21.15.81:0/154940167 conn(0x7fe830063230 msgr2=0x7fe83006e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.804+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 shutdown_connections 2023-10-06T02:46:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.804+0000 7fe82f59e700 1 -- 172.21.15.81:0/154940167 wait complete. 2023-10-06T02:46:48.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:46:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.930+0000 7fa711807700 1 Processor -- start 2023-10-06T02:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.930+0000 7fa711807700 1 -- start start 2023-10-06T02:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa711807700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa70c159b40 0x7fa70c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa711807700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c068e90 0x7fa70c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa711807700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70c0cee10 con 0x7fa70c159f10 2023-10-06T02:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa711807700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70c0cd040 con 0x7fa70c159b40 2023-10-06T02:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa711807700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0cd320 con 0x7fa70c068e90 2023-10-06T02:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa70bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa70c159f10 0x7fa70c068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45646/0 (socket says 172.21.15.81:45646) 2023-10-06T02:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa70bfff700 1 -- 172.21.15.81:0/2351732355 learned_addr learned my addr 172.21.15.81:0/2351732355 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa710805700 1 --2- 172.21.15.81:0/2351732355 >> v2:172.21.15.83:3300/0 conn(0x7fa70c159b40 0x7fa70c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa711006700 1 --2- 172.21.15.81:0/2351732355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c068e90 0x7fa70c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa70b7fe700 1 -- 172.21.15.81:0/2351732355 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925326361 0 0) 0x7fa70c0cee10 con 0x7fa70c159f10 2023-10-06T02:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa70b7fe700 1 -- 172.21.15.81:0/2351732355 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f8003570 con 0x7fa70c159f10 2023-10-06T02:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa710805700 1 -- 172.21.15.81:0/2351732355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c068e90 msgr2=0x7fa70c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa710805700 1 --2- 172.21.15.81:0/2351732355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c068e90 0x7fa70c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa710805700 1 -- 172.21.15.81:0/2351732355 >> v1:172.21.15.81:6789/0 conn(0x7fa70c159f10 legacy=0x7fa70c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa710805700 1 -- 172.21.15.81:0/2351732355 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c0ce7c0 con 0x7fa70c159b40 2023-10-06T02:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa711006700 1 --2- 172.21.15.81:0/2351732355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c068e90 0x7fa70c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.931+0000 7fa710805700 1 --2- 172.21.15.81:0/2351732355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa70c159b40 0x7fa70c0cc600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa704009e60 tx=0x7fa704009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c4e0a553dd92c50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa70b7fe700 1 -- 172.21.15.81:0/2351732355 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70400e070 con 0x7fa70c159b40 2023-10-06T02:46:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa70b7fe700 1 -- 172.21.15.81:0/2351732355 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70400bab0 con 0x7fa70c159b40 2023-10-06T02:46:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa70b7fe700 1 -- 172.21.15.81:0/2351732355 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70400be70 con 0x7fa70c159b40 2023-10-06T02:46:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa711807700 1 -- 172.21.15.81:0/2351732355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa70c159b40 msgr2=0x7fa70c0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa711807700 1 --2- 172.21.15.81:0/2351732355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa70c159b40 0x7fa70c0cc600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa704009e60 tx=0x7fa704009780 comp rx=0 tx=0).stop 2023-10-06T02:46:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa711807700 1 -- 172.21.15.81:0/2351732355 shutdown_connections 2023-10-06T02:46:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa711807700 1 --2- 172.21.15.81:0/2351732355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c068e90 0x7fa70c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa711807700 1 --2- 172.21.15.81:0/2351732355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa70c159b40 0x7fa70c0cc600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa711807700 1 -- 172.21.15.81:0/2351732355 >> 172.21.15.81:0/2351732355 conn(0x7fa70c0cd660 msgr2=0x7fa70c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa711807700 1 -- 172.21.15.81:0/2351732355 shutdown_connections 2023-10-06T02:46:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.932+0000 7fa711807700 1 -- 172.21.15.81:0/2351732355 wait complete. 2023-10-06T02:46:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.933+0000 7fa711807700 1 Processor -- start 2023-10-06T02:46:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa711807700 1 -- start start 2023-10-06T02:46:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa711807700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c068e90 0x7fa70c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa711807700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c159b40 0x7fa70c16dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa711807700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa70c159f10 0x7fa70c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa711807700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c15b350 con 0x7fa70c068e90 2023-10-06T02:46:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa711807700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c15a740 con 0x7fa70c159f10 2023-10-06T02:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa711807700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c15aa20 con 0x7fa70c159b40 2023-10-06T02:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa710805700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c068e90 0x7fa70c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa710805700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c068e90 0x7fa70c15b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44184/0 (socket says 172.21.15.81:44184) 2023-10-06T02:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.934+0000 7fa710805700 1 -- 172.21.15.81:0/510638869 learned_addr learned my addr 172.21.15.81:0/510638869 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa710805700 1 -- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c159b40 msgr2=0x7fa70c16dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa710805700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c159b40 0x7fa70c16dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa711006700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa70c159f10 0x7fa70c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa710805700 1 -- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa70c159f10 msgr2=0x7fa70c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa710805700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa70c159f10 0x7fa70c15ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa710805700 1 -- 172.21.15.81:0/510638869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4009420 con 0x7fa70c068e90 2023-10-06T02:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa710805700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c068e90 0x7fa70c15b7e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097c0 tx=0x7fa704019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa708ff9700 1 -- 172.21.15.81:0/510638869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704012d00 con 0x7fa70c068e90 2023-10-06T02:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa708ff9700 1 -- 172.21.15.81:0/510638869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa704012e80 con 0x7fa70c068e90 2023-10-06T02:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa704009a20 con 0x7fa70c068e90 2023-10-06T02:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa708ff9700 1 -- 172.21.15.81:0/510638869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7040276c0 con 0x7fa70c068e90 2023-10-06T02:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.935+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c15afe0 con 0x7fa70c068e90 2023-10-06T02:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.936+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c0cb910 con 0x7fa70c068e90 2023-10-06T02:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.936+0000 7fa708ff9700 1 -- 172.21.15.81:0/510638869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa704024070 con 0x7fa70c068e90 2023-10-06T02:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.936+0000 7fa708ff9700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6ec066f30 0x7fa6ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.937+0000 7fa708ff9700 1 -- 172.21.15.81:0/510638869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa704086c80 con 0x7fa70c068e90 2023-10-06T02:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.937+0000 7fa70bfff700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6ec066f30 0x7fa6ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.937+0000 7fa70bfff700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6ec066f30 0x7fa6ec0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0058d0 tx=0x7fa6fc0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:48.941+0000 7fa708ff9700 1 -- 172.21.15.81:0/510638869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa704053d90 con 0x7fa70c068e90 2023-10-06T02:46:49.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.166+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa70c0ceaa0 con 0x7fa70c068e90 2023-10-06T02:46:49.168 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:46:49.167+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:46:49.172 INFO:tasks.ceph.mds.d.smithi083.stderr: -3073> 2023-10-06T02:46:02.476+0000 7ff92e100700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T02:46:49.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.173+0000 7fa708ff9700 1 -- 172.21.15.81:0/510638869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa70402c090 con 0x7fa70c068e90 2023-10-06T02:46:49.175 INFO:tasks.ceph.mds.d.smithi083.stderr: -1882> 2023-10-06T02:46:13.491+0000 7ff9280f4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:46:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6ec066f30 msgr2=0x7fa6ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6ec066f30 0x7fa6ec0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0058d0 tx=0x7fa6fc0079d0 comp rx=0 tx=0).stop 2023-10-06T02:46:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c068e90 msgr2=0x7fa70c15b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c068e90 0x7fa70c15b7e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097c0 tx=0x7fa704019000 comp rx=0 tx=0).stop 2023-10-06T02:46:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 shutdown_connections 2023-10-06T02:46:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6ec066f30 0x7fa6ec0693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa70c159f10 0x7fa70c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c068e90 0x7fa70c15b7e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 --2- 172.21.15.81:0/510638869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa70c159b40 0x7fa70c16dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 >> 172.21.15.81:0/510638869 conn(0x7fa70c0cd660 msgr2=0x7fa70c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 shutdown_connections 2023-10-06T02:46:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.175+0000 7fa711807700 1 -- 172.21.15.81:0/510638869 wait complete. 2023-10-06T02:46:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:46:49.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:46:49.201 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:46:49.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.304+0000 7fc007126700 1 Processor -- start 2023-10-06T02:46:49.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.304+0000 7fc007126700 1 -- start start 2023-10-06T02:46:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fc007126700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc00006d830 0x7fc0000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fc007126700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0000d07c0 con 0x7fc000157ca0 2023-10-06T02:46:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fc007126700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0000cfbb0 con 0x7fc0001578d0 2023-10-06T02:46:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fc007126700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000cfe90 con 0x7fc00006d830 2023-10-06T02:46:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fbff7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc000157ca0 0x7fc00006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45652/0 (socket says 172.21.15.81:45652) 2023-10-06T02:46:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fbff7fff700 1 -- 172.21.15.81:0/3998177260 learned_addr learned my addr 172.21.15.81:0/3998177260 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fc0056c3700 1 --2- 172.21.15.81:0/3998177260 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc00006d830 0x7fc0000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fbff77fe700 1 -- 172.21.15.81:0/3998177260 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897129578 0 0) 0x7fc0000d07c0 con 0x7fc000157ca0 2023-10-06T02:46:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fbff77fe700 1 -- 172.21.15.81:0/3998177260 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe8003570 con 0x7fc000157ca0 2023-10-06T02:46:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fbff77fe700 1 -- 172.21.15.81:0/3998177260 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913462370 0 0) 0x7fc0000cfbb0 con 0x7fc0001578d0 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fbff77fe700 1 -- 172.21.15.81:0/3998177260 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0000d07c0 con 0x7fc0001578d0 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fc0056c3700 1 -- 172.21.15.81:0/3998177260 >> v1:172.21.15.83:6789/0 conn(0x7fc0001578d0 legacy=0x7fc00015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fc0056c3700 1 -- 172.21.15.81:0/3998177260 >> v1:172.21.15.81:6789/0 conn(0x7fc000157ca0 legacy=0x7fc00006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fc0056c3700 1 -- 172.21.15.81:0/3998177260 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000d0170 con 0x7fc00006d830 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.305+0000 7fc0056c3700 1 --2- 172.21.15.81:0/3998177260 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc00006d830 0x7fc0000cf4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009910 tx=0x7fbff80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8cbfe664e28c7e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fbff77fe700 1 -- 172.21.15.81:0/3998177260 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8011630 con 0x7fc00006d830 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fbff77fe700 1 -- 172.21.15.81:0/3998177260 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8011790 con 0x7fc00006d830 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fbff77fe700 1 -- 172.21.15.81:0/3998177260 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8011b30 con 0x7fc00006d830 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fc007126700 1 -- 172.21.15.81:0/3998177260 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc00006d830 msgr2=0x7fc0000cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fc007126700 1 --2- 172.21.15.81:0/3998177260 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc00006d830 0x7fc0000cf4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009910 tx=0x7fbff80091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fc007126700 1 -- 172.21.15.81:0/3998177260 shutdown_connections 2023-10-06T02:46:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fc007126700 1 --2- 172.21.15.81:0/3998177260 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc00006d830 0x7fc0000cf4f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fc007126700 1 -- 172.21.15.81:0/3998177260 >> 172.21.15.81:0/3998177260 conn(0x7fc00006bb90 msgr2=0x7fc00006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fc007126700 1 -- 172.21.15.81:0/3998177260 shutdown_connections 2023-10-06T02:46:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.306+0000 7fc007126700 1 -- 172.21.15.81:0/3998177260 wait complete. 2023-10-06T02:46:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.307+0000 7fc007126700 1 Processor -- start 2023-10-06T02:46:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.307+0000 7fc007126700 1 -- start start 2023-10-06T02:46:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc007126700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00006d830 0x7fc0001590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc007126700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0001578d0 0x7fc0000acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc007126700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc000157ca0 0x7fc00016a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc007126700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000ae160 con 0x7fc00006d830 2023-10-06T02:46:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc007126700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00016b840 con 0x7fc0001578d0 2023-10-06T02:46:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc007126700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000ad300 con 0x7fc000157ca0 2023-10-06T02:46:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc004ec2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00006d830 0x7fc0001590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc004ec2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00006d830 0x7fc0001590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44198/0 (socket says 172.21.15.81:44198) 2023-10-06T02:46:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc004ec2700 1 -- 172.21.15.81:0/909452002 learned_addr learned my addr 172.21.15.81:0/909452002 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fbff7fff700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0001578d0 0x7fc0000acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.308+0000 7fc0056c3700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc000157ca0 0x7fc00016a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fc004ec2700 1 -- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc000157ca0 msgr2=0x7fc00016a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fc004ec2700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc000157ca0 0x7fc00016a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fc004ec2700 1 -- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0001578d0 msgr2=0x7fc0000acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fc004ec2700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0001578d0 0x7fc0000acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fc004ec2700 1 -- 172.21.15.81:0/909452002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8009420 con 0x7fc00006d830 2023-10-06T02:46:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fc0056c3700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc000157ca0 0x7fc00016a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fc004ec2700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00006d830 0x7fc0001590c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00cb70 tx=0x7fbffc002810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fbff4ff9700 1 -- 172.21.15.81:0/909452002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00a7a0 con 0x7fc00006d830 2023-10-06T02:46:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fbff4ff9700 1 -- 172.21.15.81:0/909452002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc00a920 con 0x7fc00006d830 2023-10-06T02:46:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0000b68c0 con 0x7fc00006d830 2023-10-06T02:46:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fbff4ff9700 1 -- 172.21.15.81:0/909452002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00ace0 con 0x7fc00006d830 2023-10-06T02:46:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.309+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0000ae630 con 0x7fc00006d830 2023-10-06T02:46:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.310+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc000067ac0 con 0x7fc00006d830 2023-10-06T02:46:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.310+0000 7fbff4ff9700 1 -- 172.21.15.81:0/909452002 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbffc012630 con 0x7fc00006d830 2023-10-06T02:46:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.311+0000 7fbff4ff9700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbfec066f30 0x7fbfec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.311+0000 7fbff4ff9700 1 -- 172.21.15.81:0/909452002 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fbffc084b00 con 0x7fc00006d830 2023-10-06T02:46:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.311+0000 7fbff7fff700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbfec066f30 0x7fbfec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.311+0000 7fbff7fff700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbfec066f30 0x7fbfec0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0000b6500 tx=0x7fbff0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.315+0000 7fbff4ff9700 1 -- 172.21.15.81:0/909452002 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbffc051bc0 con 0x7fc00006d830 2023-10-06T02:46:49.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:49.543+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc0000d0450 con 0x7fc00006d830 2023-10-06T02:46:50.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.171+0000 7fbff4ff9700 1 -- 172.21.15.81:0/909452002 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbffc0551e0 con 0x7fc00006d830 2023-10-06T02:46:50.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbfec066f30 msgr2=0x7fbfec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:50.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbfec066f30 0x7fbfec0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0000b6500 tx=0x7fbff0009040 comp rx=0 tx=0).stop 2023-10-06T02:46:50.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00006d830 msgr2=0x7fc0001590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:50.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00006d830 0x7fc0001590c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00cb70 tx=0x7fbffc002810 comp rx=0 tx=0).stop 2023-10-06T02:46:50.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 shutdown_connections 2023-10-06T02:46:50.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc000157ca0 0x7fc00016a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00006d830 0x7fc0001590c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbfec066f30 0x7fbfec0693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 --2- 172.21.15.81:0/909452002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0001578d0 0x7fc0000acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 >> 172.21.15.81:0/909452002 conn(0x7fc00006bb90 msgr2=0x7fc00015c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 shutdown_connections 2023-10-06T02:46:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.174+0000 7fc007126700 1 -- 172.21.15.81:0/909452002 wait complete. 2023-10-06T02:46:50.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:46:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.305+0000 7fed67597700 1 Processor -- start 2023-10-06T02:46:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.305+0000 7fed67597700 1 -- start start 2023-10-06T02:46:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.306+0000 7fed67597700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fed601578d0 0x7fed600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.306+0000 7fed67597700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed6006d120 0x7fed6006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.306+0000 7fed67597700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed600d07c0 con 0x7fed60157ca0 2023-10-06T02:46:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.306+0000 7fed67597700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6006daa0 con 0x7fed601578d0 2023-10-06T02:46:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.306+0000 7fed67597700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600cfbb0 con 0x7fed6006d120 2023-10-06T02:46:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.306+0000 7fed64b32700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fed60157ca0 0x7fed6015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45668/0 (socket says 172.21.15.81:45668) 2023-10-06T02:46:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.306+0000 7fed64b32700 1 -- 172.21.15.81:0/3398638579 learned_addr learned my addr 172.21.15.81:0/3398638579 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed65b34700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed6006d120 0x7fed6006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed65333700 1 --2- 172.21.15.81:0/3398638579 >> v2:172.21.15.83:3300/0 conn(0x7fed601578d0 0x7fed600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563100842 0 0) 0x7fed600d07c0 con 0x7fed60157ca0 2023-10-06T02:46:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed4c003570 con 0x7fed60157ca0 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 417316729 0 0) 0x7fed4c003570 con 0x7fed60157ca0 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed6006d120 msgr2=0x7fed6006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed6006d120 0x7fed6006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 >> v2:172.21.15.83:3300/0 conn(0x7fed601578d0 msgr2=0x7fed600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 --2- 172.21.15.81:0/3398638579 >> v2:172.21.15.83:3300/0 conn(0x7fed601578d0 0x7fed600cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600cfe90 con 0x7fed60157ca0 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fed50001470 con 0x7fed60157ca0 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 >> v1:172.21.15.81:6789/0 conn(0x7fed60157ca0 legacy=0x7fed6015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4c004810 0x7fed4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed6006d120 0x7fed4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6006daa0 con 0x7fed4c003a60 2023-10-06T02:46:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600cfbb0 con 0x7fed4c004810 2023-10-06T02:46:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c00ba60 con 0x7fed6006d120 2023-10-06T02:46:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed65333700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed64b32700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4c004810 0x7fed4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed65b34700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed6006d120 0x7fed4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed65333700 1 -- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed6006d120 msgr2=0x7fed4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed65333700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed6006d120 0x7fed4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed65333700 1 -- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4c004810 msgr2=0x7fed4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed65333700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4c004810 0x7fed4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.307+0000 7fed65333700 1 -- 172.21.15.81:0/3398638579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c003570 con 0x7fed4c003a60 2023-10-06T02:46:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed65333700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed4c003e70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00e240 tx=0x7fed5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e594b2db74fb37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00eaf0 con 0x7fed4c003a60 2023-10-06T02:46:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c00f040 con 0x7fed4c003a60 2023-10-06T02:46:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed57fff700 1 -- 172.21.15.81:0/3398638579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00eea0 con 0x7fed4c003a60 2023-10-06T02:46:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed67597700 1 -- 172.21.15.81:0/3398638579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 msgr2=0x7fed4c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed67597700 1 --2- 172.21.15.81:0/3398638579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed4c003e70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00e240 tx=0x7fed5c00b040 comp rx=0 tx=0).stop 2023-10-06T02:46:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed65b34700 1 -- 172.21.15.81:0/3398638579 reap_dead start 2023-10-06T02:46:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed67597700 1 -- 172.21.15.81:0/3398638579 shutdown_connections 2023-10-06T02:46:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed67597700 1 -- 172.21.15.81:0/3398638579 >> 172.21.15.81:0/3398638579 conn(0x7fed6006bb90 msgr2=0x7fed6006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed67597700 1 -- 172.21.15.81:0/3398638579 shutdown_connections 2023-10-06T02:46:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.308+0000 7fed67597700 1 -- 172.21.15.81:0/3398638579 wait complete. 2023-10-06T02:46:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.309+0000 7fed67597700 1 Processor -- start 2023-10-06T02:46:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.309+0000 7fed67597700 1 -- start start 2023-10-06T02:46:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed67597700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed6016b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed67597700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed600aa890 0x7fed600b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed67597700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed600ac6c0 0x7fed600acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed67597700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600ad080 con 0x7fed4c003a60 2023-10-06T02:46:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed67597700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6016b990 con 0x7fed600aa890 2023-10-06T02:46:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed67597700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600b6790 con 0x7fed600ac6c0 2023-10-06T02:46:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed65333700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed6016b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed65333700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed6016b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44216/0 (socket says 172.21.15.81:44216) 2023-10-06T02:46:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed65333700 1 -- 172.21.15.81:0/902114366 learned_addr learned my addr 172.21.15.81:0/902114366 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed64b32700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed600aa890 0x7fed600b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.310+0000 7fed65b34700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed600ac6c0 0x7fed600acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed65333700 1 -- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed600ac6c0 msgr2=0x7fed600acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed65333700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed600ac6c0 0x7fed600acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed65333700 1 -- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed600aa890 msgr2=0x7fed600b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed65333700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed600aa890 0x7fed600b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed65333700 1 -- 172.21.15.81:0/902114366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600b25c0 con 0x7fed4c003a60 2023-10-06T02:46:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed65333700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed6016b450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00e830 tx=0x7fed5c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed557fa700 1 -- 172.21.15.81:0/902114366 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c014e20 con 0x7fed4c003a60 2023-10-06T02:46:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed557fa700 1 -- 172.21.15.81:0/902114366 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c01d420 con 0x7fed4c003a60 2023-10-06T02:46:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed557fa700 1 -- 172.21.15.81:0/902114366 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c01d7e0 con 0x7fed4c003a60 2023-10-06T02:46:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed600aad20 con 0x7fed4c003a60 2023-10-06T02:46:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.311+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed600ab2e0 con 0x7fed4c003a60 2023-10-06T02:46:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.312+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed60067ac0 con 0x7fed4c003a60 2023-10-06T02:46:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.312+0000 7fed557fa700 1 -- 172.21.15.81:0/902114366 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed5c003040 con 0x7fed4c003a60 2023-10-06T02:46:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.313+0000 7fed557fa700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.313+0000 7fed557fa700 1 -- 172.21.15.81:0/902114366 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fed5c0860f0 con 0x7fed4c003a60 2023-10-06T02:46:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.313+0000 7fed64b32700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.313+0000 7fed64b32700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed44066f30 0x7fed440693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed600ac3a0 tx=0x7fed600d0730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.317+0000 7fed557fa700 1 -- 172.21.15.81:0/902114366 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed5c053130 con 0x7fed4c003a60 2023-10-06T02:46:50.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:50.503+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed600d0170 con 0x7fed4c003a60 2023-10-06T02:46:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.386+0000 7fed557fa700 1 -- 172.21.15.81:0/902114366 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fed5c009780 con 0x7fed4c003a60 2023-10-06T02:46:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed44066f30 msgr2=0x7fed440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed44066f30 0x7fed440693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed600ac3a0 tx=0x7fed600d0730 comp rx=0 tx=0).stop 2023-10-06T02:46:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 msgr2=0x7fed6016b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed6016b450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00e830 tx=0x7fed5c01a000 comp rx=0 tx=0).stop 2023-10-06T02:46:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 shutdown_connections 2023-10-06T02:46:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed600ac6c0 0x7fed600acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c003a60 0x7fed6016b450 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 --2- 172.21.15.81:0/902114366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed600aa890 0x7fed600b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 >> 172.21.15.81:0/902114366 conn(0x7fed6006bb90 msgr2=0x7fed60068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 shutdown_connections 2023-10-06T02:46:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.389+0000 7fed67597700 1 -- 172.21.15.81:0/902114366 wait complete. 2023-10-06T02:46:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:46:51.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:46:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.523+0000 7f99e6aa5700 1 Processor -- start 2023-10-06T02:46:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.523+0000 7f99e6aa5700 1 -- start start 2023-10-06T02:46:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e6aa5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00d0970 0x7f99e0161c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e6aa5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f99e015f1c0 0x7f99e00d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e6aa5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99e00ce8e0 0x7f99e00ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e6aa5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e0162c10 con 0x7f99e00ce8e0 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e6aa5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e015f630 con 0x7f99e015f1c0 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e6aa5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00d1280 con 0x7f99e00d0970 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e62a4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99e00ce8e0 0x7f99e00ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e62a4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99e00ce8e0 0x7f99e00ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51562/0 (socket says 172.21.15.81:51562) 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e62a4700 1 -- 172.21.15.81:0/2551752000 learned_addr learned my addr 172.21.15.81:0/2551752000 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e52a2700 1 --2- 172.21.15.81:0/2551752000 >> v2:172.21.15.83:3300/0 conn(0x7f99e015f1c0 0x7f99e00d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e5aa3700 1 --2- 172.21.15.81:0/2551752000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00d0970 0x7f99e0161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e62a4700 1 -- 172.21.15.81:0/2551752000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00d0970 msgr2=0x7f99e0161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e62a4700 1 --2- 172.21.15.81:0/2551752000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00d0970 0x7f99e0161c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e62a4700 1 -- 172.21.15.81:0/2551752000 >> v2:172.21.15.83:3300/0 conn(0x7f99e015f1c0 msgr2=0x7f99e00d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e62a4700 1 --2- 172.21.15.81:0/2551752000 >> v2:172.21.15.83:3300/0 conn(0x7f99e015f1c0 0x7f99e00d0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e62a4700 1 -- 172.21.15.81:0/2551752000 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0162370 con 0x7f99e00ce8e0 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e52a2700 1 --2- 172.21.15.81:0/2551752000 >> v2:172.21.15.83:3300/0 conn(0x7f99e015f1c0 0x7f99e00d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e5aa3700 1 --2- 172.21.15.81:0/2551752000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00d0970 0x7f99e0161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.524+0000 7f99e62a4700 1 --2- 172.21.15.81:0/2551752000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e00ce8e0 0x7f99e00ced20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f99e006e810 tx=0x7f99d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68503d9236b53572 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e4aa1700 1 -- 172.21.15.81:0/2551752000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d000b860 con 0x7f99e00ce8e0 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e4aa1700 1 -- 172.21.15.81:0/2551752000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d000b9c0 con 0x7f99e00ce8e0 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e4aa1700 1 -- 172.21.15.81:0/2551752000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d000bd60 con 0x7f99e00ce8e0 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e6aa5700 1 -- 172.21.15.81:0/2551752000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e00ce8e0 msgr2=0x7f99e00ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/2551752000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e00ce8e0 0x7f99e00ced20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f99e006e810 tx=0x7f99d0009250 comp rx=0 tx=0).stop 2023-10-06T02:46:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e6aa5700 1 -- 172.21.15.81:0/2551752000 shutdown_connections 2023-10-06T02:46:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/2551752000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e00ce8e0 0x7f99e00ced20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/2551752000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00d0970 0x7f99e0161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/2551752000 >> v2:172.21.15.83:3300/0 conn(0x7f99e015f1c0 0x7f99e00d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e6aa5700 1 -- 172.21.15.81:0/2551752000 >> 172.21.15.81:0/2551752000 conn(0x7f99e0063230 msgr2=0x7f99e0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e6aa5700 1 -- 172.21.15.81:0/2551752000 shutdown_connections 2023-10-06T02:46:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.525+0000 7f99e6aa5700 1 -- 172.21.15.81:0/2551752000 wait complete. 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.526+0000 7f99e6aa5700 1 Processor -- start 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.526+0000 7f99e6aa5700 1 -- start start 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e6aa5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00ce8e0 0x7f99e0159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e6aa5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99e00d0970 0x7f99e00b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e6aa5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e015f1c0 0x7f99e008a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e6aa5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e008a850 con 0x7f99e015f1c0 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e6aa5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0089630 con 0x7f99e00d0970 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e6aa5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0089050 con 0x7f99e00ce8e0 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e62a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e015f1c0 0x7f99e008a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e62a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e015f1c0 0x7f99e008a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51570/0 (socket says 172.21.15.81:51570) 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e62a4700 1 -- 172.21.15.81:0/3839143699 learned_addr learned my addr 172.21.15.81:0/3839143699 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e52a2700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99e00d0970 0x7f99e00b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e5aa3700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00ce8e0 0x7f99e0159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e62a4700 1 -- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00ce8e0 msgr2=0x7f99e0159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.527+0000 7f99e62a4700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00ce8e0 0x7f99e0159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.528+0000 7f99e62a4700 1 -- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99e00d0970 msgr2=0x7f99e00b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.528+0000 7f99e62a4700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99e00d0970 0x7f99e00b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.528+0000 7f99e62a4700 1 -- 172.21.15.81:0/3839143699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d00094f0 con 0x7f99e015f1c0 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.528+0000 7f99e62a4700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e015f1c0 0x7f99e008a310 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f99e006fcc0 tx=0x7f99d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.528+0000 7f99ddffb700 1 -- 172.21.15.81:0/3839143699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0011ea0 con 0x7f99e015f1c0 2023-10-06T02:46:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.528+0000 7f99ddffb700 1 -- 172.21.15.81:0/3839143699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d001a630 con 0x7f99e015f1c0 2023-10-06T02:46:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.528+0000 7f99ddffb700 1 -- 172.21.15.81:0/3839143699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d001a9d0 con 0x7f99e015f1c0 2023-10-06T02:46:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.528+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e008aa80 con 0x7f99e015f1c0 2023-10-06T02:46:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.528+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e008ad60 con 0x7f99e015f1c0 2023-10-06T02:46:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.529+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e00897a0 con 0x7f99e015f1c0 2023-10-06T02:46:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.529+0000 7f99ddffb700 1 -- 172.21.15.81:0/3839143699 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99d001ad40 con 0x7f99e015f1c0 2023-10-06T02:46:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.530+0000 7f99ddffb700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f99cc066f30 0x7f99cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.530+0000 7f99ddffb700 1 -- 172.21.15.81:0/3839143699 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f99d0086070 con 0x7f99e015f1c0 2023-10-06T02:46:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.530+0000 7f99e5aa3700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f99cc066f30 0x7f99cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.531+0000 7f99e5aa3700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f99cc066f30 0x7f99cc0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fd0 tx=0x7f99d80077c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.534+0000 7f99ddffb700 1 -- 172.21.15.81:0/3839143699 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99d0053360 con 0x7f99e015f1c0 2023-10-06T02:46:51.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:51.717+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f99e00676e0 con 0x7f99e015f1c0 2023-10-06T02:46:52.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.392+0000 7f99ddffb700 1 -- 172.21.15.81:0/3839143699 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f99d0056980 con 0x7f99e015f1c0 2023-10-06T02:46:52.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.395+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f99cc066f30 msgr2=0x7f99cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:52.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.395+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f99cc066f30 0x7f99cc0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fd0 tx=0x7f99d80077c0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.395+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e015f1c0 msgr2=0x7f99e008a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:52.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.395+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e015f1c0 0x7f99e008a310 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f99e006fcc0 tx=0x7f99d0017000 comp rx=0 tx=0).stop 2023-10-06T02:46:52.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.396+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 shutdown_connections 2023-10-06T02:46:52.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.396+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e015f1c0 0x7f99e008a310 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.396+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f99e00ce8e0 0x7f99e0159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.396+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f99cc066f30 0x7f99cc0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.396+0000 7f99e6aa5700 1 --2- 172.21.15.81:0/3839143699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99e00d0970 0x7f99e00b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.396+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 >> 172.21.15.81:0/3839143699 conn(0x7f99e0063230 msgr2=0x7f99e0161810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:52.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.396+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 shutdown_connections 2023-10-06T02:46:52.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.396+0000 7f99e6aa5700 1 -- 172.21.15.81:0/3839143699 wait complete. 2023-10-06T02:46:52.399 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:46:52.410 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:46:52.410 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:46:52.410 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:46:52.410 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:46:52.411 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:46:52.411 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:46:52.411 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:46:52.411 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:46:52.411 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:46:52.411 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:46:52.411 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:46:52.412 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:46:52.412 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:46:52.412 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:46:52.412 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:46:52.412 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:46:52.419 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:46:52.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:46:52.420 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:46:52.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:46:52.424 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:46:52.425 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:46:52.425 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:46:52.426 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:46:52.461 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:46:52.462 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:52.462 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:46:52.462 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:52.467 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:46:52.467 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:52.467 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:46:52.468 DEBUG:teuthology.parallel:result is None 2023-10-06T02:46:52.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:46:52.539 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:46:52.539 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:46:52.555 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:46:52.555 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:46:52.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.590+0000 7f03fb59e700 1 Processor -- start 2023-10-06T02:46:52.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.590+0000 7f03fb59e700 1 -- start start 2023-10-06T02:46:52.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03fb59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f03fc159b40 0x7f03fc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03fb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03fc159f10 0x7f03fc068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03fb59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc0cee10 con 0x7f03fc0ccb40 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03fb59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc0cd040 con 0x7f03fc159f10 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03fb59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc0cd320 con 0x7f03fc159b40 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03f1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03fc159f10 0x7f03fc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03f1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03fc159f10 0x7f03fc068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51596/0 (socket says 172.21.15.81:51596) 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03f1d9b700 1 -- 172.21.15.81:0/4105442310 learned_addr learned my addr 172.21.15.81:0/4105442310 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03fa59c700 1 --2- 172.21.15.81:0/4105442310 >> v2:172.21.15.83:3300/0 conn(0x7f03fc159b40 0x7f03fc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03f1d9b700 1 -- 172.21.15.81:0/4105442310 >> v2:172.21.15.83:3300/0 conn(0x7f03fc159b40 msgr2=0x7f03fc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03f1d9b700 1 --2- 172.21.15.81:0/4105442310 >> v2:172.21.15.83:3300/0 conn(0x7f03fc159b40 0x7f03fc0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03f1d9b700 1 -- 172.21.15.81:0/4105442310 >> v1:172.21.15.83:6789/0 conn(0x7f03fc0ccb40 legacy=0x7f03fc15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03f1d9b700 1 -- 172.21.15.81:0/4105442310 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc0ce7c0 con 0x7f03fc159f10 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.591+0000 7f03fa59c700 1 --2- 172.21.15.81:0/4105442310 >> v2:172.21.15.83:3300/0 conn(0x7f03fc159b40 0x7f03fc0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03f1d9b700 1 --2- 172.21.15.81:0/4105442310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc159f10 0x7f03fc068780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0d0bc0 tx=0x7f03e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700eba1ded80e1dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03f9d9b700 1 -- 172.21.15.81:0/4105442310 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400b860 con 0x7f03fc159f10 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03f9d9b700 1 -- 172.21.15.81:0/4105442310 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e400b9c0 con 0x7f03fc159f10 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03f9d9b700 1 -- 172.21.15.81:0/4105442310 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400bd60 con 0x7f03fc159f10 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03fb59e700 1 -- 172.21.15.81:0/4105442310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc159f10 msgr2=0x7f03fc068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03fb59e700 1 --2- 172.21.15.81:0/4105442310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc159f10 0x7f03fc068780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0d0bc0 tx=0x7f03e4009250 comp rx=0 tx=0).stop 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03fb59e700 1 -- 172.21.15.81:0/4105442310 shutdown_connections 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03fb59e700 1 --2- 172.21.15.81:0/4105442310 >> v2:172.21.15.83:3300/0 conn(0x7f03fc159b40 0x7f03fc0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03fb59e700 1 --2- 172.21.15.81:0/4105442310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc159f10 0x7f03fc068780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03fb59e700 1 -- 172.21.15.81:0/4105442310 >> 172.21.15.81:0/4105442310 conn(0x7f03fc0cd660 msgr2=0x7f03fc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:52.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03fb59e700 1 -- 172.21.15.81:0/4105442310 shutdown_connections 2023-10-06T02:46:52.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.592+0000 7f03fb59e700 1 -- 172.21.15.81:0/4105442310 wait complete. 2023-10-06T02:46:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.593+0000 7f03fb59e700 1 Processor -- start 2023-10-06T02:46:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.593+0000 7f03fb59e700 1 -- start start 2023-10-06T02:46:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc0ccb40 0x7f03fc0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fb59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03fc159b40 0x7f03fc16a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fb59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03fc159f10 0x7f03fc16a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0c9e60 con 0x7f03fc0ccb40 2023-10-06T02:46:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fb59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0c9250 con 0x7f03fc159f10 2023-10-06T02:46:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fb59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0c9530 con 0x7f03fc159b40 2023-10-06T02:46:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc0ccb40 0x7f03fc0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc0ccb40 0x7f03fc0c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51608/0 (socket says 172.21.15.81:51608) 2023-10-06T02:46:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fa59c700 1 -- 172.21.15.81:0/239303186 learned_addr learned my addr 172.21.15.81:0/239303186 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03f1d9b700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03fc159b40 0x7f03fc16a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.594+0000 7f03fad9d700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03fc159f10 0x7f03fc16a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03fa59c700 1 -- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03fc159b40 msgr2=0x7f03fc16a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03fa59c700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03fc159b40 0x7f03fc16a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03fa59c700 1 -- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03fc159f10 msgr2=0x7f03fc16a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03fa59c700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03fc159f10 0x7f03fc16a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:52.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03fa59c700 1 -- 172.21.15.81:0/239303186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40094f0 con 0x7f03fc0ccb40 2023-10-06T02:46:52.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03fa59c700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc0ccb40 0x7f03fc0c8c70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00e8d0 tx=0x7f03ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:52.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03f2ffd700 1 -- 172.21.15.81:0/239303186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0093b0 con 0x7f03fc0ccb40 2023-10-06T02:46:52.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03f2ffd700 1 -- 172.21.15.81:0/239303186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec013410 con 0x7f03fc0ccb40 2023-10-06T02:46:52.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc0c9810 con 0x7f03fc0ccb40 2023-10-06T02:46:52.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03f2ffd700 1 -- 172.21.15.81:0/239303186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0137b0 con 0x7f03fc0ccb40 2023-10-06T02:46:52.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.595+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc154fe0 con 0x7f03fc0ccb40 2023-10-06T02:46:52.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.596+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03fc0cb910 con 0x7f03fc0ccb40 2023-10-06T02:46:52.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.596+0000 7f03f2ffd700 1 -- 172.21.15.81:0/239303186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03ec013be0 con 0x7f03fc0ccb40 2023-10-06T02:46:52.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.597+0000 7f03f2ffd700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f03dc066f30 0x7f03dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:52.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.597+0000 7f03f2ffd700 1 -- 172.21.15.81:0/239303186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f03ec0843d0 con 0x7f03fc0ccb40 2023-10-06T02:46:52.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.597+0000 7f03f1d9b700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f03dc066f30 0x7f03dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:52.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.597+0000 7f03f1d9b700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f03dc066f30 0x7f03dc0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0d0bc0 tx=0x7f03e4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:52.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.601+0000 7f03f2ffd700 1 -- 172.21.15.81:0/239303186 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03ec051740 con 0x7f03fc0ccb40 2023-10-06T02:46:52.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-06T02:46:52.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-06T02:46:52.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T02:46:52.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-06T02:46:52.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:52.797+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f03fc0ceaa0 con 0x7f03fc0ccb40 2023-10-06T02:46:53.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.406+0000 7f03f2ffd700 1 -- 172.21.15.81:0/239303186 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f03ec054d60 con 0x7f03fc0ccb40 2023-10-06T02:46:53.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f03dc066f30 msgr2=0x7f03dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f03dc066f30 0x7f03dc0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0d0bc0 tx=0x7f03e4017000 comp rx=0 tx=0).stop 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc0ccb40 msgr2=0x7f03fc0c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc0ccb40 0x7f03fc0c8c70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00e8d0 tx=0x7f03ec008040 comp rx=0 tx=0).stop 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 shutdown_connections 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f03dc066f30 0x7f03dc0693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03fc159f10 0x7f03fc16a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03fc0ccb40 0x7f03fc0c8c70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 --2- 172.21.15.81:0/239303186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03fc159b40 0x7f03fc16a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 >> 172.21.15.81:0/239303186 conn(0x7f03fc0cd660 msgr2=0x7f03fc06de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 shutdown_connections 2023-10-06T02:46:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.408+0000 7f03fb59e700 1 -- 172.21.15.81:0/239303186 wait complete. 2023-10-06T02:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:46:53.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:46:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.534+0000 7f4656676700 1 Processor -- start 2023-10-06T02:46:53.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.534+0000 7f4656676700 1 -- start start 2023-10-06T02:46:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4656676700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f465006d830 0x7f46500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4656676700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46500d07c0 con 0x7f4650157ca0 2023-10-06T02:46:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4656676700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46500cfbb0 con 0x7f46501578d0 2023-10-06T02:46:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4656676700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46500cfe90 con 0x7f465006d830 2023-10-06T02:46:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4654c13700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f465006d830 0x7f46500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4654c13700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f465006d830 0x7f46500cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51612/0 (socket says 172.21.15.81:51612) 2023-10-06T02:46:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f464f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4650157ca0 0x7f465006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55862/0 (socket says 172.21.15.81:55862) 2023-10-06T02:46:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4654c13700 1 -- 172.21.15.81:0/1800264152 learned_addr learned my addr 172.21.15.81:0/1800264152 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4654c13700 1 -- 172.21.15.81:0/1800264152 >> v1:172.21.15.83:6789/0 conn(0x7f46501578d0 legacy=0x7f465015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4654c13700 1 -- 172.21.15.81:0/1800264152 >> v1:172.21.15.81:6789/0 conn(0x7f4650157ca0 legacy=0x7f465006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f4654c13700 1 -- 172.21.15.81:0/1800264152 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46500d0170 con 0x7f465006d830 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.535+0000 7f464effd700 1 -- 172.21.15.81:0/1800264152 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975818288 0 0) 0x7f46500d07c0 con 0x7f4650157ca0 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f4654c13700 1 --2- 172.21.15.81:0/1800264152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465006d830 0x7f46500cf4f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4648009f20 tx=0x7f4648009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840cbe23b0fd73c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f464effd700 1 -- 172.21.15.81:0/1800264152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464800e070 con 0x7f465006d830 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f464effd700 1 -- 172.21.15.81:0/1800264152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464800ba40 con 0x7f465006d830 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f464effd700 1 -- 172.21.15.81:0/1800264152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46480092e0 con 0x7f465006d830 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f4656676700 1 -- 172.21.15.81:0/1800264152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465006d830 msgr2=0x7f46500cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f4656676700 1 --2- 172.21.15.81:0/1800264152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465006d830 0x7f46500cf4f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4648009f20 tx=0x7f4648009840 comp rx=0 tx=0).stop 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f4656676700 1 -- 172.21.15.81:0/1800264152 shutdown_connections 2023-10-06T02:46:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f4656676700 1 --2- 172.21.15.81:0/1800264152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465006d830 0x7f46500cf4f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f4656676700 1 -- 172.21.15.81:0/1800264152 >> 172.21.15.81:0/1800264152 conn(0x7f465006bb90 msgr2=0x7f465006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f4656676700 1 -- 172.21.15.81:0/1800264152 shutdown_connections 2023-10-06T02:46:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.536+0000 7f4656676700 1 -- 172.21.15.81:0/1800264152 wait complete. 2023-10-06T02:46:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.537+0000 7f4656676700 1 Processor -- start 2023-10-06T02:46:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4656676700 1 -- start start 2023-10-06T02:46:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4656676700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f465006d830 0x7f46500b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4656676700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46501578d0 0x7f46500b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4656676700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4650157ca0 0x7f465016a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4656676700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46500b4e90 con 0x7f4650157ca0 2023-10-06T02:46:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4656676700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46500b4280 con 0x7f465006d830 2023-10-06T02:46:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4656676700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46500b4560 con 0x7f46501578d0 2023-10-06T02:46:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4654c13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4650157ca0 0x7f465016a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4654c13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4650157ca0 0x7f465016a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51620/0 (socket says 172.21.15.81:51620) 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.538+0000 7f4654c13700 1 -- 172.21.15.81:0/2307463321 learned_addr learned my addr 172.21.15.81:0/2307463321 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f464ffff700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f465006d830 0x7f46500b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f464f7fe700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46501578d0 0x7f46500b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4654c13700 1 -- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46501578d0 msgr2=0x7f46500b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4654c13700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46501578d0 0x7f46500b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4654c13700 1 -- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f465006d830 msgr2=0x7f46500b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4654c13700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f465006d830 0x7f46500b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4654c13700 1 -- 172.21.15.81:0/2307463321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4648009ae0 con 0x7f4650157ca0 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4654c13700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4650157ca0 0x7f465016a440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f465006fe20 tx=0x7f4648017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4637fff700 1 -- 172.21.15.81:0/2307463321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46480094e0 con 0x7f4650157ca0 2023-10-06T02:46:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4637fff700 1 -- 172.21.15.81:0/2307463321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46480092e0 con 0x7f4650157ca0 2023-10-06T02:46:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46500b4840 con 0x7f4650157ca0 2023-10-06T02:46:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4637fff700 1 -- 172.21.15.81:0/2307463321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464801e430 con 0x7f4650157ca0 2023-10-06T02:46:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.539+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46500b6b80 con 0x7f4650157ca0 2023-10-06T02:46:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.540+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46500b5000 con 0x7f4650157ca0 2023-10-06T02:46:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.540+0000 7f4637fff700 1 -- 172.21.15.81:0/2307463321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f464801e840 con 0x7f4650157ca0 2023-10-06T02:46:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.541+0000 7f4637fff700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f463c066f30 0x7f463c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.541+0000 7f4637fff700 1 -- 172.21.15.81:0/2307463321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4648085ed0 con 0x7f4650157ca0 2023-10-06T02:46:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.541+0000 7f464ffff700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f463c066f30 0x7f463c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.541+0000 7f464ffff700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f463c066f30 0x7f463c0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4640003a30 tx=0x7f4640007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.545+0000 7f4637fff700 1 -- 172.21.15.81:0/2307463321 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4648053330 con 0x7f4650157ca0 2023-10-06T02:46:53.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.798+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f46500d0450 con 0x7f4650157ca0 2023-10-06T02:46:53.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.799+0000 7f4637fff700 1 -- 172.21.15.81:0/2307463321 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4648056950 con 0x7f4650157ca0 2023-10-06T02:46:53.802 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:53.802 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:46:53.802 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:46:53.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.802 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:46:53.802 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:46:53.802 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.802 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:46:53.803 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:46:53.803 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:46:53.803 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.803 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:46:53.803 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:46:53.803 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:46:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:46:53.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.807 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:46:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:46:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:46:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:46:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDddB9lauCqIhAANNyOiKTv9gE+hNnuFI+PWg==", 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDddB9lJ+uqIhAAc+YC+cuA9mCOag0ANaT0Mw==", 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDddB9l8fKqIhAAWloezjGBL+t4v9o0vcC5Rg==", 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T02:46:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDddB9lRPuqIhAA0TunhUI655oS0rQRcKGwJQ==", 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T02:46:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDddB9lngKrIhAAmsvByDORjXEoWG3WtlYJpA==", 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDddB9lDgqrIhAAjaV1xpmn4+EPC/klrQqn5Q==", 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:46:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:46:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:46:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:46:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:46:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:46:53.821 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f463c066f30 msgr2=0x7f463c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f463c066f30 0x7f463c0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4640003a30 tx=0x7f4640007ea0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4650157ca0 msgr2=0x7f465016a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4650157ca0 0x7f465016a440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f465006fe20 tx=0x7f4648017000 comp rx=0 tx=0).stop 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 shutdown_connections 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4650157ca0 0x7f465016a440 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f463c066f30 0x7f463c0693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f465006d830 0x7f46500b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 --2- 172.21.15.81:0/2307463321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46501578d0 0x7f46500b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 >> 172.21.15.81:0/2307463321 conn(0x7f465006bb90 msgr2=0x7f465006d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 shutdown_connections 2023-10-06T02:46:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.801+0000 7f4656676700 1 -- 172.21.15.81:0/2307463321 wait complete. 2023-10-06T02:46:53.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T02:46:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.937+0000 7f229ac57700 1 Processor -- start 2023-10-06T02:46:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.937+0000 7f229ac57700 1 -- start start 2023-10-06T02:46:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f229ac57700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2294068e90 0x7f2294164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f229ac57700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940cee10 con 0x7f2294159f10 2023-10-06T02:46:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f229ac57700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940cd040 con 0x7f2294159b40 2023-10-06T02:46:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f229ac57700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22940cd320 con 0x7f2294068e90 2023-10-06T02:46:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2299454700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2294159f10 0x7f2294068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55876/0 (socket says 172.21.15.81:55876) 2023-10-06T02:46:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2299454700 1 -- 172.21.15.81:0/937592742 learned_addr learned my addr 172.21.15.81:0/937592742 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f229a456700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2294068e90 0x7f2294164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090228926 0 0) 0x7f22940cee10 con 0x7f2294159f10 2023-10-06T02:46:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2280003570 con 0x7f2294159f10 2023-10-06T02:46:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295267809 0 0) 0x7f22940cd040 con 0x7f2294159b40 2023-10-06T02:46:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22940cee10 con 0x7f2294159b40 2023-10-06T02:46:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393245902 0 0) 0x7f2280003570 con 0x7f2294159f10 2023-10-06T02:46:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2294068e90 msgr2=0x7f2294164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2298c53700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2294068e90 0x7f2294164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 >> v1:172.21.15.83:6789/0 conn(0x7f2294159b40 legacy=0x7f22940cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.938+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940ce7c0 con 0x7f2294159f10 2023-10-06T02:46:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f2284001470 con 0x7f2294159f10 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 >> v1:172.21.15.81:6789/0 conn(0x7f2294159f10 legacy=0x7f2294068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2280003c20 0x7f2280004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2294068e90 0x7f2280004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2280004d50 0x7f22800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940cd320 con 0x7f2280003c20 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228000bb40 con 0x7f2280004d50 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228000bd00 con 0x7f2294068e90 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2299c55700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2280003c20 0x7f2280004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2299454700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2294068e90 0x7f2280004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f229a456700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2280004d50 0x7f22800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2299c55700 1 -- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2294068e90 msgr2=0x7f2280004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2299c55700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2294068e90 0x7f2280004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2299c55700 1 -- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2280004d50 msgr2=0x7f22800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2299c55700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2280004d50 0x7f22800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2299c55700 1 -- 172.21.15.81:0/937592742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280003570 con 0x7f2280003c20 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2299c55700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2280003c20 0x7f2280004010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2290001a10 tx=0x7f2290007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7134939aa41162 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229000c5d0 con 0x7f2280003c20 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229000c730 con 0x7f2280003c20 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.939+0000 7f2298c53700 1 -- 172.21.15.81:0/937592742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229000cad0 con 0x7f2280003c20 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.940+0000 7f229ac57700 1 -- 172.21.15.81:0/937592742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2280003c20 msgr2=0x7f2280004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.940+0000 7f229ac57700 1 --2- 172.21.15.81:0/937592742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2280003c20 0x7f2280004010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2290001a10 tx=0x7f2290007d30 comp rx=0 tx=0).stop 2023-10-06T02:46:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.940+0000 7f229a456700 1 -- 172.21.15.81:0/937592742 reap_dead start 2023-10-06T02:46:53.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.940+0000 7f229ac57700 1 -- 172.21.15.81:0/937592742 shutdown_connections 2023-10-06T02:46:53.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.940+0000 7f229ac57700 1 -- 172.21.15.81:0/937592742 >> 172.21.15.81:0/937592742 conn(0x7f22940cd660 msgr2=0x7f22940cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:53.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.940+0000 7f229ac57700 1 -- 172.21.15.81:0/937592742 shutdown_connections 2023-10-06T02:46:53.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.940+0000 7f229ac57700 1 -- 172.21.15.81:0/937592742 wait complete. 2023-10-06T02:46:53.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.941+0000 7f229ac57700 1 Processor -- start 2023-10-06T02:46:53.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.941+0000 7f229ac57700 1 -- start start 2023-10-06T02:46:53.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f229ac57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22941547c0 0x7f22940c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f229ac57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2294154b90 0x7f229415bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f229ac57700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229415c330 0x7f2294155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f229ac57700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229415d220 con 0x7f2294154b90 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f229ac57700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229415c7b0 con 0x7f22941547c0 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f229ac57700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229415b960 con 0x7f229415c330 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299454700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2294154b90 0x7f229415bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299454700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2294154b90 0x7f229415bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51630/0 (socket says 172.21.15.81:51630) 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299454700 1 -- 172.21.15.81:0/1325850841 learned_addr learned my addr 172.21.15.81:0/1325850841 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299c55700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22941547c0 0x7f22940c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f229a456700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229415c330 0x7f2294155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299454700 1 -- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229415c330 msgr2=0x7f2294155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299454700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229415c330 0x7f2294155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299454700 1 -- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22941547c0 msgr2=0x7f22940c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299454700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22941547c0 0x7f22940c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299454700 1 -- 172.21.15.81:0/1325850841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294158f40 con 0x7f2294154b90 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2299454700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2294154b90 0x7f229415bdf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2284007340 tx=0x7f2284001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2289ffb700 1 -- 172.21.15.81:0/1325850841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284018030 con 0x7f2294154b90 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2289ffb700 1 -- 172.21.15.81:0/1325850841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228400f5f0 con 0x7f2294154b90 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229415b030 con 0x7f2294154b90 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.942+0000 7f2289ffb700 1 -- 172.21.15.81:0/1325850841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400f990 con 0x7f2294154b90 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.943+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229415b5f0 con 0x7f2294154b90 2023-10-06T02:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.944+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229415bad0 con 0x7f2294154b90 2023-10-06T02:46:53.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.944+0000 7f2289ffb700 1 -- 172.21.15.81:0/1325850841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f228401b070 con 0x7f2294154b90 2023-10-06T02:46:53.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.944+0000 7f2289ffb700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2278066f30 0x7f22780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:53.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.945+0000 7f2289ffb700 1 -- 172.21.15.81:0/1325850841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2284019070 con 0x7f2294154b90 2023-10-06T02:46:53.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.945+0000 7f2299c55700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2278066f30 0x7f22780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:53.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.945+0000 7f2299c55700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2278066f30 0x7f22780693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2290000c00 tx=0x7f2290015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:53.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:53.949+0000 7f2289ffb700 1 -- 172.21.15.81:0/1325850841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22840514f0 con 0x7f2294154b90 2023-10-06T02:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.205+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f229406afe0 con 0x7f2294154b90 2023-10-06T02:46:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.209+0000 7f2289ffb700 1 -- 172.21.15.81:0/1325850841 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2284054b10 con 0x7f2294154b90 2023-10-06T02:46:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2278066f30 msgr2=0x7f22780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2278066f30 0x7f22780693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2290000c00 tx=0x7f2290015000 comp rx=0 tx=0).stop 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2294154b90 msgr2=0x7f229415bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2294154b90 0x7f229415bdf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2284007340 tx=0x7f2284001df0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 shutdown_connections 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229415c330 0x7f2294155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2278066f30 0x7f22780693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22941547c0 0x7f22940c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 --2- 172.21.15.81:0/1325850841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2294154b90 0x7f229415bdf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 >> 172.21.15.81:0/1325850841 conn(0x7f22940cd660 msgr2=0x7f229406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 shutdown_connections 2023-10-06T02:46:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.211+0000 7f229ac57700 1 -- 172.21.15.81:0/1325850841 wait complete. 2023-10-06T02:46:54.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T02:46:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.337+0000 7f7257e97700 1 Processor -- start 2023-10-06T02:46:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.337+0000 7f7257e97700 1 -- start start 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.338+0000 7f7257e97700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72501578d0 0x7f72500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.338+0000 7f7257e97700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7250157ca0 0x7f725015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.338+0000 7f7257e97700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72500d07c0 con 0x7f725006d120 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.338+0000 7f7257e97700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72500cfbb0 con 0x7f7250157ca0 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.338+0000 7f7257e97700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72500cfe90 con 0x7f72501578d0 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.338+0000 7f7255432700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7250157ca0 0x7f725015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.338+0000 7f7256434700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f725006d120 0x7f725015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55878/0 (socket says 172.21.15.81:55878) 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.338+0000 7f7256434700 1 -- 172.21.15.81:0/3818635214 learned_addr learned my addr 172.21.15.81:0/3818635214 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.338+0000 7f7255c33700 1 --2- 172.21.15.81:0/3818635214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72501578d0 0x7f72500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7255432700 1 -- 172.21.15.81:0/3818635214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72501578d0 msgr2=0x7f72500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7255432700 1 --2- 172.21.15.81:0/3818635214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72501578d0 0x7f72500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7255432700 1 -- 172.21.15.81:0/3818635214 >> v1:172.21.15.81:6789/0 conn(0x7f725006d120 legacy=0x7f725015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7255432700 1 -- 172.21.15.81:0/3818635214 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72500d0170 con 0x7f7250157ca0 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7254c31700 1 -- 172.21.15.81:0/3818635214 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508671659 0 0) 0x7f72500d07c0 con 0x7f725006d120 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7255432700 1 --2- 172.21.15.81:0/3818635214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7250157ca0 0x7f725015af00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f72400098e0 tx=0x7f72400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e11d11eaf2a64fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7254c31700 1 -- 172.21.15.81:0/3818635214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240009e80 con 0x7f7250157ca0 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7254c31700 1 -- 172.21.15.81:0/3818635214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724000b860 con 0x7f7250157ca0 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7254c31700 1 -- 172.21.15.81:0/3818635214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000bbe0 con 0x7f7250157ca0 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7257e97700 1 -- 172.21.15.81:0/3818635214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7250157ca0 msgr2=0x7f725015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7257e97700 1 --2- 172.21.15.81:0/3818635214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7250157ca0 0x7f725015af00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f72400098e0 tx=0x7f72400091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7257e97700 1 -- 172.21.15.81:0/3818635214 shutdown_connections 2023-10-06T02:46:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7257e97700 1 --2- 172.21.15.81:0/3818635214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72501578d0 0x7f72500cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7257e97700 1 --2- 172.21.15.81:0/3818635214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7250157ca0 0x7f725015af00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7257e97700 1 -- 172.21.15.81:0/3818635214 >> 172.21.15.81:0/3818635214 conn(0x7f725006bb90 msgr2=0x7f725006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:54.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7257e97700 1 -- 172.21.15.81:0/3818635214 shutdown_connections 2023-10-06T02:46:54.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.339+0000 7f7257e97700 1 -- 172.21.15.81:0/3818635214 wait complete. 2023-10-06T02:46:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.340+0000 7f7257e97700 1 Processor -- start 2023-10-06T02:46:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7257e97700 1 -- start start 2023-10-06T02:46:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7257e97700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d120 0x7f7250159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7257e97700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72501578d0 0x7f7250149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7257e97700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7250157ca0 0x7f7250156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7257e97700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500c7270 con 0x7f725006d120 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7257e97700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500c6660 con 0x7f72501578d0 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7257e97700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72500c6940 con 0x7f7250157ca0 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7255c33700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d120 0x7f7250159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7255c33700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d120 0x7f7250159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51660/0 (socket says 172.21.15.81:51660) 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7255c33700 1 -- 172.21.15.81:0/1950153775 learned_addr learned my addr 172.21.15.81:0/1950153775 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7255432700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72501578d0 0x7f7250149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.341+0000 7f7256434700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7250157ca0 0x7f7250156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7255c33700 1 -- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7250157ca0 msgr2=0x7f7250156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7255c33700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7250157ca0 0x7f7250156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7255c33700 1 -- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72501578d0 msgr2=0x7f7250149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7255c33700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72501578d0 0x7f7250149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7255c33700 1 -- 172.21.15.81:0/1950153775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240009420 con 0x7f725006d120 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7255432700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72501578d0 0x7f7250149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7255c33700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d120 0x7f7250159080 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f724c00e190 tx=0x7f724c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7245ffb700 1 -- 172.21.15.81:0/1950153775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c00ee30 con 0x7f725006d120 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7245ffb700 1 -- 172.21.15.81:0/1950153775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c014420 con 0x7f725006d120 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72500c6c20 con 0x7f725006d120 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7245ffb700 1 -- 172.21.15.81:0/1950153775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c0147c0 con 0x7f725006d120 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.342+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72501595c0 con 0x7f725006d120 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.343+0000 7f7245ffb700 1 -- 172.21.15.81:0/1950153775 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f724c014b70 con 0x7f725006d120 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.343+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72500c7550 con 0x7f725006d120 2023-10-06T02:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.344+0000 7f7245ffb700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7234066f30 0x7f72340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.344+0000 7f7245ffb700 1 -- 172.21.15.81:0/1950153775 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f724c084ac0 con 0x7f725006d120 2023-10-06T02:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.344+0000 7f7255432700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7234066f30 0x7f72340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.344+0000 7f7255432700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7234066f30 0x7f72340693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f72400091e0 tx=0x7f7240017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.348+0000 7f7245ffb700 1 -- 172.21.15.81:0/1950153775 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f724c051f20 con 0x7f725006d120 2023-10-06T02:46:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.609+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f725015d320 con 0x7f725006d120 2023-10-06T02:46:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.612+0000 7f7245ffb700 1 -- 172.21.15.81:0/1950153775 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f724c0099b0 con 0x7f725006d120 2023-10-06T02:46:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7234066f30 msgr2=0x7f72340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7234066f30 0x7f72340693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f72400091e0 tx=0x7f7240017000 comp rx=0 tx=0).stop 2023-10-06T02:46:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d120 msgr2=0x7f7250159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d120 0x7f7250159080 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f724c00e190 tx=0x7f724c009920 comp rx=0 tx=0).stop 2023-10-06T02:46:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 shutdown_connections 2023-10-06T02:46:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7250157ca0 0x7f7250156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d120 0x7f7250159080 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7234066f30 0x7f72340693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 --2- 172.21.15.81:0/1950153775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72501578d0 0x7f7250149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.614+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 >> 172.21.15.81:0/1950153775 conn(0x7f725006bb90 msgr2=0x7f725015a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:54.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.615+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 shutdown_connections 2023-10-06T02:46:54.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.615+0000 7f7257e97700 1 -- 172.21.15.81:0/1950153775 wait complete. 2023-10-06T02:46:54.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T02:46:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.740+0000 7fa359b8f700 1 Processor -- start 2023-10-06T02:46:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.740+0000 7fa359b8f700 1 -- start start 2023-10-06T02:46:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa359b8f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3541578d0 0x7fa3540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa359b8f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa354157ca0 0x7fa35415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa359b8f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540d07c0 con 0x7fa35406d120 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa359b8f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3540cfbb0 con 0x7fa354157ca0 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa359b8f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540cfe90 con 0x7fa3541578d0 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa352ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa354157ca0 0x7fa35415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa352ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa354157ca0 0x7fa35415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51668/0 (socket says 172.21.15.81:51668) 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa352ffd700 1 -- 172.21.15.81:0/1893604132 learned_addr learned my addr 172.21.15.81:0/1893604132 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa352ffd700 1 -- 172.21.15.81:0/1893604132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3541578d0 msgr2=0x7fa3540cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa352ffd700 1 --2- 172.21.15.81:0/1893604132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3541578d0 0x7fa3540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa352ffd700 1 -- 172.21.15.81:0/1893604132 >> v1:172.21.15.83:6789/0 conn(0x7fa35406d120 legacy=0x7fa35415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.741+0000 7fa352ffd700 1 -- 172.21.15.81:0/1893604132 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540d0170 con 0x7fa354157ca0 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa352ffd700 1 --2- 172.21.15.81:0/1893604132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa354157ca0 0x7fa35415af00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa3480099b0 tx=0x7fa348009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd51b05986e3ff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa3527fc700 1 -- 172.21.15.81:0/1893604132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800b820 con 0x7fa354157ca0 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa3527fc700 1 -- 172.21.15.81:0/1893604132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34800b980 con 0x7fa354157ca0 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa3527fc700 1 -- 172.21.15.81:0/1893604132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800bd20 con 0x7fa354157ca0 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa359b8f700 1 -- 172.21.15.81:0/1893604132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa354157ca0 msgr2=0x7fa35415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa359b8f700 1 --2- 172.21.15.81:0/1893604132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa354157ca0 0x7fa35415af00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa3480099b0 tx=0x7fa348009250 comp rx=0 tx=0).stop 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa359b8f700 1 -- 172.21.15.81:0/1893604132 shutdown_connections 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa359b8f700 1 --2- 172.21.15.81:0/1893604132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3541578d0 0x7fa3540cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa359b8f700 1 --2- 172.21.15.81:0/1893604132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa354157ca0 0x7fa35415af00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa359b8f700 1 -- 172.21.15.81:0/1893604132 >> 172.21.15.81:0/1893604132 conn(0x7fa35406bb90 msgr2=0x7fa35406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa359b8f700 1 -- 172.21.15.81:0/1893604132 shutdown_connections 2023-10-06T02:46:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.742+0000 7fa359b8f700 1 -- 172.21.15.81:0/1893604132 wait complete. 2023-10-06T02:46:54.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.744+0000 7fa359b8f700 1 Processor -- start 2023-10-06T02:46:54.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.744+0000 7fa359b8f700 1 -- start start 2023-10-06T02:46:54.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa359b8f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35406d120 0x7fa354153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa359b8f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3541578d0 0x7fa35416b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa359b8f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa354157ca0 0x7fa35415da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa359b8f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540c9ad0 con 0x7fa35406d120 2023-10-06T02:46:54.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa359b8f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354154140 con 0x7fa3541578d0 2023-10-06T02:46:54.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa359b8f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35416b720 con 0x7fa354157ca0 2023-10-06T02:46:54.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa3537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35406d120 0x7fa354153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa3537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35406d120 0x7fa354153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51672/0 (socket says 172.21.15.81:51672) 2023-10-06T02:46:54.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa3537fe700 1 -- 172.21.15.81:0/4204875390 learned_addr learned my addr 172.21.15.81:0/4204875390 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:54.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa352ffd700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3541578d0 0x7fa35416b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa353fff700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa354157ca0 0x7fa35415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa3537fe700 1 -- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa354157ca0 msgr2=0x7fa35415da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa3537fe700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa354157ca0 0x7fa35415da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa3537fe700 1 -- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3541578d0 msgr2=0x7fa35416b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:54.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa3537fe700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3541578d0 0x7fa35416b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:54.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa3537fe700 1 -- 172.21.15.81:0/4204875390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3480094f0 con 0x7fa35406d120 2023-10-06T02:46:54.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa353fff700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa354157ca0 0x7fa35415da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:54.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa3537fe700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35406d120 0x7fa354153c00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa34400bc30 tx=0x7fa344009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa33b7fe700 1 -- 172.21.15.81:0/4204875390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3440092e0 con 0x7fa35406d120 2023-10-06T02:46:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa33b7fe700 1 -- 172.21.15.81:0/4204875390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34400c740 con 0x7fa35406d120 2023-10-06T02:46:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35416c300 con 0x7fa35406d120 2023-10-06T02:46:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.745+0000 7fa33b7fe700 1 -- 172.21.15.81:0/4204875390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34400cb20 con 0x7fa35406d120 2023-10-06T02:46:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.746+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35416ba50 con 0x7fa35406d120 2023-10-06T02:46:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.746+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa354067ac0 con 0x7fa35406d120 2023-10-06T02:46:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.747+0000 7fa33b7fe700 1 -- 172.21.15.81:0/4204875390 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa344012070 con 0x7fa35406d120 2023-10-06T02:46:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.747+0000 7fa33b7fe700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa340066f30 0x7fa3400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:54.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.747+0000 7fa33b7fe700 1 -- 172.21.15.81:0/4204875390 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa344083ed0 con 0x7fa35406d120 2023-10-06T02:46:54.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.747+0000 7fa352ffd700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa340066f30 0x7fa3400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:54.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.748+0000 7fa352ffd700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa340066f30 0x7fa3400693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3480099b0 tx=0x7fa348016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:54.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:54.751+0000 7fa33b7fe700 1 -- 172.21.15.81:0/4204875390 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa344051330 con 0x7fa35406d120 2023-10-06T02:46:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.008+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa3540d0450 con 0x7fa35406d120 2023-10-06T02:46:55.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.011+0000 7fa33b7fe700 1 -- 172.21.15.81:0/4204875390 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa344054950 con 0x7fa35406d120 2023-10-06T02:46:55.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa340066f30 msgr2=0x7fa3400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa340066f30 0x7fa3400693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3480099b0 tx=0x7fa348016000 comp rx=0 tx=0).stop 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35406d120 msgr2=0x7fa354153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35406d120 0x7fa354153c00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa34400bc30 tx=0x7fa344009840 comp rx=0 tx=0).stop 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 shutdown_connections 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa354157ca0 0x7fa35415da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35406d120 0x7fa354153c00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa340066f30 0x7fa3400693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 --2- 172.21.15.81:0/4204875390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3541578d0 0x7fa35416b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 >> 172.21.15.81:0/4204875390 conn(0x7fa35406bb90 msgr2=0x7fa354154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 shutdown_connections 2023-10-06T02:46:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.013+0000 7fa359b8f700 1 -- 172.21.15.81:0/4204875390 wait complete. 2023-10-06T02:46:55.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T02:46:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.139+0000 7f7b2e44c700 1 Processor -- start 2023-10-06T02:46:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.139+0000 7f7b2e44c700 1 -- start start 2023-10-06T02:46:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.140+0000 7f7b2e44c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b281578d0 0x7f7b280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.140+0000 7f7b2e44c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7b2806d120 0x7f7b2806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.140+0000 7f7b2e44c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2806dac0 con 0x7f7b28157ca0 2023-10-06T02:46:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.140+0000 7f7b2e44c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b280d07c0 con 0x7f7b2806d120 2023-10-06T02:46:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.140+0000 7f7b2e44c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280cfbb0 con 0x7f7b281578d0 2023-10-06T02:46:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b27fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b281578d0 0x7f7b280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b2c9e9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7b2806d120 0x7f7b2806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b277fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7b28157ca0 0x7f7b2815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:39958/0 (socket says 172.21.15.81:39958) 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b27fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b281578d0 0x7f7b280cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:46612/0 (socket says 172.21.15.81:46612) 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b2c9e9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7b2806d120 0x7f7b2806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:41066/0 (socket says 172.21.15.81:41066) 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b277fe700 1 -- 172.21.15.81:0/3622366097 learned_addr learned my addr 172.21.15.81:0/3622366097 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b27fff700 1 -- 172.21.15.81:0/3622366097 >> v2:172.21.15.83:3300/0 conn(0x7f7b2806d120 msgr2=0x7f7b2806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b27fff700 1 --2- 172.21.15.81:0/3622366097 >> v2:172.21.15.83:3300/0 conn(0x7f7b2806d120 0x7f7b2806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b27fff700 1 -- 172.21.15.81:0/3622366097 >> v1:172.21.15.83:6789/0 conn(0x7f7b28157ca0 legacy=0x7f7b2815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b27fff700 1 -- 172.21.15.81:0/3622366097 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280cfe90 con 0x7f7b281578d0 2023-10-06T02:46:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b27fff700 1 --2- 172.21.15.81:0/3622366097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b281578d0 0x7f7b280cf4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b180098e0 tx=0x7f7b180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0577e61bef97067 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b26ffd700 1 -- 172.21.15.81:0/3622366097 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800b640 con 0x7f7b281578d0 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b26ffd700 1 -- 172.21.15.81:0/3622366097 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1800b7a0 con 0x7f7b281578d0 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.141+0000 7f7b26ffd700 1 -- 172.21.15.81:0/3622366097 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800bb40 con 0x7f7b281578d0 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.142+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3622366097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b281578d0 msgr2=0x7f7b280cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.142+0000 7f7b2e44c700 1 --2- 172.21.15.81:0/3622366097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b281578d0 0x7f7b280cf4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b180098e0 tx=0x7f7b180091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.142+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3622366097 shutdown_connections 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.142+0000 7f7b2e44c700 1 --2- 172.21.15.81:0/3622366097 >> v2:172.21.15.83:3300/0 conn(0x7f7b2806d120 0x7f7b2806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.142+0000 7f7b2e44c700 1 --2- 172.21.15.81:0/3622366097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b281578d0 0x7f7b280cf4f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.142+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3622366097 >> 172.21.15.81:0/3622366097 conn(0x7f7b2806bb90 msgr2=0x7f7b2806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.142+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3622366097 shutdown_connections 2023-10-06T02:46:55.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.142+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3622366097 wait complete. 2023-10-06T02:46:55.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.143+0000 7f7b2e44c700 1 Processor -- start 2023-10-06T02:46:55.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.143+0000 7f7b2e44c700 1 -- start start 2023-10-06T02:46:55.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b2e44c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b2806d120 0x7f7b280cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b2e44c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281578d0 0x7f7b28153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b2e44c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28157ca0 0x7f7b2815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b2e44c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280c6fe0 con 0x7f7b281578d0 2023-10-06T02:46:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b2e44c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280c9f60 con 0x7f7b28157ca0 2023-10-06T02:46:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b2e44c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280c7250 con 0x7f7b2806d120 2023-10-06T02:46:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281578d0 0x7f7b28153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281578d0 0x7f7b28153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51678/0 (socket says 172.21.15.81:51678) 2023-10-06T02:46:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b277fe700 1 -- 172.21.15.81:0/3886148034 learned_addr learned my addr 172.21.15.81:0/3886148034 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b27fff700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b2806d120 0x7f7b280cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b2c9e9700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28157ca0 0x7f7b2815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b277fe700 1 -- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b2806d120 msgr2=0x7f7b280cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b277fe700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b2806d120 0x7f7b280cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b277fe700 1 -- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28157ca0 msgr2=0x7f7b2815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b277fe700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28157ca0 0x7f7b2815c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b277fe700 1 -- 172.21.15.81:0/3886148034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b18009420 con 0x7f7b281578d0 2023-10-06T02:46:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.144+0000 7f7b2c9e9700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28157ca0 0x7f7b2815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.145+0000 7f7b277fe700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281578d0 0x7f7b28153db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c560 tx=0x7f7b1c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.145+0000 7f7b0ffff700 1 -- 172.21.15.81:0/3886148034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c005b30 con 0x7f7b281578d0 2023-10-06T02:46:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.145+0000 7f7b0ffff700 1 -- 172.21.15.81:0/3886148034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c005cb0 con 0x7f7b281578d0 2023-10-06T02:46:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.145+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b280c7530 con 0x7f7b281578d0 2023-10-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.145+0000 7f7b0ffff700 1 -- 172.21.15.81:0/3886148034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c007320 con 0x7f7b281578d0 2023-10-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.145+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b281542f0 con 0x7f7b281578d0 2023-10-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.146+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2815d570 con 0x7f7b281578d0 2023-10-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.146+0000 7f7b0ffff700 1 -- 172.21.15.81:0/3886148034 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b1c01b3b0 con 0x7f7b281578d0 2023-10-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.147+0000 7f7b0ffff700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.147+0000 7f7b0ffff700 1 -- 172.21.15.81:0/3886148034 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7b1c0836c0 con 0x7f7b281578d0 2023-10-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.147+0000 7f7b27fff700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.147+0000 7f7b27fff700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7b180093f0 tx=0x7f7b18017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.151+0000 7f7b0ffff700 1 -- 172.21.15.81:0/3886148034 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b1c050b20 con 0x7f7b281578d0 2023-10-06T02:46:55.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.404+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7b2806dac0 con 0x7f7b281578d0 2023-10-06T02:46:55.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.407+0000 7f7b0ffff700 1 -- 172.21.15.81:0/3886148034 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7b2806dac0 con 0x7f7b281578d0 2023-10-06T02:46:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 msgr2=0x7f7b140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7b180093f0 tx=0x7f7b18017000 comp rx=0 tx=0).stop 2023-10-06T02:46:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281578d0 msgr2=0x7f7b28153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281578d0 0x7f7b28153db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c560 tx=0x7f7b1c001020 comp rx=0 tx=0).stop 2023-10-06T02:46:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 shutdown_connections 2023-10-06T02:46:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28157ca0 0x7f7b2815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b2806d120 0x7f7b280cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 --2- 172.21.15.81:0/3886148034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281578d0 0x7f7b28153db0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 >> 172.21.15.81:0/3886148034 conn(0x7f7b2806bb90 msgr2=0x7f7b280b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:55.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 shutdown_connections 2023-10-06T02:46:55.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.409+0000 7f7b2e44c700 1 -- 172.21.15.81:0/3886148034 wait complete. 2023-10-06T02:46:55.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T02:46:55.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.536+0000 7efd7045f700 1 Processor -- start 2023-10-06T02:46:55.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.536+0000 7efd7045f700 1 -- start start 2023-10-06T02:46:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.537+0000 7efd7045f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efd681578d0 0x7efd680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.537+0000 7efd7045f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd68157ca0 0x7efd6815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.537+0000 7efd7045f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6806d120 0x7efd6806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.537+0000 7efd7045f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680d07c0 con 0x7efd68157ca0 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.537+0000 7efd7045f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6806daa0 con 0x7efd681578d0 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.537+0000 7efd7045f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680cfbb0 con 0x7efd6806d120 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.537+0000 7efd6d9fa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd68157ca0 0x7efd6815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d9fa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd68157ca0 0x7efd6815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51692/0 (socket says 172.21.15.81:51692) 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d9fa700 1 -- 172.21.15.81:0/762699726 learned_addr learned my addr 172.21.15.81:0/762699726 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6e9fc700 1 --2- 172.21.15.81:0/762699726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6806d120 0x7efd6806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6e1fb700 1 --2- 172.21.15.81:0/762699726 >> v2:172.21.15.83:3300/0 conn(0x7efd681578d0 0x7efd680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d9fa700 1 -- 172.21.15.81:0/762699726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6806d120 msgr2=0x7efd6806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d9fa700 1 --2- 172.21.15.81:0/762699726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6806d120 0x7efd6806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d9fa700 1 -- 172.21.15.81:0/762699726 >> v2:172.21.15.83:3300/0 conn(0x7efd681578d0 msgr2=0x7efd680cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d9fa700 1 --2- 172.21.15.81:0/762699726 >> v2:172.21.15.83:3300/0 conn(0x7efd681578d0 0x7efd680cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d9fa700 1 -- 172.21.15.81:0/762699726 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680cfe90 con 0x7efd68157ca0 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d9fa700 1 --2- 172.21.15.81:0/762699726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 0x7efd6815af00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efd680646b0 tx=0x7efd58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b849ee531c8094 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d1f9700 1 -- 172.21.15.81:0/762699726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800b640 con 0x7efd68157ca0 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d1f9700 1 -- 172.21.15.81:0/762699726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800b7a0 con 0x7efd68157ca0 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.538+0000 7efd6d1f9700 1 -- 172.21.15.81:0/762699726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800bb60 con 0x7efd68157ca0 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.539+0000 7efd7045f700 1 -- 172.21.15.81:0/762699726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 msgr2=0x7efd6815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.539+0000 7efd7045f700 1 --2- 172.21.15.81:0/762699726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 0x7efd6815af00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efd680646b0 tx=0x7efd58009250 comp rx=0 tx=0).stop 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.539+0000 7efd7045f700 1 -- 172.21.15.81:0/762699726 shutdown_connections 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.539+0000 7efd7045f700 1 --2- 172.21.15.81:0/762699726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6806d120 0x7efd6806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.539+0000 7efd7045f700 1 --2- 172.21.15.81:0/762699726 >> v2:172.21.15.83:3300/0 conn(0x7efd681578d0 0x7efd680cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.539+0000 7efd7045f700 1 --2- 172.21.15.81:0/762699726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 0x7efd6815af00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.539+0000 7efd7045f700 1 -- 172.21.15.81:0/762699726 >> 172.21.15.81:0/762699726 conn(0x7efd6806bb90 msgr2=0x7efd6806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:55.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.539+0000 7efd7045f700 1 -- 172.21.15.81:0/762699726 shutdown_connections 2023-10-06T02:46:55.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.539+0000 7efd7045f700 1 -- 172.21.15.81:0/762699726 wait complete. 2023-10-06T02:46:55.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.540+0000 7efd7045f700 1 Processor -- start 2023-10-06T02:46:55.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.540+0000 7efd7045f700 1 -- start start 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.540+0000 7efd7045f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6806d120 0x7efd68144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd7045f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd681578d0 0x7efd68159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd7045f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 0x7efd681598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd7045f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68145150 con 0x7efd68157ca0 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd7045f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680b22e0 con 0x7efd6806d120 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd7045f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680b25c0 con 0x7efd681578d0 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e9fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 0x7efd681598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e9fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 0x7efd681598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51700/0 (socket says 172.21.15.81:51700) 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e9fc700 1 -- 172.21.15.81:0/3535274209 learned_addr learned my addr 172.21.15.81:0/3535274209 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e1fb700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6806d120 0x7efd68144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6d9fa700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd681578d0 0x7efd68159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e9fc700 1 -- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd681578d0 msgr2=0x7efd68159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e9fc700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd681578d0 0x7efd68159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e9fc700 1 -- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6806d120 msgr2=0x7efd68144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e9fc700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6806d120 0x7efd68144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e9fc700 1 -- 172.21.15.81:0/3535274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580094f0 con 0x7efd68157ca0 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6d9fa700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd681578d0 0x7efd68159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd6e9fc700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 0x7efd681598b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efd60009e90 tx=0x7efd6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd5e7fc700 1 -- 172.21.15.81:0/3535274209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6000cc20 con 0x7efd68157ca0 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd5e7fc700 1 -- 172.21.15.81:0/3535274209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6000f040 con 0x7efd68157ca0 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd68144b00 con 0x7efd68157ca0 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd5e7fc700 1 -- 172.21.15.81:0/3535274209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60014480 con 0x7efd68157ca0 2023-10-06T02:46:55.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.541+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd68144670 con 0x7efd68157ca0 2023-10-06T02:46:55.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.542+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd68067ac0 con 0x7efd68157ca0 2023-10-06T02:46:55.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.543+0000 7efd5e7fc700 1 -- 172.21.15.81:0/3535274209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd60014830 con 0x7efd68157ca0 2023-10-06T02:46:55.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.543+0000 7efd5e7fc700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd4c066f30 0x7efd4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.543+0000 7efd5e7fc700 1 -- 172.21.15.81:0/3535274209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efd60084df0 con 0x7efd68157ca0 2023-10-06T02:46:55.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.543+0000 7efd6e1fb700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd4c066f30 0x7efd4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.544+0000 7efd6e1fb700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd4c066f30 0x7efd4c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd64009db0 tx=0x7efd640091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:55.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.547+0000 7efd5e7fc700 1 -- 172.21.15.81:0/3535274209 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd60055ce0 con 0x7efd68157ca0 2023-10-06T02:46:55.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.802+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7efd68145290 con 0x7efd68157ca0 2023-10-06T02:46:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.806+0000 7efd5e7fc700 1 -- 172.21.15.81:0/3535274209 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7efd60055870 con 0x7efd68157ca0 2023-10-06T02:46:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.807+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd4c066f30 msgr2=0x7efd4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.807+0000 7efd7045f700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd4c066f30 0x7efd4c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd64009db0 tx=0x7efd640091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.807+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 msgr2=0x7efd681598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.807+0000 7efd7045f700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 0x7efd681598b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efd60009e90 tx=0x7efd6000b040 comp rx=0 tx=0).stop 2023-10-06T02:46:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.808+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 shutdown_connections 2023-10-06T02:46:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.808+0000 7efd7045f700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd68157ca0 0x7efd681598b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.808+0000 7efd7045f700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd4c066f30 0x7efd4c0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.808+0000 7efd7045f700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6806d120 0x7efd68144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.808+0000 7efd7045f700 1 --2- 172.21.15.81:0/3535274209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd681578d0 0x7efd68159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.808+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 >> 172.21.15.81:0/3535274209 conn(0x7efd6806bb90 msgr2=0x7efd6806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.808+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 shutdown_connections 2023-10-06T02:46:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.808+0000 7efd7045f700 1 -- 172.21.15.81:0/3535274209 wait complete. 2023-10-06T02:46:55.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T02:46:55.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.935+0000 7fe91ee43700 1 Processor -- start 2023-10-06T02:46:55.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.935+0000 7fe91ee43700 1 -- start start 2023-10-06T02:46:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91ee43700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe9181578d0 0x7fe9180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91ee43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe918157ca0 0x7fe91815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91ee43700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9180d07c0 con 0x7fe91806d120 2023-10-06T02:46:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91ee43700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9180cfbb0 con 0x7fe9181578d0 2023-10-06T02:46:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91ee43700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180cfe90 con 0x7fe918157ca0 2023-10-06T02:46:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe917fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe918157ca0 0x7fe91815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91cbdf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe9181578d0 0x7fe9180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91d3e0700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe91806d120 0x7fe91815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:39962/0 (socket says 172.21.15.81:39962) 2023-10-06T02:46:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91d3e0700 1 -- 172.21.15.81:0/3097356595 learned_addr learned my addr 172.21.15.81:0/3097356595 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91cbdf700 1 -- 172.21.15.81:0/3097356595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe918157ca0 msgr2=0x7fe91815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91cbdf700 1 --2- 172.21.15.81:0/3097356595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe918157ca0 0x7fe91815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91cbdf700 1 -- 172.21.15.81:0/3097356595 >> v1:172.21.15.83:6789/0 conn(0x7fe91806d120 legacy=0x7fe91815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.936+0000 7fe91cbdf700 1 -- 172.21.15.81:0/3097356595 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9180d0170 con 0x7fe9181578d0 2023-10-06T02:46:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe91cbdf700 1 --2- 172.21.15.81:0/3097356595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9181578d0 0x7fe9180cf4f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9100098e0 tx=0x7fe9100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28eda84a71d17251 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe9177fe700 1 -- 172.21.15.81:0/3097356595 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910011630 con 0x7fe9181578d0 2023-10-06T02:46:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe9177fe700 1 -- 172.21.15.81:0/3097356595 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910011790 con 0x7fe9181578d0 2023-10-06T02:46:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe9177fe700 1 -- 172.21.15.81:0/3097356595 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910011b30 con 0x7fe9181578d0 2023-10-06T02:46:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe91ee43700 1 -- 172.21.15.81:0/3097356595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9181578d0 msgr2=0x7fe9180cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe91ee43700 1 --2- 172.21.15.81:0/3097356595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9181578d0 0x7fe9180cf4f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9100098e0 tx=0x7fe9100091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe91ee43700 1 -- 172.21.15.81:0/3097356595 shutdown_connections 2023-10-06T02:46:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe91ee43700 1 --2- 172.21.15.81:0/3097356595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9181578d0 0x7fe9180cf4f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe91ee43700 1 --2- 172.21.15.81:0/3097356595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe918157ca0 0x7fe91815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe91ee43700 1 -- 172.21.15.81:0/3097356595 >> 172.21.15.81:0/3097356595 conn(0x7fe91806bb90 msgr2=0x7fe91806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe91ee43700 1 -- 172.21.15.81:0/3097356595 shutdown_connections 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.937+0000 7fe91ee43700 1 -- 172.21.15.81:0/3097356595 wait complete. 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.938+0000 7fe91ee43700 1 Processor -- start 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.939+0000 7fe91ee43700 1 -- start start 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.939+0000 7fe91ee43700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe91806d120 0x7fe918069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.939+0000 7fe91ee43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9181578d0 0x7fe91816ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.939+0000 7fe91ee43700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe918157ca0 0x7fe91816b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.939+0000 7fe91ee43700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91816b9b0 con 0x7fe918157ca0 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.939+0000 7fe91ee43700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91816b700 con 0x7fe91806d120 2023-10-06T02:46:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.939+0000 7fe91ee43700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91816bce0 con 0x7fe9181578d0 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91d3e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe918157ca0 0x7fe91816b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91cbdf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe91806d120 0x7fe918069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91d3e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe918157ca0 0x7fe91816b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51702/0 (socket says 172.21.15.81:51702) 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91d3e0700 1 -- 172.21.15.81:0/3020812425 learned_addr learned my addr 172.21.15.81:0/3020812425 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe917fff700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9181578d0 0x7fe91816ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91d3e0700 1 -- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9181578d0 msgr2=0x7fe91816ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91d3e0700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9181578d0 0x7fe91816ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91d3e0700 1 -- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe91806d120 msgr2=0x7fe918069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91d3e0700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe91806d120 0x7fe918069e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91d3e0700 1 -- 172.21.15.81:0/3020812425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910009420 con 0x7fe918157ca0 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91cbdf700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe91806d120 0x7fe918069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:46:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91d3e0700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe918157ca0 0x7fe91816b1c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe90000c7e0 tx=0x7fe900007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe914ff9700 1 -- 172.21.15.81:0/3020812425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900005b30 con 0x7fe918157ca0 2023-10-06T02:46:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe914ff9700 1 -- 172.21.15.81:0/3020812425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe900005c90 con 0x7fe918157ca0 2023-10-06T02:46:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91816bfc0 con 0x7fe918157ca0 2023-10-06T02:46:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe914ff9700 1 -- 172.21.15.81:0/3020812425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900007320 con 0x7fe918157ca0 2023-10-06T02:46:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.940+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91816c580 con 0x7fe918157ca0 2023-10-06T02:46:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.941+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91806e7a0 con 0x7fe918157ca0 2023-10-06T02:46:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.942+0000 7fe914ff9700 1 -- 172.21.15.81:0/3020812425 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe900007690 con 0x7fe918157ca0 2023-10-06T02:46:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.942+0000 7fe914ff9700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8f8066f30 0x7fe8f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.942+0000 7fe914ff9700 1 -- 172.21.15.81:0/3020812425 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe9000837d0 con 0x7fe918157ca0 2023-10-06T02:46:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.942+0000 7fe91cbdf700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8f8066f30 0x7fe8f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.943+0000 7fe91cbdf700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8f8066f30 0x7fe8f80693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9100093f0 tx=0x7fe910016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:55.946+0000 7fe914ff9700 1 -- 172.21.15.81:0/3020812425 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe900050c30 con 0x7fe918157ca0 2023-10-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.201+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe9180d0450 con 0x7fe918157ca0 2023-10-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.205+0000 7fe914ff9700 1 -- 172.21.15.81:0/3020812425 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe900017020 con 0x7fe918157ca0 2023-10-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8f8066f30 msgr2=0x7fe8f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8f8066f30 0x7fe8f80693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9100093f0 tx=0x7fe910016000 comp rx=0 tx=0).stop 2023-10-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe918157ca0 msgr2=0x7fe91816b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe918157ca0 0x7fe91816b1c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe90000c7e0 tx=0x7fe900007ea0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 shutdown_connections 2023-10-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe918157ca0 0x7fe91816b1c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8f8066f30 0x7fe8f80693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe91806d120 0x7fe918069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 --2- 172.21.15.81:0/3020812425 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9181578d0 0x7fe91816ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 >> 172.21.15.81:0/3020812425 conn(0x7fe91806bb90 msgr2=0x7fe91815e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 shutdown_connections 2023-10-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.207+0000 7fe91ee43700 1 -- 172.21.15.81:0/3020812425 wait complete. 2023-10-06T02:46:56.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.332+0000 7f9b89db3700 1 Processor -- start 2023-10-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.332+0000 7f9b89db3700 1 -- start start 2023-10-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b89db3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b84157ca0 0x7f9b840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b89db3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9b8406d120 0x7f9b8406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b89db3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b840d07c0 con 0x7f9b841578d0 2023-10-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b89db3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8406da50 con 0x7f9b84157ca0 2023-10-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b89db3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b840cfbb0 con 0x7f9b8406d120 2023-10-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b7affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b84157ca0 0x7f9b840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b7affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b84157ca0 0x7f9b840cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51714/0 (socket says 172.21.15.81:51714) 2023-10-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b7affd700 1 -- 172.21.15.81:0/1179488847 learned_addr learned my addr 172.21.15.81:0/1179488847 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b83fff700 1 --2- 172.21.15.81:0/1179488847 >> v2:172.21.15.83:3300/0 conn(0x7f9b8406d120 0x7f9b8406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b7affd700 1 -- 172.21.15.81:0/1179488847 >> v2:172.21.15.83:3300/0 conn(0x7f9b8406d120 msgr2=0x7f9b8406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b7affd700 1 --2- 172.21.15.81:0/1179488847 >> v2:172.21.15.83:3300/0 conn(0x7f9b8406d120 0x7f9b8406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b7affd700 1 -- 172.21.15.81:0/1179488847 >> v1:172.21.15.83:6789/0 conn(0x7f9b841578d0 legacy=0x7f9b8415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b7affd700 1 -- 172.21.15.81:0/1179488847 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840cfe90 con 0x7f9b84157ca0 2023-10-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b7affd700 1 --2- 172.21.15.81:0/1179488847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b84157ca0 0x7f9b840cf4f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9b84068300 tx=0x7f9b6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca514bec1592f07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b82ffd700 1 -- 172.21.15.81:0/1179488847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00b860 con 0x7f9b84157ca0 2023-10-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b82ffd700 1 -- 172.21.15.81:0/1179488847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c00b9c0 con 0x7f9b84157ca0 2023-10-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.333+0000 7f9b82ffd700 1 -- 172.21.15.81:0/1179488847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00bd60 con 0x7f9b84157ca0 2023-10-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.334+0000 7f9b89db3700 1 -- 172.21.15.81:0/1179488847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b84157ca0 msgr2=0x7f9b840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.334+0000 7f9b89db3700 1 --2- 172.21.15.81:0/1179488847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b84157ca0 0x7f9b840cf4f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9b84068300 tx=0x7f9b6c009250 comp rx=0 tx=0).stop 2023-10-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.334+0000 7f9b89db3700 1 -- 172.21.15.81:0/1179488847 shutdown_connections 2023-10-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.334+0000 7f9b89db3700 1 --2- 172.21.15.81:0/1179488847 >> v2:172.21.15.83:3300/0 conn(0x7f9b8406d120 0x7f9b8406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.334+0000 7f9b89db3700 1 --2- 172.21.15.81:0/1179488847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b84157ca0 0x7f9b840cf4f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.334+0000 7f9b89db3700 1 -- 172.21.15.81:0/1179488847 >> 172.21.15.81:0/1179488847 conn(0x7f9b8406bb90 msgr2=0x7f9b8406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.334+0000 7f9b89db3700 1 -- 172.21.15.81:0/1179488847 shutdown_connections 2023-10-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.334+0000 7f9b89db3700 1 -- 172.21.15.81:0/1179488847 wait complete. 2023-10-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.335+0000 7f9b89db3700 1 Processor -- start 2023-10-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.335+0000 7f9b89db3700 1 -- start start 2023-10-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b89db3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8406d120 0x7f9b840cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b89db3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b841578d0 0x7f9b8416aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b89db3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b84157ca0 0x7f9b8416b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b89db3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84152810 con 0x7f9b8406d120 2023-10-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b89db3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840b5db0 con 0x7f9b84157ca0 2023-10-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b89db3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8416a5e0 con 0x7f9b841578d0 2023-10-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8406d120 0x7f9b840cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8406d120 0x7f9b840cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51726/0 (socket says 172.21.15.81:51726) 2023-10-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b837fe700 1 -- 172.21.15.81:0/1994590156 learned_addr learned my addr 172.21.15.81:0/1994590156 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b7affd700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b841578d0 0x7f9b8416aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b83fff700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b84157ca0 0x7f9b8416b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b837fe700 1 -- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b841578d0 msgr2=0x7f9b8416aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b837fe700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b841578d0 0x7f9b8416aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b837fe700 1 -- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b84157ca0 msgr2=0x7f9b8416b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b837fe700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b84157ca0 0x7f9b8416b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b837fe700 1 -- 172.21.15.81:0/1994590156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c0094f0 con 0x7f9b8406d120 2023-10-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.336+0000 7f9b83fff700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b84157ca0 0x7f9b8416b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.337+0000 7f9b837fe700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8406d120 0x7f9b840cd5c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400cb40 tx=0x7f9b740017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.337+0000 7f9b7bfff700 1 -- 172.21.15.81:0/1994590156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400a7a0 con 0x7f9b8406d120 2023-10-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.337+0000 7f9b7bfff700 1 -- 172.21.15.81:0/1994590156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7400a920 con 0x7f9b8406d120 2023-10-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.337+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b840b6000 con 0x7f9b8406d120 2023-10-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.337+0000 7f9b7bfff700 1 -- 172.21.15.81:0/1994590156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400ace0 con 0x7f9b8406d120 2023-10-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.337+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b840b65c0 con 0x7f9b8406d120 2023-10-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.338+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b84067ac0 con 0x7f9b8406d120 2023-10-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.338+0000 7f9b7bfff700 1 -- 172.21.15.81:0/1994590156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b74003030 con 0x7f9b8406d120 2023-10-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.338+0000 7f9b7bfff700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b64066f30 0x7f9b640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.338+0000 7f9b7bfff700 1 -- 172.21.15.81:0/1994590156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9b74084440 con 0x7f9b8406d120 2023-10-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.339+0000 7f9b7affd700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b64066f30 0x7f9b640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.339+0000 7f9b7affd700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b64066f30 0x7f9b640693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9b84068300 tx=0x7f9b6c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.343+0000 7f9b7bfff700 1 -- 172.21.15.81:0/1994590156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b740518a0 con 0x7f9b8406d120 2023-10-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.526+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b840d0170 con 0x7f9b8406d120 2023-10-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.527+0000 7f9b7bfff700 1 -- 172.21.15.81:0/1994590156 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13602 (secure 0 0 0) 0x7f9b74054ec0 con 0x7f9b8406d120 2023-10-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:53.411223+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b64066f30 msgr2=0x7f9b640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b64066f30 0x7f9b640693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9b84068300 tx=0x7f9b6c017000 comp rx=0 tx=0).stop 2023-10-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8406d120 msgr2=0x7f9b840cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8406d120 0x7f9b840cd5c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400cb40 tx=0x7f9b740017b0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 shutdown_connections 2023-10-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b64066f30 0x7f9b640693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b84157ca0 0x7f9b8416b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8406d120 0x7f9b840cd5c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 --2- 172.21.15.81:0/1994590156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b841578d0 0x7f9b8416aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 >> 172.21.15.81:0/1994590156 conn(0x7f9b8406bb90 msgr2=0x7f9b8415c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 shutdown_connections 2023-10-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.529+0000 7f9b89db3700 1 -- 172.21.15.81:0/1994590156 wait complete. 2023-10-06T02:46:56.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:46:56.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.659+0000 7fc29e7a8700 1 Processor -- start 2023-10-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.659+0000 7fc29e7a8700 1 -- start start 2023-10-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.660+0000 7fc29e7a8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc29806d830 0x7fc2980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.660+0000 7fc29e7a8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2980d07c0 con 0x7fc2981578d0 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.660+0000 7fc29e7a8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2980cfbb0 con 0x7fc298157ca0 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.660+0000 7fc29e7a8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2980cfe90 con 0x7fc29806d830 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.660+0000 7fc297fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc2981578d0 0x7fc29815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55892/0 (socket says 172.21.15.81:55892) 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.660+0000 7fc297fff700 1 -- 172.21.15.81:0/3735270035 learned_addr learned my addr 172.21.15.81:0/3735270035 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.660+0000 7fc29cd45700 1 --2- 172.21.15.81:0/3735270035 >> v2:172.21.15.83:3300/0 conn(0x7fc29806d830 0x7fc2980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.660+0000 7fc296ffd700 1 -- 172.21.15.81:0/3735270035 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045528943 0 0) 0x7fc2980d07c0 con 0x7fc2981578d0 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.660+0000 7fc296ffd700 1 -- 172.21.15.81:0/3735270035 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc280003570 con 0x7fc2981578d0 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc296ffd700 1 -- 172.21.15.81:0/3735270035 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335057574 0 0) 0x7fc2980cfbb0 con 0x7fc298157ca0 2023-10-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc296ffd700 1 -- 172.21.15.81:0/3735270035 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2980d07c0 con 0x7fc298157ca0 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc296ffd700 1 -- 172.21.15.81:0/3735270035 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 31283217 0 0) 0x7fc280003570 con 0x7fc2981578d0 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc29cd45700 1 -- 172.21.15.81:0/3735270035 >> v1:172.21.15.83:6789/0 conn(0x7fc298157ca0 legacy=0x7fc29806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc29cd45700 1 -- 172.21.15.81:0/3735270035 >> v1:172.21.15.81:6789/0 conn(0x7fc2981578d0 legacy=0x7fc29815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc29cd45700 1 -- 172.21.15.81:0/3735270035 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980d0170 con 0x7fc29806d830 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc29cd45700 1 --2- 172.21.15.81:0/3735270035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 0x7fc2980cf4f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc290009e60 tx=0x7fc290009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2309bb861bc66df9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc296ffd700 1 -- 172.21.15.81:0/3735270035 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000e070 con 0x7fc29806d830 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc296ffd700 1 -- 172.21.15.81:0/3735270035 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29000b7a0 con 0x7fc29806d830 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc296ffd700 1 -- 172.21.15.81:0/3735270035 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288001470 con 0x7fc29806d830 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc29e7a8700 1 -- 172.21.15.81:0/3735270035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 msgr2=0x7fc2980cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc29e7a8700 1 --2- 172.21.15.81:0/3735270035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 0x7fc2980cf4f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc290009e60 tx=0x7fc290009780 comp rx=0 tx=0).stop 2023-10-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.661+0000 7fc29e7a8700 1 -- 172.21.15.81:0/3735270035 shutdown_connections 2023-10-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.662+0000 7fc29e7a8700 1 --2- 172.21.15.81:0/3735270035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 0x7fc2980cf4f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.662+0000 7fc29e7a8700 1 -- 172.21.15.81:0/3735270035 >> 172.21.15.81:0/3735270035 conn(0x7fc29806bb90 msgr2=0x7fc29806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.662+0000 7fc29e7a8700 1 -- 172.21.15.81:0/3735270035 shutdown_connections 2023-10-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.662+0000 7fc29e7a8700 1 -- 172.21.15.81:0/3735270035 wait complete. 2023-10-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.663+0000 7fc29e7a8700 1 Processor -- start 2023-10-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.663+0000 7fc29e7a8700 1 -- start start 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.663+0000 7fc29e7a8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 0x7fc2980b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.663+0000 7fc29e7a8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2981578d0 0x7fc2980b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.663+0000 7fc29e7a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc298157ca0 0x7fc2981486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.663+0000 7fc29e7a8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980b4b50 con 0x7fc298157ca0 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.663+0000 7fc29e7a8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980b4e30 con 0x7fc29806d830 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.663+0000 7fc29e7a8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980b5110 con 0x7fc2981578d0 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29cd45700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc298157ca0 0x7fc2981486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29cd45700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc298157ca0 0x7fc2981486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51742/0 (socket says 172.21.15.81:51742) 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29cd45700 1 -- 172.21.15.81:0/2607827205 learned_addr learned my addr 172.21.15.81:0/2607827205 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc297fff700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 0x7fc2980b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc2977fe700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2981578d0 0x7fc2980b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29cd45700 1 -- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2981578d0 msgr2=0x7fc2980b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29cd45700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2981578d0 0x7fc2980b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29cd45700 1 -- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 msgr2=0x7fc2980b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29cd45700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 0x7fc2980b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29cd45700 1 -- 172.21.15.81:0/2607827205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc290009a20 con 0x7fc298157ca0 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc297fff700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 0x7fc2980b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29cd45700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc298157ca0 0x7fc2981486f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc29806fe20 tx=0x7fc290017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc27ffff700 1 -- 172.21.15.81:0/2607827205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290012da0 con 0x7fc298157ca0 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc27ffff700 1 -- 172.21.15.81:0/2607827205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29001e450 con 0x7fc298157ca0 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2980b53f0 con 0x7fc298157ca0 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc27ffff700 1 -- 172.21.15.81:0/2607827205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29001e7f0 con 0x7fc298157ca0 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.664+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29816a020 con 0x7fc298157ca0 2023-10-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.665+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29816a2d0 con 0x7fc298157ca0 2023-10-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.665+0000 7fc27ffff700 1 -- 172.21.15.81:0/2607827205 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc29001eb60 con 0x7fc298157ca0 2023-10-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.666+0000 7fc27ffff700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc284066f30 0x7fc2840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.666+0000 7fc27ffff700 1 -- 172.21.15.81:0/2607827205 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc290086620 con 0x7fc298157ca0 2023-10-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.666+0000 7fc297fff700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc284066f30 0x7fc2840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.666+0000 7fc297fff700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc284066f30 0x7fc2840693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2880011e0 tx=0x7fc288000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.670+0000 7fc27ffff700 1 -- 172.21.15.81:0/2607827205 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc290053a80 con 0x7fc298157ca0 2023-10-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.851+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2980d0450 con 0x7fc298157ca0 2023-10-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.851+0000 7fc27ffff700 1 -- 172.21.15.81:0/2607827205 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2900570a0 con 0x7fc298157ca0 2023-10-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc284066f30 msgr2=0x7fc2840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc284066f30 0x7fc2840693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2880011e0 tx=0x7fc288000bc0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc298157ca0 msgr2=0x7fc2981486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc298157ca0 0x7fc2981486f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc29806fe20 tx=0x7fc290017000 comp rx=0 tx=0).stop 2023-10-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 shutdown_connections 2023-10-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc298157ca0 0x7fc2981486f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc284066f30 0x7fc2840693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc29806d830 0x7fc2980b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 --2- 172.21.15.81:0/2607827205 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2981578d0 0x7fc2980b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.853+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 >> 172.21.15.81:0/2607827205 conn(0x7fc29806bb90 msgr2=0x7fc298156980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.854+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 shutdown_connections 2023-10-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.854+0000 7fc29e7a8700 1 -- 172.21.15.81:0/2607827205 wait complete. 2023-10-06T02:46:56.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.982+0000 7f361d215700 1 Processor -- start 2023-10-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.982+0000 7f361d215700 1 -- start start 2023-10-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.983+0000 7f361d215700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3618157ca0 0x7f36180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.983+0000 7f361d215700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36180d07c0 con 0x7f36181578d0 2023-10-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.983+0000 7f361d215700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36180cfbb0 con 0x7f361806d120 2023-10-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.983+0000 7f361d215700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36180cfe90 con 0x7f3618157ca0 2023-10-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.983+0000 7f3616d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f36181578d0 0x7f361815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55898/0 (socket says 172.21.15.81:55898) 2023-10-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.983+0000 7f3616d9d700 1 -- 172.21.15.81:0/2209359375 learned_addr learned my addr 172.21.15.81:0/2209359375 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.983+0000 7f360e59c700 1 --2- 172.21.15.81:0/2209359375 >> v2:172.21.15.83:3300/0 conn(0x7f3618157ca0 0x7f36180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.983+0000 7f361659c700 1 -- 172.21.15.81:0/2209359375 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800292826 0 0) 0x7f36180d07c0 con 0x7f36181578d0 2023-10-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.983+0000 7f361659c700 1 -- 172.21.15.81:0/2209359375 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3604003570 con 0x7f36181578d0 2023-10-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f360e59c700 1 -- 172.21.15.81:0/2209359375 >> v1:172.21.15.83:6789/0 conn(0x7f361806d120 legacy=0x7f361806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f361659c700 1 -- 172.21.15.81:0/2209359375 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364160711 0 0) 0x7f36180cfbb0 con 0x7f361806d120 2023-10-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f360e59c700 1 -- 172.21.15.81:0/2209359375 >> v1:172.21.15.81:6789/0 conn(0x7f36181578d0 legacy=0x7f361815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f360e59c700 1 -- 172.21.15.81:0/2209359375 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36180d0170 con 0x7f3618157ca0 2023-10-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f360e59c700 1 --2- 172.21.15.81:0/2209359375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 0x7f36180cf4f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f36000098e0 tx=0x7f36000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74842c21d0cbe797 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f361659c700 1 -- 172.21.15.81:0/2209359375 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000b640 con 0x7f3618157ca0 2023-10-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f361659c700 1 -- 172.21.15.81:0/2209359375 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360000b7a0 con 0x7f3618157ca0 2023-10-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f361659c700 1 -- 172.21.15.81:0/2209359375 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000bb40 con 0x7f3618157ca0 2023-10-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f361d215700 1 -- 172.21.15.81:0/2209359375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 msgr2=0x7f36180cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f361d215700 1 --2- 172.21.15.81:0/2209359375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 0x7f36180cf4f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f36000098e0 tx=0x7f36000091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f361d215700 1 -- 172.21.15.81:0/2209359375 shutdown_connections 2023-10-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f361d215700 1 --2- 172.21.15.81:0/2209359375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 0x7f36180cf4f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.984+0000 7f361d215700 1 -- 172.21.15.81:0/2209359375 >> 172.21.15.81:0/2209359375 conn(0x7f361806bb90 msgr2=0x7f361806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.985+0000 7f361d215700 1 -- 172.21.15.81:0/2209359375 shutdown_connections 2023-10-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.985+0000 7f361d215700 1 -- 172.21.15.81:0/2209359375 wait complete. 2023-10-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.986+0000 7f361d215700 1 Processor -- start 2023-10-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.986+0000 7f361d215700 1 -- start start 2023-10-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.986+0000 7f361d215700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f361806d120 0x7f36180ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.986+0000 7f361d215700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36181578d0 0x7f36180ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.986+0000 7f361d215700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 0x7f3618147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.986+0000 7f361d215700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36180ab270 con 0x7f361806d120 2023-10-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.986+0000 7f361d215700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618155160 con 0x7f3618157ca0 2023-10-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.986+0000 7f361d215700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36180ab4b0 con 0x7f36181578d0 2023-10-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f3616d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f361806d120 0x7f36180ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f3616d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f361806d120 0x7f36180ac550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51748/0 (socket says 172.21.15.81:51748) 2023-10-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f3616d9d700 1 -- 172.21.15.81:0/2018755208 learned_addr learned my addr 172.21.15.81:0/2018755208 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f361759e700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 0x7f3618147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f360e59c700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36181578d0 0x7f36180ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f3616d9d700 1 -- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36181578d0 msgr2=0x7f36180ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f3616d9d700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36181578d0 0x7f36180ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f3616d9d700 1 -- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 msgr2=0x7f3618147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f3616d9d700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 0x7f3618147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f3616d9d700 1 -- 172.21.15.81:0/2018755208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600009420 con 0x7f361806d120 2023-10-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f361759e700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 0x7f3618147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f360e59c700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36181578d0 0x7f36180ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f3616d9d700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f361806d120 0x7f36180ac550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f36080011e0 tx=0x7f3608007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f360f7fe700 1 -- 172.21.15.81:0/2018755208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608005b30 con 0x7f361806d120 2023-10-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f360f7fe700 1 -- 172.21.15.81:0/2018755208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3608005c90 con 0x7f361806d120 2023-10-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36180ab790 con 0x7f361806d120 2023-10-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f360f7fe700 1 -- 172.21.15.81:0/2018755208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36080072e0 con 0x7f361806d120 2023-10-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.987+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36180abd50 con 0x7f361806d120 2023-10-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.988+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361806e700 con 0x7f361806d120 2023-10-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.988+0000 7f360f7fe700 1 -- 172.21.15.81:0/2018755208 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3608007650 con 0x7f361806d120 2023-10-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.989+0000 7f360f7fe700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.989+0000 7f360f7fe700 1 -- 172.21.15.81:0/2018755208 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3608083760 con 0x7f361806d120 2023-10-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.989+0000 7f360e59c700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.990+0000 7f360e59c700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36181580c0 tx=0x7f3600017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:56.993+0000 7f360f7fe700 1 -- 172.21.15.81:0/2018755208 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f360804b5a0 con 0x7f361806d120 2023-10-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.173+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36180d0450 con 0x7f361806d120 2023-10-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.173+0000 7f360f7fe700 1 -- 172.21.15.81:0/2018755208 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36080170a0 con 0x7f361806d120 2023-10-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 msgr2=0x7f35f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36181580c0 tx=0x7f3600017000 comp rx=0 tx=0).stop 2023-10-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f361806d120 msgr2=0x7f36180ac550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f361806d120 0x7f36180ac550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f36080011e0 tx=0x7f3608007df0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 shutdown_connections 2023-10-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3618157ca0 0x7f3618147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f361806d120 0x7f36180ac550 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 --2- 172.21.15.81:0/2018755208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36181578d0 0x7f36180ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 >> 172.21.15.81:0/2018755208 conn(0x7f361806bb90 msgr2=0x7f3618069110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 shutdown_connections 2023-10-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.175+0000 7f361d215700 1 -- 172.21.15.81:0/2018755208 wait complete. 2023-10-06T02:46:57.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.300+0000 7f0f2e2a7700 1 Processor -- start 2023-10-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.300+0000 7f0f2e2a7700 1 -- start start 2023-10-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2e2a7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28159bc0 0x7f0f280b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2e2a7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0f28159f90 0x7f0f2806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2e2a7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f28068370 0x7f0f280ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2e2a7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f28067640 con 0x7f0f28068370 2023-10-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2e2a7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f280b1e50 con 0x7f0f28159f90 2023-10-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2e2a7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28067890 con 0x7f0f28159bc0 2023-10-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2daa6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f28068370 0x7f0f280ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2daa6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f28068370 0x7f0f280ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51754/0 (socket says 172.21.15.81:51754) 2023-10-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2daa6700 1 -- 172.21.15.81:0/1178711685 learned_addr learned my addr 172.21.15.81:0/1178711685 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2caa4700 1 --2- 172.21.15.81:0/1178711685 >> v2:172.21.15.83:3300/0 conn(0x7f0f28159f90 0x7f0f2806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2d2a5700 1 --2- 172.21.15.81:0/1178711685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28159bc0 0x7f0f280b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2daa6700 1 -- 172.21.15.81:0/1178711685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28159bc0 msgr2=0x7f0f280b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2daa6700 1 --2- 172.21.15.81:0/1178711685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28159bc0 0x7f0f280b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2daa6700 1 -- 172.21.15.81:0/1178711685 >> v2:172.21.15.83:3300/0 conn(0x7f0f28159f90 msgr2=0x7f0f2806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2daa6700 1 --2- 172.21.15.81:0/1178711685 >> v2:172.21.15.83:3300/0 conn(0x7f0f28159f90 0x7f0f2806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2daa6700 1 -- 172.21.15.81:0/1178711685 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f28067b70 con 0x7f0f28068370 2023-10-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.301+0000 7f0f2caa4700 1 --2- 172.21.15.81:0/1178711685 >> v2:172.21.15.83:3300/0 conn(0x7f0f28159f90 0x7f0f2806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2daa6700 1 --2- 172.21.15.81:0/1178711685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28068370 0x7f0f280ce950 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0f2805f3b0 tx=0x7f0f24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8232304952b6f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f1ffff700 1 -- 172.21.15.81:0/1178711685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400b860 con 0x7f0f28068370 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f1ffff700 1 -- 172.21.15.81:0/1178711685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2400b9c0 con 0x7f0f28068370 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f1ffff700 1 -- 172.21.15.81:0/1178711685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400bd60 con 0x7f0f28068370 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/1178711685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28068370 msgr2=0x7f0f280ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/1178711685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28068370 0x7f0f280ce950 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0f2805f3b0 tx=0x7f0f24009250 comp rx=0 tx=0).stop 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/1178711685 shutdown_connections 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/1178711685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28068370 0x7f0f280ce950 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/1178711685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28159bc0 0x7f0f280b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/1178711685 >> v2:172.21.15.83:3300/0 conn(0x7f0f28159f90 0x7f0f2806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/1178711685 >> 172.21.15.81:0/1178711685 conn(0x7f0f2806c620 msgr2=0x7f0f2806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/1178711685 shutdown_connections 2023-10-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.302+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/1178711685 wait complete. 2023-10-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.303+0000 7f0f2e2a7700 1 Processor -- start 2023-10-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.303+0000 7f0f2e2a7700 1 -- start start 2023-10-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.304+0000 7f0f2e2a7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28068370 0x7f0f28144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.304+0000 7f0f2e2a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28159bc0 0x7f0f280c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.304+0000 7f0f2e2a7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28159f90 0x7f0f280cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.304+0000 7f0f2e2a7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28144560 con 0x7f0f28159bc0 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.304+0000 7f0f2e2a7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280af7b0 con 0x7f0f28159f90 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.304+0000 7f0f2e2a7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280ce320 con 0x7f0f28068370 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.304+0000 7f0f2caa4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28159bc0 0x7f0f280c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.304+0000 7f0f2caa4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28159bc0 0x7f0f280c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51766/0 (socket says 172.21.15.81:51766) 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.304+0000 7f0f2caa4700 1 -- 172.21.15.81:0/4168267929 learned_addr learned my addr 172.21.15.81:0/4168267929 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2d2a5700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28068370 0x7f0f28144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2daa6700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28159f90 0x7f0f280cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2caa4700 1 -- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28068370 msgr2=0x7f0f28144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2caa4700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28068370 0x7f0f28144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2caa4700 1 -- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28159f90 msgr2=0x7f0f280cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2caa4700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28159f90 0x7f0f280cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2caa4700 1 -- 172.21.15.81:0/4168267929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f240094f0 con 0x7f0f28159bc0 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2d2a5700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28068370 0x7f0f28144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2caa4700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28159bc0 0x7f0f280c8360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800c880 tx=0x7f0f18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f1d7fa700 1 -- 172.21.15.81:0/4168267929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18011600 con 0x7f0f28159bc0 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f1d7fa700 1 -- 172.21.15.81:0/4168267929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f18011760 con 0x7f0f28159bc0 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f280af480 con 0x7f0f28159bc0 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f1d7fa700 1 -- 172.21.15.81:0/4168267929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18011b00 con 0x7f0f28159bc0 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.305+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f280ce040 con 0x7f0f28159bc0 2023-10-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.306+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f28069920 con 0x7f0f28159bc0 2023-10-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.306+0000 7f0f1d7fa700 1 -- 172.21.15.81:0/4168267929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f18018360 con 0x7f0f28159bc0 2023-10-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.307+0000 7f0f1d7fa700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0f0c066f30 0x7f0f0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.307+0000 7f0f1d7fa700 1 -- 172.21.15.81:0/4168267929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0f180843c0 con 0x7f0f28159bc0 2023-10-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.307+0000 7f0f2d2a5700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0f0c066f30 0x7f0f0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.307+0000 7f0f2d2a5700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0f0c066f30 0x7f0f0c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000e5a0 tx=0x7f0f200076f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.311+0000 7f0f1d7fa700 1 -- 172.21.15.81:0/4168267929 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f18051820 con 0x7f0f28159bc0 2023-10-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.494+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0f28071b10 con 0x7f0f28159bc0 2023-10-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.494+0000 7f0f1d7fa700 1 -- 172.21.15.81:0/4168267929 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0f18054e40 con 0x7f0f28159bc0 2023-10-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0f0c066f30 msgr2=0x7f0f0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0f0c066f30 0x7f0f0c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000e5a0 tx=0x7f0f200076f0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28159bc0 msgr2=0x7f0f280c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28159bc0 0x7f0f280c8360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800c880 tx=0x7f0f18008040 comp rx=0 tx=0).stop 2023-10-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 shutdown_connections 2023-10-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0f0c066f30 0x7f0f0c0693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28159f90 0x7f0f280cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f28068370 0x7f0f28144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 --2- 172.21.15.81:0/4168267929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f28159bc0 0x7f0f280c8360 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 >> 172.21.15.81:0/4168267929 conn(0x7f0f2806c620 msgr2=0x7f0f2815add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 shutdown_connections 2023-10-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.496+0000 7f0f2e2a7700 1 -- 172.21.15.81:0/4168267929 wait complete. 2023-10-06T02:46:57.510 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:46:57.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.626+0000 7f355ff43700 1 Processor -- start 2023-10-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.626+0000 7f355ff43700 1 -- start start 2023-10-06T02:46:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.627+0000 7f355ff43700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f355815a2a0 0x7f35580b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.627+0000 7f355ff43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 0x7f35580cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.627+0000 7f355ff43700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f355806d650 0x7f355806da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.627+0000 7f355ff43700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355806ea90 con 0x7f355815a2a0 2023-10-06T02:46:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.627+0000 7f355ff43700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35580b0ca0 con 0x7f355806d650 2023-10-06T02:46:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.627+0000 7f355ff43700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35580cf4c0 con 0x7f35580ceb30 2023-10-06T02:46:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.627+0000 7f355dcdf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f355815a2a0 0x7f35580b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.627+0000 7f355dcdf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f355815a2a0 0x7f35580b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51774/0 (socket says 172.21.15.81:51774) 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.627+0000 7f355dcdf700 1 -- 172.21.15.81:0/4237824122 learned_addr learned my addr 172.21.15.81:0/4237824122 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355d4de700 1 --2- 172.21.15.81:0/4237824122 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 0x7f35580cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355e4e0700 1 --2- 172.21.15.81:0/4237824122 >> v2:172.21.15.83:3300/0 conn(0x7f355806d650 0x7f355806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355dcdf700 1 -- 172.21.15.81:0/4237824122 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 msgr2=0x7f35580cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355dcdf700 1 --2- 172.21.15.81:0/4237824122 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 0x7f35580cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355dcdf700 1 -- 172.21.15.81:0/4237824122 >> v2:172.21.15.83:3300/0 conn(0x7f355806d650 msgr2=0x7f355806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355dcdf700 1 --2- 172.21.15.81:0/4237824122 >> v2:172.21.15.83:3300/0 conn(0x7f355806d650 0x7f355806da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355dcdf700 1 -- 172.21.15.81:0/4237824122 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580b00d0 con 0x7f355815a2a0 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355e4e0700 1 --2- 172.21.15.81:0/4237824122 >> v2:172.21.15.83:3300/0 conn(0x7f355806d650 0x7f355806da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355dcdf700 1 --2- 172.21.15.81:0/4237824122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 0x7f35580b1130 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f355806b970 tx=0x7f3554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d02889aaea32d37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355ccdd700 1 -- 172.21.15.81:0/4237824122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355400b860 con 0x7f355815a2a0 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355ccdd700 1 -- 172.21.15.81:0/4237824122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355400b9c0 con 0x7f355815a2a0 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.628+0000 7f355ccdd700 1 -- 172.21.15.81:0/4237824122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355400bd60 con 0x7f355815a2a0 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.629+0000 7f355ff43700 1 -- 172.21.15.81:0/4237824122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 msgr2=0x7f35580b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.629+0000 7f355ff43700 1 --2- 172.21.15.81:0/4237824122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 0x7f35580b1130 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f355806b970 tx=0x7f3554009250 comp rx=0 tx=0).stop 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.629+0000 7f355ff43700 1 -- 172.21.15.81:0/4237824122 shutdown_connections 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.629+0000 7f355ff43700 1 --2- 172.21.15.81:0/4237824122 >> v2:172.21.15.83:3300/0 conn(0x7f355806d650 0x7f355806da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.629+0000 7f355ff43700 1 --2- 172.21.15.81:0/4237824122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 0x7f35580b1130 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.629+0000 7f355ff43700 1 --2- 172.21.15.81:0/4237824122 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 0x7f35580cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.629+0000 7f355ff43700 1 -- 172.21.15.81:0/4237824122 >> 172.21.15.81:0/4237824122 conn(0x7f3558067640 msgr2=0x7f3558067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.629+0000 7f355ff43700 1 -- 172.21.15.81:0/4237824122 shutdown_connections 2023-10-06T02:46:57.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.629+0000 7f355ff43700 1 -- 172.21.15.81:0/4237824122 wait complete. 2023-10-06T02:46:57.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.630+0000 7f355ff43700 1 Processor -- start 2023-10-06T02:46:57.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.630+0000 7f355ff43700 1 -- start start 2023-10-06T02:46:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355ff43700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f355806d650 0x7f3558144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355ff43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 0x7f35580ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355ff43700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 0x7f35580ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355ff43700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558154020 con 0x7f355815a2a0 2023-10-06T02:46:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355ff43700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558144d70 con 0x7f355806d650 2023-10-06T02:46:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355ff43700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3558153410 con 0x7f35580ceb30 2023-10-06T02:46:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355e4e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 0x7f35580ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355e4e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 0x7f35580ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51784/0 (socket says 172.21.15.81:51784) 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355e4e0700 1 -- 172.21.15.81:0/42968249 learned_addr learned my addr 172.21.15.81:0/42968249 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355dcdf700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f355806d650 0x7f3558144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355d4de700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 0x7f35580ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355e4e0700 1 -- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 msgr2=0x7f35580ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355e4e0700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 0x7f35580ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355e4e0700 1 -- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f355806d650 msgr2=0x7f3558144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355e4e0700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f355806d650 0x7f3558144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355e4e0700 1 -- 172.21.15.81:0/42968249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540094f0 con 0x7f355815a2a0 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355dcdf700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f355806d650 0x7f3558144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355e4e0700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 0x7f35580ade70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f355000cef0 tx=0x7f3550007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f354dffb700 1 -- 172.21.15.81:0/42968249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000ae00 con 0x7f355815a2a0 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f354dffb700 1 -- 172.21.15.81:0/42968249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3550016420 con 0x7f355815a2a0 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f354dffb700 1 -- 172.21.15.81:0/42968249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500167e0 con 0x7f355815a2a0 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.631+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35581536f0 con 0x7f355815a2a0 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.632+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3558153cb0 con 0x7f355815a2a0 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.632+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35581541d0 con 0x7f355815a2a0 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.633+0000 7f354dffb700 1 -- 172.21.15.81:0/42968249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3550016bd0 con 0x7f355815a2a0 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.633+0000 7f354dffb700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f353c066f30 0x7f353c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.633+0000 7f354dffb700 1 -- 172.21.15.81:0/42968249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3550012070 con 0x7f355815a2a0 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.633+0000 7f355dcdf700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f353c066f30 0x7f353c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.634+0000 7f355dcdf700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f353c066f30 0x7f353c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f355806b970 tx=0x7f3554017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.637+0000 7f354dffb700 1 -- 172.21.15.81:0/42968249 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f355004e5a0 con 0x7f355815a2a0 2023-10-06T02:46:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:57.817+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f355804bb80 con 0x7f355815a2a0 2023-10-06T02:46:58.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.418+0000 7f354dffb700 1 -- 172.21.15.81:0/42968249 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f35581541d0 con 0x7f355815a2a0 2023-10-06T02:46:58.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.421+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f353c066f30 msgr2=0x7f353c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:58.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.421+0000 7f355ff43700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f353c066f30 0x7f353c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f355806b970 tx=0x7f3554017000 comp rx=0 tx=0).stop 2023-10-06T02:46:58.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.421+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 msgr2=0x7f35580ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:58.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.422+0000 7f355ff43700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 0x7f35580ade70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f355000cef0 tx=0x7f3550007860 comp rx=0 tx=0).stop 2023-10-06T02:46:58.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.422+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 shutdown_connections 2023-10-06T02:46:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.422+0000 7f355ff43700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355815a2a0 0x7f35580ade70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.422+0000 7f355ff43700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f353c066f30 0x7f353c0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.422+0000 7f355ff43700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f355806d650 0x7f3558144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.422+0000 7f355ff43700 1 --2- 172.21.15.81:0/42968249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35580ceb30 0x7f35580ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.422+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 >> 172.21.15.81:0/42968249 conn(0x7f3558067640 msgr2=0x7f3558156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.422+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 shutdown_connections 2023-10-06T02:46:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.422+0000 7f355ff43700 1 -- 172.21.15.81:0/42968249 wait complete. 2023-10-06T02:46:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:46:58.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:46:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.555+0000 7f0aa33bd700 1 Processor -- start 2023-10-06T02:46:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.555+0000 7f0aa33bd700 1 -- start start 2023-10-06T02:46:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa33bd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0a9c0b1ef0 0x7f0a9c06da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa33bd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a9c06f4f0 0x7f0a9c0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa33bd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b2800 0x7f0a9c0691d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa33bd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c15a520 con 0x7f0a9c06f4f0 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa33bd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c068d40 con 0x7f0a9c0b1ef0 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa33bd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c06e2d0 con 0x7f0a9c0b2800 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa1bba700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a9c06f4f0 0x7f0a9c0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa1bba700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a9c06f4f0 0x7f0a9c0b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51786/0 (socket says 172.21.15.81:51786) 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa1bba700 1 -- 172.21.15.81:0/1351943528 learned_addr learned my addr 172.21.15.81:0/1351943528 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa2bbc700 1 --2- 172.21.15.81:0/1351943528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b2800 0x7f0a9c0691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa23bb700 1 --2- 172.21.15.81:0/1351943528 >> v2:172.21.15.83:3300/0 conn(0x7f0a9c0b1ef0 0x7f0a9c06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa1bba700 1 -- 172.21.15.81:0/1351943528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b2800 msgr2=0x7f0a9c0691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa1bba700 1 --2- 172.21.15.81:0/1351943528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b2800 0x7f0a9c0691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa1bba700 1 -- 172.21.15.81:0/1351943528 >> v2:172.21.15.83:3300/0 conn(0x7f0a9c0b1ef0 msgr2=0x7f0a9c06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa1bba700 1 --2- 172.21.15.81:0/1351943528 >> v2:172.21.15.83:3300/0 conn(0x7f0a9c0b1ef0 0x7f0a9c06da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa1bba700 1 -- 172.21.15.81:0/1351943528 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0686f0 con 0x7f0a9c06f4f0 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.556+0000 7f0aa1bba700 1 --2- 172.21.15.81:0/1351943528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c06f4f0 0x7f0a9c0b22c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c06a4c0 tx=0x7f0a8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fd7537643fb023 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa13b9700 1 -- 172.21.15.81:0/1351943528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00b640 con 0x7f0a9c06f4f0 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa13b9700 1 -- 172.21.15.81:0/1351943528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00b7a0 con 0x7f0a9c06f4f0 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa13b9700 1 -- 172.21.15.81:0/1351943528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00bb60 con 0x7f0a9c06f4f0 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa33bd700 1 -- 172.21.15.81:0/1351943528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c06f4f0 msgr2=0x7f0a9c0b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/1351943528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c06f4f0 0x7f0a9c0b22c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c06a4c0 tx=0x7f0a8c009250 comp rx=0 tx=0).stop 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa33bd700 1 -- 172.21.15.81:0/1351943528 shutdown_connections 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/1351943528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b2800 0x7f0a9c0691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/1351943528 >> v2:172.21.15.83:3300/0 conn(0x7f0a9c0b1ef0 0x7f0a9c06da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/1351943528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c06f4f0 0x7f0a9c0b22c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa33bd700 1 -- 172.21.15.81:0/1351943528 >> 172.21.15.81:0/1351943528 conn(0x7f0a9c0d0bb0 msgr2=0x7f0a9c0d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa33bd700 1 -- 172.21.15.81:0/1351943528 shutdown_connections 2023-10-06T02:46:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.557+0000 7f0aa33bd700 1 -- 172.21.15.81:0/1351943528 wait complete. 2023-10-06T02:46:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.558+0000 7f0aa33bd700 1 Processor -- start 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.558+0000 7f0aa33bd700 1 -- start start 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa33bd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a9c06f4f0 0x7f0a9c157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa33bd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b1ef0 0x7f0a9c14b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa33bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c0b2800 0x7f0a9c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa33bd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c15a790 con 0x7f0a9c0b2800 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa33bd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0aff10 con 0x7f0a9c06f4f0 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa33bd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b01f0 con 0x7f0a9c0b1ef0 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa2bbc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c0b2800 0x7f0a9c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa2bbc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c0b2800 0x7f0a9c0acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51788/0 (socket says 172.21.15.81:51788) 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa2bbc700 1 -- 172.21.15.81:0/3909388727 learned_addr learned my addr 172.21.15.81:0/3909388727 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa1bba700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b1ef0 0x7f0a9c14b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.559+0000 7f0aa23bb700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a9c06f4f0 0x7f0a9c157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0aa2bbc700 1 -- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b1ef0 msgr2=0x7f0a9c14b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0aa2bbc700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b1ef0 0x7f0a9c14b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0aa2bbc700 1 -- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a9c06f4f0 msgr2=0x7f0a9c157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0aa2bbc700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a9c06f4f0 0x7f0a9c157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0aa2bbc700 1 -- 172.21.15.81:0/3909388727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0094f0 con 0x7f0a9c0b2800 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0aa2bbc700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c0b2800 0x7f0a9c0acdf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009df0 tx=0x7f0a9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0a927fc700 1 -- 172.21.15.81:0/3909388727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400caa0 con 0x7f0a9c0b2800 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0a927fc700 1 -- 172.21.15.81:0/3909388727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9400f040 con 0x7f0a9c0b2800 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c0b04d0 con 0x7f0a9c0b2800 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0a927fc700 1 -- 172.21.15.81:0/3909388727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400ce70 con 0x7f0a9c0b2800 2023-10-06T02:46:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.560+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c14bd60 con 0x7f0a9c0b2800 2023-10-06T02:46:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.561+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c15a900 con 0x7f0a9c0b2800 2023-10-06T02:46:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.561+0000 7f0a927fc700 1 -- 172.21.15.81:0/3909388727 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a94014690 con 0x7f0a9c0b2800 2023-10-06T02:46:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.562+0000 7f0a927fc700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0a80066f30 0x7f0a800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.562+0000 7f0a927fc700 1 -- 172.21.15.81:0/3909388727 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f0a94084cc0 con 0x7f0a9c0b2800 2023-10-06T02:46:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.562+0000 7f0aa23bb700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0a80066f30 0x7f0a800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.562+0000 7f0aa23bb700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0a80066f30 0x7f0a800693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009db0 tx=0x7f0a980091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.566+0000 7f0a927fc700 1 -- 172.21.15.81:0/3909388727 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a94055a40 con 0x7f0a9c0b2800 2023-10-06T02:46:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:58.749+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0a9c071b10 con 0x7f0a9c0b2800 2023-10-06T02:46:59.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-06T02:46:59.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-06T02:46:59.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T02:46:59.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-06T02:46:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.424+0000 7f0a927fc700 1 -- 172.21.15.81:0/3909388727 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0a940555d0 con 0x7f0a9c0b2800 2023-10-06T02:46:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.429+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0a80066f30 msgr2=0x7f0a800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.429+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0a80066f30 0x7f0a800693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009db0 tx=0x7f0a980091a0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.429+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c0b2800 msgr2=0x7f0a9c0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:59.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.429+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c0b2800 0x7f0a9c0acdf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009df0 tx=0x7f0a9400b040 comp rx=0 tx=0).stop 2023-10-06T02:46:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.431+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 shutdown_connections 2023-10-06T02:46:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.431+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a9c0b2800 0x7f0a9c0acdf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.431+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0a80066f30 0x7f0a800693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.431+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a9c06f4f0 0x7f0a9c157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.431+0000 7f0aa33bd700 1 --2- 172.21.15.81:0/3909388727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a9c0b1ef0 0x7f0a9c14b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.431+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 >> 172.21.15.81:0/3909388727 conn(0x7f0a9c0d0bb0 msgr2=0x7f0a9c158550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.431+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 shutdown_connections 2023-10-06T02:46:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.431+0000 7f0aa33bd700 1 -- 172.21.15.81:0/3909388727 wait complete. 2023-10-06T02:46:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:46:59.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:46:59.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.561+0000 7f9c9e32f700 1 Processor -- start 2023-10-06T02:46:59.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.561+0000 7f9c9e32f700 1 -- start start 2023-10-06T02:46:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.562+0000 7f9c9e32f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c98157ca0 0x7f9c980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.562+0000 7f9c9e32f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980d07c0 con 0x7f9c981578d0 2023-10-06T02:46:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.562+0000 7f9c9e32f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980cfbb0 con 0x7f9c9806d120 2023-10-06T02:46:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.562+0000 7f9c9e32f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980cfe90 con 0x7f9c98157ca0 2023-10-06T02:46:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.562+0000 7f9c97fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9c981578d0 0x7f9c9815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55900/0 (socket says 172.21.15.81:55900) 2023-10-06T02:46:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.562+0000 7f9c97fff700 1 -- 172.21.15.81:0/1864615597 learned_addr learned my addr 172.21.15.81:0/1864615597 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:46:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.562+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566515543 0 0) 0x7f9c980d07c0 con 0x7f9c981578d0 2023-10-06T02:46:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.562+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c80003570 con 0x7f9c981578d0 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.562+0000 7f9c977fe700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c98157ca0 0x7f9c980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 537257293 0 0) 0x7f9c80003570 con 0x7f9c981578d0 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c98157ca0 msgr2=0x7f9c980cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c98157ca0 0x7f9c980cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 >> v1:172.21.15.83:6789/0 conn(0x7f9c9806d120 legacy=0x7f9c9815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980d0170 con 0x7f9c981578d0 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f9c88001470 con 0x7f9c981578d0 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 >> v1:172.21.15.81:6789/0 conn(0x7f9c981578d0 legacy=0x7f9c9815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80003a90 0x7f9c80003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c98157ca0 0x7f9c80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80004d50 0x7f9c800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980cfe90 con 0x7f9c80003a90 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8000bb10 con 0x7f9c80004d50 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8000bcd0 con 0x7f9c98157ca0 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c97fff700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80003a90 0x7f9c80003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c977fe700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c98157ca0 0x7f9c80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c9c8cc700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80004d50 0x7f9c800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c97fff700 1 -- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c98157ca0 msgr2=0x7f9c80004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c97fff700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c98157ca0 0x7f9c80004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c97fff700 1 -- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80004d50 msgr2=0x7f9c800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c97fff700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80004d50 0x7f9c800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c97fff700 1 -- 172.21.15.81:0/1864615597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80003570 con 0x7f9c80003a90 2023-10-06T02:46:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c9c8cc700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80004d50 0x7f9c800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c97fff700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80003a90 0x7f9c80003e60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800c390 tx=0x7f9c9815b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8012bcb69c328f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800cc60 con 0x7f9c80003a90 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8800cde0 con 0x7f9c80003a90 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.563+0000 7f9c96ffd700 1 -- 172.21.15.81:0/1864615597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88005b70 con 0x7f9c80003a90 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.564+0000 7f9c9e32f700 1 -- 172.21.15.81:0/1864615597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80003a90 msgr2=0x7f9c80003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.564+0000 7f9c9e32f700 1 --2- 172.21.15.81:0/1864615597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c80003a90 0x7f9c80003e60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800c390 tx=0x7f9c9815b610 comp rx=0 tx=0).stop 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.564+0000 7f9c9c8cc700 1 -- 172.21.15.81:0/1864615597 reap_dead start 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.564+0000 7f9c9e32f700 1 -- 172.21.15.81:0/1864615597 shutdown_connections 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.564+0000 7f9c9e32f700 1 -- 172.21.15.81:0/1864615597 >> 172.21.15.81:0/1864615597 conn(0x7f9c9806bb90 msgr2=0x7f9c9806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.564+0000 7f9c9e32f700 1 -- 172.21.15.81:0/1864615597 shutdown_connections 2023-10-06T02:46:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.564+0000 7f9c9e32f700 1 -- 172.21.15.81:0/1864615597 wait complete. 2023-10-06T02:46:59.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.565+0000 7f9c9e32f700 1 Processor -- start 2023-10-06T02:46:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.565+0000 7f9c9e32f700 1 -- start start 2023-10-06T02:46:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c9e32f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80003a90 0x7f9c98151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c9e32f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9816a200 0x7f9c98153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c9e32f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c980b4790 0x7f9c980b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c9e32f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98152070 con 0x7f9c9816a200 2023-10-06T02:46:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c9e32f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98152e70 con 0x7f9c80003a90 2023-10-06T02:46:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c9e32f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98153840 con 0x7f9c980b4790 2023-10-06T02:46:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9816a200 0x7f9c98153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9816a200 0x7f9c98153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51798/0 (socket says 172.21.15.81:51798) 2023-10-06T02:46:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c977fe700 1 -- 172.21.15.81:0/923114295 learned_addr learned my addr 172.21.15.81:0/923114295 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:46:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c9c8cc700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c980b4790 0x7f9c980b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c97fff700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80003a90 0x7f9c98151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c977fe700 1 -- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c980b4790 msgr2=0x7f9c980b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c977fe700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c980b4790 0x7f9c980b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c977fe700 1 -- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80003a90 msgr2=0x7f9c98151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c977fe700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80003a90 0x7f9c98151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.566+0000 7f9c977fe700 1 -- 172.21.15.81:0/923114295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98152260 con 0x7f9c9816a200 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.567+0000 7f9c977fe700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9816a200 0x7f9c98153300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c011d40 tx=0x7f9c8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.567+0000 7f9c7ffff700 1 -- 172.21.15.81:0/923114295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c00fa10 con 0x7f9c9816a200 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.567+0000 7f9c7ffff700 1 -- 172.21.15.81:0/923114295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c00fb70 con 0x7f9c9816a200 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.567+0000 7f9c7ffff700 1 -- 172.21.15.81:0/923114295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c014440 con 0x7f9c9816a200 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.567+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c98152540 con 0x7f9c9816a200 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.567+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c98152b00 con 0x7f9c9816a200 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.568+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c98153000 con 0x7f9c9816a200 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.568+0000 7f9c7ffff700 1 -- 172.21.15.81:0/923114295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c8c014870 con 0x7f9c9816a200 2023-10-06T02:46:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.569+0000 7f9c7ffff700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c84066f60 0x7f9c84069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:46:59.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.569+0000 7f9c7ffff700 1 -- 172.21.15.81:0/923114295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f9c8c018030 con 0x7f9c9816a200 2023-10-06T02:46:59.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.569+0000 7f9c97fff700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c84066f60 0x7f9c84069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:46:59.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.569+0000 7f9c97fff700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c84066f60 0x7f9c84069410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9c88007d10 tx=0x7f9c88015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:46:59.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.573+0000 7f9c7ffff700 1 -- 172.21.15.81:0/923114295 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c8c089070 con 0x7f9c9816a200 2023-10-06T02:46:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:46:59.802+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9c980d0450 con 0x7f9c9816a200 2023-10-06T02:47:00.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.445+0000 7f9c7ffff700 1 -- 172.21.15.81:0/923114295 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9c8c0220c0 con 0x7f9c9816a200 2023-10-06T02:47:00.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.449+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c84066f60 msgr2=0x7f9c84069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.449+0000 7f9c9e32f700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c84066f60 0x7f9c84069410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9c88007d10 tx=0x7f9c88015000 comp rx=0 tx=0).stop 2023-10-06T02:47:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.449+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9816a200 msgr2=0x7f9c98153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.449+0000 7f9c9e32f700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9816a200 0x7f9c98153300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c011d40 tx=0x7f9c8c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.449+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 shutdown_connections 2023-10-06T02:47:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.449+0000 7f9c9e32f700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c980b4790 0x7f9c980b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.449+0000 7f9c9e32f700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c84066f60 0x7f9c84069410 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.449+0000 7f9c9e32f700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c80003a90 0x7f9c98151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.449+0000 7f9c9e32f700 1 --2- 172.21.15.81:0/923114295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9816a200 0x7f9c98153300 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.450+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 >> 172.21.15.81:0/923114295 conn(0x7f9c9806bb90 msgr2=0x7f9c98154610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.450+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 shutdown_connections 2023-10-06T02:47:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.450+0000 7f9c9e32f700 1 -- 172.21.15.81:0/923114295 wait complete. 2023-10-06T02:47:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T02:47:00.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.580+0000 7f350725f700 1 Processor -- start 2023-10-06T02:47:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.580+0000 7f350725f700 1 -- start start 2023-10-06T02:47:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.580+0000 7f350725f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f35001578d0 0x7f35000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.580+0000 7f350725f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35000d07c0 con 0x7f350006d120 2023-10-06T02:47:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.580+0000 7f350725f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35000cfbb0 con 0x7f3500157ca0 2023-10-06T02:47:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.580+0000 7f350725f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35000cfe90 con 0x7f35001578d0 2023-10-06T02:47:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f35057fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f350006d120 0x7f350006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38212/0 (socket says 172.21.15.81:38212) 2023-10-06T02:47:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f35057fc700 1 -- 172.21.15.81:0/899840769 learned_addr learned my addr 172.21.15.81:0/899840769 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f3504ffb700 1 --2- 172.21.15.81:0/899840769 >> v2:172.21.15.83:3300/0 conn(0x7f35001578d0 0x7f35000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f34ff7fe700 1 -- 172.21.15.81:0/899840769 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161132180 0 0) 0x7f35000d07c0 con 0x7f350006d120 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f34ff7fe700 1 -- 172.21.15.81:0/899840769 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34f0003570 con 0x7f350006d120 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f34ff7fe700 1 -- 172.21.15.81:0/899840769 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468440023 0 0) 0x7f35000cfbb0 con 0x7f3500157ca0 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f34ff7fe700 1 -- 172.21.15.81:0/899840769 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35000d07c0 con 0x7f3500157ca0 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f34ff7fe700 1 -- 172.21.15.81:0/899840769 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2601737809 0 0) 0x7f34f0003570 con 0x7f350006d120 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f3504ffb700 1 -- 172.21.15.81:0/899840769 >> v1:172.21.15.83:6789/0 conn(0x7f3500157ca0 legacy=0x7f350015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f3504ffb700 1 -- 172.21.15.81:0/899840769 >> v1:172.21.15.81:6789/0 conn(0x7f350006d120 legacy=0x7f350006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f3504ffb700 1 -- 172.21.15.81:0/899840769 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000d0170 con 0x7f35001578d0 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f3504ffb700 1 --2- 172.21.15.81:0/899840769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35001578d0 0x7f35000cf4f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098e0 tx=0x7f34f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c86b525dda2f0598 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f34ff7fe700 1 -- 172.21.15.81:0/899840769 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80017f0 con 0x7f35001578d0 2023-10-06T02:47:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f34ff7fe700 1 -- 172.21.15.81:0/899840769 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f4011420 con 0x7f35001578d0 2023-10-06T02:47:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.581+0000 7f34ff7fe700 1 -- 172.21.15.81:0/899840769 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40117c0 con 0x7f35001578d0 2023-10-06T02:47:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.582+0000 7f350725f700 1 -- 172.21.15.81:0/899840769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35001578d0 msgr2=0x7f35000cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.582+0000 7f350725f700 1 --2- 172.21.15.81:0/899840769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35001578d0 0x7f35000cf4f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098e0 tx=0x7f34f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.582+0000 7f350725f700 1 -- 172.21.15.81:0/899840769 shutdown_connections 2023-10-06T02:47:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.582+0000 7f350725f700 1 --2- 172.21.15.81:0/899840769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35001578d0 0x7f35000cf4f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.582+0000 7f350725f700 1 -- 172.21.15.81:0/899840769 >> 172.21.15.81:0/899840769 conn(0x7f350006bb90 msgr2=0x7f350006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.582+0000 7f350725f700 1 -- 172.21.15.81:0/899840769 shutdown_connections 2023-10-06T02:47:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.582+0000 7f350725f700 1 -- 172.21.15.81:0/899840769 wait complete. 2023-10-06T02:47:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.583+0000 7f350725f700 1 Processor -- start 2023-10-06T02:47:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.583+0000 7f350725f700 1 -- start start 2023-10-06T02:47:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f350725f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f350006d120 0x7f350016a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f350725f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35001578d0 0x7f35000b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f350725f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500157ca0 0x7f35000b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f350725f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000ae840 con 0x7f350006d120 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f350725f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000b27e0 con 0x7f3500157ca0 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f350725f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35000b2c70 con 0x7f35001578d0 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f3504ffb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f350006d120 0x7f350016a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f3504ffb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f350006d120 0x7f350016a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46386/0 (socket says 172.21.15.81:46386) 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f3504ffb700 1 -- 172.21.15.81:0/872833688 learned_addr learned my addr 172.21.15.81:0/872833688 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f35057fc700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500157ca0 0x7f35000b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f34fffff700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35001578d0 0x7f35000b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f3504ffb700 1 -- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35001578d0 msgr2=0x7f35000b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f3504ffb700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35001578d0 0x7f35000b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f3504ffb700 1 -- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500157ca0 msgr2=0x7f35000b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f3504ffb700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500157ca0 0x7f35000b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f3504ffb700 1 -- 172.21.15.81:0/872833688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4009420 con 0x7f350006d120 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.584+0000 7f34fffff700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35001578d0 0x7f35000b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.585+0000 7f3504ffb700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f350006d120 0x7f350016a2e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f350006fe20 tx=0x7f34f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.585+0000 7f34fcff9700 1 -- 172.21.15.81:0/872833688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f401cbe0 con 0x7f350006d120 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.585+0000 7f34fcff9700 1 -- 172.21.15.81:0/872833688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f401cd40 con 0x7f350006d120 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.585+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35000b1bd0 con 0x7f350006d120 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.585+0000 7f34fcff9700 1 -- 172.21.15.81:0/872833688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f401a6a0 con 0x7f350006d120 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.585+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35000b2190 con 0x7f350006d120 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.586+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35000b2ac0 con 0x7f350006d120 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.586+0000 7f34fcff9700 1 -- 172.21.15.81:0/872833688 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34f401aa50 con 0x7f350006d120 2023-10-06T02:47:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.586+0000 7f34fcff9700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34e4066f30 0x7f34e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.586+0000 7f34fcff9700 1 -- 172.21.15.81:0/872833688 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f34f4086030 con 0x7f350006d120 2023-10-06T02:47:00.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.587+0000 7f34fffff700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34e4066f30 0x7f34e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.587+0000 7f34fffff700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34e4066f30 0x7f34e40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f350015e380 tx=0x7f34ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:00.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.591+0000 7f34fcff9700 1 -- 172.21.15.81:0/872833688 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34f4053140 con 0x7f350006d120 2023-10-06T02:47:00.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.772+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35000d0450 con 0x7f350006d120 2023-10-06T02:47:00.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.773+0000 7f34fcff9700 1 -- 172.21.15.81:0/872833688 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f34f4056760 con 0x7f350006d120 2023-10-06T02:47:00.776 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:00.776 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:59.804393+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:57.835962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:58.768263+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34e4066f30 msgr2=0x7f34e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34e4066f30 0x7f34e40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f350015e380 tx=0x7f34ec009040 comp rx=0 tx=0).stop 2023-10-06T02:47:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f350006d120 msgr2=0x7f350016a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f350006d120 0x7f350016a2e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f350006fe20 tx=0x7f34f4016000 comp rx=0 tx=0).stop 2023-10-06T02:47:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 shutdown_connections 2023-10-06T02:47:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f34e4066f30 0x7f34e40693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3500157ca0 0x7f35000b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f350006d120 0x7f350016a2e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 --2- 172.21.15.81:0/872833688 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35001578d0 0x7f35000b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 >> 172.21.15.81:0/872833688 conn(0x7f350006bb90 msgr2=0x7f3500155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:00.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 shutdown_connections 2023-10-06T02:47:00.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.775+0000 7f350725f700 1 -- 172.21.15.81:0/872833688 wait complete. 2023-10-06T02:47:00.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.901+0000 7f2b74c5a700 1 Processor -- start 2023-10-06T02:47:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.901+0000 7f2b74c5a700 1 -- start start 2023-10-06T02:47:00.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b74c5a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b70159f10 0x7f2b70068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b74c5a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70068cc0 0x7f2b700cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b74c5a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b700cee10 con 0x7f2b70159b40 2023-10-06T02:47:00.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b74c5a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b70069140 con 0x7f2b70159f10 2023-10-06T02:47:00.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b74c5a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700cd040 con 0x7f2b70068cc0 2023-10-06T02:47:00.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b6ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70068cc0 0x7f2b700cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b6effd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b70159f10 0x7f2b70068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b6effd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b70159f10 0x7f2b70068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:55774/0 (socket says 172.21.15.81:55774) 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b6ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70068cc0 0x7f2b700cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:57606/0 (socket says 172.21.15.81:57606) 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.902+0000 7f2b6effd700 1 -- 172.21.15.81:0/3143500651 learned_addr learned my addr 172.21.15.81:0/3143500651 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.903+0000 7f2b6effd700 1 -- 172.21.15.81:0/3143500651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70068cc0 msgr2=0x7f2b700cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.903+0000 7f2b6effd700 1 --2- 172.21.15.81:0/3143500651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70068cc0 0x7f2b700cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.903+0000 7f2b6effd700 1 -- 172.21.15.81:0/3143500651 >> v1:172.21.15.83:6789/0 conn(0x7f2b70159b40 legacy=0x7f2b700cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.903+0000 7f2b6effd700 1 -- 172.21.15.81:0/3143500651 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700cd320 con 0x7f2b70159f10 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.903+0000 7f2b6e7fc700 1 -- 172.21.15.81:0/3143500651 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731644637 0 0) 0x7f2b700cee10 con 0x7f2b70159b40 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.903+0000 7f2b6effd700 1 --2- 172.21.15.81:0/3143500651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b70159f10 0x7f2b70068780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b640099b0 tx=0x7f2b64009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b7ab8cdbe0c39fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.903+0000 7f2b6e7fc700 1 -- 172.21.15.81:0/3143500651 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64009ea0 con 0x7f2b70159f10 2023-10-06T02:47:00.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.903+0000 7f2b6e7fc700 1 -- 172.21.15.81:0/3143500651 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6400b860 con 0x7f2b70159f10 2023-10-06T02:47:00.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.903+0000 7f2b6e7fc700 1 -- 172.21.15.81:0/3143500651 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400bc00 con 0x7f2b70159f10 2023-10-06T02:47:00.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.904+0000 7f2b74c5a700 1 -- 172.21.15.81:0/3143500651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b70159f10 msgr2=0x7f2b70068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.904+0000 7f2b74c5a700 1 --2- 172.21.15.81:0/3143500651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b70159f10 0x7f2b70068780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b640099b0 tx=0x7f2b64009250 comp rx=0 tx=0).stop 2023-10-06T02:47:00.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.904+0000 7f2b74c5a700 1 -- 172.21.15.81:0/3143500651 shutdown_connections 2023-10-06T02:47:00.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.904+0000 7f2b74c5a700 1 --2- 172.21.15.81:0/3143500651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70068cc0 0x7f2b700cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.904+0000 7f2b74c5a700 1 --2- 172.21.15.81:0/3143500651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b70159f10 0x7f2b70068780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.904+0000 7f2b74c5a700 1 -- 172.21.15.81:0/3143500651 >> 172.21.15.81:0/3143500651 conn(0x7f2b700cd660 msgr2=0x7f2b700cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:00.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.904+0000 7f2b74c5a700 1 -- 172.21.15.81:0/3143500651 shutdown_connections 2023-10-06T02:47:00.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.904+0000 7f2b74c5a700 1 -- 172.21.15.81:0/3143500651 wait complete. 2023-10-06T02:47:00.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.905+0000 7f2b74c5a700 1 Processor -- start 2023-10-06T02:47:00.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.905+0000 7f2b74c5a700 1 -- start start 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b74c5a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b70068cc0 0x7f2b7006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b74c5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b70159b40 0x7f2b7006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b74c5a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70159f10 0x7f2b700c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b74c5a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7014c250 con 0x7f2b70159b40 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b74c5a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700b1b00 con 0x7f2b70068cc0 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b74c5a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700b1de0 con 0x7f2b70159f10 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b70159b40 0x7f2b7006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b70159b40 0x7f2b7006dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46390/0 (socket says 172.21.15.81:46390) 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6effd700 1 -- 172.21.15.81:0/1948826716 learned_addr learned my addr 172.21.15.81:0/1948826716 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6ffff700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70159f10 0x7f2b700c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6f7fe700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b70068cc0 0x7f2b7006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6effd700 1 -- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70159f10 msgr2=0x7f2b700c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6effd700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70159f10 0x7f2b700c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6effd700 1 -- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b70068cc0 msgr2=0x7f2b7006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6effd700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b70068cc0 0x7f2b7006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6effd700 1 -- 172.21.15.81:0/1948826716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640094f0 con 0x7f2b70159b40 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b6effd700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b70159b40 0x7f2b7006dcd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b7006fe10 tx=0x7f2b64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b577fe700 1 -- 172.21.15.81:0/1948826716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400bbe0 con 0x7f2b70159b40 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b577fe700 1 -- 172.21.15.81:0/1948826716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64011420 con 0x7f2b70159b40 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b700b20c0 con 0x7f2b70159b40 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.906+0000 7f2b577fe700 1 -- 172.21.15.81:0/1948826716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640117c0 con 0x7f2b70159b40 2023-10-06T02:47:00.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.907+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b700b2680 con 0x7f2b70159b40 2023-10-06T02:47:00.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.908+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b700cc060 con 0x7f2b70159b40 2023-10-06T02:47:00.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.908+0000 7f2b577fe700 1 -- 172.21.15.81:0/1948826716 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b64011b70 con 0x7f2b70159b40 2023-10-06T02:47:00.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.908+0000 7f2b577fe700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2b5c066f30 0x7f2b5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:00.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.908+0000 7f2b577fe700 1 -- 172.21.15.81:0/1948826716 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2b64085fb0 con 0x7f2b70159b40 2023-10-06T02:47:00.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.908+0000 7f2b6f7fe700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2b5c066f30 0x7f2b5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:00.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.909+0000 7f2b6f7fe700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2b5c066f30 0x7f2b5c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b60001560 tx=0x7f2b60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:00.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:00.912+0000 7f2b577fe700 1 -- 172.21.15.81:0/1948826716 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b640b75a0 con 0x7f2b70159b40 2023-10-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.099+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b700ce7c0 con 0x7f2b70159b40 2023-10-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.100+0000 7f2b577fe700 1 -- 172.21.15.81:0/1948826716 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f2b640530c0 con 0x7f2b70159b40 2023-10-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:46:59.804393+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:57.835962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:58.768263+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2b5c066f30 msgr2=0x7f2b5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2b5c066f30 0x7f2b5c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b60001560 tx=0x7f2b60009040 comp rx=0 tx=0).stop 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b70159b40 msgr2=0x7f2b7006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b70159b40 0x7f2b7006dcd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b7006fe10 tx=0x7f2b64017000 comp rx=0 tx=0).stop 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 shutdown_connections 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b70159f10 0x7f2b700c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2b5c066f30 0x7f2b5c0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b70068cc0 0x7f2b7006d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 --2- 172.21.15.81:0/1948826716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b70159b40 0x7f2b7006dcd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 >> 172.21.15.81:0/1948826716 conn(0x7f2b700cd660 msgr2=0x7f2b700cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 shutdown_connections 2023-10-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.102+0000 7f2b74c5a700 1 -- 172.21.15.81:0/1948826716 wait complete. 2023-10-06T02:47:01.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:47:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.232+0000 7f9f243fb700 1 Processor -- start 2023-10-06T02:47:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.232+0000 7f9f243fb700 1 -- start start 2023-10-06T02:47:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.233+0000 7f9f243fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c157fe0 0x7f9f1c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.233+0000 7f9f243fb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f1c0cf240 0x7f9f1c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.233+0000 7f9f243fb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c0b2890 con 0x7f9f1c1583b0 2023-10-06T02:47:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.233+0000 7f9f243fb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1c0b4070 con 0x7f9f1c0cf240 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.233+0000 7f9f243fb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0b4350 con 0x7f9f1c157fe0 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.233+0000 7f9f22998700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f1c0cf240 0x7f9f1c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f22998700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f1c0cf240 0x7f9f1c0b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46402/0 (socket says 172.21.15.81:46402) 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f22998700 1 -- 172.21.15.81:0/3811788496 learned_addr learned my addr 172.21.15.81:0/3811788496 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f22197700 1 --2- 172.21.15.81:0/3811788496 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c157fe0 0x7f9f1c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f22998700 1 -- 172.21.15.81:0/3811788496 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c157fe0 msgr2=0x7f9f1c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f22998700 1 --2- 172.21.15.81:0/3811788496 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c157fe0 0x7f9f1c0b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f22998700 1 -- 172.21.15.81:0/3811788496 >> v1:172.21.15.83:6789/0 conn(0x7f9f1c1583b0 legacy=0x7f9f1c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f22998700 1 -- 172.21.15.81:0/3811788496 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c0b4630 con 0x7f9f1c0cf240 2023-10-06T02:47:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f22998700 1 --2- 172.21.15.81:0/3811788496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c0cf240 0x7f9f1c0b3a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009f20 tx=0x7f9f14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84dcc1775f0c5b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f21195700 1 -- 172.21.15.81:0/3811788496 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400e070 con 0x7f9f1c0cf240 2023-10-06T02:47:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f21195700 1 -- 172.21.15.81:0/3811788496 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1400ba40 con 0x7f9f1c0cf240 2023-10-06T02:47:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.234+0000 7f9f21195700 1 -- 172.21.15.81:0/3811788496 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f140092e0 con 0x7f9f1c0cf240 2023-10-06T02:47:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.235+0000 7f9f243fb700 1 -- 172.21.15.81:0/3811788496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c0cf240 msgr2=0x7f9f1c0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.235+0000 7f9f243fb700 1 --2- 172.21.15.81:0/3811788496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c0cf240 0x7f9f1c0b3a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009f20 tx=0x7f9f14009840 comp rx=0 tx=0).stop 2023-10-06T02:47:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.235+0000 7f9f243fb700 1 -- 172.21.15.81:0/3811788496 shutdown_connections 2023-10-06T02:47:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.235+0000 7f9f243fb700 1 --2- 172.21.15.81:0/3811788496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c0cf240 0x7f9f1c0b3a00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.235+0000 7f9f243fb700 1 --2- 172.21.15.81:0/3811788496 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c157fe0 0x7f9f1c0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.235+0000 7f9f243fb700 1 -- 172.21.15.81:0/3811788496 >> 172.21.15.81:0/3811788496 conn(0x7f9f1c067640 msgr2=0x7f9f1c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.235+0000 7f9f243fb700 1 -- 172.21.15.81:0/3811788496 shutdown_connections 2023-10-06T02:47:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.235+0000 7f9f243fb700 1 -- 172.21.15.81:0/3811788496 wait complete. 2023-10-06T02:47:01.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.236+0000 7f9f243fb700 1 Processor -- start 2023-10-06T02:47:01.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.236+0000 7f9f243fb700 1 -- start start 2023-10-06T02:47:01.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.236+0000 7f9f243fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c0cf240 0x7f9f1c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:01.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.236+0000 7f9f243fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157fe0 0x7f9f1c146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:01.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.236+0000 7f9f243fb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c1583b0 0x7f9f1c1469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:01.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.236+0000 7f9f243fb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c15d100 con 0x7f9f1c157fe0 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.236+0000 7f9f243fb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c06d940 con 0x7f9f1c1583b0 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.236+0000 7f9f243fb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c06dc20 con 0x7f9f1c0cf240 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f21996700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157fe0 0x7f9f1c146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f21996700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157fe0 0x7f9f1c146460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46408/0 (socket says 172.21.15.81:46408) 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f21996700 1 -- 172.21.15.81:0/3467238082 learned_addr learned my addr 172.21.15.81:0/3467238082 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f22998700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c1583b0 0x7f9f1c1469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f22197700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c0cf240 0x7f9f1c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f21996700 1 -- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c0cf240 msgr2=0x7f9f1c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f21996700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c0cf240 0x7f9f1c0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f21996700 1 -- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c1583b0 msgr2=0x7f9f1c1469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f21996700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c1583b0 0x7f9f1c1469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f21996700 1 -- 172.21.15.81:0/3467238082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14009ae0 con 0x7f9f1c157fe0 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f22197700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c0cf240 0x7f9f1c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f22998700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c1583b0 0x7f9f1c1469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f21996700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157fe0 0x7f9f1c146460 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c5d0 tx=0x7f9f0c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f127fc700 1 -- 172.21.15.81:0/3467238082 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c011590 con 0x7f9f1c157fe0 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f127fc700 1 -- 172.21.15.81:0/3467238082 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c011710 con 0x7f9f1c157fe0 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c15cd90 con 0x7f9f1c157fe0 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f127fc700 1 -- 172.21.15.81:0/3467238082 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c011ad0 con 0x7f9f1c157fe0 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.237+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c06cca0 con 0x7f9f1c157fe0 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.238+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c15cbf0 con 0x7f9f1c157fe0 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.238+0000 7f9f127fc700 1 -- 172.21.15.81:0/3467238082 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f0c01c460 con 0x7f9f1c157fe0 2023-10-06T02:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.239+0000 7f9f127fc700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.239+0000 7f9f127fc700 1 -- 172.21.15.81:0/3467238082 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9f0c084490 con 0x7f9f1c157fe0 2023-10-06T02:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.239+0000 7f9f22197700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.239+0000 7f9f22197700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800ab50 tx=0x7f9f18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.243+0000 7f9f127fc700 1 -- 172.21.15.81:0/3467238082 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f1c15cbf0 con 0x7f9f1c157fe0 2023-10-06T02:47:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:01.475+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9f1c15cbf0 con 0x7f9f1c157fe0 2023-10-06T02:47:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.458+0000 7f9f127fc700 1 -- 172.21.15.81:0/3467238082 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9f1c15cbf0 con 0x7f9f1c157fe0 2023-10-06T02:47:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 msgr2=0x7f9f000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800ab50 tx=0x7f9f18008040 comp rx=0 tx=0).stop 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157fe0 msgr2=0x7f9f1c146460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157fe0 0x7f9f1c146460 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c5d0 tx=0x7f9f0c007f60 comp rx=0 tx=0).stop 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 shutdown_connections 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c1583b0 0x7f9f1c1469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c0cf240 0x7f9f1c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 --2- 172.21.15.81:0/3467238082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157fe0 0x7f9f1c146460 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 >> 172.21.15.81:0/3467238082 conn(0x7f9f1c067640 msgr2=0x7f9f1c0ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 shutdown_connections 2023-10-06T02:47:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.460+0000 7f9f243fb700 1 -- 172.21.15.81:0/3467238082 wait complete. 2023-10-06T02:47:02.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:47:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.596+0000 7fed44897700 1 Processor -- start 2023-10-06T02:47:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.596+0000 7fed44897700 1 -- start start 2023-10-06T02:47:02.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed44897700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fed400b3bd0 0x7fed400ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:02.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed44897700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed401583b0 0x7fed400cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:02.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed44897700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed400b2890 con 0x7fed40157fe0 2023-10-06T02:47:02.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed44897700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed400b4070 con 0x7fed400b3bd0 2023-10-06T02:47:02.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed44897700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed400b4350 con 0x7fed401583b0 2023-10-06T02:47:02.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed3e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fed40157fe0 0x7fed400b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38218/0 (socket says 172.21.15.81:38218) 2023-10-06T02:47:02.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed3e59c700 1 -- 172.21.15.81:0/657251198 learned_addr learned my addr 172.21.15.81:0/657251198 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:02.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed35d9b700 1 --2- 172.21.15.81:0/657251198 >> v2:172.21.15.83:3300/0 conn(0x7fed400b3bd0 0x7fed400ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:02.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed3ed9d700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed401583b0 0x7fed400cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:02.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550595441 0 0) 0x7fed400b2890 con 0x7fed40157fe0 2023-10-06T02:47:02.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.597+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed2c003570 con 0x7fed40157fe0 2023-10-06T02:47:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3973199527 0 0) 0x7fed2c003570 con 0x7fed40157fe0 2023-10-06T02:47:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed401583b0 msgr2=0x7fed400cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed401583b0 0x7fed400cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 >> v2:172.21.15.83:3300/0 conn(0x7fed400b3bd0 msgr2=0x7fed400ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 --2- 172.21.15.81:0/657251198 >> v2:172.21.15.83:3300/0 conn(0x7fed400b3bd0 0x7fed400ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400b4630 con 0x7fed40157fe0 2023-10-06T02:47:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fed30001470 con 0x7fed40157fe0 2023-10-06T02:47:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 >> v1:172.21.15.81:6789/0 conn(0x7fed40157fe0 legacy=0x7fed400b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed401583b0 0x7fed2c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed2c003fe0 0x7fed2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c004d50 0x7fed2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed400b4070 con 0x7fed2c004d50 2023-10-06T02:47:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed400b4350 con 0x7fed2c003fe0 2023-10-06T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c00ba90 con 0x7fed401583b0 2023-10-06T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3ed9d700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c004d50 0x7fed2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed35d9b700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed2c003fe0 0x7fed2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3e59c700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed401583b0 0x7fed2c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3ed9d700 1 -- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed401583b0 msgr2=0x7fed2c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3ed9d700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed401583b0 0x7fed2c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3ed9d700 1 -- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed2c003fe0 msgr2=0x7fed2c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3ed9d700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed2c003fe0 0x7fed2c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3ed9d700 1 -- 172.21.15.81:0/657251198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c003570 con 0x7fed2c004d50 2023-10-06T02:47:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3ed9d700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c004d50 0x7fed2c0051c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed3800e210 tx=0x7fed3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a8333f1cdbcf05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3800ea60 con 0x7fed2c004d50 2023-10-06T02:47:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3800f040 con 0x7fed2c004d50 2023-10-06T02:47:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.598+0000 7fed3dd9b700 1 -- 172.21.15.81:0/657251198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3800ee10 con 0x7fed2c004d50 2023-10-06T02:47:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.599+0000 7fed44897700 1 -- 172.21.15.81:0/657251198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c004d50 msgr2=0x7fed2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.599+0000 7fed44897700 1 --2- 172.21.15.81:0/657251198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c004d50 0x7fed2c0051c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed3800e210 tx=0x7fed3800b040 comp rx=0 tx=0).stop 2023-10-06T02:47:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.599+0000 7fed3ed9d700 1 -- 172.21.15.81:0/657251198 reap_dead start 2023-10-06T02:47:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.599+0000 7fed44897700 1 -- 172.21.15.81:0/657251198 shutdown_connections 2023-10-06T02:47:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.599+0000 7fed44897700 1 -- 172.21.15.81:0/657251198 >> 172.21.15.81:0/657251198 conn(0x7fed40067640 msgr2=0x7fed40067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.599+0000 7fed44897700 1 -- 172.21.15.81:0/657251198 shutdown_connections 2023-10-06T02:47:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.599+0000 7fed44897700 1 -- 172.21.15.81:0/657251198 wait complete. 2023-10-06T02:47:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.600+0000 7fed44897700 1 Processor -- start 2023-10-06T02:47:02.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.600+0000 7fed44897700 1 -- start start 2023-10-06T02:47:02.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed44897700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4014cea0 0x7fed4015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:02.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed44897700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4015e790 0x7fed4014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:02.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed44897700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed4014fb00 0x7fed4014ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:02.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed44897700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed401504c0 con 0x7fed4015e790 2023-10-06T02:47:02.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed44897700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4015e300 con 0x7fed4014cea0 2023-10-06T02:47:02.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed44897700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4015d6f0 con 0x7fed4014fb00 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed35d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4015e790 0x7fed4014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed35d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4015e790 0x7fed4014eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46438/0 (socket says 172.21.15.81:46438) 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed35d9b700 1 -- 172.21.15.81:0/3065347539 learned_addr learned my addr 172.21.15.81:0/3065347539 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed3ed9d700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed4014fb00 0x7fed4014ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed3e59c700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4014cea0 0x7fed4015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed35d9b700 1 -- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed4014fb00 msgr2=0x7fed4014ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed35d9b700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed4014fb00 0x7fed4014ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed35d9b700 1 -- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4014cea0 msgr2=0x7fed4015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed35d9b700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4014cea0 0x7fed4015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed35d9b700 1 -- 172.21.15.81:0/3065347539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4015d9d0 con 0x7fed4015e790 2023-10-06T02:47:02.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed35d9b700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4015e790 0x7fed4014eec0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fed28009fd0 tx=0x7fed280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:02.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.601+0000 7fed36ffd700 1 -- 172.21.15.81:0/3065347539 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800f730 con 0x7fed4015e790 2023-10-06T02:47:02.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.602+0000 7fed36ffd700 1 -- 172.21.15.81:0/3065347539 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2800f890 con 0x7fed4015e790 2023-10-06T02:47:02.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.602+0000 7fed36ffd700 1 -- 172.21.15.81:0/3065347539 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800fc10 con 0x7fed4015e790 2023-10-06T02:47:02.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.602+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4015dcb0 con 0x7fed4015e790 2023-10-06T02:47:02.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.602+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4014d270 con 0x7fed4015e790 2023-10-06T02:47:02.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.603+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4015e4b0 con 0x7fed4015e790 2023-10-06T02:47:02.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.603+0000 7fed36ffd700 1 -- 172.21.15.81:0/3065347539 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed28014440 con 0x7fed4015e790 2023-10-06T02:47:02.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.603+0000 7fed36ffd700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed20066f30 0x7fed200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:02.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.603+0000 7fed36ffd700 1 -- 172.21.15.81:0/3065347539 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fed28018030 con 0x7fed4015e790 2023-10-06T02:47:02.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.603+0000 7fed3e59c700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed20066f30 0x7fed200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:02.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.604+0000 7fed3e59c700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed20066f30 0x7fed200693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed30004890 tx=0x7fed30001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:02.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.607+0000 7fed36ffd700 1 -- 172.21.15.81:0/3065347539 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed4015e4b0 con 0x7fed4015e790 2023-10-06T02:47:02.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:02.832+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fed40071b10 con 0x7fed4015e790 2023-10-06T02:47:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.459+0000 7fed36ffd700 1 -- 172.21.15.81:0/3065347539 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed280220c0 con 0x7fed4015e790 2023-10-06T02:47:03.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed20066f30 msgr2=0x7fed200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed20066f30 0x7fed200693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed30004890 tx=0x7fed30001e90 comp rx=0 tx=0).stop 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4015e790 msgr2=0x7fed4014eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4015e790 0x7fed4014eec0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fed28009fd0 tx=0x7fed280091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 shutdown_connections 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed4014fb00 0x7fed4014ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed20066f30 0x7fed200693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4014cea0 0x7fed4015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 --2- 172.21.15.81:0/3065347539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4015e790 0x7fed4014eec0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 >> 172.21.15.81:0/3065347539 conn(0x7fed40067640 msgr2=0x7fed4014d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 shutdown_connections 2023-10-06T02:47:03.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.461+0000 7fed44897700 1 -- 172.21.15.81:0/3065347539 wait complete. 2023-10-06T02:47:03.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.589+0000 7fd849d9e700 1 Processor -- start 2023-10-06T02:47:03.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.589+0000 7fd849d9e700 1 -- start start 2023-10-06T02:47:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd849d9e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd8441578d0 0x7fd8440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd849d9e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd844157ca0 0x7fd84415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd849d9e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440d07c0 con 0x7fd84406d120 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd849d9e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440cfbb0 con 0x7fd844157ca0 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd849d9e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440cfe90 con 0x7fd8441578d0 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd842ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd844157ca0 0x7fd84415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd843fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd84406d120 0x7fd84406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38222/0 (socket says 172.21.15.81:38222) 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd843fff700 1 -- 172.21.15.81:0/1507903408 learned_addr learned my addr 172.21.15.81:0/1507903408 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd842ffd700 1 -- 172.21.15.81:0/1507903408 >> v2:172.21.15.83:3300/0 conn(0x7fd8441578d0 msgr2=0x7fd8440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd8437fe700 1 --2- 172.21.15.81:0/1507903408 >> v2:172.21.15.83:3300/0 conn(0x7fd8441578d0 0x7fd8440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd842ffd700 1 --2- 172.21.15.81:0/1507903408 >> v2:172.21.15.83:3300/0 conn(0x7fd8441578d0 0x7fd8440cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd8427fc700 1 -- 172.21.15.81:0/1507903408 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141179543 0 0) 0x7fd8440d07c0 con 0x7fd84406d120 2023-10-06T02:47:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd842ffd700 1 -- 172.21.15.81:0/1507903408 >> v1:172.21.15.81:6789/0 conn(0x7fd84406d120 legacy=0x7fd84406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.590+0000 7fd842ffd700 1 -- 172.21.15.81:0/1507903408 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440d0170 con 0x7fd844157ca0 2023-10-06T02:47:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd842ffd700 1 --2- 172.21.15.81:0/1507903408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 0x7fd84415af00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8440646b0 tx=0x7fd8380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f2c7bb74660a3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd8427fc700 1 -- 172.21.15.81:0/1507903408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800b6b0 con 0x7fd844157ca0 2023-10-06T02:47:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd8427fc700 1 -- 172.21.15.81:0/1507903408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83800b810 con 0x7fd844157ca0 2023-10-06T02:47:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd8427fc700 1 -- 172.21.15.81:0/1507903408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800bbb0 con 0x7fd844157ca0 2023-10-06T02:47:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd849d9e700 1 -- 172.21.15.81:0/1507903408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 msgr2=0x7fd84415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd849d9e700 1 --2- 172.21.15.81:0/1507903408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 0x7fd84415af00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8440646b0 tx=0x7fd8380091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd849d9e700 1 -- 172.21.15.81:0/1507903408 shutdown_connections 2023-10-06T02:47:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd849d9e700 1 --2- 172.21.15.81:0/1507903408 >> v2:172.21.15.83:3300/0 conn(0x7fd8441578d0 0x7fd8440cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd849d9e700 1 --2- 172.21.15.81:0/1507903408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 0x7fd84415af00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd849d9e700 1 -- 172.21.15.81:0/1507903408 >> 172.21.15.81:0/1507903408 conn(0x7fd84406bb90 msgr2=0x7fd84406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd849d9e700 1 -- 172.21.15.81:0/1507903408 shutdown_connections 2023-10-06T02:47:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.591+0000 7fd849d9e700 1 -- 172.21.15.81:0/1507903408 wait complete. 2023-10-06T02:47:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd849d9e700 1 Processor -- start 2023-10-06T02:47:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd849d9e700 1 -- start start 2023-10-06T02:47:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd849d9e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84406d120 0x7fd8440c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd849d9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8441578d0 0x7fd8440c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd849d9e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 0x7fd8441433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd849d9e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440c7560 con 0x7fd844157ca0 2023-10-06T02:47:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd849d9e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440c6060 con 0x7fd84406d120 2023-10-06T02:47:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd849d9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8441438f0 con 0x7fd8441578d0 2023-10-06T02:47:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd843fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 0x7fd8441433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd843fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 0x7fd8441433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46450/0 (socket says 172.21.15.81:46450) 2023-10-06T02:47:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd843fff700 1 -- 172.21.15.81:0/2521173032 learned_addr learned my addr 172.21.15.81:0/2521173032 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd842ffd700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8441578d0 0x7fd8440c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.593+0000 7fd8437fe700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84406d120 0x7fd8440c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd843fff700 1 -- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8441578d0 msgr2=0x7fd8440c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd843fff700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8441578d0 0x7fd8440c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd843fff700 1 -- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84406d120 msgr2=0x7fd8440c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd843fff700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84406d120 0x7fd8440c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd843fff700 1 -- 172.21.15.81:0/2521173032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd838009420 con 0x7fd844157ca0 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd843fff700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 0x7fd8441433b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00ccc0 tx=0x7fd83c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd82b7fe700 1 -- 172.21.15.81:0/2521173032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00a8a0 con 0x7fd844157ca0 2023-10-06T02:47:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd82b7fe700 1 -- 172.21.15.81:0/2521173032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00aa00 con 0x7fd844157ca0 2023-10-06T02:47:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8440c6950 con 0x7fd844157ca0 2023-10-06T02:47:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd82b7fe700 1 -- 172.21.15.81:0/2521173032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00adc0 con 0x7fd844157ca0 2023-10-06T02:47:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.594+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8440c6f10 con 0x7fd844157ca0 2023-10-06T02:47:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.595+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8440c7710 con 0x7fd844157ca0 2023-10-06T02:47:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.595+0000 7fd82b7fe700 1 -- 172.21.15.81:0/2521173032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd83c007300 con 0x7fd844157ca0 2023-10-06T02:47:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.596+0000 7fd82b7fe700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd830066f30 0x7fd8300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.596+0000 7fd82b7fe700 1 -- 172.21.15.81:0/2521173032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd83c0849e0 con 0x7fd844157ca0 2023-10-06T02:47:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.596+0000 7fd8437fe700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd830066f30 0x7fd8300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.596+0000 7fd8437fe700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd830066f30 0x7fd8300693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd83400acb0 tx=0x7fd834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.601+0000 7fd82b7fe700 1 -- 172.21.15.81:0/2521173032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8440c7710 con 0x7fd844157ca0 2023-10-06T02:47:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.825+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8440c7710 con 0x7fd844157ca0 2023-10-06T02:47:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.825+0000 7fd82b7fe700 1 -- 172.21.15.81:0/2521173032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fd8440c7710 con 0x7fd844157ca0 2023-10-06T02:47:03.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:03.828 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/205039596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":205039596},{"type":"v1","addr":"172.21.15.83:6837","nonce":205039596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1667782716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1667782716},{"type":"v1","addr":"172.21.15.83:6836","nonce":1667782716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/433893952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":433893952},{"type":"v1","addr":"172.21.15.81:6834","nonce":433893952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:59.804697+0000","modified":"2023-10-06T02:47:03.458466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/4196355397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4196355397},{"type":"v1","addr":"172.21.15.81:6835","nonce":4196355397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:47:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.827+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd830066f30 msgr2=0x7fd8300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.827+0000 7fd849d9e700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd830066f30 0x7fd8300693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd83400acb0 tx=0x7fd834008040 comp rx=0 tx=0).stop 2023-10-06T02:47:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 msgr2=0x7fd8441433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 0x7fd8441433b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00ccc0 tx=0x7fd83c001a80 comp rx=0 tx=0).stop 2023-10-06T02:47:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 shutdown_connections 2023-10-06T02:47:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd844157ca0 0x7fd8441433b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd830066f30 0x7fd8300693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd84406d120 0x7fd8440c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 --2- 172.21.15.81:0/2521173032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8441578d0 0x7fd8440c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 >> 172.21.15.81:0/2521173032 conn(0x7fd84406bb90 msgr2=0x7fd84406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 shutdown_connections 2023-10-06T02:47:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.828+0000 7fd849d9e700 1 -- 172.21.15.81:0/2521173032 wait complete. 2023-10-06T02:47:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-10-06T02:47:03.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:03.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.954+0000 7faada543700 1 Processor -- start 2023-10-06T02:47:03.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.954+0000 7faada543700 1 -- start start 2023-10-06T02:47:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faada543700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faad4159b40 0x7faad40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faada543700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4068e90 0x7faad40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faada543700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad40cee10 con 0x7faad4159f10 2023-10-06T02:47:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faada543700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad40cd040 con 0x7faad4159b40 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faada543700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad40cd320 con 0x7faad4068e90 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faad8d40700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faad4159f10 0x7faad4068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38236/0 (socket says 172.21.15.81:38236) 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faad8d40700 1 -- 172.21.15.81:0/649114276 learned_addr learned my addr 172.21.15.81:0/649114276 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faad9541700 1 --2- 172.21.15.81:0/649114276 >> v2:172.21.15.83:3300/0 conn(0x7faad4159b40 0x7faad40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faad9d42700 1 --2- 172.21.15.81:0/649114276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4068e90 0x7faad40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faad3fff700 1 -- 172.21.15.81:0/649114276 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209602110 0 0) 0x7faad40cee10 con 0x7faad4159f10 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.955+0000 7faad3fff700 1 -- 172.21.15.81:0/649114276 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faabc003570 con 0x7faad4159f10 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad3fff700 1 -- 172.21.15.81:0/649114276 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 754267430 0 0) 0x7faabc003570 con 0x7faad4159f10 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad9d42700 1 -- 172.21.15.81:0/649114276 >> v2:172.21.15.83:3300/0 conn(0x7faad4159b40 msgr2=0x7faad40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad9d42700 1 --2- 172.21.15.81:0/649114276 >> v2:172.21.15.83:3300/0 conn(0x7faad4159b40 0x7faad40cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad9d42700 1 -- 172.21.15.81:0/649114276 >> v1:172.21.15.81:6789/0 conn(0x7faad4159f10 legacy=0x7faad4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad9d42700 1 -- 172.21.15.81:0/649114276 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40ce7c0 con 0x7faad4068e90 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad9541700 1 --2- 172.21.15.81:0/649114276 >> v2:172.21.15.83:3300/0 conn(0x7faad4159b40 0x7faad40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad9d42700 1 --2- 172.21.15.81:0/649114276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4068e90 0x7faad40cf2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faacc0098e0 tx=0x7faacc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f04ef4ffde58bc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad3fff700 1 -- 172.21.15.81:0/649114276 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac80017f0 con 0x7faad4068e90 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad3fff700 1 -- 172.21.15.81:0/649114276 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc011420 con 0x7faad4068e90 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faad3fff700 1 -- 172.21.15.81:0/649114276 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0117c0 con 0x7faad4068e90 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faada543700 1 -- 172.21.15.81:0/649114276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4068e90 msgr2=0x7faad40cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faada543700 1 --2- 172.21.15.81:0/649114276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4068e90 0x7faad40cf2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faacc0098e0 tx=0x7faacc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faada543700 1 -- 172.21.15.81:0/649114276 shutdown_connections 2023-10-06T02:47:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faada543700 1 --2- 172.21.15.81:0/649114276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4068e90 0x7faad40cf2a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faada543700 1 --2- 172.21.15.81:0/649114276 >> v2:172.21.15.83:3300/0 conn(0x7faad4159b40 0x7faad40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.956+0000 7faada543700 1 -- 172.21.15.81:0/649114276 >> 172.21.15.81:0/649114276 conn(0x7faad40cd660 msgr2=0x7faad40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.957+0000 7faada543700 1 -- 172.21.15.81:0/649114276 shutdown_connections 2023-10-06T02:47:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.957+0000 7faada543700 1 -- 172.21.15.81:0/649114276 wait complete. 2023-10-06T02:47:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.958+0000 7faada543700 1 Processor -- start 2023-10-06T02:47:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.958+0000 7faada543700 1 -- start start 2023-10-06T02:47:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.958+0000 7faada543700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4068e90 0x7faad415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.958+0000 7faada543700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faad4159b40 0x7faad40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.958+0000 7faada543700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4159f10 0x7faad40b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.958+0000 7faada543700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad415c570 con 0x7faad4068e90 2023-10-06T02:47:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.958+0000 7faada543700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad40ca550 con 0x7faad4159b40 2023-10-06T02:47:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.958+0000 7faada543700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad40ca830 con 0x7faad4159f10 2023-10-06T02:47:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9541700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4068e90 0x7faad415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9541700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4068e90 0x7faad415ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46454/0 (socket says 172.21.15.81:46454) 2023-10-06T02:47:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9541700 1 -- 172.21.15.81:0/2463518251 learned_addr learned my addr 172.21.15.81:0/2463518251 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9d42700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4159f10 0x7faad40b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad8d40700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faad4159b40 0x7faad40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9541700 1 -- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4159f10 msgr2=0x7faad40b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9541700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4159f10 0x7faad40b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9541700 1 -- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faad4159b40 msgr2=0x7faad40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9541700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faad4159b40 0x7faad40b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9541700 1 -- 172.21.15.81:0/2463518251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac4009420 con 0x7faad4068e90 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad9541700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4068e90 0x7faad415ca00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faac400ec80 tx=0x7faac40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad17fa700 1 -- 172.21.15.81:0/2463518251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac400c9d0 con 0x7faad4068e90 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad17fa700 1 -- 172.21.15.81:0/2463518251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac400cb30 con 0x7faad4068e90 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc009420 con 0x7faad4068e90 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faad17fa700 1 -- 172.21.15.81:0/2463518251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac400ceb0 con 0x7faad4068e90 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.959+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad416e8b0 con 0x7faad4068e90 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.960+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad415c850 con 0x7faad4068e90 2023-10-06T02:47:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.961+0000 7faad17fa700 1 -- 172.21.15.81:0/2463518251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faac4013680 con 0x7faad4068e90 2023-10-06T02:47:03.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.961+0000 7faad17fa700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:03.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.961+0000 7faad17fa700 1 -- 172.21.15.81:0/2463518251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faac4084b70 con 0x7faad4068e90 2023-10-06T02:47:03.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.961+0000 7faad8d40700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:03.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.962+0000 7faad8d40700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faac8002190 tx=0x7faac80014a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:03.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:03.966+0000 7faad17fa700 1 -- 172.21.15.81:0/2463518251 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faac4051c80 con 0x7faad4068e90 2023-10-06T02:47:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.149+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faad40c8130 con 0x7faad4068e90 2023-10-06T02:47:04.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.150+0000 7faad17fa700 1 -- 172.21.15.81:0/2463518251 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16818 (secure 0 0 0) 0x7faac4017090 con 0x7faad4068e90 2023-10-06T02:47:04.152 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:04.152 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:01.432116+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:57.835962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:58.768263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:04.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faac0066f30 msgr2=0x7faac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faac0066f30 0x7faac00693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faac8002190 tx=0x7faac80014a0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4068e90 msgr2=0x7faad415ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4068e90 0x7faad415ca00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faac400ec80 tx=0x7faac40091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 shutdown_connections 2023-10-06T02:47:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faad4159f10 0x7faad40b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4068e90 0x7faad415ca00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faac0066f30 0x7faac00693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 --2- 172.21.15.81:0/2463518251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faad4159b40 0x7faad40b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 >> 172.21.15.81:0/2463518251 conn(0x7faad40cd660 msgr2=0x7faad40cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 shutdown_connections 2023-10-06T02:47:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.152+0000 7faada543700 1 -- 172.21.15.81:0/2463518251 wait complete. 2023-10-06T02:47:04.166 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:47:04.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:47:04.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.279+0000 7fe27359e700 1 Processor -- start 2023-10-06T02:47:04.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.279+0000 7fe27359e700 1 -- start start 2023-10-06T02:47:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159b40 0x7fe2740cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe274159f10 0x7fe274068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2740cee10 con 0x7fe2740ccb40 2023-10-06T02:47:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2740cd040 con 0x7fe274159f10 2023-10-06T02:47:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2740cd320 con 0x7fe274159b40 2023-10-06T02:47:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe271d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe274159f10 0x7fe274068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe271d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe274159f10 0x7fe274068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46464/0 (socket says 172.21.15.81:46464) 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe272d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe2740ccb40 0x7fe27415d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38244/0 (socket says 172.21.15.81:38244) 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe271d9b700 1 -- 172.21.15.81:0/3563129748 learned_addr learned my addr 172.21.15.81:0/3563129748 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27259c700 1 --2- 172.21.15.81:0/3563129748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159b40 0x7fe2740cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe271d9b700 1 -- 172.21.15.81:0/3563129748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159b40 msgr2=0x7fe2740cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe271d9b700 1 --2- 172.21.15.81:0/3563129748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159b40 0x7fe2740cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe271d9b700 1 -- 172.21.15.81:0/3563129748 >> v1:172.21.15.81:6789/0 conn(0x7fe2740ccb40 legacy=0x7fe27415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe271d9b700 1 -- 172.21.15.81:0/3563129748 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2740ce7c0 con 0x7fe274159f10 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27159a700 1 -- 172.21.15.81:0/3563129748 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636142518 0 0) 0x7fe2740cee10 con 0x7fe2740ccb40 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe271d9b700 1 --2- 172.21.15.81:0/3563129748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159f10 0x7fe274068780 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0099b0 tx=0x7fe25c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffc7fc85463ef4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27159a700 1 -- 172.21.15.81:0/3563129748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00b860 con 0x7fe274159f10 2023-10-06T02:47:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27159a700 1 -- 172.21.15.81:0/3563129748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c00b9c0 con 0x7fe274159f10 2023-10-06T02:47:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27159a700 1 -- 172.21.15.81:0/3563129748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00bd60 con 0x7fe274159f10 2023-10-06T02:47:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 -- 172.21.15.81:0/3563129748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159f10 msgr2=0x7fe274068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 --2- 172.21.15.81:0/3563129748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159f10 0x7fe274068780 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0099b0 tx=0x7fe25c009250 comp rx=0 tx=0).stop 2023-10-06T02:47:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 -- 172.21.15.81:0/3563129748 shutdown_connections 2023-10-06T02:47:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 --2- 172.21.15.81:0/3563129748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159b40 0x7fe2740cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 --2- 172.21.15.81:0/3563129748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159f10 0x7fe274068780 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 -- 172.21.15.81:0/3563129748 >> 172.21.15.81:0/3563129748 conn(0x7fe2740cd660 msgr2=0x7fe2740cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 -- 172.21.15.81:0/3563129748 shutdown_connections 2023-10-06T02:47:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.280+0000 7fe27359e700 1 -- 172.21.15.81:0/3563129748 wait complete. 2023-10-06T02:47:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe27359e700 1 Processor -- start 2023-10-06T02:47:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe27359e700 1 -- start start 2023-10-06T02:47:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe27359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2740ccb40 0x7fe2740c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe27359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159b40 0x7fe274154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe27359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159f10 0x7fe274157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe27359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741579f0 con 0x7fe274159b40 2023-10-06T02:47:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe27359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe274156de0 con 0x7fe2740ccb40 2023-10-06T02:47:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe27359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741570c0 con 0x7fe274159f10 2023-10-06T02:47:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe271d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159b40 0x7fe274154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe271d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159b40 0x7fe274154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46478/0 (socket says 172.21.15.81:46478) 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe271d9b700 1 -- 172.21.15.81:0/366279966 learned_addr learned my addr 172.21.15.81:0/366279966 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.282+0000 7fe27259c700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2740ccb40 0x7fe2740c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe272d9d700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159f10 0x7fe274157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe271d9b700 1 -- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159f10 msgr2=0x7fe274157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe271d9b700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159f10 0x7fe274157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe271d9b700 1 -- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2740ccb40 msgr2=0x7fe2740c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe271d9b700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2740ccb40 0x7fe2740c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe271d9b700 1 -- 172.21.15.81:0/366279966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c0094f0 con 0x7fe274159b40 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe27259c700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2740ccb40 0x7fe2740c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe271d9b700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159b40 0x7fe274154850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe27406fe10 tx=0x7fe25c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe26a7fc700 1 -- 172.21.15.81:0/366279966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c024440 con 0x7fe274159b40 2023-10-06T02:47:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe26a7fc700 1 -- 172.21.15.81:0/366279966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c0245c0 con 0x7fe274159b40 2023-10-06T02:47:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2741573a0 con 0x7fe274159b40 2023-10-06T02:47:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe26a7fc700 1 -- 172.21.15.81:0/366279966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c024980 con 0x7fe274159b40 2023-10-06T02:47:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.283+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2740c8830 con 0x7fe274159b40 2023-10-06T02:47:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.284+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2740cb910 con 0x7fe274159b40 2023-10-06T02:47:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.284+0000 7fe26a7fc700 1 -- 172.21.15.81:0/366279966 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe25c01a420 con 0x7fe274159b40 2023-10-06T02:47:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.285+0000 7fe26a7fc700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe254066f30 0x7fe2540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.285+0000 7fe26a7fc700 1 -- 172.21.15.81:0/366279966 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe25c086500 con 0x7fe274159b40 2023-10-06T02:47:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.285+0000 7fe27259c700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe254066f30 0x7fe2540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.285+0000 7fe27259c700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe254066f30 0x7fe2540693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe2640075e0 tx=0x7fe2640097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.289+0000 7fe26a7fc700 1 -- 172.21.15.81:0/366279966 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe25c053610 con 0x7fe274159b40 2023-10-06T02:47:04.407 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-06T02:47:04.405+0000 7f19bf658700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:47:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.472+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe274157b30 con 0x7fe254066f30 2023-10-06T02:47:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.481+0000 7fe26a7fc700 1 -- 172.21.15.81:0/366279966 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305288 (secure 0 0 0) 0x7fe274157b30 con 0x7fe254066f30 2023-10-06T02:47:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe254066f30 msgr2=0x7fe2540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe254066f30 0x7fe2540693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe2640075e0 tx=0x7fe2640097e0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159b40 msgr2=0x7fe274154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159b40 0x7fe274154850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe27406fe10 tx=0x7fe25c017000 comp rx=0 tx=0).stop 2023-10-06T02:47:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 shutdown_connections 2023-10-06T02:47:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe274159f10 0x7fe274157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe254066f30 0x7fe2540693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2740ccb40 0x7fe2740c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 --2- 172.21.15.81:0/366279966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe274159b40 0x7fe274154850 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 >> 172.21.15.81:0/366279966 conn(0x7fe2740cd660 msgr2=0x7fe2740cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 shutdown_connections 2023-10-06T02:47:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.485+0000 7fe27359e700 1 -- 172.21.15.81:0/366279966 wait complete. 2023-10-06T02:47:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:47:04.498 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-10-06T02:47:03.504624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560174,"statfs":{"total":1600000000,"available":1597618900,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.087778"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.438136+0000","last_change":"2023-10-06T02:47:00.438136+0000","last_active":"2023-10-06T02:47:00.438136+0000","last_peered":"2023-10-06T02:47:00.438136+0000","last_clean":"2023-10-06T02:47:00.438136+0000","last_became_active":"2023-10-06T02:47:00.437902+0000","last_became_peered":"2023-10-06T02:47:00.437902+0000","last_unstale":"2023-10-06T02:47:00.438136+0000","last_undegraded":"2023-10-06T02:47:00.438136+0000","last_fullsized":"2023-10-06T02:47:00.438136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:20.265633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.445058+0000","last_change":"2023-10-06T02:47:00.445058+0000","last_active":"2023-10-06T02:47:00.445058+0000","last_peered":"2023-10-06T02:47:00.445058+0000","last_clean":"2023-10-06T02:47:00.445058+0000","last_became_active":"2023-10-06T02:47:00.443674+0000","last_became_peered":"2023-10-06T02:47:00.443674+0000","last_unstale":"2023-10-06T02:47:00.445058+0000","last_undegraded":"2023-10-06T02:47:00.445058+0000","last_fullsized":"2023-10-06T02:47:00.445058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:08.270110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446316+0000","last_change":"2023-10-06T02:47:00.446269+0000","last_active":"2023-10-06T02:47:00.446316+0000","last_peered":"2023-10-06T02:47:00.446316+0000","last_clean":"2023-10-06T02:47:00.446316+0000","last_became_active":"2023-10-06T02:47:00.445746+0000","last_became_peered":"2023-10-06T02:47:00.445746+0000","last_unstale":"2023-10-06T02:47:00.446316+0000","last_undegraded":"2023-10-06T02:47:00.446316+0000","last_fullsized":"2023-10-06T02:47:00.446316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:19.024957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443900+0000","last_change":"2023-10-06T02:47:00.443900+0000","last_active":"2023-10-06T02:47:00.443900+0000","last_peered":"2023-10-06T02:47:00.443900+0000","last_clean":"2023-10-06T02:47:00.443900+0000","last_became_active":"2023-10-06T02:47:00.443394+0000","last_became_peered":"2023-10-06T02:47:00.443394+0000","last_unstale":"2023-10-06T02:47:00.443900+0000","last_undegraded":"2023-10-06T02:47:00.443900+0000","last_fullsized":"2023-10-06T02:47:00.443900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:32.574691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444657+0000","last_change":"2023-10-06T02:47:00.444657+0000","last_active":"2023-10-06T02:47:00.444657+0000","last_peered":"2023-10-06T02:47:00.444657+0000","last_clean":"2023-10-06T02:47:00.444657+0000","last_became_active":"2023-10-06T02:47:00.444429+0000","last_became_peered":"2023-10-06T02:47:00.444429+0000","last_unstale":"2023-10-06T02:47:00.444657+0000","last_undegraded":"2023-10-06T02:47:00.444657+0000","last_fullsized":"2023-10-06T02:47:00.444657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:06.552586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444836+0000","last_change":"2023-10-06T02:47:00.444836+0000","last_active":"2023-10-06T02:47:00.444836+0000","last_peered":"2023-10-06T02:47:00.444836+0000","last_clean":"2023-10-06T02:47:00.444836+0000","last_became_active":"2023-10-06T02:47:00.444576+0000","last_became_peered":"2023-10-06T02:47:00.444576+0000","last_unstale":"2023-10-06T02:47:00.444836+0000","last_undegraded":"2023-10-06T02:47:00.444836+0000","last_fullsized":"2023-10-06T02:47:00.444836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:30.583161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439113+0000","last_change":"2023-10-06T02:47:00.439032+0000","last_active":"2023-10-06T02:47:00.439113+0000","last_peered":"2023-10-06T02:47:00.439113+0000","last_clean":"2023-10-06T02:47:00.439113+0000","last_became_active":"2023-10-06T02:47:00.438683+0000","last_became_peered":"2023-10-06T02:47:00.438683+0000","last_unstale":"2023-10-06T02:47:00.439113+0000","last_undegraded":"2023-10-06T02:47:00.439113+0000","last_fullsized":"2023-10-06T02:47:00.439113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:47.185529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.437071+0000","last_change":"2023-10-06T02:47:00.437071+0000","last_active":"2023-10-06T02:47:00.437071+0000","last_peered":"2023-10-06T02:47:00.437071+0000","last_clean":"2023-10-06T02:47:00.437071+0000","last_became_active":"2023-10-06T02:47:00.436172+0000","last_became_peered":"2023-10-06T02:47:00.436172+0000","last_unstale":"2023-10-06T02:47:00.437071+0000","last_undegraded":"2023-10-06T02:47:00.437071+0000","last_fullsized":"2023-10-06T02:47:00.437071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:28.956382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443072+0000","last_change":"2023-10-06T02:47:00.443010+0000","last_active":"2023-10-06T02:47:00.443072+0000","last_peered":"2023-10-06T02:47:00.443072+0000","last_clean":"2023-10-06T02:47:00.443072+0000","last_became_active":"2023-10-06T02:47:00.442782+0000","last_became_peered":"2023-10-06T02:47:00.442782+0000","last_unstale":"2023-10-06T02:47:00.443072+0000","last_undegraded":"2023-10-06T02:47:00.443072+0000","last_fullsized":"2023-10-06T02:47:00.443072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:41.062048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440684+0000","last_change":"2023-10-06T02:47:00.440542+0000","last_active":"2023-10-06T02:47:00.440684+0000","last_peered":"2023-10-06T02:47:00.440684+0000","last_clean":"2023-10-06T02:47:00.440684+0000","last_became_active":"2023-10-06T02:47:00.440282+0000","last_became_peered":"2023-10-06T02:47:00.440282+0000","last_unstale":"2023-10-06T02:47:00.440684+0000","last_undegraded":"2023-10-06T02:47:00.440684+0000","last_fullsized":"2023-10-06T02:47:00.440684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:00.206695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446310+0000","last_change":"2023-10-06T02:47:00.446076+0000","last_active":"2023-10-06T02:47:00.446310+0000","last_peered":"2023-10-06T02:47:00.446310+0000","last_clean":"2023-10-06T02:47:00.446310+0000","last_became_active":"2023-10-06T02:47:00.445565+0000","last_became_peered":"2023-10-06T02:47:00.445565+0000","last_unstale":"2023-10-06T02:47:00.446310+0000","last_undegraded":"2023-10-06T02:47:00.446310+0000","last_fullsized":"2023-10-06T02:47:00.446310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:32.217572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440558+0000","last_change":"2023-10-06T02:47:00.440253+0000","last_active":"2023-10-06T02:47:00.440558+0000","last_peered":"2023-10-06T02:47:00.440558+0000","last_clean":"2023-10-06T02:47:00.440558+0000","last_became_active":"2023-10-06T02:47:00.440015+0000","last_became_peered":"2023-10-06T02:47:00.440015+0000","last_unstale":"2023-10-06T02:47:00.440558+0000","last_undegraded":"2023-10-06T02:47:00.440558+0000","last_fullsized":"2023-10-06T02:47:00.440558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:39.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446241+0000","last_change":"2023-10-06T02:47:00.445125+0000","last_active":"2023-10-06T02:47:00.446241+0000","last_peered":"2023-10-06T02:47:00.446241+0000","last_clean":"2023-10-06T02:47:00.446241+0000","last_became_active":"2023-10-06T02:47:00.444379+0000","last_became_peered":"2023-10-06T02:47:00.444379+0000","last_unstale":"2023-10-06T02:47:00.446241+0000","last_undegraded":"2023-10-06T02:47:00.446241+0000","last_fullsized":"2023-10-06T02:47:00.446241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.059752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446054+0000","last_change":"2023-10-06T02:47:00.446054+0000","last_active":"2023-10-06T02:47:00.446054+0000","last_peered":"2023-10-06T02:47:00.446054+0000","last_clean":"2023-10-06T02:47:00.446054+0000","last_became_active":"2023-10-06T02:47:00.445458+0000","last_became_peered":"2023-10-06T02:47:00.445458+0000","last_unstale":"2023-10-06T02:47:00.446054+0000","last_undegraded":"2023-10-06T02:47:00.446054+0000","last_fullsized":"2023-10-06T02:47:00.446054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:28.714870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.436562+0000","last_change":"2023-10-06T02:47:00.436492+0000","last_active":"2023-10-06T02:47:00.436562+0000","last_peered":"2023-10-06T02:47:00.436562+0000","last_clean":"2023-10-06T02:47:00.436562+0000","last_became_active":"2023-10-06T02:47:00.436257+0000","last_became_peered":"2023-10-06T02:47:00.436257+0000","last_unstale":"2023-10-06T02:47:00.436562+0000","last_undegraded":"2023-10-06T02:47:00.436562+0000","last_fullsized":"2023-10-06T02:47:00.436562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:19.024957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449433+0000","last_change":"2023-10-06T02:47:00.449272+0000","last_active":"2023-10-06T02:47:00.449433+0000","last_peered":"2023-10-06T02:47:00.449433+0000","last_clean":"2023-10-06T02:47:00.449433+0000","last_became_active":"2023-10-06T02:47:00.448739+0000","last_became_peered":"2023-10-06T02:47:00.448739+0000","last_unstale":"2023-10-06T02:47:00.449433+0000","last_undegraded":"2023-10-06T02:47:00.449433+0000","last_fullsized":"2023-10-06T02:47:00.449433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:00.206695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444269+0000","last_change":"2023-10-06T02:47:00.443569+0000","last_active":"2023-10-06T02:47:00.444269+0000","last_peered":"2023-10-06T02:47:00.444269+0000","last_clean":"2023-10-06T02:47:00.444269+0000","last_became_active":"2023-10-06T02:47:00.443349+0000","last_became_peered":"2023-10-06T02:47:00.443349+0000","last_unstale":"2023-10-06T02:47:00.444269+0000","last_undegraded":"2023-10-06T02:47:00.444269+0000","last_fullsized":"2023-10-06T02:47:00.444269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:47.185529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.448547+0000","last_change":"2023-10-06T02:47:00.448547+0000","last_active":"2023-10-06T02:47:00.448547+0000","last_peered":"2023-10-06T02:47:00.448547+0000","last_clean":"2023-10-06T02:47:00.448547+0000","last_became_active":"2023-10-06T02:47:00.448304+0000","last_became_peered":"2023-10-06T02:47:00.448304+0000","last_unstale":"2023-10-06T02:47:00.448547+0000","last_undegraded":"2023-10-06T02:47:00.448547+0000","last_fullsized":"2023-10-06T02:47:00.448547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:13.205853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439827+0000","last_change":"2023-10-06T02:47:00.439827+0000","last_active":"2023-10-06T02:47:00.439827+0000","last_peered":"2023-10-06T02:47:00.439827+0000","last_clean":"2023-10-06T02:47:00.439827+0000","last_became_active":"2023-10-06T02:47:00.439599+0000","last_became_peered":"2023-10-06T02:47:00.439599+0000","last_unstale":"2023-10-06T02:47:00.439827+0000","last_undegraded":"2023-10-06T02:47:00.439827+0000","last_fullsized":"2023-10-06T02:47:00.439827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:30.819049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444953+0000","last_change":"2023-10-06T02:47:00.444953+0000","last_active":"2023-10-06T02:47:00.444953+0000","last_peered":"2023-10-06T02:47:00.444953+0000","last_clean":"2023-10-06T02:47:00.444953+0000","last_became_active":"2023-10-06T02:47:00.444611+0000","last_became_peered":"2023-10-06T02:47:00.444611+0000","last_unstale":"2023-10-06T02:47:00.444953+0000","last_undegraded":"2023-10-06T02:47:00.444953+0000","last_fullsized":"2023-10-06T02:47:00.444953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:27.458044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446274+0000","last_change":"2023-10-06T02:47:00.445941+0000","last_active":"2023-10-06T02:47:00.446274+0000","last_peered":"2023-10-06T02:47:00.446274+0000","last_clean":"2023-10-06T02:47:00.446274+0000","last_became_active":"2023-10-06T02:47:00.445250+0000","last_became_peered":"2023-10-06T02:47:00.445250+0000","last_unstale":"2023-10-06T02:47:00.446274+0000","last_undegraded":"2023-10-06T02:47:00.446274+0000","last_fullsized":"2023-10-06T02:47:00.446274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:24.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447465+0000","last_change":"2023-10-06T02:47:00.447465+0000","last_active":"2023-10-06T02:47:00.447465+0000","last_peered":"2023-10-06T02:47:00.447465+0000","last_clean":"2023-10-06T02:47:00.447465+0000","last_became_active":"2023-10-06T02:47:00.446975+0000","last_became_peered":"2023-10-06T02:47:00.446975+0000","last_unstale":"2023-10-06T02:47:00.447465+0000","last_undegraded":"2023-10-06T02:47:00.447465+0000","last_fullsized":"2023-10-06T02:47:00.447465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:00.206695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.441965+0000","last_change":"2023-10-06T02:47:00.441175+0000","last_active":"2023-10-06T02:47:00.441965+0000","last_peered":"2023-10-06T02:47:00.441965+0000","last_clean":"2023-10-06T02:47:00.441965+0000","last_became_active":"2023-10-06T02:47:00.440914+0000","last_became_peered":"2023-10-06T02:47:00.440914+0000","last_unstale":"2023-10-06T02:47:00.441965+0000","last_undegraded":"2023-10-06T02:47:00.441965+0000","last_fullsized":"2023-10-06T02:47:00.441965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:24.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443770+0000","last_change":"2023-10-06T02:47:00.443770+0000","last_active":"2023-10-06T02:47:00.443770+0000","last_peered":"2023-10-06T02:47:00.443770+0000","last_clean":"2023-10-06T02:47:00.443770+0000","last_became_active":"2023-10-06T02:47:00.443102+0000","last_became_peered":"2023-10-06T02:47:00.443102+0000","last_unstale":"2023-10-06T02:47:00.443770+0000","last_undegraded":"2023-10-06T02:47:00.443770+0000","last_fullsized":"2023-10-06T02:47:00.443770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:49.548877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443898+0000","last_change":"2023-10-06T02:47:00.443898+0000","last_active":"2023-10-06T02:47:00.443898+0000","last_peered":"2023-10-06T02:47:00.443898+0000","last_clean":"2023-10-06T02:47:00.443898+0000","last_became_active":"2023-10-06T02:47:00.443650+0000","last_became_peered":"2023-10-06T02:47:00.443650+0000","last_unstale":"2023-10-06T02:47:00.443898+0000","last_undegraded":"2023-10-06T02:47:00.443898+0000","last_fullsized":"2023-10-06T02:47:00.443898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:32.496295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447566+0000","last_change":"2023-10-06T02:47:00.447566+0000","last_active":"2023-10-06T02:47:00.447566+0000","last_peered":"2023-10-06T02:47:00.447566+0000","last_clean":"2023-10-06T02:47:00.447566+0000","last_became_active":"2023-10-06T02:47:00.447296+0000","last_became_peered":"2023-10-06T02:47:00.447296+0000","last_unstale":"2023-10-06T02:47:00.447566+0000","last_undegraded":"2023-10-06T02:47:00.447566+0000","last_fullsized":"2023-10-06T02:47:00.447566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:41.062048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447119+0000","last_change":"2023-10-06T02:47:00.447119+0000","last_active":"2023-10-06T02:47:00.447119+0000","last_peered":"2023-10-06T02:47:00.447119+0000","last_clean":"2023-10-06T02:47:00.447119+0000","last_became_active":"2023-10-06T02:47:00.446703+0000","last_became_peered":"2023-10-06T02:47:00.446703+0000","last_unstale":"2023-10-06T02:47:00.447119+0000","last_undegraded":"2023-10-06T02:47:00.447119+0000","last_fullsized":"2023-10-06T02:47:00.447119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.457697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.437753+0000","last_change":"2023-10-06T02:47:00.437204+0000","last_active":"2023-10-06T02:47:00.437753+0000","last_peered":"2023-10-06T02:47:00.437753+0000","last_clean":"2023-10-06T02:47:00.437753+0000","last_became_active":"2023-10-06T02:47:00.436911+0000","last_became_peered":"2023-10-06T02:47:00.436911+0000","last_unstale":"2023-10-06T02:47:00.437753+0000","last_undegraded":"2023-10-06T02:47:00.437753+0000","last_fullsized":"2023-10-06T02:47:00.437753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:56.656453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444882+0000","last_change":"2023-10-06T02:47:00.444882+0000","last_active":"2023-10-06T02:47:00.444882+0000","last_peered":"2023-10-06T02:47:00.444882+0000","last_clean":"2023-10-06T02:47:00.444882+0000","last_became_active":"2023-10-06T02:47:00.444626+0000","last_became_peered":"2023-10-06T02:47:00.444626+0000","last_unstale":"2023-10-06T02:47:00.444882+0000","last_undegraded":"2023-10-06T02:47:00.444882+0000","last_fullsized":"2023-10-06T02:47:00.444882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:27.924365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.441296+0000","last_change":"2023-10-06T02:47:00.441296+0000","last_active":"2023-10-06T02:47:00.441296+0000","last_peered":"2023-10-06T02:47:00.441296+0000","last_clean":"2023-10-06T02:47:00.441296+0000","last_became_active":"2023-10-06T02:47:00.441080+0000","last_became_peered":"2023-10-06T02:47:00.441080+0000","last_unstale":"2023-10-06T02:47:00.441296+0000","last_undegraded":"2023-10-06T02:47:00.441296+0000","last_fullsized":"2023-10-06T02:47:00.441296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:02.966473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449401+0000","last_change":"2023-10-06T02:47:00.448995+0000","last_active":"2023-10-06T02:47:00.449401+0000","last_peered":"2023-10-06T02:47:00.449401+0000","last_clean":"2023-10-06T02:47:00.449401+0000","last_became_active":"2023-10-06T02:47:00.448135+0000","last_became_peered":"2023-10-06T02:47:00.448135+0000","last_unstale":"2023-10-06T02:47:00.449401+0000","last_undegraded":"2023-10-06T02:47:00.449401+0000","last_fullsized":"2023-10-06T02:47:00.449401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:39.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439442+0000","last_change":"2023-10-06T02:47:00.439442+0000","last_active":"2023-10-06T02:47:00.439442+0000","last_peered":"2023-10-06T02:47:00.439442+0000","last_clean":"2023-10-06T02:47:00.439442+0000","last_became_active":"2023-10-06T02:47:00.439243+0000","last_became_peered":"2023-10-06T02:47:00.439243+0000","last_unstale":"2023-10-06T02:47:00.439442+0000","last_undegraded":"2023-10-06T02:47:00.439442+0000","last_fullsized":"2023-10-06T02:47:00.439442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:15.250830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449416+0000","last_change":"2023-10-06T02:47:00.449133+0000","last_active":"2023-10-06T02:47:00.449416+0000","last_peered":"2023-10-06T02:47:00.449416+0000","last_clean":"2023-10-06T02:47:00.449416+0000","last_became_active":"2023-10-06T02:47:00.448452+0000","last_became_peered":"2023-10-06T02:47:00.448452+0000","last_unstale":"2023-10-06T02:47:00.449416+0000","last_undegraded":"2023-10-06T02:47:00.449416+0000","last_fullsized":"2023-10-06T02:47:00.449416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.059752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.455715+0000","last_change":"2023-10-06T02:46:59.430219+0000","last_active":"2023-10-06T02:47:00.455715+0000","last_peered":"2023-10-06T02:47:00.455715+0000","last_clean":"2023-10-06T02:47:00.455715+0000","last_became_active":"2023-10-06T02:46:59.429981+0000","last_became_peered":"2023-10-06T02:46:59.429981+0000","last_unstale":"2023-10-06T02:47:00.455715+0000","last_undegraded":"2023-10-06T02:47:00.455715+0000","last_fullsized":"2023-10-06T02:47:00.455715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:15.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443944+0000","last_change":"2023-10-06T02:47:00.443944+0000","last_active":"2023-10-06T02:47:00.443944+0000","last_peered":"2023-10-06T02:47:00.443944+0000","last_clean":"2023-10-06T02:47:00.443944+0000","last_became_active":"2023-10-06T02:47:00.443355+0000","last_became_peered":"2023-10-06T02:47:00.443355+0000","last_unstale":"2023-10-06T02:47:00.443944+0000","last_undegraded":"2023-10-06T02:47:00.443944+0000","last_fullsized":"2023-10-06T02:47:00.443944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:39.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.451452+0000","last_change":"2023-10-06T02:46:59.431701+0000","last_active":"2023-10-06T02:47:00.451452+0000","last_peered":"2023-10-06T02:47:00.451452+0000","last_clean":"2023-10-06T02:47:00.451452+0000","last_became_active":"2023-10-06T02:46:59.431287+0000","last_became_peered":"2023-10-06T02:46:59.431287+0000","last_unstale":"2023-10-06T02:47:00.451452+0000","last_undegraded":"2023-10-06T02:47:00.451452+0000","last_fullsized":"2023-10-06T02:47:00.451452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:58.653124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.445908+0000","last_change":"2023-10-06T02:47:00.445908+0000","last_active":"2023-10-06T02:47:00.445908+0000","last_peered":"2023-10-06T02:47:00.445908+0000","last_clean":"2023-10-06T02:47:00.445908+0000","last_became_active":"2023-10-06T02:47:00.445155+0000","last_became_peered":"2023-10-06T02:47:00.445155+0000","last_unstale":"2023-10-06T02:47:00.445908+0000","last_undegraded":"2023-10-06T02:47:00.445908+0000","last_fullsized":"2023-10-06T02:47:00.445908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:20.265633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.450598+0000","last_change":"2023-10-06T02:46:59.431023+0000","last_active":"2023-10-06T02:47:00.450598+0000","last_peered":"2023-10-06T02:47:00.450598+0000","last_clean":"2023-10-06T02:47:00.450598+0000","last_became_active":"2023-10-06T02:46:59.430789+0000","last_became_peered":"2023-10-06T02:46:59.430789+0000","last_unstale":"2023-10-06T02:47:00.450598+0000","last_undegraded":"2023-10-06T02:47:00.450598+0000","last_fullsized":"2023-10-06T02:47:00.450598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:29.814430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443274+0000","last_change":"2023-10-06T02:47:00.443274+0000","last_active":"2023-10-06T02:47:00.443274+0000","last_peered":"2023-10-06T02:47:00.443274+0000","last_clean":"2023-10-06T02:47:00.443274+0000","last_became_active":"2023-10-06T02:47:00.443022+0000","last_became_peered":"2023-10-06T02:47:00.443022+0000","last_unstale":"2023-10-06T02:47:00.443274+0000","last_undegraded":"2023-10-06T02:47:00.443274+0000","last_fullsized":"2023-10-06T02:47:00.443274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:00.206695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.453944+0000","last_change":"2023-10-06T02:46:59.427292+0000","last_active":"2023-10-06T02:47:00.453944+0000","last_peered":"2023-10-06T02:47:00.453944+0000","last_clean":"2023-10-06T02:47:00.453944+0000","last_became_active":"2023-10-06T02:46:59.427067+0000","last_became_peered":"2023-10-06T02:46:59.427067+0000","last_unstale":"2023-10-06T02:47:00.453944+0000","last_undegraded":"2023-10-06T02:47:00.453944+0000","last_fullsized":"2023-10-06T02:47:00.453944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:14.246211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.441334+0000","last_change":"2023-10-06T02:47:00.441286+0000","last_active":"2023-10-06T02:47:00.441334+0000","last_peered":"2023-10-06T02:47:00.441334+0000","last_clean":"2023-10-06T02:47:00.441334+0000","last_became_active":"2023-10-06T02:47:00.441116+0000","last_became_peered":"2023-10-06T02:47:00.441116+0000","last_unstale":"2023-10-06T02:47:00.441334+0000","last_undegraded":"2023-10-06T02:47:00.441334+0000","last_fullsized":"2023-10-06T02:47:00.441334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:45.748289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.453277+0000","last_change":"2023-10-06T02:46:59.431939+0000","last_active":"2023-10-06T02:47:00.453277+0000","last_peered":"2023-10-06T02:47:00.453277+0000","last_clean":"2023-10-06T02:47:00.453277+0000","last_became_active":"2023-10-06T02:46:59.431397+0000","last_became_peered":"2023-10-06T02:46:59.431397+0000","last_unstale":"2023-10-06T02:47:00.453277+0000","last_undegraded":"2023-10-06T02:47:00.453277+0000","last_fullsized":"2023-10-06T02:47:00.453277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:58.653124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440666+0000","last_change":"2023-10-06T02:47:00.440159+0000","last_active":"2023-10-06T02:47:00.440666+0000","last_peered":"2023-10-06T02:47:00.440666+0000","last_clean":"2023-10-06T02:47:00.440666+0000","last_became_active":"2023-10-06T02:47:00.439901+0000","last_became_peered":"2023-10-06T02:47:00.439901+0000","last_unstale":"2023-10-06T02:47:00.440666+0000","last_undegraded":"2023-10-06T02:47:00.440666+0000","last_fullsized":"2023-10-06T02:47:00.440666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:39.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.456043+0000","last_change":"2023-10-06T02:46:59.432484+0000","last_active":"2023-10-06T02:47:00.456043+0000","last_peered":"2023-10-06T02:47:00.456043+0000","last_clean":"2023-10-06T02:47:00.456043+0000","last_became_active":"2023-10-06T02:46:59.432257+0000","last_became_peered":"2023-10-06T02:46:59.432257+0000","last_unstale":"2023-10-06T02:47:00.456043+0000","last_undegraded":"2023-10-06T02:47:00.456043+0000","last_fullsized":"2023-10-06T02:47:00.456043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:29.814430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447828+0000","last_change":"2023-10-06T02:47:00.447828+0000","last_active":"2023-10-06T02:47:00.447828+0000","last_peered":"2023-10-06T02:47:00.447828+0000","last_clean":"2023-10-06T02:47:00.447828+0000","last_became_active":"2023-10-06T02:47:00.447602+0000","last_became_peered":"2023-10-06T02:47:00.447602+0000","last_unstale":"2023-10-06T02:47:00.447828+0000","last_undegraded":"2023-10-06T02:47:00.447828+0000","last_fullsized":"2023-10-06T02:47:00.447828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:08.270110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.429257+0000","last_change":"2023-10-06T02:46:59.429089+0000","last_active":"2023-10-06T02:46:59.429257+0000","last_peered":"2023-10-06T02:46:59.429257+0000","last_clean":"2023-10-06T02:46:59.429257+0000","last_became_active":"2023-10-06T02:46:59.428897+0000","last_became_peered":"2023-10-06T02:46:59.428897+0000","last_unstale":"2023-10-06T02:46:59.429257+0000","last_undegraded":"2023-10-06T02:46:59.429257+0000","last_fullsized":"2023-10-06T02:46:59.429257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:48.660259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440894+0000","last_change":"2023-10-06T02:47:00.440894+0000","last_active":"2023-10-06T02:47:00.440894+0000","last_peered":"2023-10-06T02:47:00.440894+0000","last_clean":"2023-10-06T02:47:00.440894+0000","last_became_active":"2023-10-06T02:47:00.440587+0000","last_became_peered":"2023-10-06T02:47:00.440587+0000","last_unstale":"2023-10-06T02:47:00.440894+0000","last_undegraded":"2023-10-06T02:47:00.440894+0000","last_fullsized":"2023-10-06T02:47:00.440894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.059752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.433790+0000","last_change":"2023-10-06T02:46:59.433536+0000","last_active":"2023-10-06T02:46:59.433790+0000","last_peered":"2023-10-06T02:46:59.433790+0000","last_clean":"2023-10-06T02:46:59.433790+0000","last_became_active":"2023-10-06T02:46:59.433344+0000","last_became_peered":"2023-10-06T02:46:59.433344+0000","last_unstale":"2023-10-06T02:46:59.433790+0000","last_undegraded":"2023-10-06T02:46:59.433790+0000","last_fullsized":"2023-10-06T02:46:59.433790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:44.743670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443629+0000","last_change":"2023-10-06T02:47:00.443629+0000","last_active":"2023-10-06T02:47:00.443629+0000","last_peered":"2023-10-06T02:47:00.443629+0000","last_clean":"2023-10-06T02:47:00.443629+0000","last_became_active":"2023-10-06T02:47:00.442809+0000","last_became_peered":"2023-10-06T02:47:00.442809+0000","last_unstale":"2023-10-06T02:47:00.443629+0000","last_undegraded":"2023-10-06T02:47:00.443629+0000","last_fullsized":"2023-10-06T02:47:00.443629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:49.664878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.425885+0000","last_change":"2023-10-06T02:46:59.425767+0000","last_active":"2023-10-06T02:46:59.425885+0000","last_peered":"2023-10-06T02:46:59.425885+0000","last_clean":"2023-10-06T02:46:59.425885+0000","last_became_active":"2023-10-06T02:46:59.424703+0000","last_became_peered":"2023-10-06T02:46:59.424703+0000","last_unstale":"2023-10-06T02:46:59.425885+0000","last_undegraded":"2023-10-06T02:46:59.425885+0000","last_fullsized":"2023-10-06T02:46:59.425885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:32.164096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443114+0000","last_change":"2023-10-06T02:47:00.443033+0000","last_active":"2023-10-06T02:47:00.443114+0000","last_peered":"2023-10-06T02:47:00.443114+0000","last_clean":"2023-10-06T02:47:00.443114+0000","last_became_active":"2023-10-06T02:47:00.442754+0000","last_became_peered":"2023-10-06T02:47:00.442754+0000","last_unstale":"2023-10-06T02:47:00.443114+0000","last_undegraded":"2023-10-06T02:47:00.443114+0000","last_fullsized":"2023-10-06T02:47:00.443114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:56.656453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.435204+0000","last_change":"2023-10-06T02:46:59.431801+0000","last_active":"2023-10-06T02:47:00.435204+0000","last_peered":"2023-10-06T02:47:00.435204+0000","last_clean":"2023-10-06T02:47:00.435204+0000","last_became_active":"2023-10-06T02:46:59.431068+0000","last_became_peered":"2023-10-06T02:46:59.431068+0000","last_unstale":"2023-10-06T02:47:00.435204+0000","last_undegraded":"2023-10-06T02:47:00.435204+0000","last_fullsized":"2023-10-06T02:47:00.435204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:05.547967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.442366+0000","last_change":"2023-10-06T02:47:00.442304+0000","last_active":"2023-10-06T02:47:00.442366+0000","last_peered":"2023-10-06T02:47:00.442366+0000","last_clean":"2023-10-06T02:47:00.442366+0000","last_became_active":"2023-10-06T02:47:00.442075+0000","last_became_peered":"2023-10-06T02:47:00.442075+0000","last_unstale":"2023-10-06T02:47:00.442366+0000","last_undegraded":"2023-10-06T02:47:00.442366+0000","last_fullsized":"2023-10-06T02:47:00.442366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:07.184182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.455339+0000","last_change":"2023-10-06T02:46:59.426472+0000","last_active":"2023-10-06T02:47:00.455339+0000","last_peered":"2023-10-06T02:47:00.455339+0000","last_clean":"2023-10-06T02:47:00.455339+0000","last_became_active":"2023-10-06T02:46:59.426222+0000","last_became_peered":"2023-10-06T02:46:59.426222+0000","last_unstale":"2023-10-06T02:47:00.455339+0000","last_undegraded":"2023-10-06T02:47:00.455339+0000","last_fullsized":"2023-10-06T02:47:00.455339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:31.570072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443498+0000","last_change":"2023-10-06T02:47:00.443498+0000","last_active":"2023-10-06T02:47:00.443498+0000","last_peered":"2023-10-06T02:47:00.443498+0000","last_clean":"2023-10-06T02:47:00.443498+0000","last_became_active":"2023-10-06T02:47:00.443250+0000","last_became_peered":"2023-10-06T02:47:00.443250+0000","last_unstale":"2023-10-06T02:47:00.443498+0000","last_undegraded":"2023-10-06T02:47:00.443498+0000","last_fullsized":"2023-10-06T02:47:00.443498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:56.656453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.454223+0000","last_change":"2023-10-06T02:46:59.429465+0000","last_active":"2023-10-06T02:47:00.454223+0000","last_peered":"2023-10-06T02:47:00.454223+0000","last_clean":"2023-10-06T02:47:00.454223+0000","last_became_active":"2023-10-06T02:46:59.429224+0000","last_became_peered":"2023-10-06T02:46:59.429224+0000","last_unstale":"2023-10-06T02:47:00.454223+0000","last_undegraded":"2023-10-06T02:47:00.454223+0000","last_fullsized":"2023-10-06T02:47:00.454223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:19.968504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446432+0000","last_change":"2023-10-06T02:47:00.446364+0000","last_active":"2023-10-06T02:47:00.446432+0000","last_peered":"2023-10-06T02:47:00.446432+0000","last_clean":"2023-10-06T02:47:00.446432+0000","last_became_active":"2023-10-06T02:47:00.446063+0000","last_became_peered":"2023-10-06T02:47:00.446063+0000","last_unstale":"2023-10-06T02:47:00.446432+0000","last_undegraded":"2023-10-06T02:47:00.446432+0000","last_fullsized":"2023-10-06T02:47:00.446432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:30.583161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.451835+0000","last_change":"2023-10-06T02:46:59.423960+0000","last_active":"2023-10-06T02:47:00.451835+0000","last_peered":"2023-10-06T02:47:00.451835+0000","last_clean":"2023-10-06T02:47:00.451835+0000","last_became_active":"2023-10-06T02:46:59.423737+0000","last_became_peered":"2023-10-06T02:46:59.423737+0000","last_unstale":"2023-10-06T02:47:00.451835+0000","last_undegraded":"2023-10-06T02:47:00.451835+0000","last_fullsized":"2023-10-06T02:47:00.451835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:14.246211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.437706+0000","last_change":"2023-10-06T02:47:00.437706+0000","last_active":"2023-10-06T02:47:00.437706+0000","last_peered":"2023-10-06T02:47:00.437706+0000","last_clean":"2023-10-06T02:47:00.437706+0000","last_became_active":"2023-10-06T02:47:00.437357+0000","last_became_peered":"2023-10-06T02:47:00.437357+0000","last_unstale":"2023-10-06T02:47:00.437706+0000","last_undegraded":"2023-10-06T02:47:00.437706+0000","last_fullsized":"2023-10-06T02:47:00.437706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:28.714870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.429349+0000","last_change":"2023-10-06T02:46:59.429296+0000","last_active":"2023-10-06T02:46:59.429349+0000","last_peered":"2023-10-06T02:46:59.429349+0000","last_clean":"2023-10-06T02:46:59.429349+0000","last_became_active":"2023-10-06T02:46:59.429075+0000","last_became_peered":"2023-10-06T02:46:59.429075+0000","last_unstale":"2023-10-06T02:46:59.429349+0000","last_undegraded":"2023-10-06T02:46:59.429349+0000","last_fullsized":"2023-10-06T02:46:59.429349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:31.570072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449371+0000","last_change":"2023-10-06T02:47:00.447630+0000","last_active":"2023-10-06T02:47:00.449371+0000","last_peered":"2023-10-06T02:47:00.449371+0000","last_clean":"2023-10-06T02:47:00.449371+0000","last_became_active":"2023-10-06T02:47:00.446996+0000","last_became_peered":"2023-10-06T02:47:00.446996+0000","last_unstale":"2023-10-06T02:47:00.449371+0000","last_undegraded":"2023-10-06T02:47:00.449371+0000","last_fullsized":"2023-10-06T02:47:00.449371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:32.217572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.430713+0000","last_change":"2023-10-06T02:46:59.430552+0000","last_active":"2023-10-06T02:46:59.430713+0000","last_peered":"2023-10-06T02:46:59.430713+0000","last_clean":"2023-10-06T02:46:59.430713+0000","last_became_active":"2023-10-06T02:46:59.430319+0000","last_became_peered":"2023-10-06T02:46:59.430319+0000","last_unstale":"2023-10-06T02:46:59.430713+0000","last_undegraded":"2023-10-06T02:46:59.430713+0000","last_fullsized":"2023-10-06T02:46:59.430713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:19.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.445854+0000","last_change":"2023-10-06T02:47:00.445854+0000","last_active":"2023-10-06T02:47:00.445854+0000","last_peered":"2023-10-06T02:47:00.445854+0000","last_clean":"2023-10-06T02:47:00.445854+0000","last_became_active":"2023-10-06T02:47:00.445416+0000","last_became_peered":"2023-10-06T02:47:00.445416+0000","last_unstale":"2023-10-06T02:47:00.445854+0000","last_undegraded":"2023-10-06T02:47:00.445854+0000","last_fullsized":"2023-10-06T02:47:00.445854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:56.408406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.456003+0000","last_change":"2023-10-06T02:46:59.433833+0000","last_active":"2023-10-06T02:47:00.456003+0000","last_peered":"2023-10-06T02:47:00.456003+0000","last_clean":"2023-10-06T02:47:00.456003+0000","last_became_active":"2023-10-06T02:46:59.433614+0000","last_became_peered":"2023-10-06T02:46:59.433614+0000","last_unstale":"2023-10-06T02:47:00.456003+0000","last_undegraded":"2023-10-06T02:47:00.456003+0000","last_fullsized":"2023-10-06T02:47:00.456003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:48.660259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444357+0000","last_change":"2023-10-06T02:47:00.444357+0000","last_active":"2023-10-06T02:47:00.444357+0000","last_peered":"2023-10-06T02:47:00.444357+0000","last_clean":"2023-10-06T02:47:00.444357+0000","last_became_active":"2023-10-06T02:47:00.443375+0000","last_became_peered":"2023-10-06T02:47:00.443375+0000","last_unstale":"2023-10-06T02:47:00.444357+0000","last_undegraded":"2023-10-06T02:47:00.444357+0000","last_fullsized":"2023-10-06T02:47:00.444357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:56.656453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.454552+0000","last_change":"2023-10-06T02:46:59.431624+0000","last_active":"2023-10-06T02:47:00.454552+0000","last_peered":"2023-10-06T02:47:00.454552+0000","last_clean":"2023-10-06T02:47:00.454552+0000","last_became_active":"2023-10-06T02:46:59.431383+0000","last_became_peered":"2023-10-06T02:46:59.431383+0000","last_unstale":"2023-10-06T02:47:00.454552+0000","last_undegraded":"2023-10-06T02:47:00.454552+0000","last_fullsized":"2023-10-06T02:47:00.454552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:48.660259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446260+0000","last_change":"2023-10-06T02:47:00.445799+0000","last_active":"2023-10-06T02:47:00.446260+0000","last_peered":"2023-10-06T02:47:00.446260+0000","last_clean":"2023-10-06T02:47:00.446260+0000","last_became_active":"2023-10-06T02:47:00.444931+0000","last_became_peered":"2023-10-06T02:47:00.444931+0000","last_unstale":"2023-10-06T02:47:00.446260+0000","last_undegraded":"2023-10-06T02:47:00.446260+0000","last_fullsized":"2023-10-06T02:47:00.446260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:41.062048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.454254+0000","last_change":"2023-10-06T02:46:59.432996+0000","last_active":"2023-10-06T02:47:00.454254+0000","last_peered":"2023-10-06T02:47:00.454254+0000","last_clean":"2023-10-06T02:47:00.454254+0000","last_became_active":"2023-10-06T02:46:59.432630+0000","last_became_peered":"2023-10-06T02:46:59.432630+0000","last_unstale":"2023-10-06T02:47:00.454254+0000","last_undegraded":"2023-10-06T02:47:00.454254+0000","last_fullsized":"2023-10-06T02:47:00.454254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:12.550143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443076+0000","last_change":"2023-10-06T02:47:00.443076+0000","last_active":"2023-10-06T02:47:00.443076+0000","last_peered":"2023-10-06T02:47:00.443076+0000","last_clean":"2023-10-06T02:47:00.443076+0000","last_became_active":"2023-10-06T02:47:00.442733+0000","last_became_peered":"2023-10-06T02:47:00.442733+0000","last_unstale":"2023-10-06T02:47:00.443076+0000","last_undegraded":"2023-10-06T02:47:00.443076+0000","last_fullsized":"2023-10-06T02:47:00.443076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.059752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.433103+0000","last_change":"2023-10-06T02:46:59.431923+0000","last_active":"2023-10-06T02:47:00.433103+0000","last_peered":"2023-10-06T02:47:00.433103+0000","last_clean":"2023-10-06T02:47:00.433103+0000","last_became_active":"2023-10-06T02:46:59.431763+0000","last_became_peered":"2023-10-06T02:46:59.431763+0000","last_unstale":"2023-10-06T02:47:00.433103+0000","last_undegraded":"2023-10-06T02:47:00.433103+0000","last_fullsized":"2023-10-06T02:47:00.433103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:36.043088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440495+0000","last_change":"2023-10-06T02:47:00.440495+0000","last_active":"2023-10-06T02:47:00.440495+0000","last_peered":"2023-10-06T02:47:00.440495+0000","last_clean":"2023-10-06T02:47:00.440495+0000","last_became_active":"2023-10-06T02:47:00.440290+0000","last_became_peered":"2023-10-06T02:47:00.440290+0000","last_unstale":"2023-10-06T02:47:00.440495+0000","last_undegraded":"2023-10-06T02:47:00.440495+0000","last_fullsized":"2023-10-06T02:47:00.440495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:59.657743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.429273+0000","last_change":"2023-10-06T02:46:59.429180+0000","last_active":"2023-10-06T02:46:59.429273+0000","last_peered":"2023-10-06T02:46:59.429273+0000","last_clean":"2023-10-06T02:46:59.429273+0000","last_became_active":"2023-10-06T02:46:59.428958+0000","last_became_peered":"2023-10-06T02:46:59.428958+0000","last_unstale":"2023-10-06T02:46:59.429273+0000","last_undegraded":"2023-10-06T02:46:59.429273+0000","last_fullsized":"2023-10-06T02:46:59.429273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:48.544258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449356+0000","last_change":"2023-10-06T02:47:00.447207+0000","last_active":"2023-10-06T02:47:00.449356+0000","last_peered":"2023-10-06T02:47:00.449356+0000","last_clean":"2023-10-06T02:47:00.449356+0000","last_became_active":"2023-10-06T02:47:00.446709+0000","last_became_peered":"2023-10-06T02:47:00.446709+0000","last_unstale":"2023-10-06T02:47:00.449356+0000","last_undegraded":"2023-10-06T02:47:00.449356+0000","last_fullsized":"2023-10-06T02:47:00.449356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:08.270110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.451805+0000","last_change":"2023-10-06T02:46:59.424155+0000","last_active":"2023-10-06T02:47:00.451805+0000","last_peered":"2023-10-06T02:47:00.451805+0000","last_clean":"2023-10-06T02:47:00.451805+0000","last_became_active":"2023-10-06T02:46:59.423933+0000","last_became_peered":"2023-10-06T02:46:59.423933+0000","last_unstale":"2023-10-06T02:47:00.451805+0000","last_undegraded":"2023-10-06T02:47:00.451805+0000","last_fullsized":"2023-10-06T02:47:00.451805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:10.252367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440087+0000","last_change":"2023-10-06T02:47:00.440011+0000","last_active":"2023-10-06T02:47:00.440087+0000","last_peered":"2023-10-06T02:47:00.440087+0000","last_clean":"2023-10-06T02:47:00.440087+0000","last_became_active":"2023-10-06T02:47:00.439790+0000","last_became_peered":"2023-10-06T02:47:00.439790+0000","last_unstale":"2023-10-06T02:47:00.440087+0000","last_undegraded":"2023-10-06T02:47:00.440087+0000","last_fullsized":"2023-10-06T02:47:00.440087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:02.250831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.431649+0000","last_change":"2023-10-06T02:46:59.431601+0000","last_active":"2023-10-06T02:46:59.431649+0000","last_peered":"2023-10-06T02:46:59.431649+0000","last_clean":"2023-10-06T02:46:59.431649+0000","last_became_active":"2023-10-06T02:46:59.431366+0000","last_became_peered":"2023-10-06T02:46:59.431366+0000","last_unstale":"2023-10-06T02:46:59.431649+0000","last_undegraded":"2023-10-06T02:46:59.431649+0000","last_fullsized":"2023-10-06T02:46:59.431649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:43.307658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446289+0000","last_change":"2023-10-06T02:47:00.446010+0000","last_active":"2023-10-06T02:47:00.446289+0000","last_peered":"2023-10-06T02:47:00.446289+0000","last_clean":"2023-10-06T02:47:00.446289+0000","last_became_active":"2023-10-06T02:47:00.445511+0000","last_became_peered":"2023-10-06T02:47:00.445511+0000","last_unstale":"2023-10-06T02:47:00.446289+0000","last_undegraded":"2023-10-06T02:47:00.446289+0000","last_fullsized":"2023-10-06T02:47:00.446289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:30.583161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.438027+0000","last_change":"2023-10-06T02:46:59.433592+0000","last_active":"2023-10-06T02:47:00.438027+0000","last_peered":"2023-10-06T02:47:00.438027+0000","last_clean":"2023-10-06T02:47:00.438027+0000","last_became_active":"2023-10-06T02:46:59.433395+0000","last_became_peered":"2023-10-06T02:46:59.433395+0000","last_unstale":"2023-10-06T02:47:00.438027+0000","last_undegraded":"2023-10-06T02:47:00.438027+0000","last_fullsized":"2023-10-06T02:47:00.438027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:48.544258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.442789+0000","last_change":"2023-10-06T02:47:00.442789+0000","last_active":"2023-10-06T02:47:00.442789+0000","last_peered":"2023-10-06T02:47:00.442789+0000","last_clean":"2023-10-06T02:47:00.442789+0000","last_became_active":"2023-10-06T02:47:00.440854+0000","last_became_peered":"2023-10-06T02:47:00.440854+0000","last_unstale":"2023-10-06T02:47:00.442789+0000","last_undegraded":"2023-10-06T02:47:00.442789+0000","last_fullsized":"2023-10-06T02:47:00.442789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:57.237961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.424829+0000","last_change":"2023-10-06T02:46:59.424771+0000","last_active":"2023-10-06T02:46:59.424829+0000","last_peered":"2023-10-06T02:46:59.424829+0000","last_clean":"2023-10-06T02:46:59.424829+0000","last_became_active":"2023-10-06T02:46:59.424515+0000","last_became_peered":"2023-10-06T02:46:59.424515+0000","last_unstale":"2023-10-06T02:46:59.424829+0000","last_undegraded":"2023-10-06T02:46:59.424829+0000","last_fullsized":"2023-10-06T02:46:59.424829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:49.567116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439296+0000","last_change":"2023-10-06T02:47:00.439095+0000","last_active":"2023-10-06T02:47:00.439296+0000","last_peered":"2023-10-06T02:47:00.439296+0000","last_clean":"2023-10-06T02:47:00.439296+0000","last_became_active":"2023-10-06T02:47:00.438863+0000","last_became_peered":"2023-10-06T02:47:00.438863+0000","last_unstale":"2023-10-06T02:47:00.439296+0000","last_undegraded":"2023-10-06T02:47:00.439296+0000","last_fullsized":"2023-10-06T02:47:00.439296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:13.554761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.436452+0000","last_change":"2023-10-06T02:46:59.427380+0000","last_active":"2023-10-06T02:47:00.436452+0000","last_peered":"2023-10-06T02:47:00.436452+0000","last_clean":"2023-10-06T02:47:00.436452+0000","last_became_active":"2023-10-06T02:46:59.427001+0000","last_became_peered":"2023-10-06T02:46:59.427001+0000","last_unstale":"2023-10-06T02:47:00.436452+0000","last_undegraded":"2023-10-06T02:47:00.436452+0000","last_fullsized":"2023-10-06T02:47:00.436452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:48.660259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.425270+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:46:59.425270+0000","last_peered":"2023-10-06T02:46:59.425270+0000","last_clean":"2023-10-06T02:46:59.425270+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:46:59.425270+0000","last_undegraded":"2023-10-06T02:46:59.425270+0000","last_fullsized":"2023-10-06T02:46:59.425270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444875+0000","last_change":"2023-10-06T02:47:00.444875+0000","last_active":"2023-10-06T02:47:00.444875+0000","last_peered":"2023-10-06T02:47:00.444875+0000","last_clean":"2023-10-06T02:47:00.444875+0000","last_became_active":"2023-10-06T02:47:00.444644+0000","last_became_peered":"2023-10-06T02:47:00.444644+0000","last_unstale":"2023-10-06T02:47:00.444875+0000","last_undegraded":"2023-10-06T02:47:00.444875+0000","last_fullsized":"2023-10-06T02:47:00.444875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:50.101566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.436359+0000","last_change":"2023-10-06T02:46:59.429777+0000","last_active":"2023-10-06T02:47:00.436359+0000","last_peered":"2023-10-06T02:47:00.436359+0000","last_clean":"2023-10-06T02:47:00.436359+0000","last_became_active":"2023-10-06T02:46:59.429553+0000","last_became_peered":"2023-10-06T02:46:59.429553+0000","last_unstale":"2023-10-06T02:47:00.436359+0000","last_undegraded":"2023-10-06T02:47:00.436359+0000","last_fullsized":"2023-10-06T02:47:00.436359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:05.547967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.435412+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:47:00.435412+0000","last_peered":"2023-10-06T02:47:00.435412+0000","last_clean":"2023-10-06T02:47:00.435412+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:47:00.435412+0000","last_undegraded":"2023-10-06T02:47:00.435412+0000","last_fullsized":"2023-10-06T02:47:00.435412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449338+0000","last_change":"2023-10-06T02:47:00.446928+0000","last_active":"2023-10-06T02:47:00.449338+0000","last_peered":"2023-10-06T02:47:00.449338+0000","last_clean":"2023-10-06T02:47:00.449338+0000","last_became_active":"2023-10-06T02:47:00.446696+0000","last_became_peered":"2023-10-06T02:47:00.446696+0000","last_unstale":"2023-10-06T02:47:00.449338+0000","last_undegraded":"2023-10-06T02:47:00.449338+0000","last_fullsized":"2023-10-06T02:47:00.449338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:07.184182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.426011+0000","last_change":"2023-10-06T02:46:59.425954+0000","last_active":"2023-10-06T02:46:59.426011+0000","last_peered":"2023-10-06T02:46:59.426011+0000","last_clean":"2023-10-06T02:46:59.426011+0000","last_became_active":"2023-10-06T02:46:59.425725+0000","last_became_peered":"2023-10-06T02:46:59.425725+0000","last_unstale":"2023-10-06T02:46:59.426011+0000","last_undegraded":"2023-10-06T02:46:59.426011+0000","last_fullsized":"2023-10-06T02:46:59.426011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:34.464150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.420453+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:46:59.420453+0000","last_peered":"2023-10-06T02:46:59.420453+0000","last_clean":"2023-10-06T02:46:59.420453+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:46:59.420453+0000","last_undegraded":"2023-10-06T02:46:59.420453+0000","last_fullsized":"2023-10-06T02:46:59.420453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439090+0000","last_change":"2023-10-06T02:47:00.438892+0000","last_active":"2023-10-06T02:47:00.439090+0000","last_peered":"2023-10-06T02:47:00.439090+0000","last_clean":"2023-10-06T02:47:00.439090+0000","last_became_active":"2023-10-06T02:47:00.438353+0000","last_became_peered":"2023-10-06T02:47:00.438353+0000","last_unstale":"2023-10-06T02:47:00.439090+0000","last_undegraded":"2023-10-06T02:47:00.439090+0000","last_fullsized":"2023-10-06T02:47:00.439090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:08.270110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.438127+0000","last_change":"2023-10-06T02:46:59.432480+0000","last_active":"2023-10-06T02:47:00.438127+0000","last_peered":"2023-10-06T02:47:00.438127+0000","last_clean":"2023-10-06T02:47:00.438127+0000","last_became_active":"2023-10-06T02:46:59.431693+0000","last_became_peered":"2023-10-06T02:46:59.431693+0000","last_unstale":"2023-10-06T02:47:00.438127+0000","last_undegraded":"2023-10-06T02:47:00.438127+0000","last_fullsized":"2023-10-06T02:47:00.438127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:31.570072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.435649+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:47:00.435649+0000","last_peered":"2023-10-06T02:47:00.435649+0000","last_clean":"2023-10-06T02:47:00.435649+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:47:00.435649+0000","last_undegraded":"2023-10-06T02:47:00.435649+0000","last_fullsized":"2023-10-06T02:47:00.435649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439965+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:47:00.439965+0000","last_peered":"2023-10-06T02:47:00.439965+0000","last_clean":"2023-10-06T02:47:00.439965+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:47:00.439965+0000","last_undegraded":"2023-10-06T02:47:00.439965+0000","last_fullsized":"2023-10-06T02:47:00.439965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444045+0000","last_change":"2023-10-06T02:47:00.444045+0000","last_active":"2023-10-06T02:47:00.444045+0000","last_peered":"2023-10-06T02:47:00.444045+0000","last_clean":"2023-10-06T02:47:00.444045+0000","last_became_active":"2023-10-06T02:47:00.443612+0000","last_became_peered":"2023-10-06T02:47:00.443612+0000","last_unstale":"2023-10-06T02:47:00.444045+0000","last_undegraded":"2023-10-06T02:47:00.444045+0000","last_fullsized":"2023-10-06T02:47:00.444045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:07.184182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.453414+0000","last_change":"2023-10-06T02:46:59.431634+0000","last_active":"2023-10-06T02:47:00.453414+0000","last_peered":"2023-10-06T02:47:00.453414+0000","last_clean":"2023-10-06T02:47:00.453414+0000","last_became_active":"2023-10-06T02:46:59.430260+0000","last_became_peered":"2023-10-06T02:46:59.430260+0000","last_unstale":"2023-10-06T02:47:00.453414+0000","last_undegraded":"2023-10-06T02:47:00.453414+0000","last_fullsized":"2023-10-06T02:47:00.453414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:34.554365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439886+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:47:00.439886+0000","last_peered":"2023-10-06T02:47:00.439886+0000","last_clean":"2023-10-06T02:47:00.439886+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:47:00.439886+0000","last_undegraded":"2023-10-06T02:47:00.439886+0000","last_fullsized":"2023-10-06T02:47:00.439886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.441428+0000","last_change":"2023-10-06T02:47:00.441428+0000","last_active":"2023-10-06T02:47:00.441428+0000","last_peered":"2023-10-06T02:47:00.441428+0000","last_clean":"2023-10-06T02:47:00.441428+0000","last_became_active":"2023-10-06T02:47:00.441206+0000","last_became_peered":"2023-10-06T02:47:00.441206+0000","last_unstale":"2023-10-06T02:47:00.441428+0000","last_undegraded":"2023-10-06T02:47:00.441428+0000","last_fullsized":"2023-10-06T02:47:00.441428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:02.250831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.428632+0000","last_change":"2023-10-06T02:46:59.428553+0000","last_active":"2023-10-06T02:46:59.428632+0000","last_peered":"2023-10-06T02:46:59.428632+0000","last_clean":"2023-10-06T02:46:59.428632+0000","last_became_active":"2023-10-06T02:46:59.428314+0000","last_became_peered":"2023-10-06T02:46:59.428314+0000","last_unstale":"2023-10-06T02:46:59.428632+0000","last_undegraded":"2023-10-06T02:46:59.428632+0000","last_fullsized":"2023-10-06T02:46:59.428632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:39.689280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440043+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:47:00.440043+0000","last_peered":"2023-10-06T02:47:00.440043+0000","last_clean":"2023-10-06T02:47:00.440043+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:47:00.440043+0000","last_undegraded":"2023-10-06T02:47:00.440043+0000","last_fullsized":"2023-10-06T02:47:00.440043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447564+0000","last_change":"2023-10-06T02:47:00.447564+0000","last_active":"2023-10-06T02:47:00.447564+0000","last_peered":"2023-10-06T02:47:00.447564+0000","last_clean":"2023-10-06T02:47:00.447564+0000","last_became_active":"2023-10-06T02:47:00.447247+0000","last_became_peered":"2023-10-06T02:47:00.447247+0000","last_unstale":"2023-10-06T02:47:00.447564+0000","last_undegraded":"2023-10-06T02:47:00.447564+0000","last_fullsized":"2023-10-06T02:47:00.447564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:47.185529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.429623+0000","last_change":"2023-10-06T02:46:59.429476+0000","last_active":"2023-10-06T02:46:59.429623+0000","last_peered":"2023-10-06T02:46:59.429623+0000","last_clean":"2023-10-06T02:46:59.429623+0000","last_became_active":"2023-10-06T02:46:59.429177+0000","last_became_peered":"2023-10-06T02:46:59.429177+0000","last_unstale":"2023-10-06T02:46:59.429623+0000","last_undegraded":"2023-10-06T02:46:59.429623+0000","last_fullsized":"2023-10-06T02:46:59.429623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:19.968504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.421591+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:46:59.421591+0000","last_peered":"2023-10-06T02:46:59.421591+0000","last_clean":"2023-10-06T02:46:59.421591+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:46:59.421591+0000","last_undegraded":"2023-10-06T02:46:59.421591+0000","last_fullsized":"2023-10-06T02:46:59.421591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449386+0000","last_change":"2023-10-06T02:47:00.447845+0000","last_active":"2023-10-06T02:47:00.449386+0000","last_peered":"2023-10-06T02:47:00.449386+0000","last_clean":"2023-10-06T02:47:00.449386+0000","last_became_active":"2023-10-06T02:47:00.447423+0000","last_became_peered":"2023-10-06T02:47:00.447423+0000","last_unstale":"2023-10-06T02:47:00.449386+0000","last_undegraded":"2023-10-06T02:47:00.449386+0000","last_fullsized":"2023-10-06T02:47:00.449386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:19.024957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.424329+0000","last_change":"2023-10-06T02:46:59.424264+0000","last_active":"2023-10-06T02:46:59.424329+0000","last_peered":"2023-10-06T02:46:59.424329+0000","last_clean":"2023-10-06T02:46:59.424329+0000","last_became_active":"2023-10-06T02:46:59.424112+0000","last_became_peered":"2023-10-06T02:46:59.424112+0000","last_unstale":"2023-10-06T02:46:59.424329+0000","last_undegraded":"2023-10-06T02:46:59.424329+0000","last_fullsized":"2023-10-06T02:46:59.424329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:24.800366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.424703+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:46:59.424703+0000","last_peered":"2023-10-06T02:46:59.424703+0000","last_clean":"2023-10-06T02:46:59.424703+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:46:59.424703+0000","last_undegraded":"2023-10-06T02:46:59.424703+0000","last_fullsized":"2023-10-06T02:46:59.424703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194588,"statfs":{"total":200000000,"available":199258557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.495}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.434},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.4870000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39300000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199849977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.74299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195166,"statfs":{"total":200000000,"available":199850441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.378},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.67800000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":722,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194589,"statfs":{"total":200000000,"available":199260129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.25600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.311},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":21.942,"5min":21.942,"15min":21.942},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":22.010999999999999,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.090999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":21.98,"5min":21.98,"15min":21.98},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":11.154,"5min":11.154,"15min":11.154},"last":0.54800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195166,"statfs":{"total":200000000,"available":199850461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.316},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.378}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.5}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199848961,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.246},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.28799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.30399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.25600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.36399999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":6.4189999999999996,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":14.912000000000001,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.496},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199849955,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.8949999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":5.3579999999999997,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.9329999999999998,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.439},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":5.9820000000000002,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":5.4390000000000001,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3470000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":13.173999999999999,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.748}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195166,"statfs":{"total":200000000,"available":199850419,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.432}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.504},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.56699999999999995}]}]}],"pool_statfs":[]}} 2023-10-06T02:47:04.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:47:04.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1ca10a700 1 Processor -- start 2023-10-06T02:47:04.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1ca10a700 1 -- start start 2023-10-06T02:47:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1ca10a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1c41578d0 0x7ff1c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1ca10a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c40d07c0 con 0x7ff1c4157ca0 2023-10-06T02:47:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1ca10a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c40cfbb0 con 0x7ff1c406d120 2023-10-06T02:47:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1ca10a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40cfe90 con 0x7ff1c41578d0 2023-10-06T02:47:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1c4157ca0 0x7ff1c415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38252/0 (socket says 172.21.15.81:38252) 2023-10-06T02:47:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c2ffd700 1 -- 172.21.15.81:0/4219889733 learned_addr learned my addr 172.21.15.81:0/4219889733 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954369018 0 0) 0x7ff1c40d07c0 con 0x7ff1c4157ca0 2023-10-06T02:47:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c37fe700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1c41578d0 0x7ff1c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1ac003570 con 0x7ff1c4157ca0 2023-10-06T02:47:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509395719 0 0) 0x7ff1ac003570 con 0x7ff1c4157ca0 2023-10-06T02:47:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1c41578d0 msgr2=0x7ff1c40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1c41578d0 0x7ff1c40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 >> v1:172.21.15.83:6789/0 conn(0x7ff1c406d120 legacy=0x7ff1c415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c40d0170 con 0x7ff1c4157ca0 2023-10-06T02:47:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7ff1b4001470 con 0x7ff1c4157ca0 2023-10-06T02:47:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 >> v1:172.21.15.81:6789/0 conn(0x7ff1c4157ca0 legacy=0x7ff1c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ac003a90 0x7ff1ac003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1c41578d0 0x7ff1ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1ac004d50 0x7ff1ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40cfe90 con 0x7ff1ac003a90 2023-10-06T02:47:04.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac00bb70 con 0x7ff1ac004d50 2023-10-06T02:47:04.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac00bd30 con 0x7ff1c41578d0 2023-10-06T02:47:04.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.651+0000 7ff1c37fe700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ac003a90 0x7ff1ac003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c2ffd700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1c41578d0 0x7ff1ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c3fff700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1ac004d50 0x7ff1ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c37fe700 1 -- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1c41578d0 msgr2=0x7ff1ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c37fe700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1c41578d0 0x7ff1ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c37fe700 1 -- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1ac004d50 msgr2=0x7ff1ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c37fe700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1ac004d50 0x7ff1ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c37fe700 1 -- 172.21.15.81:0/4219889733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac003570 con 0x7ff1ac003a90 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c2ffd700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1c41578d0 0x7ff1ac004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c3fff700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1ac004d50 0x7ff1ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c37fe700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ac003a90 0x7ff1ac003ea0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009c00 tx=0x7ff1b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8805a02eb29a7002 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b800e710 con 0x7ff1ac003a90 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b800e870 con 0x7ff1ac003a90 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1c27fc700 1 -- 172.21.15.81:0/4219889733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b800ec30 con 0x7ff1ac003a90 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1ca10a700 1 -- 172.21.15.81:0/4219889733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ac003a90 msgr2=0x7ff1ac003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.652+0000 7ff1ca10a700 1 --2- 172.21.15.81:0/4219889733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ac003a90 0x7ff1ac003ea0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009c00 tx=0x7ff1b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.653+0000 7ff1c3fff700 1 -- 172.21.15.81:0/4219889733 reap_dead start 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.653+0000 7ff1ca10a700 1 -- 172.21.15.81:0/4219889733 shutdown_connections 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.653+0000 7ff1ca10a700 1 -- 172.21.15.81:0/4219889733 >> 172.21.15.81:0/4219889733 conn(0x7ff1c406bb90 msgr2=0x7ff1c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.653+0000 7ff1ca10a700 1 -- 172.21.15.81:0/4219889733 shutdown_connections 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.653+0000 7ff1ca10a700 1 -- 172.21.15.81:0/4219889733 wait complete. 2023-10-06T02:47:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.654+0000 7ff1ca10a700 1 Processor -- start 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.654+0000 7ff1ca10a700 1 -- start start 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ca10a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1ac003a90 0x7ff1c416add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ca10a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4152cd0 0x7ff1c4168120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ca10a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1c40b4830 0x7ff1c40b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ca10a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4154160 con 0x7ff1c4152cd0 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ca10a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40b51f0 con 0x7ff1c40b4830 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ca10a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c41534e0 con 0x7ff1ac003a90 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4152cd0 0x7ff1c4168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4152cd0 0x7ff1c4168120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46488/0 (socket says 172.21.15.81:46488) 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c2ffd700 1 -- 172.21.15.81:0/89637011 learned_addr learned my addr 172.21.15.81:0/89637011 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c3fff700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1c40b4830 0x7ff1c40b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c37fe700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1ac003a90 0x7ff1c416add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c2ffd700 1 -- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1ac003a90 msgr2=0x7ff1c416add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c2ffd700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1ac003a90 0x7ff1c416add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c2ffd700 1 -- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1c40b4830 msgr2=0x7ff1c40b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c2ffd700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1c40b4830 0x7ff1c40b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c2ffd700 1 -- 172.21.15.81:0/89637011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c41537c0 con 0x7ff1c4152cd0 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1c2ffd700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4152cd0 0x7ff1c4168120 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4001ed0 tx=0x7ff1c415b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ab7fe700 1 -- 172.21.15.81:0/89637011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4017070 con 0x7ff1c4152cd0 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ab7fe700 1 -- 172.21.15.81:0/89637011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4004830 con 0x7ff1c4152cd0 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c4153aa0 con 0x7ff1c4152cd0 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ab7fe700 1 -- 172.21.15.81:0/89637011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4004bb0 con 0x7ff1c4152cd0 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.655+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c4154580 con 0x7ff1c4152cd0 2023-10-06T02:47:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.656+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c41542a0 con 0x7ff1c4152cd0 2023-10-06T02:47:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.657+0000 7ff1ab7fe700 1 -- 172.21.15.81:0/89637011 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1b4005020 con 0x7ff1c4152cd0 2023-10-06T02:47:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.657+0000 7ff1ab7fe700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1b0066f30 0x7ff1b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.657+0000 7ff1ab7fe700 1 -- 172.21.15.81:0/89637011 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff1b4084280 con 0x7ff1c4152cd0 2023-10-06T02:47:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.657+0000 7ff1c37fe700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1b0066f30 0x7ff1b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.658+0000 7ff1c37fe700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1b0066f30 0x7ff1b00693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80091e0 tx=0x7ff1b801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.661+0000 7ff1ab7fe700 1 -- 172.21.15.81:0/89637011 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1c41542a0 con 0x7ff1c4152cd0 2023-10-06T02:47:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.837+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1c41542a0 con 0x7ff1b0066f30 2023-10-06T02:47:04.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.847+0000 7ff1ab7fe700 1 -- 172.21.15.81:0/89637011 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305288 (secure 0 0 0) 0x7ff1c41542a0 con 0x7ff1b0066f30 2023-10-06T02:47:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:04.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1b0066f30 msgr2=0x7ff1b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1b0066f30 0x7ff1b00693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80091e0 tx=0x7ff1b801a000 comp rx=0 tx=0).stop 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4152cd0 msgr2=0x7ff1c4168120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4152cd0 0x7ff1c4168120 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4001ed0 tx=0x7ff1c415b610 comp rx=0 tx=0).stop 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 shutdown_connections 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1b0066f30 0x7ff1b00693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1c40b4830 0x7ff1c40b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1ac003a90 0x7ff1c416add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 --2- 172.21.15.81:0/89637011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4152cd0 0x7ff1c4168120 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 >> 172.21.15.81:0/89637011 conn(0x7ff1c406bb90 msgr2=0x7ff1c406d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 shutdown_connections 2023-10-06T02:47:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:04.851+0000 7ff1ca10a700 1 -- 172.21.15.81:0/89637011 wait complete. 2023-10-06T02:47:04.856 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:47:04.864 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-10-06T02:47:03.504624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560174,"statfs":{"total":1600000000,"available":1597618900,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.087778"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.438136+0000","last_change":"2023-10-06T02:47:00.438136+0000","last_active":"2023-10-06T02:47:00.438136+0000","last_peered":"2023-10-06T02:47:00.438136+0000","last_clean":"2023-10-06T02:47:00.438136+0000","last_became_active":"2023-10-06T02:47:00.437902+0000","last_became_peered":"2023-10-06T02:47:00.437902+0000","last_unstale":"2023-10-06T02:47:00.438136+0000","last_undegraded":"2023-10-06T02:47:00.438136+0000","last_fullsized":"2023-10-06T02:47:00.438136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:20.265633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.445058+0000","last_change":"2023-10-06T02:47:00.445058+0000","last_active":"2023-10-06T02:47:00.445058+0000","last_peered":"2023-10-06T02:47:00.445058+0000","last_clean":"2023-10-06T02:47:00.445058+0000","last_became_active":"2023-10-06T02:47:00.443674+0000","last_became_peered":"2023-10-06T02:47:00.443674+0000","last_unstale":"2023-10-06T02:47:00.445058+0000","last_undegraded":"2023-10-06T02:47:00.445058+0000","last_fullsized":"2023-10-06T02:47:00.445058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:08.270110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446316+0000","last_change":"2023-10-06T02:47:00.446269+0000","last_active":"2023-10-06T02:47:00.446316+0000","last_peered":"2023-10-06T02:47:00.446316+0000","last_clean":"2023-10-06T02:47:00.446316+0000","last_became_active":"2023-10-06T02:47:00.445746+0000","last_became_peered":"2023-10-06T02:47:00.445746+0000","last_unstale":"2023-10-06T02:47:00.446316+0000","last_undegraded":"2023-10-06T02:47:00.446316+0000","last_fullsized":"2023-10-06T02:47:00.446316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:19.024957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443900+0000","last_change":"2023-10-06T02:47:00.443900+0000","last_active":"2023-10-06T02:47:00.443900+0000","last_peered":"2023-10-06T02:47:00.443900+0000","last_clean":"2023-10-06T02:47:00.443900+0000","last_became_active":"2023-10-06T02:47:00.443394+0000","last_became_peered":"2023-10-06T02:47:00.443394+0000","last_unstale":"2023-10-06T02:47:00.443900+0000","last_undegraded":"2023-10-06T02:47:00.443900+0000","last_fullsized":"2023-10-06T02:47:00.443900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:32.574691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444657+0000","last_change":"2023-10-06T02:47:00.444657+0000","last_active":"2023-10-06T02:47:00.444657+0000","last_peered":"2023-10-06T02:47:00.444657+0000","last_clean":"2023-10-06T02:47:00.444657+0000","last_became_active":"2023-10-06T02:47:00.444429+0000","last_became_peered":"2023-10-06T02:47:00.444429+0000","last_unstale":"2023-10-06T02:47:00.444657+0000","last_undegraded":"2023-10-06T02:47:00.444657+0000","last_fullsized":"2023-10-06T02:47:00.444657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:06.552586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444836+0000","last_change":"2023-10-06T02:47:00.444836+0000","last_active":"2023-10-06T02:47:00.444836+0000","last_peered":"2023-10-06T02:47:00.444836+0000","last_clean":"2023-10-06T02:47:00.444836+0000","last_became_active":"2023-10-06T02:47:00.444576+0000","last_became_peered":"2023-10-06T02:47:00.444576+0000","last_unstale":"2023-10-06T02:47:00.444836+0000","last_undegraded":"2023-10-06T02:47:00.444836+0000","last_fullsized":"2023-10-06T02:47:00.444836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:30.583161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439113+0000","last_change":"2023-10-06T02:47:00.439032+0000","last_active":"2023-10-06T02:47:00.439113+0000","last_peered":"2023-10-06T02:47:00.439113+0000","last_clean":"2023-10-06T02:47:00.439113+0000","last_became_active":"2023-10-06T02:47:00.438683+0000","last_became_peered":"2023-10-06T02:47:00.438683+0000","last_unstale":"2023-10-06T02:47:00.439113+0000","last_undegraded":"2023-10-06T02:47:00.439113+0000","last_fullsized":"2023-10-06T02:47:00.439113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:47.185529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.437071+0000","last_change":"2023-10-06T02:47:00.437071+0000","last_active":"2023-10-06T02:47:00.437071+0000","last_peered":"2023-10-06T02:47:00.437071+0000","last_clean":"2023-10-06T02:47:00.437071+0000","last_became_active":"2023-10-06T02:47:00.436172+0000","last_became_peered":"2023-10-06T02:47:00.436172+0000","last_unstale":"2023-10-06T02:47:00.437071+0000","last_undegraded":"2023-10-06T02:47:00.437071+0000","last_fullsized":"2023-10-06T02:47:00.437071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:28.956382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443072+0000","last_change":"2023-10-06T02:47:00.443010+0000","last_active":"2023-10-06T02:47:00.443072+0000","last_peered":"2023-10-06T02:47:00.443072+0000","last_clean":"2023-10-06T02:47:00.443072+0000","last_became_active":"2023-10-06T02:47:00.442782+0000","last_became_peered":"2023-10-06T02:47:00.442782+0000","last_unstale":"2023-10-06T02:47:00.443072+0000","last_undegraded":"2023-10-06T02:47:00.443072+0000","last_fullsized":"2023-10-06T02:47:00.443072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:41.062048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440684+0000","last_change":"2023-10-06T02:47:00.440542+0000","last_active":"2023-10-06T02:47:00.440684+0000","last_peered":"2023-10-06T02:47:00.440684+0000","last_clean":"2023-10-06T02:47:00.440684+0000","last_became_active":"2023-10-06T02:47:00.440282+0000","last_became_peered":"2023-10-06T02:47:00.440282+0000","last_unstale":"2023-10-06T02:47:00.440684+0000","last_undegraded":"2023-10-06T02:47:00.440684+0000","last_fullsized":"2023-10-06T02:47:00.440684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:00.206695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446310+0000","last_change":"2023-10-06T02:47:00.446076+0000","last_active":"2023-10-06T02:47:00.446310+0000","last_peered":"2023-10-06T02:47:00.446310+0000","last_clean":"2023-10-06T02:47:00.446310+0000","last_became_active":"2023-10-06T02:47:00.445565+0000","last_became_peered":"2023-10-06T02:47:00.445565+0000","last_unstale":"2023-10-06T02:47:00.446310+0000","last_undegraded":"2023-10-06T02:47:00.446310+0000","last_fullsized":"2023-10-06T02:47:00.446310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:32.217572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440558+0000","last_change":"2023-10-06T02:47:00.440253+0000","last_active":"2023-10-06T02:47:00.440558+0000","last_peered":"2023-10-06T02:47:00.440558+0000","last_clean":"2023-10-06T02:47:00.440558+0000","last_became_active":"2023-10-06T02:47:00.440015+0000","last_became_peered":"2023-10-06T02:47:00.440015+0000","last_unstale":"2023-10-06T02:47:00.440558+0000","last_undegraded":"2023-10-06T02:47:00.440558+0000","last_fullsized":"2023-10-06T02:47:00.440558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:39.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446241+0000","last_change":"2023-10-06T02:47:00.445125+0000","last_active":"2023-10-06T02:47:00.446241+0000","last_peered":"2023-10-06T02:47:00.446241+0000","last_clean":"2023-10-06T02:47:00.446241+0000","last_became_active":"2023-10-06T02:47:00.444379+0000","last_became_peered":"2023-10-06T02:47:00.444379+0000","last_unstale":"2023-10-06T02:47:00.446241+0000","last_undegraded":"2023-10-06T02:47:00.446241+0000","last_fullsized":"2023-10-06T02:47:00.446241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.059752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446054+0000","last_change":"2023-10-06T02:47:00.446054+0000","last_active":"2023-10-06T02:47:00.446054+0000","last_peered":"2023-10-06T02:47:00.446054+0000","last_clean":"2023-10-06T02:47:00.446054+0000","last_became_active":"2023-10-06T02:47:00.445458+0000","last_became_peered":"2023-10-06T02:47:00.445458+0000","last_unstale":"2023-10-06T02:47:00.446054+0000","last_undegraded":"2023-10-06T02:47:00.446054+0000","last_fullsized":"2023-10-06T02:47:00.446054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:28.714870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.436562+0000","last_change":"2023-10-06T02:47:00.436492+0000","last_active":"2023-10-06T02:47:00.436562+0000","last_peered":"2023-10-06T02:47:00.436562+0000","last_clean":"2023-10-06T02:47:00.436562+0000","last_became_active":"2023-10-06T02:47:00.436257+0000","last_became_peered":"2023-10-06T02:47:00.436257+0000","last_unstale":"2023-10-06T02:47:00.436562+0000","last_undegraded":"2023-10-06T02:47:00.436562+0000","last_fullsized":"2023-10-06T02:47:00.436562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:19.024957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449433+0000","last_change":"2023-10-06T02:47:00.449272+0000","last_active":"2023-10-06T02:47:00.449433+0000","last_peered":"2023-10-06T02:47:00.449433+0000","last_clean":"2023-10-06T02:47:00.449433+0000","last_became_active":"2023-10-06T02:47:00.448739+0000","last_became_peered":"2023-10-06T02:47:00.448739+0000","last_unstale":"2023-10-06T02:47:00.449433+0000","last_undegraded":"2023-10-06T02:47:00.449433+0000","last_fullsized":"2023-10-06T02:47:00.449433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:00.206695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444269+0000","last_change":"2023-10-06T02:47:00.443569+0000","last_active":"2023-10-06T02:47:00.444269+0000","last_peered":"2023-10-06T02:47:00.444269+0000","last_clean":"2023-10-06T02:47:00.444269+0000","last_became_active":"2023-10-06T02:47:00.443349+0000","last_became_peered":"2023-10-06T02:47:00.443349+0000","last_unstale":"2023-10-06T02:47:00.444269+0000","last_undegraded":"2023-10-06T02:47:00.444269+0000","last_fullsized":"2023-10-06T02:47:00.444269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:47.185529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.448547+0000","last_change":"2023-10-06T02:47:00.448547+0000","last_active":"2023-10-06T02:47:00.448547+0000","last_peered":"2023-10-06T02:47:00.448547+0000","last_clean":"2023-10-06T02:47:00.448547+0000","last_became_active":"2023-10-06T02:47:00.448304+0000","last_became_peered":"2023-10-06T02:47:00.448304+0000","last_unstale":"2023-10-06T02:47:00.448547+0000","last_undegraded":"2023-10-06T02:47:00.448547+0000","last_fullsized":"2023-10-06T02:47:00.448547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:13.205853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439827+0000","last_change":"2023-10-06T02:47:00.439827+0000","last_active":"2023-10-06T02:47:00.439827+0000","last_peered":"2023-10-06T02:47:00.439827+0000","last_clean":"2023-10-06T02:47:00.439827+0000","last_became_active":"2023-10-06T02:47:00.439599+0000","last_became_peered":"2023-10-06T02:47:00.439599+0000","last_unstale":"2023-10-06T02:47:00.439827+0000","last_undegraded":"2023-10-06T02:47:00.439827+0000","last_fullsized":"2023-10-06T02:47:00.439827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:30.819049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444953+0000","last_change":"2023-10-06T02:47:00.444953+0000","last_active":"2023-10-06T02:47:00.444953+0000","last_peered":"2023-10-06T02:47:00.444953+0000","last_clean":"2023-10-06T02:47:00.444953+0000","last_became_active":"2023-10-06T02:47:00.444611+0000","last_became_peered":"2023-10-06T02:47:00.444611+0000","last_unstale":"2023-10-06T02:47:00.444953+0000","last_undegraded":"2023-10-06T02:47:00.444953+0000","last_fullsized":"2023-10-06T02:47:00.444953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:27.458044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446274+0000","last_change":"2023-10-06T02:47:00.445941+0000","last_active":"2023-10-06T02:47:00.446274+0000","last_peered":"2023-10-06T02:47:00.446274+0000","last_clean":"2023-10-06T02:47:00.446274+0000","last_became_active":"2023-10-06T02:47:00.445250+0000","last_became_peered":"2023-10-06T02:47:00.445250+0000","last_unstale":"2023-10-06T02:47:00.446274+0000","last_undegraded":"2023-10-06T02:47:00.446274+0000","last_fullsized":"2023-10-06T02:47:00.446274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:24.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447465+0000","last_change":"2023-10-06T02:47:00.447465+0000","last_active":"2023-10-06T02:47:00.447465+0000","last_peered":"2023-10-06T02:47:00.447465+0000","last_clean":"2023-10-06T02:47:00.447465+0000","last_became_active":"2023-10-06T02:47:00.446975+0000","last_became_peered":"2023-10-06T02:47:00.446975+0000","last_unstale":"2023-10-06T02:47:00.447465+0000","last_undegraded":"2023-10-06T02:47:00.447465+0000","last_fullsized":"2023-10-06T02:47:00.447465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:00.206695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.441965+0000","last_change":"2023-10-06T02:47:00.441175+0000","last_active":"2023-10-06T02:47:00.441965+0000","last_peered":"2023-10-06T02:47:00.441965+0000","last_clean":"2023-10-06T02:47:00.441965+0000","last_became_active":"2023-10-06T02:47:00.440914+0000","last_became_peered":"2023-10-06T02:47:00.440914+0000","last_unstale":"2023-10-06T02:47:00.441965+0000","last_undegraded":"2023-10-06T02:47:00.441965+0000","last_fullsized":"2023-10-06T02:47:00.441965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:24.144062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443770+0000","last_change":"2023-10-06T02:47:00.443770+0000","last_active":"2023-10-06T02:47:00.443770+0000","last_peered":"2023-10-06T02:47:00.443770+0000","last_clean":"2023-10-06T02:47:00.443770+0000","last_became_active":"2023-10-06T02:47:00.443102+0000","last_became_peered":"2023-10-06T02:47:00.443102+0000","last_unstale":"2023-10-06T02:47:00.443770+0000","last_undegraded":"2023-10-06T02:47:00.443770+0000","last_fullsized":"2023-10-06T02:47:00.443770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:49.548877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443898+0000","last_change":"2023-10-06T02:47:00.443898+0000","last_active":"2023-10-06T02:47:00.443898+0000","last_peered":"2023-10-06T02:47:00.443898+0000","last_clean":"2023-10-06T02:47:00.443898+0000","last_became_active":"2023-10-06T02:47:00.443650+0000","last_became_peered":"2023-10-06T02:47:00.443650+0000","last_unstale":"2023-10-06T02:47:00.443898+0000","last_undegraded":"2023-10-06T02:47:00.443898+0000","last_fullsized":"2023-10-06T02:47:00.443898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:32.496295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447566+0000","last_change":"2023-10-06T02:47:00.447566+0000","last_active":"2023-10-06T02:47:00.447566+0000","last_peered":"2023-10-06T02:47:00.447566+0000","last_clean":"2023-10-06T02:47:00.447566+0000","last_became_active":"2023-10-06T02:47:00.447296+0000","last_became_peered":"2023-10-06T02:47:00.447296+0000","last_unstale":"2023-10-06T02:47:00.447566+0000","last_undegraded":"2023-10-06T02:47:00.447566+0000","last_fullsized":"2023-10-06T02:47:00.447566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:41.062048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447119+0000","last_change":"2023-10-06T02:47:00.447119+0000","last_active":"2023-10-06T02:47:00.447119+0000","last_peered":"2023-10-06T02:47:00.447119+0000","last_clean":"2023-10-06T02:47:00.447119+0000","last_became_active":"2023-10-06T02:47:00.446703+0000","last_became_peered":"2023-10-06T02:47:00.446703+0000","last_unstale":"2023-10-06T02:47:00.447119+0000","last_undegraded":"2023-10-06T02:47:00.447119+0000","last_fullsized":"2023-10-06T02:47:00.447119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.457697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.437753+0000","last_change":"2023-10-06T02:47:00.437204+0000","last_active":"2023-10-06T02:47:00.437753+0000","last_peered":"2023-10-06T02:47:00.437753+0000","last_clean":"2023-10-06T02:47:00.437753+0000","last_became_active":"2023-10-06T02:47:00.436911+0000","last_became_peered":"2023-10-06T02:47:00.436911+0000","last_unstale":"2023-10-06T02:47:00.437753+0000","last_undegraded":"2023-10-06T02:47:00.437753+0000","last_fullsized":"2023-10-06T02:47:00.437753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:56.656453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444882+0000","last_change":"2023-10-06T02:47:00.444882+0000","last_active":"2023-10-06T02:47:00.444882+0000","last_peered":"2023-10-06T02:47:00.444882+0000","last_clean":"2023-10-06T02:47:00.444882+0000","last_became_active":"2023-10-06T02:47:00.444626+0000","last_became_peered":"2023-10-06T02:47:00.444626+0000","last_unstale":"2023-10-06T02:47:00.444882+0000","last_undegraded":"2023-10-06T02:47:00.444882+0000","last_fullsized":"2023-10-06T02:47:00.444882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:27.924365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.441296+0000","last_change":"2023-10-06T02:47:00.441296+0000","last_active":"2023-10-06T02:47:00.441296+0000","last_peered":"2023-10-06T02:47:00.441296+0000","last_clean":"2023-10-06T02:47:00.441296+0000","last_became_active":"2023-10-06T02:47:00.441080+0000","last_became_peered":"2023-10-06T02:47:00.441080+0000","last_unstale":"2023-10-06T02:47:00.441296+0000","last_undegraded":"2023-10-06T02:47:00.441296+0000","last_fullsized":"2023-10-06T02:47:00.441296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:02.966473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449401+0000","last_change":"2023-10-06T02:47:00.448995+0000","last_active":"2023-10-06T02:47:00.449401+0000","last_peered":"2023-10-06T02:47:00.449401+0000","last_clean":"2023-10-06T02:47:00.449401+0000","last_became_active":"2023-10-06T02:47:00.448135+0000","last_became_peered":"2023-10-06T02:47:00.448135+0000","last_unstale":"2023-10-06T02:47:00.449401+0000","last_undegraded":"2023-10-06T02:47:00.449401+0000","last_fullsized":"2023-10-06T02:47:00.449401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:39.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439442+0000","last_change":"2023-10-06T02:47:00.439442+0000","last_active":"2023-10-06T02:47:00.439442+0000","last_peered":"2023-10-06T02:47:00.439442+0000","last_clean":"2023-10-06T02:47:00.439442+0000","last_became_active":"2023-10-06T02:47:00.439243+0000","last_became_peered":"2023-10-06T02:47:00.439243+0000","last_unstale":"2023-10-06T02:47:00.439442+0000","last_undegraded":"2023-10-06T02:47:00.439442+0000","last_fullsized":"2023-10-06T02:47:00.439442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:15.250830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449416+0000","last_change":"2023-10-06T02:47:00.449133+0000","last_active":"2023-10-06T02:47:00.449416+0000","last_peered":"2023-10-06T02:47:00.449416+0000","last_clean":"2023-10-06T02:47:00.449416+0000","last_became_active":"2023-10-06T02:47:00.448452+0000","last_became_peered":"2023-10-06T02:47:00.448452+0000","last_unstale":"2023-10-06T02:47:00.449416+0000","last_undegraded":"2023-10-06T02:47:00.449416+0000","last_fullsized":"2023-10-06T02:47:00.449416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.059752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.455715+0000","last_change":"2023-10-06T02:46:59.430219+0000","last_active":"2023-10-06T02:47:00.455715+0000","last_peered":"2023-10-06T02:47:00.455715+0000","last_clean":"2023-10-06T02:47:00.455715+0000","last_became_active":"2023-10-06T02:46:59.429981+0000","last_became_peered":"2023-10-06T02:46:59.429981+0000","last_unstale":"2023-10-06T02:47:00.455715+0000","last_undegraded":"2023-10-06T02:47:00.455715+0000","last_fullsized":"2023-10-06T02:47:00.455715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:15.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443944+0000","last_change":"2023-10-06T02:47:00.443944+0000","last_active":"2023-10-06T02:47:00.443944+0000","last_peered":"2023-10-06T02:47:00.443944+0000","last_clean":"2023-10-06T02:47:00.443944+0000","last_became_active":"2023-10-06T02:47:00.443355+0000","last_became_peered":"2023-10-06T02:47:00.443355+0000","last_unstale":"2023-10-06T02:47:00.443944+0000","last_undegraded":"2023-10-06T02:47:00.443944+0000","last_fullsized":"2023-10-06T02:47:00.443944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:39.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.451452+0000","last_change":"2023-10-06T02:46:59.431701+0000","last_active":"2023-10-06T02:47:00.451452+0000","last_peered":"2023-10-06T02:47:00.451452+0000","last_clean":"2023-10-06T02:47:00.451452+0000","last_became_active":"2023-10-06T02:46:59.431287+0000","last_became_peered":"2023-10-06T02:46:59.431287+0000","last_unstale":"2023-10-06T02:47:00.451452+0000","last_undegraded":"2023-10-06T02:47:00.451452+0000","last_fullsized":"2023-10-06T02:47:00.451452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:58.653124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.445908+0000","last_change":"2023-10-06T02:47:00.445908+0000","last_active":"2023-10-06T02:47:00.445908+0000","last_peered":"2023-10-06T02:47:00.445908+0000","last_clean":"2023-10-06T02:47:00.445908+0000","last_became_active":"2023-10-06T02:47:00.445155+0000","last_became_peered":"2023-10-06T02:47:00.445155+0000","last_unstale":"2023-10-06T02:47:00.445908+0000","last_undegraded":"2023-10-06T02:47:00.445908+0000","last_fullsized":"2023-10-06T02:47:00.445908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:20.265633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.450598+0000","last_change":"2023-10-06T02:46:59.431023+0000","last_active":"2023-10-06T02:47:00.450598+0000","last_peered":"2023-10-06T02:47:00.450598+0000","last_clean":"2023-10-06T02:47:00.450598+0000","last_became_active":"2023-10-06T02:46:59.430789+0000","last_became_peered":"2023-10-06T02:46:59.430789+0000","last_unstale":"2023-10-06T02:47:00.450598+0000","last_undegraded":"2023-10-06T02:47:00.450598+0000","last_fullsized":"2023-10-06T02:47:00.450598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:29.814430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443274+0000","last_change":"2023-10-06T02:47:00.443274+0000","last_active":"2023-10-06T02:47:00.443274+0000","last_peered":"2023-10-06T02:47:00.443274+0000","last_clean":"2023-10-06T02:47:00.443274+0000","last_became_active":"2023-10-06T02:47:00.443022+0000","last_became_peered":"2023-10-06T02:47:00.443022+0000","last_unstale":"2023-10-06T02:47:00.443274+0000","last_undegraded":"2023-10-06T02:47:00.443274+0000","last_fullsized":"2023-10-06T02:47:00.443274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:00.206695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.453944+0000","last_change":"2023-10-06T02:46:59.427292+0000","last_active":"2023-10-06T02:47:00.453944+0000","last_peered":"2023-10-06T02:47:00.453944+0000","last_clean":"2023-10-06T02:47:00.453944+0000","last_became_active":"2023-10-06T02:46:59.427067+0000","last_became_peered":"2023-10-06T02:46:59.427067+0000","last_unstale":"2023-10-06T02:47:00.453944+0000","last_undegraded":"2023-10-06T02:47:00.453944+0000","last_fullsized":"2023-10-06T02:47:00.453944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:14.246211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.441334+0000","last_change":"2023-10-06T02:47:00.441286+0000","last_active":"2023-10-06T02:47:00.441334+0000","last_peered":"2023-10-06T02:47:00.441334+0000","last_clean":"2023-10-06T02:47:00.441334+0000","last_became_active":"2023-10-06T02:47:00.441116+0000","last_became_peered":"2023-10-06T02:47:00.441116+0000","last_unstale":"2023-10-06T02:47:00.441334+0000","last_undegraded":"2023-10-06T02:47:00.441334+0000","last_fullsized":"2023-10-06T02:47:00.441334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:45.748289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.453277+0000","last_change":"2023-10-06T02:46:59.431939+0000","last_active":"2023-10-06T02:47:00.453277+0000","last_peered":"2023-10-06T02:47:00.453277+0000","last_clean":"2023-10-06T02:47:00.453277+0000","last_became_active":"2023-10-06T02:46:59.431397+0000","last_became_peered":"2023-10-06T02:46:59.431397+0000","last_unstale":"2023-10-06T02:47:00.453277+0000","last_undegraded":"2023-10-06T02:47:00.453277+0000","last_fullsized":"2023-10-06T02:47:00.453277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:58.653124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440666+0000","last_change":"2023-10-06T02:47:00.440159+0000","last_active":"2023-10-06T02:47:00.440666+0000","last_peered":"2023-10-06T02:47:00.440666+0000","last_clean":"2023-10-06T02:47:00.440666+0000","last_became_active":"2023-10-06T02:47:00.439901+0000","last_became_peered":"2023-10-06T02:47:00.439901+0000","last_unstale":"2023-10-06T02:47:00.440666+0000","last_undegraded":"2023-10-06T02:47:00.440666+0000","last_fullsized":"2023-10-06T02:47:00.440666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:39.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.456043+0000","last_change":"2023-10-06T02:46:59.432484+0000","last_active":"2023-10-06T02:47:00.456043+0000","last_peered":"2023-10-06T02:47:00.456043+0000","last_clean":"2023-10-06T02:47:00.456043+0000","last_became_active":"2023-10-06T02:46:59.432257+0000","last_became_peered":"2023-10-06T02:46:59.432257+0000","last_unstale":"2023-10-06T02:47:00.456043+0000","last_undegraded":"2023-10-06T02:47:00.456043+0000","last_fullsized":"2023-10-06T02:47:00.456043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:29.814430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447828+0000","last_change":"2023-10-06T02:47:00.447828+0000","last_active":"2023-10-06T02:47:00.447828+0000","last_peered":"2023-10-06T02:47:00.447828+0000","last_clean":"2023-10-06T02:47:00.447828+0000","last_became_active":"2023-10-06T02:47:00.447602+0000","last_became_peered":"2023-10-06T02:47:00.447602+0000","last_unstale":"2023-10-06T02:47:00.447828+0000","last_undegraded":"2023-10-06T02:47:00.447828+0000","last_fullsized":"2023-10-06T02:47:00.447828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:08.270110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.429257+0000","last_change":"2023-10-06T02:46:59.429089+0000","last_active":"2023-10-06T02:46:59.429257+0000","last_peered":"2023-10-06T02:46:59.429257+0000","last_clean":"2023-10-06T02:46:59.429257+0000","last_became_active":"2023-10-06T02:46:59.428897+0000","last_became_peered":"2023-10-06T02:46:59.428897+0000","last_unstale":"2023-10-06T02:46:59.429257+0000","last_undegraded":"2023-10-06T02:46:59.429257+0000","last_fullsized":"2023-10-06T02:46:59.429257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:48.660259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440894+0000","last_change":"2023-10-06T02:47:00.440894+0000","last_active":"2023-10-06T02:47:00.440894+0000","last_peered":"2023-10-06T02:47:00.440894+0000","last_clean":"2023-10-06T02:47:00.440894+0000","last_became_active":"2023-10-06T02:47:00.440587+0000","last_became_peered":"2023-10-06T02:47:00.440587+0000","last_unstale":"2023-10-06T02:47:00.440894+0000","last_undegraded":"2023-10-06T02:47:00.440894+0000","last_fullsized":"2023-10-06T02:47:00.440894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.059752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.433790+0000","last_change":"2023-10-06T02:46:59.433536+0000","last_active":"2023-10-06T02:46:59.433790+0000","last_peered":"2023-10-06T02:46:59.433790+0000","last_clean":"2023-10-06T02:46:59.433790+0000","last_became_active":"2023-10-06T02:46:59.433344+0000","last_became_peered":"2023-10-06T02:46:59.433344+0000","last_unstale":"2023-10-06T02:46:59.433790+0000","last_undegraded":"2023-10-06T02:46:59.433790+0000","last_fullsized":"2023-10-06T02:46:59.433790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:44.743670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443629+0000","last_change":"2023-10-06T02:47:00.443629+0000","last_active":"2023-10-06T02:47:00.443629+0000","last_peered":"2023-10-06T02:47:00.443629+0000","last_clean":"2023-10-06T02:47:00.443629+0000","last_became_active":"2023-10-06T02:47:00.442809+0000","last_became_peered":"2023-10-06T02:47:00.442809+0000","last_unstale":"2023-10-06T02:47:00.443629+0000","last_undegraded":"2023-10-06T02:47:00.443629+0000","last_fullsized":"2023-10-06T02:47:00.443629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:49.664878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.425885+0000","last_change":"2023-10-06T02:46:59.425767+0000","last_active":"2023-10-06T02:46:59.425885+0000","last_peered":"2023-10-06T02:46:59.425885+0000","last_clean":"2023-10-06T02:46:59.425885+0000","last_became_active":"2023-10-06T02:46:59.424703+0000","last_became_peered":"2023-10-06T02:46:59.424703+0000","last_unstale":"2023-10-06T02:46:59.425885+0000","last_undegraded":"2023-10-06T02:46:59.425885+0000","last_fullsized":"2023-10-06T02:46:59.425885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:32.164096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443114+0000","last_change":"2023-10-06T02:47:00.443033+0000","last_active":"2023-10-06T02:47:00.443114+0000","last_peered":"2023-10-06T02:47:00.443114+0000","last_clean":"2023-10-06T02:47:00.443114+0000","last_became_active":"2023-10-06T02:47:00.442754+0000","last_became_peered":"2023-10-06T02:47:00.442754+0000","last_unstale":"2023-10-06T02:47:00.443114+0000","last_undegraded":"2023-10-06T02:47:00.443114+0000","last_fullsized":"2023-10-06T02:47:00.443114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:56.656453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.435204+0000","last_change":"2023-10-06T02:46:59.431801+0000","last_active":"2023-10-06T02:47:00.435204+0000","last_peered":"2023-10-06T02:47:00.435204+0000","last_clean":"2023-10-06T02:47:00.435204+0000","last_became_active":"2023-10-06T02:46:59.431068+0000","last_became_peered":"2023-10-06T02:46:59.431068+0000","last_unstale":"2023-10-06T02:47:00.435204+0000","last_undegraded":"2023-10-06T02:47:00.435204+0000","last_fullsized":"2023-10-06T02:47:00.435204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:05.547967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.442366+0000","last_change":"2023-10-06T02:47:00.442304+0000","last_active":"2023-10-06T02:47:00.442366+0000","last_peered":"2023-10-06T02:47:00.442366+0000","last_clean":"2023-10-06T02:47:00.442366+0000","last_became_active":"2023-10-06T02:47:00.442075+0000","last_became_peered":"2023-10-06T02:47:00.442075+0000","last_unstale":"2023-10-06T02:47:00.442366+0000","last_undegraded":"2023-10-06T02:47:00.442366+0000","last_fullsized":"2023-10-06T02:47:00.442366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:07.184182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.455339+0000","last_change":"2023-10-06T02:46:59.426472+0000","last_active":"2023-10-06T02:47:00.455339+0000","last_peered":"2023-10-06T02:47:00.455339+0000","last_clean":"2023-10-06T02:47:00.455339+0000","last_became_active":"2023-10-06T02:46:59.426222+0000","last_became_peered":"2023-10-06T02:46:59.426222+0000","last_unstale":"2023-10-06T02:47:00.455339+0000","last_undegraded":"2023-10-06T02:47:00.455339+0000","last_fullsized":"2023-10-06T02:47:00.455339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:31.570072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443498+0000","last_change":"2023-10-06T02:47:00.443498+0000","last_active":"2023-10-06T02:47:00.443498+0000","last_peered":"2023-10-06T02:47:00.443498+0000","last_clean":"2023-10-06T02:47:00.443498+0000","last_became_active":"2023-10-06T02:47:00.443250+0000","last_became_peered":"2023-10-06T02:47:00.443250+0000","last_unstale":"2023-10-06T02:47:00.443498+0000","last_undegraded":"2023-10-06T02:47:00.443498+0000","last_fullsized":"2023-10-06T02:47:00.443498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:56.656453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.454223+0000","last_change":"2023-10-06T02:46:59.429465+0000","last_active":"2023-10-06T02:47:00.454223+0000","last_peered":"2023-10-06T02:47:00.454223+0000","last_clean":"2023-10-06T02:47:00.454223+0000","last_became_active":"2023-10-06T02:46:59.429224+0000","last_became_peered":"2023-10-06T02:46:59.429224+0000","last_unstale":"2023-10-06T02:47:00.454223+0000","last_undegraded":"2023-10-06T02:47:00.454223+0000","last_fullsized":"2023-10-06T02:47:00.454223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:19.968504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446432+0000","last_change":"2023-10-06T02:47:00.446364+0000","last_active":"2023-10-06T02:47:00.446432+0000","last_peered":"2023-10-06T02:47:00.446432+0000","last_clean":"2023-10-06T02:47:00.446432+0000","last_became_active":"2023-10-06T02:47:00.446063+0000","last_became_peered":"2023-10-06T02:47:00.446063+0000","last_unstale":"2023-10-06T02:47:00.446432+0000","last_undegraded":"2023-10-06T02:47:00.446432+0000","last_fullsized":"2023-10-06T02:47:00.446432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:30.583161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.451835+0000","last_change":"2023-10-06T02:46:59.423960+0000","last_active":"2023-10-06T02:47:00.451835+0000","last_peered":"2023-10-06T02:47:00.451835+0000","last_clean":"2023-10-06T02:47:00.451835+0000","last_became_active":"2023-10-06T02:46:59.423737+0000","last_became_peered":"2023-10-06T02:46:59.423737+0000","last_unstale":"2023-10-06T02:47:00.451835+0000","last_undegraded":"2023-10-06T02:47:00.451835+0000","last_fullsized":"2023-10-06T02:47:00.451835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:14.246211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.437706+0000","last_change":"2023-10-06T02:47:00.437706+0000","last_active":"2023-10-06T02:47:00.437706+0000","last_peered":"2023-10-06T02:47:00.437706+0000","last_clean":"2023-10-06T02:47:00.437706+0000","last_became_active":"2023-10-06T02:47:00.437357+0000","last_became_peered":"2023-10-06T02:47:00.437357+0000","last_unstale":"2023-10-06T02:47:00.437706+0000","last_undegraded":"2023-10-06T02:47:00.437706+0000","last_fullsized":"2023-10-06T02:47:00.437706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:28.714870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.429349+0000","last_change":"2023-10-06T02:46:59.429296+0000","last_active":"2023-10-06T02:46:59.429349+0000","last_peered":"2023-10-06T02:46:59.429349+0000","last_clean":"2023-10-06T02:46:59.429349+0000","last_became_active":"2023-10-06T02:46:59.429075+0000","last_became_peered":"2023-10-06T02:46:59.429075+0000","last_unstale":"2023-10-06T02:46:59.429349+0000","last_undegraded":"2023-10-06T02:46:59.429349+0000","last_fullsized":"2023-10-06T02:46:59.429349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:31.570072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449371+0000","last_change":"2023-10-06T02:47:00.447630+0000","last_active":"2023-10-06T02:47:00.449371+0000","last_peered":"2023-10-06T02:47:00.449371+0000","last_clean":"2023-10-06T02:47:00.449371+0000","last_became_active":"2023-10-06T02:47:00.446996+0000","last_became_peered":"2023-10-06T02:47:00.446996+0000","last_unstale":"2023-10-06T02:47:00.449371+0000","last_undegraded":"2023-10-06T02:47:00.449371+0000","last_fullsized":"2023-10-06T02:47:00.449371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:32.217572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.430713+0000","last_change":"2023-10-06T02:46:59.430552+0000","last_active":"2023-10-06T02:46:59.430713+0000","last_peered":"2023-10-06T02:46:59.430713+0000","last_clean":"2023-10-06T02:46:59.430713+0000","last_became_active":"2023-10-06T02:46:59.430319+0000","last_became_peered":"2023-10-06T02:46:59.430319+0000","last_unstale":"2023-10-06T02:46:59.430713+0000","last_undegraded":"2023-10-06T02:46:59.430713+0000","last_fullsized":"2023-10-06T02:46:59.430713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:19.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.445854+0000","last_change":"2023-10-06T02:47:00.445854+0000","last_active":"2023-10-06T02:47:00.445854+0000","last_peered":"2023-10-06T02:47:00.445854+0000","last_clean":"2023-10-06T02:47:00.445854+0000","last_became_active":"2023-10-06T02:47:00.445416+0000","last_became_peered":"2023-10-06T02:47:00.445416+0000","last_unstale":"2023-10-06T02:47:00.445854+0000","last_undegraded":"2023-10-06T02:47:00.445854+0000","last_fullsized":"2023-10-06T02:47:00.445854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:56.408406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.456003+0000","last_change":"2023-10-06T02:46:59.433833+0000","last_active":"2023-10-06T02:47:00.456003+0000","last_peered":"2023-10-06T02:47:00.456003+0000","last_clean":"2023-10-06T02:47:00.456003+0000","last_became_active":"2023-10-06T02:46:59.433614+0000","last_became_peered":"2023-10-06T02:46:59.433614+0000","last_unstale":"2023-10-06T02:47:00.456003+0000","last_undegraded":"2023-10-06T02:47:00.456003+0000","last_fullsized":"2023-10-06T02:47:00.456003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:48.660259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444357+0000","last_change":"2023-10-06T02:47:00.444357+0000","last_active":"2023-10-06T02:47:00.444357+0000","last_peered":"2023-10-06T02:47:00.444357+0000","last_clean":"2023-10-06T02:47:00.444357+0000","last_became_active":"2023-10-06T02:47:00.443375+0000","last_became_peered":"2023-10-06T02:47:00.443375+0000","last_unstale":"2023-10-06T02:47:00.444357+0000","last_undegraded":"2023-10-06T02:47:00.444357+0000","last_fullsized":"2023-10-06T02:47:00.444357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:56.656453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.454552+0000","last_change":"2023-10-06T02:46:59.431624+0000","last_active":"2023-10-06T02:47:00.454552+0000","last_peered":"2023-10-06T02:47:00.454552+0000","last_clean":"2023-10-06T02:47:00.454552+0000","last_became_active":"2023-10-06T02:46:59.431383+0000","last_became_peered":"2023-10-06T02:46:59.431383+0000","last_unstale":"2023-10-06T02:47:00.454552+0000","last_undegraded":"2023-10-06T02:47:00.454552+0000","last_fullsized":"2023-10-06T02:47:00.454552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:48.660259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446260+0000","last_change":"2023-10-06T02:47:00.445799+0000","last_active":"2023-10-06T02:47:00.446260+0000","last_peered":"2023-10-06T02:47:00.446260+0000","last_clean":"2023-10-06T02:47:00.446260+0000","last_became_active":"2023-10-06T02:47:00.444931+0000","last_became_peered":"2023-10-06T02:47:00.444931+0000","last_unstale":"2023-10-06T02:47:00.446260+0000","last_undegraded":"2023-10-06T02:47:00.446260+0000","last_fullsized":"2023-10-06T02:47:00.446260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:41.062048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.454254+0000","last_change":"2023-10-06T02:46:59.432996+0000","last_active":"2023-10-06T02:47:00.454254+0000","last_peered":"2023-10-06T02:47:00.454254+0000","last_clean":"2023-10-06T02:47:00.454254+0000","last_became_active":"2023-10-06T02:46:59.432630+0000","last_became_peered":"2023-10-06T02:46:59.432630+0000","last_unstale":"2023-10-06T02:47:00.454254+0000","last_undegraded":"2023-10-06T02:47:00.454254+0000","last_fullsized":"2023-10-06T02:47:00.454254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:12.550143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.443076+0000","last_change":"2023-10-06T02:47:00.443076+0000","last_active":"2023-10-06T02:47:00.443076+0000","last_peered":"2023-10-06T02:47:00.443076+0000","last_clean":"2023-10-06T02:47:00.443076+0000","last_became_active":"2023-10-06T02:47:00.442733+0000","last_became_peered":"2023-10-06T02:47:00.442733+0000","last_unstale":"2023-10-06T02:47:00.443076+0000","last_undegraded":"2023-10-06T02:47:00.443076+0000","last_fullsized":"2023-10-06T02:47:00.443076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.059752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.433103+0000","last_change":"2023-10-06T02:46:59.431923+0000","last_active":"2023-10-06T02:47:00.433103+0000","last_peered":"2023-10-06T02:47:00.433103+0000","last_clean":"2023-10-06T02:47:00.433103+0000","last_became_active":"2023-10-06T02:46:59.431763+0000","last_became_peered":"2023-10-06T02:46:59.431763+0000","last_unstale":"2023-10-06T02:47:00.433103+0000","last_undegraded":"2023-10-06T02:47:00.433103+0000","last_fullsized":"2023-10-06T02:47:00.433103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:36.043088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440495+0000","last_change":"2023-10-06T02:47:00.440495+0000","last_active":"2023-10-06T02:47:00.440495+0000","last_peered":"2023-10-06T02:47:00.440495+0000","last_clean":"2023-10-06T02:47:00.440495+0000","last_became_active":"2023-10-06T02:47:00.440290+0000","last_became_peered":"2023-10-06T02:47:00.440290+0000","last_unstale":"2023-10-06T02:47:00.440495+0000","last_undegraded":"2023-10-06T02:47:00.440495+0000","last_fullsized":"2023-10-06T02:47:00.440495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:59.657743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.429273+0000","last_change":"2023-10-06T02:46:59.429180+0000","last_active":"2023-10-06T02:46:59.429273+0000","last_peered":"2023-10-06T02:46:59.429273+0000","last_clean":"2023-10-06T02:46:59.429273+0000","last_became_active":"2023-10-06T02:46:59.428958+0000","last_became_peered":"2023-10-06T02:46:59.428958+0000","last_unstale":"2023-10-06T02:46:59.429273+0000","last_undegraded":"2023-10-06T02:46:59.429273+0000","last_fullsized":"2023-10-06T02:46:59.429273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:48.544258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449356+0000","last_change":"2023-10-06T02:47:00.447207+0000","last_active":"2023-10-06T02:47:00.449356+0000","last_peered":"2023-10-06T02:47:00.449356+0000","last_clean":"2023-10-06T02:47:00.449356+0000","last_became_active":"2023-10-06T02:47:00.446709+0000","last_became_peered":"2023-10-06T02:47:00.446709+0000","last_unstale":"2023-10-06T02:47:00.449356+0000","last_undegraded":"2023-10-06T02:47:00.449356+0000","last_fullsized":"2023-10-06T02:47:00.449356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:08.270110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.451805+0000","last_change":"2023-10-06T02:46:59.424155+0000","last_active":"2023-10-06T02:47:00.451805+0000","last_peered":"2023-10-06T02:47:00.451805+0000","last_clean":"2023-10-06T02:47:00.451805+0000","last_became_active":"2023-10-06T02:46:59.423933+0000","last_became_peered":"2023-10-06T02:46:59.423933+0000","last_unstale":"2023-10-06T02:47:00.451805+0000","last_undegraded":"2023-10-06T02:47:00.451805+0000","last_fullsized":"2023-10-06T02:47:00.451805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:10.252367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440087+0000","last_change":"2023-10-06T02:47:00.440011+0000","last_active":"2023-10-06T02:47:00.440087+0000","last_peered":"2023-10-06T02:47:00.440087+0000","last_clean":"2023-10-06T02:47:00.440087+0000","last_became_active":"2023-10-06T02:47:00.439790+0000","last_became_peered":"2023-10-06T02:47:00.439790+0000","last_unstale":"2023-10-06T02:47:00.440087+0000","last_undegraded":"2023-10-06T02:47:00.440087+0000","last_fullsized":"2023-10-06T02:47:00.440087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:02.250831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.431649+0000","last_change":"2023-10-06T02:46:59.431601+0000","last_active":"2023-10-06T02:46:59.431649+0000","last_peered":"2023-10-06T02:46:59.431649+0000","last_clean":"2023-10-06T02:46:59.431649+0000","last_became_active":"2023-10-06T02:46:59.431366+0000","last_became_peered":"2023-10-06T02:46:59.431366+0000","last_unstale":"2023-10-06T02:46:59.431649+0000","last_undegraded":"2023-10-06T02:46:59.431649+0000","last_fullsized":"2023-10-06T02:46:59.431649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:43.307658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.446289+0000","last_change":"2023-10-06T02:47:00.446010+0000","last_active":"2023-10-06T02:47:00.446289+0000","last_peered":"2023-10-06T02:47:00.446289+0000","last_clean":"2023-10-06T02:47:00.446289+0000","last_became_active":"2023-10-06T02:47:00.445511+0000","last_became_peered":"2023-10-06T02:47:00.445511+0000","last_unstale":"2023-10-06T02:47:00.446289+0000","last_undegraded":"2023-10-06T02:47:00.446289+0000","last_fullsized":"2023-10-06T02:47:00.446289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:30.583161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.438027+0000","last_change":"2023-10-06T02:46:59.433592+0000","last_active":"2023-10-06T02:47:00.438027+0000","last_peered":"2023-10-06T02:47:00.438027+0000","last_clean":"2023-10-06T02:47:00.438027+0000","last_became_active":"2023-10-06T02:46:59.433395+0000","last_became_peered":"2023-10-06T02:46:59.433395+0000","last_unstale":"2023-10-06T02:47:00.438027+0000","last_undegraded":"2023-10-06T02:47:00.438027+0000","last_fullsized":"2023-10-06T02:47:00.438027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:48.544258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.442789+0000","last_change":"2023-10-06T02:47:00.442789+0000","last_active":"2023-10-06T02:47:00.442789+0000","last_peered":"2023-10-06T02:47:00.442789+0000","last_clean":"2023-10-06T02:47:00.442789+0000","last_became_active":"2023-10-06T02:47:00.440854+0000","last_became_peered":"2023-10-06T02:47:00.440854+0000","last_unstale":"2023-10-06T02:47:00.442789+0000","last_undegraded":"2023-10-06T02:47:00.442789+0000","last_fullsized":"2023-10-06T02:47:00.442789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:57.237961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.424829+0000","last_change":"2023-10-06T02:46:59.424771+0000","last_active":"2023-10-06T02:46:59.424829+0000","last_peered":"2023-10-06T02:46:59.424829+0000","last_clean":"2023-10-06T02:46:59.424829+0000","last_became_active":"2023-10-06T02:46:59.424515+0000","last_became_peered":"2023-10-06T02:46:59.424515+0000","last_unstale":"2023-10-06T02:46:59.424829+0000","last_undegraded":"2023-10-06T02:46:59.424829+0000","last_fullsized":"2023-10-06T02:46:59.424829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:49.567116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439296+0000","last_change":"2023-10-06T02:47:00.439095+0000","last_active":"2023-10-06T02:47:00.439296+0000","last_peered":"2023-10-06T02:47:00.439296+0000","last_clean":"2023-10-06T02:47:00.439296+0000","last_became_active":"2023-10-06T02:47:00.438863+0000","last_became_peered":"2023-10-06T02:47:00.438863+0000","last_unstale":"2023-10-06T02:47:00.439296+0000","last_undegraded":"2023-10-06T02:47:00.439296+0000","last_fullsized":"2023-10-06T02:47:00.439296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:13.554761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.436452+0000","last_change":"2023-10-06T02:46:59.427380+0000","last_active":"2023-10-06T02:47:00.436452+0000","last_peered":"2023-10-06T02:47:00.436452+0000","last_clean":"2023-10-06T02:47:00.436452+0000","last_became_active":"2023-10-06T02:46:59.427001+0000","last_became_peered":"2023-10-06T02:46:59.427001+0000","last_unstale":"2023-10-06T02:47:00.436452+0000","last_undegraded":"2023-10-06T02:47:00.436452+0000","last_fullsized":"2023-10-06T02:47:00.436452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:48.660259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.425270+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:46:59.425270+0000","last_peered":"2023-10-06T02:46:59.425270+0000","last_clean":"2023-10-06T02:46:59.425270+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:46:59.425270+0000","last_undegraded":"2023-10-06T02:46:59.425270+0000","last_fullsized":"2023-10-06T02:46:59.425270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444875+0000","last_change":"2023-10-06T02:47:00.444875+0000","last_active":"2023-10-06T02:47:00.444875+0000","last_peered":"2023-10-06T02:47:00.444875+0000","last_clean":"2023-10-06T02:47:00.444875+0000","last_became_active":"2023-10-06T02:47:00.444644+0000","last_became_peered":"2023-10-06T02:47:00.444644+0000","last_unstale":"2023-10-06T02:47:00.444875+0000","last_undegraded":"2023-10-06T02:47:00.444875+0000","last_fullsized":"2023-10-06T02:47:00.444875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:50.101566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.436359+0000","last_change":"2023-10-06T02:46:59.429777+0000","last_active":"2023-10-06T02:47:00.436359+0000","last_peered":"2023-10-06T02:47:00.436359+0000","last_clean":"2023-10-06T02:47:00.436359+0000","last_became_active":"2023-10-06T02:46:59.429553+0000","last_became_peered":"2023-10-06T02:46:59.429553+0000","last_unstale":"2023-10-06T02:47:00.436359+0000","last_undegraded":"2023-10-06T02:47:00.436359+0000","last_fullsized":"2023-10-06T02:47:00.436359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:05.547967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.435412+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:47:00.435412+0000","last_peered":"2023-10-06T02:47:00.435412+0000","last_clean":"2023-10-06T02:47:00.435412+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:47:00.435412+0000","last_undegraded":"2023-10-06T02:47:00.435412+0000","last_fullsized":"2023-10-06T02:47:00.435412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449338+0000","last_change":"2023-10-06T02:47:00.446928+0000","last_active":"2023-10-06T02:47:00.449338+0000","last_peered":"2023-10-06T02:47:00.449338+0000","last_clean":"2023-10-06T02:47:00.449338+0000","last_became_active":"2023-10-06T02:47:00.446696+0000","last_became_peered":"2023-10-06T02:47:00.446696+0000","last_unstale":"2023-10-06T02:47:00.449338+0000","last_undegraded":"2023-10-06T02:47:00.449338+0000","last_fullsized":"2023-10-06T02:47:00.449338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:07.184182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.426011+0000","last_change":"2023-10-06T02:46:59.425954+0000","last_active":"2023-10-06T02:46:59.426011+0000","last_peered":"2023-10-06T02:46:59.426011+0000","last_clean":"2023-10-06T02:46:59.426011+0000","last_became_active":"2023-10-06T02:46:59.425725+0000","last_became_peered":"2023-10-06T02:46:59.425725+0000","last_unstale":"2023-10-06T02:46:59.426011+0000","last_undegraded":"2023-10-06T02:46:59.426011+0000","last_fullsized":"2023-10-06T02:46:59.426011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:34.464150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.420453+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:46:59.420453+0000","last_peered":"2023-10-06T02:46:59.420453+0000","last_clean":"2023-10-06T02:46:59.420453+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:46:59.420453+0000","last_undegraded":"2023-10-06T02:46:59.420453+0000","last_fullsized":"2023-10-06T02:46:59.420453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439090+0000","last_change":"2023-10-06T02:47:00.438892+0000","last_active":"2023-10-06T02:47:00.439090+0000","last_peered":"2023-10-06T02:47:00.439090+0000","last_clean":"2023-10-06T02:47:00.439090+0000","last_became_active":"2023-10-06T02:47:00.438353+0000","last_became_peered":"2023-10-06T02:47:00.438353+0000","last_unstale":"2023-10-06T02:47:00.439090+0000","last_undegraded":"2023-10-06T02:47:00.439090+0000","last_fullsized":"2023-10-06T02:47:00.439090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:08.270110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.438127+0000","last_change":"2023-10-06T02:46:59.432480+0000","last_active":"2023-10-06T02:47:00.438127+0000","last_peered":"2023-10-06T02:47:00.438127+0000","last_clean":"2023-10-06T02:47:00.438127+0000","last_became_active":"2023-10-06T02:46:59.431693+0000","last_became_peered":"2023-10-06T02:46:59.431693+0000","last_unstale":"2023-10-06T02:47:00.438127+0000","last_undegraded":"2023-10-06T02:47:00.438127+0000","last_fullsized":"2023-10-06T02:47:00.438127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:31.570072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.435649+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:47:00.435649+0000","last_peered":"2023-10-06T02:47:00.435649+0000","last_clean":"2023-10-06T02:47:00.435649+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:47:00.435649+0000","last_undegraded":"2023-10-06T02:47:00.435649+0000","last_fullsized":"2023-10-06T02:47:00.435649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439965+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:47:00.439965+0000","last_peered":"2023-10-06T02:47:00.439965+0000","last_clean":"2023-10-06T02:47:00.439965+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:47:00.439965+0000","last_undegraded":"2023-10-06T02:47:00.439965+0000","last_fullsized":"2023-10-06T02:47:00.439965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.444045+0000","last_change":"2023-10-06T02:47:00.444045+0000","last_active":"2023-10-06T02:47:00.444045+0000","last_peered":"2023-10-06T02:47:00.444045+0000","last_clean":"2023-10-06T02:47:00.444045+0000","last_became_active":"2023-10-06T02:47:00.443612+0000","last_became_peered":"2023-10-06T02:47:00.443612+0000","last_unstale":"2023-10-06T02:47:00.444045+0000","last_undegraded":"2023-10-06T02:47:00.444045+0000","last_fullsized":"2023-10-06T02:47:00.444045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:07.184182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.453414+0000","last_change":"2023-10-06T02:46:59.431634+0000","last_active":"2023-10-06T02:47:00.453414+0000","last_peered":"2023-10-06T02:47:00.453414+0000","last_clean":"2023-10-06T02:47:00.453414+0000","last_became_active":"2023-10-06T02:46:59.430260+0000","last_became_peered":"2023-10-06T02:46:59.430260+0000","last_unstale":"2023-10-06T02:47:00.453414+0000","last_undegraded":"2023-10-06T02:47:00.453414+0000","last_fullsized":"2023-10-06T02:47:00.453414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:34.554365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.439886+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:47:00.439886+0000","last_peered":"2023-10-06T02:47:00.439886+0000","last_clean":"2023-10-06T02:47:00.439886+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:47:00.439886+0000","last_undegraded":"2023-10-06T02:47:00.439886+0000","last_fullsized":"2023-10-06T02:47:00.439886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.441428+0000","last_change":"2023-10-06T02:47:00.441428+0000","last_active":"2023-10-06T02:47:00.441428+0000","last_peered":"2023-10-06T02:47:00.441428+0000","last_clean":"2023-10-06T02:47:00.441428+0000","last_became_active":"2023-10-06T02:47:00.441206+0000","last_became_peered":"2023-10-06T02:47:00.441206+0000","last_unstale":"2023-10-06T02:47:00.441428+0000","last_undegraded":"2023-10-06T02:47:00.441428+0000","last_fullsized":"2023-10-06T02:47:00.441428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:02.250831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.428632+0000","last_change":"2023-10-06T02:46:59.428553+0000","last_active":"2023-10-06T02:46:59.428632+0000","last_peered":"2023-10-06T02:46:59.428632+0000","last_clean":"2023-10-06T02:46:59.428632+0000","last_became_active":"2023-10-06T02:46:59.428314+0000","last_became_peered":"2023-10-06T02:46:59.428314+0000","last_unstale":"2023-10-06T02:46:59.428632+0000","last_undegraded":"2023-10-06T02:46:59.428632+0000","last_fullsized":"2023-10-06T02:46:59.428632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:39.689280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.440043+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:47:00.440043+0000","last_peered":"2023-10-06T02:47:00.440043+0000","last_clean":"2023-10-06T02:47:00.440043+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:47:00.440043+0000","last_undegraded":"2023-10-06T02:47:00.440043+0000","last_fullsized":"2023-10-06T02:47:00.440043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.447564+0000","last_change":"2023-10-06T02:47:00.447564+0000","last_active":"2023-10-06T02:47:00.447564+0000","last_peered":"2023-10-06T02:47:00.447564+0000","last_clean":"2023-10-06T02:47:00.447564+0000","last_became_active":"2023-10-06T02:47:00.447247+0000","last_became_peered":"2023-10-06T02:47:00.447247+0000","last_unstale":"2023-10-06T02:47:00.447564+0000","last_undegraded":"2023-10-06T02:47:00.447564+0000","last_fullsized":"2023-10-06T02:47:00.447564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:47.185529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.429623+0000","last_change":"2023-10-06T02:46:59.429476+0000","last_active":"2023-10-06T02:46:59.429623+0000","last_peered":"2023-10-06T02:46:59.429623+0000","last_clean":"2023-10-06T02:46:59.429623+0000","last_became_active":"2023-10-06T02:46:59.429177+0000","last_became_peered":"2023-10-06T02:46:59.429177+0000","last_unstale":"2023-10-06T02:46:59.429623+0000","last_undegraded":"2023-10-06T02:46:59.429623+0000","last_fullsized":"2023-10-06T02:46:59.429623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:19.968504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.421591+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:46:59.421591+0000","last_peered":"2023-10-06T02:46:59.421591+0000","last_clean":"2023-10-06T02:46:59.421591+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:46:59.421591+0000","last_undegraded":"2023-10-06T02:46:59.421591+0000","last_fullsized":"2023-10-06T02:46:59.421591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T02:47:00.449386+0000","last_change":"2023-10-06T02:47:00.447845+0000","last_active":"2023-10-06T02:47:00.449386+0000","last_peered":"2023-10-06T02:47:00.449386+0000","last_clean":"2023-10-06T02:47:00.449386+0000","last_became_active":"2023-10-06T02:47:00.447423+0000","last_became_peered":"2023-10-06T02:47:00.447423+0000","last_unstale":"2023-10-06T02:47:00.449386+0000","last_undegraded":"2023-10-06T02:47:00.449386+0000","last_fullsized":"2023-10-06T02:47:00.449386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:59.416211+0000","last_clean_scrub_stamp":"2023-10-06T02:46:59.416211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:19.024957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.424329+0000","last_change":"2023-10-06T02:46:59.424264+0000","last_active":"2023-10-06T02:46:59.424329+0000","last_peered":"2023-10-06T02:46:59.424329+0000","last_clean":"2023-10-06T02:46:59.424329+0000","last_became_active":"2023-10-06T02:46:59.424112+0000","last_became_peered":"2023-10-06T02:46:59.424112+0000","last_unstale":"2023-10-06T02:46:59.424329+0000","last_undegraded":"2023-10-06T02:46:59.424329+0000","last_fullsized":"2023-10-06T02:46:59.424329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:58.411592+0000","last_clean_scrub_stamp":"2023-10-06T02:46:58.411592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:24.800366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-06T02:46:59.424703+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:46:59.424703+0000","last_peered":"2023-10-06T02:46:59.424703+0000","last_clean":"2023-10-06T02:46:59.424703+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:46:59.424703+0000","last_undegraded":"2023-10-06T02:46:59.424703+0000","last_fullsized":"2023-10-06T02:46:59.424703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194588,"statfs":{"total":200000000,"available":199258557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.495}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.434},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.4870000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39300000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199849977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.74299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195166,"statfs":{"total":200000000,"available":199850441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.378},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.67800000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":722,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194589,"statfs":{"total":200000000,"available":199260129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.25600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.311},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":21.942,"5min":21.942,"15min":21.942},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":22.010999999999999,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.090999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":21.98,"5min":21.98,"15min":21.98},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":11.154,"5min":11.154,"15min":11.154},"last":0.54800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195166,"statfs":{"total":200000000,"available":199850461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.316},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.378}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.5}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199848961,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.246},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.28799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.30399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.25600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.36399999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":6.4189999999999996,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":14.912000000000001,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.496},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199849955,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.8949999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":5.3579999999999997,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.9329999999999998,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.439},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":5.9820000000000002,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":5.4390000000000001,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3470000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":13.173999999999999,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.748}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195166,"statfs":{"total":200000000,"available":199850419,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.432}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.504},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.56699999999999995}]}]}],"pool_statfs":[]}} 2023-10-06T02:47:04.871 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:47:04.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:47:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.023+0000 7f7afaaf2700 1 Processor -- start 2023-10-06T02:47:05.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.023+0000 7f7afaaf2700 1 -- start start 2023-10-06T02:47:05.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.024+0000 7f7afaaf2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7af4068f20 0x7f7af40cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.024+0000 7f7afaaf2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af40cca80 con 0x7f7af41577c0 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.024+0000 7f7afaaf2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af40cedd0 con 0x7f7af4157b90 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.024+0000 7f7afaaf2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af40cc4c0 con 0x7f7af4068f20 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.024+0000 7f7af888e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7af41577c0 0x7f7af4068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38268/0 (socket says 172.21.15.81:38268) 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.024+0000 7f7aebfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7af4068f20 0x7f7af40cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.024+0000 7f7af888e700 1 -- 172.21.15.81:0/2762533052 learned_addr learned my addr 172.21.15.81:0/2762533052 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7aebfff700 1 -- 172.21.15.81:0/2762533052 >> v1:172.21.15.83:6789/0 conn(0x7f7af4157b90 legacy=0x7f7af40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7aebfff700 1 -- 172.21.15.81:0/2762533052 >> v1:172.21.15.81:6789/0 conn(0x7f7af41577c0 legacy=0x7f7af4068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7aeb7fe700 1 -- 172.21.15.81:0/2762533052 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181500090 0 0) 0x7f7af40cca80 con 0x7f7af41577c0 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7aebfff700 1 -- 172.21.15.81:0/2762533052 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af40cc7a0 con 0x7f7af4068f20 2023-10-06T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7aebfff700 1 --2- 172.21.15.81:0/2762533052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 0x7f7af40cb790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40098e0 tx=0x7f7ae40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afdd868731ec784 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7aeb7fe700 1 -- 172.21.15.81:0/2762533052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4009e80 con 0x7f7af4068f20 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7aeb7fe700 1 -- 172.21.15.81:0/2762533052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae400b860 con 0x7f7af4068f20 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7aeb7fe700 1 -- 172.21.15.81:0/2762533052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400bbe0 con 0x7f7af4068f20 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2762533052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 msgr2=0x7f7af40cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7afaaf2700 1 --2- 172.21.15.81:0/2762533052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 0x7f7af40cb790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40098e0 tx=0x7f7ae40091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2762533052 shutdown_connections 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7afaaf2700 1 --2- 172.21.15.81:0/2762533052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 0x7f7af40cb790 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2762533052 >> 172.21.15.81:0/2762533052 conn(0x7f7af40d0df0 msgr2=0x7f7af40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.025+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2762533052 shutdown_connections 2023-10-06T02:47:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.026+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2762533052 wait complete. 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.027+0000 7f7afaaf2700 1 Processor -- start 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.027+0000 7f7afaaf2700 1 -- start start 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.027+0000 7f7afaaf2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 0x7f7af40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.027+0000 7f7afaaf2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7af41577c0 0x7f7af415cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.027+0000 7f7afaaf2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7af4157b90 0x7f7af4154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.027+0000 7f7afaaf2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af415d050 con 0x7f7af4068f20 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.027+0000 7f7afaaf2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af4155150 con 0x7f7af4157b90 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.027+0000 7f7afaaf2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40b42c0 con 0x7f7af41577c0 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af888e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 0x7f7af40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af888e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 0x7f7af40b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46506/0 (socket says 172.21.15.81:46506) 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af888e700 1 -- 172.21.15.81:0/2785837232 learned_addr learned my addr 172.21.15.81:0/2785837232 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7aebfff700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7af41577c0 0x7f7af415cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af908f700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7af4157b90 0x7f7af4154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af888e700 1 -- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7af41577c0 msgr2=0x7f7af415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af888e700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7af41577c0 0x7f7af415cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af888e700 1 -- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7af4157b90 msgr2=0x7f7af4154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af888e700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7af4157b90 0x7f7af4154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af888e700 1 -- 172.21.15.81:0/2785837232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4009420 con 0x7f7af4068f20 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7af888e700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 0x7f7af40b3c30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7af000c840 tx=0x7f7af0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7ae8ff9700 1 -- 172.21.15.81:0/2785837232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0005c00 con 0x7f7af4068f20 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7ae8ff9700 1 -- 172.21.15.81:0/2785837232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af0005d60 con 0x7f7af4068f20 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af40b45a0 con 0x7f7af4068f20 2023-10-06T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7ae8ff9700 1 -- 172.21.15.81:0/2785837232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0007320 con 0x7f7af4068f20 2023-10-06T02:47:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.028+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af40b4b60 con 0x7f7af4068f20 2023-10-06T02:47:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.029+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af4067a50 con 0x7f7af4068f20 2023-10-06T02:47:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.029+0000 7f7ae8ff9700 1 -- 172.21.15.81:0/2785837232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7af001b3b0 con 0x7f7af4068f20 2023-10-06T02:47:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.030+0000 7f7ae8ff9700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ae0066f30 0x7f7ae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.030+0000 7f7ae8ff9700 1 -- 172.21.15.81:0/2785837232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7af0083b60 con 0x7f7af4068f20 2023-10-06T02:47:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.030+0000 7f7aebfff700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ae0066f30 0x7f7ae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.031+0000 7f7aebfff700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ae0066f30 0x7f7ae00693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7af4069320 tx=0x7f7ae4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.034+0000 7f7ae8ff9700 1 -- 172.21.15.81:0/2785837232 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7af0050c70 con 0x7f7af4068f20 2023-10-06T02:47:05.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.289+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7af40cea60 con 0x7f7af4068f20 2023-10-06T02:47:05.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.292+0000 7f7ae8ff9700 1 -- 172.21.15.81:0/2785837232 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7af0017020 con 0x7f7af4068f20 2023-10-06T02:47:05.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ae0066f30 msgr2=0x7f7ae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ae0066f30 0x7f7ae00693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7af4069320 tx=0x7f7ae4017000 comp rx=0 tx=0).stop 2023-10-06T02:47:05.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 msgr2=0x7f7af40b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 0x7f7af40b3c30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7af000c840 tx=0x7f7af0007d90 comp rx=0 tx=0).stop 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 shutdown_connections 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ae0066f30 0x7f7ae00693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7af4157b90 0x7f7af4154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af4068f20 0x7f7af40b3c30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 --2- 172.21.15.81:0/2785837232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7af41577c0 0x7f7af415cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 >> 172.21.15.81:0/2785837232 conn(0x7f7af40d0df0 msgr2=0x7f7af4155450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 shutdown_connections 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.295+0000 7f7afaaf2700 1 -- 172.21.15.81:0/2785837232 wait complete. 2023-10-06T02:47:05.297 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:47:05.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.420+0000 7f63bc17b700 1 Processor -- start 2023-10-06T02:47:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.421+0000 7f63bc17b700 1 -- start start 2023-10-06T02:47:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.421+0000 7f63bc17b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63b41578d0 0x7f63b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.421+0000 7f63bc17b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40d07c0 con 0x7f63b4157ca0 2023-10-06T02:47:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.421+0000 7f63bc17b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40cfbb0 con 0x7f63b406d120 2023-10-06T02:47:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.421+0000 7f63bc17b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b40cfe90 con 0x7f63b41578d0 2023-10-06T02:47:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.421+0000 7f63b9f17700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63b41578d0 0x7f63b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.421+0000 7f63b9716700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f63b4157ca0 0x7f63b415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38272/0 (socket says 172.21.15.81:38272) 2023-10-06T02:47:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.421+0000 7f63b9716700 1 -- 172.21.15.81:0/492751123 learned_addr learned my addr 172.21.15.81:0/492751123 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.422+0000 7f63b9f17700 1 -- 172.21.15.81:0/492751123 >> v1:172.21.15.83:6789/0 conn(0x7f63b406d120 legacy=0x7f63b406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.422+0000 7f63b9f17700 1 -- 172.21.15.81:0/492751123 >> v1:172.21.15.81:6789/0 conn(0x7f63b4157ca0 legacy=0x7f63b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.422+0000 7f63b9f17700 1 -- 172.21.15.81:0/492751123 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40d0170 con 0x7f63b41578d0 2023-10-06T02:47:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.422+0000 7f63b9f17700 1 --2- 172.21.15.81:0/492751123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b41578d0 0x7f63b40cf4f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f63b00098e0 tx=0x7f63b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0e4c5e2d372fb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.422+0000 7f63b8f15700 1 -- 172.21.15.81:0/492751123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0009e80 con 0x7f63b41578d0 2023-10-06T02:47:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.422+0000 7f63b8f15700 1 -- 172.21.15.81:0/492751123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b000b860 con 0x7f63b41578d0 2023-10-06T02:47:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.422+0000 7f63b8f15700 1 -- 172.21.15.81:0/492751123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b000bbe0 con 0x7f63b41578d0 2023-10-06T02:47:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.422+0000 7f63bc17b700 1 -- 172.21.15.81:0/492751123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b41578d0 msgr2=0x7f63b40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.422+0000 7f63bc17b700 1 --2- 172.21.15.81:0/492751123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b41578d0 0x7f63b40cf4f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f63b00098e0 tx=0x7f63b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.423+0000 7f63bc17b700 1 -- 172.21.15.81:0/492751123 shutdown_connections 2023-10-06T02:47:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.423+0000 7f63bc17b700 1 --2- 172.21.15.81:0/492751123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b41578d0 0x7f63b40cf4f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.423+0000 7f63bc17b700 1 -- 172.21.15.81:0/492751123 >> 172.21.15.81:0/492751123 conn(0x7f63b406bb90 msgr2=0x7f63b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.423+0000 7f63bc17b700 1 -- 172.21.15.81:0/492751123 shutdown_connections 2023-10-06T02:47:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.423+0000 7f63bc17b700 1 -- 172.21.15.81:0/492751123 wait complete. 2023-10-06T02:47:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.424+0000 7f63bc17b700 1 Processor -- start 2023-10-06T02:47:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.424+0000 7f63bc17b700 1 -- start start 2023-10-06T02:47:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.424+0000 7f63bc17b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b406d120 0x7f63b416b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.424+0000 7f63bc17b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b41578d0 0x7f63b4155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.424+0000 7f63bc17b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63b4157ca0 0x7f63b41596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.424+0000 7f63bc17b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40cd690 con 0x7f63b406d120 2023-10-06T02:47:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.424+0000 7f63bc17b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b416b5c0 con 0x7f63b41578d0 2023-10-06T02:47:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.424+0000 7f63bc17b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b41557a0 con 0x7f63b4157ca0 2023-10-06T02:47:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9f17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b406d120 0x7f63b416b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9f17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b406d120 0x7f63b416b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46522/0 (socket says 172.21.15.81:46522) 2023-10-06T02:47:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9f17700 1 -- 172.21.15.81:0/2587248845 learned_addr learned my addr 172.21.15.81:0/2587248845 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9716700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b41578d0 0x7f63b4155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63ba718700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63b4157ca0 0x7f63b41596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9f17700 1 -- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63b4157ca0 msgr2=0x7f63b41596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9f17700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63b4157ca0 0x7f63b41596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9f17700 1 -- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b41578d0 msgr2=0x7f63b4155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9f17700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b41578d0 0x7f63b4155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9f17700 1 -- 172.21.15.81:0/2587248845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0009420 con 0x7f63b406d120 2023-10-06T02:47:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9716700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b41578d0 0x7f63b4155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63b9f17700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b406d120 0x7f63b416b080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f63b406fe20 tx=0x7f63b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63a9ffb700 1 -- 172.21.15.81:0/2587248845 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b000bb20 con 0x7f63b406d120 2023-10-06T02:47:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63a9ffb700 1 -- 172.21.15.81:0/2587248845 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0025420 con 0x7f63b406d120 2023-10-06T02:47:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b40cca80 con 0x7f63b406d120 2023-10-06T02:47:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63a9ffb700 1 -- 172.21.15.81:0/2587248845 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b00257c0 con 0x7f63b406d120 2023-10-06T02:47:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.425+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b40cd040 con 0x7f63b406d120 2023-10-06T02:47:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.426+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b4067ac0 con 0x7f63b406d120 2023-10-06T02:47:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.427+0000 7f63a9ffb700 1 -- 172.21.15.81:0/2587248845 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63b0023070 con 0x7f63b406d120 2023-10-06T02:47:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.427+0000 7f63a9ffb700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6398066f30 0x7f63980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.427+0000 7f63a9ffb700 1 -- 172.21.15.81:0/2587248845 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f63b0085d90 con 0x7f63b406d120 2023-10-06T02:47:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.427+0000 7f63b9716700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6398066f30 0x7f63980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.428+0000 7f63b9716700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6398066f30 0x7f63980693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f63b41681f0 tx=0x7f63a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.431+0000 7f63a9ffb700 1 -- 172.21.15.81:0/2587248845 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63b0052ea0 con 0x7f63b406d120 2023-10-06T02:47:05.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.657+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63b40d0450 con 0x7f63b406d120 2023-10-06T02:47:05.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.657+0000 7f63a9ffb700 1 -- 172.21.15.81:0/2587248845 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f63b00564c0 con 0x7f63b406d120 2023-10-06T02:47:05.659 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:05.659 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/205039596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":205039596},{"type":"v1","addr":"172.21.15.83:6837","nonce":205039596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1667782716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1667782716},{"type":"v1","addr":"172.21.15.83:6836","nonce":1667782716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/433893952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":433893952},{"type":"v1","addr":"172.21.15.81:6834","nonce":433893952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:59.804697+0000","modified":"2023-10-06T02:47:03.458466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/4196355397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4196355397},{"type":"v1","addr":"172.21.15.81:6835","nonce":4196355397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.659+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6398066f30 msgr2=0x7f63980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.659+0000 7f63bc17b700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6398066f30 0x7f63980693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f63b41681f0 tx=0x7f63a4009040 comp rx=0 tx=0).stop 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.659+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b406d120 msgr2=0x7f63b416b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.659+0000 7f63bc17b700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b406d120 0x7f63b416b080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f63b406fe20 tx=0x7f63b0017000 comp rx=0 tx=0).stop 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.660+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 shutdown_connections 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.660+0000 7f63bc17b700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63b4157ca0 0x7f63b41596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.660+0000 7f63bc17b700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b406d120 0x7f63b416b080 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.660+0000 7f63bc17b700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6398066f30 0x7f63980693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.660+0000 7f63bc17b700 1 --2- 172.21.15.81:0/2587248845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b41578d0 0x7f63b4155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.660+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 >> 172.21.15.81:0/2587248845 conn(0x7f63b406bb90 msgr2=0x7f63b406a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.660+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 shutdown_connections 2023-10-06T02:47:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:05.660+0000 7f63bc17b700 1 -- 172.21.15.81:0/2587248845 wait complete. 2023-10-06T02:47:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-10-06T02:47:06.075 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:46:59.804697+0000', 'modified': '2023-10-06T02:47:03.458466+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5034}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5034': {'gid': 5034, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/4196355397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 4196355397}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 4196355397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:47:06.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:47:06.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:47:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.191+0000 7f4673ddf700 1 Processor -- start 2023-10-06T02:47:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.191+0000 7f4673ddf700 1 -- start start 2023-10-06T02:47:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.192+0000 7f4673ddf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f466c156db0 0x7f466c06e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.192+0000 7f4673ddf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c06ebd0 con 0x7f466c06e770 2023-10-06T02:47:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.192+0000 7f4673ddf700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c0b2290 con 0x7f466c1569e0 2023-10-06T02:47:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.192+0000 7f4673ddf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c157c00 con 0x7f466c156db0 2023-10-06T02:47:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.192+0000 7f467237c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f466c06e770 0x7f466c0cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38278/0 (socket says 172.21.15.81:38278) 2023-10-06T02:47:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.192+0000 7f467237c700 1 -- 172.21.15.81:0/148694042 learned_addr learned my addr 172.21.15.81:0/148694042 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.192+0000 7f467137a700 1 --2- 172.21.15.81:0/148694042 >> v2:172.21.15.83:3300/0 conn(0x7f466c156db0 0x7f466c06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f4670b79700 1 -- 172.21.15.81:0/148694042 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694697049 0 0) 0x7f4664001490 con 0x7f466c06e770 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f4670b79700 1 -- 172.21.15.81:0/148694042 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4658003570 con 0x7f466c06e770 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f4670b79700 1 -- 172.21.15.81:0/148694042 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164571606 0 0) 0x7f466c0b2290 con 0x7f466c1569e0 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f4670b79700 1 -- 172.21.15.81:0/148694042 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4664001490 con 0x7f466c1569e0 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f467137a700 1 -- 172.21.15.81:0/148694042 >> v1:172.21.15.83:6789/0 conn(0x7f466c1569e0 legacy=0x7f466c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f467137a700 1 -- 172.21.15.81:0/148694042 >> v1:172.21.15.81:6789/0 conn(0x7f466c06e770 legacy=0x7f466c0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f467137a700 1 -- 172.21.15.81:0/148694042 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c1572d0 con 0x7f466c156db0 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f467137a700 1 --2- 172.21.15.81:0/148694042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 0x7f466c06e230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f465c0098e0 tx=0x7f465c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76dae2d5dd5ad605 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f4670b79700 1 -- 172.21.15.81:0/148694042 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c011630 con 0x7f466c156db0 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f4670b79700 1 -- 172.21.15.81:0/148694042 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c011790 con 0x7f466c156db0 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.193+0000 7f4670b79700 1 -- 172.21.15.81:0/148694042 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c011b30 con 0x7f466c156db0 2023-10-06T02:47:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.194+0000 7f4673ddf700 1 -- 172.21.15.81:0/148694042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 msgr2=0x7f466c06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.194+0000 7f4673ddf700 1 --2- 172.21.15.81:0/148694042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 0x7f466c06e230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f465c0098e0 tx=0x7f465c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.194+0000 7f4673ddf700 1 -- 172.21.15.81:0/148694042 shutdown_connections 2023-10-06T02:47:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.194+0000 7f4673ddf700 1 --2- 172.21.15.81:0/148694042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 0x7f466c06e230 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.194+0000 7f4673ddf700 1 -- 172.21.15.81:0/148694042 >> 172.21.15.81:0/148694042 conn(0x7f466c06cca0 msgr2=0x7f466c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.194+0000 7f4673ddf700 1 -- 172.21.15.81:0/148694042 shutdown_connections 2023-10-06T02:47:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.194+0000 7f4673ddf700 1 -- 172.21.15.81:0/148694042 wait complete. 2023-10-06T02:47:06.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.195+0000 7f4673ddf700 1 Processor -- start 2023-10-06T02:47:06.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.195+0000 7f4673ddf700 1 -- start start 2023-10-06T02:47:06.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4673ddf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c06e770 0x7f466c06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4673ddf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c1569e0 0x7f466c06c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4673ddf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 0x7f466c168490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4673ddf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c1694d0 con 0x7f466c06e770 2023-10-06T02:47:06.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4673ddf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0ae500 con 0x7f466c156db0 2023-10-06T02:47:06.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4673ddf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c1691f0 con 0x7f466c1569e0 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4671b7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c06e770 0x7f466c06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4671b7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c06e770 0x7f466c06bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46526/0 (socket says 172.21.15.81:46526) 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4671b7b700 1 -- 172.21.15.81:0/3631443418 learned_addr learned my addr 172.21.15.81:0/3631443418 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f467137a700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c1569e0 0x7f466c06c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f467237c700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 0x7f466c168490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4671b7b700 1 -- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c1569e0 msgr2=0x7f466c06c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4671b7b700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c1569e0 0x7f466c06c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4671b7b700 1 -- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 msgr2=0x7f466c168490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4671b7b700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 0x7f466c168490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4671b7b700 1 -- 172.21.15.81:0/3631443418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c009420 con 0x7f466c06e770 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f467137a700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c1569e0 0x7f466c06c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f467237c700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 0x7f466c168490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4671b7b700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c06e770 0x7f466c06bb90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f466800c790 tx=0x7f4668007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4661ffb700 1 -- 172.21.15.81:0/3631443418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668010510 con 0x7f466c06e770 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4661ffb700 1 -- 172.21.15.81:0/3631443418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4668010670 con 0x7f466c06e770 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4673ddf700 1 -- 172.21.15.81:0/3631443418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c0adeb0 con 0x7f466c06e770 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.196+0000 7f4661ffb700 1 -- 172.21.15.81:0/3631443418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668010a10 con 0x7f466c06e770 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.197+0000 7f4673ddf700 1 -- 172.21.15.81:0/3631443418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c169660 con 0x7f466c06e770 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.198+0000 7f4661ffb700 1 -- 172.21.15.81:0/3631443418 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f466801b400 con 0x7f466c06e770 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.198+0000 7f4661ffb700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4650066f30 0x7f46500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.198+0000 7f4661ffb700 1 -- 172.21.15.81:0/3631443418 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46680844e0 con 0x7f466c06e770 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.198+0000 7f467137a700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4650066f30 0x7f46500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.199+0000 7f467137a700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4650066f30 0x7f46500693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f466c157200 tx=0x7f465c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.200+0000 7f467d0d7b80 1 Processor -- start 2023-10-06T02:47:06.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.200+0000 7f467d0d7b80 1 -- start start 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 0x55575a650c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a651cc0 0x55575a6a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575a5a7a70 con 0x55575a6a0c00 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575a5a5270 con 0x55575a650840 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55575a5a1060 con 0x55575a651cc0 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467237c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467237c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46542/0 (socket says 172.21.15.81:46542) 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467237c700 1 -- 172.21.15.81:0/1964329308 learned_addr learned my addr 172.21.15.81:0/1964329308 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f4671b7b700 1 --2- 172.21.15.81:0/1964329308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 0x55575a650c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467137a700 1 --2- 172.21.15.81:0/1964329308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a651cc0 0x55575a6a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467237c700 1 -- 172.21.15.81:0/1964329308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a651cc0 msgr2=0x55575a6a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467237c700 1 --2- 172.21.15.81:0/1964329308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a651cc0 0x55575a6a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467237c700 1 -- 172.21.15.81:0/1964329308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 msgr2=0x55575a650c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467237c700 1 --2- 172.21.15.81:0/1964329308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 0x55575a650c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.201+0000 7f467237c700 1 -- 172.21.15.81:0/1964329308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55575a43b270 con 0x55575a6a0c00 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467237c700 1 --2- 172.21.15.81:0/1964329308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6a1050 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f466400e380 tx=0x7f4664009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad88ecd33ac72d2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f4656ffd700 1 -- 172.21.15.81:0/1964329308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466400ee00 con 0x55575a6a0c00 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f4656ffd700 1 -- 172.21.15.81:0/1964329308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4664014480 con 0x55575a6a0c00 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f4656ffd700 1 -- 172.21.15.81:0/1964329308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664014800 con 0x55575a6a0c00 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1964329308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 msgr2=0x55575a6a1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1964329308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6a1050 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f466400e380 tx=0x7f4664009040 comp rx=0 tx=0).stop 2023-10-06T02:47:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1964329308 shutdown_connections 2023-10-06T02:47:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1964329308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6a1050 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1964329308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 0x55575a650c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1964329308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a651cc0 0x55575a6a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1964329308 >> 172.21.15.81:0/1964329308 conn(0x55575a652160 msgr2=0x55575a652530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1964329308 shutdown_connections 2023-10-06T02:47:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.202+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1964329308 wait complete. 2023-10-06T02:47:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.203+0000 7f467d0d7b80 1 -- start start 2023-10-06T02:47:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.203+0000 7f467d0d7b80 1 Processor -- start 2023-10-06T02:47:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 0x55575a694910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a697260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a6a0c00 0x55575a6977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575a54c890 con 0x55575a651cc0 2023-10-06T02:47:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575a567ea0 con 0x55575a650840 2023-10-06T02:47:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55575a423e30 con 0x55575a6a0c00 2023-10-06T02:47:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467d0d7b80 10 client.0 _ll_register_callbacks cb 0x55575a613e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:47:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467137a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a697260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467137a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a697260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46544/0 (socket says 172.21.15.81:46544) 2023-10-06T02:47:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467137a700 1 -- 172.21.15.81:0/1960397755 learned_addr learned my addr 172.21.15.81:0/1960397755 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f4671b7b700 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 0x55575a694910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467237c700 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a6a0c00 0x55575a6977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467137a700 1 -- 172.21.15.81:0/1960397755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a6a0c00 msgr2=0x55575a6977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467137a700 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a6a0c00 0x55575a6977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467137a700 1 -- 172.21.15.81:0/1960397755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 msgr2=0x55575a694910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467137a700 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 0x55575a694910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f467137a700 1 -- 172.21.15.81:0/1960397755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466400f040 con 0x55575a651cc0 2023-10-06T02:47:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.204+0000 7f4671b7b700 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 0x55575a694910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467137a700 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a697260 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f465c013000 tx=0x7f465c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c16132baa31cfa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f464bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:47:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f464bfff700 1 -- 172.21.15.81:0/1960397755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c021070 con 0x55575a651cc0 2023-10-06T02:47:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f464bfff700 1 -- 172.21.15.81:0/1960397755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f465c028e20 con 0x55575a651cc0 2023-10-06T02:47:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1960397755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55575a645940 con 0x55575a651cc0 2023-10-06T02:47:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f464bfff700 1 -- 172.21.15.81:0/1960397755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f465c0316e0 con 0x55575a651cc0 2023-10-06T02:47:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467d0d7b80 10 client.5217 fetch_fsmap learned FSMap version 17 2023-10-06T02:47:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1960397755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55575a3ddfe0 con 0x55575a651cc0 2023-10-06T02:47:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f464bfff700 1 -- 172.21.15.81:0/1960397755 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55575a645940 con 0x55575a651cc0 2023-10-06T02:47:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f464bfff700 1 -- 172.21.15.81:0/1960397755 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f465c031840 con 0x55575a651cc0 2023-10-06T02:47:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467d0d7b80 10 client.5217 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T02:47:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467d0d7b80 10 client.5217 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467d0d7b80 20 client.5217 populate_metadata read hostname 'smithi081' 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] conn(0x55575a6aa990 0x55575a6aad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467d0d7b80 4 client.5217 mds_command: new command op to 5034 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1960397755 --> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55575a622870 con 0x55575a6aa990 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f4671b7b700 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] conn(0x55575a6aa990 0x55575a6aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.205+0000 7f464bfff700 10 client.5217 ms_handle_connect on v2:172.21.15.81:6833/4196355397 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f4671b7b700 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] conn(0x55575a6aa990 0x55575a6aad60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc3854ccdbb0cc3a server_cookie=d39750ab98083c0 in_seq=0 out_seq=0 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f464bfff700 1 -- 172.21.15.81:0/1960397755 <== mds.0 v2:172.21.15.81:6833/4196355397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55575a622870 con 0x55575a6aa990 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f464bfff700 10 client.5217 handle_command_reply: tid=0 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 client.5217 shutdown 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1960397755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 msgr2=0x55575a697260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a697260 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f465c013000 tx=0x7f465c021000 comp rx=0 tx=0).stop 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1960397755 shutdown_connections 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] conn(0x55575a6aa990 0x55575a6aad60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a6a0c00 0x55575a6977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a650840 0x55575a694910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1960397755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a697260 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f464bfff700 0 client.5217 ms_handle_reset on v2:172.21.15.81:6833/4196355397 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1960397755 >> 172.21.15.81:0/1960397755 conn(0x55575a652160 msgr2=0x55575a6511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1960397755 shutdown_connections 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.206+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1960397755 wait complete. 2023-10-06T02:47:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.207+0000 7f467d0d7b80 20 client.5217 trim_cache size 0 max 16384 2023-10-06T02:47:06.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.223+0000 7f467d0d7b80 1 Processor -- start 2023-10-06T02:47:06.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.223+0000 7f467d0d7b80 1 -- start start 2023-10-06T02:47:06.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a650840 0x55575a6b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a6767a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a6a0c00 0x55575a676ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575a629280 con 0x55575a651cc0 2023-10-06T02:47:06.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575a69a7d0 con 0x55575a6a0c00 2023-10-06T02:47:06.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55575a6806d0 con 0x55575a650840 2023-10-06T02:47:06.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467137a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a6767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467137a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a6767a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46554/0 (socket says 172.21.15.81:46554) 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467137a700 1 -- 172.21.15.81:0/1591589457 learned_addr learned my addr 172.21.15.81:0/1591589457 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467137a700 1 -- 172.21.15.81:0/1591589457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a650840 msgr2=0x55575a6b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467137a700 1 --2- 172.21.15.81:0/1591589457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a650840 0x55575a6b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467137a700 1 -- 172.21.15.81:0/1591589457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a6a0c00 msgr2=0x55575a676ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467137a700 1 --2- 172.21.15.81:0/1591589457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a6a0c00 0x55575a676ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467137a700 1 -- 172.21.15.81:0/1591589457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55575a56f780 con 0x55575a651cc0 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f467137a700 1 --2- 172.21.15.81:0/1591589457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a6767a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f465c009ed0 tx=0x7f465c00b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c959151cca2d3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f46577fe700 1 -- 172.21.15.81:0/1591589457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c021070 con 0x55575a651cc0 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f46577fe700 1 -- 172.21.15.81:0/1591589457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c011b10 con 0x55575a651cc0 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.224+0000 7f46577fe700 1 -- 172.21.15.81:0/1591589457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c031930 con 0x55575a651cc0 2023-10-06T02:47:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1591589457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 msgr2=0x55575a6767a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1591589457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a6767a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f465c009ed0 tx=0x7f465c00b050 comp rx=0 tx=0).stop 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1591589457 shutdown_connections 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1591589457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a6a0c00 0x55575a676ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1591589457 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a650840 0x55575a6b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/1591589457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a651cc0 0x55575a6767a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1591589457 >> 172.21.15.81:0/1591589457 conn(0x55575a652160 msgr2=0x55575a649280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1591589457 shutdown_connections 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 -- 172.21.15.81:0/1591589457 wait complete. 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 -- start start 2023-10-06T02:47:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.225+0000 7f467d0d7b80 1 Processor -- start 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.226+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a650840 0x55575a6f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.226+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a651cc0 0x55575a6a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.226+0000 7f467d0d7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.226+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575a6fd4e0 con 0x55575a6a0c00 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.226+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575a7007d0 con 0x55575a651cc0 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.226+0000 7f467d0d7b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55575a6a9810 con 0x55575a650840 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.226+0000 7f467d0d7b80 10 client.0 _ll_register_callbacks cb 0x55575a613e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467237c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467237c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6aa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46564/0 (socket says 172.21.15.81:46564) 2023-10-06T02:47:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467237c700 1 -- 172.21.15.81:0/267626180 learned_addr learned my addr 172.21.15.81:0/267626180 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467137a700 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a651cc0 0x55575a6a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f4671b7b700 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a650840 0x55575a6f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467237c700 1 -- 172.21.15.81:0/267626180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a650840 msgr2=0x55575a6f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467237c700 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a650840 0x55575a6f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467237c700 1 -- 172.21.15.81:0/267626180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a651cc0 msgr2=0x55575a6a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467237c700 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a651cc0 0x55575a6a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467237c700 1 -- 172.21.15.81:0/267626180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55575a3ddfe0 con 0x55575a6a0c00 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467237c700 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6aa1e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4664013000 tx=0x7f4664017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48266a8c83ea96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f464bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f464bfff700 1 -- 172.21.15.81:0/267626180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664014b70 con 0x55575a6a0c00 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f464bfff700 1 -- 172.21.15.81:0/267626180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4664014cd0 con 0x55575a6a0c00 2023-10-06T02:47:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467d0d7b80 1 -- 172.21.15.81:0/267626180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55575a543e00 con 0x55575a6a0c00 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f464bfff700 1 -- 172.21.15.81:0/267626180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46640072e0 con 0x55575a6a0c00 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467d0d7b80 10 client.5223 fetch_fsmap learned FSMap version 17 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467d0d7b80 1 -- 172.21.15.81:0/267626180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55575a556470 con 0x55575a6a0c00 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f464bfff700 1 -- 172.21.15.81:0/267626180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55575a543e00 con 0x55575a6a0c00 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f464bfff700 1 -- 172.21.15.81:0/267626180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4664007440 con 0x55575a6a0c00 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467d0d7b80 10 client.5223 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467d0d7b80 10 client.5223 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467d0d7b80 20 client.5223 populate_metadata read hostname 'smithi081' 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.227+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] conn(0x55575a68f810 0x55575a68fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 4 client.5223 mds_command: new command op to 5034 tid=0[{"prefix": "status"}] 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 -- 172.21.15.81:0/267626180 --> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55575a543b20 con 0x55575a68f810 2023-10-06T02:47:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f4671b7b700 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] conn(0x55575a68f810 0x55575a68fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f464bfff700 10 client.5223 ms_handle_connect on v2:172.21.15.81:6833/4196355397 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f4671b7b700 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] conn(0x55575a68f810 0x55575a68fbe0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5e05a4a4111b552 server_cookie=2532ac1b2eb83a42 in_seq=0 out_seq=0 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f464bfff700 1 -- 172.21.15.81:0/267626180 <== mds.0 v2:172.21.15.81:6833/4196355397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55575a543b20 con 0x55575a68f810 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f464bfff700 10 client.5223 handle_command_reply: tid=0 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 client.5223 shutdown 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 -- 172.21.15.81:0/267626180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 msgr2=0x55575a6aa1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6aa1e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4664013000 tx=0x7f4664017000 comp rx=0 tx=0).stop 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 -- 172.21.15.81:0/267626180 shutdown_connections 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.81:6833/4196355397,v1:172.21.15.81:6835/4196355397] conn(0x55575a68f810 0x55575a68fbe0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55575a6a0c00 0x55575a6aa1e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f464bfff700 0 client.5223 ms_handle_reset on v2:172.21.15.81:6833/4196355397 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55575a650840 0x55575a6f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 --2- 172.21.15.81:0/267626180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55575a651cc0 0x55575a6a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 -- 172.21.15.81:0/267626180 >> 172.21.15.81:0/267626180 conn(0x55575a652160 msgr2=0x55575a679a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 -- 172.21.15.81:0/267626180 shutdown_connections 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.228+0000 7f467d0d7b80 1 -- 172.21.15.81:0/267626180 wait complete. 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f467d0d7b80 20 client.5223 trim_cache size 0 max 16384 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:47:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5034, 2023-10-06T02:47:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:47:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:47:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:47:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.785215698, 2023-10-06T02:47:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 17, 2023-10-06T02:47:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 34, 2023-10-06T02:47:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 34, 2023-10-06T02:47:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.688223722 2023-10-06T02:47:06.238 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 -- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4650066f30 msgr2=0x7f46500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4650066f30 0x7f46500693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f466c157200 tx=0x7f465c017000 comp rx=0 tx=0).stop 2023-10-06T02:47:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 -- 172.21.15.81:0/3631443418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c06e770 msgr2=0x7f466c06bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c06e770 0x7f466c06bb90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f466800c790 tx=0x7f4668007e10 comp rx=0 tx=0).stop 2023-10-06T02:47:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 -- 172.21.15.81:0/3631443418 shutdown_connections 2023-10-06T02:47:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4650066f30 0x7f46500693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c156db0 0x7f466c168490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c06e770 0x7f466c06bb90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 --2- 172.21.15.81:0/3631443418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c1569e0 0x7f466c06c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 -- 172.21.15.81:0/3631443418 >> 172.21.15.81:0/3631443418 conn(0x7f466c06cca0 msgr2=0x7f466c1517d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 -- 172.21.15.81:0/3631443418 shutdown_connections 2023-10-06T02:47:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.229+0000 7f4673ddf700 1 -- 172.21.15.81:0/3631443418 wait complete. 2023-10-06T02:47:06.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:47:06.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:47:06.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:47:06.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.357+0000 7f501759e700 1 Processor -- start 2023-10-06T02:47:06.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.357+0000 7f501759e700 1 -- start start 2023-10-06T02:47:06.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f501759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5018068e90 0x7f5018164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f501759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50180cee10 con 0x7f5018159b40 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f501759e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50180cd040 con 0x7f5018159f10 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f501759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50180cd320 con 0x7f5018068e90 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f5016d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5018068e90 0x7f5018164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f501659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5018159b40 0x7f50180cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38292/0 (socket says 172.21.15.81:38292) 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f501659c700 1 -- 172.21.15.81:0/4044031269 learned_addr learned my addr 172.21.15.81:0/4044031269 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f5016d9d700 1 -- 172.21.15.81:0/4044031269 >> v1:172.21.15.83:6789/0 conn(0x7f5018159f10 legacy=0x7f5018068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f5016d9d700 1 -- 172.21.15.81:0/4044031269 >> v1:172.21.15.81:6789/0 conn(0x7f5018159b40 legacy=0x7f50180cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f5016d9d700 1 -- 172.21.15.81:0/4044031269 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50180ce7c0 con 0x7f5018068e90 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f5015d9b700 1 -- 172.21.15.81:0/4044031269 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988130125 0 0) 0x7f50180cee10 con 0x7f5018159b40 2023-10-06T02:47:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.358+0000 7f5016d9d700 1 --2- 172.21.15.81:0/4044031269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 0x7f5018164c70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5010009e60 tx=0x7f5010009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c75324c92a00b3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f5015d9b700 1 -- 172.21.15.81:0/4044031269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000e070 con 0x7f5018068e90 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f5015d9b700 1 -- 172.21.15.81:0/4044031269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501000bbf0 con 0x7f5018068e90 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f5015d9b700 1 -- 172.21.15.81:0/4044031269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010012430 con 0x7f5018068e90 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f501759e700 1 -- 172.21.15.81:0/4044031269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 msgr2=0x7f5018164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f501759e700 1 --2- 172.21.15.81:0/4044031269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 0x7f5018164c70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5010009e60 tx=0x7f5010009780 comp rx=0 tx=0).stop 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f501759e700 1 -- 172.21.15.81:0/4044031269 shutdown_connections 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f501759e700 1 --2- 172.21.15.81:0/4044031269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 0x7f5018164c70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f501759e700 1 -- 172.21.15.81:0/4044031269 >> 172.21.15.81:0/4044031269 conn(0x7f50180cd660 msgr2=0x7f50180cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f501759e700 1 -- 172.21.15.81:0/4044031269 shutdown_connections 2023-10-06T02:47:06.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.359+0000 7f501759e700 1 -- 172.21.15.81:0/4044031269 wait complete. 2023-10-06T02:47:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.360+0000 7f501759e700 1 Processor -- start 2023-10-06T02:47:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.360+0000 7f501759e700 1 -- start start 2023-10-06T02:47:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.361+0000 7f501759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 0x7f501816e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.361+0000 7f501759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5018159b40 0x7f50181474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.361+0000 7f501759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5018159f10 0x7f501816a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.361+0000 7f501759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501816ddd0 con 0x7f5018068e90 2023-10-06T02:47:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.361+0000 7f501759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501816b2d0 con 0x7f5018159f10 2023-10-06T02:47:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.361+0000 7f501759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501816ad10 con 0x7f5018159b40 2023-10-06T02:47:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.361+0000 7f501659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 0x7f501816e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.361+0000 7f501659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 0x7f501816e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46580/0 (socket says 172.21.15.81:46580) 2023-10-06T02:47:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.361+0000 7f501659c700 1 -- 172.21.15.81:0/3584758327 learned_addr learned my addr 172.21.15.81:0/3584758327 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f5016d9d700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5018159f10 0x7f501816a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f501659c700 1 -- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5018159b40 msgr2=0x7f50181474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f501659c700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5018159b40 0x7f50181474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f501659c700 1 -- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5018159f10 msgr2=0x7f501816a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f501659c700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5018159f10 0x7f501816a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f501659c700 1 -- 172.21.15.81:0/3584758327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010009a20 con 0x7f5018068e90 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f501659c700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 0x7f501816e260 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f500800c7e0 tx=0x7f5008007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f500effd700 1 -- 172.21.15.81:0/3584758327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008005b30 con 0x7f5018068e90 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f500effd700 1 -- 172.21.15.81:0/3584758327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5008005c90 con 0x7f5018068e90 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501816aff0 con 0x7f5018068e90 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f500effd700 1 -- 172.21.15.81:0/3584758327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008007300 con 0x7f5018068e90 2023-10-06T02:47:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.362+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501816e7a0 con 0x7f5018068e90 2023-10-06T02:47:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.363+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5018063e90 con 0x7f5018068e90 2023-10-06T02:47:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.363+0000 7f500effd700 1 -- 172.21.15.81:0/3584758327 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f500801b400 con 0x7f5018068e90 2023-10-06T02:47:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.363+0000 7f500effd700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ff8066f30 0x7f4ff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.364+0000 7f500effd700 1 -- 172.21.15.81:0/3584758327 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f50080841a0 con 0x7f5018068e90 2023-10-06T02:47:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.364+0000 7f500dd9b700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ff8066f30 0x7f4ff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.364+0000 7f500dd9b700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ff8066f30 0x7f4ff80693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5018154ec0 tx=0x7f5000006c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.368+0000 7f500effd700 1 -- 172.21.15.81:0/3584758327 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5008051330 con 0x7f5018068e90 2023-10-06T02:47:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.597+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f50180ceaa0 con 0x7f5018068e90 2023-10-06T02:47:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.597+0000 7f500effd700 1 -- 172.21.15.81:0/3584758327 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5008054950 con 0x7f5018068e90 2023-10-06T02:47:06.598 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:47:06.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ff8066f30 msgr2=0x7f4ff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ff8066f30 0x7f4ff80693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5018154ec0 tx=0x7f5000006c60 comp rx=0 tx=0).stop 2023-10-06T02:47:06.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 msgr2=0x7f501816e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 0x7f501816e260 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f500800c7e0 tx=0x7f5008007df0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 shutdown_connections 2023-10-06T02:47:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ff8066f30 0x7f4ff80693e0 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5018154ec0 tx=0x7f5000006c60 comp rx=0 tx=0).stop 2023-10-06T02:47:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5018159f10 0x7f501816a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5018068e90 0x7f501816e260 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 --2- 172.21.15.81:0/3584758327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5018159b40 0x7f50181474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 >> 172.21.15.81:0/3584758327 conn(0x7f50180cd660 msgr2=0x7f501806d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 shutdown_connections 2023-10-06T02:47:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:06.599+0000 7f501759e700 1 -- 172.21.15.81:0/3584758327 wait complete. 2023-10-06T02:47:06.612 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:47:06.612 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:47:06.612 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:47:06.612 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:47:06.612 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:47:06.612 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:47:06.613 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:47:06.613 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:47:06.613 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:47:06.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:06.613 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:47:06.667 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:47:06.667 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:47:06.668 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42490sec preferred_lft 42490sec 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:47:06.669 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:06.670 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:47:06.670 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:47:06.670 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:47:06.670 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:06.670 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:47:06.670 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:47:06.670 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:47:06.670 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:06.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:06.671 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:47:06.730 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:47:06.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:06.732 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:47:06.788 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:47:06.788 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:47:06.788 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:47:06.788 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:47:06.788 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:47:06.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:06.789 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:47:06.789 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:47:06.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:47:06.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:47:06.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:47:06.789 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:47:06.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:06.887 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:47:06.902 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:47:06.902 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:47:06.902 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:47:06.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:06.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:47:06.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:47:06.966 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:47:07.020 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:47:07.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:47:07.020 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:47:07.074 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:47:07.074 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:47:07.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:07.172 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:07.172 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:07.172 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:47:07.173 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:47:07.173 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:47:07.173 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:47:07.173 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:47:07.173 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:47:07.193 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:07.193 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:07.193 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:47:07.193 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:47:07.193 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:47:07.193 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:47:07.194 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:47:07.194 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:47:07.194 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:47:07.194 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:47:07.194 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:47:07.195 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:47:07.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:07.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:47:07.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:47:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.414+0000 7fc738a89700 1 Processor -- start 2023-10-06T02:47:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.414+0000 7fc738a89700 1 -- start start 2023-10-06T02:47:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc738a89700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc73406d830 0x7fc7340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc738a89700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7340d07c0 con 0x7fc734157ca0 2023-10-06T02:47:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc738a89700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7340cfbb0 con 0x7fc7341578d0 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc738a89700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7340cfe90 con 0x7fc73406d830 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc732d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc73406d830 0x7fc7340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc729d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc734157ca0 0x7fc73406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38302/0 (socket says 172.21.15.81:38302) 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc729d9b700 1 -- 172.21.15.81:0/3982776488 learned_addr learned my addr 172.21.15.81:0/3982776488 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc732d9d700 1 -- 172.21.15.81:0/3982776488 >> v1:172.21.15.83:6789/0 conn(0x7fc7341578d0 legacy=0x7fc73415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc732d9d700 1 -- 172.21.15.81:0/3982776488 >> v1:172.21.15.81:6789/0 conn(0x7fc734157ca0 legacy=0x7fc73406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc731d9b700 1 -- 172.21.15.81:0/3982776488 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331257839 0 0) 0x7fc7340d07c0 con 0x7fc734157ca0 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc732d9d700 1 -- 172.21.15.81:0/3982776488 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340d0170 con 0x7fc73406d830 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc732d9d700 1 --2- 172.21.15.81:0/3982776488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73406d830 0x7fc7340cf4f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009e60 tx=0x7fc72c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd97dedd04f55924 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc731d9b700 1 -- 172.21.15.81:0/3982776488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00e070 con 0x7fc73406d830 2023-10-06T02:47:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc731d9b700 1 -- 172.21.15.81:0/3982776488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c00bc30 con 0x7fc73406d830 2023-10-06T02:47:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.415+0000 7fc731d9b700 1 -- 172.21.15.81:0/3982776488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c012430 con 0x7fc73406d830 2023-10-06T02:47:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.416+0000 7fc738a89700 1 -- 172.21.15.81:0/3982776488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73406d830 msgr2=0x7fc7340cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.416+0000 7fc738a89700 1 --2- 172.21.15.81:0/3982776488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73406d830 0x7fc7340cf4f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009e60 tx=0x7fc72c009780 comp rx=0 tx=0).stop 2023-10-06T02:47:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.416+0000 7fc738a89700 1 -- 172.21.15.81:0/3982776488 shutdown_connections 2023-10-06T02:47:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.416+0000 7fc738a89700 1 --2- 172.21.15.81:0/3982776488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73406d830 0x7fc7340cf4f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.416+0000 7fc738a89700 1 -- 172.21.15.81:0/3982776488 >> 172.21.15.81:0/3982776488 conn(0x7fc73406bb90 msgr2=0x7fc73406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.416+0000 7fc738a89700 1 -- 172.21.15.81:0/3982776488 shutdown_connections 2023-10-06T02:47:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.416+0000 7fc738a89700 1 -- 172.21.15.81:0/3982776488 wait complete. 2023-10-06T02:47:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.417+0000 7fc738a89700 1 Processor -- start 2023-10-06T02:47:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.417+0000 7fc738a89700 1 -- start start 2023-10-06T02:47:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc738a89700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc73406d830 0x7fc734148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc738a89700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7341578d0 0x7fc7340b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc738a89700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc734157ca0 0x7fc7340ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc738a89700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc734148d60 con 0x7fc734157ca0 2023-10-06T02:47:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc738a89700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340b69f0 con 0x7fc7341578d0 2023-10-06T02:47:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc738a89700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340b4b50 con 0x7fc73406d830 2023-10-06T02:47:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc732d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc734157ca0 0x7fc7340ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc732d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc734157ca0 0x7fc7340ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46606/0 (socket says 172.21.15.81:46606) 2023-10-06T02:47:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc732d9d700 1 -- 172.21.15.81:0/3057204119 learned_addr learned my addr 172.21.15.81:0/3057204119 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc729d9b700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7341578d0 0x7fc7340b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc73259c700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc73406d830 0x7fc734148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc732d9d700 1 -- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc73406d830 msgr2=0x7fc734148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc732d9d700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc73406d830 0x7fc734148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc732d9d700 1 -- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7341578d0 msgr2=0x7fc7340b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc732d9d700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7341578d0 0x7fc7340b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc732d9d700 1 -- 172.21.15.81:0/3057204119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c009a20 con 0x7fc734157ca0 2023-10-06T02:47:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc729d9b700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7341578d0 0x7fc7340b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc73259c700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc73406d830 0x7fc734148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.418+0000 7fc732d9d700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc734157ca0 0x7fc7340ac380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc72c013000 tx=0x7fc72c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.419+0000 7fc72affd700 1 -- 172.21.15.81:0/3057204119 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c01d630 con 0x7fc734157ca0 2023-10-06T02:47:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.419+0000 7fc72affd700 1 -- 172.21.15.81:0/3057204119 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c01d790 con 0x7fc734157ca0 2023-10-06T02:47:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.419+0000 7fc72affd700 1 -- 172.21.15.81:0/3057204119 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c01db30 con 0x7fc734157ca0 2023-10-06T02:47:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.419+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7340b4e30 con 0x7fc734157ca0 2023-10-06T02:47:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.419+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7340b53f0 con 0x7fc734157ca0 2023-10-06T02:47:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.419+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc734067ac0 con 0x7fc734157ca0 2023-10-06T02:47:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.420+0000 7fc72affd700 1 -- 172.21.15.81:0/3057204119 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc72c024070 con 0x7fc734157ca0 2023-10-06T02:47:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.420+0000 7fc72affd700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc714066f30 0x7fc7140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.420+0000 7fc72affd700 1 -- 172.21.15.81:0/3057204119 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc72c086fe0 con 0x7fc734157ca0 2023-10-06T02:47:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.421+0000 7fc73259c700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc714066f30 0x7fc7140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.421+0000 7fc73259c700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc714066f30 0x7fc7140693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc724001860 tx=0x7fc724009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:07.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.425+0000 7fc72affd700 1 -- 172.21.15.81:0/3057204119 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc72c0540f0 con 0x7fc734157ca0 2023-10-06T02:47:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.652+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc7340d0450 con 0x7fc734157ca0 2023-10-06T02:47:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.653+0000 7fc72affd700 1 -- 172.21.15.81:0/3057204119 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc72c057710 con 0x7fc734157ca0 2023-10-06T02:47:07.654 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:47:07.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc714066f30 msgr2=0x7fc7140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc714066f30 0x7fc7140693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc724001860 tx=0x7fc724009040 comp rx=0 tx=0).stop 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc734157ca0 msgr2=0x7fc7340ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc734157ca0 0x7fc7340ac380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc72c013000 tx=0x7fc72c019000 comp rx=0 tx=0).stop 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 shutdown_connections 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc734157ca0 0x7fc7340ac380 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc73406d830 0x7fc734148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc714066f30 0x7fc7140693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 --2- 172.21.15.81:0/3057204119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7341578d0 0x7fc7340b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 >> 172.21.15.81:0/3057204119 conn(0x7fc73406bb90 msgr2=0x7fc73406d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 shutdown_connections 2023-10-06T02:47:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:07.655+0000 7fc738a89700 1 -- 172.21.15.81:0/3057204119 wait complete. 2023-10-06T02:47:07.668 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:47:07.668 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:47:07.668 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:47:07.668 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:47:07.668 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:47:07.668 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:47:07.668 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:47:07.668 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:47:07.669 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:47:07.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:07.669 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:47:07.687 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:07.688 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42489sec preferred_lft 42489sec 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:47:07.689 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:47:07.690 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:47:07.691 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:07.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:07.691 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:47:07.756 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:47:07.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:07.757 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:47:07.817 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:47:07.817 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:47:07.817 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:47:07.817 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:47:07.817 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:47:07.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:07.818 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:47:07.818 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:47:07.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:47:07.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:47:07.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:47:07.818 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:47:07.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:07.925 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:47:07.940 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:47:07.940 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:47:07.941 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:47:07.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:07.941 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:47:08.006 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:47:08.007 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:47:08.062 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:47:08.062 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:47:08.062 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:47:08.117 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:47:08.117 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:47:08.117 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:08.198 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:08.198 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:08.217 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:08.217 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:08.217 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:47:08.217 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:47:08.217 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:47:08.217 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:47:08.218 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:47:08.218 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:47:08.238 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:08.238 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:08.238 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:47:08.239 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:47:08.239 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:47:08.239 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:47:08.239 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:47:08.239 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:47:08.239 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:47:08.239 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:47:08.239 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:47:08.241 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:47:08.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:08.241 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:47:08.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:08.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.418+0000 7f808b553700 1 Processor -- start 2023-10-06T02:47:08.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.418+0000 7f808b553700 1 -- start start 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.419+0000 7f808b553700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f80841578d0 0x7f80840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.419+0000 7f808b553700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f808406d120 0x7f808406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.419+0000 7f808b553700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80840d07c0 con 0x7f8084157ca0 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.419+0000 7f808b553700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808406da50 con 0x7f808406d120 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.419+0000 7f808b553700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80840cfbb0 con 0x7f80841578d0 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.419+0000 7f8089af0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f808406d120 0x7f808406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.419+0000 7f8089af0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f808406d120 0x7f808406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46608/0 (socket says 172.21.15.81:46608) 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.419+0000 7f8089af0700 1 -- 172.21.15.81:0/3705227853 learned_addr learned my addr 172.21.15.81:0/3705227853 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f80892ef700 1 --2- 172.21.15.81:0/3705227853 >> v2:172.21.15.83:3300/0 conn(0x7f80841578d0 0x7f80840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f8089af0700 1 -- 172.21.15.81:0/3705227853 >> v2:172.21.15.83:3300/0 conn(0x7f80841578d0 msgr2=0x7f80840cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f8089af0700 1 --2- 172.21.15.81:0/3705227853 >> v2:172.21.15.83:3300/0 conn(0x7f80841578d0 0x7f80840cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f8089af0700 1 -- 172.21.15.81:0/3705227853 >> v1:172.21.15.83:6789/0 conn(0x7f8084157ca0 legacy=0x7f808415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f8089af0700 1 -- 172.21.15.81:0/3705227853 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80840cfe90 con 0x7f808406d120 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f80892ef700 1 --2- 172.21.15.81:0/3705227853 >> v2:172.21.15.83:3300/0 conn(0x7f80841578d0 0x7f80840cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f8089af0700 1 --2- 172.21.15.81:0/3705227853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f808406d120 0x7f808406d510 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f80840646b0 tx=0x7f807c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8353410f90990a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f807bfff700 1 -- 172.21.15.81:0/3705227853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c00e070 con 0x7f808406d120 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f807bfff700 1 -- 172.21.15.81:0/3705227853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c00ba10 con 0x7f808406d120 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f807bfff700 1 -- 172.21.15.81:0/3705227853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0092e0 con 0x7f808406d120 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f808b553700 1 -- 172.21.15.81:0/3705227853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f808406d120 msgr2=0x7f808406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f808b553700 1 --2- 172.21.15.81:0/3705227853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f808406d120 0x7f808406d510 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f80840646b0 tx=0x7f807c009840 comp rx=0 tx=0).stop 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f808b553700 1 -- 172.21.15.81:0/3705227853 shutdown_connections 2023-10-06T02:47:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f808b553700 1 --2- 172.21.15.81:0/3705227853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f808406d120 0x7f808406d510 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f808b553700 1 --2- 172.21.15.81:0/3705227853 >> v2:172.21.15.83:3300/0 conn(0x7f80841578d0 0x7f80840cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.420+0000 7f808b553700 1 -- 172.21.15.81:0/3705227853 >> 172.21.15.81:0/3705227853 conn(0x7f808406bb90 msgr2=0x7f808406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.421+0000 7f808b553700 1 -- 172.21.15.81:0/3705227853 shutdown_connections 2023-10-06T02:47:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.421+0000 7f808b553700 1 -- 172.21.15.81:0/3705227853 wait complete. 2023-10-06T02:47:08.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.422+0000 7f808b553700 1 Processor -- start 2023-10-06T02:47:08.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.422+0000 7f808b553700 1 -- start start 2023-10-06T02:47:08.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f808b553700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f808406d120 0x7f80841593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f808b553700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80841578d0 0x7f80841598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f808b553700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8084157ca0 0x7f80840aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f808b553700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80840aebf0 con 0x7f80841578d0 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f808b553700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80840ae6d0 con 0x7f808406d120 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f808b553700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808416ae90 con 0x7f8084157ca0 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8088aee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80841578d0 0x7f80841598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8088aee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80841578d0 0x7f80841598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46622/0 (socket says 172.21.15.81:46622) 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8088aee700 1 -- 172.21.15.81:0/2556526823 learned_addr learned my addr 172.21.15.81:0/2556526823 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f80892ef700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f808406d120 0x7f80841593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8089af0700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8084157ca0 0x7f80840aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8088aee700 1 -- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8084157ca0 msgr2=0x7f80840aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8088aee700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8084157ca0 0x7f80840aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8088aee700 1 -- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f808406d120 msgr2=0x7f80841593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8088aee700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f808406d120 0x7f80841593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8088aee700 1 -- 172.21.15.81:0/2556526823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c009ae0 con 0x7f80841578d0 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f8088aee700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80841578d0 0x7f80841598e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f807400b5e0 tx=0x7f80740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f80797fa700 1 -- 172.21.15.81:0/2556526823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400f510 con 0x7f80841578d0 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f80797fa700 1 -- 172.21.15.81:0/2556526823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807400f6b0 con 0x7f80841578d0 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f80797fa700 1 -- 172.21.15.81:0/2556526823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400fa70 con 0x7f80841578d0 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8084144380 con 0x7f80841578d0 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.423+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808416a4f0 con 0x7f80841578d0 2023-10-06T02:47:08.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.424+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808416b000 con 0x7f80841578d0 2023-10-06T02:47:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.425+0000 7f80797fa700 1 -- 172.21.15.81:0/2556526823 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f807401a400 con 0x7f80841578d0 2023-10-06T02:47:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.425+0000 7f80797fa700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8068066f30 0x7f80680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.425+0000 7f80797fa700 1 -- 172.21.15.81:0/2556526823 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8074084010 con 0x7f80841578d0 2023-10-06T02:47:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.425+0000 7f80892ef700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8068066f30 0x7f80680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.426+0000 7f80892ef700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8068066f30 0x7f80680693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f808000adc0 tx=0x7f8080006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.429+0000 7f80797fa700 1 -- 172.21.15.81:0/2556526823 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80740511a0 con 0x7f80841578d0 2023-10-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.659+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8084067b50 con 0x7f80841578d0 2023-10-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.659+0000 7f80797fa700 1 -- 172.21.15.81:0/2556526823 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f80740091f0 con 0x7f80841578d0 2023-10-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/205039596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":205039596},{"type":"v1","addr":"172.21.15.83:6837","nonce":205039596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1667782716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1667782716},{"type":"v1","addr":"172.21.15.83:6836","nonce":1667782716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/433893952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":433893952},{"type":"v1","addr":"172.21.15.81:6834","nonce":433893952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:59.804697+0000","modified":"2023-10-06T02:47:03.458466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/4196355397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4196355397},{"type":"v1","addr":"172.21.15.81:6835","nonce":4196355397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8068066f30 msgr2=0x7f80680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8068066f30 0x7f80680693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f808000adc0 tx=0x7f8080006f90 comp rx=0 tx=0).stop 2023-10-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80841578d0 msgr2=0x7f80841598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80841578d0 0x7f80841598e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f807400b5e0 tx=0x7f80740090f0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 shutdown_connections 2023-10-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8084157ca0 0x7f80840aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8068066f30 0x7f80680693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f808406d120 0x7f80841593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 --2- 172.21.15.81:0/2556526823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80841578d0 0x7f80841598e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 >> 172.21.15.81:0/2556526823 conn(0x7f808406bb90 msgr2=0x7f8084155af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.661+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 shutdown_connections 2023-10-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.662+0000 7f808b553700 1 -- 172.21.15.81:0/2556526823 wait complete. 2023-10-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-10-06T02:47:08.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-06T02:47:08.807 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":5034,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3529931590000004,"mdsmap_epoch":17,"osdmap_epoch":34,"osdmap_epoch_barrier":34,"uptime":16.256006249999999} 2023-10-06T02:47:08.807 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 5034, "mdsmap_epoch": 17, "osdmap_epoch": 34, "osdmap_epoch_barrier": 34, "rank_uptime": 8.352993159, "state": "up:active", "uptime": 16.25600625, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:47:08.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-10-06T02:47:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.918+0000 7fea107af700 1 Processor -- start 2023-10-06T02:47:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.919+0000 7fea107af700 1 -- start start 2023-10-06T02:47:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.919+0000 7fea107af700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea081577e0 0x7fea0815b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.919+0000 7fea107af700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fea08157bb0 0x7fea080cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.919+0000 7fea107af700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080cfdd0 con 0x7fea0806d240 2023-10-06T02:47:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.919+0000 7fea107af700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea080d00b0 con 0x7fea081577e0 2023-10-06T02:47:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.919+0000 7fea107af700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea080d0390 con 0x7fea08157bb0 2023-10-06T02:47:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0e54b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea081577e0 0x7fea0815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0e54b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea081577e0 0x7fea0815b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46630/0 (socket says 172.21.15.81:46630) 2023-10-06T02:47:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0e54b700 1 -- 172.21.15.81:0/3513036644 learned_addr learned my addr 172.21.15.81:0/3513036644 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0dd4a700 1 --2- 172.21.15.81:0/3513036644 >> v2:172.21.15.83:3300/0 conn(0x7fea08157bb0 0x7fea080cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0e54b700 1 -- 172.21.15.81:0/3513036644 >> v2:172.21.15.83:3300/0 conn(0x7fea08157bb0 msgr2=0x7fea080cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0e54b700 1 --2- 172.21.15.81:0/3513036644 >> v2:172.21.15.83:3300/0 conn(0x7fea08157bb0 0x7fea080cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0e54b700 1 -- 172.21.15.81:0/3513036644 >> v1:172.21.15.83:6789/0 conn(0x7fea0806d240 legacy=0x7fea0806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0e54b700 1 -- 172.21.15.81:0/3513036644 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080d0670 con 0x7fea081577e0 2023-10-06T02:47:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0dd4a700 1 --2- 172.21.15.81:0/3513036644 >> v2:172.21.15.83:3300/0 conn(0x7fea08157bb0 0x7fea080cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0e54b700 1 --2- 172.21.15.81:0/3513036644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea081577e0 0x7fea0815b070 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fea080b6e70 tx=0x7fea04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97d8eb9be57efc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0d549700 1 -- 172.21.15.81:0/3513036644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400e070 con 0x7fea081577e0 2023-10-06T02:47:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0d549700 1 -- 172.21.15.81:0/3513036644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0400ba50 con 0x7fea081577e0 2023-10-06T02:47:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.920+0000 7fea0d549700 1 -- 172.21.15.81:0/3513036644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040092e0 con 0x7fea081577e0 2023-10-06T02:47:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.921+0000 7fea107af700 1 -- 172.21.15.81:0/3513036644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea081577e0 msgr2=0x7fea0815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.921+0000 7fea107af700 1 --2- 172.21.15.81:0/3513036644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea081577e0 0x7fea0815b070 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fea080b6e70 tx=0x7fea04009840 comp rx=0 tx=0).stop 2023-10-06T02:47:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.921+0000 7fea107af700 1 -- 172.21.15.81:0/3513036644 shutdown_connections 2023-10-06T02:47:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.921+0000 7fea107af700 1 --2- 172.21.15.81:0/3513036644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea081577e0 0x7fea0815b070 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.921+0000 7fea107af700 1 --2- 172.21.15.81:0/3513036644 >> v2:172.21.15.83:3300/0 conn(0x7fea08157bb0 0x7fea080cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.921+0000 7fea107af700 1 -- 172.21.15.81:0/3513036644 >> 172.21.15.81:0/3513036644 conn(0x7fea0806bb90 msgr2=0x7fea0806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.921+0000 7fea107af700 1 -- 172.21.15.81:0/3513036644 shutdown_connections 2023-10-06T02:47:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.921+0000 7fea107af700 1 -- 172.21.15.81:0/3513036644 wait complete. 2023-10-06T02:47:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.922+0000 7fea107af700 1 Processor -- start 2023-10-06T02:47:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.922+0000 7fea107af700 1 -- start start 2023-10-06T02:47:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea107af700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0806d240 0x7fea08154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea107af700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea081577e0 0x7fea080cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea107af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea08157bb0 0x7fea080cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea107af700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0816a580 con 0x7fea08157bb0 2023-10-06T02:47:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea107af700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0816b3e0 con 0x7fea081577e0 2023-10-06T02:47:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea107af700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0816a760 con 0x7fea0806d240 2023-10-06T02:47:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0ed4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea08157bb0 0x7fea080cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0ed4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea08157bb0 0x7fea080cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46638/0 (socket says 172.21.15.81:46638) 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0ed4c700 1 -- 172.21.15.81:0/4211042987 learned_addr learned my addr 172.21.15.81:0/4211042987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0dd4a700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea081577e0 0x7fea080cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0e54b700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0806d240 0x7fea08154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0ed4c700 1 -- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0806d240 msgr2=0x7fea08154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0ed4c700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0806d240 0x7fea08154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0ed4c700 1 -- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea081577e0 msgr2=0x7fea080cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0ed4c700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea081577e0 0x7fea080cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0ed4c700 1 -- 172.21.15.81:0/4211042987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04009ae0 con 0x7fea08157bb0 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.923+0000 7fea0ed4c700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea08157bb0 0x7fea080cd690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fea0000c590 tx=0x7fea00007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.924+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/4211042987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00011590 con 0x7fea08157bb0 2023-10-06T02:47:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.924+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/4211042987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea000116f0 con 0x7fea08157bb0 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.924+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0816aa40 con 0x7fea08157bb0 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.924+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/4211042987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00011ab0 con 0x7fea08157bb0 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.924+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0816b000 con 0x7fea08157bb0 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.924+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea080b36f0 con 0x7fea08157bb0 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.925+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/4211042987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea0001b3b0 con 0x7fea08157bb0 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.925+0000 7fe9fe7fc700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec066f30 0x7fe9ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.925+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/4211042987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea00083a50 con 0x7fea08157bb0 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.925+0000 7fea0e54b700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec066f30 0x7fe9ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.926+0000 7fea0e54b700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec066f30 0x7fe9ec0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fea04009880 tx=0x7fea04018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:08.929+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/4211042987 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea00050b60 con 0x7fea08157bb0 2023-10-06T02:47:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.186+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fea080cfa50 con 0x7fea08157bb0 2023-10-06T02:47:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.187+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/4211042987 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1921 (secure 0 0 0) 0x7fea00017070 con 0x7fea08157bb0 2023-10-06T02:47:09.189 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:09.189 INFO:teuthology.orchestra.run.smithi081.stdout: "stats": { 2023-10-06T02:47:09.189 INFO:teuthology.orchestra.run.smithi081.stdout: "total_bytes": 1600000000, 2023-10-06T02:47:09.189 INFO:teuthology.orchestra.run.smithi081.stdout: "total_avail_bytes": 1597565772, 2023-10-06T02:47:09.190 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_bytes": 2434228, 2023-10-06T02:47:09.190 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_raw_bytes": 2434228, 2023-10-06T02:47:09.190 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_raw_ratio": 0.0015213924925774336, 2023-10-06T02:47:09.190 INFO:teuthology.orchestra.run.smithi081.stdout: "num_osds": 8, 2023-10-06T02:47:09.190 INFO:teuthology.orchestra.run.smithi081.stdout: "num_per_pool_osds": 0, 2023-10-06T02:47:09.190 INFO:teuthology.orchestra.run.smithi081.stdout: "num_per_pool_omap_osds": 0 2023-10-06T02:47:09.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:09.191 INFO:teuthology.orchestra.run.smithi081.stdout: "stats_by_class": { 2023-10-06T02:47:09.191 INFO:teuthology.orchestra.run.smithi081.stdout: "hdd": { 2023-10-06T02:47:09.191 INFO:teuthology.orchestra.run.smithi081.stdout: "total_bytes": 1600000000, 2023-10-06T02:47:09.191 INFO:teuthology.orchestra.run.smithi081.stdout: "total_avail_bytes": 1597565772, 2023-10-06T02:47:09.192 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_bytes": 2434228, 2023-10-06T02:47:09.192 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_raw_bytes": 2434228, 2023-10-06T02:47:09.192 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_raw_ratio": 0.0015213924925774336 2023-10-06T02:47:09.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:09.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:09.192 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:47:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": ".mgr", 2023-10-06T02:47:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 1, 2023-10-06T02:47:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "stats": { 2023-10-06T02:47:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "stored": 590368, 2023-10-06T02:47:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "objects": 2, 2023-10-06T02:47:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: "kb_used": 577, 2023-10-06T02:47:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 590368, 2023-10-06T02:47:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: "percent_used": 0.0005296685267239809, 2023-10-06T02:47:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: "max_avail": 557004352 2023-10-06T02:47:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd", 2023-10-06T02:47:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 2, 2023-10-06T02:47:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "stats": { 2023-10-06T02:47:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "stored": 0, 2023-10-06T02:47:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "objects": 0, 2023-10-06T02:47:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "kb_used": 0, 2023-10-06T02:47:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 0, 2023-10-06T02:47:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: "percent_used": 0, 2023-10-06T02:47:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: "max_avail": 557004352 2023-10-06T02:47:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs_metadata", 2023-10-06T02:47:09.198 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5, 2023-10-06T02:47:09.198 INFO:teuthology.orchestra.run.smithi081.stdout: "stats": { 2023-10-06T02:47:09.198 INFO:teuthology.orchestra.run.smithi081.stdout: "stored": 2306, 2023-10-06T02:47:09.198 INFO:teuthology.orchestra.run.smithi081.stdout: "objects": 22, 2023-10-06T02:47:09.198 INFO:teuthology.orchestra.run.smithi081.stdout: "kb_used": 3, 2023-10-06T02:47:09.198 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 2306, 2023-10-06T02:47:09.199 INFO:teuthology.orchestra.run.smithi081.stdout: "percent_used": 2.0699974356830353e-06, 2023-10-06T02:47:09.199 INFO:teuthology.orchestra.run.smithi081.stdout: "max_avail": 557004352 2023-10-06T02:47:09.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:09.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:09.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs_data", 2023-10-06T02:47:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6, 2023-10-06T02:47:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "stats": { 2023-10-06T02:47:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "stored": 0, 2023-10-06T02:47:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "objects": 0, 2023-10-06T02:47:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "kb_used": 0, 2023-10-06T02:47:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 0, 2023-10-06T02:47:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: "percent_used": 0, 2023-10-06T02:47:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: "max_avail": 557004352 2023-10-06T02:47:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:09.202 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:09.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec066f30 msgr2=0x7fe9ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:09.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec066f30 0x7fe9ec0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fea04009880 tx=0x7fea04018000 comp rx=0 tx=0).stop 2023-10-06T02:47:09.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea08157bb0 msgr2=0x7fea080cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:09.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea08157bb0 0x7fea080cd690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fea0000c590 tx=0x7fea00007ef0 comp rx=0 tx=0).stop 2023-10-06T02:47:09.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 shutdown_connections 2023-10-06T02:47:09.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea08157bb0 0x7fea080cd690 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:09.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea0806d240 0x7fea08154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:09.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9ec066f30 0x7fe9ec0693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:09.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 --2- 172.21.15.81:0/4211042987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea081577e0 0x7fea080cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:09.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 >> 172.21.15.81:0/4211042987 conn(0x7fea0806bb90 msgr2=0x7fea08156980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:09.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 shutdown_connections 2023-10-06T02:47:09.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.189+0000 7fea107af700 1 -- 172.21.15.81:0/4211042987 wait complete. 2023-10-06T02:47:09.208 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:47:09.208 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:47:09.208 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-06T02:47:09.208 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-06T02:47:09.208 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-06T02:47:09.208 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-06T02:47:09.209 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:47:09.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:09.462 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-06T02:47:09.530 INFO:teuthology.orchestra.run.smithi081.stdout:client5235 2023-10-06T02:47:09.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:09.531 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/072ce422-278f-434c-8814-5b3ff2abcdfb.client5235/osdmap') 2023-10-06T02:47:09.607 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 34 barrier 34 flags 0x588000 2023-10-06T02:47:09.608 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:09.608 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:09.608 INFO:teuthology.orchestra.run.smithi081.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:09.608 INFO:teuthology.orchestra.run.smithi081.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:09.608 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-06T02:47:09.608 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-06T02:47:09.608 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-06T02:47:09.608 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6804 100% (exists, up) 100% -1 2023-10-06T02:47:09.609 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.83:6801 100% (exists, up) 100% -1 2023-10-06T02:47:09.609 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.83:6809 100% (exists, up) 100% -1 2023-10-06T02:47:09.609 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.83:6825 100% (exists, up) 100% -1 2023-10-06T02:47:09.609 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.83:6817 100% (exists, up) 100% -1 2023-10-06T02:47:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-06T02:47:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-06T02:47:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:896 bytes copied, 3.7264e-05 s, 24.0 MB/s 2023-10-06T02:47:09.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-06T02:47:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.766+0000 7f2f72606700 1 Processor -- start 2023-10-06T02:47:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.766+0000 7f2f72606700 1 -- start start 2023-10-06T02:47:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.767+0000 7f2f72606700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f6c0af270 0x7f2f6c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.767+0000 7f2f72606700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c06aae0 con 0x7f2f6c0aeea0 2023-10-06T02:47:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.767+0000 7f2f72606700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c069ed0 con 0x7f2f6c0c3030 2023-10-06T02:47:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.767+0000 7f2f72606700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c06a1b0 con 0x7f2f6c0af270 2023-10-06T02:47:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.767+0000 7f2f6b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f6c0af270 0x7f2f6c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.767+0000 7f2f6bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2f6c0aeea0 0x7f2f6c0c2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38306/0 (socket says 172.21.15.81:38306) 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.767+0000 7f2f6b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f6c0af270 0x7f2f6c0c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46646/0 (socket says 172.21.15.81:46646) 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.767+0000 7f2f6bfff700 1 -- 172.21.15.81:0/2806418556 learned_addr learned my addr 172.21.15.81:0/2806418556 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f6b7fe700 1 -- 172.21.15.81:0/2806418556 >> v1:172.21.15.83:6789/0 conn(0x7f2f6c0c3030 legacy=0x7f2f6c0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f6b7fe700 1 -- 172.21.15.81:0/2806418556 >> v1:172.21.15.81:6789/0 conn(0x7f2f6c0aeea0 legacy=0x7f2f6c0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f6b7fe700 1 -- 172.21.15.81:0/2806418556 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c06a490 con 0x7f2f6c0af270 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f6affd700 1 -- 172.21.15.81:0/2806418556 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361682836 0 0) 0x7f2f6c06aae0 con 0x7f2f6c0aeea0 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f6b7fe700 1 --2- 172.21.15.81:0/2806418556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 0x7f2f6c0c7d00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000bb90 tx=0x7f2f6000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf951bc0ae72f77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f6affd700 1 -- 172.21.15.81:0/2806418556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6000dbf0 con 0x7f2f6c0af270 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f6affd700 1 -- 172.21.15.81:0/2806418556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6000dd50 con 0x7f2f6c0af270 2023-10-06T02:47:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f6affd700 1 -- 172.21.15.81:0/2806418556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f600106a0 con 0x7f2f6c0af270 2023-10-06T02:47:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f72606700 1 -- 172.21.15.81:0/2806418556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 msgr2=0x7f2f6c0c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.768+0000 7f2f72606700 1 --2- 172.21.15.81:0/2806418556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 0x7f2f6c0c7d00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000bb90 tx=0x7f2f6000b430 comp rx=0 tx=0).stop 2023-10-06T02:47:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.769+0000 7f2f72606700 1 -- 172.21.15.81:0/2806418556 shutdown_connections 2023-10-06T02:47:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.769+0000 7f2f72606700 1 --2- 172.21.15.81:0/2806418556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 0x7f2f6c0c7d00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.769+0000 7f2f72606700 1 -- 172.21.15.81:0/2806418556 >> 172.21.15.81:0/2806418556 conn(0x7f2f6c06c660 msgr2=0x7f2f6c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.769+0000 7f2f72606700 1 -- 172.21.15.81:0/2806418556 shutdown_connections 2023-10-06T02:47:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.769+0000 7f2f72606700 1 -- 172.21.15.81:0/2806418556 wait complete. 2023-10-06T02:47:09.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.770+0000 7f2f72606700 1 Processor -- start 2023-10-06T02:47:09.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.770+0000 7f2f72606700 1 -- start start 2023-10-06T02:47:09.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f72606700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f6c0aeea0 0x7f2f6c145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:09.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f72606700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 0x7f2f6c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f72606700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f6c0c3030 0x7f2f6c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f72606700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c15a680 con 0x7f2f6c0af270 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f72606700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c5070 con 0x7f2f6c0aeea0 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f72606700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c4740 con 0x7f2f6c0c3030 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 0x7f2f6c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 0x7f2f6c159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46648/0 (socket says 172.21.15.81:46648) 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6b7fe700 1 -- 172.21.15.81:0/3229960167 learned_addr learned my addr 172.21.15.81:0/3229960167 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6bfff700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f6c0aeea0 0x7f2f6c145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f70ba3700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f6c0c3030 0x7f2f6c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6b7fe700 1 -- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f6c0c3030 msgr2=0x7f2f6c0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6b7fe700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f6c0c3030 0x7f2f6c0c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6b7fe700 1 -- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f6c0aeea0 msgr2=0x7f2f6c145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6b7fe700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f6c0aeea0 0x7f2f6c145070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6b7fe700 1 -- 172.21.15.81:0/3229960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6000b6d0 con 0x7f2f6c0af270 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f6b7fe700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 0x7f2f6c159c50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000ba60 tx=0x7f2f6001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f53fff700 1 -- 172.21.15.81:0/3229960167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60018970 con 0x7f2f6c0af270 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f53fff700 1 -- 172.21.15.81:0/3229960167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f60018ad0 con 0x7f2f6c0af270 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c0c4a20 con 0x7f2f6c0af270 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f53fff700 1 -- 172.21.15.81:0/3229960167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60018e70 con 0x7f2f6c0af270 2023-10-06T02:47:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.771+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c1455b0 con 0x7f2f6c0af270 2023-10-06T02:47:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.772+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c0c51e0 con 0x7f2f6c0af270 2023-10-06T02:47:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.773+0000 7f2f53fff700 1 -- 172.21.15.81:0/3229960167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f60022600 con 0x7f2f6c0af270 2023-10-06T02:47:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.773+0000 7f2f53fff700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f58066f30 0x7f2f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.773+0000 7f2f53fff700 1 -- 172.21.15.81:0/3229960167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2f60014070 con 0x7f2f6c0af270 2023-10-06T02:47:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.773+0000 7f2f6bfff700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f58066f30 0x7f2f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.774+0000 7f2f6bfff700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f58066f30 0x7f2f580693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0011e0 tx=0x7f2f5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.777+0000 7f2f53fff700 1 -- 172.21.15.81:0/3229960167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f60053410 con 0x7f2f6c0af270 2023-10-06T02:47:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:09.970+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f2f6c06a770 con 0x7f2f6c0af270 2023-10-06T02:47:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.487+0000 7f2f53fff700 1 -- 172.21.15.81:0/3229960167 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7f2f60056a30 con 0x7f2f6c0af270 2023-10-06T02:47:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f58066f30 msgr2=0x7f2f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f58066f30 0x7f2f580693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0011e0 tx=0x7f2f5c009040 comp rx=0 tx=0).stop 2023-10-06T02:47:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 msgr2=0x7f2f6c159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 0x7f2f6c159c50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000ba60 tx=0x7f2f6001a000 comp rx=0 tx=0).stop 2023-10-06T02:47:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 shutdown_connections 2023-10-06T02:47:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f6c0c3030 0x7f2f6c0c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2f58066f30 0x7f2f580693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f6c0aeea0 0x7f2f6c145070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 --2- 172.21.15.81:0/3229960167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c0af270 0x7f2f6c159c50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 >> 172.21.15.81:0/3229960167 conn(0x7f2f6c06c660 msgr2=0x7f2f6c1552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 shutdown_connections 2023-10-06T02:47:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.489+0000 7f2f72606700 1 -- 172.21.15.81:0/3229960167 wait complete. 2023-10-06T02:47:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:pauserd,pausewr is set 2023-10-06T02:47:10.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-06T02:47:10.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.618+0000 7f9ad44e6700 1 Processor -- start 2023-10-06T02:47:10.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.618+0000 7f9ad44e6700 1 -- start start 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.619+0000 7f9ad44e6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc157fe0 0x7f9acc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.619+0000 7f9ad44e6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc0b2890 con 0x7f9acc0cf240 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.619+0000 7f9ad44e6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc0b4070 con 0x7f9acc1583b0 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.619+0000 7f9ad44e6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0b4350 con 0x7f9acc157fe0 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.619+0000 7f9ad2a83700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9acc0cf240 0x7f9acc158bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48246/0 (socket says 172.21.15.81:48246) 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.619+0000 7f9ad2a83700 1 -- 172.21.15.81:0/2376827907 learned_addr learned my addr 172.21.15.81:0/2376827907 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad2282700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc157fe0 0x7f9acc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555586058 0 0) 0x7f9acc0b2890 con 0x7f9acc0cf240 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab8003570 con 0x7f9acc0cf240 2023-10-06T02:47:10.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444871468 0 0) 0x7f9acc0b4070 con 0x7f9acc1583b0 2023-10-06T02:47:10.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9acc0b2890 con 0x7f9acc1583b0 2023-10-06T02:47:10.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4059134554 0 0) 0x7f9ab8003570 con 0x7f9acc0cf240 2023-10-06T02:47:10.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc157fe0 msgr2=0x7f9acc0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:10.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc157fe0 0x7f9acc0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:10.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 >> v1:172.21.15.83:6789/0 conn(0x7f9acc1583b0 legacy=0x7f9acc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:10.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0b4630 con 0x7f9acc0cf240 2023-10-06T02:47:10.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f9ac4001470 con 0x7f9acc0cf240 2023-10-06T02:47:10.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 >> v1:172.21.15.81:6789/0 conn(0x7f9acc0cf240 legacy=0x7f9acc158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ab8003c20 0x7f9ab8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc157fe0 0x7f9ab8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9ab80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0b4350 con 0x7f9ab8004d50 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab800bb40 con 0x7f9ab8003c20 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab800bd00 con 0x7f9acc157fe0 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad2282700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ab8003c20 0x7f9ab8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad2a83700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9ab80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad1a81700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc157fe0 0x7f9ab8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad2a83700 1 -- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc157fe0 msgr2=0x7f9ab8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad2a83700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc157fe0 0x7f9ab8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad2a83700 1 -- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ab8003c20 msgr2=0x7f9ab8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad2a83700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ab8003c20 0x7f9ab8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.620+0000 7f9ad2a83700 1 -- 172.21.15.81:0/2376827907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8003570 con 0x7f9ab8004d50 2023-10-06T02:47:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad2a83700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9ab80051c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0cf640 tx=0x7f9acc0b1d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e493d4dab8ab1342 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400cba0 con 0x7f9ab8004d50 2023-10-06T02:47:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac400cd00 con 0x7f9ab8004d50 2023-10-06T02:47:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad1280700 1 -- 172.21.15.81:0/2376827907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4005b70 con 0x7f9ab8004d50 2023-10-06T02:47:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2376827907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 msgr2=0x7f9ab80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad44e6700 1 --2- 172.21.15.81:0/2376827907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9ab80051c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0cf640 tx=0x7f9acc0b1d70 comp rx=0 tx=0).stop 2023-10-06T02:47:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad2a83700 1 -- 172.21.15.81:0/2376827907 reap_dead start 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2376827907 shutdown_connections 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2376827907 >> 172.21.15.81:0/2376827907 conn(0x7f9acc067640 msgr2=0x7f9acc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2376827907 shutdown_connections 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.621+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2376827907 wait complete. 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.622+0000 7f9ad44e6700 1 Processor -- start 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.622+0000 7f9ad44e6700 1 -- start start 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad44e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9acc152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad44e6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc0c86f0 0x7f9acc16b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad44e6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9acc0c9ff0 0x7f9acc0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad44e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc152f60 con 0x7f9ab8004d50 2023-10-06T02:47:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad44e6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0c98c0 con 0x7f9acc0c9ff0 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad44e6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0ca9a0 con 0x7f9acc0c86f0 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad2282700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9acc152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad2282700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9acc152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49392/0 (socket says 172.21.15.81:49392) 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad2282700 1 -- 172.21.15.81:0/2585710984 learned_addr learned my addr 172.21.15.81:0/2585710984 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad1a81700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc0c86f0 0x7f9acc16b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad2a83700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9acc0c9ff0 0x7f9acc0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad2282700 1 -- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc0c86f0 msgr2=0x7f9acc16b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad2282700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc0c86f0 0x7f9acc16b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad2282700 1 -- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9acc0c9ff0 msgr2=0x7f9acc0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad2282700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9acc0c9ff0 0x7f9acc0ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.623+0000 7f9ad2282700 1 -- 172.21.15.81:0/2585710984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc16bcb0 con 0x7f9ab8004d50 2023-10-06T02:47:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.624+0000 7f9ad2282700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9acc152a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8011f60 tx=0x7f9ac800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:10.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.624+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac800e040 con 0x7f9ab8004d50 2023-10-06T02:47:10.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.624+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac800f040 con 0x7f9ab8004d50 2023-10-06T02:47:10.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.624+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc0c8cb0 con 0x7f9ab8004d50 2023-10-06T02:47:10.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.624+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac800fe70 con 0x7f9ab8004d50 2023-10-06T02:47:10.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.624+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc0c9270 con 0x7f9ab8004d50 2023-10-06T02:47:10.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.625+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc069e40 con 0x7f9ab8004d50 2023-10-06T02:47:10.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.625+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ac8015640 con 0x7f9ab8004d50 2023-10-06T02:47:10.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.625+0000 7f9ac27fc700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9ab0066f30 0x7f9ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:10.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.626+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ac8085340 con 0x7f9ab8004d50 2023-10-06T02:47:10.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.626+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=36+}) v3 -- 0x7f9ab006f0f0 con 0x7f9ab8004d50 2023-10-06T02:47:10.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.626+0000 7f9ad1a81700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9ab0066f30 0x7f9ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:10.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.626+0000 7f9ad1a81700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9ab0066f30 0x7f9ab00693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0cac70 tx=0x7f9abc007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:10.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.630+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ac8055ee0 con 0x7f9ab8004d50 2023-10-06T02:47:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:10.821+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f9acc0cc6b0 con 0x7f9ab8004d50 2023-10-06T02:47:11.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.490+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(36..36 src has 1..36) v4 ==== 280+0+0 (secure 0 0 0) 0x7f9ac8056810 con 0x7f9ab8004d50 2023-10-06T02:47:11.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.490+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=37}) v3 -- 0x7f9ab006fa40 con 0x7f9ab8004d50 2023-10-06T02:47:11.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.492+0000 7f9ac27fc700 1 -- 172.21.15.81:0/2585710984 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ac8055a70 con 0x7f9ab8004d50 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9ab0066f30 msgr2=0x7f9ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9ab0066f30 0x7f9ab00693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0cac70 tx=0x7f9abc007d30 comp rx=0 tx=0).stop 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 msgr2=0x7f9acc152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9acc152a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8011f60 tx=0x7f9ac800b040 comp rx=0 tx=0).stop 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 shutdown_connections 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9ab0066f30 0x7f9ab00693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9acc0c9ff0 0x7f9acc0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ab8004d50 0x7f9acc152a20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 --2- 172.21.15.81:0/2585710984 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9acc0c86f0 0x7f9acc16b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 >> 172.21.15.81:0/2585710984 conn(0x7f9acc067640 msgr2=0x7f9acc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 shutdown_connections 2023-10-06T02:47:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.495+0000 7f9ad44e6700 1 -- 172.21.15.81:0/2585710984 wait complete. 2023-10-06T02:47:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:pauserd,pausewr is unset 2023-10-06T02:47:11.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:11.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.625+0000 7f201dd56700 1 Processor -- start 2023-10-06T02:47:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.625+0000 7f201dd56700 1 -- start start 2023-10-06T02:47:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f201dd56700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f20181578d0 0x7f20180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f201dd56700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f201806d120 0x7f201806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f201dd56700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201806dac0 con 0x7f2018157ca0 2023-10-06T02:47:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f201dd56700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20180d07c0 con 0x7f201806d120 2023-10-06T02:47:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f201dd56700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20180cfbb0 con 0x7f20181578d0 2023-10-06T02:47:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f2017fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f201806d120 0x7f201806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f2017fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f201806d120 0x7f201806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49404/0 (socket says 172.21.15.81:49404) 2023-10-06T02:47:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f2017fff700 1 -- 172.21.15.81:0/1040674437 learned_addr learned my addr 172.21.15.81:0/1040674437 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f20177fe700 1 --2- 172.21.15.81:0/1040674437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f20181578d0 0x7f20180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f2017fff700 1 -- 172.21.15.81:0/1040674437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f20181578d0 msgr2=0x7f20180cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f2017fff700 1 --2- 172.21.15.81:0/1040674437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f20181578d0 0x7f20180cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f2017fff700 1 -- 172.21.15.81:0/1040674437 >> v1:172.21.15.83:6789/0 conn(0x7f2018157ca0 legacy=0x7f201815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.626+0000 7f2017fff700 1 -- 172.21.15.81:0/1040674437 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20180cfe90 con 0x7f201806d120 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f2017fff700 1 --2- 172.21.15.81:0/1040674437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201806d120 0x7f201806d580 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f20100099b0 tx=0x7f2010009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5b0c60ddaaab9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f20167fc700 1 -- 172.21.15.81:0/1040674437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000b860 con 0x7f201806d120 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f20167fc700 1 -- 172.21.15.81:0/1040674437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201000b9c0 con 0x7f201806d120 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f20167fc700 1 -- 172.21.15.81:0/1040674437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000bd60 con 0x7f201806d120 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f201dd56700 1 -- 172.21.15.81:0/1040674437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201806d120 msgr2=0x7f201806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f201dd56700 1 --2- 172.21.15.81:0/1040674437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201806d120 0x7f201806d580 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f20100099b0 tx=0x7f2010009250 comp rx=0 tx=0).stop 2023-10-06T02:47:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f201dd56700 1 -- 172.21.15.81:0/1040674437 shutdown_connections 2023-10-06T02:47:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f201dd56700 1 --2- 172.21.15.81:0/1040674437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201806d120 0x7f201806d580 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f201dd56700 1 --2- 172.21.15.81:0/1040674437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f20181578d0 0x7f20180cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f201dd56700 1 -- 172.21.15.81:0/1040674437 >> 172.21.15.81:0/1040674437 conn(0x7f201806bb90 msgr2=0x7f201806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f201dd56700 1 -- 172.21.15.81:0/1040674437 shutdown_connections 2023-10-06T02:47:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.627+0000 7f201dd56700 1 -- 172.21.15.81:0/1040674437 wait complete. 2023-10-06T02:47:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f201dd56700 1 Processor -- start 2023-10-06T02:47:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f201dd56700 1 -- start start 2023-10-06T02:47:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f201dd56700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f201806d120 0x7f20180ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f201dd56700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20181578d0 0x7f201816a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f201dd56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2018157ca0 0x7f20180b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f201dd56700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20180b4e00 con 0x7f2018157ca0 2023-10-06T02:47:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f201dd56700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20180b5150 con 0x7f20181578d0 2023-10-06T02:47:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f201dd56700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20180b5430 con 0x7f201806d120 2023-10-06T02:47:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f2017fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2018157ca0 0x7f20180b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f20177fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f201806d120 0x7f20180ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f2017fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2018157ca0 0x7f20180b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49418/0 (socket says 172.21.15.81:49418) 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f2017fff700 1 -- 172.21.15.81:0/1628456543 learned_addr learned my addr 172.21.15.81:0/1628456543 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f20177fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f201806d120 0x7f20180ab9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:56842/0 (socket says 172.21.15.81:56842) 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.629+0000 7f2016ffd700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20181578d0 0x7f201816a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f2017fff700 1 -- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f201806d120 msgr2=0x7f20180ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f2017fff700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f201806d120 0x7f20180ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f2017fff700 1 -- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20181578d0 msgr2=0x7f201816a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f2017fff700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20181578d0 0x7f201816a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f2017fff700 1 -- 172.21.15.81:0/1628456543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20100094f0 con 0x7f2018157ca0 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f2017fff700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2018157ca0 0x7f20180b4580 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f201806fe20 tx=0x7f2010017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f1fff7fe700 1 -- 172.21.15.81:0/1628456543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000b860 con 0x7f2018157ca0 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f1fff7fe700 1 -- 172.21.15.81:0/1628456543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201001a630 con 0x7f2018157ca0 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20180b5710 con 0x7f2018157ca0 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f1fff7fe700 1 -- 172.21.15.81:0/1628456543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201001aa10 con 0x7f2018157ca0 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.630+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201816aa80 con 0x7f2018157ca0 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.631+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2018067ac0 con 0x7f2018157ca0 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.631+0000 7f1fff7fe700 1 -- 172.21.15.81:0/1628456543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f201002d440 con 0x7f2018157ca0 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.632+0000 7f1fff7fe700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2004066f30 0x7f20040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.632+0000 7f1fff7fe700 1 -- 172.21.15.81:0/1628456543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2010086130 con 0x7f2018157ca0 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.632+0000 7f20177fe700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2004066f30 0x7f20040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.632+0000 7f20177fe700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2004066f30 0x7f20040693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2008007640 tx=0x7f2008009850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.636+0000 7f1fff7fe700 1 -- 172.21.15.81:0/1628456543 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2010053240 con 0x7f2018157ca0 2023-10-06T02:47:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.820+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20180d0170 con 0x7f2018157ca0 2023-10-06T02:47:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.821+0000 7f1fff7fe700 1 -- 172.21.15.81:0/1628456543 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f2010056860 con 0x7f2018157ca0 2023-10-06T02:47:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:11.822 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:11.486392+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:57.835962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:58.768263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2004066f30 msgr2=0x7f20040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2004066f30 0x7f20040693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2008007640 tx=0x7f2008009850 comp rx=0 tx=0).stop 2023-10-06T02:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2018157ca0 msgr2=0x7f20180b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2018157ca0 0x7f20180b4580 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f201806fe20 tx=0x7f2010017000 comp rx=0 tx=0).stop 2023-10-06T02:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 shutdown_connections 2023-10-06T02:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2018157ca0 0x7f20180b4580 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f201806d120 0x7f20180ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2004066f30 0x7f20040693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 --2- 172.21.15.81:0/1628456543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f20181578d0 0x7f201816a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 >> 172.21.15.81:0/1628456543 conn(0x7f201806bb90 msgr2=0x7f2018070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 shutdown_connections 2023-10-06T02:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:11.823+0000 7f201dd56700 1 -- 172.21.15.81:0/1628456543 wait complete. 2023-10-06T02:47:11.836 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:47:11.836 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:47:11.836 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-06T02:47:11.837 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-06T02:47:11.837 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-06T02:47:11.837 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-06T02:47:11.837 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:47:12.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:12.090 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-06T02:47:12.158 INFO:teuthology.orchestra.run.smithi081.stdout:client5235 2023-10-06T02:47:12.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:12.158 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/072ce422-278f-434c-8814-5b3ff2abcdfb.client5235/osdmap') 2023-10-06T02:47:12.233 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 34 barrier 34 flags 0x588000 2023-10-06T02:47:12.233 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6804 100% (exists, up) 100% -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.83:6801 100% (exists, up) 100% -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.83:6809 100% (exists, up) 100% -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.83:6825 100% (exists, up) 100% -1 2023-10-06T02:47:12.234 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.83:6817 100% (exists, up) 100% -1 2023-10-06T02:47:12.235 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-06T02:47:12.235 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-06T02:47:12.236 INFO:teuthology.orchestra.run.smithi081.stderr:896 bytes copied, 3.7266e-05 s, 24.0 MB/s 2023-10-06T02:47:12.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.389+0000 7f6c5c28e700 1 Processor -- start 2023-10-06T02:47:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.389+0000 7f6c5c28e700 1 -- start start 2023-10-06T02:47:12.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5c28e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:12.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5c28e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c5406d120 0x7f6c5406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:12.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5c28e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5406dac0 con 0x7f6c54157ca0 2023-10-06T02:47:12.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5c28e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540d07c0 con 0x7f6c5406d120 2023-10-06T02:47:12.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5c28e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540cfbb0 con 0x7f6c541578d0 2023-10-06T02:47:12.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5a02a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:12.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5a82b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c5406d120 0x7f6c5406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:12.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5a82b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6c5406d120 0x7f6c5406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:58422/0 (socket says 172.21.15.81:58422) 2023-10-06T02:47:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5a02a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c540cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:56854/0 (socket says 172.21.15.81:56854) 2023-10-06T02:47:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5a82b700 1 -- 172.21.15.81:0/4020077609 learned_addr learned my addr 172.21.15.81:0/4020077609 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c59829700 1 --1- 172.21.15.81:0/4020077609 >> v1:172.21.15.83:6789/0 conn(0x7f6c54157ca0 0x7f6c5415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:50194/0 (socket says 172.21.15.81:50194) 2023-10-06T02:47:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5a82b700 1 -- 172.21.15.81:0/4020077609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 msgr2=0x7f6c540cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5a82b700 1 --2- 172.21.15.81:0/4020077609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c540cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.390+0000 7f6c5a82b700 1 -- 172.21.15.81:0/4020077609 >> v1:172.21.15.83:6789/0 conn(0x7f6c54157ca0 legacy=0x7f6c5415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c5a82b700 1 -- 172.21.15.81:0/4020077609 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540cfe90 con 0x7f6c5406d120 2023-10-06T02:47:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c5a02a700 1 --2- 172.21.15.81:0/4020077609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c540cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c5a82b700 1 --2- 172.21.15.81:0/4020077609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d120 0x7f6c5406d580 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009f20 tx=0x7f6c4c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98edb73dd97e1a55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c59028700 1 -- 172.21.15.81:0/4020077609 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00e070 con 0x7f6c5406d120 2023-10-06T02:47:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c59028700 1 -- 172.21.15.81:0/4020077609 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00b9d0 con 0x7f6c5406d120 2023-10-06T02:47:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c59028700 1 -- 172.21.15.81:0/4020077609 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0092e0 con 0x7f6c5406d120 2023-10-06T02:47:12.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4020077609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d120 msgr2=0x7f6c5406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:12.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c5c28e700 1 --2- 172.21.15.81:0/4020077609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d120 0x7f6c5406d580 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009f20 tx=0x7f6c4c009840 comp rx=0 tx=0).stop 2023-10-06T02:47:12.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4020077609 shutdown_connections 2023-10-06T02:47:12.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c5c28e700 1 --2- 172.21.15.81:0/4020077609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5406d120 0x7f6c5406d580 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c5c28e700 1 --2- 172.21.15.81:0/4020077609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c540cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.391+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4020077609 >> 172.21.15.81:0/4020077609 conn(0x7f6c5406bb90 msgr2=0x7f6c5406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:12.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.392+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4020077609 shutdown_connections 2023-10-06T02:47:12.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.392+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4020077609 wait complete. 2023-10-06T02:47:12.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.393+0000 7f6c5c28e700 1 Processor -- start 2023-10-06T02:47:12.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.393+0000 7f6c5c28e700 1 -- start start 2023-10-06T02:47:12.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.393+0000 7f6c5c28e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5406d120 0x7f6c5416ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.393+0000 7f6c5c28e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c54154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.393+0000 7f6c5c28e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c54157ca0 0x7f6c5416a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.393+0000 7f6c5c28e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5416ed50 con 0x7f6c5406d120 2023-10-06T02:47:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5c28e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b6740 con 0x7f6c54157ca0 2023-10-06T02:47:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5c28e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c7600 con 0x7f6c541578d0 2023-10-06T02:47:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a02a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5406d120 0x7f6c5416ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a02a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5406d120 0x7f6c5416ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49424/0 (socket says 172.21.15.81:49424) 2023-10-06T02:47:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a02a700 1 -- 172.21.15.81:0/4241414477 learned_addr learned my addr 172.21.15.81:0/4241414477 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c59829700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c54154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a82b700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c54157ca0 0x7f6c5416a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a02a700 1 -- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 msgr2=0x7f6c54154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a02a700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c54154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a02a700 1 -- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c54157ca0 msgr2=0x7f6c5416a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a02a700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c54157ca0 0x7f6c5416a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a02a700 1 -- 172.21.15.81:0/4241414477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c50009420 con 0x7f6c5406d120 2023-10-06T02:47:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5a02a700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5406d120 0x7f6c5416ddd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000ec80 tx=0x7f6c500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c4a7fc700 1 -- 172.21.15.81:0/4241414477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000c920 con 0x7f6c5406d120 2023-10-06T02:47:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c4a7fc700 1 -- 172.21.15.81:0/4241414477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5000ca80 con 0x7f6c5406d120 2023-10-06T02:47:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c009ae0 con 0x7f6c5406d120 2023-10-06T02:47:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c4a7fc700 1 -- 172.21.15.81:0/4241414477 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000ce00 con 0x7f6c5406d120 2023-10-06T02:47:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.394+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5416e790 con 0x7f6c5406d120 2023-10-06T02:47:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.395+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540ce590 con 0x7f6c5406d120 2023-10-06T02:47:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.396+0000 7f6c4a7fc700 1 -- 172.21.15.81:0/4241414477 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c50013680 con 0x7f6c5406d120 2023-10-06T02:47:12.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.396+0000 7f6c4a7fc700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c38066f30 0x7f6c380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:12.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.396+0000 7f6c4a7fc700 1 -- 172.21.15.81:0/4241414477 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6c50084d80 con 0x7f6c5406d120 2023-10-06T02:47:12.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.396+0000 7f6c59829700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c38066f30 0x7f6c380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:12.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.396+0000 7f6c59829700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c38066f30 0x7f6c380693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c5415cb70 tx=0x7f6c44000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:12.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.400+0000 7f6c4a7fc700 1 -- 172.21.15.81:0/4241414477 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c50051e90 con 0x7f6c5406d120 2023-10-06T02:47:12.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.630+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c5406a790 con 0x7f6c5406d120 2023-10-06T02:47:12.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.630+0000 7f6c4a7fc700 1 -- 172.21.15.81:0/4241414477 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f6c50017090 con 0x7f6c5406d120 2023-10-06T02:47:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:12.632 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/205039596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":205039596},{"type":"v1","addr":"172.21.15.83:6837","nonce":205039596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1667782716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1667782716},{"type":"v1","addr":"172.21.15.83:6836","nonce":1667782716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/433893952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":433893952},{"type":"v1","addr":"172.21.15.81:6834","nonce":433893952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:59.804697+0000","modified":"2023-10-06T02:47:03.458466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/4196355397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4196355397},{"type":"v1","addr":"172.21.15.81:6835","nonce":4196355397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:47:12.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c38066f30 msgr2=0x7f6c380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c38066f30 0x7f6c380693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c5415cb70 tx=0x7f6c44000bc0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5406d120 msgr2=0x7f6c5416ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5406d120 0x7f6c5416ddd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000ec80 tx=0x7f6c500091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 shutdown_connections 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c38066f30 0x7f6c380693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c54157ca0 0x7f6c5416a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5406d120 0x7f6c5416ddd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 --2- 172.21.15.81:0/4241414477 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c541578d0 0x7f6c54154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 >> 172.21.15.81:0/4241414477 conn(0x7f6c5406bb90 msgr2=0x7f6c54070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 shutdown_connections 2023-10-06T02:47:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:12.632+0000 7f6c5c28e700 1 -- 172.21.15.81:0/4241414477 wait complete. 2023-10-06T02:47:12.636 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-10-06T02:47:12.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 36 2023-10-06T02:47:12.776 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-06T02:47:12.776 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:47:12.776 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:47:12.776 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-06T02:47:12.777 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-06T02:47:12.777 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-06T02:47:12.777 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-06T02:47:12.777 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:47:13.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:13.030 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-06T02:47:13.098 INFO:teuthology.orchestra.run.smithi081.stdout:client5235 2023-10-06T02:47:13.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:13.099 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/072ce422-278f-434c-8814-5b3ff2abcdfb.client5235/osdmap') 2023-10-06T02:47:13.174 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 36 barrier 36 flags 0x588000 2023-10-06T02:47:13.175 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:13.175 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:13.175 INFO:teuthology.orchestra.run.smithi081.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:13.175 INFO:teuthology.orchestra.run.smithi081.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:13.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-06T02:47:13.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-06T02:47:13.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-06T02:47:13.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6804 100% (exists, up) 100% -1 2023-10-06T02:47:13.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.83:6801 100% (exists, up) 100% -1 2023-10-06T02:47:13.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.83:6809 100% (exists, up) 100% -1 2023-10-06T02:47:13.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.83:6825 100% (exists, up) 100% -1 2023-10-06T02:47:13.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.83:6817 100% (exists, up) 100% -1 2023-10-06T02:47:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-06T02:47:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-06T02:47:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:896 bytes copied, 3.3938e-05 s, 26.4 MB/s 2023-10-06T02:47:13.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:13.179 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-06T02:47:13.245 INFO:teuthology.orchestra.run.smithi081.stdout:client5235 2023-10-06T02:47:13.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:13.246 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/072ce422-278f-434c-8814-5b3ff2abcdfb.client5235/osdmap') 2023-10-06T02:47:13.321 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 36 barrier 36 flags 0x588000 2023-10-06T02:47:13.321 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:13.321 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:13.321 INFO:teuthology.orchestra.run.smithi081.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:13.321 INFO:teuthology.orchestra.run.smithi081.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:47:13.322 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-06T02:47:13.322 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-06T02:47:13.322 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-06T02:47:13.322 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6804 100% (exists, up) 100% -1 2023-10-06T02:47:13.322 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.83:6801 100% (exists, up) 100% -1 2023-10-06T02:47:13.322 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.83:6809 100% (exists, up) 100% -1 2023-10-06T02:47:13.322 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.83:6825 100% (exists, up) 100% -1 2023-10-06T02:47:13.322 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.83:6817 100% (exists, up) 100% -1 2023-10-06T02:47:13.323 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-06T02:47:13.323 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-06T02:47:13.323 INFO:teuthology.orchestra.run.smithi081.stderr:896 bytes copied, 4.9107e-05 s, 18.2 MB/s 2023-10-06T02:47:13.323 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:47:13.324 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:47:13.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:47:13.396 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:47:13.438 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:47:13.438 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:47:13.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:13.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:47:13.495 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:47:13.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:13.496 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:47:13.516 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:47:13.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:13.517 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:47:13.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:47:13.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:13.560 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:47:13.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:13.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.728+0000 7f10e54ef700 1 Processor -- start 2023-10-06T02:47:13.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.728+0000 7f10e54ef700 1 -- start start 2023-10-06T02:47:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10e54ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e015a2a0 0x7f10e00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10e54ef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10e00ceb30 0x7f10e00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10e54ef700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00cf4e0 con 0x7f10e006d650 2023-10-06T02:47:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10e54ef700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e006ea90 con 0x7f10e00ceb30 2023-10-06T02:47:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10e54ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00b0ca0 con 0x7f10e015a2a0 2023-10-06T02:47:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10d67fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10e00ceb30 0x7f10e00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10df7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f10e006d650 0x7f10e006da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48262/0 (socket says 172.21.15.81:48262) 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10d67fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10e00ceb30 0x7f10e00cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49434/0 (socket says 172.21.15.81:49434) 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10df7fe700 1 -- 172.21.15.81:0/17660570 learned_addr learned my addr 172.21.15.81:0/17660570 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10deffd700 1 --2- 172.21.15.81:0/17660570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e015a2a0 0x7f10e00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10d67fc700 1 -- 172.21.15.81:0/17660570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e015a2a0 msgr2=0x7f10e00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.729+0000 7f10d67fc700 1 --2- 172.21.15.81:0/17660570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e015a2a0 0x7f10e00b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10d67fc700 1 -- 172.21.15.81:0/17660570 >> v1:172.21.15.81:6789/0 conn(0x7f10e006d650 legacy=0x7f10e006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10d67fc700 1 -- 172.21.15.81:0/17660570 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00b00d0 con 0x7f10e00ceb30 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10deffd700 1 --2- 172.21.15.81:0/17660570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e015a2a0 0x7f10e00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10de7fc700 1 -- 172.21.15.81:0/17660570 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453115967 0 0) 0x7f10e00cf4e0 con 0x7f10e006d650 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10d67fc700 1 --2- 172.21.15.81:0/17660570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e00ceb30 0x7f10e00cefa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f10c80098e0 tx=0x7f10c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eabbd273f725238 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10de7fc700 1 -- 172.21.15.81:0/17660570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8009e80 con 0x7f10e00ceb30 2023-10-06T02:47:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10de7fc700 1 -- 172.21.15.81:0/17660570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c800b860 con 0x7f10e00ceb30 2023-10-06T02:47:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10de7fc700 1 -- 172.21.15.81:0/17660570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800bbe0 con 0x7f10e00ceb30 2023-10-06T02:47:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10e54ef700 1 -- 172.21.15.81:0/17660570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e00ceb30 msgr2=0x7f10e00cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10e54ef700 1 --2- 172.21.15.81:0/17660570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e00ceb30 0x7f10e00cefa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f10c80098e0 tx=0x7f10c80091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10e54ef700 1 -- 172.21.15.81:0/17660570 shutdown_connections 2023-10-06T02:47:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10e54ef700 1 --2- 172.21.15.81:0/17660570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e015a2a0 0x7f10e00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10e54ef700 1 --2- 172.21.15.81:0/17660570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e00ceb30 0x7f10e00cefa0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10e54ef700 1 -- 172.21.15.81:0/17660570 >> 172.21.15.81:0/17660570 conn(0x7f10e0067640 msgr2=0x7f10e0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10e54ef700 1 -- 172.21.15.81:0/17660570 shutdown_connections 2023-10-06T02:47:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.730+0000 7f10e54ef700 1 -- 172.21.15.81:0/17660570 wait complete. 2023-10-06T02:47:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10e54ef700 1 Processor -- start 2023-10-06T02:47:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10e54ef700 1 -- start start 2023-10-06T02:47:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10e54ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e006d650 0x7f10e016a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10e54ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e00ceb30 0x7f10e00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10e54ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e015a2a0 0x7f10e0155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10e54ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0154670 con 0x7f10e015a2a0 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10e54ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e015c810 con 0x7f10e006d650 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10e54ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e015cab0 con 0x7f10e00ceb30 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10df7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e015a2a0 0x7f10e0155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10df7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e015a2a0 0x7f10e0155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49438/0 (socket says 172.21.15.81:49438) 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.732+0000 7f10df7fe700 1 -- 172.21.15.81:0/1196700301 learned_addr learned my addr 172.21.15.81:0/1196700301 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10deffd700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e006d650 0x7f10e016a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10d67fc700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e00ceb30 0x7f10e00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10df7fe700 1 -- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e00ceb30 msgr2=0x7f10e00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10df7fe700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e00ceb30 0x7f10e00b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10df7fe700 1 -- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e006d650 msgr2=0x7f10e016a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10df7fe700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e006d650 0x7f10e016a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10df7fe700 1 -- 172.21.15.81:0/1196700301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8009420 con 0x7f10e015a2a0 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10d67fc700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e00ceb30 0x7f10e00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10deffd700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e006d650 0x7f10e016a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10df7fe700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e015a2a0 0x7f10e0155a40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f10d800cc90 tx=0x7f10d8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10d77fe700 1 -- 172.21.15.81:0/1196700301 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d800cea0 con 0x7f10e015a2a0 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10d77fe700 1 -- 172.21.15.81:0/1196700301 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d800ab70 con 0x7f10e015a2a0 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e015cd90 con 0x7f10e015a2a0 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10d77fe700 1 -- 172.21.15.81:0/1196700301 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80070f0 con 0x7f10e015a2a0 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.733+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e016aee0 con 0x7f10e015a2a0 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.734+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e015cf80 con 0x7f10e015a2a0 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.734+0000 7f10d77fe700 1 -- 172.21.15.81:0/1196700301 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10d80074a0 con 0x7f10e015a2a0 2023-10-06T02:47:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.735+0000 7f10d77fe700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10c0066f60 0x7f10c0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.735+0000 7f10d77fe700 1 -- 172.21.15.81:0/1196700301 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f10d8084b40 con 0x7f10e015a2a0 2023-10-06T02:47:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.735+0000 7f10deffd700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10c0066f60 0x7f10c0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.735+0000 7f10deffd700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10c0066f60 0x7f10c0069410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006fd0 tx=0x7f10d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.739+0000 7f10d77fe700 1 -- 172.21.15.81:0/1196700301 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10d8051c30 con 0x7f10e015a2a0 2023-10-06T02:47:13.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.962+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10e015d180 con 0x7f10e015a2a0 2023-10-06T02:47:13.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.963+0000 7f10d77fe700 1 -- 172.21.15.81:0/1196700301 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f10d8055250 con 0x7f10e015a2a0 2023-10-06T02:47:13.964 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:13.964 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/205039596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":205039596},{"type":"v1","addr":"172.21.15.83:6837","nonce":205039596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1667782716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1667782716},{"type":"v1","addr":"172.21.15.83:6836","nonce":1667782716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/433893952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":433893952},{"type":"v1","addr":"172.21.15.81:6834","nonce":433893952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:59.804697+0000","modified":"2023-10-06T02:47:03.458466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/4196355397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4196355397},{"type":"v1","addr":"172.21.15.81:6835","nonce":4196355397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:47:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10c0066f60 msgr2=0x7f10c0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10c0066f60 0x7f10c0069410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006fd0 tx=0x7f10d0008040 comp rx=0 tx=0).stop 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e015a2a0 msgr2=0x7f10e0155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e015a2a0 0x7f10e0155a40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f10d800cc90 tx=0x7f10d8001a80 comp rx=0 tx=0).stop 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 shutdown_connections 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e015a2a0 0x7f10e0155a40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10c0066f60 0x7f10c0069410 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e006d650 0x7f10e016a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 --2- 172.21.15.81:0/1196700301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e00ceb30 0x7f10e00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 >> 172.21.15.81:0/1196700301 conn(0x7f10e0067640 msgr2=0x7f10e0158140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 shutdown_connections 2023-10-06T02:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:13.965+0000 7f10e54ef700 1 -- 172.21.15.81:0/1196700301 wait complete. 2023-10-06T02:47:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-10-06T02:47:13.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.090+0000 7fad76a84700 1 Processor -- start 2023-10-06T02:47:14.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.090+0000 7fad76a84700 1 -- start start 2023-10-06T02:47:14.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad76a84700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad701578d0 0x7fad700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad76a84700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70157ca0 0x7fad7015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad76a84700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad700d07c0 con 0x7fad7006d120 2023-10-06T02:47:14.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad76a84700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad700cfbb0 con 0x7fad701578d0 2023-10-06T02:47:14.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad76a84700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad700cfe90 con 0x7fad70157ca0 2023-10-06T02:47:14.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad74820700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad701578d0 0x7fad700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad75021700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fad7006d120 0x7fad7015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48268/0 (socket says 172.21.15.81:48268) 2023-10-06T02:47:14.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad75021700 1 -- 172.21.15.81:0/3952674417 learned_addr learned my addr 172.21.15.81:0/3952674417 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:14.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad67fff700 1 --2- 172.21.15.81:0/3952674417 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70157ca0 0x7fad7015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad74820700 1 -- 172.21.15.81:0/3952674417 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70157ca0 msgr2=0x7fad7015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:14.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad74820700 1 --2- 172.21.15.81:0/3952674417 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70157ca0 0x7fad7015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad74820700 1 -- 172.21.15.81:0/3952674417 >> v1:172.21.15.81:6789/0 conn(0x7fad7006d120 legacy=0x7fad7015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad677fe700 1 -- 172.21.15.81:0/3952674417 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084312482 0 0) 0x7fad700d07c0 con 0x7fad7006d120 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad74820700 1 -- 172.21.15.81:0/3952674417 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad700d0170 con 0x7fad701578d0 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.091+0000 7fad67fff700 1 --2- 172.21.15.81:0/3952674417 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70157ca0 0x7fad7015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad74820700 1 --2- 172.21.15.81:0/3952674417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad701578d0 0x7fad700cf4f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009e60 tx=0x7fad6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f665d9ed58ac55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad677fe700 1 -- 172.21.15.81:0/3952674417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00e070 con 0x7fad701578d0 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad677fe700 1 -- 172.21.15.81:0/3952674417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c00bc30 con 0x7fad701578d0 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad677fe700 1 -- 172.21.15.81:0/3952674417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c012430 con 0x7fad701578d0 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad76a84700 1 -- 172.21.15.81:0/3952674417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad701578d0 msgr2=0x7fad700cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad76a84700 1 --2- 172.21.15.81:0/3952674417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad701578d0 0x7fad700cf4f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009e60 tx=0x7fad6c009780 comp rx=0 tx=0).stop 2023-10-06T02:47:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad76a84700 1 -- 172.21.15.81:0/3952674417 shutdown_connections 2023-10-06T02:47:14.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad76a84700 1 --2- 172.21.15.81:0/3952674417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad701578d0 0x7fad700cf4f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad76a84700 1 --2- 172.21.15.81:0/3952674417 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70157ca0 0x7fad7015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad76a84700 1 -- 172.21.15.81:0/3952674417 >> 172.21.15.81:0/3952674417 conn(0x7fad7006bb90 msgr2=0x7fad7006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:14.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad76a84700 1 -- 172.21.15.81:0/3952674417 shutdown_connections 2023-10-06T02:47:14.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.092+0000 7fad76a84700 1 -- 172.21.15.81:0/3952674417 wait complete. 2023-10-06T02:47:14.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.093+0000 7fad76a84700 1 Processor -- start 2023-10-06T02:47:14.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad76a84700 1 -- start start 2023-10-06T02:47:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad76a84700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad7006d120 0x7fad700c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad76a84700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad701578d0 0x7fad70154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad76a84700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157ca0 0x7fad7015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad76a84700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad70154a00 con 0x7fad70157ca0 2023-10-06T02:47:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad76a84700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700c6df0 con 0x7fad701578d0 2023-10-06T02:47:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad76a84700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad700b50c0 con 0x7fad7006d120 2023-10-06T02:47:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad75021700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157ca0 0x7fad7015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad75021700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157ca0 0x7fad7015eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49454/0 (socket says 172.21.15.81:49454) 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.094+0000 7fad75021700 1 -- 172.21.15.81:0/1776932872 learned_addr learned my addr 172.21.15.81:0/1776932872 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad74820700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad7006d120 0x7fad700c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad67fff700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad701578d0 0x7fad70154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad75021700 1 -- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad7006d120 msgr2=0x7fad700c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad75021700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad7006d120 0x7fad700c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad75021700 1 -- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad701578d0 msgr2=0x7fad70154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad75021700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad701578d0 0x7fad70154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad75021700 1 -- 172.21.15.81:0/1776932872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c009a20 con 0x7fad70157ca0 2023-10-06T02:47:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad74820700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad7006d120 0x7fad700c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad75021700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157ca0 0x7fad7015eef0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fad6800c7e0 tx=0x7fad68007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad64ff9700 1 -- 172.21.15.81:0/1776932872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68005c00 con 0x7fad70157ca0 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad64ff9700 1 -- 172.21.15.81:0/1776932872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad68005d60 con 0x7fad70157ca0 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad700c6b10 con 0x7fad70157ca0 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad64ff9700 1 -- 172.21.15.81:0/1776932872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68004a80 con 0x7fad70157ca0 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.095+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad700b4d50 con 0x7fad70157ca0 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.096+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad70067ac0 con 0x7fad70157ca0 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.096+0000 7fad64ff9700 1 -- 172.21.15.81:0/1776932872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad68005030 con 0x7fad70157ca0 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.097+0000 7fad64ff9700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.097+0000 7fad64ff9700 1 -- 172.21.15.81:0/1776932872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad68083b10 con 0x7fad70157ca0 2023-10-06T02:47:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.097+0000 7fad74820700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.097+0000 7fad74820700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009e60 tx=0x7fad6c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.101+0000 7fad64ff9700 1 -- 172.21.15.81:0/1776932872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad6804b5a0 con 0x7fad70157ca0 2023-10-06T02:47:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.285+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad700b5200 con 0x7fad70157ca0 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.286+0000 7fad64ff9700 1 -- 172.21.15.81:0/1776932872 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fad68050c20 con 0x7fad70157ca0 2023-10-06T02:47:14.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:11.486392+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:57.835962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:58.768263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:14.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 msgr2=0x7fad5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009e60 tx=0x7fad6c019000 comp rx=0 tx=0).stop 2023-10-06T02:47:14.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157ca0 msgr2=0x7fad7015eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157ca0 0x7fad7015eef0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fad6800c7e0 tx=0x7fad68007d90 comp rx=0 tx=0).stop 2023-10-06T02:47:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 shutdown_connections 2023-10-06T02:47:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157ca0 0x7fad7015eef0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad7006d120 0x7fad700c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 --2- 172.21.15.81:0/1776932872 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad701578d0 0x7fad70154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 >> 172.21.15.81:0/1776932872 conn(0x7fad7006bb90 msgr2=0x7fad7006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 shutdown_connections 2023-10-06T02:47:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.288+0000 7fad76a84700 1 -- 172.21.15.81:0/1776932872 wait complete. 2023-10-06T02:47:14.301 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:46:57.835962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:46:58.768263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:47:14.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:47:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.419+0000 7f59d1146700 1 Processor -- start 2023-10-06T02:47:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.419+0000 7f59d1146700 1 -- start start 2023-10-06T02:47:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59d1146700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f59cc1578d0 0x7f59cc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59d1146700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc157ca0 0x7f59cc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59d1146700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59cc06d120 0x7f59cc06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59d1146700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc06dac0 con 0x7f59cc06d120 2023-10-06T02:47:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59d1146700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc0d07c0 con 0x7f59cc1578d0 2023-10-06T02:47:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59d1146700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0cfbb0 con 0x7f59cc157ca0 2023-10-06T02:47:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59cb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59cc06d120 0x7f59cc06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59cb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59cc06d120 0x7f59cc06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49460/0 (socket says 172.21.15.81:49460) 2023-10-06T02:47:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59cb59e700 1 -- 172.21.15.81:0/3119166035 learned_addr learned my addr 172.21.15.81:0/3119166035 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59cad9d700 1 --2- 172.21.15.81:0/3119166035 >> v2:172.21.15.83:3300/0 conn(0x7f59cc1578d0 0x7f59cc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59c3fff700 1 --2- 172.21.15.81:0/3119166035 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc157ca0 0x7f59cc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59cb59e700 1 -- 172.21.15.81:0/3119166035 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc157ca0 msgr2=0x7f59cc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59cb59e700 1 --2- 172.21.15.81:0/3119166035 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc157ca0 0x7f59cc15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59cb59e700 1 -- 172.21.15.81:0/3119166035 >> v2:172.21.15.83:3300/0 conn(0x7f59cc1578d0 msgr2=0x7f59cc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:14.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.420+0000 7f59cb59e700 1 --2- 172.21.15.81:0/3119166035 >> v2:172.21.15.83:3300/0 conn(0x7f59cc1578d0 0x7f59cc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59cb59e700 1 -- 172.21.15.81:0/3119166035 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc0cfe90 con 0x7f59cc06d120 2023-10-06T02:47:14.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59cad9d700 1 --2- 172.21.15.81:0/3119166035 >> v2:172.21.15.83:3300/0 conn(0x7f59cc1578d0 0x7f59cc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:14.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59cb59e700 1 --2- 172.21.15.81:0/3119166035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc06d120 0x7f59cc06d580 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0646b0 tx=0x7f59c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f71f269a5fe1b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:14.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59ca59c700 1 -- 172.21.15.81:0/3119166035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c400e070 con 0x7f59cc06d120 2023-10-06T02:47:14.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59ca59c700 1 -- 172.21.15.81:0/3119166035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c400ba50 con 0x7f59cc06d120 2023-10-06T02:47:14.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59ca59c700 1 -- 172.21.15.81:0/3119166035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40092e0 con 0x7f59cc06d120 2023-10-06T02:47:14.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59d1146700 1 -- 172.21.15.81:0/3119166035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc06d120 msgr2=0x7f59cc06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59d1146700 1 --2- 172.21.15.81:0/3119166035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc06d120 0x7f59cc06d580 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0646b0 tx=0x7f59c4009840 comp rx=0 tx=0).stop 2023-10-06T02:47:14.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59d1146700 1 -- 172.21.15.81:0/3119166035 shutdown_connections 2023-10-06T02:47:14.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59d1146700 1 --2- 172.21.15.81:0/3119166035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc06d120 0x7f59cc06d580 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59d1146700 1 --2- 172.21.15.81:0/3119166035 >> v2:172.21.15.83:3300/0 conn(0x7f59cc1578d0 0x7f59cc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59d1146700 1 --2- 172.21.15.81:0/3119166035 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc157ca0 0x7f59cc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59d1146700 1 -- 172.21.15.81:0/3119166035 >> 172.21.15.81:0/3119166035 conn(0x7f59cc06bb90 msgr2=0x7f59cc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:14.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59d1146700 1 -- 172.21.15.81:0/3119166035 shutdown_connections 2023-10-06T02:47:14.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.421+0000 7f59d1146700 1 -- 172.21.15.81:0/3119166035 wait complete. 2023-10-06T02:47:14.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.422+0000 7f59d1146700 1 Processor -- start 2023-10-06T02:47:14.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.422+0000 7f59d1146700 1 -- start start 2023-10-06T02:47:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59d1146700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59cc06d120 0x7f59cc0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59d1146700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc1578d0 0x7f59cc16a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59d1146700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc157ca0 0x7f59cc0b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59d1146700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc154a90 con 0x7f59cc157ca0 2023-10-06T02:47:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59d1146700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0b5190 con 0x7f59cc06d120 2023-10-06T02:47:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59d1146700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0b4580 con 0x7f59cc1578d0 2023-10-06T02:47:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59cb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc157ca0 0x7f59cc0b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59cb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc157ca0 0x7f59cc0b5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49476/0 (socket says 172.21.15.81:49476) 2023-10-06T02:47:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59cb59e700 1 -- 172.21.15.81:0/1645604128 learned_addr learned my addr 172.21.15.81:0/1645604128 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59c3fff700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc1578d0 0x7f59cc16a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59cad9d700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59cc06d120 0x7f59cc0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59cb59e700 1 -- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc1578d0 msgr2=0x7f59cc16a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59cb59e700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc1578d0 0x7f59cc16a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59cb59e700 1 -- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59cc06d120 msgr2=0x7f59cc0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59cb59e700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59cc06d120 0x7f59cc0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.423+0000 7f59cb59e700 1 -- 172.21.15.81:0/1645604128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4009ae0 con 0x7f59cc157ca0 2023-10-06T02:47:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.424+0000 7f59cb59e700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc157ca0 0x7f59cc0b5620 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06fe20 tx=0x7f59c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.424+0000 7f59c2ffd700 1 -- 172.21.15.81:0/1645604128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40032f0 con 0x7f59cc157ca0 2023-10-06T02:47:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.424+0000 7f59c2ffd700 1 -- 172.21.15.81:0/1645604128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4008e40 con 0x7f59cc157ca0 2023-10-06T02:47:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.424+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc0b4860 con 0x7f59cc157ca0 2023-10-06T02:47:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.424+0000 7f59c2ffd700 1 -- 172.21.15.81:0/1645604128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40266b0 con 0x7f59cc157ca0 2023-10-06T02:47:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.424+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc0b4e20 con 0x7f59cc157ca0 2023-10-06T02:47:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.425+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59cc067ac0 con 0x7f59cc157ca0 2023-10-06T02:47:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.425+0000 7f59c2ffd700 1 -- 172.21.15.81:0/1645604128 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59c4003040 con 0x7f59cc157ca0 2023-10-06T02:47:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.425+0000 7f59c2ffd700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59ac066f30 0x7f59ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.426+0000 7f59c2ffd700 1 -- 172.21.15.81:0/1645604128 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f59c4086640 con 0x7f59cc157ca0 2023-10-06T02:47:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.426+0000 7f59cad9d700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59ac066f30 0x7f59ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.426+0000 7f59cad9d700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59ac066f30 0x7f59ac0693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f59bc006f00 tx=0x7f59bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.430+0000 7f59c2ffd700 1 -- 172.21.15.81:0/1645604128 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59c4053750 con 0x7f59cc157ca0 2023-10-06T02:47:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.616+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59cc0d0170 con 0x7f59cc157ca0 2023-10-06T02:47:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.616+0000 7f59c2ffd700 1 -- 172.21.15.81:0/1645604128 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59c4056d70 con 0x7f59cc157ca0 2023-10-06T02:47:14.618 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59ac066f30 msgr2=0x7f59ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59ac066f30 0x7f59ac0693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f59bc006f00 tx=0x7f59bc008040 comp rx=0 tx=0).stop 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc157ca0 msgr2=0x7f59cc0b5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc157ca0 0x7f59cc0b5620 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06fe20 tx=0x7f59c4018000 comp rx=0 tx=0).stop 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 shutdown_connections 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc157ca0 0x7f59cc0b5620 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f59ac066f30 0x7f59ac0693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59cc06d120 0x7f59cc0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 --2- 172.21.15.81:0/1645604128 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f59cc1578d0 0x7f59cc16a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 >> 172.21.15.81:0/1645604128 conn(0x7f59cc06bb90 msgr2=0x7f59cc1568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 shutdown_connections 2023-10-06T02:47:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.618+0000 7f59d1146700 1 -- 172.21.15.81:0/1645604128 wait complete. 2023-10-06T02:47:14.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:47:14.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.746+0000 7f7e90055700 1 Processor -- start 2023-10-06T02:47:14.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.746+0000 7f7e90055700 1 -- start start 2023-10-06T02:47:14.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.747+0000 7f7e90055700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881578d0 0x7f7e880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.747+0000 7f7e90055700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7e88157ca0 0x7f7e8815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.747+0000 7f7e90055700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e880d07c0 con 0x7f7e8806d120 2023-10-06T02:47:14.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.747+0000 7f7e90055700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e880cfbb0 con 0x7f7e88157ca0 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.747+0000 7f7e90055700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880cfe90 con 0x7f7e881578d0 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8ddf1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881578d0 0x7f7e880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8d5f0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7e88157ca0 0x7f7e8815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8d5f0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7e88157ca0 0x7f7e8815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:58480/0 (socket says 172.21.15.81:58480) 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8e5f2700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7e8806d120 0x7f7e8815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:50200/0 (socket says 172.21.15.81:50200) 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8ddf1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881578d0 0x7f7e880cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:56942/0 (socket says 172.21.15.81:56942) 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8d5f0700 1 -- 172.21.15.81:0/2939847729 learned_addr learned my addr 172.21.15.81:0/2939847729 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8ddf1700 1 -- 172.21.15.81:0/2939847729 >> v2:172.21.15.83:3300/0 conn(0x7f7e88157ca0 msgr2=0x7f7e8815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8ddf1700 1 --2- 172.21.15.81:0/2939847729 >> v2:172.21.15.83:3300/0 conn(0x7f7e88157ca0 0x7f7e8815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8ddf1700 1 -- 172.21.15.81:0/2939847729 >> v1:172.21.15.83:6789/0 conn(0x7f7e8806d120 legacy=0x7f7e8815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8ddf1700 1 -- 172.21.15.81:0/2939847729 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880d0170 con 0x7f7e881578d0 2023-10-06T02:47:14.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8d5f0700 1 --2- 172.21.15.81:0/2939847729 >> v2:172.21.15.83:3300/0 conn(0x7f7e88157ca0 0x7f7e8815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:14.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8ddf1700 1 --2- 172.21.15.81:0/2939847729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881578d0 0x7f7e880cf4f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e840098e0 tx=0x7f7e840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d43811ba0961cc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:14.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8cdef700 1 -- 172.21.15.81:0/2939847729 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400b640 con 0x7f7e881578d0 2023-10-06T02:47:14.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8cdef700 1 -- 172.21.15.81:0/2939847729 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8400b7a0 con 0x7f7e881578d0 2023-10-06T02:47:14.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.748+0000 7f7e8cdef700 1 -- 172.21.15.81:0/2939847729 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400bb40 con 0x7f7e881578d0 2023-10-06T02:47:14.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.749+0000 7f7e90055700 1 -- 172.21.15.81:0/2939847729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881578d0 msgr2=0x7f7e880cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.749+0000 7f7e90055700 1 --2- 172.21.15.81:0/2939847729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881578d0 0x7f7e880cf4f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e840098e0 tx=0x7f7e840091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.749+0000 7f7e90055700 1 -- 172.21.15.81:0/2939847729 shutdown_connections 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.749+0000 7f7e90055700 1 --2- 172.21.15.81:0/2939847729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881578d0 0x7f7e880cf4f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.749+0000 7f7e90055700 1 --2- 172.21.15.81:0/2939847729 >> v2:172.21.15.83:3300/0 conn(0x7f7e88157ca0 0x7f7e8815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.749+0000 7f7e90055700 1 -- 172.21.15.81:0/2939847729 >> 172.21.15.81:0/2939847729 conn(0x7f7e8806bb90 msgr2=0x7f7e8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.749+0000 7f7e90055700 1 -- 172.21.15.81:0/2939847729 shutdown_connections 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.749+0000 7f7e90055700 1 -- 172.21.15.81:0/2939847729 wait complete. 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.750+0000 7f7e90055700 1 Processor -- start 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.750+0000 7f7e90055700 1 -- start start 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e90055700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e8806d120 0x7f7e88155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e90055700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e881578d0 0x7f7e880c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e90055700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88157ca0 0x7f7e880c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e90055700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c6ba0 con 0x7f7e88157ca0 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e90055700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c65e0 con 0x7f7e881578d0 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e90055700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c68c0 con 0x7f7e8806d120 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8e5f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88157ca0 0x7f7e880c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8e5f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88157ca0 0x7f7e880c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49480/0 (socket says 172.21.15.81:49480) 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8e5f2700 1 -- 172.21.15.81:0/1926093593 learned_addr learned my addr 172.21.15.81:0/1926093593 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8ddf1700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e8806d120 0x7f7e88155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8d5f0700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e881578d0 0x7f7e880c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8e5f2700 1 -- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e8806d120 msgr2=0x7f7e88155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8e5f2700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e8806d120 0x7f7e88155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8e5f2700 1 -- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e881578d0 msgr2=0x7f7e880c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8e5f2700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e881578d0 0x7f7e880c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.751+0000 7f7e8e5f2700 1 -- 172.21.15.81:0/1926093593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780094f0 con 0x7f7e88157ca0 2023-10-06T02:47:14.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.752+0000 7f7e8e5f2700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88157ca0 0x7f7e880c84a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000cd00 tx=0x7f7e80001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:14.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.752+0000 7f7e7dffb700 1 -- 172.21.15.81:0/1926093593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000ce60 con 0x7f7e88157ca0 2023-10-06T02:47:14.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.752+0000 7f7e7dffb700 1 -- 172.21.15.81:0/1926093593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80005df0 con 0x7f7e88157ca0 2023-10-06T02:47:14.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.752+0000 7f7e7dffb700 1 -- 172.21.15.81:0/1926093593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000ab00 con 0x7f7e88157ca0 2023-10-06T02:47:14.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.752+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e84009420 con 0x7f7e88157ca0 2023-10-06T02:47:14.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.752+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e880c7f80 con 0x7f7e88157ca0 2023-10-06T02:47:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.753+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e880c81a0 con 0x7f7e88157ca0 2023-10-06T02:47:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.753+0000 7f7e7dffb700 1 -- 172.21.15.81:0/1926093593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e800070f0 con 0x7f7e88157ca0 2023-10-06T02:47:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.754+0000 7f7e7dffb700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e6c066f30 0x7f7e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.754+0000 7f7e7dffb700 1 -- 172.21.15.81:0/1926093593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7e80084710 con 0x7f7e88157ca0 2023-10-06T02:47:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.754+0000 7f7e8ddf1700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e6c066f30 0x7f7e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.754+0000 7f7e8ddf1700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e6c066f30 0x7f7e6c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e840093f0 tx=0x7f7e84017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.758+0000 7f7e7dffb700 1 -- 172.21.15.81:0/1926093593 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e80051820 con 0x7f7e88157ca0 2023-10-06T02:47:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.939+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e880d0450 con 0x7f7e88157ca0 2023-10-06T02:47:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.939+0000 7f7e7dffb700 1 -- 172.21.15.81:0/1926093593 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e80054e40 con 0x7f7e88157ca0 2023-10-06T02:47:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:47:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e6c066f30 msgr2=0x7f7e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e6c066f30 0x7f7e6c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e840093f0 tx=0x7f7e84017000 comp rx=0 tx=0).stop 2023-10-06T02:47:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88157ca0 msgr2=0x7f7e880c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88157ca0 0x7f7e880c84a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000cd00 tx=0x7f7e80001b10 comp rx=0 tx=0).stop 2023-10-06T02:47:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 shutdown_connections 2023-10-06T02:47:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88157ca0 0x7f7e880c84a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e8806d120 0x7f7e88155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e6c066f30 0x7f7e6c0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 --2- 172.21.15.81:0/1926093593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e881578d0 0x7f7e880c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 >> 172.21.15.81:0/1926093593 conn(0x7f7e8806bb90 msgr2=0x7f7e8806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:14.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 shutdown_connections 2023-10-06T02:47:14.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:14.942+0000 7f7e90055700 1 -- 172.21.15.81:0/1926093593 wait complete. 2023-10-06T02:47:14.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:47:15.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.071+0000 7efd3330f700 1 Processor -- start 2023-10-06T02:47:15.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.071+0000 7efd3330f700 1 -- start start 2023-10-06T02:47:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd3330f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd2c0b3bd0 0x7efd2c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd3330f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efd2c1583b0 0x7efd2c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd3330f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2c0b2890 con 0x7efd2c157fe0 2023-10-06T02:47:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd3330f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c0b4070 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd3330f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c0b4350 con 0x7efd2c1583b0 2023-10-06T02:47:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd310ab700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efd2c157fe0 0x7efd2c0b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48274/0 (socket says 172.21.15.81:48274) 2023-10-06T02:47:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd308aa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd2c0b3bd0 0x7efd2c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd310ab700 1 -- 172.21.15.81:0/3413391686 learned_addr learned my addr 172.21.15.81:0/3413391686 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd318ac700 1 --2- 172.21.15.81:0/3413391686 >> v2:172.21.15.83:3300/0 conn(0x7efd2c1583b0 0x7efd2c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd308aa700 1 -- 172.21.15.81:0/3413391686 >> v2:172.21.15.83:3300/0 conn(0x7efd2c1583b0 msgr2=0x7efd2c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd308aa700 1 --2- 172.21.15.81:0/3413391686 >> v2:172.21.15.83:3300/0 conn(0x7efd2c1583b0 0x7efd2c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd308aa700 1 -- 172.21.15.81:0/3413391686 >> v1:172.21.15.81:6789/0 conn(0x7efd2c157fe0 legacy=0x7efd2c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd2bfff700 1 -- 172.21.15.81:0/3413391686 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758157671 0 0) 0x7efd2c0b2890 con 0x7efd2c157fe0 2023-10-06T02:47:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd308aa700 1 -- 172.21.15.81:0/3413391686 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c0b4630 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd318ac700 1 --2- 172.21.15.81:0/3413391686 >> v2:172.21.15.83:3300/0 conn(0x7efd2c1583b0 0x7efd2c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd308aa700 1 --2- 172.21.15.81:0/3413391686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 0x7efd2c0ceb30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0cc640 tx=0x7efd20009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b63e1bdc780b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.072+0000 7efd2bfff700 1 -- 172.21.15.81:0/3413391686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2000e070 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd2bfff700 1 -- 172.21.15.81:0/3413391686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2000bc30 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd2bfff700 1 -- 172.21.15.81:0/3413391686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20012430 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd3330f700 1 -- 172.21.15.81:0/3413391686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 msgr2=0x7efd2c0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd3330f700 1 --2- 172.21.15.81:0/3413391686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 0x7efd2c0ceb30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0cc640 tx=0x7efd20009780 comp rx=0 tx=0).stop 2023-10-06T02:47:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd3330f700 1 -- 172.21.15.81:0/3413391686 shutdown_connections 2023-10-06T02:47:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd3330f700 1 --2- 172.21.15.81:0/3413391686 >> v2:172.21.15.83:3300/0 conn(0x7efd2c1583b0 0x7efd2c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd3330f700 1 --2- 172.21.15.81:0/3413391686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 0x7efd2c0ceb30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd3330f700 1 -- 172.21.15.81:0/3413391686 >> 172.21.15.81:0/3413391686 conn(0x7efd2c067640 msgr2=0x7efd2c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:15.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd3330f700 1 -- 172.21.15.81:0/3413391686 shutdown_connections 2023-10-06T02:47:15.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.073+0000 7efd3330f700 1 -- 172.21.15.81:0/3413391686 wait complete. 2023-10-06T02:47:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.074+0000 7efd3330f700 1 Processor -- start 2023-10-06T02:47:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.074+0000 7efd3330f700 1 -- start start 2023-10-06T02:47:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.075+0000 7efd3330f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 0x7efd2c140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.075+0000 7efd3330f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd2c157fe0 0x7efd2c06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.075+0000 7efd3330f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd2c1583b0 0x7efd2c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.075+0000 7efd3330f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c06e400 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.075+0000 7efd3330f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c140fd0 con 0x7efd2c157fe0 2023-10-06T02:47:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.075+0000 7efd3330f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c151bf0 con 0x7efd2c1583b0 2023-10-06T02:47:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.075+0000 7efd310ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 0x7efd2c140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.075+0000 7efd310ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 0x7efd2c140a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49496/0 (socket says 172.21.15.81:49496) 2023-10-06T02:47:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.075+0000 7efd310ab700 1 -- 172.21.15.81:0/1311283208 learned_addr learned my addr 172.21.15.81:0/1311283208 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd308aa700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd2c157fe0 0x7efd2c06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd318ac700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd2c1583b0 0x7efd2c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd310ab700 1 -- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd2c1583b0 msgr2=0x7efd2c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd310ab700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd2c1583b0 0x7efd2c06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd310ab700 1 -- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd2c157fe0 msgr2=0x7efd2c06cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd310ab700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd2c157fe0 0x7efd2c06cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd310ab700 1 -- 172.21.15.81:0/1311283208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd20009a20 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd308aa700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd2c157fe0 0x7efd2c06cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd318ac700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd2c1583b0 0x7efd2c06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd310ab700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 0x7efd2c140a90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd2400c7e0 tx=0x7efd24007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd297fa700 1 -- 172.21.15.81:0/1311283208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24005b30 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd297fa700 1 -- 172.21.15.81:0/1311283208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24005c90 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd297fa700 1 -- 172.21.15.81:0/1311283208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24007300 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c06d7f0 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.076+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c06ddb0 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.077+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c069e40 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.077+0000 7efd297fa700 1 -- 172.21.15.81:0/1311283208 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd2401b400 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.078+0000 7efd297fa700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd18066f30 0x7efd180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.078+0000 7efd297fa700 1 -- 172.21.15.81:0/1311283208 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efd24084210 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.078+0000 7efd308aa700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd18066f30 0x7efd180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.078+0000 7efd308aa700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd18066f30 0x7efd180693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0cc640 tx=0x7efd20019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:15.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.082+0000 7efd297fa700 1 -- 172.21.15.81:0/1311283208 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd240513a0 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.263+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd2c0cc6b0 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.263+0000 7efd297fa700 1 -- 172.21.15.81:0/1311283208 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd240549c0 con 0x7efd2c0b3bd0 2023-10-06T02:47:15.265 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:47:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd18066f30 msgr2=0x7efd180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd18066f30 0x7efd180693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0cc640 tx=0x7efd20019000 comp rx=0 tx=0).stop 2023-10-06T02:47:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 msgr2=0x7efd2c140a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 0x7efd2c140a90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd2400c7e0 tx=0x7efd24007df0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 shutdown_connections 2023-10-06T02:47:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd2c1583b0 0x7efd2c06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd2c0b3bd0 0x7efd2c140a90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efd18066f30 0x7efd180693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 --2- 172.21.15.81:0/1311283208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd2c157fe0 0x7efd2c06cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 >> 172.21.15.81:0/1311283208 conn(0x7efd2c067640 msgr2=0x7efd2c1534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 shutdown_connections 2023-10-06T02:47:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.266+0000 7efd3330f700 1 -- 172.21.15.81:0/1311283208 wait complete. 2023-10-06T02:47:15.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:47:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.394+0000 7ff6c7a28700 1 Processor -- start 2023-10-06T02:47:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.394+0000 7ff6c7a28700 1 -- start start 2023-10-06T02:47:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.394+0000 7ff6c7a28700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6c0157ca0 0x7ff6c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c7a28700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c00d07c0 con 0x7ff6c01578d0 2023-10-06T02:47:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c7a28700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c00cfbb0 con 0x7ff6c006d120 2023-10-06T02:47:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c7a28700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c00cfe90 con 0x7ff6c0157ca0 2023-10-06T02:47:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c4fc3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6c0157ca0 0x7ff6c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c57c4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff6c01578d0 0x7ff6c015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48290/0 (socket says 172.21.15.81:48290) 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c57c4700 1 -- 172.21.15.81:0/1575836866 learned_addr learned my addr 172.21.15.81:0/1575836866 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c4fc3700 1 -- 172.21.15.81:0/1575836866 >> v1:172.21.15.83:6789/0 conn(0x7ff6c006d120 legacy=0x7ff6c006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c4fc3700 1 -- 172.21.15.81:0/1575836866 >> v1:172.21.15.81:6789/0 conn(0x7ff6c01578d0 legacy=0x7ff6c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c4fc3700 1 -- 172.21.15.81:0/1575836866 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c00d0170 con 0x7ff6c0157ca0 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6b7fff700 1 -- 172.21.15.81:0/1575836866 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569761823 0 0) 0x7ff6c00d07c0 con 0x7ff6c01578d0 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6c4fc3700 1 --2- 172.21.15.81:0/1575836866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0157ca0 0x7ff6c00cf4f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00098e0 tx=0x7ff6b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765e9b2aa0c15b72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6b7fff700 1 -- 172.21.15.81:0/1575836866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0009e80 con 0x7ff6c0157ca0 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6b7fff700 1 -- 172.21.15.81:0/1575836866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b000b860 con 0x7ff6c0157ca0 2023-10-06T02:47:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.395+0000 7ff6b7fff700 1 -- 172.21.15.81:0/1575836866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b000bbe0 con 0x7ff6c0157ca0 2023-10-06T02:47:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.396+0000 7ff6c7a28700 1 -- 172.21.15.81:0/1575836866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0157ca0 msgr2=0x7ff6c00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.396+0000 7ff6c7a28700 1 --2- 172.21.15.81:0/1575836866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0157ca0 0x7ff6c00cf4f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00098e0 tx=0x7ff6b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.396+0000 7ff6c7a28700 1 -- 172.21.15.81:0/1575836866 shutdown_connections 2023-10-06T02:47:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.396+0000 7ff6c7a28700 1 --2- 172.21.15.81:0/1575836866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0157ca0 0x7ff6c00cf4f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.396+0000 7ff6c7a28700 1 -- 172.21.15.81:0/1575836866 >> 172.21.15.81:0/1575836866 conn(0x7ff6c006bb90 msgr2=0x7ff6c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.396+0000 7ff6c7a28700 1 -- 172.21.15.81:0/1575836866 shutdown_connections 2023-10-06T02:47:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.396+0000 7ff6c7a28700 1 -- 172.21.15.81:0/1575836866 wait complete. 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.397+0000 7ff6c7a28700 1 Processor -- start 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.397+0000 7ff6c7a28700 1 -- start start 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c7a28700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c006d120 0x7ff6c00af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c7a28700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6c01578d0 0x7ff6c016dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c7a28700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6c0157ca0 0x7ff6c016e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c7a28700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01450d0 con 0x7ff6c006d120 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c7a28700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00b2220 con 0x7ff6c01578d0 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c7a28700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00b2500 con 0x7ff6c0157ca0 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c57c4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c006d120 0x7ff6c00af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c57c4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c006d120 0x7ff6c00af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49520/0 (socket says 172.21.15.81:49520) 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c57c4700 1 -- 172.21.15.81:0/3326630107 learned_addr learned my addr 172.21.15.81:0/3326630107 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:15.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c57c4700 1 -- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6c0157ca0 msgr2=0x7ff6c016e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c57c4700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6c0157ca0 0x7ff6c016e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c57c4700 1 -- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6c01578d0 msgr2=0x7ff6c016dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c4fc3700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6c01578d0 0x7ff6c016dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c57c4700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6c01578d0 0x7ff6c016dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c57c4700 1 -- 172.21.15.81:0/3326630107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0009420 con 0x7ff6c006d120 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c4fc3700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6c01578d0 0x7ff6c016dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6c57c4700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c006d120 0x7ff6c00af080 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00c810 tx=0x7ff6bc007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6b57fa700 1 -- 172.21.15.81:0/3326630107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc005c00 con 0x7ff6c006d120 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.398+0000 7ff6b57fa700 1 -- 172.21.15.81:0/3326630107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc005d60 con 0x7ff6c006d120 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.399+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c016b900 con 0x7ff6c006d120 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.399+0000 7ff6b57fa700 1 -- 172.21.15.81:0/3326630107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc007340 con 0x7ff6c006d120 2023-10-06T02:47:15.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.399+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c00b14f0 con 0x7ff6c006d120 2023-10-06T02:47:15.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.399+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c016be20 con 0x7ff6c006d120 2023-10-06T02:47:15.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.400+0000 7ff6b57fa700 1 -- 172.21.15.81:0/3326630107 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6bc01b400 con 0x7ff6c006d120 2023-10-06T02:47:15.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.400+0000 7ff6b57fa700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6a4066f30 0x7ff6a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.400+0000 7ff6b57fa700 1 -- 172.21.15.81:0/3326630107 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6bc084170 con 0x7ff6c006d120 2023-10-06T02:47:15.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.401+0000 7ff6c4fc3700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6a4066f30 0x7ff6a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.401+0000 7ff6c4fc3700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6a4066f30 0x7ff6a40693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff6c01580c0 tx=0x7ff6b0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:15.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.405+0000 7ff6b57fa700 1 -- 172.21.15.81:0/3326630107 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6c016be20 con 0x7ff6c006d120 2023-10-06T02:47:15.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.587+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6c016be20 con 0x7ff6c006d120 2023-10-06T02:47:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.588+0000 7ff6b57fa700 1 -- 172.21.15.81:0/3326630107 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6bc051300 con 0x7ff6c006d120 2023-10-06T02:47:15.589 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:47:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6a4066f30 msgr2=0x7ff6a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6a4066f30 0x7ff6a40693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff6c01580c0 tx=0x7ff6b0017000 comp rx=0 tx=0).stop 2023-10-06T02:47:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c006d120 msgr2=0x7ff6c00af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c006d120 0x7ff6c00af080 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00c810 tx=0x7ff6bc007d90 comp rx=0 tx=0).stop 2023-10-06T02:47:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 shutdown_connections 2023-10-06T02:47:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6c0157ca0 0x7ff6c016e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c006d120 0x7ff6c00af080 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff6a4066f30 0x7ff6a40693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 --2- 172.21.15.81:0/3326630107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6c01578d0 0x7ff6c016dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 >> 172.21.15.81:0/3326630107 conn(0x7ff6c006bb90 msgr2=0x7ff6c006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:15.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 shutdown_connections 2023-10-06T02:47:15.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.590+0000 7ff6c7a28700 1 -- 172.21.15.81:0/3326630107 wait complete. 2023-10-06T02:47:15.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.716+0000 7f9922f60700 1 Processor -- start 2023-10-06T02:47:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.716+0000 7f9922f60700 1 -- start start 2023-10-06T02:47:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f9922f60700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 0x7f991c0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f9922f60700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f991c06e940 0x7f991c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f9922f60700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0b2290 con 0x7f991c156db0 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f9922f60700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c157c00 con 0x7f991c06e940 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f9922f60700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1572d0 con 0x7f991c1569e0 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f99214fd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f991c06e940 0x7f991c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f99214fd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f991c06e940 0x7f991c0cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49534/0 (socket says 172.21.15.81:49534) 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f99214fd700 1 -- 172.21.15.81:0/1618203382 learned_addr learned my addr 172.21.15.81:0/1618203382 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f9920cfc700 1 --2- 172.21.15.81:0/1618203382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 0x7f991c0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f99214fd700 1 -- 172.21.15.81:0/1618203382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 msgr2=0x7f991c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f99214fd700 1 --2- 172.21.15.81:0/1618203382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 0x7f991c0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f99214fd700 1 -- 172.21.15.81:0/1618203382 >> v1:172.21.15.83:6789/0 conn(0x7f991c156db0 legacy=0x7f991c06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f99214fd700 1 -- 172.21.15.81:0/1618203382 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c1575b0 con 0x7f991c06e940 2023-10-06T02:47:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.717+0000 7f99214fd700 1 --2- 172.21.15.81:0/1618203382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c06e940 0x7f991c0cd920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9914009f20 tx=0x7f9914009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58a025a191c8a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f991b7fe700 1 -- 172.21.15.81:0/1618203382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400e070 con 0x7f991c06e940 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f991b7fe700 1 -- 172.21.15.81:0/1618203382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991400b9d0 con 0x7f991c06e940 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f991b7fe700 1 -- 172.21.15.81:0/1618203382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99140092e0 con 0x7f991c06e940 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f9922f60700 1 -- 172.21.15.81:0/1618203382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c06e940 msgr2=0x7f991c0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f9922f60700 1 --2- 172.21.15.81:0/1618203382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c06e940 0x7f991c0cd920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9914009f20 tx=0x7f9914009840 comp rx=0 tx=0).stop 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f9922f60700 1 -- 172.21.15.81:0/1618203382 shutdown_connections 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f9922f60700 1 --2- 172.21.15.81:0/1618203382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c06e940 0x7f991c0cd920 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f9922f60700 1 --2- 172.21.15.81:0/1618203382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 0x7f991c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f9922f60700 1 -- 172.21.15.81:0/1618203382 >> 172.21.15.81:0/1618203382 conn(0x7f991c06cca0 msgr2=0x7f991c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f9922f60700 1 -- 172.21.15.81:0/1618203382 shutdown_connections 2023-10-06T02:47:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.718+0000 7f9922f60700 1 -- 172.21.15.81:0/1618203382 wait complete. 2023-10-06T02:47:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.719+0000 7f9922f60700 1 Processor -- start 2023-10-06T02:47:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.719+0000 7f9922f60700 1 -- start start 2023-10-06T02:47:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f9922f60700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f991c06e940 0x7f991c158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f9922f60700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 0x7f991c150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f9922f60700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c156db0 0x7f991c166b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f9922f60700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1507b0 con 0x7f991c156db0 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f9922f60700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0aef30 con 0x7f991c06e940 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f9922f60700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c167080 con 0x7f991c1569e0 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f99214fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c156db0 0x7f991c166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f99214fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c156db0 0x7f991c166b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49538/0 (socket says 172.21.15.81:49538) 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f99214fd700 1 -- 172.21.15.81:0/153538193 learned_addr learned my addr 172.21.15.81:0/153538193 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f9920cfc700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f991c06e940 0x7f991c158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.720+0000 7f991bfff700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 0x7f991c150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f99214fd700 1 -- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 msgr2=0x7f991c150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f99214fd700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 0x7f991c150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f99214fd700 1 -- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f991c06e940 msgr2=0x7f991c158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f99214fd700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f991c06e940 0x7f991c158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f99214fd700 1 -- 172.21.15.81:0/153538193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914009ae0 con 0x7f991c156db0 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f99214fd700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c156db0 0x7f991c166b40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f991c071450 tx=0x7f9914018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f9918ff9700 1 -- 172.21.15.81:0/153538193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914008ad0 con 0x7f991c156db0 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f9918ff9700 1 -- 172.21.15.81:0/153538193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9914008c30 con 0x7f991c156db0 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f9918ff9700 1 -- 172.21.15.81:0/153538193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914026460 con 0x7f991c156db0 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c150b30 con 0x7f991c156db0 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.721+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c159100 con 0x7f991c156db0 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.722+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c068900 con 0x7f991c156db0 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.722+0000 7f9918ff9700 1 -- 172.21.15.81:0/153538193 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9914003040 con 0x7f991c156db0 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.723+0000 7f9918ff9700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.723+0000 7f9918ff9700 1 -- 172.21.15.81:0/153538193 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9914086440 con 0x7f991c156db0 2023-10-06T02:47:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.723+0000 7f9920cfc700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.723+0000 7f9920cfc700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9900066f30 0x7f99000693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9910009db0 tx=0x7f99100091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.727+0000 7f9918ff9700 1 -- 172.21.15.81:0/153538193 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9914053550 con 0x7f991c156db0 2023-10-06T02:47:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.950+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f991c157890 con 0x7f991c156db0 2023-10-06T02:47:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.951+0000 7f9918ff9700 1 -- 172.21.15.81:0/153538193 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f9914056b70 con 0x7f991c156db0 2023-10-06T02:47:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:15.954 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/205039596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":205039596},{"type":"v1","addr":"172.21.15.83:6837","nonce":205039596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1667782716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1667782716},{"type":"v1","addr":"172.21.15.83:6836","nonce":1667782716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/433893952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":433893952},{"type":"v1","addr":"172.21.15.81:6834","nonce":433893952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:59.804697+0000","modified":"2023-10-06T02:47:03.458466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/4196355397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4196355397},{"type":"v1","addr":"172.21.15.81:6835","nonce":4196355397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:47:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9900066f30 msgr2=0x7f99000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9900066f30 0x7f99000693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9910009db0 tx=0x7f99100091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c156db0 msgr2=0x7f991c166b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c156db0 0x7f991c166b40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f991c071450 tx=0x7f9914018000 comp rx=0 tx=0).stop 2023-10-06T02:47:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 shutdown_connections 2023-10-06T02:47:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991c156db0 0x7f991c166b40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f991c06e940 0x7f991c158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 --2- 172.21.15.81:0/153538193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f991c1569e0 0x7f991c150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 >> 172.21.15.81:0/153538193 conn(0x7f991c06cca0 msgr2=0x7f991c152510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:15.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 shutdown_connections 2023-10-06T02:47:15.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:15.953+0000 7f9922f60700 1 -- 172.21.15.81:0/153538193 wait complete. 2023-10-06T02:47:15.957 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-10-06T02:47:15.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:16.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.080+0000 7f2646a22700 1 Processor -- start 2023-10-06T02:47:16.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.080+0000 7f2646a22700 1 -- start start 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.081+0000 7f2646a22700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2640157ca0 0x7f26400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.081+0000 7f2646a22700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26400d07c0 con 0x7f264006d120 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.081+0000 7f2646a22700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26400cfbb0 con 0x7f26401578d0 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.081+0000 7f2646a22700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26400cfe90 con 0x7f2640157ca0 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.081+0000 7f2644fbf700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f264006d120 0x7f264006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48300/0 (socket says 172.21.15.81:48300) 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.081+0000 7f2644fbf700 1 -- 172.21.15.81:0/2760148179 learned_addr learned my addr 172.21.15.81:0/2760148179 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.081+0000 7f263f7fe700 1 --2- 172.21.15.81:0/2760148179 >> v2:172.21.15.83:3300/0 conn(0x7f2640157ca0 0x7f26400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.081+0000 7f263effd700 1 -- 172.21.15.81:0/2760148179 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061460905 0 0) 0x7f26400d07c0 con 0x7f264006d120 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f263effd700 1 -- 172.21.15.81:0/2760148179 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2628003570 con 0x7f264006d120 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f263f7fe700 1 -- 172.21.15.81:0/2760148179 >> v1:172.21.15.83:6789/0 conn(0x7f26401578d0 legacy=0x7f264015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f263f7fe700 1 -- 172.21.15.81:0/2760148179 >> v1:172.21.15.81:6789/0 conn(0x7f264006d120 legacy=0x7f264006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f263f7fe700 1 -- 172.21.15.81:0/2760148179 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400d0170 con 0x7f2640157ca0 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f263f7fe700 1 --2- 172.21.15.81:0/2760148179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2640157ca0 0x7f26400cf4f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f26340098e0 tx=0x7f26340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=605e897c3bb0a1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f263effd700 1 -- 172.21.15.81:0/2760148179 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263400b640 con 0x7f2640157ca0 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f263effd700 1 -- 172.21.15.81:0/2760148179 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263400b7a0 con 0x7f2640157ca0 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f263effd700 1 -- 172.21.15.81:0/2760148179 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263400bb40 con 0x7f2640157ca0 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f2646a22700 1 -- 172.21.15.81:0/2760148179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2640157ca0 msgr2=0x7f26400cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.082+0000 7f2646a22700 1 --2- 172.21.15.81:0/2760148179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2640157ca0 0x7f26400cf4f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f26340098e0 tx=0x7f26340091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.083+0000 7f2646a22700 1 -- 172.21.15.81:0/2760148179 shutdown_connections 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.083+0000 7f2646a22700 1 --2- 172.21.15.81:0/2760148179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2640157ca0 0x7f26400cf4f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.083+0000 7f2646a22700 1 -- 172.21.15.81:0/2760148179 >> 172.21.15.81:0/2760148179 conn(0x7f264006bb90 msgr2=0x7f264006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.083+0000 7f2646a22700 1 -- 172.21.15.81:0/2760148179 shutdown_connections 2023-10-06T02:47:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.083+0000 7f2646a22700 1 -- 172.21.15.81:0/2760148179 wait complete. 2023-10-06T02:47:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.084+0000 7f2646a22700 1 Processor -- start 2023-10-06T02:47:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.084+0000 7f2646a22700 1 -- start start 2023-10-06T02:47:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.084+0000 7f2646a22700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f264006d120 0x7f264014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.084+0000 7f2646a22700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26401578d0 0x7f264014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.084+0000 7f2646a22700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2640157ca0 0x7f2640152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2646a22700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640152ba0 con 0x7f2640157ca0 2023-10-06T02:47:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2646a22700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640158f40 con 0x7f26401578d0 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2646a22700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264014d630 con 0x7f264006d120 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2644fbf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2640157ca0 0x7f2640152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2644fbf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2640157ca0 0x7f2640152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49548/0 (socket says 172.21.15.81:49548) 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2644fbf700 1 -- 172.21.15.81:0/1166676381 learned_addr learned my addr 172.21.15.81:0/1166676381 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f263f7fe700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26401578d0 0x7f264014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f263ffff700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f264006d120 0x7f264014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2644fbf700 1 -- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f264006d120 msgr2=0x7f264014d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2644fbf700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f264006d120 0x7f264014d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2644fbf700 1 -- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26401578d0 msgr2=0x7f264014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2644fbf700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26401578d0 0x7f264014eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2644fbf700 1 -- 172.21.15.81:0/1166676381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2634009420 con 0x7f2640157ca0 2023-10-06T02:47:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f263ffff700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f264006d120 0x7f264014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2644fbf700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2640157ca0 0x7f2640152100 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f263800cca0 tx=0x7f2638001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2627fff700 1 -- 172.21.15.81:0/1166676381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800a980 con 0x7f2640157ca0 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2627fff700 1 -- 172.21.15.81:0/1166676381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800aae0 con 0x7f2640157ca0 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2640158650 con 0x7f2640157ca0 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2627fff700 1 -- 172.21.15.81:0/1166676381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800ae60 con 0x7f2640157ca0 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.085+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2640158bd0 con 0x7f2640157ca0 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.086+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264006de70 con 0x7f2640157ca0 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.087+0000 7f2627fff700 1 -- 172.21.15.81:0/1166676381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2638007300 con 0x7f2640157ca0 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.087+0000 7f2627fff700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f262c066f30 0x7f262c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.087+0000 7f2627fff700 1 -- 172.21.15.81:0/1166676381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2638084b60 con 0x7f2640157ca0 2023-10-06T02:47:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.087+0000 7f263ffff700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f262c066f30 0x7f262c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.088+0000 7f263ffff700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f262c066f30 0x7f262c0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2630007fd0 tx=0x7f2630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:16.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.091+0000 7f2627fff700 1 -- 172.21.15.81:0/1166676381 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2638051be0 con 0x7f2640157ca0 2023-10-06T02:47:16.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.277+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2640159080 con 0x7f2640157ca0 2023-10-06T02:47:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.278+0000 7f2627fff700 1 -- 172.21.15.81:0/1166676381 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f2638055200 con 0x7f2640157ca0 2023-10-06T02:47:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:16.279 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:11.486392+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:57.835962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:58.768263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:16.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f262c066f30 msgr2=0x7f262c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f262c066f30 0x7f262c0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2630007fd0 tx=0x7f2630009040 comp rx=0 tx=0).stop 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2640157ca0 msgr2=0x7f2640152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2640157ca0 0x7f2640152100 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f263800cca0 tx=0x7f2638001ae0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 shutdown_connections 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2640157ca0 0x7f2640152100 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f264006d120 0x7f264014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f262c066f30 0x7f262c0693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 --2- 172.21.15.81:0/1166676381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26401578d0 0x7f264014eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 >> 172.21.15.81:0/1166676381 conn(0x7f264006bb90 msgr2=0x7f264006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 shutdown_connections 2023-10-06T02:47:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.280+0000 7f2646a22700 1 -- 172.21.15.81:0/1166676381 wait complete. 2023-10-06T02:47:16.293 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:47:16.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:16.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.406+0000 7fc36074e700 1 Processor -- start 2023-10-06T02:47:16.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.406+0000 7fc36074e700 1 -- start start 2023-10-06T02:47:16.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.407+0000 7fc36074e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc3581578d0 0x7fc3580cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.407+0000 7fc36074e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc358157ca0 0x7fc35815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.407+0000 7fc36074e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3580d07c0 con 0x7fc35806d120 2023-10-06T02:47:16.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.407+0000 7fc36074e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3580cfbb0 con 0x7fc3581578d0 2023-10-06T02:47:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.407+0000 7fc36074e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580cfe90 con 0x7fc358157ca0 2023-10-06T02:47:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.407+0000 7fc35dce9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc358157ca0 0x7fc35815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.407+0000 7fc35e4ea700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc3581578d0 0x7fc3580cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.407+0000 7fc35dce9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc358157ca0 0x7fc35815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:56998/0 (socket says 172.21.15.81:56998) 2023-10-06T02:47:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.407+0000 7fc35dce9700 1 -- 172.21.15.81:0/451863989 learned_addr learned my addr 172.21.15.81:0/451863989 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.408+0000 7fc35dce9700 1 -- 172.21.15.81:0/451863989 >> v2:172.21.15.83:3300/0 conn(0x7fc3581578d0 msgr2=0x7fc3580cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.408+0000 7fc35dce9700 1 --2- 172.21.15.81:0/451863989 >> v2:172.21.15.83:3300/0 conn(0x7fc3581578d0 0x7fc3580cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.408+0000 7fc35dce9700 1 -- 172.21.15.81:0/451863989 >> v1:172.21.15.83:6789/0 conn(0x7fc35806d120 legacy=0x7fc35815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.408+0000 7fc35dce9700 1 -- 172.21.15.81:0/451863989 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3580d0170 con 0x7fc358157ca0 2023-10-06T02:47:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.408+0000 7fc35e4ea700 1 --2- 172.21.15.81:0/451863989 >> v2:172.21.15.83:3300/0 conn(0x7fc3581578d0 0x7fc3580cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.408+0000 7fc35dce9700 1 --2- 172.21.15.81:0/451863989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc358157ca0 0x7fc35815af00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3480099b0 tx=0x7fc348009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d38ae664ba0fb1ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.408+0000 7fc35d4e8700 1 -- 172.21.15.81:0/451863989 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348009ea0 con 0x7fc358157ca0 2023-10-06T02:47:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.408+0000 7fc35d4e8700 1 -- 172.21.15.81:0/451863989 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34800b860 con 0x7fc358157ca0 2023-10-06T02:47:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.408+0000 7fc35d4e8700 1 -- 172.21.15.81:0/451863989 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34800bc00 con 0x7fc358157ca0 2023-10-06T02:47:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.409+0000 7fc36074e700 1 -- 172.21.15.81:0/451863989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc358157ca0 msgr2=0x7fc35815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.409+0000 7fc36074e700 1 --2- 172.21.15.81:0/451863989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc358157ca0 0x7fc35815af00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3480099b0 tx=0x7fc348009250 comp rx=0 tx=0).stop 2023-10-06T02:47:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.409+0000 7fc36074e700 1 -- 172.21.15.81:0/451863989 shutdown_connections 2023-10-06T02:47:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.409+0000 7fc36074e700 1 --2- 172.21.15.81:0/451863989 >> v2:172.21.15.83:3300/0 conn(0x7fc3581578d0 0x7fc3580cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.409+0000 7fc36074e700 1 --2- 172.21.15.81:0/451863989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc358157ca0 0x7fc35815af00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.409+0000 7fc36074e700 1 -- 172.21.15.81:0/451863989 >> 172.21.15.81:0/451863989 conn(0x7fc35806bb90 msgr2=0x7fc35806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.409+0000 7fc36074e700 1 -- 172.21.15.81:0/451863989 shutdown_connections 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.409+0000 7fc36074e700 1 -- 172.21.15.81:0/451863989 wait complete. 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.410+0000 7fc36074e700 1 Processor -- start 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.410+0000 7fc36074e700 1 -- start start 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.410+0000 7fc36074e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc35806d120 0x7fc35816a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.410+0000 7fc36074e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3581578d0 0x7fc35816dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.410+0000 7fc36074e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc358157ca0 0x7fc358151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.410+0000 7fc36074e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35816b990 con 0x7fc3581578d0 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.410+0000 7fc36074e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580b5d70 con 0x7fc358157ca0 2023-10-06T02:47:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.410+0000 7fc36074e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35816e7d0 con 0x7fc35806d120 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35dce9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3581578d0 0x7fc35816dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35dce9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3581578d0 0x7fc35816dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49562/0 (socket says 172.21.15.81:49562) 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35dce9700 1 -- 172.21.15.81:0/3141867398 learned_addr learned my addr 172.21.15.81:0/3141867398 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35e4ea700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc35806d120 0x7fc35816a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35eceb700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc358157ca0 0x7fc358151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35dce9700 1 -- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc35806d120 msgr2=0x7fc35816a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35dce9700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc35806d120 0x7fc35816a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35dce9700 1 -- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc358157ca0 msgr2=0x7fc358151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35dce9700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc358157ca0 0x7fc358151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35dce9700 1 -- 172.21.15.81:0/3141867398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009420 con 0x7fc3581578d0 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc35dce9700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3581578d0 0x7fc35816dfa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc358068330 tx=0x7fc348017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc34e7fc700 1 -- 172.21.15.81:0/3141867398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348000d10 con 0x7fc3581578d0 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc34e7fc700 1 -- 172.21.15.81:0/3141867398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34800bbe0 con 0x7fc3581578d0 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3480094f0 con 0x7fc3581578d0 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc34e7fc700 1 -- 172.21.15.81:0/3141867398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348011670 con 0x7fc3581578d0 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.411+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3580b5a00 con 0x7fc3581578d0 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.412+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3580b5f20 con 0x7fc3581578d0 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.412+0000 7fc34e7fc700 1 -- 172.21.15.81:0/3141867398 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc348011aa0 con 0x7fc3581578d0 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.413+0000 7fc34e7fc700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc33c066f30 0x7fc33c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.413+0000 7fc34e7fc700 1 -- 172.21.15.81:0/3141867398 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc348085e30 con 0x7fc3581578d0 2023-10-06T02:47:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.413+0000 7fc35e4ea700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc33c066f30 0x7fc33c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.413+0000 7fc35e4ea700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc33c066f30 0x7fc33c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc35815ec00 tx=0x7fc3540091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.417+0000 7fc34e7fc700 1 -- 172.21.15.81:0/3141867398 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3580b5f20 con 0x7fc3581578d0 2023-10-06T02:47:16.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.646+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3580b5ee0 con 0x7fc3581578d0 2023-10-06T02:47:16.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.646+0000 7fc34e7fc700 1 -- 172.21.15.81:0/3141867398 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fc348052f40 con 0x7fc3581578d0 2023-10-06T02:47:16.648 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:16.648 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/205039596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":205039596},{"type":"v1","addr":"172.21.15.83:6837","nonce":205039596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1667782716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1667782716},{"type":"v1","addr":"172.21.15.83:6836","nonce":1667782716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/433893952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":433893952},{"type":"v1","addr":"172.21.15.81:6834","nonce":433893952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:59.804697+0000","modified":"2023-10-06T02:47:03.458466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/4196355397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4196355397},{"type":"v1","addr":"172.21.15.81:6835","nonce":4196355397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:47:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.648+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc33c066f30 msgr2=0x7fc33c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc33c066f30 0x7fc33c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc35815ec00 tx=0x7fc3540091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3581578d0 msgr2=0x7fc35816dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3581578d0 0x7fc35816dfa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc358068330 tx=0x7fc348017000 comp rx=0 tx=0).stop 2023-10-06T02:47:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 shutdown_connections 2023-10-06T02:47:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc33c066f30 0x7fc33c0693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc358157ca0 0x7fc358151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc35806d120 0x7fc35816a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 --2- 172.21.15.81:0/3141867398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3581578d0 0x7fc35816dfa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 >> 172.21.15.81:0/3141867398 conn(0x7fc35806bb90 msgr2=0x7fc3581558a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 shutdown_connections 2023-10-06T02:47:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.649+0000 7fc36074e700 1 -- 172.21.15.81:0/3141867398 wait complete. 2023-10-06T02:47:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-10-06T02:47:16.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:16.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.775+0000 7fb6c0fe3700 1 Processor -- start 2023-10-06T02:47:16.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.775+0000 7fb6c0fe3700 1 -- start start 2023-10-06T02:47:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6c0fe3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc068e90 0x7fb6bc164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6c0fe3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc0cee10 con 0x7fb6bc159f10 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6c0fe3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc0cd040 con 0x7fb6bc159b40 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6c0fe3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0cd320 con 0x7fb6bc068e90 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6baffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb6bc159f10 0x7fb6bc068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48304/0 (socket says 172.21.15.81:48304) 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6baffd700 1 -- 172.21.15.81:0/2675956733 learned_addr learned my addr 172.21.15.81:0/2675956733 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6bbfff700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc068e90 0x7fb6bc164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874043526 0 0) 0x7fb6bc0cee10 con 0x7fb6bc159f10 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a4003570 con 0x7fb6bc159f10 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674173036 0 0) 0x7fb6bc0cd040 con 0x7fb6bc159b40 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.776+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6bc0cee10 con 0x7fb6bc159b40 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 702213793 0 0) 0x7fb6a4003570 con 0x7fb6bc159f10 2023-10-06T02:47:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc068e90 msgr2=0x7fb6bc164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc068e90 0x7fb6bc164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 >> v1:172.21.15.83:6789/0 conn(0x7fb6bc159b40 legacy=0x7fb6bc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0ce7c0 con 0x7fb6bc159f10 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fb6b0001470 con 0x7fb6bc159f10 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 >> v1:172.21.15.81:6789/0 conn(0x7fb6bc159f10 legacy=0x7fb6bc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4003c20 0x7fb6a4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a4004810 0x7fb6a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6a40051c0 0x7fb6a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0cd320 con 0x7fb6a4004810 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a400c020 con 0x7fb6a4003c20 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a400c1e0 con 0x7fb6a40051c0 2023-10-06T02:47:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6bbfff700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc068e90 0x7fb6bc164c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6baffd700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a4004810 0x7fb6a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6bb7fe700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4003c20 0x7fb6a4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6bbfff700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6a40051c0 0x7fb6a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6baffd700 1 -- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6a40051c0 msgr2=0x7fb6a400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6baffd700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6a40051c0 0x7fb6a400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6baffd700 1 -- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4003c20 msgr2=0x7fb6a4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6baffd700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4003c20 0x7fb6a4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6baffd700 1 -- 172.21.15.81:0/2675956733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a4003570 con 0x7fb6a4004810 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6bb7fe700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4003c20 0x7fb6a4004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6baffd700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a4004810 0x7fb6a4004c80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c2d0 tx=0x7fb6b0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fceb23f3722a38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000cba0 con 0x7fb6a4004810 2023-10-06T02:47:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b000cd00 con 0x7fb6a4004810 2023-10-06T02:47:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.777+0000 7fb6ba7fc700 1 -- 172.21.15.81:0/2675956733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0005b70 con 0x7fb6a4004810 2023-10-06T02:47:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.778+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/2675956733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a4004810 msgr2=0x7fb6a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.778+0000 7fb6c0fe3700 1 --2- 172.21.15.81:0/2675956733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a4004810 0x7fb6a4004c80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c2d0 tx=0x7fb6b0001e10 comp rx=0 tx=0).stop 2023-10-06T02:47:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.778+0000 7fb6bbfff700 1 -- 172.21.15.81:0/2675956733 reap_dead start 2023-10-06T02:47:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.778+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/2675956733 shutdown_connections 2023-10-06T02:47:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.778+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/2675956733 >> 172.21.15.81:0/2675956733 conn(0x7fb6bc0cd660 msgr2=0x7fb6bc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.778+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/2675956733 shutdown_connections 2023-10-06T02:47:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.778+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/2675956733 wait complete. 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.779+0000 7fb6c0fe3700 1 Processor -- start 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.779+0000 7fb6c0fe3700 1 -- start start 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6c0fe3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4004810 0x7fb6bc0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6c0fe3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc0c9b20 0x7fb6bc16a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6c0fe3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6bc0c9f90 0x7fb6bc16a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6c0fe3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc16b3d0 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6c0fe3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc16b670 con 0x7fb6a4004810 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6c0fe3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc16b950 con 0x7fb6bc0c9b20 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6bc0c9f90 0x7fb6bc16a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6bc0c9f90 0x7fb6bc16a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49580/0 (socket says 172.21.15.81:49580) 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bbfff700 1 -- 172.21.15.81:0/229297481 learned_addr learned my addr 172.21.15.81:0/229297481 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6baffd700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc0c9b20 0x7fb6bc16a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bb7fe700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4004810 0x7fb6bc0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bbfff700 1 -- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc0c9b20 msgr2=0x7fb6bc16a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bbfff700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc0c9b20 0x7fb6bc16a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bbfff700 1 -- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4004810 msgr2=0x7fb6bc0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bbfff700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4004810 0x7fb6bc0c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bbfff700 1 -- 172.21.15.81:0/229297481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc16bc30 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bb7fe700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4004810 0x7fb6bc0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.780+0000 7fb6bbfff700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6bc0c9f90 0x7fb6bc16a740 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc069260 tx=0x7fb6b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.781+0000 7fb6a37fe700 1 -- 172.21.15.81:0/229297481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4015670 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.781+0000 7fb6a37fe700 1 -- 172.21.15.81:0/229297481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b40157f0 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.781+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc0ca540 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.781+0000 7fb6a37fe700 1 -- 172.21.15.81:0/229297481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4015bb0 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.781+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc16aec0 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.782+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc16b0b0 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.782+0000 7fb6a37fe700 1 -- 172.21.15.81:0/229297481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6b401f410 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.782+0000 7fb6a37fe700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb6a8066f60 0x7fb6a8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.782+0000 7fb6a37fe700 1 -- 172.21.15.81:0/229297481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb6b40844c0 con 0x7fb6bc0c9f90 2023-10-06T02:47:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.783+0000 7fb6bb7fe700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb6a8066f60 0x7fb6a8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.783+0000 7fb6bb7fe700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb6a8066f60 0x7fb6a8069410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac003720 tx=0x7fb6ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:16.786+0000 7fb6a37fe700 1 -- 172.21.15.81:0/229297481 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6b40515d0 con 0x7fb6bc0c9f90 2023-10-06T02:47:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.010+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6bc0ccd90 con 0x7fb6bc0c9f90 2023-10-06T02:47:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.010+0000 7fb6a37fe700 1 -- 172.21.15.81:0/229297481 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fb6b4054bf0 con 0x7fb6bc0c9f90 2023-10-06T02:47:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:17.012 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/205039596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":205039596},{"type":"v1","addr":"172.21.15.83:6837","nonce":205039596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1667782716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1667782716},{"type":"v1","addr":"172.21.15.83:6836","nonce":1667782716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/433893952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":433893952},{"type":"v1","addr":"172.21.15.81:6834","nonce":433893952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:46:59.804697+0000","modified":"2023-10-06T02:47:03.458466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/4196355397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4196355397},{"type":"v1","addr":"172.21.15.81:6835","nonce":4196355397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:47:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb6a8066f60 msgr2=0x7fb6a8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb6a8066f60 0x7fb6a8069410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac003720 tx=0x7fb6ac009040 comp rx=0 tx=0).stop 2023-10-06T02:47:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6bc0c9f90 msgr2=0x7fb6bc16a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6bc0c9f90 0x7fb6bc16a740 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc069260 tx=0x7fb6b4008040 comp rx=0 tx=0).stop 2023-10-06T02:47:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 shutdown_connections 2023-10-06T02:47:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6bc0c9f90 0x7fb6bc16a740 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb6a8066f60 0x7fb6a8069410 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6a4004810 0x7fb6bc0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 --2- 172.21.15.81:0/229297481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6bc0c9b20 0x7fb6bc16a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 >> 172.21.15.81:0/229297481 conn(0x7fb6bc0cd660 msgr2=0x7fb6bc06ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 shutdown_connections 2023-10-06T02:47:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.012+0000 7fb6c0fe3700 1 -- 172.21.15.81:0/229297481 wait complete. 2023-10-06T02:47:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-10-06T02:47:17.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.138+0000 7f20328d2700 1 Processor -- start 2023-10-06T02:47:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.138+0000 7f20328d2700 1 -- start start 2023-10-06T02:47:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f20328d2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f202c1578d0 0x7f202c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f20328d2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c157ca0 0x7f202c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f20328d2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0d07c0 con 0x7f202c06d120 2023-10-06T02:47:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f20328d2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0cfbb0 con 0x7f202c1578d0 2023-10-06T02:47:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f20328d2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0cfe90 con 0x7f202c157ca0 2023-10-06T02:47:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f202c1578d0 0x7f202c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f202c1578d0 0x7f202c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49596/0 (socket says 172.21.15.81:49596) 2023-10-06T02:47:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202bfff700 1 -- 172.21.15.81:0/1386958211 learned_addr learned my addr 172.21.15.81:0/1386958211 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202bfff700 1 -- 172.21.15.81:0/1386958211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c157ca0 msgr2=0x7f202c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202bfff700 1 --2- 172.21.15.81:0/1386958211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c157ca0 0x7f202c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202bfff700 1 -- 172.21.15.81:0/1386958211 >> v1:172.21.15.83:6789/0 conn(0x7f202c06d120 legacy=0x7f202c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202bfff700 1 -- 172.21.15.81:0/1386958211 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0d0170 con 0x7f202c1578d0 2023-10-06T02:47:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202bfff700 1 --2- 172.21.15.81:0/1386958211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c1578d0 0x7f202c0cf4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f201c0099b0 tx=0x7f201c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52543be7e702641c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202affd700 1 -- 172.21.15.81:0/1386958211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00b820 con 0x7f202c1578d0 2023-10-06T02:47:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202affd700 1 -- 172.21.15.81:0/1386958211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c00b980 con 0x7f202c1578d0 2023-10-06T02:47:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.139+0000 7f202affd700 1 -- 172.21.15.81:0/1386958211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00bd20 con 0x7f202c1578d0 2023-10-06T02:47:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.140+0000 7f20328d2700 1 -- 172.21.15.81:0/1386958211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c1578d0 msgr2=0x7f202c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.140+0000 7f20328d2700 1 --2- 172.21.15.81:0/1386958211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c1578d0 0x7f202c0cf4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f201c0099b0 tx=0x7f201c009250 comp rx=0 tx=0).stop 2023-10-06T02:47:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.140+0000 7f20328d2700 1 -- 172.21.15.81:0/1386958211 shutdown_connections 2023-10-06T02:47:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.140+0000 7f20328d2700 1 --2- 172.21.15.81:0/1386958211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c1578d0 0x7f202c0cf4f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.140+0000 7f20328d2700 1 --2- 172.21.15.81:0/1386958211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c157ca0 0x7f202c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.140+0000 7f20328d2700 1 -- 172.21.15.81:0/1386958211 >> 172.21.15.81:0/1386958211 conn(0x7f202c06bb90 msgr2=0x7f202c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.140+0000 7f20328d2700 1 -- 172.21.15.81:0/1386958211 shutdown_connections 2023-10-06T02:47:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.140+0000 7f20328d2700 1 -- 172.21.15.81:0/1386958211 wait complete. 2023-10-06T02:47:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.141+0000 7f20328d2700 1 Processor -- start 2023-10-06T02:47:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.141+0000 7f20328d2700 1 -- start start 2023-10-06T02:47:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f20328d2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f202c06d120 0x7f202c150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f20328d2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c1578d0 0x7f202c16a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f20328d2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c157ca0 0x7f202c15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f20328d2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c14ebf0 con 0x7f202c157ca0 2023-10-06T02:47:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f20328d2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c151a20 con 0x7f202c06d120 2023-10-06T02:47:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f20328d2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c150e10 con 0x7f202c1578d0 2023-10-06T02:47:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f2030e6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c157ca0 0x7f202c15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f2030e6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c157ca0 0x7f202c15c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49606/0 (socket says 172.21.15.81:49606) 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f2030e6f700 1 -- 172.21.15.81:0/3349262843 learned_addr learned my addr 172.21.15.81:0/3349262843 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f202b7fe700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c1578d0 0x7f202c16a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f202bfff700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f202c06d120 0x7f202c150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f2030e6f700 1 -- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c1578d0 msgr2=0x7f202c16a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f2030e6f700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c1578d0 0x7f202c16a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f2030e6f700 1 -- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f202c06d120 msgr2=0x7f202c150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f2030e6f700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f202c06d120 0x7f202c150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f2030e6f700 1 -- 172.21.15.81:0/3349262843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0094f0 con 0x7f202c157ca0 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f202bfff700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f202c06d120 0x7f202c150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.142+0000 7f202b7fe700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c1578d0 0x7f202c16a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.143+0000 7f2030e6f700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c157ca0 0x7f202c15c990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f202400bbb0 tx=0x7f2024009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.143+0000 7f2013fff700 1 -- 172.21.15.81:0/3349262843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240092e0 con 0x7f202c157ca0 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.143+0000 7f2013fff700 1 -- 172.21.15.81:0/3349262843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202400c7a0 con 0x7f202c157ca0 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.143+0000 7f2013fff700 1 -- 172.21.15.81:0/3349262843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400cb40 con 0x7f202c157ca0 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.143+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c1510f0 con 0x7f202c157ca0 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.143+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c1516b0 con 0x7f202c157ca0 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.144+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c067ac0 con 0x7f202c157ca0 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.144+0000 7f2013fff700 1 -- 172.21.15.81:0/3349262843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2024012070 con 0x7f202c157ca0 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.144+0000 7f2013fff700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2018066f30 0x7f20180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.144+0000 7f2013fff700 1 -- 172.21.15.81:0/3349262843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f20240843d0 con 0x7f202c157ca0 2023-10-06T02:47:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.145+0000 7f202bfff700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2018066f30 0x7f20180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.145+0000 7f202bfff700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2018066f30 0x7f20180693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f201c0099b0 tx=0x7f201c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.149+0000 7f2013fff700 1 -- 172.21.15.81:0/3349262843 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20240514e0 con 0x7f202c157ca0 2023-10-06T02:47:17.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.334+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f202c151b60 con 0x7f202c157ca0 2023-10-06T02:47:17.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.335+0000 7f2013fff700 1 -- 172.21.15.81:0/3349262843 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f2024054b00 con 0x7f202c157ca0 2023-10-06T02:47:17.337 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:17.337 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:11.486392+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:46:57.835962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:46:58.768263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:17.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2018066f30 msgr2=0x7f20180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2018066f30 0x7f20180693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f201c0099b0 tx=0x7f201c016000 comp rx=0 tx=0).stop 2023-10-06T02:47:17.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c157ca0 msgr2=0x7f202c15c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c157ca0 0x7f202c15c990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f202400bbb0 tx=0x7f2024009840 comp rx=0 tx=0).stop 2023-10-06T02:47:17.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 shutdown_connections 2023-10-06T02:47:17.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f202c157ca0 0x7f202c15c990 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2018066f30 0x7f20180693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f202c06d120 0x7f202c150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 --2- 172.21.15.81:0/3349262843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f202c1578d0 0x7f202c16a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 >> 172.21.15.81:0/3349262843 conn(0x7f202c06bb90 msgr2=0x7f202c1548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 shutdown_connections 2023-10-06T02:47:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.338+0000 7f20328d2700 1 -- 172.21.15.81:0/3349262843 wait complete. 2023-10-06T02:47:17.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:47:17.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.464+0000 7f14ad415700 1 Processor -- start 2023-10-06T02:47:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.464+0000 7f14ad415700 1 -- start start 2023-10-06T02:47:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.465+0000 7f14ad415700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f14a80cf240 0x7f14a80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.465+0000 7f14ad415700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14a806d650 0x7f14a806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.465+0000 7f14ad415700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80b0ca0 con 0x7f14a815a2a0 2023-10-06T02:47:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.465+0000 7f14ad415700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a806ea90 con 0x7f14a806d650 2023-10-06T02:47:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.465+0000 7f14ad415700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a80b00d0 con 0x7f14a80cf240 2023-10-06T02:47:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.465+0000 7f14a77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14a806d650 0x7f14a806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.465+0000 7f14a77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14a806d650 0x7f14a806da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49610/0 (socket says 172.21.15.81:49610) 2023-10-06T02:47:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.465+0000 7f14a77fe700 1 -- 172.21.15.81:0/2733612615 learned_addr learned my addr 172.21.15.81:0/2733612615 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14a67fc700 1 --2- 172.21.15.81:0/2733612615 >> v2:172.21.15.83:3300/0 conn(0x7f14a80cf240 0x7f14a80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14a77fe700 1 -- 172.21.15.81:0/2733612615 >> v2:172.21.15.83:3300/0 conn(0x7f14a80cf240 msgr2=0x7f14a80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14a77fe700 1 --2- 172.21.15.81:0/2733612615 >> v2:172.21.15.83:3300/0 conn(0x7f14a80cf240 0x7f14a80b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14a77fe700 1 -- 172.21.15.81:0/2733612615 >> v1:172.21.15.83:6789/0 conn(0x7f14a815a2a0 legacy=0x7f14a80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14a77fe700 1 -- 172.21.15.81:0/2733612615 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a80b0370 con 0x7f14a806d650 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14a77fe700 1 --2- 172.21.15.81:0/2733612615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a806d650 0x7f14a806da20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f14a80713b0 tx=0x7f14a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c3f7bf7e6df860 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14a5ffb700 1 -- 172.21.15.81:0/2733612615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000e070 con 0x7f14a806d650 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14a5ffb700 1 -- 172.21.15.81:0/2733612615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a000ba10 con 0x7f14a806d650 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14a5ffb700 1 -- 172.21.15.81:0/2733612615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00092e0 con 0x7f14a806d650 2023-10-06T02:47:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14ad415700 1 -- 172.21.15.81:0/2733612615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a806d650 msgr2=0x7f14a806da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14ad415700 1 --2- 172.21.15.81:0/2733612615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a806d650 0x7f14a806da20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f14a80713b0 tx=0x7f14a0009840 comp rx=0 tx=0).stop 2023-10-06T02:47:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14ad415700 1 -- 172.21.15.81:0/2733612615 shutdown_connections 2023-10-06T02:47:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14ad415700 1 --2- 172.21.15.81:0/2733612615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a806d650 0x7f14a806da20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14ad415700 1 --2- 172.21.15.81:0/2733612615 >> v2:172.21.15.83:3300/0 conn(0x7f14a80cf240 0x7f14a80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.466+0000 7f14ad415700 1 -- 172.21.15.81:0/2733612615 >> 172.21.15.81:0/2733612615 conn(0x7f14a8067640 msgr2=0x7f14a8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.467+0000 7f14ad415700 1 -- 172.21.15.81:0/2733612615 shutdown_connections 2023-10-06T02:47:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.467+0000 7f14ad415700 1 -- 172.21.15.81:0/2733612615 wait complete. 2023-10-06T02:47:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.468+0000 7f14ad415700 1 Processor -- start 2023-10-06T02:47:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.468+0000 7f14ad415700 1 -- start start 2023-10-06T02:47:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.468+0000 7f14ad415700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14a806d650 0x7f14a8155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.468+0000 7f14ad415700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a80cf240 0x7f14a816a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14ad415700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a815a2a0 0x7f14a8153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14ad415700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80b20d0 con 0x7f14a815a2a0 2023-10-06T02:47:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14ad415700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80b2c50 con 0x7f14a80cf240 2023-10-06T02:47:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14ad415700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80b2320 con 0x7f14a806d650 2023-10-06T02:47:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a815a2a0 0x7f14a8153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a815a2a0 0x7f14a8153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49612/0 (socket says 172.21.15.81:49612) 2023-10-06T02:47:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a77fe700 1 -- 172.21.15.81:0/338076415 learned_addr learned my addr 172.21.15.81:0/338076415 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a67fc700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a80cf240 0x7f14a816a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a6ffd700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14a806d650 0x7f14a8155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a77fe700 1 -- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14a806d650 msgr2=0x7f14a8155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a77fe700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14a806d650 0x7f14a8155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a77fe700 1 -- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a80cf240 msgr2=0x7f14a816a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a77fe700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a80cf240 0x7f14a816a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a77fe700 1 -- 172.21.15.81:0/338076415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0009ae0 con 0x7f14a815a2a0 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14a77fe700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a815a2a0 0x7f14a8153890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009880 tx=0x7f14a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f148effd700 1 -- 172.21.15.81:0/338076415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0012e60 con 0x7f14a815a2a0 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f148effd700 1 -- 172.21.15.81:0/338076415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a00092e0 con 0x7f14a815a2a0 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f148effd700 1 -- 172.21.15.81:0/338076415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a001d670 con 0x7f14a815a2a0 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a80b2600 con 0x7f14a815a2a0 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.469+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a8156020 con 0x7f14a815a2a0 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.470+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a80b2e00 con 0x7f14a815a2a0 2023-10-06T02:47:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.471+0000 7f148effd700 1 -- 172.21.15.81:0/338076415 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14a001da60 con 0x7f14a815a2a0 2023-10-06T02:47:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.471+0000 7f148effd700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1494066f30 0x7f14940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.471+0000 7f148effd700 1 -- 172.21.15.81:0/338076415 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f14a0085f50 con 0x7f14a815a2a0 2023-10-06T02:47:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.471+0000 7f14a6ffd700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1494066f30 0x7f14940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.471+0000 7f14a6ffd700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1494066f30 0x7f14940693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f149800a8a0 tx=0x7f1498008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.475+0000 7f148effd700 1 -- 172.21.15.81:0/338076415 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a80b2e00 con 0x7f14a815a2a0 2023-10-06T02:47:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.703+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14a80b2dc0 con 0x7f14a815a2a0 2023-10-06T02:47:17.704 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:47:17.703+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:47:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.710+0000 7f148effd700 1 -- 172.21.15.81:0/338076415 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f14a0053060 con 0x7f14a815a2a0 2023-10-06T02:47:17.713 INFO:tasks.ceph.mds.a.smithi081.stderr: -3372> 2023-10-06T02:47:04.405+0000 7f19bf658700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:47:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1494066f30 msgr2=0x7f14940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1494066f30 0x7f14940693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f149800a8a0 tx=0x7f1498008040 comp rx=0 tx=0).stop 2023-10-06T02:47:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a815a2a0 msgr2=0x7f14a8153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a815a2a0 0x7f14a8153890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009880 tx=0x7f14a0017000 comp rx=0 tx=0).stop 2023-10-06T02:47:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 shutdown_connections 2023-10-06T02:47:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a815a2a0 0x7f14a8153890 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14a806d650 0x7f14a8155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1494066f30 0x7f14940693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 --2- 172.21.15.81:0/338076415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a80cf240 0x7f14a816a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.712+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 >> 172.21.15.81:0/338076415 conn(0x7f14a8067640 msgr2=0x7f14a80cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.713+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 shutdown_connections 2023-10-06T02:47:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.713+0000 7f14ad415700 1 -- 172.21.15.81:0/338076415 wait complete. 2023-10-06T02:47:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:47:17.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:47:17.737 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:47:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.841+0000 7fb9c62a4700 1 Processor -- start 2023-10-06T02:47:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.841+0000 7fb9c62a4700 1 -- start start 2023-10-06T02:47:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.842+0000 7fb9c62a4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9c01578d0 0x7fb9c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.842+0000 7fb9c62a4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9c006d120 0x7fb9c006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.842+0000 7fb9c62a4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c00d07c0 con 0x7fb9c0157ca0 2023-10-06T02:47:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.842+0000 7fb9c62a4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c006daa0 con 0x7fb9c01578d0 2023-10-06T02:47:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.842+0000 7fb9c62a4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00cfbb0 con 0x7fb9c006d120 2023-10-06T02:47:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.842+0000 7fb9bffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9c01578d0 0x7fb9c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.842+0000 7fb9bf7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb9c0157ca0 0x7fb9c015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48320/0 (socket says 172.21.15.81:48320) 2023-10-06T02:47:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.842+0000 7fb9bf7fe700 1 -- 172.21.15.81:0/2650562190 learned_addr learned my addr 172.21.15.81:0/2650562190 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9bffff700 1 -- 172.21.15.81:0/2650562190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9c006d120 msgr2=0x7fb9c006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9bffff700 1 --2- 172.21.15.81:0/2650562190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9c006d120 0x7fb9c006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9bffff700 1 -- 172.21.15.81:0/2650562190 >> v1:172.21.15.81:6789/0 conn(0x7fb9c0157ca0 legacy=0x7fb9c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9bffff700 1 -- 172.21.15.81:0/2650562190 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00cfe90 con 0x7fb9c01578d0 2023-10-06T02:47:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9beffd700 1 -- 172.21.15.81:0/2650562190 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072734723 0 0) 0x7fb9c00d07c0 con 0x7fb9c0157ca0 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9bffff700 1 --2- 172.21.15.81:0/2650562190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c01578d0 0x7fb9c00cf4f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00098e0 tx=0x7fb9b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c80be18fe7f134c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9beffd700 1 -- 172.21.15.81:0/2650562190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0009e80 con 0x7fb9c01578d0 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9beffd700 1 -- 172.21.15.81:0/2650562190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b000b860 con 0x7fb9c01578d0 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9beffd700 1 -- 172.21.15.81:0/2650562190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b000bbe0 con 0x7fb9c01578d0 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9c62a4700 1 -- 172.21.15.81:0/2650562190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c01578d0 msgr2=0x7fb9c00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9c62a4700 1 --2- 172.21.15.81:0/2650562190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c01578d0 0x7fb9c00cf4f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00098e0 tx=0x7fb9b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9c62a4700 1 -- 172.21.15.81:0/2650562190 shutdown_connections 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9c62a4700 1 --2- 172.21.15.81:0/2650562190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9c006d120 0x7fb9c006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9c62a4700 1 --2- 172.21.15.81:0/2650562190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c01578d0 0x7fb9c00cf4f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9c62a4700 1 -- 172.21.15.81:0/2650562190 >> 172.21.15.81:0/2650562190 conn(0x7fb9c006bb90 msgr2=0x7fb9c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.843+0000 7fb9c62a4700 1 -- 172.21.15.81:0/2650562190 shutdown_connections 2023-10-06T02:47:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.844+0000 7fb9c62a4700 1 -- 172.21.15.81:0/2650562190 wait complete. 2023-10-06T02:47:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.845+0000 7fb9c62a4700 1 Processor -- start 2023-10-06T02:47:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.845+0000 7fb9c62a4700 1 -- start start 2023-10-06T02:47:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.845+0000 7fb9c62a4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9c006d120 0x7fb9c00c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.845+0000 7fb9c62a4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9c01578d0 0x7fb9c00c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.845+0000 7fb9c62a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c0157ca0 0x7fb9c00cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c62a4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00c8600 con 0x7fb9c0157ca0 2023-10-06T02:47:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c62a4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00c7c30 con 0x7fb9c01578d0 2023-10-06T02:47:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c62a4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00c7020 con 0x7fb9c006d120 2023-10-06T02:47:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c4841700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c0157ca0 0x7fb9c00cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c4841700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c0157ca0 0x7fb9c00cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49642/0 (socket says 172.21.15.81:49642) 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c4841700 1 -- 172.21.15.81:0/4202942193 learned_addr learned my addr 172.21.15.81:0/4202942193 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9bffff700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9c006d120 0x7fb9c00c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9bf7fe700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9c01578d0 0x7fb9c00c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c4841700 1 -- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9c006d120 msgr2=0x7fb9c00c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c4841700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9c006d120 0x7fb9c00c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c4841700 1 -- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9c01578d0 msgr2=0x7fb9c00c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c4841700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9c01578d0 0x7fb9c00c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c4841700 1 -- 172.21.15.81:0/4202942193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b0009420 con 0x7fb9c0157ca0 2023-10-06T02:47:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c4841700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c0157ca0 0x7fb9c00cced0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800bc30 tx=0x7fb9b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9a7fff700 1 -- 172.21.15.81:0/4202942193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80092e0 con 0x7fb9c0157ca0 2023-10-06T02:47:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9a7fff700 1 -- 172.21.15.81:0/4202942193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b800c5d0 con 0x7fb9c0157ca0 2023-10-06T02:47:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c00c7300 con 0x7fb9c0157ca0 2023-10-06T02:47:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9a7fff700 1 -- 172.21.15.81:0/4202942193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800c9b0 con 0x7fb9c0157ca0 2023-10-06T02:47:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.846+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c00cd410 con 0x7fb9c0157ca0 2023-10-06T02:47:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.847+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c0067ac0 con 0x7fb9c0157ca0 2023-10-06T02:47:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.847+0000 7fb9a7fff700 1 -- 172.21.15.81:0/4202942193 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9b8012070 con 0x7fb9c0157ca0 2023-10-06T02:47:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.848+0000 7fb9a7fff700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb9ac066f60 0x7fb9ac069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.848+0000 7fb9a7fff700 1 -- 172.21.15.81:0/4202942193 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb9b8084170 con 0x7fb9c0157ca0 2023-10-06T02:47:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.848+0000 7fb9bffff700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb9ac066f60 0x7fb9ac069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.848+0000 7fb9bffff700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb9ac066f60 0x7fb9ac069410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00091e0 tx=0x7fb9b0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:17.852+0000 7fb9a7fff700 1 -- 172.21.15.81:0/4202942193 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9b8051230 con 0x7fb9c0157ca0 2023-10-06T02:47:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.076+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb9c004bb80 con 0x7fb9c0157ca0 2023-10-06T02:47:18.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.709+0000 7fb9a7fff700 1 -- 172.21.15.81:0/4202942193 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb9b8054850 con 0x7fb9c0157ca0 2023-10-06T02:47:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb9ac066f60 msgr2=0x7fb9ac069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb9ac066f60 0x7fb9ac069410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00091e0 tx=0x7fb9b0017000 comp rx=0 tx=0).stop 2023-10-06T02:47:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c0157ca0 msgr2=0x7fb9c00cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c0157ca0 0x7fb9c00cced0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800bc30 tx=0x7fb9b8009840 comp rx=0 tx=0).stop 2023-10-06T02:47:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 shutdown_connections 2023-10-06T02:47:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c0157ca0 0x7fb9c00cced0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9c006d120 0x7fb9c00c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb9ac066f60 0x7fb9ac069410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 --2- 172.21.15.81:0/4202942193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9c01578d0 0x7fb9c00c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.711+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 >> 172.21.15.81:0/4202942193 conn(0x7fb9c006bb90 msgr2=0x7fb9c0155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.712+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 shutdown_connections 2023-10-06T02:47:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.712+0000 7fb9c62a4700 1 -- 172.21.15.81:0/4202942193 wait complete. 2023-10-06T02:47:18.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:47:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.882+0000 7f1715a14700 1 Processor -- start 2023-10-06T02:47:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.882+0000 7f1715a14700 1 -- start start 2023-10-06T02:47:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f1715a14700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1710157ca0 0x7f17100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f1715a14700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f171006d120 0x7f171006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f1715a14700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17100d07c0 con 0x7f17101578d0 2023-10-06T02:47:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f1715a14700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171006daa0 con 0x7f1710157ca0 2023-10-06T02:47:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f1715a14700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17100cfbb0 con 0x7f171006d120 2023-10-06T02:47:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1710157ca0 0x7f17100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1710157ca0 0x7f17100cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49648/0 (socket says 172.21.15.81:49648) 2023-10-06T02:47:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170e7fc700 1 -- 172.21.15.81:0/1674856497 learned_addr learned my addr 172.21.15.81:0/1674856497 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170f7fe700 1 --2- 172.21.15.81:0/1674856497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f171006d120 0x7f171006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170e7fc700 1 -- 172.21.15.81:0/1674856497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f171006d120 msgr2=0x7f171006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170e7fc700 1 --2- 172.21.15.81:0/1674856497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f171006d120 0x7f171006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170e7fc700 1 -- 172.21.15.81:0/1674856497 >> v1:172.21.15.83:6789/0 conn(0x7f17101578d0 legacy=0x7f171015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170e7fc700 1 -- 172.21.15.81:0/1674856497 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17100cfe90 con 0x7f1710157ca0 2023-10-06T02:47:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170e7fc700 1 --2- 172.21.15.81:0/1674856497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710157ca0 0x7f17100cf4f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f17040099b0 tx=0x7f1704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5645a41a931c5e40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.883+0000 7f170dffb700 1 -- 172.21.15.81:0/1674856497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704009ea0 con 0x7f1710157ca0 2023-10-06T02:47:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f170dffb700 1 -- 172.21.15.81:0/1674856497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170400b860 con 0x7f1710157ca0 2023-10-06T02:47:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f170dffb700 1 -- 172.21.15.81:0/1674856497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170400bc00 con 0x7f1710157ca0 2023-10-06T02:47:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f1715a14700 1 -- 172.21.15.81:0/1674856497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710157ca0 msgr2=0x7f17100cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f1715a14700 1 --2- 172.21.15.81:0/1674856497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710157ca0 0x7f17100cf4f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f17040099b0 tx=0x7f1704009250 comp rx=0 tx=0).stop 2023-10-06T02:47:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f1715a14700 1 -- 172.21.15.81:0/1674856497 shutdown_connections 2023-10-06T02:47:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f1715a14700 1 --2- 172.21.15.81:0/1674856497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f171006d120 0x7f171006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f1715a14700 1 --2- 172.21.15.81:0/1674856497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1710157ca0 0x7f17100cf4f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f1715a14700 1 -- 172.21.15.81:0/1674856497 >> 172.21.15.81:0/1674856497 conn(0x7f171006bb90 msgr2=0x7f171006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f1715a14700 1 -- 172.21.15.81:0/1674856497 shutdown_connections 2023-10-06T02:47:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.884+0000 7f1715a14700 1 -- 172.21.15.81:0/1674856497 wait complete. 2023-10-06T02:47:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.885+0000 7f1715a14700 1 Processor -- start 2023-10-06T02:47:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.885+0000 7f1715a14700 1 -- start start 2023-10-06T02:47:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f1715a14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171006d120 0x7f171016adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f1715a14700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17101578d0 0x7f1710154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f1715a14700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1710157ca0 0x7f1710159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f1715a14700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17100c5b20 con 0x7f171006d120 2023-10-06T02:47:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f1715a14700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171016b330 con 0x7f1710157ca0 2023-10-06T02:47:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f1715a14700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171016de30 con 0x7f17101578d0 2023-10-06T02:47:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f170effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171006d120 0x7f171016adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f170effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171006d120 0x7f171016adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49654/0 (socket says 172.21.15.81:49654) 2023-10-06T02:47:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f170effd700 1 -- 172.21.15.81:0/1004281877 learned_addr learned my addr 172.21.15.81:0/1004281877 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f170f7fe700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1710157ca0 0x7f1710159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f170e7fc700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17101578d0 0x7f1710154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f170effd700 1 -- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17101578d0 msgr2=0x7f1710154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.886+0000 7f170effd700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17101578d0 0x7f1710154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.887+0000 7f170effd700 1 -- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1710157ca0 msgr2=0x7f1710159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.887+0000 7f170effd700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1710157ca0 0x7f1710159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.887+0000 7f170effd700 1 -- 172.21.15.81:0/1004281877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040094f0 con 0x7f171006d120 2023-10-06T02:47:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.887+0000 7f170effd700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171006d120 0x7f171016adf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f170000cb10 tx=0x7f17000017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.887+0000 7f16f6ffd700 1 -- 172.21.15.81:0/1004281877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000a700 con 0x7f171006d120 2023-10-06T02:47:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.887+0000 7f16f6ffd700 1 -- 172.21.15.81:0/1004281877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170000a880 con 0x7f171006d120 2023-10-06T02:47:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.887+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171016e110 con 0x7f171006d120 2023-10-06T02:47:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.887+0000 7f16f6ffd700 1 -- 172.21.15.81:0/1004281877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000ac40 con 0x7f171006d120 2023-10-06T02:47:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.887+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171016e6d0 con 0x7f171006d120 2023-10-06T02:47:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.888+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1710067ac0 con 0x7f171006d120 2023-10-06T02:47:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.888+0000 7f16f6ffd700 1 -- 172.21.15.81:0/1004281877 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1700003030 con 0x7f171006d120 2023-10-06T02:47:18.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.889+0000 7f16f6ffd700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16fc066f00 0x7f16fc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:18.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.889+0000 7f16f6ffd700 1 -- 172.21.15.81:0/1004281877 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f1700084760 con 0x7f171006d120 2023-10-06T02:47:18.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.889+0000 7f170e7fc700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16fc066f00 0x7f16fc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:18.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.889+0000 7f170e7fc700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16fc066f00 0x7f16fc0693b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17040099b0 tx=0x7f1704017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:18.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:18.893+0000 7f16f6ffd700 1 -- 172.21.15.81:0/1004281877 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1700051820 con 0x7f171006d120 2023-10-06T02:47:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.075+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f17100d0170 con 0x7f171006d120 2023-10-06T02:47:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.711+0000 7f16f6ffd700 1 -- 172.21.15.81:0/1004281877 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1700054e40 con 0x7f171006d120 2023-10-06T02:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16fc066f00 msgr2=0x7f16fc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16fc066f00 0x7f16fc0693b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17040099b0 tx=0x7f1704017000 comp rx=0 tx=0).stop 2023-10-06T02:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171006d120 msgr2=0x7f171016adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171006d120 0x7f171016adf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f170000cb10 tx=0x7f17000017b0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 shutdown_connections 2023-10-06T02:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16fc066f00 0x7f16fc0693b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1710157ca0 0x7f1710159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171006d120 0x7f171016adf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 --2- 172.21.15.81:0/1004281877 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17101578d0 0x7f1710154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 >> 172.21.15.81:0/1004281877 conn(0x7f171006bb90 msgr2=0x7f171006a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 shutdown_connections 2023-10-06T02:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.714+0000 7f1715a14700 1 -- 172.21.15.81:0/1004281877 wait complete. 2023-10-06T02:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:47:19.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:47:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.847+0000 7f6109f8e700 1 Processor -- start 2023-10-06T02:47:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.847+0000 7f6109f8e700 1 -- start start 2023-10-06T02:47:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.848+0000 7f6109f8e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f610406d830 0x7f61040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.848+0000 7f6109f8e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61040d07c0 con 0x7f6104157ca0 2023-10-06T02:47:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.848+0000 7f6109f8e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61040cfbb0 con 0x7f61041578d0 2023-10-06T02:47:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.848+0000 7f6109f8e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61040cfe90 con 0x7f610406d830 2023-10-06T02:47:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.848+0000 7f6102ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6104157ca0 0x7f610406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48322/0 (socket says 172.21.15.81:48322) 2023-10-06T02:47:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.848+0000 7f6102ffd700 1 -- 172.21.15.81:0/4192342903 learned_addr learned my addr 172.21.15.81:0/4192342903 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766333394 0 0) 0x7f61040d07c0 con 0x7f6104157ca0 2023-10-06T02:47:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60ec003570 con 0x7f6104157ca0 2023-10-06T02:47:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f6103fff700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f610406d830 0x7f61040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4086704895 0 0) 0x7f60ec003570 con 0x7f6104157ca0 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f610406d830 msgr2=0x7f61040cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f610406d830 0x7f61040cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 >> v1:172.21.15.83:6789/0 conn(0x7f61041578d0 legacy=0x7f610415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61040d0170 con 0x7f6104157ca0 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f60f8001470 con 0x7f6104157ca0 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 >> v1:172.21.15.81:6789/0 conn(0x7f6104157ca0 legacy=0x7f610406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60ec003a90 0x7f60ec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60ec004810 0x7f60ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f610406d830 0x7f60ec0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61040cfe90 con 0x7f60ec003a90 2023-10-06T02:47:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec00bb60 con 0x7f60ec004810 2023-10-06T02:47:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec00bd20 con 0x7f610406d830 2023-10-06T02:47:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61037fe700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60ec003a90 0x7f60ec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f6102ffd700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60ec004810 0x7f60ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f6103fff700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f610406d830 0x7f60ec0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.849+0000 7f61037fe700 1 -- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f610406d830 msgr2=0x7f60ec0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f61037fe700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f610406d830 0x7f60ec0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f61037fe700 1 -- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60ec004810 msgr2=0x7f60ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f61037fe700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60ec004810 0x7f60ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f61037fe700 1 -- 172.21.15.81:0/4192342903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec003570 con 0x7f60ec003a90 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f61037fe700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60ec003a90 0x7f60ec003ea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f60f40018e0 tx=0x7f60f4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efd92de3776be72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4012420 con 0x7f60ec003a90 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4012580 con 0x7f60ec003a90 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f61027fc700 1 -- 172.21.15.81:0/4192342903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4012920 con 0x7f60ec003a90 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f6109f8e700 1 -- 172.21.15.81:0/4192342903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60ec003a90 msgr2=0x7f60ec003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f6109f8e700 1 --2- 172.21.15.81:0/4192342903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60ec003a90 0x7f60ec003ea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f60f40018e0 tx=0x7f60f4007d30 comp rx=0 tx=0).stop 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f6103fff700 1 -- 172.21.15.81:0/4192342903 reap_dead start 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f6109f8e700 1 -- 172.21.15.81:0/4192342903 shutdown_connections 2023-10-06T02:47:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f6109f8e700 1 -- 172.21.15.81:0/4192342903 >> 172.21.15.81:0/4192342903 conn(0x7f610406bb90 msgr2=0x7f610406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:19.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f6109f8e700 1 -- 172.21.15.81:0/4192342903 shutdown_connections 2023-10-06T02:47:19.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.850+0000 7f6109f8e700 1 -- 172.21.15.81:0/4192342903 wait complete. 2023-10-06T02:47:19.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.852+0000 7f6109f8e700 1 Processor -- start 2023-10-06T02:47:19.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.852+0000 7f6109f8e700 1 -- start start 2023-10-06T02:47:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.852+0000 7f6109f8e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60ec003a90 0x7f6104154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.852+0000 7f6109f8e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6104151dc0 0x7f610414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.852+0000 7f6109f8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f610414a9e0 0x7f61040b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.852+0000 7f6109f8e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610414ef60 con 0x7f610414a9e0 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.852+0000 7f6109f8e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61040b52b0 con 0x7f6104151dc0 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.852+0000 7f6109f8e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610414f9a0 con 0x7f60ec003a90 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6103fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f610414a9e0 0x7f61040b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6103fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f610414a9e0 0x7f61040b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49668/0 (socket says 172.21.15.81:49668) 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6103fff700 1 -- 172.21.15.81:0/1469176623 learned_addr learned my addr 172.21.15.81:0/1469176623 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f61037fe700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60ec003a90 0x7f6104154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6102ffd700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6104151dc0 0x7f610414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6103fff700 1 -- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60ec003a90 msgr2=0x7f6104154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6103fff700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60ec003a90 0x7f6104154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6103fff700 1 -- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6104151dc0 msgr2=0x7f610414f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6103fff700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6104151dc0 0x7f610414f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6103fff700 1 -- 172.21.15.81:0/1469176623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104152530 con 0x7f610414a9e0 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6103fff700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f610414a9e0 0x7f61040b3ba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f610406dc30 tx=0x7f60fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f60eb7fe700 1 -- 172.21.15.81:0/1469176623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00e040 con 0x7f610414a9e0 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f60eb7fe700 1 -- 172.21.15.81:0/1469176623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc00f040 con 0x7f610414a9e0 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f60eb7fe700 1 -- 172.21.15.81:0/1469176623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00fe20 con 0x7f610414a9e0 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6104152810 con 0x7f610414a9e0 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.853+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6104152dd0 con 0x7f610414a9e0 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.854+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6104152290 con 0x7f610414a9e0 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.854+0000 7f60eb7fe700 1 -- 172.21.15.81:0/1469176623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60fc015640 con 0x7f610414a9e0 2023-10-06T02:47:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.855+0000 7f60eb7fe700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f60f0066f30 0x7f60f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.855+0000 7f60eb7fe700 1 -- 172.21.15.81:0/1469176623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f60fc084db0 con 0x7f610414a9e0 2023-10-06T02:47:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.855+0000 7f61037fe700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f60f0066f30 0x7f60f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.855+0000 7f61037fe700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f60f0066f30 0x7f60f00693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f60f4008fd0 tx=0x7f60f4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:19.859+0000 7f60eb7fe700 1 -- 172.21.15.81:0/1469176623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60fc052020 con 0x7f610414a9e0 2023-10-06T02:47:20.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.040+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61040d0450 con 0x7f610414a9e0 2023-10-06T02:47:20.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.713+0000 7f60eb7fe700 1 -- 172.21.15.81:0/1469176623 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f60fc055640 con 0x7f610414a9e0 2023-10-06T02:47:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.717+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f60f0066f30 msgr2=0x7f60f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.717+0000 7f6109f8e700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f60f0066f30 0x7f60f00693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f60f4008fd0 tx=0x7f60f4015000 comp rx=0 tx=0).stop 2023-10-06T02:47:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.717+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f610414a9e0 msgr2=0x7f61040b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.717+0000 7f6109f8e700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f610414a9e0 0x7f61040b3ba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f610406dc30 tx=0x7f60fc00b040 comp rx=0 tx=0).stop 2023-10-06T02:47:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.718+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 shutdown_connections 2023-10-06T02:47:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.718+0000 7f6109f8e700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f610414a9e0 0x7f61040b3ba0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.718+0000 7f6109f8e700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60ec003a90 0x7f6104154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.718+0000 7f6109f8e700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f60f0066f30 0x7f60f00693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.718+0000 7f6109f8e700 1 --2- 172.21.15.81:0/1469176623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6104151dc0 0x7f610414f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:20.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.718+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 >> 172.21.15.81:0/1469176623 conn(0x7f610406bb90 msgr2=0x7f6104159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:20.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.718+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 shutdown_connections 2023-10-06T02:47:20.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.718+0000 7f6109f8e700 1 -- 172.21.15.81:0/1469176623 wait complete. 2023-10-06T02:47:20.758 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:47:20.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:47:20.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.874+0000 7effb1ef4700 1 Processor -- start 2023-10-06T02:47:20.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.874+0000 7effb1ef4700 1 -- start start 2023-10-06T02:47:20.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effb1ef4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7effac0d0f50 0x7effac06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:20.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effb1ef4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac06d990 con 0x7effac0d0b80 2023-10-06T02:47:20.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effb1ef4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac0cf2d0 con 0x7effac06d530 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effb1ef4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac15a690 con 0x7effac0d0f50 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effabfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7effac0d0f50 0x7effac06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effabfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7effac0d0f50 0x7effac06cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40706/0 (socket says 172.21.15.81:40706) 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effb0ef2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7effac0d0b80 0x7effac0cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42374/0 (socket says 172.21.15.81:42374) 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effabfff700 1 -- 172.21.15.81:0/759857846 learned_addr learned my addr 172.21.15.81:0/759857846 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effabfff700 1 -- 172.21.15.81:0/759857846 >> v1:172.21.15.83:6789/0 conn(0x7effac06d530 legacy=0x7effac15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effabfff700 1 -- 172.21.15.81:0/759857846 >> v1:172.21.15.81:6789/0 conn(0x7effac0d0b80 legacy=0x7effac0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effabfff700 1 -- 172.21.15.81:0/759857846 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0d0480 con 0x7effac0d0f50 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effab7fe700 1 -- 172.21.15.81:0/759857846 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639482161 0 0) 0x7effac06d990 con 0x7effac0d0b80 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effabfff700 1 --2- 172.21.15.81:0/759857846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 0x7effac06cff0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff980099b0 tx=0x7eff98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc59c99704336a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.875+0000 7effab7fe700 1 -- 172.21.15.81:0/759857846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9800b860 con 0x7effac0d0f50 2023-10-06T02:47:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.876+0000 7effab7fe700 1 -- 172.21.15.81:0/759857846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9800b9c0 con 0x7effac0d0f50 2023-10-06T02:47:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.876+0000 7effab7fe700 1 -- 172.21.15.81:0/759857846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9800bd60 con 0x7effac0d0f50 2023-10-06T02:47:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.876+0000 7effb1ef4700 1 -- 172.21.15.81:0/759857846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 msgr2=0x7effac06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.876+0000 7effb1ef4700 1 --2- 172.21.15.81:0/759857846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 0x7effac06cff0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff980099b0 tx=0x7eff98009250 comp rx=0 tx=0).stop 2023-10-06T02:47:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.876+0000 7effb1ef4700 1 -- 172.21.15.81:0/759857846 shutdown_connections 2023-10-06T02:47:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.876+0000 7effb1ef4700 1 --2- 172.21.15.81:0/759857846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 0x7effac06cff0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.876+0000 7effb1ef4700 1 -- 172.21.15.81:0/759857846 >> 172.21.15.81:0/759857846 conn(0x7effac063230 msgr2=0x7effac063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.876+0000 7effb1ef4700 1 -- 172.21.15.81:0/759857846 shutdown_connections 2023-10-06T02:47:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.876+0000 7effb1ef4700 1 -- 172.21.15.81:0/759857846 wait complete. 2023-10-06T02:47:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.877+0000 7effb1ef4700 1 Processor -- start 2023-10-06T02:47:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.877+0000 7effb1ef4700 1 -- start start 2023-10-06T02:47:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb1ef4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effac06d530 0x7effac156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb1ef4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effac0d0b80 0x7effac16b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb1ef4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 0x7effac06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb1ef4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0adec0 con 0x7effac0d0f50 2023-10-06T02:47:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb1ef4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ae110 con 0x7effac0d0b80 2023-10-06T02:47:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb1ef4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ae3f0 con 0x7effac06d530 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb16f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 0x7effac06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb16f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 0x7effac06bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40708/0 (socket says 172.21.15.81:40708) 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb16f3700 1 -- 172.21.15.81:0/81697365 learned_addr learned my addr 172.21.15.81:0/81697365 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effabfff700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effac0d0b80 0x7effac16b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb0ef2700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effac06d530 0x7effac156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb16f3700 1 -- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effac06d530 msgr2=0x7effac156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb16f3700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effac06d530 0x7effac156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb16f3700 1 -- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effac0d0b80 msgr2=0x7effac16b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb16f3700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effac0d0b80 0x7effac16b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.878+0000 7effb16f3700 1 -- 172.21.15.81:0/81697365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff980094f0 con 0x7effac0d0f50 2023-10-06T02:47:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.879+0000 7effabfff700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effac0d0b80 0x7effac16b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.879+0000 7effb16f3700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 0x7effac06bb90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7effa400c8e0 tx=0x7effa4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.879+0000 7effa8ff9700 1 -- 172.21.15.81:0/81697365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400ce80 con 0x7effac0d0f50 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.879+0000 7effa8ff9700 1 -- 172.21.15.81:0/81697365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa400a7e0 con 0x7effac0d0f50 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.879+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac0ae6d0 con 0x7effac0d0f50 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.879+0000 7effa8ff9700 1 -- 172.21.15.81:0/81697365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400aba0 con 0x7effac0d0f50 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.879+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac1573a0 con 0x7effac0d0f50 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.880+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac0676e0 con 0x7effac0d0f50 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.880+0000 7effa8ff9700 1 -- 172.21.15.81:0/81697365 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effa4003030 con 0x7effac0d0f50 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.880+0000 7effa8ff9700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff90066f30 0x7eff900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.880+0000 7effa8ff9700 1 -- 172.21.15.81:0/81697365 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7effa4084360 con 0x7effac0d0f50 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.881+0000 7effb0ef2700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff90066f30 0x7eff900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.881+0000 7effb0ef2700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff90066f30 0x7eff900693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7effa0007fd0 tx=0x7effa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:20.885+0000 7effa8ff9700 1 -- 172.21.15.81:0/81697365 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effa4051770 con 0x7effac0d0f50 2023-10-06T02:47:21.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.066+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7effac06dc00 con 0x7effac0d0f50 2023-10-06T02:47:21.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.069+0000 7effa8ff9700 1 -- 172.21.15.81:0/81697365 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7effa4054d90 con 0x7effac0d0f50 2023-10-06T02:47:21.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.071+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff90066f30 msgr2=0x7eff900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.071+0000 7effb1ef4700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff90066f30 0x7eff900693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7effa0007fd0 tx=0x7effa0009040 comp rx=0 tx=0).stop 2023-10-06T02:47:21.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.071+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 msgr2=0x7effac06bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.071+0000 7effb1ef4700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 0x7effac06bb90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7effa400c8e0 tx=0x7effa4001710 comp rx=0 tx=0).stop 2023-10-06T02:47:21.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.071+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 shutdown_connections 2023-10-06T02:47:21.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.071+0000 7effb1ef4700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effac0d0f50 0x7effac06bb90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.071+0000 7effb1ef4700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effac06d530 0x7effac156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.071+0000 7effb1ef4700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff90066f30 0x7eff900693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.071+0000 7effb1ef4700 1 --2- 172.21.15.81:0/81697365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effac0d0b80 0x7effac16b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.072+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 >> 172.21.15.81:0/81697365 conn(0x7effac063230 msgr2=0x7effac0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.072+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 shutdown_connections 2023-10-06T02:47:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.072+0000 7effb1ef4700 1 -- 172.21.15.81:0/81697365 wait complete. 2023-10-06T02:47:21.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-06T02:47:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.197+0000 7f7c6d2d6700 1 Processor -- start 2023-10-06T02:47:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.197+0000 7f7c6d2d6700 1 -- start start 2023-10-06T02:47:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.197+0000 7f7c6d2d6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.197+0000 7f7c6d2d6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c6806d120 0x7f7c6806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.197+0000 7f7c6d2d6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6806dac0 con 0x7f7c68157ca0 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.197+0000 7f7c6d2d6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c680d07c0 con 0x7f7c6806d120 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.197+0000 7f7c6d2d6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680cfbb0 con 0x7f7c681578d0 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.197+0000 7f7c677fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c6806d120 0x7f7c6806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c677fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c6806d120 0x7f7c6806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40710/0 (socket says 172.21.15.81:40710) 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c677fe700 1 -- 172.21.15.81:0/3252687024 learned_addr learned my addr 172.21.15.81:0/3252687024 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c677fe700 1 -- 172.21.15.81:0/3252687024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 msgr2=0x7f7c680cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c66ffd700 1 --2- 172.21.15.81:0/3252687024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c677fe700 1 --2- 172.21.15.81:0/3252687024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c680cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c677fe700 1 -- 172.21.15.81:0/3252687024 >> v1:172.21.15.83:6789/0 conn(0x7f7c68157ca0 legacy=0x7f7c6815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c677fe700 1 -- 172.21.15.81:0/3252687024 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c680cfe90 con 0x7f7c6806d120 2023-10-06T02:47:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c66ffd700 1 --2- 172.21.15.81:0/3252687024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c680cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c677fe700 1 --2- 172.21.15.81:0/3252687024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 0x7f7c6806d580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7c600099b0 tx=0x7f7c60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1f709221b1f1c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c65ffb700 1 -- 172.21.15.81:0/3252687024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000b820 con 0x7f7c6806d120 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c65ffb700 1 -- 172.21.15.81:0/3252687024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000b980 con 0x7f7c6806d120 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.198+0000 7f7c65ffb700 1 -- 172.21.15.81:0/3252687024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000bd20 con 0x7f7c6806d120 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.199+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/3252687024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 msgr2=0x7f7c6806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.199+0000 7f7c6d2d6700 1 --2- 172.21.15.81:0/3252687024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 0x7f7c6806d580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7c600099b0 tx=0x7f7c60009250 comp rx=0 tx=0).stop 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.199+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/3252687024 shutdown_connections 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.199+0000 7f7c6d2d6700 1 --2- 172.21.15.81:0/3252687024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 0x7f7c6806d580 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.199+0000 7f7c6d2d6700 1 --2- 172.21.15.81:0/3252687024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c680cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.199+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/3252687024 >> 172.21.15.81:0/3252687024 conn(0x7f7c6806bb90 msgr2=0x7f7c6806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.199+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/3252687024 shutdown_connections 2023-10-06T02:47:21.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.199+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/3252687024 wait complete. 2023-10-06T02:47:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.200+0000 7f7c6d2d6700 1 Processor -- start 2023-10-06T02:47:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.200+0000 7f7c6d2d6700 1 -- start start 2023-10-06T02:47:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c6d2d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 0x7f7c68154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c6d2d6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c68153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c6d2d6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c68157ca0 0x7f7c6816a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c6d2d6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6816de10 con 0x7f7c6806d120 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c6d2d6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68154bb0 con 0x7f7c68157ca0 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c6d2d6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6816a080 con 0x7f7c681578d0 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c66ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 0x7f7c68154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c66ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 0x7f7c68154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40718/0 (socket says 172.21.15.81:40718) 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c66ffd700 1 -- 172.21.15.81:0/982399112 learned_addr learned my addr 172.21.15.81:0/982399112 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c677fe700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c68157ca0 0x7f7c6816a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c667fc700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c68153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c66ffd700 1 -- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 msgr2=0x7f7c68153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c66ffd700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c68153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c66ffd700 1 -- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c68157ca0 msgr2=0x7f7c6816a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c66ffd700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c68157ca0 0x7f7c6816a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c66ffd700 1 -- 172.21.15.81:0/982399112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600094f0 con 0x7f7c6806d120 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c667fc700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c68153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c677fe700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c68157ca0 0x7f7c6816a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c66ffd700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 0x7f7c68154670 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800a400 tx=0x7f7c58007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c4effd700 1 -- 172.21.15.81:0/982399112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800d650 con 0x7f7c6806d120 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c4effd700 1 -- 172.21.15.81:0/982399112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5800d7b0 con 0x7f7c6806d120 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c4effd700 1 -- 172.21.15.81:0/982399112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800db50 con 0x7f7c6806d120 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c681540b0 con 0x7f7c6806d120 2023-10-06T02:47:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.201+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c68154390 con 0x7f7c6806d120 2023-10-06T02:47:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.202+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6816a360 con 0x7f7c6806d120 2023-10-06T02:47:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.203+0000 7f7c4effd700 1 -- 172.21.15.81:0/982399112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c58015440 con 0x7f7c6806d120 2023-10-06T02:47:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.203+0000 7f7c4effd700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7c54066f30 0x7f7c540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.203+0000 7f7c4effd700 1 -- 172.21.15.81:0/982399112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7c58084ca0 con 0x7f7c6806d120 2023-10-06T02:47:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.203+0000 7f7c667fc700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7c54066f30 0x7f7c540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.204+0000 7f7c667fc700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7c54066f30 0x7f7c540693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7c680b2920 tx=0x7f7c5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.207+0000 7f7c4effd700 1 -- 172.21.15.81:0/982399112 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c5804e5a0 con 0x7f7c6806d120 2023-10-06T02:47:21.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.461+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f7c680d0170 con 0x7f7c6806d120 2023-10-06T02:47:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.714+0000 7f7c4effd700 1 -- 172.21.15.81:0/982399112 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v88) v1 ==== 130+0+0 (secure 0 0 0) 0x7f7c58052160 con 0x7f7c6806d120 2023-10-06T02:47:21.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7c54066f30 msgr2=0x7f7c540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7c54066f30 0x7f7c540693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7c680b2920 tx=0x7f7c5c008040 comp rx=0 tx=0).stop 2023-10-06T02:47:21.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 msgr2=0x7f7c68154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 0x7f7c68154670 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800a400 tx=0x7f7c58007910 comp rx=0 tx=0).stop 2023-10-06T02:47:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 shutdown_connections 2023-10-06T02:47:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7c54066f30 0x7f7c540693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c68157ca0 0x7f7c6816a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c6806d120 0x7f7c68154670 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 --2- 172.21.15.81:0/982399112 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c681578d0 0x7f7c68153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 >> 172.21.15.81:0/982399112 conn(0x7f7c6806bb90 msgr2=0x7f7c68156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 shutdown_connections 2023-10-06T02:47:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.716+0000 7f7c6d2d6700 1 -- 172.21.15.81:0/982399112 wait complete. 2023-10-06T02:47:21.729 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-06T02:47:21.729 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-06T02:47:21.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-06T02:47:21.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.843+0000 7f492b242700 1 Processor -- start 2023-10-06T02:47:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.843+0000 7f492b242700 1 -- start start 2023-10-06T02:47:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f492b242700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49241578d0 0x7f49240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f492b242700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4924157ca0 0x7f492415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f492b242700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49240d07c0 con 0x7f492406d120 2023-10-06T02:47:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f492b242700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49240cfbb0 con 0x7f4924157ca0 2023-10-06T02:47:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f492b242700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240cfe90 con 0x7f49241578d0 2023-10-06T02:47:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f491bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4924157ca0 0x7f492415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f49297df700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f492406d120 0x7f492415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42390/0 (socket says 172.21.15.81:42390) 2023-10-06T02:47:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f49297df700 1 -- 172.21.15.81:0/4010401171 learned_addr learned my addr 172.21.15.81:0/4010401171 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f4928fde700 1 --2- 172.21.15.81:0/4010401171 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49241578d0 0x7f49240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f491bfff700 1 -- 172.21.15.81:0/4010401171 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49241578d0 msgr2=0x7f49240cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f491bfff700 1 --2- 172.21.15.81:0/4010401171 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49241578d0 0x7f49240cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f491bfff700 1 -- 172.21.15.81:0/4010401171 >> v1:172.21.15.81:6789/0 conn(0x7f492406d120 legacy=0x7f492415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f491b7fe700 1 -- 172.21.15.81:0/4010401171 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444308512 0 0) 0x7f49240d07c0 con 0x7f492406d120 2023-10-06T02:47:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.844+0000 7f491bfff700 1 -- 172.21.15.81:0/4010401171 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240d0170 con 0x7f4924157ca0 2023-10-06T02:47:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f491bfff700 1 --2- 172.21.15.81:0/4010401171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4924157ca0 0x7f492415af00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f49140098e0 tx=0x7f49140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce43ca5f502ac22c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f491b7fe700 1 -- 172.21.15.81:0/4010401171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914009e80 con 0x7f4924157ca0 2023-10-06T02:47:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f491b7fe700 1 -- 172.21.15.81:0/4010401171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491400b860 con 0x7f4924157ca0 2023-10-06T02:47:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f491b7fe700 1 -- 172.21.15.81:0/4010401171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400bbe0 con 0x7f4924157ca0 2023-10-06T02:47:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f492b242700 1 -- 172.21.15.81:0/4010401171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4924157ca0 msgr2=0x7f492415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f492b242700 1 --2- 172.21.15.81:0/4010401171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4924157ca0 0x7f492415af00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f49140098e0 tx=0x7f49140091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f492b242700 1 -- 172.21.15.81:0/4010401171 shutdown_connections 2023-10-06T02:47:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f492b242700 1 --2- 172.21.15.81:0/4010401171 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49241578d0 0x7f49240cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f492b242700 1 --2- 172.21.15.81:0/4010401171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4924157ca0 0x7f492415af00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f492b242700 1 -- 172.21.15.81:0/4010401171 >> 172.21.15.81:0/4010401171 conn(0x7f492406bb90 msgr2=0x7f492406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f492b242700 1 -- 172.21.15.81:0/4010401171 shutdown_connections 2023-10-06T02:47:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.845+0000 7f492b242700 1 -- 172.21.15.81:0/4010401171 wait complete. 2023-10-06T02:47:21.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.846+0000 7f492b242700 1 Processor -- start 2023-10-06T02:47:21.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f492b242700 1 -- start start 2023-10-06T02:47:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f492b242700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492406d120 0x7f4924159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f492b242700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49241578d0 0x7f4924149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f492b242700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4924157ca0 0x7f4924156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f492b242700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240c7270 con 0x7f492406d120 2023-10-06T02:47:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f492b242700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240c6660 con 0x7f49241578d0 2023-10-06T02:47:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f492b242700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240c6940 con 0x7f4924157ca0 2023-10-06T02:47:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f4928fde700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492406d120 0x7f4924159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f4928fde700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492406d120 0x7f4924159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40724/0 (socket says 172.21.15.81:40724) 2023-10-06T02:47:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.847+0000 7f4928fde700 1 -- 172.21.15.81:0/3858362162 learned_addr learned my addr 172.21.15.81:0/3858362162 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f49297df700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4924157ca0 0x7f4924156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f491bfff700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49241578d0 0x7f4924149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f4928fde700 1 -- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4924157ca0 msgr2=0x7f4924156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f4928fde700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4924157ca0 0x7f4924156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f4928fde700 1 -- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49241578d0 msgr2=0x7f4924149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f4928fde700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49241578d0 0x7f4924149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f4928fde700 1 -- 172.21.15.81:0/3858362162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914009420 con 0x7f492406d120 2023-10-06T02:47:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f491bfff700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49241578d0 0x7f4924149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f4928fde700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492406d120 0x7f4924159080 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f492000e190 tx=0x7f4920009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f4918ff9700 1 -- 172.21.15.81:0/3858362162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000ee30 con 0x7f492406d120 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f4918ff9700 1 -- 172.21.15.81:0/3858362162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4920014420 con 0x7f492406d120 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49240c6c20 con 0x7f492406d120 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f4918ff9700 1 -- 172.21.15.81:0/3858362162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200147c0 con 0x7f492406d120 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.848+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49241595c0 con 0x7f492406d120 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.849+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49240c7550 con 0x7f492406d120 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.849+0000 7f4918ff9700 1 -- 172.21.15.81:0/3858362162 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4920014b70 con 0x7f492406d120 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.850+0000 7f4918ff9700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4910066f30 0x7f49100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.850+0000 7f4918ff9700 1 -- 172.21.15.81:0/3858362162 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4920084b10 con 0x7f492406d120 2023-10-06T02:47:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.850+0000 7f491bfff700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4910066f30 0x7f49100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:21.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.850+0000 7f491bfff700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4910066f30 0x7f49100693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49140091e0 tx=0x7f4914017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:21.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:21.854+0000 7f4918ff9700 1 -- 172.21.15.81:0/3858362162 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4920051f20 con 0x7f492406d120 2023-10-06T02:47:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.114+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f492415d320 con 0x7f492406d120 2023-10-06T02:47:22.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.715+0000 7f4918ff9700 1 -- 172.21.15.81:0/3858362162 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v89) v1 ==== 145+0+0 (secure 0 0 0) 0x7f49200099b0 con 0x7f492406d120 2023-10-06T02:47:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4910066f30 msgr2=0x7f49100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4910066f30 0x7f49100693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49140091e0 tx=0x7f4914017000 comp rx=0 tx=0).stop 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492406d120 msgr2=0x7f4924159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492406d120 0x7f4924159080 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f492000e190 tx=0x7f4920009920 comp rx=0 tx=0).stop 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 shutdown_connections 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4924157ca0 0x7f4924156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492406d120 0x7f4924159080 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4910066f30 0x7f49100693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 --2- 172.21.15.81:0/3858362162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49241578d0 0x7f4924149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 >> 172.21.15.81:0/3858362162 conn(0x7f492406bb90 msgr2=0x7f492415a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 shutdown_connections 2023-10-06T02:47:22.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.717+0000 7f492b242700 1 -- 172.21.15.81:0/3858362162 wait complete. 2023-10-06T02:47:22.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-06T02:47:22.860 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-06T02:47:22.860 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-06T02:47:22.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:47:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.975+0000 7fc629df0700 1 Processor -- start 2023-10-06T02:47:22.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.975+0000 7fc629df0700 1 -- start start 2023-10-06T02:47:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc629df0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6241578d0 0x7fc6240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc629df0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc624157ca0 0x7fc62415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc629df0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc62406d120 0x7fc62406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc629df0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62406dac0 con 0x7fc62406d120 2023-10-06T02:47:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc629df0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6240d07c0 con 0x7fc624157ca0 2023-10-06T02:47:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc629df0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240cfbb0 con 0x7fc6241578d0 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc623fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc62406d120 0x7fc62406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc623fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc62406d120 0x7fc62406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40736/0 (socket says 172.21.15.81:40736) 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc623fff700 1 -- 172.21.15.81:0/1084469330 learned_addr learned my addr 172.21.15.81:0/1084469330 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc622ffd700 1 --2- 172.21.15.81:0/1084469330 >> v2:172.21.15.83:3300/0 conn(0x7fc624157ca0 0x7fc62415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc6237fe700 1 --2- 172.21.15.81:0/1084469330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6241578d0 0x7fc6240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc623fff700 1 -- 172.21.15.81:0/1084469330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6241578d0 msgr2=0x7fc6240cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc623fff700 1 --2- 172.21.15.81:0/1084469330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6241578d0 0x7fc6240cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc623fff700 1 -- 172.21.15.81:0/1084469330 >> v2:172.21.15.83:3300/0 conn(0x7fc624157ca0 msgr2=0x7fc62415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc623fff700 1 --2- 172.21.15.81:0/1084469330 >> v2:172.21.15.83:3300/0 conn(0x7fc624157ca0 0x7fc62415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.976+0000 7fc623fff700 1 -- 172.21.15.81:0/1084469330 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240cfe90 con 0x7fc62406d120 2023-10-06T02:47:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc622ffd700 1 --2- 172.21.15.81:0/1084469330 >> v2:172.21.15.83:3300/0 conn(0x7fc624157ca0 0x7fc62415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc623fff700 1 --2- 172.21.15.81:0/1084469330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc62406d120 0x7fc62406d580 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc62406cb70 tx=0x7fc61c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c478de6c24c4e93d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc6227fc700 1 -- 172.21.15.81:0/1084469330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00b860 con 0x7fc62406d120 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc6227fc700 1 -- 172.21.15.81:0/1084469330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c00b9c0 con 0x7fc62406d120 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc6227fc700 1 -- 172.21.15.81:0/1084469330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00bd60 con 0x7fc62406d120 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc629df0700 1 -- 172.21.15.81:0/1084469330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc62406d120 msgr2=0x7fc62406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc629df0700 1 --2- 172.21.15.81:0/1084469330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc62406d120 0x7fc62406d580 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc62406cb70 tx=0x7fc61c009250 comp rx=0 tx=0).stop 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc629df0700 1 -- 172.21.15.81:0/1084469330 shutdown_connections 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc629df0700 1 --2- 172.21.15.81:0/1084469330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc62406d120 0x7fc62406d580 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc629df0700 1 --2- 172.21.15.81:0/1084469330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6241578d0 0x7fc6240cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc629df0700 1 --2- 172.21.15.81:0/1084469330 >> v2:172.21.15.83:3300/0 conn(0x7fc624157ca0 0x7fc62415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc629df0700 1 -- 172.21.15.81:0/1084469330 >> 172.21.15.81:0/1084469330 conn(0x7fc62406bb90 msgr2=0x7fc62406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc629df0700 1 -- 172.21.15.81:0/1084469330 shutdown_connections 2023-10-06T02:47:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.977+0000 7fc629df0700 1 -- 172.21.15.81:0/1084469330 wait complete. 2023-10-06T02:47:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc629df0700 1 Processor -- start 2023-10-06T02:47:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc629df0700 1 -- start start 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc629df0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc62406d120 0x7fc62416b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc629df0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6241578d0 0x7fc62415c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc629df0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc624157ca0 0x7fc6241524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc629df0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240b5990 con 0x7fc624157ca0 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc629df0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c7210 con 0x7fc6241578d0 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc629df0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240b5340 con 0x7fc62406d120 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc623fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc624157ca0 0x7fc6241524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc623fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc624157ca0 0x7fc6241524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40738/0 (socket says 172.21.15.81:40738) 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.979+0000 7fc623fff700 1 -- 172.21.15.81:0/3709252304 learned_addr learned my addr 172.21.15.81:0/3709252304 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc6237fe700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc62406d120 0x7fc62416b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc622ffd700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6241578d0 0x7fc62415c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc623fff700 1 -- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc62406d120 msgr2=0x7fc62416b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc623fff700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc62406d120 0x7fc62416b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc623fff700 1 -- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6241578d0 msgr2=0x7fc62415c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc623fff700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6241578d0 0x7fc62415c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc623fff700 1 -- 172.21.15.81:0/3709252304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0094f0 con 0x7fc624157ca0 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc623fff700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc624157ca0 0x7fc6241524d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0090b0 tx=0x7fc61c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc60b7fe700 1 -- 172.21.15.81:0/3709252304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011e60 con 0x7fc624157ca0 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc60b7fe700 1 -- 172.21.15.81:0/3709252304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c01f070 con 0x7fc624157ca0 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6240b5620 con 0x7fc624157ca0 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc60b7fe700 1 -- 172.21.15.81:0/3709252304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c01a870 con 0x7fc624157ca0 2023-10-06T02:47:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.980+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62415cbd0 con 0x7fc624157ca0 2023-10-06T02:47:22.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.981+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62415cdc0 con 0x7fc624157ca0 2023-10-06T02:47:22.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.981+0000 7fc60b7fe700 1 -- 172.21.15.81:0/3709252304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc61c01ac20 con 0x7fc624157ca0 2023-10-06T02:47:22.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.982+0000 7fc60b7fe700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc610066f30 0x7fc6100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:22.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.982+0000 7fc60b7fe700 1 -- 172.21.15.81:0/3709252304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc61c021070 con 0x7fc624157ca0 2023-10-06T02:47:22.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.982+0000 7fc6237fe700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc610066f30 0x7fc6100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:22.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.983+0000 7fc6237fe700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc610066f30 0x7fc6100693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc614009fd0 tx=0x7fc614009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:22.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:22.986+0000 7fc60b7fe700 1 -- 172.21.15.81:0/3709252304 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc61c053810 con 0x7fc624157ca0 2023-10-06T02:47:23.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.167+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc6240d0170 con 0x7fc624157ca0 2023-10-06T02:47:23.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.173+0000 7fc60b7fe700 1 -- 172.21.15.81:0/3709252304 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc61c0150c0 con 0x7fc624157ca0 2023-10-06T02:47:23.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc610066f30 msgr2=0x7fc6100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc610066f30 0x7fc6100693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc614009fd0 tx=0x7fc614009880 comp rx=0 tx=0).stop 2023-10-06T02:47:23.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc624157ca0 msgr2=0x7fc6241524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc624157ca0 0x7fc6241524d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0090b0 tx=0x7fc61c017000 comp rx=0 tx=0).stop 2023-10-06T02:47:23.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 shutdown_connections 2023-10-06T02:47:23.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc624157ca0 0x7fc6241524d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc62406d120 0x7fc62416b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc610066f30 0x7fc6100693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 --2- 172.21.15.81:0/3709252304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6241578d0 0x7fc62415c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 >> 172.21.15.81:0/3709252304 conn(0x7fc62406bb90 msgr2=0x7fc624155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:23.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 shutdown_connections 2023-10-06T02:47:23.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.175+0000 7fc629df0700 1 -- 172.21.15.81:0/3709252304 wait complete. 2023-10-06T02:47:23.188 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:47:23.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:47:23.227 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:47:23.270 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:47:23.270 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:47:23.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.382+0000 7f2360682700 1 Processor -- start 2023-10-06T02:47:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.382+0000 7f2360682700 1 -- start start 2023-10-06T02:47:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.383+0000 7f2360682700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580cf240 0x7f2358162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.383+0000 7f2360682700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23580b2890 con 0x7f2358157fe0 2023-10-06T02:47:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.383+0000 7f2360682700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23580b4070 con 0x7f23580b3bd0 2023-10-06T02:47:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.383+0000 7f2360682700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580b4350 con 0x7f23580cf240 2023-10-06T02:47:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.383+0000 7f235e41e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2358157fe0 0x7f23580b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42402/0 (socket says 172.21.15.81:42402) 2023-10-06T02:47:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.383+0000 7f235e41e700 1 -- 172.21.15.81:0/3459453889 learned_addr learned my addr 172.21.15.81:0/3459453889 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750769680 0 0) 0x7f23580b2890 con 0x7f2358157fe0 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2344003570 con 0x7f2358157fe0 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235ec1f700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580cf240 0x7f2358162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405425945 0 0) 0x7f2344003570 con 0x7f2358157fe0 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580cf240 msgr2=0x7f2358162cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580cf240 0x7f2358162cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 >> v1:172.21.15.83:6789/0 conn(0x7f23580b3bd0 legacy=0x7f23580ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580b4630 con 0x7f2358157fe0 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f23540017f0 con 0x7f2358157fe0 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235ec1f700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580cf240 0x7f2358162cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 >> v1:172.21.15.81:6789/0 conn(0x7f2358157fe0 legacy=0x7f23580b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2344003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2344004810 0x7f2344004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580cf240 0x7f2344005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580b4350 con 0x7f2344003a90 2023-10-06T02:47:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234400bbf0 con 0x7f2344004810 2023-10-06T02:47:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234400bdb0 con 0x7f23580cf240 2023-10-06T02:47:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235e41e700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2344003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235dc1d700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2344004810 0x7f2344004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235ec1f700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580cf240 0x7f2344005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235e41e700 1 -- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580cf240 msgr2=0x7f2344005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235e41e700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580cf240 0x7f2344005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235e41e700 1 -- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2344004810 msgr2=0x7f2344004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235e41e700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2344004810 0x7f2344004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.384+0000 7f235e41e700 1 -- 172.21.15.81:0/3459453889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2344003570 con 0x7f2344003a90 2023-10-06T02:47:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f235e41e700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2344003ea0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f235400a930 tx=0x7f23540021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81609881d42b70a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540070d0 con 0x7f2344003a90 2023-10-06T02:47:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354007270 con 0x7f2344003a90 2023-10-06T02:47:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f235d41c700 1 -- 172.21.15.81:0/3459453889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354007630 con 0x7f2344003a90 2023-10-06T02:47:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f2360682700 1 -- 172.21.15.81:0/3459453889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 msgr2=0x7f2344003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f2360682700 1 --2- 172.21.15.81:0/3459453889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2344003ea0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f235400a930 tx=0x7f23540021d0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f235ec1f700 1 -- 172.21.15.81:0/3459453889 reap_dead start 2023-10-06T02:47:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f2360682700 1 -- 172.21.15.81:0/3459453889 shutdown_connections 2023-10-06T02:47:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f2360682700 1 -- 172.21.15.81:0/3459453889 >> 172.21.15.81:0/3459453889 conn(0x7f2358067640 msgr2=0x7f2358067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f2360682700 1 -- 172.21.15.81:0/3459453889 shutdown_connections 2023-10-06T02:47:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.385+0000 7f2360682700 1 -- 172.21.15.81:0/3459453889 wait complete. 2023-10-06T02:47:23.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.386+0000 7f2360682700 1 Processor -- start 2023-10-06T02:47:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.386+0000 7f2360682700 1 -- start start 2023-10-06T02:47:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f2360682700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2358145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f2360682700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23580c9100 0x7f23580c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f2360682700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580ca0f0 0x7f235815c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f2360682700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c8c70 con 0x7f2344003a90 2023-10-06T02:47:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f2360682700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c8060 con 0x7f23580c9100 2023-10-06T02:47:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f2360682700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c8340 con 0x7f23580ca0f0 2023-10-06T02:47:23.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235e41e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2358145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235e41e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2358145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40756/0 (socket says 172.21.15.81:40756) 2023-10-06T02:47:23.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235e41e700 1 -- 172.21.15.81:0/2421220090 learned_addr learned my addr 172.21.15.81:0/2421220090 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:23.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235dc1d700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23580c9100 0x7f23580c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235ec1f700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580ca0f0 0x7f235815c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235e41e700 1 -- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580ca0f0 msgr2=0x7f235815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235e41e700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580ca0f0 0x7f235815c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235e41e700 1 -- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23580c9100 msgr2=0x7f23580c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235e41e700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23580c9100 0x7f23580c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235e41e700 1 -- 172.21.15.81:0/2421220090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580c8620 con 0x7f2344003a90 2023-10-06T02:47:23.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.387+0000 7f235dc1d700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23580c9100 0x7f23580c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:23.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.388+0000 7f235e41e700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2358145710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f235400a3f0 tx=0x7f2354016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:23.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.388+0000 7f234e7fc700 1 -- 172.21.15.81:0/2421220090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540075f0 con 0x7f2344003a90 2023-10-06T02:47:23.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.388+0000 7f234e7fc700 1 -- 172.21.15.81:0/2421220090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354027470 con 0x7f2344003a90 2023-10-06T02:47:23.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.388+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23580c8900 con 0x7f2344003a90 2023-10-06T02:47:23.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.388+0000 7f234e7fc700 1 -- 172.21.15.81:0/2421220090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354027830 con 0x7f2344003a90 2023-10-06T02:47:23.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.388+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2358145c50 con 0x7f2344003a90 2023-10-06T02:47:23.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.389+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23580ca4f0 con 0x7f2344003a90 2023-10-06T02:47:23.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.389+0000 7f234e7fc700 1 -- 172.21.15.81:0/2421220090 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2354024070 con 0x7f2344003a90 2023-10-06T02:47:23.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.389+0000 7f234e7fc700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f233c066f30 0x7f233c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.390+0000 7f234e7fc700 1 -- 172.21.15.81:0/2421220090 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f23540867f0 con 0x7f2344003a90 2023-10-06T02:47:23.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.390+0000 7f235dc1d700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f233c066f30 0x7f233c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.390+0000 7f235dc1d700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f233c066f30 0x7f233c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f23580c94f0 tx=0x7f2348009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:23.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.394+0000 7f234e7fc700 1 -- 172.21.15.81:0/2421220090 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23580ca4f0 con 0x7f2344003a90 2023-10-06T02:47:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.615+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23580ca4f0 con 0x7f2344003a90 2023-10-06T02:47:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.616+0000 7f234e7fc700 1 -- 172.21.15.81:0/2421220090 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f23580ca4f0 con 0x7f2344003a90 2023-10-06T02:47:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:23.617 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/205039596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":205039596},{"type":"v1","addr":"172.21.15.83:6837","nonce":205039596}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1667782716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1667782716},{"type":"v1","addr":"172.21.15.83:6836","nonce":1667782716}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/433893952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":433893952},{"type":"v1","addr":"172.21.15.81:6834","nonce":433893952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1271298158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1271298158},{"type":"v1","addr":"172.21.15.81:6835","nonce":1271298158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-10-06T02:47:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f233c066f30 msgr2=0x7f233c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f233c066f30 0x7f233c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f23580c94f0 tx=0x7f2348009040 comp rx=0 tx=0).stop 2023-10-06T02:47:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 msgr2=0x7f2358145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2358145710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f235400a3f0 tx=0x7f2354016000 comp rx=0 tx=0).stop 2023-10-06T02:47:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 shutdown_connections 2023-10-06T02:47:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23580ca0f0 0x7f235815c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344003a90 0x7f2358145710 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f233c066f30 0x7f233c0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 --2- 172.21.15.81:0/2421220090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23580c9100 0x7f23580c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 >> 172.21.15.81:0/2421220090 conn(0x7f2358067640 msgr2=0x7f2358155910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:23.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 shutdown_connections 2023-10-06T02:47:23.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.618+0000 7f2360682700 1 -- 172.21.15.81:0/2421220090 wait complete. 2023-10-06T02:47:23.622 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 19 2023-10-06T02:47:23.632 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:47:23.632 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:47:23.632 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:47:23.632 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:47:23.633 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:47:23.633 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:47:23.633 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:47:23.634 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:47:23.634 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:47:23.634 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:47:23.634 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:47:23.634 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:47:23.635 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:47:23.635 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:47:23.635 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:47:23.635 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:47:23.641 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:47:23.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:47:23.643 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:47:23.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:47:23.647 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:47:23.648 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:47:23.648 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:47:23.648 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:47:23.684 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:47:23.685 DEBUG:teuthology.parallel:result is None 2023-10-06T02:47:23.686 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:47:23.686 DEBUG:teuthology.parallel:result is None 2023-10-06T02:47:23.690 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:47:23.690 DEBUG:teuthology.parallel:result is None 2023-10-06T02:47:23.691 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:47:23.691 DEBUG:teuthology.parallel:result is None 2023-10-06T02:47:23.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:47:23.758 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:47:23.758 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:47:23.773 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:47:23.773 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:47:23.773 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-10-06T02:47:23.772+0000 7f3ebb5a5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T02:47:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.813+0000 7fd1898ba700 1 Processor -- start 2023-10-06T02:47:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.813+0000 7fd1898ba700 1 -- start start 2023-10-06T02:47:23.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.813+0000 7fd1898ba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1841578d0 0x7fd1840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1898ba700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd18406d120 0x7fd18406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1898ba700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18406dac0 con 0x7fd184157ca0 2023-10-06T02:47:23.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1898ba700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1840d07c0 con 0x7fd18406d120 2023-10-06T02:47:23.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1898ba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1840cfbb0 con 0x7fd1841578d0 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1837fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd18406d120 0x7fd18406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1827fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd184157ca0 0x7fd18415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42420/0 (socket says 172.21.15.81:42420) 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1827fc700 1 -- 172.21.15.81:0/2280764035 learned_addr learned my addr 172.21.15.81:0/2280764035 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd182ffd700 1 --2- 172.21.15.81:0/2280764035 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1841578d0 0x7fd1840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1837fe700 1 -- 172.21.15.81:0/2280764035 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1841578d0 msgr2=0x7fd1840cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1837fe700 1 --2- 172.21.15.81:0/2280764035 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1841578d0 0x7fd1840cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1837fe700 1 -- 172.21.15.81:0/2280764035 >> v1:172.21.15.81:6789/0 conn(0x7fd184157ca0 legacy=0x7fd18415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1837fe700 1 -- 172.21.15.81:0/2280764035 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1840cfe90 con 0x7fd18406d120 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd1837fe700 1 --2- 172.21.15.81:0/2280764035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18406d120 0x7fd18406d580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd1740098e0 tx=0x7fd1740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f86090ab382c21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd181ffb700 1 -- 172.21.15.81:0/2280764035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174011630 con 0x7fd18406d120 2023-10-06T02:47:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd181ffb700 1 -- 172.21.15.81:0/2280764035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd174011790 con 0x7fd18406d120 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.814+0000 7fd181ffb700 1 -- 172.21.15.81:0/2280764035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174011b30 con 0x7fd18406d120 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.815+0000 7fd1898ba700 1 -- 172.21.15.81:0/2280764035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18406d120 msgr2=0x7fd18406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.815+0000 7fd1898ba700 1 --2- 172.21.15.81:0/2280764035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18406d120 0x7fd18406d580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd1740098e0 tx=0x7fd1740091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.815+0000 7fd1898ba700 1 -- 172.21.15.81:0/2280764035 shutdown_connections 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.815+0000 7fd1898ba700 1 --2- 172.21.15.81:0/2280764035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18406d120 0x7fd18406d580 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.815+0000 7fd1898ba700 1 --2- 172.21.15.81:0/2280764035 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1841578d0 0x7fd1840cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.815+0000 7fd1898ba700 1 -- 172.21.15.81:0/2280764035 >> 172.21.15.81:0/2280764035 conn(0x7fd18406bb90 msgr2=0x7fd18406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.815+0000 7fd1898ba700 1 -- 172.21.15.81:0/2280764035 shutdown_connections 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.815+0000 7fd1898ba700 1 -- 172.21.15.81:0/2280764035 wait complete. 2023-10-06T02:47:23.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.816+0000 7fd1898ba700 1 Processor -- start 2023-10-06T02:47:23.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.816+0000 7fd1898ba700 1 -- start start 2023-10-06T02:47:23.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1898ba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd18406d120 0x7fd1841540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1898ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1841578d0 0x7fd1840aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1898ba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd184157ca0 0x7fd184069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1898ba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1840b4ca0 con 0x7fd1841578d0 2023-10-06T02:47:23.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1898ba700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1840abb90 con 0x7fd18406d120 2023-10-06T02:47:23.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1898ba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1840ab2f0 con 0x7fd184157ca0 2023-10-06T02:47:23.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1827fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1841578d0 0x7fd1840aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1827fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1841578d0 0x7fd1840aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40800/0 (socket says 172.21.15.81:40800) 2023-10-06T02:47:23.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1827fc700 1 -- 172.21.15.81:0/2159957089 learned_addr learned my addr 172.21.15.81:0/2159957089 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:23.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1837fe700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd184157ca0 0x7fd184069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd182ffd700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd18406d120 0x7fd1841540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1827fc700 1 -- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd184157ca0 msgr2=0x7fd184069740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1827fc700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd184157ca0 0x7fd184069740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1827fc700 1 -- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd18406d120 msgr2=0x7fd1841540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1827fc700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd18406d120 0x7fd1841540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.817+0000 7fd1827fc700 1 -- 172.21.15.81:0/2159957089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174009420 con 0x7fd1841578d0 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.818+0000 7fd1827fc700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1841578d0 0x7fd1840aa890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c890 tx=0x7fd16c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.818+0000 7fd17affd700 1 -- 172.21.15.81:0/2159957089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c005b30 con 0x7fd1841578d0 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.818+0000 7fd17affd700 1 -- 172.21.15.81:0/2159957089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c005c90 con 0x7fd1841578d0 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.818+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1840ab5d0 con 0x7fd1841578d0 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.818+0000 7fd17affd700 1 -- 172.21.15.81:0/2159957089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c007340 con 0x7fd1841578d0 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.818+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd184154be0 con 0x7fd1841578d0 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.819+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1840b4e10 con 0x7fd1841578d0 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.819+0000 7fd17affd700 1 -- 172.21.15.81:0/2159957089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd16c01b400 con 0x7fd1841578d0 2023-10-06T02:47:23.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.820+0000 7fd17affd700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd164066f30 0x7fd1640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:23.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.820+0000 7fd17affd700 1 -- 172.21.15.81:0/2159957089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd16c083e60 con 0x7fd1841578d0 2023-10-06T02:47:23.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.820+0000 7fd182ffd700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd164066f30 0x7fd1640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:23.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.820+0000 7fd182ffd700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd164066f30 0x7fd1640693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00f570 tx=0x7fd17c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:23.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:23.824+0000 7fd17affd700 1 -- 172.21.15.81:0/2159957089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd16c051270 con 0x7fd1841578d0 2023-10-06T02:47:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:24.023+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd18406dac0 con 0x7fd1841578d0 2023-10-06T02:47:25.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.200+0000 7fd17affd700 1 -- 172.21.15.81:0/2159957089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd18406dac0 con 0x7fd1841578d0 2023-10-06T02:47:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd164066f30 msgr2=0x7fd1640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd164066f30 0x7fd1640693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00f570 tx=0x7fd17c00b040 comp rx=0 tx=0).stop 2023-10-06T02:47:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1841578d0 msgr2=0x7fd1840aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1841578d0 0x7fd1840aa890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c890 tx=0x7fd16c007f30 comp rx=0 tx=0).stop 2023-10-06T02:47:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 shutdown_connections 2023-10-06T02:47:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd184157ca0 0x7fd184069740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd164066f30 0x7fd1640693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd18406d120 0x7fd1841540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 --2- 172.21.15.81:0/2159957089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1841578d0 0x7fd1840aa890 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 >> 172.21.15.81:0/2159957089 conn(0x7fd18406bb90 msgr2=0x7fd18415b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 shutdown_connections 2023-10-06T02:47:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.203+0000 7fd1898ba700 1 -- 172.21.15.81:0/2159957089 wait complete. 2023-10-06T02:47:25.206 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:47:25.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:47:25.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.336+0000 7f494bef7700 1 Processor -- start 2023-10-06T02:47:25.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.336+0000 7f494bef7700 1 -- start start 2023-10-06T02:47:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.337+0000 7f494bef7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4944157ca0 0x7f49440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.337+0000 7f494bef7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49440d07c0 con 0x7f494406d120 2023-10-06T02:47:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.337+0000 7f494bef7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49440cfbb0 con 0x7f49441578d0 2023-10-06T02:47:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.337+0000 7f494bef7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49440cfe90 con 0x7f4944157ca0 2023-10-06T02:47:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.337+0000 7f4949492700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4944157ca0 0x7f49440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.337+0000 7f494a494700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f494406d120 0x7f494406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42428/0 (socket says 172.21.15.81:42428) 2023-10-06T02:47:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.337+0000 7f494a494700 1 -- 172.21.15.81:0/4223002874 learned_addr learned my addr 172.21.15.81:0/4223002874 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f4949492700 1 -- 172.21.15.81:0/4223002874 >> v1:172.21.15.83:6789/0 conn(0x7f49441578d0 legacy=0x7f494415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:25.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f4949492700 1 -- 172.21.15.81:0/4223002874 >> v1:172.21.15.81:6789/0 conn(0x7f494406d120 legacy=0x7f494406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f4949492700 1 -- 172.21.15.81:0/4223002874 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440d0170 con 0x7f4944157ca0 2023-10-06T02:47:25.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f4948c91700 1 -- 172.21.15.81:0/4223002874 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226991457 0 0) 0x7f49440d07c0 con 0x7f494406d120 2023-10-06T02:47:25.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f4949492700 1 --2- 172.21.15.81:0/4223002874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4944157ca0 0x7f49440cf4f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f49340098e0 tx=0x7f49340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69984a9b745cd93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:25.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f4948c91700 1 -- 172.21.15.81:0/4223002874 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934009e80 con 0x7f4944157ca0 2023-10-06T02:47:25.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f4948c91700 1 -- 172.21.15.81:0/4223002874 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400b820 con 0x7f4944157ca0 2023-10-06T02:47:25.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f4948c91700 1 -- 172.21.15.81:0/4223002874 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400bba0 con 0x7f4944157ca0 2023-10-06T02:47:25.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f494bef7700 1 -- 172.21.15.81:0/4223002874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4944157ca0 msgr2=0x7f49440cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f494bef7700 1 --2- 172.21.15.81:0/4223002874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4944157ca0 0x7f49440cf4f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f49340098e0 tx=0x7f49340091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f494bef7700 1 -- 172.21.15.81:0/4223002874 shutdown_connections 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f494bef7700 1 --2- 172.21.15.81:0/4223002874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4944157ca0 0x7f49440cf4f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.338+0000 7f494bef7700 1 -- 172.21.15.81:0/4223002874 >> 172.21.15.81:0/4223002874 conn(0x7f494406bb90 msgr2=0x7f494406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.339+0000 7f494bef7700 1 -- 172.21.15.81:0/4223002874 shutdown_connections 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.339+0000 7f494bef7700 1 -- 172.21.15.81:0/4223002874 wait complete. 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f494bef7700 1 Processor -- start 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f494bef7700 1 -- start start 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f494bef7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f494406d120 0x7f4944143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f494bef7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49441578d0 0x7f4944159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f494bef7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4944157ca0 0x7f49440aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f494bef7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4944159ac0 con 0x7f494406d120 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f494bef7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49441432e0 con 0x7f49441578d0 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f494bef7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49440ac420 con 0x7f4944157ca0 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f4949c93700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f494406d120 0x7f4944143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f4949c93700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f494406d120 0x7f4944143570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40820/0 (socket says 172.21.15.81:40820) 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.340+0000 7f4949c93700 1 -- 172.21.15.81:0/417639900 learned_addr learned my addr 172.21.15.81:0/417639900 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f4949c93700 1 -- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4944157ca0 msgr2=0x7f49440aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f4949c93700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4944157ca0 0x7f49440aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f4949c93700 1 -- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49441578d0 msgr2=0x7f4944159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f4949c93700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49441578d0 0x7f4944159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f4949c93700 1 -- 172.21.15.81:0/417639900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934009420 con 0x7f494406d120 2023-10-06T02:47:25.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f4949c93700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f494406d120 0x7f4944143570 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f494000c950 tx=0x7f4940002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:25.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f4939ffb700 1 -- 172.21.15.81:0/417639900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000a7e0 con 0x7f494406d120 2023-10-06T02:47:25.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f4939ffb700 1 -- 172.21.15.81:0/417639900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494000a940 con 0x7f494406d120 2023-10-06T02:47:25.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49440ab810 con 0x7f494406d120 2023-10-06T02:47:25.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f4939ffb700 1 -- 172.21.15.81:0/417639900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000ad00 con 0x7f494406d120 2023-10-06T02:47:25.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.341+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49440abdd0 con 0x7f494406d120 2023-10-06T02:47:25.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.342+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4944067ac0 con 0x7f494406d120 2023-10-06T02:47:25.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.342+0000 7f4939ffb700 1 -- 172.21.15.81:0/417639900 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4940012630 con 0x7f494406d120 2023-10-06T02:47:25.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.343+0000 7f4939ffb700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4928066f30 0x7f49280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.343+0000 7f4939ffb700 1 -- 172.21.15.81:0/417639900 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f49400847c0 con 0x7f494406d120 2023-10-06T02:47:25.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.343+0000 7f4949492700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4928066f30 0x7f49280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:25.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.343+0000 7f4949492700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4928066f30 0x7f49280693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f49441580c0 tx=0x7f4934016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.347+0000 7f4939ffb700 1 -- 172.21.15.81:0/417639900 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4940051c20 con 0x7f494406d120 2023-10-06T02:47:25.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.600+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f49440d0450 con 0x7f494406d120 2023-10-06T02:47:25.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.600+0000 7f4939ffb700 1 -- 172.21.15.81:0/417639900 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f494000ae60 con 0x7f494406d120 2023-10-06T02:47:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:47:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:47:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:47:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:47:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:47:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:47:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:47:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:47:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:47:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:47:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:47:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:47:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:47:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:47:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:47:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:47:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:47:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:47:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:47:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:47:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:25.621 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4928066f30 msgr2=0x7f49280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4928066f30 0x7f49280693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f49441580c0 tx=0x7f4934016000 comp rx=0 tx=0).stop 2023-10-06T02:47:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f494406d120 msgr2=0x7f4944143570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f494406d120 0x7f4944143570 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f494000c950 tx=0x7f4940002760 comp rx=0 tx=0).stop 2023-10-06T02:47:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 shutdown_connections 2023-10-06T02:47:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4944157ca0 0x7f49440aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f494406d120 0x7f4944143570 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4928066f30 0x7f49280693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 --2- 172.21.15.81:0/417639900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49441578d0 0x7f4944159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 >> 172.21.15.81:0/417639900 conn(0x7f494406bb90 msgr2=0x7f4944155940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 shutdown_connections 2023-10-06T02:47:25.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.602+0000 7f494bef7700 1 -- 172.21.15.81:0/417639900 wait complete. 2023-10-06T02:47:25.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:25.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.739+0000 7f8d3cffc700 1 Processor -- start 2023-10-06T02:47:25.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.739+0000 7f8d3cffc700 1 -- start start 2023-10-06T02:47:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d3cffc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d3806d830 0x7f8d380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d3cffc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d380d07c0 con 0x7f8d38157ca0 2023-10-06T02:47:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d3cffc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d380cfbb0 con 0x7f8d381578d0 2023-10-06T02:47:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d3cffc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d380cfe90 con 0x7f8d3806d830 2023-10-06T02:47:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d36d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d3806d830 0x7f8d380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d35d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8d38157ca0 0x7f8d3806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42442/0 (socket says 172.21.15.81:42442) 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d35d9b700 1 -- 172.21.15.81:0/1448574839 learned_addr learned my addr 172.21.15.81:0/1448574839 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d36d9d700 1 -- 172.21.15.81:0/1448574839 >> v1:172.21.15.83:6789/0 conn(0x7f8d381578d0 legacy=0x7f8d3815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d36d9d700 1 -- 172.21.15.81:0/1448574839 >> v1:172.21.15.81:6789/0 conn(0x7f8d38157ca0 legacy=0x7f8d3806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d36d9d700 1 -- 172.21.15.81:0/1448574839 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380d0170 con 0x7f8d3806d830 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d3559a700 1 -- 172.21.15.81:0/1448574839 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826094593 0 0) 0x7f8d380d07c0 con 0x7f8d38157ca0 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d36d9d700 1 --2- 172.21.15.81:0/1448574839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3806d830 0x7f8d380cf4f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8d280098e0 tx=0x7f8d280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cfe459fbf462c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d3559a700 1 -- 172.21.15.81:0/1448574839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d28009e80 con 0x7f8d3806d830 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d3559a700 1 -- 172.21.15.81:0/1448574839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2800b820 con 0x7f8d3806d830 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.740+0000 7f8d3559a700 1 -- 172.21.15.81:0/1448574839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2800bba0 con 0x7f8d3806d830 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.741+0000 7f8d3cffc700 1 -- 172.21.15.81:0/1448574839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3806d830 msgr2=0x7f8d380cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.741+0000 7f8d3cffc700 1 --2- 172.21.15.81:0/1448574839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3806d830 0x7f8d380cf4f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8d280098e0 tx=0x7f8d280091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.741+0000 7f8d3cffc700 1 -- 172.21.15.81:0/1448574839 shutdown_connections 2023-10-06T02:47:25.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.741+0000 7f8d3cffc700 1 --2- 172.21.15.81:0/1448574839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3806d830 0x7f8d380cf4f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.741+0000 7f8d3cffc700 1 -- 172.21.15.81:0/1448574839 >> 172.21.15.81:0/1448574839 conn(0x7f8d3806bb90 msgr2=0x7f8d3806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:25.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.741+0000 7f8d3cffc700 1 -- 172.21.15.81:0/1448574839 shutdown_connections 2023-10-06T02:47:25.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.741+0000 7f8d3cffc700 1 -- 172.21.15.81:0/1448574839 wait complete. 2023-10-06T02:47:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.742+0000 7f8d3cffc700 1 Processor -- start 2023-10-06T02:47:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.742+0000 7f8d3cffc700 1 -- start start 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d3cffc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d3806d830 0x7f8d380b6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d3cffc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d381578d0 0x7f8d380ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d3cffc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d38157ca0 0x7f8d38155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d3cffc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380ac700 con 0x7f8d381578d0 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d3cffc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380abaf0 con 0x7f8d3806d830 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d3cffc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380abdd0 con 0x7f8d38157ca0 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d35d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d381578d0 0x7f8d380ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d35d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d381578d0 0x7f8d380ab270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40834/0 (socket says 172.21.15.81:40834) 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d35d9b700 1 -- 172.21.15.81:0/359272400 learned_addr learned my addr 172.21.15.81:0/359272400 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d3659c700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d3806d830 0x7f8d380b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d36d9d700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d38157ca0 0x7f8d38155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d35d9b700 1 -- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d38157ca0 msgr2=0x7f8d38155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d35d9b700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d38157ca0 0x7f8d38155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d35d9b700 1 -- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d3806d830 msgr2=0x7f8d380b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d35d9b700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d3806d830 0x7f8d380b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d35d9b700 1 -- 172.21.15.81:0/359272400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d28009420 con 0x7f8d381578d0 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d3659c700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d3806d830 0x7f8d380b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.743+0000 7f8d35d9b700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d381578d0 0x7f8d380ab270 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000c5e0 tx=0x7f8d20000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.744+0000 7f8d2e7fc700 1 -- 172.21.15.81:0/359272400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20005b30 con 0x7f8d381578d0 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.744+0000 7f8d2e7fc700 1 -- 172.21.15.81:0/359272400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d20005c90 con 0x7f8d381578d0 2023-10-06T02:47:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.744+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d380ac0b0 con 0x7f8d381578d0 2023-10-06T02:47:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.744+0000 7f8d2e7fc700 1 -- 172.21.15.81:0/359272400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20007300 con 0x7f8d381578d0 2023-10-06T02:47:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.744+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d380ab7b0 con 0x7f8d381578d0 2023-10-06T02:47:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.744+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d38067ac0 con 0x7f8d381578d0 2023-10-06T02:47:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.745+0000 7f8d2e7fc700 1 -- 172.21.15.81:0/359272400 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d200076b0 con 0x7f8d381578d0 2023-10-06T02:47:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.745+0000 7f8d2e7fc700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d18066f30 0x7f8d180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.745+0000 7f8d2e7fc700 1 -- 172.21.15.81:0/359272400 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8d20083880 con 0x7f8d381578d0 2023-10-06T02:47:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.745+0000 7f8d3659c700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d18066f30 0x7f8d180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.746+0000 7f8d3659c700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d18066f30 0x7f8d180693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8d30007fd0 tx=0x7f8d30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.749+0000 7f8d2e7fc700 1 -- 172.21.15.81:0/359272400 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d20050ce0 con 0x7f8d381578d0 2023-10-06T02:47:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.932+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d380d0450 con 0x7f8d381578d0 2023-10-06T02:47:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.932+0000 7f8d2e7fc700 1 -- 172.21.15.81:0/359272400 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13602 (secure 0 0 0) 0x7f8d20017090 con 0x7f8d381578d0 2023-10-06T02:47:25.934 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:25.934 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:25.197146+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.934+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d18066f30 msgr2=0x7f8d180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.934+0000 7f8d3cffc700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d18066f30 0x7f8d180693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8d30007fd0 tx=0x7f8d30009040 comp rx=0 tx=0).stop 2023-10-06T02:47:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.934+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d381578d0 msgr2=0x7f8d380ab270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.934+0000 7f8d3cffc700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d381578d0 0x7f8d380ab270 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000c5e0 tx=0x7f8d20000fe0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.935+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 shutdown_connections 2023-10-06T02:47:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.935+0000 7f8d3cffc700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d38157ca0 0x7f8d38155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.935+0000 7f8d3cffc700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d18066f30 0x7f8d180693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.935+0000 7f8d3cffc700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d3806d830 0x7f8d380b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.935+0000 7f8d3cffc700 1 --2- 172.21.15.81:0/359272400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d381578d0 0x7f8d380ab270 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.935+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 >> 172.21.15.81:0/359272400 conn(0x7f8d3806bb90 msgr2=0x7f8d38069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.935+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 shutdown_connections 2023-10-06T02:47:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:25.935+0000 7f8d3cffc700 1 -- 172.21.15.81:0/359272400 wait complete. 2023-10-06T02:47:25.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:47:25.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:47:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.064+0000 7f90fe148700 1 Processor -- start 2023-10-06T02:47:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.064+0000 7f90fe148700 1 -- start start 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90fe148700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f90f806d830 0x7f90f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90fe148700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f80d07c0 con 0x7f90f8157ca0 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90fe148700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f80cfbb0 con 0x7f90f81578d0 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90fe148700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f80cfe90 con 0x7f90f806d830 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90f6ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f90f8157ca0 0x7f90f806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42448/0 (socket says 172.21.15.81:42448) 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90f6ffd700 1 -- 172.21.15.81:0/864259430 learned_addr learned my addr 172.21.15.81:0/864259430 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90f7fff700 1 --2- 172.21.15.81:0/864259430 >> v2:172.21.15.83:3300/0 conn(0x7f90f806d830 0x7f90f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201138993 0 0) 0x7f90f80d07c0 con 0x7f90f8157ca0 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90e0003570 con 0x7f90f8157ca0 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111439450 0 0) 0x7f90f80cfbb0 con 0x7f90f81578d0 2023-10-06T02:47:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f80d07c0 con 0x7f90f81578d0 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.065+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1350108424 0 0) 0x7f90e0003570 con 0x7f90f8157ca0 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 >> v2:172.21.15.83:3300/0 conn(0x7f90f806d830 msgr2=0x7f90f80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 --2- 172.21.15.81:0/864259430 >> v2:172.21.15.83:3300/0 conn(0x7f90f806d830 0x7f90f80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 >> v1:172.21.15.83:6789/0 conn(0x7f90f81578d0 legacy=0x7f90f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80d0170 con 0x7f90f8157ca0 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f90ec001470 con 0x7f90f8157ca0 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 >> v1:172.21.15.81:6789/0 conn(0x7f90f8157ca0 legacy=0x7f90f806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90e0003bf0 0x7f90e0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90e0004810 0x7f90e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80cfe90 con 0x7f90e00051c0 2023-10-06T02:47:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e000c0b0 con 0x7f90e0003bf0 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e000c270 con 0x7f90e0004810 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f7fff700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f77fe700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90e0003bf0 0x7f90e0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f6ffd700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90e0004810 0x7f90e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f7fff700 1 -- 172.21.15.81:0/864259430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90e0004810 msgr2=0x7f90e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f7fff700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90e0004810 0x7f90e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f7fff700 1 -- 172.21.15.81:0/864259430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90e0003bf0 msgr2=0x7f90e0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f7fff700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90e0003bf0 0x7f90e0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f7fff700 1 -- 172.21.15.81:0/864259430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e0003570 con 0x7f90e00051c0 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f7fff700 1 -- 172.21.15.81:0/864259430 reap_dead start 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f7fff700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90e000ba60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009c00 tx=0x7f90f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840a638f7bf8198 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000e710 con 0x7f90e00051c0 2023-10-06T02:47:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f000e890 con 0x7f90e00051c0 2023-10-06T02:47:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.066+0000 7f90f67fc700 1 -- 172.21.15.81:0/864259430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000ec50 con 0x7f90e00051c0 2023-10-06T02:47:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.067+0000 7f90fe148700 1 -- 172.21.15.81:0/864259430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 msgr2=0x7f90e000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.067+0000 7f90fe148700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90e000ba60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009c00 tx=0x7f90f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.067+0000 7f90fe148700 1 -- 172.21.15.81:0/864259430 shutdown_connections 2023-10-06T02:47:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.067+0000 7f90fe148700 1 --2- 172.21.15.81:0/864259430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90e000ba60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.067+0000 7f90fe148700 1 -- 172.21.15.81:0/864259430 >> 172.21.15.81:0/864259430 conn(0x7f90f806bb90 msgr2=0x7f90f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.067+0000 7f90fe148700 1 -- 172.21.15.81:0/864259430 shutdown_connections 2023-10-06T02:47:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.067+0000 7f90fe148700 1 -- 172.21.15.81:0/864259430 wait complete. 2023-10-06T02:47:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.068+0000 7f90fe148700 1 Processor -- start 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.068+0000 7f90fe148700 1 -- start start 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90fe148700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90f8153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90fe148700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90f80c6ac0 0x7f90f80c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90fe148700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f81588d0 0x7f90f8158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90fe148700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8159280 con 0x7f90e00051c0 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90fe148700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80b3f80 con 0x7f90f81588d0 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90fe148700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80b4260 con 0x7f90f80c6ac0 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90f8153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90f8153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40852/0 (socket says 172.21.15.81:40852) 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f77fe700 1 -- 172.21.15.81:0/1189781376 learned_addr learned my addr 172.21.15.81:0/1189781376 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f77fe700 1 -- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90f80c6ac0 msgr2=0x7f90f80c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f6ffd700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90f80c6ac0 0x7f90f80c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f7fff700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f81588d0 0x7f90f8158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f77fe700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90f80c6ac0 0x7f90f80c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f77fe700 1 -- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f81588d0 msgr2=0x7f90f8158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f77fe700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f81588d0 0x7f90f8158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f77fe700 1 -- 172.21.15.81:0/1189781376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80b4540 con 0x7f90e00051c0 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f7fff700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f81588d0 0x7f90f8158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.069+0000 7f90f77fe700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90f8153a70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f90e800ecf0 tx=0x7f90e80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.070+0000 7f90df7fe700 1 -- 172.21.15.81:0/1189781376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8019070 con 0x7f90e00051c0 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.070+0000 7f90df7fe700 1 -- 172.21.15.81:0/1189781376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e800eea0 con 0x7f90e00051c0 2023-10-06T02:47:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.070+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f80b4820 con 0x7f90e00051c0 2023-10-06T02:47:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.070+0000 7f90df7fe700 1 -- 172.21.15.81:0/1189781376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8006df0 con 0x7f90e00051c0 2023-10-06T02:47:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.070+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f80b3ba0 con 0x7f90e00051c0 2023-10-06T02:47:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.070+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f8067ac0 con 0x7f90e00051c0 2023-10-06T02:47:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.071+0000 7f90df7fe700 1 -- 172.21.15.81:0/1189781376 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90e8015430 con 0x7f90e00051c0 2023-10-06T02:47:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.071+0000 7f90df7fe700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90e4066f30 0x7f90e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.071+0000 7f90df7fe700 1 -- 172.21.15.81:0/1189781376 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f90e80848e0 con 0x7f90e00051c0 2023-10-06T02:47:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.072+0000 7f90f6ffd700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90e4066f30 0x7f90e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.072+0000 7f90f6ffd700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90e4066f30 0x7f90e40693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90ec001200 tx=0x7f90ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.076+0000 7f90df7fe700 1 -- 172.21.15.81:0/1189781376 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90e8051d40 con 0x7f90e00051c0 2023-10-06T02:47:26.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.260+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90f80d0450 con 0x7f90e00051c0 2023-10-06T02:47:26.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.260+0000 7f90df7fe700 1 -- 172.21.15.81:0/1189781376 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90e8055360 con 0x7f90e00051c0 2023-10-06T02:47:26.262 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:47:26.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90e4066f30 msgr2=0x7f90e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90e4066f30 0x7f90e40693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90ec001200 tx=0x7f90ec009040 comp rx=0 tx=0).stop 2023-10-06T02:47:26.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 msgr2=0x7f90f8153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90f8153a70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f90e800ecf0 tx=0x7f90e80017a0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 shutdown_connections 2023-10-06T02:47:26.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f90e4066f30 0x7f90e40693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f81588d0 0x7f90f8158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00051c0 0x7f90f8153a70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 --2- 172.21.15.81:0/1189781376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90f80c6ac0 0x7f90f80c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 >> 172.21.15.81:0/1189781376 conn(0x7f90f806bb90 msgr2=0x7f90f8155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:26.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 shutdown_connections 2023-10-06T02:47:26.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.262+0000 7f90fe148700 1 -- 172.21.15.81:0/1189781376 wait complete. 2023-10-06T02:47:26.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:47:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.390+0000 7fbc438e4700 1 Processor -- start 2023-10-06T02:47:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.390+0000 7fbc438e4700 1 -- start start 2023-10-06T02:47:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.391+0000 7fbc438e4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc3c06d830 0x7fbc3c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.391+0000 7fbc438e4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c0d07c0 con 0x7fbc3c1578d0 2023-10-06T02:47:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.391+0000 7fbc438e4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c0cfbb0 con 0x7fbc3c157ca0 2023-10-06T02:47:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.391+0000 7fbc438e4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c0cfe90 con 0x7fbc3c06d830 2023-10-06T02:47:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.391+0000 7fbc41e81700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc3c06d830 0x7fbc3c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.391+0000 7fbc41680700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbc3c1578d0 0x7fbc3c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42460/0 (socket says 172.21.15.81:42460) 2023-10-06T02:47:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.391+0000 7fbc41680700 1 -- 172.21.15.81:0/606057677 learned_addr learned my addr 172.21.15.81:0/606057677 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc41e81700 1 -- 172.21.15.81:0/606057677 >> v1:172.21.15.83:6789/0 conn(0x7fbc3c157ca0 legacy=0x7fbc3c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc41e81700 1 -- 172.21.15.81:0/606057677 >> v1:172.21.15.81:6789/0 conn(0x7fbc3c1578d0 legacy=0x7fbc3c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc41e81700 1 -- 172.21.15.81:0/606057677 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0d0170 con 0x7fbc3c06d830 2023-10-06T02:47:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc33fff700 1 -- 172.21.15.81:0/606057677 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258889413 0 0) 0x7fbc3c0d07c0 con 0x7fbc3c1578d0 2023-10-06T02:47:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc41e81700 1 --2- 172.21.15.81:0/606057677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c06d830 0x7fbc3c0cf4f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbc340098e0 tx=0x7fbc340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91c966e2340d283 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc33fff700 1 -- 172.21.15.81:0/606057677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34009e80 con 0x7fbc3c06d830 2023-10-06T02:47:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc33fff700 1 -- 172.21.15.81:0/606057677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400b860 con 0x7fbc3c06d830 2023-10-06T02:47:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc33fff700 1 -- 172.21.15.81:0/606057677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400bbe0 con 0x7fbc3c06d830 2023-10-06T02:47:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc438e4700 1 -- 172.21.15.81:0/606057677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c06d830 msgr2=0x7fbc3c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc438e4700 1 --2- 172.21.15.81:0/606057677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c06d830 0x7fbc3c0cf4f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbc340098e0 tx=0x7fbc340091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc438e4700 1 -- 172.21.15.81:0/606057677 shutdown_connections 2023-10-06T02:47:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc438e4700 1 --2- 172.21.15.81:0/606057677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c06d830 0x7fbc3c0cf4f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.392+0000 7fbc438e4700 1 -- 172.21.15.81:0/606057677 >> 172.21.15.81:0/606057677 conn(0x7fbc3c06bb90 msgr2=0x7fbc3c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.393+0000 7fbc438e4700 1 -- 172.21.15.81:0/606057677 shutdown_connections 2023-10-06T02:47:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.393+0000 7fbc438e4700 1 -- 172.21.15.81:0/606057677 wait complete. 2023-10-06T02:47:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.394+0000 7fbc438e4700 1 Processor -- start 2023-10-06T02:47:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.394+0000 7fbc438e4700 1 -- start start 2023-10-06T02:47:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.394+0000 7fbc438e4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc3c06d830 0x7fbc3c1478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.394+0000 7fbc438e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c1578d0 0x7fbc3c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc438e4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc3c157ca0 0x7fbc3c1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc438e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c16ea80 con 0x7fbc3c1578d0 2023-10-06T02:47:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc438e4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c153e90 con 0x7fbc3c157ca0 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc438e4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c16be70 con 0x7fbc3c06d830 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc40e7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c1578d0 0x7fbc3c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc40e7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c1578d0 0x7fbc3c159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40872/0 (socket says 172.21.15.81:40872) 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc40e7f700 1 -- 172.21.15.81:0/3264887621 learned_addr learned my addr 172.21.15.81:0/3264887621 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc41680700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc3c06d830 0x7fbc3c1478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc41e81700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc3c157ca0 0x7fbc3c1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc40e7f700 1 -- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc3c06d830 msgr2=0x7fbc3c1478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc40e7f700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc3c06d830 0x7fbc3c1478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc40e7f700 1 -- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc3c157ca0 msgr2=0x7fbc3c1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc40e7f700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc3c157ca0 0x7fbc3c1597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc40e7f700 1 -- 172.21.15.81:0/3264887621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc34009420 con 0x7fbc3c1578d0 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc41e81700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc3c157ca0 0x7fbc3c1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc40e7f700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c1578d0 0x7fbc3c159270 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c590 tx=0x7fbc2c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc317fa700 1 -- 172.21.15.81:0/3264887621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c011590 con 0x7fbc3c1578d0 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc317fa700 1 -- 172.21.15.81:0/3264887621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c0116f0 con 0x7fbc3c1578d0 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c147e30 con 0x7fbc3c1578d0 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc317fa700 1 -- 172.21.15.81:0/3264887621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c011ab0 con 0x7fbc3c1578d0 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.395+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c16b820 con 0x7fbc3c1578d0 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.396+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c16b660 con 0x7fbc3c1578d0 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.397+0000 7fbc317fa700 1 -- 172.21.15.81:0/3264887621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc2c01b3b0 con 0x7fbc3c1578d0 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.397+0000 7fbc317fa700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbc20066f30 0x7fbc200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.397+0000 7fbc317fa700 1 -- 172.21.15.81:0/3264887621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbc2c083740 con 0x7fbc3c1578d0 2023-10-06T02:47:26.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.397+0000 7fbc41680700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbc20066f30 0x7fbc200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.398+0000 7fbc41680700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbc20066f30 0x7fbc200693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c159e10 tx=0x7fbc38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:26.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.401+0000 7fbc317fa700 1 -- 172.21.15.81:0/3264887621 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc2c050ba0 con 0x7fbc3c1578d0 2023-10-06T02:47:26.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.584+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbc3c067b60 con 0x7fbc3c1578d0 2023-10-06T02:47:26.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.584+0000 7fbc317fa700 1 -- 172.21.15.81:0/3264887621 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbc3c067b60 con 0x7fbc3c1578d0 2023-10-06T02:47:26.586 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbc20066f30 msgr2=0x7fbc200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbc20066f30 0x7fbc200693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c159e10 tx=0x7fbc38009040 comp rx=0 tx=0).stop 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c1578d0 msgr2=0x7fbc3c159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c1578d0 0x7fbc3c159270 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c590 tx=0x7fbc2c007f50 comp rx=0 tx=0).stop 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 shutdown_connections 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbc20066f30 0x7fbc200693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc3c157ca0 0x7fbc3c1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc3c06d830 0x7fbc3c1478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 --2- 172.21.15.81:0/3264887621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3c1578d0 0x7fbc3c159270 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 >> 172.21.15.81:0/3264887621 conn(0x7fbc3c06bb90 msgr2=0x7fbc3c1558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:26.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 shutdown_connections 2023-10-06T02:47:26.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.586+0000 7fbc438e4700 1 -- 172.21.15.81:0/3264887621 wait complete. 2023-10-06T02:47:26.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:47:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.712+0000 7f14ede74700 1 Processor -- start 2023-10-06T02:47:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.712+0000 7f14ede74700 1 -- start start 2023-10-06T02:47:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14ede74700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f14e8157a20 0x7f14e80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14ede74700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e806c380 con 0x7f14e80afc60 2023-10-06T02:47:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14ede74700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e80b0170 con 0x7f14e80ce270 2023-10-06T02:47:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14ede74700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e80b0450 con 0x7f14e8157a20 2023-10-06T02:47:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14e7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f14e80afc60 0x7f14e80cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42466/0 (socket says 172.21.15.81:42466) 2023-10-06T02:47:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14e7fff700 1 -- 172.21.15.81:0/1620659168 learned_addr learned my addr 172.21.15.81:0/1620659168 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14ece72700 1 --2- 172.21.15.81:0/1620659168 >> v2:172.21.15.83:3300/0 conn(0x7f14e8157a20 0x7f14e80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14e77fe700 1 -- 172.21.15.81:0/1620659168 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421201744 0 0) 0x7f14e806c380 con 0x7f14e80afc60 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14e77fe700 1 -- 172.21.15.81:0/1620659168 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d8003570 con 0x7f14e80afc60 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14e77fe700 1 -- 172.21.15.81:0/1620659168 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727134447 0 0) 0x7f14e80b0170 con 0x7f14e80ce270 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14e77fe700 1 -- 172.21.15.81:0/1620659168 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14e806c380 con 0x7f14e80ce270 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14ece72700 1 -- 172.21.15.81:0/1620659168 >> v1:172.21.15.83:6789/0 conn(0x7f14e80ce270 legacy=0x7f14e8157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14ece72700 1 -- 172.21.15.81:0/1620659168 >> v1:172.21.15.81:6789/0 conn(0x7f14e80afc60 legacy=0x7f14e80cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.713+0000 7f14ece72700 1 -- 172.21.15.81:0/1620659168 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e806bd30 con 0x7f14e8157a20 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14ece72700 1 --2- 172.21.15.81:0/1620659168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e8157a20 0x7f14e80af720 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0098e0 tx=0x7f14dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9253b7c9a3419e62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14e77fe700 1 -- 172.21.15.81:0/1620659168 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc011630 con 0x7f14e8157a20 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14e77fe700 1 -- 172.21.15.81:0/1620659168 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc011790 con 0x7f14e8157a20 2023-10-06T02:47:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14e77fe700 1 -- 172.21.15.81:0/1620659168 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc011b30 con 0x7f14e8157a20 2023-10-06T02:47:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14ede74700 1 -- 172.21.15.81:0/1620659168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e8157a20 msgr2=0x7f14e80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14ede74700 1 --2- 172.21.15.81:0/1620659168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e8157a20 0x7f14e80af720 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0098e0 tx=0x7f14dc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14ede74700 1 -- 172.21.15.81:0/1620659168 shutdown_connections 2023-10-06T02:47:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14ede74700 1 --2- 172.21.15.81:0/1620659168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e8157a20 0x7f14e80af720 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14ede74700 1 -- 172.21.15.81:0/1620659168 >> 172.21.15.81:0/1620659168 conn(0x7f14e8063230 msgr2=0x7f14e8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14ede74700 1 -- 172.21.15.81:0/1620659168 shutdown_connections 2023-10-06T02:47:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.714+0000 7f14ede74700 1 -- 172.21.15.81:0/1620659168 wait complete. 2023-10-06T02:47:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.715+0000 7f14ede74700 1 Processor -- start 2023-10-06T02:47:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.716+0000 7f14ede74700 1 -- start start 2023-10-06T02:47:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.716+0000 7f14ede74700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e80afc60 0x7f14e81681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.716+0000 7f14ede74700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ce270 0x7f14e80b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.716+0000 7f14ede74700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e8157a20 0x7f14e80c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.716+0000 7f14ede74700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c52a0 con 0x7f14e80ce270 2023-10-06T02:47:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.716+0000 7f14ede74700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c6000 con 0x7f14e80afc60 2023-10-06T02:47:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.716+0000 7f14ede74700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c69e0 con 0x7f14e8157a20 2023-10-06T02:47:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.716+0000 7f14e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ce270 0x7f14e80b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.716+0000 7f14e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ce270 0x7f14e80b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40884/0 (socket says 172.21.15.81:40884) 2023-10-06T02:47:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e7fff700 1 -- 172.21.15.81:0/3303170266 learned_addr learned my addr 172.21.15.81:0/3303170266 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14ece72700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e80afc60 0x7f14e81681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14ed673700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e8157a20 0x7f14e80c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e7fff700 1 -- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e8157a20 msgr2=0x7f14e80c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e7fff700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e8157a20 0x7f14e80c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e7fff700 1 -- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e80afc60 msgr2=0x7f14e81681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e7fff700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e80afc60 0x7f14e81681c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e7fff700 1 -- 172.21.15.81:0/3303170266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc009420 con 0x7f14e80ce270 2023-10-06T02:47:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e7fff700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ce270 0x7f14e80b0ad0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c790 tx=0x7f14d4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e4ff9700 1 -- 172.21.15.81:0/3303170266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4005b30 con 0x7f14e80ce270 2023-10-06T02:47:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e4ff9700 1 -- 172.21.15.81:0/3303170266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d4005c90 con 0x7f14e80ce270 2023-10-06T02:47:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e80c4ce0 con 0x7f14e80ce270 2023-10-06T02:47:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14e4ff9700 1 -- 172.21.15.81:0/3303170266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4007300 con 0x7f14e80ce270 2023-10-06T02:47:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.717+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e80c66f0 con 0x7f14e80ce270 2023-10-06T02:47:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.718+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e80c64d0 con 0x7f14e80ce270 2023-10-06T02:47:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.718+0000 7f14e4ff9700 1 -- 172.21.15.81:0/3303170266 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14d401b3b0 con 0x7f14e80ce270 2023-10-06T02:47:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.719+0000 7f14e4ff9700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f14cc066f30 0x7f14cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.719+0000 7f14e4ff9700 1 -- 172.21.15.81:0/3303170266 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f14d40837f0 con 0x7f14e80ce270 2023-10-06T02:47:26.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.719+0000 7f14ece72700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f14cc066f30 0x7f14cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:26.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.719+0000 7f14ece72700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f14cc066f30 0x7f14cc0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0093f0 tx=0x7f14dc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:26.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.723+0000 7f14e4ff9700 1 -- 172.21.15.81:0/3303170266 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14e80c64d0 con 0x7f14e80ce270 2023-10-06T02:47:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.906+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f14e80c64d0 con 0x7f14e80ce270 2023-10-06T02:47:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.907+0000 7f14e4ff9700 1 -- 172.21.15.81:0/3303170266 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+126 (secure 0 0 0) 0x7f14e80c64d0 con 0x7f14e80ce270 2023-10-06T02:47:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:26.909 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:47:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f14cc066f30 msgr2=0x7f14cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f14cc066f30 0x7f14cc0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0093f0 tx=0x7f14dc017000 comp rx=0 tx=0).stop 2023-10-06T02:47:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ce270 msgr2=0x7f14e80b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ce270 0x7f14e80b0ad0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c790 tx=0x7f14d4007ea0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 shutdown_connections 2023-10-06T02:47:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e8157a20 0x7f14e80c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f14cc066f30 0x7f14cc0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e80afc60 0x7f14e81681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 --2- 172.21.15.81:0/3303170266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e80ce270 0x7f14e80b0ad0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 >> 172.21.15.81:0/3303170266 conn(0x7f14e8063230 msgr2=0x7f14e8159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 shutdown_connections 2023-10-06T02:47:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:26.909+0000 7f14ede74700 1 -- 172.21.15.81:0/3303170266 wait complete. 2023-10-06T02:47:26.922 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:47:26.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:47:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.038+0000 7f9383500700 1 Processor -- start 2023-10-06T02:47:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.038+0000 7f9383500700 1 -- start start 2023-10-06T02:47:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.039+0000 7f9383500700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f937c1578d0 0x7f937c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.039+0000 7f9383500700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c157ca0 0x7f937c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.039+0000 7f9383500700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937c0d07c0 con 0x7f937c06d120 2023-10-06T02:47:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.039+0000 7f9383500700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937c0cfbb0 con 0x7f937c1578d0 2023-10-06T02:47:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.039+0000 7f9383500700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0cfe90 con 0x7f937c157ca0 2023-10-06T02:47:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.039+0000 7f9381a9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f937c06d120 0x7f937c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42478/0 (socket says 172.21.15.81:42478) 2023-10-06T02:47:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.039+0000 7f9381a9d700 1 -- 172.21.15.81:0/2358041972 learned_addr learned my addr 172.21.15.81:0/2358041972 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9380a9b700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c157ca0 0x7f937c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f938129c700 1 --2- 172.21.15.81:0/2358041972 >> v2:172.21.15.83:3300/0 conn(0x7f937c1578d0 0x7f937c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696697108 0 0) 0x7f937c0d07c0 con 0x7f937c06d120 2023-10-06T02:47:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9368003570 con 0x7f937c06d120 2023-10-06T02:47:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2203090598 0 0) 0x7f9368003570 con 0x7f937c06d120 2023-10-06T02:47:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c157ca0 msgr2=0x7f937c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c157ca0 0x7f937c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 >> v2:172.21.15.83:3300/0 conn(0x7f937c1578d0 msgr2=0x7f937c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 --2- 172.21.15.81:0/2358041972 >> v2:172.21.15.83:3300/0 conn(0x7f937c1578d0 0x7f937c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c0d0170 con 0x7f937c06d120 2023-10-06T02:47:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f9374001470 con 0x7f937c06d120 2023-10-06T02:47:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 >> v1:172.21.15.81:6789/0 conn(0x7f937c06d120 legacy=0x7f937c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c157ca0 0x7f9368003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9368003fe0 0x7f9368004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368004d50 0x7f93680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0cfbb0 con 0x7f9368004d50 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0cfe90 con 0x7f9368003fe0 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936800ba90 con 0x7f937c157ca0 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9381a9d700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368004d50 0x7f93680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f938129c700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c157ca0 0x7f9368003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9380a9b700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9368003fe0 0x7f9368004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9381a9d700 1 -- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c157ca0 msgr2=0x7f9368003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9381a9d700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c157ca0 0x7f9368003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9381a9d700 1 -- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9368003fe0 msgr2=0x7f9368004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9381a9d700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9368003fe0 0x7f9368004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.040+0000 7f9381a9d700 1 -- 172.21.15.81:0/2358041972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9368003570 con 0x7f9368004d50 2023-10-06T02:47:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9381a9d700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368004d50 0x7f93680051c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f937400c3c0 tx=0x7f937c0d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478369606aea2759 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400cc30 con 0x7f9368004d50 2023-10-06T02:47:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937400cd90 con 0x7f9368004d50 2023-10-06T02:47:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9373fff700 1 -- 172.21.15.81:0/2358041972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374005b70 con 0x7f9368004d50 2023-10-06T02:47:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9383500700 1 -- 172.21.15.81:0/2358041972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368004d50 msgr2=0x7f93680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9383500700 1 --2- 172.21.15.81:0/2358041972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368004d50 0x7f93680051c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f937400c3c0 tx=0x7f937c0d0730 comp rx=0 tx=0).stop 2023-10-06T02:47:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9381a9d700 1 -- 172.21.15.81:0/2358041972 reap_dead start 2023-10-06T02:47:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9383500700 1 -- 172.21.15.81:0/2358041972 shutdown_connections 2023-10-06T02:47:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9383500700 1 -- 172.21.15.81:0/2358041972 >> 172.21.15.81:0/2358041972 conn(0x7f937c06bb90 msgr2=0x7f937c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9383500700 1 -- 172.21.15.81:0/2358041972 shutdown_connections 2023-10-06T02:47:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.041+0000 7f9383500700 1 -- 172.21.15.81:0/2358041972 wait complete. 2023-10-06T02:47:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.042+0000 7f9383500700 1 Processor -- start 2023-10-06T02:47:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.042+0000 7f9383500700 1 -- start start 2023-10-06T02:47:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f9383500700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f937c16d3c0 0x7f937c16b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f9383500700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c16a520 0x7f937c158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f9383500700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f937c15ec30 0x7f937c15f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f9383500700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c16a990 con 0x7f937c16d3c0 2023-10-06T02:47:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f9383500700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c15f5c0 con 0x7f937c15ec30 2023-10-06T02:47:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f9383500700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c1598e0 con 0x7f937c16a520 2023-10-06T02:47:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f938129c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f937c16d3c0 0x7f937c16b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f938129c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f937c16d3c0 0x7f937c16b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40914/0 (socket says 172.21.15.81:40914) 2023-10-06T02:47:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f938129c700 1 -- 172.21.15.81:0/1435360222 learned_addr learned my addr 172.21.15.81:0/1435360222 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f9381a9d700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f937c15ec30 0x7f937c15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.043+0000 7f9380a9b700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c16a520 0x7f937c158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f938129c700 1 -- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c16a520 msgr2=0x7f937c158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f938129c700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c16a520 0x7f937c158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f938129c700 1 -- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f937c15ec30 msgr2=0x7f937c15f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f938129c700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f937c15ec30 0x7f937c15f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f938129c700 1 -- 172.21.15.81:0/1435360222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c16abb0 con 0x7f937c16d3c0 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f9381a9d700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f937c15ec30 0x7f937c15f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f9380a9b700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c16a520 0x7f937c158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f938129c700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f937c16d3c0 0x7f937c16b730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9378009fd0 tx=0x7f937800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f93717fa700 1 -- 172.21.15.81:0/1435360222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937800e040 con 0x7f937c16d3c0 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f93717fa700 1 -- 172.21.15.81:0/1435360222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937800f040 con 0x7f937c16d3c0 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937c16ae90 con 0x7f937c16d3c0 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f93717fa700 1 -- 172.21.15.81:0/1435360222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378015430 con 0x7f937c16d3c0 2023-10-06T02:47:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.044+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937c16b450 con 0x7f937c16d3c0 2023-10-06T02:47:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.045+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937c06e700 con 0x7f937c16d3c0 2023-10-06T02:47:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.045+0000 7f93717fa700 1 -- 172.21.15.81:0/1435360222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9378015820 con 0x7f937c16d3c0 2023-10-06T02:47:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.046+0000 7f93717fa700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9360066f30 0x7f93600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.046+0000 7f93717fa700 1 -- 172.21.15.81:0/1435360222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9378085010 con 0x7f937c16d3c0 2023-10-06T02:47:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.046+0000 7f9380a9b700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9360066f30 0x7f93600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.046+0000 7f9380a9b700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9360066f30 0x7f93600693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f936c006f00 tx=0x7f936c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.050+0000 7f93717fa700 1 -- 172.21.15.81:0/1435360222 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9378052470 con 0x7f937c16d3c0 2023-10-06T02:47:27.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.232+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f937c0d0450 con 0x7f937c16d3c0 2023-10-06T02:47:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.736+0000 7f93717fa700 1 -- 172.21.15.81:0/1435360222 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9378055a90 con 0x7f937c16d3c0 2023-10-06T02:47:27.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.739+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9360066f30 msgr2=0x7f93600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.739+0000 7f9383500700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9360066f30 0x7f93600693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f936c006f00 tx=0x7f936c008040 comp rx=0 tx=0).stop 2023-10-06T02:47:27.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.739+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f937c16d3c0 msgr2=0x7f937c16b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.739+0000 7f9383500700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f937c16d3c0 0x7f937c16b730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9378009fd0 tx=0x7f937800b040 comp rx=0 tx=0).stop 2023-10-06T02:47:27.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.740+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 shutdown_connections 2023-10-06T02:47:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.740+0000 7f9383500700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9360066f30 0x7f93600693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.740+0000 7f9383500700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f937c15ec30 0x7f937c15f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.740+0000 7f9383500700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f937c16d3c0 0x7f937c16b730 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.740+0000 7f9383500700 1 --2- 172.21.15.81:0/1435360222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f937c16a520 0x7f937c158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.740+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 >> 172.21.15.81:0/1435360222 conn(0x7f937c06bb90 msgr2=0x7f937c06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.740+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 shutdown_connections 2023-10-06T02:47:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.740+0000 7f9383500700 1 -- 172.21.15.81:0/1435360222 wait complete. 2023-10-06T02:47:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:47:27.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:47:27.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.874+0000 7f2519db1700 1 Processor -- start 2023-10-06T02:47:27.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.874+0000 7f2519db1700 1 -- start start 2023-10-06T02:47:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f2519db1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2514154790 0x7f251406ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f2519db1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f251415e600 0x7f251406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f2519db1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25140ab990 con 0x7f2514069120 2023-10-06T02:47:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f2519db1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251415ede0 con 0x7f2514154790 2023-10-06T02:47:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f2519db1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25140abe20 con 0x7f251415e600 2023-10-06T02:47:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f25137fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2514154790 0x7f251406ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f2512ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2514069120 0x7f251415def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42484/0 (socket says 172.21.15.81:42484) 2023-10-06T02:47:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f2512ffd700 1 -- 172.21.15.81:0/1030371556 learned_addr learned my addr 172.21.15.81:0/1030371556 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f2513fff700 1 --2- 172.21.15.81:0/1030371556 >> v2:172.21.15.83:3300/0 conn(0x7f251415e600 0x7f251406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f25137fe700 1 -- 172.21.15.81:0/1030371556 >> v2:172.21.15.83:3300/0 conn(0x7f251415e600 msgr2=0x7f251406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f25137fe700 1 --2- 172.21.15.81:0/1030371556 >> v2:172.21.15.83:3300/0 conn(0x7f251415e600 0x7f251406bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f25137fe700 1 -- 172.21.15.81:0/1030371556 >> v1:172.21.15.81:6789/0 conn(0x7f2514069120 legacy=0x7f251415def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f25127fc700 1 -- 172.21.15.81:0/1030371556 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675722146 0 0) 0x7f25140ab990 con 0x7f2514069120 2023-10-06T02:47:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.875+0000 7f25137fe700 1 -- 172.21.15.81:0/1030371556 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2514069590 con 0x7f2514154790 2023-10-06T02:47:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f25137fe700 1 --2- 172.21.15.81:0/1030371556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 0x7f251406ae00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f25140b3370 tx=0x7f2504009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755f5a5538cb9ddb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f25127fc700 1 -- 172.21.15.81:0/1030371556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250400e070 con 0x7f2514154790 2023-10-06T02:47:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f25127fc700 1 -- 172.21.15.81:0/1030371556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250400bc30 con 0x7f2514154790 2023-10-06T02:47:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f25127fc700 1 -- 172.21.15.81:0/1030371556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504012430 con 0x7f2514154790 2023-10-06T02:47:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f2519db1700 1 -- 172.21.15.81:0/1030371556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 msgr2=0x7f251406ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f2519db1700 1 --2- 172.21.15.81:0/1030371556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 0x7f251406ae00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f25140b3370 tx=0x7f2504009780 comp rx=0 tx=0).stop 2023-10-06T02:47:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f2519db1700 1 -- 172.21.15.81:0/1030371556 shutdown_connections 2023-10-06T02:47:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f2519db1700 1 --2- 172.21.15.81:0/1030371556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 0x7f251406ae00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f2519db1700 1 --2- 172.21.15.81:0/1030371556 >> v2:172.21.15.83:3300/0 conn(0x7f251415e600 0x7f251406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f2519db1700 1 -- 172.21.15.81:0/1030371556 >> 172.21.15.81:0/1030371556 conn(0x7f251406e650 msgr2=0x7f25140cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f2519db1700 1 -- 172.21.15.81:0/1030371556 shutdown_connections 2023-10-06T02:47:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.876+0000 7f2519db1700 1 -- 172.21.15.81:0/1030371556 wait complete. 2023-10-06T02:47:27.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2519db1700 1 Processor -- start 2023-10-06T02:47:27.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2519db1700 1 -- start start 2023-10-06T02:47:27.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2519db1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2514069120 0x7f2514154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2519db1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 0x7f251416ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2519db1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251415e600 0x7f251416b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2519db1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251415c110 con 0x7f2514154790 2023-10-06T02:47:27.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2519db1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251415b500 con 0x7f2514069120 2023-10-06T02:47:27.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2519db1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251415b7e0 con 0x7f251415e600 2023-10-06T02:47:27.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2512ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 0x7f251416ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2512ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 0x7f251416ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40932/0 (socket says 172.21.15.81:40932) 2023-10-06T02:47:27.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.878+0000 7f2512ffd700 1 -- 172.21.15.81:0/3713232303 learned_addr learned my addr 172.21.15.81:0/3713232303 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f25137fe700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2514069120 0x7f2514154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f2513fff700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251415e600 0x7f251416b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f2512ffd700 1 -- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251415e600 msgr2=0x7f251416b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f2512ffd700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251415e600 0x7f251416b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f2512ffd700 1 -- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2514069120 msgr2=0x7f2514154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f2512ffd700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2514069120 0x7f2514154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f2512ffd700 1 -- 172.21.15.81:0/3713232303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2504009a20 con 0x7f2514154790 2023-10-06T02:47:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f2512ffd700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 0x7f251416ac00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00c5b0 tx=0x7f24fc001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f250b7fe700 1 -- 172.21.15.81:0/3713232303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc005b30 con 0x7f2514154790 2023-10-06T02:47:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f250b7fe700 1 -- 172.21.15.81:0/3713232303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc005c90 con 0x7f2514154790 2023-10-06T02:47:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251415bac0 con 0x7f2514154790 2023-10-06T02:47:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f250b7fe700 1 -- 172.21.15.81:0/3713232303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc007300 con 0x7f2514154790 2023-10-06T02:47:27.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.879+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25141550a0 con 0x7f2514154790 2023-10-06T02:47:27.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.880+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2514068360 con 0x7f2514154790 2023-10-06T02:47:27.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.881+0000 7f250b7fe700 1 -- 172.21.15.81:0/3713232303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24fc01b3b0 con 0x7f2514154790 2023-10-06T02:47:27.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.881+0000 7f250b7fe700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24f4066f30 0x7f24f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:27.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.881+0000 7f250b7fe700 1 -- 172.21.15.81:0/3713232303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f24fc083960 con 0x7f2514154790 2023-10-06T02:47:27.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.881+0000 7f25137fe700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24f4066f30 0x7f24f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:27.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.882+0000 7f25137fe700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24f4066f30 0x7f24f40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f25140b3370 tx=0x7f2504019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:27.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:27.886+0000 7f250b7fe700 1 -- 172.21.15.81:0/3713232303 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24fc050c50 con 0x7f2514154790 2023-10-06T02:47:28.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.065+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f25140aab40 con 0x7f2514154790 2023-10-06T02:47:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.742+0000 7f250b7fe700 1 -- 172.21.15.81:0/3713232303 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7f24fc0170d0 con 0x7f2514154790 2023-10-06T02:47:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24f4066f30 msgr2=0x7f24f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24f4066f30 0x7f24f40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f25140b3370 tx=0x7f2504019000 comp rx=0 tx=0).stop 2023-10-06T02:47:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 msgr2=0x7f251416ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 0x7f251416ac00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00c5b0 tx=0x7f24fc001070 comp rx=0 tx=0).stop 2023-10-06T02:47:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 shutdown_connections 2023-10-06T02:47:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251415e600 0x7f251416b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24f4066f30 0x7f24f40693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2514069120 0x7f2514154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 --2- 172.21.15.81:0/3713232303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2514154790 0x7f251416ac00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.750+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 >> 172.21.15.81:0/3713232303 conn(0x7f251406e650 msgr2=0x7f251406be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.751+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 shutdown_connections 2023-10-06T02:47:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.751+0000 7f2519db1700 1 -- 172.21.15.81:0/3713232303 wait complete. 2023-10-06T02:47:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:47:28.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:47:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.880+0000 7f68308e4700 1 Processor -- start 2023-10-06T02:47:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.880+0000 7f68308e4700 1 -- start start 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f68308e4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f682c0d0b80 0x7f682c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f68308e4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c06d700 0x7f682c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f68308e4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c0cf2d0 con 0x7f682c0d02b0 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f68308e4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682c15a690 con 0x7f682c0d0b80 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f68308e4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c06dc00 con 0x7f682c06d700 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f682c0d02b0 0x7f682c06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42490/0 (socket says 172.21.15.81:42490) 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682259c700 1 -- 172.21.15.81:0/3821104246 learned_addr learned my addr 172.21.15.81:0/3821104246 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682b59e700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c06d700 0x7f682c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085969396 0 0) 0x7f682c0cf2d0 con 0x7f682c0d02b0 2023-10-06T02:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6818003570 con 0x7f682c0d02b0 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682ad9d700 1 --2- 172.21.15.81:0/3821104246 >> v2:172.21.15.83:3300/0 conn(0x7f682c0d0b80 0x7f682c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2027591781 0 0) 0x7f6818003570 con 0x7f682c0d02b0 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c06d700 msgr2=0x7f682c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682a59c700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c06d700 0x7f682c15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 >> v2:172.21.15.83:3300/0 conn(0x7f682c0d0b80 msgr2=0x7f682c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682a59c700 1 --2- 172.21.15.81:0/3821104246 >> v2:172.21.15.83:3300/0 conn(0x7f682c0d0b80 0x7f682c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0cf570 con 0x7f682c0d02b0 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.881+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f6814001470 con 0x7f682c0d02b0 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 >> v1:172.21.15.81:6789/0 conn(0x7f682c0d02b0 legacy=0x7f682c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f6818003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6818004810 0x7f6818004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c06d700 0x7f68180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c15a690 con 0x7f6818003a60 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c06dc00 con 0x7f6818004810 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681800ba60 con 0x7f682c06d700 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682ad9d700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f6818003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682259c700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6818004810 0x7f6818004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682b59e700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c06d700 0x7f68180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682ad9d700 1 -- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c06d700 msgr2=0x7f68180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682ad9d700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c06d700 0x7f68180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682ad9d700 1 -- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6818004810 msgr2=0x7f6818004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682ad9d700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6818004810 0x7f6818004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682ad9d700 1 -- 172.21.15.81:0/3821104246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6818003570 con 0x7f6818003a60 2023-10-06T02:47:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682259c700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6818004810 0x7f6818004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682ad9d700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f6818003e70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f681c009c30 tx=0x7f681c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf540e5351caec5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00e710 con 0x7f6818003a60 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c00e870 con 0x7f6818003a60 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.882+0000 7f682a59c700 1 -- 172.21.15.81:0/3821104246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00ec30 con 0x7f6818003a60 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.883+0000 7f68308e4700 1 -- 172.21.15.81:0/3821104246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 msgr2=0x7f6818003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.883+0000 7f68308e4700 1 --2- 172.21.15.81:0/3821104246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f6818003e70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f681c009c30 tx=0x7f681c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.883+0000 7f682b59e700 1 -- 172.21.15.81:0/3821104246 reap_dead start 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.883+0000 7f68308e4700 1 -- 172.21.15.81:0/3821104246 shutdown_connections 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.883+0000 7f68308e4700 1 -- 172.21.15.81:0/3821104246 >> 172.21.15.81:0/3821104246 conn(0x7f682c063230 msgr2=0x7f682c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.883+0000 7f68308e4700 1 -- 172.21.15.81:0/3821104246 shutdown_connections 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.883+0000 7f68308e4700 1 -- 172.21.15.81:0/3821104246 wait complete. 2023-10-06T02:47:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.884+0000 7f68308e4700 1 Processor -- start 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.884+0000 7f68308e4700 1 -- start start 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68308e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f682c14a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68308e4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c0ae010 0x7f682c0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68308e4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f682c15fa00 0x7f682c15fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68308e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0aff40 con 0x7f6818003a60 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68308e4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c1603b0 con 0x7f682c15fa00 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68308e4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0ac820 con 0x7f682c0ae010 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f682c14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f682c14a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40960/0 (socket says 172.21.15.81:40960) 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682ad9d700 1 -- 172.21.15.81:0/1314524168 learned_addr learned my addr 172.21.15.81:0/1314524168 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682b59e700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f682c15fa00 0x7f682c15fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682ad9d700 1 -- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c0ae010 msgr2=0x7f682c0ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682ad9d700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c0ae010 0x7f682c0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682ad9d700 1 -- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f682c15fa00 msgr2=0x7f682c15fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682ad9d700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f682c15fa00 0x7f682c15fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682ad9d700 1 -- 172.21.15.81:0/1314524168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0acb00 con 0x7f6818003a60 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f682ad9d700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f682c14a650 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f681c00e4b0 tx=0x7f681c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68237fe700 1 -- 172.21.15.81:0/1314524168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c023070 con 0x7f6818003a60 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68237fe700 1 -- 172.21.15.81:0/1314524168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c00e9e0 con 0x7f6818003a60 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68237fe700 1 -- 172.21.15.81:0/1314524168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c01e030 con 0x7f6818003a60 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c0acde0 con 0x7f6818003a60 2023-10-06T02:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.885+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c0ad0c0 con 0x7f6818003a60 2023-10-06T02:47:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.886+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c0afd10 con 0x7f6818003a60 2023-10-06T02:47:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.887+0000 7f68237fe700 1 -- 172.21.15.81:0/1314524168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f681c013470 con 0x7f6818003a60 2023-10-06T02:47:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.887+0000 7f68237fe700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f680c066f30 0x7f680c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.887+0000 7f68237fe700 1 -- 172.21.15.81:0/1314524168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f681c085c20 con 0x7f6818003a60 2023-10-06T02:47:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.887+0000 7f682259c700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f680c066f30 0x7f680c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.888+0000 7f682259c700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f680c066f30 0x7f680c0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f68140015e0 tx=0x7f682c0cf460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:28.891+0000 7f68237fe700 1 -- 172.21.15.81:0/1314524168 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f682c0afd10 con 0x7f6818003a60 2023-10-06T02:47:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.115+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f682c0afd10 con 0x7f6818003a60 2023-10-06T02:47:29.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.750+0000 7f68237fe700 1 -- 172.21.15.81:0/1314524168 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f682c0afd10 con 0x7f6818003a60 2023-10-06T02:47:29.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f680c066f30 msgr2=0x7f680c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:29.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f680c066f30 0x7f680c0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f68140015e0 tx=0x7f682c0cf460 comp rx=0 tx=0).stop 2023-10-06T02:47:29.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 msgr2=0x7f682c14a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:29.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f682c14a650 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f681c00e4b0 tx=0x7f681c01a000 comp rx=0 tx=0).stop 2023-10-06T02:47:29.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 shutdown_connections 2023-10-06T02:47:29.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f680c066f30 0x7f680c0693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f682c15fa00 0x7f682c15fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818003a60 0x7f682c14a650 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 --2- 172.21.15.81:0/1314524168 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f682c0ae010 0x7f682c0ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 >> 172.21.15.81:0/1314524168 conn(0x7f682c063230 msgr2=0x7f682c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:29.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 shutdown_connections 2023-10-06T02:47:29.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.754+0000 7f68308e4700 1 -- 172.21.15.81:0/1314524168 wait complete. 2023-10-06T02:47:29.758 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 7 and data pool 8 2023-10-06T02:47:29.770 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:29.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.882+0000 7f7662e16700 1 Processor -- start 2023-10-06T02:47:29.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.883+0000 7f7662e16700 1 -- start start 2023-10-06T02:47:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.883+0000 7f7662e16700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f765c15a2a0 0x7f765c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.883+0000 7f7662e16700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f765c0ceb30 0x7f765c0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.883+0000 7f7662e16700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0b0ca0 con 0x7f765c06d650 2023-10-06T02:47:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.883+0000 7f7662e16700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c06e160 con 0x7f765c0ceb30 2023-10-06T02:47:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.883+0000 7f7662e16700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c06ea90 con 0x7f765c15a2a0 2023-10-06T02:47:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.883+0000 7f7653fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f765c0ceb30 0x7f765c0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.883+0000 7f76613b3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f765c06d650 0x7f765c06da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42498/0 (socket says 172.21.15.81:42498) 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.883+0000 7f76613b3700 1 -- 172.21.15.81:0/317523761 learned_addr learned my addr 172.21.15.81:0/317523761 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f7660bb2700 1 --2- 172.21.15.81:0/317523761 >> v2:172.21.15.83:3300/0 conn(0x7f765c15a2a0 0x7f765c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f7653fff700 1 -- 172.21.15.81:0/317523761 >> v2:172.21.15.83:3300/0 conn(0x7f765c15a2a0 msgr2=0x7f765c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f7653fff700 1 --2- 172.21.15.81:0/317523761 >> v2:172.21.15.83:3300/0 conn(0x7f765c15a2a0 0x7f765c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f7653fff700 1 -- 172.21.15.81:0/317523761 >> v1:172.21.15.81:6789/0 conn(0x7f765c06d650 legacy=0x7f765c06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f76537fe700 1 -- 172.21.15.81:0/317523761 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836936648 0 0) 0x7f765c0b0ca0 con 0x7f765c06d650 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f7653fff700 1 -- 172.21.15.81:0/317523761 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0b00d0 con 0x7f765c0ceb30 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f7653fff700 1 --2- 172.21.15.81:0/317523761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 0x7f765c0cefb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f765c0637a0 tx=0x7f764c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688c0a1761a6a4c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f76537fe700 1 -- 172.21.15.81:0/317523761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c011630 con 0x7f765c0ceb30 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f76537fe700 1 -- 172.21.15.81:0/317523761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c011790 con 0x7f765c0ceb30 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.884+0000 7f76537fe700 1 -- 172.21.15.81:0/317523761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c011b30 con 0x7f765c0ceb30 2023-10-06T02:47:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.885+0000 7f7662e16700 1 -- 172.21.15.81:0/317523761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 msgr2=0x7f765c0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.885+0000 7f7662e16700 1 --2- 172.21.15.81:0/317523761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 0x7f765c0cefb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f765c0637a0 tx=0x7f764c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.885+0000 7f7662e16700 1 -- 172.21.15.81:0/317523761 shutdown_connections 2023-10-06T02:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.885+0000 7f7662e16700 1 --2- 172.21.15.81:0/317523761 >> v2:172.21.15.83:3300/0 conn(0x7f765c15a2a0 0x7f765c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.885+0000 7f7662e16700 1 --2- 172.21.15.81:0/317523761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 0x7f765c0cefb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.885+0000 7f7662e16700 1 -- 172.21.15.81:0/317523761 >> 172.21.15.81:0/317523761 conn(0x7f765c067640 msgr2=0x7f765c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.885+0000 7f7662e16700 1 -- 172.21.15.81:0/317523761 shutdown_connections 2023-10-06T02:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.885+0000 7f7662e16700 1 -- 172.21.15.81:0/317523761 wait complete. 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.886+0000 7f7662e16700 1 Processor -- start 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.886+0000 7f7662e16700 1 -- start start 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7662e16700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c06d650 0x7f765c14a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7662e16700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 0x7f765c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7662e16700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c15a2a0 0x7f765c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7662e16700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0b1940 con 0x7f765c0ceb30 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7662e16700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0b28e0 con 0x7f765c06d650 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7662e16700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0b3810 con 0x7f765c15a2a0 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7653fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 0x7f765c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7653fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 0x7f765c0b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40982/0 (socket says 172.21.15.81:40982) 2023-10-06T02:47:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7653fff700 1 -- 172.21.15.81:0/2222039551 learned_addr learned my addr 172.21.15.81:0/2222039551 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7660bb2700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c06d650 0x7f765c14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7653fff700 1 -- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c15a2a0 msgr2=0x7f765c15b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7653fff700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c15a2a0 0x7f765c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7653fff700 1 -- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c06d650 msgr2=0x7f765c14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7653fff700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c06d650 0x7f765c14a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7653fff700 1 -- 172.21.15.81:0/2222039551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c009420 con 0x7f765c0ceb30 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7653fff700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 0x7f765c0b32d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f765c06f990 tx=0x7f764c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7650ff9700 1 -- 172.21.15.81:0/2222039551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c011b10 con 0x7f765c0ceb30 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7650ff9700 1 -- 172.21.15.81:0/2222039551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c0253f0 con 0x7f765c0ceb30 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c0b2450 con 0x7f765c0ceb30 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7650ff9700 1 -- 172.21.15.81:0/2222039551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c025790 con 0x7f765c0ceb30 2023-10-06T02:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.887+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c0b1e00 con 0x7f765c0ceb30 2023-10-06T02:47:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.888+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c0b25e0 con 0x7f765c0ceb30 2023-10-06T02:47:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.889+0000 7f7650ff9700 1 -- 172.21.15.81:0/2222039551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f764c025b80 con 0x7f765c0ceb30 2023-10-06T02:47:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.889+0000 7f7650ff9700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7648066f30 0x7f76480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.889+0000 7f7650ff9700 1 -- 172.21.15.81:0/2222039551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f764c085fb0 con 0x7f765c0ceb30 2023-10-06T02:47:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.889+0000 7f7660bb2700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7648066f30 0x7f76480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.890+0000 7f7660bb2700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7648066f30 0x7f76480693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f765c0b3040 tx=0x7f7658008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:29.893+0000 7f7650ff9700 1 -- 172.21.15.81:0/2222039551 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f764c0b75a0 con 0x7f765c0ceb30 2023-10-06T02:47:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.076+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f765c04bb80 con 0x7f765c0ceb30 2023-10-06T02:47:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.077+0000 7f7650ff9700 1 -- 172.21.15.81:0/2222039551 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f764c0530c0 con 0x7f765c0ceb30 2023-10-06T02:47:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:30.078 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:29.116695+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:47:27.250251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:47:28.083304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7648066f30 msgr2=0x7f76480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7648066f30 0x7f76480693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f765c0b3040 tx=0x7f7658008040 comp rx=0 tx=0).stop 2023-10-06T02:47:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 msgr2=0x7f765c0b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 0x7f765c0b32d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f765c06f990 tx=0x7f764c017000 comp rx=0 tx=0).stop 2023-10-06T02:47:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 shutdown_connections 2023-10-06T02:47:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f765c15a2a0 0x7f765c15b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7648066f30 0x7f76480693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f765c06d650 0x7f765c14a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 --2- 172.21.15.81:0/2222039551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765c0ceb30 0x7f765c0b32d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 >> 172.21.15.81:0/2222039551 conn(0x7f765c067640 msgr2=0x7f765c0cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 shutdown_connections 2023-10-06T02:47:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.079+0000 7f7662e16700 1 -- 172.21.15.81:0/2222039551 wait complete. 2023-10-06T02:47:30.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:30.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.204+0000 7f86ade6a700 1 Processor -- start 2023-10-06T02:47:30.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.204+0000 7f86ade6a700 1 -- start start 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.205+0000 7f86ade6a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86a806d830 0x7f86a80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.205+0000 7f86ade6a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a80d07c0 con 0x7f86a8157ca0 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.205+0000 7f86ade6a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a80cfbb0 con 0x7f86a81578d0 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.205+0000 7f86ade6a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a80cfe90 con 0x7f86a806d830 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.205+0000 7f86a7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86a806d830 0x7f86a80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.205+0000 7f86a6ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f86a8157ca0 0x7f86a806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42500/0 (socket says 172.21.15.81:42500) 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.205+0000 7f86a6ffd700 1 -- 172.21.15.81:0/3401914280 learned_addr learned my addr 172.21.15.81:0/3401914280 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.205+0000 7f86a7fff700 1 -- 172.21.15.81:0/3401914280 >> v1:172.21.15.83:6789/0 conn(0x7f86a81578d0 legacy=0x7f86a815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86a7fff700 1 -- 172.21.15.81:0/3401914280 >> v1:172.21.15.81:6789/0 conn(0x7f86a8157ca0 legacy=0x7f86a806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86a7fff700 1 -- 172.21.15.81:0/3401914280 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a80d0170 con 0x7f86a806d830 2023-10-06T02:47:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86a67fc700 1 -- 172.21.15.81:0/3401914280 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512694537 0 0) 0x7f86a80d07c0 con 0x7f86a8157ca0 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86a7fff700 1 --2- 172.21.15.81:0/3401914280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 0x7f86a80cf4f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f86a00098e0 tx=0x7f86a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560d9829d4ccd902 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86a67fc700 1 -- 172.21.15.81:0/3401914280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0009e80 con 0x7f86a806d830 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86a67fc700 1 -- 172.21.15.81:0/3401914280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a000b860 con 0x7f86a806d830 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86a67fc700 1 -- 172.21.15.81:0/3401914280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a000bbe0 con 0x7f86a806d830 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86ade6a700 1 -- 172.21.15.81:0/3401914280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 msgr2=0x7f86a80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86ade6a700 1 --2- 172.21.15.81:0/3401914280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 0x7f86a80cf4f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f86a00098e0 tx=0x7f86a00091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86ade6a700 1 -- 172.21.15.81:0/3401914280 shutdown_connections 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86ade6a700 1 --2- 172.21.15.81:0/3401914280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 0x7f86a80cf4f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86ade6a700 1 -- 172.21.15.81:0/3401914280 >> 172.21.15.81:0/3401914280 conn(0x7f86a806bb90 msgr2=0x7f86a806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86ade6a700 1 -- 172.21.15.81:0/3401914280 shutdown_connections 2023-10-06T02:47:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.206+0000 7f86ade6a700 1 -- 172.21.15.81:0/3401914280 wait complete. 2023-10-06T02:47:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86ade6a700 1 Processor -- start 2023-10-06T02:47:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86ade6a700 1 -- start start 2023-10-06T02:47:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86ade6a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 0x7f86a8154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86ade6a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a81578d0 0x7f86a80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86ade6a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86a8157ca0 0x7f86a80b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86ade6a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a8154fa0 con 0x7f86a806d830 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86ade6a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a815ea20 con 0x7f86a81578d0 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86ade6a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a80b60f0 con 0x7f86a8157ca0 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 0x7f86a8154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 0x7f86a8154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40988/0 (socket says 172.21.15.81:40988) 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.208+0000 7f86a77fe700 1 -- 172.21.15.81:0/2759955978 learned_addr learned my addr 172.21.15.81:0/2759955978 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86a6ffd700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a81578d0 0x7f86a80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86a7fff700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86a8157ca0 0x7f86a80b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86a77fe700 1 -- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86a8157ca0 msgr2=0x7f86a80b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86a77fe700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86a8157ca0 0x7f86a80b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86a77fe700 1 -- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a81578d0 msgr2=0x7f86a80b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86a77fe700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a81578d0 0x7f86a80b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86a77fe700 1 -- 172.21.15.81:0/2759955978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a0009420 con 0x7f86a806d830 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86a77fe700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 0x7f86a8154a60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f869800cb10 tx=0x7f86980017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f868f7fe700 1 -- 172.21.15.81:0/2759955978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800ce20 con 0x7f86a806d830 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f868f7fe700 1 -- 172.21.15.81:0/2759955978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869800a7e0 con 0x7f86a806d830 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a80b63d0 con 0x7f86a806d830 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f868f7fe700 1 -- 172.21.15.81:0/2759955978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800aba0 con 0x7f86a806d830 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.209+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a80b6990 con 0x7f86a806d830 2023-10-06T02:47:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.210+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a8067ac0 con 0x7f86a806d830 2023-10-06T02:47:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.211+0000 7f868f7fe700 1 -- 172.21.15.81:0/2759955978 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8698003030 con 0x7f86a806d830 2023-10-06T02:47:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.211+0000 7f868f7fe700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8694066f30 0x7f86940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.211+0000 7f868f7fe700 1 -- 172.21.15.81:0/2759955978 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f86980846c0 con 0x7f86a806d830 2023-10-06T02:47:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.211+0000 7f86a6ffd700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8694066f30 0x7f86940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.211+0000 7f86a6ffd700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8694066f30 0x7f86940693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f86a815f0e0 tx=0x7f869c007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.215+0000 7f868f7fe700 1 -- 172.21.15.81:0/2759955978 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8698051730 con 0x7f86a806d830 2023-10-06T02:47:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.403+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86a80d0450 con 0x7f86a806d830 2023-10-06T02:47:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.404+0000 7f868f7fe700 1 -- 172.21.15.81:0/2759955978 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f8698054d50 con 0x7f86a806d830 2023-10-06T02:47:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:30.405 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":48,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:30.359304+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:47:27.250251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:47:28.083304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8694066f30 msgr2=0x7f86940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8694066f30 0x7f86940693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f86a815f0e0 tx=0x7f869c007f50 comp rx=0 tx=0).stop 2023-10-06T02:47:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 msgr2=0x7f86a8154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 0x7f86a8154a60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f869800cb10 tx=0x7f86980017b0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 shutdown_connections 2023-10-06T02:47:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86a8157ca0 0x7f86a80b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a806d830 0x7f86a8154a60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8694066f30 0x7f86940693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 --2- 172.21.15.81:0/2759955978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a81578d0 0x7f86a80b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 >> 172.21.15.81:0/2759955978 conn(0x7f86a806bb90 msgr2=0x7f86a81567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 shutdown_connections 2023-10-06T02:47:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.406+0000 7f86ade6a700 1 -- 172.21.15.81:0/2759955978 wait complete. 2023-10-06T02:47:30.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:47:30.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.535+0000 7f3dc63a7700 1 Processor -- start 2023-10-06T02:47:30.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.535+0000 7f3dc63a7700 1 -- start start 2023-10-06T02:47:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dc63a7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3dc01578d0 0x7f3dc00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dc63a7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dc63a7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc00d07c0 con 0x7f3dc006d120 2023-10-06T02:47:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dc63a7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc00cfbb0 con 0x7f3dc01578d0 2023-10-06T02:47:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dc63a7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00cfe90 con 0x7f3dc0157ca0 2023-10-06T02:47:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dbffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3dc01578d0 0x7f3dc00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dbf7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dbf7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:35800/0 (socket says 172.21.15.81:35800) 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dbffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3dc01578d0 0x7f3dc00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:48208/0 (socket says 172.21.15.81:48208) 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dc4944700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3dc006d120 0x7f3dc015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:54468/0 (socket says 172.21.15.81:54468) 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.536+0000 7f3dbf7fe700 1 -- 172.21.15.81:0/1786467014 learned_addr learned my addr 172.21.15.81:0/1786467014 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbffff700 1 -- 172.21.15.81:0/1786467014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 msgr2=0x7f3dc015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbffff700 1 --2- 172.21.15.81:0/1786467014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbffff700 1 -- 172.21.15.81:0/1786467014 >> v1:172.21.15.83:6789/0 conn(0x7f3dc006d120 legacy=0x7f3dc015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbffff700 1 -- 172.21.15.81:0/1786467014 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc00d0170 con 0x7f3dc01578d0 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbeffd700 1 -- 172.21.15.81:0/1786467014 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925045067 0 0) 0x7f3dc00d07c0 con 0x7f3dc006d120 2023-10-06T02:47:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbf7fe700 1 --2- 172.21.15.81:0/1786467014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbffff700 1 --2- 172.21.15.81:0/1786467014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dc01578d0 0x7f3dc00cf4f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3db00098e0 tx=0x7f3db00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dbfbeab380046d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbeffd700 1 -- 172.21.15.81:0/1786467014 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db000b640 con 0x7f3dc01578d0 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbeffd700 1 -- 172.21.15.81:0/1786467014 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db000b7a0 con 0x7f3dc01578d0 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.537+0000 7f3dbeffd700 1 -- 172.21.15.81:0/1786467014 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db000bb40 con 0x7f3dc01578d0 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.538+0000 7f3dc63a7700 1 -- 172.21.15.81:0/1786467014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dc01578d0 msgr2=0x7f3dc00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.538+0000 7f3dc63a7700 1 --2- 172.21.15.81:0/1786467014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dc01578d0 0x7f3dc00cf4f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3db00098e0 tx=0x7f3db00091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.538+0000 7f3dc63a7700 1 -- 172.21.15.81:0/1786467014 shutdown_connections 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.538+0000 7f3dc63a7700 1 --2- 172.21.15.81:0/1786467014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dc01578d0 0x7f3dc00cf4f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.538+0000 7f3dc63a7700 1 --2- 172.21.15.81:0/1786467014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.538+0000 7f3dc63a7700 1 -- 172.21.15.81:0/1786467014 >> 172.21.15.81:0/1786467014 conn(0x7f3dc006bb90 msgr2=0x7f3dc006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:30.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.538+0000 7f3dc63a7700 1 -- 172.21.15.81:0/1786467014 shutdown_connections 2023-10-06T02:47:30.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.538+0000 7f3dc63a7700 1 -- 172.21.15.81:0/1786467014 wait complete. 2023-10-06T02:47:30.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.539+0000 7f3dc63a7700 1 Processor -- start 2023-10-06T02:47:30.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.539+0000 7f3dc63a7700 1 -- start start 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dc63a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dc006d120 0x7f3dc01546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dc63a7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dc01578d0 0x7f3dc0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dc63a7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc0069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dc63a7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00c8420 con 0x7f3dc006d120 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dc63a7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00c9240 con 0x7f3dc01578d0 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dc63a7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00c8630 con 0x7f3dc0157ca0 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dc006d120 0x7f3dc01546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dc006d120 0x7f3dc01546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56060/0 (socket says 172.21.15.81:56060) 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbffff700 1 -- 172.21.15.81:0/2513923829 learned_addr learned my addr 172.21.15.81:0/2513923829 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:30.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbf7fe700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dc01578d0 0x7f3dc0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dc4944700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc0069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbffff700 1 -- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 msgr2=0x7f3dc0069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbffff700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc0069a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbffff700 1 -- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dc01578d0 msgr2=0x7f3dc0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbffff700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dc01578d0 0x7f3dc0156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbffff700 1 -- 172.21.15.81:0/2513923829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db40094f0 con 0x7f3dc006d120 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dbffff700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dc006d120 0x7f3dc01546c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3dc006fe20 tx=0x7f3db0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3da7fff700 1 -- 172.21.15.81:0/2513923829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db000bb20 con 0x7f3dc006d120 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3da7fff700 1 -- 172.21.15.81:0/2513923829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db0000c90 con 0x7f3dc006d120 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db0009420 con 0x7f3dc006d120 2023-10-06T02:47:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.540+0000 7f3da7fff700 1 -- 172.21.15.81:0/2513923829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0011650 con 0x7f3dc006d120 2023-10-06T02:47:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.541+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc00c8bf0 con 0x7f3dc006d120 2023-10-06T02:47:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.541+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc0067ac0 con 0x7f3dc006d120 2023-10-06T02:47:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.543+0000 7f3da7fff700 1 -- 172.21.15.81:0/2513923829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3db0011a00 con 0x7f3dc006d120 2023-10-06T02:47:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.543+0000 7f3da7fff700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3dac066f30 0x7f3dac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.543+0000 7f3da7fff700 1 -- 172.21.15.81:0/2513923829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3db0085d30 con 0x7f3dc006d120 2023-10-06T02:47:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.543+0000 7f3dbf7fe700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3dac066f30 0x7f3dac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.544+0000 7f3dbf7fe700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3dac066f30 0x7f3dac0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00cecd0 tx=0x7f3db4009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.547+0000 7f3da7fff700 1 -- 172.21.15.81:0/2513923829 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3db0052da0 con 0x7f3dc006d120 2023-10-06T02:47:30.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:30.778+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3dc00d0450 con 0x7f3dc006d120 2023-10-06T02:47:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.769+0000 7f3da7fff700 1 -- 172.21.15.81:0/2513923829 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3db0011cb0 con 0x7f3dc006d120 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3dac066f30 msgr2=0x7f3dac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3dac066f30 0x7f3dac0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00cecd0 tx=0x7f3db4009250 comp rx=0 tx=0).stop 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dc006d120 msgr2=0x7f3dc01546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dc006d120 0x7f3dc01546c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3dc006fe20 tx=0x7f3db0017000 comp rx=0 tx=0).stop 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 shutdown_connections 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3dc0157ca0 0x7f3dc0069a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dc006d120 0x7f3dc01546c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3dac066f30 0x7f3dac0693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 --2- 172.21.15.81:0/2513923829 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dc01578d0 0x7f3dc0156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 >> 172.21.15.81:0/2513923829 conn(0x7f3dc006bb90 msgr2=0x7f3dc0155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:31.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.771+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 shutdown_connections 2023-10-06T02:47:31.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.772+0000 7f3dc63a7700 1 -- 172.21.15.81:0/2513923829 wait complete. 2023-10-06T02:47:31.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:47:31.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.904+0000 7f738ce6f700 1 Processor -- start 2023-10-06T02:47:31.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.904+0000 7f738ce6f700 1 -- start start 2023-10-06T02:47:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f738ce6f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0f50 0x7f738806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f738ce6f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f738806d530 0x7f738815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f738ce6f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738806d9b0 con 0x7f73880d0b80 2023-10-06T02:47:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f738ce6f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738815a690 con 0x7f738806d530 2023-10-06T02:47:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f738ce6f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73880cf2d0 con 0x7f73880d0f50 2023-10-06T02:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f7387fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f738806d530 0x7f738815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f73877fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f73880d0b80 0x7f73880cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46840/0 (socket says 172.21.15.81:46840) 2023-10-06T02:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f73877fe700 1 -- 172.21.15.81:0/2683526514 learned_addr learned my addr 172.21.15.81:0/2683526514 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f7386ffd700 1 --2- 172.21.15.81:0/2683526514 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0f50 0x7f738806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f7387fff700 1 -- 172.21.15.81:0/2683526514 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0f50 msgr2=0x7f738806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f7387fff700 1 --2- 172.21.15.81:0/2683526514 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0f50 0x7f738806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f7387fff700 1 -- 172.21.15.81:0/2683526514 >> v1:172.21.15.81:6789/0 conn(0x7f73880d0b80 legacy=0x7f73880cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f7387fff700 1 -- 172.21.15.81:0/2683526514 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73880d0480 con 0x7f738806d530 2023-10-06T02:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f73867fc700 1 -- 172.21.15.81:0/2683526514 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188232312 0 0) 0x7f738806d9b0 con 0x7f73880d0b80 2023-10-06T02:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f7387fff700 1 --2- 172.21.15.81:0/2683526514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f738806d530 0x7f738815b320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f73800098e0 tx=0x7f73800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ca4ca619b3c826 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f73867fc700 1 -- 172.21.15.81:0/2683526514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380009e80 con 0x7f738806d530 2023-10-06T02:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f73867fc700 1 -- 172.21.15.81:0/2683526514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738000b860 con 0x7f738806d530 2023-10-06T02:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.905+0000 7f73867fc700 1 -- 172.21.15.81:0/2683526514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738000bbe0 con 0x7f738806d530 2023-10-06T02:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.906+0000 7f738ce6f700 1 -- 172.21.15.81:0/2683526514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f738806d530 msgr2=0x7f738815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.906+0000 7f738ce6f700 1 --2- 172.21.15.81:0/2683526514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f738806d530 0x7f738815b320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f73800098e0 tx=0x7f73800091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.906+0000 7f738ce6f700 1 -- 172.21.15.81:0/2683526514 shutdown_connections 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.906+0000 7f738ce6f700 1 --2- 172.21.15.81:0/2683526514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f738806d530 0x7f738815b320 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.906+0000 7f738ce6f700 1 --2- 172.21.15.81:0/2683526514 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0f50 0x7f738806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.906+0000 7f738ce6f700 1 -- 172.21.15.81:0/2683526514 >> 172.21.15.81:0/2683526514 conn(0x7f7388063230 msgr2=0x7f7388063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.906+0000 7f738ce6f700 1 -- 172.21.15.81:0/2683526514 shutdown_connections 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.906+0000 7f738ce6f700 1 -- 172.21.15.81:0/2683526514 wait complete. 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.907+0000 7f738ce6f700 1 Processor -- start 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.907+0000 7f738ce6f700 1 -- start start 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f738ce6f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738806d530 0x7f73880ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f738ce6f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0b80 0x7f738816a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f738ce6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73880d0f50 0x7f738816cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f738ce6f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73880b46a0 con 0x7f73880d0f50 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f738ce6f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73880abf40 con 0x7f738806d530 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f738ce6f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73880b4050 con 0x7f73880d0b80 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7387fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73880d0f50 0x7f738816cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7387fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73880d0f50 0x7f738816cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56088/0 (socket says 172.21.15.81:56088) 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7387fff700 1 -- 172.21.15.81:0/1398891967 learned_addr learned my addr 172.21.15.81:0/1398891967 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f73877fe700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738806d530 0x7f73880ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7386ffd700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0b80 0x7f738816a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7387fff700 1 -- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0b80 msgr2=0x7f738816a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7387fff700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0b80 0x7f738816a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7387fff700 1 -- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738806d530 msgr2=0x7f73880ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7387fff700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738806d530 0x7f73880ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7387fff700 1 -- 172.21.15.81:0/1398891967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380009420 con 0x7f73880d0f50 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f7387fff700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73880d0f50 0x7f738816cf00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f738000b3c0 tx=0x7f7380017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f736f7fe700 1 -- 172.21.15.81:0/1398891967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380011630 con 0x7f73880d0f50 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f736f7fe700 1 -- 172.21.15.81:0/1398891967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7380011790 con 0x7f73880d0f50 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f736f7fe700 1 -- 172.21.15.81:0/1398891967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380011b50 con 0x7f73880d0f50 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.908+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73880b4330 con 0x7f73880d0f50 2023-10-06T02:47:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.909+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738816d440 con 0x7f73880d0f50 2023-10-06T02:47:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.909+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73880b3eb0 con 0x7f73880d0f50 2023-10-06T02:47:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.910+0000 7f736f7fe700 1 -- 172.21.15.81:0/1398891967 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73800253f0 con 0x7f73880d0f50 2023-10-06T02:47:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.910+0000 7f736f7fe700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7374066f30 0x7f73740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.910+0000 7f736f7fe700 1 -- 172.21.15.81:0/1398891967 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7380086250 con 0x7f73880d0f50 2023-10-06T02:47:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.911+0000 7f73877fe700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7374066f30 0x7f73740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.911+0000 7f73877fe700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7374066f30 0x7f73740693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7378001560 tx=0x7f7378009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:31.914+0000 7f736f7fe700 1 -- 172.21.15.81:0/1398891967 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73880b3eb0 con 0x7f73880d0f50 2023-10-06T02:47:32.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.140+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f73880b3eb0 con 0x7f73880d0f50 2023-10-06T02:47:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.775+0000 7f736f7fe700 1 -- 172.21.15.81:0/1398891967 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f73880b3eb0 con 0x7f73880d0f50 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7374066f30 msgr2=0x7f73740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7374066f30 0x7f73740693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7378001560 tx=0x7f7378009040 comp rx=0 tx=0).stop 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73880d0f50 msgr2=0x7f738816cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73880d0f50 0x7f738816cf00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f738000b3c0 tx=0x7f7380017000 comp rx=0 tx=0).stop 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 shutdown_connections 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73880d0f50 0x7f738816cf00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7374066f30 0x7f73740693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738806d530 0x7f73880ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 --2- 172.21.15.81:0/1398891967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f73880d0b80 0x7f738816a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 >> 172.21.15.81:0/1398891967 conn(0x7f7388063230 msgr2=0x7f738815b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:32.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 shutdown_connections 2023-10-06T02:47:32.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.777+0000 7f738ce6f700 1 -- 172.21.15.81:0/1398891967 wait complete. 2023-10-06T02:47:32.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.903+0000 7fe1f65ef700 1 Processor -- start 2023-10-06T02:47:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.903+0000 7fe1f65ef700 1 -- start start 2023-10-06T02:47:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.904+0000 7fe1f65ef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1f006c190 0x7fe1f00b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.904+0000 7fe1f65ef700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe1f00b3170 0x7fe1f006a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.904+0000 7fe1f65ef700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f0069d10 con 0x7fe1f0157a60 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.904+0000 7fe1f65ef700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f00b35b0 con 0x7fe1f006c190 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.904+0000 7fe1f65ef700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f015c130 con 0x7fe1f00b3170 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.904+0000 7fe1ef7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1f006c190 0x7fe1f00b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.904+0000 7fe1ef7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1f006c190 0x7fe1f00b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56098/0 (socket says 172.21.15.81:56098) 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.904+0000 7fe1ef7fe700 1 -- 172.21.15.81:0/95383416 learned_addr learned my addr 172.21.15.81:0/95383416 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.904+0000 7fe1f4b8c700 1 --2- 172.21.15.81:0/95383416 >> v2:172.21.15.83:3300/0 conn(0x7fe1f00b3170 0x7fe1f006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1ef7fe700 1 -- 172.21.15.81:0/95383416 >> v2:172.21.15.83:3300/0 conn(0x7fe1f00b3170 msgr2=0x7fe1f006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1ef7fe700 1 --2- 172.21.15.81:0/95383416 >> v2:172.21.15.83:3300/0 conn(0x7fe1f00b3170 0x7fe1f006a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1ef7fe700 1 -- 172.21.15.81:0/95383416 >> v1:172.21.15.83:6789/0 conn(0x7fe1f0157a60 legacy=0x7fe1f015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1ef7fe700 1 -- 172.21.15.81:0/95383416 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f015c410 con 0x7fe1f006c190 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1ef7fe700 1 --2- 172.21.15.81:0/95383416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f006c190 0x7fe1f00b2c30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00ceb60 tx=0x7fe1e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd1c8c0d8622e66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1eeffd700 1 -- 172.21.15.81:0/95383416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4009e70 con 0x7fe1f006c190 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1eeffd700 1 -- 172.21.15.81:0/95383416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e400b860 con 0x7fe1f006c190 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1eeffd700 1 -- 172.21.15.81:0/95383416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e400bc00 con 0x7fe1f006c190 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1f65ef700 1 -- 172.21.15.81:0/95383416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f006c190 msgr2=0x7fe1f00b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.905+0000 7fe1f65ef700 1 --2- 172.21.15.81:0/95383416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f006c190 0x7fe1f00b2c30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00ceb60 tx=0x7fe1e4009250 comp rx=0 tx=0).stop 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.906+0000 7fe1f65ef700 1 -- 172.21.15.81:0/95383416 shutdown_connections 2023-10-06T02:47:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.906+0000 7fe1f65ef700 1 --2- 172.21.15.81:0/95383416 >> v2:172.21.15.83:3300/0 conn(0x7fe1f00b3170 0x7fe1f006a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:32.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.906+0000 7fe1f65ef700 1 --2- 172.21.15.81:0/95383416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f006c190 0x7fe1f00b2c30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:32.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.906+0000 7fe1f65ef700 1 -- 172.21.15.81:0/95383416 >> 172.21.15.81:0/95383416 conn(0x7fe1f006cca0 msgr2=0x7fe1f006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:32.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.906+0000 7fe1f65ef700 1 -- 172.21.15.81:0/95383416 shutdown_connections 2023-10-06T02:47:32.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.906+0000 7fe1f65ef700 1 -- 172.21.15.81:0/95383416 wait complete. 2023-10-06T02:47:32.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.907+0000 7fe1f65ef700 1 Processor -- start 2023-10-06T02:47:32.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.907+0000 7fe1f65ef700 1 -- start start 2023-10-06T02:47:32.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1f65ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe1f006c190 0x7fe1f0143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:32.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1f65ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f00b3170 0x7fe1f00a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:32.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1f65ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1f0157a60 0x7fe1f0153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:32.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1f65ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f016b890 con 0x7fe1f00b3170 2023-10-06T02:47:32.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1f65ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f016bb70 con 0x7fe1f0157a60 2023-10-06T02:47:32.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1f65ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f016be50 con 0x7fe1f006c190 2023-10-06T02:47:32.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f00b3170 0x7fe1f00a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:32.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f00b3170 0x7fe1f00a6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56104/0 (socket says 172.21.15.81:56104) 2023-10-06T02:47:32.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1ef7fe700 1 -- 172.21.15.81:0/4200206791 learned_addr learned my addr 172.21.15.81:0/4200206791 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:32.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1effff700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe1f006c190 0x7fe1f0143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:32.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1f4b8c700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1f0157a60 0x7fe1f0153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:32.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1ef7fe700 1 -- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe1f006c190 msgr2=0x7fe1f0143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:32.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1ef7fe700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe1f006c190 0x7fe1f0143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:32.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1ef7fe700 1 -- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1f0157a60 msgr2=0x7fe1f0153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:32.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1ef7fe700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1f0157a60 0x7fe1f0153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:32.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1ef7fe700 1 -- 172.21.15.81:0/4200206791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40094f0 con 0x7fe1f00b3170 2023-10-06T02:47:32.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1ef7fe700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f00b3170 0x7fe1f00a6530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00714a0 tx=0x7fe1e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:32.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1d7fff700 1 -- 172.21.15.81:0/4200206791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4011420 con 0x7fe1f00b3170 2023-10-06T02:47:32.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1d7fff700 1 -- 172.21.15.81:0/4200206791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e40115a0 con 0x7fe1f00b3170 2023-10-06T02:47:32.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f016c130 con 0x7fe1f00b3170 2023-10-06T02:47:32.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1d7fff700 1 -- 172.21.15.81:0/4200206791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4011960 con 0x7fe1f00b3170 2023-10-06T02:47:32.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.908+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f01439c0 con 0x7fe1f00b3170 2023-10-06T02:47:32.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.909+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f0068900 con 0x7fe1f00b3170 2023-10-06T02:47:32.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.910+0000 7fe1d7fff700 1 -- 172.21.15.81:0/4200206791 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1e4011d50 con 0x7fe1f00b3170 2023-10-06T02:47:32.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.910+0000 7fe1d7fff700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe1dc066f30 0x7fe1dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:32.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.910+0000 7fe1d7fff700 1 -- 172.21.15.81:0/4200206791 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe1e4085d50 con 0x7fe1f00b3170 2023-10-06T02:47:32.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.910+0000 7fe1effff700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe1dc066f30 0x7fe1dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:32.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.911+0000 7fe1effff700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe1dc066f30 0x7fe1dc0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00037c0 tx=0x7fe1e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:32.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:32.914+0000 7fe1d7fff700 1 -- 172.21.15.81:0/4200206791 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1e4089030 con 0x7fe1f00b3170 2023-10-06T02:47:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.140+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1f015c6f0 con 0x7fe1f00b3170 2023-10-06T02:47:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.141+0000 7fe1d7fff700 1 -- 172.21.15.81:0/4200206791 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fe1e4052e60 con 0x7fe1f00b3170 2023-10-06T02:47:33.142 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:33.142 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:47:29.117013+0000","modified":"2023-10-06T02:47:32.768965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2380710039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2380710039},{"type":"v1","addr":"172.21.15.81:6835","nonce":2380710039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:47:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe1dc066f30 msgr2=0x7fe1dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe1dc066f30 0x7fe1dc0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00037c0 tx=0x7fe1e0009040 comp rx=0 tx=0).stop 2023-10-06T02:47:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f00b3170 msgr2=0x7fe1f00a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f00b3170 0x7fe1f00a6530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00714a0 tx=0x7fe1e4017000 comp rx=0 tx=0).stop 2023-10-06T02:47:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 shutdown_connections 2023-10-06T02:47:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe1dc066f30 0x7fe1dc0693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1f0157a60 0x7fe1f0153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe1f006c190 0x7fe1f0143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 --2- 172.21.15.81:0/4200206791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f00b3170 0x7fe1f00a6530 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 >> 172.21.15.81:0/4200206791 conn(0x7fe1f006cca0 msgr2=0x7fe1f00af520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 shutdown_connections 2023-10-06T02:47:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.143+0000 7fe1f65ef700 1 -- 172.21.15.81:0/4200206791 wait complete. 2023-10-06T02:47:33.146 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T02:47:33.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:47:33.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.271+0000 7fe248761700 1 Processor -- start 2023-10-06T02:47:33.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.271+0000 7fe248761700 1 -- start start 2023-10-06T02:47:33.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.272+0000 7fe248761700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24015a2a0 0x7fe2400b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.272+0000 7fe248761700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe2400ceb30 0x7fe2400cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.272+0000 7fe248761700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2400cf4e0 con 0x7fe24006d650 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.272+0000 7fe248761700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24006ea90 con 0x7fe2400ceb30 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.272+0000 7fe248761700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400b0ca0 con 0x7fe24015a2a0 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.272+0000 7fe246cfe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe24006d650 0x7fe24006da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46850/0 (socket says 172.21.15.81:46850) 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.272+0000 7fe246cfe700 1 -- 172.21.15.81:0/1237406364 learned_addr learned my addr 172.21.15.81:0/1237406364 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2464fd700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24015a2a0 0x7fe2400b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe245cfc700 1 --2- 172.21.15.81:0/1237406364 >> v2:172.21.15.83:3300/0 conn(0x7fe2400ceb30 0x7fe2400cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559350460 0 0) 0x7fe2400cf4e0 con 0x7fe24006d650 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe22c003570 con 0x7fe24006d650 2023-10-06T02:47:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1509318967 0 0) 0x7fe22c003570 con 0x7fe24006d650 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24015a2a0 msgr2=0x7fe2400b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24015a2a0 0x7fe2400b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 >> v2:172.21.15.83:3300/0 conn(0x7fe2400ceb30 msgr2=0x7fe2400cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 --2- 172.21.15.81:0/1237406364 >> v2:172.21.15.83:3300/0 conn(0x7fe2400ceb30 0x7fe2400cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2400b00d0 con 0x7fe24006d650 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fe2380017f0 con 0x7fe24006d650 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 >> v1:172.21.15.81:6789/0 conn(0x7fe24006d650 legacy=0x7fe24006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe22c003a60 0x7fe22c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe22c004810 0x7fe22c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24015a2a0 0x7fe22c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24006ea90 con 0x7fe22c004810 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400b0ca0 con 0x7fe22c003a60 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c00ba60 con 0x7fe24015a2a0 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe245cfc700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe22c004810 0x7fe22c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe2464fd700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe22c003a60 0x7fe22c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe246cfe700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24015a2a0 0x7fe22c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe245cfc700 1 -- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24015a2a0 msgr2=0x7fe22c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe245cfc700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24015a2a0 0x7fe22c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe245cfc700 1 -- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe22c003a60 msgr2=0x7fe22c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe245cfc700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe22c003a60 0x7fe22c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe245cfc700 1 -- 172.21.15.81:0/1237406364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c003570 con 0x7fe22c004810 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.273+0000 7fe246cfe700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24015a2a0 0x7fe22c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe245cfc700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe22c004810 0x7fe22c004c80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe230009c30 tx=0x7fe2300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514179b3fe35a3fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23000e710 con 0x7fe22c004810 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23000e870 con 0x7fe22c004810 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe2454fb700 1 -- 172.21.15.81:0/1237406364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23000ec30 con 0x7fe22c004810 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe248761700 1 -- 172.21.15.81:0/1237406364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe22c004810 msgr2=0x7fe22c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe248761700 1 --2- 172.21.15.81:0/1237406364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe22c004810 0x7fe22c004c80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe230009c30 tx=0x7fe2300091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe246cfe700 1 -- 172.21.15.81:0/1237406364 reap_dead start 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe248761700 1 -- 172.21.15.81:0/1237406364 shutdown_connections 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe248761700 1 -- 172.21.15.81:0/1237406364 >> 172.21.15.81:0/1237406364 conn(0x7fe240067640 msgr2=0x7fe240067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe248761700 1 -- 172.21.15.81:0/1237406364 shutdown_connections 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.274+0000 7fe248761700 1 -- 172.21.15.81:0/1237406364 wait complete. 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.275+0000 7fe248761700 1 Processor -- start 2023-10-06T02:47:33.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.275+0000 7fe248761700 1 -- start start 2023-10-06T02:47:33.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe248761700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe22c004810 0x7fe24016d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe248761700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24015e700 0x7fe24015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe248761700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2400b19b0 0x7fe2400b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe248761700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24015f0b0 con 0x7fe24015e700 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe248761700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400b3330 con 0x7fe2400b19b0 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe248761700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400b2720 con 0x7fe22c004810 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe245cfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24015e700 0x7fe24015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe245cfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24015e700 0x7fe24015eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56134/0 (socket says 172.21.15.81:56134) 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe245cfc700 1 -- 172.21.15.81:0/2243575000 learned_addr learned my addr 172.21.15.81:0/2243575000 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe246cfe700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2400b19b0 0x7fe2400b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe2464fd700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe22c004810 0x7fe24016d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe245cfc700 1 -- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe22c004810 msgr2=0x7fe24016d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe245cfc700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe22c004810 0x7fe24016d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe245cfc700 1 -- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2400b19b0 msgr2=0x7fe2400b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe245cfc700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2400b19b0 0x7fe2400b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.276+0000 7fe245cfc700 1 -- 172.21.15.81:0/2243575000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2400b2a00 con 0x7fe24015e700 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.277+0000 7fe246cfe700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2400b19b0 0x7fe2400b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.277+0000 7fe2464fd700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe22c004810 0x7fe24016d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.277+0000 7fe245cfc700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24015e700 0x7fe24015eb70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0046d0 tx=0x7fe23001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.277+0000 7fe2367fc700 1 -- 172.21.15.81:0/2243575000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230022070 con 0x7fe24015e700 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.277+0000 7fe2367fc700 1 -- 172.21.15.81:0/2243575000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23000ebf0 con 0x7fe24015e700 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.277+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2400b2ce0 con 0x7fe24015e700 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.277+0000 7fe2367fc700 1 -- 172.21.15.81:0/2243575000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23001c680 con 0x7fe24015e700 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.277+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2400b2360 con 0x7fe24015e700 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.278+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe240069e40 con 0x7fe24015e700 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.278+0000 7fe2367fc700 1 -- 172.21.15.81:0/2243575000 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe23001ca70 con 0x7fe24015e700 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.279+0000 7fe2367fc700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe224066f30 0x7fe2240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.279+0000 7fe2367fc700 1 -- 172.21.15.81:0/2243575000 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe230085fd0 con 0x7fe24015e700 2023-10-06T02:47:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.279+0000 7fe2464fd700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe224066f30 0x7fe2240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.279+0000 7fe2464fd700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe224066f30 0x7fe2240693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe23c006dc0 tx=0x7fe23c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.283+0000 7fe2367fc700 1 -- 172.21.15.81:0/2243575000 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2300530e0 con 0x7fe24015e700 2023-10-06T02:47:33.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.466+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe24006b750 con 0x7fe24015e700 2023-10-06T02:47:33.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.467+0000 7fe2367fc700 1 -- 172.21.15.81:0/2243575000 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fe230017090 con 0x7fe24015e700 2023-10-06T02:47:33.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:33.469 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":48,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:30.359304+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:47:27.250251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:47:28.083304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:47:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe224066f30 msgr2=0x7fe2240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe224066f30 0x7fe2240693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe23c006dc0 tx=0x7fe23c008040 comp rx=0 tx=0).stop 2023-10-06T02:47:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24015e700 msgr2=0x7fe24015eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24015e700 0x7fe24015eb70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0046d0 tx=0x7fe23001a000 comp rx=0 tx=0).stop 2023-10-06T02:47:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 shutdown_connections 2023-10-06T02:47:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe224066f30 0x7fe2240693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2400b19b0 0x7fe2400b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe22c004810 0x7fe24016d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 --2- 172.21.15.81:0/2243575000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24015e700 0x7fe24015eb70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 >> 172.21.15.81:0/2243575000 conn(0x7fe240067640 msgr2=0x7fe240156900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 shutdown_connections 2023-10-06T02:47:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.469+0000 7fe248761700 1 -- 172.21.15.81:0/2243575000 wait complete. 2023-10-06T02:47:33.483 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:47:33.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:47:33.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.596+0000 7f9cbbfa5700 1 Processor -- start 2023-10-06T02:47:33.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.596+0000 7f9cbbfa5700 1 -- start start 2023-10-06T02:47:33.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.597+0000 7f9cbbfa5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9cb41578d0 0x7f9cb40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.597+0000 7f9cbbfa5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb40d07c0 con 0x7f9cb406d120 2023-10-06T02:47:33.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.597+0000 7f9cbbfa5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb40cfbb0 con 0x7f9cb4157ca0 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.597+0000 7f9cbbfa5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb40cfe90 con 0x7f9cb41578d0 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.597+0000 7f9cba542700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9cb406d120 0x7f9cb406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46856/0 (socket says 172.21.15.81:46856) 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.597+0000 7f9cba542700 1 -- 172.21.15.81:0/1285217472 learned_addr learned my addr 172.21.15.81:0/1285217472 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.597+0000 7f9cb9d41700 1 --2- 172.21.15.81:0/1285217472 >> v2:172.21.15.83:3300/0 conn(0x7f9cb41578d0 0x7f9cb40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.597+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442507045 0 0) 0x7f9cb40d07c0 con 0x7f9cb406d120 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.597+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca0003570 con 0x7f9cb406d120 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2538217972 0 0) 0x7f9ca0003570 con 0x7f9cb406d120 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 >> v2:172.21.15.83:3300/0 conn(0x7f9cb41578d0 msgr2=0x7f9cb40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 --2- 172.21.15.81:0/1285217472 >> v2:172.21.15.83:3300/0 conn(0x7f9cb41578d0 0x7f9cb40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 >> v1:172.21.15.83:6789/0 conn(0x7f9cb4157ca0 legacy=0x7f9cb415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40d0170 con 0x7f9cb406d120 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f9cac001470 con 0x7f9cb406d120 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 >> v1:172.21.15.81:6789/0 conn(0x7f9cb406d120 legacy=0x7f9cb406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca0003a60 0x7f9ca0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ca0004810 0x7f9ca0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca00051c0 0x7f9ca000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40cfe90 con 0x7f9ca00051c0 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca000c0d0 con 0x7f9ca0003a60 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca000c290 con 0x7f9ca0004810 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cba542700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca00051c0 0x7f9ca000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb9d41700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca0003a60 0x7f9ca0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb9540700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ca0004810 0x7f9ca0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cba542700 1 -- 172.21.15.81:0/1285217472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ca0004810 msgr2=0x7f9ca0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cba542700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ca0004810 0x7f9ca0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cba542700 1 -- 172.21.15.81:0/1285217472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca0003a60 msgr2=0x7f9ca0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cba542700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca0003a60 0x7f9ca0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cba542700 1 -- 172.21.15.81:0/1285217472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca0003570 con 0x7f9ca00051c0 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb9540700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ca0004810 0x7f9ca0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cba542700 1 -- 172.21.15.81:0/1285217472 reap_dead start 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cba542700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca00051c0 0x7f9ca000ba60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c3c0 tx=0x7f9cac001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a18d718e165942 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00cc90 con 0x7f9ca00051c0 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac00ce30 con 0x7f9ca00051c0 2023-10-06T02:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.598+0000 7f9cb8d3f700 1 -- 172.21.15.81:0/1285217472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac005b70 con 0x7f9ca00051c0 2023-10-06T02:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.599+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/1285217472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca00051c0 msgr2=0x7f9ca000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.599+0000 7f9cbbfa5700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca00051c0 0x7f9ca000ba60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c3c0 tx=0x7f9cac001e50 comp rx=0 tx=0).stop 2023-10-06T02:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.599+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/1285217472 shutdown_connections 2023-10-06T02:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.599+0000 7f9cbbfa5700 1 --2- 172.21.15.81:0/1285217472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca00051c0 0x7f9ca000ba60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.599+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/1285217472 >> 172.21.15.81:0/1285217472 conn(0x7f9cb406bb90 msgr2=0x7f9cb406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.599+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/1285217472 shutdown_connections 2023-10-06T02:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.599+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/1285217472 wait complete. 2023-10-06T02:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.600+0000 7f9cbbfa5700 1 Processor -- start 2023-10-06T02:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.600+0000 7f9cbbfa5700 1 -- start start 2023-10-06T02:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cbbfa5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca00051c0 0x7f9cb40c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cbbfa5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb40b6310 0x7f9cb40c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cbbfa5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cb40b4bb0 0x7f9cb40b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cbbfa5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40b3ba0 con 0x7f9cb40b6310 2023-10-06T02:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cbbfa5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40b4720 con 0x7f9ca00051c0 2023-10-06T02:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cbbfa5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40c8600 con 0x7f9cb40b4bb0 2023-10-06T02:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9540700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb40b6310 0x7f9cb40c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9540700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb40b6310 0x7f9cb40c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56158/0 (socket says 172.21.15.81:56158) 2023-10-06T02:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9540700 1 -- 172.21.15.81:0/950844740 learned_addr learned my addr 172.21.15.81:0/950844740 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9d41700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca00051c0 0x7f9cb40c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cba542700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cb40b4bb0 0x7f9cb40b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9540700 1 -- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cb40b4bb0 msgr2=0x7f9cb40b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9540700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cb40b4bb0 0x7f9cb40b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9540700 1 -- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca00051c0 msgr2=0x7f9cb40c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9540700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca00051c0 0x7f9cb40c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9540700 1 -- 172.21.15.81:0/950844740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40b3df0 con 0x7f9cb40b6310 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cba542700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cb40b4bb0 0x7f9cb40b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cb9540700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb40b6310 0x7f9cb40c6240 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400e560 tx=0x7f9ca4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9ca9ffb700 1 -- 172.21.15.81:0/950844740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4011460 con 0x7f9cb40b6310 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9ca9ffb700 1 -- 172.21.15.81:0/950844740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca4010040 con 0x7f9cb40b6310 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb40b40d0 con 0x7f9cb40b6310 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.601+0000 7f9ca9ffb700 1 -- 172.21.15.81:0/950844740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4011810 con 0x7f9cb40b6310 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.602+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb40c6780 con 0x7f9cb40b6310 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.603+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb40c69a0 con 0x7f9cb40b6310 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.603+0000 7f9ca9ffb700 1 -- 172.21.15.81:0/950844740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ca4011bc0 con 0x7f9cb40b6310 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.603+0000 7f9ca9ffb700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c98066f30 0x7f9c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.603+0000 7f9ca9ffb700 1 -- 172.21.15.81:0/950844740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ca40838a0 con 0x7f9cb40b6310 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.604+0000 7f9cb9d41700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c98066f30 0x7f9c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.604+0000 7f9cb9d41700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c98066f30 0x7f9c980693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009fd0 tx=0x7f9cb000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.607+0000 7f9ca9ffb700 1 -- 172.21.15.81:0/950844740 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ca404d5a0 con 0x7f9cb40b6310 2023-10-06T02:47:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.787+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cb40b4860 con 0x7f9c98066f30 2023-10-06T02:47:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.796+0000 7f9ca9ffb700 1 -- 172.21.15.81:0/950844740 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305260 (secure 0 0 0) 0x7f9cb40b4860 con 0x7f9c98066f30 2023-10-06T02:47:33.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:33.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c98066f30 msgr2=0x7f9c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c98066f30 0x7f9c980693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009fd0 tx=0x7f9cb000b040 comp rx=0 tx=0).stop 2023-10-06T02:47:33.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb40b6310 msgr2=0x7f9cb40c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb40b6310 0x7f9cb40c6240 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400e560 tx=0x7f9ca4009040 comp rx=0 tx=0).stop 2023-10-06T02:47:33.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 shutdown_connections 2023-10-06T02:47:33.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9cb40b4bb0 0x7f9cb40b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c98066f30 0x7f9c980693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca00051c0 0x7f9cb40c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 --2- 172.21.15.81:0/950844740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb40b6310 0x7f9cb40c6240 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 >> 172.21.15.81:0/950844740 conn(0x7f9cb406bb90 msgr2=0x7f9cb4068bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:33.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 shutdown_connections 2023-10-06T02:47:33.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.800+0000 7f9cbbfa5700 1 -- 172.21.15.81:0/950844740 wait complete. 2023-10-06T02:47:33.805 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:47:33.813 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-10-06T02:47:33.512190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559464,"statfs":{"total":1600000000,"available":1596891557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.778302"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365638+0000","last_change":"2023-10-06T02:47:29.365596+0000","last_active":"2023-10-06T02:47:29.365638+0000","last_peered":"2023-10-06T02:47:29.365638+0000","last_clean":"2023-10-06T02:47:29.365638+0000","last_became_active":"2023-10-06T02:47:29.365409+0000","last_became_peered":"2023-10-06T02:47:29.365409+0000","last_unstale":"2023-10-06T02:47:29.365638+0000","last_undegraded":"2023-10-06T02:47:29.365638+0000","last_fullsized":"2023-10-06T02:47:29.365638+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:38.034082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378983+0000","last_change":"2023-10-06T02:47:29.378894+0000","last_active":"2023-10-06T02:47:29.378983+0000","last_peered":"2023-10-06T02:47:29.378983+0000","last_clean":"2023-10-06T02:47:29.378983+0000","last_became_active":"2023-10-06T02:47:29.378539+0000","last_became_peered":"2023-10-06T02:47:29.378539+0000","last_unstale":"2023-10-06T02:47:29.378983+0000","last_undegraded":"2023-10-06T02:47:29.378983+0000","last_fullsized":"2023-10-06T02:47:29.378983+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:38.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365666+0000","last_change":"2023-10-06T02:47:29.364114+0000","last_active":"2023-10-06T02:47:29.365666+0000","last_peered":"2023-10-06T02:47:29.365666+0000","last_clean":"2023-10-06T02:47:29.365666+0000","last_became_active":"2023-10-06T02:47:29.363829+0000","last_became_peered":"2023-10-06T02:47:29.363829+0000","last_unstale":"2023-10-06T02:47:29.365666+0000","last_undegraded":"2023-10-06T02:47:29.365666+0000","last_fullsized":"2023-10-06T02:47:29.365666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:00.426995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374677+0000","last_change":"2023-10-06T02:47:29.374096+0000","last_active":"2023-10-06T02:47:29.374677+0000","last_peered":"2023-10-06T02:47:29.374677+0000","last_clean":"2023-10-06T02:47:29.374677+0000","last_became_active":"2023-10-06T02:47:29.373815+0000","last_became_peered":"2023-10-06T02:47:29.373815+0000","last_unstale":"2023-10-06T02:47:29.374677+0000","last_undegraded":"2023-10-06T02:47:29.374677+0000","last_fullsized":"2023-10-06T02:47:29.374677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:55:23.156167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.375691+0000","last_change":"2023-10-06T02:47:29.375629+0000","last_active":"2023-10-06T02:47:29.375691+0000","last_peered":"2023-10-06T02:47:29.375691+0000","last_clean":"2023-10-06T02:47:29.375691+0000","last_became_active":"2023-10-06T02:47:29.375266+0000","last_became_peered":"2023-10-06T02:47:29.375266+0000","last_unstale":"2023-10-06T02:47:29.375691+0000","last_undegraded":"2023-10-06T02:47:29.375691+0000","last_fullsized":"2023-10-06T02:47:29.375691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:38.153033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.377371+0000","last_change":"2023-10-06T02:47:29.377322+0000","last_active":"2023-10-06T02:47:29.377371+0000","last_peered":"2023-10-06T02:47:29.377371+0000","last_clean":"2023-10-06T02:47:29.377371+0000","last_became_active":"2023-10-06T02:47:29.377190+0000","last_became_peered":"2023-10-06T02:47:29.377190+0000","last_unstale":"2023-10-06T02:47:29.377371+0000","last_undegraded":"2023-10-06T02:47:29.377371+0000","last_fullsized":"2023-10-06T02:47:29.377371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:38.153033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366701+0000","last_change":"2023-10-06T02:47:29.366644+0000","last_active":"2023-10-06T02:47:29.366701+0000","last_peered":"2023-10-06T02:47:29.366701+0000","last_clean":"2023-10-06T02:47:29.366701+0000","last_became_active":"2023-10-06T02:47:29.366206+0000","last_became_peered":"2023-10-06T02:47:29.366206+0000","last_unstale":"2023-10-06T02:47:29.366701+0000","last_undegraded":"2023-10-06T02:47:29.366701+0000","last_fullsized":"2023-10-06T02:47:29.366701+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:42.558021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371301+0000","last_change":"2023-10-06T02:47:29.371250+0000","last_active":"2023-10-06T02:47:29.371301+0000","last_peered":"2023-10-06T02:47:29.371301+0000","last_clean":"2023-10-06T02:47:29.371301+0000","last_became_active":"2023-10-06T02:47:29.371032+0000","last_became_peered":"2023-10-06T02:47:29.371032+0000","last_unstale":"2023-10-06T02:47:29.371301+0000","last_undegraded":"2023-10-06T02:47:29.371301+0000","last_fullsized":"2023-10-06T02:47:29.371301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:00.426995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371565+0000","last_change":"2023-10-06T02:47:29.371508+0000","last_active":"2023-10-06T02:47:29.371565+0000","last_peered":"2023-10-06T02:47:29.371565+0000","last_clean":"2023-10-06T02:47:29.371565+0000","last_became_active":"2023-10-06T02:47:29.371295+0000","last_became_peered":"2023-10-06T02:47:29.371295+0000","last_unstale":"2023-10-06T02:47:29.371565+0000","last_undegraded":"2023-10-06T02:47:29.371565+0000","last_fullsized":"2023-10-06T02:47:29.371565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:49.590043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372474+0000","last_change":"2023-10-06T02:47:29.372401+0000","last_active":"2023-10-06T02:47:29.372474+0000","last_peered":"2023-10-06T02:47:29.372474+0000","last_clean":"2023-10-06T02:47:29.372474+0000","last_became_active":"2023-10-06T02:47:29.372182+0000","last_became_peered":"2023-10-06T02:47:29.372182+0000","last_unstale":"2023-10-06T02:47:29.372474+0000","last_undegraded":"2023-10-06T02:47:29.372474+0000","last_fullsized":"2023-10-06T02:47:29.372474+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:27.998786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.377589+0000","last_change":"2023-10-06T02:47:29.377540+0000","last_active":"2023-10-06T02:47:29.377589+0000","last_peered":"2023-10-06T02:47:29.377589+0000","last_clean":"2023-10-06T02:47:29.377589+0000","last_became_active":"2023-10-06T02:47:29.377370+0000","last_became_peered":"2023-10-06T02:47:29.377370+0000","last_unstale":"2023-10-06T02:47:29.377589+0000","last_undegraded":"2023-10-06T02:47:29.377589+0000","last_fullsized":"2023-10-06T02:47:29.377589+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:26.879596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373590+0000","last_change":"2023-10-06T02:47:29.373542+0000","last_active":"2023-10-06T02:47:29.373590+0000","last_peered":"2023-10-06T02:47:29.373590+0000","last_clean":"2023-10-06T02:47:29.373590+0000","last_became_active":"2023-10-06T02:47:29.373211+0000","last_became_peered":"2023-10-06T02:47:29.373211+0000","last_unstale":"2023-10-06T02:47:29.373590+0000","last_undegraded":"2023-10-06T02:47:29.373590+0000","last_fullsized":"2023-10-06T02:47:29.373590+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:14:58.202640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371894+0000","last_change":"2023-10-06T02:47:29.371803+0000","last_active":"2023-10-06T02:47:29.371894+0000","last_peered":"2023-10-06T02:47:29.371894+0000","last_clean":"2023-10-06T02:47:29.371894+0000","last_became_active":"2023-10-06T02:47:29.371577+0000","last_became_peered":"2023-10-06T02:47:29.371577+0000","last_unstale":"2023-10-06T02:47:29.371894+0000","last_undegraded":"2023-10-06T02:47:29.371894+0000","last_fullsized":"2023-10-06T02:47:29.371894+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:30.214630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365732+0000","last_change":"2023-10-06T02:47:29.364658+0000","last_active":"2023-10-06T02:47:29.365732+0000","last_peered":"2023-10-06T02:47:29.365732+0000","last_clean":"2023-10-06T02:47:29.365732+0000","last_became_active":"2023-10-06T02:47:29.364243+0000","last_became_peered":"2023-10-06T02:47:29.364243+0000","last_unstale":"2023-10-06T02:47:29.365732+0000","last_undegraded":"2023-10-06T02:47:29.365732+0000","last_fullsized":"2023-10-06T02:47:29.365732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:42.640460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378257+0000","last_change":"2023-10-06T02:47:29.378060+0000","last_active":"2023-10-06T02:47:29.378257+0000","last_peered":"2023-10-06T02:47:29.378257+0000","last_clean":"2023-10-06T02:47:29.378257+0000","last_became_active":"2023-10-06T02:47:29.377680+0000","last_became_peered":"2023-10-06T02:47:29.377680+0000","last_unstale":"2023-10-06T02:47:29.378257+0000","last_undegraded":"2023-10-06T02:47:29.378257+0000","last_fullsized":"2023-10-06T02:47:29.378257+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:48.279515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371912+0000","last_change":"2023-10-06T02:47:29.371854+0000","last_active":"2023-10-06T02:47:29.371912+0000","last_peered":"2023-10-06T02:47:29.371912+0000","last_clean":"2023-10-06T02:47:29.371912+0000","last_became_active":"2023-10-06T02:47:29.371620+0000","last_became_peered":"2023-10-06T02:47:29.371620+0000","last_unstale":"2023-10-06T02:47:29.371912+0000","last_undegraded":"2023-10-06T02:47:29.371912+0000","last_fullsized":"2023-10-06T02:47:29.371912+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:38.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366495+0000","last_change":"2023-10-06T02:47:29.366419+0000","last_active":"2023-10-06T02:47:29.366495+0000","last_peered":"2023-10-06T02:47:29.366495+0000","last_clean":"2023-10-06T02:47:29.366495+0000","last_became_active":"2023-10-06T02:47:29.365873+0000","last_became_peered":"2023-10-06T02:47:29.365873+0000","last_unstale":"2023-10-06T02:47:29.366495+0000","last_undegraded":"2023-10-06T02:47:29.366495+0000","last_fullsized":"2023-10-06T02:47:29.366495+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:37.995899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378239+0000","last_change":"2023-10-06T02:47:29.378012+0000","last_active":"2023-10-06T02:47:29.378239+0000","last_peered":"2023-10-06T02:47:29.378239+0000","last_clean":"2023-10-06T02:47:29.378239+0000","last_became_active":"2023-10-06T02:47:29.376966+0000","last_became_peered":"2023-10-06T02:47:29.376966+0000","last_unstale":"2023-10-06T02:47:29.378239+0000","last_undegraded":"2023-10-06T02:47:29.378239+0000","last_fullsized":"2023-10-06T02:47:29.378239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:33.771859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371408+0000","last_change":"2023-10-06T02:47:29.370943+0000","last_active":"2023-10-06T02:47:29.371408+0000","last_peered":"2023-10-06T02:47:29.371408+0000","last_clean":"2023-10-06T02:47:29.371408+0000","last_became_active":"2023-10-06T02:47:29.370730+0000","last_became_peered":"2023-10-06T02:47:29.370730+0000","last_unstale":"2023-10-06T02:47:29.371408+0000","last_undegraded":"2023-10-06T02:47:29.371408+0000","last_fullsized":"2023-10-06T02:47:29.371408+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:34.361006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372779+0000","last_change":"2023-10-06T02:47:29.371957+0000","last_active":"2023-10-06T02:47:29.372779+0000","last_peered":"2023-10-06T02:47:29.372779+0000","last_clean":"2023-10-06T02:47:29.372779+0000","last_became_active":"2023-10-06T02:47:29.371721+0000","last_became_peered":"2023-10-06T02:47:29.371721+0000","last_unstale":"2023-10-06T02:47:29.372779+0000","last_undegraded":"2023-10-06T02:47:29.372779+0000","last_fullsized":"2023-10-06T02:47:29.372779+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:50.195035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378868+0000","last_change":"2023-10-06T02:47:29.378819+0000","last_active":"2023-10-06T02:47:29.378868+0000","last_peered":"2023-10-06T02:47:29.378868+0000","last_clean":"2023-10-06T02:47:29.378868+0000","last_became_active":"2023-10-06T02:47:29.378338+0000","last_became_peered":"2023-10-06T02:47:29.378338+0000","last_unstale":"2023-10-06T02:47:29.378868+0000","last_undegraded":"2023-10-06T02:47:29.378868+0000","last_fullsized":"2023-10-06T02:47:29.378868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:40.880410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373541+0000","last_change":"2023-10-06T02:47:29.373410+0000","last_active":"2023-10-06T02:47:29.373541+0000","last_peered":"2023-10-06T02:47:29.373541+0000","last_clean":"2023-10-06T02:47:29.373541+0000","last_became_active":"2023-10-06T02:47:29.372915+0000","last_became_peered":"2023-10-06T02:47:29.372915+0000","last_unstale":"2023-10-06T02:47:29.373541+0000","last_undegraded":"2023-10-06T02:47:29.373541+0000","last_fullsized":"2023-10-06T02:47:29.373541+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:43.903083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370708+0000","last_change":"2023-10-06T02:47:29.370576+0000","last_active":"2023-10-06T02:47:29.370708+0000","last_peered":"2023-10-06T02:47:29.370708+0000","last_clean":"2023-10-06T02:47:29.370708+0000","last_became_active":"2023-10-06T02:47:29.370359+0000","last_became_peered":"2023-10-06T02:47:29.370359+0000","last_unstale":"2023-10-06T02:47:29.370708+0000","last_undegraded":"2023-10-06T02:47:29.370708+0000","last_fullsized":"2023-10-06T02:47:29.370708+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:50.195035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365702+0000","last_change":"2023-10-06T02:47:29.364487+0000","last_active":"2023-10-06T02:47:29.365702+0000","last_peered":"2023-10-06T02:47:29.365702+0000","last_clean":"2023-10-06T02:47:29.365702+0000","last_became_active":"2023-10-06T02:47:29.363745+0000","last_became_peered":"2023-10-06T02:47:29.363745+0000","last_unstale":"2023-10-06T02:47:29.365702+0000","last_undegraded":"2023-10-06T02:47:29.365702+0000","last_fullsized":"2023-10-06T02:47:29.365702+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:59.356466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374808+0000","last_change":"2023-10-06T02:47:29.374584+0000","last_active":"2023-10-06T02:47:29.374808+0000","last_peered":"2023-10-06T02:47:29.374808+0000","last_clean":"2023-10-06T02:47:29.374808+0000","last_became_active":"2023-10-06T02:47:29.374374+0000","last_became_peered":"2023-10-06T02:47:29.374374+0000","last_unstale":"2023-10-06T02:47:29.374808+0000","last_undegraded":"2023-10-06T02:47:29.374808+0000","last_fullsized":"2023-10-06T02:47:29.374808+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:55.530093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370621+0000","last_change":"2023-10-06T02:47:29.369545+0000","last_active":"2023-10-06T02:47:29.370621+0000","last_peered":"2023-10-06T02:47:29.370621+0000","last_clean":"2023-10-06T02:47:29.370621+0000","last_became_active":"2023-10-06T02:47:29.369332+0000","last_became_peered":"2023-10-06T02:47:29.369332+0000","last_unstale":"2023-10-06T02:47:29.370621+0000","last_undegraded":"2023-10-06T02:47:29.370621+0000","last_fullsized":"2023-10-06T02:47:29.370621+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:37.995899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.367083+0000","last_change":"2023-10-06T02:47:29.367005+0000","last_active":"2023-10-06T02:47:29.367083+0000","last_peered":"2023-10-06T02:47:29.367083+0000","last_clean":"2023-10-06T02:47:29.367083+0000","last_became_active":"2023-10-06T02:47:29.366783+0000","last_became_peered":"2023-10-06T02:47:29.366783+0000","last_unstale":"2023-10-06T02:47:29.367083+0000","last_undegraded":"2023-10-06T02:47:29.367083+0000","last_fullsized":"2023-10-06T02:47:29.367083+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:32.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370971+0000","last_change":"2023-10-06T02:47:29.370899+0000","last_active":"2023-10-06T02:47:29.370971+0000","last_peered":"2023-10-06T02:47:29.370971+0000","last_clean":"2023-10-06T02:47:29.370971+0000","last_became_active":"2023-10-06T02:47:29.370640+0000","last_became_peered":"2023-10-06T02:47:29.370640+0000","last_unstale":"2023-10-06T02:47:29.370971+0000","last_undegraded":"2023-10-06T02:47:29.370971+0000","last_fullsized":"2023-10-06T02:47:29.370971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:56.178235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371425+0000","last_change":"2023-10-06T02:47:29.371328+0000","last_active":"2023-10-06T02:47:29.371425+0000","last_peered":"2023-10-06T02:47:29.371425+0000","last_clean":"2023-10-06T02:47:29.371425+0000","last_became_active":"2023-10-06T02:47:29.371174+0000","last_became_peered":"2023-10-06T02:47:29.371174+0000","last_unstale":"2023-10-06T02:47:29.371425+0000","last_undegraded":"2023-10-06T02:47:29.371425+0000","last_fullsized":"2023-10-06T02:47:29.371425+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:10.396225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378022+0000","last_change":"2023-10-06T02:47:29.377909+0000","last_active":"2023-10-06T02:47:29.378022+0000","last_peered":"2023-10-06T02:47:29.378022+0000","last_clean":"2023-10-06T02:47:29.378022+0000","last_became_active":"2023-10-06T02:47:29.377346+0000","last_became_peered":"2023-10-06T02:47:29.377346+0000","last_unstale":"2023-10-06T02:47:29.378022+0000","last_undegraded":"2023-10-06T02:47:29.378022+0000","last_fullsized":"2023-10-06T02:47:29.378022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.625194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365689+0000","last_change":"2023-10-06T02:47:29.364313+0000","last_active":"2023-10-06T02:47:29.365689+0000","last_peered":"2023-10-06T02:47:29.365689+0000","last_clean":"2023-10-06T02:47:29.365689+0000","last_became_active":"2023-10-06T02:47:29.364100+0000","last_became_peered":"2023-10-06T02:47:29.364100+0000","last_unstale":"2023-10-06T02:47:29.365689+0000","last_undegraded":"2023-10-06T02:47:29.365689+0000","last_fullsized":"2023-10-06T02:47:29.365689+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.217184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373357+0000","last_change":"2023-10-06T02:47:29.373286+0000","last_active":"2023-10-06T02:47:29.373357+0000","last_peered":"2023-10-06T02:47:29.373357+0000","last_clean":"2023-10-06T02:47:29.373357+0000","last_became_active":"2023-10-06T02:47:29.373060+0000","last_became_peered":"2023-10-06T02:47:29.373060+0000","last_unstale":"2023-10-06T02:47:29.373357+0000","last_undegraded":"2023-10-06T02:47:29.373357+0000","last_fullsized":"2023-10-06T02:47:29.373357+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:38.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378272+0000","last_change":"2023-10-06T02:47:29.378162+0000","last_active":"2023-10-06T02:47:29.378272+0000","last_peered":"2023-10-06T02:47:29.378272+0000","last_clean":"2023-10-06T02:47:29.378272+0000","last_became_active":"2023-10-06T02:47:29.377423+0000","last_became_peered":"2023-10-06T02:47:29.377423+0000","last_unstale":"2023-10-06T02:47:29.378272+0000","last_undegraded":"2023-10-06T02:47:29.378272+0000","last_fullsized":"2023-10-06T02:47:29.378272+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:27.998786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.758202+0000","last_change":"2023-10-06T02:47:28.744478+0000","last_active":"2023-10-06T02:47:29.758202+0000","last_peered":"2023-10-06T02:47:29.758202+0000","last_clean":"2023-10-06T02:47:29.758202+0000","last_became_active":"2023-10-06T02:47:28.744251+0000","last_became_peered":"2023-10-06T02:47:28.744251+0000","last_unstale":"2023-10-06T02:47:29.758202+0000","last_undegraded":"2023-10-06T02:47:29.758202+0000","last_fullsized":"2023-10-06T02:47:29.758202+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:08.234127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378060+0000","last_change":"2023-10-06T02:47:29.377741+0000","last_active":"2023-10-06T02:47:29.378060+0000","last_peered":"2023-10-06T02:47:29.378060+0000","last_clean":"2023-10-06T02:47:29.378060+0000","last_became_active":"2023-10-06T02:47:29.377457+0000","last_became_peered":"2023-10-06T02:47:29.377457+0000","last_unstale":"2023-10-06T02:47:29.378060+0000","last_undegraded":"2023-10-06T02:47:29.378060+0000","last_fullsized":"2023-10-06T02:47:29.378060+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:38.153033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.754559+0000","last_change":"2023-10-06T02:47:28.750779+0000","last_active":"2023-10-06T02:47:29.754559+0000","last_peered":"2023-10-06T02:47:29.754559+0000","last_clean":"2023-10-06T02:47:29.754559+0000","last_became_active":"2023-10-06T02:47:28.750559+0000","last_became_peered":"2023-10-06T02:47:28.750559+0000","last_unstale":"2023-10-06T02:47:29.754559+0000","last_undegraded":"2023-10-06T02:47:29.754559+0000","last_fullsized":"2023-10-06T02:47:29.754559+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:35.923909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378977+0000","last_change":"2023-10-06T02:47:29.378926+0000","last_active":"2023-10-06T02:47:29.378977+0000","last_peered":"2023-10-06T02:47:29.378977+0000","last_clean":"2023-10-06T02:47:29.378977+0000","last_became_active":"2023-10-06T02:47:29.378635+0000","last_became_peered":"2023-10-06T02:47:29.378635+0000","last_unstale":"2023-10-06T02:47:29.378977+0000","last_undegraded":"2023-10-06T02:47:29.378977+0000","last_fullsized":"2023-10-06T02:47:29.378977+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:36.929925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.755304+0000","last_change":"2023-10-06T02:47:28.747603+0000","last_active":"2023-10-06T02:47:29.755304+0000","last_peered":"2023-10-06T02:47:29.755304+0000","last_clean":"2023-10-06T02:47:29.755304+0000","last_became_active":"2023-10-06T02:47:28.747097+0000","last_became_peered":"2023-10-06T02:47:28.747097+0000","last_unstale":"2023-10-06T02:47:29.755304+0000","last_undegraded":"2023-10-06T02:47:29.755304+0000","last_fullsized":"2023-10-06T02:47:29.755304+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:24.712370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374598+0000","last_change":"2023-10-06T02:47:29.374504+0000","last_active":"2023-10-06T02:47:29.374598+0000","last_peered":"2023-10-06T02:47:29.374598+0000","last_clean":"2023-10-06T02:47:29.374598+0000","last_became_active":"2023-10-06T02:47:29.374271+0000","last_became_peered":"2023-10-06T02:47:29.374271+0000","last_unstale":"2023-10-06T02:47:29.374598+0000","last_undegraded":"2023-10-06T02:47:29.374598+0000","last_fullsized":"2023-10-06T02:47:29.374598+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:55:23.156167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.757894+0000","last_change":"2023-10-06T02:47:28.745500+0000","last_active":"2023-10-06T02:47:29.757894+0000","last_peered":"2023-10-06T02:47:29.757894+0000","last_clean":"2023-10-06T02:47:29.757894+0000","last_became_active":"2023-10-06T02:47:28.745289+0000","last_became_peered":"2023-10-06T02:47:28.745289+0000","last_unstale":"2023-10-06T02:47:29.757894+0000","last_undegraded":"2023-10-06T02:47:29.757894+0000","last_fullsized":"2023-10-06T02:47:29.757894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:37.493317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374435+0000","last_change":"2023-10-06T02:47:29.374322+0000","last_active":"2023-10-06T02:47:29.374435+0000","last_peered":"2023-10-06T02:47:29.374435+0000","last_clean":"2023-10-06T02:47:29.374435+0000","last_became_active":"2023-10-06T02:47:29.373854+0000","last_became_peered":"2023-10-06T02:47:29.373854+0000","last_unstale":"2023-10-06T02:47:29.374435+0000","last_undegraded":"2023-10-06T02:47:29.374435+0000","last_fullsized":"2023-10-06T02:47:29.374435+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:30.214630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.753837+0000","last_change":"2023-10-06T02:47:28.745721+0000","last_active":"2023-10-06T02:47:29.753837+0000","last_peered":"2023-10-06T02:47:29.753837+0000","last_clean":"2023-10-06T02:47:29.753837+0000","last_became_active":"2023-10-06T02:47:28.744392+0000","last_became_peered":"2023-10-06T02:47:28.744392+0000","last_unstale":"2023-10-06T02:47:29.753837+0000","last_undegraded":"2023-10-06T02:47:29.753837+0000","last_fullsized":"2023-10-06T02:47:29.753837+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:23.164771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.379140+0000","last_change":"2023-10-06T02:47:29.379075+0000","last_active":"2023-10-06T02:47:29.379140+0000","last_peered":"2023-10-06T02:47:29.379140+0000","last_clean":"2023-10-06T02:47:29.379140+0000","last_became_active":"2023-10-06T02:47:29.377768+0000","last_became_peered":"2023-10-06T02:47:29.377768+0000","last_unstale":"2023-10-06T02:47:29.379140+0000","last_undegraded":"2023-10-06T02:47:29.379140+0000","last_fullsized":"2023-10-06T02:47:29.379140+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:26.817389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.755152+0000","last_change":"2023-10-06T02:47:28.744368+0000","last_active":"2023-10-06T02:47:29.755152+0000","last_peered":"2023-10-06T02:47:29.755152+0000","last_clean":"2023-10-06T02:47:29.755152+0000","last_became_active":"2023-10-06T02:47:28.744103+0000","last_became_peered":"2023-10-06T02:47:28.744103+0000","last_unstale":"2023-10-06T02:47:29.755152+0000","last_undegraded":"2023-10-06T02:47:29.755152+0000","last_fullsized":"2023-10-06T02:47:29.755152+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:11.664273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370645+0000","last_change":"2023-10-06T02:47:29.370530+0000","last_active":"2023-10-06T02:47:29.370645+0000","last_peered":"2023-10-06T02:47:29.370645+0000","last_clean":"2023-10-06T02:47:29.370645+0000","last_became_active":"2023-10-06T02:47:29.370327+0000","last_became_peered":"2023-10-06T02:47:29.370327+0000","last_unstale":"2023-10-06T02:47:29.370645+0000","last_undegraded":"2023-10-06T02:47:29.370645+0000","last_fullsized":"2023-10-06T02:47:29.370645+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:10.396225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.367285+0000","last_change":"2023-10-06T02:47:28.746403+0000","last_active":"2023-10-06T02:47:29.367285+0000","last_peered":"2023-10-06T02:47:29.367285+0000","last_clean":"2023-10-06T02:47:29.367285+0000","last_became_active":"2023-10-06T02:47:28.746168+0000","last_became_peered":"2023-10-06T02:47:28.746168+0000","last_unstale":"2023-10-06T02:47:29.367285+0000","last_undegraded":"2023-10-06T02:47:29.367285+0000","last_fullsized":"2023-10-06T02:47:29.367285+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:14.134118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378040+0000","last_change":"2023-10-06T02:47:29.377945+0000","last_active":"2023-10-06T02:47:29.378040+0000","last_peered":"2023-10-06T02:47:29.378040+0000","last_clean":"2023-10-06T02:47:29.378040+0000","last_became_active":"2023-10-06T02:47:29.377487+0000","last_became_peered":"2023-10-06T02:47:29.377487+0000","last_unstale":"2023-10-06T02:47:29.378040+0000","last_undegraded":"2023-10-06T02:47:29.378040+0000","last_fullsized":"2023-10-06T02:47:29.378040+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:32.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.361042+0000","last_change":"2023-10-06T02:47:28.748595+0000","last_active":"2023-10-06T02:47:29.361042+0000","last_peered":"2023-10-06T02:47:29.361042+0000","last_clean":"2023-10-06T02:47:29.361042+0000","last_became_active":"2023-10-06T02:47:28.744243+0000","last_became_peered":"2023-10-06T02:47:28.744243+0000","last_unstale":"2023-10-06T02:47:29.361042+0000","last_undegraded":"2023-10-06T02:47:29.361042+0000","last_fullsized":"2023-10-06T02:47:29.361042+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:26.464271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.375547+0000","last_change":"2023-10-06T02:47:29.375480+0000","last_active":"2023-10-06T02:47:29.375547+0000","last_peered":"2023-10-06T02:47:29.375547+0000","last_clean":"2023-10-06T02:47:29.375547+0000","last_became_active":"2023-10-06T02:47:29.375024+0000","last_became_peered":"2023-10-06T02:47:29.375024+0000","last_unstale":"2023-10-06T02:47:29.375547+0000","last_undegraded":"2023-10-06T02:47:29.375547+0000","last_fullsized":"2023-10-06T02:47:29.375547+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:38.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.376851+0000","last_change":"2023-10-06T02:47:28.740324+0000","last_active":"2023-10-06T02:47:29.376851+0000","last_peered":"2023-10-06T02:47:29.376851+0000","last_clean":"2023-10-06T02:47:29.376851+0000","last_became_active":"2023-10-06T02:47:28.740096+0000","last_became_peered":"2023-10-06T02:47:28.740096+0000","last_unstale":"2023-10-06T02:47:29.376851+0000","last_undegraded":"2023-10-06T02:47:29.376851+0000","last_fullsized":"2023-10-06T02:47:29.376851+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:37.493317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372954+0000","last_change":"2023-10-06T02:47:29.372599+0000","last_active":"2023-10-06T02:47:29.372954+0000","last_peered":"2023-10-06T02:47:29.372954+0000","last_clean":"2023-10-06T02:47:29.372954+0000","last_became_active":"2023-10-06T02:47:29.372289+0000","last_became_peered":"2023-10-06T02:47:29.372289+0000","last_unstale":"2023-10-06T02:47:29.372954+0000","last_undegraded":"2023-10-06T02:47:29.372954+0000","last_fullsized":"2023-10-06T02:47:29.372954+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:38.034082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368855+0000","last_change":"2023-10-06T02:47:28.746425+0000","last_active":"2023-10-06T02:47:29.368855+0000","last_peered":"2023-10-06T02:47:29.368855+0000","last_clean":"2023-10-06T02:47:29.368855+0000","last_became_active":"2023-10-06T02:47:28.746181+0000","last_became_peered":"2023-10-06T02:47:28.746181+0000","last_unstale":"2023-10-06T02:47:29.368855+0000","last_undegraded":"2023-10-06T02:47:29.368855+0000","last_fullsized":"2023-10-06T02:47:29.368855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:37.493317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372781+0000","last_change":"2023-10-06T02:47:29.372717+0000","last_active":"2023-10-06T02:47:29.372781+0000","last_peered":"2023-10-06T02:47:29.372781+0000","last_clean":"2023-10-06T02:47:29.372781+0000","last_became_active":"2023-10-06T02:47:29.371975+0000","last_became_peered":"2023-10-06T02:47:29.371975+0000","last_unstale":"2023-10-06T02:47:29.372781+0000","last_undegraded":"2023-10-06T02:47:29.372781+0000","last_fullsized":"2023-10-06T02:47:29.372781+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:49.590043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.754719+0000","last_change":"2023-10-06T02:47:28.745810+0000","last_active":"2023-10-06T02:47:29.754719+0000","last_peered":"2023-10-06T02:47:29.754719+0000","last_clean":"2023-10-06T02:47:29.754719+0000","last_became_active":"2023-10-06T02:47:28.744970+0000","last_became_peered":"2023-10-06T02:47:28.744970+0000","last_unstale":"2023-10-06T02:47:29.754719+0000","last_undegraded":"2023-10-06T02:47:29.754719+0000","last_fullsized":"2023-10-06T02:47:29.754719+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:26.464271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372655+0000","last_change":"2023-10-06T02:47:29.372007+0000","last_active":"2023-10-06T02:47:29.372655+0000","last_peered":"2023-10-06T02:47:29.372655+0000","last_clean":"2023-10-06T02:47:29.372655+0000","last_became_active":"2023-10-06T02:47:29.371783+0000","last_became_peered":"2023-10-06T02:47:29.371783+0000","last_unstale":"2023-10-06T02:47:29.372655+0000","last_undegraded":"2023-10-06T02:47:29.372655+0000","last_fullsized":"2023-10-06T02:47:29.372655+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:52.356362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.758879+0000","last_change":"2023-10-06T02:47:28.747153+0000","last_active":"2023-10-06T02:47:29.758879+0000","last_peered":"2023-10-06T02:47:29.758879+0000","last_clean":"2023-10-06T02:47:29.758879+0000","last_became_active":"2023-10-06T02:47:28.743928+0000","last_became_peered":"2023-10-06T02:47:28.743928+0000","last_unstale":"2023-10-06T02:47:29.758879+0000","last_undegraded":"2023-10-06T02:47:29.758879+0000","last_fullsized":"2023-10-06T02:47:29.758879+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:19.864723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378689+0000","last_change":"2023-10-06T02:47:29.378371+0000","last_active":"2023-10-06T02:47:29.378689+0000","last_peered":"2023-10-06T02:47:29.378689+0000","last_clean":"2023-10-06T02:47:29.378689+0000","last_became_active":"2023-10-06T02:47:29.377945+0000","last_became_peered":"2023-10-06T02:47:29.377945+0000","last_unstale":"2023-10-06T02:47:29.378689+0000","last_undegraded":"2023-10-06T02:47:29.378689+0000","last_fullsized":"2023-10-06T02:47:29.378689+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:32.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.754442+0000","last_change":"2023-10-06T02:47:28.751643+0000","last_active":"2023-10-06T02:47:29.754442+0000","last_peered":"2023-10-06T02:47:29.754442+0000","last_clean":"2023-10-06T02:47:29.754442+0000","last_became_active":"2023-10-06T02:47:28.749642+0000","last_became_peered":"2023-10-06T02:47:28.749642+0000","last_unstale":"2023-10-06T02:47:29.754442+0000","last_undegraded":"2023-10-06T02:47:29.754442+0000","last_fullsized":"2023-10-06T02:47:29.754442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:11.664273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366211+0000","last_change":"2023-10-06T02:47:29.366145+0000","last_active":"2023-10-06T02:47:29.366211+0000","last_peered":"2023-10-06T02:47:29.366211+0000","last_clean":"2023-10-06T02:47:29.366211+0000","last_became_active":"2023-10-06T02:47:29.365893+0000","last_became_peered":"2023-10-06T02:47:29.365893+0000","last_unstale":"2023-10-06T02:47:29.366211+0000","last_undegraded":"2023-10-06T02:47:29.366211+0000","last_fullsized":"2023-10-06T02:47:29.366211+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:43.903083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371254+0000","last_change":"2023-10-06T02:47:28.746538+0000","last_active":"2023-10-06T02:47:29.371254+0000","last_peered":"2023-10-06T02:47:29.371254+0000","last_clean":"2023-10-06T02:47:29.371254+0000","last_became_active":"2023-10-06T02:47:28.745931+0000","last_became_peered":"2023-10-06T02:47:28.745931+0000","last_unstale":"2023-10-06T02:47:29.371254+0000","last_undegraded":"2023-10-06T02:47:29.371254+0000","last_fullsized":"2023-10-06T02:47:29.371254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:44.890256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373352+0000","last_change":"2023-10-06T02:47:29.373248+0000","last_active":"2023-10-06T02:47:29.373352+0000","last_peered":"2023-10-06T02:47:29.373352+0000","last_clean":"2023-10-06T02:47:29.373352+0000","last_became_active":"2023-10-06T02:47:29.372982+0000","last_became_peered":"2023-10-06T02:47:29.372982+0000","last_unstale":"2023-10-06T02:47:29.373352+0000","last_undegraded":"2023-10-06T02:47:29.373352+0000","last_fullsized":"2023-10-06T02:47:29.373352+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:57.886727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374503+0000","last_change":"2023-10-06T02:47:28.745482+0000","last_active":"2023-10-06T02:47:29.374503+0000","last_peered":"2023-10-06T02:47:29.374503+0000","last_clean":"2023-10-06T02:47:29.374503+0000","last_became_active":"2023-10-06T02:47:28.745221+0000","last_became_peered":"2023-10-06T02:47:28.745221+0000","last_unstale":"2023-10-06T02:47:29.374503+0000","last_undegraded":"2023-10-06T02:47:29.374503+0000","last_fullsized":"2023-10-06T02:47:29.374503+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:11.664273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365717+0000","last_change":"2023-10-06T02:47:29.364540+0000","last_active":"2023-10-06T02:47:29.365717+0000","last_peered":"2023-10-06T02:47:29.365717+0000","last_clean":"2023-10-06T02:47:29.365717+0000","last_became_active":"2023-10-06T02:47:29.364331+0000","last_became_peered":"2023-10-06T02:47:29.364331+0000","last_unstale":"2023-10-06T02:47:29.365717+0000","last_undegraded":"2023-10-06T02:47:29.365717+0000","last_fullsized":"2023-10-06T02:47:29.365717+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:14:58.202640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.759242+0000","last_change":"2023-10-06T02:47:28.748837+0000","last_active":"2023-10-06T02:47:29.759242+0000","last_peered":"2023-10-06T02:47:29.759242+0000","last_clean":"2023-10-06T02:47:29.759242+0000","last_became_active":"2023-10-06T02:47:28.748611+0000","last_became_peered":"2023-10-06T02:47:28.748611+0000","last_unstale":"2023-10-06T02:47:29.759242+0000","last_undegraded":"2023-10-06T02:47:29.759242+0000","last_fullsized":"2023-10-06T02:47:29.759242+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:44.347198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374565+0000","last_change":"2023-10-06T02:47:29.374123+0000","last_active":"2023-10-06T02:47:29.374565+0000","last_peered":"2023-10-06T02:47:29.374565+0000","last_clean":"2023-10-06T02:47:29.374565+0000","last_became_active":"2023-10-06T02:47:29.373941+0000","last_became_peered":"2023-10-06T02:47:29.373941+0000","last_unstale":"2023-10-06T02:47:29.374565+0000","last_undegraded":"2023-10-06T02:47:29.374565+0000","last_fullsized":"2023-10-06T02:47:29.374565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:42.558021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.753789+0000","last_change":"2023-10-06T02:47:28.751209+0000","last_active":"2023-10-06T02:47:29.753789+0000","last_peered":"2023-10-06T02:47:29.753789+0000","last_clean":"2023-10-06T02:47:29.753789+0000","last_became_active":"2023-10-06T02:47:28.750981+0000","last_became_peered":"2023-10-06T02:47:28.750981+0000","last_unstale":"2023-10-06T02:47:29.753789+0000","last_undegraded":"2023-10-06T02:47:29.753789+0000","last_fullsized":"2023-10-06T02:47:29.753789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:06.920712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366200+0000","last_change":"2023-10-06T02:47:29.366146+0000","last_active":"2023-10-06T02:47:29.366200+0000","last_peered":"2023-10-06T02:47:29.366200+0000","last_clean":"2023-10-06T02:47:29.366200+0000","last_became_active":"2023-10-06T02:47:29.365939+0000","last_became_peered":"2023-10-06T02:47:29.365939+0000","last_unstale":"2023-10-06T02:47:29.366200+0000","last_undegraded":"2023-10-06T02:47:29.366200+0000","last_fullsized":"2023-10-06T02:47:29.366200+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.625194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.754381+0000","last_change":"2023-10-06T02:47:28.739786+0000","last_active":"2023-10-06T02:47:29.754381+0000","last_peered":"2023-10-06T02:47:29.754381+0000","last_clean":"2023-10-06T02:47:29.754381+0000","last_became_active":"2023-10-06T02:47:28.739555+0000","last_became_peered":"2023-10-06T02:47:28.739555+0000","last_unstale":"2023-10-06T02:47:29.754381+0000","last_undegraded":"2023-10-06T02:47:29.754381+0000","last_fullsized":"2023-10-06T02:47:29.754381+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.842853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372635+0000","last_change":"2023-10-06T02:47:29.371532+0000","last_active":"2023-10-06T02:47:29.372635+0000","last_peered":"2023-10-06T02:47:29.372635+0000","last_clean":"2023-10-06T02:47:29.372635+0000","last_became_active":"2023-10-06T02:47:29.370188+0000","last_became_peered":"2023-10-06T02:47:29.370188+0000","last_unstale":"2023-10-06T02:47:29.372635+0000","last_undegraded":"2023-10-06T02:47:29.372635+0000","last_fullsized":"2023-10-06T02:47:29.372635+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:38.034082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.757609+0000","last_change":"2023-10-06T02:47:28.747227+0000","last_active":"2023-10-06T02:47:29.757609+0000","last_peered":"2023-10-06T02:47:29.757609+0000","last_clean":"2023-10-06T02:47:29.757609+0000","last_became_active":"2023-10-06T02:47:28.747026+0000","last_became_peered":"2023-10-06T02:47:28.747026+0000","last_unstale":"2023-10-06T02:47:29.757609+0000","last_undegraded":"2023-10-06T02:47:29.757609+0000","last_fullsized":"2023-10-06T02:47:29.757609+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:25.753396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366338+0000","last_change":"2023-10-06T02:47:29.366290+0000","last_active":"2023-10-06T02:47:29.366338+0000","last_peered":"2023-10-06T02:47:29.366338+0000","last_clean":"2023-10-06T02:47:29.366338+0000","last_became_active":"2023-10-06T02:47:29.366092+0000","last_became_peered":"2023-10-06T02:47:29.366092+0000","last_unstale":"2023-10-06T02:47:29.366338+0000","last_undegraded":"2023-10-06T02:47:29.366338+0000","last_fullsized":"2023-10-06T02:47:29.366338+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:20.870739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.367347+0000","last_change":"2023-10-06T02:47:28.748849+0000","last_active":"2023-10-06T02:47:29.367347+0000","last_peered":"2023-10-06T02:47:29.367347+0000","last_clean":"2023-10-06T02:47:29.367347+0000","last_became_active":"2023-10-06T02:47:28.748688+0000","last_became_peered":"2023-10-06T02:47:28.748688+0000","last_unstale":"2023-10-06T02:47:29.367347+0000","last_undegraded":"2023-10-06T02:47:29.367347+0000","last_fullsized":"2023-10-06T02:47:29.367347+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:03.244419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372974+0000","last_change":"2023-10-06T02:47:29.372710+0000","last_active":"2023-10-06T02:47:29.372974+0000","last_peered":"2023-10-06T02:47:29.372974+0000","last_clean":"2023-10-06T02:47:29.372974+0000","last_became_active":"2023-10-06T02:47:29.372452+0000","last_became_peered":"2023-10-06T02:47:29.372452+0000","last_unstale":"2023-10-06T02:47:29.372974+0000","last_undegraded":"2023-10-06T02:47:29.372974+0000","last_fullsized":"2023-10-06T02:47:29.372974+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:30.214630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.755415+0000","last_change":"2023-10-06T02:47:28.743965+0000","last_active":"2023-10-06T02:47:29.755415+0000","last_peered":"2023-10-06T02:47:29.755415+0000","last_clean":"2023-10-06T02:47:29.755415+0000","last_became_active":"2023-10-06T02:47:28.743728+0000","last_became_peered":"2023-10-06T02:47:28.743728+0000","last_unstale":"2023-10-06T02:47:29.755415+0000","last_undegraded":"2023-10-06T02:47:29.755415+0000","last_fullsized":"2023-10-06T02:47:29.755415+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:39.874394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373283+0000","last_change":"2023-10-06T02:47:29.373217+0000","last_active":"2023-10-06T02:47:29.373283+0000","last_peered":"2023-10-06T02:47:29.373283+0000","last_clean":"2023-10-06T02:47:29.373283+0000","last_became_active":"2023-10-06T02:47:29.372988+0000","last_became_peered":"2023-10-06T02:47:29.372988+0000","last_unstale":"2023-10-06T02:47:29.373283+0000","last_undegraded":"2023-10-06T02:47:29.373283+0000","last_fullsized":"2023-10-06T02:47:29.373283+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:26.879596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.369085+0000","last_change":"2023-10-06T02:47:28.746389+0000","last_active":"2023-10-06T02:47:29.369085+0000","last_peered":"2023-10-06T02:47:29.369085+0000","last_clean":"2023-10-06T02:47:29.369085+0000","last_became_active":"2023-10-06T02:47:28.743600+0000","last_became_peered":"2023-10-06T02:47:28.743600+0000","last_unstale":"2023-10-06T02:47:29.369085+0000","last_undegraded":"2023-10-06T02:47:29.369085+0000","last_fullsized":"2023-10-06T02:47:29.369085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:44:56.639803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372909+0000","last_change":"2023-10-06T02:47:29.372856+0000","last_active":"2023-10-06T02:47:29.372909+0000","last_peered":"2023-10-06T02:47:29.372909+0000","last_clean":"2023-10-06T02:47:29.372909+0000","last_became_active":"2023-10-06T02:47:29.372305+0000","last_became_peered":"2023-10-06T02:47:29.372305+0000","last_unstale":"2023-10-06T02:47:29.372909+0000","last_undegraded":"2023-10-06T02:47:29.372909+0000","last_fullsized":"2023-10-06T02:47:29.372909+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:57.886727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.361089+0000","last_change":"2023-10-06T02:47:28.743137+0000","last_active":"2023-10-06T02:47:29.361089+0000","last_peered":"2023-10-06T02:47:29.361089+0000","last_clean":"2023-10-06T02:47:29.361089+0000","last_became_active":"2023-10-06T02:47:28.742895+0000","last_became_peered":"2023-10-06T02:47:28.742895+0000","last_unstale":"2023-10-06T02:47:29.361089+0000","last_undegraded":"2023-10-06T02:47:29.361089+0000","last_fullsized":"2023-10-06T02:47:29.361089+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:13.743249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373367+0000","last_change":"2023-10-06T02:47:29.373299+0000","last_active":"2023-10-06T02:47:29.373367+0000","last_peered":"2023-10-06T02:47:29.373367+0000","last_clean":"2023-10-06T02:47:29.373367+0000","last_became_active":"2023-10-06T02:47:29.373056+0000","last_became_peered":"2023-10-06T02:47:29.373056+0000","last_unstale":"2023-10-06T02:47:29.373367+0000","last_undegraded":"2023-10-06T02:47:29.373367+0000","last_fullsized":"2023-10-06T02:47:29.373367+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:44:57.645819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363643+0000","last_change":"2023-10-06T02:47:28.743516+0000","last_active":"2023-10-06T02:47:29.363643+0000","last_peered":"2023-10-06T02:47:29.363643+0000","last_clean":"2023-10-06T02:47:29.363643+0000","last_became_active":"2023-10-06T02:47:28.743307+0000","last_became_peered":"2023-10-06T02:47:28.743307+0000","last_unstale":"2023-10-06T02:47:29.363643+0000","last_undegraded":"2023-10-06T02:47:29.363643+0000","last_fullsized":"2023-10-06T02:47:29.363643+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:17.691598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365638+0000","last_change":"2023-10-06T02:47:29.363985+0000","last_active":"2023-10-06T02:47:29.365638+0000","last_peered":"2023-10-06T02:47:29.365638+0000","last_clean":"2023-10-06T02:47:29.365638+0000","last_became_active":"2023-10-06T02:47:29.363759+0000","last_became_peered":"2023-10-06T02:47:29.363759+0000","last_unstale":"2023-10-06T02:47:29.365638+0000","last_undegraded":"2023-10-06T02:47:29.365638+0000","last_fullsized":"2023-10-06T02:47:29.365638+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:54.744664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368612+0000","last_change":"2023-10-06T02:47:28.747098+0000","last_active":"2023-10-06T02:47:29.368612+0000","last_peered":"2023-10-06T02:47:29.368612+0000","last_clean":"2023-10-06T02:47:29.368612+0000","last_became_active":"2023-10-06T02:47:28.746806+0000","last_became_peered":"2023-10-06T02:47:28.746806+0000","last_unstale":"2023-10-06T02:47:29.368612+0000","last_undegraded":"2023-10-06T02:47:29.368612+0000","last_fullsized":"2023-10-06T02:47:29.368612+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:13.743249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363883+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:47:29.363883+0000","last_peered":"2023-10-06T02:47:29.363883+0000","last_clean":"2023-10-06T02:47:29.363883+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:47:29.363883+0000","last_undegraded":"2023-10-06T02:47:29.363883+0000","last_fullsized":"2023-10-06T02:47:29.363883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371852+0000","last_change":"2023-10-06T02:47:29.369599+0000","last_active":"2023-10-06T02:47:29.371852+0000","last_peered":"2023-10-06T02:47:29.371852+0000","last_clean":"2023-10-06T02:47:29.371852+0000","last_became_active":"2023-10-06T02:47:29.369362+0000","last_became_peered":"2023-10-06T02:47:29.369362+0000","last_unstale":"2023-10-06T02:47:29.371852+0000","last_undegraded":"2023-10-06T02:47:29.371852+0000","last_fullsized":"2023-10-06T02:47:29.371852+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.625194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.757133+0000","last_change":"2023-10-06T02:47:28.749593+0000","last_active":"2023-10-06T02:47:29.757133+0000","last_peered":"2023-10-06T02:47:29.757133+0000","last_clean":"2023-10-06T02:47:29.757133+0000","last_became_active":"2023-10-06T02:47:28.749424+0000","last_became_peered":"2023-10-06T02:47:28.749424+0000","last_unstale":"2023-10-06T02:47:29.757133+0000","last_undegraded":"2023-10-06T02:47:29.757133+0000","last_fullsized":"2023-10-06T02:47:29.757133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:00.466176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.364241+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:47:29.364241+0000","last_peered":"2023-10-06T02:47:29.364241+0000","last_clean":"2023-10-06T02:47:29.364241+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:47:29.364241+0000","last_undegraded":"2023-10-06T02:47:29.364241+0000","last_fullsized":"2023-10-06T02:47:29.364241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374583+0000","last_change":"2023-10-06T02:47:29.374397+0000","last_active":"2023-10-06T02:47:29.374583+0000","last_peered":"2023-10-06T02:47:29.374583+0000","last_clean":"2023-10-06T02:47:29.374583+0000","last_became_active":"2023-10-06T02:47:29.374141+0000","last_became_peered":"2023-10-06T02:47:29.374141+0000","last_unstale":"2023-10-06T02:47:29.374583+0000","last_undegraded":"2023-10-06T02:47:29.374583+0000","last_fullsized":"2023-10-06T02:47:29.374583+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.217184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.360978+0000","last_change":"2023-10-06T02:47:28.751926+0000","last_active":"2023-10-06T02:47:29.360978+0000","last_peered":"2023-10-06T02:47:29.360978+0000","last_clean":"2023-10-06T02:47:29.360978+0000","last_became_active":"2023-10-06T02:47:28.749931+0000","last_became_peered":"2023-10-06T02:47:28.749931+0000","last_unstale":"2023-10-06T02:47:29.360978+0000","last_undegraded":"2023-10-06T02:47:29.360978+0000","last_fullsized":"2023-10-06T02:47:29.360978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:23.900521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363296+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:47:29.363296+0000","last_peered":"2023-10-06T02:47:29.363296+0000","last_clean":"2023-10-06T02:47:29.363296+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:47:29.363296+0000","last_undegraded":"2023-10-06T02:47:29.363296+0000","last_fullsized":"2023-10-06T02:47:29.363296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371217+0000","last_change":"2023-10-06T02:47:29.371119+0000","last_active":"2023-10-06T02:47:29.371217+0000","last_peered":"2023-10-06T02:47:29.371217+0000","last_clean":"2023-10-06T02:47:29.371217+0000","last_became_active":"2023-10-06T02:47:29.370887+0000","last_became_peered":"2023-10-06T02:47:29.370887+0000","last_unstale":"2023-10-06T02:47:29.371217+0000","last_undegraded":"2023-10-06T02:47:29.371217+0000","last_fullsized":"2023-10-06T02:47:29.371217+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:39.937749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.360897+0000","last_change":"2023-10-06T02:47:28.743638+0000","last_active":"2023-10-06T02:47:29.360897+0000","last_peered":"2023-10-06T02:47:29.360897+0000","last_clean":"2023-10-06T02:47:29.360897+0000","last_became_active":"2023-10-06T02:47:28.743336+0000","last_became_peered":"2023-10-06T02:47:28.743336+0000","last_unstale":"2023-10-06T02:47:29.360897+0000","last_undegraded":"2023-10-06T02:47:29.360897+0000","last_fullsized":"2023-10-06T02:47:29.360897+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:37.493317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.364223+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:47:29.364223+0000","last_peered":"2023-10-06T02:47:29.364223+0000","last_clean":"2023-10-06T02:47:29.364223+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:47:29.364223+0000","last_undegraded":"2023-10-06T02:47:29.364223+0000","last_fullsized":"2023-10-06T02:47:29.364223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368803+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:47:29.368803+0000","last_peered":"2023-10-06T02:47:29.368803+0000","last_clean":"2023-10-06T02:47:29.368803+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:47:29.368803+0000","last_undegraded":"2023-10-06T02:47:29.368803+0000","last_fullsized":"2023-10-06T02:47:29.368803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365344+0000","last_change":"2023-10-06T02:47:29.365101+0000","last_active":"2023-10-06T02:47:29.365344+0000","last_peered":"2023-10-06T02:47:29.365344+0000","last_clean":"2023-10-06T02:47:29.365344+0000","last_became_active":"2023-10-06T02:47:29.364874+0000","last_became_peered":"2023-10-06T02:47:29.364874+0000","last_unstale":"2023-10-06T02:47:29.365344+0000","last_undegraded":"2023-10-06T02:47:29.365344+0000","last_fullsized":"2023-10-06T02:47:29.365344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:52.356362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368320+0000","last_change":"2023-10-06T02:47:28.744067+0000","last_active":"2023-10-06T02:47:29.368320+0000","last_peered":"2023-10-06T02:47:29.368320+0000","last_clean":"2023-10-06T02:47:29.368320+0000","last_became_active":"2023-10-06T02:47:28.743545+0000","last_became_peered":"2023-10-06T02:47:28.743545+0000","last_unstale":"2023-10-06T02:47:29.368320+0000","last_undegraded":"2023-10-06T02:47:29.368320+0000","last_fullsized":"2023-10-06T02:47:29.368320+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:13.743249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368403+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:47:29.368403+0000","last_peered":"2023-10-06T02:47:29.368403+0000","last_clean":"2023-10-06T02:47:29.368403+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:47:29.368403+0000","last_undegraded":"2023-10-06T02:47:29.368403+0000","last_fullsized":"2023-10-06T02:47:29.368403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370638+0000","last_change":"2023-10-06T02:47:29.370314+0000","last_active":"2023-10-06T02:47:29.370638+0000","last_peered":"2023-10-06T02:47:29.370638+0000","last_clean":"2023-10-06T02:47:29.370638+0000","last_became_active":"2023-10-06T02:47:29.370116+0000","last_became_peered":"2023-10-06T02:47:29.370116+0000","last_unstale":"2023-10-06T02:47:29.370638+0000","last_undegraded":"2023-10-06T02:47:29.370638+0000","last_fullsized":"2023-10-06T02:47:29.370638+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:10.807265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363830+0000","last_change":"2023-10-06T02:47:28.742681+0000","last_active":"2023-10-06T02:47:29.363830+0000","last_peered":"2023-10-06T02:47:29.363830+0000","last_clean":"2023-10-06T02:47:29.363830+0000","last_became_active":"2023-10-06T02:47:28.742448+0000","last_became_peered":"2023-10-06T02:47:28.742448+0000","last_unstale":"2023-10-06T02:47:29.363830+0000","last_undegraded":"2023-10-06T02:47:29.363830+0000","last_fullsized":"2023-10-06T02:47:29.363830+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:13.743249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368887+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:47:29.368887+0000","last_peered":"2023-10-06T02:47:29.368887+0000","last_clean":"2023-10-06T02:47:29.368887+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:47:29.368887+0000","last_undegraded":"2023-10-06T02:47:29.368887+0000","last_fullsized":"2023-10-06T02:47:29.368887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374454+0000","last_change":"2023-10-06T02:47:29.374400+0000","last_active":"2023-10-06T02:47:29.374454+0000","last_peered":"2023-10-06T02:47:29.374454+0000","last_clean":"2023-10-06T02:47:29.374454+0000","last_became_active":"2023-10-06T02:47:29.374097+0000","last_became_peered":"2023-10-06T02:47:29.374097+0000","last_unstale":"2023-10-06T02:47:29.374454+0000","last_undegraded":"2023-10-06T02:47:29.374454+0000","last_fullsized":"2023-10-06T02:47:29.374454+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:10.807265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368659+0000","last_change":"2023-10-06T02:47:28.748409+0000","last_active":"2023-10-06T02:47:29.368659+0000","last_peered":"2023-10-06T02:47:29.368659+0000","last_clean":"2023-10-06T02:47:29.368659+0000","last_became_active":"2023-10-06T02:47:28.748223+0000","last_became_peered":"2023-10-06T02:47:28.748223+0000","last_unstale":"2023-10-06T02:47:29.368659+0000","last_undegraded":"2023-10-06T02:47:29.368659+0000","last_fullsized":"2023-10-06T02:47:29.368659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:23.900521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363079+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:47:29.363079+0000","last_peered":"2023-10-06T02:47:29.363079+0000","last_clean":"2023-10-06T02:47:29.363079+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:47:29.363079+0000","last_undegraded":"2023-10-06T02:47:29.363079+0000","last_fullsized":"2023-10-06T02:47:29.363079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378666+0000","last_change":"2023-10-06T02:47:29.378211+0000","last_active":"2023-10-06T02:47:29.378666+0000","last_peered":"2023-10-06T02:47:29.378666+0000","last_clean":"2023-10-06T02:47:29.378666+0000","last_became_active":"2023-10-06T02:47:29.377624+0000","last_became_peered":"2023-10-06T02:47:29.377624+0000","last_unstale":"2023-10-06T02:47:29.378666+0000","last_undegraded":"2023-10-06T02:47:29.378666+0000","last_fullsized":"2023-10-06T02:47:29.378666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:27.998786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370114+0000","last_change":"2023-10-06T02:47:28.748399+0000","last_active":"2023-10-06T02:47:29.370114+0000","last_peered":"2023-10-06T02:47:29.370114+0000","last_clean":"2023-10-06T02:47:29.370114+0000","last_became_active":"2023-10-06T02:47:28.748192+0000","last_became_peered":"2023-10-06T02:47:28.748192+0000","last_unstale":"2023-10-06T02:47:29.370114+0000","last_undegraded":"2023-10-06T02:47:29.370114+0000","last_fullsized":"2023-10-06T02:47:29.370114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:53.323823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.367530+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:47:29.367530+0000","last_peered":"2023-10-06T02:47:29.367530+0000","last_clean":"2023-10-06T02:47:29.367530+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:47:29.367530+0000","last_undegraded":"2023-10-06T02:47:29.367530+0000","last_fullsized":"2023-10-06T02:47:29.367530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168291,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.4870000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.626},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758159,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.496}]},{"osd":2,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.436},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.317},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.248}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.373},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199175000,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":21.942,"5min":21.942,"15min":21.942},"last":0.437}]},{"osd":4,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":22.010999999999999,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.090999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":21.98,"5min":21.98,"15min":21.98},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":11.154,"5min":11.154,"15min":11.154},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757247,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.219},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.252}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":1.2569999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757225,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.307},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.373},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.38600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":6.4189999999999996,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46999999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":14.912000000000001,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.45900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.8949999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.625},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":5.3579999999999997,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.9329999999999998,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":5.9820000000000002,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":5.4390000000000001,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.5},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3470000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":13.173999999999999,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.75},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.67900000000000005}]}]}],"pool_statfs":[]}} 2023-10-06T02:47:33.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:47:33.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.965+0000 7fc3308a6700 1 Processor -- start 2023-10-06T02:47:33.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.965+0000 7fc3308a6700 1 -- start start 2023-10-06T02:47:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.966+0000 7fc3308a6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc32c0cf240 0x7fc32c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.966+0000 7fc3308a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c06da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.966+0000 7fc3308a6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32c0b0ca0 con 0x7fc32c15a2a0 2023-10-06T02:47:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.966+0000 7fc3308a6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32c06ea90 con 0x7fc32c0cf240 2023-10-06T02:47:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.966+0000 7fc3308a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c0b00d0 con 0x7fc32c06d650 2023-10-06T02:47:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.966+0000 7fc321d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc32c0cf240 0x7fc32c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.966+0000 7fc32a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc32c15a2a0 0x7fc32c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46870/0 (socket says 172.21.15.81:46870) 2023-10-06T02:47:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.966+0000 7fc32a59c700 1 -- 172.21.15.81:0/447955921 learned_addr learned my addr 172.21.15.81:0/447955921 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc32ad9d700 1 --2- 172.21.15.81:0/447955921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c06da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc321d9b700 1 -- 172.21.15.81:0/447955921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 msgr2=0x7fc32c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc321d9b700 1 --2- 172.21.15.81:0/447955921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c06da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc329d9b700 1 -- 172.21.15.81:0/447955921 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195549 0 0) 0x7fc32c0b0ca0 con 0x7fc32c15a2a0 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc321d9b700 1 -- 172.21.15.81:0/447955921 >> v1:172.21.15.81:6789/0 conn(0x7fc32c15a2a0 legacy=0x7fc32c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc321d9b700 1 -- 172.21.15.81:0/447955921 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c0b0370 con 0x7fc32c0cf240 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc32ad9d700 1 --2- 172.21.15.81:0/447955921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c06da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc321d9b700 1 --2- 172.21.15.81:0/447955921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 0x7fc32c0b1130 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc3140098e0 tx=0x7fc3140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dcee9d8df93da1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc329d9b700 1 -- 172.21.15.81:0/447955921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314009e80 con 0x7fc32c0cf240 2023-10-06T02:47:33.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc329d9b700 1 -- 172.21.15.81:0/447955921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31400b860 con 0x7fc32c0cf240 2023-10-06T02:47:33.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc329d9b700 1 -- 172.21.15.81:0/447955921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31400bbe0 con 0x7fc32c0cf240 2023-10-06T02:47:33.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc3308a6700 1 -- 172.21.15.81:0/447955921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 msgr2=0x7fc32c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc3308a6700 1 --2- 172.21.15.81:0/447955921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 0x7fc32c0b1130 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc3140098e0 tx=0x7fc3140091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc3308a6700 1 -- 172.21.15.81:0/447955921 shutdown_connections 2023-10-06T02:47:33.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc3308a6700 1 --2- 172.21.15.81:0/447955921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c06da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc3308a6700 1 --2- 172.21.15.81:0/447955921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 0x7fc32c0b1130 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.967+0000 7fc3308a6700 1 -- 172.21.15.81:0/447955921 >> 172.21.15.81:0/447955921 conn(0x7fc32c067640 msgr2=0x7fc32c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:33.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.968+0000 7fc3308a6700 1 -- 172.21.15.81:0/447955921 shutdown_connections 2023-10-06T02:47:33.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.968+0000 7fc3308a6700 1 -- 172.21.15.81:0/447955921 wait complete. 2023-10-06T02:47:33.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.969+0000 7fc3308a6700 1 Processor -- start 2023-10-06T02:47:33.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.969+0000 7fc3308a6700 1 -- start start 2023-10-06T02:47:33.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.969+0000 7fc3308a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.969+0000 7fc3308a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 0x7fc32c15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.969+0000 7fc3308a6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32c15a2a0 0x7fc32c0b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.969+0000 7fc3308a6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c15a7a0 con 0x7fc32c0cf240 2023-10-06T02:47:33.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.969+0000 7fc3308a6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c0b19e0 con 0x7fc32c15a2a0 2023-10-06T02:47:33.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.969+0000 7fc3308a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c0b1f30 con 0x7fc32c06d650 2023-10-06T02:47:33.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.969+0000 7fc321d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 0x7fc32c15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc321d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 0x7fc32c15c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56180/0 (socket says 172.21.15.81:56180) 2023-10-06T02:47:33.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc321d9b700 1 -- 172.21.15.81:0/2265278703 learned_addr learned my addr 172.21.15.81:0/2265278703 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc32ad9d700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32c15a2a0 0x7fc32c0b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc32a59c700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc321d9b700 1 -- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 msgr2=0x7fc32c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc321d9b700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c0b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc321d9b700 1 -- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32c15a2a0 msgr2=0x7fc32c0b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc321d9b700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32c15a2a0 0x7fc32c0b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc321d9b700 1 -- 172.21.15.81:0/2265278703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314009420 con 0x7fc32c0cf240 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc32a59c700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c0b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc32ad9d700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32c15a2a0 0x7fc32c0b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:33.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc321d9b700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 0x7fc32c15c140 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc32c06f990 tx=0x7fc314017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc322ffd700 1 -- 172.21.15.81:0/2265278703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314011420 con 0x7fc32c0cf240 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc322ffd700 1 -- 172.21.15.81:0/2265278703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3140115a0 con 0x7fc32c0cf240 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc322ffd700 1 -- 172.21.15.81:0/2265278703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314011960 con 0x7fc32c0cf240 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32c0b1c50 con 0x7fc32c0cf240 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.970+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32c152ac0 con 0x7fc32c0cf240 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.971+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32c15a950 con 0x7fc32c0cf240 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.971+0000 7fc322ffd700 1 -- 172.21.15.81:0/2265278703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc314011d50 con 0x7fc32c0cf240 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.972+0000 7fc322ffd700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc30c066f30 0x7fc30c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.972+0000 7fc322ffd700 1 -- 172.21.15.81:0/2265278703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc3140861a0 con 0x7fc32c0cf240 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.972+0000 7fc32a59c700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc30c066f30 0x7fc30c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:33.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.973+0000 7fc32a59c700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc30c066f30 0x7fc30c0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc31c007fd0 tx=0x7fc31c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:33.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:33.976+0000 7fc322ffd700 1 -- 172.21.15.81:0/2265278703 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc32c15a950 con 0x7fc32c0cf240 2023-10-06T02:47:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.154+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc32c15a950 con 0x7fc30c066f30 2023-10-06T02:47:34.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.163+0000 7fc322ffd700 1 -- 172.21.15.81:0/2265278703 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305260 (secure 0 0 0) 0x7fc32c15a950 con 0x7fc30c066f30 2023-10-06T02:47:34.168 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:34.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc30c066f30 msgr2=0x7fc30c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc30c066f30 0x7fc30c0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc31c007fd0 tx=0x7fc31c009040 comp rx=0 tx=0).stop 2023-10-06T02:47:34.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 msgr2=0x7fc32c15c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 0x7fc32c15c140 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc32c06f990 tx=0x7fc314017000 comp rx=0 tx=0).stop 2023-10-06T02:47:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 shutdown_connections 2023-10-06T02:47:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc30c066f30 0x7fc30c0693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc32c15a2a0 0x7fc32c0b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc32c06d650 0x7fc32c0b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 --2- 172.21.15.81:0/2265278703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c0cf240 0x7fc32c15c140 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 >> 172.21.15.81:0/2265278703 conn(0x7fc32c067640 msgr2=0x7fc32c158180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.166+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 shutdown_connections 2023-10-06T02:47:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.167+0000 7fc3308a6700 1 -- 172.21.15.81:0/2265278703 wait complete. 2023-10-06T02:47:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:47:34.179 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-10-06T02:47:33.512190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559464,"statfs":{"total":1600000000,"available":1596891557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.778302"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365638+0000","last_change":"2023-10-06T02:47:29.365596+0000","last_active":"2023-10-06T02:47:29.365638+0000","last_peered":"2023-10-06T02:47:29.365638+0000","last_clean":"2023-10-06T02:47:29.365638+0000","last_became_active":"2023-10-06T02:47:29.365409+0000","last_became_peered":"2023-10-06T02:47:29.365409+0000","last_unstale":"2023-10-06T02:47:29.365638+0000","last_undegraded":"2023-10-06T02:47:29.365638+0000","last_fullsized":"2023-10-06T02:47:29.365638+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:38.034082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378983+0000","last_change":"2023-10-06T02:47:29.378894+0000","last_active":"2023-10-06T02:47:29.378983+0000","last_peered":"2023-10-06T02:47:29.378983+0000","last_clean":"2023-10-06T02:47:29.378983+0000","last_became_active":"2023-10-06T02:47:29.378539+0000","last_became_peered":"2023-10-06T02:47:29.378539+0000","last_unstale":"2023-10-06T02:47:29.378983+0000","last_undegraded":"2023-10-06T02:47:29.378983+0000","last_fullsized":"2023-10-06T02:47:29.378983+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:38.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365666+0000","last_change":"2023-10-06T02:47:29.364114+0000","last_active":"2023-10-06T02:47:29.365666+0000","last_peered":"2023-10-06T02:47:29.365666+0000","last_clean":"2023-10-06T02:47:29.365666+0000","last_became_active":"2023-10-06T02:47:29.363829+0000","last_became_peered":"2023-10-06T02:47:29.363829+0000","last_unstale":"2023-10-06T02:47:29.365666+0000","last_undegraded":"2023-10-06T02:47:29.365666+0000","last_fullsized":"2023-10-06T02:47:29.365666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:00.426995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374677+0000","last_change":"2023-10-06T02:47:29.374096+0000","last_active":"2023-10-06T02:47:29.374677+0000","last_peered":"2023-10-06T02:47:29.374677+0000","last_clean":"2023-10-06T02:47:29.374677+0000","last_became_active":"2023-10-06T02:47:29.373815+0000","last_became_peered":"2023-10-06T02:47:29.373815+0000","last_unstale":"2023-10-06T02:47:29.374677+0000","last_undegraded":"2023-10-06T02:47:29.374677+0000","last_fullsized":"2023-10-06T02:47:29.374677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:55:23.156167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.375691+0000","last_change":"2023-10-06T02:47:29.375629+0000","last_active":"2023-10-06T02:47:29.375691+0000","last_peered":"2023-10-06T02:47:29.375691+0000","last_clean":"2023-10-06T02:47:29.375691+0000","last_became_active":"2023-10-06T02:47:29.375266+0000","last_became_peered":"2023-10-06T02:47:29.375266+0000","last_unstale":"2023-10-06T02:47:29.375691+0000","last_undegraded":"2023-10-06T02:47:29.375691+0000","last_fullsized":"2023-10-06T02:47:29.375691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:38.153033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.377371+0000","last_change":"2023-10-06T02:47:29.377322+0000","last_active":"2023-10-06T02:47:29.377371+0000","last_peered":"2023-10-06T02:47:29.377371+0000","last_clean":"2023-10-06T02:47:29.377371+0000","last_became_active":"2023-10-06T02:47:29.377190+0000","last_became_peered":"2023-10-06T02:47:29.377190+0000","last_unstale":"2023-10-06T02:47:29.377371+0000","last_undegraded":"2023-10-06T02:47:29.377371+0000","last_fullsized":"2023-10-06T02:47:29.377371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:38.153033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366701+0000","last_change":"2023-10-06T02:47:29.366644+0000","last_active":"2023-10-06T02:47:29.366701+0000","last_peered":"2023-10-06T02:47:29.366701+0000","last_clean":"2023-10-06T02:47:29.366701+0000","last_became_active":"2023-10-06T02:47:29.366206+0000","last_became_peered":"2023-10-06T02:47:29.366206+0000","last_unstale":"2023-10-06T02:47:29.366701+0000","last_undegraded":"2023-10-06T02:47:29.366701+0000","last_fullsized":"2023-10-06T02:47:29.366701+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:42.558021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371301+0000","last_change":"2023-10-06T02:47:29.371250+0000","last_active":"2023-10-06T02:47:29.371301+0000","last_peered":"2023-10-06T02:47:29.371301+0000","last_clean":"2023-10-06T02:47:29.371301+0000","last_became_active":"2023-10-06T02:47:29.371032+0000","last_became_peered":"2023-10-06T02:47:29.371032+0000","last_unstale":"2023-10-06T02:47:29.371301+0000","last_undegraded":"2023-10-06T02:47:29.371301+0000","last_fullsized":"2023-10-06T02:47:29.371301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:00.426995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371565+0000","last_change":"2023-10-06T02:47:29.371508+0000","last_active":"2023-10-06T02:47:29.371565+0000","last_peered":"2023-10-06T02:47:29.371565+0000","last_clean":"2023-10-06T02:47:29.371565+0000","last_became_active":"2023-10-06T02:47:29.371295+0000","last_became_peered":"2023-10-06T02:47:29.371295+0000","last_unstale":"2023-10-06T02:47:29.371565+0000","last_undegraded":"2023-10-06T02:47:29.371565+0000","last_fullsized":"2023-10-06T02:47:29.371565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:49.590043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372474+0000","last_change":"2023-10-06T02:47:29.372401+0000","last_active":"2023-10-06T02:47:29.372474+0000","last_peered":"2023-10-06T02:47:29.372474+0000","last_clean":"2023-10-06T02:47:29.372474+0000","last_became_active":"2023-10-06T02:47:29.372182+0000","last_became_peered":"2023-10-06T02:47:29.372182+0000","last_unstale":"2023-10-06T02:47:29.372474+0000","last_undegraded":"2023-10-06T02:47:29.372474+0000","last_fullsized":"2023-10-06T02:47:29.372474+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:27.998786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.377589+0000","last_change":"2023-10-06T02:47:29.377540+0000","last_active":"2023-10-06T02:47:29.377589+0000","last_peered":"2023-10-06T02:47:29.377589+0000","last_clean":"2023-10-06T02:47:29.377589+0000","last_became_active":"2023-10-06T02:47:29.377370+0000","last_became_peered":"2023-10-06T02:47:29.377370+0000","last_unstale":"2023-10-06T02:47:29.377589+0000","last_undegraded":"2023-10-06T02:47:29.377589+0000","last_fullsized":"2023-10-06T02:47:29.377589+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:26.879596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373590+0000","last_change":"2023-10-06T02:47:29.373542+0000","last_active":"2023-10-06T02:47:29.373590+0000","last_peered":"2023-10-06T02:47:29.373590+0000","last_clean":"2023-10-06T02:47:29.373590+0000","last_became_active":"2023-10-06T02:47:29.373211+0000","last_became_peered":"2023-10-06T02:47:29.373211+0000","last_unstale":"2023-10-06T02:47:29.373590+0000","last_undegraded":"2023-10-06T02:47:29.373590+0000","last_fullsized":"2023-10-06T02:47:29.373590+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:14:58.202640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371894+0000","last_change":"2023-10-06T02:47:29.371803+0000","last_active":"2023-10-06T02:47:29.371894+0000","last_peered":"2023-10-06T02:47:29.371894+0000","last_clean":"2023-10-06T02:47:29.371894+0000","last_became_active":"2023-10-06T02:47:29.371577+0000","last_became_peered":"2023-10-06T02:47:29.371577+0000","last_unstale":"2023-10-06T02:47:29.371894+0000","last_undegraded":"2023-10-06T02:47:29.371894+0000","last_fullsized":"2023-10-06T02:47:29.371894+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:30.214630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365732+0000","last_change":"2023-10-06T02:47:29.364658+0000","last_active":"2023-10-06T02:47:29.365732+0000","last_peered":"2023-10-06T02:47:29.365732+0000","last_clean":"2023-10-06T02:47:29.365732+0000","last_became_active":"2023-10-06T02:47:29.364243+0000","last_became_peered":"2023-10-06T02:47:29.364243+0000","last_unstale":"2023-10-06T02:47:29.365732+0000","last_undegraded":"2023-10-06T02:47:29.365732+0000","last_fullsized":"2023-10-06T02:47:29.365732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:42.640460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378257+0000","last_change":"2023-10-06T02:47:29.378060+0000","last_active":"2023-10-06T02:47:29.378257+0000","last_peered":"2023-10-06T02:47:29.378257+0000","last_clean":"2023-10-06T02:47:29.378257+0000","last_became_active":"2023-10-06T02:47:29.377680+0000","last_became_peered":"2023-10-06T02:47:29.377680+0000","last_unstale":"2023-10-06T02:47:29.378257+0000","last_undegraded":"2023-10-06T02:47:29.378257+0000","last_fullsized":"2023-10-06T02:47:29.378257+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:48.279515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371912+0000","last_change":"2023-10-06T02:47:29.371854+0000","last_active":"2023-10-06T02:47:29.371912+0000","last_peered":"2023-10-06T02:47:29.371912+0000","last_clean":"2023-10-06T02:47:29.371912+0000","last_became_active":"2023-10-06T02:47:29.371620+0000","last_became_peered":"2023-10-06T02:47:29.371620+0000","last_unstale":"2023-10-06T02:47:29.371912+0000","last_undegraded":"2023-10-06T02:47:29.371912+0000","last_fullsized":"2023-10-06T02:47:29.371912+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:38.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366495+0000","last_change":"2023-10-06T02:47:29.366419+0000","last_active":"2023-10-06T02:47:29.366495+0000","last_peered":"2023-10-06T02:47:29.366495+0000","last_clean":"2023-10-06T02:47:29.366495+0000","last_became_active":"2023-10-06T02:47:29.365873+0000","last_became_peered":"2023-10-06T02:47:29.365873+0000","last_unstale":"2023-10-06T02:47:29.366495+0000","last_undegraded":"2023-10-06T02:47:29.366495+0000","last_fullsized":"2023-10-06T02:47:29.366495+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:37.995899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378239+0000","last_change":"2023-10-06T02:47:29.378012+0000","last_active":"2023-10-06T02:47:29.378239+0000","last_peered":"2023-10-06T02:47:29.378239+0000","last_clean":"2023-10-06T02:47:29.378239+0000","last_became_active":"2023-10-06T02:47:29.376966+0000","last_became_peered":"2023-10-06T02:47:29.376966+0000","last_unstale":"2023-10-06T02:47:29.378239+0000","last_undegraded":"2023-10-06T02:47:29.378239+0000","last_fullsized":"2023-10-06T02:47:29.378239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:33.771859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371408+0000","last_change":"2023-10-06T02:47:29.370943+0000","last_active":"2023-10-06T02:47:29.371408+0000","last_peered":"2023-10-06T02:47:29.371408+0000","last_clean":"2023-10-06T02:47:29.371408+0000","last_became_active":"2023-10-06T02:47:29.370730+0000","last_became_peered":"2023-10-06T02:47:29.370730+0000","last_unstale":"2023-10-06T02:47:29.371408+0000","last_undegraded":"2023-10-06T02:47:29.371408+0000","last_fullsized":"2023-10-06T02:47:29.371408+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:34.361006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372779+0000","last_change":"2023-10-06T02:47:29.371957+0000","last_active":"2023-10-06T02:47:29.372779+0000","last_peered":"2023-10-06T02:47:29.372779+0000","last_clean":"2023-10-06T02:47:29.372779+0000","last_became_active":"2023-10-06T02:47:29.371721+0000","last_became_peered":"2023-10-06T02:47:29.371721+0000","last_unstale":"2023-10-06T02:47:29.372779+0000","last_undegraded":"2023-10-06T02:47:29.372779+0000","last_fullsized":"2023-10-06T02:47:29.372779+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:50.195035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378868+0000","last_change":"2023-10-06T02:47:29.378819+0000","last_active":"2023-10-06T02:47:29.378868+0000","last_peered":"2023-10-06T02:47:29.378868+0000","last_clean":"2023-10-06T02:47:29.378868+0000","last_became_active":"2023-10-06T02:47:29.378338+0000","last_became_peered":"2023-10-06T02:47:29.378338+0000","last_unstale":"2023-10-06T02:47:29.378868+0000","last_undegraded":"2023-10-06T02:47:29.378868+0000","last_fullsized":"2023-10-06T02:47:29.378868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:40.880410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373541+0000","last_change":"2023-10-06T02:47:29.373410+0000","last_active":"2023-10-06T02:47:29.373541+0000","last_peered":"2023-10-06T02:47:29.373541+0000","last_clean":"2023-10-06T02:47:29.373541+0000","last_became_active":"2023-10-06T02:47:29.372915+0000","last_became_peered":"2023-10-06T02:47:29.372915+0000","last_unstale":"2023-10-06T02:47:29.373541+0000","last_undegraded":"2023-10-06T02:47:29.373541+0000","last_fullsized":"2023-10-06T02:47:29.373541+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:43.903083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370708+0000","last_change":"2023-10-06T02:47:29.370576+0000","last_active":"2023-10-06T02:47:29.370708+0000","last_peered":"2023-10-06T02:47:29.370708+0000","last_clean":"2023-10-06T02:47:29.370708+0000","last_became_active":"2023-10-06T02:47:29.370359+0000","last_became_peered":"2023-10-06T02:47:29.370359+0000","last_unstale":"2023-10-06T02:47:29.370708+0000","last_undegraded":"2023-10-06T02:47:29.370708+0000","last_fullsized":"2023-10-06T02:47:29.370708+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:50.195035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365702+0000","last_change":"2023-10-06T02:47:29.364487+0000","last_active":"2023-10-06T02:47:29.365702+0000","last_peered":"2023-10-06T02:47:29.365702+0000","last_clean":"2023-10-06T02:47:29.365702+0000","last_became_active":"2023-10-06T02:47:29.363745+0000","last_became_peered":"2023-10-06T02:47:29.363745+0000","last_unstale":"2023-10-06T02:47:29.365702+0000","last_undegraded":"2023-10-06T02:47:29.365702+0000","last_fullsized":"2023-10-06T02:47:29.365702+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:59.356466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374808+0000","last_change":"2023-10-06T02:47:29.374584+0000","last_active":"2023-10-06T02:47:29.374808+0000","last_peered":"2023-10-06T02:47:29.374808+0000","last_clean":"2023-10-06T02:47:29.374808+0000","last_became_active":"2023-10-06T02:47:29.374374+0000","last_became_peered":"2023-10-06T02:47:29.374374+0000","last_unstale":"2023-10-06T02:47:29.374808+0000","last_undegraded":"2023-10-06T02:47:29.374808+0000","last_fullsized":"2023-10-06T02:47:29.374808+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:55.530093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370621+0000","last_change":"2023-10-06T02:47:29.369545+0000","last_active":"2023-10-06T02:47:29.370621+0000","last_peered":"2023-10-06T02:47:29.370621+0000","last_clean":"2023-10-06T02:47:29.370621+0000","last_became_active":"2023-10-06T02:47:29.369332+0000","last_became_peered":"2023-10-06T02:47:29.369332+0000","last_unstale":"2023-10-06T02:47:29.370621+0000","last_undegraded":"2023-10-06T02:47:29.370621+0000","last_fullsized":"2023-10-06T02:47:29.370621+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:37.995899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.367083+0000","last_change":"2023-10-06T02:47:29.367005+0000","last_active":"2023-10-06T02:47:29.367083+0000","last_peered":"2023-10-06T02:47:29.367083+0000","last_clean":"2023-10-06T02:47:29.367083+0000","last_became_active":"2023-10-06T02:47:29.366783+0000","last_became_peered":"2023-10-06T02:47:29.366783+0000","last_unstale":"2023-10-06T02:47:29.367083+0000","last_undegraded":"2023-10-06T02:47:29.367083+0000","last_fullsized":"2023-10-06T02:47:29.367083+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:32.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370971+0000","last_change":"2023-10-06T02:47:29.370899+0000","last_active":"2023-10-06T02:47:29.370971+0000","last_peered":"2023-10-06T02:47:29.370971+0000","last_clean":"2023-10-06T02:47:29.370971+0000","last_became_active":"2023-10-06T02:47:29.370640+0000","last_became_peered":"2023-10-06T02:47:29.370640+0000","last_unstale":"2023-10-06T02:47:29.370971+0000","last_undegraded":"2023-10-06T02:47:29.370971+0000","last_fullsized":"2023-10-06T02:47:29.370971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:56.178235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371425+0000","last_change":"2023-10-06T02:47:29.371328+0000","last_active":"2023-10-06T02:47:29.371425+0000","last_peered":"2023-10-06T02:47:29.371425+0000","last_clean":"2023-10-06T02:47:29.371425+0000","last_became_active":"2023-10-06T02:47:29.371174+0000","last_became_peered":"2023-10-06T02:47:29.371174+0000","last_unstale":"2023-10-06T02:47:29.371425+0000","last_undegraded":"2023-10-06T02:47:29.371425+0000","last_fullsized":"2023-10-06T02:47:29.371425+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:10.396225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378022+0000","last_change":"2023-10-06T02:47:29.377909+0000","last_active":"2023-10-06T02:47:29.378022+0000","last_peered":"2023-10-06T02:47:29.378022+0000","last_clean":"2023-10-06T02:47:29.378022+0000","last_became_active":"2023-10-06T02:47:29.377346+0000","last_became_peered":"2023-10-06T02:47:29.377346+0000","last_unstale":"2023-10-06T02:47:29.378022+0000","last_undegraded":"2023-10-06T02:47:29.378022+0000","last_fullsized":"2023-10-06T02:47:29.378022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.625194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365689+0000","last_change":"2023-10-06T02:47:29.364313+0000","last_active":"2023-10-06T02:47:29.365689+0000","last_peered":"2023-10-06T02:47:29.365689+0000","last_clean":"2023-10-06T02:47:29.365689+0000","last_became_active":"2023-10-06T02:47:29.364100+0000","last_became_peered":"2023-10-06T02:47:29.364100+0000","last_unstale":"2023-10-06T02:47:29.365689+0000","last_undegraded":"2023-10-06T02:47:29.365689+0000","last_fullsized":"2023-10-06T02:47:29.365689+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.217184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373357+0000","last_change":"2023-10-06T02:47:29.373286+0000","last_active":"2023-10-06T02:47:29.373357+0000","last_peered":"2023-10-06T02:47:29.373357+0000","last_clean":"2023-10-06T02:47:29.373357+0000","last_became_active":"2023-10-06T02:47:29.373060+0000","last_became_peered":"2023-10-06T02:47:29.373060+0000","last_unstale":"2023-10-06T02:47:29.373357+0000","last_undegraded":"2023-10-06T02:47:29.373357+0000","last_fullsized":"2023-10-06T02:47:29.373357+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:38.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378272+0000","last_change":"2023-10-06T02:47:29.378162+0000","last_active":"2023-10-06T02:47:29.378272+0000","last_peered":"2023-10-06T02:47:29.378272+0000","last_clean":"2023-10-06T02:47:29.378272+0000","last_became_active":"2023-10-06T02:47:29.377423+0000","last_became_peered":"2023-10-06T02:47:29.377423+0000","last_unstale":"2023-10-06T02:47:29.378272+0000","last_undegraded":"2023-10-06T02:47:29.378272+0000","last_fullsized":"2023-10-06T02:47:29.378272+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:27.998786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.758202+0000","last_change":"2023-10-06T02:47:28.744478+0000","last_active":"2023-10-06T02:47:29.758202+0000","last_peered":"2023-10-06T02:47:29.758202+0000","last_clean":"2023-10-06T02:47:29.758202+0000","last_became_active":"2023-10-06T02:47:28.744251+0000","last_became_peered":"2023-10-06T02:47:28.744251+0000","last_unstale":"2023-10-06T02:47:29.758202+0000","last_undegraded":"2023-10-06T02:47:29.758202+0000","last_fullsized":"2023-10-06T02:47:29.758202+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:08.234127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378060+0000","last_change":"2023-10-06T02:47:29.377741+0000","last_active":"2023-10-06T02:47:29.378060+0000","last_peered":"2023-10-06T02:47:29.378060+0000","last_clean":"2023-10-06T02:47:29.378060+0000","last_became_active":"2023-10-06T02:47:29.377457+0000","last_became_peered":"2023-10-06T02:47:29.377457+0000","last_unstale":"2023-10-06T02:47:29.378060+0000","last_undegraded":"2023-10-06T02:47:29.378060+0000","last_fullsized":"2023-10-06T02:47:29.378060+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:38.153033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.754559+0000","last_change":"2023-10-06T02:47:28.750779+0000","last_active":"2023-10-06T02:47:29.754559+0000","last_peered":"2023-10-06T02:47:29.754559+0000","last_clean":"2023-10-06T02:47:29.754559+0000","last_became_active":"2023-10-06T02:47:28.750559+0000","last_became_peered":"2023-10-06T02:47:28.750559+0000","last_unstale":"2023-10-06T02:47:29.754559+0000","last_undegraded":"2023-10-06T02:47:29.754559+0000","last_fullsized":"2023-10-06T02:47:29.754559+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:35.923909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378977+0000","last_change":"2023-10-06T02:47:29.378926+0000","last_active":"2023-10-06T02:47:29.378977+0000","last_peered":"2023-10-06T02:47:29.378977+0000","last_clean":"2023-10-06T02:47:29.378977+0000","last_became_active":"2023-10-06T02:47:29.378635+0000","last_became_peered":"2023-10-06T02:47:29.378635+0000","last_unstale":"2023-10-06T02:47:29.378977+0000","last_undegraded":"2023-10-06T02:47:29.378977+0000","last_fullsized":"2023-10-06T02:47:29.378977+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:36.929925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.755304+0000","last_change":"2023-10-06T02:47:28.747603+0000","last_active":"2023-10-06T02:47:29.755304+0000","last_peered":"2023-10-06T02:47:29.755304+0000","last_clean":"2023-10-06T02:47:29.755304+0000","last_became_active":"2023-10-06T02:47:28.747097+0000","last_became_peered":"2023-10-06T02:47:28.747097+0000","last_unstale":"2023-10-06T02:47:29.755304+0000","last_undegraded":"2023-10-06T02:47:29.755304+0000","last_fullsized":"2023-10-06T02:47:29.755304+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:24.712370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374598+0000","last_change":"2023-10-06T02:47:29.374504+0000","last_active":"2023-10-06T02:47:29.374598+0000","last_peered":"2023-10-06T02:47:29.374598+0000","last_clean":"2023-10-06T02:47:29.374598+0000","last_became_active":"2023-10-06T02:47:29.374271+0000","last_became_peered":"2023-10-06T02:47:29.374271+0000","last_unstale":"2023-10-06T02:47:29.374598+0000","last_undegraded":"2023-10-06T02:47:29.374598+0000","last_fullsized":"2023-10-06T02:47:29.374598+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:55:23.156167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.757894+0000","last_change":"2023-10-06T02:47:28.745500+0000","last_active":"2023-10-06T02:47:29.757894+0000","last_peered":"2023-10-06T02:47:29.757894+0000","last_clean":"2023-10-06T02:47:29.757894+0000","last_became_active":"2023-10-06T02:47:28.745289+0000","last_became_peered":"2023-10-06T02:47:28.745289+0000","last_unstale":"2023-10-06T02:47:29.757894+0000","last_undegraded":"2023-10-06T02:47:29.757894+0000","last_fullsized":"2023-10-06T02:47:29.757894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:37.493317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374435+0000","last_change":"2023-10-06T02:47:29.374322+0000","last_active":"2023-10-06T02:47:29.374435+0000","last_peered":"2023-10-06T02:47:29.374435+0000","last_clean":"2023-10-06T02:47:29.374435+0000","last_became_active":"2023-10-06T02:47:29.373854+0000","last_became_peered":"2023-10-06T02:47:29.373854+0000","last_unstale":"2023-10-06T02:47:29.374435+0000","last_undegraded":"2023-10-06T02:47:29.374435+0000","last_fullsized":"2023-10-06T02:47:29.374435+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:30.214630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.753837+0000","last_change":"2023-10-06T02:47:28.745721+0000","last_active":"2023-10-06T02:47:29.753837+0000","last_peered":"2023-10-06T02:47:29.753837+0000","last_clean":"2023-10-06T02:47:29.753837+0000","last_became_active":"2023-10-06T02:47:28.744392+0000","last_became_peered":"2023-10-06T02:47:28.744392+0000","last_unstale":"2023-10-06T02:47:29.753837+0000","last_undegraded":"2023-10-06T02:47:29.753837+0000","last_fullsized":"2023-10-06T02:47:29.753837+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:23.164771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.379140+0000","last_change":"2023-10-06T02:47:29.379075+0000","last_active":"2023-10-06T02:47:29.379140+0000","last_peered":"2023-10-06T02:47:29.379140+0000","last_clean":"2023-10-06T02:47:29.379140+0000","last_became_active":"2023-10-06T02:47:29.377768+0000","last_became_peered":"2023-10-06T02:47:29.377768+0000","last_unstale":"2023-10-06T02:47:29.379140+0000","last_undegraded":"2023-10-06T02:47:29.379140+0000","last_fullsized":"2023-10-06T02:47:29.379140+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:26.817389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.755152+0000","last_change":"2023-10-06T02:47:28.744368+0000","last_active":"2023-10-06T02:47:29.755152+0000","last_peered":"2023-10-06T02:47:29.755152+0000","last_clean":"2023-10-06T02:47:29.755152+0000","last_became_active":"2023-10-06T02:47:28.744103+0000","last_became_peered":"2023-10-06T02:47:28.744103+0000","last_unstale":"2023-10-06T02:47:29.755152+0000","last_undegraded":"2023-10-06T02:47:29.755152+0000","last_fullsized":"2023-10-06T02:47:29.755152+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:11.664273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370645+0000","last_change":"2023-10-06T02:47:29.370530+0000","last_active":"2023-10-06T02:47:29.370645+0000","last_peered":"2023-10-06T02:47:29.370645+0000","last_clean":"2023-10-06T02:47:29.370645+0000","last_became_active":"2023-10-06T02:47:29.370327+0000","last_became_peered":"2023-10-06T02:47:29.370327+0000","last_unstale":"2023-10-06T02:47:29.370645+0000","last_undegraded":"2023-10-06T02:47:29.370645+0000","last_fullsized":"2023-10-06T02:47:29.370645+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:10.396225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.367285+0000","last_change":"2023-10-06T02:47:28.746403+0000","last_active":"2023-10-06T02:47:29.367285+0000","last_peered":"2023-10-06T02:47:29.367285+0000","last_clean":"2023-10-06T02:47:29.367285+0000","last_became_active":"2023-10-06T02:47:28.746168+0000","last_became_peered":"2023-10-06T02:47:28.746168+0000","last_unstale":"2023-10-06T02:47:29.367285+0000","last_undegraded":"2023-10-06T02:47:29.367285+0000","last_fullsized":"2023-10-06T02:47:29.367285+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:14.134118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378040+0000","last_change":"2023-10-06T02:47:29.377945+0000","last_active":"2023-10-06T02:47:29.378040+0000","last_peered":"2023-10-06T02:47:29.378040+0000","last_clean":"2023-10-06T02:47:29.378040+0000","last_became_active":"2023-10-06T02:47:29.377487+0000","last_became_peered":"2023-10-06T02:47:29.377487+0000","last_unstale":"2023-10-06T02:47:29.378040+0000","last_undegraded":"2023-10-06T02:47:29.378040+0000","last_fullsized":"2023-10-06T02:47:29.378040+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:32.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.361042+0000","last_change":"2023-10-06T02:47:28.748595+0000","last_active":"2023-10-06T02:47:29.361042+0000","last_peered":"2023-10-06T02:47:29.361042+0000","last_clean":"2023-10-06T02:47:29.361042+0000","last_became_active":"2023-10-06T02:47:28.744243+0000","last_became_peered":"2023-10-06T02:47:28.744243+0000","last_unstale":"2023-10-06T02:47:29.361042+0000","last_undegraded":"2023-10-06T02:47:29.361042+0000","last_fullsized":"2023-10-06T02:47:29.361042+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:26.464271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.375547+0000","last_change":"2023-10-06T02:47:29.375480+0000","last_active":"2023-10-06T02:47:29.375547+0000","last_peered":"2023-10-06T02:47:29.375547+0000","last_clean":"2023-10-06T02:47:29.375547+0000","last_became_active":"2023-10-06T02:47:29.375024+0000","last_became_peered":"2023-10-06T02:47:29.375024+0000","last_unstale":"2023-10-06T02:47:29.375547+0000","last_undegraded":"2023-10-06T02:47:29.375547+0000","last_fullsized":"2023-10-06T02:47:29.375547+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:38.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.376851+0000","last_change":"2023-10-06T02:47:28.740324+0000","last_active":"2023-10-06T02:47:29.376851+0000","last_peered":"2023-10-06T02:47:29.376851+0000","last_clean":"2023-10-06T02:47:29.376851+0000","last_became_active":"2023-10-06T02:47:28.740096+0000","last_became_peered":"2023-10-06T02:47:28.740096+0000","last_unstale":"2023-10-06T02:47:29.376851+0000","last_undegraded":"2023-10-06T02:47:29.376851+0000","last_fullsized":"2023-10-06T02:47:29.376851+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:37.493317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372954+0000","last_change":"2023-10-06T02:47:29.372599+0000","last_active":"2023-10-06T02:47:29.372954+0000","last_peered":"2023-10-06T02:47:29.372954+0000","last_clean":"2023-10-06T02:47:29.372954+0000","last_became_active":"2023-10-06T02:47:29.372289+0000","last_became_peered":"2023-10-06T02:47:29.372289+0000","last_unstale":"2023-10-06T02:47:29.372954+0000","last_undegraded":"2023-10-06T02:47:29.372954+0000","last_fullsized":"2023-10-06T02:47:29.372954+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:38.034082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368855+0000","last_change":"2023-10-06T02:47:28.746425+0000","last_active":"2023-10-06T02:47:29.368855+0000","last_peered":"2023-10-06T02:47:29.368855+0000","last_clean":"2023-10-06T02:47:29.368855+0000","last_became_active":"2023-10-06T02:47:28.746181+0000","last_became_peered":"2023-10-06T02:47:28.746181+0000","last_unstale":"2023-10-06T02:47:29.368855+0000","last_undegraded":"2023-10-06T02:47:29.368855+0000","last_fullsized":"2023-10-06T02:47:29.368855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:37.493317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372781+0000","last_change":"2023-10-06T02:47:29.372717+0000","last_active":"2023-10-06T02:47:29.372781+0000","last_peered":"2023-10-06T02:47:29.372781+0000","last_clean":"2023-10-06T02:47:29.372781+0000","last_became_active":"2023-10-06T02:47:29.371975+0000","last_became_peered":"2023-10-06T02:47:29.371975+0000","last_unstale":"2023-10-06T02:47:29.372781+0000","last_undegraded":"2023-10-06T02:47:29.372781+0000","last_fullsized":"2023-10-06T02:47:29.372781+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:49.590043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.754719+0000","last_change":"2023-10-06T02:47:28.745810+0000","last_active":"2023-10-06T02:47:29.754719+0000","last_peered":"2023-10-06T02:47:29.754719+0000","last_clean":"2023-10-06T02:47:29.754719+0000","last_became_active":"2023-10-06T02:47:28.744970+0000","last_became_peered":"2023-10-06T02:47:28.744970+0000","last_unstale":"2023-10-06T02:47:29.754719+0000","last_undegraded":"2023-10-06T02:47:29.754719+0000","last_fullsized":"2023-10-06T02:47:29.754719+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:26.464271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372655+0000","last_change":"2023-10-06T02:47:29.372007+0000","last_active":"2023-10-06T02:47:29.372655+0000","last_peered":"2023-10-06T02:47:29.372655+0000","last_clean":"2023-10-06T02:47:29.372655+0000","last_became_active":"2023-10-06T02:47:29.371783+0000","last_became_peered":"2023-10-06T02:47:29.371783+0000","last_unstale":"2023-10-06T02:47:29.372655+0000","last_undegraded":"2023-10-06T02:47:29.372655+0000","last_fullsized":"2023-10-06T02:47:29.372655+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:52.356362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.758879+0000","last_change":"2023-10-06T02:47:28.747153+0000","last_active":"2023-10-06T02:47:29.758879+0000","last_peered":"2023-10-06T02:47:29.758879+0000","last_clean":"2023-10-06T02:47:29.758879+0000","last_became_active":"2023-10-06T02:47:28.743928+0000","last_became_peered":"2023-10-06T02:47:28.743928+0000","last_unstale":"2023-10-06T02:47:29.758879+0000","last_undegraded":"2023-10-06T02:47:29.758879+0000","last_fullsized":"2023-10-06T02:47:29.758879+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:19.864723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378689+0000","last_change":"2023-10-06T02:47:29.378371+0000","last_active":"2023-10-06T02:47:29.378689+0000","last_peered":"2023-10-06T02:47:29.378689+0000","last_clean":"2023-10-06T02:47:29.378689+0000","last_became_active":"2023-10-06T02:47:29.377945+0000","last_became_peered":"2023-10-06T02:47:29.377945+0000","last_unstale":"2023-10-06T02:47:29.378689+0000","last_undegraded":"2023-10-06T02:47:29.378689+0000","last_fullsized":"2023-10-06T02:47:29.378689+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:32.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.754442+0000","last_change":"2023-10-06T02:47:28.751643+0000","last_active":"2023-10-06T02:47:29.754442+0000","last_peered":"2023-10-06T02:47:29.754442+0000","last_clean":"2023-10-06T02:47:29.754442+0000","last_became_active":"2023-10-06T02:47:28.749642+0000","last_became_peered":"2023-10-06T02:47:28.749642+0000","last_unstale":"2023-10-06T02:47:29.754442+0000","last_undegraded":"2023-10-06T02:47:29.754442+0000","last_fullsized":"2023-10-06T02:47:29.754442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:11.664273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366211+0000","last_change":"2023-10-06T02:47:29.366145+0000","last_active":"2023-10-06T02:47:29.366211+0000","last_peered":"2023-10-06T02:47:29.366211+0000","last_clean":"2023-10-06T02:47:29.366211+0000","last_became_active":"2023-10-06T02:47:29.365893+0000","last_became_peered":"2023-10-06T02:47:29.365893+0000","last_unstale":"2023-10-06T02:47:29.366211+0000","last_undegraded":"2023-10-06T02:47:29.366211+0000","last_fullsized":"2023-10-06T02:47:29.366211+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:43.903083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371254+0000","last_change":"2023-10-06T02:47:28.746538+0000","last_active":"2023-10-06T02:47:29.371254+0000","last_peered":"2023-10-06T02:47:29.371254+0000","last_clean":"2023-10-06T02:47:29.371254+0000","last_became_active":"2023-10-06T02:47:28.745931+0000","last_became_peered":"2023-10-06T02:47:28.745931+0000","last_unstale":"2023-10-06T02:47:29.371254+0000","last_undegraded":"2023-10-06T02:47:29.371254+0000","last_fullsized":"2023-10-06T02:47:29.371254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:44.890256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373352+0000","last_change":"2023-10-06T02:47:29.373248+0000","last_active":"2023-10-06T02:47:29.373352+0000","last_peered":"2023-10-06T02:47:29.373352+0000","last_clean":"2023-10-06T02:47:29.373352+0000","last_became_active":"2023-10-06T02:47:29.372982+0000","last_became_peered":"2023-10-06T02:47:29.372982+0000","last_unstale":"2023-10-06T02:47:29.373352+0000","last_undegraded":"2023-10-06T02:47:29.373352+0000","last_fullsized":"2023-10-06T02:47:29.373352+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:57.886727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374503+0000","last_change":"2023-10-06T02:47:28.745482+0000","last_active":"2023-10-06T02:47:29.374503+0000","last_peered":"2023-10-06T02:47:29.374503+0000","last_clean":"2023-10-06T02:47:29.374503+0000","last_became_active":"2023-10-06T02:47:28.745221+0000","last_became_peered":"2023-10-06T02:47:28.745221+0000","last_unstale":"2023-10-06T02:47:29.374503+0000","last_undegraded":"2023-10-06T02:47:29.374503+0000","last_fullsized":"2023-10-06T02:47:29.374503+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:11.664273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365717+0000","last_change":"2023-10-06T02:47:29.364540+0000","last_active":"2023-10-06T02:47:29.365717+0000","last_peered":"2023-10-06T02:47:29.365717+0000","last_clean":"2023-10-06T02:47:29.365717+0000","last_became_active":"2023-10-06T02:47:29.364331+0000","last_became_peered":"2023-10-06T02:47:29.364331+0000","last_unstale":"2023-10-06T02:47:29.365717+0000","last_undegraded":"2023-10-06T02:47:29.365717+0000","last_fullsized":"2023-10-06T02:47:29.365717+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:14:58.202640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.759242+0000","last_change":"2023-10-06T02:47:28.748837+0000","last_active":"2023-10-06T02:47:29.759242+0000","last_peered":"2023-10-06T02:47:29.759242+0000","last_clean":"2023-10-06T02:47:29.759242+0000","last_became_active":"2023-10-06T02:47:28.748611+0000","last_became_peered":"2023-10-06T02:47:28.748611+0000","last_unstale":"2023-10-06T02:47:29.759242+0000","last_undegraded":"2023-10-06T02:47:29.759242+0000","last_fullsized":"2023-10-06T02:47:29.759242+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:44.347198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374565+0000","last_change":"2023-10-06T02:47:29.374123+0000","last_active":"2023-10-06T02:47:29.374565+0000","last_peered":"2023-10-06T02:47:29.374565+0000","last_clean":"2023-10-06T02:47:29.374565+0000","last_became_active":"2023-10-06T02:47:29.373941+0000","last_became_peered":"2023-10-06T02:47:29.373941+0000","last_unstale":"2023-10-06T02:47:29.374565+0000","last_undegraded":"2023-10-06T02:47:29.374565+0000","last_fullsized":"2023-10-06T02:47:29.374565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:42.558021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.753789+0000","last_change":"2023-10-06T02:47:28.751209+0000","last_active":"2023-10-06T02:47:29.753789+0000","last_peered":"2023-10-06T02:47:29.753789+0000","last_clean":"2023-10-06T02:47:29.753789+0000","last_became_active":"2023-10-06T02:47:28.750981+0000","last_became_peered":"2023-10-06T02:47:28.750981+0000","last_unstale":"2023-10-06T02:47:29.753789+0000","last_undegraded":"2023-10-06T02:47:29.753789+0000","last_fullsized":"2023-10-06T02:47:29.753789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:06.920712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366200+0000","last_change":"2023-10-06T02:47:29.366146+0000","last_active":"2023-10-06T02:47:29.366200+0000","last_peered":"2023-10-06T02:47:29.366200+0000","last_clean":"2023-10-06T02:47:29.366200+0000","last_became_active":"2023-10-06T02:47:29.365939+0000","last_became_peered":"2023-10-06T02:47:29.365939+0000","last_unstale":"2023-10-06T02:47:29.366200+0000","last_undegraded":"2023-10-06T02:47:29.366200+0000","last_fullsized":"2023-10-06T02:47:29.366200+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.625194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.754381+0000","last_change":"2023-10-06T02:47:28.739786+0000","last_active":"2023-10-06T02:47:29.754381+0000","last_peered":"2023-10-06T02:47:29.754381+0000","last_clean":"2023-10-06T02:47:29.754381+0000","last_became_active":"2023-10-06T02:47:28.739555+0000","last_became_peered":"2023-10-06T02:47:28.739555+0000","last_unstale":"2023-10-06T02:47:29.754381+0000","last_undegraded":"2023-10-06T02:47:29.754381+0000","last_fullsized":"2023-10-06T02:47:29.754381+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.842853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372635+0000","last_change":"2023-10-06T02:47:29.371532+0000","last_active":"2023-10-06T02:47:29.372635+0000","last_peered":"2023-10-06T02:47:29.372635+0000","last_clean":"2023-10-06T02:47:29.372635+0000","last_became_active":"2023-10-06T02:47:29.370188+0000","last_became_peered":"2023-10-06T02:47:29.370188+0000","last_unstale":"2023-10-06T02:47:29.372635+0000","last_undegraded":"2023-10-06T02:47:29.372635+0000","last_fullsized":"2023-10-06T02:47:29.372635+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:38.034082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.757609+0000","last_change":"2023-10-06T02:47:28.747227+0000","last_active":"2023-10-06T02:47:29.757609+0000","last_peered":"2023-10-06T02:47:29.757609+0000","last_clean":"2023-10-06T02:47:29.757609+0000","last_became_active":"2023-10-06T02:47:28.747026+0000","last_became_peered":"2023-10-06T02:47:28.747026+0000","last_unstale":"2023-10-06T02:47:29.757609+0000","last_undegraded":"2023-10-06T02:47:29.757609+0000","last_fullsized":"2023-10-06T02:47:29.757609+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:25.753396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.366338+0000","last_change":"2023-10-06T02:47:29.366290+0000","last_active":"2023-10-06T02:47:29.366338+0000","last_peered":"2023-10-06T02:47:29.366338+0000","last_clean":"2023-10-06T02:47:29.366338+0000","last_became_active":"2023-10-06T02:47:29.366092+0000","last_became_peered":"2023-10-06T02:47:29.366092+0000","last_unstale":"2023-10-06T02:47:29.366338+0000","last_undegraded":"2023-10-06T02:47:29.366338+0000","last_fullsized":"2023-10-06T02:47:29.366338+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:20.870739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.367347+0000","last_change":"2023-10-06T02:47:28.748849+0000","last_active":"2023-10-06T02:47:29.367347+0000","last_peered":"2023-10-06T02:47:29.367347+0000","last_clean":"2023-10-06T02:47:29.367347+0000","last_became_active":"2023-10-06T02:47:28.748688+0000","last_became_peered":"2023-10-06T02:47:28.748688+0000","last_unstale":"2023-10-06T02:47:29.367347+0000","last_undegraded":"2023-10-06T02:47:29.367347+0000","last_fullsized":"2023-10-06T02:47:29.367347+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:03.244419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372974+0000","last_change":"2023-10-06T02:47:29.372710+0000","last_active":"2023-10-06T02:47:29.372974+0000","last_peered":"2023-10-06T02:47:29.372974+0000","last_clean":"2023-10-06T02:47:29.372974+0000","last_became_active":"2023-10-06T02:47:29.372452+0000","last_became_peered":"2023-10-06T02:47:29.372452+0000","last_unstale":"2023-10-06T02:47:29.372974+0000","last_undegraded":"2023-10-06T02:47:29.372974+0000","last_fullsized":"2023-10-06T02:47:29.372974+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:30.214630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.755415+0000","last_change":"2023-10-06T02:47:28.743965+0000","last_active":"2023-10-06T02:47:29.755415+0000","last_peered":"2023-10-06T02:47:29.755415+0000","last_clean":"2023-10-06T02:47:29.755415+0000","last_became_active":"2023-10-06T02:47:28.743728+0000","last_became_peered":"2023-10-06T02:47:28.743728+0000","last_unstale":"2023-10-06T02:47:29.755415+0000","last_undegraded":"2023-10-06T02:47:29.755415+0000","last_fullsized":"2023-10-06T02:47:29.755415+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:39.874394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373283+0000","last_change":"2023-10-06T02:47:29.373217+0000","last_active":"2023-10-06T02:47:29.373283+0000","last_peered":"2023-10-06T02:47:29.373283+0000","last_clean":"2023-10-06T02:47:29.373283+0000","last_became_active":"2023-10-06T02:47:29.372988+0000","last_became_peered":"2023-10-06T02:47:29.372988+0000","last_unstale":"2023-10-06T02:47:29.373283+0000","last_undegraded":"2023-10-06T02:47:29.373283+0000","last_fullsized":"2023-10-06T02:47:29.373283+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:26.879596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.369085+0000","last_change":"2023-10-06T02:47:28.746389+0000","last_active":"2023-10-06T02:47:29.369085+0000","last_peered":"2023-10-06T02:47:29.369085+0000","last_clean":"2023-10-06T02:47:29.369085+0000","last_became_active":"2023-10-06T02:47:28.743600+0000","last_became_peered":"2023-10-06T02:47:28.743600+0000","last_unstale":"2023-10-06T02:47:29.369085+0000","last_undegraded":"2023-10-06T02:47:29.369085+0000","last_fullsized":"2023-10-06T02:47:29.369085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:44:56.639803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.372909+0000","last_change":"2023-10-06T02:47:29.372856+0000","last_active":"2023-10-06T02:47:29.372909+0000","last_peered":"2023-10-06T02:47:29.372909+0000","last_clean":"2023-10-06T02:47:29.372909+0000","last_became_active":"2023-10-06T02:47:29.372305+0000","last_became_peered":"2023-10-06T02:47:29.372305+0000","last_unstale":"2023-10-06T02:47:29.372909+0000","last_undegraded":"2023-10-06T02:47:29.372909+0000","last_fullsized":"2023-10-06T02:47:29.372909+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:57.886727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.361089+0000","last_change":"2023-10-06T02:47:28.743137+0000","last_active":"2023-10-06T02:47:29.361089+0000","last_peered":"2023-10-06T02:47:29.361089+0000","last_clean":"2023-10-06T02:47:29.361089+0000","last_became_active":"2023-10-06T02:47:28.742895+0000","last_became_peered":"2023-10-06T02:47:28.742895+0000","last_unstale":"2023-10-06T02:47:29.361089+0000","last_undegraded":"2023-10-06T02:47:29.361089+0000","last_fullsized":"2023-10-06T02:47:29.361089+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:13.743249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.373367+0000","last_change":"2023-10-06T02:47:29.373299+0000","last_active":"2023-10-06T02:47:29.373367+0000","last_peered":"2023-10-06T02:47:29.373367+0000","last_clean":"2023-10-06T02:47:29.373367+0000","last_became_active":"2023-10-06T02:47:29.373056+0000","last_became_peered":"2023-10-06T02:47:29.373056+0000","last_unstale":"2023-10-06T02:47:29.373367+0000","last_undegraded":"2023-10-06T02:47:29.373367+0000","last_fullsized":"2023-10-06T02:47:29.373367+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:44:57.645819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363643+0000","last_change":"2023-10-06T02:47:28.743516+0000","last_active":"2023-10-06T02:47:29.363643+0000","last_peered":"2023-10-06T02:47:29.363643+0000","last_clean":"2023-10-06T02:47:29.363643+0000","last_became_active":"2023-10-06T02:47:28.743307+0000","last_became_peered":"2023-10-06T02:47:28.743307+0000","last_unstale":"2023-10-06T02:47:29.363643+0000","last_undegraded":"2023-10-06T02:47:29.363643+0000","last_fullsized":"2023-10-06T02:47:29.363643+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:17.691598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365638+0000","last_change":"2023-10-06T02:47:29.363985+0000","last_active":"2023-10-06T02:47:29.365638+0000","last_peered":"2023-10-06T02:47:29.365638+0000","last_clean":"2023-10-06T02:47:29.365638+0000","last_became_active":"2023-10-06T02:47:29.363759+0000","last_became_peered":"2023-10-06T02:47:29.363759+0000","last_unstale":"2023-10-06T02:47:29.365638+0000","last_undegraded":"2023-10-06T02:47:29.365638+0000","last_fullsized":"2023-10-06T02:47:29.365638+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:54.744664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368612+0000","last_change":"2023-10-06T02:47:28.747098+0000","last_active":"2023-10-06T02:47:29.368612+0000","last_peered":"2023-10-06T02:47:29.368612+0000","last_clean":"2023-10-06T02:47:29.368612+0000","last_became_active":"2023-10-06T02:47:28.746806+0000","last_became_peered":"2023-10-06T02:47:28.746806+0000","last_unstale":"2023-10-06T02:47:29.368612+0000","last_undegraded":"2023-10-06T02:47:29.368612+0000","last_fullsized":"2023-10-06T02:47:29.368612+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:13.743249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363883+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:47:29.363883+0000","last_peered":"2023-10-06T02:47:29.363883+0000","last_clean":"2023-10-06T02:47:29.363883+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:47:29.363883+0000","last_undegraded":"2023-10-06T02:47:29.363883+0000","last_fullsized":"2023-10-06T02:47:29.363883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371852+0000","last_change":"2023-10-06T02:47:29.369599+0000","last_active":"2023-10-06T02:47:29.371852+0000","last_peered":"2023-10-06T02:47:29.371852+0000","last_clean":"2023-10-06T02:47:29.371852+0000","last_became_active":"2023-10-06T02:47:29.369362+0000","last_became_peered":"2023-10-06T02:47:29.369362+0000","last_unstale":"2023-10-06T02:47:29.371852+0000","last_undegraded":"2023-10-06T02:47:29.371852+0000","last_fullsized":"2023-10-06T02:47:29.371852+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.625194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.757133+0000","last_change":"2023-10-06T02:47:28.749593+0000","last_active":"2023-10-06T02:47:29.757133+0000","last_peered":"2023-10-06T02:47:29.757133+0000","last_clean":"2023-10-06T02:47:29.757133+0000","last_became_active":"2023-10-06T02:47:28.749424+0000","last_became_peered":"2023-10-06T02:47:28.749424+0000","last_unstale":"2023-10-06T02:47:29.757133+0000","last_undegraded":"2023-10-06T02:47:29.757133+0000","last_fullsized":"2023-10-06T02:47:29.757133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:00.466176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.364241+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:47:29.364241+0000","last_peered":"2023-10-06T02:47:29.364241+0000","last_clean":"2023-10-06T02:47:29.364241+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:47:29.364241+0000","last_undegraded":"2023-10-06T02:47:29.364241+0000","last_fullsized":"2023-10-06T02:47:29.364241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374583+0000","last_change":"2023-10-06T02:47:29.374397+0000","last_active":"2023-10-06T02:47:29.374583+0000","last_peered":"2023-10-06T02:47:29.374583+0000","last_clean":"2023-10-06T02:47:29.374583+0000","last_became_active":"2023-10-06T02:47:29.374141+0000","last_became_peered":"2023-10-06T02:47:29.374141+0000","last_unstale":"2023-10-06T02:47:29.374583+0000","last_undegraded":"2023-10-06T02:47:29.374583+0000","last_fullsized":"2023-10-06T02:47:29.374583+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.217184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.360978+0000","last_change":"2023-10-06T02:47:28.751926+0000","last_active":"2023-10-06T02:47:29.360978+0000","last_peered":"2023-10-06T02:47:29.360978+0000","last_clean":"2023-10-06T02:47:29.360978+0000","last_became_active":"2023-10-06T02:47:28.749931+0000","last_became_peered":"2023-10-06T02:47:28.749931+0000","last_unstale":"2023-10-06T02:47:29.360978+0000","last_undegraded":"2023-10-06T02:47:29.360978+0000","last_fullsized":"2023-10-06T02:47:29.360978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:23.900521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363296+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:47:29.363296+0000","last_peered":"2023-10-06T02:47:29.363296+0000","last_clean":"2023-10-06T02:47:29.363296+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:47:29.363296+0000","last_undegraded":"2023-10-06T02:47:29.363296+0000","last_fullsized":"2023-10-06T02:47:29.363296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.371217+0000","last_change":"2023-10-06T02:47:29.371119+0000","last_active":"2023-10-06T02:47:29.371217+0000","last_peered":"2023-10-06T02:47:29.371217+0000","last_clean":"2023-10-06T02:47:29.371217+0000","last_became_active":"2023-10-06T02:47:29.370887+0000","last_became_peered":"2023-10-06T02:47:29.370887+0000","last_unstale":"2023-10-06T02:47:29.371217+0000","last_undegraded":"2023-10-06T02:47:29.371217+0000","last_fullsized":"2023-10-06T02:47:29.371217+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:39.937749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.360897+0000","last_change":"2023-10-06T02:47:28.743638+0000","last_active":"2023-10-06T02:47:29.360897+0000","last_peered":"2023-10-06T02:47:29.360897+0000","last_clean":"2023-10-06T02:47:29.360897+0000","last_became_active":"2023-10-06T02:47:28.743336+0000","last_became_peered":"2023-10-06T02:47:28.743336+0000","last_unstale":"2023-10-06T02:47:29.360897+0000","last_undegraded":"2023-10-06T02:47:29.360897+0000","last_fullsized":"2023-10-06T02:47:29.360897+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:37.493317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.364223+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:47:29.364223+0000","last_peered":"2023-10-06T02:47:29.364223+0000","last_clean":"2023-10-06T02:47:29.364223+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:47:29.364223+0000","last_undegraded":"2023-10-06T02:47:29.364223+0000","last_fullsized":"2023-10-06T02:47:29.364223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368803+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:47:29.368803+0000","last_peered":"2023-10-06T02:47:29.368803+0000","last_clean":"2023-10-06T02:47:29.368803+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:47:29.368803+0000","last_undegraded":"2023-10-06T02:47:29.368803+0000","last_fullsized":"2023-10-06T02:47:29.368803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.365344+0000","last_change":"2023-10-06T02:47:29.365101+0000","last_active":"2023-10-06T02:47:29.365344+0000","last_peered":"2023-10-06T02:47:29.365344+0000","last_clean":"2023-10-06T02:47:29.365344+0000","last_became_active":"2023-10-06T02:47:29.364874+0000","last_became_peered":"2023-10-06T02:47:29.364874+0000","last_unstale":"2023-10-06T02:47:29.365344+0000","last_undegraded":"2023-10-06T02:47:29.365344+0000","last_fullsized":"2023-10-06T02:47:29.365344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:52.356362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368320+0000","last_change":"2023-10-06T02:47:28.744067+0000","last_active":"2023-10-06T02:47:29.368320+0000","last_peered":"2023-10-06T02:47:29.368320+0000","last_clean":"2023-10-06T02:47:29.368320+0000","last_became_active":"2023-10-06T02:47:28.743545+0000","last_became_peered":"2023-10-06T02:47:28.743545+0000","last_unstale":"2023-10-06T02:47:29.368320+0000","last_undegraded":"2023-10-06T02:47:29.368320+0000","last_fullsized":"2023-10-06T02:47:29.368320+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:13.743249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368403+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:47:29.368403+0000","last_peered":"2023-10-06T02:47:29.368403+0000","last_clean":"2023-10-06T02:47:29.368403+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:47:29.368403+0000","last_undegraded":"2023-10-06T02:47:29.368403+0000","last_fullsized":"2023-10-06T02:47:29.368403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370638+0000","last_change":"2023-10-06T02:47:29.370314+0000","last_active":"2023-10-06T02:47:29.370638+0000","last_peered":"2023-10-06T02:47:29.370638+0000","last_clean":"2023-10-06T02:47:29.370638+0000","last_became_active":"2023-10-06T02:47:29.370116+0000","last_became_peered":"2023-10-06T02:47:29.370116+0000","last_unstale":"2023-10-06T02:47:29.370638+0000","last_undegraded":"2023-10-06T02:47:29.370638+0000","last_fullsized":"2023-10-06T02:47:29.370638+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:10.807265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363830+0000","last_change":"2023-10-06T02:47:28.742681+0000","last_active":"2023-10-06T02:47:29.363830+0000","last_peered":"2023-10-06T02:47:29.363830+0000","last_clean":"2023-10-06T02:47:29.363830+0000","last_became_active":"2023-10-06T02:47:28.742448+0000","last_became_peered":"2023-10-06T02:47:28.742448+0000","last_unstale":"2023-10-06T02:47:29.363830+0000","last_undegraded":"2023-10-06T02:47:29.363830+0000","last_fullsized":"2023-10-06T02:47:29.363830+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:13.743249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368887+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:47:29.368887+0000","last_peered":"2023-10-06T02:47:29.368887+0000","last_clean":"2023-10-06T02:47:29.368887+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:47:29.368887+0000","last_undegraded":"2023-10-06T02:47:29.368887+0000","last_fullsized":"2023-10-06T02:47:29.368887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.374454+0000","last_change":"2023-10-06T02:47:29.374400+0000","last_active":"2023-10-06T02:47:29.374454+0000","last_peered":"2023-10-06T02:47:29.374454+0000","last_clean":"2023-10-06T02:47:29.374454+0000","last_became_active":"2023-10-06T02:47:29.374097+0000","last_became_peered":"2023-10-06T02:47:29.374097+0000","last_unstale":"2023-10-06T02:47:29.374454+0000","last_undegraded":"2023-10-06T02:47:29.374454+0000","last_fullsized":"2023-10-06T02:47:29.374454+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:10.807265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.368659+0000","last_change":"2023-10-06T02:47:28.748409+0000","last_active":"2023-10-06T02:47:29.368659+0000","last_peered":"2023-10-06T02:47:29.368659+0000","last_clean":"2023-10-06T02:47:29.368659+0000","last_became_active":"2023-10-06T02:47:28.748223+0000","last_became_peered":"2023-10-06T02:47:28.748223+0000","last_unstale":"2023-10-06T02:47:29.368659+0000","last_undegraded":"2023-10-06T02:47:29.368659+0000","last_fullsized":"2023-10-06T02:47:29.368659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:23.900521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.363079+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:47:29.363079+0000","last_peered":"2023-10-06T02:47:29.363079+0000","last_clean":"2023-10-06T02:47:29.363079+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:47:29.363079+0000","last_undegraded":"2023-10-06T02:47:29.363079+0000","last_fullsized":"2023-10-06T02:47:29.363079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.378666+0000","last_change":"2023-10-06T02:47:29.378211+0000","last_active":"2023-10-06T02:47:29.378666+0000","last_peered":"2023-10-06T02:47:29.378666+0000","last_clean":"2023-10-06T02:47:29.378666+0000","last_became_active":"2023-10-06T02:47:29.377624+0000","last_became_peered":"2023-10-06T02:47:29.377624+0000","last_unstale":"2023-10-06T02:47:29.378666+0000","last_undegraded":"2023-10-06T02:47:29.378666+0000","last_fullsized":"2023-10-06T02:47:29.378666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:28.732910+0000","last_clean_scrub_stamp":"2023-10-06T02:47:28.732910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:27.998786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.370114+0000","last_change":"2023-10-06T02:47:28.748399+0000","last_active":"2023-10-06T02:47:29.370114+0000","last_peered":"2023-10-06T02:47:29.370114+0000","last_clean":"2023-10-06T02:47:29.370114+0000","last_became_active":"2023-10-06T02:47:28.748192+0000","last_became_peered":"2023-10-06T02:47:28.748192+0000","last_unstale":"2023-10-06T02:47:29.370114+0000","last_undegraded":"2023-10-06T02:47:29.370114+0000","last_fullsized":"2023-10-06T02:47:29.370114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:47:27.726894+0000","last_clean_scrub_stamp":"2023-10-06T02:47:27.726894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:53.323823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T02:47:29.367530+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:47:29.367530+0000","last_peered":"2023-10-06T02:47:29.367530+0000","last_clean":"2023-10-06T02:47:29.367530+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:47:29.367530+0000","last_undegraded":"2023-10-06T02:47:29.367530+0000","last_fullsized":"2023-10-06T02:47:29.367530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168291,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.4870000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.626},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758159,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.496}]},{"osd":2,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.436},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.317},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.248}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.373},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199175000,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":21.942,"5min":21.942,"15min":21.942},"last":0.437}]},{"osd":4,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":22.010999999999999,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.090999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":21.98,"5min":21.98,"15min":21.98},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":11.154,"5min":11.154,"15min":11.154},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757247,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.219},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.252}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":1.2569999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757225,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.307},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.373},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.38600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":6.4189999999999996,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46999999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:46:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":14.912000000000001,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.45900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.8949999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.625},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":5.3579999999999997,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.9329999999999998,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":5.9820000000000002,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":5.4390000000000001,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.5},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.3470000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:46:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":13.173999999999999,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.75},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.67900000000000005}]}]}],"pool_statfs":[]}} 2023-10-06T02:47:34.186 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:47:34.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:47:34.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.339+0000 7fb681eac700 1 Processor -- start 2023-10-06T02:47:34.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.339+0000 7fb681eac700 1 -- start start 2023-10-06T02:47:34.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb681eac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c157b90 0x7fb67c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb681eac700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c0cca80 con 0x7fb67c068f20 2023-10-06T02:47:34.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb681eac700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c0cedd0 con 0x7fb67c1577c0 2023-10-06T02:47:34.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb681eac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0cc4c0 con 0x7fb67c157b90 2023-10-06T02:47:34.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb672ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb67c068f20 0x7fb67c0cb790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46878/0 (socket says 172.21.15.81:46878) 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb672ffd700 1 -- 172.21.15.81:0/1993305891 learned_addr learned my addr 172.21.15.81:0/1993305891 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347369621 0 0) 0x7fb67c0cca80 con 0x7fb67c068f20 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67bfff700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c157b90 0x7fb67c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb668003570 con 0x7fb67c068f20 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766425879 0 0) 0x7fb67c0cedd0 con 0x7fb67c1577c0 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb67c0cca80 con 0x7fb67c1577c0 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2720823491 0 0) 0x7fb668003570 con 0x7fb67c068f20 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c157b90 msgr2=0x7fb67c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c157b90 0x7fb67c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 >> v1:172.21.15.83:6789/0 conn(0x7fb67c1577c0 legacy=0x7fb67c068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0cc7a0 con 0x7fb67c068f20 2023-10-06T02:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fb664001470 con 0x7fb67c068f20 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 >> v1:172.21.15.81:6789/0 conn(0x7fb67c068f20 legacy=0x7fb67c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c157b90 0x7fb668003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6680041d0 0x7fb668004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb668004d50 0x7fb6680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0cc4c0 con 0x7fb668004d50 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66800bbf0 con 0x7fb6680041d0 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.340+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66800bdb0 con 0x7fb67c157b90 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67bfff700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb668004d50 0x7fb6680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67b7fe700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c157b90 0x7fb668003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb672ffd700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6680041d0 0x7fb668004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67bfff700 1 -- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c157b90 msgr2=0x7fb668003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67bfff700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c157b90 0x7fb668003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67bfff700 1 -- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6680041d0 msgr2=0x7fb668004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67bfff700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6680041d0 0x7fb668004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67bfff700 1 -- 172.21.15.81:0/1993305891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668003570 con 0x7fb668004d50 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67bfff700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb668004d50 0x7fb6680051c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb67400e210 tx=0x7fb67400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214938bd973404b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67400eac0 con 0x7fb668004d50 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67400f040 con 0x7fb668004d50 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.341+0000 7fb67affd700 1 -- 172.21.15.81:0/1993305891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67400ee70 con 0x7fb668004d50 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.342+0000 7fb681eac700 1 -- 172.21.15.81:0/1993305891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb668004d50 msgr2=0x7fb6680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.342+0000 7fb681eac700 1 --2- 172.21.15.81:0/1993305891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb668004d50 0x7fb6680051c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb67400e210 tx=0x7fb67400b040 comp rx=0 tx=0).stop 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.342+0000 7fb67bfff700 1 -- 172.21.15.81:0/1993305891 reap_dead start 2023-10-06T02:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.342+0000 7fb681eac700 1 -- 172.21.15.81:0/1993305891 shutdown_connections 2023-10-06T02:47:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.342+0000 7fb681eac700 1 -- 172.21.15.81:0/1993305891 >> 172.21.15.81:0/1993305891 conn(0x7fb67c0d0df0 msgr2=0x7fb67c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.342+0000 7fb681eac700 1 -- 172.21.15.81:0/1993305891 shutdown_connections 2023-10-06T02:47:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.342+0000 7fb681eac700 1 -- 172.21.15.81:0/1993305891 wait complete. 2023-10-06T02:47:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.343+0000 7fb681eac700 1 Processor -- start 2023-10-06T02:47:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.343+0000 7fb681eac700 1 -- start start 2023-10-06T02:47:34.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb681eac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb67c0b5fe0 0x7fb67c0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb681eac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c0b55f0 0x7fb67c14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb681eac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67c0ca710 0x7fb67c14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb681eac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0b4c20 con 0x7fb67c0ca710 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb681eac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0b4010 con 0x7fb67c0b5fe0 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb681eac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0b42f0 con 0x7fb67c0b55f0 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67c0ca710 0x7fb67c14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67c0ca710 0x7fb67c14feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56192/0 (socket says 172.21.15.81:56192) 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67bfff700 1 -- 172.21.15.81:0/1531318041 learned_addr learned my addr 172.21.15.81:0/1531318041 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67b7fe700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb67c0b5fe0 0x7fb67c0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb672ffd700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c0b55f0 0x7fb67c14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67bfff700 1 -- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c0b55f0 msgr2=0x7fb67c14f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67bfff700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c0b55f0 0x7fb67c14f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67bfff700 1 -- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb67c0b5fe0 msgr2=0x7fb67c0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67bfff700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb67c0b5fe0 0x7fb67c0b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67bfff700 1 -- 172.21.15.81:0/1531318041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0b45d0 con 0x7fb67c0ca710 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67b7fe700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb67c0b5fe0 0x7fb67c0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb672ffd700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c0b55f0 0x7fb67c14f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb67bfff700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67c0ca710 0x7fb67c14feb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb674002230 tx=0x7fb67401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb673fff700 1 -- 172.21.15.81:0/1531318041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67401d630 con 0x7fb67c0ca710 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb673fff700 1 -- 172.21.15.81:0/1531318041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67401d7b0 con 0x7fb67c0ca710 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb673fff700 1 -- 172.21.15.81:0/1531318041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67401db70 con 0x7fb67c0ca710 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c0b48b0 con 0x7fb67c0ca710 2023-10-06T02:47:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.344+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c1541e0 con 0x7fb67c0ca710 2023-10-06T02:47:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.345+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c0d0170 con 0x7fb67c0ca710 2023-10-06T02:47:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.346+0000 7fb673fff700 1 -- 172.21.15.81:0/1531318041 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb674003040 con 0x7fb67c0ca710 2023-10-06T02:47:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.346+0000 7fb673fff700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb65c066f30 0x7fb65c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.346+0000 7fb673fff700 1 -- 172.21.15.81:0/1531318041 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb674085cc0 con 0x7fb67c0ca710 2023-10-06T02:47:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.346+0000 7fb67b7fe700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb65c066f30 0x7fb65c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.347+0000 7fb67b7fe700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb65c066f30 0x7fb65c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000f60 tx=0x7fb66c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.350+0000 7fb673fff700 1 -- 172.21.15.81:0/1531318041 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb674052dd0 con 0x7fb67c0ca710 2023-10-06T02:47:34.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.606+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb67c0b4d60 con 0x7fb67c0ca710 2023-10-06T02:47:34.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.612+0000 7fb673fff700 1 -- 172.21.15.81:0/1531318041 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb6740563f0 con 0x7fb67c0ca710 2023-10-06T02:47:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb65c066f30 msgr2=0x7fb65c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb65c066f30 0x7fb65c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000f60 tx=0x7fb66c009040 comp rx=0 tx=0).stop 2023-10-06T02:47:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67c0ca710 msgr2=0x7fb67c14feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67c0ca710 0x7fb67c14feb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb674002230 tx=0x7fb67401a000 comp rx=0 tx=0).stop 2023-10-06T02:47:34.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 shutdown_connections 2023-10-06T02:47:34.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67c0ca710 0x7fb67c14feb0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb65c066f30 0x7fb65c0693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb67c0b5fe0 0x7fb67c0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 --2- 172.21.15.81:0/1531318041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb67c0b55f0 0x7fb67c14f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 >> 172.21.15.81:0/1531318041 conn(0x7fb67c0d0df0 msgr2=0x7fb67c1561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:34.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 shutdown_connections 2023-10-06T02:47:34.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.614+0000 7fb681eac700 1 -- 172.21.15.81:0/1531318041 wait complete. 2023-10-06T02:47:34.617 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:47:34.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:34.730 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-06T02:47:34.729+0000 7fa180699700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:47:34.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.739+0000 7fdaa4f12700 1 Processor -- start 2023-10-06T02:47:34.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.739+0000 7fdaa4f12700 1 -- start start 2023-10-06T02:47:34.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.740+0000 7fdaa4f12700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0159c90 0x7fdaa015d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.740+0000 7fdaa4f12700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa015e830 con 0x7fdaa00686e0 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.740+0000 7fdaa4f12700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa00cb3f0 con 0x7fdaa00b2b20 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.740+0000 7fdaa4f12700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa00caf60 con 0x7fdaa0159c90 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.740+0000 7fda9effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdaa00686e0 0x7fdaa00ccc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46890/0 (socket says 172.21.15.81:46890) 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.740+0000 7fda9effd700 1 -- 172.21.15.81:0/17789327 learned_addr learned my addr 172.21.15.81:0/17789327 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.740+0000 7fda9f7fe700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0159c90 0x7fdaa015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.740+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227174367 0 0) 0x7fda94001110 con 0x7fdaa00686e0 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.740+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda88003570 con 0x7fdaa00686e0 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283348606 0 0) 0x7fdaa00cb3f0 con 0x7fdaa00b2b20 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda94001110 con 0x7fdaa00b2b20 2023-10-06T02:47:34.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3777758796 0 0) 0x7fda88003570 con 0x7fdaa00686e0 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0159c90 msgr2=0x7fdaa015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0159c90 0x7fdaa015d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 >> v1:172.21.15.83:6789/0 conn(0x7fdaa00b2b20 legacy=0x7fdaa00cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa00cd390 con 0x7fdaa00686e0 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fda94001600 con 0x7fdaa00686e0 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 >> v1:172.21.15.81:6789/0 conn(0x7fdaa00686e0 legacy=0x7fdaa00ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda88003c20 0x7fda88004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fda88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda880051c0 0x7fda8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa00caf60 con 0x7fda88004810 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8800c0b0 con 0x7fda88003c20 2023-10-06T02:47:34.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8800c270 con 0x7fda880051c0 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9f7fe700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0159c90 0x7fdaa015d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9effd700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fda88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9ffff700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda880051c0 0x7fda8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9f7fe700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda88003c20 0x7fda88004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9effd700 1 -- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda880051c0 msgr2=0x7fda8800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9effd700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda880051c0 0x7fda8800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9effd700 1 -- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda88003c20 msgr2=0x7fda88004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9effd700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda88003c20 0x7fda88004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9effd700 1 -- 172.21.15.81:0/17789327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88003570 con 0x7fda88004810 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9effd700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fda88004c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c390 tx=0x7fda94007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be1c23135a2ec11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400cc80 con 0x7fda88004810 2023-10-06T02:47:34.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400ce00 con 0x7fda88004810 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.741+0000 7fda9e7fc700 1 -- 172.21.15.81:0/17789327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94005b70 con 0x7fda88004810 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.742+0000 7fdaa4f12700 1 -- 172.21.15.81:0/17789327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 msgr2=0x7fda88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.742+0000 7fdaa4f12700 1 --2- 172.21.15.81:0/17789327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fda88004c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c390 tx=0x7fda94007940 comp rx=0 tx=0).stop 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.742+0000 7fda9ffff700 1 -- 172.21.15.81:0/17789327 reap_dead start 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.742+0000 7fdaa4f12700 1 -- 172.21.15.81:0/17789327 shutdown_connections 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.742+0000 7fdaa4f12700 1 -- 172.21.15.81:0/17789327 >> 172.21.15.81:0/17789327 conn(0x7fdaa006bb90 msgr2=0x7fdaa006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.742+0000 7fdaa4f12700 1 -- 172.21.15.81:0/17789327 shutdown_connections 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.742+0000 7fdaa4f12700 1 -- 172.21.15.81:0/17789327 wait complete. 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.743+0000 7fdaa4f12700 1 Processor -- start 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.743+0000 7fdaa4f12700 1 -- start start 2023-10-06T02:47:34.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fdaa4f12700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fdaa0158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fdaa4f12700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0157800 0x7fdaa015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fdaa4f12700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdaa016a7f0 0x7fdaa016ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fdaa4f12700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa015c9d0 con 0x7fda88004810 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fdaa4f12700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa015b3f0 con 0x7fdaa016a7f0 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fdaa4f12700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa015b6d0 con 0x7fdaa0157800 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fdaa0158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fdaa0158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56218/0 (socket says 172.21.15.81:56218) 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9f7fe700 1 -- 172.21.15.81:0/867288077 learned_addr learned my addr 172.21.15.81:0/867288077 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9ffff700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdaa016a7f0 0x7fdaa016ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9effd700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0157800 0x7fdaa015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9f7fe700 1 -- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0157800 msgr2=0x7fdaa015c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9f7fe700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0157800 0x7fdaa015c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9f7fe700 1 -- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdaa016a7f0 msgr2=0x7fdaa016ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9f7fe700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdaa016a7f0 0x7fdaa016ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9f7fe700 1 -- 172.21.15.81:0/867288077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa015b9b0 con 0x7fda88004810 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.744+0000 7fda9f7fe700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fdaa0158640 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fda90011500 tx=0x7fda9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.745+0000 7fda877fe700 1 -- 172.21.15.81:0/867288077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000e030 con 0x7fda88004810 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.745+0000 7fda877fe700 1 -- 172.21.15.81:0/867288077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90016470 con 0x7fda88004810 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.745+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa015bc90 con 0x7fda88004810 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.745+0000 7fda877fe700 1 -- 172.21.15.81:0/867288077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90016830 con 0x7fda88004810 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.745+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa015b030 con 0x7fda88004810 2023-10-06T02:47:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.746+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa015c2e0 con 0x7fda88004810 2023-10-06T02:47:34.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.746+0000 7fda877fe700 1 -- 172.21.15.81:0/867288077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda90016be0 con 0x7fda88004810 2023-10-06T02:47:34.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.746+0000 7fda877fe700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fda8c066f30 0x7fda8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:34.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.746+0000 7fda877fe700 1 -- 172.21.15.81:0/867288077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fda9000f070 con 0x7fda88004810 2023-10-06T02:47:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.747+0000 7fda9effd700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fda8c066f30 0x7fda8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.747+0000 7fda9effd700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fda8c066f30 0x7fda8c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda94008fd0 tx=0x7fda94015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.751+0000 7fda877fe700 1 -- 172.21.15.81:0/867288077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda90052760 con 0x7fda88004810 2023-10-06T02:47:34.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.972+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdaa006fbe0 con 0x7fda88004810 2023-10-06T02:47:34.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.973+0000 7fda877fe700 1 -- 172.21.15.81:0/867288077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fda90055d80 con 0x7fda88004810 2023-10-06T02:47:34.974 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:34.974 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:47:29.117013+0000","modified":"2023-10-06T02:47:32.768965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2380710039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2380710039},{"type":"v1","addr":"172.21.15.81:6835","nonce":2380710039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:47:34.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.974+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fda8c066f30 msgr2=0x7fda8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.974+0000 7fdaa4f12700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fda8c066f30 0x7fda8c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda94008fd0 tx=0x7fda94015000 comp rx=0 tx=0).stop 2023-10-06T02:47:34.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.974+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 msgr2=0x7fdaa0158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:34.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.974+0000 7fdaa4f12700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fdaa0158640 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fda90011500 tx=0x7fda9000b040 comp rx=0 tx=0).stop 2023-10-06T02:47:34.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.975+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 shutdown_connections 2023-10-06T02:47:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.975+0000 7fdaa4f12700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fda8c066f30 0x7fda8c0693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.975+0000 7fdaa4f12700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdaa016a7f0 0x7fdaa016ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.975+0000 7fdaa4f12700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda88004810 0x7fdaa0158640 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.975+0000 7fdaa4f12700 1 --2- 172.21.15.81:0/867288077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdaa0157800 0x7fdaa015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.975+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 >> 172.21.15.81:0/867288077 conn(0x7fdaa006bb90 msgr2=0x7fdaa00ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.975+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 shutdown_connections 2023-10-06T02:47:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:34.975+0000 7fdaa4f12700 1 -- 172.21.15.81:0/867288077 wait complete. 2023-10-06T02:47:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T02:47:35.390 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:47:29.117013+0000', 'modified': '2023-10-06T02:47:32.768965+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5433': {'gid': 5433, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/2380710039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 2380710039}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2380710039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:47:35.390 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:47:35.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:47:35.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.505+0000 7f2b09bc9700 1 Processor -- start 2023-10-06T02:47:35.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.505+0000 7f2b09bc9700 1 -- start start 2023-10-06T02:47:35.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b09bc9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 0x7f2b040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b09bc9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b04157ca0 0x7f2b0415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b09bc9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b0406d120 0x7f2b0406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b09bc9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0406dac0 con 0x7f2b0406d120 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b09bc9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b040d07c0 con 0x7f2b04157ca0 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b09bc9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040cfbb0 con 0x7f2b041578d0 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b03fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b0406d120 0x7f2b0406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b03fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b0406d120 0x7f2b0406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56228/0 (socket says 172.21.15.81:56228) 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b03fff700 1 -- 172.21.15.81:0/743928050 learned_addr learned my addr 172.21.15.81:0/743928050 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b037fe700 1 --2- 172.21.15.81:0/743928050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 0x7f2b040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/743928050 >> v2:172.21.15.83:3300/0 conn(0x7f2b04157ca0 0x7f2b0415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b03fff700 1 -- 172.21.15.81:0/743928050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 msgr2=0x7f2b040cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b03fff700 1 --2- 172.21.15.81:0/743928050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 0x7f2b040cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b03fff700 1 -- 172.21.15.81:0/743928050 >> v2:172.21.15.83:3300/0 conn(0x7f2b04157ca0 msgr2=0x7f2b0415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b03fff700 1 --2- 172.21.15.81:0/743928050 >> v2:172.21.15.83:3300/0 conn(0x7f2b04157ca0 0x7f2b0415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b03fff700 1 -- 172.21.15.81:0/743928050 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b040cfe90 con 0x7f2b0406d120 2023-10-06T02:47:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b03fff700 1 --2- 172.21.15.81:0/743928050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 0x7f2b0406d580 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2b0406cb70 tx=0x7f2afc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9a90f708de1267 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b027fc700 1 -- 172.21.15.81:0/743928050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00e070 con 0x7f2b0406d120 2023-10-06T02:47:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b027fc700 1 -- 172.21.15.81:0/743928050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc00b970 con 0x7f2b0406d120 2023-10-06T02:47:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.506+0000 7f2b027fc700 1 -- 172.21.15.81:0/743928050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0092e0 con 0x7f2b0406d120 2023-10-06T02:47:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.507+0000 7f2b09bc9700 1 -- 172.21.15.81:0/743928050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 msgr2=0x7f2b0406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.507+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/743928050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 0x7f2b0406d580 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2b0406cb70 tx=0x7f2afc009840 comp rx=0 tx=0).stop 2023-10-06T02:47:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.507+0000 7f2b09bc9700 1 -- 172.21.15.81:0/743928050 shutdown_connections 2023-10-06T02:47:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.507+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/743928050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 0x7f2b0406d580 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.507+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/743928050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 0x7f2b040cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.507+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/743928050 >> v2:172.21.15.83:3300/0 conn(0x7f2b04157ca0 0x7f2b0415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.507+0000 7f2b09bc9700 1 -- 172.21.15.81:0/743928050 >> 172.21.15.81:0/743928050 conn(0x7f2b0406bb90 msgr2=0x7f2b0406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.507+0000 7f2b09bc9700 1 -- 172.21.15.81:0/743928050 shutdown_connections 2023-10-06T02:47:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.507+0000 7f2b09bc9700 1 -- 172.21.15.81:0/743928050 wait complete. 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.508+0000 7f2b09bc9700 1 Processor -- start 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.508+0000 7f2b09bc9700 1 -- start start 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b09bc9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 0x7f2b041549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b09bc9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 0x7f2b040ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b09bc9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b04157ca0 0x7f2b040b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b09bc9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040b40a0 con 0x7f2b0406d120 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b09bc9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040b4380 con 0x7f2b04157ca0 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b09bc9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040b4660 con 0x7f2b041578d0 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 0x7f2b041549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 0x7f2b041549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56232/0 (socket says 172.21.15.81:56232) 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b037fe700 1 -- 172.21.15.81:0/808615339 learned_addr learned my addr 172.21.15.81:0/808615339 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b037fe700 1 -- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 msgr2=0x7f2b040ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 0x7f2b040ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b03fff700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b04157ca0 0x7f2b040b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b037fe700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 0x7f2b040ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b037fe700 1 -- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b04157ca0 msgr2=0x7f2b040b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b037fe700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b04157ca0 0x7f2b040b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.509+0000 7f2b037fe700 1 -- 172.21.15.81:0/808615339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009ae0 con 0x7f2b0406d120 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.510+0000 7f2b037fe700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 0x7f2b041549e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ec80 tx=0x7f2af40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.510+0000 7f2aeb7fe700 1 -- 172.21.15.81:0/808615339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400c9d0 con 0x7f2b0406d120 2023-10-06T02:47:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.510+0000 7f2aeb7fe700 1 -- 172.21.15.81:0/808615339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af400cb50 con 0x7f2b0406d120 2023-10-06T02:47:35.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.510+0000 7f2b09bc9700 1 -- 172.21.15.81:0/808615339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b040b4940 con 0x7f2b0406d120 2023-10-06T02:47:35.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.510+0000 7f2aeb7fe700 1 -- 172.21.15.81:0/808615339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4013470 con 0x7f2b0406d120 2023-10-06T02:47:35.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.510+0000 7f2b09bc9700 1 -- 172.21.15.81:0/808615339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b040abea0 con 0x7f2b0406d120 2023-10-06T02:47:35.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.511+0000 7f2aeb7fe700 1 -- 172.21.15.81:0/808615339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2af4013860 con 0x7f2b0406d120 2023-10-06T02:47:35.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.511+0000 7f2aeb7fe700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2af0066f30 0x7f2af00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.512+0000 7f2aeb7fe700 1 -- 172.21.15.81:0/808615339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2af4084a60 con 0x7f2b0406d120 2023-10-06T02:47:35.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.512+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2af0066f30 0x7f2af00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.512+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2af0066f30 0x7f2af00693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2af8006f00 tx=0x7f2af8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.514+0000 7f2b12ec1b80 1 Processor -- start 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.514+0000 7f2b12ec1b80 1 -- start start 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.514+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea174cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.514+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1751d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.514+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1751e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.514+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea17424a70 con 0x55ea174cecc0 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.514+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea17422270 con 0x55ea1751dc00 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.514+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea1741e060 con 0x55ea174cd840 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1751d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1751d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56236/0 (socket says 172.21.15.81:56236) 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b02ffd700 1 -- 172.21.15.81:0/1843884806 learned_addr learned my addr 172.21.15.81:0/1843884806 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b03fff700 1 --2- 172.21.15.81:0/1843884806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1751e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b037fe700 1 --2- 172.21.15.81:0/1843884806 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea174cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b02ffd700 1 -- 172.21.15.81:0/1843884806 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 msgr2=0x55ea174cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/1843884806 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea174cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b02ffd700 1 -- 172.21.15.81:0/1843884806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 msgr2=0x55ea1751e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/1843884806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1751e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b02ffd700 1 -- 172.21.15.81:0/1843884806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea172b8270 con 0x55ea174cecc0 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/1843884806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1751d6c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2af8010a80 tx=0x7f2af8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3045e3e9b7d7e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2ae8ff9700 1 -- 172.21.15.81:0/1843884806 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8015b10 con 0x55ea174cecc0 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2ae8ff9700 1 -- 172.21.15.81:0/1843884806 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af801a070 con 0x55ea174cecc0 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.515+0000 7f2ae8ff9700 1 -- 172.21.15.81:0/1843884806 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8015e80 con 0x55ea174cecc0 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/1843884806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 msgr2=0x55ea1751d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/1843884806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1751d6c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2af8010a80 tx=0x7f2af8017000 comp rx=0 tx=0).stop 2023-10-06T02:47:35.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/1843884806 shutdown_connections 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/1843884806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1751e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/1843884806 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea174cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/1843884806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1751d6c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/1843884806 >> 172.21.15.81:0/1843884806 conn(0x55ea174cf160 msgr2=0x55ea174cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/1843884806 shutdown_connections 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/1843884806 wait complete. 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.516+0000 7f2b12ec1b80 1 -- start start 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b12ec1b80 1 Processor -- start 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea174cd840 0x55ea175172e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cecc0 0x55ea1750bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1751dc00 0x55ea17523ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea173c9890 con 0x55ea1751dc00 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea173e4ea0 con 0x55ea174cd840 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea172a0e30 con 0x55ea174cecc0 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b12ec1b80 10 client.0 _ll_register_callbacks cb 0x55ea17490e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b03fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1751dc00 0x55ea17523ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b03fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1751dc00 0x55ea17523ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56246/0 (socket says 172.21.15.81:56246) 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b03fff700 1 -- 172.21.15.81:0/3015042240 learned_addr learned my addr 172.21.15.81:0/3015042240 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cecc0 0x55ea1750bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.517+0000 7f2b037fe700 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea174cd840 0x55ea175172e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b03fff700 1 -- 172.21.15.81:0/3015042240 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cecc0 msgr2=0x55ea1750bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b03fff700 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cecc0 0x55ea1750bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b03fff700 1 -- 172.21.15.81:0/3015042240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea174cd840 msgr2=0x55ea175172e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b03fff700 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea174cd840 0x55ea175172e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b03fff700 1 -- 172.21.15.81:0/3015042240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af800e050 con 0x55ea1751dc00 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b03fff700 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1751dc00 0x55ea17523ef0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2afc012000 tx=0x7f2afc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e71a6ef9552899 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2ae1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/3015042240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc009940 con 0x55ea1751dc00 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3015042240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea174c2940 con 0x55ea1751dc00 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/3015042240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2afc012c20 con 0x55ea1751dc00 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/3015042240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2afc0032f0 con 0x55ea1751dc00 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b12ec1b80 10 client.5598 fetch_fsmap learned FSMap version 25 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3015042240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55ea1725afe0 con 0x55ea1751dc00 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/3015042240 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ea174c2940 con 0x55ea1751dc00 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/3015042240 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2afc00b050 con 0x55ea1751dc00 2023-10-06T02:47:35.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b12ec1b80 10 client.5598 fetch_fsmap finished waiting for FSMap version 25 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b12ec1b80 10 client.5598 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b12ec1b80 20 client.5598 populate_metadata read hostname 'smithi081' 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] conn(0x55ea174f8410 0x55ea174f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b12ec1b80 4 client.5598 mds_command: new command op to 5433 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3015042240 --> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea1749f870 con 0x55ea174f8410 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.518+0000 7f2b037fe700 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] conn(0x55ea174f8410 0x55ea174f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2ae1ffb700 10 client.5598 ms_handle_connect on v2:172.21.15.81:6833/2380710039 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b037fe700 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] conn(0x55ea174f8410 0x55ea174f87e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39eedf75fb66b8d5 server_cookie=1bb72676bba0a33 in_seq=0 out_seq=0 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/3015042240 <== mds.0 v2:172.21.15.81:6833/2380710039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ea1749f870 con 0x55ea174f8410 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2ae1ffb700 10 client.5598 handle_command_reply: tid=0 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b12ec1b80 1 client.5598 shutdown 2023-10-06T02:47:35.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3015042240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1751dc00 msgr2=0x55ea17523ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1751dc00 0x55ea17523ef0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2afc012000 tx=0x7f2afc018000 comp rx=0 tx=0).stop 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3015042240 shutdown_connections 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] conn(0x55ea174f8410 0x55ea174f87e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1751dc00 0x55ea17523ef0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea174cd840 0x55ea175172e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3015042240 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cecc0 0x55ea1750bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2ae1ffb700 0 client.5598 ms_handle_reset on v2:172.21.15.81:6833/2380710039 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.519+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3015042240 >> 172.21.15.81:0/3015042240 conn(0x55ea174cf160 msgr2=0x55ea174ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.520+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3015042240 shutdown_connections 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.520+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3015042240 wait complete. 2023-10-06T02:47:35.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.520+0000 7f2b12ec1b80 20 client.5598 trim_cache size 0 max 16384 2023-10-06T02:47:35.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.536+0000 7f2b12ec1b80 1 Processor -- start 2023-10-06T02:47:35.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.536+0000 7f2b12ec1b80 1 -- start start 2023-10-06T02:47:35.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea174f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1750d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1750d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea175272f0 con 0x55ea174cecc0 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea174f31d0 con 0x55ea1751dc00 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea174f9890 con 0x55ea174cd840 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1750d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1750d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56254/0 (socket says 172.21.15.81:56254) 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b02ffd700 1 -- 172.21.15.81:0/3550225910 learned_addr learned my addr 172.21.15.81:0/3550225910 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b02ffd700 1 -- 172.21.15.81:0/3550225910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 msgr2=0x55ea174f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/3550225910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea174f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b03fff700 1 --2- 172.21.15.81:0/3550225910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1750d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b02ffd700 1 -- 172.21.15.81:0/3550225910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 msgr2=0x55ea1750d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/3550225910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1750d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b02ffd700 1 -- 172.21.15.81:0/3550225910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea173ec780 con 0x55ea174cecc0 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b03fff700 1 --2- 172.21.15.81:0/3550225910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1750d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.537+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/3550225910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1750d230 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2af8008010 tx=0x7f2af801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94be631e6beebb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2ae97fa700 1 -- 172.21.15.81:0/3550225910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8030070 con 0x55ea174cecc0 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2ae97fa700 1 -- 172.21.15.81:0/3550225910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af8009830 con 0x55ea174cecc0 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2ae97fa700 1 -- 172.21.15.81:0/3550225910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8015d40 con 0x55ea174cecc0 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3550225910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 msgr2=0x55ea1750d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3550225910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1750d230 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2af8008010 tx=0x7f2af801a000 comp rx=0 tx=0).stop 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3550225910 shutdown_connections 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3550225910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1750d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3550225910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea174f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/3550225910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea1750d230 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3550225910 >> 172.21.15.81:0/3550225910 conn(0x55ea174cf160 msgr2=0x55ea174f29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3550225910 shutdown_connections 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.538+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/3550225910 wait complete. 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.539+0000 7f2b12ec1b80 1 -- start start 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.539+0000 7f2b12ec1b80 1 Processor -- start 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea1757ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea175114e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1750d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea175121c0 con 0x55ea174cecc0 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea175174f0 con 0x55ea1751dc00 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea175177d0 con 0x55ea174cd840 2023-10-06T02:47:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 10 client.0 _ll_register_callbacks cb 0x55ea17490e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea175114e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea175114e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56260/0 (socket says 172.21.15.81:56260) 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b02ffd700 1 -- 172.21.15.81:0/2794880789 learned_addr learned my addr 172.21.15.81:0/2794880789 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b03fff700 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1750d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b037fe700 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea1757ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b02ffd700 1 -- 172.21.15.81:0/2794880789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 msgr2=0x55ea1757ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea1757ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b02ffd700 1 -- 172.21.15.81:0/2794880789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 msgr2=0x55ea1750d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1750d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b02ffd700 1 -- 172.21.15.81:0/2794880789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea172b8270 con 0x55ea174cecc0 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b02ffd700 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea175114e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2af8008010 tx=0x7f2af8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2c5ccd0e5224f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2ae1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/2794880789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af803f440 con 0x55ea174cecc0 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/2794880789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2af8040dc0 con 0x55ea174cecc0 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/2794880789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2af801a070 con 0x55ea174cecc0 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/2794880789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2af8034640 con 0x55ea174cecc0 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 10 client.5604 fetch_fsmap learned FSMap version 25 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.540+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/2794880789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55ea173d3470 con 0x55ea174cecc0 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/2794880789 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af801a070 con 0x55ea174cecc0 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/2794880789 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2af80347a0 con 0x55ea174cecc0 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 10 client.5604 fetch_fsmap finished waiting for FSMap version 25 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 10 client.5604 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 20 client.5604 populate_metadata read hostname 'smithi081' 2023-10-06T02:47:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] conn(0x55ea17511a20 0x55ea1750d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 4 client.5604 mds_command: new command op to 5433 tid=0[{"prefix": "status"}] 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/2794880789 --> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ea173c0e00 con 0x55ea17511a20 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b037fe700 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] conn(0x55ea17511a20 0x55ea1750d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2ae1ffb700 10 client.5604 ms_handle_connect on v2:172.21.15.81:6833/2380710039 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b037fe700 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] conn(0x55ea17511a20 0x55ea1750d6d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa63460a2d8d7182 server_cookie=c4b3d60d6287e103 in_seq=0 out_seq=0 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2ae1ffb700 1 -- 172.21.15.81:0/2794880789 <== mds.0 v2:172.21.15.81:6833/2380710039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55ea173c0e00 con 0x55ea17511a20 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2ae1ffb700 10 client.5604 handle_command_reply: tid=0 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 client.5604 shutdown 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/2794880789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 msgr2=0x55ea175114e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea175114e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2af8008010 tx=0x7f2af8030000 comp rx=0 tx=0).stop 2023-10-06T02:47:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/2794880789 shutdown_connections 2023-10-06T02:47:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.81:6833/2380710039,v1:172.21.15.81:6835/2380710039] conn(0x55ea17511a20 0x55ea1750d6d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea1751dc00 0x55ea1750d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55ea174cd840 0x55ea1757ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 --2- 172.21.15.81:0/2794880789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea174cecc0 0x55ea175114e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2ae1ffb700 0 client.5604 ms_handle_reset on v2:172.21.15.81:6833/2380710039 2023-10-06T02:47:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/2794880789 >> 172.21.15.81:0/2794880789 conn(0x55ea174cf160 msgr2=0x55ea174f1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/2794880789 shutdown_connections 2023-10-06T02:47:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.541+0000 7f2b12ec1b80 1 -- 172.21.15.81:0/2794880789 wait complete. 2023-10-06T02:47:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b12ec1b80 20 client.5604 trim_cache size 0 max 16384 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5433, 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.7928389859999996, 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 25, 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 48, 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 48, 2023-10-06T02:47:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.78246757 2023-10-06T02:47:35.558 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:35.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 -- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2af0066f30 msgr2=0x7f2af00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2af0066f30 0x7f2af00693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2af8006f00 tx=0x7f2af8008040 comp rx=0 tx=0).stop 2023-10-06T02:47:35.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 -- 172.21.15.81:0/808615339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 msgr2=0x7f2b041549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 0x7f2b041549e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ec80 tx=0x7f2af40091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 -- 172.21.15.81:0/808615339 shutdown_connections 2023-10-06T02:47:35.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2af0066f30 0x7f2af00693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b04157ca0 0x7f2b040b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b0406d120 0x7f2b041549e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 --2- 172.21.15.81:0/808615339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b041578d0 0x7f2b040ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 -- 172.21.15.81:0/808615339 >> 172.21.15.81:0/808615339 conn(0x7f2b0406bb90 msgr2=0x7f2b040699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 -- 172.21.15.81:0/808615339 shutdown_connections 2023-10-06T02:47:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.542+0000 7f2b09bc9700 1 -- 172.21.15.81:0/808615339 wait complete. 2023-10-06T02:47:35.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:47:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.673+0000 7f0f17458700 1 Processor -- start 2023-10-06T02:47:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.673+0000 7f0f17458700 1 -- start start 2023-10-06T02:47:35.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f17458700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f101578d0 0x7f0f100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f17458700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f10157ca0 0x7f0f1015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f17458700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0f1006d120 0x7f0f1006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f17458700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1006dac0 con 0x7f0f101578d0 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f17458700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f100d07c0 con 0x7f0f1006d120 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f17458700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f100cfbb0 con 0x7f0f10157ca0 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f151f4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f101578d0 0x7f0f100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f151f4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f101578d0 0x7f0f100cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56272/0 (socket says 172.21.15.81:56272) 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f151f4700 1 -- 172.21.15.81:0/12792746 learned_addr learned my addr 172.21.15.81:0/12792746 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f159f5700 1 --2- 172.21.15.81:0/12792746 >> v2:172.21.15.83:3300/0 conn(0x7f0f1006d120 0x7f0f1006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f149f3700 1 --2- 172.21.15.81:0/12792746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f10157ca0 0x7f0f1015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f151f4700 1 -- 172.21.15.81:0/12792746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f10157ca0 msgr2=0x7f0f1015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f151f4700 1 --2- 172.21.15.81:0/12792746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f10157ca0 0x7f0f1015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f151f4700 1 -- 172.21.15.81:0/12792746 >> v2:172.21.15.83:3300/0 conn(0x7f0f1006d120 msgr2=0x7f0f1006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f151f4700 1 --2- 172.21.15.81:0/12792746 >> v2:172.21.15.83:3300/0 conn(0x7f0f1006d120 0x7f0f1006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f151f4700 1 -- 172.21.15.81:0/12792746 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f100cfe90 con 0x7f0f101578d0 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f159f5700 1 --2- 172.21.15.81:0/12792746 >> v2:172.21.15.83:3300/0 conn(0x7f0f1006d120 0x7f0f1006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f149f3700 1 --2- 172.21.15.81:0/12792746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f10157ca0 0x7f0f1015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f151f4700 1 --2- 172.21.15.81:0/12792746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f101578d0 0x7f0f100cf4f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0f100b3940 tx=0x7f0f0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa102ea690c3cc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f07fff700 1 -- 172.21.15.81:0/12792746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c00b860 con 0x7f0f101578d0 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.674+0000 7f0f07fff700 1 -- 172.21.15.81:0/12792746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c00b9c0 con 0x7f0f101578d0 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f07fff700 1 -- 172.21.15.81:0/12792746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c00bd60 con 0x7f0f101578d0 2023-10-06T02:47:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f17458700 1 -- 172.21.15.81:0/12792746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f101578d0 msgr2=0x7f0f100cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f17458700 1 --2- 172.21.15.81:0/12792746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f101578d0 0x7f0f100cf4f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0f100b3940 tx=0x7f0f0c009250 comp rx=0 tx=0).stop 2023-10-06T02:47:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f17458700 1 -- 172.21.15.81:0/12792746 shutdown_connections 2023-10-06T02:47:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f17458700 1 --2- 172.21.15.81:0/12792746 >> v2:172.21.15.83:3300/0 conn(0x7f0f1006d120 0x7f0f1006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f17458700 1 --2- 172.21.15.81:0/12792746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f101578d0 0x7f0f100cf4f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f17458700 1 --2- 172.21.15.81:0/12792746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f10157ca0 0x7f0f1015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f17458700 1 -- 172.21.15.81:0/12792746 >> 172.21.15.81:0/12792746 conn(0x7f0f1006bb90 msgr2=0x7f0f1006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f17458700 1 -- 172.21.15.81:0/12792746 shutdown_connections 2023-10-06T02:47:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.675+0000 7f0f17458700 1 -- 172.21.15.81:0/12792746 wait complete. 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.676+0000 7f0f17458700 1 Processor -- start 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.676+0000 7f0f17458700 1 -- start start 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f17458700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f1006d120 0x7f0f10154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f17458700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f101578d0 0x7f0f1016e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f17458700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f10157ca0 0x7f0f10069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f17458700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f100b5410 con 0x7f0f10157ca0 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f17458700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1008d000 con 0x7f0f101578d0 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f17458700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f100b5660 con 0x7f0f1006d120 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f159f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f10157ca0 0x7f0f10069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f159f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f10157ca0 0x7f0f10069ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56280/0 (socket says 172.21.15.81:56280) 2023-10-06T02:47:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f159f5700 1 -- 172.21.15.81:0/3117885514 learned_addr learned my addr 172.21.15.81:0/3117885514 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f149f3700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f101578d0 0x7f0f1016e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f151f4700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f1006d120 0x7f0f10154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f159f5700 1 -- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f1006d120 msgr2=0x7f0f10154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.677+0000 7f0f159f5700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f1006d120 0x7f0f10154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f159f5700 1 -- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f101578d0 msgr2=0x7f0f1016e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f159f5700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f101578d0 0x7f0f1016e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f159f5700 1 -- 172.21.15.81:0/3117885514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0094f0 con 0x7f0f10157ca0 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f149f3700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f101578d0 0x7f0f1016e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f151f4700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f1006d120 0x7f0f10154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f159f5700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f10157ca0 0x7f0f10069ce0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800cf60 tx=0x7f0f08007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f057fa700 1 -- 172.21.15.81:0/3117885514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08015440 con 0x7f0f10157ca0 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f057fa700 1 -- 172.21.15.81:0/3117885514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f080155a0 con 0x7f0f10157ca0 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f057fa700 1 -- 172.21.15.81:0/3117885514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08015960 con 0x7f0f10157ca0 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f100b5940 con 0x7f0f10157ca0 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.678+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f10154cd0 con 0x7f0f10157ca0 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.679+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f100b5e60 con 0x7f0f10157ca0 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.679+0000 7f0f057fa700 1 -- 172.21.15.81:0/3117885514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f08015d50 con 0x7f0f10157ca0 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.680+0000 7f0f057fa700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ef4066f30 0x7f0ef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.680+0000 7f0f057fa700 1 -- 172.21.15.81:0/3117885514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0f08085040 con 0x7f0f10157ca0 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.680+0000 7f0f151f4700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ef4066f30 0x7f0ef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.680+0000 7f0f151f4700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ef4066f30 0x7f0ef40693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f100b3940 tx=0x7f0f0c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.684+0000 7f0f057fa700 1 -- 172.21.15.81:0/3117885514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f100b5e60 con 0x7f0f10157ca0 2023-10-06T02:47:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.908+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f100b5e60 con 0x7f0f10157ca0 2023-10-06T02:47:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.908+0000 7f0f057fa700 1 -- 172.21.15.81:0/3117885514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0f0801a060 con 0x7f0f10157ca0 2023-10-06T02:47:35.910 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:47:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.910+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ef4066f30 msgr2=0x7f0ef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.910+0000 7f0f17458700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ef4066f30 0x7f0ef40693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f100b3940 tx=0x7f0f0c017000 comp rx=0 tx=0).stop 2023-10-06T02:47:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.910+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f10157ca0 msgr2=0x7f0f10069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.910+0000 7f0f17458700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f10157ca0 0x7f0f10069ce0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800cf60 tx=0x7f0f08007870 comp rx=0 tx=0).stop 2023-10-06T02:47:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.911+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 shutdown_connections 2023-10-06T02:47:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.911+0000 7f0f17458700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f10157ca0 0x7f0f10069ce0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.911+0000 7f0f17458700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f1006d120 0x7f0f10154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.911+0000 7f0f17458700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ef4066f30 0x7f0ef40693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.911+0000 7f0f17458700 1 --2- 172.21.15.81:0/3117885514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f101578d0 0x7f0f1016e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:35.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.911+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 >> 172.21.15.81:0/3117885514 conn(0x7f0f1006bb90 msgr2=0x7f0f10156840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:35.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.911+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 shutdown_connections 2023-10-06T02:47:35.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:35.911+0000 7f0f17458700 1 -- 172.21.15.81:0/3117885514 wait complete. 2023-10-06T02:47:35.923 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:47:35.923 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:47:35.923 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:47:35.924 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:47:35.924 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:47:35.924 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:47:35.924 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:47:35.924 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:47:35.924 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:47:35.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:35.924 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:47:35.939 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:35.940 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42461sec preferred_lft 42461sec 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:35.941 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:47:35.942 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:35.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:35.943 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:47:36.003 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:47:36.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:36.004 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:47:36.060 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:47:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:47:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:47:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:47:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:47:36.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:36.061 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:47:36.061 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:47:36.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:47:36.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:47:36.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:47:36.062 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:47:36.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:36.160 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:47:36.175 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:47:36.175 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:47:36.175 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:47:36.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:36.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:47:36.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:47:36.242 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:47:36.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:47:36.297 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:47:36.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:47:36.351 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:47:36.351 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:47:36.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:36.392 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:47:36.432 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:36.432 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:36.451 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:36.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:36.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:47:36.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:47:36.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:47:36.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:47:36.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:47:36.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:47:36.472 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:36.472 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:36.472 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:47:36.473 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:47:36.473 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:47:36.473 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:47:36.473 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:47:36.473 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:47:36.473 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:47:36.473 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:47:36.473 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:47:36.475 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:47:36.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:36.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:47:36.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:47:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.692+0000 7fb1d047e700 1 Processor -- start 2023-10-06T02:47:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.692+0000 7fb1d047e700 1 -- start start 2023-10-06T02:47:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.693+0000 7fb1d047e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb1c8157ca0 0x7fb1c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.693+0000 7fb1d047e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1c806d120 0x7fb1c806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.693+0000 7fb1d047e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c80d07c0 con 0x7fb1c81578d0 2023-10-06T02:47:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.693+0000 7fb1d047e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c806da50 con 0x7fb1c806d120 2023-10-06T02:47:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.693+0000 7fb1d047e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c80cfbb0 con 0x7fb1c8157ca0 2023-10-06T02:47:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.693+0000 7fb1cea1b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1c806d120 0x7fb1c806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.693+0000 7fb1ce21a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb1c81578d0 0x7fb1c815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46894/0 (socket says 172.21.15.81:46894) 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.693+0000 7fb1ce21a700 1 -- 172.21.15.81:0/2040220588 learned_addr learned my addr 172.21.15.81:0/2040220588 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cea1b700 1 -- 172.21.15.81:0/2040220588 >> v2:172.21.15.83:3300/0 conn(0x7fb1c8157ca0 msgr2=0x7fb1c80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cda19700 1 --2- 172.21.15.81:0/2040220588 >> v2:172.21.15.83:3300/0 conn(0x7fb1c8157ca0 0x7fb1c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cd218700 1 -- 172.21.15.81:0/2040220588 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416007652 0 0) 0x7fb1c80d07c0 con 0x7fb1c81578d0 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cea1b700 1 --2- 172.21.15.81:0/2040220588 >> v2:172.21.15.83:3300/0 conn(0x7fb1c8157ca0 0x7fb1c80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cea1b700 1 -- 172.21.15.81:0/2040220588 >> v1:172.21.15.81:6789/0 conn(0x7fb1c81578d0 legacy=0x7fb1c815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cea1b700 1 -- 172.21.15.81:0/2040220588 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80cfe90 con 0x7fb1c806d120 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cda19700 1 --2- 172.21.15.81:0/2040220588 >> v2:172.21.15.83:3300/0 conn(0x7fb1c8157ca0 0x7fb1c80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cea1b700 1 --2- 172.21.15.81:0/2040220588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 0x7fb1c806d510 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8068510 tx=0x7fb1c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85bf3b4584da091 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cd218700 1 -- 172.21.15.81:0/2040220588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000b6b0 con 0x7fb1c806d120 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cd218700 1 -- 172.21.15.81:0/2040220588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c000b810 con 0x7fb1c806d120 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1cd218700 1 -- 172.21.15.81:0/2040220588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000bbb0 con 0x7fb1c806d120 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1d047e700 1 -- 172.21.15.81:0/2040220588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 msgr2=0x7fb1c806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.694+0000 7fb1d047e700 1 --2- 172.21.15.81:0/2040220588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 0x7fb1c806d510 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8068510 tx=0x7fb1c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.695+0000 7fb1d047e700 1 -- 172.21.15.81:0/2040220588 shutdown_connections 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.695+0000 7fb1d047e700 1 --2- 172.21.15.81:0/2040220588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 0x7fb1c806d510 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.695+0000 7fb1d047e700 1 --2- 172.21.15.81:0/2040220588 >> v2:172.21.15.83:3300/0 conn(0x7fb1c8157ca0 0x7fb1c80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.695+0000 7fb1d047e700 1 -- 172.21.15.81:0/2040220588 >> 172.21.15.81:0/2040220588 conn(0x7fb1c806bb90 msgr2=0x7fb1c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.695+0000 7fb1d047e700 1 -- 172.21.15.81:0/2040220588 shutdown_connections 2023-10-06T02:47:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.695+0000 7fb1d047e700 1 -- 172.21.15.81:0/2040220588 wait complete. 2023-10-06T02:47:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1d047e700 1 Processor -- start 2023-10-06T02:47:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1d047e700 1 -- start start 2023-10-06T02:47:36.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1d047e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 0x7fb1c80aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:36.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1d047e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1c81578d0 0x7fb1c8154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:36.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1d047e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1c8157ca0 0x7fb1c815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:36.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1d047e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80ab9f0 con 0x7fb1c806d120 2023-10-06T02:47:36.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1d047e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8169d70 con 0x7fb1c81578d0 2023-10-06T02:47:36.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1d047e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c816a010 con 0x7fb1c8157ca0 2023-10-06T02:47:36.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1ce21a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 0x7fb1c80aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:36.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1ce21a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 0x7fb1c80aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56294/0 (socket says 172.21.15.81:56294) 2023-10-06T02:47:36.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.696+0000 7fb1ce21a700 1 -- 172.21.15.81:0/2823204439 learned_addr learned my addr 172.21.15.81:0/2823204439 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:36.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1cea1b700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1c8157ca0 0x7fb1c815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1cda19700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1c81578d0 0x7fb1c8154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1ce21a700 1 -- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1c8157ca0 msgr2=0x7fb1c815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1ce21a700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1c8157ca0 0x7fb1c815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1ce21a700 1 -- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1c81578d0 msgr2=0x7fb1c8154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1ce21a700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1c81578d0 0x7fb1c8154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1ce21a700 1 -- 172.21.15.81:0/2823204439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c0009420 con 0x7fb1c806d120 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1cea1b700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1c8157ca0 0x7fb1c815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1cda19700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1c81578d0 0x7fb1c8154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1ce21a700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 0x7fb1c80aa890 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400cd80 tx=0x7fb1c4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1be7fc700 1 -- 172.21.15.81:0/2823204439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400ab10 con 0x7fb1c806d120 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1be7fc700 1 -- 172.21.15.81:0/2823204439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c400ac70 con 0x7fb1c806d120 2023-10-06T02:47:36.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c80ab150 con 0x7fb1c806d120 2023-10-06T02:47:36.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1be7fc700 1 -- 172.21.15.81:0/2823204439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40070f0 con 0x7fb1c806d120 2023-10-06T02:47:36.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.697+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c80ab710 con 0x7fb1c806d120 2023-10-06T02:47:36.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.698+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c8067ac0 con 0x7fb1c806d120 2023-10-06T02:47:36.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.698+0000 7fb1be7fc700 1 -- 172.21.15.81:0/2823204439 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1c40074e0 con 0x7fb1c806d120 2023-10-06T02:47:36.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.699+0000 7fb1be7fc700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1ac066f30 0x7fb1ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:36.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.699+0000 7fb1be7fc700 1 -- 172.21.15.81:0/2823204439 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb1c4084bc0 con 0x7fb1c806d120 2023-10-06T02:47:36.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.699+0000 7fb1cda19700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1ac066f30 0x7fb1ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:36.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.699+0000 7fb1cda19700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1ac066f30 0x7fb1ac0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8006fd0 tx=0x7fb1b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:36.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.703+0000 7fb1be7fc700 1 -- 172.21.15.81:0/2823204439 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1c4051d50 con 0x7fb1c806d120 2023-10-06T02:47:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.929+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb1c80d0170 con 0x7fb1c806d120 2023-10-06T02:47:36.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.930+0000 7fb1be7fc700 1 -- 172.21.15.81:0/2823204439 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb1c4055370 con 0x7fb1c806d120 2023-10-06T02:47:36.931 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:47:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.931+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1ac066f30 msgr2=0x7fb1ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.931+0000 7fb1d047e700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1ac066f30 0x7fb1ac0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8006fd0 tx=0x7fb1b8008040 comp rx=0 tx=0).stop 2023-10-06T02:47:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.931+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 msgr2=0x7fb1c80aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.931+0000 7fb1d047e700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 0x7fb1c80aa890 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400cd80 tx=0x7fb1c4001ae0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.932+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 shutdown_connections 2023-10-06T02:47:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.932+0000 7fb1d047e700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1c8157ca0 0x7fb1c815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.932+0000 7fb1d047e700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c806d120 0x7fb1c80aa890 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.932+0000 7fb1d047e700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1ac066f30 0x7fb1ac0693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.932+0000 7fb1d047e700 1 --2- 172.21.15.81:0/2823204439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1c81578d0 0x7fb1c8154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:36.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.932+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 >> 172.21.15.81:0/2823204439 conn(0x7fb1c806bb90 msgr2=0x7fb1c8069890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:36.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.932+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 shutdown_connections 2023-10-06T02:47:36.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:36.932+0000 7fb1d047e700 1 -- 172.21.15.81:0/2823204439 wait complete. 2023-10-06T02:47:36.944 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:47:36.944 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:47:36.944 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:47:36.944 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:47:36.945 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:47:36.945 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:47:36.945 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:47:36.945 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:47:36.945 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:47:36.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:36.946 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:47:36.964 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:47:36.964 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:47:36.964 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:47:36.964 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:36.964 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:36.965 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42460sec preferred_lft 42460sec 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:47:36.966 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:47:36.967 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:36.967 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:47:36.967 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:47:36.967 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:47:36.967 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:47:36.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:36.967 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:47:37.031 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:47:37.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:37.033 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:47:37.092 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:47:37.093 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:47:37.093 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:47:37.093 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:47:37.093 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:47:37.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:37.093 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:47:37.093 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:47:37.093 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:47:37.093 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:47:37.094 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:47:37.094 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:47:37.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:37.199 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:47:37.215 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:47:37.215 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:47:37.215 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:47:37.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:37.215 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:47:37.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:47:37.280 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:47:37.335 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:47:37.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:47:37.336 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:47:37.392 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:47:37.392 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:47:37.392 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:37.473 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:37.473 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:37.490 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:37.490 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:37.490 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:47:37.490 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:47:37.490 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:47:37.490 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:47:37.491 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:47:37.491 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:47:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:47:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:47:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:47:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:47:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:47:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:47:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:47:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:47:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:47:37.513 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:47:37.513 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:47:37.514 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:47:37.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:47:37.514 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:47:37.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:37.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.693+0000 7f9dc044e700 1 Processor -- start 2023-10-06T02:47:37.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.693+0000 7f9dc044e700 1 -- start start 2023-10-06T02:47:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.694+0000 7f9dc044e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 0x7f9db80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.694+0000 7f9dc044e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9db80ceb30 0x7f9db80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.694+0000 7f9dc044e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9db806d650 0x7f9db806da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.694+0000 7f9dc044e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db806ea90 con 0x7f9db806d650 2023-10-06T02:47:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.694+0000 7f9dc044e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db80cf4e0 con 0x7f9db80ceb30 2023-10-06T02:47:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.694+0000 7f9dc044e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80b0ca0 con 0x7f9db815a2a0 2023-10-06T02:47:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.694+0000 7f9dbe9eb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9db806d650 0x7f9db806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe9eb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9db806d650 0x7f9db806da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56308/0 (socket says 172.21.15.81:56308) 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe9eb700 1 -- 172.21.15.81:0/189161975 learned_addr learned my addr 172.21.15.81:0/189161975 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbd9e9700 1 --2- 172.21.15.81:0/189161975 >> v2:172.21.15.83:3300/0 conn(0x7f9db80ceb30 0x7f9db80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe1ea700 1 --2- 172.21.15.81:0/189161975 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 0x7f9db80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe9eb700 1 -- 172.21.15.81:0/189161975 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 msgr2=0x7f9db80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe9eb700 1 --2- 172.21.15.81:0/189161975 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 0x7f9db80b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe9eb700 1 -- 172.21.15.81:0/189161975 >> v2:172.21.15.83:3300/0 conn(0x7f9db80ceb30 msgr2=0x7f9db80cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe9eb700 1 --2- 172.21.15.81:0/189161975 >> v2:172.21.15.83:3300/0 conn(0x7f9db80ceb30 0x7f9db80cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe9eb700 1 -- 172.21.15.81:0/189161975 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db80b00d0 con 0x7f9db806d650 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe1ea700 1 --2- 172.21.15.81:0/189161975 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 0x7f9db80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbd9e9700 1 --2- 172.21.15.81:0/189161975 >> v2:172.21.15.83:3300/0 conn(0x7f9db80ceb30 0x7f9db80cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbe9eb700 1 --2- 172.21.15.81:0/189161975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 0x7f9db806da70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9db806f9c0 tx=0x7f9db0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3753adaa500f2ed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbd1e8700 1 -- 172.21.15.81:0/189161975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db000b860 con 0x7f9db806d650 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbd1e8700 1 -- 172.21.15.81:0/189161975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db000b9c0 con 0x7f9db806d650 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.695+0000 7f9dbd1e8700 1 -- 172.21.15.81:0/189161975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db000bd60 con 0x7f9db806d650 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.696+0000 7f9dc044e700 1 -- 172.21.15.81:0/189161975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 msgr2=0x7f9db806da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.696+0000 7f9dc044e700 1 --2- 172.21.15.81:0/189161975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 0x7f9db806da70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9db806f9c0 tx=0x7f9db0009250 comp rx=0 tx=0).stop 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.696+0000 7f9dc044e700 1 -- 172.21.15.81:0/189161975 shutdown_connections 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.696+0000 7f9dc044e700 1 --2- 172.21.15.81:0/189161975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 0x7f9db806da70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.696+0000 7f9dc044e700 1 --2- 172.21.15.81:0/189161975 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 0x7f9db80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.696+0000 7f9dc044e700 1 --2- 172.21.15.81:0/189161975 >> v2:172.21.15.83:3300/0 conn(0x7f9db80ceb30 0x7f9db80cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.696+0000 7f9dc044e700 1 -- 172.21.15.81:0/189161975 >> 172.21.15.81:0/189161975 conn(0x7f9db8067640 msgr2=0x7f9db8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.696+0000 7f9dc044e700 1 -- 172.21.15.81:0/189161975 shutdown_connections 2023-10-06T02:47:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.696+0000 7f9dc044e700 1 -- 172.21.15.81:0/189161975 wait complete. 2023-10-06T02:47:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.697+0000 7f9dc044e700 1 Processor -- start 2023-10-06T02:47:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.697+0000 7f9dc044e700 1 -- start start 2023-10-06T02:47:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dc044e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 0x7f9db816a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dc044e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9db80ceb30 0x7f9db8156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dc044e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 0x7f9db814f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dc044e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8154030 con 0x7f9db806d650 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dc044e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8157020 con 0x7f9db80ceb30 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dc044e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db816b260 con 0x7f9db815a2a0 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbe1ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 0x7f9db816a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbe1ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 0x7f9db816a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56310/0 (socket says 172.21.15.81:56310) 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbe1ea700 1 -- 172.21.15.81:0/2649955146 learned_addr learned my addr 172.21.15.81:0/2649955146 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbe1ea700 1 -- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 msgr2=0x7f9db814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbd9e9700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9db80ceb30 0x7f9db8156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbe1ea700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 0x7f9db814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbe1ea700 1 -- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9db80ceb30 msgr2=0x7f9db8156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbe1ea700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9db80ceb30 0x7f9db8156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbe1ea700 1 -- 172.21.15.81:0/2649955146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00094f0 con 0x7f9db806d650 2023-10-06T02:47:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dbe1ea700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 0x7f9db816a2c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9db400cfb0 tx=0x7f9db4007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dae7fc700 1 -- 172.21.15.81:0/2649955146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4016420 con 0x7f9db806d650 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dae7fc700 1 -- 172.21.15.81:0/2649955146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db4016580 con 0x7f9db806d650 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db816a9c0 con 0x7f9db806d650 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dae7fc700 1 -- 172.21.15.81:0/2649955146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4016940 con 0x7f9db806d650 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.698+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db816af80 con 0x7f9db806d650 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.699+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db8069e40 con 0x7f9db806d650 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.700+0000 7f9dae7fc700 1 -- 172.21.15.81:0/2649955146 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9db4016d30 con 0x7f9db806d650 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.700+0000 7f9dae7fc700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d9c066f30 0x7f9d9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.700+0000 7f9dae7fc700 1 -- 172.21.15.81:0/2649955146 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9db4012070 con 0x7f9db806d650 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.700+0000 7f9dbd9e9700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d9c066f30 0x7f9d9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.701+0000 7f9dbd9e9700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d9c066f30 0x7f9d9c0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9db80c9190 tx=0x7f9da8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.704+0000 7f9dae7fc700 1 -- 172.21.15.81:0/2649955146 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9db404e5a0 con 0x7f9db806d650 2023-10-06T02:47:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.927+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9db804bb80 con 0x7f9db806d650 2023-10-06T02:47:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.928+0000 7f9dae7fc700 1 -- 172.21.15.81:0/2649955146 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f9db4052130 con 0x7f9db806d650 2023-10-06T02:47:37.929 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:47:29.117013+0000","modified":"2023-10-06T02:47:32.768965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2380710039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2380710039},{"type":"v1","addr":"172.21.15.81:6835","nonce":2380710039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:47:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d9c066f30 msgr2=0x7f9d9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d9c066f30 0x7f9d9c0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9db80c9190 tx=0x7f9da8008040 comp rx=0 tx=0).stop 2023-10-06T02:47:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 msgr2=0x7f9db816a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 0x7f9db816a2c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9db400cfb0 tx=0x7f9db4007870 comp rx=0 tx=0).stop 2023-10-06T02:47:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 shutdown_connections 2023-10-06T02:47:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9db815a2a0 0x7f9db814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db806d650 0x7f9db816a2c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d9c066f30 0x7f9d9c0693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 --2- 172.21.15.81:0/2649955146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9db80ceb30 0x7f9db8156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 >> 172.21.15.81:0/2649955146 conn(0x7f9db8067640 msgr2=0x7f9db806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 shutdown_connections 2023-10-06T02:47:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:37.930+0000 7f9dc044e700 1 -- 172.21.15.81:0/2649955146 wait complete. 2023-10-06T02:47:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T02:47:37.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:47:38.077 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":5433,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3176057740000005,"mdsmap_epoch":25,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":14.307234374} 2023-10-06T02:47:38.077 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 5433, "mdsmap_epoch": 25, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 8.317605774, "state": "up:active", "uptime": 14.307234374, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:47:38.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-06T02:47:38.206 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-06T02:47:38.206 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-06T02:47:38.206 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-06T02:47:38.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:38.207 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-06T02:47:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:265+0 records in 2023-10-06T02:47:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:265+0 records out 2023-10-06T02:47:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.31351 s, 212 MB/s 2023-10-06T02:47:39.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:39.539 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-06T02:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:292+0 records in 2023-10-06T02:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:292+0 records out 2023-10-06T02:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.48055 s, 207 MB/s 2023-10-06T02:47:41.036 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-06T02:47:41.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:47:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.148+0000 7f9514aef700 1 Processor -- start 2023-10-06T02:47:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.148+0000 7f9514aef700 1 -- start start 2023-10-06T02:47:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f9514aef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 0x7f95100cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f9514aef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9510159f10 0x7f9510068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f9514aef700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f95100ccb40 0x7f9510068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f9514aef700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95100cee10 con 0x7f9510159f10 2023-10-06T02:47:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f9514aef700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95100cd040 con 0x7f95100ccb40 2023-10-06T02:47:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f9514aef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95100cd320 con 0x7f9510159b40 2023-10-06T02:47:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9510159f10 0x7f9510068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9510159f10 0x7f9510068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49818/0 (socket says 172.21.15.81:49818) 2023-10-06T02:47:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950effd700 1 -- 172.21.15.81:0/3001237041 learned_addr learned my addr 172.21.15.81:0/3001237041 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950ffff700 1 --2- 172.21.15.81:0/3001237041 >> v2:172.21.15.83:3300/0 conn(0x7f95100ccb40 0x7f9510068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950f7fe700 1 --2- 172.21.15.81:0/3001237041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 0x7f95100cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950effd700 1 -- 172.21.15.81:0/3001237041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 msgr2=0x7f95100cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950effd700 1 --2- 172.21.15.81:0/3001237041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 0x7f95100cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950effd700 1 -- 172.21.15.81:0/3001237041 >> v2:172.21.15.83:3300/0 conn(0x7f95100ccb40 msgr2=0x7f9510068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950effd700 1 --2- 172.21.15.81:0/3001237041 >> v2:172.21.15.83:3300/0 conn(0x7f95100ccb40 0x7f9510068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950effd700 1 -- 172.21.15.81:0/3001237041 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95100ce7c0 con 0x7f9510159f10 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.149+0000 7f950effd700 1 --2- 172.21.15.81:0/3001237041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 0x7f9510068780 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f95100b6bf0 tx=0x7f9504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6261b276715423 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f950e7fc700 1 -- 172.21.15.81:0/3001237041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950400b640 con 0x7f9510159f10 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f950e7fc700 1 -- 172.21.15.81:0/3001237041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950400b7a0 con 0x7f9510159f10 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f950e7fc700 1 -- 172.21.15.81:0/3001237041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950400bb60 con 0x7f9510159f10 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f9514aef700 1 -- 172.21.15.81:0/3001237041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 msgr2=0x7f9510068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f9514aef700 1 --2- 172.21.15.81:0/3001237041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 0x7f9510068780 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f95100b6bf0 tx=0x7f9504009250 comp rx=0 tx=0).stop 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f9514aef700 1 -- 172.21.15.81:0/3001237041 shutdown_connections 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f9514aef700 1 --2- 172.21.15.81:0/3001237041 >> v2:172.21.15.83:3300/0 conn(0x7f95100ccb40 0x7f9510068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f9514aef700 1 --2- 172.21.15.81:0/3001237041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 0x7f95100cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f9514aef700 1 --2- 172.21.15.81:0/3001237041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 0x7f9510068780 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f9514aef700 1 -- 172.21.15.81:0/3001237041 >> 172.21.15.81:0/3001237041 conn(0x7f95100cd660 msgr2=0x7f95100cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f9514aef700 1 -- 172.21.15.81:0/3001237041 shutdown_connections 2023-10-06T02:47:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.150+0000 7f9514aef700 1 -- 172.21.15.81:0/3001237041 wait complete. 2023-10-06T02:47:41.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.151+0000 7f9514aef700 1 Processor -- start 2023-10-06T02:47:41.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.151+0000 7f9514aef700 1 -- start start 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f9514aef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95100ccb40 0x7f9510140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f9514aef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 0x7f9510158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f9514aef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 0x7f9510141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f9514aef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9510157c30 con 0x7f9510159f10 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f9514aef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951015a5b0 con 0x7f95100ccb40 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f9514aef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9510157020 con 0x7f9510159b40 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f950f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95100ccb40 0x7f9510140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f950ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 0x7f9510141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f950f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95100ccb40 0x7f9510140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:46748/0 (socket says 172.21.15.81:46748) 2023-10-06T02:47:41.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f950f7fe700 1 -- 172.21.15.81:0/3801043144 learned_addr learned my addr 172.21.15.81:0/3801043144 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.152+0000 7f950effd700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 0x7f9510158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f950f7fe700 1 -- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 msgr2=0x7f9510158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f950f7fe700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 0x7f9510158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f950f7fe700 1 -- 172.21.15.81:0/3801043144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 msgr2=0x7f9510141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f950f7fe700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 0x7f9510141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f950f7fe700 1 -- 172.21.15.81:0/3801043144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95040094f0 con 0x7f95100ccb40 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f950ffff700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 0x7f9510141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f950f7fe700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95100ccb40 0x7f9510140d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9500009ef0 tx=0x7f950000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f94f77fe700 1 -- 172.21.15.81:0/3801043144 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950000cb70 con 0x7f95100ccb40 2023-10-06T02:47:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f94f77fe700 1 -- 172.21.15.81:0/3801043144 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950000f040 con 0x7f95100ccb40 2023-10-06T02:47:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f94f77fe700 1 -- 172.21.15.81:0/3801043144 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500014480 con 0x7f95100ccb40 2023-10-06T02:47:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9510157300 con 0x7f95100ccb40 2023-10-06T02:47:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.153+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95101578c0 con 0x7f95100ccb40 2023-10-06T02:47:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.154+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9510157f10 con 0x7f95100ccb40 2023-10-06T02:47:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.154+0000 7f94f77fe700 1 -- 172.21.15.81:0/3801043144 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95000147f0 con 0x7f95100ccb40 2023-10-06T02:47:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.155+0000 7f94f77fe700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f94fc066f30 0x7f94fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.155+0000 7f94f77fe700 1 -- 172.21.15.81:0/3801043144 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9500085030 con 0x7f95100ccb40 2023-10-06T02:47:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.155+0000 7f950effd700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f94fc066f30 0x7f94fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.155+0000 7f950effd700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f94fc066f30 0x7f94fc0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95100b6bf0 tx=0x7f9504017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:41.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.160+0000 7f94f77fe700 1 -- 172.21.15.81:0/3801043144 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9500052140 con 0x7f95100ccb40 2023-10-06T02:47:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.340+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f95100cb890 con 0x7f95100ccb40 2023-10-06T02:47:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.342+0000 7f94f77fe700 1 -- 172.21.15.81:0/3801043144 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+34769 (secure 0 0 0) 0x7f9500055760 con 0x7f95100ccb40 2023-10-06T02:47:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 48, 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:47:30.359304+0000", 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:47:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 8, 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:47:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:47:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:47:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "19", 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:47:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:47:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:27.250251+0000", 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "47", 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:47:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:47:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 8, 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:28.083304+0000", 2023-10-06T02:47:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:47:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-06T02:47:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:47:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:47:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:47:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:47:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:47:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:47:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:47:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:47:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:47:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:41.383 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:41.383 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:41.383 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:41.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:47:41.384 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:41.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:47:41.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:41.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.385 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.385 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:41.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:47:41.386 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:41.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:47:41.387 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:41.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.387 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.387 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:41.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:47:41.388 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:41.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:47:41.389 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:41.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.389 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.390 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:41.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:47:41.391 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:41.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:47:41.391 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:41.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.392 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.392 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:47:41.392 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:47:41.392 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:47:41.393 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:47:41.393 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:41.393 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:41.393 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:41.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.394 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:41.394 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:41.394 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:41.394 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:41.395 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:41.395 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:41.395 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:41.395 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:41.396 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:41.396 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:41.396 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:41.396 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:41.396 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:41.397 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.397 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:47:41.397 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:41.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:47:41.398 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.400 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:41.402 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:41.403 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.403 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:41.403 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:41.403 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:41.403 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:41.404 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:41.404 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:41.404 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:41.404 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:41.404 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:41.404 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:41.404 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:41.405 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:41.405 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:41.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:47:41.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:41.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:47:41.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:41.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.407 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:41.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.408 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:47:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:47:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:41.425 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:41.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.431 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:41.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:41.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.435 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.435 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:41.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.436 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:47:41.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:41.439 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:41.440 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:41.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:41.443 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:41.444 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:47:41.445 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:47:41.446 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:47:41.447 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:47:41.447 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:47:41.447 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:47:41.447 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:47:41.447 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:47:41.447 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:47:41.447 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:47:41.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:41.447 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f94fc066f30 msgr2=0x7f94fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f94fc066f30 0x7f94fc0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95100b6bf0 tx=0x7f9504017000 comp rx=0 tx=0).stop 2023-10-06T02:47:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95100ccb40 msgr2=0x7f9510140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95100ccb40 0x7f9510140d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9500009ef0 tx=0x7f950000b040 comp rx=0 tx=0).stop 2023-10-06T02:47:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 shutdown_connections 2023-10-06T02:47:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510159f10 0x7f9510141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f94fc066f30 0x7f94fc0693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95100ccb40 0x7f9510140d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 --2- 172.21.15.81:0/3801043144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9510159b40 0x7f9510158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 >> 172.21.15.81:0/3801043144 conn(0x7f95100cd660 msgr2=0x7f951006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 shutdown_connections 2023-10-06T02:47:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:41.344+0000 7f9514aef700 1 -- 172.21.15.81:0/3801043144 wait complete. 2023-10-06T02:47:41.450 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:47:43.372 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:47:43.372+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-06T02:47:46.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:47:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.573+0000 7f0e6a9b2700 1 Processor -- start 2023-10-06T02:47:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.574+0000 7f0e6a9b2700 1 -- start start 2023-10-06T02:47:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.574+0000 7f0e6a9b2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0e6406d830 0x7f0e640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.574+0000 7f0e6a9b2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e640d07c0 con 0x7f0e641578d0 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.574+0000 7f0e6a9b2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e640cfbb0 con 0x7f0e64157ca0 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.574+0000 7f0e6a9b2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e640cfe90 con 0x7f0e6406d830 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.574+0000 7f0e63fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0e641578d0 0x7f0e6415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52494/0 (socket says 172.21.15.81:52494) 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.574+0000 7f0e63fff700 1 -- 172.21.15.81:0/1669001269 learned_addr learned my addr 172.21.15.81:0/1669001269 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e68f4f700 1 --2- 172.21.15.81:0/1669001269 >> v2:172.21.15.83:3300/0 conn(0x7f0e6406d830 0x7f0e640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988329150 0 0) 0x7f0e640d07c0 con 0x7f0e641578d0 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e4c003570 con 0x7f0e641578d0 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897501372 0 0) 0x7f0e640cfbb0 con 0x7f0e64157ca0 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e640d07c0 con 0x7f0e64157ca0 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1573992094 0 0) 0x7f0e4c003570 con 0x7f0e641578d0 2023-10-06T02:47:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 >> v2:172.21.15.83:3300/0 conn(0x7f0e6406d830 msgr2=0x7f0e640cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 --2- 172.21.15.81:0/1669001269 >> v2:172.21.15.83:3300/0 conn(0x7f0e6406d830 0x7f0e640cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 >> v1:172.21.15.83:6789/0 conn(0x7f0e64157ca0 legacy=0x7f0e6406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640d0170 con 0x7f0e641578d0 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f0e54001470 con 0x7f0e641578d0 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 >> v1:172.21.15.81:6789/0 conn(0x7f0e641578d0 legacy=0x7f0e6415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e4c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e4c004810 0x7f0e4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e4c005210 0x7f0e4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640cfe90 con 0x7f0e4c003c40 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c00c130 con 0x7f0e4c005210 2023-10-06T02:47:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c00c2c0 con 0x7f0e4c004810 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e63fff700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e4c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e68f4f700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e4c005210 0x7f0e4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e637fe700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e4c004810 0x7f0e4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e63fff700 1 -- 172.21.15.81:0/1669001269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e4c004810 msgr2=0x7f0e4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e63fff700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e4c004810 0x7f0e4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e63fff700 1 -- 172.21.15.81:0/1669001269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e4c005210 msgr2=0x7f0e4c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e63fff700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e4c005210 0x7f0e4c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e63fff700 1 -- 172.21.15.81:0/1669001269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c003570 con 0x7f0e4c003c40 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e68f4f700 1 -- 172.21.15.81:0/1669001269 reap_dead start 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.575+0000 7f0e637fe700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e4c004810 0x7f0e4c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e63fff700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e4c004030 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400c210 tx=0x7f0e54001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd7d2f0655866f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400cad0 con 0x7f0e4c003c40 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5400cc50 con 0x7f0e4c003c40 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e62ffd700 1 -- 172.21.15.81:0/1669001269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54005920 con 0x7f0e4c003c40 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/1669001269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 msgr2=0x7f0e4c004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e6a9b2700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e4c004030 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400c210 tx=0x7f0e54001d40 comp rx=0 tx=0).stop 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/1669001269 shutdown_connections 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e6a9b2700 1 --2- 172.21.15.81:0/1669001269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e4c004030 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/1669001269 >> 172.21.15.81:0/1669001269 conn(0x7f0e6406bb90 msgr2=0x7f0e6406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/1669001269 shutdown_connections 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.576+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/1669001269 wait complete. 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.577+0000 7f0e6a9b2700 1 Processor -- start 2023-10-06T02:47:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e6a9b2700 1 -- start start 2023-10-06T02:47:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e6a9b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e640b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e6a9b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e640aafd0 0x7f0e6415da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e6a9b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e640ab440 0x7f0e6415df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e6a9b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640b69d0 con 0x7f0e4c003c40 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e6a9b2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640b6000 con 0x7f0e640ab440 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e6a9b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640b53f0 con 0x7f0e640aafd0 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e63fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e640b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e63fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e640b6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49852/0 (socket says 172.21.15.81:49852) 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.578+0000 7f0e63fff700 1 -- 172.21.15.81:0/4283934246 learned_addr learned my addr 172.21.15.81:0/4283934246 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e637fe700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e640aafd0 0x7f0e6415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e68f4f700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e640ab440 0x7f0e6415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e63fff700 1 -- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e640aafd0 msgr2=0x7f0e6415da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e63fff700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e640aafd0 0x7f0e6415da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e63fff700 1 -- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e640ab440 msgr2=0x7f0e6415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e63fff700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e640ab440 0x7f0e6415df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e63fff700 1 -- 172.21.15.81:0/4283934246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640b56d0 con 0x7f0e4c003c40 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e68f4f700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e640ab440 0x7f0e6415df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e637fe700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e640aafd0 0x7f0e6415da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e63fff700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e640b6490 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0e54007fd0 tx=0x7f0e54015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e4bfff700 1 -- 172.21.15.81:0/4283934246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54005910 con 0x7f0e4c003c40 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e4bfff700 1 -- 172.21.15.81:0/4283934246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e540072e0 con 0x7f0e4c003c40 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e640b59b0 con 0x7f0e4c003c40 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e4bfff700 1 -- 172.21.15.81:0/4283934246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e540076a0 con 0x7f0e4c003c40 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.579+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e640b46c0 con 0x7f0e4c003c40 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.580+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e64067ac0 con 0x7f0e4c003c40 2023-10-06T02:47:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.580+0000 7f0e4bfff700 1 -- 172.21.15.81:0/4283934246 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e54019030 con 0x7f0e4c003c40 2023-10-06T02:47:46.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.581+0000 7f0e4bfff700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e50066f60 0x7f0e50069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:46.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.581+0000 7f0e4bfff700 1 -- 172.21.15.81:0/4283934246 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e54085e40 con 0x7f0e4c003c40 2023-10-06T02:47:46.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.581+0000 7f0e4bfff700 1 -- 172.21.15.81:0/4283934246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7f0e5006f120 con 0x7f0e4c003c40 2023-10-06T02:47:46.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.581+0000 7f0e637fe700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e50066f60 0x7f0e50069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:46.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.582+0000 7f0e637fe700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e50066f60 0x7f0e50069410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0e640aab20 tx=0x7f0e58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:46.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.585+0000 7f0e4bfff700 1 -- 172.21.15.81:0/4283934246 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e54052f60 con 0x7f0e4c003c40 2023-10-06T02:47:46.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.767+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0e640d0450 con 0x7f0e4c003c40 2023-10-06T02:47:46.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.768+0000 7f0e4bfff700 1 -- 172.21.15.81:0/4283934246 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+34861 (secure 0 0 0) 0x7f0e54022070 con 0x7f0e4c003c40 2023-10-06T02:47:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:46.770 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 51, 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:47:45.430798+0000", 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:47:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 8, 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:47:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:47:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:47:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:47:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:27.250251+0000", 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:47:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 8, 2023-10-06T02:47:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:28.083304+0000", 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:47:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:47:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:47:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:47:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:47:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:47:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:47:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:47:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:47:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:47:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:47:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:47:46.858 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:47:46.858 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:47:46.858 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:47:46.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:46.858 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e50066f60 msgr2=0x7f0e50069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e50066f60 0x7f0e50069410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0e640aab20 tx=0x7f0e58009040 comp rx=0 tx=0).stop 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 msgr2=0x7f0e640b6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e640b6490 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0e54007fd0 tx=0x7f0e54015000 comp rx=0 tx=0).stop 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 shutdown_connections 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e50066f60 0x7f0e50069410 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e640ab440 0x7f0e6415df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4c003c40 0x7f0e640b6490 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 --2- 172.21.15.81:0/4283934246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e640aafd0 0x7f0e6415da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 >> 172.21.15.81:0/4283934246 conn(0x7f0e6406bb90 msgr2=0x7f0e6406d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 shutdown_connections 2023-10-06T02:47:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:46.770+0000 7f0e6a9b2700 1 -- 172.21.15.81:0/4283934246 wait complete. 2023-10-06T02:47:46.861 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:47:46.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:46.861 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-06T02:47:47.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:47:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-06T02:47:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-06T02:47:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-06T02:47:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.229189 s, 229 MB/s 2023-10-06T02:47:47.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:47:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.230+0000 7fd9afce8700 1 Processor -- start 2023-10-06T02:47:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.230+0000 7fd9afce8700 1 -- start start 2023-10-06T02:47:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9afce8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd9a8156420 0x7fd9a80cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9afce8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a80c71d0 0x7fd9a80c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9afce8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a80cb880 con 0x7fd9a80cc250 2023-10-06T02:47:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9afce8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a80c7bb0 con 0x7fd9a8156420 2023-10-06T02:47:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9afce8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a806aa10 con 0x7fd9a80c71d0 2023-10-06T02:47:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9ae285700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a80c71d0 0x7fd9a80c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9ada84700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd9a8156420 0x7fd9a80cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9ad283700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd9a80cc250 0x7fd9a8069440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:59822/0 (socket says 172.21.15.81:59822) 2023-10-06T02:47:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9ae285700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a80c71d0 0x7fd9a80c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:46806/0 (socket says 172.21.15.81:46806) 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.231+0000 7fd9ad283700 1 -- 172.21.15.81:0/3375025605 learned_addr learned my addr 172.21.15.81:0/3375025605 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.232+0000 7fd9ada84700 1 -- 172.21.15.81:0/3375025605 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a80c71d0 msgr2=0x7fd9a80c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.232+0000 7fd9ada84700 1 --2- 172.21.15.81:0/3375025605 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a80c71d0 0x7fd9a80c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.232+0000 7fd9ada84700 1 -- 172.21.15.81:0/3375025605 >> v1:172.21.15.83:6789/0 conn(0x7fd9a80cc250 legacy=0x7fd9a8069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.232+0000 7fd9ada84700 1 -- 172.21.15.81:0/3375025605 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a80cac70 con 0x7fd9a8156420 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.232+0000 7fd9ae285700 1 --2- 172.21.15.81:0/3375025605 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a80c71d0 0x7fd9a80c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.232+0000 7fd9ada84700 1 --2- 172.21.15.81:0/3375025605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9a8156420 0x7fd9a80cbd10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000aa90 tx=0x7fd9a000a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a8ae451ff15d6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.232+0000 7fd9aca82700 1 -- 172.21.15.81:0/3375025605 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000c970 con 0x7fd9a8156420 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.232+0000 7fd9aca82700 1 -- 172.21.15.81:0/3375025605 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a000cad0 con 0x7fd9a8156420 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.232+0000 7fd9aca82700 1 -- 172.21.15.81:0/3375025605 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000ce70 con 0x7fd9a8156420 2023-10-06T02:47:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.233+0000 7fd9afce8700 1 -- 172.21.15.81:0/3375025605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9a8156420 msgr2=0x7fd9a80cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.233+0000 7fd9afce8700 1 --2- 172.21.15.81:0/3375025605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9a8156420 0x7fd9a80cbd10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000aa90 tx=0x7fd9a000a330 comp rx=0 tx=0).stop 2023-10-06T02:47:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.233+0000 7fd9afce8700 1 -- 172.21.15.81:0/3375025605 shutdown_connections 2023-10-06T02:47:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.233+0000 7fd9afce8700 1 --2- 172.21.15.81:0/3375025605 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a80c71d0 0x7fd9a80c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.233+0000 7fd9afce8700 1 --2- 172.21.15.81:0/3375025605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9a8156420 0x7fd9a80cbd10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.233+0000 7fd9afce8700 1 -- 172.21.15.81:0/3375025605 >> 172.21.15.81:0/3375025605 conn(0x7fd9a806c660 msgr2=0x7fd9a80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.233+0000 7fd9afce8700 1 -- 172.21.15.81:0/3375025605 shutdown_connections 2023-10-06T02:47:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.233+0000 7fd9afce8700 1 -- 172.21.15.81:0/3375025605 wait complete. 2023-10-06T02:47:47.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.234+0000 7fd9afce8700 1 Processor -- start 2023-10-06T02:47:47.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.234+0000 7fd9afce8700 1 -- start start 2023-10-06T02:47:47.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.234+0000 7fd9afce8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9a80c71d0 0x7fd9a80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.234+0000 7fd9afce8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a80cc250 0x7fd9a813dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.234+0000 7fd9afce8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a8156420 0x7fd9a80c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.234+0000 7fd9afce8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80b0830 con 0x7fd9a80cc250 2023-10-06T02:47:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.234+0000 7fd9afce8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80b1600 con 0x7fd9a80c71d0 2023-10-06T02:47:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.234+0000 7fd9afce8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80b18e0 con 0x7fd9a8156420 2023-10-06T02:47:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ad283700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a80cc250 0x7fd9a813dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ad283700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a80cc250 0x7fd9a813dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49858/0 (socket says 172.21.15.81:49858) 2023-10-06T02:47:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ad283700 1 -- 172.21.15.81:0/319717406 learned_addr learned my addr 172.21.15.81:0/319717406 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ada84700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9a80c71d0 0x7fd9a80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ae285700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a8156420 0x7fd9a80c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ad283700 1 -- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a8156420 msgr2=0x7fd9a80c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ad283700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a8156420 0x7fd9a80c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ad283700 1 -- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9a80c71d0 msgr2=0x7fd9a80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ad283700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9a80c71d0 0x7fd9a80b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ad283700 1 -- 172.21.15.81:0/319717406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009a20 con 0x7fd9a80cc250 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9ad283700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a80cc250 0x7fd9a813dcb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00e9d0 tx=0x7fd99c00c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9a5ffb700 1 -- 172.21.15.81:0/319717406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00ee60 con 0x7fd9a80cc250 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9a5ffb700 1 -- 172.21.15.81:0/319717406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c005b30 con 0x7fd9a80cc250 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a000a5d0 con 0x7fd9a80cc250 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9a5ffb700 1 -- 172.21.15.81:0/319717406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c004830 con 0x7fd9a80cc250 2023-10-06T02:47:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.235+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a80b2620 con 0x7fd9a80cc250 2023-10-06T02:47:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.236+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a80b1460 con 0x7fd9a80cc250 2023-10-06T02:47:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.237+0000 7fd9a5ffb700 1 -- 172.21.15.81:0/319717406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd99c004c20 con 0x7fd9a80cc250 2023-10-06T02:47:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.237+0000 7fd9a5ffb700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.237+0000 7fd9a5ffb700 1 -- 172.21.15.81:0/319717406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd99c0867f0 con 0x7fd9a80cc250 2023-10-06T02:47:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.237+0000 7fd9a5ffb700 1 -- 172.21.15.81:0/319717406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7fd99406f0f0 con 0x7fd9a80cc250 2023-10-06T02:47:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.237+0000 7fd9ada84700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.238+0000 7fd9ada84700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000a5a0 tx=0x7fd9a001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.241+0000 7fd9a5ffb700 1 -- 172.21.15.81:0/319717406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd99c01f060 con 0x7fd9a80cc250 2023-10-06T02:47:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.424+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd9a806b710 con 0x7fd9a80cc250 2023-10-06T02:47:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.425+0000 7fd9a5ffb700 1 -- 172.21.15.81:0/319717406 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+34861 (secure 0 0 0) 0x7fd9a80b1460 con 0x7fd9a80cc250 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 51, 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:47:45.430798+0000", 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:47:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:47:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 8, 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:47:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:47:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:27.250251+0000", 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:47:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 8, 2023-10-06T02:47:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:28.083304+0000", 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:47:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:47:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:47:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:47:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:47:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:47:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:47:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:47:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:47:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.505 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:47.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.508 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.509 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:47.510 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:47.511 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:47.512 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:47.514 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:47:47.515 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:47:47.516 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:47.517 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 msgr2=0x7fd9940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000a5a0 tx=0x7fd9a001a000 comp rx=0 tx=0).stop 2023-10-06T02:47:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a80cc250 msgr2=0x7fd9a813dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a80cc250 0x7fd9a813dcb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00e9d0 tx=0x7fd99c00c270 comp rx=0 tx=0).stop 2023-10-06T02:47:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 shutdown_connections 2023-10-06T02:47:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9a8156420 0x7fd9a80c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9a80c71d0 0x7fd9a80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 --2- 172.21.15.81:0/319717406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a80cc250 0x7fd9a813dcb0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 >> 172.21.15.81:0/319717406 conn(0x7fd9a806c660 msgr2=0x7fd9a806d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 shutdown_connections 2023-10-06T02:47:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.427+0000 7fd9afce8700 1 -- 172.21.15.81:0/319717406 wait complete. 2023-10-06T02:47:47.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:47.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.632+0000 7f831fc5f700 1 Processor -- start 2023-10-06T02:47:47.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.632+0000 7f831fc5f700 1 -- start start 2023-10-06T02:47:47.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.633+0000 7f831fc5f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f831806d830 0x7f83180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.633+0000 7f831fc5f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180d07c0 con 0x7f8318157ca0 2023-10-06T02:47:47.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.633+0000 7f831fc5f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180cfbb0 con 0x7f83181578d0 2023-10-06T02:47:47.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.633+0000 7f831fc5f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180cfe90 con 0x7f831806d830 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.633+0000 7f831d1fa700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8318157ca0 0x7f831806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52498/0 (socket says 172.21.15.81:52498) 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.633+0000 7f831d1fa700 1 -- 172.21.15.81:0/4132545626 learned_addr learned my addr 172.21.15.81:0/4132545626 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.633+0000 7f831e1fc700 1 --2- 172.21.15.81:0/4132545626 >> v2:172.21.15.83:3300/0 conn(0x7f831806d830 0x7f83180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.633+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689497271 0 0) 0x7f83180d07c0 con 0x7f8318157ca0 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.633+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8300003570 con 0x7f8318157ca0 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189986992 0 0) 0x7f83180cfbb0 con 0x7f83181578d0 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83180d07c0 con 0x7f83181578d0 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906307941 0 0) 0x7f8300003570 con 0x7f8318157ca0 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 >> v2:172.21.15.83:3300/0 conn(0x7f831806d830 msgr2=0x7f83180cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 --2- 172.21.15.81:0/4132545626 >> v2:172.21.15.83:3300/0 conn(0x7f831806d830 0x7f83180cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 >> v1:172.21.15.83:6789/0 conn(0x7f83181578d0 legacy=0x7f831815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180d0170 con 0x7f8318157ca0 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f830c0013f0 con 0x7f8318157ca0 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 >> v1:172.21.15.81:6789/0 conn(0x7f8318157ca0 legacy=0x7f831806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8300003c40 0x7f8300004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300004810 0x7f8300004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300005210 0x7f830000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180cfe90 con 0x7f8300005210 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830000c130 con 0x7f8300004810 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830000c2c0 con 0x7f8300003c40 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831e1fc700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300005210 0x7f830000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831d1fa700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300004810 0x7f8300004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831d9fb700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8300003c40 0x7f8300004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831e1fc700 1 -- 172.21.15.81:0/4132545626 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8300003c40 msgr2=0x7f8300004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831e1fc700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8300003c40 0x7f8300004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831e1fc700 1 -- 172.21.15.81:0/4132545626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300004810 msgr2=0x7f8300004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831e1fc700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300004810 0x7f8300004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831e1fc700 1 -- 172.21.15.81:0/4132545626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300003570 con 0x7f8300005210 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831e1fc700 1 -- 172.21.15.81:0/4132545626 reap_dead start 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.634+0000 7f831e1fc700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300005210 0x7f830000ba60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8308009c30 tx=0x7f83080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f703b55dcce556af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83080095b0 con 0x7f8300005210 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830800e710 con 0x7f8300005210 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831c9f9700 1 -- 172.21.15.81:0/4132545626 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830800eaf0 con 0x7f8300005210 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831fc5f700 1 -- 172.21.15.81:0/4132545626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300005210 msgr2=0x7f830000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831fc5f700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300005210 0x7f830000ba60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8308009c30 tx=0x7f83080091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831fc5f700 1 -- 172.21.15.81:0/4132545626 shutdown_connections 2023-10-06T02:47:47.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831fc5f700 1 --2- 172.21.15.81:0/4132545626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300005210 0x7f830000ba60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831fc5f700 1 -- 172.21.15.81:0/4132545626 >> 172.21.15.81:0/4132545626 conn(0x7f831806bb90 msgr2=0x7f831806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:47.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831fc5f700 1 -- 172.21.15.81:0/4132545626 shutdown_connections 2023-10-06T02:47:47.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.635+0000 7f831fc5f700 1 -- 172.21.15.81:0/4132545626 wait complete. 2023-10-06T02:47:47.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.636+0000 7f831fc5f700 1 Processor -- start 2023-10-06T02:47:47.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.636+0000 7f831fc5f700 1 -- start start 2023-10-06T02:47:47.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831fc5f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300005210 0x7f8318145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831fc5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831815ee50 0x7f831815f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831fc5f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83180b5550 0x7f83180b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831fc5f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180b5f30 con 0x7f831815ee50 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831fc5f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8318153d90 con 0x7f8300005210 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831fc5f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8318152bd0 con 0x7f83180b5550 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831d1fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831815ee50 0x7f831815f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831d1fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831815ee50 0x7f831815f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49878/0 (socket says 172.21.15.81:49878) 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831d1fa700 1 -- 172.21.15.81:0/4048705582 learned_addr learned my addr 172.21.15.81:0/4048705582 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831d1fa700 1 -- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83180b5550 msgr2=0x7f83180b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831d1fa700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83180b5550 0x7f83180b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831d1fa700 1 -- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300005210 msgr2=0x7f8318145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831d1fa700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300005210 0x7f8318145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.637+0000 7f831d1fa700 1 -- 172.21.15.81:0/4048705582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318153180 con 0x7f831815ee50 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.638+0000 7f831d1fa700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831815ee50 0x7f831815f2c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f830c004fb0 tx=0x7f830c001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.638+0000 7f8315ffb700 1 -- 172.21.15.81:0/4048705582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c011590 con 0x7f831815ee50 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.638+0000 7f8315ffb700 1 -- 172.21.15.81:0/4048705582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c011710 con 0x7f831815ee50 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.638+0000 7f8315ffb700 1 -- 172.21.15.81:0/4048705582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c011ad0 con 0x7f831815ee50 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.638+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8318153460 con 0x7f831815ee50 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.638+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8318153a20 con 0x7f831815ee50 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.639+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8318067ac0 con 0x7f831815ee50 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.639+0000 7f8315ffb700 1 -- 172.21.15.81:0/4048705582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f830c01d460 con 0x7f831815ee50 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.640+0000 7f8315ffb700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.640+0000 7f8315ffb700 1 -- 172.21.15.81:0/4048705582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f830c084870 con 0x7f831815ee50 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.640+0000 7f831d9fb700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.640+0000 7f8315ffb700 1 -- 172.21.15.81:0/4048705582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=53}) v3 -- 0x7f830406f0f0 con 0x7f831815ee50 2023-10-06T02:47:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.640+0000 7f831d9fb700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f83100018b0 tx=0x7f83100017a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.644+0000 7f8315ffb700 1 -- 172.21.15.81:0/4048705582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f830c051980 con 0x7f831815ee50 2023-10-06T02:47:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.871+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8318153ed0 con 0x7f831815ee50 2023-10-06T02:47:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.872+0000 7f8315ffb700 1 -- 172.21.15.81:0/4048705582 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f830c054fa0 con 0x7f831815ee50 2023-10-06T02:47:47.874 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:47.874 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:47:29.117013+0000","modified":"2023-10-06T02:47:32.768965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2380710039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2380710039},{"type":"v1","addr":"172.21.15.81:6835","nonce":2380710039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:47:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 msgr2=0x7f83040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f83100018b0 tx=0x7f83100017a0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831815ee50 msgr2=0x7f831815f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831815ee50 0x7f831815f2c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f830c004fb0 tx=0x7f830c001cc0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 shutdown_connections 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83180b5550 0x7f83180b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8304066f30 0x7f83040693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300005210 0x7f8318145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 --2- 172.21.15.81:0/4048705582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831815ee50 0x7f831815f2c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 >> 172.21.15.81:0/4048705582 conn(0x7f831806bb90 msgr2=0x7f8318155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 shutdown_connections 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:47.874+0000 7f831fc5f700 1 -- 172.21.15.81:0/4048705582 wait complete. 2023-10-06T02:47:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T02:47:47.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:47:48.019 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":5433,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.259525727,"mdsmap_epoch":25,"osdmap_epoch":52,"osdmap_epoch_barrier":51,"uptime":24.249156965000001} 2023-10-06T02:47:48.019 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 5433, "mdsmap_epoch": 25, "osdmap_epoch": 52, "osdmap_epoch_barrier": 51, "rank_uptime": 18.259525727, "state": "up:active", "uptime": 24.249156965, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:47:48.019 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:47:48.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:48.020 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-06T02:47:48.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:47:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-06T02:47:48.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:48.035 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-06T02:47:48.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:47:48.091 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-06T02:47:48.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:47:48.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.301+0000 7f3ce7810700 1 Processor -- start 2023-10-06T02:47:48.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.301+0000 7f3ce7810700 1 -- start start 2023-10-06T02:47:48.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce7810700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ce01578d0 0x7f3ce00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:48.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce7810700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3ce0157ca0 0x7f3ce015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce7810700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce00d07c0 con 0x7f3ce006d120 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce7810700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00cfbb0 con 0x7f3ce01578d0 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce7810700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00cfe90 con 0x7f3ce0157ca0 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce55ac700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ce01578d0 0x7f3ce00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce5dad700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3ce006d120 0x7f3ce006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52514/0 (socket says 172.21.15.81:52514) 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce5dad700 1 -- 172.21.15.81:0/3232082472 learned_addr learned my addr 172.21.15.81:0/3232082472 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce4dab700 1 --2- 172.21.15.81:0/3232082472 >> v2:172.21.15.83:3300/0 conn(0x7f3ce0157ca0 0x7f3ce015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce55ac700 1 -- 172.21.15.81:0/3232082472 >> v2:172.21.15.83:3300/0 conn(0x7f3ce0157ca0 msgr2=0x7f3ce015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce55ac700 1 --2- 172.21.15.81:0/3232082472 >> v2:172.21.15.83:3300/0 conn(0x7f3ce0157ca0 0x7f3ce015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce55ac700 1 -- 172.21.15.81:0/3232082472 >> v1:172.21.15.81:6789/0 conn(0x7f3ce006d120 legacy=0x7f3ce006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:48.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce55ac700 1 -- 172.21.15.81:0/3232082472 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00d0170 con 0x7f3ce01578d0 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3cd7fff700 1 -- 172.21.15.81:0/3232082472 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481885401 0 0) 0x7f3ce00d07c0 con 0x7f3ce006d120 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3ce55ac700 1 --2- 172.21.15.81:0/3232082472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce01578d0 0x7f3ce00cf4f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0068510 tx=0x7f3cdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2376496547c08dde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3cd7fff700 1 -- 172.21.15.81:0/3232082472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00b6b0 con 0x7f3ce01578d0 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3cd7fff700 1 -- 172.21.15.81:0/3232082472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00b810 con 0x7f3ce01578d0 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.302+0000 7f3cd7fff700 1 -- 172.21.15.81:0/3232082472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00bbb0 con 0x7f3ce01578d0 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.303+0000 7f3ce7810700 1 -- 172.21.15.81:0/3232082472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce01578d0 msgr2=0x7f3ce00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.303+0000 7f3ce7810700 1 --2- 172.21.15.81:0/3232082472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce01578d0 0x7f3ce00cf4f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0068510 tx=0x7f3cdc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.303+0000 7f3ce7810700 1 -- 172.21.15.81:0/3232082472 shutdown_connections 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.303+0000 7f3ce7810700 1 --2- 172.21.15.81:0/3232082472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce01578d0 0x7f3ce00cf4f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.303+0000 7f3ce7810700 1 --2- 172.21.15.81:0/3232082472 >> v2:172.21.15.83:3300/0 conn(0x7f3ce0157ca0 0x7f3ce015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.303+0000 7f3ce7810700 1 -- 172.21.15.81:0/3232082472 >> 172.21.15.81:0/3232082472 conn(0x7f3ce006bb90 msgr2=0x7f3ce006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:48.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.303+0000 7f3ce7810700 1 -- 172.21.15.81:0/3232082472 shutdown_connections 2023-10-06T02:47:48.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.303+0000 7f3ce7810700 1 -- 172.21.15.81:0/3232082472 wait complete. 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.304+0000 7f3ce7810700 1 Processor -- start 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.304+0000 7f3ce7810700 1 -- start start 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce7810700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ce006d120 0x7f3ce00b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce7810700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ce01578d0 0x7f3ce00b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce7810700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce0157ca0 0x7f3ce016a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce7810700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00b5b10 con 0x7f3ce0157ca0 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce7810700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00b5270 con 0x7f3ce006d120 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce7810700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00b5550 con 0x7f3ce01578d0 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce5dad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce0157ca0 0x7f3ce016a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce5dad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce0157ca0 0x7f3ce016a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49894/0 (socket says 172.21.15.81:49894) 2023-10-06T02:47:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce5dad700 1 -- 172.21.15.81:0/606448594 learned_addr learned my addr 172.21.15.81:0/606448594 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce4dab700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ce01578d0 0x7f3ce00b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce55ac700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ce006d120 0x7f3ce00b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce5dad700 1 -- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ce01578d0 msgr2=0x7f3ce00b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce5dad700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ce01578d0 0x7f3ce00b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce5dad700 1 -- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ce006d120 msgr2=0x7f3ce00b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce5dad700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ce006d120 0x7f3ce00b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce5dad700 1 -- 172.21.15.81:0/606448594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc009420 con 0x7f3ce0157ca0 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.305+0000 7f3ce55ac700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ce006d120 0x7f3ce00b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.306+0000 7f3ce5dad700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce0157ca0 0x7f3ce016a2d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800cc90 tx=0x7f3cd8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.306+0000 7f3cd57fa700 1 -- 172.21.15.81:0/606448594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800cea0 con 0x7f3ce0157ca0 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.306+0000 7f3cd57fa700 1 -- 172.21.15.81:0/606448594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800ab70 con 0x7f3ce0157ca0 2023-10-06T02:47:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.306+0000 7f3cd57fa700 1 -- 172.21.15.81:0/606448594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd80070f0 con 0x7f3ce0157ca0 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.306+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce00b5830 con 0x7f3ce0157ca0 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.306+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce016a810 con 0x7f3ce0157ca0 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.307+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce0067ac0 con 0x7f3ce0157ca0 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.307+0000 7f3cd57fa700 1 -- 172.21.15.81:0/606448594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cd80074a0 con 0x7f3ce0157ca0 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.307+0000 7f3cd57fa700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3cc4066f30 0x7f3cc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.307+0000 7f3cd57fa700 1 -- 172.21.15.81:0/606448594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3cd8084b10 con 0x7f3ce0157ca0 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.308+0000 7f3ce55ac700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3cc4066f30 0x7f3cc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.308+0000 7f3cd57fa700 1 -- 172.21.15.81:0/606448594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=53}) v3 -- 0x7f3cc406f0f0 con 0x7f3ce0157ca0 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.308+0000 7f3ce55ac700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3cc4066f30 0x7f3cc40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0093f0 tx=0x7f3cdc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.311+0000 7f3cd57fa700 1 -- 172.21.15.81:0/606448594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cd8051ca0 con 0x7f3ce0157ca0 2023-10-06T02:47:48.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.496+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3ce00d0450 con 0x7f3ce0157ca0 2023-10-06T02:47:48.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.497+0000 7f3cd57fa700 1 -- 172.21.15.81:0/606448594 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+34909 (secure 0 0 0) 0x7f3cd80552c0 con 0x7f3ce0157ca0 2023-10-06T02:47:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:48.500 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 52, 2023-10-06T02:47:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:47:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:47:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:47:47.443220+0000", 2023-10-06T02:47:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:47:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:47:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:47:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 8, 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:47:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-06T02:47:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:27.250251+0000", 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 8, 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:28.083304+0000", 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:47:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:47:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:47:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:47:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:47:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:47:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:47:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:48.572 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:48.573 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.574 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.575 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:48.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:48.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:48.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:47:48.579 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:48.581 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:48.582 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:47:48.583 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:48.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.584 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:48.584 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:48.584 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:48.584 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:48.584 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:48.584 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:48.584 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:47:48.585 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.586 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:47:48.587 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:47:48.588 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:47:48.589 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:47:48.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3cc4066f30 msgr2=0x7f3cc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3cc4066f30 0x7f3cc40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0093f0 tx=0x7f3cdc017000 comp rx=0 tx=0).stop 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce0157ca0 msgr2=0x7f3ce016a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce0157ca0 0x7f3ce016a2d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800cc90 tx=0x7f3cd8001a80 comp rx=0 tx=0).stop 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 shutdown_connections 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce0157ca0 0x7f3ce016a2d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3cc4066f30 0x7f3cc40693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ce006d120 0x7f3ce00b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 --2- 172.21.15.81:0/606448594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3ce01578d0 0x7f3ce00b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 >> 172.21.15.81:0/606448594 conn(0x7f3ce006bb90 msgr2=0x7f3ce006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 shutdown_connections 2023-10-06T02:47:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:48.500+0000 7f3ce7810700 1 -- 172.21.15.81:0/606448594 wait complete. 2023-10-06T02:47:48.592 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:47:49.363 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:47:49.361+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-10-06T02:47:53.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:47:53.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.710+0000 7f3a2f18a700 1 Processor -- start 2023-10-06T02:47:53.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.710+0000 7f3a2f18a700 1 -- start start 2023-10-06T02:47:53.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2f18a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3a28159b40 0x7f3a280cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2f18a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 0x7f3a28068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2f18a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a280ccb40 0x7f3a28068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2f18a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280cee10 con 0x7f3a280ccb40 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2f18a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280cd040 con 0x7f3a28159b40 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2f18a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280cd320 con 0x7f3a28159f10 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e989700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a280ccb40 0x7f3a28068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e989700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a280ccb40 0x7f3a28068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40990/0 (socket says 172.21.15.81:40990) 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e989700 1 -- 172.21.15.81:0/108834785 learned_addr learned my addr 172.21.15.81:0/108834785 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e188700 1 --2- 172.21.15.81:0/108834785 >> v2:172.21.15.83:3300/0 conn(0x7f3a28159b40 0x7f3a280cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2d987700 1 --2- 172.21.15.81:0/108834785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 0x7f3a28068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e989700 1 -- 172.21.15.81:0/108834785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 msgr2=0x7f3a28068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e989700 1 --2- 172.21.15.81:0/108834785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 0x7f3a28068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e989700 1 -- 172.21.15.81:0/108834785 >> v2:172.21.15.83:3300/0 conn(0x7f3a28159b40 msgr2=0x7f3a280cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e989700 1 --2- 172.21.15.81:0/108834785 >> v2:172.21.15.83:3300/0 conn(0x7f3a28159b40 0x7f3a280cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e989700 1 -- 172.21.15.81:0/108834785 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280ce7c0 con 0x7f3a280ccb40 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.711+0000 7f3a2e188700 1 --2- 172.21.15.81:0/108834785 >> v2:172.21.15.83:3300/0 conn(0x7f3a28159b40 0x7f3a280cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2e989700 1 --2- 172.21.15.81:0/108834785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 0x7f3a28068cc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3a280d0bc0 tx=0x7f3a18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16240016d2742403 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2d186700 1 -- 172.21.15.81:0/108834785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800b860 con 0x7f3a280ccb40 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2d186700 1 -- 172.21.15.81:0/108834785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1800b9c0 con 0x7f3a280ccb40 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2d186700 1 -- 172.21.15.81:0/108834785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800bd60 con 0x7f3a280ccb40 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2f18a700 1 -- 172.21.15.81:0/108834785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 msgr2=0x7f3a28068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/108834785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 0x7f3a28068cc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3a280d0bc0 tx=0x7f3a18009250 comp rx=0 tx=0).stop 2023-10-06T02:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2f18a700 1 -- 172.21.15.81:0/108834785 shutdown_connections 2023-10-06T02:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/108834785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 0x7f3a28068cc0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/108834785 >> v2:172.21.15.83:3300/0 conn(0x7f3a28159b40 0x7f3a280cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/108834785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 0x7f3a28068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2f18a700 1 -- 172.21.15.81:0/108834785 >> 172.21.15.81:0/108834785 conn(0x7f3a280cd660 msgr2=0x7f3a280cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2f18a700 1 -- 172.21.15.81:0/108834785 shutdown_connections 2023-10-06T02:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.712+0000 7f3a2f18a700 1 -- 172.21.15.81:0/108834785 wait complete. 2023-10-06T02:47:53.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.713+0000 7f3a2f18a700 1 Processor -- start 2023-10-06T02:47:53.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.713+0000 7f3a2f18a700 1 -- start start 2023-10-06T02:47:53.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2f18a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 0x7f3a28153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:53.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2f18a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a28159b40 0x7f3a28158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:53.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2f18a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 0x7f3a2815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:53.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2f18a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a281540c0 con 0x7f3a280ccb40 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2f18a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2815b1a0 con 0x7f3a28159b40 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2f18a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2815b480 con 0x7f3a28159f10 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2e188700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 0x7f3a28153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2e188700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 0x7f3a28153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40992/0 (socket says 172.21.15.81:40992) 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2e188700 1 -- 172.21.15.81:0/493704235 learned_addr learned my addr 172.21.15.81:0/493704235 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2e989700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 0x7f3a2815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2d987700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a28159b40 0x7f3a28158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2e188700 1 -- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 msgr2=0x7f3a2815c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2e188700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 0x7f3a2815c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2e188700 1 -- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a28159b40 msgr2=0x7f3a28158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2e188700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a28159b40 0x7f3a28158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2e188700 1 -- 172.21.15.81:0/493704235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180094f0 con 0x7f3a280ccb40 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.714+0000 7f3a2d987700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a28159b40 0x7f3a28158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.715+0000 7f3a2e188700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 0x7f3a28153b80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000d1d0 tx=0x7f3a20009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.715+0000 7f3a267fc700 1 -- 172.21.15.81:0/493704235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000ddc0 con 0x7f3a280ccb40 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.715+0000 7f3a267fc700 1 -- 172.21.15.81:0/493704235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2000f040 con 0x7f3a280ccb40 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.715+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2815b760 con 0x7f3a280ccb40 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.715+0000 7f3a267fc700 1 -- 172.21.15.81:0/493704235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20015670 con 0x7f3a280ccb40 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.715+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a28159260 con 0x7f3a280ccb40 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.716+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a28063e90 con 0x7f3a280ccb40 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.716+0000 7f3a267fc700 1 -- 172.21.15.81:0/493704235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a20015a60 con 0x7f3a280ccb40 2023-10-06T02:47:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.716+0000 7f3a267fc700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3a14066f30 0x7f3a140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.716+0000 7f3a267fc700 1 -- 172.21.15.81:0/493704235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3a20084b10 con 0x7f3a280ccb40 2023-10-06T02:47:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.717+0000 7f3a267fc700 1 -- 172.21.15.81:0/493704235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=53}) v3 -- 0x7f3a1406f0f0 con 0x7f3a280ccb40 2023-10-06T02:47:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.717+0000 7f3a2d987700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3a14066f30 0x7f3a140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.717+0000 7f3a2d987700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3a14066f30 0x7f3a140693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a280b3280 tx=0x7f3a1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.721+0000 7f3a267fc700 1 -- 172.21.15.81:0/493704235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a2004e5a0 con 0x7f3a280ccb40 2023-10-06T02:47:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.921+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3a280ceaa0 con 0x7f3a280ccb40 2023-10-06T02:47:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.922+0000 7f3a267fc700 1 -- 172.21.15.81:0/493704235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+34909 (secure 0 0 0) 0x7f3a2001a060 con 0x7f3a280ccb40 2023-10-06T02:47:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:53.924 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 52, 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:47:47.443220+0000", 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:47:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 8, 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:47:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:47:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:47:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:47:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:27.250251+0000", 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:47:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:47:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:47:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:47:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:47:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 8, 2023-10-06T02:47:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:47:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:28.083304+0000", 2023-10-06T02:47:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:47:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:47:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:47:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:47:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:47:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "49", 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:47:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:47:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:47:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:47:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:47:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:47:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:47:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:47:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:47:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:47:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:47:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:47:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:47:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:47:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:47:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:47:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:47:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:47:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:47:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:47:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:47:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:47:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:47:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:47:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:47:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:47:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:47:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:47:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:47:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:47:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:54.027 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3a14066f30 msgr2=0x7f3a140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3a14066f30 0x7f3a140693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a280b3280 tx=0x7f3a1c008040 comp rx=0 tx=0).stop 2023-10-06T02:47:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 msgr2=0x7f3a28153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 0x7f3a28153b80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000d1d0 tx=0x7f3a20009a90 comp rx=0 tx=0).stop 2023-10-06T02:47:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 shutdown_connections 2023-10-06T02:47:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a28159f10 0x7f3a2815c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a280ccb40 0x7f3a28153b80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3a14066f30 0x7f3a140693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 --2- 172.21.15.81:0/493704235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a28159b40 0x7f3a28158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 >> 172.21.15.81:0/493704235 conn(0x7f3a280cd660 msgr2=0x7f3a280b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 shutdown_connections 2023-10-06T02:47:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:53.924+0000 7f3a2f18a700 1 -- 172.21.15.81:0/493704235 wait complete. 2023-10-06T02:47:54.030 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:47:55.573 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:47:55.572+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-06T02:47:59.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:47:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.154+0000 7f4ed8681700 1 Processor -- start 2023-10-06T02:47:59.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.154+0000 7f4ed8681700 1 -- start start 2023-10-06T02:47:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.155+0000 7f4ed8681700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed00ce5c0 0x7f4ed00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.155+0000 7f4ed8681700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed015dfb0 con 0x7f4ed00ce1f0 2023-10-06T02:47:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.155+0000 7f4ed8681700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed00acec0 con 0x7f4ed00ac570 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.155+0000 7f4ed8681700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00ad1a0 con 0x7f4ed00ce5c0 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.155+0000 7f4ed641d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ed00ce1f0 0x7f4ed015e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52568/0 (socket says 172.21.15.81:52568) 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.155+0000 7f4ed641d700 1 -- 172.21.15.81:0/359563866 learned_addr learned my addr 172.21.15.81:0/359563866 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed5c1c700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed00ce5c0 0x7f4ed00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748857271 0 0) 0x7f4ed015dfb0 con 0x7f4ed00ce1f0 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ebc003570 con 0x7f4ed00ce1f0 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1815012471 0 0) 0x7f4ebc003570 con 0x7f4ed00ce1f0 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed00ce5c0 msgr2=0x7f4ed00aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed00ce5c0 0x7f4ed00aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 >> v1:172.21.15.83:6789/0 conn(0x7f4ed00ac570 legacy=0x7f4ed006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed015dc40 con 0x7f4ed00ce1f0 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f4ecc0017f0 con 0x7f4ed00ce1f0 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 >> v1:172.21.15.81:6789/0 conn(0x7f4ed00ce1f0 legacy=0x7f4ed015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ebc003a90 0x7f4ebc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed00ce5c0 0x7f4ebc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ebc004d50 0x7f4ebc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00ad1a0 con 0x7f4ebc003a90 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc00bb10 con 0x7f4ebc004d50 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc00bcd0 con 0x7f4ed00ce5c0 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed641d700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ebc003a90 0x7f4ebc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed5c1c700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed00ce5c0 0x7f4ebc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed6c1e700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ebc004d50 0x7f4ebc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed641d700 1 -- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed00ce5c0 msgr2=0x7f4ebc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed641d700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed00ce5c0 0x7f4ebc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed641d700 1 -- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ebc004d50 msgr2=0x7f4ebc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed641d700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ebc004d50 0x7f4ebc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.156+0000 7f4ed641d700 1 -- 172.21.15.81:0/359563866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc003570 con 0x7f4ebc003a90 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed641d700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ebc003a90 0x7f4ebc003e60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00a950 tx=0x7f4ecc0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2217d2c80c8e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0070d0 con 0x7f4ebc003a90 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc007250 con 0x7f4ebc003a90 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed541b700 1 -- 172.21.15.81:0/359563866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc007610 con 0x7f4ebc003a90 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed8681700 1 -- 172.21.15.81:0/359563866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ebc003a90 msgr2=0x7f4ebc003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed8681700 1 --2- 172.21.15.81:0/359563866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ebc003a90 0x7f4ebc003e60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00a950 tx=0x7f4ecc0021f0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed6c1e700 1 -- 172.21.15.81:0/359563866 reap_dead start 2023-10-06T02:47:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed8681700 1 -- 172.21.15.81:0/359563866 shutdown_connections 2023-10-06T02:47:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed8681700 1 -- 172.21.15.81:0/359563866 >> 172.21.15.81:0/359563866 conn(0x7f4ed006cca0 msgr2=0x7f4ed006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed8681700 1 -- 172.21.15.81:0/359563866 shutdown_connections 2023-10-06T02:47:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.157+0000 7f4ed8681700 1 -- 172.21.15.81:0/359563866 wait complete. 2023-10-06T02:47:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.158+0000 7f4ed8681700 1 Processor -- start 2023-10-06T02:47:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.158+0000 7f4ed8681700 1 -- start start 2023-10-06T02:47:59.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed8681700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ebc003a90 0x7f4ed0147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed8681700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed014a750 0x7f4ed015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed8681700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed015b330 0x7f4ed0159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed8681700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00c31c0 con 0x7f4ed014a750 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed8681700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00c34a0 con 0x7f4ebc003a90 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed8681700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00c3780 con 0x7f4ed015b330 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed5c1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed014a750 0x7f4ed015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed5c1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed014a750 0x7f4ed015adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41012/0 (socket says 172.21.15.81:41012) 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed5c1c700 1 -- 172.21.15.81:0/563861632 learned_addr learned my addr 172.21.15.81:0/563861632 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed641d700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ebc003a90 0x7f4ed0147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.159+0000 7f4ed6c1e700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed015b330 0x7f4ed0159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ed5c1c700 1 -- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed015b330 msgr2=0x7f4ed0159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ed5c1c700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed015b330 0x7f4ed0159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ed5c1c700 1 -- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ebc003a90 msgr2=0x7f4ed0147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ed5c1c700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ebc003a90 0x7f4ed0147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ed5c1c700 1 -- 172.21.15.81:0/563861632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00c3a60 con 0x7f4ed014a750 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ed5c1c700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed014a750 0x7f4ed015adf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0011d40 tx=0x7f4ec00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ec67fc700 1 -- 172.21.15.81:0/563861632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000fa10 con 0x7f4ed014a750 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ec67fc700 1 -- 172.21.15.81:0/563861632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec000fb70 con 0x7f4ed014a750 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ec67fc700 1 -- 172.21.15.81:0/563861632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0014440 con 0x7f4ed014a750 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed015b8e0 con 0x7f4ed014a750 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.160+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed014abc0 con 0x7f4ed014a750 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.161+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed015b700 con 0x7f4ed014a750 2023-10-06T02:47:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.161+0000 7f4ec67fc700 1 -- 172.21.15.81:0/563861632 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ec0014870 con 0x7f4ed014a750 2023-10-06T02:47:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.162+0000 7f4ec67fc700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4eb4066f30 0x7f4eb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.162+0000 7f4ec67fc700 1 -- 172.21.15.81:0/563861632 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f4ec0018030 con 0x7f4ed014a750 2023-10-06T02:47:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.162+0000 7f4ed641d700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4eb4066f30 0x7f4eb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.162+0000 7f4ed641d700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4eb4066f30 0x7f4eb40693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc002250 tx=0x7f4ecc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.166+0000 7f4ec67fc700 1 -- 172.21.15.81:0/563861632 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ec00520f0 con 0x7f4ed014a750 2023-10-06T02:47:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.350+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4ed015bf30 con 0x7f4ed014a750 2023-10-06T02:47:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.351+0000 7f4ec67fc700 1 -- 172.21.15.81:0/563861632 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+35144 (secure 0 0 0) 0x7f4ec0022090 con 0x7f4ed014a750 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 55, 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:47:57.585600+0000", 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:47:59.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:47:59.355 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 8, 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:59.356 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:47:59.357 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:59.358 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:59.359 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:59.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:59.361 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:47:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:47:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:47:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:47:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:27.250251+0000", 2023-10-06T02:47:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:47:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:59.373 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 8, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:28.083304+0000", 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:59.375 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:59.376 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:59.377 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:59.378 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:59.379 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:59.380 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:47:59.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.382 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.383 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:47:59.383 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:47:59.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.385 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.390 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.391 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.392 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:47:59.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:47:59.396 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.397 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.401 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 53, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.404 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:47:59.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:47:59.408 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:47:59.409 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.410 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:47:59.411 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 53, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.424 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:47:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.430 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2023-10-06T02:47:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "8.2a", 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 0, 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 6 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "8.2f", 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2023-10-06T02:47:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 0, 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 6 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:47:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:47:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:47:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:47:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:47:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:47:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:47:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:47:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:47:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.447 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4eb4066f30 msgr2=0x7f4eb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4eb4066f30 0x7f4eb40693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc002250 tx=0x7f4ecc015000 comp rx=0 tx=0).stop 2023-10-06T02:47:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed014a750 msgr2=0x7f4ed015adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed014a750 0x7f4ed015adf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0011d40 tx=0x7f4ec00091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 shutdown_connections 2023-10-06T02:47:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ed015b330 0x7f4ed0159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4eb4066f30 0x7f4eb40693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ebc003a90 0x7f4ed0147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 --2- 172.21.15.81:0/563861632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed014a750 0x7f4ed015adf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 >> 172.21.15.81:0/563861632 conn(0x7f4ed006cca0 msgr2=0x7f4ed00ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 shutdown_connections 2023-10-06T02:47:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.353+0000 7f4ed8681700 1 -- 172.21.15.81:0/563861632 wait complete. 2023-10-06T02:47:59.450 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-06T02:47:59.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:47:59.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.563+0000 7fdf5394d700 1 Processor -- start 2023-10-06T02:47:59.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.563+0000 7fdf5394d700 1 -- start start 2023-10-06T02:47:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf5394d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf4c1578d0 0x7fdf4c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf5394d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf4c157ca0 0x7fdf4c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf5394d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdf4c06d120 0x7fdf4c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf5394d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4c06dac0 con 0x7fdf4c157ca0 2023-10-06T02:47:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf5394d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4c0d07c0 con 0x7fdf4c06d120 2023-10-06T02:47:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf5394d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c0cfbb0 con 0x7fdf4c1578d0 2023-10-06T02:47:59.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf50ee8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf4c157ca0 0x7fdf4c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf50ee8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf4c157ca0 0x7fdf4c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41020/0 (socket says 172.21.15.81:41020) 2023-10-06T02:47:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf50ee8700 1 -- 172.21.15.81:0/558453215 learned_addr learned my addr 172.21.15.81:0/558453215 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf50ee8700 1 -- 172.21.15.81:0/558453215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf4c1578d0 msgr2=0x7fdf4c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf50ee8700 1 --2- 172.21.15.81:0/558453215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf4c1578d0 0x7fdf4c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf50ee8700 1 -- 172.21.15.81:0/558453215 >> v2:172.21.15.83:3300/0 conn(0x7fdf4c06d120 msgr2=0x7fdf4c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.564+0000 7fdf51eea700 1 --2- 172.21.15.81:0/558453215 >> v2:172.21.15.83:3300/0 conn(0x7fdf4c06d120 0x7fdf4c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf50ee8700 1 --2- 172.21.15.81:0/558453215 >> v2:172.21.15.83:3300/0 conn(0x7fdf4c06d120 0x7fdf4c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf50ee8700 1 -- 172.21.15.81:0/558453215 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c0cfe90 con 0x7fdf4c157ca0 2023-10-06T02:47:59.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf51eea700 1 --2- 172.21.15.81:0/558453215 >> v2:172.21.15.83:3300/0 conn(0x7fdf4c06d120 0x7fdf4c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf50ee8700 1 --2- 172.21.15.81:0/558453215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c157ca0 0x7fdf4c15af00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0b3940 tx=0x7fdf3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19127363b061e247 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf43fff700 1 -- 172.21.15.81:0/558453215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00b860 con 0x7fdf4c157ca0 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf43fff700 1 -- 172.21.15.81:0/558453215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c00b9c0 con 0x7fdf4c157ca0 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf43fff700 1 -- 172.21.15.81:0/558453215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00bd60 con 0x7fdf4c157ca0 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf5394d700 1 -- 172.21.15.81:0/558453215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c157ca0 msgr2=0x7fdf4c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf5394d700 1 --2- 172.21.15.81:0/558453215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c157ca0 0x7fdf4c15af00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0b3940 tx=0x7fdf3c009250 comp rx=0 tx=0).stop 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf5394d700 1 -- 172.21.15.81:0/558453215 shutdown_connections 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf5394d700 1 --2- 172.21.15.81:0/558453215 >> v2:172.21.15.83:3300/0 conn(0x7fdf4c06d120 0x7fdf4c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf5394d700 1 --2- 172.21.15.81:0/558453215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf4c1578d0 0x7fdf4c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf5394d700 1 --2- 172.21.15.81:0/558453215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c157ca0 0x7fdf4c15af00 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf5394d700 1 -- 172.21.15.81:0/558453215 >> 172.21.15.81:0/558453215 conn(0x7fdf4c06bb90 msgr2=0x7fdf4c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf5394d700 1 -- 172.21.15.81:0/558453215 shutdown_connections 2023-10-06T02:47:59.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.565+0000 7fdf5394d700 1 -- 172.21.15.81:0/558453215 wait complete. 2023-10-06T02:47:59.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.566+0000 7fdf5394d700 1 Processor -- start 2023-10-06T02:47:59.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.567+0000 7fdf5394d700 1 -- start start 2023-10-06T02:47:59.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.567+0000 7fdf5394d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf4c06d120 0x7fdf4c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.567+0000 7fdf5394d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c1578d0 0x7fdf4c148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.567+0000 7fdf5394d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf4c157ca0 0x7fdf4c069c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.567+0000 7fdf5394d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c15ca40 con 0x7fdf4c1578d0 2023-10-06T02:47:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.567+0000 7fdf5394d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c0c7c60 con 0x7fdf4c157ca0 2023-10-06T02:47:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.567+0000 7fdf5394d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c15be30 con 0x7fdf4c06d120 2023-10-06T02:47:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.567+0000 7fdf50ee8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c1578d0 0x7fdf4c148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf50ee8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c1578d0 0x7fdf4c148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41036/0 (socket says 172.21.15.81:41036) 2023-10-06T02:47:59.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf50ee8700 1 -- 172.21.15.81:0/1873577809 learned_addr learned my addr 172.21.15.81:0/1873577809 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf51eea700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf4c157ca0 0x7fdf4c069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf516e9700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf4c06d120 0x7fdf4c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf50ee8700 1 -- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf4c06d120 msgr2=0x7fdf4c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf50ee8700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf4c06d120 0x7fdf4c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf50ee8700 1 -- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf4c157ca0 msgr2=0x7fdf4c069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf50ee8700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf4c157ca0 0x7fdf4c069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf50ee8700 1 -- 172.21.15.81:0/1873577809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c0094f0 con 0x7fdf4c1578d0 2023-10-06T02:47:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf50ee8700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c1578d0 0x7fdf4c148720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009290 tx=0x7fdf3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf417fa700 1 -- 172.21.15.81:0/1873577809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c011e40 con 0x7fdf4c1578d0 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf417fa700 1 -- 172.21.15.81:0/1873577809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c01f070 con 0x7fdf4c1578d0 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf417fa700 1 -- 172.21.15.81:0/1873577809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0266d0 con 0x7fdf4c1578d0 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c15c110 con 0x7fdf4c1578d0 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.568+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c15c6d0 con 0x7fdf4c1578d0 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.569+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4c15cbb0 con 0x7fdf4c1578d0 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.569+0000 7fdf417fa700 1 -- 172.21.15.81:0/1873577809 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf3c026a40 con 0x7fdf4c1578d0 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.570+0000 7fdf417fa700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf30066f30 0x7fdf300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.570+0000 7fdf417fa700 1 -- 172.21.15.81:0/1873577809 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fdf3c021070 con 0x7fdf4c1578d0 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.570+0000 7fdf516e9700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf30066f30 0x7fdf300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.570+0000 7fdf516e9700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf30066f30 0x7fdf300693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009bf0 tx=0x7fdf480091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:59.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.574+0000 7fdf417fa700 1 -- 172.21.15.81:0/1873577809 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf3c053450 con 0x7fdf4c1578d0 2023-10-06T02:47:59.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.757+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fdf4c0d0170 con 0x7fdf4c1578d0 2023-10-06T02:47:59.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.758+0000 7fdf417fa700 1 -- 172.21.15.81:0/1873577809 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+35144 (secure 0 0 0) 0x7fdf3c056a70 con 0x7fdf4c1578d0 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 55, 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:47:57.585600+0000", 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:47:59.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 8, 2023-10-06T02:47:59.761 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:47:59.762 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:47:59.762 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2023-10-06T02:47:59.762 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:47:59.762 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:47:59.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.762 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:47:59.762 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:47:59.762 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:47:59.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:59.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:59.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:59.763 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:59.763 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:59.763 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:59.763 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:59.763 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:59.763 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:59.763 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:59.764 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:59.765 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:59.766 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:59.766 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:59.766 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:59.766 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:59.766 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:59.766 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:59.766 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:59.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:59.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:59.767 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:59.767 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:59.767 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:59.767 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:59.767 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:59.768 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:59.768 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:59.768 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:59.769 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:59.770 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:59.771 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:47:59.772 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:27.250251+0000", 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:47:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:59.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 8, 2023-10-06T02:47:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:47:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:47:28.083304+0000", 2023-10-06T02:47:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:47:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:47:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:47:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:47:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:47:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:47:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:47:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:47:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:47:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:47:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:47:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:47:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:47:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:47:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:47:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:47:59.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:47:59.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:47:59.804 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.805 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:47:59.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 53, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.812 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:47:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:47:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:47:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:47:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 53, 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:47:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:47:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 46, 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:47:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:47:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:47:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "8.2a", 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 0, 2023-10-06T02:47:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 6 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "8.2f", 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 0, 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 6 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:47:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:47:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:47:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:47:59.855 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:47:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf30066f30 msgr2=0x7fdf300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf30066f30 0x7fdf300693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009bf0 tx=0x7fdf480091a0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c1578d0 msgr2=0x7fdf4c148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c1578d0 0x7fdf4c148720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009290 tx=0x7fdf3c017000 comp rx=0 tx=0).stop 2023-10-06T02:47:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 shutdown_connections 2023-10-06T02:47:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf30066f30 0x7fdf300693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf4c157ca0 0x7fdf4c069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf4c06d120 0x7fdf4c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 --2- 172.21.15.81:0/1873577809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c1578d0 0x7fdf4c148720 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 >> 172.21.15.81:0/1873577809 conn(0x7fdf4c06bb90 msgr2=0x7fdf4c15a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 shutdown_connections 2023-10-06T02:47:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.760+0000 7fdf5394d700 1 -- 172.21.15.81:0/1873577809 wait complete. 2023-10-06T02:47:59.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:47:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.971+0000 7fe6c4ce8700 1 Processor -- start 2023-10-06T02:47:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.971+0000 7fe6c4ce8700 1 -- start start 2023-10-06T02:47:59.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.972+0000 7fe6c4ce8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe6c00cf240 0x7fe6c00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.972+0000 7fe6c4ce8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6c006d650 0x7fe6c006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.972+0000 7fe6c4ce8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c00b0ca0 con 0x7fe6c015a2a0 2023-10-06T02:47:59.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.972+0000 7fe6c4ce8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c006ea90 con 0x7fe6c006d650 2023-10-06T02:47:59.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.972+0000 7fe6c4ce8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c00b00d0 con 0x7fe6c00cf240 2023-10-06T02:47:59.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.972+0000 7fe6bed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6c006d650 0x7fe6c006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.972+0000 7fe6bed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6c006d650 0x7fe6c006da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41048/0 (socket says 172.21.15.81:41048) 2023-10-06T02:47:59.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.972+0000 7fe6bed9d700 1 -- 172.21.15.81:0/1583916205 learned_addr learned my addr 172.21.15.81:0/1583916205 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:59.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.972+0000 7fe6b5d9b700 1 --2- 172.21.15.81:0/1583916205 >> v2:172.21.15.83:3300/0 conn(0x7fe6c00cf240 0x7fe6c00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6bed9d700 1 -- 172.21.15.81:0/1583916205 >> v2:172.21.15.83:3300/0 conn(0x7fe6c00cf240 msgr2=0x7fe6c00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:59.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6bed9d700 1 --2- 172.21.15.81:0/1583916205 >> v2:172.21.15.83:3300/0 conn(0x7fe6c00cf240 0x7fe6c00b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6bed9d700 1 -- 172.21.15.81:0/1583916205 >> v1:172.21.15.83:6789/0 conn(0x7fe6c015a2a0 legacy=0x7fe6c00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6bed9d700 1 -- 172.21.15.81:0/1583916205 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c00b0370 con 0x7fe6c006d650 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6bed9d700 1 --2- 172.21.15.81:0/1583916205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c006d650 0x7fe6c006da20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00713b0 tx=0x7fe6b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7a47eb9827f4b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6bdd9b700 1 -- 172.21.15.81:0/1583916205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b800e070 con 0x7fe6c006d650 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6bdd9b700 1 -- 172.21.15.81:0/1583916205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b800ba10 con 0x7fe6c006d650 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6bdd9b700 1 -- 172.21.15.81:0/1583916205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80092e0 con 0x7fe6c006d650 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/1583916205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c006d650 msgr2=0x7fe6c006da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6c4ce8700 1 --2- 172.21.15.81:0/1583916205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c006d650 0x7fe6c006da20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00713b0 tx=0x7fe6b8009840 comp rx=0 tx=0).stop 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/1583916205 shutdown_connections 2023-10-06T02:47:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6c4ce8700 1 --2- 172.21.15.81:0/1583916205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c006d650 0x7fe6c006da20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6c4ce8700 1 --2- 172.21.15.81:0/1583916205 >> v2:172.21.15.83:3300/0 conn(0x7fe6c00cf240 0x7fe6c00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.973+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/1583916205 >> 172.21.15.81:0/1583916205 conn(0x7fe6c0067640 msgr2=0x7fe6c0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:47:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.974+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/1583916205 shutdown_connections 2023-10-06T02:47:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.974+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/1583916205 wait complete. 2023-10-06T02:47:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.975+0000 7fe6c4ce8700 1 Processor -- start 2023-10-06T02:47:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.975+0000 7fe6c4ce8700 1 -- start start 2023-10-06T02:47:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.975+0000 7fe6c4ce8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6c006d650 0x7fe6c00b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.975+0000 7fe6c4ce8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c00cf240 0x7fe6c015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.975+0000 7fe6c4ce8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c015a2a0 0x7fe6c015f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.975+0000 7fe6c4ce8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00b4b80 con 0x7fe6c015a2a0 2023-10-06T02:47:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.975+0000 7fe6c4ce8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c015fa70 con 0x7fe6c00cf240 2023-10-06T02:47:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.975+0000 7fe6c4ce8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c016b040 con 0x7fe6c006d650 2023-10-06T02:47:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6bed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c015a2a0 0x7fe6c015f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6bed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c015a2a0 0x7fe6c015f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41062/0 (socket says 172.21.15.81:41062) 2023-10-06T02:47:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6bed9d700 1 -- 172.21.15.81:0/797738145 learned_addr learned my addr 172.21.15.81:0/797738145 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:47:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6b5d9b700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c00cf240 0x7fe6c015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6be59c700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6c006d650 0x7fe6c00b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6bed9d700 1 -- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6c006d650 msgr2=0x7fe6c00b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6bed9d700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6c006d650 0x7fe6c00b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6bed9d700 1 -- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c00cf240 msgr2=0x7fe6c015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:47:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6bed9d700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c00cf240 0x7fe6c015eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:47:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6bed9d700 1 -- 172.21.15.81:0/797738145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8009ae0 con 0x7fe6c015a2a0 2023-10-06T02:47:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6bed9d700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c015a2a0 0x7fe6c015f530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009880 tx=0x7fe6b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6b6ffd700 1 -- 172.21.15.81:0/797738145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8012e60 con 0x7fe6c015a2a0 2023-10-06T02:47:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6b6ffd700 1 -- 172.21.15.81:0/797738145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b80092e0 con 0x7fe6c015a2a0 2023-10-06T02:47:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c016a710 con 0x7fe6c015a2a0 2023-10-06T02:47:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6b6ffd700 1 -- 172.21.15.81:0/797738145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b801d670 con 0x7fe6c015a2a0 2023-10-06T02:47:59.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.976+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c016acd0 con 0x7fe6c015a2a0 2023-10-06T02:47:59.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.977+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c0069e40 con 0x7fe6c015a2a0 2023-10-06T02:47:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.978+0000 7fe6b6ffd700 1 -- 172.21.15.81:0/797738145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6b801da60 con 0x7fe6c015a2a0 2023-10-06T02:47:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.978+0000 7fe6b6ffd700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6a0066f30 0x7fe6a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:47:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.978+0000 7fe6b6ffd700 1 -- 172.21.15.81:0/797738145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe6b8086030 con 0x7fe6c015a2a0 2023-10-06T02:47:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.978+0000 7fe6be59c700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6a0066f30 0x7fe6a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:47:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.979+0000 7fe6be59c700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6a0066f30 0x7fe6a00693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000a8a0 tx=0x7fe6b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:47:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:47:59.982+0000 7fe6b6ffd700 1 -- 172.21.15.81:0/797738145 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6b8053100 con 0x7fe6c015a2a0 2023-10-06T02:48:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.206+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6c016b180 con 0x7fe6c015a2a0 2023-10-06T02:48:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.207+0000 7fe6b6ffd700 1 -- 172.21.15.81:0/797738145 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fe6b8056720 con 0x7fe6c015a2a0 2023-10-06T02:48:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:00.208 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:47:29.117013+0000","modified":"2023-10-06T02:47:32.768965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2380710039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2380710039},{"type":"v1","addr":"172.21.15.81:6835","nonce":2380710039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:48:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6a0066f30 msgr2=0x7fe6a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6a0066f30 0x7fe6a00693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000a8a0 tx=0x7fe6b0008040 comp rx=0 tx=0).stop 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c015a2a0 msgr2=0x7fe6c015f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c015a2a0 0x7fe6c015f530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009880 tx=0x7fe6b8017000 comp rx=0 tx=0).stop 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 shutdown_connections 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c015a2a0 0x7fe6c015f530 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6c006d650 0x7fe6c00b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6a0066f30 0x7fe6a00693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 --2- 172.21.15.81:0/797738145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c00cf240 0x7fe6c015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 >> 172.21.15.81:0/797738145 conn(0x7fe6c0067640 msgr2=0x7fe6c0157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 shutdown_connections 2023-10-06T02:48:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.209+0000 7fe6c4ce8700 1 -- 172.21.15.81:0/797738145 wait complete. 2023-10-06T02:48:00.212 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T02:48:00.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:48:00.355 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":5433,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":30.595487582000001,"mdsmap_epoch":25,"osdmap_epoch":55,"osdmap_epoch_barrier":51,"uptime":36.585118350000002} 2023-10-06T02:48:00.355 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 5433, "mdsmap_epoch": 25, "osdmap_epoch": 55, "osdmap_epoch_barrier": 51, "rank_uptime": 30.595487582, "state": "up:active", "uptime": 36.58511835, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:48:00.356 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:48:00.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:48:00.356 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-06T02:48:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-06T02:48:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-06T02:48:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.249349 s, 210 MB/s 2023-10-06T02:48:00.623 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:48:00.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:48:00.664 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:48:00.699 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:48:00.699 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:48:00.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:48:00.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:48:00.765 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:48:00.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:00.765 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:48:00.788 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:48:00.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:48:00.788 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:48:00.826 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:48:00.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:00.826 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:48:00.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.992+0000 7f1e88032700 1 Processor -- start 2023-10-06T02:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.992+0000 7f1e88032700 1 -- start start 2023-10-06T02:48:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e88032700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e801578d0 0x7f1e800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e88032700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8006d120 0x7f1e8006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e88032700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e800d07c0 con 0x7f1e80157ca0 2023-10-06T02:48:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e88032700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8006daa0 con 0x7f1e801578d0 2023-10-06T02:48:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e88032700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800cfbb0 con 0x7f1e8006d120 2023-10-06T02:48:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e85dce700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e801578d0 0x7f1e800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e855cd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1e80157ca0 0x7f1e8015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47010/0 (socket says 172.21.15.81:47010) 2023-10-06T02:48:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e855cd700 1 -- 172.21.15.81:0/2494036606 learned_addr learned my addr 172.21.15.81:0/2494036606 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e865cf700 1 --2- 172.21.15.81:0/2494036606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8006d120 0x7f1e8006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e85dce700 1 -- 172.21.15.81:0/2494036606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8006d120 msgr2=0x7f1e8006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e85dce700 1 --2- 172.21.15.81:0/2494036606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8006d120 0x7f1e8006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e85dce700 1 -- 172.21.15.81:0/2494036606 >> v1:172.21.15.81:6789/0 conn(0x7f1e80157ca0 legacy=0x7f1e8015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e85dce700 1 -- 172.21.15.81:0/2494036606 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800cfe90 con 0x7f1e801578d0 2023-10-06T02:48:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e85dce700 1 --2- 172.21.15.81:0/2494036606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 0x7f1e800cf4f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0098e0 tx=0x7f1e7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faea7ed286b85b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e84dcc700 1 -- 172.21.15.81:0/2494036606 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c009e80 con 0x7f1e801578d0 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e84dcc700 1 -- 172.21.15.81:0/2494036606 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c00b860 con 0x7f1e801578d0 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.993+0000 7f1e84dcc700 1 -- 172.21.15.81:0/2494036606 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00bbe0 con 0x7f1e801578d0 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.994+0000 7f1e88032700 1 -- 172.21.15.81:0/2494036606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 msgr2=0x7f1e800cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.994+0000 7f1e88032700 1 --2- 172.21.15.81:0/2494036606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 0x7f1e800cf4f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0098e0 tx=0x7f1e7c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.994+0000 7f1e88032700 1 -- 172.21.15.81:0/2494036606 shutdown_connections 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.994+0000 7f1e88032700 1 --2- 172.21.15.81:0/2494036606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e8006d120 0x7f1e8006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.994+0000 7f1e88032700 1 --2- 172.21.15.81:0/2494036606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 0x7f1e800cf4f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.994+0000 7f1e88032700 1 -- 172.21.15.81:0/2494036606 >> 172.21.15.81:0/2494036606 conn(0x7f1e8006bb90 msgr2=0x7f1e8006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.994+0000 7f1e88032700 1 -- 172.21.15.81:0/2494036606 shutdown_connections 2023-10-06T02:48:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.994+0000 7f1e88032700 1 -- 172.21.15.81:0/2494036606 wait complete. 2023-10-06T02:48:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.995+0000 7f1e88032700 1 Processor -- start 2023-10-06T02:48:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.995+0000 7f1e88032700 1 -- start start 2023-10-06T02:48:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e88032700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8006d120 0x7f1e801596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e88032700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 0x7f1e800ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e88032700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e80157ca0 0x7f1e800adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e88032700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800ab9c0 con 0x7f1e801578d0 2023-10-06T02:48:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e88032700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800acee0 con 0x7f1e8006d120 2023-10-06T02:48:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e88032700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800ac7d0 con 0x7f1e80157ca0 2023-10-06T02:48:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e855cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 0x7f1e800ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e855cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 0x7f1e800ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56312/0 (socket says 172.21.15.81:56312) 2023-10-06T02:48:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e855cd700 1 -- 172.21.15.81:0/3590338933 learned_addr learned my addr 172.21.15.81:0/3590338933 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e865cf700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e80157ca0 0x7f1e800adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e85dce700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8006d120 0x7f1e801596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e855cd700 1 -- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e80157ca0 msgr2=0x7f1e800adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e855cd700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e80157ca0 0x7f1e800adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e855cd700 1 -- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8006d120 msgr2=0x7f1e801596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e855cd700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8006d120 0x7f1e801596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e855cd700 1 -- 172.21.15.81:0/3590338933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c009420 con 0x7f1e801578d0 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e855cd700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 0x7f1e800ad6a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000c590 tx=0x7f1e70001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e75ffb700 1 -- 172.21.15.81:0/3590338933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70005b30 con 0x7f1e801578d0 2023-10-06T02:48:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e75ffb700 1 -- 172.21.15.81:0/3590338933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70005cb0 con 0x7f1e801578d0 2023-10-06T02:48:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e800ab400 con 0x7f1e801578d0 2023-10-06T02:48:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.996+0000 7f1e75ffb700 1 -- 172.21.15.81:0/3590338933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70007320 con 0x7f1e801578d0 2023-10-06T02:48:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.997+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e800ad180 con 0x7f1e801578d0 2023-10-06T02:48:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.997+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e800ad3a0 con 0x7f1e801578d0 2023-10-06T02:48:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.998+0000 7f1e75ffb700 1 -- 172.21.15.81:0/3590338933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e7001b3b0 con 0x7f1e801578d0 2023-10-06T02:48:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.998+0000 7f1e75ffb700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.998+0000 7f1e75ffb700 1 -- 172.21.15.81:0/3590338933 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1e70083a20 con 0x7f1e801578d0 2023-10-06T02:48:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.998+0000 7f1e85dce700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:00.999+0000 7f1e85dce700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0091e0 tx=0x7f1e7c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.002+0000 7f1e75ffb700 1 -- 172.21.15.81:0/3590338933 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e70050af0 con 0x7f1e801578d0 2023-10-06T02:48:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.224+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e800d0170 con 0x7f1e801578d0 2023-10-06T02:48:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.224+0000 7f1e75ffb700 1 -- 172.21.15.81:0/3590338933 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f1e70017090 con 0x7f1e801578d0 2023-10-06T02:48:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:01.226 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:47:29.117013+0000","modified":"2023-10-06T02:47:32.768965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2380710039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2380710039},{"type":"v1","addr":"172.21.15.81:6835","nonce":2380710039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:48:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 msgr2=0x7f1e640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0091e0 tx=0x7f1e7c017000 comp rx=0 tx=0).stop 2023-10-06T02:48:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 msgr2=0x7f1e800ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 0x7f1e800ad6a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000c590 tx=0x7f1e70001020 comp rx=0 tx=0).stop 2023-10-06T02:48:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 shutdown_connections 2023-10-06T02:48:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e80157ca0 0x7f1e800adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e8006d120 0x7f1e801596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 --2- 172.21.15.81:0/3590338933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e801578d0 0x7f1e800ad6a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 >> 172.21.15.81:0/3590338933 conn(0x7f1e8006bb90 msgr2=0x7f1e800697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 shutdown_connections 2023-10-06T02:48:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.226+0000 7f1e88032700 1 -- 172.21.15.81:0/3590338933 wait complete. 2023-10-06T02:48:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T02:48:01.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:48:01.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.351+0000 7f1d0dc6d700 1 Processor -- start 2023-10-06T02:48:01.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.351+0000 7f1d0dc6d700 1 -- start start 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d0dc6d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1d08157ca0 0x7f1d080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d0dc6d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0806d120 0x7f1d0806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d0dc6d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d080d07c0 con 0x7f1d081578d0 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d0dc6d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0806daa0 con 0x7f1d08157ca0 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d0dc6d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080cfbb0 con 0x7f1d0806d120 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d077fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1d081578d0 0x7f1d0815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47026/0 (socket says 172.21.15.81:47026) 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d077fe700 1 -- 172.21.15.81:0/3425100095 learned_addr learned my addr 172.21.15.81:0/3425100095 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d07fff700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0806d120 0x7f1d0806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d06ffd700 1 --2- 172.21.15.81:0/3425100095 >> v2:172.21.15.83:3300/0 conn(0x7f1d08157ca0 0x7f1d080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967905509 0 0) 0x7f1d080d07c0 con 0x7f1d081578d0 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.352+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf0003570 con 0x7f1d081578d0 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621310395 0 0) 0x7f1cf0003570 con 0x7f1d081578d0 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0806d120 msgr2=0x7f1d0806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0806d120 0x7f1d0806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 >> v2:172.21.15.83:3300/0 conn(0x7f1d08157ca0 msgr2=0x7f1d080cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 --2- 172.21.15.81:0/3425100095 >> v2:172.21.15.83:3300/0 conn(0x7f1d08157ca0 0x7f1d080cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080cfe90 con 0x7f1d081578d0 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f1cf80017f0 con 0x7f1d081578d0 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 >> v1:172.21.15.81:6789/0 conn(0x7f1d081578d0 legacy=0x7f1d0815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0003a60 0x7f1cf0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cf0004810 0x7f1cf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1cf000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0806daa0 con 0x7f1cf00051c0 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080cfbb0 con 0x7f1cf0004810 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf000bfa0 con 0x7f1cf0003a60 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d07fff700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0806d120 0x7f1d0806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d06ffd700 1 --2- 172.21.15.81:0/3425100095 >> v2:172.21.15.83:3300/0 conn(0x7f1d08157ca0 0x7f1d080cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d07fff700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1cf000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d077fe700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0003a60 0x7f1cf0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d06ffd700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cf0004810 0x7f1cf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d07fff700 1 -- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0003a60 msgr2=0x7f1cf0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d07fff700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0003a60 0x7f1cf0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d07fff700 1 -- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cf0004810 msgr2=0x7f1cf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:01.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d07fff700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cf0004810 0x7f1cf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d07fff700 1 -- 172.21.15.81:0/3425100095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf0003570 con 0x7f1cf00051c0 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d07fff700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1cf000ba60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1d0806d4f0 tx=0x7f1d000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20f09960a444160 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000e710 con 0x7f1cf00051c0 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0000e870 con 0x7f1cf00051c0 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.353+0000 7f1d067fc700 1 -- 172.21.15.81:0/3425100095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000ec10 con 0x7f1cf00051c0 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.354+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/3425100095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 msgr2=0x7f1cf000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.354+0000 7f1d0dc6d700 1 --2- 172.21.15.81:0/3425100095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1cf000ba60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1d0806d4f0 tx=0x7f1d000091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.354+0000 7f1d07fff700 1 -- 172.21.15.81:0/3425100095 reap_dead start 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.354+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/3425100095 shutdown_connections 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.354+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/3425100095 >> 172.21.15.81:0/3425100095 conn(0x7f1d0806bb90 msgr2=0x7f1d0806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.354+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/3425100095 shutdown_connections 2023-10-06T02:48:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.354+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/3425100095 wait complete. 2023-10-06T02:48:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.355+0000 7f1d0dc6d700 1 Processor -- start 2023-10-06T02:48:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.355+0000 7f1d0dc6d700 1 -- start start 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d0dc6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1d080c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d0dc6d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d080c6f10 0x7f1d080cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d0dc6d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0815ba60 0x7f1d08153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d0dc6d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080c5bc0 con 0x7f1cf00051c0 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d0dc6d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080c8f90 con 0x7f1d080c6f10 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d0dc6d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080cb5b0 con 0x7f1d0815ba60 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1d080c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1d080c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56326/0 (socket says 172.21.15.81:56326) 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d077fe700 1 -- 172.21.15.81:0/1167107242 learned_addr learned my addr 172.21.15.81:0/1167107242 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d06ffd700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d080c6f10 0x7f1d080cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d07fff700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0815ba60 0x7f1d08153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d077fe700 1 -- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0815ba60 msgr2=0x7f1d08153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d077fe700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0815ba60 0x7f1d08153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d077fe700 1 -- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d080c6f10 msgr2=0x7f1d080cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d077fe700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d080c6f10 0x7f1d080cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d077fe700 1 -- 172.21.15.81:0/1167107242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080c9230 con 0x7f1cf00051c0 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d07fff700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0815ba60 0x7f1d08153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.356+0000 7f1d077fe700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1d080c8a50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8007bc0 tx=0x7f1d080d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.357+0000 7f1cef7fe700 1 -- 172.21.15.81:0/1167107242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800ae80 con 0x7f1cf00051c0 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.357+0000 7f1cef7fe700 1 -- 172.21.15.81:0/1167107242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf80133f0 con 0x7f1cf00051c0 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.357+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d080c9510 con 0x7f1cf00051c0 2023-10-06T02:48:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.357+0000 7f1cef7fe700 1 -- 172.21.15.81:0/1167107242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80137b0 con 0x7f1cf00051c0 2023-10-06T02:48:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.357+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d080c9ad0 con 0x7f1cf00051c0 2023-10-06T02:48:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.358+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d08067ac0 con 0x7f1cf00051c0 2023-10-06T02:48:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.358+0000 7f1cef7fe700 1 -- 172.21.15.81:0/1167107242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cf8013b60 con 0x7f1cf00051c0 2023-10-06T02:48:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.358+0000 7f1cef7fe700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cf4066f30 0x7f1cf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.358+0000 7f1cef7fe700 1 -- 172.21.15.81:0/1167107242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1cf80854f0 con 0x7f1cf00051c0 2023-10-06T02:48:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.358+0000 7f1d06ffd700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cf4066f30 0x7f1cf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.359+0000 7f1d06ffd700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cf4066f30 0x7f1cf40693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d0815c640 tx=0x7f1cfc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.362+0000 7f1cef7fe700 1 -- 172.21.15.81:0/1167107242 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cf80525c0 con 0x7f1cf00051c0 2023-10-06T02:48:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.548+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d080d0170 con 0x7f1cf00051c0 2023-10-06T02:48:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.549+0000 7f1cef7fe700 1 -- 172.21.15.81:0/1167107242 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f1cf8055be0 con 0x7f1cf00051c0 2023-10-06T02:48:01.551 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:01.551 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:57.585600+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:47:27.250251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:47:28.083304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cf4066f30 msgr2=0x7f1cf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cf4066f30 0x7f1cf40693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d0815c640 tx=0x7f1cfc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 msgr2=0x7f1d080c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1d080c8a50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8007bc0 tx=0x7f1d080d0730 comp rx=0 tx=0).stop 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 shutdown_connections 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d0815ba60 0x7f1d08153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf00051c0 0x7f1d080c8a50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cf4066f30 0x7f1cf40693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 --2- 172.21.15.81:0/1167107242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d080c6f10 0x7f1d080cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 >> 172.21.15.81:0/1167107242 conn(0x7f1d0806bb90 msgr2=0x7f1d08069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 shutdown_connections 2023-10-06T02:48:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.551+0000 7f1d0dc6d700 1 -- 172.21.15.81:0/1167107242 wait complete. 2023-10-06T02:48:01.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:47:27.250251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:47:28.083304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:48:01.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:48:01.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:48:01.596+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2023-10-06T02:48:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.682+0000 7ff7ab10e700 1 Processor -- start 2023-10-06T02:48:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.682+0000 7ff7ab10e700 1 -- start start 2023-10-06T02:48:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7ab10e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7a41578d0 0x7ff7a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7ab10e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7a406d120 0x7ff7a406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7ab10e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a406dac0 con 0x7ff7a4157ca0 2023-10-06T02:48:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7ab10e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a40d07c0 con 0x7ff7a406d120 2023-10-06T02:48:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7ab10e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40cfbb0 con 0x7ff7a41578d0 2023-10-06T02:48:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a96ab700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7a406d120 0x7ff7a406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a96ab700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7a406d120 0x7ff7a406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56340/0 (socket says 172.21.15.81:56340) 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a96ab700 1 -- 172.21.15.81:0/2071795969 learned_addr learned my addr 172.21.15.81:0/2071795969 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a8eaa700 1 --2- 172.21.15.81:0/2071795969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7a41578d0 0x7ff7a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a96ab700 1 -- 172.21.15.81:0/2071795969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7a41578d0 msgr2=0x7ff7a40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a96ab700 1 --2- 172.21.15.81:0/2071795969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7a41578d0 0x7ff7a40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a96ab700 1 -- 172.21.15.81:0/2071795969 >> v1:172.21.15.83:6789/0 conn(0x7ff7a4157ca0 legacy=0x7ff7a415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a96ab700 1 -- 172.21.15.81:0/2071795969 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a40cfe90 con 0x7ff7a406d120 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a96ab700 1 --2- 172.21.15.81:0/2071795969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 0x7ff7a406d580 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009f20 tx=0x7ff79c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ff93b35a76ea2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a37fe700 1 -- 172.21.15.81:0/2071795969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00e070 con 0x7ff7a406d120 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a37fe700 1 -- 172.21.15.81:0/2071795969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c00b9d0 con 0x7ff7a406d120 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.683+0000 7ff7a37fe700 1 -- 172.21.15.81:0/2071795969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0092e0 con 0x7ff7a406d120 2023-10-06T02:48:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.684+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2071795969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 msgr2=0x7ff7a406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.684+0000 7ff7ab10e700 1 --2- 172.21.15.81:0/2071795969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 0x7ff7a406d580 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009f20 tx=0x7ff79c009840 comp rx=0 tx=0).stop 2023-10-06T02:48:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.684+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2071795969 shutdown_connections 2023-10-06T02:48:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.684+0000 7ff7ab10e700 1 --2- 172.21.15.81:0/2071795969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 0x7ff7a406d580 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.684+0000 7ff7ab10e700 1 --2- 172.21.15.81:0/2071795969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7a41578d0 0x7ff7a40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.684+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2071795969 >> 172.21.15.81:0/2071795969 conn(0x7ff7a406bb90 msgr2=0x7ff7a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.684+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2071795969 shutdown_connections 2023-10-06T02:48:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.684+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2071795969 wait complete. 2023-10-06T02:48:01.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.685+0000 7ff7ab10e700 1 Processor -- start 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.685+0000 7ff7ab10e700 1 -- start start 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7ab10e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 0x7ff7a416d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7ab10e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7a41578d0 0x7ff7a416a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7ab10e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7a4157ca0 0x7ff7a40c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7ab10e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40b3ba0 con 0x7ff7a406d120 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7ab10e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40b3df0 con 0x7ff7a4157ca0 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7ab10e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40b40d0 con 0x7ff7a41578d0 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a8eaa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 0x7ff7a416d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a8eaa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 0x7ff7a416d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56342/0 (socket says 172.21.15.81:56342) 2023-10-06T02:48:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a8eaa700 1 -- 172.21.15.81:0/2458834717 learned_addr learned my addr 172.21.15.81:0/2458834717 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a8eaa700 1 -- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7a41578d0 msgr2=0x7ff7a416a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a8eaa700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7a41578d0 0x7ff7a416a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a8eaa700 1 -- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7a4157ca0 msgr2=0x7ff7a40c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a8eaa700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7a4157ca0 0x7ff7a40c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a8eaa700 1 -- 172.21.15.81:0/2458834717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c009ae0 con 0x7ff7a406d120 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a8eaa700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 0x7ff7a416d2e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff79800ec80 tx=0x7ff7980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a0ff9700 1 -- 172.21.15.81:0/2458834717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79800c9d0 con 0x7ff7a406d120 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a0ff9700 1 -- 172.21.15.81:0/2458834717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79800cb30 con 0x7ff7a406d120 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a40b43b0 con 0x7ff7a406d120 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.686+0000 7ff7a0ff9700 1 -- 172.21.15.81:0/2458834717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798013470 con 0x7ff7a406d120 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.687+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a40b6580 con 0x7ff7a406d120 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.687+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a4067ac0 con 0x7ff7a406d120 2023-10-06T02:48:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.688+0000 7ff7a0ff9700 1 -- 172.21.15.81:0/2458834717 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff798013820 con 0x7ff7a406d120 2023-10-06T02:48:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.688+0000 7ff7a0ff9700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff788066f30 0x7ff7880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.688+0000 7ff7a0ff9700 1 -- 172.21.15.81:0/2458834717 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff798084a40 con 0x7ff7a406d120 2023-10-06T02:48:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.688+0000 7ff7a3fff700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff788066f30 0x7ff7880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.689+0000 7ff7a3fff700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff788066f30 0x7ff7880693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff7a415cce0 tx=0x7ff790007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.692+0000 7ff7a0ff9700 1 -- 172.21.15.81:0/2458834717 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff798086e60 con 0x7ff7a406d120 2023-10-06T02:48:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.875+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7a40d0170 con 0x7ff7a406d120 2023-10-06T02:48:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.875+0000 7ff7a0ff9700 1 -- 172.21.15.81:0/2458834717 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff798051b10 con 0x7ff7a406d120 2023-10-06T02:48:01.876 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:48:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff788066f30 msgr2=0x7ff7880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff788066f30 0x7ff7880693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff7a415cce0 tx=0x7ff790007b40 comp rx=0 tx=0).stop 2023-10-06T02:48:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 msgr2=0x7ff7a416d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 0x7ff7a416d2e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff79800ec80 tx=0x7ff7980091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 shutdown_connections 2023-10-06T02:48:01.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff788066f30 0x7ff7880693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7a4157ca0 0x7ff7a40c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a406d120 0x7ff7a416d2e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 --2- 172.21.15.81:0/2458834717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7a41578d0 0x7ff7a416a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:01.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 >> 172.21.15.81:0/2458834717 conn(0x7ff7a406bb90 msgr2=0x7ff7a40699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:01.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 shutdown_connections 2023-10-06T02:48:01.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:01.877+0000 7ff7ab10e700 1 -- 172.21.15.81:0/2458834717 wait complete. 2023-10-06T02:48:01.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:48:02.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.048+0000 7fe9cc857700 1 Processor -- start 2023-10-06T02:48:02.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.048+0000 7fe9cc857700 1 -- start start 2023-10-06T02:48:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9cc857700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0b80 0x7fe9c80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9cc857700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe9c80d02b0 0x7fe9c806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9cc857700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9c80d0f50 0x7fe9c806d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9cc857700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c815a690 con 0x7fe9c80d0f50 2023-10-06T02:48:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9cc857700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c80cf2d0 con 0x7fe9c80d02b0 2023-10-06T02:48:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9cc857700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c806dc00 con 0x7fe9c80d0b80 2023-10-06T02:48:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9c80d0f50 0x7fe9c806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9c80d0f50 0x7fe9c806d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56358/0 (socket says 172.21.15.81:56358) 2023-10-06T02:48:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c759e700 1 -- 172.21.15.81:0/2110313314 learned_addr learned my addr 172.21.15.81:0/2110313314 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c6d9d700 1 --2- 172.21.15.81:0/2110313314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0b80 0x7fe9c80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9be59c700 1 --2- 172.21.15.81:0/2110313314 >> v2:172.21.15.83:3300/0 conn(0x7fe9c80d02b0 0x7fe9c806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c759e700 1 -- 172.21.15.81:0/2110313314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0b80 msgr2=0x7fe9c80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c759e700 1 --2- 172.21.15.81:0/2110313314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0b80 0x7fe9c80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c759e700 1 -- 172.21.15.81:0/2110313314 >> v2:172.21.15.83:3300/0 conn(0x7fe9c80d02b0 msgr2=0x7fe9c806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c759e700 1 --2- 172.21.15.81:0/2110313314 >> v2:172.21.15.83:3300/0 conn(0x7fe9c80d02b0 0x7fe9c806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c759e700 1 -- 172.21.15.81:0/2110313314 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c80cf570 con 0x7fe9c80d0f50 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c6d9d700 1 --2- 172.21.15.81:0/2110313314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0b80 0x7fe9c80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9be59c700 1 --2- 172.21.15.81:0/2110313314 >> v2:172.21.15.83:3300/0 conn(0x7fe9c80d02b0 0x7fe9c806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c759e700 1 --2- 172.21.15.81:0/2110313314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0f50 0x7fe9c806d530 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe9c806e810 tx=0x7fe9c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ca65d72ca03116 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c659c700 1 -- 172.21.15.81:0/2110313314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000b860 con 0x7fe9c80d0f50 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c659c700 1 -- 172.21.15.81:0/2110313314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c000b9c0 con 0x7fe9c80d0f50 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.049+0000 7fe9c659c700 1 -- 172.21.15.81:0/2110313314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000bd60 con 0x7fe9c80d0f50 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.050+0000 7fe9cc857700 1 -- 172.21.15.81:0/2110313314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0f50 msgr2=0x7fe9c806d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.050+0000 7fe9cc857700 1 --2- 172.21.15.81:0/2110313314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0f50 0x7fe9c806d530 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe9c806e810 tx=0x7fe9c0009250 comp rx=0 tx=0).stop 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.050+0000 7fe9cc857700 1 -- 172.21.15.81:0/2110313314 shutdown_connections 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.050+0000 7fe9cc857700 1 --2- 172.21.15.81:0/2110313314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0f50 0x7fe9c806d530 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.050+0000 7fe9cc857700 1 --2- 172.21.15.81:0/2110313314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0b80 0x7fe9c80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.050+0000 7fe9cc857700 1 --2- 172.21.15.81:0/2110313314 >> v2:172.21.15.83:3300/0 conn(0x7fe9c80d02b0 0x7fe9c806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.050+0000 7fe9cc857700 1 -- 172.21.15.81:0/2110313314 >> 172.21.15.81:0/2110313314 conn(0x7fe9c8063230 msgr2=0x7fe9c8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.050+0000 7fe9cc857700 1 -- 172.21.15.81:0/2110313314 shutdown_connections 2023-10-06T02:48:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.050+0000 7fe9cc857700 1 -- 172.21.15.81:0/2110313314 wait complete. 2023-10-06T02:48:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.051+0000 7fe9cc857700 1 Processor -- start 2023-10-06T02:48:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.051+0000 7fe9cc857700 1 -- start start 2023-10-06T02:48:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9cc857700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9c80d02b0 0x7fe9c8144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9cc857700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0b80 0x7fe9c815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9cc857700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0f50 0x7fe9c815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9cc857700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80c6af0 con 0x7fe9c80d0b80 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9cc857700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80c7350 con 0x7fe9c80d02b0 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9cc857700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c81452c0 con 0x7fe9c80d0f50 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0b80 0x7fe9c815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0b80 0x7fe9c815c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56364/0 (socket says 172.21.15.81:56364) 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9be59c700 1 -- 172.21.15.81:0/99273187 learned_addr learned my addr 172.21.15.81:0/99273187 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9c6d9d700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9c80d02b0 0x7fe9c8144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9c759e700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0f50 0x7fe9c815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9be59c700 1 -- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0f50 msgr2=0x7fe9c815c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9be59c700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0f50 0x7fe9c815c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9be59c700 1 -- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9c80d02b0 msgr2=0x7fe9c8144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9be59c700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9c80d02b0 0x7fe9c8144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9be59c700 1 -- 172.21.15.81:0/99273187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00094f0 con 0x7fe9c80d0b80 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.052+0000 7fe9c759e700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0f50 0x7fe9c815c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.053+0000 7fe9be59c700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0b80 0x7fe9c815c4b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000e8d0 tx=0x7fe9b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.053+0000 7fe9bf7fe700 1 -- 172.21.15.81:0/99273187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0013410 con 0x7fe9c80d0b80 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.053+0000 7fe9bf7fe700 1 -- 172.21.15.81:0/99273187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b0013570 con 0x7fe9c80d0b80 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.053+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c816add0 con 0x7fe9c80d0b80 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.053+0000 7fe9bf7fe700 1 -- 172.21.15.81:0/99273187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0013910 con 0x7fe9c80d0b80 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.053+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c80c6fe0 con 0x7fe9c80d0b80 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.054+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c80c74e0 con 0x7fe9c80d0b80 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.054+0000 7fe9bf7fe700 1 -- 172.21.15.81:0/99273187 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9b0013d00 con 0x7fe9c80d0b80 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.054+0000 7fe9bf7fe700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9a8066f30 0x7fe9a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.055+0000 7fe9bf7fe700 1 -- 172.21.15.81:0/99273187 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe9b0084440 con 0x7fe9c80d0b80 2023-10-06T02:48:02.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.055+0000 7fe9c6d9d700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9a8066f30 0x7fe9a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.055+0000 7fe9c6d9d700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9a8066f30 0x7fe9a80693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80d1af0 tx=0x7fe9b8009960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:02.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.059+0000 7fe9bf7fe700 1 -- 172.21.15.81:0/99273187 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9b0051510 con 0x7fe9c80d0b80 2023-10-06T02:48:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.239+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9c80676e0 con 0x7fe9c80d0b80 2023-10-06T02:48:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.239+0000 7fe9bf7fe700 1 -- 172.21.15.81:0/99273187 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9b0054b30 con 0x7fe9c80d0b80 2023-10-06T02:48:02.240 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:48:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9a8066f30 msgr2=0x7fe9a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9a8066f30 0x7fe9a80693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80d1af0 tx=0x7fe9b8009960 comp rx=0 tx=0).stop 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0b80 msgr2=0x7fe9c815c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0b80 0x7fe9c815c4b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000e8d0 tx=0x7fe9b0008040 comp rx=0 tx=0).stop 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 shutdown_connections 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9c80d0f50 0x7fe9c815c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe9a8066f30 0x7fe9a80693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9c80d02b0 0x7fe9c8144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 --2- 172.21.15.81:0/99273187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d0b80 0x7fe9c815c4b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 >> 172.21.15.81:0/99273187 conn(0x7fe9c8063230 msgr2=0x7fe9c8069450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 shutdown_connections 2023-10-06T02:48:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.241+0000 7fe9cc857700 1 -- 172.21.15.81:0/99273187 wait complete. 2023-10-06T02:48:02.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:48:02.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.368+0000 7f0513508700 1 Processor -- start 2023-10-06T02:48:02.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.369+0000 7f0513508700 1 -- start start 2023-10-06T02:48:02.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.369+0000 7f0513508700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 0x7f050c0c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.369+0000 7f0513508700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c06aae0 con 0x7f050c0af270 2023-10-06T02:48:02.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.369+0000 7f0513508700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c069ed0 con 0x7f050c0c8410 2023-10-06T02:48:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.369+0000 7f0513508700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c06a1b0 con 0x7f050c0aeea0 2023-10-06T02:48:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f0510aa3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f050c0af270 0x7f050c0c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47030/0 (socket says 172.21.15.81:47030) 2023-10-06T02:48:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f0510aa3700 1 -- 172.21.15.81:0/768355622 learned_addr learned my addr 172.21.15.81:0/768355622 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f05112a4700 1 --2- 172.21.15.81:0/768355622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 0x7f050c0c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f0503fff700 1 -- 172.21.15.81:0/768355622 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479442426 0 0) 0x7f050c06aae0 con 0x7f050c0af270 2023-10-06T02:48:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f0503fff700 1 -- 172.21.15.81:0/768355622 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f8003570 con 0x7f050c0af270 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f0503fff700 1 -- 172.21.15.81:0/768355622 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895537288 0 0) 0x7f050c069ed0 con 0x7f050c0c8410 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f0503fff700 1 -- 172.21.15.81:0/768355622 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c06aae0 con 0x7f050c0c8410 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f05112a4700 1 -- 172.21.15.81:0/768355622 >> v1:172.21.15.83:6789/0 conn(0x7f050c0c8410 legacy=0x7f050c0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f05112a4700 1 -- 172.21.15.81:0/768355622 >> v1:172.21.15.81:6789/0 conn(0x7f050c0af270 legacy=0x7f050c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f05112a4700 1 -- 172.21.15.81:0/768355622 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c06a490 con 0x7f050c0aeea0 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f05112a4700 1 --2- 172.21.15.81:0/768355622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 0x7f050c0c2920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0508009e90 tx=0x7f0508009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5efaab7c3a37af83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f0503fff700 1 -- 172.21.15.81:0/768355622 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050800e070 con 0x7f050c0aeea0 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f0503fff700 1 -- 172.21.15.81:0/768355622 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050800bc10 con 0x7f050c0aeea0 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.370+0000 7f0503fff700 1 -- 172.21.15.81:0/768355622 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508012430 con 0x7f050c0aeea0 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.371+0000 7f0513508700 1 -- 172.21.15.81:0/768355622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 msgr2=0x7f050c0c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.371+0000 7f0513508700 1 --2- 172.21.15.81:0/768355622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 0x7f050c0c2920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0508009e90 tx=0x7f0508009780 comp rx=0 tx=0).stop 2023-10-06T02:48:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.371+0000 7f0513508700 1 -- 172.21.15.81:0/768355622 shutdown_connections 2023-10-06T02:48:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.371+0000 7f0513508700 1 --2- 172.21.15.81:0/768355622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 0x7f050c0c2920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.371+0000 7f0513508700 1 -- 172.21.15.81:0/768355622 >> 172.21.15.81:0/768355622 conn(0x7f050c06c660 msgr2=0x7f050c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.371+0000 7f0513508700 1 -- 172.21.15.81:0/768355622 shutdown_connections 2023-10-06T02:48:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.371+0000 7f0513508700 1 -- 172.21.15.81:0/768355622 wait complete. 2023-10-06T02:48:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.372+0000 7f0513508700 1 Processor -- start 2023-10-06T02:48:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.372+0000 7f0513508700 1 -- start start 2023-10-06T02:48:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0513508700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 0x7f050c0ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0513508700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f050c0af270 0x7f050c154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0513508700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f050c0c8410 0x7f050c0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0513508700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c159ff0 con 0x7f050c0af270 2023-10-06T02:48:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0513508700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c1689b0 con 0x7f050c0c8410 2023-10-06T02:48:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0513508700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c168c90 con 0x7f050c0aeea0 2023-10-06T02:48:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0510aa3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f050c0af270 0x7f050c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0510aa3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f050c0af270 0x7f050c154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56376/0 (socket says 172.21.15.81:56376) 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0510aa3700 1 -- 172.21.15.81:0/1596011256 learned_addr learned my addr 172.21.15.81:0/1596011256 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f05112a4700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 0x7f050c0ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0511aa5700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f050c0c8410 0x7f050c0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0510aa3700 1 -- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 msgr2=0x7f050c0ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0510aa3700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 0x7f050c0ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0510aa3700 1 -- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f050c0c8410 msgr2=0x7f050c0b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0510aa3700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f050c0c8410 0x7f050c0b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.373+0000 7f0510aa3700 1 -- 172.21.15.81:0/1596011256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508009a20 con 0x7f050c0af270 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.374+0000 7f0510aa3700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f050c0af270 0x7f050c154620 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00c790 tx=0x7f04fc007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.374+0000 7f05017fa700 1 -- 172.21.15.81:0/1596011256 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc005b30 con 0x7f050c0af270 2023-10-06T02:48:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.374+0000 7f05017fa700 1 -- 172.21.15.81:0/1596011256 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc005c90 con 0x7f050c0af270 2023-10-06T02:48:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.374+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c168f70 con 0x7f050c0af270 2023-10-06T02:48:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.374+0000 7f05017fa700 1 -- 172.21.15.81:0/1596011256 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc007300 con 0x7f050c0af270 2023-10-06T02:48:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.374+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c169530 con 0x7f050c0af270 2023-10-06T02:48:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.375+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c067bc0 con 0x7f050c0af270 2023-10-06T02:48:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.375+0000 7f05017fa700 1 -- 172.21.15.81:0/1596011256 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04fc01b3b0 con 0x7f050c0af270 2023-10-06T02:48:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.375+0000 7f05017fa700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04f0066f30 0x7f04f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.376+0000 7f05017fa700 1 -- 172.21.15.81:0/1596011256 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f04fc083c30 con 0x7f050c0af270 2023-10-06T02:48:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.376+0000 7f05112a4700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04f0066f30 0x7f04f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.376+0000 7f05112a4700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04f0066f30 0x7f04f00693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0508009de0 tx=0x7f0508019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:02.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.380+0000 7f05017fa700 1 -- 172.21.15.81:0/1596011256 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04fc050d00 con 0x7f050c0af270 2023-10-06T02:48:02.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.560+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f050c0b26a0 con 0x7f050c0af270 2023-10-06T02:48:02.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.561+0000 7f05017fa700 1 -- 172.21.15.81:0/1596011256 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04fc0170a0 con 0x7f050c0af270 2023-10-06T02:48:02.562 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04f0066f30 msgr2=0x7f04f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04f0066f30 0x7f04f00693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0508009de0 tx=0x7f0508019000 comp rx=0 tx=0).stop 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f050c0af270 msgr2=0x7f050c154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f050c0af270 0x7f050c154620 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00c790 tx=0x7f04fc007ea0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 shutdown_connections 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04f0066f30 0x7f04f00693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f050c0c8410 0x7f050c0b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f050c0aeea0 0x7f050c0ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 --2- 172.21.15.81:0/1596011256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f050c0af270 0x7f050c154620 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 >> 172.21.15.81:0/1596011256 conn(0x7f050c06c660 msgr2=0x7f050c1554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:02.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 shutdown_connections 2023-10-06T02:48:02.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.563+0000 7f0513508700 1 -- 172.21.15.81:0/1596011256 wait complete. 2023-10-06T02:48:02.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:48:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.692+0000 7faaea1d5700 1 Processor -- start 2023-10-06T02:48:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.692+0000 7faaea1d5700 1 -- start start 2023-10-06T02:48:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.693+0000 7faaea1d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae41578d0 0x7faae40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.693+0000 7faaea1d5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae40d07c0 con 0x7faae406d120 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.693+0000 7faaea1d5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae40cfbb0 con 0x7faae4157ca0 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.693+0000 7faaea1d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae40cfe90 con 0x7faae41578d0 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.693+0000 7faae3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faae406d120 0x7faae415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47034/0 (socket says 172.21.15.81:47034) 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.693+0000 7faae3fff700 1 -- 172.21.15.81:0/883925873 learned_addr learned my addr 172.21.15.81:0/883925873 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.693+0000 7faae37fe700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae41578d0 0x7faae40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241147934 0 0) 0x7faae40d07c0 con 0x7faae406d120 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faacc003570 con 0x7faae406d120 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783416311 0 0) 0x7faae40cfbb0 con 0x7faae4157ca0 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae40d07c0 con 0x7faae4157ca0 2023-10-06T02:48:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3689268799 0 0) 0x7faacc003570 con 0x7faae406d120 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae41578d0 msgr2=0x7faae40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae41578d0 0x7faae40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 >> v1:172.21.15.83:6789/0 conn(0x7faae4157ca0 legacy=0x7faae415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40d0170 con 0x7faae406d120 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7faadc001470 con 0x7faae406d120 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 >> v1:172.21.15.81:6789/0 conn(0x7faae406d120 legacy=0x7faae415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc003c20 0x7faacc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae41578d0 0x7faacc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faacc004d50 0x7faacc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae40cfe90 con 0x7faacc003c20 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc00bb40 con 0x7faacc004d50 2023-10-06T02:48:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc00bd00 con 0x7faae41578d0 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae37fe700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc003c20 0x7faacc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae3fff700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faacc004d50 0x7faacc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae2ffd700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae41578d0 0x7faacc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae37fe700 1 -- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae41578d0 msgr2=0x7faacc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae37fe700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae41578d0 0x7faacc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae37fe700 1 -- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faacc004d50 msgr2=0x7faacc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae37fe700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faacc004d50 0x7faacc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae37fe700 1 -- 172.21.15.81:0/883925873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc003570 con 0x7faacc003c20 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae37fe700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc003c20 0x7faacc004010 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faad400e210 tx=0x7faad400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1064550014b4f9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.694+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400eac0 con 0x7faacc003c20 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.695+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400f040 con 0x7faacc003c20 2023-10-06T02:48:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.695+0000 7faae27fc700 1 -- 172.21.15.81:0/883925873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400ee70 con 0x7faacc003c20 2023-10-06T02:48:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.695+0000 7faaea1d5700 1 -- 172.21.15.81:0/883925873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc003c20 msgr2=0x7faacc004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.695+0000 7faaea1d5700 1 --2- 172.21.15.81:0/883925873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc003c20 0x7faacc004010 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faad400e210 tx=0x7faad400b040 comp rx=0 tx=0).stop 2023-10-06T02:48:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.695+0000 7faae3fff700 1 -- 172.21.15.81:0/883925873 reap_dead start 2023-10-06T02:48:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.695+0000 7faaea1d5700 1 -- 172.21.15.81:0/883925873 shutdown_connections 2023-10-06T02:48:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.695+0000 7faaea1d5700 1 -- 172.21.15.81:0/883925873 >> 172.21.15.81:0/883925873 conn(0x7faae406bb90 msgr2=0x7faae406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.695+0000 7faaea1d5700 1 -- 172.21.15.81:0/883925873 shutdown_connections 2023-10-06T02:48:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.695+0000 7faaea1d5700 1 -- 172.21.15.81:0/883925873 wait complete. 2023-10-06T02:48:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.696+0000 7faaea1d5700 1 Processor -- start 2023-10-06T02:48:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.696+0000 7faaea1d5700 1 -- start start 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faaea1d5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faacc003c20 0x7faae41681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faaea1d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae416b670 0x7faae40c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faaea1d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae40c8380 0x7faae40b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faaea1d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae40c6b10 con 0x7faae416b670 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faaea1d5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae4168700 con 0x7faacc003c20 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faaea1d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae40c8800 con 0x7faae40c8380 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae416b670 0x7faae40c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae416b670 0x7faae40c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56390/0 (socket says 172.21.15.81:56390) 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae2ffd700 1 -- 172.21.15.81:0/3716459238 learned_addr learned my addr 172.21.15.81:0/3716459238 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae3fff700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae40c8380 0x7faae40b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae37fe700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faacc003c20 0x7faae41681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae2ffd700 1 -- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae40c8380 msgr2=0x7faae40b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae2ffd700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae40c8380 0x7faae40b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae2ffd700 1 -- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faacc003c20 msgr2=0x7faae41681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae2ffd700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faacc003c20 0x7faae41681c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.697+0000 7faae2ffd700 1 -- 172.21.15.81:0/3716459238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40c6f30 con 0x7faae416b670 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.698+0000 7faae2ffd700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae416b670 0x7faae40c7e40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faad800e810 tx=0x7faad8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.698+0000 7faacb7fe700 1 -- 172.21.15.81:0/3716459238 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad80026a0 con 0x7faae416b670 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.698+0000 7faacb7fe700 1 -- 172.21.15.81:0/3716459238 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad8002800 con 0x7faae416b670 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.698+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae40c5e90 con 0x7faae416b670 2023-10-06T02:48:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.698+0000 7faacb7fe700 1 -- 172.21.15.81:0/3716459238 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8002bc0 con 0x7faae416b670 2023-10-06T02:48:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.698+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae40c6450 con 0x7faae416b670 2023-10-06T02:48:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.699+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae40c6c50 con 0x7faae416b670 2023-10-06T02:48:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.699+0000 7faacb7fe700 1 -- 172.21.15.81:0/3716459238 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faad80133e0 con 0x7faae416b670 2023-10-06T02:48:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.700+0000 7faacb7fe700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faad0066f30 0x7faad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.700+0000 7faacb7fe700 1 -- 172.21.15.81:0/3716459238 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7faad8084960 con 0x7faae416b670 2023-10-06T02:48:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.700+0000 7faae37fe700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faad0066f30 0x7faad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.700+0000 7faae37fe700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faad0066f30 0x7faad00693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faad400afd0 tx=0x7faad401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.704+0000 7faacb7fe700 1 -- 172.21.15.81:0/3716459238 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faae40c6c50 con 0x7faae416b670 2023-10-06T02:48:02.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.887+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faae40c6c50 con 0x7faae416b670 2023-10-06T02:48:02.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.887+0000 7faacb7fe700 1 -- 172.21.15.81:0/3716459238 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7faae40c6c50 con 0x7faae416b670 2023-10-06T02:48:02.889 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:48:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.889+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faad0066f30 msgr2=0x7faad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.889+0000 7faaea1d5700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faad0066f30 0x7faad00693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faad400afd0 tx=0x7faad401a000 comp rx=0 tx=0).stop 2023-10-06T02:48:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.889+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae416b670 msgr2=0x7faae40c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.889+0000 7faaea1d5700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae416b670 0x7faae40c7e40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faad800e810 tx=0x7faad8009040 comp rx=0 tx=0).stop 2023-10-06T02:48:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.890+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 shutdown_connections 2023-10-06T02:48:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.890+0000 7faaea1d5700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faae40c8380 0x7faae40b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.890+0000 7faaea1d5700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faad0066f30 0x7faad00693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.890+0000 7faaea1d5700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faacc003c20 0x7faae41681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.890+0000 7faaea1d5700 1 --2- 172.21.15.81:0/3716459238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae416b670 0x7faae40c7e40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.890+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 >> 172.21.15.81:0/3716459238 conn(0x7faae406bb90 msgr2=0x7faae4068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.890+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 shutdown_connections 2023-10-06T02:48:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:02.890+0000 7faaea1d5700 1 -- 172.21.15.81:0/3716459238 wait complete. 2023-10-06T02:48:02.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:48:03.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.016+0000 7f133b59e700 1 Processor -- start 2023-10-06T02:48:03.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.016+0000 7f133b59e700 1 -- start start 2023-10-06T02:48:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f133b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c0cefa0 0x7f133c067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f133b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c067ff0 con 0x7f133c0add30 2023-10-06T02:48:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f133b59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c0b17c0 con 0x7f133c067640 2023-10-06T02:48:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f133b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0b37b0 con 0x7f133c0cefa0 2023-10-06T02:48:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f133a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f133c0add30 0x7f133c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47040/0 (socket says 172.21.15.81:47040) 2023-10-06T02:48:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f133a59c700 1 -- 172.21.15.81:0/656548804 learned_addr learned my addr 172.21.15.81:0/656548804 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435881312 0 0) 0x7f133c067ff0 con 0x7f133c0add30 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f133ad9d700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c0cefa0 0x7f133c067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1328003570 con 0x7f133c0add30 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898773784 0 0) 0x7f133c0b17c0 con 0x7f133c067640 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f133c067ff0 con 0x7f133c067640 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3564069031 0 0) 0x7f1328003570 con 0x7f133c0add30 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c0cefa0 msgr2=0x7f133c067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c0cefa0 0x7f133c067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 >> v1:172.21.15.83:6789/0 conn(0x7f133c067640 legacy=0x7f133c0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0b1d80 con 0x7f133c0add30 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.017+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f132c001470 con 0x7f133c0add30 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 >> v1:172.21.15.81:6789/0 conn(0x7f133c0add30 legacy=0x7f133c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c0cefa0 0x7f1328003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f1328004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1328004d50 0x7f13280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132800bbf0 con 0x7f13280041d0 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132800bd30 con 0x7f1328004d50 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132800bef0 con 0x7f133c0cefa0 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1331d9b700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f1328004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f133ad9d700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1328004d50 0x7f13280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f133a59c700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c0cefa0 0x7f1328003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1331d9b700 1 -- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c0cefa0 msgr2=0x7f1328003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1331d9b700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c0cefa0 0x7f1328003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1331d9b700 1 -- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1328004d50 msgr2=0x7f13280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1331d9b700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1328004d50 0x7f13280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1331d9b700 1 -- 172.21.15.81:0/656548804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328003570 con 0x7f13280041d0 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1331d9b700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f1328004810 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1324001a50 tx=0x7f1324007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f862a9ab495b9efe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132400c5d0 con 0x7f13280041d0 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132400c730 con 0x7f13280041d0 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.018+0000 7f1339d9b700 1 -- 172.21.15.81:0/656548804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132400cad0 con 0x7f13280041d0 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.019+0000 7f133b59e700 1 -- 172.21.15.81:0/656548804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 msgr2=0x7f1328004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.019+0000 7f133b59e700 1 --2- 172.21.15.81:0/656548804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f1328004810 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1324001a50 tx=0x7f1324007d30 comp rx=0 tx=0).stop 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.019+0000 7f133ad9d700 1 -- 172.21.15.81:0/656548804 reap_dead start 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.019+0000 7f133b59e700 1 -- 172.21.15.81:0/656548804 shutdown_connections 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.019+0000 7f133b59e700 1 -- 172.21.15.81:0/656548804 >> 172.21.15.81:0/656548804 conn(0x7f133c06c620 msgr2=0x7f133c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.019+0000 7f133b59e700 1 -- 172.21.15.81:0/656548804 shutdown_connections 2023-10-06T02:48:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.019+0000 7f133b59e700 1 -- 172.21.15.81:0/656548804 wait complete. 2023-10-06T02:48:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.020+0000 7f133b59e700 1 Processor -- start 2023-10-06T02:48:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.020+0000 7f133b59e700 1 -- start start 2023-10-06T02:48:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f133c0ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c143dd0 0x7f133c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f133c16a350 0x7f133c16a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0ab1c0 con 0x7f13280041d0 2023-10-06T02:48:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c15d280 con 0x7f133c16a350 2023-10-06T02:48:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c16b0c0 con 0x7f133c143dd0 2023-10-06T02:48:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f133c0ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f133c0ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56404/0 (socket says 172.21.15.81:56404) 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133a59c700 1 -- 172.21.15.81:0/1304316448 learned_addr learned my addr 172.21.15.81:0/1304316448 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f1331d9b700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c143dd0 0x7f133c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133ad9d700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f133c16a350 0x7f133c16a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133a59c700 1 -- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c143dd0 msgr2=0x7f133c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133a59c700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c143dd0 0x7f133c0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133a59c700 1 -- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f133c16a350 msgr2=0x7f133c16a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133a59c700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f133c16a350 0x7f133c16a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133a59c700 1 -- 172.21.15.81:0/1304316448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0aa890 con 0x7f13280041d0 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133a59c700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f133c0ae100 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f132c007390 tx=0x7f133c0b1cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f1332ffd700 1 -- 172.21.15.81:0/1304316448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c018030 con 0x7f13280041d0 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f1332ffd700 1 -- 172.21.15.81:0/1304316448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c001020 con 0x7f13280041d0 2023-10-06T02:48:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c0aab70 con 0x7f13280041d0 2023-10-06T02:48:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f1332ffd700 1 -- 172.21.15.81:0/1304316448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00faa0 con 0x7f13280041d0 2023-10-06T02:48:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.021+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c0ab650 con 0x7f13280041d0 2023-10-06T02:48:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.022+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c0ab010 con 0x7f13280041d0 2023-10-06T02:48:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.023+0000 7f1332ffd700 1 -- 172.21.15.81:0/1304316448 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f132c01b070 con 0x7f13280041d0 2023-10-06T02:48:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.023+0000 7f1332ffd700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f131c066fb0 0x7f131c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.023+0000 7f1332ffd700 1 -- 172.21.15.81:0/1304316448 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f132c019070 con 0x7f13280041d0 2023-10-06T02:48:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.023+0000 7f1331d9b700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f131c066fb0 0x7f131c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.024+0000 7f1331d9b700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f131c066fb0 0x7f131c069460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1324001ed0 tx=0x7f1324015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.027+0000 7f1332ffd700 1 -- 172.21.15.81:0/1304316448 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f132c051620 con 0x7f13280041d0 2023-10-06T02:48:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.251+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f133c0ab4a0 con 0x7f13280041d0 2023-10-06T02:48:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.252+0000 7f1332ffd700 1 -- 172.21.15.81:0/1304316448 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f132c054c40 con 0x7f13280041d0 2023-10-06T02:48:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:03.253 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:47:29.117013+0000","modified":"2023-10-06T02:47:32.768965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2380710039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2380710039},{"type":"v1","addr":"172.21.15.81:6835","nonce":2380710039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f131c066fb0 msgr2=0x7f131c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f131c066fb0 0x7f131c069460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1324001ed0 tx=0x7f1324015000 comp rx=0 tx=0).stop 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 msgr2=0x7f133c0ae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f133c0ae100 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f132c007390 tx=0x7f133c0b1cf0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 shutdown_connections 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f131c066fb0 0x7f131c069460 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f133c16a350 0x7f133c16a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13280041d0 0x7f133c0ae100 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 --2- 172.21.15.81:0/1304316448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f133c143dd0 0x7f133c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 >> 172.21.15.81:0/1304316448 conn(0x7f133c06c620 msgr2=0x7f133c0b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 shutdown_connections 2023-10-06T02:48:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.254+0000 7f133b59e700 1 -- 172.21.15.81:0/1304316448 wait complete. 2023-10-06T02:48:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T02:48:03.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:48:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.379+0000 7fbbb329f700 1 Processor -- start 2023-10-06T02:48:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.379+0000 7fbbb329f700 1 -- start start 2023-10-06T02:48:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.380+0000 7fbbb329f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbbac0ce5c0 0x7fbbac0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.380+0000 7fbbb329f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbac0ac570 0x7fbbac06e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.380+0000 7fbbb329f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac15dfb0 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.380+0000 7fbbb329f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0acec0 con 0x7fbbac0ac570 2023-10-06T02:48:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.380+0000 7fbbb329f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0ad1a0 con 0x7fbbac0ce5c0 2023-10-06T02:48:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.380+0000 7fbbb183c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbac0ac570 0x7fbbac06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.380+0000 7fbbb103b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbbac0ce1f0 0x7fbbac15e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47044/0 (socket says 172.21.15.81:47044) 2023-10-06T02:48:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.380+0000 7fbbb103b700 1 -- 172.21.15.81:0/1448957144 learned_addr learned my addr 172.21.15.81:0/1448957144 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbbb083a700 1 --2- 172.21.15.81:0/1448957144 >> v2:172.21.15.83:3300/0 conn(0x7fbbac0ce5c0 0x7fbbac0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbbb183c700 1 -- 172.21.15.81:0/1448957144 >> v2:172.21.15.83:3300/0 conn(0x7fbbac0ce5c0 msgr2=0x7fbbac0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbbb183c700 1 --2- 172.21.15.81:0/1448957144 >> v2:172.21.15.83:3300/0 conn(0x7fbbac0ce5c0 0x7fbbac0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbbb183c700 1 -- 172.21.15.81:0/1448957144 >> v1:172.21.15.81:6789/0 conn(0x7fbbac0ce1f0 legacy=0x7fbbac15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbba3fff700 1 -- 172.21.15.81:0/1448957144 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878778302 0 0) 0x7fbbac15dfb0 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbbb183c700 1 -- 172.21.15.81:0/1448957144 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac15dc40 con 0x7fbbac0ac570 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbbb183c700 1 --2- 172.21.15.81:0/1448957144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ac570 0x7fbbac06e230 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbbac06f590 tx=0x7fbba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a713f5448249abdf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbba3fff700 1 -- 172.21.15.81:0/1448957144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4011630 con 0x7fbbac0ac570 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbba3fff700 1 -- 172.21.15.81:0/1448957144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba4011790 con 0x7fbbac0ac570 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbba3fff700 1 -- 172.21.15.81:0/1448957144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4011b30 con 0x7fbbac0ac570 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbbb329f700 1 -- 172.21.15.81:0/1448957144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ac570 msgr2=0x7fbbac06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.381+0000 7fbbb329f700 1 --2- 172.21.15.81:0/1448957144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ac570 0x7fbbac06e230 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbbac06f590 tx=0x7fbba40091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.382+0000 7fbbb329f700 1 -- 172.21.15.81:0/1448957144 shutdown_connections 2023-10-06T02:48:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.382+0000 7fbbb329f700 1 --2- 172.21.15.81:0/1448957144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ac570 0x7fbbac06e230 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.382+0000 7fbbb329f700 1 --2- 172.21.15.81:0/1448957144 >> v2:172.21.15.83:3300/0 conn(0x7fbbac0ce5c0 0x7fbbac0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.382+0000 7fbbb329f700 1 -- 172.21.15.81:0/1448957144 >> 172.21.15.81:0/1448957144 conn(0x7fbbac06cca0 msgr2=0x7fbbac06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.382+0000 7fbbb329f700 1 -- 172.21.15.81:0/1448957144 shutdown_connections 2023-10-06T02:48:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.382+0000 7fbbb329f700 1 -- 172.21.15.81:0/1448957144 wait complete. 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.383+0000 7fbbb329f700 1 Processor -- start 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.383+0000 7fbbb329f700 1 -- start start 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb329f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ac570 0x7fbbac15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb329f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ce1f0 0x7fbbac14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb329f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac0ce5c0 0x7fbbac16a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb329f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0af420 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb329f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0ae810 con 0x7fbbac0ce5c0 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb329f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0aeaf0 con 0x7fbbac0ac570 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb083a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ce1f0 0x7fbbac14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb083a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ce1f0 0x7fbbac14f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56420/0 (socket says 172.21.15.81:56420) 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb083a700 1 -- 172.21.15.81:0/1896893434 learned_addr learned my addr 172.21.15.81:0/1896893434 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb103b700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ac570 0x7fbbac15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb183c700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac0ce5c0 0x7fbbac16a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb083a700 1 -- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ac570 msgr2=0x7fbbac15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb083a700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ac570 0x7fbbac15b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb083a700 1 -- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac0ce5c0 msgr2=0x7fbbac16a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb083a700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac0ce5c0 0x7fbbac16a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb083a700 1 -- 172.21.15.81:0/1896893434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba4009420 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb183c700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac0ce5c0 0x7fbbac16a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb083a700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ce1f0 0x7fbbac14f9e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00ec80 tx=0x7fbb9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbba17fa700 1 -- 172.21.15.81:0/1896893434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00c850 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbba17fa700 1 -- 172.21.15.81:0/1896893434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c00c9b0 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac0aedd0 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbba17fa700 1 -- 172.21.15.81:0/1896893434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00cd50 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.384+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac15b600 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.385+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac0af5d0 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.386+0000 7fbba17fa700 1 -- 172.21.15.81:0/1896893434 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb9c013680 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.386+0000 7fbba17fa700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb90066f30 0x7fbb900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.386+0000 7fbba17fa700 1 -- 172.21.15.81:0/1896893434 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fbb9c0849f0 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.386+0000 7fbbb103b700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb90066f30 0x7fbb900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.387+0000 7fbbb103b700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb90066f30 0x7fbb900693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbba8002250 tx=0x7fbba8001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.390+0000 7fbba17fa700 1 -- 172.21.15.81:0/1896893434 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbac0af5d0 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.572+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbac0af560 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.573+0000 7fbba17fa700 1 -- 172.21.15.81:0/1896893434 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fbb9c017090 con 0x7fbbac0ce1f0 2023-10-06T02:48:03.574 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:03.574 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:57.585600+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:47:27.250251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:47:28.083304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:48:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb90066f30 msgr2=0x7fbb900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb90066f30 0x7fbb900693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbba8002250 tx=0x7fbba8001a20 comp rx=0 tx=0).stop 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ce1f0 msgr2=0x7fbbac14f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ce1f0 0x7fbbac14f9e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00ec80 tx=0x7fbb9c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 shutdown_connections 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb90066f30 0x7fbb900693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac0ce5c0 0x7fbbac16a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ac570 0x7fbbac15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 --2- 172.21.15.81:0/1896893434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac0ce1f0 0x7fbbac14f9e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 >> 172.21.15.81:0/1896893434 conn(0x7fbbac06cca0 msgr2=0x7fbbac1574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 shutdown_connections 2023-10-06T02:48:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.575+0000 7fbbb329f700 1 -- 172.21.15.81:0/1896893434 wait complete. 2023-10-06T02:48:03.588 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:48:03.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:48:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.700+0000 7f50f3fff700 1 Processor -- start 2023-10-06T02:48:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.700+0000 7f50f3fff700 1 -- start start 2023-10-06T02:48:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.701+0000 7f50f3fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f50f4159b40 0x7f50f40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.701+0000 7f50f3fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40cee10 con 0x7f50f4068e90 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.701+0000 7f50f3fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40cd040 con 0x7f50f4159f10 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.701+0000 7f50f3fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f40cd320 con 0x7f50f4159b40 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.701+0000 7f50f37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f50f4068e90 0x7f50f40cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47050/0 (socket says 172.21.15.81:47050) 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.701+0000 7f50f37fe700 1 -- 172.21.15.81:0/779244687 learned_addr learned my addr 172.21.15.81:0/779244687 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.701+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688895034 0 0) 0x7f50f40cee10 con 0x7f50f4068e90 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.701+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e0003570 con 0x7f50f4068e90 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.701+0000 7f50f2ffd700 1 --2- 172.21.15.81:0/779244687 >> v2:172.21.15.83:3300/0 conn(0x7f50f4159b40 0x7f50f40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1499360404 0 0) 0x7f50e0003570 con 0x7f50f4068e90 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 >> v2:172.21.15.83:3300/0 conn(0x7f50f4159b40 msgr2=0x7f50f40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 --2- 172.21.15.81:0/779244687 >> v2:172.21.15.83:3300/0 conn(0x7f50f4159b40 0x7f50f40cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 >> v1:172.21.15.83:6789/0 conn(0x7f50f4159f10 legacy=0x7f50f4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f40ce7c0 con 0x7f50f4068e90 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f50ec0017f0 con 0x7f50f4068e90 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 >> v1:172.21.15.81:6789/0 conn(0x7f50f4068e90 legacy=0x7f50f40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50e0003a60 0x7f50e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50e0004810 0x7f50e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50e00051c0 0x7f50e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40cd320 con 0x7f50e0004810 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e000c0d0 con 0x7f50e0003a60 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e000c290 con 0x7f50e00051c0 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50ea7fc700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50e0004810 0x7f50e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f2ffd700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50e0003a60 0x7f50e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f37fe700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50e00051c0 0x7f50e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50ea7fc700 1 -- 172.21.15.81:0/779244687 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50e00051c0 msgr2=0x7f50e000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50ea7fc700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50e00051c0 0x7f50e000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50ea7fc700 1 -- 172.21.15.81:0/779244687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50e0003a60 msgr2=0x7f50e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50ea7fc700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50e0003a60 0x7f50e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50ea7fc700 1 -- 172.21.15.81:0/779244687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0003570 con 0x7f50e0004810 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f37fe700 1 -- 172.21.15.81:0/779244687 reap_dead start 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50ea7fc700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50e0004810 0x7f50e0004c80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0018b0 tx=0x7f50dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b30f00c4703447 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc012420 con 0x7f50e0004810 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc012580 con 0x7f50e0004810 2023-10-06T02:48:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.702+0000 7f50f27fc700 1 -- 172.21.15.81:0/779244687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc012920 con 0x7f50e0004810 2023-10-06T02:48:03.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.703+0000 7f50f3fff700 1 -- 172.21.15.81:0/779244687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50e0004810 msgr2=0x7f50e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.703+0000 7f50f3fff700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50e0004810 0x7f50e0004c80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0018b0 tx=0x7f50dc007d30 comp rx=0 tx=0).stop 2023-10-06T02:48:03.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.703+0000 7f50f3fff700 1 -- 172.21.15.81:0/779244687 shutdown_connections 2023-10-06T02:48:03.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.703+0000 7f50f3fff700 1 --2- 172.21.15.81:0/779244687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50e0004810 0x7f50e0004c80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.703+0000 7f50f3fff700 1 -- 172.21.15.81:0/779244687 >> 172.21.15.81:0/779244687 conn(0x7f50f40cd660 msgr2=0x7f50f40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:03.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.703+0000 7f50f3fff700 1 -- 172.21.15.81:0/779244687 shutdown_connections 2023-10-06T02:48:03.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.703+0000 7f50f3fff700 1 -- 172.21.15.81:0/779244687 wait complete. 2023-10-06T02:48:03.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.704+0000 7f50f3fff700 1 Processor -- start 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.704+0000 7f50f3fff700 1 -- start start 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50e0004810 0x7f50f4153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50f40ca650 0x7f50f416b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f41560c0 0x7f50f4156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40c7ca0 con 0x7f50f41560c0 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f3fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40c8b00 con 0x7f50e0004810 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f3fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4156a70 con 0x7f50f40ca650 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f41560c0 0x7f50f4156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f41560c0 0x7f50f4156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56440/0 (socket says 172.21.15.81:56440) 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f37fe700 1 -- 172.21.15.81:0/597413158 learned_addr learned my addr 172.21.15.81:0/597413158 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f2ffd700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50e0004810 0x7f50f4153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50ea7fc700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50f40ca650 0x7f50f416b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f37fe700 1 -- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50f40ca650 msgr2=0x7f50f416b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f37fe700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50f40ca650 0x7f50f416b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f37fe700 1 -- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50e0004810 msgr2=0x7f50f4153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f37fe700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50e0004810 0x7f50f4153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f37fe700 1 -- 172.21.15.81:0/597413158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f40c7ef0 con 0x7f50f41560c0 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50f37fe700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f41560c0 0x7f50f4156530 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f50f4067a80 tx=0x7f50ec0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.705+0000 7f50eb7fe700 1 -- 172.21.15.81:0/597413158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00ac90 con 0x7f50f41560c0 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.706+0000 7f50eb7fe700 1 -- 172.21.15.81:0/597413158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec00ae10 con 0x7f50f41560c0 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.706+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f40c81d0 con 0x7f50f41560c0 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.706+0000 7f50eb7fe700 1 -- 172.21.15.81:0/597413158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec013640 con 0x7f50f41560c0 2023-10-06T02:48:03.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.706+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f40c8790 con 0x7f50f41560c0 2023-10-06T02:48:03.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.707+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f4068810 con 0x7f50f41560c0 2023-10-06T02:48:03.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.707+0000 7f50eb7fe700 1 -- 172.21.15.81:0/597413158 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50ec0139f0 con 0x7f50f41560c0 2023-10-06T02:48:03.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.707+0000 7f50eb7fe700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f50d4066f30 0x7f50d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:03.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.707+0000 7f50eb7fe700 1 -- 172.21.15.81:0/597413158 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f50ec084d30 con 0x7f50f41560c0 2023-10-06T02:48:03.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.707+0000 7f50f2ffd700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f50d4066f30 0x7f50d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:03.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.708+0000 7f50f2ffd700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f50d4066f30 0x7f50d40693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50f4161300 tx=0x7f50e40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:03.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.711+0000 7f50eb7fe700 1 -- 172.21.15.81:0/597413158 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50ec051e00 con 0x7f50f41560c0 2023-10-06T02:48:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.937+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50f40c8c70 con 0x7f50f41560c0 2023-10-06T02:48:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.937+0000 7f50eb7fe700 1 -- 172.21.15.81:0/597413158 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f50ec055420 con 0x7f50f41560c0 2023-10-06T02:48:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:03.939 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:47:29.117013+0000","modified":"2023-10-06T02:47:32.768965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2380710039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2380710039},{"type":"v1","addr":"172.21.15.81:6835","nonce":2380710039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:48:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f50d4066f30 msgr2=0x7f50d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f50d4066f30 0x7f50d40693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50f4161300 tx=0x7f50e40091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f41560c0 msgr2=0x7f50f4156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f41560c0 0x7f50f4156530 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f50f4067a80 tx=0x7f50ec0021d0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 shutdown_connections 2023-10-06T02:48:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f41560c0 0x7f50f4156530 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f50d4066f30 0x7f50d40693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50e0004810 0x7f50f4153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 --2- 172.21.15.81:0/597413158 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50f40ca650 0x7f50f416b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 >> 172.21.15.81:0/597413158 conn(0x7f50f40cd660 msgr2=0x7f50f406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 shutdown_connections 2023-10-06T02:48:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:03.939+0000 7f50f3fff700 1 -- 172.21.15.81:0/597413158 wait complete. 2023-10-06T02:48:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T02:48:03.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:48:04.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.065+0000 7f425f852700 1 Processor -- start 2023-10-06T02:48:04.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.065+0000 7f425f852700 1 -- start start 2023-10-06T02:48:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f425f852700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f42581578d0 0x7f42580cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f425f852700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f425806d120 0x7f425806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f425f852700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42580d07c0 con 0x7f4258157ca0 2023-10-06T02:48:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f425f852700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425806daa0 con 0x7f42581578d0 2023-10-06T02:48:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f425f852700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42580cfbb0 con 0x7f425806d120 2023-10-06T02:48:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f425cded700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4258157ca0 0x7f425815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47060/0 (socket says 172.21.15.81:47060) 2023-10-06T02:48:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f425cded700 1 -- 172.21.15.81:0/2505547905 learned_addr learned my addr 172.21.15.81:0/2505547905 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f425ddef700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f425806d120 0x7f425806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f425d5ee700 1 --2- 172.21.15.81:0/2505547905 >> v2:172.21.15.83:3300/0 conn(0x7f42581578d0 0x7f42580cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87934363 0 0) 0x7f42580d07c0 con 0x7f4258157ca0 2023-10-06T02:48:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4244003570 con 0x7f4258157ca0 2023-10-06T02:48:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629913215 0 0) 0x7f4244003570 con 0x7f4258157ca0 2023-10-06T02:48:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f425806d120 msgr2=0x7f425806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f425806d120 0x7f425806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 >> v2:172.21.15.83:3300/0 conn(0x7f42581578d0 msgr2=0x7f42580cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 --2- 172.21.15.81:0/2505547905 >> v2:172.21.15.83:3300/0 conn(0x7f42581578d0 0x7f42580cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580cfe90 con 0x7f4258157ca0 2023-10-06T02:48:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f4248001470 con 0x7f4258157ca0 2023-10-06T02:48:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.066+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 >> v1:172.21.15.81:6789/0 conn(0x7f4258157ca0 legacy=0x7f425815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f424ffff700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4244003a60 0x7f4244003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f424ffff700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f425806d120 0x7f4244004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f424ffff700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244004d50 0x7f42440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425806daa0 con 0x7f4244003a60 2023-10-06T02:48:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42580cfbb0 con 0x7f4244004d50 2023-10-06T02:48:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424400ba60 con 0x7f425806d120 2023-10-06T02:48:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425d5ee700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4244003a60 0x7f4244003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425cded700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f425806d120 0x7f4244004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425ddef700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244004d50 0x7f42440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425d5ee700 1 -- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f425806d120 msgr2=0x7f4244004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425d5ee700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f425806d120 0x7f4244004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425d5ee700 1 -- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244004d50 msgr2=0x7f42440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425d5ee700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244004d50 0x7f42440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425d5ee700 1 -- 172.21.15.81:0/2505547905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244003570 con 0x7f4244003a60 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425ddef700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244004d50 0x7f42440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f425d5ee700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4244003a60 0x7f4244003e70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4254009c00 tx=0x7f42540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7144292e9ec86f5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425400e6b0 con 0x7f4244003a60 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425400e810 con 0x7f4244003a60 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.067+0000 7f424ffff700 1 -- 172.21.15.81:0/2505547905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425400ebd0 con 0x7f4244003a60 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.068+0000 7f425f852700 1 -- 172.21.15.81:0/2505547905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4244003a60 msgr2=0x7f4244003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.068+0000 7f425f852700 1 --2- 172.21.15.81:0/2505547905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4244003a60 0x7f4244003e70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4254009c00 tx=0x7f42540091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.068+0000 7f425ddef700 1 -- 172.21.15.81:0/2505547905 reap_dead start 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.068+0000 7f425f852700 1 -- 172.21.15.81:0/2505547905 shutdown_connections 2023-10-06T02:48:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.068+0000 7f425f852700 1 -- 172.21.15.81:0/2505547905 >> 172.21.15.81:0/2505547905 conn(0x7f425806bb90 msgr2=0x7f425806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.068+0000 7f425f852700 1 -- 172.21.15.81:0/2505547905 shutdown_connections 2023-10-06T02:48:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.068+0000 7f425f852700 1 -- 172.21.15.81:0/2505547905 wait complete. 2023-10-06T02:48:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.069+0000 7f425f852700 1 Processor -- start 2023-10-06T02:48:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.069+0000 7f425f852700 1 -- start start 2023-10-06T02:48:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425f852700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244003a60 0x7f4258151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425f852700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42580aa890 0x7f42580b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425f852700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42580aad00 0x7f42581556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425f852700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42580b56a0 con 0x7f42580aa890 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425f852700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42580b69b0 con 0x7f4244003a60 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425f852700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42580b2410 con 0x7f42580aad00 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425cded700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42580aa890 0x7f42580b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425cded700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42580aa890 0x7f42580b5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56456/0 (socket says 172.21.15.81:56456) 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425cded700 1 -- 172.21.15.81:0/975260361 learned_addr learned my addr 172.21.15.81:0/975260361 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425d5ee700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244003a60 0x7f4258151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425ddef700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42580aad00 0x7f42581556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425cded700 1 -- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42580aad00 msgr2=0x7f42581556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425cded700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42580aad00 0x7f42581556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425cded700 1 -- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244003a60 msgr2=0x7f4258151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425cded700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244003a60 0x7f4258151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425cded700 1 -- 172.21.15.81:0/975260361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580b26f0 con 0x7f42580aa890 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f425cded700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42580aa890 0x7f42580b5b30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4248007390 tx=0x7f42580d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.070+0000 7f424d7fa700 1 -- 172.21.15.81:0/975260361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248018030 con 0x7f42580aa890 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.071+0000 7f424d7fa700 1 -- 172.21.15.81:0/975260361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424800f9f0 con 0x7f42580aa890 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.071+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42580b5050 con 0x7f42580aa890 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.071+0000 7f424d7fa700 1 -- 172.21.15.81:0/975260361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424800fd90 con 0x7f42580aa890 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.071+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4258151e60 con 0x7f42580aa890 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.071+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4258067ac0 con 0x7f42580aa890 2023-10-06T02:48:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.072+0000 7f424d7fa700 1 -- 172.21.15.81:0/975260361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f424801b070 con 0x7f42580aa890 2023-10-06T02:48:04.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.072+0000 7f424d7fa700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f423c066f30 0x7f423c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.072+0000 7f424d7fa700 1 -- 172.21.15.81:0/975260361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f4248019070 con 0x7f42580aa890 2023-10-06T02:48:04.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.072+0000 7f425d5ee700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f423c066f30 0x7f423c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.073+0000 7f425d5ee700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f423c066f30 0x7f423c0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4254009c00 tx=0x7f425401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:04.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.076+0000 7f424d7fa700 1 -- 172.21.15.81:0/975260361 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42480518a0 con 0x7f42580aa890 2023-10-06T02:48:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.302+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42580d0170 con 0x7f42580aa890 2023-10-06T02:48:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.303+0000 7f424d7fa700 1 -- 172.21.15.81:0/975260361 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f4248054ec0 con 0x7f42580aa890 2023-10-06T02:48:04.304 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:04.304 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:47:29.117013+0000","modified":"2023-10-06T02:47:32.768965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2380710039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2380710039},{"type":"v1","addr":"172.21.15.81:6835","nonce":2380710039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:48:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f423c066f30 msgr2=0x7f423c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f423c066f30 0x7f423c0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4254009c00 tx=0x7f425401a000 comp rx=0 tx=0).stop 2023-10-06T02:48:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42580aa890 msgr2=0x7f42580b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42580aa890 0x7f42580b5b30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4248007390 tx=0x7f42580d0730 comp rx=0 tx=0).stop 2023-10-06T02:48:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 shutdown_connections 2023-10-06T02:48:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42580aad00 0x7f42581556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f423c066f30 0x7f423c0693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4244003a60 0x7f4258151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 --2- 172.21.15.81:0/975260361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42580aa890 0x7f42580b5b30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 >> 172.21.15.81:0/975260361 conn(0x7f425806bb90 msgr2=0x7f4258154960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 shutdown_connections 2023-10-06T02:48:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.305+0000 7f425f852700 1 -- 172.21.15.81:0/975260361 wait complete. 2023-10-06T02:48:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T02:48:04.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:48:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.430+0000 7f1e88ea1700 1 Processor -- start 2023-10-06T02:48:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.430+0000 7f1e88ea1700 1 -- start start 2023-10-06T02:48:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e88ea1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e841578d0 0x7f1e840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e88ea1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1e84157ca0 0x7f1e8415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e88ea1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e840d07c0 con 0x7f1e8406d120 2023-10-06T02:48:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e88ea1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e840cfbb0 con 0x7f1e84157ca0 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e88ea1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840cfe90 con 0x7f1e841578d0 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e82d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1e8406d120 0x7f1e8415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47074/0 (socket says 172.21.15.81:47074) 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e82d9d700 1 -- 172.21.15.81:0/33805497 learned_addr learned my addr 172.21.15.81:0/33805497 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e8259c700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e841578d0 0x7f1e840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e81d9b700 1 --2- 172.21.15.81:0/33805497 >> v2:172.21.15.83:3300/0 conn(0x7f1e84157ca0 0x7f1e8415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733484753 0 0) 0x7f1e840d07c0 con 0x7f1e8406d120 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e70003570 con 0x7f1e8406d120 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2005241077 0 0) 0x7f1e70003570 con 0x7f1e8406d120 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e841578d0 msgr2=0x7f1e840cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.431+0000 7f1e8159a700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e841578d0 0x7f1e840cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 >> v2:172.21.15.83:3300/0 conn(0x7f1e84157ca0 msgr2=0x7f1e8415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 --2- 172.21.15.81:0/33805497 >> v2:172.21.15.83:3300/0 conn(0x7f1e84157ca0 0x7f1e8415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840d0170 con 0x7f1e8406d120 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f1e74001470 con 0x7f1e8406d120 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 >> v1:172.21.15.81:6789/0 conn(0x7f1e8406d120 legacy=0x7f1e8415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e70003a60 0x7f1e70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e841578d0 0x7f1e70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840cfbb0 con 0x7f1e70004d50 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840cfe90 con 0x7f1e70003a60 2023-10-06T02:48:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7000ba60 con 0x7f1e841578d0 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e82d9d700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8259c700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e70003a60 0x7f1e70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e81d9b700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e841578d0 0x7f1e70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e82d9d700 1 -- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e841578d0 msgr2=0x7f1e70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e82d9d700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e841578d0 0x7f1e70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e82d9d700 1 -- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e70003a60 msgr2=0x7f1e70003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e82d9d700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e70003a60 0x7f1e70003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e82d9d700 1 -- 172.21.15.81:0/33805497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70003570 con 0x7f1e70004d50 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e82d9d700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e700051c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c3c0 tx=0x7f1e840d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73583f5efff1ad05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400cc30 con 0x7f1e70004d50 2023-10-06T02:48:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7400cd90 con 0x7f1e70004d50 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.432+0000 7f1e8159a700 1 -- 172.21.15.81:0/33805497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74005b70 con 0x7f1e70004d50 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.433+0000 7f1e88ea1700 1 -- 172.21.15.81:0/33805497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 msgr2=0x7f1e700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.433+0000 7f1e88ea1700 1 --2- 172.21.15.81:0/33805497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e700051c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c3c0 tx=0x7f1e840d0730 comp rx=0 tx=0).stop 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.433+0000 7f1e82d9d700 1 -- 172.21.15.81:0/33805497 reap_dead start 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.433+0000 7f1e88ea1700 1 -- 172.21.15.81:0/33805497 shutdown_connections 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.433+0000 7f1e88ea1700 1 -- 172.21.15.81:0/33805497 >> 172.21.15.81:0/33805497 conn(0x7f1e8406bb90 msgr2=0x7f1e8406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.433+0000 7f1e88ea1700 1 -- 172.21.15.81:0/33805497 shutdown_connections 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.433+0000 7f1e88ea1700 1 -- 172.21.15.81:0/33805497 wait complete. 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.434+0000 7f1e88ea1700 1 Processor -- start 2023-10-06T02:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.434+0000 7f1e88ea1700 1 -- start start 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e88ea1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e841548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e88ea1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e84154e20 0x7f1e840c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e88ea1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e840c6dc0 0x7f1e840cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e88ea1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840c7260 con 0x7f1e70004d50 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e88ea1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8416ecb0 con 0x7f1e84154e20 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e88ea1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8416def0 con 0x7f1e840c6dc0 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e8259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e841548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e8259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e841548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56472/0 (socket says 172.21.15.81:56472) 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e8259c700 1 -- 172.21.15.81:0/1352440202 learned_addr learned my addr 172.21.15.81:0/1352440202 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e81d9b700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e84154e20 0x7f1e840c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e82d9d700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e840c6dc0 0x7f1e840cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e8259c700 1 -- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e840c6dc0 msgr2=0x7f1e840cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e8259c700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e840c6dc0 0x7f1e840cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e8259c700 1 -- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e84154e20 msgr2=0x7f1e840c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e8259c700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e84154e20 0x7f1e840c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e8259c700 1 -- 172.21.15.81:0/1352440202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8416e1d0 con 0x7f1e70004d50 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e8259c700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e841548e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c011f30 tx=0x7f1e7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e7a7fc700 1 -- 172.21.15.81:0/1352440202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00e040 con 0x7f1e70004d50 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e7a7fc700 1 -- 172.21.15.81:0/1352440202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c00f040 con 0x7f1e70004d50 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8416e4b0 con 0x7f1e70004d50 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e7a7fc700 1 -- 172.21.15.81:0/1352440202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c015430 con 0x7f1e70004d50 2023-10-06T02:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.435+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e840cd630 con 0x7f1e70004d50 2023-10-06T02:48:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.436+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8416e950 con 0x7f1e70004d50 2023-10-06T02:48:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.437+0000 7f1e7a7fc700 1 -- 172.21.15.81:0/1352440202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e7c015860 con 0x7f1e70004d50 2023-10-06T02:48:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.437+0000 7f1e7a7fc700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.437+0000 7f1e7a7fc700 1 -- 172.21.15.81:0/1352440202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1e7c0853d0 con 0x7f1e70004d50 2023-10-06T02:48:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.437+0000 7f1e81d9b700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.438+0000 7f1e81d9b700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1e841551f0 tx=0x7f1e6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.441+0000 7f1e7a7fc700 1 -- 172.21.15.81:0/1352440202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e7c0524a0 con 0x7f1e70004d50 2023-10-06T02:48:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.624+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e840d0450 con 0x7f1e70004d50 2023-10-06T02:48:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.624+0000 7f1e7a7fc700 1 -- 172.21.15.81:0/1352440202 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f1e7c055ac0 con 0x7f1e70004d50 2023-10-06T02:48:04.626 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:04.626 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:47:57.585600+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:47:27.250251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:47:28.083304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:48:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.626+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 msgr2=0x7f1e640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.626+0000 7f1e88ea1700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1e841551f0 tx=0x7f1e6c008040 comp rx=0 tx=0).stop 2023-10-06T02:48:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.626+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 msgr2=0x7f1e841548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.626+0000 7f1e88ea1700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e841548e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c011f30 tx=0x7f1e7c00b040 comp rx=0 tx=0).stop 2023-10-06T02:48:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.626+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 shutdown_connections 2023-10-06T02:48:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.626+0000 7f1e88ea1700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e840c6dc0 0x7f1e840cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.626+0000 7f1e88ea1700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e70004d50 0x7f1e841548e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.626+0000 7f1e88ea1700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e64066f30 0x7f1e640693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.627+0000 7f1e88ea1700 1 --2- 172.21.15.81:0/1352440202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e84154e20 0x7f1e840c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.627+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 >> 172.21.15.81:0/1352440202 conn(0x7f1e8406bb90 msgr2=0x7f1e8415c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:04.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.627+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 shutdown_connections 2023-10-06T02:48:04.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.627+0000 7f1e88ea1700 1 -- 172.21.15.81:0/1352440202 wait complete. 2023-10-06T02:48:04.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:48:04.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.753+0000 7f46e2294700 1 Processor -- start 2023-10-06T02:48:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.753+0000 7f46e2294700 1 -- start start 2023-10-06T02:48:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.754+0000 7f46e2294700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46dc0aeea0 0x7f46dc0c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.754+0000 7f46e2294700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f46dc0c8410 0x7f46dc0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.754+0000 7f46e2294700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46dc06aae0 con 0x7f46dc0af270 2023-10-06T02:48:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.754+0000 7f46e2294700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc0c8810 con 0x7f46dc0aeea0 2023-10-06T02:48:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.754+0000 7f46e2294700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc069ed0 con 0x7f46dc0c8410 2023-10-06T02:48:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.754+0000 7f46dbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46dc0aeea0 0x7f46dc0c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.754+0000 7f46dbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46dc0aeea0 0x7f46dc0c2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56482/0 (socket says 172.21.15.81:56482) 2023-10-06T02:48:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.754+0000 7f46dbfff700 1 -- 172.21.15.81:0/1536963997 learned_addr learned my addr 172.21.15.81:0/1536963997 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46e0831700 1 --2- 172.21.15.81:0/1536963997 >> v2:172.21.15.83:3300/0 conn(0x7f46dc0c8410 0x7f46dc0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46dbfff700 1 -- 172.21.15.81:0/1536963997 >> v2:172.21.15.83:3300/0 conn(0x7f46dc0c8410 msgr2=0x7f46dc0c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46dbfff700 1 --2- 172.21.15.81:0/1536963997 >> v2:172.21.15.83:3300/0 conn(0x7f46dc0c8410 0x7f46dc0c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46dbfff700 1 -- 172.21.15.81:0/1536963997 >> v1:172.21.15.83:6789/0 conn(0x7f46dc0af270 legacy=0x7f46dc0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46dbfff700 1 -- 172.21.15.81:0/1536963997 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc06a1b0 con 0x7f46dc0aeea0 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46dbfff700 1 --2- 172.21.15.81:0/1536963997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0aeea0 0x7f46dc0c2920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0cda70 tx=0x7f46d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae446907e1883442 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46daffd700 1 -- 172.21.15.81:0/1536963997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000b8b0 con 0x7f46dc0aeea0 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46daffd700 1 -- 172.21.15.81:0/1536963997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d000ba10 con 0x7f46dc0aeea0 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46daffd700 1 -- 172.21.15.81:0/1536963997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000bdb0 con 0x7f46dc0aeea0 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46e2294700 1 -- 172.21.15.81:0/1536963997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0aeea0 msgr2=0x7f46dc0c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46e2294700 1 --2- 172.21.15.81:0/1536963997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0aeea0 0x7f46dc0c2920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0cda70 tx=0x7f46d0009250 comp rx=0 tx=0).stop 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46e2294700 1 -- 172.21.15.81:0/1536963997 shutdown_connections 2023-10-06T02:48:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46e2294700 1 --2- 172.21.15.81:0/1536963997 >> v2:172.21.15.83:3300/0 conn(0x7f46dc0c8410 0x7f46dc0c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46e2294700 1 --2- 172.21.15.81:0/1536963997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0aeea0 0x7f46dc0c2920 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.755+0000 7f46e2294700 1 -- 172.21.15.81:0/1536963997 >> 172.21.15.81:0/1536963997 conn(0x7f46dc06c660 msgr2=0x7f46dc0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.756+0000 7f46e2294700 1 -- 172.21.15.81:0/1536963997 shutdown_connections 2023-10-06T02:48:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.756+0000 7f46e2294700 1 -- 172.21.15.81:0/1536963997 wait complete. 2023-10-06T02:48:04.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.757+0000 7f46e2294700 1 Processor -- start 2023-10-06T02:48:04.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.757+0000 7f46e2294700 1 -- start start 2023-10-06T02:48:04.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.757+0000 7f46e2294700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46dc0aeea0 0x7f46dc140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.757+0000 7f46e2294700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0af270 0x7f46dc157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.757+0000 7f46e2294700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46dc0c8410 0x7f46dc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.757+0000 7f46e2294700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc154810 con 0x7f46dc0af270 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.757+0000 7f46e2294700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc153c00 con 0x7f46dc0aeea0 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.757+0000 7f46e2294700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc153ee0 con 0x7f46dc0c8410 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46db7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0af270 0x7f46dc157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46db7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0af270 0x7f46dc157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56496/0 (socket says 172.21.15.81:56496) 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46db7fe700 1 -- 172.21.15.81:0/3193420107 learned_addr learned my addr 172.21.15.81:0/3193420107 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46e0831700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46dc0c8410 0x7f46dc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46dbfff700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46dc0aeea0 0x7f46dc140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46db7fe700 1 -- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46dc0c8410 msgr2=0x7f46dc06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46db7fe700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46dc0c8410 0x7f46dc06d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46db7fe700 1 -- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46dc0aeea0 msgr2=0x7f46dc140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46db7fe700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46dc0aeea0 0x7f46dc140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46db7fe700 1 -- 172.21.15.81:0/3193420107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00094f0 con 0x7f46dc0af270 2023-10-06T02:48:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46db7fe700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0af270 0x7f46dc157540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00c5d0 tx=0x7f46cc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46c3fff700 1 -- 172.21.15.81:0/3193420107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc011590 con 0x7f46dc0af270 2023-10-06T02:48:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46c3fff700 1 -- 172.21.15.81:0/3193420107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc011710 con 0x7f46dc0af270 2023-10-06T02:48:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46dc1541c0 con 0x7f46dc0af270 2023-10-06T02:48:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46c3fff700 1 -- 172.21.15.81:0/3193420107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc011ad0 con 0x7f46dc0af270 2023-10-06T02:48:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.758+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc1537c0 con 0x7f46dc0af270 2023-10-06T02:48:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.759+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46dc067bc0 con 0x7f46dc0af270 2023-10-06T02:48:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.759+0000 7f46c3fff700 1 -- 172.21.15.81:0/3193420107 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46cc01c460 con 0x7f46dc0af270 2023-10-06T02:48:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.760+0000 7f46c3fff700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f46c8066f60 0x7f46c8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.760+0000 7f46c3fff700 1 -- 172.21.15.81:0/3193420107 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f46cc0843d0 con 0x7f46dc0af270 2023-10-06T02:48:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.760+0000 7f46dbfff700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f46c8066f60 0x7f46c8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.760+0000 7f46dbfff700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f46c8066f60 0x7f46c8069410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0cda70 tx=0x7f46d0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.764+0000 7f46c3fff700 1 -- 172.21.15.81:0/3193420107 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46cc0514a0 con 0x7f46dc0af270 2023-10-06T02:48:04.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.988+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f46dc06a490 con 0x7f46dc0af270 2023-10-06T02:48:04.990 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:48:04.989+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.993+0000 7f46c3fff700 1 -- 172.21.15.81:0/3193420107 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f46cc054ac0 con 0x7f46dc0af270 2023-10-06T02:48:04.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f46c8066f60 msgr2=0x7f46c8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f46c8066f60 0x7f46c8069410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0cda70 tx=0x7f46d0016000 comp rx=0 tx=0).stop 2023-10-06T02:48:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0af270 msgr2=0x7f46dc157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0af270 0x7f46dc157540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00c5d0 tx=0x7f46cc007f60 comp rx=0 tx=0).stop 2023-10-06T02:48:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 shutdown_connections 2023-10-06T02:48:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46dc0c8410 0x7f46dc06d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f46c8066f60 0x7f46c8069410 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46dc0aeea0 0x7f46dc140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 --2- 172.21.15.81:0/3193420107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46dc0af270 0x7f46dc157540 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:04.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 >> 172.21.15.81:0/3193420107 conn(0x7f46dc06c660 msgr2=0x7f46dc155480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 shutdown_connections 2023-10-06T02:48:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:04.996+0000 7f46e2294700 1 -- 172.21.15.81:0/3193420107 wait complete. 2023-10-06T02:48:04.999 INFO:tasks.ceph.mds.c.smithi081.stderr: -9051> 2023-10-06T02:47:34.729+0000 7fa180699700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:48:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:48:05.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:48:05.027 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:48:05.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.126+0000 7fad76687700 1 Processor -- start 2023-10-06T02:48:05.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.126+0000 7fad76687700 1 -- start start 2023-10-06T02:48:05.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad76687700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 0x7fad7006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:05.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad76687700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fad7006ceb0 0x7fad70157130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad76687700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7006ac50 con 0x7fad70157670 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad76687700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7006a400 con 0x7fad7006ceb0 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad76687700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad700c8fd0 con 0x7fad70156d60 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6f7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fad7006ceb0 0x7fad70157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad74c24700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fad70157670 0x7fad700cae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:43858/0 (socket says 172.21.15.81:43858) 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad74c24700 1 -- 172.21.15.81:0/1020158869 learned_addr learned my addr 172.21.15.81:0/1020158869 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6ffff700 1 --2- 172.21.15.81:0/1020158869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 0x7fad7006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6effd700 1 -- 172.21.15.81:0/1020158869 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281858238 0 0) 0x7fad7006ac50 con 0x7fad70157670 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6effd700 1 -- 172.21.15.81:0/1020158869 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad58003570 con 0x7fad70157670 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6ffff700 1 -- 172.21.15.81:0/1020158869 >> v2:172.21.15.83:3300/0 conn(0x7fad7006ceb0 msgr2=0x7fad70157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:05.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6ffff700 1 --2- 172.21.15.81:0/1020158869 >> v2:172.21.15.83:3300/0 conn(0x7fad7006ceb0 0x7fad70157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6ffff700 1 -- 172.21.15.81:0/1020158869 >> v1:172.21.15.83:6789/0 conn(0x7fad70157670 legacy=0x7fad700cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6ffff700 1 -- 172.21.15.81:0/1020158869 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad700c8cf0 con 0x7fad70156d60 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6f7fe700 1 --2- 172.21.15.81:0/1020158869 >> v2:172.21.15.83:3300/0 conn(0x7fad7006ceb0 0x7fad70157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.127+0000 7fad6ffff700 1 --2- 172.21.15.81:0/1020158869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 0x7fad7006b0e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad600098e0 tx=0x7fad600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28dd35610242be41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad6effd700 1 -- 172.21.15.81:0/1020158869 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60011630 con 0x7fad70156d60 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad6effd700 1 -- 172.21.15.81:0/1020158869 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60011790 con 0x7fad70156d60 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad6effd700 1 -- 172.21.15.81:0/1020158869 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60011b10 con 0x7fad70156d60 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad76687700 1 -- 172.21.15.81:0/1020158869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 msgr2=0x7fad7006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad76687700 1 --2- 172.21.15.81:0/1020158869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 0x7fad7006b0e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad600098e0 tx=0x7fad600091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad76687700 1 -- 172.21.15.81:0/1020158869 shutdown_connections 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad76687700 1 --2- 172.21.15.81:0/1020158869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 0x7fad7006b0e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad76687700 1 --2- 172.21.15.81:0/1020158869 >> v2:172.21.15.83:3300/0 conn(0x7fad7006ceb0 0x7fad70157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad76687700 1 -- 172.21.15.81:0/1020158869 >> 172.21.15.81:0/1020158869 conn(0x7fad700c9ca0 msgr2=0x7fad700ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad76687700 1 -- 172.21.15.81:0/1020158869 shutdown_connections 2023-10-06T02:48:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.128+0000 7fad76687700 1 -- 172.21.15.81:0/1020158869 wait complete. 2023-10-06T02:48:05.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.129+0000 7fad76687700 1 Processor -- start 2023-10-06T02:48:05.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.129+0000 7fad76687700 1 -- start start 2023-10-06T02:48:05.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad76687700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad7006ceb0 0x7fad700aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:05.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad76687700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 0x7fad70158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad76687700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157670 0x7fad70158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad76687700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701592b0 con 0x7fad70157670 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad76687700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700af220 con 0x7fad7006ceb0 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad76687700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7016f420 con 0x7fad70156d60 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad74c24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157670 0x7fad70158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad74c24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157670 0x7fad70158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56520/0 (socket says 172.21.15.81:56520) 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad74c24700 1 -- 172.21.15.81:0/1742220424 learned_addr learned my addr 172.21.15.81:0/1742220424 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad6f7fe700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 0x7fad70158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.130+0000 7fad6ffff700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad7006ceb0 0x7fad700aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad74c24700 1 -- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 msgr2=0x7fad70158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad74c24700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 0x7fad70158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad74c24700 1 -- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad7006ceb0 msgr2=0x7fad700aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad74c24700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad7006ceb0 0x7fad700aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad74c24700 1 -- 172.21.15.81:0/1742220424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad64009420 con 0x7fad70157670 2023-10-06T02:48:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad74c24700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157670 0x7fad70158d70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fad6800cc40 tx=0x7fad68001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad57fff700 1 -- 172.21.15.81:0/1742220424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800a830 con 0x7fad70157670 2023-10-06T02:48:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad57fff700 1 -- 172.21.15.81:0/1742220424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6800a990 con 0x7fad70157670 2023-10-06T02:48:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad60009420 con 0x7fad70157670 2023-10-06T02:48:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad57fff700 1 -- 172.21.15.81:0/1742220424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800ad10 con 0x7fad70157670 2023-10-06T02:48:05.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.131+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad70171ed0 con 0x7fad70157670 2023-10-06T02:48:05.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.132+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad70068080 con 0x7fad70157670 2023-10-06T02:48:05.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.132+0000 7fad57fff700 1 -- 172.21.15.81:0/1742220424 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad68007300 con 0x7fad70157670 2023-10-06T02:48:05.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.133+0000 7fad57fff700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:05.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.133+0000 7fad57fff700 1 -- 172.21.15.81:0/1742220424 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fad680849b0 con 0x7fad70157670 2023-10-06T02:48:05.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.133+0000 7fad6ffff700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:05.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.133+0000 7fad6ffff700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fad600091e0 tx=0x7fad60017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:05.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.137+0000 7fad57fff700 1 -- 172.21.15.81:0/1742220424 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad68051ab0 con 0x7fad70157670 2023-10-06T02:48:05.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.361+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fad7004bb80 con 0x7fad70157670 2023-10-06T02:48:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.997+0000 7fad57fff700 1 -- 172.21.15.81:0/1742220424 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fad680550d0 con 0x7fad70157670 2023-10-06T02:48:06.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 msgr2=0x7fad5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:06.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fad600091e0 tx=0x7fad60017000 comp rx=0 tx=0).stop 2023-10-06T02:48:06.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157670 msgr2=0x7fad70158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:06.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157670 0x7fad70158d70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fad6800cc40 tx=0x7fad68001a40 comp rx=0 tx=0).stop 2023-10-06T02:48:06.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 shutdown_connections 2023-10-06T02:48:06.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad70157670 0x7fad70158d70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:06.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad7006ceb0 0x7fad700aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 --2- 172.21.15.81:0/1742220424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad70156d60 0x7fad70158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:05.999+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 >> 172.21.15.81:0/1742220424 conn(0x7fad700c9ca0 msgr2=0x7fad700c2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.000+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 shutdown_connections 2023-10-06T02:48:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.000+0000 7fad76687700 1 -- 172.21.15.81:0/1742220424 wait complete. 2023-10-06T02:48:06.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:48:06.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.288+0000 7f3486790700 1 Processor -- start 2023-10-06T02:48:06.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.288+0000 7f3486790700 1 -- start start 2023-10-06T02:48:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f3486790700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3480157fe0 0x7f34800b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:06.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f3486790700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34800cf240 0x7f34800b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:06.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f3486790700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34800b2890 con 0x7f34801583b0 2023-10-06T02:48:06.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f3486790700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34800b4070 con 0x7f3480157fe0 2023-10-06T02:48:06.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f3486790700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34800b4350 con 0x7f34800cf240 2023-10-06T02:48:06.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f347ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3480157fe0 0x7f34800b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:06.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f347ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3480157fe0 0x7f34800b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56532/0 (socket says 172.21.15.81:56532) 2023-10-06T02:48:06.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f347ffff700 1 -- 172.21.15.81:0/1846018601 learned_addr learned my addr 172.21.15.81:0/1846018601 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:06.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f347ffff700 1 -- 172.21.15.81:0/1846018601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34800cf240 msgr2=0x7f34800b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:06.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f3484d2d700 1 --2- 172.21.15.81:0/1846018601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34800cf240 0x7f34800b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:06.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f347ffff700 1 --2- 172.21.15.81:0/1846018601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34800cf240 0x7f34800b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.289+0000 7f347ffff700 1 -- 172.21.15.81:0/1846018601 >> v1:172.21.15.83:6789/0 conn(0x7f34801583b0 legacy=0x7f34800ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f347ffff700 1 -- 172.21.15.81:0/1846018601 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34800b4630 con 0x7f3480157fe0 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f3484d2d700 1 --2- 172.21.15.81:0/1846018601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34800cf240 0x7f34800b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f347ffff700 1 --2- 172.21.15.81:0/1846018601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3480157fe0 0x7f34800b34c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f34700099b0 tx=0x7f3470009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccbace96c5eda8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f347effd700 1 -- 172.21.15.81:0/1846018601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347000b820 con 0x7f3480157fe0 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f347effd700 1 -- 172.21.15.81:0/1846018601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347000b980 con 0x7f3480157fe0 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f347effd700 1 -- 172.21.15.81:0/1846018601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347000bd40 con 0x7f3480157fe0 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f3486790700 1 -- 172.21.15.81:0/1846018601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3480157fe0 msgr2=0x7f34800b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f3486790700 1 --2- 172.21.15.81:0/1846018601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3480157fe0 0x7f34800b34c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f34700099b0 tx=0x7f3470009250 comp rx=0 tx=0).stop 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f3486790700 1 -- 172.21.15.81:0/1846018601 shutdown_connections 2023-10-06T02:48:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f3486790700 1 --2- 172.21.15.81:0/1846018601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34800cf240 0x7f34800b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f3486790700 1 --2- 172.21.15.81:0/1846018601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3480157fe0 0x7f34800b34c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f3486790700 1 -- 172.21.15.81:0/1846018601 >> 172.21.15.81:0/1846018601 conn(0x7f3480067640 msgr2=0x7f3480067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f3486790700 1 -- 172.21.15.81:0/1846018601 shutdown_connections 2023-10-06T02:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.290+0000 7f3486790700 1 -- 172.21.15.81:0/1846018601 wait complete. 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.291+0000 7f3486790700 1 Processor -- start 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3486790700 1 -- start start 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3486790700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34800cf240 0x7f34801501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3486790700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480157fe0 0x7f348015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3486790700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34801583b0 0x7f34800ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3486790700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348015b5b0 con 0x7f34801583b0 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3486790700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34801514e0 con 0x7f34800cf240 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3486790700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34801508d0 con 0x7f3480157fe0 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3484d2d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34801583b0 0x7f34800ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3484d2d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34801583b0 0x7f34800ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56534/0 (socket says 172.21.15.81:56534) 2023-10-06T02:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f3484d2d700 1 -- 172.21.15.81:0/4217143136 learned_addr learned my addr 172.21.15.81:0/4217143136 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.292+0000 7f347ffff700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34800cf240 0x7f34801501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f347f7fe700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480157fe0 0x7f348015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3484d2d700 1 -- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480157fe0 msgr2=0x7f348015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3484d2d700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480157fe0 0x7f348015b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3484d2d700 1 -- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34800cf240 msgr2=0x7f34801501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3484d2d700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34800cf240 0x7f34801501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3484d2d700 1 -- 172.21.15.81:0/4217143136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34700094f0 con 0x7f34801583b0 2023-10-06T02:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f347ffff700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34800cf240 0x7f34801501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3484d2d700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34801583b0 0x7f34800ccf00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f347800cef0 tx=0x7f3478007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3467fff700 1 -- 172.21.15.81:0/4217143136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347800ae00 con 0x7f34801583b0 2023-10-06T02:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3467fff700 1 -- 172.21.15.81:0/4217143136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3478016430 con 0x7f34801583b0 2023-10-06T02:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3480150bb0 con 0x7f34801583b0 2023-10-06T02:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3467fff700 1 -- 172.21.15.81:0/4217143136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780167f0 con 0x7f34801583b0 2023-10-06T02:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.293+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3480151170 con 0x7f34801583b0 2023-10-06T02:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.294+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3480069e40 con 0x7f34801583b0 2023-10-06T02:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.294+0000 7f3467fff700 1 -- 172.21.15.81:0/4217143136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3478003020 con 0x7f34801583b0 2023-10-06T02:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.295+0000 7f3467fff700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f346c066f30 0x7f346c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.295+0000 7f3467fff700 1 -- 172.21.15.81:0/4217143136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f3478012070 con 0x7f34801583b0 2023-10-06T02:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.295+0000 7f347ffff700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f346c066f30 0x7f346c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.295+0000 7f347ffff700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f346c066f30 0x7f346c0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f34700099b0 tx=0x7f3470016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.299+0000 7f3467fff700 1 -- 172.21.15.81:0/4217143136 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34780525e0 con 0x7f34801583b0 2023-10-06T02:48:06.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:06.483+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f34800cc6b0 con 0x7f34801583b0 2023-10-06T02:48:06.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:48:06.513 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:48:07.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.001+0000 7f3467fff700 1 -- 172.21.15.81:0/4217143136 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3478055c00 con 0x7f34801583b0 2023-10-06T02:48:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f346c066f30 msgr2=0x7f346c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f346c066f30 0x7f346c0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f34700099b0 tx=0x7f3470016000 comp rx=0 tx=0).stop 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34801583b0 msgr2=0x7f34800ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34801583b0 0x7f34800ccf00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f347800cef0 tx=0x7f3478007820 comp rx=0 tx=0).stop 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 shutdown_connections 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34801583b0 0x7f34800ccf00 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f346c066f30 0x7f346c0693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34800cf240 0x7f34801501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 --2- 172.21.15.81:0/4217143136 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480157fe0 0x7f348015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 >> 172.21.15.81:0/4217143136 conn(0x7f3480067640 msgr2=0x7f34801571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 shutdown_connections 2023-10-06T02:48:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.004+0000 7f3486790700 1 -- 172.21.15.81:0/4217143136 wait complete. 2023-10-06T02:48:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:48:07.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:48:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.134+0000 7fa3c3f1b700 1 Processor -- start 2023-10-06T02:48:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.134+0000 7fa3c3f1b700 1 -- start start 2023-10-06T02:48:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.135+0000 7fa3c3f1b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc157ca0 0x7fa3bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.135+0000 7fa3c3f1b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc0d07c0 con 0x7fa3bc06d120 2023-10-06T02:48:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.135+0000 7fa3c3f1b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc0cfbb0 con 0x7fa3bc1578d0 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.135+0000 7fa3c3f1b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0cfe90 con 0x7fa3bc157ca0 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.135+0000 7fa3c24b8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa3bc06d120 0x7fa3bc15b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47088/0 (socket says 172.21.15.81:47088) 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.135+0000 7fa3c24b8700 1 -- 172.21.15.81:0/668851055 learned_addr learned my addr 172.21.15.81:0/668851055 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c14b6700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc157ca0 0x7fa3bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231614901 0 0) 0x7fa3bc0d07c0 con 0x7fa3bc06d120 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a8003570 con 0x7fa3bc06d120 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446807023 0 0) 0x7fa3bc0cfbb0 con 0x7fa3bc1578d0 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3bc0d07c0 con 0x7fa3bc1578d0 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3848416154 0 0) 0x7fa3a8003570 con 0x7fa3bc06d120 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc157ca0 msgr2=0x7fa3bc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc157ca0 0x7fa3bc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 >> v1:172.21.15.83:6789/0 conn(0x7fa3bc1578d0 legacy=0x7fa3bc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc0d0170 con 0x7fa3bc06d120 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fa3b40017f0 con 0x7fa3bc06d120 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 >> v1:172.21.15.81:6789/0 conn(0x7fa3bc06d120 legacy=0x7fa3bc15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3a8003c20 0x7fa3a8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc157ca0 0x7fa3a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0cfe90 con 0x7fa3a8004810 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a800bb40 con 0x7fa3a8003c20 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a800bd00 con 0x7fa3bc157ca0 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c14b6700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c1cb7700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3a8003c20 0x7fa3a8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c24b8700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc157ca0 0x7fa3a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c14b6700 1 -- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc157ca0 msgr2=0x7fa3a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c14b6700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc157ca0 0x7fa3a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c14b6700 1 -- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3a8003c20 msgr2=0x7fa3a8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c14b6700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3a8003c20 0x7fa3a8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c14b6700 1 -- 172.21.15.81:0/668851055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8003570 con 0x7fa3a8004810 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.136+0000 7fa3c1cb7700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3a8003c20 0x7fa3a8004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c14b6700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3a8004c80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009be0 tx=0x7fa3ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c020ec706646a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00e710 con 0x7fa3a8004810 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac00e870 con 0x7fa3a8004810 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c0cb5700 1 -- 172.21.15.81:0/668851055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00ec30 con 0x7fa3a8004810 2023-10-06T02:48:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/668851055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 msgr2=0x7fa3a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:07.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c3f1b700 1 --2- 172.21.15.81:0/668851055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3a8004c80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009be0 tx=0x7fa3ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c24b8700 1 -- 172.21.15.81:0/668851055 reap_dead start 2023-10-06T02:48:07.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/668851055 shutdown_connections 2023-10-06T02:48:07.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/668851055 >> 172.21.15.81:0/668851055 conn(0x7fa3bc06bb90 msgr2=0x7fa3bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:07.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/668851055 shutdown_connections 2023-10-06T02:48:07.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.137+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/668851055 wait complete. 2023-10-06T02:48:07.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.138+0000 7fa3c3f1b700 1 Processor -- start 2023-10-06T02:48:07.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.138+0000 7fa3c3f1b700 1 -- start start 2023-10-06T02:48:07.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c3f1b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3bc0c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:07.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c3f1b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc16a190 0x7fa3bc148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:07.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c3f1b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc148880 0x7fa3bc0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c3f1b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0c6bd0 con 0x7fa3a8004810 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c3f1b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0b3c40 con 0x7fa3bc148880 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c3f1b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0b3f20 con 0x7fa3bc16a190 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c1cb7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3bc0c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c1cb7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3bc0c7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56552/0 (socket says 172.21.15.81:56552) 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c1cb7700 1 -- 172.21.15.81:0/1903939188 learned_addr learned my addr 172.21.15.81:0/1903939188 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c14b6700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc16a190 0x7fa3bc148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c24b8700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc148880 0x7fa3bc0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c1cb7700 1 -- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc16a190 msgr2=0x7fa3bc148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c1cb7700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc16a190 0x7fa3bc148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c1cb7700 1 -- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc148880 msgr2=0x7fa3bc0c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.139+0000 7fa3c1cb7700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc148880 0x7fa3bc0c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.140+0000 7fa3c1cb7700 1 -- 172.21.15.81:0/1903939188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc0b4200 con 0x7fa3a8004810 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.140+0000 7fa3c24b8700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc148880 0x7fa3bc0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.140+0000 7fa3c1cb7700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3bc0c7690 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800e840 tx=0x7fa3b8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.140+0000 7fa3b1ffb700 1 -- 172.21.15.81:0/1903939188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8006820 con 0x7fa3a8004810 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.140+0000 7fa3b1ffb700 1 -- 172.21.15.81:0/1903939188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8006980 con 0x7fa3a8004810 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.140+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc0b44e0 con 0x7fa3a8004810 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.140+0000 7fa3b1ffb700 1 -- 172.21.15.81:0/1903939188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8006d60 con 0x7fa3a8004810 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.140+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc0c7bd0 con 0x7fa3a8004810 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.141+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc0b46d0 con 0x7fa3a8004810 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.141+0000 7fa3b1ffb700 1 -- 172.21.15.81:0/1903939188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3b8007230 con 0x7fa3a8004810 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.141+0000 7fa3b1ffb700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa3a0066f30 0x7fa3a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:07.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.142+0000 7fa3b1ffb700 1 -- 172.21.15.81:0/1903939188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5764+0+0 (secure 0 0 0) 0x7fa3b8084790 con 0x7fa3a8004810 2023-10-06T02:48:07.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.142+0000 7fa3c14b6700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa3a0066f30 0x7fa3a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:07.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.142+0000 7fa3c14b6700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa3a0066f30 0x7fa3a00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc15b7a0 tx=0x7fa3ac019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:07.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.146+0000 7fa3b1ffb700 1 -- 172.21.15.81:0/1903939188 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3b80519c0 con 0x7fa3a8004810 2023-10-06T02:48:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:07.326+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3bc0d0450 con 0x7fa3a8004810 2023-10-06T02:48:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.007+0000 7fa3b1ffb700 1 -- 172.21.15.81:0/1903939188 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa3b8054fe0 con 0x7fa3a8004810 2023-10-06T02:48:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa3a0066f30 msgr2=0x7fa3a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa3a0066f30 0x7fa3a00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc15b7a0 tx=0x7fa3ac019000 comp rx=0 tx=0).stop 2023-10-06T02:48:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 msgr2=0x7fa3bc0c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3bc0c7690 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800e840 tx=0x7fa3b8009040 comp rx=0 tx=0).stop 2023-10-06T02:48:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 shutdown_connections 2023-10-06T02:48:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa3a0066f30 0x7fa3a00693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc148880 0x7fa3bc0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8004810 0x7fa3bc0c7690 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 --2- 172.21.15.81:0/1903939188 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3bc16a190 0x7fa3bc148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 >> 172.21.15.81:0/1903939188 conn(0x7fa3bc06bb90 msgr2=0x7fa3bc1568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 shutdown_connections 2023-10-06T02:48:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.010+0000 7fa3c3f1b700 1 -- 172.21.15.81:0/1903939188 wait complete. 2023-10-06T02:48:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:48:08.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:48:08.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.140+0000 7f6d8d11f700 1 Processor -- start 2023-10-06T02:48:08.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.140+0000 7f6d8d11f700 1 -- start start 2023-10-06T02:48:08.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d8d11f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d880d0b80 0x7f6d880cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d8d11f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d880d02b0 0x7f6d8806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d8d11f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d880cf2d0 con 0x7f6d880d0f50 2023-10-06T02:48:08.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d8d11f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8815a690 con 0x7f6d880d0b80 2023-10-06T02:48:08.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d8d11f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8806dc00 con 0x7f6d880d02b0 2023-10-06T02:48:08.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d8c91e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6d880d0f50 0x7f6d8815b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47104/0 (socket says 172.21.15.81:47104) 2023-10-06T02:48:08.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d8c91e700 1 -- 172.21.15.81:0/3561334210 learned_addr learned my addr 172.21.15.81:0/3561334210 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:08.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d87fff700 1 --2- 172.21.15.81:0/3561334210 >> v2:172.21.15.83:3300/0 conn(0x7f6d880d0b80 0x7f6d880cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d877fe700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d880d02b0 0x7f6d8806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601227841 0 0) 0x7f6d880cf2d0 con 0x7f6d880d0f50 2023-10-06T02:48:08.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d70003570 con 0x7f6d880d0f50 2023-10-06T02:48:08.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 169185367 0 0) 0x7f6d70003570 con 0x7f6d880d0f50 2023-10-06T02:48:08.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d880d02b0 msgr2=0x7f6d8806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:08.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d86ffd700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d880d02b0 0x7f6d8806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 >> v2:172.21.15.83:3300/0 conn(0x7f6d880d0b80 msgr2=0x7f6d880cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:08.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d86ffd700 1 --2- 172.21.15.81:0/3561334210 >> v2:172.21.15.83:3300/0 conn(0x7f6d880d0b80 0x7f6d880cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.141+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d880cf570 con 0x7f6d880d0f50 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f6d800017f0 con 0x7f6d880d0f50 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d87fff700 1 --2- 172.21.15.81:0/3561334210 >> v2:172.21.15.83:3300/0 conn(0x7f6d880d0b80 0x7f6d880cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 >> v1:172.21.15.81:6789/0 conn(0x7f6d880d0f50 legacy=0x7f6d8815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d70003a60 0x7f6d70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d880d02b0 0x7f6d70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70004d50 0x7f6d700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815a690 con 0x7f6d70003a60 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8806dc00 con 0x7f6d70004d50 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7000ba60 con 0x7f6d880d02b0 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d87fff700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d70003a60 0x7f6d70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d877fe700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d880d02b0 0x7f6d70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d8c91e700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70004d50 0x7f6d700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d87fff700 1 -- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d880d02b0 msgr2=0x7f6d70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d87fff700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d880d02b0 0x7f6d70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d87fff700 1 -- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70004d50 msgr2=0x7f6d700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d87fff700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70004d50 0x7f6d700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d87fff700 1 -- 172.21.15.81:0/3561334210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70003570 con 0x7f6d70003a60 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d8c91e700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70004d50 0x7f6d700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d87fff700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d70003a60 0x7f6d70003e70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009df0 tx=0x7f6d780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3851c2d61e8e785 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7800e8c0 con 0x7f6d70003a60 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7800ea20 con 0x7f6d70003a60 2023-10-06T02:48:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.142+0000 7f6d86ffd700 1 -- 172.21.15.81:0/3561334210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7800edc0 con 0x7f6d70003a60 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.143+0000 7f6d8d11f700 1 -- 172.21.15.81:0/3561334210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d70003a60 msgr2=0x7f6d70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.143+0000 7f6d8d11f700 1 --2- 172.21.15.81:0/3561334210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d70003a60 0x7f6d70003e70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009df0 tx=0x7f6d780091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.143+0000 7f6d8c91e700 1 -- 172.21.15.81:0/3561334210 reap_dead start 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.143+0000 7f6d8d11f700 1 -- 172.21.15.81:0/3561334210 shutdown_connections 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.143+0000 7f6d8d11f700 1 -- 172.21.15.81:0/3561334210 >> 172.21.15.81:0/3561334210 conn(0x7f6d88063230 msgr2=0x7f6d88063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.143+0000 7f6d8d11f700 1 -- 172.21.15.81:0/3561334210 shutdown_connections 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.143+0000 7f6d8d11f700 1 -- 172.21.15.81:0/3561334210 wait complete. 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.144+0000 7f6d8d11f700 1 Processor -- start 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.144+0000 7f6d8d11f700 1 -- start start 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8d11f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70003a60 0x7f6d88169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8d11f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d88157550 0x7f6d88155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8d11f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8815cdd0 0x7f6d8815d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8d11f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88156660 con 0x7f6d8815cdd0 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8d11f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88169fe0 con 0x7f6d70003a60 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8d11f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88155b80 con 0x7f6d88157550 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8c91e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8815cdd0 0x7f6d8815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8c91e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8815cdd0 0x7f6d8815d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56570/0 (socket says 172.21.15.81:56570) 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8c91e700 1 -- 172.21.15.81:0/4036379300 learned_addr learned my addr 172.21.15.81:0/4036379300 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d877fe700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d88157550 0x7f6d88155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d87fff700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70003a60 0x7f6d88169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8c91e700 1 -- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d88157550 msgr2=0x7f6d88155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8c91e700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d88157550 0x7f6d88155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8c91e700 1 -- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70003a60 msgr2=0x7f6d88169aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8c91e700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70003a60 0x7f6d88169aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8c91e700 1 -- 172.21.15.81:0/4036379300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8815f0f0 con 0x7f6d8815cdd0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8c91e700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8815cdd0 0x7f6d8815d220 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6d880d1320 tx=0x7f6d880cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d6ffff700 1 -- 172.21.15.81:0/4036379300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80017070 con 0x7f6d8815cdd0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d6ffff700 1 -- 172.21.15.81:0/4036379300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000ec30 con 0x7f6d8815cdd0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d6ffff700 1 -- 172.21.15.81:0/4036379300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80013420 con 0x7f6d8815cdd0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.145+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8815d760 con 0x7f6d8815cdd0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.146+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d88155e40 con 0x7f6d8815cdd0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.146+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8815f280 con 0x7f6d8815cdd0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.147+0000 7f6d6ffff700 1 -- 172.21.15.81:0/4036379300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d80013850 con 0x7f6d8815cdd0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.147+0000 7f6d6ffff700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d74066f60 0x7f6d74069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.147+0000 7f6d6ffff700 1 -- 172.21.15.81:0/4036379300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6d80084280 con 0x7f6d8815cdd0 2023-10-06T02:48:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.148+0000 7f6d87fff700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d74066f60 0x7f6d74069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.148+0000 7f6d87fff700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d74066f60 0x7f6d74069410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6d78006ed0 tx=0x7f6d7801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:08.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.152+0000 7f6d6ffff700 1 -- 172.21.15.81:0/4036379300 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d80051690 con 0x7f6d8815cdd0 2023-10-06T02:48:08.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.342+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6d880676e0 con 0x7f6d8815cdd0 2023-10-06T02:48:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.345+0000 7f6d6ffff700 1 -- 172.21.15.81:0/4036379300 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6d80054cb0 con 0x7f6d8815cdd0 2023-10-06T02:48:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.347+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d74066f60 msgr2=0x7f6d74069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.347+0000 7f6d8d11f700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d74066f60 0x7f6d74069410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6d78006ed0 tx=0x7f6d7801a000 comp rx=0 tx=0).stop 2023-10-06T02:48:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8815cdd0 msgr2=0x7f6d8815d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8815cdd0 0x7f6d8815d220 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6d880d1320 tx=0x7f6d880cf460 comp rx=0 tx=0).stop 2023-10-06T02:48:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 shutdown_connections 2023-10-06T02:48:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8815cdd0 0x7f6d8815d220 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d74066f60 0x7f6d74069410 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d70003a60 0x7f6d88169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 --2- 172.21.15.81:0/4036379300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d88157550 0x7f6d88155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 >> 172.21.15.81:0/4036379300 conn(0x7f6d88063230 msgr2=0x7f6d880b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 shutdown_connections 2023-10-06T02:48:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.348+0000 7f6d8d11f700 1 -- 172.21.15.81:0/4036379300 wait complete. 2023-10-06T02:48:08.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-06T02:48:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.473+0000 7f6bc469e700 1 Processor -- start 2023-10-06T02:48:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.473+0000 7f6bc469e700 1 -- start start 2023-10-06T02:48:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.474+0000 7f6bc469e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6bbc156420 0x7f6bbc0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.474+0000 7f6bc469e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 0x7f6bbc0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.474+0000 7f6bc469e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc0cb880 con 0x7f6bbc0cc250 2023-10-06T02:48:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.474+0000 7f6bc469e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc0c7bb0 con 0x7f6bbc156420 2023-10-06T02:48:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.474+0000 7f6bc469e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc06aa10 con 0x7f6bbc0c71d0 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc243a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6bbc156420 0x7f6bbc0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc2c3b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 0x7f6bbc0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc243a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6bbc156420 0x7f6bbc0cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:49122/0 (socket says 172.21.15.81:49122) 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc1c39700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6bbc0cc250 0x7f6bbc069440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:43880/0 (socket says 172.21.15.81:43880) 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc243a700 1 -- 172.21.15.81:0/1575460396 learned_addr learned my addr 172.21.15.81:0/1575460396 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc2c3b700 1 -- 172.21.15.81:0/1575460396 >> v2:172.21.15.83:3300/0 conn(0x7f6bbc156420 msgr2=0x7f6bbc0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc2c3b700 1 --2- 172.21.15.81:0/1575460396 >> v2:172.21.15.83:3300/0 conn(0x7f6bbc156420 0x7f6bbc0cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc2c3b700 1 -- 172.21.15.81:0/1575460396 >> v1:172.21.15.83:6789/0 conn(0x7f6bbc0cc250 legacy=0x7f6bbc069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc2c3b700 1 -- 172.21.15.81:0/1575460396 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0cac70 con 0x7f6bbc0c71d0 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc243a700 1 --2- 172.21.15.81:0/1575460396 >> v2:172.21.15.83:3300/0 conn(0x7f6bbc156420 0x7f6bbc0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:48:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc2c3b700 1 --2- 172.21.15.81:0/1575460396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 0x7f6bbc0c7670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40098e0 tx=0x7f6bb40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d24fa2138af7fac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc1438700 1 -- 172.21.15.81:0/1575460396 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400b640 con 0x7f6bbc0c71d0 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc1438700 1 -- 172.21.15.81:0/1575460396 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb400b7a0 con 0x7f6bbc0c71d0 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.475+0000 7f6bc1438700 1 -- 172.21.15.81:0/1575460396 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400bb40 con 0x7f6bbc0c71d0 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.476+0000 7f6bc469e700 1 -- 172.21.15.81:0/1575460396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 msgr2=0x7f6bbc0c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.476+0000 7f6bc469e700 1 --2- 172.21.15.81:0/1575460396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 0x7f6bbc0c7670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40098e0 tx=0x7f6bb40091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.476+0000 7f6bc469e700 1 -- 172.21.15.81:0/1575460396 shutdown_connections 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.476+0000 7f6bc469e700 1 --2- 172.21.15.81:0/1575460396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 0x7f6bbc0c7670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.476+0000 7f6bc469e700 1 --2- 172.21.15.81:0/1575460396 >> v2:172.21.15.83:3300/0 conn(0x7f6bbc156420 0x7f6bbc0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.476+0000 7f6bc469e700 1 -- 172.21.15.81:0/1575460396 >> 172.21.15.81:0/1575460396 conn(0x7f6bbc06c660 msgr2=0x7f6bbc0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.476+0000 7f6bc469e700 1 -- 172.21.15.81:0/1575460396 shutdown_connections 2023-10-06T02:48:08.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.476+0000 7f6bc469e700 1 -- 172.21.15.81:0/1575460396 wait complete. 2023-10-06T02:48:08.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.477+0000 7f6bc469e700 1 Processor -- start 2023-10-06T02:48:08.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.477+0000 7f6bc469e700 1 -- start start 2023-10-06T02:48:08.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc469e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 0x7f6bbc156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc469e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bbc0cc250 0x7f6bbc145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc469e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc156420 0x7f6bbc1572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc469e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc1470d0 con 0x7f6bbc156420 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc469e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc1589f0 con 0x7f6bbc0cc250 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc469e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc146870 con 0x7f6bbc0c71d0 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc2c3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc156420 0x7f6bbc1572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc2c3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc156420 0x7f6bbc1572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56576/0 (socket says 172.21.15.81:56576) 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc2c3b700 1 -- 172.21.15.81:0/1358495397 learned_addr learned my addr 172.21.15.81:0/1358495397 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc1c39700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bbc0cc250 0x7f6bbc145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc243a700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 0x7f6bbc156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc2c3b700 1 -- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 msgr2=0x7f6bbc156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc2c3b700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 0x7f6bbc156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc2c3b700 1 -- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bbc0cc250 msgr2=0x7f6bbc145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc2c3b700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bbc0cc250 0x7f6bbc145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc2c3b700 1 -- 172.21.15.81:0/1358495397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009ae0 con 0x7f6bbc156420 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc1c39700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bbc0cc250 0x7f6bbc145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.478+0000 7f6bc2c3b700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc156420 0x7f6bbc1572a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc06ab50 tx=0x7f6bb4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.479+0000 7f6bb27fc700 1 -- 172.21.15.81:0/1358495397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400b640 con 0x7f6bbc156420 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.479+0000 7f6bb27fc700 1 -- 172.21.15.81:0/1358495397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb401be40 con 0x7f6bbc156420 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.479+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb4009420 con 0x7f6bbc156420 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.479+0000 7f6bb27fc700 1 -- 172.21.15.81:0/1358495397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4011860 con 0x7f6bbc156420 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.479+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc146df0 con 0x7f6bbc156420 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.480+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc067bc0 con 0x7f6bbc156420 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.480+0000 7f6bb27fc700 1 -- 172.21.15.81:0/1358495397 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bb4011bd0 con 0x7f6bbc156420 2023-10-06T02:48:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.480+0000 7f6bb27fc700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ba0066f30 0x7f6ba00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:08.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.481+0000 7f6bb27fc700 1 -- 172.21.15.81:0/1358495397 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6bb4085eb0 con 0x7f6bbc156420 2023-10-06T02:48:08.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.481+0000 7f6bc243a700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ba0066f30 0x7f6ba00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:08.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.481+0000 7f6bc243a700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ba0066f30 0x7f6ba00693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009ab0 tx=0x7f6bb800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:08.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.485+0000 7f6bb27fc700 1 -- 172.21.15.81:0/1358495397 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bb40532c0 con 0x7f6bbc156420 2023-10-06T02:48:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:08.740+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f6bbc0caf50 con 0x7f6bbc156420 2023-10-06T02:48:09.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.008+0000 7f6bb27fc700 1 -- 172.21.15.81:0/1358495397 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v131) v1 ==== 142+0+0 (secure 0 0 0) 0x7f6bb40568e0 con 0x7f6bbc156420 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ba0066f30 msgr2=0x7f6ba00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ba0066f30 0x7f6ba00693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009ab0 tx=0x7f6bb800b040 comp rx=0 tx=0).stop 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc156420 msgr2=0x7f6bbc1572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc156420 0x7f6bbc1572a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc06ab50 tx=0x7f6bb4017000 comp rx=0 tx=0).stop 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 shutdown_connections 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc156420 0x7f6bbc1572a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6bbc0c71d0 0x7f6bbc156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ba0066f30 0x7f6ba00693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 --2- 172.21.15.81:0/1358495397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6bbc0cc250 0x7f6bbc145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 >> 172.21.15.81:0/1358495397 conn(0x7f6bbc06c660 msgr2=0x7f6bbc0c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:09.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 shutdown_connections 2023-10-06T02:48:09.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.010+0000 7f6bc469e700 1 -- 172.21.15.81:0/1358495397 wait complete. 2023-10-06T02:48:09.023 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-06T02:48:09.023 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-10-06T02:48:09.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-06T02:48:09.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.136+0000 7faa0563c700 1 Processor -- start 2023-10-06T02:48:09.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.136+0000 7faa0563c700 1 -- start start 2023-10-06T02:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7faa0563c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faa00159b40 0x7faa000cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7faa0563c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00068e90 0x7faa000cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7faa0563c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa000cee10 con 0x7faa00159f10 2023-10-06T02:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7faa0563c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa000cd040 con 0x7faa00159b40 2023-10-06T02:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7faa0563c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa000cd320 con 0x7faa00068e90 2023-10-06T02:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7faa04e3b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00068e90 0x7faa000cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7fa9fffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faa00159b40 0x7faa000cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7fa9fffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faa00159b40 0x7faa000cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:49134/0 (socket says 172.21.15.81:49134) 2023-10-06T02:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7faa04e3b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00068e90 0x7faa000cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:56634/0 (socket says 172.21.15.81:56634) 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7fa9fffff700 1 -- 172.21.15.81:0/3394032091 learned_addr learned my addr 172.21.15.81:0/3394032091 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.137+0000 7fa9ff7fe700 1 --1- 172.21.15.81:0/3394032091 >> v1:172.21.15.83:6789/0 conn(0x7faa00159f10 0x7faa00068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:43882/0 (socket says 172.21.15.81:43882) 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7faa04e3b700 1 -- 172.21.15.81:0/3394032091 >> v2:172.21.15.83:3300/0 conn(0x7faa00159b40 msgr2=0x7faa000cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7faa04e3b700 1 --2- 172.21.15.81:0/3394032091 >> v2:172.21.15.83:3300/0 conn(0x7faa00159b40 0x7faa000cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7faa04e3b700 1 -- 172.21.15.81:0/3394032091 >> v1:172.21.15.83:6789/0 conn(0x7faa00159f10 legacy=0x7faa00068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7faa04e3b700 1 -- 172.21.15.81:0/3394032091 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa000ce7c0 con 0x7faa00068e90 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7fa9feffd700 1 -- 172.21.15.81:0/3394032091 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882395270 0 0) 0x7faa000cee10 con 0x7faa00159f10 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7fa9fffff700 1 --2- 172.21.15.81:0/3394032091 >> v2:172.21.15.83:3300/0 conn(0x7faa00159b40 0x7faa000cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7faa04e3b700 1 --2- 172.21.15.81:0/3394032091 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00068e90 0x7faa000cf2a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009e60 tx=0x7fa9f8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5800133f7a1c2fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7fa9feffd700 1 -- 172.21.15.81:0/3394032091 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800e070 con 0x7faa00068e90 2023-10-06T02:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7fa9feffd700 1 -- 172.21.15.81:0/3394032091 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f800bb60 con 0x7faa00068e90 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7fa9feffd700 1 -- 172.21.15.81:0/3394032091 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8012430 con 0x7faa00068e90 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7faa0563c700 1 -- 172.21.15.81:0/3394032091 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00068e90 msgr2=0x7faa000cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.138+0000 7faa0563c700 1 --2- 172.21.15.81:0/3394032091 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00068e90 0x7faa000cf2a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009e60 tx=0x7fa9f8009780 comp rx=0 tx=0).stop 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.139+0000 7faa0563c700 1 -- 172.21.15.81:0/3394032091 shutdown_connections 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.139+0000 7faa0563c700 1 --2- 172.21.15.81:0/3394032091 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00068e90 0x7faa000cf2a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.139+0000 7faa0563c700 1 --2- 172.21.15.81:0/3394032091 >> v2:172.21.15.83:3300/0 conn(0x7faa00159b40 0x7faa000cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.139+0000 7faa0563c700 1 -- 172.21.15.81:0/3394032091 >> 172.21.15.81:0/3394032091 conn(0x7faa000cd660 msgr2=0x7faa000cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.139+0000 7faa0563c700 1 -- 172.21.15.81:0/3394032091 shutdown_connections 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.139+0000 7faa0563c700 1 -- 172.21.15.81:0/3394032091 wait complete. 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.140+0000 7faa0563c700 1 Processor -- start 2023-10-06T02:48:09.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.140+0000 7faa0563c700 1 -- start start 2023-10-06T02:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.140+0000 7faa0563c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa00068e90 0x7faa0015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.140+0000 7faa0563c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa00159b40 0x7faa0016e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.140+0000 7faa0563c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00159f10 0x7faa00169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.140+0000 7faa0563c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa00157090 con 0x7faa00159b40 2023-10-06T02:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7faa0563c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0015a840 con 0x7faa00068e90 2023-10-06T02:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7faa0563c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa00156480 con 0x7faa00159f10 2023-10-06T02:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa00159b40 0x7faa0016e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9fffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa00068e90 0x7faa0015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa00159b40 0x7faa0016e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56584/0 (socket says 172.21.15.81:56584) 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9ff7fe700 1 -- 172.21.15.81:0/2323282724 learned_addr learned my addr 172.21.15.81:0/2323282724 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7faa04e3b700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00159f10 0x7faa00169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9ff7fe700 1 -- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00159f10 msgr2=0x7faa00169c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9ff7fe700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00159f10 0x7faa00169c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9ff7fe700 1 -- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa00068e90 msgr2=0x7faa0015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9ff7fe700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa00068e90 0x7faa0015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9ff7fe700 1 -- 172.21.15.81:0/2323282724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00094f0 con 0x7faa00159b40 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9ff7fe700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa00159b40 0x7faa0016e050 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c5b0 tx=0x7fa9f4001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9e7fff700 1 -- 172.21.15.81:0/2323282724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4005a70 con 0x7faa00159b40 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9e7fff700 1 -- 172.21.15.81:0/2323282724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4005bd0 con 0x7faa00159b40 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7fa9e7fff700 1 -- 172.21.15.81:0/2323282724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40070d0 con 0x7faa00159b40 2023-10-06T02:48:09.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f8009a20 con 0x7faa00159b40 2023-10-06T02:48:09.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.141+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa00156a40 con 0x7faa00159b40 2023-10-06T02:48:09.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.142+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa00157420 con 0x7faa00159b40 2023-10-06T02:48:09.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.143+0000 7fa9e7fff700 1 -- 172.21.15.81:0/2323282724 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9f4007480 con 0x7faa00159b40 2023-10-06T02:48:09.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.143+0000 7fa9e7fff700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9ec066f30 0x7fa9ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:09.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.143+0000 7fa9e7fff700 1 -- 172.21.15.81:0/2323282724 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa9f40837e0 con 0x7faa00159b40 2023-10-06T02:48:09.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.143+0000 7fa9fffff700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9ec066f30 0x7fa9ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:09.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.144+0000 7fa9fffff700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9ec066f30 0x7fa9ec0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0006d20 tx=0x7fa9f0009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:09.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.147+0000 7fa9e7fff700 1 -- 172.21.15.81:0/2323282724 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa00157420 con 0x7faa00159b40 2023-10-06T02:48:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:09.407+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7faa00157420 con 0x7faa00159b40 2023-10-06T02:48:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.009+0000 7fa9e7fff700 1 -- 172.21.15.81:0/2323282724 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v132) v1 ==== 137+0+0 (secure 0 0 0) 0x7faa00157420 con 0x7faa00159b40 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9ec066f30 msgr2=0x7fa9ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9ec066f30 0x7fa9ec0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0006d20 tx=0x7fa9f0009250 comp rx=0 tx=0).stop 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa00159b40 msgr2=0x7faa0016e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa00159b40 0x7faa0016e050 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c5b0 tx=0x7fa9f4001040 comp rx=0 tx=0).stop 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 shutdown_connections 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa00159f10 0x7faa00169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9ec066f30 0x7fa9ec0693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa00068e90 0x7faa0015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 --2- 172.21.15.81:0/2323282724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa00159b40 0x7faa0016e050 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 >> 172.21.15.81:0/2323282724 conn(0x7faa000cd660 msgr2=0x7faa0006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 shutdown_connections 2023-10-06T02:48:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.011+0000 7faa0563c700 1 -- 172.21.15.81:0/2323282724 wait complete. 2023-10-06T02:48:10.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-06T02:48:10.155 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-06T02:48:10.155 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-06T02:48:10.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:48:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.272+0000 7f62492d1700 1 Processor -- start 2023-10-06T02:48:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.272+0000 7f62492d1700 1 -- start start 2023-10-06T02:48:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.273+0000 7f62492d1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6244157ca0 0x7f62440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.273+0000 7f62492d1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f624406d120 0x7f624406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.273+0000 7f62492d1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62440d07c0 con 0x7f62441578d0 2023-10-06T02:48:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.273+0000 7f62492d1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624406da50 con 0x7f6244157ca0 2023-10-06T02:48:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.273+0000 7f62492d1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62440cfbb0 con 0x7f624406d120 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.273+0000 7f6242ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f62441578d0 0x7f624415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47118/0 (socket says 172.21.15.81:47118) 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.273+0000 7f623a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6244157ca0 0x7f62440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.273+0000 7f6242ffd700 1 -- 172.21.15.81:0/2212528385 learned_addr learned my addr 172.21.15.81:0/2212528385 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.273+0000 7f62437fe700 1 --2- 172.21.15.81:0/2212528385 >> v2:172.21.15.83:3300/0 conn(0x7f624406d120 0x7f624406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f623a7fc700 1 -- 172.21.15.81:0/2212528385 >> v2:172.21.15.83:3300/0 conn(0x7f624406d120 msgr2=0x7f624406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f623a7fc700 1 --2- 172.21.15.81:0/2212528385 >> v2:172.21.15.83:3300/0 conn(0x7f624406d120 0x7f624406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f623a7fc700 1 -- 172.21.15.81:0/2212528385 >> v1:172.21.15.81:6789/0 conn(0x7f62441578d0 legacy=0x7f624415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f623a7fc700 1 -- 172.21.15.81:0/2212528385 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440cfe90 con 0x7f6244157ca0 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62427fc700 1 -- 172.21.15.81:0/2212528385 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006568998 0 0) 0x7f62440d07c0 con 0x7f62441578d0 2023-10-06T02:48:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f623a7fc700 1 --2- 172.21.15.81:0/2212528385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 0x7f62440cf4f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6244068300 tx=0x7f622c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7182449a7a0842 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62427fc700 1 -- 172.21.15.81:0/2212528385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c011630 con 0x7f6244157ca0 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62427fc700 1 -- 172.21.15.81:0/2212528385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c011790 con 0x7f6244157ca0 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62427fc700 1 -- 172.21.15.81:0/2212528385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c011b30 con 0x7f6244157ca0 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62492d1700 1 -- 172.21.15.81:0/2212528385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 msgr2=0x7f62440cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62492d1700 1 --2- 172.21.15.81:0/2212528385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 0x7f62440cf4f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6244068300 tx=0x7f622c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62492d1700 1 -- 172.21.15.81:0/2212528385 shutdown_connections 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62492d1700 1 --2- 172.21.15.81:0/2212528385 >> v2:172.21.15.83:3300/0 conn(0x7f624406d120 0x7f624406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62492d1700 1 --2- 172.21.15.81:0/2212528385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 0x7f62440cf4f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.274+0000 7f62492d1700 1 -- 172.21.15.81:0/2212528385 >> 172.21.15.81:0/2212528385 conn(0x7f624406bb90 msgr2=0x7f624406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.275+0000 7f62492d1700 1 -- 172.21.15.81:0/2212528385 shutdown_connections 2023-10-06T02:48:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.275+0000 7f62492d1700 1 -- 172.21.15.81:0/2212528385 wait complete. 2023-10-06T02:48:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.276+0000 7f62492d1700 1 Processor -- start 2023-10-06T02:48:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.276+0000 7f62492d1700 1 -- start start 2023-10-06T02:48:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.276+0000 7f62492d1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f624406d120 0x7f6244153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.276+0000 7f62492d1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62441578d0 0x7f62440b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.276+0000 7f62492d1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 0x7f624416a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.276+0000 7f62492d1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62440b5f80 con 0x7f6244157ca0 2023-10-06T02:48:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.276+0000 7f62492d1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62440ab570 con 0x7f62441578d0 2023-10-06T02:48:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.276+0000 7f62492d1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62440aac40 con 0x7f624406d120 2023-10-06T02:48:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 0x7f624416a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 0x7f624416a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56588/0 (socket says 172.21.15.81:56588) 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62437fe700 1 -- 172.21.15.81:0/1888715508 learned_addr learned my addr 172.21.15.81:0/1888715508 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f623a7fc700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62441578d0 0x7f62440b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f6242ffd700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f624406d120 0x7f6244153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62437fe700 1 -- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f624406d120 msgr2=0x7f6244153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62437fe700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f624406d120 0x7f6244153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62437fe700 1 -- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62441578d0 msgr2=0x7f62440b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62437fe700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62441578d0 0x7f62440b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62437fe700 1 -- 172.21.15.81:0/1888715508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c009420 con 0x7f6244157ca0 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62437fe700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 0x7f624416a4c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f623c009e90 tx=0x7f623c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f623b7fe700 1 -- 172.21.15.81:0/1888715508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00cb70 con 0x7f6244157ca0 2023-10-06T02:48:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f623b7fe700 1 -- 172.21.15.81:0/1888715508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c00f040 con 0x7f6244157ca0 2023-10-06T02:48:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62440aaf20 con 0x7f6244157ca0 2023-10-06T02:48:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f623b7fe700 1 -- 172.21.15.81:0/1888715508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c014480 con 0x7f6244157ca0 2023-10-06T02:48:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.277+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6244153f40 con 0x7f6244157ca0 2023-10-06T02:48:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.278+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6244067ac0 con 0x7f6244157ca0 2023-10-06T02:48:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.279+0000 7f623b7fe700 1 -- 172.21.15.81:0/1888715508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f623c0147f0 con 0x7f6244157ca0 2023-10-06T02:48:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.279+0000 7f623b7fe700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.279+0000 7f623b7fe700 1 -- 172.21.15.81:0/1888715508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f623c085040 con 0x7f6244157ca0 2023-10-06T02:48:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.279+0000 7f6242ffd700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.280+0000 7f6242ffd700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6224066f30 0x7f62240693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6234007fd0 tx=0x7f6234007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.283+0000 7f623b7fe700 1 -- 172.21.15.81:0/1888715508 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f623c052450 con 0x7f6244157ca0 2023-10-06T02:48:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.466+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f62440d0170 con 0x7f6244157ca0 2023-10-06T02:48:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.469+0000 7f623b7fe700 1 -- 172.21.15.81:0/1888715508 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f623c055a70 con 0x7f6244157ca0 2023-10-06T02:48:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6224066f30 msgr2=0x7f62240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6224066f30 0x7f62240693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6234007fd0 tx=0x7f6234007d30 comp rx=0 tx=0).stop 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 msgr2=0x7f624416a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 0x7f624416a4c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f623c009e90 tx=0x7f623c00b040 comp rx=0 tx=0).stop 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 shutdown_connections 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6244157ca0 0x7f624416a4c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f624406d120 0x7f6244153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 --2- 172.21.15.81:0/1888715508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62441578d0 0x7f62440b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 >> 172.21.15.81:0/1888715508 conn(0x7f624406bb90 msgr2=0x7f624406a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 shutdown_connections 2023-10-06T02:48:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.471+0000 7f62492d1700 1 -- 172.21.15.81:0/1888715508 wait complete. 2023-10-06T02:48:10.485 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:48:10.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:48:10.529 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:48:10.572 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:48:10.573 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:48:10.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:48:10.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.686+0000 7f7e4a4e6700 1 Processor -- start 2023-10-06T02:48:10.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.686+0000 7f7e4a4e6700 1 -- start start 2023-10-06T02:48:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.686+0000 7f7e4a4e6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e44157fe0 0x7f7e440b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.686+0000 7f7e4a4e6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7e440cf240 0x7f7e440b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.686+0000 7f7e4a4e6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e440b2890 con 0x7f7e441583b0 2023-10-06T02:48:10.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.686+0000 7f7e4a4e6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e440b4070 con 0x7f7e440cf240 2023-10-06T02:48:10.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.686+0000 7f7e4a4e6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440b4350 con 0x7f7e44157fe0 2023-10-06T02:48:10.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e437fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7e441583b0 0x7f7e440ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44678/0 (socket says 172.21.15.81:44678) 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e437fe700 1 -- 172.21.15.81:0/1191775632 learned_addr learned my addr 172.21.15.81:0/1191775632 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e48a83700 1 --2- 172.21.15.81:0/1191775632 >> v2:172.21.15.83:3300/0 conn(0x7f7e440cf240 0x7f7e440b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e43fff700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e44157fe0 0x7f7e440b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403918254 0 0) 0x7f7e440b2890 con 0x7f7e441583b0 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e2c003570 con 0x7f7e441583b0 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710416708 0 0) 0x7f7e2c003570 con 0x7f7e441583b0 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e44157fe0 msgr2=0x7f7e440b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e44157fe0 0x7f7e440b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 >> v2:172.21.15.83:3300/0 conn(0x7f7e440cf240 msgr2=0x7f7e440b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 --2- 172.21.15.81:0/1191775632 >> v2:172.21.15.83:3300/0 conn(0x7f7e440cf240 0x7f7e440b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440b4630 con 0x7f7e441583b0 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f7e38001470 con 0x7f7e441583b0 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 >> v1:172.21.15.81:6789/0 conn(0x7f7e441583b0 legacy=0x7f7e440ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e2c003a60 0x7f7e2c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e44157fe0 0x7f7e2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c004d50 0x7f7e2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440b4070 con 0x7f7e2c004d50 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440b4350 con 0x7f7e2c003a60 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c00bae0 con 0x7f7e44157fe0 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e48a83700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c004d50 0x7f7e2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e43fff700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e2c003a60 0x7f7e2c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.687+0000 7f7e437fe700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e44157fe0 0x7f7e2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e48a83700 1 -- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e44157fe0 msgr2=0x7f7e2c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e48a83700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e44157fe0 0x7f7e2c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e48a83700 1 -- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e2c003a60 msgr2=0x7f7e2c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e48a83700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e2c003a60 0x7f7e2c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e48a83700 1 -- 172.21.15.81:0/1191775632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c003570 con 0x7f7e2c004d50 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e48a83700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c004d50 0x7f7e2c0051c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7e4406abb0 tx=0x7f7e3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809d4456a77053f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00ea60 con 0x7f7e2c004d50 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00f040 con 0x7f7e2c004d50 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e42ffd700 1 -- 172.21.15.81:0/1191775632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00ee10 con 0x7f7e2c004d50 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1191775632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c004d50 msgr2=0x7f7e2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e4a4e6700 1 --2- 172.21.15.81:0/1191775632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c004d50 0x7f7e2c0051c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7e4406abb0 tx=0x7f7e3c00b040 comp rx=0 tx=0).stop 2023-10-06T02:48:10.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e48a83700 1 -- 172.21.15.81:0/1191775632 reap_dead start 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1191775632 shutdown_connections 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1191775632 >> 172.21.15.81:0/1191775632 conn(0x7f7e44067640 msgr2=0x7f7e44067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1191775632 shutdown_connections 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.688+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1191775632 wait complete. 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.689+0000 7f7e4a4e6700 1 Processor -- start 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.690+0000 7f7e4a4e6700 1 -- start start 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.690+0000 7f7e4a4e6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e441526e0 0x7f7e440c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.690+0000 7f7e4a4e6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e440c9450 0x7f7e440c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.690+0000 7f7e4a4e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e440c98c0 0x7f7e440c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.690+0000 7f7e4a4e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c7cf0 con 0x7f7e440c98c0 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.690+0000 7f7e4a4e6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c4c50 con 0x7f7e440c9450 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.690+0000 7f7e4a4e6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c4f30 con 0x7f7e441526e0 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e48a83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e440c98c0 0x7f7e440c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e48a83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e440c98c0 0x7f7e440c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48842/0 (socket says 172.21.15.81:48842) 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e48a83700 1 -- 172.21.15.81:0/1290855540 learned_addr learned my addr 172.21.15.81:0/1290855540 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e437fe700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e440c9450 0x7f7e440c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e43fff700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e441526e0 0x7f7e440c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e48a83700 1 -- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e441526e0 msgr2=0x7f7e440c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e48a83700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e441526e0 0x7f7e440c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e48a83700 1 -- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e440c9450 msgr2=0x7f7e440c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e48a83700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e440c9450 0x7f7e440c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e48a83700 1 -- 172.21.15.81:0/1290855540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440c5210 con 0x7f7e440c98c0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e48a83700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e440c98c0 0x7f7e440c5c70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00afd0 tx=0x7f7e3c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e2bfff700 1 -- 172.21.15.81:0/1290855540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00eee0 con 0x7f7e440c98c0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e2bfff700 1 -- 172.21.15.81:0/1290855540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c01d630 con 0x7f7e440c98c0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e2bfff700 1 -- 172.21.15.81:0/1290855540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c01d9f0 con 0x7f7e440c98c0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e440c7a00 con 0x7f7e440c98c0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.691+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e44152ab0 con 0x7f7e440c98c0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.692+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e440c4ab0 con 0x7f7e440c98c0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.692+0000 7f7e2bfff700 1 -- 172.21.15.81:0/1290855540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e3c003040 con 0x7f7e440c98c0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.693+0000 7f7e2bfff700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e30066f30 0x7f7e300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.693+0000 7f7e2bfff700 1 -- 172.21.15.81:0/1290855540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7e3c085860 con 0x7f7e440c98c0 2023-10-06T02:48:10.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.693+0000 7f7e43fff700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e30066f30 0x7f7e300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:10.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.693+0000 7f7e43fff700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e30066f30 0x7f7e300693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7e34006f00 tx=0x7f7e34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:10.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.697+0000 7f7e2bfff700 1 -- 172.21.15.81:0/1290855540 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e440c4ab0 con 0x7f7e440c98c0 2023-10-06T02:48:10.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.919+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e440c4ab0 con 0x7f7e440c98c0 2023-10-06T02:48:10.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.920+0000 7f7e2bfff700 1 -- 172.21.15.81:0/1290855540 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f7e3c018de0 con 0x7f7e440c98c0 2023-10-06T02:48:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:10.921 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1614529442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1614529442},{"type":"v1","addr":"172.21.15.83:6837","nonce":1614529442}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2807315224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2807315224},{"type":"v1","addr":"172.21.15.83:6836","nonce":2807315224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1011222990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1011222990},{"type":"v1","addr":"172.21.15.81:6834","nonce":1011222990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2501038206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2501038206},{"type":"v1","addr":"172.21.15.81:6835","nonce":2501038206}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-10-06T02:48:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e30066f30 msgr2=0x7f7e300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e30066f30 0x7f7e300693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7e34006f00 tx=0x7f7e34008040 comp rx=0 tx=0).stop 2023-10-06T02:48:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e440c98c0 msgr2=0x7f7e440c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e440c98c0 0x7f7e440c5c70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00afd0 tx=0x7f7e3c01a000 comp rx=0 tx=0).stop 2023-10-06T02:48:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 shutdown_connections 2023-10-06T02:48:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e440c98c0 0x7f7e440c5c70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e441526e0 0x7f7e440c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e30066f30 0x7f7e300693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 --2- 172.21.15.81:0/1290855540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e440c9450 0x7f7e440c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 >> 172.21.15.81:0/1290855540 conn(0x7f7e44067640 msgr2=0x7f7e44154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 shutdown_connections 2023-10-06T02:48:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:10.922+0000 7f7e4a4e6700 1 -- 172.21.15.81:0/1290855540 wait complete. 2023-10-06T02:48:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2023-10-06T02:48:10.935 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:48:10.935 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:48:10.935 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:48:10.936 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:48:10.936 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:48:10.936 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:48:10.936 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:48:10.936 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:48:10.936 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:48:10.936 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:48:10.937 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:48:10.937 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:48:10.937 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:48:10.937 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:48:10.937 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:48:10.937 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:48:10.944 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:48:10.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:48:10.945 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:48:10.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:48:10.947 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:48:10.947 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:48:10.948 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:48:10.948 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:48:10.986 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:48:10.987 DEBUG:teuthology.parallel:result is None 2023-10-06T02:48:10.987 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:48:10.987 DEBUG:teuthology.parallel:result is None 2023-10-06T02:48:10.990 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:48:10.990 DEBUG:teuthology.parallel:result is None 2023-10-06T02:48:10.990 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:48:10.991 DEBUG:teuthology.parallel:result is None 2023-10-06T02:48:10.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:48:11.063 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:48:11.063 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:48:11.063 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-06T02:48:11.059+0000 7f3911c85700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-06T02:48:11.070 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:48:11.070 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:48:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.111+0000 7f4e04e6e700 1 Processor -- start 2023-10-06T02:48:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.111+0000 7f4e04e6e700 1 -- start start 2023-10-06T02:48:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.111+0000 7f4e04e6e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e0015a2a0 0x7f4e000b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.111+0000 7f4e04e6e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4e000ceb30 0x7f4e000cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.111+0000 7f4e04e6e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e000cf4e0 con 0x7f4e0006d650 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.111+0000 7f4e04e6e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0006ea90 con 0x7f4e000ceb30 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.111+0000 7f4e04e6e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000b0ca0 con 0x7f4e0015a2a0 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4e0006d650 0x7f4e0006da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44684/0 (socket says 172.21.15.81:44684) 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfed9d700 1 -- 172.21.15.81:0/2564112407 learned_addr learned my addr 172.21.15.81:0/2564112407 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfe59c700 1 --2- 172.21.15.81:0/2564112407 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e0015a2a0 0x7f4e000b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4df7fff700 1 --2- 172.21.15.81:0/2564112407 >> v2:172.21.15.83:3300/0 conn(0x7f4e000ceb30 0x7f4e000cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfdd9b700 1 -- 172.21.15.81:0/2564112407 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876556432 0 0) 0x7f4e000cf4e0 con 0x7f4e0006d650 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfdd9b700 1 -- 172.21.15.81:0/2564112407 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dec003570 con 0x7f4e0006d650 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfdd9b700 1 -- 172.21.15.81:0/2564112407 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3899936729 0 0) 0x7f4dec003570 con 0x7f4e0006d650 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfe59c700 1 -- 172.21.15.81:0/2564112407 >> v2:172.21.15.83:3300/0 conn(0x7f4e000ceb30 msgr2=0x7f4e000cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfe59c700 1 --2- 172.21.15.81:0/2564112407 >> v2:172.21.15.83:3300/0 conn(0x7f4e000ceb30 0x7f4e000cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfe59c700 1 -- 172.21.15.81:0/2564112407 >> v1:172.21.15.81:6789/0 conn(0x7f4e0006d650 legacy=0x7f4e0006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfe59c700 1 -- 172.21.15.81:0/2564112407 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e000b00d0 con 0x7f4e0015a2a0 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfe59c700 1 --2- 172.21.15.81:0/2564112407 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e0015a2a0 0x7f4e000b1130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4df00098e0 tx=0x7f4df00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b461be562b2f01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfdd9b700 1 -- 172.21.15.81:0/2564112407 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df80017f0 con 0x7f4e0015a2a0 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfdd9b700 1 -- 172.21.15.81:0/2564112407 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0011420 con 0x7f4e0015a2a0 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.112+0000 7f4dfdd9b700 1 -- 172.21.15.81:0/2564112407 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df00117c0 con 0x7f4e0015a2a0 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.113+0000 7f4e04e6e700 1 -- 172.21.15.81:0/2564112407 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e0015a2a0 msgr2=0x7f4e000b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.113+0000 7f4e04e6e700 1 --2- 172.21.15.81:0/2564112407 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e0015a2a0 0x7f4e000b1130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4df00098e0 tx=0x7f4df00091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.113+0000 7f4e04e6e700 1 -- 172.21.15.81:0/2564112407 shutdown_connections 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.113+0000 7f4e04e6e700 1 --2- 172.21.15.81:0/2564112407 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e0015a2a0 0x7f4e000b1130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.113+0000 7f4e04e6e700 1 --2- 172.21.15.81:0/2564112407 >> v2:172.21.15.83:3300/0 conn(0x7f4e000ceb30 0x7f4e000cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.113+0000 7f4e04e6e700 1 -- 172.21.15.81:0/2564112407 >> 172.21.15.81:0/2564112407 conn(0x7f4e00067640 msgr2=0x7f4e00067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.113+0000 7f4e04e6e700 1 -- 172.21.15.81:0/2564112407 shutdown_connections 2023-10-06T02:48:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.113+0000 7f4e04e6e700 1 -- 172.21.15.81:0/2564112407 wait complete. 2023-10-06T02:48:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.114+0000 7f4e04e6e700 1 Processor -- start 2023-10-06T02:48:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.114+0000 7f4e04e6e700 1 -- start start 2023-10-06T02:48:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4e04e6e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e0006d650 0x7f4e00153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4e04e6e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e000ceb30 0x7f4e0016af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4e04e6e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e0015a2a0 0x7f4e0015e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4e04e6e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000cbf90 con 0x7f4e0006d650 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4e04e6e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0016b4d0 con 0x7f4e0015a2a0 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4e04e6e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000b3ba0 con 0x7f4e000ceb30 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e0006d650 0x7f4e00153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e0006d650 0x7f4e00153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48884/0 (socket says 172.21.15.81:48884) 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfe59c700 1 -- 172.21.15.81:0/887116654 learned_addr learned my addr 172.21.15.81:0/887116654 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4df7fff700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e000ceb30 0x7f4e0016af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfed9d700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e0015a2a0 0x7f4e0015e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfe59c700 1 -- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e000ceb30 msgr2=0x7f4e0016af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfe59c700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e000ceb30 0x7f4e0016af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfe59c700 1 -- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e0015a2a0 msgr2=0x7f4e0015e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfe59c700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e0015a2a0 0x7f4e0015e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfe59c700 1 -- 172.21.15.81:0/887116654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0009420 con 0x7f4e0006d650 2023-10-06T02:48:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4df7fff700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e000ceb30 0x7f4e0016af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.115+0000 7f4dfe59c700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e0006d650 0x7f4e00153800 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4df00030c0 tx=0x7f4df0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.116+0000 7f4df67fc700 1 -- 172.21.15.81:0/887116654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df001cc90 con 0x7f4e0006d650 2023-10-06T02:48:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.116+0000 7f4df67fc700 1 -- 172.21.15.81:0/887116654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df001cdf0 con 0x7f4e0006d650 2023-10-06T02:48:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.116+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e000b3e80 con 0x7f4e0006d650 2023-10-06T02:48:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.116+0000 7f4df67fc700 1 -- 172.21.15.81:0/887116654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df001a6a0 con 0x7f4e0006d650 2023-10-06T02:48:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.116+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e000cc1a0 con 0x7f4e0006d650 2023-10-06T02:48:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.116+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e00069e40 con 0x7f4e0006d650 2023-10-06T02:48:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.117+0000 7f4df67fc700 1 -- 172.21.15.81:0/887116654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4df001aad0 con 0x7f4e0006d650 2023-10-06T02:48:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.117+0000 7f4df67fc700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4de0066f30 0x7f4de00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.117+0000 7f4df67fc700 1 -- 172.21.15.81:0/887116654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4df0085d30 con 0x7f4e0006d650 2023-10-06T02:48:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.117+0000 7f4df7fff700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4de0066f30 0x7f4de00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.118+0000 7f4df7fff700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4de0066f30 0x7f4de00693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4e0016b690 tx=0x7f4de8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.121+0000 7f4df67fc700 1 -- 172.21.15.81:0/887116654 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4df0053140 con 0x7f4e0006d650 2023-10-06T02:48:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:11.319+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4e0004bb80 con 0x7f4e0006d650 2023-10-06T02:48:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.018+0000 7f4df67fc700 1 -- 172.21.15.81:0/887116654 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4df0029080 con 0x7f4e0006d650 2023-10-06T02:48:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4de0066f30 msgr2=0x7f4de00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4de0066f30 0x7f4de00693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4e0016b690 tx=0x7f4de8008040 comp rx=0 tx=0).stop 2023-10-06T02:48:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e0006d650 msgr2=0x7f4e00153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e0006d650 0x7f4e00153800 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4df00030c0 tx=0x7f4df0016000 comp rx=0 tx=0).stop 2023-10-06T02:48:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 shutdown_connections 2023-10-06T02:48:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4de0066f30 0x7f4de00693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e0015a2a0 0x7f4e0015e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e0006d650 0x7f4e00153800 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 --2- 172.21.15.81:0/887116654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e000ceb30 0x7f4e0016af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 >> 172.21.15.81:0/887116654 conn(0x7f4e00067640 msgr2=0x7f4e00156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 shutdown_connections 2023-10-06T02:48:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.020+0000 7f4e04e6e700 1 -- 172.21.15.81:0/887116654 wait complete. 2023-10-06T02:48:12.024 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:48:12.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:48:12.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.148+0000 7f3b6cb6e700 1 Processor -- start 2023-10-06T02:48:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.148+0000 7f3b6cb6e700 1 -- start start 2023-10-06T02:48:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.149+0000 7f3b6cb6e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3b68157a60 0x7f3b6815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.149+0000 7f3b6cb6e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b6806c190 0x7f3b680b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.149+0000 7f3b6cb6e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b680b35d0 con 0x7f3b680b3170 2023-10-06T02:48:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.149+0000 7f3b6cb6e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b68069d10 con 0x7f3b68157a60 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.149+0000 7f3b6cb6e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6815c130 con 0x7f3b6806c190 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.149+0000 7f3b6659c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3b68157a60 0x7f3b6815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.149+0000 7f3b5dd9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b6806c190 0x7f3b680b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.149+0000 7f3b66d9d700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3b680b3170 0x7f3b6806a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:42514/0 (socket says 172.21.15.81:42514) 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.149+0000 7f3b66d9d700 1 -- 172.21.15.81:0/1355519918 learned_addr learned my addr 172.21.15.81:0/1355519918 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b5dd9b700 1 -- 172.21.15.81:0/1355519918 >> v2:172.21.15.83:3300/0 conn(0x7f3b68157a60 msgr2=0x7f3b6815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b5dd9b700 1 --2- 172.21.15.81:0/1355519918 >> v2:172.21.15.83:3300/0 conn(0x7f3b68157a60 0x7f3b6815b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b5dd9b700 1 -- 172.21.15.81:0/1355519918 >> v1:172.21.15.83:6789/0 conn(0x7f3b680b3170 legacy=0x7f3b6806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b5dd9b700 1 -- 172.21.15.81:0/1355519918 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6815c410 con 0x7f3b6806c190 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b65d9b700 1 -- 172.21.15.81:0/1355519918 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187245090 0 0) 0x7f3b60001490 con 0x7f3b680b3170 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b6659c700 1 --2- 172.21.15.81:0/1355519918 >> v2:172.21.15.83:3300/0 conn(0x7f3b68157a60 0x7f3b6815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b5dd9b700 1 --2- 172.21.15.81:0/1355519918 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b6806c190 0x7f3b680b2c30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b500098e0 tx=0x7f3b500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae269a1318030251 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b65d9b700 1 -- 172.21.15.81:0/1355519918 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000b640 con 0x7f3b6806c190 2023-10-06T02:48:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b65d9b700 1 -- 172.21.15.81:0/1355519918 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000b7a0 con 0x7f3b6806c190 2023-10-06T02:48:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.150+0000 7f3b65d9b700 1 -- 172.21.15.81:0/1355519918 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000bb40 con 0x7f3b6806c190 2023-10-06T02:48:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.151+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/1355519918 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b6806c190 msgr2=0x7f3b680b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.151+0000 7f3b6cb6e700 1 --2- 172.21.15.81:0/1355519918 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b6806c190 0x7f3b680b2c30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b500098e0 tx=0x7f3b500091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.151+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/1355519918 shutdown_connections 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.151+0000 7f3b6cb6e700 1 --2- 172.21.15.81:0/1355519918 >> v2:172.21.15.83:3300/0 conn(0x7f3b68157a60 0x7f3b6815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.151+0000 7f3b6cb6e700 1 --2- 172.21.15.81:0/1355519918 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b6806c190 0x7f3b680b2c30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.151+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/1355519918 >> 172.21.15.81:0/1355519918 conn(0x7f3b6806cca0 msgr2=0x7f3b6806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.151+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/1355519918 shutdown_connections 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.151+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/1355519918 wait complete. 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.152+0000 7f3b6cb6e700 1 Processor -- start 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.152+0000 7f3b6cb6e700 1 -- start start 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6cb6e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6806c190 0x7f3b681691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6cb6e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b680b3170 0x7f3b6816b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6cb6e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b68157a60 0x7f3b68156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6cb6e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68169730 con 0x7f3b6806c190 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6cb6e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68158de0 con 0x7f3b68157a60 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6cb6e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b681581d0 con 0x7f3b680b3170 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6806c190 0x7f3b681691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6806c190 0x7f3b681691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48894/0 (socket says 172.21.15.81:48894) 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6659c700 1 -- 172.21.15.81:0/2395215330 learned_addr learned my addr 172.21.15.81:0/2395215330 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b66d9d700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b68157a60 0x7f3b68156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b5dd9b700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b680b3170 0x7f3b6816b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6659c700 1 -- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b680b3170 msgr2=0x7f3b6816b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6659c700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b680b3170 0x7f3b6816b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6659c700 1 -- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b68157a60 msgr2=0x7f3b68156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6659c700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b68157a60 0x7f3b68156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6659c700 1 -- 172.21.15.81:0/2395215330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58009420 con 0x7f3b6806c190 2023-10-06T02:48:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b5dd9b700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b680b3170 0x7f3b6816b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6659c700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6806c190 0x7f3b681691f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800ec80 tx=0x7f3b580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b5effd700 1 -- 172.21.15.81:0/2395215330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800c8f0 con 0x7f3b6806c190 2023-10-06T02:48:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b5effd700 1 -- 172.21.15.81:0/2395215330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5800ca50 con 0x7f3b6806c190 2023-10-06T02:48:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b50009420 con 0x7f3b6806c190 2023-10-06T02:48:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.153+0000 7f3b5effd700 1 -- 172.21.15.81:0/2395215330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800cdd0 con 0x7f3b6806c190 2023-10-06T02:48:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.154+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b68158a70 con 0x7f3b6806c190 2023-10-06T02:48:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.154+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b68158f50 con 0x7f3b6806c190 2023-10-06T02:48:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.155+0000 7f3b5effd700 1 -- 172.21.15.81:0/2395215330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b58013680 con 0x7f3b6806c190 2023-10-06T02:48:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.155+0000 7f3b5effd700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b48066f30 0x7f3b480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.155+0000 7f3b5effd700 1 -- 172.21.15.81:0/2395215330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3b580846f0 con 0x7f3b6806c190 2023-10-06T02:48:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.155+0000 7f3b5dd9b700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b48066f30 0x7f3b480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.156+0000 7f3b5dd9b700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b48066f30 0x7f3b480693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3b500093f0 tx=0x7f3b50017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.159+0000 7f3b5effd700 1 -- 172.21.15.81:0/2395215330 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b58051b50 con 0x7f3b6806c190 2023-10-06T02:48:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.412+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3b68169870 con 0x7f3b6806c190 2023-10-06T02:48:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.413+0000 7f3b5effd700 1 -- 172.21.15.81:0/2395215330 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3b68169870 con 0x7f3b6806c190 2023-10-06T02:48:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:12.414 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:48:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:48:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:48:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:48:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:48:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:48:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:48:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:48:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:48:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:48:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:48:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:48:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:48:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:48:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:48:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:48:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:48:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:48:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:48:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:48:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:48:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:48:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:48:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:48:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:48:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:48:12.431 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:48:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b48066f30 msgr2=0x7f3b480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b48066f30 0x7f3b480693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3b500093f0 tx=0x7f3b50017000 comp rx=0 tx=0).stop 2023-10-06T02:48:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6806c190 msgr2=0x7f3b681691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6806c190 0x7f3b681691f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800ec80 tx=0x7f3b580091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 shutdown_connections 2023-10-06T02:48:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b48066f30 0x7f3b480693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b68157a60 0x7f3b68156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6806c190 0x7f3b681691f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 --2- 172.21.15.81:0/2395215330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b680b3170 0x7f3b6816b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.414+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 >> 172.21.15.81:0/2395215330 conn(0x7f3b6806cca0 msgr2=0x7f3b68154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.415+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 shutdown_connections 2023-10-06T02:48:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.415+0000 7f3b6cb6e700 1 -- 172.21.15.81:0/2395215330 wait complete. 2023-10-06T02:48:12.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:48:12.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.547+0000 7f70b0115700 1 Processor -- start 2023-10-06T02:48:12.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.547+0000 7f70b0115700 1 -- start start 2023-10-06T02:48:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70b0115700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f70a8157ca0 0x7f70a80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70b0115700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70a806d120 0x7f70a806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70b0115700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a80d07c0 con 0x7f70a81578d0 2023-10-06T02:48:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70b0115700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a806da50 con 0x7f70a806d120 2023-10-06T02:48:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70b0115700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a80cfbb0 con 0x7f70a8157ca0 2023-10-06T02:48:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70ae6b2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70a806d120 0x7f70a806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70ae6b2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70a806d120 0x7f70a806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48908/0 (socket says 172.21.15.81:48908) 2023-10-06T02:48:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70ae6b2700 1 -- 172.21.15.81:0/3199933623 learned_addr learned my addr 172.21.15.81:0/3199933623 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70ad6b0700 1 --2- 172.21.15.81:0/3199933623 >> v2:172.21.15.83:3300/0 conn(0x7f70a8157ca0 0x7f70a80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70ae6b2700 1 -- 172.21.15.81:0/3199933623 >> v2:172.21.15.83:3300/0 conn(0x7f70a8157ca0 msgr2=0x7f70a80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70ae6b2700 1 --2- 172.21.15.81:0/3199933623 >> v2:172.21.15.83:3300/0 conn(0x7f70a8157ca0 0x7f70a80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.548+0000 7f70ae6b2700 1 -- 172.21.15.81:0/3199933623 >> v1:172.21.15.83:6789/0 conn(0x7f70a81578d0 legacy=0x7f70a815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70ae6b2700 1 -- 172.21.15.81:0/3199933623 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a80cfe90 con 0x7f70a806d120 2023-10-06T02:48:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70ae6b2700 1 --2- 172.21.15.81:0/3199933623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a806d120 0x7f70a806d510 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f70a8068510 tx=0x7f70a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de4486ef50f23fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70aceaf700 1 -- 172.21.15.81:0/3199933623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a000b820 con 0x7f70a806d120 2023-10-06T02:48:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70aceaf700 1 -- 172.21.15.81:0/3199933623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a000b980 con 0x7f70a806d120 2023-10-06T02:48:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70aceaf700 1 -- 172.21.15.81:0/3199933623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a000bd20 con 0x7f70a806d120 2023-10-06T02:48:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70b0115700 1 -- 172.21.15.81:0/3199933623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a806d120 msgr2=0x7f70a806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70b0115700 1 --2- 172.21.15.81:0/3199933623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a806d120 0x7f70a806d510 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f70a8068510 tx=0x7f70a0009250 comp rx=0 tx=0).stop 2023-10-06T02:48:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70b0115700 1 -- 172.21.15.81:0/3199933623 shutdown_connections 2023-10-06T02:48:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70b0115700 1 --2- 172.21.15.81:0/3199933623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a806d120 0x7f70a806d510 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70b0115700 1 --2- 172.21.15.81:0/3199933623 >> v2:172.21.15.83:3300/0 conn(0x7f70a8157ca0 0x7f70a80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70b0115700 1 -- 172.21.15.81:0/3199933623 >> 172.21.15.81:0/3199933623 conn(0x7f70a806bb90 msgr2=0x7f70a806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70b0115700 1 -- 172.21.15.81:0/3199933623 shutdown_connections 2023-10-06T02:48:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.549+0000 7f70b0115700 1 -- 172.21.15.81:0/3199933623 wait complete. 2023-10-06T02:48:12.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.550+0000 7f70b0115700 1 Processor -- start 2023-10-06T02:48:12.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.550+0000 7f70b0115700 1 -- start start 2023-10-06T02:48:12.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70b0115700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70a806d120 0x7f70a80ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70b0115700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70a81578d0 0x7f70a816dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70b0115700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8157ca0 0x7f70a8068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70b0115700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a816ebd0 con 0x7f70a8157ca0 2023-10-06T02:48:12.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70b0115700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a816e330 con 0x7f70a81578d0 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70b0115700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a816e610 con 0x7f70a806d120 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70ae6b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8157ca0 0x7f70a8068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70ae6b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8157ca0 0x7f70a8068ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48910/0 (socket says 172.21.15.81:48910) 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70ae6b2700 1 -- 172.21.15.81:0/2549522010 learned_addr learned my addr 172.21.15.81:0/2549522010 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70ad6b0700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70a81578d0 0x7f70a816dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.551+0000 7f70adeb1700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70a806d120 0x7f70a80ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70ae6b2700 1 -- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70a806d120 msgr2=0x7f70a80ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70ae6b2700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70a806d120 0x7f70a80ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70ae6b2700 1 -- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70a81578d0 msgr2=0x7f70a816dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70ae6b2700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70a81578d0 0x7f70a816dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70ae6b2700 1 -- 172.21.15.81:0/2549522010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00094f0 con 0x7f70a8157ca0 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70ad6b0700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70a81578d0 0x7f70a816dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70adeb1700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70a806d120 0x7f70a80ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70ae6b2700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8157ca0 0x7f70a8068ad0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009290 tx=0x7f70a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f709dffb700 1 -- 172.21.15.81:0/2549522010 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a001b520 con 0x7f70a8157ca0 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f709dffb700 1 -- 172.21.15.81:0/2549522010 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0020070 con 0x7f70a8157ca0 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f709dffb700 1 -- 172.21.15.81:0/2549522010 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a001b8f0 con 0x7f70a8157ca0 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a816e8f0 con 0x7f70a8157ca0 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.552+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a8069010 con 0x7f70a8157ca0 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.553+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a81583d0 con 0x7f70a8157ca0 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.553+0000 7f709dffb700 1 -- 172.21.15.81:0/2549522010 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70a0022030 con 0x7f70a8157ca0 2023-10-06T02:48:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.554+0000 7f709dffb700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f708c066f30 0x7f708c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.554+0000 7f709dffb700 1 -- 172.21.15.81:0/2549522010 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f70a00864e0 con 0x7f70a8157ca0 2023-10-06T02:48:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.554+0000 7f70adeb1700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f708c066f30 0x7f708c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.555+0000 7f70adeb1700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f708c066f30 0x7f708c0693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70a4007fd0 tx=0x7f70a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.558+0000 7f709dffb700 1 -- 172.21.15.81:0/2549522010 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70a81583d0 con 0x7f70a8157ca0 2023-10-06T02:48:12.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.740+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70a81583d0 con 0x7f70a8157ca0 2023-10-06T02:48:12.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.741+0000 7f709dffb700 1 -- 172.21.15.81:0/2549522010 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+13602 (secure 0 0 0) 0x7f70a81583d0 con 0x7f70a8157ca0 2023-10-06T02:48:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:12.742 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":62,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:48:12.031174+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:48:12.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.742+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f708c066f30 msgr2=0x7f708c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.742+0000 7f70b0115700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f708c066f30 0x7f708c0693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70a4007fd0 tx=0x7f70a4009040 comp rx=0 tx=0).stop 2023-10-06T02:48:12.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8157ca0 msgr2=0x7f70a8068ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8157ca0 0x7f70a8068ad0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009290 tx=0x7f70a0016000 comp rx=0 tx=0).stop 2023-10-06T02:48:12.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 shutdown_connections 2023-10-06T02:48:12.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8157ca0 0x7f70a8068ad0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70a806d120 0x7f70a80ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f708c066f30 0x7f708c0693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 --2- 172.21.15.81:0/2549522010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70a81578d0 0x7f70a816dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 >> 172.21.15.81:0/2549522010 conn(0x7f70a806bb90 msgr2=0x7f70a8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:12.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 shutdown_connections 2023-10-06T02:48:12.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.743+0000 7f70b0115700 1 -- 172.21.15.81:0/2549522010 wait complete. 2023-10-06T02:48:12.756 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:48:12.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:48:12.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.871+0000 7f33c2ff5700 1 Processor -- start 2023-10-06T02:48:12.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.871+0000 7f33c2ff5700 1 -- start start 2023-10-06T02:48:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.872+0000 7f33c2ff5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f33bc15a2a0 0x7f33bc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.872+0000 7f33c2ff5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc0b0ca0 con 0x7f33bc0ceb30 2023-10-06T02:48:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.872+0000 7f33c2ff5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc0b00d0 con 0x7f33bc06dd60 2023-10-06T02:48:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.872+0000 7f33c2ff5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc06e160 con 0x7f33bc15a2a0 2023-10-06T02:48:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.872+0000 7f33b3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f33bc0ceb30 0x7f33bc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44686/0 (socket says 172.21.15.81:44686) 2023-10-06T02:48:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.872+0000 7f33b3fff700 1 -- 172.21.15.81:0/2759909878 learned_addr learned my addr 172.21.15.81:0/2759909878 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.872+0000 7f33c0d91700 1 --2- 172.21.15.81:0/2759909878 >> v2:172.21.15.83:3300/0 conn(0x7f33bc15a2a0 0x7f33bc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33b37fe700 1 -- 172.21.15.81:0/2759909878 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493492818 0 0) 0x7f33bc0b0ca0 con 0x7f33bc0ceb30 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33b37fe700 1 -- 172.21.15.81:0/2759909878 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a4003570 con 0x7f33bc0ceb30 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33b37fe700 1 -- 172.21.15.81:0/2759909878 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771061175 0 0) 0x7f33bc0b00d0 con 0x7f33bc06dd60 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33b37fe700 1 -- 172.21.15.81:0/2759909878 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33bc0b0ca0 con 0x7f33bc06dd60 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33c0d91700 1 -- 172.21.15.81:0/2759909878 >> v1:172.21.15.83:6789/0 conn(0x7f33bc06dd60 legacy=0x7f33bc0b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33c0d91700 1 -- 172.21.15.81:0/2759909878 >> v1:172.21.15.81:6789/0 conn(0x7f33bc0ceb30 legacy=0x7f33bc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33c0d91700 1 -- 172.21.15.81:0/2759909878 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc0b0370 con 0x7f33bc15a2a0 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33c0d91700 1 --2- 172.21.15.81:0/2759909878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc15a2a0 0x7f33bc0b1130 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33b80098e0 tx=0x7f33b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71392975fabf1a7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33b37fe700 1 -- 172.21.15.81:0/2759909878 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8011630 con 0x7f33bc15a2a0 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33b37fe700 1 -- 172.21.15.81:0/2759909878 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8011790 con 0x7f33bc15a2a0 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.873+0000 7f33b37fe700 1 -- 172.21.15.81:0/2759909878 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8011b10 con 0x7f33bc15a2a0 2023-10-06T02:48:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.874+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2759909878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc15a2a0 msgr2=0x7f33bc0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.874+0000 7f33c2ff5700 1 --2- 172.21.15.81:0/2759909878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc15a2a0 0x7f33bc0b1130 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33b80098e0 tx=0x7f33b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.874+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2759909878 shutdown_connections 2023-10-06T02:48:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.874+0000 7f33c2ff5700 1 --2- 172.21.15.81:0/2759909878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc15a2a0 0x7f33bc0b1130 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.874+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2759909878 >> 172.21.15.81:0/2759909878 conn(0x7f33bc067640 msgr2=0x7f33bc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.874+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2759909878 shutdown_connections 2023-10-06T02:48:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.874+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2759909878 wait complete. 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.875+0000 7f33c2ff5700 1 Processor -- start 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.875+0000 7f33c2ff5700 1 -- start start 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33c2ff5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc06dd60 0x7f33bc147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33c2ff5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33bc0ceb30 0x7f33bc155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33c2ff5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33bc15a2a0 0x7f33bc1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33c2ff5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc156bb0 con 0x7f33bc0ceb30 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33c2ff5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc16e150 con 0x7f33bc06dd60 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33c2ff5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1568d0 con 0x7f33bc15a2a0 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33bc0ceb30 0x7f33bc155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33bc0ceb30 0x7f33bc155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48924/0 (socket says 172.21.15.81:48924) 2023-10-06T02:48:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b3fff700 1 -- 172.21.15.81:0/2805059445 learned_addr learned my addr 172.21.15.81:0/2805059445 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33c0d91700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc06dd60 0x7f33bc147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33c1592700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33bc15a2a0 0x7f33bc1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b3fff700 1 -- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33bc15a2a0 msgr2=0x7f33bc1562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b3fff700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33bc15a2a0 0x7f33bc1562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b3fff700 1 -- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc06dd60 msgr2=0x7f33bc147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b3fff700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc06dd60 0x7f33bc147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b3fff700 1 -- 172.21.15.81:0/2805059445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8009420 con 0x7f33bc0ceb30 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33c0d91700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc06dd60 0x7f33bc147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b3fff700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33bc0ceb30 0x7f33bc155d60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c7c0 tx=0x7f33ac007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b0ff9700 1 -- 172.21.15.81:0/2805059445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac005b30 con 0x7f33bc0ceb30 2023-10-06T02:48:12.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.876+0000 7f33b0ff9700 1 -- 172.21.15.81:0/2805059445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac005c90 con 0x7f33bc0ceb30 2023-10-06T02:48:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.877+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc16db00 con 0x7f33bc0ceb30 2023-10-06T02:48:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.877+0000 7f33b0ff9700 1 -- 172.21.15.81:0/2805059445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac007300 con 0x7f33bc0ceb30 2023-10-06T02:48:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.877+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc154b90 con 0x7f33bc0ceb30 2023-10-06T02:48:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.877+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc16e2e0 con 0x7f33bc0ceb30 2023-10-06T02:48:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.878+0000 7f33b0ff9700 1 -- 172.21.15.81:0/2805059445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33ac01b400 con 0x7f33bc0ceb30 2023-10-06T02:48:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.878+0000 7f33b0ff9700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33a8066f30 0x7f33a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.878+0000 7f33b0ff9700 1 -- 172.21.15.81:0/2805059445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f33ac083e60 con 0x7f33bc0ceb30 2023-10-06T02:48:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.878+0000 7f33c0d91700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33a8066f30 0x7f33a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.879+0000 7f33c0d91700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33a8066f30 0x7f33a80693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f33b80093f0 tx=0x7f33b8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:12.882+0000 7f33b0ff9700 1 -- 172.21.15.81:0/2805059445 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33ac054dd0 con 0x7f33bc0ceb30 2023-10-06T02:48:13.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.068+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33bc0b4aa0 con 0x7f33bc0ceb30 2023-10-06T02:48:13.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.069+0000 7f33b0ff9700 1 -- 172.21.15.81:0/2805059445 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33ac054960 con 0x7f33bc0ceb30 2023-10-06T02:48:13.070 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:48:13.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33a8066f30 msgr2=0x7f33a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33a8066f30 0x7f33a80693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f33b80093f0 tx=0x7f33b8017000 comp rx=0 tx=0).stop 2023-10-06T02:48:13.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33bc0ceb30 msgr2=0x7f33bc155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33bc0ceb30 0x7f33bc155d60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c7c0 tx=0x7f33ac007ea0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 shutdown_connections 2023-10-06T02:48:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33bc15a2a0 0x7f33bc1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33a8066f30 0x7f33a80693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33bc06dd60 0x7f33bc147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 --2- 172.21.15.81:0/2805059445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33bc0ceb30 0x7f33bc155d60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 >> 172.21.15.81:0/2805059445 conn(0x7f33bc067640 msgr2=0x7f33bc157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 shutdown_connections 2023-10-06T02:48:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.071+0000 7f33c2ff5700 1 -- 172.21.15.81:0/2805059445 wait complete. 2023-10-06T02:48:13.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:48:13.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.200+0000 7fdd19d71700 1 Processor -- start 2023-10-06T02:48:13.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.200+0000 7fdd19d71700 1 -- start start 2023-10-06T02:48:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd19d71700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdd140b43c0 0x7fdd140cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd19d71700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd140cddd0 0x7fdd140ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd19d71700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd140cadb0 con 0x7fdd140cd030 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd19d71700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd140cc250 con 0x7fdd140cddd0 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd19d71700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd140cf000 con 0x7fdd140b43c0 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd13fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd140cddd0 0x7fdd140ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd19570700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdd140cd030 0x7fdd1415b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44694/0 (socket says 172.21.15.81:44694) 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd19570700 1 -- 172.21.15.81:0/3717738111 learned_addr learned my addr 172.21.15.81:0/3717738111 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd18d6f700 1 --2- 172.21.15.81:0/3717738111 >> v2:172.21.15.83:3300/0 conn(0x7fdd140b43c0 0x7fdd140cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd13fff700 1 -- 172.21.15.81:0/3717738111 >> v2:172.21.15.83:3300/0 conn(0x7fdd140b43c0 msgr2=0x7fdd140cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd13fff700 1 --2- 172.21.15.81:0/3717738111 >> v2:172.21.15.83:3300/0 conn(0x7fdd140b43c0 0x7fdd140cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd13fff700 1 -- 172.21.15.81:0/3717738111 >> v1:172.21.15.81:6789/0 conn(0x7fdd140cd030 legacy=0x7fdd1415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd137fe700 1 -- 172.21.15.81:0/3717738111 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799260582 0 0) 0x7fdd140cadb0 con 0x7fdd140cd030 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd13fff700 1 -- 172.21.15.81:0/3717738111 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd140cf2e0 con 0x7fdd140cddd0 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd13fff700 1 --2- 172.21.15.81:0/3717738111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140cddd0 0x7fdd140ccaf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdd1406cb70 tx=0x7fdd04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a132c2739251172 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.201+0000 7fdd137fe700 1 -- 172.21.15.81:0/3717738111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400e070 con 0x7fdd140cddd0 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd137fe700 1 -- 172.21.15.81:0/3717738111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0400bb60 con 0x7fdd140cddd0 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd137fe700 1 -- 172.21.15.81:0/3717738111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04012430 con 0x7fdd140cddd0 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd19d71700 1 -- 172.21.15.81:0/3717738111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140cddd0 msgr2=0x7fdd140ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd19d71700 1 --2- 172.21.15.81:0/3717738111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140cddd0 0x7fdd140ccaf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdd1406cb70 tx=0x7fdd04009780 comp rx=0 tx=0).stop 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd19d71700 1 -- 172.21.15.81:0/3717738111 shutdown_connections 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd19d71700 1 --2- 172.21.15.81:0/3717738111 >> v2:172.21.15.83:3300/0 conn(0x7fdd140b43c0 0x7fdd140cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd19d71700 1 --2- 172.21.15.81:0/3717738111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140cddd0 0x7fdd140ccaf0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd19d71700 1 -- 172.21.15.81:0/3717738111 >> 172.21.15.81:0/3717738111 conn(0x7fdd14068110 msgr2=0x7fdd1406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:13.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd19d71700 1 -- 172.21.15.81:0/3717738111 shutdown_connections 2023-10-06T02:48:13.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.202+0000 7fdd19d71700 1 -- 172.21.15.81:0/3717738111 wait complete. 2023-10-06T02:48:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.203+0000 7fdd19d71700 1 Processor -- start 2023-10-06T02:48:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.203+0000 7fdd19d71700 1 -- start start 2023-10-06T02:48:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd19d71700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140b43c0 0x7fdd140c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd19d71700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd140cd030 0x7fdd141555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd19d71700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd140cddd0 0x7fdd140ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd19d71700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1416dd30 con 0x7fdd140b43c0 2023-10-06T02:48:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd19d71700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1416ac80 con 0x7fdd140cddd0 2023-10-06T02:48:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd19d71700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1416d400 con 0x7fdd140cd030 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd18d6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140b43c0 0x7fdd140c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd18d6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140b43c0 0x7fdd140c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48942/0 (socket says 172.21.15.81:48942) 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd18d6f700 1 -- 172.21.15.81:0/330855563 learned_addr learned my addr 172.21.15.81:0/330855563 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd18d6f700 1 -- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd140cd030 msgr2=0x7fdd141555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd18d6f700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd140cd030 0x7fdd141555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd19570700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd140cddd0 0x7fdd140ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd18d6f700 1 -- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd140cddd0 msgr2=0x7fdd140ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd18d6f700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd140cddd0 0x7fdd140ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.204+0000 7fdd18d6f700 1 -- 172.21.15.81:0/330855563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04009a20 con 0x7fdd140b43c0 2023-10-06T02:48:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.205+0000 7fdd18d6f700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140b43c0 0x7fdd140c8400 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00ec80 tx=0x7fdd0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.205+0000 7fdd10ff9700 1 -- 172.21.15.81:0/330855563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00c9d0 con 0x7fdd140b43c0 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.205+0000 7fdd10ff9700 1 -- 172.21.15.81:0/330855563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c00cb30 con 0x7fdd140b43c0 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.205+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1416d6e0 con 0x7fdd140b43c0 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.205+0000 7fdd10ff9700 1 -- 172.21.15.81:0/330855563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c013470 con 0x7fdd140b43c0 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.205+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd14155b20 con 0x7fdd140b43c0 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.206+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd14069c00 con 0x7fdd140b43c0 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.206+0000 7fdd10ff9700 1 -- 172.21.15.81:0/330855563 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd0c013820 con 0x7fdd140b43c0 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.207+0000 7fdd10ff9700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdcf4066f30 0x7fdcf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.207+0000 7fdd10ff9700 1 -- 172.21.15.81:0/330855563 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdd0c084700 con 0x7fdd140b43c0 2023-10-06T02:48:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.207+0000 7fdd13fff700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdcf4066f30 0x7fdcf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.207+0000 7fdd13fff700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdcf4066f30 0x7fdcf40693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdd140c6050 tx=0x7fdd04019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:13.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.211+0000 7fdd10ff9700 1 -- 172.21.15.81:0/330855563 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd0c051b60 con 0x7fdd140b43c0 2023-10-06T02:48:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.392+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd14071b10 con 0x7fdd140b43c0 2023-10-06T02:48:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.393+0000 7fdd10ff9700 1 -- 172.21.15.81:0/330855563 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd0c055180 con 0x7fdd140b43c0 2023-10-06T02:48:13.394 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:48:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdcf4066f30 msgr2=0x7fdcf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdcf4066f30 0x7fdcf40693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdd140c6050 tx=0x7fdd04019000 comp rx=0 tx=0).stop 2023-10-06T02:48:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140b43c0 msgr2=0x7fdd140c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140b43c0 0x7fdd140c8400 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00ec80 tx=0x7fdd0c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 shutdown_connections 2023-10-06T02:48:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdcf4066f30 0x7fdcf40693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd140cddd0 0x7fdd140ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd140b43c0 0x7fdd140c8400 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 --2- 172.21.15.81:0/330855563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd140cd030 0x7fdd141555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.394+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 >> 172.21.15.81:0/330855563 conn(0x7fdd14068110 msgr2=0x7fdd140c5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.395+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 shutdown_connections 2023-10-06T02:48:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.395+0000 7fdd19d71700 1 -- 172.21.15.81:0/330855563 wait complete. 2023-10-06T02:48:13.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:48:13.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.521+0000 7f7879788700 1 Processor -- start 2023-10-06T02:48:13.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.521+0000 7f7879788700 1 -- start start 2023-10-06T02:48:13.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.521+0000 7f7879788700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f787406d830 0x7f78740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.521+0000 7f7879788700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78740d07c0 con 0x7f7874157ca0 2023-10-06T02:48:13.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.521+0000 7f7879788700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78740cfbb0 con 0x7f78741578d0 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.521+0000 7f7879788700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78740cfe90 con 0x7f787406d830 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.521+0000 7f78737fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f787406d830 0x7f78740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f78727fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7874157ca0 0x7f787406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44698/0 (socket says 172.21.15.81:44698) 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f78727fc700 1 -- 172.21.15.81:0/2424492724 learned_addr learned my addr 172.21.15.81:0/2424492724 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f7871ffb700 1 -- 172.21.15.81:0/2424492724 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219257184 0 0) 0x7f78740d07c0 con 0x7f7874157ca0 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f7871ffb700 1 -- 172.21.15.81:0/2424492724 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7860003570 con 0x7f7874157ca0 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f78737fe700 1 -- 172.21.15.81:0/2424492724 >> v1:172.21.15.83:6789/0 conn(0x7f78741578d0 legacy=0x7f787415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f78737fe700 1 -- 172.21.15.81:0/2424492724 >> v1:172.21.15.81:6789/0 conn(0x7f7874157ca0 legacy=0x7f787406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f78737fe700 1 -- 172.21.15.81:0/2424492724 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740d0170 con 0x7f787406d830 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f78737fe700 1 --2- 172.21.15.81:0/2424492724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787406d830 0x7f78740cf4f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f786c009e60 tx=0x7f786c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc55b9898ec256b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f7871ffb700 1 -- 172.21.15.81:0/2424492724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00e070 con 0x7f787406d830 2023-10-06T02:48:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f7871ffb700 1 -- 172.21.15.81:0/2424492724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c00bb60 con 0x7f787406d830 2023-10-06T02:48:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.522+0000 7f7871ffb700 1 -- 172.21.15.81:0/2424492724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c012430 con 0x7f787406d830 2023-10-06T02:48:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.523+0000 7f7879788700 1 -- 172.21.15.81:0/2424492724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787406d830 msgr2=0x7f78740cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.523+0000 7f7879788700 1 --2- 172.21.15.81:0/2424492724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787406d830 0x7f78740cf4f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f786c009e60 tx=0x7f786c009780 comp rx=0 tx=0).stop 2023-10-06T02:48:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.523+0000 7f7879788700 1 -- 172.21.15.81:0/2424492724 shutdown_connections 2023-10-06T02:48:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.523+0000 7f7879788700 1 --2- 172.21.15.81:0/2424492724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787406d830 0x7f78740cf4f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.523+0000 7f7879788700 1 -- 172.21.15.81:0/2424492724 >> 172.21.15.81:0/2424492724 conn(0x7f787406bb90 msgr2=0x7f787406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.523+0000 7f7879788700 1 -- 172.21.15.81:0/2424492724 shutdown_connections 2023-10-06T02:48:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.523+0000 7f7879788700 1 -- 172.21.15.81:0/2424492724 wait complete. 2023-10-06T02:48:13.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.524+0000 7f7879788700 1 Processor -- start 2023-10-06T02:48:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.524+0000 7f7879788700 1 -- start start 2023-10-06T02:48:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f7879788700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f787406d830 0x7f787416b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f7879788700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741578d0 0x7f787416d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f7879788700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7874157ca0 0x7f787416afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f7879788700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740c75e0 con 0x7f7874157ca0 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f7879788700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740c5b20 con 0x7f78741578d0 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f7879788700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787416d910 con 0x7f787406d830 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7874157ca0 0x7f787416afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7874157ca0 0x7f787416afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48958/0 (socket says 172.21.15.81:48958) 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78737fe700 1 -- 172.21.15.81:0/1263357156 learned_addr learned my addr 172.21.15.81:0/1263357156 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78727fc700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741578d0 0x7f787416d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f7872ffd700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f787406d830 0x7f787416b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78737fe700 1 -- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f787406d830 msgr2=0x7f787416b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78737fe700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f787406d830 0x7f787416b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78737fe700 1 -- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741578d0 msgr2=0x7f787416d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78737fe700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741578d0 0x7f787416d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78737fe700 1 -- 172.21.15.81:0/1263357156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c009a20 con 0x7f7874157ca0 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78727fc700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741578d0 0x7f787416d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f7872ffd700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f787406d830 0x7f787416b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f78737fe700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7874157ca0 0x7f787416afc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f787406fe20 tx=0x7f786c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f786affd700 1 -- 172.21.15.81:0/1263357156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c012e00 con 0x7f7874157ca0 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f786affd700 1 -- 172.21.15.81:0/1263357156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c01d630 con 0x7f7874157ca0 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78740b5f90 con 0x7f7874157ca0 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.525+0000 7f786affd700 1 -- 172.21.15.81:0/1263357156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c01d9f0 con 0x7f7874157ca0 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.526+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78740b6550 con 0x7f7874157ca0 2023-10-06T02:48:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.526+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78740c5cd0 con 0x7f7874157ca0 2023-10-06T02:48:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.527+0000 7f786affd700 1 -- 172.21.15.81:0/1263357156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f786c024070 con 0x7f7874157ca0 2023-10-06T02:48:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.527+0000 7f786affd700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7854066f30 0x7f78540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.527+0000 7f786affd700 1 -- 172.21.15.81:0/1263357156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f786c086b10 con 0x7f7874157ca0 2023-10-06T02:48:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.527+0000 7f7872ffd700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7854066f30 0x7f78540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.528+0000 7f7872ffd700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7854066f30 0x7f78540693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f785c001840 tx=0x7f785c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.531+0000 7f786affd700 1 -- 172.21.15.81:0/1263357156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f786c053f70 con 0x7f7874157ca0 2023-10-06T02:48:13.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.713+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f78740d0450 con 0x7f7874157ca0 2023-10-06T02:48:13.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.714+0000 7f786affd700 1 -- 172.21.15.81:0/1263357156 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) v1 ==== 84+0+126 (secure 0 0 0) 0x7f786c02c090 con 0x7f7874157ca0 2023-10-06T02:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7854066f30 msgr2=0x7f78540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7854066f30 0x7f78540693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f785c001840 tx=0x7f785c009040 comp rx=0 tx=0).stop 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7874157ca0 msgr2=0x7f787416afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7874157ca0 0x7f787416afc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f787406fe20 tx=0x7f786c019000 comp rx=0 tx=0).stop 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 shutdown_connections 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7874157ca0 0x7f787416afc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f787406d830 0x7f787416b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7854066f30 0x7f78540693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 --2- 172.21.15.81:0/1263357156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741578d0 0x7f787416d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 >> 172.21.15.81:0/1263357156 conn(0x7f787406bb90 msgr2=0x7f7874069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 shutdown_connections 2023-10-06T02:48:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.716+0000 7f7879788700 1 -- 172.21.15.81:0/1263357156 wait complete. 2023-10-06T02:48:13.729 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:48:13.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:48:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.846+0000 7f952cac9700 1 Processor -- start 2023-10-06T02:48:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.846+0000 7f952cac9700 1 -- start start 2023-10-06T02:48:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f952cac9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f95280d0b80 0x7f95280cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f952cac9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952806d700 0x7f952815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f952cac9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95280cf2d0 con 0x7f95280d02b0 2023-10-06T02:48:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f952cac9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952815a690 con 0x7f95280d0b80 2023-10-06T02:48:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f952cac9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952806dc00 con 0x7f952806d700 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f9526ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f95280d02b0 0x7f952806cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44700/0 (socket says 172.21.15.81:44700) 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f9526ffd700 1 -- 172.21.15.81:0/1137701025 learned_addr learned my addr 172.21.15.81:0/1137701025 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311522021 0 0) 0x7f95280cf2d0 con 0x7f95280d02b0 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f95277fe700 1 --2- 172.21.15.81:0/1137701025 >> v2:172.21.15.83:3300/0 conn(0x7f95280d0b80 0x7f95280cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9510003570 con 0x7f95280d02b0 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f9527fff700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952806d700 0x7f952815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1811625939 0 0) 0x7f9510003570 con 0x7f95280d02b0 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952806d700 msgr2=0x7f952815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.847+0000 7f95267fc700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952806d700 0x7f952815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 >> v2:172.21.15.83:3300/0 conn(0x7f95280d0b80 msgr2=0x7f95280cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 --2- 172.21.15.81:0/1137701025 >> v2:172.21.15.83:3300/0 conn(0x7f95280d0b80 0x7f95280cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280cf570 con 0x7f95280d02b0 2023-10-06T02:48:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f951c001470 con 0x7f95280d02b0 2023-10-06T02:48:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 >> v1:172.21.15.81:6789/0 conn(0x7f95280d02b0 legacy=0x7f952806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510003a60 0x7f9510003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510004810 0x7f9510004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952806d700 0x7f95100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952815a690 con 0x7f9510004810 2023-10-06T02:48:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952806dc00 con 0x7f9510003a60 2023-10-06T02:48:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951000bae0 con 0x7f952806d700 2023-10-06T02:48:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f9526ffd700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510004810 0x7f9510004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95277fe700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510003a60 0x7f9510003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f9527fff700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952806d700 0x7f95100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f9526ffd700 1 -- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952806d700 msgr2=0x7f95100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f9526ffd700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952806d700 0x7f95100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f9526ffd700 1 -- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510003a60 msgr2=0x7f9510003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f9526ffd700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510003a60 0x7f9510003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f9526ffd700 1 -- 172.21.15.81:0/1137701025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510003570 con 0x7f9510004810 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f9526ffd700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510004810 0x7f9510004c80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c3c0 tx=0x7f95280cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33baae0d7b34d14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c00cc90 con 0x7f9510004810 2023-10-06T02:48:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c00cdf0 con 0x7f9510004810 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.848+0000 7f95267fc700 1 -- 172.21.15.81:0/1137701025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c005b70 con 0x7f9510004810 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.849+0000 7f952cac9700 1 -- 172.21.15.81:0/1137701025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510004810 msgr2=0x7f9510004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.849+0000 7f952cac9700 1 --2- 172.21.15.81:0/1137701025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9510004810 0x7f9510004c80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c3c0 tx=0x7f95280cf460 comp rx=0 tx=0).stop 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.849+0000 7f9527fff700 1 -- 172.21.15.81:0/1137701025 reap_dead start 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.849+0000 7f952cac9700 1 -- 172.21.15.81:0/1137701025 shutdown_connections 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.849+0000 7f952cac9700 1 -- 172.21.15.81:0/1137701025 >> 172.21.15.81:0/1137701025 conn(0x7f9528063230 msgr2=0x7f9528063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.849+0000 7f952cac9700 1 -- 172.21.15.81:0/1137701025 shutdown_connections 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.849+0000 7f952cac9700 1 -- 172.21.15.81:0/1137701025 wait complete. 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.850+0000 7f952cac9700 1 Processor -- start 2023-10-06T02:48:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.850+0000 7f952cac9700 1 -- start start 2023-10-06T02:48:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f952cac9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510004810 0x7f95281601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f952cac9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95280c7a20 0x7f95280c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f952cac9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c8700 0x7f95280c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f952cac9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95280c6790 con 0x7f95280c8700 2023-10-06T02:48:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f952cac9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95280c7590 con 0x7f9510004810 2023-10-06T02:48:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f952cac9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95280c6980 con 0x7f95280c7a20 2023-10-06T02:48:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9527fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c8700 0x7f95280c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9527fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c8700 0x7f95280c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48968/0 (socket says 172.21.15.81:48968) 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9527fff700 1 -- 172.21.15.81:0/2100818927 learned_addr learned my addr 172.21.15.81:0/2100818927 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9526ffd700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95280c7a20 0x7f95280c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f95277fe700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510004810 0x7f95281601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9527fff700 1 -- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95280c7a20 msgr2=0x7f95280c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9527fff700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95280c7a20 0x7f95280c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9527fff700 1 -- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510004810 msgr2=0x7f95281601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9527fff700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510004810 0x7f95281601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9527fff700 1 -- 172.21.15.81:0/2100818927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280c6c60 con 0x7f95280c8700 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f95277fe700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510004810 0x7f95281601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.851+0000 7f9527fff700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c8700 0x7f95280c8ba0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f95200094d0 tx=0x7f952000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.852+0000 7f950f7fe700 1 -- 172.21.15.81:0/2100818927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000e040 con 0x7f95280c8700 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.852+0000 7f950f7fe700 1 -- 172.21.15.81:0/2100818927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000f040 con 0x7f95280c8700 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.852+0000 7f950f7fe700 1 -- 172.21.15.81:0/2100818927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000fe40 con 0x7f95280c8700 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.852+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95280c6f40 con 0x7f95280c8700 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.852+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9528157f80 con 0x7f95280c8700 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.852+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95280c7740 con 0x7f95280c8700 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.853+0000 7f950f7fe700 1 -- 172.21.15.81:0/2100818927 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9520015640 con 0x7f95280c8700 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.853+0000 7f950f7fe700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9514066f30 0x7f95140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.853+0000 7f950f7fe700 1 -- 172.21.15.81:0/2100818927 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9520084a70 con 0x7f95280c8700 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.853+0000 7f95277fe700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9514066f30 0x7f95140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.854+0000 7f95277fe700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9514066f30 0x7f95140693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9518006f00 tx=0x7f9518008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:13.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:13.857+0000 7f950f7fe700 1 -- 172.21.15.81:0/2100818927 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95280c7740 con 0x7f95280c8700 2023-10-06T02:48:14.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:14.038+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f95280c7700 con 0x7f95280c8700 2023-10-06T02:48:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.033+0000 7f950f7fe700 1 -- 172.21.15.81:0/2100818927 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9520051ed0 con 0x7f95280c8700 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9514066f30 msgr2=0x7f95140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9514066f30 0x7f95140693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9518006f00 tx=0x7f9518008040 comp rx=0 tx=0).stop 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c8700 msgr2=0x7f95280c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c8700 0x7f95280c8ba0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f95200094d0 tx=0x7f952000b040 comp rx=0 tx=0).stop 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 shutdown_connections 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c8700 0x7f95280c8ba0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9514066f30 0x7f95140693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9510004810 0x7f95281601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 --2- 172.21.15.81:0/2100818927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95280c7a20 0x7f95280c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 >> 172.21.15.81:0/2100818927 conn(0x7f9528063230 msgr2=0x7f95280b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 shutdown_connections 2023-10-06T02:48:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.036+0000 7f952cac9700 1 -- 172.21.15.81:0/2100818927 wait complete. 2023-10-06T02:48:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:48:15.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:48:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.176+0000 7f026e9eb700 1 Processor -- start 2023-10-06T02:48:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.176+0000 7f026e9eb700 1 -- start start 2023-10-06T02:48:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.177+0000 7f026e9eb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0268068f20 0x7f02680cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.177+0000 7f026e9eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268157b90 0x7f02680cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.177+0000 7f026e9eb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680cca80 con 0x7f02681577c0 2023-10-06T02:48:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.177+0000 7f026e9eb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680cedd0 con 0x7f0268068f20 2023-10-06T02:48:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.177+0000 7f026e9eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02680cc210 con 0x7f0268157b90 2023-10-06T02:48:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.177+0000 7f0267fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f02681577c0 0x7f0268068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44706/0 (socket says 172.21.15.81:44706) 2023-10-06T02:48:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.177+0000 7f0267fff700 1 -- 172.21.15.81:0/3567199174 learned_addr learned my addr 172.21.15.81:0/3567199174 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f026cf88700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268157b90 0x7f02680cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f02677fe700 1 --2- 172.21.15.81:0/3567199174 >> v2:172.21.15.83:3300/0 conn(0x7f0268068f20 0x7f02680cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041464714 0 0) 0x7f02680cca80 con 0x7f02681577c0 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0250003570 con 0x7f02681577c0 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 215937780 0 0) 0x7f0250003570 con 0x7f02681577c0 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268157b90 msgr2=0x7f02680cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268157b90 0x7f02680cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 >> v2:172.21.15.83:3300/0 conn(0x7f0268068f20 msgr2=0x7f02680cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 --2- 172.21.15.81:0/3567199174 >> v2:172.21.15.83:3300/0 conn(0x7f0268068f20 0x7f02680cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680cc4c0 con 0x7f02681577c0 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f0258001470 con 0x7f02681577c0 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 >> v1:172.21.15.81:6789/0 conn(0x7f02681577c0 legacy=0x7f0268068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0250003a60 0x7f0250003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268157b90 0x7f0250004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0250004d50 0x7f02500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680cedd0 con 0x7f0250004d50 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680cc210 con 0x7f0250003a60 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025000ba60 con 0x7f0268157b90 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f026cf88700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0250004d50 0x7f02500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f02677fe700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268157b90 0x7f0250004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f0267fff700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0250003a60 0x7f0250003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f026cf88700 1 -- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268157b90 msgr2=0x7f0250004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f026cf88700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268157b90 0x7f0250004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f026cf88700 1 -- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0250003a60 msgr2=0x7f0250003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f026cf88700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0250003a60 0x7f0250003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f026cf88700 1 -- 172.21.15.81:0/3567199174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250003570 con 0x7f0250004d50 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.178+0000 7f026cf88700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0250004d50 0x7f02500051c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f026000e210 tx=0x7f026000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5662ff13a153792 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000ea60 con 0x7f0250004d50 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000f040 con 0x7f0250004d50 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f0266ffd700 1 -- 172.21.15.81:0/3567199174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000ee10 con 0x7f0250004d50 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f026e9eb700 1 -- 172.21.15.81:0/3567199174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0250004d50 msgr2=0x7f02500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f026e9eb700 1 --2- 172.21.15.81:0/3567199174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0250004d50 0x7f02500051c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f026000e210 tx=0x7f026000b040 comp rx=0 tx=0).stop 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f026cf88700 1 -- 172.21.15.81:0/3567199174 reap_dead start 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f026e9eb700 1 -- 172.21.15.81:0/3567199174 shutdown_connections 2023-10-06T02:48:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f026e9eb700 1 -- 172.21.15.81:0/3567199174 >> 172.21.15.81:0/3567199174 conn(0x7f02680d0df0 msgr2=0x7f02680d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:15.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f026e9eb700 1 -- 172.21.15.81:0/3567199174 shutdown_connections 2023-10-06T02:48:15.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.179+0000 7f026e9eb700 1 -- 172.21.15.81:0/3567199174 wait complete. 2023-10-06T02:48:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.180+0000 7f026e9eb700 1 Processor -- start 2023-10-06T02:48:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.180+0000 7f026e9eb700 1 -- start start 2023-10-06T02:48:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f026e9eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02680caaf0 0x7f0268155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f026e9eb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02680caec0 0x7f026816e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f026e9eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268152350 0x7f02681527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f026e9eb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268150f30 con 0x7f02680caaf0 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f026e9eb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026816e160 con 0x7f02680caec0 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f026e9eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02681564f0 con 0x7f0268152350 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f0267fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02680caaf0 0x7f0268155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f0267fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02680caaf0 0x7f0268155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48980/0 (socket says 172.21.15.81:48980) 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f0267fff700 1 -- 172.21.15.81:0/2489543048 learned_addr learned my addr 172.21.15.81:0/2489543048 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f02677fe700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02680caec0 0x7f026816e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.181+0000 7f026cf88700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268152350 0x7f02681527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f0267fff700 1 -- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268152350 msgr2=0x7f02681527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:15.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f0267fff700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268152350 0x7f02681527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f0267fff700 1 -- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02680caec0 msgr2=0x7f026816e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f0267fff700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02680caec0 0x7f026816e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f0267fff700 1 -- 172.21.15.81:0/2489543048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268150690 con 0x7f02680caaf0 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f0267fff700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02680caaf0 0x7f0268155fb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0258004890 tx=0x7f0258001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f024ffff700 1 -- 172.21.15.81:0/2489543048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258018030 con 0x7f02680caaf0 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f024ffff700 1 -- 172.21.15.81:0/2489543048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02580077a0 con 0x7f02680caaf0 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f024ffff700 1 -- 172.21.15.81:0/2489543048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800fa70 con 0x7f02680caaf0 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0268150970 con 0x7f02680caaf0 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.182+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026816ddf0 con 0x7f02680caaf0 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.183+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026816dc50 con 0x7f02680caaf0 2023-10-06T02:48:15.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.183+0000 7f024ffff700 1 -- 172.21.15.81:0/2489543048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f025801b070 con 0x7f02680caaf0 2023-10-06T02:48:15.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.183+0000 7f024ffff700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0254066f30 0x7f02540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:15.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.184+0000 7f024ffff700 1 -- 172.21.15.81:0/2489543048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f0258019070 con 0x7f02680caaf0 2023-10-06T02:48:15.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.184+0000 7f02677fe700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0254066f30 0x7f02540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:15.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.184+0000 7f02677fe700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0254066f30 0x7f02540693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f025c006f00 tx=0x7f025c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:15.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.188+0000 7f024ffff700 1 -- 172.21.15.81:0/2489543048 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f026816dc50 con 0x7f02680caaf0 2023-10-06T02:48:15.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:15.374+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f026816dc50 con 0x7f02680caaf0 2023-10-06T02:48:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.042+0000 7f024ffff700 1 -- 172.21.15.81:0/2489543048 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) v1 ==== 170+0+0 (secure 0 0 0) 0x7f026816dc50 con 0x7f02680caaf0 2023-10-06T02:48:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.048+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0254066f30 msgr2=0x7f02540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.048+0000 7f026e9eb700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0254066f30 0x7f02540693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f025c006f00 tx=0x7f025c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.048+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02680caaf0 msgr2=0x7f0268155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.048+0000 7f026e9eb700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02680caaf0 0x7f0268155fb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0258004890 tx=0x7f0258001e90 comp rx=0 tx=0).stop 2023-10-06T02:48:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.049+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 shutdown_connections 2023-10-06T02:48:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.049+0000 7f026e9eb700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0268152350 0x7f02681527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.049+0000 7f026e9eb700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02680caaf0 0x7f0268155fb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.049+0000 7f026e9eb700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0254066f30 0x7f02540693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.049+0000 7f026e9eb700 1 --2- 172.21.15.81:0/2489543048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02680caec0 0x7f026816e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.049+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 >> 172.21.15.81:0/2489543048 conn(0x7f02680d0df0 msgr2=0x7f0268158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.049+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 shutdown_connections 2023-10-06T02:48:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.049+0000 7f026e9eb700 1 -- 172.21.15.81:0/2489543048 wait complete. 2023-10-06T02:48:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:48:16.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:48:16.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.181+0000 7f83e5f5a700 1 Processor -- start 2023-10-06T02:48:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.181+0000 7f83e5f5a700 1 -- start start 2023-10-06T02:48:16.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83e5f5a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83e00d0b80 0x7f83e00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:16.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83e5f5a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f83e006d700 0x7f83e015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:16.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83e5f5a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e00cf2d0 con 0x7f83e00d02b0 2023-10-06T02:48:16.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83e5f5a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e015a690 con 0x7f83e006d700 2023-10-06T02:48:16.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83e5f5a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e006dc00 con 0x7f83e00d0b80 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83d7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f83e00d02b0 0x7f83e006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44718/0 (socket says 172.21.15.81:44718) 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83d7fff700 1 -- 172.21.15.81:0/2500246766 learned_addr learned my addr 172.21.15.81:0/2500246766 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406042882 0 0) 0x7f83e00cf2d0 con 0x7f83e00d02b0 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c8003570 con 0x7f83e00d02b0 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83e5759700 1 --2- 172.21.15.81:0/2500246766 >> v2:172.21.15.83:3300/0 conn(0x7f83e006d700 0x7f83e015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.182+0000 7f83e4f58700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83e00d0b80 0x7f83e00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 376034497 0 0) 0x7f83c8003570 con 0x7f83e00d02b0 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83e00d0b80 msgr2=0x7f83e00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83e00d0b80 0x7f83e00cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 >> v2:172.21.15.83:3300/0 conn(0x7f83e006d700 msgr2=0x7f83e015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:16.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 --2- 172.21.15.81:0/2500246766 >> v2:172.21.15.83:3300/0 conn(0x7f83e006d700 0x7f83e015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00cf570 con 0x7f83e00d02b0 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f83d0001470 con 0x7f83e00d02b0 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 >> v1:172.21.15.81:6789/0 conn(0x7f83e00d02b0 legacy=0x7f83e006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c8003a60 0x7f83c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83e00d0b80 0x7f83c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83c8004d50 0x7f83c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e015a690 con 0x7f83c8003a60 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e006dc00 con 0x7f83c8004d50 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c800ba60 con 0x7f83e00d0b80 2023-10-06T02:48:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83e4f58700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c8003a60 0x7f83c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d7fff700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83e00d0b80 0x7f83c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83e5759700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83c8004d50 0x7f83c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83e4f58700 1 -- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83e00d0b80 msgr2=0x7f83c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83e4f58700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83e00d0b80 0x7f83c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83e4f58700 1 -- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83c8004d50 msgr2=0x7f83c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83e4f58700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83c8004d50 0x7f83c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83e4f58700 1 -- 172.21.15.81:0/2500246766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8003570 con 0x7f83c8003a60 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83e5759700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83c8004d50 0x7f83c80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d7fff700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83e00d0b80 0x7f83c8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83e4f58700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c8003a60 0x7f83c8003e70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009c00 tx=0x7f83dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209f9b119a7d6c52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00e6b0 con 0x7f83c8003a60 2023-10-06T02:48:16.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00e810 con 0x7f83c8003a60 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.183+0000 7f83d77fe700 1 -- 172.21.15.81:0/2500246766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00ebd0 con 0x7f83c8003a60 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.184+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2500246766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c8003a60 msgr2=0x7f83c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.184+0000 7f83e5f5a700 1 --2- 172.21.15.81:0/2500246766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83c8003a60 0x7f83c8003e70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009c00 tx=0x7f83dc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.184+0000 7f83e5759700 1 -- 172.21.15.81:0/2500246766 reap_dead start 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.184+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2500246766 shutdown_connections 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.184+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2500246766 >> 172.21.15.81:0/2500246766 conn(0x7f83e0063230 msgr2=0x7f83e0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.184+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2500246766 shutdown_connections 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.184+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2500246766 wait complete. 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.185+0000 7f83e5f5a700 1 Processor -- start 2023-10-06T02:48:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.185+0000 7f83e5f5a700 1 -- start start 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e5f5a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83c8003a60 0x7f83e00b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e5f5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e00b0530 0x7f83e00cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e5f5a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e00aec10 0x7f83e00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e5f5a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e00b00a0 con 0x7f83e00b0530 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e5f5a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e00af490 con 0x7f83e00aec10 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e5f5a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e00af770 con 0x7f83c8003a60 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e00b0530 0x7f83e00cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e00b0530 0x7f83e00cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48992/0 (socket says 172.21.15.81:48992) 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83d7fff700 1 -- 172.21.15.81:0/2961426654 learned_addr learned my addr 172.21.15.81:0/2961426654 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e5759700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e00aec10 0x7f83e00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e4f58700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83c8003a60 0x7f83e00b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83d7fff700 1 -- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83c8003a60 msgr2=0x7f83e00b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83d7fff700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83c8003a60 0x7f83e00b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83d7fff700 1 -- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e00aec10 msgr2=0x7f83e00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83d7fff700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e00aec10 0x7f83e00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83d7fff700 1 -- 172.21.15.81:0/2961426654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00afa50 con 0x7f83e00b0530 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e4f58700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83c8003a60 0x7f83e00b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.186+0000 7f83e5759700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e00aec10 0x7f83e00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.187+0000 7f83d7fff700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e00b0530 0x7f83e00cd4f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f83d00015e0 tx=0x7f83d0001570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.187+0000 7f83d4ff9700 1 -- 172.21.15.81:0/2961426654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d000c7b0 con 0x7f83e00b0530 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.187+0000 7f83d4ff9700 1 -- 172.21.15.81:0/2961426654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d000c910 con 0x7f83e00b0530 2023-10-06T02:48:16.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.187+0000 7f83d4ff9700 1 -- 172.21.15.81:0/2961426654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d000ccb0 con 0x7f83e00b0530 2023-10-06T02:48:16.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.187+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e00afd30 con 0x7f83e00b0530 2023-10-06T02:48:16.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.187+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e00cda30 con 0x7f83e00b0530 2023-10-06T02:48:16.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.188+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e00b0250 con 0x7f83e00b0530 2023-10-06T02:48:16.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.188+0000 7f83d4ff9700 1 -- 172.21.15.81:0/2961426654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83d0013630 con 0x7f83e00b0530 2023-10-06T02:48:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.189+0000 7f83d4ff9700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f83cc066f30 0x7f83cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.189+0000 7f83d4ff9700 1 -- 172.21.15.81:0/2961426654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f83d0084720 con 0x7f83e00b0530 2023-10-06T02:48:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.189+0000 7f83e4f58700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f83cc066f30 0x7f83cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.189+0000 7f83e4f58700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f83cc066f30 0x7f83cc0693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009c00 tx=0x7f83dc01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.193+0000 7f83d4ff9700 1 -- 172.21.15.81:0/2961426654 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83e00b0250 con 0x7f83e00b0530 2023-10-06T02:48:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:16.416+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f83e00676e0 con 0x7f83e00b0530 2023-10-06T02:48:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.056+0000 7f83d4ff9700 1 -- 172.21.15.81:0/2961426654 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v30) v1 ==== 173+0+0 (secure 0 0 0) 0x7f83d0055090 con 0x7f83e00b0530 2023-10-06T02:48:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f83cc066f30 msgr2=0x7f83cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f83cc066f30 0x7f83cc0693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009c00 tx=0x7f83dc01a000 comp rx=0 tx=0).stop 2023-10-06T02:48:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e00b0530 msgr2=0x7f83e00cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e00b0530 0x7f83e00cd4f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f83d00015e0 tx=0x7f83d0001570 comp rx=0 tx=0).stop 2023-10-06T02:48:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 shutdown_connections 2023-10-06T02:48:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f83cc066f30 0x7f83cc0693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e00aec10 0x7f83e00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83c8003a60 0x7f83e00b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 --2- 172.21.15.81:0/2961426654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e00b0530 0x7f83e00cd4f0 secure :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f83d00015e0 tx=0x7f83d0001570 comp rx=0 tx=0).stop 2023-10-06T02:48:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.061+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 >> 172.21.15.81:0/2961426654 conn(0x7f83e0063230 msgr2=0x7f83e015b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.062+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 shutdown_connections 2023-10-06T02:48:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.062+0000 7f83e5f5a700 1 -- 172.21.15.81:0/2961426654 wait complete. 2023-10-06T02:48:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 9 and data pool 10 2023-10-06T02:48:17.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:48:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.190+0000 7fa201b7a700 1 Processor -- start 2023-10-06T02:48:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.190+0000 7fa201b7a700 1 -- start start 2023-10-06T02:48:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa201b7a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa1fc159b40 0x7fa1fc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa201b7a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1fc159f10 0x7fa1fc068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa201b7a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1fc0cee10 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa201b7a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1fc0cd040 con 0x7fa1fc159f10 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa201b7a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1fc0cd320 con 0x7fa1fc159b40 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa1fbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1fc159f10 0x7fa1fc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa201379700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa1fc0ccb40 0x7fa1fc15d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44726/0 (socket says 172.21.15.81:44726) 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa1fbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1fc159f10 0x7fa1fc068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49000/0 (socket says 172.21.15.81:49000) 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa201379700 1 -- 172.21.15.81:0/3347808044 learned_addr learned my addr 172.21.15.81:0/3347808044 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa1fbfff700 1 -- 172.21.15.81:0/3347808044 >> v2:172.21.15.83:3300/0 conn(0x7fa1fc159b40 msgr2=0x7fa1fc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa1fbfff700 1 --2- 172.21.15.81:0/3347808044 >> v2:172.21.15.83:3300/0 conn(0x7fa1fc159b40 0x7fa1fc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa1fbfff700 1 -- 172.21.15.81:0/3347808044 >> v1:172.21.15.81:6789/0 conn(0x7fa1fc0ccb40 legacy=0x7fa1fc15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa1fb7fe700 1 -- 172.21.15.81:0/3347808044 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680834041 0 0) 0x7fa1fc0cee10 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa1fbfff700 1 -- 172.21.15.81:0/3347808044 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc0ce7c0 con 0x7fa1fc159f10 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.191+0000 7fa1fbfff700 1 --2- 172.21.15.81:0/3347808044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc159f10 0x7fa1fc068780 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0d0bc0 tx=0x7fa1e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915c5d0d48532f0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa1fb7fe700 1 -- 172.21.15.81:0/3347808044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800b6b0 con 0x7fa1fc159f10 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa1fb7fe700 1 -- 172.21.15.81:0/3347808044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e800b810 con 0x7fa1fc159f10 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa1fb7fe700 1 -- 172.21.15.81:0/3347808044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800bbb0 con 0x7fa1fc159f10 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa201b7a700 1 -- 172.21.15.81:0/3347808044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc159f10 msgr2=0x7fa1fc068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa201b7a700 1 --2- 172.21.15.81:0/3347808044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc159f10 0x7fa1fc068780 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0d0bc0 tx=0x7fa1e80091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa201b7a700 1 -- 172.21.15.81:0/3347808044 shutdown_connections 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa201b7a700 1 --2- 172.21.15.81:0/3347808044 >> v2:172.21.15.83:3300/0 conn(0x7fa1fc159b40 0x7fa1fc0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa201b7a700 1 --2- 172.21.15.81:0/3347808044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc159f10 0x7fa1fc068780 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa201b7a700 1 -- 172.21.15.81:0/3347808044 >> 172.21.15.81:0/3347808044 conn(0x7fa1fc0cd660 msgr2=0x7fa1fc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa201b7a700 1 -- 172.21.15.81:0/3347808044 shutdown_connections 2023-10-06T02:48:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.192+0000 7fa201b7a700 1 -- 172.21.15.81:0/3347808044 wait complete. 2023-10-06T02:48:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.193+0000 7fa201b7a700 1 Processor -- start 2023-10-06T02:48:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.193+0000 7fa201b7a700 1 -- start start 2023-10-06T02:48:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa201b7a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0ccb40 0x7fa1fc15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa201b7a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1fc159b40 0x7fa1fc16a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa201b7a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1fc159f10 0x7fa1fc0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa201b7a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc154e90 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa201b7a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc0c9130 con 0x7fa1fc159b40 2023-10-06T02:48:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa201b7a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc0c9410 con 0x7fa1fc159f10 2023-10-06T02:48:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa200b78700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0ccb40 0x7fa1fc15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa200b78700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0ccb40 0x7fa1fc15a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49008/0 (socket says 172.21.15.81:49008) 2023-10-06T02:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa200b78700 1 -- 172.21.15.81:0/3102054561 learned_addr learned my addr 172.21.15.81:0/3102054561 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa200b78700 1 -- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1fc159f10 msgr2=0x7fa1fc0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa200b78700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1fc159f10 0x7fa1fc0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa200b78700 1 -- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1fc159b40 msgr2=0x7fa1fc16a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa1fbfff700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1fc159b40 0x7fa1fc16a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa200b78700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1fc159b40 0x7fa1fc16a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.194+0000 7fa200b78700 1 -- 172.21.15.81:0/3102054561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009420 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.195+0000 7fa200b78700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0ccb40 0x7fa1fc15a550 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000b810 tx=0x7fa1f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.195+0000 7fa1f8ff9700 1 -- 172.21.15.81:0/3102054561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f000f5f0 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.195+0000 7fa1f8ff9700 1 -- 172.21.15.81:0/3102054561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f000f770 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.195+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc0c96f0 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.195+0000 7fa1f8ff9700 1 -- 172.21.15.81:0/3102054561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f000fb30 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.195+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc15aa90 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.196+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc0c98e0 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.196+0000 7fa1f8ff9700 1 -- 172.21.15.81:0/3102054561 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1f0010480 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.196+0000 7fa1f8ff9700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa1e0066f30 0x7fa1e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.197+0000 7fa1f8ff9700 1 -- 172.21.15.81:0/3102054561 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa1f00845d0 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.197+0000 7fa1fbfff700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa1e0066f30 0x7fa1e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.197+0000 7fa1fbfff700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa1e0066f30 0x7fa1e00693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc15c190 tx=0x7fa1e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.201+0000 7fa1f8ff9700 1 -- 172.21.15.81:0/3102054561 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1f0051760 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.384+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1fc0cc130 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.385+0000 7fa1f8ff9700 1 -- 172.21.15.81:0/3102054561 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16833 (secure 0 0 0) 0x7fa1f0054d80 con 0x7fa1fc0ccb40 2023-10-06T02:48:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:17.387 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":65,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:48:16.417393+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:48:14.055897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:48:15.392030+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:48:17.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa1e0066f30 msgr2=0x7fa1e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa1e0066f30 0x7fa1e00693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc15c190 tx=0x7fa1e8017000 comp rx=0 tx=0).stop 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0ccb40 msgr2=0x7fa1fc15a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0ccb40 0x7fa1fc15a550 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000b810 tx=0x7fa1f0009250 comp rx=0 tx=0).stop 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 shutdown_connections 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1fc159f10 0x7fa1fc0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0ccb40 0x7fa1fc15a550 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa1e0066f30 0x7fa1e00693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 --2- 172.21.15.81:0/3102054561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1fc159b40 0x7fa1fc16a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 >> 172.21.15.81:0/3102054561 conn(0x7fa1fc0cd660 msgr2=0x7fa1fc0cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 shutdown_connections 2023-10-06T02:48:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.387+0000 7fa201b7a700 1 -- 172.21.15.81:0/3102054561 wait complete. 2023-10-06T02:48:17.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:48:17.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.512+0000 7f006359e700 1 Processor -- start 2023-10-06T02:48:17.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.512+0000 7f006359e700 1 -- start start 2023-10-06T02:48:17.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00640add30 0x7f00640b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 0x7f0064067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0064067ff0 con 0x7f00640ce890 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640b37b0 con 0x7f00640add30 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00640b17c0 con 0x7f0064067640 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00640add30 0x7f00640b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00640add30 0x7f00640b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49012/0 (socket says 172.21.15.81:49012) 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f0062d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f00640ce890 0x7f00640cc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44728/0 (socket says 172.21.15.81:44728) 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006259c700 1 -- 172.21.15.81:0/3071373285 learned_addr learned my addr 172.21.15.81:0/3071373285 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f0061d9b700 1 --2- 172.21.15.81:0/3071373285 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 0x7f0064067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006259c700 1 -- 172.21.15.81:0/3071373285 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 msgr2=0x7f0064067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006259c700 1 --2- 172.21.15.81:0/3071373285 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 0x7f0064067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006259c700 1 -- 172.21.15.81:0/3071373285 >> v1:172.21.15.81:6789/0 conn(0x7f00640ce890 legacy=0x7f00640cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006259c700 1 -- 172.21.15.81:0/3071373285 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640b1d80 con 0x7f00640add30 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006159a700 1 -- 172.21.15.81:0/3071373285 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376160394 0 0) 0x7f0064067ff0 con 0x7f00640ce890 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.513+0000 7f006259c700 1 --2- 172.21.15.81:0/3071373285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 0x7f00640b2210 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f005c009f20 tx=0x7f005c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4e069867f15196 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006159a700 1 -- 172.21.15.81:0/3071373285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00e070 con 0x7f00640add30 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006159a700 1 -- 172.21.15.81:0/3071373285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c00ba80 con 0x7f00640add30 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006159a700 1 -- 172.21.15.81:0/3071373285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c0092e0 con 0x7f00640add30 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006359e700 1 -- 172.21.15.81:0/3071373285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 msgr2=0x7f00640b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006359e700 1 --2- 172.21.15.81:0/3071373285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 0x7f00640b2210 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f005c009f20 tx=0x7f005c009840 comp rx=0 tx=0).stop 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006359e700 1 -- 172.21.15.81:0/3071373285 shutdown_connections 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006359e700 1 --2- 172.21.15.81:0/3071373285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 0x7f00640b2210 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006359e700 1 --2- 172.21.15.81:0/3071373285 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 0x7f0064067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006359e700 1 -- 172.21.15.81:0/3071373285 >> 172.21.15.81:0/3071373285 conn(0x7f006406c620 msgr2=0x7f006406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006359e700 1 -- 172.21.15.81:0/3071373285 shutdown_connections 2023-10-06T02:48:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.514+0000 7f006359e700 1 -- 172.21.15.81:0/3071373285 wait complete. 2023-10-06T02:48:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.515+0000 7f006359e700 1 Processor -- start 2023-10-06T02:48:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.515+0000 7f006359e700 1 -- start start 2023-10-06T02:48:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f006359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 0x7f00640a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f006359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 0x7f00641551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f006359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00640ce890 0x7f0064158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f006359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640a6480 con 0x7f00640add30 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f006359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0064158b50 con 0x7f00640ce890 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f006359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0064158e30 con 0x7f0064067640 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f0061d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 0x7f00641551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f0061d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 0x7f00641551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49020/0 (socket says 172.21.15.81:49020) 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f0061d9b700 1 -- 172.21.15.81:0/605556179 learned_addr learned my addr 172.21.15.81:0/605556179 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f0062d9d700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00640ce890 0x7f0064158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f0061d9b700 1 -- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 msgr2=0x7f00640a8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f006259c700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 0x7f00640a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f0061d9b700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 0x7f00640a8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f0061d9b700 1 -- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00640ce890 msgr2=0x7f0064158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f0061d9b700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00640ce890 0x7f0064158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.516+0000 7f0061d9b700 1 -- 172.21.15.81:0/605556179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c009ae0 con 0x7f00640add30 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.517+0000 7f0061d9b700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 0x7f00641551d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f004c00d890 tx=0x7f004c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.517+0000 7f005a7fc700 1 -- 172.21.15.81:0/605556179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00b600 con 0x7f00640add30 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.517+0000 7f005a7fc700 1 -- 172.21.15.81:0/605556179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c00b760 con 0x7f00640add30 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.517+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0064159110 con 0x7f00640add30 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.517+0000 7f005a7fc700 1 -- 172.21.15.81:0/605556179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00bae0 con 0x7f00640add30 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.517+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640a8550 con 0x7f00640add30 2023-10-06T02:48:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.518+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0064069920 con 0x7f00640add30 2023-10-06T02:48:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.518+0000 7f005a7fc700 1 -- 172.21.15.81:0/605556179 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f004c01e460 con 0x7f00640add30 2023-10-06T02:48:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.518+0000 7f005a7fc700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0044066f60 0x7f0044069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.519+0000 7f005a7fc700 1 -- 172.21.15.81:0/605556179 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f004c084d20 con 0x7f00640add30 2023-10-06T02:48:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.519+0000 7f006259c700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0044066f60 0x7f0044069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.519+0000 7f006259c700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0044066f60 0x7f0044069410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f005c009880 tx=0x7f005c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.523+0000 7f005a7fc700 1 -- 172.21.15.81:0/605556179 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f004c051e30 con 0x7f00640add30 2023-10-06T02:48:17.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.706+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0064068220 con 0x7f00640add30 2023-10-06T02:48:17.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.707+0000 7f005a7fc700 1 -- 172.21.15.81:0/605556179 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16833 (secure 0 0 0) 0x7f004c055450 con 0x7f00640add30 2023-10-06T02:48:17.708 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:17.708 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":65,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:48:16.417393+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:48:14.055897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:48:15.392030+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:48:17.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0044066f60 msgr2=0x7f0044069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0044066f60 0x7f0044069410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f005c009880 tx=0x7f005c018000 comp rx=0 tx=0).stop 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 msgr2=0x7f00641551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 0x7f00641551d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f004c00d890 tx=0x7f004c008040 comp rx=0 tx=0).stop 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 shutdown_connections 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0044066f60 0x7f0044069410 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00640ce890 0x7f0064158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0064067640 0x7f00640a8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 --2- 172.21.15.81:0/605556179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00640add30 0x7f00641551d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 >> 172.21.15.81:0/605556179 conn(0x7f006406c620 msgr2=0x7f00640ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 shutdown_connections 2023-10-06T02:48:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.709+0000 7f006359e700 1 -- 172.21.15.81:0/605556179 wait complete. 2023-10-06T02:48:17.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:48:17.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.837+0000 7f6025a37700 1 Processor -- start 2023-10-06T02:48:17.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.837+0000 7f6025a37700 1 -- start start 2023-10-06T02:48:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.838+0000 7f6025a37700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6020157fe0 0x7f60200b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.838+0000 7f6025a37700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60200cf240 0x7f60200b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.838+0000 7f6025a37700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60200b2890 con 0x7f60201583b0 2023-10-06T02:48:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.838+0000 7f6025a37700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200b4070 con 0x7f60200cf240 2023-10-06T02:48:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.838+0000 7f6025a37700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200b4350 con 0x7f6020157fe0 2023-10-06T02:48:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.838+0000 7f601f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60200cf240 0x7f60200b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.838+0000 7f601f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60200cf240 0x7f60200b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49036/0 (socket says 172.21.15.81:49036) 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.838+0000 7f601f7fe700 1 -- 172.21.15.81:0/1441240204 learned_addr learned my addr 172.21.15.81:0/1441240204 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601effd700 1 --2- 172.21.15.81:0/1441240204 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6020157fe0 0x7f60200b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601f7fe700 1 -- 172.21.15.81:0/1441240204 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6020157fe0 msgr2=0x7f60200b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601f7fe700 1 --2- 172.21.15.81:0/1441240204 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6020157fe0 0x7f60200b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601f7fe700 1 -- 172.21.15.81:0/1441240204 >> v1:172.21.15.83:6789/0 conn(0x7f60201583b0 legacy=0x7f60200ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601f7fe700 1 -- 172.21.15.81:0/1441240204 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200b4630 con 0x7f60200cf240 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601effd700 1 --2- 172.21.15.81:0/1441240204 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6020157fe0 0x7f60200b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601f7fe700 1 --2- 172.21.15.81:0/1441240204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60200cf240 0x7f60200b3a00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6018009f20 tx=0x7f6018009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263a124a4425d1e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601e7fc700 1 -- 172.21.15.81:0/1441240204 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800e070 con 0x7f60200cf240 2023-10-06T02:48:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601e7fc700 1 -- 172.21.15.81:0/1441240204 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601800ba80 con 0x7f60200cf240 2023-10-06T02:48:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.839+0000 7f601e7fc700 1 -- 172.21.15.81:0/1441240204 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180092e0 con 0x7f60200cf240 2023-10-06T02:48:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.840+0000 7f6025a37700 1 -- 172.21.15.81:0/1441240204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60200cf240 msgr2=0x7f60200b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.840+0000 7f6025a37700 1 --2- 172.21.15.81:0/1441240204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60200cf240 0x7f60200b3a00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6018009f20 tx=0x7f6018009840 comp rx=0 tx=0).stop 2023-10-06T02:48:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.840+0000 7f6025a37700 1 -- 172.21.15.81:0/1441240204 shutdown_connections 2023-10-06T02:48:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.840+0000 7f6025a37700 1 --2- 172.21.15.81:0/1441240204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60200cf240 0x7f60200b3a00 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.840+0000 7f6025a37700 1 --2- 172.21.15.81:0/1441240204 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6020157fe0 0x7f60200b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.840+0000 7f6025a37700 1 -- 172.21.15.81:0/1441240204 >> 172.21.15.81:0/1441240204 conn(0x7f6020067640 msgr2=0x7f6020067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.840+0000 7f6025a37700 1 -- 172.21.15.81:0/1441240204 shutdown_connections 2023-10-06T02:48:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.840+0000 7f6025a37700 1 -- 172.21.15.81:0/1441240204 wait complete. 2023-10-06T02:48:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.841+0000 7f6025a37700 1 Processor -- start 2023-10-06T02:48:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.841+0000 7f6025a37700 1 -- start start 2023-10-06T02:48:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f6025a37700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200cf240 0x7f602013fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f6025a37700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6020157fe0 0x7f602015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f6025a37700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60201583b0 0x7f602015d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f6025a37700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200cb720 con 0x7f6020157fe0 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f6025a37700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200caaa0 con 0x7f60200cf240 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f6025a37700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200cad80 con 0x7f60201583b0 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60167fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6020157fe0 0x7f602015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60167fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6020157fe0 0x7f602015cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49050/0 (socket says 172.21.15.81:49050) 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60167fc700 1 -- 172.21.15.81:0/1298709695 learned_addr learned my addr 172.21.15.81:0/1298709695 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f601f7fe700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60201583b0 0x7f602015d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f601effd700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200cf240 0x7f602013fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60167fc700 1 -- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60201583b0 msgr2=0x7f602015d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60167fc700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60201583b0 0x7f602015d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60167fc700 1 -- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200cf240 msgr2=0x7f602013fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60167fc700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200cf240 0x7f602013fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60167fc700 1 -- 172.21.15.81:0/1298709695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018009ae0 con 0x7f6020157fe0 2023-10-06T02:48:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f601effd700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200cf240 0x7f602013fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60167fc700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6020157fe0 0x7f602015cbf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f600800c590 tx=0x7f600800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60177fe700 1 -- 172.21.15.81:0/1298709695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008011590 con 0x7f6020157fe0 2023-10-06T02:48:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60177fe700 1 -- 172.21.15.81:0/1298709695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6008011710 con 0x7f6020157fe0 2023-10-06T02:48:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f60177fe700 1 -- 172.21.15.81:0/1298709695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008011ad0 con 0x7f6020157fe0 2023-10-06T02:48:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.842+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60200cb060 con 0x7f6020157fe0 2023-10-06T02:48:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.843+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6020140050 con 0x7f6020157fe0 2023-10-06T02:48:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.843+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60200cb860 con 0x7f6020157fe0 2023-10-06T02:48:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.844+0000 7f60177fe700 1 -- 172.21.15.81:0/1298709695 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f600801b3b0 con 0x7f6020157fe0 2023-10-06T02:48:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.844+0000 7f60177fe700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6000066f30 0x7f60000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.844+0000 7f60177fe700 1 -- 172.21.15.81:0/1298709695 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6008083bc0 con 0x7f6020157fe0 2023-10-06T02:48:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.844+0000 7f601effd700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6000066f30 0x7f60000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.845+0000 7f601effd700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6000066f30 0x7f60000693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f601000ac10 tx=0x7f6010006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:17.848+0000 7f60177fe700 1 -- 172.21.15.81:0/1298709695 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60200cb860 con 0x7f6020157fe0 2023-10-06T02:48:18.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:18.075+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f60200cb860 con 0x7f6020157fe0 2023-10-06T02:48:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.070+0000 7f60177fe700 1 -- 172.21.15.81:0/1298709695 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7f60200cb860 con 0x7f6020157fe0 2023-10-06T02:48:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6000066f30 msgr2=0x7f60000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6000066f30 0x7f60000693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f601000ac10 tx=0x7f6010006f90 comp rx=0 tx=0).stop 2023-10-06T02:48:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6020157fe0 msgr2=0x7f602015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6020157fe0 0x7f602015cbf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f600800c590 tx=0x7f600800c8a0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 shutdown_connections 2023-10-06T02:48:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60201583b0 0x7f602015d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6000066f30 0x7f60000693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200cf240 0x7f602013fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 --2- 172.21.15.81:0/1298709695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6020157fe0 0x7f602015cbf0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.072+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 >> 172.21.15.81:0/1298709695 conn(0x7f6020067640 msgr2=0x7f6020156030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.073+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 shutdown_connections 2023-10-06T02:48:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.073+0000 7f6025a37700 1 -- 172.21.15.81:0/1298709695 wait complete. 2023-10-06T02:48:19.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:48:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.203+0000 7f4009498700 1 Processor -- start 2023-10-06T02:48:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.203+0000 7f4009498700 1 -- start start 2023-10-06T02:48:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4009498700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040d0f50 0x7f400406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4009498700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400406d9b0 con 0x7f400406d530 2023-10-06T02:48:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4009498700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40040cf2d0 con 0x7f40040d0b80 2023-10-06T02:48:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4009498700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400415a690 con 0x7f40040d0f50 2023-10-06T02:48:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4008c97700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f400406d530 0x7f400415b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44730/0 (socket says 172.21.15.81:44730) 2023-10-06T02:48:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4008c97700 1 -- 172.21.15.81:0/3041882512 learned_addr learned my addr 172.21.15.81:0/3041882512 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f40037fe700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040d0f50 0x7f400406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971316329 0 0) 0x7f400406d9b0 con 0x7f400406d530 2023-10-06T02:48:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fec003570 con 0x7f400406d530 2023-10-06T02:48:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3870264824 0 0) 0x7f3fec003570 con 0x7f400406d530 2023-10-06T02:48:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040d0f50 msgr2=0x7f400406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040d0f50 0x7f400406cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 >> v1:172.21.15.83:6789/0 conn(0x7f40040d0b80 legacy=0x7f40040cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40040d0480 con 0x7f400406d530 2023-10-06T02:48:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f3ffc0017f0 con 0x7f400406d530 2023-10-06T02:48:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 >> v1:172.21.15.81:6789/0 conn(0x7f400406d530 legacy=0x7f400415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:19.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fec003a90 0x7f3fec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:19.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.204+0000 7f4002ffd700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040d0f50 0x7f3fec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:19.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4002ffd700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fec004d50 0x7f3fec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:19.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400415a690 con 0x7f3fec004d50 2023-10-06T02:48:19.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec00bba0 con 0x7f3fec003a90 2023-10-06T02:48:19.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec00bd60 con 0x7f40040d0f50 2023-10-06T02:48:19.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4008c97700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fec004d50 0x7f3fec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:19.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f40037fe700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040d0f50 0x7f3fec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:19.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4003fff700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fec003a90 0x7f3fec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:19.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4008c97700 1 -- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040d0f50 msgr2=0x7f3fec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:19.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4008c97700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040d0f50 0x7f3fec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4008c97700 1 -- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fec003a90 msgr2=0x7f3fec003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4008c97700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fec003a90 0x7f3fec003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4008c97700 1 -- 172.21.15.81:0/3041882512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec003570 con 0x7f3fec004d50 2023-10-06T02:48:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4003fff700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fec003a90 0x7f3fec003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4008c97700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fec004d50 0x7f3fec0051c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00a900 tx=0x7f40040cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2526a7b584ff045f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc0070d0 con 0x7f3fec004d50 2023-10-06T02:48:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc007230 con 0x7f3fec004d50 2023-10-06T02:48:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.205+0000 7f4002ffd700 1 -- 172.21.15.81:0/3041882512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc0075f0 con 0x7f3fec004d50 2023-10-06T02:48:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.206+0000 7f4009498700 1 -- 172.21.15.81:0/3041882512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fec004d50 msgr2=0x7f3fec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.206+0000 7f4009498700 1 --2- 172.21.15.81:0/3041882512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fec004d50 0x7f3fec0051c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00a900 tx=0x7f40040cf460 comp rx=0 tx=0).stop 2023-10-06T02:48:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.206+0000 7f4008c97700 1 -- 172.21.15.81:0/3041882512 reap_dead start 2023-10-06T02:48:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.206+0000 7f4009498700 1 -- 172.21.15.81:0/3041882512 shutdown_connections 2023-10-06T02:48:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.206+0000 7f4009498700 1 -- 172.21.15.81:0/3041882512 >> 172.21.15.81:0/3041882512 conn(0x7f4004063230 msgr2=0x7f4004063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.206+0000 7f4009498700 1 -- 172.21.15.81:0/3041882512 shutdown_connections 2023-10-06T02:48:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.206+0000 7f4009498700 1 -- 172.21.15.81:0/3041882512 wait complete. 2023-10-06T02:48:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.207+0000 7f4009498700 1 Processor -- start 2023-10-06T02:48:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.207+0000 7f4009498700 1 -- start start 2023-10-06T02:48:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4009498700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f400414e5c0 0x7f4004156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4009498700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040b4f90 0x7f40041519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4009498700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4004151f30 0x7f400416d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4009498700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40040b42e0 con 0x7f400414e5c0 2023-10-06T02:48:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4009498700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40041523a0 con 0x7f4004151f30 2023-10-06T02:48:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4009498700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4004152810 con 0x7f40040b4f90 2023-10-06T02:48:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4003fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f400414e5c0 0x7f4004156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4003fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f400414e5c0 0x7f4004156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49072/0 (socket says 172.21.15.81:49072) 2023-10-06T02:48:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4003fff700 1 -- 172.21.15.81:0/2679068502 learned_addr learned my addr 172.21.15.81:0/2679068502 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f40037fe700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040b4f90 0x7f40041519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4008c97700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4004151f30 0x7f400416d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4003fff700 1 -- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040b4f90 msgr2=0x7f40041519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4003fff700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040b4f90 0x7f40041519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4003fff700 1 -- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4004151f30 msgr2=0x7f400416d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4003fff700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4004151f30 0x7f400416d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4003fff700 1 -- 172.21.15.81:0/2679068502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40041571c0 con 0x7f400414e5c0 2023-10-06T02:48:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f40037fe700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040b4f90 0x7f40041519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4003fff700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f400414e5c0 0x7f4004156ac0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400e7e0 tx=0x7f3ff4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f3febfff700 1 -- 172.21.15.81:0/2679068502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4006820 con 0x7f400414e5c0 2023-10-06T02:48:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f3febfff700 1 -- 172.21.15.81:0/2679068502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff4010040 con 0x7f400414e5c0 2023-10-06T02:48:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40041574a0 con 0x7f400414e5c0 2023-10-06T02:48:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f3febfff700 1 -- 172.21.15.81:0/2679068502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4006bd0 con 0x7f400414e5c0 2023-10-06T02:48:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.208+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4004157a60 con 0x7f400414e5c0 2023-10-06T02:48:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.209+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40040676e0 con 0x7f400414e5c0 2023-10-06T02:48:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.210+0000 7f3febfff700 1 -- 172.21.15.81:0/2679068502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ff4007020 con 0x7f400414e5c0 2023-10-06T02:48:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.210+0000 7f3febfff700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ff0066f30 0x7f3ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.210+0000 7f3febfff700 1 -- 172.21.15.81:0/2679068502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ff4083f50 con 0x7f400414e5c0 2023-10-06T02:48:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.210+0000 7f40037fe700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ff0066f30 0x7f3ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.211+0000 7f40037fe700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ff0066f30 0x7f3ff00693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40040cdc80 tx=0x7f3ff8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.214+0000 7f3febfff700 1 -- 172.21.15.81:0/2679068502 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ff4051060 con 0x7f400414e5c0 2023-10-06T02:48:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:19.442+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f400406dc00 con 0x7f400414e5c0 2023-10-06T02:48:20.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.379+0000 7f3febfff700 1 -- 172.21.15.81:0/2679068502 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ff4054680 con 0x7f400414e5c0 2023-10-06T02:48:20.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ff0066f30 msgr2=0x7f3ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ff0066f30 0x7f3ff00693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40040cdc80 tx=0x7f3ff8008040 comp rx=0 tx=0).stop 2023-10-06T02:48:20.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f400414e5c0 msgr2=0x7f4004156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f400414e5c0 0x7f4004156ac0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400e7e0 tx=0x7f3ff4009040 comp rx=0 tx=0).stop 2023-10-06T02:48:20.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 shutdown_connections 2023-10-06T02:48:20.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ff0066f30 0x7f3ff00693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4004151f30 0x7f400416d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f400414e5c0 0x7f4004156ac0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 --2- 172.21.15.81:0/2679068502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40040b4f90 0x7f40041519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 >> 172.21.15.81:0/2679068502 conn(0x7f4004063230 msgr2=0x7f400415b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:20.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 shutdown_connections 2023-10-06T02:48:20.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.381+0000 7f4009498700 1 -- 172.21.15.81:0/2679068502 wait complete. 2023-10-06T02:48:20.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:48:20.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.511+0000 7fe3fd74b700 1 Processor -- start 2023-10-06T02:48:20.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.511+0000 7fe3fd74b700 1 -- start start 2023-10-06T02:48:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3fd74b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3f81578d0 0x7fe3f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3fd74b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f806d120 0x7fe3f806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3fd74b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f80d07c0 con 0x7fe3f8157ca0 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3fd74b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f806daa0 con 0x7fe3f81578d0 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3fd74b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80cfbb0 con 0x7fe3f806d120 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f67fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe3f8157ca0 0x7fe3f815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41612/0 (socket says 172.21.15.81:41612) 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f67fc700 1 -- 172.21.15.81:0/829362881 learned_addr learned my addr 172.21.15.81:0/829362881 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608643781 0 0) 0x7fe3f80d07c0 con 0x7fe3f8157ca0 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e0003570 con 0x7fe3f8157ca0 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f77fe700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f806d120 0x7fe3f806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f6ffd700 1 --2- 172.21.15.81:0/829362881 >> v2:172.21.15.83:3300/0 conn(0x7fe3f81578d0 0x7fe3f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3773174593 0 0) 0x7fe3e0003570 con 0x7fe3f8157ca0 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f806d120 msgr2=0x7fe3f806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f806d120 0x7fe3f806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 >> v2:172.21.15.83:3300/0 conn(0x7fe3f81578d0 msgr2=0x7fe3f80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 --2- 172.21.15.81:0/829362881 >> v2:172.21.15.83:3300/0 conn(0x7fe3f81578d0 0x7fe3f80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80cfe90 con 0x7fe3f8157ca0 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fe3ec001470 con 0x7fe3f8157ca0 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 >> v1:172.21.15.81:6789/0 conn(0x7fe3f8157ca0 legacy=0x7fe3f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e0003a60 0x7fe3e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3e0004810 0x7fe3e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f806d120 0x7fe3e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f806daa0 con 0x7fe3e0004810 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80cfbb0 con 0x7fe3e0003a60 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.512+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e000ba60 con 0x7fe3f806d120 2023-10-06T02:48:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f67fc700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3e0004810 0x7fe3e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f6ffd700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e0003a60 0x7fe3e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f77fe700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f806d120 0x7fe3e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f67fc700 1 -- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f806d120 msgr2=0x7fe3e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f67fc700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f806d120 0x7fe3e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f67fc700 1 -- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e0003a60 msgr2=0x7fe3e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f67fc700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e0003a60 0x7fe3e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f67fc700 1 -- 172.21.15.81:0/829362881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0003570 con 0x7fe3e0004810 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f67fc700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3e0004810 0x7fe3e0004c80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00c3c0 tx=0x7fe3f80d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c678e59d3c8eb75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec00cc50 con 0x7fe3e0004810 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec00cdb0 con 0x7fe3e0004810 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f5ffb700 1 -- 172.21.15.81:0/829362881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec005b70 con 0x7fe3e0004810 2023-10-06T02:48:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3fd74b700 1 -- 172.21.15.81:0/829362881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3e0004810 msgr2=0x7fe3e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3fd74b700 1 --2- 172.21.15.81:0/829362881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3e0004810 0x7fe3e0004c80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00c3c0 tx=0x7fe3f80d0730 comp rx=0 tx=0).stop 2023-10-06T02:48:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3f77fe700 1 -- 172.21.15.81:0/829362881 reap_dead start 2023-10-06T02:48:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3fd74b700 1 -- 172.21.15.81:0/829362881 shutdown_connections 2023-10-06T02:48:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.513+0000 7fe3fd74b700 1 -- 172.21.15.81:0/829362881 >> 172.21.15.81:0/829362881 conn(0x7fe3f806bb90 msgr2=0x7fe3f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.514+0000 7fe3fd74b700 1 -- 172.21.15.81:0/829362881 shutdown_connections 2023-10-06T02:48:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.514+0000 7fe3fd74b700 1 -- 172.21.15.81:0/829362881 wait complete. 2023-10-06T02:48:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.515+0000 7fe3fd74b700 1 Processor -- start 2023-10-06T02:48:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.515+0000 7fe3fd74b700 1 -- start start 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.515+0000 7fe3fd74b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e0004810 0x7fe3f80b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.515+0000 7fe3fd74b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f81532e0 0x7fe3f80aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.515+0000 7fe3fd74b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80aadd0 0x7fe3f80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.515+0000 7fe3fd74b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80ab230 con 0x7fe3f80aadd0 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.515+0000 7fe3fd74b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80b5090 con 0x7fe3e0004810 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.515+0000 7fe3fd74b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80b4480 con 0x7fe3f81532e0 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80aadd0 0x7fe3f80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80aadd0 0x7fe3f80b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38400/0 (socket says 172.21.15.81:38400) 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f77fe700 1 -- 172.21.15.81:0/2392636309 learned_addr learned my addr 172.21.15.81:0/2392636309 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f6ffd700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e0004810 0x7fe3f80b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f67fc700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f81532e0 0x7fe3f80aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f77fe700 1 -- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f81532e0 msgr2=0x7fe3f80aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f77fe700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f81532e0 0x7fe3f80aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f77fe700 1 -- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e0004810 msgr2=0x7fe3f80b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f77fe700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e0004810 0x7fe3f80b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f77fe700 1 -- 172.21.15.81:0/2392636309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80b4760 con 0x7fe3f80aadd0 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3f77fe700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80aadd0 0x7fe3f80b5520 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8063f70 tx=0x7fe3f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3deffd700 1 -- 172.21.15.81:0/2392636309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000e040 con 0x7fe3f80aadd0 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3deffd700 1 -- 172.21.15.81:0/2392636309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000f040 con 0x7fe3f80aadd0 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f80b4a40 con 0x7fe3f80aadd0 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3deffd700 1 -- 172.21.15.81:0/2392636309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000fd70 con 0x7fe3f80aadd0 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.516+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f80b40e0 con 0x7fe3f80aadd0 2023-10-06T02:48:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.517+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f80b2f80 con 0x7fe3f80aadd0 2023-10-06T02:48:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.517+0000 7fe3deffd700 1 -- 172.21.15.81:0/2392636309 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3f0015640 con 0x7fe3f80aadd0 2023-10-06T02:48:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.518+0000 7fe3deffd700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3e4066f60 0x7fe3e4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.518+0000 7fe3deffd700 1 -- 172.21.15.81:0/2392636309 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3f0084cc0 con 0x7fe3f80aadd0 2023-10-06T02:48:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.518+0000 7fe3f6ffd700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3e4066f60 0x7fe3e4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.518+0000 7fe3f6ffd700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3e4066f60 0x7fe3e4069410 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006f00 tx=0x7fe3e80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.522+0000 7fe3deffd700 1 -- 172.21.15.81:0/2392636309 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3f0051dd0 con 0x7fe3f80aadd0 2023-10-06T02:48:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.746+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3f80b5220 con 0x7fe3f80aadd0 2023-10-06T02:48:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.746+0000 7fe3deffd700 1 -- 172.21.15.81:0/2392636309 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fe3f00553f0 con 0x7fe3f80aadd0 2023-10-06T02:48:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:20.748 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1289364984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1289364984},{"type":"v1","addr":"172.21.15.83:6836","nonce":1289364984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3185368649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3185368649},{"type":"v1","addr":"172.21.15.83:6837","nonce":3185368649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5817,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/869401920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":869401920},{"type":"v1","addr":"172.21.15.81:6834","nonce":869401920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:48:16.417708+0000","modified":"2023-10-06T02:48:20.372496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2518286030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2518286030},{"type":"v1","addr":"172.21.15.81:6835","nonce":2518286030}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:48:20.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3e4066f60 msgr2=0x7fe3e4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3e4066f60 0x7fe3e4069410 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006f00 tx=0x7fe3e80091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80aadd0 msgr2=0x7fe3f80b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80aadd0 0x7fe3f80b5520 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8063f70 tx=0x7fe3f000b040 comp rx=0 tx=0).stop 2023-10-06T02:48:20.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 shutdown_connections 2023-10-06T02:48:20.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80aadd0 0x7fe3f80b5520 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3e4066f60 0x7fe3e4069410 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e0004810 0x7fe3f80b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 --2- 172.21.15.81:0/2392636309 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3f81532e0 0x7fe3f80aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 >> 172.21.15.81:0/2392636309 conn(0x7fe3f806bb90 msgr2=0x7fe3f8068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:20.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.748+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 shutdown_connections 2023-10-06T02:48:20.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.749+0000 7fe3fd74b700 1 -- 172.21.15.81:0/2392636309 wait complete. 2023-10-06T02:48:20.752 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2023-10-06T02:48:20.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:48:20.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.875+0000 7f71e0f8c700 1 Processor -- start 2023-10-06T02:48:20.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.875+0000 7f71e0f8c700 1 -- start start 2023-10-06T02:48:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71e0f8c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71dc159b40 0x7f71dc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71e0f8c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159f10 0x7f71dc068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71e0f8c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0cee10 con 0x7f71dc0ccb40 2023-10-06T02:48:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71e0f8c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0cd040 con 0x7f71dc159b40 2023-10-06T02:48:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71e0f8c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0cd320 con 0x7f71dc159f10 2023-10-06T02:48:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71db7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71dc159b40 0x7f71dc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71db7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71dc159b40 0x7f71dc0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38402/0 (socket says 172.21.15.81:38402) 2023-10-06T02:48:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71db7fe700 1 -- 172.21.15.81:0/141439334 learned_addr learned my addr 172.21.15.81:0/141439334 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71db7fe700 1 -- 172.21.15.81:0/141439334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159f10 msgr2=0x7f71dc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71db7fe700 1 --2- 172.21.15.81:0/141439334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159f10 0x7f71dc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71db7fe700 1 -- 172.21.15.81:0/141439334 >> v1:172.21.15.83:6789/0 conn(0x7f71dc0ccb40 legacy=0x7f71dc15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71db7fe700 1 -- 172.21.15.81:0/141439334 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0ce7c0 con 0x7f71dc159b40 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.876+0000 7f71db7fe700 1 --2- 172.21.15.81:0/141439334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159b40 0x7f71dc0cc600 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009f20 tx=0x7f71cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf8c4724c701207 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71da7fc700 1 -- 172.21.15.81:0/141439334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00e070 con 0x7f71dc159b40 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71da7fc700 1 -- 172.21.15.81:0/141439334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc00ba40 con 0x7f71dc159b40 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71da7fc700 1 -- 172.21.15.81:0/141439334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0092e0 con 0x7f71dc159b40 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71e0f8c700 1 -- 172.21.15.81:0/141439334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159b40 msgr2=0x7f71dc0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71e0f8c700 1 --2- 172.21.15.81:0/141439334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159b40 0x7f71dc0cc600 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009f20 tx=0x7f71cc009840 comp rx=0 tx=0).stop 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71e0f8c700 1 -- 172.21.15.81:0/141439334 shutdown_connections 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71e0f8c700 1 --2- 172.21.15.81:0/141439334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159b40 0x7f71dc0cc600 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71e0f8c700 1 --2- 172.21.15.81:0/141439334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159f10 0x7f71dc068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71e0f8c700 1 -- 172.21.15.81:0/141439334 >> 172.21.15.81:0/141439334 conn(0x7f71dc0cd660 msgr2=0x7f71dc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71e0f8c700 1 -- 172.21.15.81:0/141439334 shutdown_connections 2023-10-06T02:48:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.877+0000 7f71e0f8c700 1 -- 172.21.15.81:0/141439334 wait complete. 2023-10-06T02:48:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.878+0000 7f71e0f8c700 1 Processor -- start 2023-10-06T02:48:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71e0f8c700 1 -- start start 2023-10-06T02:48:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71e0f8c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc0ccb40 0x7f71dc15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71e0f8c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159b40 0x7f71dc157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71e0f8c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159f10 0x7f71dc158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71e0f8c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc155c10 con 0x7f71dc159f10 2023-10-06T02:48:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71e0f8c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc15c290 con 0x7f71dc0ccb40 2023-10-06T02:48:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71e0f8c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc15b680 con 0x7f71dc159b40 2023-10-06T02:48:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159f10 0x7f71dc158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159f10 0x7f71dc158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38408/0 (socket says 172.21.15.81:38408) 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71dbfff700 1 -- 172.21.15.81:0/526323634 learned_addr learned my addr 172.21.15.81:0/526323634 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71db7fe700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc0ccb40 0x7f71dc15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.879+0000 7f71daffd700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159b40 0x7f71dc157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71dbfff700 1 -- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159b40 msgr2=0x7f71dc157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71dbfff700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159b40 0x7f71dc157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71dbfff700 1 -- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc0ccb40 msgr2=0x7f71dc15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71dbfff700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc0ccb40 0x7f71dc15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71dbfff700 1 -- 172.21.15.81:0/526323634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc009ae0 con 0x7f71dc159f10 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71daffd700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159b40 0x7f71dc157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71db7fe700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc0ccb40 0x7f71dc15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71dbfff700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159f10 0x7f71dc158530 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f71d400c5e0 tx=0x7f71d4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71c37fe700 1 -- 172.21.15.81:0/526323634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4011590 con 0x7f71dc159f10 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71c37fe700 1 -- 172.21.15.81:0/526323634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d4011710 con 0x7f71dc159f10 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc15b960 con 0x7f71dc159f10 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71c37fe700 1 -- 172.21.15.81:0/526323634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4011ad0 con 0x7f71dc159f10 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.880+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc15bf20 con 0x7f71dc159f10 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.881+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc15c420 con 0x7f71dc159f10 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.881+0000 7f71c37fe700 1 -- 172.21.15.81:0/526323634 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71d401c460 con 0x7f71dc159f10 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.882+0000 7f71c37fe700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c8066f30 0x7f71c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.882+0000 7f71c37fe700 1 -- 172.21.15.81:0/526323634 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71d4084370 con 0x7f71dc159f10 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.882+0000 7f71db7fe700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c8066f30 0x7f71c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.883+0000 7f71db7fe700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c8066f30 0x7f71c80693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009880 tx=0x7f71cc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:20.886+0000 7f71c37fe700 1 -- 172.21.15.81:0/526323634 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71d4051480 con 0x7f71dc159f10 2023-10-06T02:48:21.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.070+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71dc0cb910 con 0x7f71dc159f10 2023-10-06T02:48:21.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.071+0000 7f71c37fe700 1 -- 172.21.15.81:0/526323634 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16820 (secure 0 0 0) 0x7f71d4054aa0 con 0x7f71dc159f10 2023-10-06T02:48:21.072 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:21.072 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:48:18.042171+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:48:14.055897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:48:15.392030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:48:21.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c8066f30 msgr2=0x7f71c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c8066f30 0x7f71c80693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009880 tx=0x7f71cc017000 comp rx=0 tx=0).stop 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159f10 msgr2=0x7f71dc158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159f10 0x7f71dc158530 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f71d400c5e0 tx=0x7f71d4007f60 comp rx=0 tx=0).stop 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 shutdown_connections 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71dc159f10 0x7f71dc158530 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c8066f30 0x7f71c80693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc0ccb40 0x7f71dc15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 --2- 172.21.15.81:0/526323634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc159b40 0x7f71dc157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 >> 172.21.15.81:0/526323634 conn(0x7f71dc0cd660 msgr2=0x7f71dc0b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 shutdown_connections 2023-10-06T02:48:21.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.073+0000 7f71e0f8c700 1 -- 172.21.15.81:0/526323634 wait complete. 2023-10-06T02:48:21.086 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:48:21.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:48:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.200+0000 7f47c1a4f700 1 Processor -- start 2023-10-06T02:48:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.200+0000 7f47c1a4f700 1 -- start start 2023-10-06T02:48:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.201+0000 7f47c1a4f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47bc1578d0 0x7f47bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.201+0000 7f47c1a4f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc157ca0 0x7f47bc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.201+0000 7f47c1a4f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0d07c0 con 0x7f47bc06d120 2023-10-06T02:48:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.201+0000 7f47c1a4f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc0cfbb0 con 0x7f47bc1578d0 2023-10-06T02:48:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.201+0000 7f47c1a4f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0cfe90 con 0x7f47bc157ca0 2023-10-06T02:48:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47baffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47bc1578d0 0x7f47bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47b27fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc157ca0 0x7f47bc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47bb7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f47bc06d120 0x7f47bc15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:34944/0 (socket says 172.21.15.81:34944) 2023-10-06T02:48:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47bb7fe700 1 -- 172.21.15.81:0/2440270428 learned_addr learned my addr 172.21.15.81:0/2440270428 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47b27fc700 1 -- 172.21.15.81:0/2440270428 >> v2:172.21.15.83:3300/0 conn(0x7f47bc1578d0 msgr2=0x7f47bc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47b27fc700 1 --2- 172.21.15.81:0/2440270428 >> v2:172.21.15.83:3300/0 conn(0x7f47bc1578d0 0x7f47bc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47b27fc700 1 -- 172.21.15.81:0/2440270428 >> v1:172.21.15.83:6789/0 conn(0x7f47bc06d120 legacy=0x7f47bc15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47b27fc700 1 -- 172.21.15.81:0/2440270428 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0d0170 con 0x7f47bc157ca0 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47b27fc700 1 --2- 172.21.15.81:0/2440270428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc157ca0 0x7f47bc15af00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47a40098e0 tx=0x7f47a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a380a00e95186498 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47ba7fc700 1 -- 172.21.15.81:0/2440270428 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400b640 con 0x7f47bc157ca0 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47ba7fc700 1 -- 172.21.15.81:0/2440270428 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a400b7a0 con 0x7f47bc157ca0 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.202+0000 7f47ba7fc700 1 -- 172.21.15.81:0/2440270428 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400bb40 con 0x7f47bc157ca0 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.203+0000 7f47c1a4f700 1 -- 172.21.15.81:0/2440270428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc157ca0 msgr2=0x7f47bc15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.203+0000 7f47c1a4f700 1 --2- 172.21.15.81:0/2440270428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc157ca0 0x7f47bc15af00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47a40098e0 tx=0x7f47a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.203+0000 7f47c1a4f700 1 -- 172.21.15.81:0/2440270428 shutdown_connections 2023-10-06T02:48:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.203+0000 7f47c1a4f700 1 --2- 172.21.15.81:0/2440270428 >> v2:172.21.15.83:3300/0 conn(0x7f47bc1578d0 0x7f47bc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.203+0000 7f47c1a4f700 1 --2- 172.21.15.81:0/2440270428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc157ca0 0x7f47bc15af00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.203+0000 7f47c1a4f700 1 -- 172.21.15.81:0/2440270428 >> 172.21.15.81:0/2440270428 conn(0x7f47bc06bb90 msgr2=0x7f47bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.203+0000 7f47c1a4f700 1 -- 172.21.15.81:0/2440270428 shutdown_connections 2023-10-06T02:48:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.203+0000 7f47c1a4f700 1 -- 172.21.15.81:0/2440270428 wait complete. 2023-10-06T02:48:21.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.204+0000 7f47c1a4f700 1 Processor -- start 2023-10-06T02:48:21.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.204+0000 7f47c1a4f700 1 -- start start 2023-10-06T02:48:21.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47c1a4f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc06d120 0x7f47bc155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47c1a4f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47bc1578d0 0x7f47bc0cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47c1a4f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47bc157ca0 0x7f47bc0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47c1a4f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc16e600 con 0x7f47bc157ca0 2023-10-06T02:48:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47c1a4f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0cce80 con 0x7f47bc1578d0 2023-10-06T02:48:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47c1a4f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0cbff0 con 0x7f47bc06d120 2023-10-06T02:48:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47bc157ca0 0x7f47bc0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47b27fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47bc1578d0 0x7f47bc0cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47bc157ca0 0x7f47bc0c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38410/0 (socket says 172.21.15.81:38410) 2023-10-06T02:48:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47bb7fe700 1 -- 172.21.15.81:0/1032383413 learned_addr learned my addr 172.21.15.81:0/1032383413 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47baffd700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc06d120 0x7f47bc155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47bb7fe700 1 -- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc06d120 msgr2=0x7f47bc155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47bb7fe700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc06d120 0x7f47bc155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47bb7fe700 1 -- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47bc1578d0 msgr2=0x7f47bc0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47bb7fe700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47bc1578d0 0x7f47bc0cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.205+0000 7f47bb7fe700 1 -- 172.21.15.81:0/1032383413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4009420 con 0x7f47bc157ca0 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.206+0000 7f47bb7fe700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47bc157ca0 0x7f47bc0c8530 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f47b400cc70 tx=0x7f47b4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.206+0000 7f47b37fe700 1 -- 172.21.15.81:0/1032383413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400a850 con 0x7f47bc157ca0 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.206+0000 7f47b37fe700 1 -- 172.21.15.81:0/1032383413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b400a9b0 con 0x7f47bc157ca0 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.206+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc0cc270 con 0x7f47bc157ca0 2023-10-06T02:48:21.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.206+0000 7f47b37fe700 1 -- 172.21.15.81:0/1032383413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400ad70 con 0x7f47bc157ca0 2023-10-06T02:48:21.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.206+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0cc830 con 0x7f47bc157ca0 2023-10-06T02:48:21.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.207+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc0cd030 con 0x7f47bc157ca0 2023-10-06T02:48:21.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.208+0000 7f47b37fe700 1 -- 172.21.15.81:0/1032383413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47b4007300 con 0x7f47bc157ca0 2023-10-06T02:48:21.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.208+0000 7f47b37fe700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f479c066f30 0x7f479c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.208+0000 7f47b37fe700 1 -- 172.21.15.81:0/1032383413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f47b40851e0 con 0x7f47bc157ca0 2023-10-06T02:48:21.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.208+0000 7f47baffd700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f479c066f30 0x7f479c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.209+0000 7f47baffd700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f479c066f30 0x7f479c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009db0 tx=0x7f47ac0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.212+0000 7f47b37fe700 1 -- 172.21.15.81:0/1032383413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47b4052450 con 0x7f47bc157ca0 2023-10-06T02:48:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.388+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47bc0cd030 con 0x7f479c066f30 2023-10-06T02:48:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.397+0000 7f47b37fe700 1 -- 172.21.15.81:0/1032383413 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302525 (secure 0 0 0) 0x7f47bc0cd030 con 0x7f479c066f30 2023-10-06T02:48:21.402 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.400+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f479c066f30 msgr2=0x7f479c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.400+0000 7f47c1a4f700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f479c066f30 0x7f479c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009db0 tx=0x7f47ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.400+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47bc157ca0 msgr2=0x7f47bc0c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.400+0000 7f47c1a4f700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47bc157ca0 0x7f47bc0c8530 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f47b400cc70 tx=0x7f47b4001a50 comp rx=0 tx=0).stop 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.401+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 shutdown_connections 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.401+0000 7f47c1a4f700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47bc157ca0 0x7f47bc0c8530 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.401+0000 7f47c1a4f700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47bc06d120 0x7f47bc155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.401+0000 7f47c1a4f700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f479c066f30 0x7f479c0693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.401+0000 7f47c1a4f700 1 --2- 172.21.15.81:0/1032383413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47bc1578d0 0x7f47bc0cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.401+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 >> 172.21.15.81:0/1032383413 conn(0x7f47bc06bb90 msgr2=0x7f47bc15a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.401+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 shutdown_connections 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.401+0000 7f47c1a4f700 1 -- 172.21.15.81:0/1032383413 wait complete. 2023-10-06T02:48:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:48:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-10-06T02:48:19.522239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558703,"statfs":{"total":1600000000,"available":1596112488,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.485822"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045125+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:58.827546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045046+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:45.305899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.049720+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:25.472066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.048236+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:55.797965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.050859+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:13.338469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.044570+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:34.863651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045145+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:17.001530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.058486+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:01.265631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.050611+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:13.581865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.047822+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:23.715220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.046154+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:23.135880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.055990+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:57.296415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.058125+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:23.715220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.050265+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:27.024353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.048402+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:01.265631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045317+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:15.115275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.044720+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:44.936287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.056768+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:51.111968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.052809+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:57.409529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045451+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:50.061912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.046256+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:30.513380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.047260+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:38.762722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.046551+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:57.660580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.049901+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:39.946549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.046743+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:38.730559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045704+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:58.827546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.048942+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:13.119403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.044766+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:44:17.637914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.047332+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:57.296415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.046341+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:51.111968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045753+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:52.299380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.043834+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:59.516075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.050406+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:22.321045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.052721+0000","last_change":"2023-10-06T02:48:16.052721+0000","last_active":"2023-10-06T02:48:16.052721+0000","last_peered":"2023-10-06T02:48:16.052721+0000","last_clean":"2023-10-06T02:48:16.052721+0000","last_became_active":"2023-10-06T02:48:16.052527+0000","last_became_peered":"2023-10-06T02:48:16.052527+0000","last_unstale":"2023-10-06T02:48:16.052721+0000","last_undegraded":"2023-10-06T02:48:16.052721+0000","last_fullsized":"2023-10-06T02:48:16.052721+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:50.370996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.047324+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:51.381126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.057040+0000","last_change":"2023-10-06T02:48:16.057040+0000","last_active":"2023-10-06T02:48:16.057040+0000","last_peered":"2023-10-06T02:48:16.057040+0000","last_clean":"2023-10-06T02:48:16.057040+0000","last_became_active":"2023-10-06T02:48:16.056792+0000","last_became_peered":"2023-10-06T02:48:16.056792+0000","last_unstale":"2023-10-06T02:48:16.057040+0000","last_undegraded":"2023-10-06T02:48:16.057040+0000","last_fullsized":"2023-10-06T02:48:16.057040+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:48.716690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.043887+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:17.896165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.060094+0000","last_change":"2023-10-06T02:48:16.060094+0000","last_active":"2023-10-06T02:48:16.060094+0000","last_peered":"2023-10-06T02:48:16.060094+0000","last_clean":"2023-10-06T02:48:16.060094+0000","last_became_active":"2023-10-06T02:48:16.059874+0000","last_became_peered":"2023-10-06T02:48:16.059874+0000","last_unstale":"2023-10-06T02:48:16.060094+0000","last_undegraded":"2023-10-06T02:48:16.060094+0000","last_fullsized":"2023-10-06T02:48:16.060094+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:12.571735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.049342+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:12.999316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.045919+0000","last_change":"2023-10-06T02:48:16.045919+0000","last_active":"2023-10-06T02:48:16.045919+0000","last_peered":"2023-10-06T02:48:16.045919+0000","last_clean":"2023-10-06T02:48:16.045919+0000","last_became_active":"2023-10-06T02:48:16.045698+0000","last_became_peered":"2023-10-06T02:48:16.045698+0000","last_unstale":"2023-10-06T02:48:16.045919+0000","last_undegraded":"2023-10-06T02:48:16.045919+0000","last_fullsized":"2023-10-06T02:48:16.045919+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:03.649335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045280+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:24.762313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.048022+0000","last_change":"2023-10-06T02:48:16.048022+0000","last_active":"2023-10-06T02:48:16.048022+0000","last_peered":"2023-10-06T02:48:16.048022+0000","last_clean":"2023-10-06T02:48:16.048022+0000","last_became_active":"2023-10-06T02:48:16.047502+0000","last_became_peered":"2023-10-06T02:48:16.047502+0000","last_unstale":"2023-10-06T02:48:16.048022+0000","last_undegraded":"2023-10-06T02:48:16.048022+0000","last_fullsized":"2023-10-06T02:48:16.048022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:58.505945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.048054+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:51.111968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.047106+0000","last_change":"2023-10-06T02:48:16.047106+0000","last_active":"2023-10-06T02:48:16.047106+0000","last_peered":"2023-10-06T02:48:16.047106+0000","last_clean":"2023-10-06T02:48:16.047106+0000","last_became_active":"2023-10-06T02:48:16.046884+0000","last_became_peered":"2023-10-06T02:48:16.046884+0000","last_unstale":"2023-10-06T02:48:16.047106+0000","last_undegraded":"2023-10-06T02:48:16.047106+0000","last_fullsized":"2023-10-06T02:48:16.047106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:14.519825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.048743+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:55.936543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.054108+0000","last_change":"2023-10-06T02:48:16.054108+0000","last_active":"2023-10-06T02:48:16.054108+0000","last_peered":"2023-10-06T02:48:16.054108+0000","last_clean":"2023-10-06T02:48:16.054108+0000","last_became_active":"2023-10-06T02:48:16.053977+0000","last_became_peered":"2023-10-06T02:48:16.053977+0000","last_unstale":"2023-10-06T02:48:16.054108+0000","last_undegraded":"2023-10-06T02:48:16.054108+0000","last_fullsized":"2023-10-06T02:48:16.054108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:12.571735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.046945+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:47.147785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.055003+0000","last_change":"2023-10-06T02:48:16.055003+0000","last_active":"2023-10-06T02:48:16.055003+0000","last_peered":"2023-10-06T02:48:16.055003+0000","last_clean":"2023-10-06T02:48:16.055003+0000","last_became_active":"2023-10-06T02:48:16.054706+0000","last_became_peered":"2023-10-06T02:48:16.054706+0000","last_unstale":"2023-10-06T02:48:16.055003+0000","last_undegraded":"2023-10-06T02:48:16.055003+0000","last_fullsized":"2023-10-06T02:48:16.055003+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:12.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.043630+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:13.119403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.054020+0000","last_change":"2023-10-06T02:48:16.054020+0000","last_active":"2023-10-06T02:48:16.054020+0000","last_peered":"2023-10-06T02:48:16.054020+0000","last_clean":"2023-10-06T02:48:16.054020+0000","last_became_active":"2023-10-06T02:48:16.053357+0000","last_became_peered":"2023-10-06T02:48:16.053357+0000","last_unstale":"2023-10-06T02:48:16.054020+0000","last_undegraded":"2023-10-06T02:48:16.054020+0000","last_fullsized":"2023-10-06T02:48:16.054020+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:44:16.627785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.046197+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:34.863651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.058121+0000","last_change":"2023-10-06T02:48:16.058121+0000","last_active":"2023-10-06T02:48:16.058121+0000","last_peered":"2023-10-06T02:48:16.058121+0000","last_clean":"2023-10-06T02:48:16.058121+0000","last_became_active":"2023-10-06T02:48:16.057850+0000","last_became_peered":"2023-10-06T02:48:16.057850+0000","last_unstale":"2023-10-06T02:48:16.058121+0000","last_undegraded":"2023-10-06T02:48:16.058121+0000","last_fullsized":"2023-10-06T02:48:16.058121+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:37.725868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.049896+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:38.568582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.053832+0000","last_change":"2023-10-06T02:48:16.053832+0000","last_active":"2023-10-06T02:48:16.053832+0000","last_peered":"2023-10-06T02:48:16.053832+0000","last_clean":"2023-10-06T02:48:16.053832+0000","last_became_active":"2023-10-06T02:48:16.053519+0000","last_became_peered":"2023-10-06T02:48:16.053519+0000","last_unstale":"2023-10-06T02:48:16.053832+0000","last_undegraded":"2023-10-06T02:48:16.053832+0000","last_fullsized":"2023-10-06T02:48:16.053832+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:44.295769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045334+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:41.836684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.056589+0000","last_change":"2023-10-06T02:48:16.056589+0000","last_active":"2023-10-06T02:48:16.056589+0000","last_peered":"2023-10-06T02:48:16.056589+0000","last_clean":"2023-10-06T02:48:16.056589+0000","last_became_active":"2023-10-06T02:48:16.056344+0000","last_became_peered":"2023-10-06T02:48:16.056344+0000","last_unstale":"2023-10-06T02:48:16.056589+0000","last_undegraded":"2023-10-06T02:48:16.056589+0000","last_fullsized":"2023-10-06T02:48:16.056589+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:22.125751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.056369+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:58.827546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.054844+0000","last_change":"2023-10-06T02:48:16.054844+0000","last_active":"2023-10-06T02:48:16.054844+0000","last_peered":"2023-10-06T02:48:16.054844+0000","last_clean":"2023-10-06T02:48:16.054844+0000","last_became_active":"2023-10-06T02:48:16.054624+0000","last_became_peered":"2023-10-06T02:48:16.054624+0000","last_unstale":"2023-10-06T02:48:16.054844+0000","last_undegraded":"2023-10-06T02:48:16.054844+0000","last_fullsized":"2023-10-06T02:48:16.054844+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:43.926157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.044653+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:44.936287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.060423+0000","last_change":"2023-10-06T02:48:16.060423+0000","last_active":"2023-10-06T02:48:16.060423+0000","last_peered":"2023-10-06T02:48:16.060423+0000","last_clean":"2023-10-06T02:48:16.060423+0000","last_became_active":"2023-10-06T02:48:16.059532+0000","last_became_peered":"2023-10-06T02:48:16.059532+0000","last_unstale":"2023-10-06T02:48:16.060423+0000","last_undegraded":"2023-10-06T02:48:16.060423+0000","last_fullsized":"2023-10-06T02:48:16.060423+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:54.787836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.050005+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:28.909016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.052758+0000","last_change":"2023-10-06T02:48:16.052758+0000","last_active":"2023-10-06T02:48:16.052758+0000","last_peered":"2023-10-06T02:48:16.052758+0000","last_clean":"2023-10-06T02:48:16.052758+0000","last_became_active":"2023-10-06T02:48:16.052473+0000","last_became_peered":"2023-10-06T02:48:16.052473+0000","last_unstale":"2023-10-06T02:48:16.052758+0000","last_undegraded":"2023-10-06T02:48:16.052758+0000","last_fullsized":"2023-10-06T02:48:16.052758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:50.101838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.044110+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:19.932621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.057909+0000","last_change":"2023-10-06T02:48:16.057909+0000","last_active":"2023-10-06T02:48:16.057909+0000","last_peered":"2023-10-06T02:48:16.057909+0000","last_clean":"2023-10-06T02:48:16.057909+0000","last_became_active":"2023-10-06T02:48:16.057490+0000","last_became_peered":"2023-10-06T02:48:16.057490+0000","last_unstale":"2023-10-06T02:48:16.057909+0000","last_undegraded":"2023-10-06T02:48:16.057909+0000","last_fullsized":"2023-10-06T02:48:16.057909+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:24.691740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.043976+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:50.061912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.059776+0000","last_change":"2023-10-06T02:48:16.059776+0000","last_active":"2023-10-06T02:48:16.059776+0000","last_peered":"2023-10-06T02:48:16.059776+0000","last_clean":"2023-10-06T02:48:16.059776+0000","last_became_active":"2023-10-06T02:48:16.059158+0000","last_became_peered":"2023-10-06T02:48:16.059158+0000","last_unstale":"2023-10-06T02:48:16.059776+0000","last_undegraded":"2023-10-06T02:48:16.059776+0000","last_fullsized":"2023-10-06T02:48:16.059776+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:12.109273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045584+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:48.695635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.059828+0000","last_change":"2023-10-06T02:48:16.059828+0000","last_active":"2023-10-06T02:48:16.059828+0000","last_peered":"2023-10-06T02:48:16.059828+0000","last_clean":"2023-10-06T02:48:16.059828+0000","last_became_active":"2023-10-06T02:48:16.059078+0000","last_became_peered":"2023-10-06T02:48:16.059078+0000","last_unstale":"2023-10-06T02:48:16.059828+0000","last_undegraded":"2023-10-06T02:48:16.059828+0000","last_fullsized":"2023-10-06T02:48:16.059828+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:22.125751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.044725+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:44:17.637914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.060050+0000","last_change":"2023-10-06T02:48:16.060050+0000","last_active":"2023-10-06T02:48:16.060050+0000","last_peered":"2023-10-06T02:48:16.060050+0000","last_clean":"2023-10-06T02:48:16.060050+0000","last_became_active":"2023-10-06T02:48:16.059579+0000","last_became_peered":"2023-10-06T02:48:16.059579+0000","last_unstale":"2023-10-06T02:48:16.060050+0000","last_undegraded":"2023-10-06T02:48:16.060050+0000","last_fullsized":"2023-10-06T02:48:16.060050+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:38.936420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.049362+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.816565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.056329+0000","last_change":"2023-10-06T02:48:16.056329+0000","last_active":"2023-10-06T02:48:16.056329+0000","last_peered":"2023-10-06T02:48:16.056329+0000","last_clean":"2023-10-06T02:48:16.056329+0000","last_became_active":"2023-10-06T02:48:16.056138+0000","last_became_peered":"2023-10-06T02:48:16.056138+0000","last_unstale":"2023-10-06T02:48:16.056329+0000","last_undegraded":"2023-10-06T02:48:16.056329+0000","last_fullsized":"2023-10-06T02:48:16.056329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:49.555358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.050680+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:02:44.346855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.052779+0000","last_change":"2023-10-06T02:48:16.052779+0000","last_active":"2023-10-06T02:48:16.052779+0000","last_peered":"2023-10-06T02:48:16.052779+0000","last_clean":"2023-10-06T02:48:16.052779+0000","last_became_active":"2023-10-06T02:48:16.052531+0000","last_became_peered":"2023-10-06T02:48:16.052531+0000","last_unstale":"2023-10-06T02:48:16.052779+0000","last_undegraded":"2023-10-06T02:48:16.052779+0000","last_fullsized":"2023-10-06T02:48:16.052779+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:57.817416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.055989+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:45.305899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.048168+0000","last_change":"2023-10-06T02:48:16.048168+0000","last_active":"2023-10-06T02:48:16.048168+0000","last_peered":"2023-10-06T02:48:16.048168+0000","last_clean":"2023-10-06T02:48:16.048168+0000","last_became_active":"2023-10-06T02:48:16.047810+0000","last_became_peered":"2023-10-06T02:48:16.047810+0000","last_unstale":"2023-10-06T02:48:16.048168+0000","last_undegraded":"2023-10-06T02:48:16.048168+0000","last_fullsized":"2023-10-06T02:48:16.048168+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:09.783685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.044333+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:10.123365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.051304+0000","last_change":"2023-10-06T02:48:16.051304+0000","last_active":"2023-10-06T02:48:16.051304+0000","last_peered":"2023-10-06T02:48:16.051304+0000","last_clean":"2023-10-06T02:48:16.051304+0000","last_became_active":"2023-10-06T02:48:16.050841+0000","last_became_peered":"2023-10-06T02:48:16.050841+0000","last_unstale":"2023-10-06T02:48:16.051304+0000","last_undegraded":"2023-10-06T02:48:16.051304+0000","last_fullsized":"2023-10-06T02:48:16.051304+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:26.014223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.044979+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:42.631021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.054712+0000","last_change":"2023-10-06T02:48:16.054712+0000","last_active":"2023-10-06T02:48:16.054712+0000","last_peered":"2023-10-06T02:48:16.054712+0000","last_clean":"2023-10-06T02:48:16.054712+0000","last_became_active":"2023-10-06T02:48:16.054573+0000","last_became_peered":"2023-10-06T02:48:16.054573+0000","last_unstale":"2023-10-06T02:48:16.054712+0000","last_undegraded":"2023-10-06T02:48:16.054712+0000","last_fullsized":"2023-10-06T02:48:16.054712+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:51.289251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.048742+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:03.583910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.060322+0000","last_change":"2023-10-06T02:48:16.060322+0000","last_active":"2023-10-06T02:48:16.060322+0000","last_peered":"2023-10-06T02:48:16.060322+0000","last_clean":"2023-10-06T02:48:16.060322+0000","last_became_active":"2023-10-06T02:48:16.059890+0000","last_became_peered":"2023-10-06T02:48:16.059890+0000","last_unstale":"2023-10-06T02:48:16.060322+0000","last_undegraded":"2023-10-06T02:48:16.060322+0000","last_fullsized":"2023-10-06T02:48:16.060322+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:18.922492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-06T02:48:15.033784+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:48:15.033784+0000","last_peered":"2023-10-06T02:48:15.033784+0000","last_clean":"2023-10-06T02:48:15.033784+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:48:15.033784+0000","last_undegraded":"2023-10-06T02:48:15.033784+0000","last_fullsized":"2023-10-06T02:48:15.033784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.051026+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:25.448936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.057999+0000","last_change":"2023-10-06T02:48:16.057999+0000","last_active":"2023-10-06T02:48:16.057999+0000","last_peered":"2023-10-06T02:48:16.057999+0000","last_clean":"2023-10-06T02:48:16.057999+0000","last_became_active":"2023-10-06T02:48:16.057757+0000","last_became_peered":"2023-10-06T02:48:16.057757+0000","last_unstale":"2023-10-06T02:48:16.057999+0000","last_undegraded":"2023-10-06T02:48:16.057999+0000","last_fullsized":"2023-10-06T02:48:16.057999+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:22.240095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-06T02:48:15.038921+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:48:15.038921+0000","last_peered":"2023-10-06T02:48:15.038921+0000","last_clean":"2023-10-06T02:48:15.038921+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:48:15.038921+0000","last_undegraded":"2023-10-06T02:48:15.038921+0000","last_fullsized":"2023-10-06T02:48:15.038921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.045322+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:45.305899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.059695+0000","last_change":"2023-10-06T02:48:16.059695+0000","last_active":"2023-10-06T02:48:16.059695+0000","last_peered":"2023-10-06T02:48:16.059695+0000","last_clean":"2023-10-06T02:48:16.059695+0000","last_became_active":"2023-10-06T02:48:16.059304+0000","last_became_peered":"2023-10-06T02:48:16.059304+0000","last_unstale":"2023-10-06T02:48:16.059695+0000","last_undegraded":"2023-10-06T02:48:16.059695+0000","last_fullsized":"2023-10-06T02:48:16.059695+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:50.370996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-06T02:48:15.038939+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:48:15.038939+0000","last_peered":"2023-10-06T02:48:15.038939+0000","last_clean":"2023-10-06T02:48:15.038939+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:48:15.038939+0000","last_undegraded":"2023-10-06T02:48:15.038939+0000","last_fullsized":"2023-10-06T02:48:15.038939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.047972+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:21.839619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.047846+0000","last_change":"2023-10-06T02:48:16.047846+0000","last_active":"2023-10-06T02:48:16.047846+0000","last_peered":"2023-10-06T02:48:16.047846+0000","last_clean":"2023-10-06T02:48:16.047846+0000","last_became_active":"2023-10-06T02:48:16.047591+0000","last_became_peered":"2023-10-06T02:48:16.047591+0000","last_unstale":"2023-10-06T02:48:16.047846+0000","last_undegraded":"2023-10-06T02:48:16.047846+0000","last_fullsized":"2023-10-06T02:48:16.047846+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:22.240095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":54,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-06T02:48:15.038614+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:48:15.038614+0000","last_peered":"2023-10-06T02:48:15.038614+0000","last_clean":"2023-10-06T02:48:15.038614+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:48:15.038614+0000","last_undegraded":"2023-10-06T02:48:15.038614+0000","last_fullsized":"2023-10-06T02:48:15.038614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-06T02:48:15.036585+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:48:15.036585+0000","last_peered":"2023-10-06T02:48:15.036585+0000","last_clean":"2023-10-06T02:48:15.036585+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:48:15.036585+0000","last_undegraded":"2023-10-06T02:48:15.036585+0000","last_fullsized":"2023-10-06T02:48:15.036585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.043439+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:15.529954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.049585+0000","last_change":"2023-10-06T02:48:16.049585+0000","last_active":"2023-10-06T02:48:16.049585+0000","last_peered":"2023-10-06T02:48:16.049585+0000","last_clean":"2023-10-06T02:48:16.049585+0000","last_became_active":"2023-10-06T02:48:16.049391+0000","last_became_peered":"2023-10-06T02:48:16.049391+0000","last_unstale":"2023-10-06T02:48:16.049585+0000","last_undegraded":"2023-10-06T02:48:16.049585+0000","last_fullsized":"2023-10-06T02:48:16.049585+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:26.014223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-06T02:48:15.036477+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:48:15.036477+0000","last_peered":"2023-10-06T02:48:15.036477+0000","last_clean":"2023-10-06T02:48:15.036477+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:48:15.036477+0000","last_undegraded":"2023-10-06T02:48:15.036477+0000","last_fullsized":"2023-10-06T02:48:15.036477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.046862+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:41:29.924809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.054391+0000","last_change":"2023-10-06T02:48:16.054391+0000","last_active":"2023-10-06T02:48:16.054391+0000","last_peered":"2023-10-06T02:48:16.054391+0000","last_clean":"2023-10-06T02:48:16.054391+0000","last_became_active":"2023-10-06T02:48:16.054065+0000","last_became_peered":"2023-10-06T02:48:16.054065+0000","last_unstale":"2023-10-06T02:48:16.054391+0000","last_undegraded":"2023-10-06T02:48:16.054391+0000","last_fullsized":"2023-10-06T02:48:16.054391+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:29.503250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-06T02:48:15.036668+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:48:15.036668+0000","last_peered":"2023-10-06T02:48:15.036668+0000","last_clean":"2023-10-06T02:48:15.036668+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:48:15.036668+0000","last_undegraded":"2023-10-06T02:48:15.036668+0000","last_fullsized":"2023-10-06T02:48:15.036668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.046945+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:50.565488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.054220+0000","last_change":"2023-10-06T02:48:16.054220+0000","last_active":"2023-10-06T02:48:16.054220+0000","last_peered":"2023-10-06T02:48:16.054220+0000","last_clean":"2023-10-06T02:48:16.054220+0000","last_became_active":"2023-10-06T02:48:16.053754+0000","last_became_peered":"2023-10-06T02:48:16.053754+0000","last_unstale":"2023-10-06T02:48:16.054220+0000","last_undegraded":"2023-10-06T02:48:16.054220+0000","last_fullsized":"2023-10-06T02:48:16.054220+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:09.113236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-06T02:48:15.033784+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:48:15.033784+0000","last_peered":"2023-10-06T02:48:15.033784+0000","last_clean":"2023-10-06T02:48:15.033784+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:48:15.033784+0000","last_undegraded":"2023-10-06T02:48:15.033784+0000","last_fullsized":"2023-10-06T02:48:15.033784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:48:16.033530+0000","last_change":"2023-10-06T02:48:16.051326+0000","last_active":"2023-10-06T02:48:16.033530+0000","last_peered":"2023-10-06T02:48:16.033530+0000","last_clean":"2023-10-06T02:48:16.033530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:48:16.033530+0000","last_undegraded":"2023-10-06T02:48:16.033530+0000","last_fullsized":"2023-10-06T02:48:16.033530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:49.477051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-06T02:48:16.051426+0000","last_change":"2023-10-06T02:48:16.051426+0000","last_active":"2023-10-06T02:48:16.051426+0000","last_peered":"2023-10-06T02:48:16.051426+0000","last_clean":"2023-10-06T02:48:16.051426+0000","last_became_active":"2023-10-06T02:48:16.051241+0000","last_became_peered":"2023-10-06T02:48:16.051241+0000","last_unstale":"2023-10-06T02:48:16.051426+0000","last_undegraded":"2023-10-06T02:48:16.051426+0000","last_fullsized":"2023-10-06T02:48:16.051426+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:48.716690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-06T02:48:15.036169+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:48:15.036169+0000","last_peered":"2023-10-06T02:48:15.036169+0000","last_clean":"2023-10-06T02:48:15.036169+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:48:15.036169+0000","last_undegraded":"2023-10-06T02:48:15.036169+0000","last_fullsized":"2023-10-06T02:48:15.036169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":910,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194402,"statfs":{"total":200000000,"available":199067981,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52800000000000002,"15min":0.53100000000000003},"min":{"1min":0.33100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.80600000000000005,"5min":1.393,"15min":1.393},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40200000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.33000000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.497,"15min":0.495},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76400000000000001,"5min":1.081,"15min":1.081},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.311,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83999999999999997,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.8129999999999997,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.0649999999999999,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59299999999999997},"min":{"1min":0.40999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97899999999999998,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.45500000000000002},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.432},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.621,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71599999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.45700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.503},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194978,"statfs":{"total":200000000,"available":199658349,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68400000000000005,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":1.879,"15min":1.879},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73899999999999999,"5min":0.874,"15min":0.874},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":1.0309999999999999,"15min":1.111},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.80000000000000004,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68999999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69099999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.58999999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83399999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76300000000000001,"5min":1.163,"15min":1.163},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.56699999999999995,"15min":0.58099999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72699999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.627},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.747,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199664957,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.28199999999999997,"5min":0.30599999999999999,"15min":0.31},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.373,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.32100000000000001,"15min":0.32300000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.42499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.313,"15min":0.315},"min":{"1min":0.23699999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.36199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.42799999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.308,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.46700000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.246,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.441,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32900000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.36099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65700000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76000000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69299999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79100000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73999999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.749,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":910,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194402,"statfs":{"total":200000000,"available":199067981,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34799999999999998,"15min":0.35199999999999998},"min":{"1min":0.219,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":1.177,"15min":1.177},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.39800000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55700000000000005,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":1.177,"15min":1.321},"min":{"1min":0.21099999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.439,"5min":22.038,"15min":22.038},"last":0.246},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48799999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.25900000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.52800000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.36799999999999999,"5min":1.208,"15min":1.3480000000000001},"min":{"1min":0.27900000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.54500000000000004,"5min":21.942,"15min":21.942},"last":0.307}]},{"osd":4,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72199999999999998,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":1.258,"15min":1.3799999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.35099999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":1.361,"15min":1.4970000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80200000000000005,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":1.401,"15min":1.401},"last":0.36399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.29,"15min":1.411},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85999999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":1.389,"15min":1.5269999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84799999999999998,"5min":21.98,"15min":21.98},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":1.425,"15min":1.425},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.96299999999999997,"15min":1.026},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81799999999999995,"5min":11.154,"15min":11.154},"last":0.44800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199664957,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.23799999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.34899999999999998,"15min":0.35099999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.379,"15min":0.377},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.255}]},{"osd":3,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36599999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.373},{"interface":"front","average":{"1min":0.379,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64200000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54800000000000004,"15min":0.55800000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71199999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.874,"15min":0.874},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77200000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199664957,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.23200000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.317,"15min":0.315},"min":{"1min":0.24099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.41699999999999998,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32000000000000001,"15min":0.31900000000000001},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.39700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.27000000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.40600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.434,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.378},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78100000000000003,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72499999999999998,"5min":2.25,"15min":2.25},"last":0.498}]},{"osd":5,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.70099999999999996,"15min":0.72699999999999998},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.438,"5min":0.373,"15min":0.373},"max":{"1min":0.749,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.44500000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":1.002,"15min":1.071},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194978,"statfs":{"total":200000000,"available":199658349,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.83899999999999997,"15min":0.89400000000000002},"min":{"1min":0.38700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70599999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.495,"5min":0.64300000000000002,"15min":0.66800000000000004},"min":{"1min":0.38700000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.64500000000000002,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.626}]},{"osd":1,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.81699999999999995,"15min":0.86599999999999999},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.65000000000000002,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64500000000000002,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.47199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67000000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65100000000000002,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65900000000000003,"5min":3.456,"15min":3.456},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.68999999999999995,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70099999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.75},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.1699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73899999999999999,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199664957,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.752,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.312},{"interface":"front","average":{"1min":0.504,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76600000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.375},{"interface":"front","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.434},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.38900000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57499999999999996}]}]}],"pool_statfs":[]}} 2023-10-06T02:48:21.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:48:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.567+0000 7faf6c23e700 1 Processor -- start 2023-10-06T02:48:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.567+0000 7faf6c23e700 1 -- start start 2023-10-06T02:48:21.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.568+0000 7faf6c23e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf641578d0 0x7faf640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.568+0000 7faf6c23e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faf64157ca0 0x7faf6415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.568+0000 7faf6c23e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf640d07c0 con 0x7faf6406d120 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.568+0000 7faf6c23e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640cfbb0 con 0x7faf64157ca0 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.568+0000 7faf6c23e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640cfe90 con 0x7faf641578d0 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.568+0000 7faf6a7db700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faf6406d120 0x7faf6415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41628/0 (socket says 172.21.15.81:41628) 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.568+0000 7faf6a7db700 1 -- 172.21.15.81:0/1891140429 learned_addr learned my addr 172.21.15.81:0/1891140429 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf697d9700 1 --2- 172.21.15.81:0/1891140429 >> v2:172.21.15.83:3300/0 conn(0x7faf64157ca0 0x7faf6415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053794806 0 0) 0x7faf640d07c0 con 0x7faf6406d120 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf69fda700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf641578d0 0x7faf640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf50003570 con 0x7faf6406d120 2023-10-06T02:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 479674470 0 0) 0x7faf50003570 con 0x7faf6406d120 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf641578d0 msgr2=0x7faf640cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf641578d0 0x7faf640cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 >> v2:172.21.15.83:3300/0 conn(0x7faf64157ca0 msgr2=0x7faf6415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 --2- 172.21.15.81:0/1891140429 >> v2:172.21.15.83:3300/0 conn(0x7faf64157ca0 0x7faf6415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640d0170 con 0x7faf6406d120 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7faf5c0017f0 con 0x7faf6406d120 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 >> v1:172.21.15.81:6789/0 conn(0x7faf6406d120 legacy=0x7faf6415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf641578d0 0x7faf50003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf50003fe0 0x7faf50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf50004d50 0x7faf500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640cfbb0 con 0x7faf50004d50 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640cfe90 con 0x7faf50003fe0 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5000ba90 con 0x7faf641578d0 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf6a7db700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf50004d50 0x7faf500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf69fda700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf641578d0 0x7faf50003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf697d9700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf50003fe0 0x7faf50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf6a7db700 1 -- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf641578d0 msgr2=0x7faf50003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf6a7db700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf641578d0 0x7faf50003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf6a7db700 1 -- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf50003fe0 msgr2=0x7faf50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf6a7db700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf50003fe0 0x7faf50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.569+0000 7faf6a7db700 1 -- 172.21.15.81:0/1891140429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50003570 con 0x7faf50004d50 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf6a7db700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf50004d50 0x7faf500051c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00a970 tx=0x7faf640d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a622accfc476da15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0070d0 con 0x7faf50004d50 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c007230 con 0x7faf50004d50 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf68fd8700 1 -- 172.21.15.81:0/1891140429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0075f0 con 0x7faf50004d50 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf6c23e700 1 -- 172.21.15.81:0/1891140429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf50004d50 msgr2=0x7faf500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf6c23e700 1 --2- 172.21.15.81:0/1891140429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf50004d50 0x7faf500051c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00a970 tx=0x7faf640d0730 comp rx=0 tx=0).stop 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf6a7db700 1 -- 172.21.15.81:0/1891140429 reap_dead start 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf6c23e700 1 -- 172.21.15.81:0/1891140429 shutdown_connections 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf6c23e700 1 -- 172.21.15.81:0/1891140429 >> 172.21.15.81:0/1891140429 conn(0x7faf6406bb90 msgr2=0x7faf6406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf6c23e700 1 -- 172.21.15.81:0/1891140429 shutdown_connections 2023-10-06T02:48:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.570+0000 7faf6c23e700 1 -- 172.21.15.81:0/1891140429 wait complete. 2023-10-06T02:48:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.571+0000 7faf6c23e700 1 Processor -- start 2023-10-06T02:48:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.571+0000 7faf6c23e700 1 -- start start 2023-10-06T02:48:21.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6c23e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf6414eb20 0x7faf64152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6c23e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf64153340 0x7faf6416e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6c23e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf6416e5a0 0x7faf6416bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6c23e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6416ea40 con 0x7faf6416e5a0 2023-10-06T02:48:21.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6c23e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf64151d60 con 0x7faf64153340 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6c23e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf64152040 con 0x7faf6414eb20 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6a7db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf6416e5a0 0x7faf6416bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6a7db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf6416e5a0 0x7faf6416bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38442/0 (socket says 172.21.15.81:38442) 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6a7db700 1 -- 172.21.15.81:0/3563507993 learned_addr learned my addr 172.21.15.81:0/3563507993 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf69fda700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf6414eb20 0x7faf64152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf697d9700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf64153340 0x7faf6416e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6a7db700 1 -- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf6414eb20 msgr2=0x7faf64152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6a7db700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf6414eb20 0x7faf64152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6a7db700 1 -- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf64153340 msgr2=0x7faf6416e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6a7db700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf64153340 0x7faf6416e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.572+0000 7faf6a7db700 1 -- 172.21.15.81:0/3563507993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64152320 con 0x7faf6416e5a0 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.573+0000 7faf6a7db700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf6416e5a0 0x7faf6416bc30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7faf5c007760 tx=0x7faf5c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.573+0000 7faf59ffb700 1 -- 172.21.15.81:0/3563507993 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0070d0 con 0x7faf6416e5a0 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.573+0000 7faf59ffb700 1 -- 172.21.15.81:0/3563507993 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c0017b0 con 0x7faf6416e5a0 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.573+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf64152600 con 0x7faf6416e5a0 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.573+0000 7faf59ffb700 1 -- 172.21.15.81:0/3563507993 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c01e890 con 0x7faf6416e5a0 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.573+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6414eef0 con 0x7faf6416e5a0 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.574+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf64152b20 con 0x7faf6416e5a0 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.574+0000 7faf59ffb700 1 -- 172.21.15.81:0/3563507993 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf5c01ec80 con 0x7faf6416e5a0 2023-10-06T02:48:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.575+0000 7faf59ffb700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf48066f30 0x7faf480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.575+0000 7faf59ffb700 1 -- 172.21.15.81:0/3563507993 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faf5c086d40 con 0x7faf6416e5a0 2023-10-06T02:48:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.575+0000 7faf69fda700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf48066f30 0x7faf480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.575+0000 7faf69fda700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf48066f30 0x7faf480693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf60006f00 tx=0x7faf600091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.579+0000 7faf59ffb700 1 -- 172.21.15.81:0/3563507993 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf64152b20 con 0x7faf6416e5a0 2023-10-06T02:48:21.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.757+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf64152b20 con 0x7faf48066f30 2023-10-06T02:48:21.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.766+0000 7faf59ffb700 1 -- 172.21.15.81:0/3563507993 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305309 (secure 0 0 0) 0x7faf64152b20 con 0x7faf48066f30 2023-10-06T02:48:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:21.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf48066f30 msgr2=0x7faf480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf48066f30 0x7faf480693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf60006f00 tx=0x7faf600091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf6416e5a0 msgr2=0x7faf6416bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf6416e5a0 0x7faf6416bc30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7faf5c007760 tx=0x7faf5c016000 comp rx=0 tx=0).stop 2023-10-06T02:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 shutdown_connections 2023-10-06T02:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf6416e5a0 0x7faf6416bc30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf6414eb20 0x7faf64152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faf48066f30 0x7faf480693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 --2- 172.21.15.81:0/3563507993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf64153340 0x7faf6416e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 >> 172.21.15.81:0/3563507993 conn(0x7faf6406bb90 msgr2=0x7faf64154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 shutdown_connections 2023-10-06T02:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.769+0000 7faf6c23e700 1 -- 172.21.15.81:0/3563507993 wait complete. 2023-10-06T02:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:48:21.782 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-10-06T02:48:21.522666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558565,"statfs":{"total":1600000000,"available":1595971388,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001190"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055164+0000","last_change":"2023-10-06T02:48:17.055108+0000","last_active":"2023-10-06T02:48:17.055164+0000","last_peered":"2023-10-06T02:48:17.055164+0000","last_clean":"2023-10-06T02:48:17.055164+0000","last_became_active":"2023-10-06T02:48:17.054886+0000","last_became_peered":"2023-10-06T02:48:17.054886+0000","last_unstale":"2023-10-06T02:48:17.055164+0000","last_undegraded":"2023-10-06T02:48:17.055164+0000","last_fullsized":"2023-10-06T02:48:17.055164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:58.570550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.049788+0000","last_change":"2023-10-06T02:48:17.049678+0000","last_active":"2023-10-06T02:48:17.049788+0000","last_peered":"2023-10-06T02:48:17.049788+0000","last_clean":"2023-10-06T02:48:17.049788+0000","last_became_active":"2023-10-06T02:48:17.049471+0000","last_became_peered":"2023-10-06T02:48:17.049471+0000","last_unstale":"2023-10-06T02:48:17.049788+0000","last_undegraded":"2023-10-06T02:48:17.049788+0000","last_fullsized":"2023-10-06T02:48:17.049788+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:30.513380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055081+0000","last_change":"2023-10-06T02:48:17.054931+0000","last_active":"2023-10-06T02:48:17.055081+0000","last_peered":"2023-10-06T02:48:17.055081+0000","last_clean":"2023-10-06T02:48:17.055081+0000","last_became_active":"2023-10-06T02:48:17.054706+0000","last_became_peered":"2023-10-06T02:48:17.054706+0000","last_unstale":"2023-10-06T02:48:17.055081+0000","last_undegraded":"2023-10-06T02:48:17.055081+0000","last_fullsized":"2023-10-06T02:48:17.055081+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:15.529954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.048623+0000","last_change":"2023-10-06T02:48:17.048351+0000","last_active":"2023-10-06T02:48:17.048623+0000","last_peered":"2023-10-06T02:48:17.048623+0000","last_clean":"2023-10-06T02:48:17.048623+0000","last_became_active":"2023-10-06T02:48:17.048150+0000","last_became_peered":"2023-10-06T02:48:17.048150+0000","last_unstale":"2023-10-06T02:48:17.048623+0000","last_undegraded":"2023-10-06T02:48:17.048623+0000","last_fullsized":"2023-10-06T02:48:17.048623+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:19.932621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.053811+0000","last_change":"2023-10-06T02:48:17.053733+0000","last_active":"2023-10-06T02:48:17.053811+0000","last_peered":"2023-10-06T02:48:17.053811+0000","last_clean":"2023-10-06T02:48:17.053811+0000","last_became_active":"2023-10-06T02:48:17.053502+0000","last_became_peered":"2023-10-06T02:48:17.053502+0000","last_unstale":"2023-10-06T02:48:17.053811+0000","last_undegraded":"2023-10-06T02:48:17.053811+0000","last_fullsized":"2023-10-06T02:48:17.053811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:51.381126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.053335+0000","last_change":"2023-10-06T02:48:17.053148+0000","last_active":"2023-10-06T02:48:17.053335+0000","last_peered":"2023-10-06T02:48:17.053335+0000","last_clean":"2023-10-06T02:48:17.053335+0000","last_became_active":"2023-10-06T02:48:17.052593+0000","last_became_peered":"2023-10-06T02:48:17.052593+0000","last_unstale":"2023-10-06T02:48:17.053335+0000","last_undegraded":"2023-10-06T02:48:17.053335+0000","last_fullsized":"2023-10-06T02:48:17.053335+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.050562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.054944+0000","last_change":"2023-10-06T02:48:17.054623+0000","last_active":"2023-10-06T02:48:17.054944+0000","last_peered":"2023-10-06T02:48:17.054944+0000","last_clean":"2023-10-06T02:48:17.054944+0000","last_became_active":"2023-10-06T02:48:17.054394+0000","last_became_peered":"2023-10-06T02:48:17.054394+0000","last_unstale":"2023-10-06T02:48:17.054944+0000","last_undegraded":"2023-10-06T02:48:17.054944+0000","last_fullsized":"2023-10-06T02:48:17.054944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:30.358930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.058466+0000","last_change":"2023-10-06T02:48:17.058395+0000","last_active":"2023-10-06T02:48:17.058466+0000","last_peered":"2023-10-06T02:48:17.058466+0000","last_clean":"2023-10-06T02:48:17.058466+0000","last_became_active":"2023-10-06T02:48:17.058141+0000","last_became_peered":"2023-10-06T02:48:17.058141+0000","last_unstale":"2023-10-06T02:48:17.058466+0000","last_undegraded":"2023-10-06T02:48:17.058466+0000","last_fullsized":"2023-10-06T02:48:17.058466+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:13.581865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.060681+0000","last_change":"2023-10-06T02:48:17.060326+0000","last_active":"2023-10-06T02:48:17.060681+0000","last_peered":"2023-10-06T02:48:17.060681+0000","last_clean":"2023-10-06T02:48:17.060681+0000","last_became_active":"2023-10-06T02:48:17.059812+0000","last_became_peered":"2023-10-06T02:48:17.059812+0000","last_unstale":"2023-10-06T02:48:17.060681+0000","last_undegraded":"2023-10-06T02:48:17.060681+0000","last_fullsized":"2023-10-06T02:48:17.060681+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:23.250224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.058909+0000","last_change":"2023-10-06T02:48:17.056289+0000","last_active":"2023-10-06T02:48:17.058909+0000","last_peered":"2023-10-06T02:48:17.058909+0000","last_clean":"2023-10-06T02:48:17.058909+0000","last_became_active":"2023-10-06T02:48:17.055918+0000","last_became_peered":"2023-10-06T02:48:17.055918+0000","last_unstale":"2023-10-06T02:48:17.058909+0000","last_undegraded":"2023-10-06T02:48:17.058909+0000","last_fullsized":"2023-10-06T02:48:17.058909+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:52.028566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055655+0000","last_change":"2023-10-06T02:48:17.051384+0000","last_active":"2023-10-06T02:48:17.055655+0000","last_peered":"2023-10-06T02:48:17.055655+0000","last_clean":"2023-10-06T02:48:17.055655+0000","last_became_active":"2023-10-06T02:48:17.049561+0000","last_became_peered":"2023-10-06T02:48:17.049561+0000","last_unstale":"2023-10-06T02:48:17.055655+0000","last_undegraded":"2023-10-06T02:48:17.055655+0000","last_fullsized":"2023-10-06T02:48:17.055655+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:30.513380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.057823+0000","last_change":"2023-10-06T02:48:17.057353+0000","last_active":"2023-10-06T02:48:17.057823+0000","last_peered":"2023-10-06T02:48:17.057823+0000","last_clean":"2023-10-06T02:48:17.057823+0000","last_became_active":"2023-10-06T02:48:17.053877+0000","last_became_peered":"2023-10-06T02:48:17.053877+0000","last_unstale":"2023-10-06T02:48:17.057823+0000","last_undegraded":"2023-10-06T02:48:17.057823+0000","last_fullsized":"2023-10-06T02:48:17.057823+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:04.659464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.047920+0000","last_change":"2023-10-06T02:48:17.047681+0000","last_active":"2023-10-06T02:48:17.047920+0000","last_peered":"2023-10-06T02:48:17.047920+0000","last_clean":"2023-10-06T02:48:17.047920+0000","last_became_active":"2023-10-06T02:48:17.047444+0000","last_became_peered":"2023-10-06T02:48:17.047444+0000","last_unstale":"2023-10-06T02:48:17.047920+0000","last_undegraded":"2023-10-06T02:48:17.047920+0000","last_fullsized":"2023-10-06T02:48:17.047920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:52.028566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.053738+0000","last_change":"2023-10-06T02:48:17.053384+0000","last_active":"2023-10-06T02:48:17.053738+0000","last_peered":"2023-10-06T02:48:17.053738+0000","last_clean":"2023-10-06T02:48:17.053738+0000","last_became_active":"2023-10-06T02:48:17.053159+0000","last_became_peered":"2023-10-06T02:48:17.053159+0000","last_unstale":"2023-10-06T02:48:17.053738+0000","last_undegraded":"2023-10-06T02:48:17.053738+0000","last_fullsized":"2023-10-06T02:48:17.053738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:17.896165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.058894+0000","last_change":"2023-10-06T02:48:17.055587+0000","last_active":"2023-10-06T02:48:17.058894+0000","last_peered":"2023-10-06T02:48:17.058894+0000","last_clean":"2023-10-06T02:48:17.058894+0000","last_became_active":"2023-10-06T02:48:17.055323+0000","last_became_peered":"2023-10-06T02:48:17.055323+0000","last_unstale":"2023-10-06T02:48:17.058894+0000","last_undegraded":"2023-10-06T02:48:17.058894+0000","last_fullsized":"2023-10-06T02:48:17.058894+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:58.570550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.050658+0000","last_change":"2023-10-06T02:48:17.050614+0000","last_active":"2023-10-06T02:48:17.050658+0000","last_peered":"2023-10-06T02:48:17.050658+0000","last_clean":"2023-10-06T02:48:17.050658+0000","last_became_active":"2023-10-06T02:48:17.048704+0000","last_became_peered":"2023-10-06T02:48:17.048704+0000","last_unstale":"2023-10-06T02:48:17.050658+0000","last_undegraded":"2023-10-06T02:48:17.050658+0000","last_fullsized":"2023-10-06T02:48:17.050658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:13.738843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.052710+0000","last_change":"2023-10-06T02:48:17.052314+0000","last_active":"2023-10-06T02:48:17.052710+0000","last_peered":"2023-10-06T02:48:17.052710+0000","last_clean":"2023-10-06T02:48:17.052710+0000","last_became_active":"2023-10-06T02:48:17.051802+0000","last_became_peered":"2023-10-06T02:48:17.051802+0000","last_unstale":"2023-10-06T02:48:17.052710+0000","last_undegraded":"2023-10-06T02:48:17.052710+0000","last_fullsized":"2023-10-06T02:48:17.052710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:52.028566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.047664+0000","last_change":"2023-10-06T02:48:17.047605+0000","last_active":"2023-10-06T02:48:17.047664+0000","last_peered":"2023-10-06T02:48:17.047664+0000","last_clean":"2023-10-06T02:48:17.047664+0000","last_became_active":"2023-10-06T02:48:17.047362+0000","last_became_peered":"2023-10-06T02:48:17.047362+0000","last_unstale":"2023-10-06T02:48:17.047664+0000","last_undegraded":"2023-10-06T02:48:17.047664+0000","last_fullsized":"2023-10-06T02:48:17.047664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:23.715220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055238+0000","last_change":"2023-10-06T02:48:17.055125+0000","last_active":"2023-10-06T02:48:17.055238+0000","last_peered":"2023-10-06T02:48:17.055238+0000","last_clean":"2023-10-06T02:48:17.055238+0000","last_became_active":"2023-10-06T02:48:17.054899+0000","last_became_peered":"2023-10-06T02:48:17.054899+0000","last_unstale":"2023-10-06T02:48:17.055238+0000","last_undegraded":"2023-10-06T02:48:17.055238+0000","last_fullsized":"2023-10-06T02:48:17.055238+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:22.167880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.054349+0000","last_change":"2023-10-06T02:48:17.054284+0000","last_active":"2023-10-06T02:48:17.054349+0000","last_peered":"2023-10-06T02:48:17.054349+0000","last_clean":"2023-10-06T02:48:17.054349+0000","last_became_active":"2023-10-06T02:48:17.054009+0000","last_became_peered":"2023-10-06T02:48:17.054009+0000","last_unstale":"2023-10-06T02:48:17.054349+0000","last_undegraded":"2023-10-06T02:48:17.054349+0000","last_fullsized":"2023-10-06T02:48:17.054349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:21.022804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.057855+0000","last_change":"2023-10-06T02:48:17.057473+0000","last_active":"2023-10-06T02:48:17.057855+0000","last_peered":"2023-10-06T02:48:17.057855+0000","last_clean":"2023-10-06T02:48:17.057855+0000","last_became_active":"2023-10-06T02:48:17.052890+0000","last_became_peered":"2023-10-06T02:48:17.052890+0000","last_unstale":"2023-10-06T02:48:17.057855+0000","last_undegraded":"2023-10-06T02:48:17.057855+0000","last_fullsized":"2023-10-06T02:48:17.057855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:27.024353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055064+0000","last_change":"2023-10-06T02:48:17.054977+0000","last_active":"2023-10-06T02:48:17.055064+0000","last_peered":"2023-10-06T02:48:17.055064+0000","last_clean":"2023-10-06T02:48:17.055064+0000","last_became_active":"2023-10-06T02:48:17.054767+0000","last_became_peered":"2023-10-06T02:48:17.054767+0000","last_unstale":"2023-10-06T02:48:17.055064+0000","last_undegraded":"2023-10-06T02:48:17.055064+0000","last_fullsized":"2023-10-06T02:48:17.055064+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:51.750415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.054906+0000","last_change":"2023-10-06T02:48:17.054811+0000","last_active":"2023-10-06T02:48:17.054906+0000","last_peered":"2023-10-06T02:48:17.054906+0000","last_clean":"2023-10-06T02:48:17.054906+0000","last_became_active":"2023-10-06T02:48:17.054580+0000","last_became_peered":"2023-10-06T02:48:17.054580+0000","last_unstale":"2023-10-06T02:48:17.054906+0000","last_undegraded":"2023-10-06T02:48:17.054906+0000","last_fullsized":"2023-10-06T02:48:17.054906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:40.367106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.058924+0000","last_change":"2023-10-06T02:48:17.056473+0000","last_active":"2023-10-06T02:48:17.058924+0000","last_peered":"2023-10-06T02:48:17.058924+0000","last_clean":"2023-10-06T02:48:17.058924+0000","last_became_active":"2023-10-06T02:48:17.056267+0000","last_became_peered":"2023-10-06T02:48:17.056267+0000","last_unstale":"2023-10-06T02:48:17.058924+0000","last_undegraded":"2023-10-06T02:48:17.058924+0000","last_fullsized":"2023-10-06T02:48:17.058924+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:59.516075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.057839+0000","last_change":"2023-10-06T02:48:17.057440+0000","last_active":"2023-10-06T02:48:17.057839+0000","last_peered":"2023-10-06T02:48:17.057839+0000","last_clean":"2023-10-06T02:48:17.057839+0000","last_became_active":"2023-10-06T02:48:17.056561+0000","last_became_peered":"2023-10-06T02:48:17.056561+0000","last_unstale":"2023-10-06T02:48:17.057839+0000","last_undegraded":"2023-10-06T02:48:17.057839+0000","last_fullsized":"2023-10-06T02:48:17.057839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:58.570550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.058224+0000","last_change":"2023-10-06T02:48:17.057952+0000","last_active":"2023-10-06T02:48:17.058224+0000","last_peered":"2023-10-06T02:48:17.058224+0000","last_clean":"2023-10-06T02:48:17.058224+0000","last_became_active":"2023-10-06T02:48:17.053634+0000","last_became_peered":"2023-10-06T02:48:17.053634+0000","last_unstale":"2023-10-06T02:48:17.058224+0000","last_undegraded":"2023-10-06T02:48:17.058224+0000","last_fullsized":"2023-10-06T02:48:17.058224+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:25.472066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.059217+0000","last_change":"2023-10-06T02:48:17.057575+0000","last_active":"2023-10-06T02:48:17.059217+0000","last_peered":"2023-10-06T02:48:17.059217+0000","last_clean":"2023-10-06T02:48:17.059217+0000","last_became_active":"2023-10-06T02:48:17.056910+0000","last_became_peered":"2023-10-06T02:48:17.056910+0000","last_unstale":"2023-10-06T02:48:17.059217+0000","last_undegraded":"2023-10-06T02:48:17.059217+0000","last_fullsized":"2023-10-06T02:48:17.059217+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:44:17.637914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.053772+0000","last_change":"2023-10-06T02:48:17.053705+0000","last_active":"2023-10-06T02:48:17.053772+0000","last_peered":"2023-10-06T02:48:17.053772+0000","last_clean":"2023-10-06T02:48:17.053772+0000","last_became_active":"2023-10-06T02:48:17.053348+0000","last_became_peered":"2023-10-06T02:48:17.053348+0000","last_unstale":"2023-10-06T02:48:17.053772+0000","last_undegraded":"2023-10-06T02:48:17.053772+0000","last_fullsized":"2023-10-06T02:48:17.053772+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:23.715220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.060715+0000","last_change":"2023-10-06T02:48:17.060477+0000","last_active":"2023-10-06T02:48:17.060715+0000","last_peered":"2023-10-06T02:48:17.060715+0000","last_clean":"2023-10-06T02:48:17.060715+0000","last_became_active":"2023-10-06T02:48:17.060114+0000","last_became_peered":"2023-10-06T02:48:17.060114+0000","last_unstale":"2023-10-06T02:48:17.060715+0000","last_undegraded":"2023-10-06T02:48:17.060715+0000","last_fullsized":"2023-10-06T02:48:17.060715+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:04.659464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.057906+0000","last_change":"2023-10-06T02:48:17.057741+0000","last_active":"2023-10-06T02:48:17.057906+0000","last_peered":"2023-10-06T02:48:17.057906+0000","last_clean":"2023-10-06T02:48:17.057906+0000","last_became_active":"2023-10-06T02:48:17.057212+0000","last_became_peered":"2023-10-06T02:48:17.057212+0000","last_unstale":"2023-10-06T02:48:17.057906+0000","last_undegraded":"2023-10-06T02:48:17.057906+0000","last_fullsized":"2023-10-06T02:48:17.057906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:49.726820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.059237+0000","last_change":"2023-10-06T02:48:17.058100+0000","last_active":"2023-10-06T02:48:17.059237+0000","last_peered":"2023-10-06T02:48:17.059237+0000","last_clean":"2023-10-06T02:48:17.059237+0000","last_became_active":"2023-10-06T02:48:17.057526+0000","last_became_peered":"2023-10-06T02:48:17.057526+0000","last_unstale":"2023-10-06T02:48:17.059237+0000","last_undegraded":"2023-10-06T02:48:17.059237+0000","last_fullsized":"2023-10-06T02:48:17.059237+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:44.936287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.053031+0000","last_change":"2023-10-06T02:48:17.052647+0000","last_active":"2023-10-06T02:48:17.053031+0000","last_peered":"2023-10-06T02:48:17.053031+0000","last_clean":"2023-10-06T02:48:17.053031+0000","last_became_active":"2023-10-06T02:48:17.052445+0000","last_became_peered":"2023-10-06T02:48:17.052445+0000","last_unstale":"2023-10-06T02:48:17.053031+0000","last_undegraded":"2023-10-06T02:48:17.053031+0000","last_fullsized":"2023-10-06T02:48:17.053031+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:47.147785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.051782+0000","last_change":"2023-10-06T02:48:17.050567+0000","last_active":"2023-10-06T02:48:17.051782+0000","last_peered":"2023-10-06T02:48:17.051782+0000","last_clean":"2023-10-06T02:48:17.051782+0000","last_became_active":"2023-10-06T02:48:17.050341+0000","last_became_peered":"2023-10-06T02:48:17.050341+0000","last_unstale":"2023-10-06T02:48:17.051782+0000","last_undegraded":"2023-10-06T02:48:17.051782+0000","last_fullsized":"2023-10-06T02:48:17.051782+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:30.058547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.065179+0000","last_change":"2023-10-06T02:48:16.052721+0000","last_active":"2023-10-06T02:48:17.065179+0000","last_peered":"2023-10-06T02:48:17.065179+0000","last_clean":"2023-10-06T02:48:17.065179+0000","last_became_active":"2023-10-06T02:48:16.052527+0000","last_became_peered":"2023-10-06T02:48:16.052527+0000","last_unstale":"2023-10-06T02:48:17.065179+0000","last_undegraded":"2023-10-06T02:48:17.065179+0000","last_fullsized":"2023-10-06T02:48:17.065179+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:50.370996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055690+0000","last_change":"2023-10-06T02:48:17.055624+0000","last_active":"2023-10-06T02:48:17.055690+0000","last_peered":"2023-10-06T02:48:17.055690+0000","last_clean":"2023-10-06T02:48:17.055690+0000","last_became_active":"2023-10-06T02:48:17.055108+0000","last_became_peered":"2023-10-06T02:48:17.055108+0000","last_unstale":"2023-10-06T02:48:17.055690+0000","last_undegraded":"2023-10-06T02:48:17.055690+0000","last_fullsized":"2023-10-06T02:48:17.055690+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:57.296415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.061790+0000","last_change":"2023-10-06T02:48:16.057040+0000","last_active":"2023-10-06T02:48:17.061790+0000","last_peered":"2023-10-06T02:48:17.061790+0000","last_clean":"2023-10-06T02:48:17.061790+0000","last_became_active":"2023-10-06T02:48:16.056792+0000","last_became_peered":"2023-10-06T02:48:16.056792+0000","last_unstale":"2023-10-06T02:48:17.061790+0000","last_undegraded":"2023-10-06T02:48:17.061790+0000","last_fullsized":"2023-10-06T02:48:17.061790+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:48.716690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055647+0000","last_change":"2023-10-06T02:48:17.055420+0000","last_active":"2023-10-06T02:48:17.055647+0000","last_peered":"2023-10-06T02:48:17.055647+0000","last_clean":"2023-10-06T02:48:17.055647+0000","last_became_active":"2023-10-06T02:48:17.055080+0000","last_became_peered":"2023-10-06T02:48:17.055080+0000","last_unstale":"2023-10-06T02:48:17.055647+0000","last_undegraded":"2023-10-06T02:48:17.055647+0000","last_fullsized":"2023-10-06T02:48:17.055647+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:38.762722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.061426+0000","last_change":"2023-10-06T02:48:16.060094+0000","last_active":"2023-10-06T02:48:17.061426+0000","last_peered":"2023-10-06T02:48:17.061426+0000","last_clean":"2023-10-06T02:48:17.061426+0000","last_became_active":"2023-10-06T02:48:16.059874+0000","last_became_peered":"2023-10-06T02:48:16.059874+0000","last_unstale":"2023-10-06T02:48:17.061426+0000","last_undegraded":"2023-10-06T02:48:17.061426+0000","last_fullsized":"2023-10-06T02:48:17.061426+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:12.571735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.058877+0000","last_change":"2023-10-06T02:48:17.055379+0000","last_active":"2023-10-06T02:48:17.058877+0000","last_peered":"2023-10-06T02:48:17.058877+0000","last_clean":"2023-10-06T02:48:17.058877+0000","last_became_active":"2023-10-06T02:48:17.055162+0000","last_became_peered":"2023-10-06T02:48:17.055162+0000","last_unstale":"2023-10-06T02:48:17.058877+0000","last_undegraded":"2023-10-06T02:48:17.058877+0000","last_fullsized":"2023-10-06T02:48:17.058877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:10.793815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.063317+0000","last_change":"2023-10-06T02:48:16.045919+0000","last_active":"2023-10-06T02:48:17.063317+0000","last_peered":"2023-10-06T02:48:17.063317+0000","last_clean":"2023-10-06T02:48:17.063317+0000","last_became_active":"2023-10-06T02:48:16.045698+0000","last_became_peered":"2023-10-06T02:48:16.045698+0000","last_unstale":"2023-10-06T02:48:17.063317+0000","last_undegraded":"2023-10-06T02:48:17.063317+0000","last_fullsized":"2023-10-06T02:48:17.063317+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:03.649335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.050039+0000","last_change":"2023-10-06T02:48:17.049950+0000","last_active":"2023-10-06T02:48:17.050039+0000","last_peered":"2023-10-06T02:48:17.050039+0000","last_clean":"2023-10-06T02:48:17.050039+0000","last_became_active":"2023-10-06T02:48:17.049734+0000","last_became_peered":"2023-10-06T02:48:17.049734+0000","last_unstale":"2023-10-06T02:48:17.050039+0000","last_undegraded":"2023-10-06T02:48:17.050039+0000","last_fullsized":"2023-10-06T02:48:17.050039+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:38.587445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.061591+0000","last_change":"2023-10-06T02:48:16.048022+0000","last_active":"2023-10-06T02:48:17.061591+0000","last_peered":"2023-10-06T02:48:17.061591+0000","last_clean":"2023-10-06T02:48:17.061591+0000","last_became_active":"2023-10-06T02:48:16.047502+0000","last_became_peered":"2023-10-06T02:48:16.047502+0000","last_unstale":"2023-10-06T02:48:17.061591+0000","last_undegraded":"2023-10-06T02:48:17.061591+0000","last_fullsized":"2023-10-06T02:48:17.061591+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:58.505945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.056441+0000","last_change":"2023-10-06T02:48:17.056391+0000","last_active":"2023-10-06T02:48:17.056441+0000","last_peered":"2023-10-06T02:48:17.056441+0000","last_clean":"2023-10-06T02:48:17.056441+0000","last_became_active":"2023-10-06T02:48:17.056243+0000","last_became_peered":"2023-10-06T02:48:17.056243+0000","last_unstale":"2023-10-06T02:48:17.056441+0000","last_undegraded":"2023-10-06T02:48:17.056441+0000","last_fullsized":"2023-10-06T02:48:17.056441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:01.265631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.061601+0000","last_change":"2023-10-06T02:48:16.047106+0000","last_active":"2023-10-06T02:48:17.061601+0000","last_peered":"2023-10-06T02:48:17.061601+0000","last_clean":"2023-10-06T02:48:17.061601+0000","last_became_active":"2023-10-06T02:48:16.046884+0000","last_became_peered":"2023-10-06T02:48:16.046884+0000","last_unstale":"2023-10-06T02:48:17.061601+0000","last_undegraded":"2023-10-06T02:48:17.061601+0000","last_fullsized":"2023-10-06T02:48:17.061601+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:14.519825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055205+0000","last_change":"2023-10-06T02:48:17.054594+0000","last_active":"2023-10-06T02:48:17.055205+0000","last_peered":"2023-10-06T02:48:17.055205+0000","last_clean":"2023-10-06T02:48:17.055205+0000","last_became_active":"2023-10-06T02:48:17.054362+0000","last_became_peered":"2023-10-06T02:48:17.054362+0000","last_unstale":"2023-10-06T02:48:17.055205+0000","last_undegraded":"2023-10-06T02:48:17.055205+0000","last_fullsized":"2023-10-06T02:48:17.055205+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:48.636782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.047790+0000","last_change":"2023-10-06T02:48:16.054108+0000","last_active":"2023-10-06T02:48:17.047790+0000","last_peered":"2023-10-06T02:48:17.047790+0000","last_clean":"2023-10-06T02:48:17.047790+0000","last_became_active":"2023-10-06T02:48:16.053977+0000","last_became_peered":"2023-10-06T02:48:16.053977+0000","last_unstale":"2023-10-06T02:48:17.047790+0000","last_undegraded":"2023-10-06T02:48:17.047790+0000","last_fullsized":"2023-10-06T02:48:17.047790+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:12.571735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.056987+0000","last_change":"2023-10-06T02:48:17.056924+0000","last_active":"2023-10-06T02:48:17.056987+0000","last_peered":"2023-10-06T02:48:17.056987+0000","last_clean":"2023-10-06T02:48:17.056987+0000","last_became_active":"2023-10-06T02:48:17.056714+0000","last_became_peered":"2023-10-06T02:48:17.056714+0000","last_unstale":"2023-10-06T02:48:17.056987+0000","last_undegraded":"2023-10-06T02:48:17.056987+0000","last_fullsized":"2023-10-06T02:48:17.056987+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.050562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.050726+0000","last_change":"2023-10-06T02:48:16.055003+0000","last_active":"2023-10-06T02:48:17.050726+0000","last_peered":"2023-10-06T02:48:17.050726+0000","last_clean":"2023-10-06T02:48:17.050726+0000","last_became_active":"2023-10-06T02:48:16.054706+0000","last_became_peered":"2023-10-06T02:48:16.054706+0000","last_unstale":"2023-10-06T02:48:17.050726+0000","last_undegraded":"2023-10-06T02:48:17.050726+0000","last_fullsized":"2023-10-06T02:48:17.050726+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:12.728713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.053138+0000","last_change":"2023-10-06T02:48:17.052963+0000","last_active":"2023-10-06T02:48:17.053138+0000","last_peered":"2023-10-06T02:48:17.053138+0000","last_clean":"2023-10-06T02:48:17.053138+0000","last_became_active":"2023-10-06T02:48:17.052735+0000","last_became_peered":"2023-10-06T02:48:17.052735+0000","last_unstale":"2023-10-06T02:48:17.053138+0000","last_undegraded":"2023-10-06T02:48:17.053138+0000","last_fullsized":"2023-10-06T02:48:17.053138+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:38.730559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.051111+0000","last_change":"2023-10-06T02:48:16.054020+0000","last_active":"2023-10-06T02:48:17.051111+0000","last_peered":"2023-10-06T02:48:17.051111+0000","last_clean":"2023-10-06T02:48:17.051111+0000","last_became_active":"2023-10-06T02:48:16.053357+0000","last_became_peered":"2023-10-06T02:48:16.053357+0000","last_unstale":"2023-10-06T02:48:17.051111+0000","last_undegraded":"2023-10-06T02:48:17.051111+0000","last_fullsized":"2023-10-06T02:48:17.051111+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:44:16.627785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.051626+0000","last_change":"2023-10-06T02:48:17.051272+0000","last_active":"2023-10-06T02:48:17.051626+0000","last_peered":"2023-10-06T02:48:17.051626+0000","last_clean":"2023-10-06T02:48:17.051626+0000","last_became_active":"2023-10-06T02:48:17.051069+0000","last_became_peered":"2023-10-06T02:48:17.051069+0000","last_unstale":"2023-10-06T02:48:17.051626+0000","last_undegraded":"2023-10-06T02:48:17.051626+0000","last_fullsized":"2023-10-06T02:48:17.051626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:58.844578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.044887+0000","last_change":"2023-10-06T02:48:16.058121+0000","last_active":"2023-10-06T02:48:17.044887+0000","last_peered":"2023-10-06T02:48:17.044887+0000","last_clean":"2023-10-06T02:48:17.044887+0000","last_became_active":"2023-10-06T02:48:16.057850+0000","last_became_peered":"2023-10-06T02:48:16.057850+0000","last_unstale":"2023-10-06T02:48:17.044887+0000","last_undegraded":"2023-10-06T02:48:17.044887+0000","last_fullsized":"2023-10-06T02:48:17.044887+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:37.725868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.052422+0000","last_change":"2023-10-06T02:48:17.052266+0000","last_active":"2023-10-06T02:48:17.052422+0000","last_peered":"2023-10-06T02:48:17.052422+0000","last_clean":"2023-10-06T02:48:17.052422+0000","last_became_active":"2023-10-06T02:48:17.051745+0000","last_became_peered":"2023-10-06T02:48:17.051745+0000","last_unstale":"2023-10-06T02:48:17.052422+0000","last_undegraded":"2023-10-06T02:48:17.052422+0000","last_fullsized":"2023-10-06T02:48:17.052422+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:50.565488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.064746+0000","last_change":"2023-10-06T02:48:16.053832+0000","last_active":"2023-10-06T02:48:17.064746+0000","last_peered":"2023-10-06T02:48:17.064746+0000","last_clean":"2023-10-06T02:48:17.064746+0000","last_became_active":"2023-10-06T02:48:16.053519+0000","last_became_peered":"2023-10-06T02:48:16.053519+0000","last_unstale":"2023-10-06T02:48:17.064746+0000","last_undegraded":"2023-10-06T02:48:17.064746+0000","last_fullsized":"2023-10-06T02:48:17.064746+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:44.295769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.059253+0000","last_change":"2023-10-06T02:48:17.058437+0000","last_active":"2023-10-06T02:48:17.059253+0000","last_peered":"2023-10-06T02:48:17.059253+0000","last_clean":"2023-10-06T02:48:17.059253+0000","last_became_active":"2023-10-06T02:48:17.057862+0000","last_became_peered":"2023-10-06T02:48:17.057862+0000","last_unstale":"2023-10-06T02:48:17.059253+0000","last_undegraded":"2023-10-06T02:48:17.059253+0000","last_fullsized":"2023-10-06T02:48:17.059253+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:10.123365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.065824+0000","last_change":"2023-10-06T02:48:16.056589+0000","last_active":"2023-10-06T02:48:17.065824+0000","last_peered":"2023-10-06T02:48:17.065824+0000","last_clean":"2023-10-06T02:48:17.065824+0000","last_became_active":"2023-10-06T02:48:16.056344+0000","last_became_peered":"2023-10-06T02:48:16.056344+0000","last_unstale":"2023-10-06T02:48:17.065824+0000","last_undegraded":"2023-10-06T02:48:17.065824+0000","last_fullsized":"2023-10-06T02:48:17.065824+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:22.125751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.059285+0000","last_change":"2023-10-06T02:48:17.058788+0000","last_active":"2023-10-06T02:48:17.059285+0000","last_peered":"2023-10-06T02:48:17.059285+0000","last_clean":"2023-10-06T02:48:17.059285+0000","last_became_active":"2023-10-06T02:48:17.058439+0000","last_became_peered":"2023-10-06T02:48:17.058439+0000","last_unstale":"2023-10-06T02:48:17.059285+0000","last_undegraded":"2023-10-06T02:48:17.059285+0000","last_fullsized":"2023-10-06T02:48:17.059285+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:03.583910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.064820+0000","last_change":"2023-10-06T02:48:16.054844+0000","last_active":"2023-10-06T02:48:17.064820+0000","last_peered":"2023-10-06T02:48:17.064820+0000","last_clean":"2023-10-06T02:48:17.064820+0000","last_became_active":"2023-10-06T02:48:16.054624+0000","last_became_peered":"2023-10-06T02:48:16.054624+0000","last_unstale":"2023-10-06T02:48:17.064820+0000","last_undegraded":"2023-10-06T02:48:17.064820+0000","last_fullsized":"2023-10-06T02:48:17.064820+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:43.926157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.057805+0000","last_change":"2023-10-06T02:48:17.057200+0000","last_active":"2023-10-06T02:48:17.057805+0000","last_peered":"2023-10-06T02:48:17.057805+0000","last_clean":"2023-10-06T02:48:17.057805+0000","last_became_active":"2023-10-06T02:48:17.053528+0000","last_became_peered":"2023-10-06T02:48:17.053528+0000","last_unstale":"2023-10-06T02:48:17.057805+0000","last_undegraded":"2023-10-06T02:48:17.057805+0000","last_fullsized":"2023-10-06T02:48:17.057805+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:12.999316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.045765+0000","last_change":"2023-10-06T02:48:16.060423+0000","last_active":"2023-10-06T02:48:17.045765+0000","last_peered":"2023-10-06T02:48:17.045765+0000","last_clean":"2023-10-06T02:48:17.045765+0000","last_became_active":"2023-10-06T02:48:16.059532+0000","last_became_peered":"2023-10-06T02:48:16.059532+0000","last_unstale":"2023-10-06T02:48:17.045765+0000","last_undegraded":"2023-10-06T02:48:17.045765+0000","last_fullsized":"2023-10-06T02:48:17.045765+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:54.787836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.053162+0000","last_change":"2023-10-06T02:48:17.053100+0000","last_active":"2023-10-06T02:48:17.053162+0000","last_peered":"2023-10-06T02:48:17.053162+0000","last_clean":"2023-10-06T02:48:17.053162+0000","last_became_active":"2023-10-06T02:48:17.052867+0000","last_became_peered":"2023-10-06T02:48:17.052867+0000","last_unstale":"2023-10-06T02:48:17.053162+0000","last_undegraded":"2023-10-06T02:48:17.053162+0000","last_fullsized":"2023-10-06T02:48:17.053162+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:52.299380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.052144+0000","last_change":"2023-10-06T02:48:16.052758+0000","last_active":"2023-10-06T02:48:17.052144+0000","last_peered":"2023-10-06T02:48:17.052144+0000","last_clean":"2023-10-06T02:48:17.052144+0000","last_became_active":"2023-10-06T02:48:16.052473+0000","last_became_peered":"2023-10-06T02:48:16.052473+0000","last_unstale":"2023-10-06T02:48:17.052144+0000","last_undegraded":"2023-10-06T02:48:17.052144+0000","last_fullsized":"2023-10-06T02:48:17.052144+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:50.101838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055335+0000","last_change":"2023-10-06T02:48:17.055263+0000","last_active":"2023-10-06T02:48:17.055335+0000","last_peered":"2023-10-06T02:48:17.055335+0000","last_clean":"2023-10-06T02:48:17.055335+0000","last_became_active":"2023-10-06T02:48:17.054984+0000","last_became_peered":"2023-10-06T02:48:17.054984+0000","last_unstale":"2023-10-06T02:48:17.055335+0000","last_undegraded":"2023-10-06T02:48:17.055335+0000","last_fullsized":"2023-10-06T02:48:17.055335+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:57.296415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.064997+0000","last_change":"2023-10-06T02:48:16.057909+0000","last_active":"2023-10-06T02:48:17.064997+0000","last_peered":"2023-10-06T02:48:17.064997+0000","last_clean":"2023-10-06T02:48:17.064997+0000","last_became_active":"2023-10-06T02:48:16.057490+0000","last_became_peered":"2023-10-06T02:48:16.057490+0000","last_unstale":"2023-10-06T02:48:17.064997+0000","last_undegraded":"2023-10-06T02:48:17.064997+0000","last_fullsized":"2023-10-06T02:48:17.064997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:24.691740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.049742+0000","last_change":"2023-10-06T02:48:17.049345+0000","last_active":"2023-10-06T02:48:17.049742+0000","last_peered":"2023-10-06T02:48:17.049742+0000","last_clean":"2023-10-06T02:48:17.049742+0000","last_became_active":"2023-10-06T02:48:17.049117+0000","last_became_peered":"2023-10-06T02:48:17.049117+0000","last_unstale":"2023-10-06T02:48:17.049742+0000","last_undegraded":"2023-10-06T02:48:17.049742+0000","last_fullsized":"2023-10-06T02:48:17.049742+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:51.750415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.064278+0000","last_change":"2023-10-06T02:48:16.059776+0000","last_active":"2023-10-06T02:48:17.064278+0000","last_peered":"2023-10-06T02:48:17.064278+0000","last_clean":"2023-10-06T02:48:17.064278+0000","last_became_active":"2023-10-06T02:48:16.059158+0000","last_became_peered":"2023-10-06T02:48:16.059158+0000","last_unstale":"2023-10-06T02:48:17.064278+0000","last_undegraded":"2023-10-06T02:48:17.064278+0000","last_fullsized":"2023-10-06T02:48:17.064278+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:12.109273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.051271+0000","last_change":"2023-10-06T02:48:17.051206+0000","last_active":"2023-10-06T02:48:17.051271+0000","last_peered":"2023-10-06T02:48:17.051271+0000","last_clean":"2023-10-06T02:48:17.051271+0000","last_became_active":"2023-10-06T02:48:17.050591+0000","last_became_peered":"2023-10-06T02:48:17.050591+0000","last_unstale":"2023-10-06T02:48:17.051271+0000","last_undegraded":"2023-10-06T02:48:17.051271+0000","last_fullsized":"2023-10-06T02:48:17.051271+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:35:44.585005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:48:18.045805+0000","last_change":"2023-10-06T02:48:16.059828+0000","last_active":"2023-10-06T02:48:18.045805+0000","last_peered":"2023-10-06T02:48:18.045805+0000","last_clean":"2023-10-06T02:48:18.045805+0000","last_became_active":"2023-10-06T02:48:16.059078+0000","last_became_peered":"2023-10-06T02:48:16.059078+0000","last_unstale":"2023-10-06T02:48:18.045805+0000","last_undegraded":"2023-10-06T02:48:18.045805+0000","last_fullsized":"2023-10-06T02:48:18.045805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:22.125751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.058208+0000","last_change":"2023-10-06T02:48:17.057913+0000","last_active":"2023-10-06T02:48:17.058208+0000","last_peered":"2023-10-06T02:48:17.058208+0000","last_clean":"2023-10-06T02:48:17.058208+0000","last_became_active":"2023-10-06T02:48:17.052842+0000","last_became_peered":"2023-10-06T02:48:17.052842+0000","last_unstale":"2023-10-06T02:48:17.058208+0000","last_undegraded":"2023-10-06T02:48:17.058208+0000","last_fullsized":"2023-10-06T02:48:17.058208+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:39.946549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.046724+0000","last_change":"2023-10-06T02:48:16.060050+0000","last_active":"2023-10-06T02:48:17.046724+0000","last_peered":"2023-10-06T02:48:17.046724+0000","last_clean":"2023-10-06T02:48:17.046724+0000","last_became_active":"2023-10-06T02:48:16.059579+0000","last_became_peered":"2023-10-06T02:48:16.059579+0000","last_unstale":"2023-10-06T02:48:17.046724+0000","last_undegraded":"2023-10-06T02:48:17.046724+0000","last_fullsized":"2023-10-06T02:48:17.046724+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:38.936420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.052453+0000","last_change":"2023-10-06T02:48:17.052392+0000","last_active":"2023-10-06T02:48:17.052453+0000","last_peered":"2023-10-06T02:48:17.052453+0000","last_clean":"2023-10-06T02:48:17.052453+0000","last_became_active":"2023-10-06T02:48:17.052050+0000","last_became_peered":"2023-10-06T02:48:17.052050+0000","last_unstale":"2023-10-06T02:48:17.052453+0000","last_undegraded":"2023-10-06T02:48:17.052453+0000","last_fullsized":"2023-10-06T02:48:17.052453+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:04.143348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.046278+0000","last_change":"2023-10-06T02:48:16.056329+0000","last_active":"2023-10-06T02:48:17.046278+0000","last_peered":"2023-10-06T02:48:17.046278+0000","last_clean":"2023-10-06T02:48:17.046278+0000","last_became_active":"2023-10-06T02:48:16.056138+0000","last_became_peered":"2023-10-06T02:48:16.056138+0000","last_unstale":"2023-10-06T02:48:17.046278+0000","last_undegraded":"2023-10-06T02:48:17.046278+0000","last_fullsized":"2023-10-06T02:48:17.046278+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:49.555358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.053794+0000","last_change":"2023-10-06T02:48:17.053652+0000","last_active":"2023-10-06T02:48:17.053794+0000","last_peered":"2023-10-06T02:48:17.053794+0000","last_clean":"2023-10-06T02:48:17.053794+0000","last_became_active":"2023-10-06T02:48:17.050878+0000","last_became_peered":"2023-10-06T02:48:17.050878+0000","last_unstale":"2023-10-06T02:48:17.053794+0000","last_undegraded":"2023-10-06T02:48:17.053794+0000","last_fullsized":"2023-10-06T02:48:17.053794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:38.735997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.051279+0000","last_change":"2023-10-06T02:48:16.052779+0000","last_active":"2023-10-06T02:48:17.051279+0000","last_peered":"2023-10-06T02:48:17.051279+0000","last_clean":"2023-10-06T02:48:17.051279+0000","last_became_active":"2023-10-06T02:48:16.052531+0000","last_became_peered":"2023-10-06T02:48:16.052531+0000","last_unstale":"2023-10-06T02:48:17.051279+0000","last_undegraded":"2023-10-06T02:48:17.051279+0000","last_fullsized":"2023-10-06T02:48:17.051279+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:57.817416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.059270+0000","last_change":"2023-10-06T02:48:17.058654+0000","last_active":"2023-10-06T02:48:17.059270+0000","last_peered":"2023-10-06T02:48:17.059270+0000","last_clean":"2023-10-06T02:48:17.059270+0000","last_became_active":"2023-10-06T02:48:17.058120+0000","last_became_peered":"2023-10-06T02:48:17.058120+0000","last_unstale":"2023-10-06T02:48:17.059270+0000","last_undegraded":"2023-10-06T02:48:17.059270+0000","last_fullsized":"2023-10-06T02:48:17.059270+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:01.265631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.048683+0000","last_change":"2023-10-06T02:48:16.048168+0000","last_active":"2023-10-06T02:48:17.048683+0000","last_peered":"2023-10-06T02:48:17.048683+0000","last_clean":"2023-10-06T02:48:17.048683+0000","last_became_active":"2023-10-06T02:48:16.047810+0000","last_became_peered":"2023-10-06T02:48:16.047810+0000","last_unstale":"2023-10-06T02:48:17.048683+0000","last_undegraded":"2023-10-06T02:48:17.048683+0000","last_fullsized":"2023-10-06T02:48:17.048683+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:09.783685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.052729+0000","last_change":"2023-10-06T02:48:17.052449+0000","last_active":"2023-10-06T02:48:17.052729+0000","last_peered":"2023-10-06T02:48:17.052729+0000","last_clean":"2023-10-06T02:48:17.052729+0000","last_became_active":"2023-10-06T02:48:17.052094+0000","last_became_peered":"2023-10-06T02:48:17.052094+0000","last_unstale":"2023-10-06T02:48:17.052729+0000","last_undegraded":"2023-10-06T02:48:17.052729+0000","last_fullsized":"2023-10-06T02:48:17.052729+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:03.583910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.048459+0000","last_change":"2023-10-06T02:48:16.051304+0000","last_active":"2023-10-06T02:48:17.048459+0000","last_peered":"2023-10-06T02:48:17.048459+0000","last_clean":"2023-10-06T02:48:17.048459+0000","last_became_active":"2023-10-06T02:48:16.050841+0000","last_became_peered":"2023-10-06T02:48:16.050841+0000","last_unstale":"2023-10-06T02:48:17.048459+0000","last_undegraded":"2023-10-06T02:48:17.048459+0000","last_fullsized":"2023-10-06T02:48:17.048459+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:26.014223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.050819+0000","last_change":"2023-10-06T02:48:17.050778+0000","last_active":"2023-10-06T02:48:17.050819+0000","last_peered":"2023-10-06T02:48:17.050819+0000","last_clean":"2023-10-06T02:48:17.050819+0000","last_became_active":"2023-10-06T02:48:17.050231+0000","last_became_peered":"2023-10-06T02:48:17.050231+0000","last_unstale":"2023-10-06T02:48:17.050819+0000","last_undegraded":"2023-10-06T02:48:17.050819+0000","last_fullsized":"2023-10-06T02:48:17.050819+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:47.850434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.047349+0000","last_change":"2023-10-06T02:48:16.054712+0000","last_active":"2023-10-06T02:48:17.047349+0000","last_peered":"2023-10-06T02:48:17.047349+0000","last_clean":"2023-10-06T02:48:17.047349+0000","last_became_active":"2023-10-06T02:48:16.054573+0000","last_became_peered":"2023-10-06T02:48:16.054573+0000","last_unstale":"2023-10-06T02:48:17.047349+0000","last_undegraded":"2023-10-06T02:48:17.047349+0000","last_fullsized":"2023-10-06T02:48:17.047349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:51.289251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.060664+0000","last_change":"2023-10-06T02:48:17.060166+0000","last_active":"2023-10-06T02:48:17.060664+0000","last_peered":"2023-10-06T02:48:17.060664+0000","last_clean":"2023-10-06T02:48:17.060664+0000","last_became_active":"2023-10-06T02:48:17.059859+0000","last_became_peered":"2023-10-06T02:48:17.059859+0000","last_unstale":"2023-10-06T02:48:17.060664+0000","last_undegraded":"2023-10-06T02:48:17.060664+0000","last_fullsized":"2023-10-06T02:48:17.060664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:49.726820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.063367+0000","last_change":"2023-10-06T02:48:16.060322+0000","last_active":"2023-10-06T02:48:17.063367+0000","last_peered":"2023-10-06T02:48:17.063367+0000","last_clean":"2023-10-06T02:48:17.063367+0000","last_became_active":"2023-10-06T02:48:16.059890+0000","last_became_peered":"2023-10-06T02:48:16.059890+0000","last_unstale":"2023-10-06T02:48:17.063367+0000","last_undegraded":"2023-10-06T02:48:17.063367+0000","last_fullsized":"2023-10-06T02:48:17.063367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:18.922492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.046351+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:48:17.046351+0000","last_peered":"2023-10-06T02:48:17.046351+0000","last_clean":"2023-10-06T02:48:17.046351+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:48:17.046351+0000","last_undegraded":"2023-10-06T02:48:17.046351+0000","last_fullsized":"2023-10-06T02:48:17.046351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055187+0000","last_change":"2023-10-06T02:48:17.054516+0000","last_active":"2023-10-06T02:48:17.055187+0000","last_peered":"2023-10-06T02:48:17.055187+0000","last_clean":"2023-10-06T02:48:17.055187+0000","last_became_active":"2023-10-06T02:48:17.053918+0000","last_became_peered":"2023-10-06T02:48:17.053918+0000","last_unstale":"2023-10-06T02:48:17.055187+0000","last_undegraded":"2023-10-06T02:48:17.055187+0000","last_fullsized":"2023-10-06T02:48:17.055187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:23.135880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.046268+0000","last_change":"2023-10-06T02:48:16.057999+0000","last_active":"2023-10-06T02:48:17.046268+0000","last_peered":"2023-10-06T02:48:17.046268+0000","last_clean":"2023-10-06T02:48:17.046268+0000","last_became_active":"2023-10-06T02:48:16.057757+0000","last_became_peered":"2023-10-06T02:48:16.057757+0000","last_unstale":"2023-10-06T02:48:17.046268+0000","last_undegraded":"2023-10-06T02:48:17.046268+0000","last_fullsized":"2023-10-06T02:48:17.046268+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:22.240095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.045284+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:48:17.045284+0000","last_peered":"2023-10-06T02:48:17.045284+0000","last_clean":"2023-10-06T02:48:17.045284+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:48:17.045284+0000","last_undegraded":"2023-10-06T02:48:17.045284+0000","last_fullsized":"2023-10-06T02:48:17.045284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.057891+0000","last_change":"2023-10-06T02:48:17.057586+0000","last_active":"2023-10-06T02:48:17.057891+0000","last_peered":"2023-10-06T02:48:17.057891+0000","last_clean":"2023-10-06T02:48:17.057891+0000","last_became_active":"2023-10-06T02:48:17.056907+0000","last_became_peered":"2023-10-06T02:48:17.056907+0000","last_unstale":"2023-10-06T02:48:17.057891+0000","last_undegraded":"2023-10-06T02:48:17.057891+0000","last_fullsized":"2023-10-06T02:48:17.057891+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:03.583910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.043997+0000","last_change":"2023-10-06T02:48:16.059695+0000","last_active":"2023-10-06T02:48:17.043997+0000","last_peered":"2023-10-06T02:48:17.043997+0000","last_clean":"2023-10-06T02:48:17.043997+0000","last_became_active":"2023-10-06T02:48:16.059304+0000","last_became_peered":"2023-10-06T02:48:16.059304+0000","last_unstale":"2023-10-06T02:48:17.043997+0000","last_undegraded":"2023-10-06T02:48:17.043997+0000","last_fullsized":"2023-10-06T02:48:17.043997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:50.370996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.043172+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:48:17.043172+0000","last_peered":"2023-10-06T02:48:17.043172+0000","last_clean":"2023-10-06T02:48:17.043172+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:48:17.043172+0000","last_undegraded":"2023-10-06T02:48:17.043172+0000","last_fullsized":"2023-10-06T02:48:17.043172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.052438+0000","last_change":"2023-10-06T02:48:17.052368+0000","last_active":"2023-10-06T02:48:17.052438+0000","last_peered":"2023-10-06T02:48:17.052438+0000","last_clean":"2023-10-06T02:48:17.052438+0000","last_became_active":"2023-10-06T02:48:17.052099+0000","last_became_peered":"2023-10-06T02:48:17.052099+0000","last_unstale":"2023-10-06T02:48:17.052438+0000","last_undegraded":"2023-10-06T02:48:17.052438+0000","last_fullsized":"2023-10-06T02:48:17.052438+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:40.746465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.047901+0000","last_change":"2023-10-06T02:48:16.047846+0000","last_active":"2023-10-06T02:48:17.047901+0000","last_peered":"2023-10-06T02:48:17.047901+0000","last_clean":"2023-10-06T02:48:17.047901+0000","last_became_active":"2023-10-06T02:48:16.047591+0000","last_became_peered":"2023-10-06T02:48:16.047591+0000","last_unstale":"2023-10-06T02:48:17.047901+0000","last_undegraded":"2023-10-06T02:48:17.047901+0000","last_fullsized":"2023-10-06T02:48:17.047901+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:22.240095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.045837+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:48:17.045837+0000","last_peered":"2023-10-06T02:48:17.045837+0000","last_clean":"2023-10-06T02:48:17.045837+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:48:17.045837+0000","last_undegraded":"2023-10-06T02:48:17.045837+0000","last_fullsized":"2023-10-06T02:48:17.045837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.051249+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:48:17.051249+0000","last_peered":"2023-10-06T02:48:17.051249+0000","last_clean":"2023-10-06T02:48:17.051249+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:48:17.051249+0000","last_undegraded":"2023-10-06T02:48:17.051249+0000","last_fullsized":"2023-10-06T02:48:17.051249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.053351+0000","last_change":"2023-10-06T02:48:17.053282+0000","last_active":"2023-10-06T02:48:17.053351+0000","last_peered":"2023-10-06T02:48:17.053351+0000","last_clean":"2023-10-06T02:48:17.053351+0000","last_became_active":"2023-10-06T02:48:17.052917+0000","last_became_peered":"2023-10-06T02:48:17.052917+0000","last_unstale":"2023-10-06T02:48:17.053351+0000","last_undegraded":"2023-10-06T02:48:17.053351+0000","last_fullsized":"2023-10-06T02:48:17.053351+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:57.660580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.061962+0000","last_change":"2023-10-06T02:48:16.049585+0000","last_active":"2023-10-06T02:48:17.061962+0000","last_peered":"2023-10-06T02:48:17.061962+0000","last_clean":"2023-10-06T02:48:17.061962+0000","last_became_active":"2023-10-06T02:48:16.049391+0000","last_became_peered":"2023-10-06T02:48:16.049391+0000","last_unstale":"2023-10-06T02:48:17.061962+0000","last_undegraded":"2023-10-06T02:48:17.061962+0000","last_fullsized":"2023-10-06T02:48:17.061962+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:26.014223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.051167+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:48:17.051167+0000","last_peered":"2023-10-06T02:48:17.051167+0000","last_clean":"2023-10-06T02:48:17.051167+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:48:17.051167+0000","last_undegraded":"2023-10-06T02:48:17.051167+0000","last_fullsized":"2023-10-06T02:48:17.051167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.057284+0000","last_change":"2023-10-06T02:48:17.057036+0000","last_active":"2023-10-06T02:48:17.057284+0000","last_peered":"2023-10-06T02:48:17.057284+0000","last_clean":"2023-10-06T02:48:17.057284+0000","last_became_active":"2023-10-06T02:48:17.056813+0000","last_became_peered":"2023-10-06T02:48:17.056813+0000","last_unstale":"2023-10-06T02:48:17.057284+0000","last_undegraded":"2023-10-06T02:48:17.057284+0000","last_fullsized":"2023-10-06T02:48:17.057284+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:41.836684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.064467+0000","last_change":"2023-10-06T02:48:16.054391+0000","last_active":"2023-10-06T02:48:17.064467+0000","last_peered":"2023-10-06T02:48:17.064467+0000","last_clean":"2023-10-06T02:48:17.064467+0000","last_became_active":"2023-10-06T02:48:16.054065+0000","last_became_peered":"2023-10-06T02:48:16.054065+0000","last_unstale":"2023-10-06T02:48:17.064467+0000","last_undegraded":"2023-10-06T02:48:17.064467+0000","last_fullsized":"2023-10-06T02:48:17.064467+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:29.503250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.051608+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:48:17.051608+0000","last_peered":"2023-10-06T02:48:17.051608+0000","last_clean":"2023-10-06T02:48:17.051608+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:48:17.051608+0000","last_undegraded":"2023-10-06T02:48:17.051608+0000","last_fullsized":"2023-10-06T02:48:17.051608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055674+0000","last_change":"2023-10-06T02:48:17.055478+0000","last_active":"2023-10-06T02:48:17.055674+0000","last_peered":"2023-10-06T02:48:17.055674+0000","last_clean":"2023-10-06T02:48:17.055674+0000","last_became_active":"2023-10-06T02:48:17.054815+0000","last_became_peered":"2023-10-06T02:48:17.054815+0000","last_unstale":"2023-10-06T02:48:17.055674+0000","last_undegraded":"2023-10-06T02:48:17.055674+0000","last_fullsized":"2023-10-06T02:48:17.055674+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:38.730559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.064353+0000","last_change":"2023-10-06T02:48:16.054220+0000","last_active":"2023-10-06T02:48:17.064353+0000","last_peered":"2023-10-06T02:48:17.064353+0000","last_clean":"2023-10-06T02:48:17.064353+0000","last_became_active":"2023-10-06T02:48:16.053754+0000","last_became_peered":"2023-10-06T02:48:16.053754+0000","last_unstale":"2023-10-06T02:48:17.064353+0000","last_undegraded":"2023-10-06T02:48:17.064353+0000","last_fullsized":"2023-10-06T02:48:17.064353+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:09.113236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.047725+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:48:17.047725+0000","last_peered":"2023-10-06T02:48:17.047725+0000","last_clean":"2023-10-06T02:48:17.047725+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:48:17.047725+0000","last_undegraded":"2023-10-06T02:48:17.047725+0000","last_fullsized":"2023-10-06T02:48:17.047725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.055222+0000","last_change":"2023-10-06T02:48:17.054676+0000","last_active":"2023-10-06T02:48:17.055222+0000","last_peered":"2023-10-06T02:48:17.055222+0000","last_clean":"2023-10-06T02:48:17.055222+0000","last_became_active":"2023-10-06T02:48:17.054260+0000","last_became_peered":"2023-10-06T02:48:17.054260+0000","last_unstale":"2023-10-06T02:48:17.055222+0000","last_undegraded":"2023-10-06T02:48:17.055222+0000","last_fullsized":"2023-10-06T02:48:17.055222+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:16.033530+0000","last_clean_scrub_stamp":"2023-10-06T02:48:16.033530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:25.701870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.048592+0000","last_change":"2023-10-06T02:48:16.051426+0000","last_active":"2023-10-06T02:48:17.048592+0000","last_peered":"2023-10-06T02:48:17.048592+0000","last_clean":"2023-10-06T02:48:17.048592+0000","last_became_active":"2023-10-06T02:48:16.051241+0000","last_became_peered":"2023-10-06T02:48:16.051241+0000","last_unstale":"2023-10-06T02:48:17.048592+0000","last_undegraded":"2023-10-06T02:48:17.048592+0000","last_fullsized":"2023-10-06T02:48:17.048592+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:48:15.023400+0000","last_clean_scrub_stamp":"2023-10-06T02:48:15.023400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:48.716690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:48:17.048711+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:48:17.048711+0000","last_peered":"2023-10-06T02:48:17.048711+0000","last_clean":"2023-10-06T02:48:17.048711+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:48:17.048711+0000","last_undegraded":"2023-10-06T02:48:17.048711+0000","last_fullsized":"2023-10-06T02:48:17.048711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":924,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194388,"statfs":{"total":200000000,"available":199053476,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52800000000000002,"15min":0.53100000000000003},"min":{"1min":0.33100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.80600000000000005,"5min":1.393,"15min":1.393},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40200000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.65000000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.497,"15min":0.495},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76400000000000001,"5min":1.081,"15min":1.081},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.311,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83999999999999997,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.8129999999999997,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.621}]},{"osd":3,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.0649999999999999,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59299999999999997},"min":{"1min":0.40999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97899999999999998,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.45500000000000002},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.372},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.621,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71599999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.45700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644558,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68400000000000005,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":1.879,"15min":1.879},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73899999999999999,"5min":0.874,"15min":0.874},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":1.0309999999999999,"15min":1.111},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.80000000000000004,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68999999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69099999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.58999999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83399999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76300000000000001,"5min":1.163,"15min":1.163},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.56699999999999995,"15min":0.58099999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72699999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:48:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.747,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.47399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194963,"statfs":{"total":200000000,"available":199642320,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.28199999999999997,"5min":0.30599999999999999,"15min":0.31},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.373,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.32100000000000001,"15min":0.32300000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.42499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.313,"15min":0.315},"min":{"1min":0.23699999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.248},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.36199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.42799999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.32600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.308,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.46700000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.372},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.246,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.441,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.27700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.36099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65700000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76000000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.443}]},{"osd":6,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69299999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.436},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79100000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73999999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.749,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":923,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194388,"statfs":{"total":200000000,"available":199054224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34799999999999998,"15min":0.35199999999999998},"min":{"1min":0.219,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":1.177,"15min":1.177},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.39800000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55700000000000005,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.28199999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":1.177,"15min":1.321},"min":{"1min":0.21099999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.439,"5min":22.038,"15min":22.038},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48799999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.23699999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.52800000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.224},{"interface":"front","average":{"1min":0.36799999999999999,"5min":1.208,"15min":1.3480000000000001},"min":{"1min":0.27900000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.54500000000000004,"5min":21.942,"15min":21.942},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72199999999999998,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":1.258,"15min":1.3799999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":1.361,"15min":1.4970000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80200000000000005,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.501},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":1.401,"15min":1.401},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.29,"15min":1.411},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85999999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":1.389,"15min":1.5269999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84799999999999998,"5min":21.98,"15min":21.98},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":1.425,"15min":1.425},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.96299999999999997,"15min":1.026},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81799999999999995,"5min":11.154,"15min":11.154},"last":0.60099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.245},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.312}]},{"osd":1,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.34899999999999998,"15min":0.35099999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.379,"15min":0.377},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.27900000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36599999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64200000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54800000000000004,"15min":0.55800000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71199999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.874,"15min":0.874},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77200000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.754},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.23200000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.317,"15min":0.315},"min":{"1min":0.24099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.41699999999999998,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.245}]},{"osd":1,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32000000000000001,"15min":0.31900000000000001},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.39700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.27000000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.40600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.23100000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.434,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78100000000000003,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72499999999999998,"5min":2.25,"15min":2.25},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.70099999999999996,"15min":0.72699999999999998},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.438,"5min":0.373,"15min":0.373},"max":{"1min":0.749,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.44500000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":1.002,"15min":1.071},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.442}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":348,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194963,"statfs":{"total":200000000,"available":199643056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.83899999999999997,"15min":0.89400000000000002},"min":{"1min":0.38700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70599999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.64300000000000002,"15min":0.66800000000000004},"min":{"1min":0.38700000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.64500000000000002,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.81699999999999995,"15min":0.86599999999999999},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.65000000000000002,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64500000000000002,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.47199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67000000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.51200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65100000000000002,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.495},{"interface":"front","average":{"1min":0.502,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65900000000000003,"5min":3.456,"15min":3.456},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.68999999999999995,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70099999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.62},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.1699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73899999999999999,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644570,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.752,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.502}]},{"osd":1,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76600000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.38},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.622},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.38900000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64300000000000002}]}]}],"pool_statfs":[]}} 2023-10-06T02:48:21.789 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:48:21.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:48:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.941+0000 7efe8dde8700 1 Processor -- start 2023-10-06T02:48:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.941+0000 7efe8dde8700 1 -- start start 2023-10-06T02:48:21.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.941+0000 7efe8dde8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efe8806f4f0 0x7efe880b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.941+0000 7efe8dde8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe88068d40 con 0x7efe880b1ef0 2023-10-06T02:48:21.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.941+0000 7efe8dde8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8806a1e0 con 0x7efe880b2800 2023-10-06T02:48:21.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.941+0000 7efe8dde8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8815a520 con 0x7efe8806f4f0 2023-10-06T02:48:21.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe8cde6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efe880b1ef0 0x7efe8806da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41644/0 (socket says 172.21.15.81:41644) 2023-10-06T02:48:21.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe8cde6700 1 -- 172.21.15.81:0/797362417 learned_addr learned my addr 172.21.15.81:0/797362417 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:21.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe87fff700 1 --2- 172.21.15.81:0/797362417 >> v2:172.21.15.83:3300/0 conn(0x7efe8806f4f0 0x7efe880b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146401777 0 0) 0x7efe88068d40 con 0x7efe880b1ef0 2023-10-06T02:48:21.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe74003570 con 0x7efe880b1ef0 2023-10-06T02:48:21.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920843979 0 0) 0x7efe74003570 con 0x7efe880b1ef0 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 >> v2:172.21.15.83:3300/0 conn(0x7efe8806f4f0 msgr2=0x7efe880b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 --2- 172.21.15.81:0/797362417 >> v2:172.21.15.83:3300/0 conn(0x7efe8806f4f0 0x7efe880b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 >> v1:172.21.15.83:6789/0 conn(0x7efe880b2800 legacy=0x7efe88163bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8806e2d0 con 0x7efe880b1ef0 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7efe78001470 con 0x7efe880b1ef0 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe87fff700 1 --2- 172.21.15.81:0/797362417 >> v2:172.21.15.83:3300/0 conn(0x7efe8806f4f0 0x7efe880b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 >> v1:172.21.15.81:6789/0 conn(0x7efe880b1ef0 legacy=0x7efe8806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe74003a60 0x7efe74003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe74004810 0x7efe74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe740051c0 0x7efe7400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8815a520 con 0x7efe740051c0 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7400c0d0 con 0x7efe74004810 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7400c290 con 0x7efe74003a60 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe8d5e7700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe740051c0 0x7efe7400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe8cde6700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe74003a60 0x7efe74003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.942+0000 7efe87fff700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe74004810 0x7efe74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8d5e7700 1 -- 172.21.15.81:0/797362417 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe74003a60 msgr2=0x7efe74003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8d5e7700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe74003a60 0x7efe74003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8d5e7700 1 -- 172.21.15.81:0/797362417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe74004810 msgr2=0x7efe74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8d5e7700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe74004810 0x7efe74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8d5e7700 1 -- 172.21.15.81:0/797362417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74003570 con 0x7efe740051c0 2023-10-06T02:48:21.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe87fff700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe74004810 0x7efe74004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:21.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8d5e7700 1 -- 172.21.15.81:0/797362417 reap_dead start 2023-10-06T02:48:21.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8d5e7700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe740051c0 0x7efe7400ba60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7efe80001fc0 tx=0x7efe80001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18973da88080624 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:21.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80001950 con 0x7efe740051c0 2023-10-06T02:48:21.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8000c8b0 con 0x7efe740051c0 2023-10-06T02:48:21.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe877fe700 1 -- 172.21.15.81:0/797362417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8000cc50 con 0x7efe740051c0 2023-10-06T02:48:21.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8dde8700 1 -- 172.21.15.81:0/797362417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe740051c0 msgr2=0x7efe7400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8dde8700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe740051c0 0x7efe7400ba60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7efe80001fc0 tx=0x7efe80001640 comp rx=0 tx=0).stop 2023-10-06T02:48:21.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8dde8700 1 -- 172.21.15.81:0/797362417 shutdown_connections 2023-10-06T02:48:21.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8dde8700 1 --2- 172.21.15.81:0/797362417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe740051c0 0x7efe7400ba60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.943+0000 7efe8dde8700 1 -- 172.21.15.81:0/797362417 >> 172.21.15.81:0/797362417 conn(0x7efe880d0bb0 msgr2=0x7efe880d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:21.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.944+0000 7efe8dde8700 1 -- 172.21.15.81:0/797362417 shutdown_connections 2023-10-06T02:48:21.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.944+0000 7efe8dde8700 1 -- 172.21.15.81:0/797362417 wait complete. 2023-10-06T02:48:21.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.945+0000 7efe8dde8700 1 Processor -- start 2023-10-06T02:48:21.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.945+0000 7efe8dde8700 1 -- start start 2023-10-06T02:48:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8dde8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe740051c0 0x7efe8808ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8dde8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88156af0 0x7efe880d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8dde8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88156f60 0x7efe880d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8dde8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe88157e00 con 0x7efe88156f60 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8dde8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8815a660 con 0x7efe740051c0 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8dde8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8815a900 con 0x7efe88156af0 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8d5e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88156f60 0x7efe880d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8d5e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88156f60 0x7efe880d14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38462/0 (socket says 172.21.15.81:38462) 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8d5e7700 1 -- 172.21.15.81:0/2631674284 learned_addr learned my addr 172.21.15.81:0/2631674284 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8cde6700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe740051c0 0x7efe8808ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe87fff700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88156af0 0x7efe880d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8d5e7700 1 -- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88156af0 msgr2=0x7efe880d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8d5e7700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88156af0 0x7efe880d0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8d5e7700 1 -- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe740051c0 msgr2=0x7efe8808ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8d5e7700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe740051c0 0x7efe8808ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8d5e7700 1 -- 172.21.15.81:0/2631674284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8815abe0 con 0x7efe88156f60 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8d5e7700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88156f60 0x7efe880d14c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efe88065630 tx=0x7efe80015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe84ff9700 1 -- 172.21.15.81:0/2631674284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80001950 con 0x7efe88156f60 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe84ff9700 1 -- 172.21.15.81:0/2631674284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8000c6d0 con 0x7efe88156f60 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8815aec0 con 0x7efe88156f60 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe84ff9700 1 -- 172.21.15.81:0/2631674284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80006df0 con 0x7efe88156f60 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.946+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8815b480 con 0x7efe88156f60 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.947+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe88067b70 con 0x7efe88156f60 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.948+0000 7efe84ff9700 1 -- 172.21.15.81:0/2631674284 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe800263b0 con 0x7efe88156f60 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.948+0000 7efe84ff9700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe68066f30 0x7efe680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.948+0000 7efe84ff9700 1 -- 172.21.15.81:0/2631674284 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efe800852c0 con 0x7efe88156f60 2023-10-06T02:48:21.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.948+0000 7efe8cde6700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe68066f30 0x7efe680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:21.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.949+0000 7efe8cde6700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe68066f30 0x7efe680693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efe78007f50 tx=0x7efe78001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:21.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:21.952+0000 7efe84ff9700 1 -- 172.21.15.81:0/2631674284 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe800523d0 con 0x7efe88156f60 2023-10-06T02:48:22.020 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-06T02:48:22.019+0000 7f390bc79700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:48:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.208+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7efe8815a0b0 con 0x7efe88156f60 2023-10-06T02:48:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.212+0000 7efe84ff9700 1 -- 172.21.15.81:0/2631674284 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7efe800220e0 con 0x7efe88156f60 2023-10-06T02:48:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe68066f30 msgr2=0x7efe680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe68066f30 0x7efe680693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efe78007f50 tx=0x7efe78001e50 comp rx=0 tx=0).stop 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88156f60 msgr2=0x7efe880d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88156f60 0x7efe880d14c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efe88065630 tx=0x7efe80015000 comp rx=0 tx=0).stop 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 shutdown_connections 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe88156f60 0x7efe880d14c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe68066f30 0x7efe680693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe740051c0 0x7efe8808ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 --2- 172.21.15.81:0/2631674284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efe88156af0 0x7efe880d0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 >> 172.21.15.81:0/2631674284 conn(0x7efe880d0bb0 msgr2=0x7efe880cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 shutdown_connections 2023-10-06T02:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.214+0000 7efe8dde8700 1 -- 172.21.15.81:0/2631674284 wait complete. 2023-10-06T02:48:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:48:22.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:48:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.339+0000 7fe258882700 1 Processor -- start 2023-10-06T02:48:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.339+0000 7fe258882700 1 -- start start 2023-10-06T02:48:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.340+0000 7fe258882700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe254159b40 0x7fe2540cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.340+0000 7fe258882700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254068e90 0x7fe2540cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.340+0000 7fe258882700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540cee10 con 0x7fe254159f10 2023-10-06T02:48:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.340+0000 7fe258882700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2540cd040 con 0x7fe254159b40 2023-10-06T02:48:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.340+0000 7fe258882700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540cd320 con 0x7fe254068e90 2023-10-06T02:48:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.340+0000 7fe252d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe254159b40 0x7fe2540cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.340+0000 7fe24a59c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe254159f10 0x7fe254068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:34962/0 (socket says 172.21.15.81:34962) 2023-10-06T02:48:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.340+0000 7fe24a59c700 1 -- 172.21.15.81:0/3634371296 learned_addr learned my addr 172.21.15.81:0/3634371296 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.340+0000 7fe25359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254068e90 0x7fe2540cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe252d9d700 1 -- 172.21.15.81:0/3634371296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254068e90 msgr2=0x7fe2540cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe252d9d700 1 --2- 172.21.15.81:0/3634371296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254068e90 0x7fe2540cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe252d9d700 1 -- 172.21.15.81:0/3634371296 >> v1:172.21.15.83:6789/0 conn(0x7fe254159f10 legacy=0x7fe254068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe252d9d700 1 -- 172.21.15.81:0/3634371296 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540ce7c0 con 0x7fe254159b40 2023-10-06T02:48:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe252d9d700 1 --2- 172.21.15.81:0/3634371296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe254159b40 0x7fe2540cc600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe2440098e0 tx=0x7fe2440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc6a71806edd65b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe25259c700 1 -- 172.21.15.81:0/3634371296 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24400b640 con 0x7fe254159b40 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe25259c700 1 -- 172.21.15.81:0/3634371296 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24400b7a0 con 0x7fe254159b40 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe25259c700 1 -- 172.21.15.81:0/3634371296 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24400bb40 con 0x7fe254159b40 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe258882700 1 -- 172.21.15.81:0/3634371296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe254159b40 msgr2=0x7fe2540cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe258882700 1 --2- 172.21.15.81:0/3634371296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe254159b40 0x7fe2540cc600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe2440098e0 tx=0x7fe2440091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe258882700 1 -- 172.21.15.81:0/3634371296 shutdown_connections 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe258882700 1 --2- 172.21.15.81:0/3634371296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254068e90 0x7fe2540cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe258882700 1 --2- 172.21.15.81:0/3634371296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe254159b40 0x7fe2540cc600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe258882700 1 -- 172.21.15.81:0/3634371296 >> 172.21.15.81:0/3634371296 conn(0x7fe2540cd660 msgr2=0x7fe2540cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe258882700 1 -- 172.21.15.81:0/3634371296 shutdown_connections 2023-10-06T02:48:22.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.341+0000 7fe258882700 1 -- 172.21.15.81:0/3634371296 wait complete. 2023-10-06T02:48:22.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.343+0000 7fe258882700 1 Processor -- start 2023-10-06T02:48:22.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.343+0000 7fe258882700 1 -- start start 2023-10-06T02:48:22.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.343+0000 7fe258882700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe254068e90 0x7fe2540ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:22.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.343+0000 7fe258882700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254159b40 0x7fe25416b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:22.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.343+0000 7fe258882700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe254159f10 0x7fe25416dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:22.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.343+0000 7fe258882700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe254158000 con 0x7fe254068e90 2023-10-06T02:48:22.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.343+0000 7fe258882700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25415cc70 con 0x7fe254159f10 2023-10-06T02:48:22.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.343+0000 7fe258882700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2541579b0 con 0x7fe254159b40 2023-10-06T02:48:22.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.343+0000 7fe252d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe254068e90 0x7fe2540ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:22.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe252d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe254068e90 0x7fe2540ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38464/0 (socket says 172.21.15.81:38464) 2023-10-06T02:48:22.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe252d9d700 1 -- 172.21.15.81:0/3819948060 learned_addr learned my addr 172.21.15.81:0/3819948060 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:22.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe25359e700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe254159f10 0x7fe25416dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:22.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe24a59c700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254159b40 0x7fe25416b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:22.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe252d9d700 1 -- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254159b40 msgr2=0x7fe25416b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:22.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe252d9d700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254159b40 0x7fe25416b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe252d9d700 1 -- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe254159f10 msgr2=0x7fe25416dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:22.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe252d9d700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe254159f10 0x7fe25416dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe252d9d700 1 -- 172.21.15.81:0/3819948060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244009420 con 0x7fe254068e90 2023-10-06T02:48:22.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe252d9d700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe254068e90 0x7fe2540ca7f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe25406fe10 tx=0x7fe244017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:22.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe24b7fe700 1 -- 172.21.15.81:0/3819948060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24401bc40 con 0x7fe254068e90 2023-10-06T02:48:22.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe24b7fe700 1 -- 172.21.15.81:0/3819948060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24401bdc0 con 0x7fe254068e90 2023-10-06T02:48:22.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe254157c90 con 0x7fe254068e90 2023-10-06T02:48:22.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe24b7fe700 1 -- 172.21.15.81:0/3819948060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244011670 con 0x7fe254068e90 2023-10-06T02:48:22.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.344+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25416e2a0 con 0x7fe254068e90 2023-10-06T02:48:22.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.345+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2540cb910 con 0x7fe254068e90 2023-10-06T02:48:22.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.345+0000 7fe24b7fe700 1 -- 172.21.15.81:0/3819948060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe244011a20 con 0x7fe254068e90 2023-10-06T02:48:22.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.346+0000 7fe24b7fe700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe234066f30 0x7fe2340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:22.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.346+0000 7fe24b7fe700 1 -- 172.21.15.81:0/3819948060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe244085c10 con 0x7fe254068e90 2023-10-06T02:48:22.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.346+0000 7fe24a59c700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe234066f30 0x7fe2340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:22.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.346+0000 7fe24a59c700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe234066f30 0x7fe2340693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe2540b2f70 tx=0x7fe23c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:22.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.350+0000 7fe24b7fe700 1 -- 172.21.15.81:0/3819948060 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe244052d20 con 0x7fe254068e90 2023-10-06T02:48:22.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.574+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2540ceaa0 con 0x7fe254068e90 2023-10-06T02:48:22.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.574+0000 7fe24b7fe700 1 -- 172.21.15.81:0/3819948060 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fe244056340 con 0x7fe254068e90 2023-10-06T02:48:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:22.576 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1289364984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1289364984},{"type":"v1","addr":"172.21.15.83:6836","nonce":1289364984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3185368649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3185368649},{"type":"v1","addr":"172.21.15.83:6837","nonce":3185368649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5817,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/869401920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":869401920},{"type":"v1","addr":"172.21.15.81:6834","nonce":869401920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:48:16.417708+0000","modified":"2023-10-06T02:48:20.372496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2518286030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2518286030},{"type":"v1","addr":"172.21.15.81:6835","nonce":2518286030}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:48:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe234066f30 msgr2=0x7fe2340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe234066f30 0x7fe2340693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe2540b2f70 tx=0x7fe23c009040 comp rx=0 tx=0).stop 2023-10-06T02:48:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe254068e90 msgr2=0x7fe2540ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe254068e90 0x7fe2540ca7f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe25406fe10 tx=0x7fe244017000 comp rx=0 tx=0).stop 2023-10-06T02:48:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 shutdown_connections 2023-10-06T02:48:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe234066f30 0x7fe2340693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe254159f10 0x7fe25416dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe254068e90 0x7fe2540ca7f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 --2- 172.21.15.81:0/3819948060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe254159b40 0x7fe25416b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.576+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 >> 172.21.15.81:0/3819948060 conn(0x7fe2540cd660 msgr2=0x7fe25406d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.577+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 shutdown_connections 2023-10-06T02:48:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:22.577+0000 7fe258882700 1 -- 172.21.15.81:0/3819948060 wait complete. 2023-10-06T02:48:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2023-10-06T02:48:22.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:48:16.417708+0000', 'modified': '2023-10-06T02:48:20.372496+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5820}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5820': {'gid': 5820, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/2518286030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 2518286030}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2518286030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:48:22.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:48:22.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:48:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.108+0000 7f4c151ef700 1 Processor -- start 2023-10-06T02:48:23.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.108+0000 7f4c151ef700 1 -- start start 2023-10-06T02:48:23.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.109+0000 7f4c151ef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c100b3bd0 0x7f4c100ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.109+0000 7f4c151ef700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c100b2890 con 0x7f4c101583b0 2023-10-06T02:48:23.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.109+0000 7f4c151ef700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c100b4070 con 0x7f4c10157fe0 2023-10-06T02:48:23.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.109+0000 7f4c151ef700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c100b4350 con 0x7f4c100b3bd0 2023-10-06T02:48:23.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.109+0000 7f4c0659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c100b3bd0 0x7f4c100ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.109+0000 7f4c0f59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4c101583b0 0x7f4c10158bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41650/0 (socket says 172.21.15.81:41650) 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.109+0000 7f4c0659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c100b3bd0 0x7f4c100ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38466/0 (socket says 172.21.15.81:38466) 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.109+0000 7f4c0f59e700 1 -- 172.21.15.81:0/4250943388 learned_addr learned my addr 172.21.15.81:0/4250943388 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c0659c700 1 -- 172.21.15.81:0/4250943388 >> v1:172.21.15.83:6789/0 conn(0x7f4c10157fe0 legacy=0x7f4c100b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c0659c700 1 -- 172.21.15.81:0/4250943388 >> v1:172.21.15.81:6789/0 conn(0x7f4c101583b0 legacy=0x7f4c10158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c0659c700 1 -- 172.21.15.81:0/4250943388 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100b4630 con 0x7f4c100b3bd0 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c0e59c700 1 -- 172.21.15.81:0/4250943388 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168113467 0 0) 0x7f4c100b2890 con 0x7f4c101583b0 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c0659c700 1 --2- 172.21.15.81:0/4250943388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c100b3bd0 0x7f4c100ceb30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80098e0 tx=0x7f4bf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a2bc11b14aef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c0e59c700 1 -- 172.21.15.81:0/4250943388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8009e80 con 0x7f4c100b3bd0 2023-10-06T02:48:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c0e59c700 1 -- 172.21.15.81:0/4250943388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf800b860 con 0x7f4c100b3bd0 2023-10-06T02:48:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c0e59c700 1 -- 172.21.15.81:0/4250943388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf800bbe0 con 0x7f4c100b3bd0 2023-10-06T02:48:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c151ef700 1 -- 172.21.15.81:0/4250943388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c100b3bd0 msgr2=0x7f4c100ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c151ef700 1 --2- 172.21.15.81:0/4250943388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c100b3bd0 0x7f4c100ceb30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80098e0 tx=0x7f4bf80091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c151ef700 1 -- 172.21.15.81:0/4250943388 shutdown_connections 2023-10-06T02:48:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c151ef700 1 --2- 172.21.15.81:0/4250943388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c100b3bd0 0x7f4c100ceb30 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.110+0000 7f4c151ef700 1 -- 172.21.15.81:0/4250943388 >> 172.21.15.81:0/4250943388 conn(0x7f4c10067640 msgr2=0x7f4c10067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.111+0000 7f4c151ef700 1 -- 172.21.15.81:0/4250943388 shutdown_connections 2023-10-06T02:48:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.111+0000 7f4c151ef700 1 -- 172.21.15.81:0/4250943388 wait complete. 2023-10-06T02:48:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.112+0000 7f4c151ef700 1 Processor -- start 2023-10-06T02:48:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.112+0000 7f4c151ef700 1 -- start start 2023-10-06T02:48:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.112+0000 7f4c151ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c100b3bd0 0x7f4c101426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.112+0000 7f4c151ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c10157fe0 0x7f4c100c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.112+0000 7f4c151ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c101583b0 0x7f4c100c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c151ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c100c3940 con 0x7f4c101583b0 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c151ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c100c3c20 con 0x7f4c100b3bd0 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c151ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c100c3f00 con 0x7f4c10157fe0 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c101583b0 0x7f4c100c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c101583b0 0x7f4c100c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38468/0 (socket says 172.21.15.81:38468) 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0f59e700 1 -- 172.21.15.81:0/23466847 learned_addr learned my addr 172.21.15.81:0/23466847 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c100b3bd0 0x7f4c101426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0659c700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c10157fe0 0x7f4c100c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0f59e700 1 -- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c10157fe0 msgr2=0x7f4c100c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c10157fe0 0x7f4c100c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0f59e700 1 -- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c100b3bd0 msgr2=0x7f4c101426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c100b3bd0 0x7f4c101426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0f59e700 1 -- 172.21.15.81:0/23466847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8009420 con 0x7f4c101583b0 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c100b3bd0 0x7f4c101426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0659c700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c10157fe0 0x7f4c100c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c101583b0 0x7f4c100c67c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800cc90 tx=0x7f4c08001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c077fe700 1 -- 172.21.15.81:0/23466847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800cea0 con 0x7f4c101583b0 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c077fe700 1 -- 172.21.15.81:0/23466847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0800ab70 con 0x7f4c101583b0 2023-10-06T02:48:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c151ef700 1 -- 172.21.15.81:0/23466847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c100c41e0 con 0x7f4c101583b0 2023-10-06T02:48:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c077fe700 1 -- 172.21.15.81:0/23466847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c080070f0 con 0x7f4c101583b0 2023-10-06T02:48:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.113+0000 7f4c151ef700 1 -- 172.21.15.81:0/23466847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c10142c20 con 0x7f4c101583b0 2023-10-06T02:48:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.115+0000 7f4c077fe700 1 -- 172.21.15.81:0/23466847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c080074a0 con 0x7f4c101583b0 2023-10-06T02:48:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.115+0000 7f4c077fe700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4bf0066f30 0x7f4bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.115+0000 7f4c077fe700 1 -- 172.21.15.81:0/23466847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4c08084b10 con 0x7f4c101583b0 2023-10-06T02:48:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.115+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4bf0066f30 0x7f4bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.116+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4bf0066f30 0x7f4bf00693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c00002880 tx=0x7f4c00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.117+0000 7f4c1e4e7b80 1 Processor -- start 2023-10-06T02:48:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.117+0000 7f4c1e4e7b80 1 -- start start 2023-10-06T02:48:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519b68c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 0x563519bb86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 0x563519bb9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563519abfa70 con 0x563519b68840 2023-10-06T02:48:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x563519abd270 con 0x563519bb8c00 2023-10-06T02:48:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x563519ab9060 con 0x563519b69cc0 2023-10-06T02:48:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519b68c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519b68c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38484/0 (socket says 172.21.15.81:38484) 2023-10-06T02:48:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0ed9d700 1 -- 172.21.15.81:0/3597946071 learned_addr learned my addr 172.21.15.81:0/3597946071 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/3597946071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 0x563519bb9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0659c700 1 --2- 172.21.15.81:0/3597946071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 0x563519bb86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0ed9d700 1 -- 172.21.15.81:0/3597946071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 msgr2=0x563519bb86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/3597946071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 0x563519bb86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0ed9d700 1 -- 172.21.15.81:0/3597946071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 msgr2=0x563519bb9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/3597946071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 0x563519bb9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0ed9d700 1 -- 172.21.15.81:0/3597946071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563519953270 con 0x563519b68840 2023-10-06T02:48:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/3597946071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519b68c10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000dad0 tx=0x7f4c00014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0acc4881a85bd70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.118+0000 7f4beffff700 1 -- 172.21.15.81:0/3597946071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0000de90 con 0x563519b68840 2023-10-06T02:48:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4beffff700 1 -- 172.21.15.81:0/3597946071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c00014ac0 con 0x563519b68840 2023-10-06T02:48:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4beffff700 1 -- 172.21.15.81:0/3597946071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00014e60 con 0x563519b68840 2023-10-06T02:48:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3597946071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 msgr2=0x563519b68c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3597946071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519b68c10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000dad0 tx=0x7f4c00014000 comp rx=0 tx=0).stop 2023-10-06T02:48:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3597946071 shutdown_connections 2023-10-06T02:48:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3597946071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 0x563519bb9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3597946071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519b68c10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3597946071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 0x563519bb86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3597946071 >> 172.21.15.81:0/3597946071 conn(0x563519b6a160 msgr2=0x563519b6a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3597946071 shutdown_connections 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.119+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3597946071 wait complete. 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.120+0000 7f4c1e4e7b80 1 -- start start 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.120+0000 7f4c1e4e7b80 1 Processor -- start 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 0x563519b91ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 0x563519bb17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b63a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563519a64890 con 0x563519bb8c00 2023-10-06T02:48:23.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x563519a7fea0 con 0x563519b69cc0 2023-10-06T02:48:23.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x56351993be30 con 0x563519b68840 2023-10-06T02:48:23.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c1e4e7b80 10 client.0 _ll_register_callbacks cb 0x563519b2be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:48:23.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b63a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b63a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38490/0 (socket says 172.21.15.81:38490) 2023-10-06T02:48:23.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0f59e700 1 -- 172.21.15.81:0/3617816242 learned_addr learned my addr 172.21.15.81:0/3617816242 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:23.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 0x563519b91ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0659c700 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 0x563519bb17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0f59e700 1 -- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 msgr2=0x563519b91ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 0x563519b91ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0f59e700 1 -- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 msgr2=0x563519bb17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 0x563519bb17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0f59e700 1 -- 172.21.15.81:0/3617816242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0000d690 con 0x563519bb8c00 2023-10-06T02:48:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0659c700 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 0x563519bb17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 0x563519b91ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b63a10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4c08051e60 tx=0x7f4c08014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bb89c5c7b83c69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.121+0000 7f4bed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:48:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4bed7fa700 1 -- 172.21.15.81:0/3617816242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0805c980 con 0x563519bb8c00 2023-10-06T02:48:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4bed7fa700 1 -- 172.21.15.81:0/3617816242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4c08054e50 con 0x563519bb8c00 2023-10-06T02:48:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3617816242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563519b5d940 con 0x563519bb8c00 2023-10-06T02:48:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4bed7fa700 1 -- 172.21.15.81:0/3617816242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c0805c470 con 0x563519bb8c00 2023-10-06T02:48:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c1e4e7b80 10 client.5964 fetch_fsmap learned FSMap version 34 2023-10-06T02:48:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3617816242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x5635198f5fe0 con 0x563519bb8c00 2023-10-06T02:48:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4bed7fa700 1 -- 172.21.15.81:0/3617816242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08064080 con 0x563519bb8c00 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4bed7fa700 1 -- 172.21.15.81:0/3617816242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4c0801ac10 con 0x563519bb8c00 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c1e4e7b80 10 client.5964 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c1e4e7b80 10 client.5964 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c1e4e7b80 20 client.5964 populate_metadata read hostname 'smithi081' 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] conn(0x563519ba7e60 0x563519ba8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c1e4e7b80 4 client.5964 mds_command: new command op to 5820 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3617816242 --> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563519b3a870 con 0x563519ba7e60 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] conn(0x563519ba7e60 0x563519ba8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4bed7fa700 10 client.5964 ms_handle_connect on v2:172.21.15.81:6833/2518286030 2023-10-06T02:48:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.122+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] conn(0x563519ba7e60 0x563519ba8230 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549d83f0900d9269 server_cookie=4ccbbeeb759907f2 in_seq=0 out_seq=0 2023-10-06T02:48:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4bed7fa700 1 -- 172.21.15.81:0/3617816242 <== mds.0 v2:172.21.15.81:6833/2518286030 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563519b3a870 con 0x563519ba7e60 2023-10-06T02:48:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4bed7fa700 10 client.5964 handle_command_reply: tid=0 2023-10-06T02:48:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 client.5964 shutdown 2023-10-06T02:48:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3617816242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 msgr2=0x563519b63a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b63a10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4c08051e60 tx=0x7f4c08014040 comp rx=0 tx=0).stop 2023-10-06T02:48:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3617816242 shutdown_connections 2023-10-06T02:48:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] conn(0x563519ba7e60 0x563519ba8230 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b63a10 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 0x563519b91ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/3617816242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 0x563519bb17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4bed7fa700 0 client.5964 ms_handle_reset on v2:172.21.15.81:6833/2518286030 2023-10-06T02:48:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3617816242 >> 172.21.15.81:0/3617816242 conn(0x563519b6a160 msgr2=0x563519babfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3617816242 shutdown_connections 2023-10-06T02:48:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/3617816242 wait complete. 2023-10-06T02:48:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.123+0000 7f4c1e4e7b80 20 client.5964 trim_cache size 0 max 16384 2023-10-06T02:48:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.140+0000 7f4c1e4e7b80 1 Processor -- start 2023-10-06T02:48:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.140+0000 7f4c1e4e7b80 1 -- start start 2023-10-06T02:48:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.140+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 0x563519b69550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.140+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 0x563519bac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b907b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563519bd1a50 con 0x563519bb8c00 2023-10-06T02:48:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x563519b666d0 con 0x563519b69cc0 2023-10-06T02:48:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x563519b926c0 con 0x563519b68840 2023-10-06T02:48:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b907b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38502/0 (socket says 172.21.15.81:38502) 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0f59e700 1 -- 172.21.15.81:0/1814096412 learned_addr learned my addr 172.21.15.81:0/1814096412 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0659c700 1 --2- 172.21.15.81:0/1814096412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 0x563519bac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/1814096412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 0x563519b69550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0f59e700 1 -- 172.21.15.81:0/1814096412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 msgr2=0x563519b69550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/1814096412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 0x563519b69550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0f59e700 1 -- 172.21.15.81:0/1814096412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 msgr2=0x563519bac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/1814096412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 0x563519bac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0f59e700 1 -- 172.21.15.81:0/1814096412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563519a87780 con 0x563519bb8c00 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/1814096412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b907b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4c08055660 tx=0x7f4c08080000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4383b3fbe965b16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c04d99700 1 -- 172.21.15.81:0/1814096412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0805c470 con 0x563519bb8c00 2023-10-06T02:48:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c04d99700 1 -- 172.21.15.81:0/1814096412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08064070 con 0x563519bb8c00 2023-10-06T02:48:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.141+0000 7f4c04d99700 1 -- 172.21.15.81:0/1814096412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08054e50 con 0x563519bb8c00 2023-10-06T02:48:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/1814096412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 msgr2=0x563519b907b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/1814096412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b907b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4c08055660 tx=0x7f4c08080000 comp rx=0 tx=0).stop 2023-10-06T02:48:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/1814096412 shutdown_connections 2023-10-06T02:48:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/1814096412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519bb8c00 0x563519b907b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/1814096412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b68840 0x563519b69550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/1814096412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519b69cc0 0x563519bac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/1814096412 >> 172.21.15.81:0/1814096412 conn(0x563519b6a160 msgr2=0x563519ba7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:23.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/1814096412 shutdown_connections 2023-10-06T02:48:23.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/1814096412 wait complete. 2023-10-06T02:48:23.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 -- start start 2023-10-06T02:48:23.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.142+0000 7f4c1e4e7b80 1 Processor -- start 2023-10-06T02:48:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519bb2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 0x563519c19040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c1e4e7b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 0x563519c1d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563519bc1c20 con 0x563519b68840 2023-10-06T02:48:23.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x563519bb3780 con 0x563519bb8c00 2023-10-06T02:48:23.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c1e4e7b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x563519bc26d0 con 0x563519b69cc0 2023-10-06T02:48:23.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c1e4e7b80 10 client.0 _ll_register_callbacks cb 0x563519b2be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:48:23.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c0ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519bb2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c0ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519bb2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38514/0 (socket says 172.21.15.81:38514) 2023-10-06T02:48:23.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c0ed9d700 1 -- 172.21.15.81:0/748358987 learned_addr learned my addr 172.21.15.81:0/748358987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:23.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c0f59e700 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 0x563519c1d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.143+0000 7f4c0659c700 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 0x563519c19040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c0ed9d700 1 -- 172.21.15.81:0/748358987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 msgr2=0x563519c19040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:23.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 0x563519c19040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c0ed9d700 1 -- 172.21.15.81:0/748358987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 msgr2=0x563519c1d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:23.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 0x563519c1d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c0ed9d700 1 -- 172.21.15.81:0/748358987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635198f5fe0 con 0x563519b68840 2023-10-06T02:48:23.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c0ed9d700 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519bb2e80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4c0001f000 tx=0x7f4c00016030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d3ad927504ed99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4bed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:48:23.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4bed7fa700 1 -- 172.21.15.81:0/748358987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00030070 con 0x563519b68840 2023-10-06T02:48:23.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4bed7fa700 1 -- 172.21.15.81:0/748358987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4c00006a30 con 0x563519b68840 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/748358987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c00014ac0 con 0x563519b68840 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4bed7fa700 1 -- 172.21.15.81:0/748358987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c00006e00 con 0x563519b68840 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c1e4e7b80 10 client.5970 fetch_fsmap learned FSMap version 34 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/748358987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x563519a6e470 con 0x563519b68840 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4bed7fa700 1 -- 172.21.15.81:0/748358987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c00014ac0 con 0x563519b68840 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4bed7fa700 1 -- 172.21.15.81:0/748358987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4c00007030 con 0x563519b68840 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c1e4e7b80 10 client.5970 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c1e4e7b80 10 client.5970 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c1e4e7b80 20 client.5970 populate_metadata read hostname 'smithi081' 2023-10-06T02:48:23.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] conn(0x563519b907b0 0x563519b90b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c1e4e7b80 4 client.5970 mds_command: new command op to 5820 tid=0[{"prefix": "status"}] 2023-10-06T02:48:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/748358987 --> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563519a5be00 con 0x563519b907b0 2023-10-06T02:48:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.144+0000 7f4c0659c700 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] conn(0x563519b907b0 0x563519b90b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4bed7fa700 10 client.5970 ms_handle_connect on v2:172.21.15.81:6833/2518286030 2023-10-06T02:48:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c0659c700 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] conn(0x563519b907b0 0x563519b90b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=327e32b9ac704d36 server_cookie=c2c9eb7ca1e21fc8 in_seq=0 out_seq=0 2023-10-06T02:48:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4bed7fa700 1 -- 172.21.15.81:0/748358987 <== mds.0 v2:172.21.15.81:6833/2518286030 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563519a5be00 con 0x563519b907b0 2023-10-06T02:48:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4bed7fa700 10 client.5970 handle_command_reply: tid=0 2023-10-06T02:48:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 client.5970 shutdown 2023-10-06T02:48:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/748358987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 msgr2=0x563519bb2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519bb2e80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4c0001f000 tx=0x7f4c00016030 comp rx=0 tx=0).stop 2023-10-06T02:48:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/748358987 shutdown_connections 2023-10-06T02:48:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.81:6833/2518286030,v1:172.21.15.81:6835/2518286030] conn(0x563519b907b0 0x563519b90b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563519bb8c00 0x563519c1d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4bed7fa700 0 client.5970 ms_handle_reset on v2:172.21.15.81:6833/2518286030 2023-10-06T02:48:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563519b68840 0x563519bb2e80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 --2- 172.21.15.81:0/748358987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563519b69cc0 0x563519c19040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/748358987 >> 172.21.15.81:0/748358987 conn(0x563519b6a160 msgr2=0x563519b69550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/748358987 shutdown_connections 2023-10-06T02:48:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 1 -- 172.21.15.81:0/748358987 wait complete. 2023-10-06T02:48:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.145+0000 7f4c1e4e7b80 20 client.5970 trim_cache size 0 max 16384 2023-10-06T02:48:23.159 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:48:23.159 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:48:23.159 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:48:23.159 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5820, 2023-10-06T02:48:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:48:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:48:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:48:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 6.0901370139999997, 2023-10-06T02:48:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 34, 2023-10-06T02:48:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 66, 2023-10-06T02:48:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 66, 2023-10-06T02:48:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 12.084440408000001 2023-10-06T02:48:23.160 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:48:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 -- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4bf0066f30 msgr2=0x7f4bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4bf0066f30 0x7f4bf00693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c00002880 tx=0x7f4c00009040 comp rx=0 tx=0).stop 2023-10-06T02:48:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 -- 172.21.15.81:0/23466847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c101583b0 msgr2=0x7f4c100c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c101583b0 0x7f4c100c67c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800cc90 tx=0x7f4c08001a80 comp rx=0 tx=0).stop 2023-10-06T02:48:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 -- 172.21.15.81:0/23466847 shutdown_connections 2023-10-06T02:48:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c101583b0 0x7f4c100c67c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4bf0066f30 0x7f4bf00693e0 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c00002880 tx=0x7f4c00009040 comp rx=0 tx=0).stop 2023-10-06T02:48:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c100b3bd0 0x7f4c101426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 --2- 172.21.15.81:0/23466847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c10157fe0 0x7f4c100c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 -- 172.21.15.81:0/23466847 >> 172.21.15.81:0/23466847 conn(0x7f4c10067640 msgr2=0x7f4c100b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:23.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 -- 172.21.15.81:0/23466847 shutdown_connections 2023-10-06T02:48:23.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.146+0000 7f4c151ef700 1 -- 172.21.15.81:0/23466847 wait complete. 2023-10-06T02:48:23.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:48:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.276+0000 7f68aa06a700 1 Processor -- start 2023-10-06T02:48:23.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.276+0000 7f68aa06a700 1 -- start start 2023-10-06T02:48:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68aa06a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f68a4157ca0 0x7f68a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68aa06a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a40d07c0 con 0x7f68a41578d0 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68aa06a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a40cfbb0 con 0x7f68a406d120 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68aa06a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a40cfe90 con 0x7f68a4157ca0 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f68a41578d0 0x7f68a415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41658/0 (socket says 172.21.15.81:41658) 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a37fe700 1 -- 172.21.15.81:0/2470166400 learned_addr learned my addr 172.21.15.81:0/2470166400 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a2ffd700 1 --2- 172.21.15.81:0/2470166400 >> v2:172.21.15.83:3300/0 conn(0x7f68a4157ca0 0x7f68a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a27fc700 1 -- 172.21.15.81:0/2470166400 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854107464 0 0) 0x7f68a40d07c0 con 0x7f68a41578d0 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a27fc700 1 -- 172.21.15.81:0/2470166400 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6890003570 con 0x7f68a41578d0 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a27fc700 1 -- 172.21.15.81:0/2470166400 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083781856 0 0) 0x7f68a40cfbb0 con 0x7f68a406d120 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a27fc700 1 -- 172.21.15.81:0/2470166400 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a40d07c0 con 0x7f68a406d120 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a2ffd700 1 -- 172.21.15.81:0/2470166400 >> v1:172.21.15.83:6789/0 conn(0x7f68a406d120 legacy=0x7f68a406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a2ffd700 1 -- 172.21.15.81:0/2470166400 >> v1:172.21.15.81:6789/0 conn(0x7f68a41578d0 legacy=0x7f68a415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a2ffd700 1 -- 172.21.15.81:0/2470166400 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a40d0170 con 0x7f68a4157ca0 2023-10-06T02:48:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.277+0000 7f68a2ffd700 1 --2- 172.21.15.81:0/2470166400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4157ca0 0x7f68a40cf4f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f688c0098e0 tx=0x7f688c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ebef4929a5a4caf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68a27fc700 1 -- 172.21.15.81:0/2470166400 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c011630 con 0x7f68a4157ca0 2023-10-06T02:48:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68a27fc700 1 -- 172.21.15.81:0/2470166400 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c011790 con 0x7f68a4157ca0 2023-10-06T02:48:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68a27fc700 1 -- 172.21.15.81:0/2470166400 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c011b30 con 0x7f68a4157ca0 2023-10-06T02:48:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68aa06a700 1 -- 172.21.15.81:0/2470166400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4157ca0 msgr2=0x7f68a40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68aa06a700 1 --2- 172.21.15.81:0/2470166400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4157ca0 0x7f68a40cf4f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f688c0098e0 tx=0x7f688c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68aa06a700 1 -- 172.21.15.81:0/2470166400 shutdown_connections 2023-10-06T02:48:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68aa06a700 1 --2- 172.21.15.81:0/2470166400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4157ca0 0x7f68a40cf4f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68aa06a700 1 -- 172.21.15.81:0/2470166400 >> 172.21.15.81:0/2470166400 conn(0x7f68a406bb90 msgr2=0x7f68a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:23.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68aa06a700 1 -- 172.21.15.81:0/2470166400 shutdown_connections 2023-10-06T02:48:23.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.278+0000 7f68aa06a700 1 -- 172.21.15.81:0/2470166400 wait complete. 2023-10-06T02:48:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.279+0000 7f68aa06a700 1 Processor -- start 2023-10-06T02:48:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.279+0000 7f68aa06a700 1 -- start start 2023-10-06T02:48:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68aa06a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a406d120 0x7f68a414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68aa06a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68a41578d0 0x7f68a413d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68aa06a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4157ca0 0x7f68a416dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68aa06a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4158e50 con 0x7f68a406d120 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68aa06a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4159e00 con 0x7f68a4157ca0 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68aa06a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4159970 con 0x7f68a41578d0 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a406d120 0x7f68a414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a406d120 0x7f68a414db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38528/0 (socket says 172.21.15.81:38528) 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68a37fe700 1 -- 172.21.15.81:0/2744616494 learned_addr learned my addr 172.21.15.81:0/2744616494 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68a37fe700 1 -- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68a41578d0 msgr2=0x7f68a413d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68a37fe700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68a41578d0 0x7f68a413d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68a37fe700 1 -- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4157ca0 msgr2=0x7f68a416dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68a37fe700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4157ca0 0x7f68a416dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.280+0000 7f68a37fe700 1 -- 172.21.15.81:0/2744616494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c009420 con 0x7f68a406d120 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.281+0000 7f68a37fe700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a406d120 0x7f68a414db10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f689c00cd80 tx=0x7f689c001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.281+0000 7f689b7fe700 1 -- 172.21.15.81:0/2744616494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c00aaf0 con 0x7f68a406d120 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.281+0000 7f689b7fe700 1 -- 172.21.15.81:0/2744616494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c00ac50 con 0x7f68a406d120 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.281+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a4159040 con 0x7f68a406d120 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.281+0000 7f689b7fe700 1 -- 172.21.15.81:0/2744616494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0070f0 con 0x7f68a406d120 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.281+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a4159600 con 0x7f68a406d120 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.282+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a4067ac0 con 0x7f68a406d120 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.282+0000 7f689b7fe700 1 -- 172.21.15.81:0/2744616494 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f689c0074e0 con 0x7f68a406d120 2023-10-06T02:48:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.283+0000 7f689b7fe700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6884066f30 0x7f68840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.283+0000 7f689b7fe700 1 -- 172.21.15.81:0/2744616494 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f689c084c20 con 0x7f68a406d120 2023-10-06T02:48:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.283+0000 7f68a2ffd700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6884066f30 0x7f68840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.283+0000 7f68a2ffd700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6884066f30 0x7f68840693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f68a41580c0 tx=0x7f688c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.287+0000 7f689b7fe700 1 -- 172.21.15.81:0/2744616494 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f689c051db0 con 0x7f68a406d120 2023-10-06T02:48:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.511+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68a40d0450 con 0x7f68a406d120 2023-10-06T02:48:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.512+0000 7f689b7fe700 1 -- 172.21.15.81:0/2744616494 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f689c0553d0 con 0x7f68a406d120 2023-10-06T02:48:23.513 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:48:23.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6884066f30 msgr2=0x7f68840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6884066f30 0x7f68840693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f68a41580c0 tx=0x7f688c017000 comp rx=0 tx=0).stop 2023-10-06T02:48:23.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a406d120 msgr2=0x7f68a414db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:23.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a406d120 0x7f68a414db10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f689c00cd80 tx=0x7f689c001bb0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 shutdown_connections 2023-10-06T02:48:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6884066f30 0x7f68840693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68a4157ca0 0x7f68a416dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a406d120 0x7f68a414db10 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 --2- 172.21.15.81:0/2744616494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68a41578d0 0x7f68a413d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 >> 172.21.15.81:0/2744616494 conn(0x7f68a406bb90 msgr2=0x7f68a406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 shutdown_connections 2023-10-06T02:48:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:23.514+0000 7f68aa06a700 1 -- 172.21.15.81:0/2744616494 wait complete. 2023-10-06T02:48:23.527 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:48:23.527 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:48:23.527 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:48:23.527 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:48:23.527 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:48:23.527 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:48:23.527 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:48:23.527 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:48:23.527 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:48:23.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:23.528 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:48:23.542 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:23.543 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42413sec preferred_lft 42413sec 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:23.544 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:48:23.545 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:23.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:23.546 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:48:23.606 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:48:23.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:23.607 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:48:23.663 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:48:23.663 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:48:23.663 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:48:23.663 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:48:23.664 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:48:23.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:23.664 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:48:23.664 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:48:23.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:48:23.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:48:23.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:48:23.664 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:48:23.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:23.763 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:48:23.777 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:48:23.777 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:48:23.777 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:48:23.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:23.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:48:23.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:48:23.842 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:48:23.896 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:48:23.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:48:23.897 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:48:23.951 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:48:23.951 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:48:23.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:48:24.031 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:48:24.031 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:48:24.050 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:48:24.051 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:48:24.051 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:48:24.051 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:48:24.051 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:48:24.051 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:48:24.051 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:48:24.051 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:48:24.071 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:48:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:48:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:48:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:48:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:48:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:48:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:48:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:48:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:48:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:48:24.073 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:48:24.074 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:48:24.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:24.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:48:24.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:48:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.292+0000 7f04ce86c700 1 Processor -- start 2023-10-06T02:48:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.292+0000 7f04ce86c700 1 -- start start 2023-10-06T02:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.293+0000 7f04ce86c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f04c81578d0 0x7f04c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.293+0000 7f04ce86c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04c806d120 0x7f04c806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.293+0000 7f04ce86c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c80d07c0 con 0x7f04c8157ca0 2023-10-06T02:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.293+0000 7f04ce86c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c806da50 con 0x7f04c806d120 2023-10-06T02:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.293+0000 7f04ce86c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c80cfbb0 con 0x7f04c81578d0 2023-10-06T02:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.293+0000 7f04cce09700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04c806d120 0x7f04c806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.293+0000 7f04cce09700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04c806d120 0x7f04c806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38530/0 (socket says 172.21.15.81:38530) 2023-10-06T02:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.293+0000 7f04cce09700 1 -- 172.21.15.81:0/1924197692 learned_addr learned my addr 172.21.15.81:0/1924197692 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.293+0000 7f04c7fff700 1 --2- 172.21.15.81:0/1924197692 >> v2:172.21.15.83:3300/0 conn(0x7f04c81578d0 0x7f04c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04cce09700 1 -- 172.21.15.81:0/1924197692 >> v2:172.21.15.83:3300/0 conn(0x7f04c81578d0 msgr2=0x7f04c80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04cce09700 1 --2- 172.21.15.81:0/1924197692 >> v2:172.21.15.83:3300/0 conn(0x7f04c81578d0 0x7f04c80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04cce09700 1 -- 172.21.15.81:0/1924197692 >> v1:172.21.15.83:6789/0 conn(0x7f04c8157ca0 legacy=0x7f04c815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04cce09700 1 -- 172.21.15.81:0/1924197692 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c80cfe90 con 0x7f04c806d120 2023-10-06T02:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04cce09700 1 --2- 172.21.15.81:0/1924197692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c806d120 0x7f04c806d510 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f04c80646b0 tx=0x7f04c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60778f87113efd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04c6ffd700 1 -- 172.21.15.81:0/1924197692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000e070 con 0x7f04c806d120 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04c6ffd700 1 -- 172.21.15.81:0/1924197692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c000ba20 con 0x7f04c806d120 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04c6ffd700 1 -- 172.21.15.81:0/1924197692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c00092e0 con 0x7f04c806d120 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04ce86c700 1 -- 172.21.15.81:0/1924197692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c806d120 msgr2=0x7f04c806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04ce86c700 1 --2- 172.21.15.81:0/1924197692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c806d120 0x7f04c806d510 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f04c80646b0 tx=0x7f04c0009840 comp rx=0 tx=0).stop 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04ce86c700 1 -- 172.21.15.81:0/1924197692 shutdown_connections 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04ce86c700 1 --2- 172.21.15.81:0/1924197692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c806d120 0x7f04c806d510 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.294+0000 7f04ce86c700 1 --2- 172.21.15.81:0/1924197692 >> v2:172.21.15.83:3300/0 conn(0x7f04c81578d0 0x7f04c80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.295+0000 7f04ce86c700 1 -- 172.21.15.81:0/1924197692 >> 172.21.15.81:0/1924197692 conn(0x7f04c806bb90 msgr2=0x7f04c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.295+0000 7f04ce86c700 1 -- 172.21.15.81:0/1924197692 shutdown_connections 2023-10-06T02:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.295+0000 7f04ce86c700 1 -- 172.21.15.81:0/1924197692 wait complete. 2023-10-06T02:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.296+0000 7f04ce86c700 1 Processor -- start 2023-10-06T02:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.296+0000 7f04ce86c700 1 -- start start 2023-10-06T02:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.296+0000 7f04ce86c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04c806d120 0x7f04c8154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.296+0000 7f04ce86c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c81578d0 0x7f04c80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.296+0000 7f04ce86c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8157ca0 0x7f04c80b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.296+0000 7f04ce86c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80c90d0 con 0x7f04c81578d0 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.296+0000 7f04ce86c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80b3f70 con 0x7f04c806d120 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.296+0000 7f04ce86c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c816b220 con 0x7f04c8157ca0 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c81578d0 0x7f04c80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c81578d0 0x7f04c80c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38536/0 (socket says 172.21.15.81:38536) 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c77fe700 1 -- 172.21.15.81:0/3214712964 learned_addr learned my addr 172.21.15.81:0/3214712964 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c7fff700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04c806d120 0x7f04c8154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04cce09700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8157ca0 0x7f04c80b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c77fe700 1 -- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8157ca0 msgr2=0x7f04c80b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c77fe700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8157ca0 0x7f04c80b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c77fe700 1 -- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04c806d120 msgr2=0x7f04c8154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c77fe700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04c806d120 0x7f04c8154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c77fe700 1 -- 172.21.15.81:0/3214712964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0009ae0 con 0x7f04c81578d0 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04cce09700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8157ca0 0x7f04c80b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04c77fe700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c81578d0 0x7f04c80c5b20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00c590 tx=0x7f04bc007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04affff700 1 -- 172.21.15.81:0/3214712964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc011590 con 0x7f04c81578d0 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04affff700 1 -- 172.21.15.81:0/3214712964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc011710 con 0x7f04c81578d0 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c8154960 con 0x7f04c81578d0 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04affff700 1 -- 172.21.15.81:0/3214712964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc011ad0 con 0x7f04c81578d0 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.297+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c80c67e0 con 0x7f04c81578d0 2023-10-06T02:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.298+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c80b4100 con 0x7f04c81578d0 2023-10-06T02:48:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.299+0000 7f04affff700 1 -- 172.21.15.81:0/3214712964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04bc01a360 con 0x7f04c81578d0 2023-10-06T02:48:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.299+0000 7f04affff700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04b4066f30 0x7f04b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.299+0000 7f04affff700 1 -- 172.21.15.81:0/3214712964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f04bc083620 con 0x7f04c81578d0 2023-10-06T02:48:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.299+0000 7f04c7fff700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04b4066f30 0x7f04b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.300+0000 7f04c7fff700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04b4066f30 0x7f04b40693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f04c80c96a0 tx=0x7f04b80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.303+0000 7f04affff700 1 -- 172.21.15.81:0/3214712964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04bc050730 con 0x7f04c81578d0 2023-10-06T02:48:24.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.528+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f04c80d0170 con 0x7f04c81578d0 2023-10-06T02:48:24.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.528+0000 7f04affff700 1 -- 172.21.15.81:0/3214712964 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f04bc053d50 con 0x7f04c81578d0 2023-10-06T02:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:48:24.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04b4066f30 msgr2=0x7f04b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04b4066f30 0x7f04b40693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f04c80c96a0 tx=0x7f04b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c81578d0 msgr2=0x7f04c80c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c81578d0 0x7f04c80c5b20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00c590 tx=0x7f04bc007f50 comp rx=0 tx=0).stop 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 shutdown_connections 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04c8157ca0 0x7f04c80b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f04b4066f30 0x7f04b40693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04c806d120 0x7f04c8154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 --2- 172.21.15.81:0/3214712964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c81578d0 0x7f04c80c5b20 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 >> 172.21.15.81:0/3214712964 conn(0x7f04c806bb90 msgr2=0x7f04c8155570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 shutdown_connections 2023-10-06T02:48:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:24.530+0000 7f04ce86c700 1 -- 172.21.15.81:0/3214712964 wait complete. 2023-10-06T02:48:24.543 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:48:24.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:48:24.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:48:24.543 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:48:24.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:48:24.543 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:48:24.544 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:48:24.544 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:48:24.544 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:48:24.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:24.544 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:48:24.563 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:48:24.563 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:48:24.563 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:48:24.563 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:24.563 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:48:24.563 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:24.563 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:48:24.563 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:24.563 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42412sec preferred_lft 42412sec 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:48:24.564 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:48:24.565 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:48:24.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:24.566 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:48:24.630 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:48:24.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:24.632 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:48:24.690 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:48:24.690 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:48:24.690 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:48:24.691 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:48:24.691 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:48:24.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:24.691 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:48:24.691 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:48:24.691 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:48:24.691 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:48:24.691 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:48:24.692 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:48:24.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:24.798 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:48:24.813 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:48:24.813 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:48:24.813 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:48:24.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:24.814 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:48:24.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:48:24.879 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:48:24.934 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:48:24.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:48:24.935 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:48:24.989 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:48:24.989 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:48:24.989 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:48:25.069 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:48:25.069 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:48:25.088 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:48:25.088 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:48:25.088 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:48:25.088 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:48:25.088 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:48:25.088 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:48:25.089 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:48:25.089 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:48:25.109 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:48:25.109 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:48:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:48:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:48:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:48:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:48:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:48:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:48:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:48:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:48:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:48:25.111 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:48:25.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:48:25.111 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:48:25.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:48:25.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.290+0000 7f36cfd3a700 1 Processor -- start 2023-10-06T02:48:25.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.290+0000 7f36cfd3a700 1 -- start start 2023-10-06T02:48:25.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.291+0000 7f36cfd3a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36c81578d0 0x7f36c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:25.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.291+0000 7f36cfd3a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c80d07c0 con 0x7f36c806d120 2023-10-06T02:48:25.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.291+0000 7f36cfd3a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c80cfbb0 con 0x7f36c8157ca0 2023-10-06T02:48:25.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.291+0000 7f36cfd3a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c80cfe90 con 0x7f36c81578d0 2023-10-06T02:48:25.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.291+0000 7f36cdad6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36c81578d0 0x7f36c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:25.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.291+0000 7f36ce2d7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f36c806d120 0x7f36c806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41672/0 (socket says 172.21.15.81:41672) 2023-10-06T02:48:25.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.291+0000 7f36ce2d7700 1 -- 172.21.15.81:0/1399919487 learned_addr learned my addr 172.21.15.81:0/1399919487 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:48:25.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36cdad6700 1 -- 172.21.15.81:0/1399919487 >> v1:172.21.15.83:6789/0 conn(0x7f36c8157ca0 legacy=0x7f36c815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:48:25.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36cdad6700 1 -- 172.21.15.81:0/1399919487 >> v1:172.21.15.81:6789/0 conn(0x7f36c806d120 legacy=0x7f36c806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:25.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36cdad6700 1 -- 172.21.15.81:0/1399919487 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c80d0170 con 0x7f36c81578d0 2023-10-06T02:48:25.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36ccad4700 1 -- 172.21.15.81:0/1399919487 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476506139 0 0) 0x7f36c80d07c0 con 0x7f36c806d120 2023-10-06T02:48:25.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36cdad6700 1 --2- 172.21.15.81:0/1399919487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c81578d0 0x7f36c80cf4f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009e60 tx=0x7f36c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a2055ff79662ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:25.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36ccad4700 1 -- 172.21.15.81:0/1399919487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c400e070 con 0x7f36c81578d0 2023-10-06T02:48:25.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36ccad4700 1 -- 172.21.15.81:0/1399919487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c400bbf0 con 0x7f36c81578d0 2023-10-06T02:48:25.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36ccad4700 1 -- 172.21.15.81:0/1399919487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4012430 con 0x7f36c81578d0 2023-10-06T02:48:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36cfd3a700 1 -- 172.21.15.81:0/1399919487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c81578d0 msgr2=0x7f36c80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36cfd3a700 1 --2- 172.21.15.81:0/1399919487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c81578d0 0x7f36c80cf4f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009e60 tx=0x7f36c4009780 comp rx=0 tx=0).stop 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36cfd3a700 1 -- 172.21.15.81:0/1399919487 shutdown_connections 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36cfd3a700 1 --2- 172.21.15.81:0/1399919487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c81578d0 0x7f36c80cf4f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.292+0000 7f36cfd3a700 1 -- 172.21.15.81:0/1399919487 >> 172.21.15.81:0/1399919487 conn(0x7f36c806bb90 msgr2=0x7f36c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.293+0000 7f36cfd3a700 1 -- 172.21.15.81:0/1399919487 shutdown_connections 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.293+0000 7f36cfd3a700 1 -- 172.21.15.81:0/1399919487 wait complete. 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cfd3a700 1 Processor -- start 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cfd3a700 1 -- start start 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cfd3a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c806d120 0x7f36c816a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cfd3a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36c81578d0 0x7f36c8154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cfd3a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36c8157ca0 0x7f36c816b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cfd3a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c816bc20 con 0x7f36c806d120 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cfd3a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c816bf00 con 0x7f36c8157ca0 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cfd3a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c816c1e0 con 0x7f36c81578d0 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cdad6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c806d120 0x7f36c816a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cdad6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c806d120 0x7f36c816a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38556/0 (socket says 172.21.15.81:38556) 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.294+0000 7f36cdad6700 1 -- 172.21.15.81:0/3485187013 learned_addr learned my addr 172.21.15.81:0/3485187013 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36ce2d7700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36c8157ca0 0x7f36c816b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cd2d5700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36c81578d0 0x7f36c8154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cdad6700 1 -- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36c81578d0 msgr2=0x7f36c8154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cdad6700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36c81578d0 0x7f36c8154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cdad6700 1 -- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36c8157ca0 msgr2=0x7f36c816b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cdad6700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36c8157ca0 0x7f36c816b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cdad6700 1 -- 172.21.15.81:0/3485187013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c4009a20 con 0x7f36c806d120 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36ce2d7700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36c8157ca0 0x7f36c816b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cd2d5700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36c81578d0 0x7f36c8154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cdad6700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c806d120 0x7f36c816a210 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f36c806fe20 tx=0x7f36c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36bdffb700 1 -- 172.21.15.81:0/3485187013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4012e80 con 0x7f36c806d120 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36bdffb700 1 -- 172.21.15.81:0/3485187013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c401e640 con 0x7f36c806d120 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c816c4c0 con 0x7f36c806d120 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36bdffb700 1 -- 172.21.15.81:0/3485187013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c401e9e0 con 0x7f36c806d120 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.295+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c816b910 con 0x7f36c806d120 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.296+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c816c9c0 con 0x7f36c806d120 2023-10-06T02:48:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.296+0000 7f36bdffb700 1 -- 172.21.15.81:0/3485187013 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36c4024070 con 0x7f36c806d120 2023-10-06T02:48:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.297+0000 7f36bdffb700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f36ac066f30 0x7f36ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:48:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.297+0000 7f36bdffb700 1 -- 172.21.15.81:0/3485187013 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f36c40870b0 con 0x7f36c806d120 2023-10-06T02:48:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.297+0000 7f36cd2d5700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f36ac066f30 0x7f36ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:48:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.297+0000 7f36cd2d5700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f36ac066f30 0x7f36ac0693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006fd0 tx=0x7f36b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:48:25.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.301+0000 7f36bdffb700 1 -- 172.21.15.81:0/3485187013 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36c4054270 con 0x7f36c806d120 2023-10-06T02:48:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.529+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36c80d0450 con 0x7f36c806d120 2023-10-06T02:48:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.530+0000 7f36bdffb700 1 -- 172.21.15.81:0/3485187013 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f36c4057890 con 0x7f36c806d120 2023-10-06T02:48:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:48:25.531 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1289364984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1289364984},{"type":"v1","addr":"172.21.15.83:6836","nonce":1289364984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3185368649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3185368649},{"type":"v1","addr":"172.21.15.83:6837","nonce":3185368649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5817,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/869401920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":869401920},{"type":"v1","addr":"172.21.15.81:6834","nonce":869401920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:48:16.417708+0000","modified":"2023-10-06T02:48:20.372496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2518286030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2518286030},{"type":"v1","addr":"172.21.15.81:6835","nonce":2518286030}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f36ac066f30 msgr2=0x7f36ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f36ac066f30 0x7f36ac0693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006fd0 tx=0x7f36b8008040 comp rx=0 tx=0).stop 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c806d120 msgr2=0x7f36c816a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c806d120 0x7f36c816a210 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f36c806fe20 tx=0x7f36c4018000 comp rx=0 tx=0).stop 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 shutdown_connections 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f36ac066f30 0x7f36ac0693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36c8157ca0 0x7f36c816b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c806d120 0x7f36c816a210 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 --2- 172.21.15.81:0/3485187013 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36c81578d0 0x7f36c8154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:48:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 >> 172.21.15.81:0/3485187013 conn(0x7f36c806bb90 msgr2=0x7f36c806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:48:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 shutdown_connections 2023-10-06T02:48:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:48:25.532+0000 7f36cfd3a700 1 -- 172.21.15.81:0/3485187013 wait complete. 2023-10-06T02:48:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2023-10-06T02:48:25.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-06T02:48:25.677 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":5820,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.6116069700000004,"mdsmap_epoch":34,"osdmap_epoch":66,"osdmap_epoch_barrier":66,"uptime":14.605911975} 2023-10-06T02:48:25.678 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 5820, "mdsmap_epoch": 34, "osdmap_epoch": 66, "osdmap_epoch_barrier": 66, "rank_uptime": 8.61160697, "state": "up:active", "uptime": 14.605911975, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:48:25.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-06T02:48:25.807 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-06T02:48:25.808 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-06T02:48:25.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-06T02:48:25.929 INFO:teuthology.orchestra.run.smithi081.stdout:{"mon_tick_interval":"5"} 2023-10-06T02:48:25.929 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-06T02:48:25.929 INFO:tasks.cephfs.test_full:pool capacity 557004352, 531MB should be enough to fill it 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> import time 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> import datetime 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> # Write some buffered data through before going full, all should be well 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> print("writing some data through which we expect to succeed") 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> bytes = 0 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-06T02:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> # buffered IO, the error should always only appear from fsync and not 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> # from write 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> full = False 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:48:25.931 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(531 * 0.9)): 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> print("done writing {0} bytes".format(bytes)) 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> # OK, now we should sneak in under the full condition 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> # due to the time it takes the OSDs to report to the 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> # mons, and get a successful fsync on our full-making data 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:48:25.932 DEBUG:teuthology.orchestra.run.smithi081:> # buffered write, add more dirty data to the buffer 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> print("starting buffered write") 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(531 * 0.2)): 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(15.0) 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> except OSError: 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> pass; 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-06T02:48:25.933 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> # Wait long enough for a background flush that should fail 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(30) 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> # ...and check that the failed background flush is reflected in fclose 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> except OSError: 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> print("close() returned an error as expected") 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-06T02:48:25.934 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("close() failed to raise error") 2023-10-06T02:48:25.935 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-06T02:48:25.935 DEBUG:teuthology.orchestra.run.smithi081:> # The kernel cephfs client does not raise errors on fclose 2023-10-06T02:48:25.935 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-06T02:48:25.935 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:48:25.935 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-06T02:48:25.935 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:48:26.124 INFO:teuthology.orchestra.run.smithi081.stdout:writing some data through which we expect to succeed 2023-10-06T02:48:26.124 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-06T02:48:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-06T02:48:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-10-06T02:48:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-10-06T02:48:26.128 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-10-06T02:48:26.129 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-10-06T02:48:26.130 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-10-06T02:48:26.131 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-10-06T02:48:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-10-06T02:48:26.133 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-10-06T02:48:26.134 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-10-06T02:48:26.135 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-10-06T02:48:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-10-06T02:48:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-10-06T02:48:26.138 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-10-06T02:48:26.138 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-10-06T02:48:26.138 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-10-06T02:48:26.138 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-10-06T02:48:26.173 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-10-06T02:48:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-10-06T02:48:26.175 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-10-06T02:48:26.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-10-06T02:48:26.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-10-06T02:48:26.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-10-06T02:48:26.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-10-06T02:48:26.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-10-06T02:48:26.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-10-06T02:48:26.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-10-06T02:48:26.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-10-06T02:48:26.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-10-06T02:48:26.178 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-10-06T02:48:26.178 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-10-06T02:48:26.178 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-10-06T02:48:26.178 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-10-06T02:48:26.178 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-10-06T02:48:26.179 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-10-06T02:48:26.179 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-10-06T02:48:26.181 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-10-06T02:48:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-10-06T02:48:26.183 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-10-06T02:48:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-10-06T02:48:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-10-06T02:48:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-10-06T02:48:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-10-06T02:48:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-10-06T02:48:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-10-06T02:48:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-10-06T02:48:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-10-06T02:48:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-10-06T02:48:26.185 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-10-06T02:48:26.186 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-10-06T02:48:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-10-06T02:48:26.188 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-10-06T02:48:26.189 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-10-06T02:48:26.189 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-10-06T02:48:26.189 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-10-06T02:48:26.189 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-10-06T02:48:26.189 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-10-06T02:48:26.220 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-10-06T02:48:26.221 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-10-06T02:48:26.222 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-10-06T02:48:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-10-06T02:48:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-10-06T02:48:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-10-06T02:48:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-10-06T02:48:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-10-06T02:48:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-10-06T02:48:26.229 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-10-06T02:48:26.230 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-10-06T02:48:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-10-06T02:48:26.232 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-10-06T02:48:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-10-06T02:48:26.234 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-10-06T02:48:26.234 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-10-06T02:48:30.372 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:48:30.371+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-06T02:48:36.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:48:36.581 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:48:39.372 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:48:39.372+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-06T02:49:01.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:49:01.583+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2023-10-06T02:49:06.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:49:06.648 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:49:36.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:49:36.727 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:49:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-10-06T02:49:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-10-06T02:49:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-10-06T02:49:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-10-06T02:49:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-10-06T02:49:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-10-06T02:49:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-10-06T02:49:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-10-06T02:49:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:done writing 500695040 bytes 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:successfully fsync'ed prior to getting full state reported 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:starting buffered write 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:49:41.699 INFO:teuthology.orchestra.run.smithi081.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-06T02:49:41.891 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:49:41.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:49:41.933 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:49:41.985 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:49:41.986 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:49:41.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:49:41.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:49:42.035 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:49:42.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:49:42.035 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:49:42.051 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:49:42.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:49:42.052 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:49:42.092 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:49:42.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:49:42.092 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:49:42.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:49:42.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.288+0000 7fb1ff0a5700 1 Processor -- start 2023-10-06T02:49:42.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.288+0000 7fb1ff0a5700 1 -- start start 2023-10-06T02:49:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.289+0000 7fb1ff0a5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb1f8157fe0 0x7fb1f80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.289+0000 7fb1ff0a5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1f81583b0 0x7fb1f80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.289+0000 7fb1ff0a5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f80ceb30 0x7fb1f80cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.289+0000 7fb1ff0a5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f80cf4b0 con 0x7fb1f81583b0 2023-10-06T02:49:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.289+0000 7fb1ff0a5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f80b2890 con 0x7fb1f8157fe0 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.289+0000 7fb1ff0a5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80b4070 con 0x7fb1f80ceb30 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.289+0000 7fb1effff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1f81583b0 0x7fb1f80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.289+0000 7fb1effff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1f81583b0 0x7fb1f80b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55488/0 (socket says 172.21.15.81:55488) 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.289+0000 7fb1effff700 1 -- 172.21.15.81:0/3666633292 learned_addr learned my addr 172.21.15.81:0/3666633292 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1fce41700 1 --2- 172.21.15.81:0/3666633292 >> v2:172.21.15.83:3300/0 conn(0x7fb1f8157fe0 0x7fb1f80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1fd642700 1 --2- 172.21.15.81:0/3666633292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f80ceb30 0x7fb1f80cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1effff700 1 -- 172.21.15.81:0/3666633292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f80ceb30 msgr2=0x7fb1f80cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1effff700 1 --2- 172.21.15.81:0/3666633292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f80ceb30 0x7fb1f80cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1effff700 1 -- 172.21.15.81:0/3666633292 >> v2:172.21.15.83:3300/0 conn(0x7fb1f8157fe0 msgr2=0x7fb1f80b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1effff700 1 --2- 172.21.15.81:0/3666633292 >> v2:172.21.15.83:3300/0 conn(0x7fb1f8157fe0 0x7fb1f80b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1effff700 1 -- 172.21.15.81:0/3666633292 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80b4350 con 0x7fb1f81583b0 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1fd642700 1 --2- 172.21.15.81:0/3666633292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f80ceb30 0x7fb1f80cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1effff700 1 --2- 172.21.15.81:0/3666633292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f81583b0 0x7fb1f80b3a00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8064d90 tx=0x7fb1e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dd3c3c1fc8e0fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ef7fe700 1 -- 172.21.15.81:0/3666633292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800b860 con 0x7fb1f81583b0 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ef7fe700 1 -- 172.21.15.81:0/3666633292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e800b9c0 con 0x7fb1f81583b0 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ef7fe700 1 -- 172.21.15.81:0/3666633292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800bd80 con 0x7fb1f81583b0 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/3666633292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f81583b0 msgr2=0x7fb1f80b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/3666633292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f81583b0 0x7fb1f80b3a00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8064d90 tx=0x7fb1e8009250 comp rx=0 tx=0).stop 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/3666633292 shutdown_connections 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/3666633292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f80ceb30 0x7fb1f80cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/3666633292 >> v2:172.21.15.83:3300/0 conn(0x7fb1f8157fe0 0x7fb1f80b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/3666633292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f81583b0 0x7fb1f80b3a00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.290+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/3666633292 >> 172.21.15.81:0/3666633292 conn(0x7fb1f8067640 msgr2=0x7fb1f8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.291+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/3666633292 shutdown_connections 2023-10-06T02:49:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.291+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/3666633292 wait complete. 2023-10-06T02:49:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.292+0000 7fb1ff0a5700 1 Processor -- start 2023-10-06T02:49:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.292+0000 7fb1ff0a5700 1 -- start start 2023-10-06T02:49:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.292+0000 7fb1ff0a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f80ceb30 0x7fb1f8152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.292+0000 7fb1ff0a5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f8157fe0 0x7fb1f80c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.292+0000 7fb1ff0a5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1f81583b0 0x7fb1f81552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.292+0000 7fb1ff0a5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f8168230 con 0x7fb1f80ceb30 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.292+0000 7fb1ff0a5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f81684c0 con 0x7fb1f81583b0 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.292+0000 7fb1ff0a5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f81687a0 con 0x7fb1f8157fe0 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.292+0000 7fb1fce41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f80ceb30 0x7fb1f8152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1fce41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f80ceb30 0x7fb1f8152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55496/0 (socket says 172.21.15.81:55496) 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1fce41700 1 -- 172.21.15.81:0/1896249959 learned_addr learned my addr 172.21.15.81:0/1896249959 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1fd642700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1f81583b0 0x7fb1f81552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1effff700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f8157fe0 0x7fb1f80c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1fce41700 1 -- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f8157fe0 msgr2=0x7fb1f80c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1fce41700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f8157fe0 0x7fb1f80c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1fce41700 1 -- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1f81583b0 msgr2=0x7fb1f81552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1fce41700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1f81583b0 0x7fb1f81552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1fce41700 1 -- 172.21.15.81:0/1896249959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80094f0 con 0x7fb1f80ceb30 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1fce41700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f80ceb30 0x7fb1f8152990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400d890 tx=0x7fb1f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1ecff9700 1 -- 172.21.15.81:0/1896249959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40125f0 con 0x7fb1f80ceb30 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1ecff9700 1 -- 172.21.15.81:0/1896249959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4012750 con 0x7fb1f80ceb30 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f8168a80 con 0x7fb1f80ceb30 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1ecff9700 1 -- 172.21.15.81:0/1896249959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4012af0 con 0x7fb1f80ceb30 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.293+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f8169040 con 0x7fb1f80ceb30 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.294+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f8069e40 con 0x7fb1f80ceb30 2023-10-06T02:49:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.294+0000 7fb1ecff9700 1 -- 172.21.15.81:0/1896249959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1f401e460 con 0x7fb1f80ceb30 2023-10-06T02:49:42.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.295+0000 7fb1ecff9700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1e4066f30 0x7fb1e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.295+0000 7fb1ecff9700 1 -- 172.21.15.81:0/1896249959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fb1f4084c90 con 0x7fb1f80ceb30 2023-10-06T02:49:42.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.295+0000 7fb1ecff9700 1 -- 172.21.15.81:0/1896249959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7fb1e406f2d0 con 0x7fb1f80ceb30 2023-10-06T02:49:42.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.295+0000 7fb1effff700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1e4066f30 0x7fb1e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.295+0000 7fb1effff700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1e4066f30 0x7fb1e40693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8064d90 tx=0x7fb1e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:42.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.299+0000 7fb1ecff9700 1 -- 172.21.15.81:0/1896249959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1f4051d10 con 0x7fb1f80ceb30 2023-10-06T02:49:42.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.523+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1f80cc6b0 con 0x7fb1f80ceb30 2023-10-06T02:49:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.523+0000 7fb1ecff9700 1 -- 172.21.15.81:0/1896249959 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fb1f4055330 con 0x7fb1f80ceb30 2023-10-06T02:49:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:42.526 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1289364984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1289364984},{"type":"v1","addr":"172.21.15.83:6836","nonce":1289364984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3185368649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3185368649},{"type":"v1","addr":"172.21.15.83:6837","nonce":3185368649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5817,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/869401920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":869401920},{"type":"v1","addr":"172.21.15.81:6834","nonce":869401920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:48:16.417708+0000","modified":"2023-10-06T02:48:20.372496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2518286030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2518286030},{"type":"v1","addr":"172.21.15.81:6835","nonce":2518286030}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:49:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1e4066f30 msgr2=0x7fb1e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1e4066f30 0x7fb1e40693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8064d90 tx=0x7fb1e8017000 comp rx=0 tx=0).stop 2023-10-06T02:49:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f80ceb30 msgr2=0x7fb1f8152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f80ceb30 0x7fb1f8152990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400d890 tx=0x7fb1f4008040 comp rx=0 tx=0).stop 2023-10-06T02:49:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 shutdown_connections 2023-10-06T02:49:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1e4066f30 0x7fb1e40693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1f81583b0 0x7fb1f81552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f80ceb30 0x7fb1f8152990 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 --2- 172.21.15.81:0/1896249959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1f8157fe0 0x7fb1f80c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 >> 172.21.15.81:0/1896249959 conn(0x7fb1f8067640 msgr2=0x7fb1f81536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 shutdown_connections 2023-10-06T02:49:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.526+0000 7fb1ff0a5700 1 -- 172.21.15.81:0/1896249959 wait complete. 2023-10-06T02:49:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2023-10-06T02:49:42.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:49:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.652+0000 7f8733bdf700 1 Processor -- start 2023-10-06T02:49:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.653+0000 7f8733bdf700 1 -- start start 2023-10-06T02:49:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.653+0000 7f8733bdf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f872c0ce1f0 0x7f872c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.653+0000 7f8733bdf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f872c0ce5c0 0x7f872c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.653+0000 7f8733bdf700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c15dfb0 con 0x7f872c0ac570 2023-10-06T02:49:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.653+0000 7f8733bdf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872c0acec0 con 0x7f872c0ce1f0 2023-10-06T02:49:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.653+0000 7f8733bdf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872c0ad1a0 con 0x7f872c0ce5c0 2023-10-06T02:49:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f873197b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f872c0ce1f0 0x7f872c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f873197b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f872c0ce1f0 0x7f872c0aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55510/0 (socket says 172.21.15.81:55510) 2023-10-06T02:49:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f873197b700 1 -- 172.21.15.81:0/3562446838 learned_addr learned my addr 172.21.15.81:0/3562446838 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f873117a700 1 --2- 172.21.15.81:0/3562446838 >> v2:172.21.15.83:3300/0 conn(0x7f872c0ce5c0 0x7f872c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f873197b700 1 -- 172.21.15.81:0/3562446838 >> v2:172.21.15.83:3300/0 conn(0x7f872c0ce5c0 msgr2=0x7f872c15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f873197b700 1 --2- 172.21.15.81:0/3562446838 >> v2:172.21.15.83:3300/0 conn(0x7f872c0ce5c0 0x7f872c15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f873197b700 1 -- 172.21.15.81:0/3562446838 >> v1:172.21.15.83:6789/0 conn(0x7f872c0ac570 legacy=0x7f872c06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f873197b700 1 -- 172.21.15.81:0/3562446838 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c15dc40 con 0x7f872c0ce1f0 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f873197b700 1 --2- 172.21.15.81:0/3562446838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce1f0 0x7f872c0aacf0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f872c06f590 tx=0x7f8728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b844aea5e93c3830 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f8730979700 1 -- 172.21.15.81:0/3562446838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728009e70 con 0x7f872c0ce1f0 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f8730979700 1 -- 172.21.15.81:0/3562446838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872800b860 con 0x7f872c0ce1f0 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.654+0000 7f8730979700 1 -- 172.21.15.81:0/3562446838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800bc00 con 0x7f872c0ce1f0 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.655+0000 7f8733bdf700 1 -- 172.21.15.81:0/3562446838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce1f0 msgr2=0x7f872c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.655+0000 7f8733bdf700 1 --2- 172.21.15.81:0/3562446838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce1f0 0x7f872c0aacf0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f872c06f590 tx=0x7f8728009250 comp rx=0 tx=0).stop 2023-10-06T02:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.655+0000 7f8733bdf700 1 -- 172.21.15.81:0/3562446838 shutdown_connections 2023-10-06T02:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.655+0000 7f8733bdf700 1 --2- 172.21.15.81:0/3562446838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce1f0 0x7f872c0aacf0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.655+0000 7f8733bdf700 1 --2- 172.21.15.81:0/3562446838 >> v2:172.21.15.83:3300/0 conn(0x7f872c0ce5c0 0x7f872c15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.655+0000 7f8733bdf700 1 -- 172.21.15.81:0/3562446838 >> 172.21.15.81:0/3562446838 conn(0x7f872c06cca0 msgr2=0x7f872c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.655+0000 7f8733bdf700 1 -- 172.21.15.81:0/3562446838 shutdown_connections 2023-10-06T02:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.655+0000 7f8733bdf700 1 -- 172.21.15.81:0/3562446838 wait complete. 2023-10-06T02:49:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.656+0000 7f8733bdf700 1 Processor -- start 2023-10-06T02:49:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.656+0000 7f8733bdf700 1 -- start start 2023-10-06T02:49:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.656+0000 7f8733bdf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f872c0ac570 0x7f872c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.656+0000 7f8733bdf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f872c0ce1f0 0x7f872c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.656+0000 7f8733bdf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce5c0 0x7f872c16adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.656+0000 7f8733bdf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c15c340 con 0x7f872c0ce5c0 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.656+0000 7f8733bdf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c15b420 con 0x7f872c0ac570 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.656+0000 7f8733bdf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c15a810 con 0x7f872c0ce1f0 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873217c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce5c0 0x7f872c16adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873197b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f872c0ac570 0x7f872c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873117a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f872c0ce1f0 0x7f872c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873197b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f872c0ac570 0x7f872c0b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:44516/0 (socket says 172.21.15.81:44516) 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873217c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce5c0 0x7f872c16adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55520/0 (socket says 172.21.15.81:55520) 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873197b700 1 -- 172.21.15.81:0/1589099654 learned_addr learned my addr 172.21.15.81:0/1589099654 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873197b700 1 -- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f872c0ce1f0 msgr2=0x7f872c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873197b700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f872c0ce1f0 0x7f872c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873197b700 1 -- 172.21.15.81:0/1589099654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce5c0 msgr2=0x7f872c16adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873197b700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce5c0 0x7f872c16adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873197b700 1 -- 172.21.15.81:0/1589099654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280094f0 con 0x7f872c0ac570 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873217c700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce5c0 0x7f872c16adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f873197b700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f872c0ac570 0x7f872c0b2060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8728006fd0 tx=0x7f8728017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f8721ffb700 1 -- 172.21.15.81:0/1589099654 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800bbe0 con 0x7f872c0ac570 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f8721ffb700 1 -- 172.21.15.81:0/1589099654 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728011420 con 0x7f872c0ac570 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c15aaf0 con 0x7f872c0ac570 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.657+0000 7f8721ffb700 1 -- 172.21.15.81:0/1589099654 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280117e0 con 0x7f872c0ac570 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.658+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c15b0b0 con 0x7f872c0ac570 2023-10-06T02:49:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.658+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c068900 con 0x7f872c0ac570 2023-10-06T02:49:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.659+0000 7f8721ffb700 1 -- 172.21.15.81:0/1589099654 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8728011c10 con 0x7f872c0ac570 2023-10-06T02:49:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.659+0000 7f8721ffb700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8710066f30 0x7f87100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.659+0000 7f8721ffb700 1 -- 172.21.15.81:0/1589099654 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f8728086010 con 0x7f872c0ac570 2023-10-06T02:49:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.659+0000 7f873117a700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8710066f30 0x7f87100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.659+0000 7f8721ffb700 1 -- 172.21.15.81:0/1589099654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f871006f250 con 0x7f872c0ac570 2023-10-06T02:49:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.660+0000 7f873117a700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8710066f30 0x7f87100693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f872c0b2c10 tx=0x7f871c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:42.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.664+0000 7f8721ffb700 1 -- 172.21.15.81:0/1589099654 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8728053090 con 0x7f872c0ac570 2023-10-06T02:49:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.846+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f872c15e980 con 0x7f872c0ac570 2023-10-06T02:49:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.847+0000 7f8721ffb700 1 -- 172.21.15.81:0/1589099654 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+17131 (secure 0 0 0) 0x7f8728015070 con 0x7f872c0ac570 2023-10-06T02:49:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:42.850 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":71,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:48:56.596909+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:48:14.055897+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:48:15.392030+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.39","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:49:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.849+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8710066f30 msgr2=0x7f87100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.849+0000 7f8733bdf700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8710066f30 0x7f87100693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f872c0b2c10 tx=0x7f871c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.849+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f872c0ac570 msgr2=0x7f872c0b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.849+0000 7f8733bdf700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f872c0ac570 0x7f872c0b2060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8728006fd0 tx=0x7f8728017000 comp rx=0 tx=0).stop 2023-10-06T02:49:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.849+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 shutdown_connections 2023-10-06T02:49:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.849+0000 7f8733bdf700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0ce5c0 0x7f872c16adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.850+0000 7f8733bdf700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8710066f30 0x7f87100693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.850+0000 7f8733bdf700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f872c0ac570 0x7f872c0b2060 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.850+0000 7f8733bdf700 1 --2- 172.21.15.81:0/1589099654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f872c0ce1f0 0x7f872c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.850+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 >> 172.21.15.81:0/1589099654 conn(0x7f872c06cca0 msgr2=0x7f872c1569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.850+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 shutdown_connections 2023-10-06T02:49:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.850+0000 7f8733bdf700 1 -- 172.21.15.81:0/1589099654 wait complete. 2023-10-06T02:49:42.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:48:14.055897+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:48:15.392030+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:49:42.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:49:42.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.979+0000 7f522cdc3700 1 Processor -- start 2023-10-06T02:49:42.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.979+0000 7f522cdc3700 1 -- start start 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f522cdc3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5228157ca0 0x7f52280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f522cdc3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f522806d120 0x7f522806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f522cdc3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52280d07c0 con 0x7f52281578d0 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f522cdc3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522806da50 con 0x7f522806d120 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f522cdc3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52280cfbb0 con 0x7f5228157ca0 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f5226d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f522806d120 0x7f522806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f522659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f52281578d0 0x7f522815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58314/0 (socket says 172.21.15.81:58314) 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f522659c700 1 -- 172.21.15.81:0/1762645574 learned_addr learned my addr 172.21.15.81:0/1762645574 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f521dd9b700 1 --2- 172.21.15.81:0/1762645574 >> v2:172.21.15.83:3300/0 conn(0x7f5228157ca0 0x7f52280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f5226d9d700 1 -- 172.21.15.81:0/1762645574 >> v2:172.21.15.83:3300/0 conn(0x7f5228157ca0 msgr2=0x7f52280cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f5226d9d700 1 --2- 172.21.15.81:0/1762645574 >> v2:172.21.15.83:3300/0 conn(0x7f5228157ca0 0x7f52280cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f5226d9d700 1 -- 172.21.15.81:0/1762645574 >> v1:172.21.15.81:6789/0 conn(0x7f52281578d0 legacy=0x7f522815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f5226d9d700 1 -- 172.21.15.81:0/1762645574 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280cfe90 con 0x7f522806d120 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.980+0000 7f5225d9b700 1 -- 172.21.15.81:0/1762645574 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564966585 0 0) 0x7f52280d07c0 con 0x7f52281578d0 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f5226d9d700 1 --2- 172.21.15.81:0/1762645574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 0x7f522806d510 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5228068510 tx=0x7f5220009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8724652bb04cd73d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f5225d9b700 1 -- 172.21.15.81:0/1762645574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000e070 con 0x7f522806d120 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f5225d9b700 1 -- 172.21.15.81:0/1762645574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522000bc30 con 0x7f522806d120 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f5225d9b700 1 -- 172.21.15.81:0/1762645574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220012430 con 0x7f522806d120 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f522cdc3700 1 -- 172.21.15.81:0/1762645574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 msgr2=0x7f522806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f522cdc3700 1 --2- 172.21.15.81:0/1762645574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 0x7f522806d510 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5228068510 tx=0x7f5220009780 comp rx=0 tx=0).stop 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f522cdc3700 1 -- 172.21.15.81:0/1762645574 shutdown_connections 2023-10-06T02:49:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f522cdc3700 1 --2- 172.21.15.81:0/1762645574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 0x7f522806d510 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f522cdc3700 1 --2- 172.21.15.81:0/1762645574 >> v2:172.21.15.83:3300/0 conn(0x7f5228157ca0 0x7f52280cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f522cdc3700 1 -- 172.21.15.81:0/1762645574 >> 172.21.15.81:0/1762645574 conn(0x7f522806bb90 msgr2=0x7f522806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f522cdc3700 1 -- 172.21.15.81:0/1762645574 shutdown_connections 2023-10-06T02:49:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.981+0000 7f522cdc3700 1 -- 172.21.15.81:0/1762645574 wait complete. 2023-10-06T02:49:42.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.982+0000 7f522cdc3700 1 Processor -- start 2023-10-06T02:49:42.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.982+0000 7f522cdc3700 1 -- start start 2023-10-06T02:49:42.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522cdc3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 0x7f52280c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522cdc3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52281578d0 0x7f52280c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522cdc3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5228157ca0 0x7f522816d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522cdc3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c6490 con 0x7f522806d120 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522cdc3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c6770 con 0x7f5228157ca0 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522cdc3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c6a50 con 0x7f52281578d0 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 0x7f52280c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 0x7f52280c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55550/0 (socket says 172.21.15.81:55550) 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522659c700 1 -- 172.21.15.81:0/3416868366 learned_addr learned my addr 172.21.15.81:0/3416868366 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f5226d9d700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5228157ca0 0x7f522816d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522659c700 1 -- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52281578d0 msgr2=0x7f52280c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522659c700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52281578d0 0x7f52280c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522659c700 1 -- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5228157ca0 msgr2=0x7f522816d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522659c700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5228157ca0 0x7f522816d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.983+0000 7f522659c700 1 -- 172.21.15.81:0/3416868366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220009a20 con 0x7f522806d120 2023-10-06T02:49:42.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.984+0000 7f522659c700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 0x7f52280c7530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f521800c7e0 tx=0x7f5218007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.984+0000 7f521effd700 1 -- 172.21.15.81:0/3416868366 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218005b30 con 0x7f522806d120 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.984+0000 7f521effd700 1 -- 172.21.15.81:0/3416868366 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218005c90 con 0x7f522806d120 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.984+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52280c6d30 con 0x7f522806d120 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.984+0000 7f521effd700 1 -- 172.21.15.81:0/3416868366 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218007300 con 0x7f522806d120 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.984+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52280c70c0 con 0x7f522806d120 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.985+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52280c7250 con 0x7f522806d120 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.985+0000 7f521effd700 1 -- 172.21.15.81:0/3416868366 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f521801b400 con 0x7f522806d120 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.985+0000 7f521effd700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5208066f30 0x7f52080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.985+0000 7f521effd700 1 -- 172.21.15.81:0/3416868366 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f5218084230 con 0x7f522806d120 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.986+0000 7f521dd9b700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5208066f30 0x7f52080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.986+0000 7f521effd700 1 -- 172.21.15.81:0/3416868366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f520806f2d0 con 0x7f522806d120 2023-10-06T02:49:42.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.986+0000 7f521dd9b700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5208066f30 0x7f52080693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f52280b5770 tx=0x7f5210008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:42.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:42.990+0000 7f521effd700 1 -- 172.21.15.81:0/3416868366 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52280c7250 con 0x7f522806d120 2023-10-06T02:49:43.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.172+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52280c7250 con 0x7f522806d120 2023-10-06T02:49:43.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.172+0000 7f521effd700 1 -- 172.21.15.81:0/3416868366 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5218051330 con 0x7f522806d120 2023-10-06T02:49:43.174 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:49:43.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5208066f30 msgr2=0x7f52080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5208066f30 0x7f52080693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f52280b5770 tx=0x7f5210008040 comp rx=0 tx=0).stop 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 msgr2=0x7f52280c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 0x7f52280c7530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f521800c7e0 tx=0x7f5218007df0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 shutdown_connections 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5208066f30 0x7f52080693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5228157ca0 0x7f522816d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522806d120 0x7f52280c7530 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 --2- 172.21.15.81:0/3416868366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52281578d0 0x7f52280c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 >> 172.21.15.81:0/3416868366 conn(0x7f522806bb90 msgr2=0x7f5228156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 shutdown_connections 2023-10-06T02:49:43.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.174+0000 7f522cdc3700 1 -- 172.21.15.81:0/3416868366 wait complete. 2023-10-06T02:49:43.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:49:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.302+0000 7efef2617700 1 Processor -- start 2023-10-06T02:49:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.302+0000 7efef2617700 1 -- start start 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efef2617700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efeec0d0b80 0x7efeec0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efef2617700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efeec0d02b0 0x7efeec06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efef2617700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0cf2d0 con 0x7efeec0d0f50 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efef2617700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec15a690 con 0x7efeec0d0b80 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efef2617700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec06dc00 con 0x7efeec0d02b0 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efef1e16700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efeec0d0f50 0x7efeec15b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58316/0 (socket says 172.21.15.81:58316) 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efef1e16700 1 -- 172.21.15.81:0/2395791039 learned_addr learned my addr 172.21.15.81:0/2395791039 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efef1615700 1 --2- 172.21.15.81:0/2395791039 >> v2:172.21.15.83:3300/0 conn(0x7efeec0d0b80 0x7efeec0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efef0e14700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efeec0d02b0 0x7efeec06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566398217 0 0) 0x7efeec0cf2d0 con 0x7efeec0d0f50 2023-10-06T02:49:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed8003570 con 0x7efeec0d0f50 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3634127181 0 0) 0x7efed8003570 con 0x7efeec0d0f50 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efeec0d02b0 msgr2=0x7efeec06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efeec0d02b0 0x7efeec06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 >> v2:172.21.15.83:3300/0 conn(0x7efeec0d0b80 msgr2=0x7efeec0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 --2- 172.21.15.81:0/2395791039 >> v2:172.21.15.83:3300/0 conn(0x7efeec0d0b80 0x7efeec0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0cf570 con 0x7efeec0d0f50 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7efee4001470 con 0x7efeec0d0f50 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 >> v1:172.21.15.81:6789/0 conn(0x7efeec0d0f50 legacy=0x7efeec15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efeec0d02b0 0x7efed8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efed8003fe0 0x7efed8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed8004d50 0x7efed80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec15a690 con 0x7efed8004d50 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec06dc00 con 0x7efed8003fe0 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.303+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed800ba90 con 0x7efeec0d02b0 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efef1e16700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed8004d50 0x7efed80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efef1615700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efeec0d02b0 0x7efed8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efef0e14700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efed8003fe0 0x7efed8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efef1e16700 1 -- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efeec0d02b0 msgr2=0x7efed8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efef1e16700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efeec0d02b0 0x7efed8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efef1e16700 1 -- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efed8003fe0 msgr2=0x7efed8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efef1e16700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efed8003fe0 0x7efed8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efef1e16700 1 -- 172.21.15.81:0/2395791039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8003570 con 0x7efed8004d50 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efef1e16700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed8004d50 0x7efed80051c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efee400c3c0 tx=0x7efeec0cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ca53f32b74d6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee400cc30 con 0x7efed8004d50 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee400cd90 con 0x7efed8004d50 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.304+0000 7efee3fff700 1 -- 172.21.15.81:0/2395791039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4005b70 con 0x7efed8004d50 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.305+0000 7efef2617700 1 -- 172.21.15.81:0/2395791039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed8004d50 msgr2=0x7efed80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.305+0000 7efef2617700 1 --2- 172.21.15.81:0/2395791039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed8004d50 0x7efed80051c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efee400c3c0 tx=0x7efeec0cf460 comp rx=0 tx=0).stop 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.305+0000 7efef1e16700 1 -- 172.21.15.81:0/2395791039 reap_dead start 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.305+0000 7efef2617700 1 -- 172.21.15.81:0/2395791039 shutdown_connections 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.305+0000 7efef2617700 1 -- 172.21.15.81:0/2395791039 >> 172.21.15.81:0/2395791039 conn(0x7efeec063230 msgr2=0x7efeec063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.305+0000 7efef2617700 1 -- 172.21.15.81:0/2395791039 shutdown_connections 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.305+0000 7efef2617700 1 -- 172.21.15.81:0/2395791039 wait complete. 2023-10-06T02:49:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.306+0000 7efef2617700 1 Processor -- start 2023-10-06T02:49:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.306+0000 7efef2617700 1 -- start start 2023-10-06T02:49:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef2617700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efed8004d50 0x7efeec150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef2617700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efeec15b400 0x7efeec15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef2617700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeec155270 0x7efeec1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef2617700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec160080 con 0x7efeec155270 2023-10-06T02:49:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef2617700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec151450 con 0x7efeec15b400 2023-10-06T02:49:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef2617700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec160e80 con 0x7efed8004d50 2023-10-06T02:49:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1e16700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeec155270 0x7efeec1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1e16700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeec155270 0x7efeec1556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55572/0 (socket says 172.21.15.81:55572) 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1e16700 1 -- 172.21.15.81:0/3010635679 learned_addr learned my addr 172.21.15.81:0/3010635679 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1615700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efed8004d50 0x7efeec150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef0e14700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efeec15b400 0x7efeec15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1e16700 1 -- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efed8004d50 msgr2=0x7efeec150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1e16700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efed8004d50 0x7efeec150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1e16700 1 -- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efeec15b400 msgr2=0x7efeec15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1e16700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efeec15b400 0x7efeec15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1e16700 1 -- 172.21.15.81:0/3010635679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec15c260 con 0x7efeec155270 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1615700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efed8004d50 0x7efeec150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef1e16700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeec155270 0x7efeec1556e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7efee4011000 tx=0x7efee4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efee17fa700 1 -- 172.21.15.81:0/3010635679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee400cc30 con 0x7efeec155270 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efee17fa700 1 -- 172.21.15.81:0/3010635679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee4001430 con 0x7efeec155270 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efee17fa700 1 -- 172.21.15.81:0/3010635679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4007530 con 0x7efeec155270 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec15bdb0 con 0x7efeec155270 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.307+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec160550 con 0x7efeec155270 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.308+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec160fc0 con 0x7efeec155270 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.309+0000 7efee17fa700 1 -- 172.21.15.81:0/3010635679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efee4019070 con 0x7efeec155270 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.309+0000 7efee17fa700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efed0066f30 0x7efed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.309+0000 7efee17fa700 1 -- 172.21.15.81:0/3010635679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6203+0+0 (secure 0 0 0) 0x7efee4085030 con 0x7efeec155270 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.309+0000 7efef1615700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efed0066f30 0x7efed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.309+0000 7efee17fa700 1 -- 172.21.15.81:0/3010635679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7efed006f2d0 con 0x7efeec155270 2023-10-06T02:49:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.310+0000 7efef1615700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efed0066f30 0x7efed00693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efee80094a0 tx=0x7efee800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.313+0000 7efee17fa700 1 -- 172.21.15.81:0/3010635679 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efeec160fc0 con 0x7efeec155270 2023-10-06T02:49:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.493+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efeec160fc0 con 0x7efeec155270 2023-10-06T02:49:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.493+0000 7efee17fa700 1 -- 172.21.15.81:0/3010635679 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v71) v1 ==== 92+0+10 (secure 0 0 0) 0x7efeec160fc0 con 0x7efeec155270 2023-10-06T02:49:43.496 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:49:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efed0066f30 msgr2=0x7efed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efed0066f30 0x7efed00693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efee80094a0 tx=0x7efee800b040 comp rx=0 tx=0).stop 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeec155270 msgr2=0x7efeec1556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeec155270 0x7efeec1556e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7efee4011000 tx=0x7efee4015000 comp rx=0 tx=0).stop 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 shutdown_connections 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeec155270 0x7efeec1556e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efed8004d50 0x7efeec150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efed0066f30 0x7efed00693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 --2- 172.21.15.81:0/3010635679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efeec15b400 0x7efeec15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 >> 172.21.15.81:0/3010635679 conn(0x7efeec063230 msgr2=0x7efeec0b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 shutdown_connections 2023-10-06T02:49:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.495+0000 7efef2617700 1 -- 172.21.15.81:0/3010635679 wait complete. 2023-10-06T02:49:43.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:49:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.627+0000 7fd472634700 1 Processor -- start 2023-10-06T02:49:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.627+0000 7fd472634700 1 -- start start 2023-10-06T02:49:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd472634700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd46c1578d0 0x7fd46c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd472634700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd46c06d120 0x7fd46c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd472634700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c0d07c0 con 0x7fd46c157ca0 2023-10-06T02:49:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd472634700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c06da50 con 0x7fd46c1578d0 2023-10-06T02:49:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd472634700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c0cfbb0 con 0x7fd46c06d120 2023-10-06T02:49:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd46bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd46c1578d0 0x7fd46c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd46bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd46c1578d0 0x7fd46c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55582/0 (socket says 172.21.15.81:55582) 2023-10-06T02:49:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd46bfff700 1 -- 172.21.15.81:0/3516968533 learned_addr learned my addr 172.21.15.81:0/3516968533 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd470bd1700 1 --2- 172.21.15.81:0/3516968533 >> v2:172.21.15.83:3300/0 conn(0x7fd46c06d120 0x7fd46c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd46bfff700 1 -- 172.21.15.81:0/3516968533 >> v2:172.21.15.83:3300/0 conn(0x7fd46c06d120 msgr2=0x7fd46c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd46bfff700 1 --2- 172.21.15.81:0/3516968533 >> v2:172.21.15.83:3300/0 conn(0x7fd46c06d120 0x7fd46c06d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd46bfff700 1 -- 172.21.15.81:0/3516968533 >> v1:172.21.15.83:6789/0 conn(0x7fd46c157ca0 legacy=0x7fd46c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.628+0000 7fd46bfff700 1 -- 172.21.15.81:0/3516968533 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c0cfe90 con 0x7fd46c1578d0 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd46bfff700 1 --2- 172.21.15.81:0/3516968533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c1578d0 0x7fd46c0cf4f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd46c068300 tx=0x7fd45c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c7087146dce769 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd46affd700 1 -- 172.21.15.81:0/3516968533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00b820 con 0x7fd46c1578d0 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd46affd700 1 -- 172.21.15.81:0/3516968533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c00b980 con 0x7fd46c1578d0 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd46affd700 1 -- 172.21.15.81:0/3516968533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00bd20 con 0x7fd46c1578d0 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd472634700 1 -- 172.21.15.81:0/3516968533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c1578d0 msgr2=0x7fd46c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd472634700 1 --2- 172.21.15.81:0/3516968533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c1578d0 0x7fd46c0cf4f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd46c068300 tx=0x7fd45c009250 comp rx=0 tx=0).stop 2023-10-06T02:49:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd472634700 1 -- 172.21.15.81:0/3516968533 shutdown_connections 2023-10-06T02:49:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd472634700 1 --2- 172.21.15.81:0/3516968533 >> v2:172.21.15.83:3300/0 conn(0x7fd46c06d120 0x7fd46c06d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd472634700 1 --2- 172.21.15.81:0/3516968533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c1578d0 0x7fd46c0cf4f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd472634700 1 -- 172.21.15.81:0/3516968533 >> 172.21.15.81:0/3516968533 conn(0x7fd46c06bb90 msgr2=0x7fd46c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd472634700 1 -- 172.21.15.81:0/3516968533 shutdown_connections 2023-10-06T02:49:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.629+0000 7fd472634700 1 -- 172.21.15.81:0/3516968533 wait complete. 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.630+0000 7fd472634700 1 Processor -- start 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd472634700 1 -- start start 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd472634700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd46c06d120 0x7fd46c153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd472634700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd46c1578d0 0x7fd46c0cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd472634700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c157ca0 0x7fd46c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd472634700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c16a5b0 con 0x7fd46c157ca0 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd472634700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c16a890 con 0x7fd46c1578d0 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd472634700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c16ab70 con 0x7fd46c06d120 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd470bd1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c157ca0 0x7fd46c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd470bd1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c157ca0 0x7fd46c0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55584/0 (socket says 172.21.15.81:55584) 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.631+0000 7fd470bd1700 1 -- 172.21.15.81:0/4184981440 learned_addr learned my addr 172.21.15.81:0/4184981440 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd46bfff700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd46c06d120 0x7fd46c153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd46b7fe700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd46c1578d0 0x7fd46c0cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd470bd1700 1 -- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd46c06d120 msgr2=0x7fd46c153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd470bd1700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd46c06d120 0x7fd46c153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd470bd1700 1 -- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd46c1578d0 msgr2=0x7fd46c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd470bd1700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd46c1578d0 0x7fd46c0cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd470bd1700 1 -- 172.21.15.81:0/4184981440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c0094f0 con 0x7fd46c157ca0 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd470bd1700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c157ca0 0x7fd46c0cd570 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd464009fa0 tx=0x7fd464009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd453fff700 1 -- 172.21.15.81:0/4184981440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46400ebc0 con 0x7fd46c157ca0 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd453fff700 1 -- 172.21.15.81:0/4184981440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46400ed20 con 0x7fd46c157ca0 2023-10-06T02:49:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd453fff700 1 -- 172.21.15.81:0/4184981440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464014670 con 0x7fd46c157ca0 2023-10-06T02:49:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c16ae50 con 0x7fd46c157ca0 2023-10-06T02:49:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.632+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c153760 con 0x7fd46c157ca0 2023-10-06T02:49:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.633+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c067ac0 con 0x7fd46c157ca0 2023-10-06T02:49:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.633+0000 7fd453fff700 1 -- 172.21.15.81:0/4184981440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4640149e0 con 0x7fd46c157ca0 2023-10-06T02:49:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.634+0000 7fd453fff700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd458066f30 0x7fd4580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.634+0000 7fd453fff700 1 -- 172.21.15.81:0/4184981440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fd464084dc0 con 0x7fd46c157ca0 2023-10-06T02:49:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.634+0000 7fd453fff700 1 -- 172.21.15.81:0/4184981440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7fd45806f2d0 con 0x7fd46c157ca0 2023-10-06T02:49:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.634+0000 7fd46bfff700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd458066f30 0x7fd4580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.634+0000 7fd46bfff700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd458066f30 0x7fd4580693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd46c068300 tx=0x7fd45c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.638+0000 7fd453fff700 1 -- 172.21.15.81:0/4184981440 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd464051e40 con 0x7fd46c157ca0 2023-10-06T02:49:43.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.819+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd46c0d0170 con 0x7fd46c157ca0 2023-10-06T02:49:43.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.819+0000 7fd453fff700 1 -- 172.21.15.81:0/4184981440 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd464055460 con 0x7fd46c157ca0 2023-10-06T02:49:43.822 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd458066f30 msgr2=0x7fd4580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd458066f30 0x7fd4580693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd46c068300 tx=0x7fd45c016000 comp rx=0 tx=0).stop 2023-10-06T02:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c157ca0 msgr2=0x7fd46c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c157ca0 0x7fd46c0cd570 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd464009fa0 tx=0x7fd464009900 comp rx=0 tx=0).stop 2023-10-06T02:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 shutdown_connections 2023-10-06T02:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c157ca0 0x7fd46c0cd570 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd46c06d120 0x7fd46c153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd458066f30 0x7fd4580693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 --2- 172.21.15.81:0/4184981440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd46c1578d0 0x7fd46c0cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 >> 172.21.15.81:0/4184981440 conn(0x7fd46c06bb90 msgr2=0x7fd46c154940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 shutdown_connections 2023-10-06T02:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.822+0000 7fd472634700 1 -- 172.21.15.81:0/4184981440 wait complete. 2023-10-06T02:49:43.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:49:43.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.949+0000 7f7013f2e700 1 Processor -- start 2023-10-06T02:49:43.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.949+0000 7f7013f2e700 1 -- start start 2023-10-06T02:49:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.950+0000 7f7013f2e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f700c1578d0 0x7f700c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.950+0000 7f7013f2e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f700c157ca0 0x7f700c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.950+0000 7f7013f2e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700c0d07c0 con 0x7f700c06d120 2023-10-06T02:49:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.950+0000 7f7013f2e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700c0cfbb0 con 0x7f700c157ca0 2023-10-06T02:49:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.950+0000 7f7013f2e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700c0cfe90 con 0x7f700c1578d0 2023-10-06T02:49:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.950+0000 7f70114c9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f700c157ca0 0x7f700c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.950+0000 7f70124cb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f700c06d120 0x7f700c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58332/0 (socket says 172.21.15.81:58332) 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.950+0000 7f70124cb700 1 -- 172.21.15.81:0/3757780764 learned_addr learned my addr 172.21.15.81:0/3757780764 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7011cca700 1 --2- 172.21.15.81:0/3757780764 >> v2:172.21.15.83:3300/0 conn(0x7f700c1578d0 0x7f700c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f70114c9700 1 -- 172.21.15.81:0/3757780764 >> v2:172.21.15.83:3300/0 conn(0x7f700c1578d0 msgr2=0x7f700c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f70114c9700 1 --2- 172.21.15.81:0/3757780764 >> v2:172.21.15.83:3300/0 conn(0x7f700c1578d0 0x7f700c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f70114c9700 1 -- 172.21.15.81:0/3757780764 >> v1:172.21.15.81:6789/0 conn(0x7f700c06d120 legacy=0x7f700c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f70114c9700 1 -- 172.21.15.81:0/3757780764 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c0d0170 con 0x7f700c157ca0 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7010cc8700 1 -- 172.21.15.81:0/3757780764 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621162147 0 0) 0x7f700c0d07c0 con 0x7f700c06d120 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f70114c9700 1 --2- 172.21.15.81:0/3757780764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 0x7f700c15af00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f700c0646b0 tx=0x7f6ffc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef4fc9ed016c45e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7010cc8700 1 -- 172.21.15.81:0/3757780764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00b6b0 con 0x7f700c157ca0 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7010cc8700 1 -- 172.21.15.81:0/3757780764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc00b810 con 0x7f700c157ca0 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7010cc8700 1 -- 172.21.15.81:0/3757780764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00bbb0 con 0x7f700c157ca0 2023-10-06T02:49:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7013f2e700 1 -- 172.21.15.81:0/3757780764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 msgr2=0x7f700c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7013f2e700 1 --2- 172.21.15.81:0/3757780764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 0x7f700c15af00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f700c0646b0 tx=0x7f6ffc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7013f2e700 1 -- 172.21.15.81:0/3757780764 shutdown_connections 2023-10-06T02:49:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7013f2e700 1 --2- 172.21.15.81:0/3757780764 >> v2:172.21.15.83:3300/0 conn(0x7f700c1578d0 0x7f700c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7013f2e700 1 --2- 172.21.15.81:0/3757780764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 0x7f700c15af00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.951+0000 7f7013f2e700 1 -- 172.21.15.81:0/3757780764 >> 172.21.15.81:0/3757780764 conn(0x7f700c06bb90 msgr2=0x7f700c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.952+0000 7f7013f2e700 1 -- 172.21.15.81:0/3757780764 shutdown_connections 2023-10-06T02:49:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.952+0000 7f7013f2e700 1 -- 172.21.15.81:0/3757780764 wait complete. 2023-10-06T02:49:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f7013f2e700 1 Processor -- start 2023-10-06T02:49:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f7013f2e700 1 -- start start 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f7013f2e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f700c06d120 0x7f700c149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f7013f2e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f700c1578d0 0x7f700c145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f7013f2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 0x7f700c145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f7013f2e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c146f20 con 0x7f700c157ca0 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f7013f2e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c145e80 con 0x7f700c1578d0 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f7013f2e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c146160 con 0x7f700c06d120 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f70124cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 0x7f700c145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f70124cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 0x7f700c145660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55600/0 (socket says 172.21.15.81:55600) 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f70124cb700 1 -- 172.21.15.81:0/1259366640 learned_addr learned my addr 172.21.15.81:0/1259366640 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.953+0000 7f70114c9700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f700c1578d0 0x7f700c145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f7011cca700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f700c06d120 0x7f700c149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f70124cb700 1 -- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f700c06d120 msgr2=0x7f700c149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f70124cb700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f700c06d120 0x7f700c149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f70124cb700 1 -- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f700c1578d0 msgr2=0x7f700c145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f70124cb700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f700c1578d0 0x7f700c145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f70124cb700 1 -- 172.21.15.81:0/1259366640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc009420 con 0x7f700c157ca0 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f70124cb700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 0x7f700c145660 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f700400cc90 tx=0x7f7004001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f7001ffb700 1 -- 172.21.15.81:0/1259366640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700400a960 con 0x7f700c157ca0 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f7001ffb700 1 -- 172.21.15.81:0/1259366640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700400aac0 con 0x7f700c157ca0 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700c146440 con 0x7f700c157ca0 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f7001ffb700 1 -- 172.21.15.81:0/1259366640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700400ae80 con 0x7f700c157ca0 2023-10-06T02:49:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.954+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c146a00 con 0x7f700c157ca0 2023-10-06T02:49:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.955+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700c146c20 con 0x7f700c157ca0 2023-10-06T02:49:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.955+0000 7f7001ffb700 1 -- 172.21.15.81:0/1259366640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7004007300 con 0x7f700c157ca0 2023-10-06T02:49:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.956+0000 7f7001ffb700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ff0066f30 0x7f6ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.956+0000 7f7001ffb700 1 -- 172.21.15.81:0/1259366640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f7004084b00 con 0x7f700c157ca0 2023-10-06T02:49:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.956+0000 7f7001ffb700 1 -- 172.21.15.81:0/1259366640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f6ff006f2d0 con 0x7f700c157ca0 2023-10-06T02:49:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.956+0000 7f7011cca700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ff0066f30 0x7f6ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.956+0000 7f7011cca700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ff0066f30 0x7f6ff00693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7008006fd0 tx=0x7f7008008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:43.960+0000 7f7001ffb700 1 -- 172.21.15.81:0/1259366640 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7004051c00 con 0x7f700c157ca0 2023-10-06T02:49:44.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.144+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f700c0d0450 con 0x7f700c157ca0 2023-10-06T02:49:44.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.144+0000 7f7001ffb700 1 -- 172.21.15.81:0/1259366640 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7004055220 con 0x7f700c157ca0 2023-10-06T02:49:44.146 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:49:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ff0066f30 msgr2=0x7f6ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ff0066f30 0x7f6ff00693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7008006fd0 tx=0x7f7008008040 comp rx=0 tx=0).stop 2023-10-06T02:49:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 msgr2=0x7f700c145660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 0x7f700c145660 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f700400cc90 tx=0x7f7004001a80 comp rx=0 tx=0).stop 2023-10-06T02:49:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 shutdown_connections 2023-10-06T02:49:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c157ca0 0x7f700c145660 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f700c06d120 0x7f700c149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ff0066f30 0x7f6ff00693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 --2- 172.21.15.81:0/1259366640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f700c1578d0 0x7f700c145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 >> 172.21.15.81:0/1259366640 conn(0x7f700c06bb90 msgr2=0x7f700c155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 shutdown_connections 2023-10-06T02:49:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.146+0000 7f7013f2e700 1 -- 172.21.15.81:0/1259366640 wait complete. 2023-10-06T02:49:44.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:49:44.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.272+0000 7f96c3890700 1 Processor -- start 2023-10-06T02:49:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.272+0000 7f96c3890700 1 -- start start 2023-10-06T02:49:44.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c3890700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f96bc157fe0 0x7f96bc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c3890700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96bc1583b0 0x7f96bc0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c3890700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc0ceb30 0x7f96bc0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c3890700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0cf4b0 con 0x7f96bc1583b0 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c3890700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0b2890 con 0x7f96bc157fe0 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c3890700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0b4070 con 0x7f96bc0ceb30 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c0e2b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96bc1583b0 0x7f96bc0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c0e2b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96bc1583b0 0x7f96bc0b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55608/0 (socket says 172.21.15.81:55608) 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c0e2b700 1 -- 172.21.15.81:0/879698685 learned_addr learned my addr 172.21.15.81:0/879698685 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c162c700 1 --2- 172.21.15.81:0/879698685 >> v2:172.21.15.83:3300/0 conn(0x7f96bc157fe0 0x7f96bc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c1e2d700 1 --2- 172.21.15.81:0/879698685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc0ceb30 0x7f96bc0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c0e2b700 1 -- 172.21.15.81:0/879698685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc0ceb30 msgr2=0x7f96bc0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c0e2b700 1 --2- 172.21.15.81:0/879698685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc0ceb30 0x7f96bc0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.273+0000 7f96c0e2b700 1 -- 172.21.15.81:0/879698685 >> v2:172.21.15.83:3300/0 conn(0x7f96bc157fe0 msgr2=0x7f96bc0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c0e2b700 1 --2- 172.21.15.81:0/879698685 >> v2:172.21.15.83:3300/0 conn(0x7f96bc157fe0 0x7f96bc0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c0e2b700 1 -- 172.21.15.81:0/879698685 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0b4350 con 0x7f96bc1583b0 2023-10-06T02:49:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c162c700 1 --2- 172.21.15.81:0/879698685 >> v2:172.21.15.83:3300/0 conn(0x7f96bc157fe0 0x7f96bc0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:49:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c1e2d700 1 --2- 172.21.15.81:0/879698685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc0ceb30 0x7f96bc0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:49:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c0e2b700 1 --2- 172.21.15.81:0/879698685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 0x7f96bc0b3a00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f96bc064d90 tx=0x7f96ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58440fadd7b3f36f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96b3fff700 1 -- 172.21.15.81:0/879698685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac00b860 con 0x7f96bc1583b0 2023-10-06T02:49:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96b3fff700 1 -- 172.21.15.81:0/879698685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac00b9c0 con 0x7f96bc1583b0 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96b3fff700 1 -- 172.21.15.81:0/879698685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac00bd80 con 0x7f96bc1583b0 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c3890700 1 -- 172.21.15.81:0/879698685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 msgr2=0x7f96bc0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c3890700 1 --2- 172.21.15.81:0/879698685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 0x7f96bc0b3a00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f96bc064d90 tx=0x7f96ac009250 comp rx=0 tx=0).stop 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c3890700 1 -- 172.21.15.81:0/879698685 shutdown_connections 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c3890700 1 --2- 172.21.15.81:0/879698685 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc0ceb30 0x7f96bc0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c3890700 1 --2- 172.21.15.81:0/879698685 >> v2:172.21.15.83:3300/0 conn(0x7f96bc157fe0 0x7f96bc0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c3890700 1 --2- 172.21.15.81:0/879698685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 0x7f96bc0b3a00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c3890700 1 -- 172.21.15.81:0/879698685 >> 172.21.15.81:0/879698685 conn(0x7f96bc067640 msgr2=0x7f96bc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c3890700 1 -- 172.21.15.81:0/879698685 shutdown_connections 2023-10-06T02:49:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.274+0000 7f96c3890700 1 -- 172.21.15.81:0/879698685 wait complete. 2023-10-06T02:49:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.275+0000 7f96c3890700 1 Processor -- start 2023-10-06T02:49:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.276+0000 7f96c3890700 1 -- start start 2023-10-06T02:49:44.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.276+0000 7f96c3890700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0ceb30 0x7f96bc1488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.276+0000 7f96c3890700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc157fe0 0x7f96bc06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.276+0000 7f96c3890700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 0x7f96bc1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.276+0000 7f96c3890700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc148e30 con 0x7f96bc1583b0 2023-10-06T02:49:44.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.276+0000 7f96c3890700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc06d9a0 con 0x7f96bc0ceb30 2023-10-06T02:49:44.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.276+0000 7f96c3890700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc06cdd0 con 0x7f96bc157fe0 2023-10-06T02:49:44.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c1e2d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 0x7f96bc1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c162c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0ceb30 0x7f96bc1488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c0e2b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc157fe0 0x7f96bc06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c1e2d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 0x7f96bc1552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55622/0 (socket says 172.21.15.81:55622) 2023-10-06T02:49:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c1e2d700 1 -- 172.21.15.81:0/3775101932 learned_addr learned my addr 172.21.15.81:0/3775101932 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c1e2d700 1 -- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc157fe0 msgr2=0x7f96bc06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c1e2d700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc157fe0 0x7f96bc06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c1e2d700 1 -- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0ceb30 msgr2=0x7f96bc1488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c1e2d700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0ceb30 0x7f96bc1488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c1e2d700 1 -- 172.21.15.81:0/3775101932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac0094f0 con 0x7f96bc1583b0 2023-10-06T02:49:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c1e2d700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 0x7f96bc1552e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f96b400c8b0 tx=0x7f96b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96b17fa700 1 -- 172.21.15.81:0/3775101932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4011600 con 0x7f96bc1583b0 2023-10-06T02:49:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96b17fa700 1 -- 172.21.15.81:0/3775101932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b4011780 con 0x7f96bc1583b0 2023-10-06T02:49:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc06d070 con 0x7f96bc1583b0 2023-10-06T02:49:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96b17fa700 1 -- 172.21.15.81:0/3775101932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4011b40 con 0x7f96bc1583b0 2023-10-06T02:49:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.277+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc06d630 con 0x7f96bc1583b0 2023-10-06T02:49:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.278+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc06db30 con 0x7f96bc1583b0 2023-10-06T02:49:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.278+0000 7f96b17fa700 1 -- 172.21.15.81:0/3775101932 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96b40193b0 con 0x7f96bc1583b0 2023-10-06T02:49:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.279+0000 7f96b17fa700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f96a0066f30 0x7f96a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.279+0000 7f96b17fa700 1 -- 172.21.15.81:0/3775101932 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f96b4084520 con 0x7f96bc1583b0 2023-10-06T02:49:44.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.279+0000 7f96c162c700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f96a0066f30 0x7f96a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.279+0000 7f96b17fa700 1 -- 172.21.15.81:0/3775101932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f96a006f2d0 con 0x7f96bc1583b0 2023-10-06T02:49:44.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.279+0000 7f96c162c700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f96a0066f30 0x7f96a00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f96b800d6e0 tx=0x7f96b8007850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:44.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.283+0000 7f96b17fa700 1 -- 172.21.15.81:0/3775101932 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96b40515a0 con 0x7f96bc1583b0 2023-10-06T02:49:44.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.507+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96bc0cc6b0 con 0x7f96bc1583b0 2023-10-06T02:49:44.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.507+0000 7f96b17fa700 1 -- 172.21.15.81:0/3775101932 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f96b4015090 con 0x7f96bc1583b0 2023-10-06T02:49:44.510 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:44.510 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1289364984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1289364984},{"type":"v1","addr":"172.21.15.83:6836","nonce":1289364984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3185368649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3185368649},{"type":"v1","addr":"172.21.15.83:6837","nonce":3185368649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5817,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/869401920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":869401920},{"type":"v1","addr":"172.21.15.81:6834","nonce":869401920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:48:16.417708+0000","modified":"2023-10-06T02:48:20.372496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2518286030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2518286030},{"type":"v1","addr":"172.21.15.81:6835","nonce":2518286030}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:49:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f96a0066f30 msgr2=0x7f96a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f96a0066f30 0x7f96a00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f96b800d6e0 tx=0x7f96b8007850 comp rx=0 tx=0).stop 2023-10-06T02:49:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 msgr2=0x7f96bc1552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 0x7f96bc1552e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f96b400c8b0 tx=0x7f96b4008040 comp rx=0 tx=0).stop 2023-10-06T02:49:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 shutdown_connections 2023-10-06T02:49:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc1583b0 0x7f96bc1552e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f96a0066f30 0x7f96a00693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0ceb30 0x7f96bc1488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 --2- 172.21.15.81:0/3775101932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc157fe0 0x7f96bc06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 >> 172.21.15.81:0/3775101932 conn(0x7f96bc067640 msgr2=0x7f96bc15d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 shutdown_connections 2023-10-06T02:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.509+0000 7f96c3890700 1 -- 172.21.15.81:0/3775101932 wait complete. 2023-10-06T02:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2023-10-06T02:49:44.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:49:44.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.637+0000 7fe5fe28b700 1 Processor -- start 2023-10-06T02:49:44.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.637+0000 7fe5fe28b700 1 -- start start 2023-10-06T02:49:44.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.638+0000 7fe5fe28b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5f80cf240 0x7fe5f80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.638+0000 7fe5fe28b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80b0ca0 con 0x7fe5f806d650 2023-10-06T02:49:44.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.638+0000 7fe5fe28b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80b00d0 con 0x7fe5f815a2a0 2023-10-06T02:49:44.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.638+0000 7fe5fe28b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f806ea90 con 0x7fe5f80cf240 2023-10-06T02:49:44.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.638+0000 7fe5f77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5f80cf240 0x7fe5f80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.638+0000 7fe5fc828700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe5f806d650 0x7fe5f806da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58342/0 (socket says 172.21.15.81:58342) 2023-10-06T02:49:44.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.638+0000 7fe5fc828700 1 -- 172.21.15.81:0/1598595058 learned_addr learned my addr 172.21.15.81:0/1598595058 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.639+0000 7fe5f77fe700 1 -- 172.21.15.81:0/1598595058 >> v1:172.21.15.83:6789/0 conn(0x7fe5f815a2a0 legacy=0x7fe5f80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.639+0000 7fe5f77fe700 1 -- 172.21.15.81:0/1598595058 >> v1:172.21.15.81:6789/0 conn(0x7fe5f806d650 legacy=0x7fe5f806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.639+0000 7fe5f6ffd700 1 -- 172.21.15.81:0/1598595058 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879601113 0 0) 0x7fe5f80b0ca0 con 0x7fe5f806d650 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.639+0000 7fe5f77fe700 1 -- 172.21.15.81:0/1598595058 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80b0370 con 0x7fe5f80cf240 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.639+0000 7fe5f77fe700 1 --2- 172.21.15.81:0/1598595058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 0x7fe5f80b1130 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0098e0 tx=0x7fe5ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475553c6c88a1aa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.639+0000 7fe5f6ffd700 1 -- 172.21.15.81:0/1598595058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec009e80 con 0x7fe5f80cf240 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.639+0000 7fe5f6ffd700 1 -- 172.21.15.81:0/1598595058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec00b860 con 0x7fe5f80cf240 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.639+0000 7fe5f6ffd700 1 -- 172.21.15.81:0/1598595058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00bbe0 con 0x7fe5f80cf240 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.640+0000 7fe5fe28b700 1 -- 172.21.15.81:0/1598595058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 msgr2=0x7fe5f80b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.640+0000 7fe5fe28b700 1 --2- 172.21.15.81:0/1598595058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 0x7fe5f80b1130 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0098e0 tx=0x7fe5ec0091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.640+0000 7fe5fe28b700 1 -- 172.21.15.81:0/1598595058 shutdown_connections 2023-10-06T02:49:44.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.640+0000 7fe5fe28b700 1 --2- 172.21.15.81:0/1598595058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 0x7fe5f80b1130 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.640+0000 7fe5fe28b700 1 -- 172.21.15.81:0/1598595058 >> 172.21.15.81:0/1598595058 conn(0x7fe5f8067640 msgr2=0x7fe5f8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:44.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.640+0000 7fe5fe28b700 1 -- 172.21.15.81:0/1598595058 shutdown_connections 2023-10-06T02:49:44.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.640+0000 7fe5fe28b700 1 -- 172.21.15.81:0/1598595058 wait complete. 2023-10-06T02:49:44.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.641+0000 7fe5fe28b700 1 Processor -- start 2023-10-06T02:49:44.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.641+0000 7fe5fe28b700 1 -- start start 2023-10-06T02:49:44.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5fe28b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5f806d650 0x7fe5f816ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5fe28b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 0x7fe5f80cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5fe28b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f815a2a0 0x7fe5f816e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5fe28b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80b1c70 con 0x7fe5f80cf240 2023-10-06T02:49:44.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5fe28b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80b3920 con 0x7fe5f815a2a0 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5fe28b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80b3310 con 0x7fe5f806d650 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 0x7fe5f80cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 0x7fe5f80cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55642/0 (socket says 172.21.15.81:55642) 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f77fe700 1 -- 172.21.15.81:0/2799083033 learned_addr learned my addr 172.21.15.81:0/2799083033 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f7fff700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5f806d650 0x7fe5f816ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5fc828700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f815a2a0 0x7fe5f816e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f77fe700 1 -- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5f806d650 msgr2=0x7fe5f816ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f77fe700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5f806d650 0x7fe5f816ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f77fe700 1 -- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f815a2a0 msgr2=0x7fe5f816e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f77fe700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f815a2a0 0x7fe5f816e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f77fe700 1 -- 172.21.15.81:0/2799083033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec009420 con 0x7fe5f80cf240 2023-10-06T02:49:44.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f7fff700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5f806d650 0x7fe5f816ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5f77fe700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 0x7fe5f80cdfa0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec013000 tx=0x7fe5ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5dffff700 1 -- 172.21.15.81:0/2799083033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec01f070 con 0x7fe5f80cf240 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5dffff700 1 -- 172.21.15.81:0/2799083033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec011420 con 0x7fe5f80cf240 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5dffff700 1 -- 172.21.15.81:0/2799083033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00bbe0 con 0x7fe5f80cf240 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f816ed30 con 0x7fe5f80cf240 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.642+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f816f010 con 0x7fe5f80cf240 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.643+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f80b3a90 con 0x7fe5f80cf240 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.644+0000 7fe5dffff700 1 -- 172.21.15.81:0/2799083033 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5ec011a50 con 0x7fe5f80cf240 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.644+0000 7fe5dffff700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e4066f30 0x7fe5e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.644+0000 7fe5dffff700 1 -- 172.21.15.81:0/2799083033 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fe5ec085d50 con 0x7fe5f80cf240 2023-10-06T02:49:44.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.644+0000 7fe5f7fff700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e4066f30 0x7fe5e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.644+0000 7fe5dffff700 1 -- 172.21.15.81:0/2799083033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fe5e406f2d0 con 0x7fe5f80cf240 2023-10-06T02:49:44.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.645+0000 7fe5f7fff700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e4066f30 0x7fe5e40693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8007fd0 tx=0x7fe5e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:44.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.648+0000 7fe5dffff700 1 -- 172.21.15.81:0/2799083033 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5ec028060 con 0x7fe5f80cf240 2023-10-06T02:49:44.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.830+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5f8071b10 con 0x7fe5f80cf240 2023-10-06T02:49:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.831+0000 7fe5dffff700 1 -- 172.21.15.81:0/2799083033 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+17116 (secure 0 0 0) 0x7fe5ec015020 con 0x7fe5f80cf240 2023-10-06T02:49:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:44.833 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:49:44.604453+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:48:14.055897+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:48:15.392030+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.39","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e4066f30 msgr2=0x7fe5e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e4066f30 0x7fe5e40693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8007fd0 tx=0x7fe5e8009040 comp rx=0 tx=0).stop 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 msgr2=0x7fe5f80cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 0x7fe5f80cdfa0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec013000 tx=0x7fe5ec017000 comp rx=0 tx=0).stop 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 shutdown_connections 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e4066f30 0x7fe5e40693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f815a2a0 0x7fe5f816e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5f806d650 0x7fe5f816ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 --2- 172.21.15.81:0/2799083033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f80cf240 0x7fe5f80cdfa0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 >> 172.21.15.81:0/2799083033 conn(0x7fe5f8067640 msgr2=0x7fe5f8156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:44.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 shutdown_connections 2023-10-06T02:49:44.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.833+0000 7fe5fe28b700 1 -- 172.21.15.81:0/2799083033 wait complete. 2023-10-06T02:49:44.847 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:49:44.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:49:44.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.959+0000 7f0b8b59e700 1 Processor -- start 2023-10-06T02:49:44.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.959+0000 7f0b8b59e700 1 -- start start 2023-10-06T02:49:44.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b8b59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0b8c0cf060 0x7f0b8c0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b8b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c067640 con 0x7f0b8c159bc0 2023-10-06T02:49:44.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b8b59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c0b1e50 con 0x7f0b8c159f90 2023-10-06T02:49:44.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b8b59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c067890 con 0x7f0b8c0cf060 2023-10-06T02:49:44.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b8a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0b8c159bc0 0x7f0b8c0ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58344/0 (socket says 172.21.15.81:58344) 2023-10-06T02:49:44.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b8a59c700 1 -- 172.21.15.81:0/1656170885 learned_addr learned my addr 172.21.15.81:0/1656170885 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:44.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b81d9b700 1 --2- 172.21.15.81:0/1656170885 >> v2:172.21.15.83:3300/0 conn(0x7f0b8c0cf060 0x7f0b8c0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b89d9b700 1 -- 172.21.15.81:0/1656170885 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642193644 0 0) 0x7f0b8c067640 con 0x7f0b8c159bc0 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b89d9b700 1 -- 172.21.15.81:0/1656170885 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b78003570 con 0x7f0b8c159bc0 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b81d9b700 1 -- 172.21.15.81:0/1656170885 >> v1:172.21.15.83:6789/0 conn(0x7f0b8c159f90 legacy=0x7f0b8c163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b81d9b700 1 -- 172.21.15.81:0/1656170885 >> v1:172.21.15.81:6789/0 conn(0x7f0b8c159bc0 legacy=0x7f0b8c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.960+0000 7f0b81d9b700 1 -- 172.21.15.81:0/1656170885 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c067b70 con 0x7f0b8c0cf060 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b81d9b700 1 --2- 172.21.15.81:0/1656170885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b8c0cf060 0x7f0b8c0b17c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0b740098e0 tx=0x7f0b740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=505e37c7f1c8d0d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b89d9b700 1 -- 172.21.15.81:0/1656170885 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400b640 con 0x7f0b8c0cf060 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b89d9b700 1 -- 172.21.15.81:0/1656170885 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7400b7a0 con 0x7f0b8c0cf060 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b89d9b700 1 -- 172.21.15.81:0/1656170885 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400bb40 con 0x7f0b8c0cf060 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b8b59e700 1 -- 172.21.15.81:0/1656170885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b8c0cf060 msgr2=0x7f0b8c0b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b8b59e700 1 --2- 172.21.15.81:0/1656170885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b8c0cf060 0x7f0b8c0b17c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0b740098e0 tx=0x7f0b740091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b8b59e700 1 -- 172.21.15.81:0/1656170885 shutdown_connections 2023-10-06T02:49:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b8b59e700 1 --2- 172.21.15.81:0/1656170885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b8c0cf060 0x7f0b8c0b17c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b8b59e700 1 -- 172.21.15.81:0/1656170885 >> 172.21.15.81:0/1656170885 conn(0x7f0b8c06c620 msgr2=0x7f0b8c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b8b59e700 1 -- 172.21.15.81:0/1656170885 shutdown_connections 2023-10-06T02:49:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.961+0000 7f0b8b59e700 1 -- 172.21.15.81:0/1656170885 wait complete. 2023-10-06T02:49:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8b59e700 1 Processor -- start 2023-10-06T02:49:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8b59e700 1 -- start start 2023-10-06T02:49:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8c0cf060 0x7f0b8c147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b8c159bc0 0x7f0b8c0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b8c159f90 0x7f0b8c0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0cdf60 con 0x7f0b8c0cf060 2023-10-06T02:49:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c156e60 con 0x7f0b8c159bc0 2023-10-06T02:49:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c157140 con 0x7f0b8c159f90 2023-10-06T02:49:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8c0cf060 0x7f0b8c147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8c0cf060 0x7f0b8c147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55646/0 (socket says 172.21.15.81:55646) 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b8a59c700 1 -- 172.21.15.81:0/746441995 learned_addr learned my addr 172.21.15.81:0/746441995 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.963+0000 7f0b81d9b700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b8c159bc0 0x7f0b8c0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b8ad9d700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b8c159f90 0x7f0b8c0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b8a59c700 1 -- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b8c159f90 msgr2=0x7f0b8c0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b8a59c700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b8c159f90 0x7f0b8c0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b8a59c700 1 -- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b8c159bc0 msgr2=0x7f0b8c0cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b8a59c700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b8c159bc0 0x7f0b8c0cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b8a59c700 1 -- 172.21.15.81:0/746441995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74009420 con 0x7f0b8c0cf060 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b8a59c700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8c0cf060 0x7f0b8c147390 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c7c0 tx=0x7f0b7c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b82ffd700 1 -- 172.21.15.81:0/746441995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c005b30 con 0x7f0b8c0cf060 2023-10-06T02:49:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b82ffd700 1 -- 172.21.15.81:0/746441995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c005cb0 con 0x7f0b8c0cf060 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b82ffd700 1 -- 172.21.15.81:0/746441995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c007320 con 0x7f0b8c0cf060 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c157420 con 0x7f0b8c0cf060 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.964+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c1478d0 con 0x7f0b8c0cf060 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.965+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c157660 con 0x7f0b8c0cf060 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.965+0000 7f0b82ffd700 1 -- 172.21.15.81:0/746441995 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b7c01b3b0 con 0x7f0b8c0cf060 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.966+0000 7f0b82ffd700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b6c066f30 0x7f0b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.966+0000 7f0b82ffd700 1 -- 172.21.15.81:0/746441995 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f0b7c083cb0 con 0x7f0b8c0cf060 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.966+0000 7f0b82ffd700 1 -- 172.21.15.81:0/746441995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f0b6c06f2d0 con 0x7f0b8c0cf060 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.966+0000 7f0b81d9b700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b6c066f30 0x7f0b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.966+0000 7f0b81d9b700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b6c066f30 0x7f0b6c0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0cf460 tx=0x7f0b74017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:44.970+0000 7f0b82ffd700 1 -- 172.21.15.81:0/746441995 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b7c017020 con 0x7f0b8c0cf060 2023-10-06T02:49:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.199+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b8c15c3e0 con 0x7f0b8c0cf060 2023-10-06T02:49:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.200+0000 7f0b82ffd700 1 -- 172.21.15.81:0/746441995 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f0b8c157660 con 0x7f0b8c0cf060 2023-10-06T02:49:45.203 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:45.203 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1289364984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1289364984},{"type":"v1","addr":"172.21.15.83:6836","nonce":1289364984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3185368649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3185368649},{"type":"v1","addr":"172.21.15.83:6837","nonce":3185368649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5817,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/869401920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":869401920},{"type":"v1","addr":"172.21.15.81:6834","nonce":869401920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:48:16.417708+0000","modified":"2023-10-06T02:48:20.372496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2518286030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2518286030},{"type":"v1","addr":"172.21.15.81:6835","nonce":2518286030}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:49:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b6c066f30 msgr2=0x7f0b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b6c066f30 0x7f0b6c0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0cf460 tx=0x7f0b74017000 comp rx=0 tx=0).stop 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8c0cf060 msgr2=0x7f0b8c147390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8c0cf060 0x7f0b8c147390 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c7c0 tx=0x7f0b7c007e00 comp rx=0 tx=0).stop 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 shutdown_connections 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b8c159f90 0x7f0b8c0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8c0cf060 0x7f0b8c147390 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b6c066f30 0x7f0b6c0693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 --2- 172.21.15.81:0/746441995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b8c159bc0 0x7f0b8c0cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 >> 172.21.15.81:0/746441995 conn(0x7f0b8c06c620 msgr2=0x7f0b8c15cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 shutdown_connections 2023-10-06T02:49:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.202+0000 7f0b8b59e700 1 -- 172.21.15.81:0/746441995 wait complete. 2023-10-06T02:49:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2023-10-06T02:49:45.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:49:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.327+0000 7f82d7a50700 1 Processor -- start 2023-10-06T02:49:45.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.327+0000 7f82d7a50700 1 -- start start 2023-10-06T02:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.328+0000 7f82d7a50700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82d01578d0 0x7f82d00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.328+0000 7f82d7a50700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d00d07c0 con 0x7f82d006d120 2023-10-06T02:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.328+0000 7f82d7a50700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d00cfbb0 con 0x7f82d0157ca0 2023-10-06T02:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.328+0000 7f82d7a50700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00cfe90 con 0x7f82d01578d0 2023-10-06T02:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.328+0000 7f82d57ec700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82d01578d0 0x7f82d00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.328+0000 7f82d57ec700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82d01578d0 0x7f82d00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55654/0 (socket says 172.21.15.81:55654) 2023-10-06T02:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.328+0000 7f82d5fed700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f82d006d120 0x7f82d006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58360/0 (socket says 172.21.15.81:58360) 2023-10-06T02:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.328+0000 7f82d57ec700 1 -- 172.21.15.81:0/668748113 learned_addr learned my addr 172.21.15.81:0/668748113 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82d57ec700 1 -- 172.21.15.81:0/668748113 >> v1:172.21.15.83:6789/0 conn(0x7f82d0157ca0 legacy=0x7f82d015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82d57ec700 1 -- 172.21.15.81:0/668748113 >> v1:172.21.15.81:6789/0 conn(0x7f82d006d120 legacy=0x7f82d006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82c7fff700 1 -- 172.21.15.81:0/668748113 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247284456 0 0) 0x7f82d00d07c0 con 0x7f82d006d120 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82d57ec700 1 -- 172.21.15.81:0/668748113 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00d0170 con 0x7f82d01578d0 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82d57ec700 1 --2- 172.21.15.81:0/668748113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 0x7f82d00cf4f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009f20 tx=0x7f82cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dba18a41290528 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82c7fff700 1 -- 172.21.15.81:0/668748113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00e070 con 0x7f82d01578d0 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82c7fff700 1 -- 172.21.15.81:0/668748113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc00ba40 con 0x7f82d01578d0 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82c7fff700 1 -- 172.21.15.81:0/668748113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0092e0 con 0x7f82d01578d0 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82d7a50700 1 -- 172.21.15.81:0/668748113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 msgr2=0x7f82d00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82d7a50700 1 --2- 172.21.15.81:0/668748113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 0x7f82d00cf4f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009f20 tx=0x7f82cc009840 comp rx=0 tx=0).stop 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82d7a50700 1 -- 172.21.15.81:0/668748113 shutdown_connections 2023-10-06T02:49:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82d7a50700 1 --2- 172.21.15.81:0/668748113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 0x7f82d00cf4f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.329+0000 7f82d7a50700 1 -- 172.21.15.81:0/668748113 >> 172.21.15.81:0/668748113 conn(0x7f82d006bb90 msgr2=0x7f82d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.330+0000 7f82d7a50700 1 -- 172.21.15.81:0/668748113 shutdown_connections 2023-10-06T02:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.330+0000 7f82d7a50700 1 -- 172.21.15.81:0/668748113 wait complete. 2023-10-06T02:49:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.331+0000 7f82d7a50700 1 Processor -- start 2023-10-06T02:49:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.331+0000 7f82d7a50700 1 -- start start 2023-10-06T02:49:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.331+0000 7f82d7a50700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d006d120 0x7f82d00b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.331+0000 7f82d7a50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 0x7f82d00c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d7a50700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d0157ca0 0x7f82d016a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d7a50700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00b5b40 con 0x7f82d01578d0 2023-10-06T02:49:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d7a50700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00b4f30 con 0x7f82d0157ca0 2023-10-06T02:49:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d7a50700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00b5210 con 0x7f82d006d120 2023-10-06T02:49:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d4feb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 0x7f82d00c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d4feb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 0x7f82d00c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55666/0 (socket says 172.21.15.81:55666) 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d4feb700 1 -- 172.21.15.81:0/2413491430 learned_addr learned my addr 172.21.15.81:0/2413491430 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d5fed700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d0157ca0 0x7f82d016a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d57ec700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d006d120 0x7f82d00b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d4feb700 1 -- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d006d120 msgr2=0x7f82d00b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d4feb700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d006d120 0x7f82d00b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d4feb700 1 -- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d0157ca0 msgr2=0x7f82d016a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d4feb700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d0157ca0 0x7f82d016a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d4feb700 1 -- 172.21.15.81:0/2413491430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc009ae0 con 0x7f82d01578d0 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d5fed700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d0157ca0 0x7f82d016a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:45.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d4feb700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 0x7f82d00c8350 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f82c000b5e0 tx=0x7f82c00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82c57fa700 1 -- 172.21.15.81:0/2413491430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000f510 con 0x7f82d01578d0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82c57fa700 1 -- 172.21.15.81:0/2413491430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c000f6b0 con 0x7f82d01578d0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d00b54f0 con 0x7f82d01578d0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82c57fa700 1 -- 172.21.15.81:0/2413491430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000fa70 con 0x7f82d01578d0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.332+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d00b6510 con 0x7f82d01578d0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.333+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d0067ac0 con 0x7f82d01578d0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.334+0000 7f82c57fa700 1 -- 172.21.15.81:0/2413491430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82c001a400 con 0x7f82d01578d0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.334+0000 7f82c57fa700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82b4066f30 0x7f82b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.334+0000 7f82c57fa700 1 -- 172.21.15.81:0/2413491430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f82c00842a0 con 0x7f82d01578d0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.334+0000 7f82d57ec700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82b4066f30 0x7f82b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.334+0000 7f82c57fa700 1 -- 172.21.15.81:0/2413491430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f82b406f2d0 con 0x7f82d01578d0 2023-10-06T02:49:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.335+0000 7f82d57ec700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82b4066f30 0x7f82b40693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009880 tx=0x7f82cc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.338+0000 7f82c57fa700 1 -- 172.21.15.81:0/2413491430 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82c00513a0 con 0x7f82d01578d0 2023-10-06T02:49:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.561+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82d00b5c80 con 0x7f82d01578d0 2023-10-06T02:49:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.562+0000 7f82c57fa700 1 -- 172.21.15.81:0/2413491430 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f82c00549c0 con 0x7f82d01578d0 2023-10-06T02:49:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:45.564 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1289364984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1289364984},{"type":"v1","addr":"172.21.15.83:6836","nonce":1289364984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3185368649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3185368649},{"type":"v1","addr":"172.21.15.83:6837","nonce":3185368649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5817,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/869401920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":869401920},{"type":"v1","addr":"172.21.15.81:6834","nonce":869401920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:48:16.417708+0000","modified":"2023-10-06T02:48:20.372496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2518286030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2518286030},{"type":"v1","addr":"172.21.15.81:6835","nonce":2518286030}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:49:45.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82b4066f30 msgr2=0x7f82b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82b4066f30 0x7f82b40693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009880 tx=0x7f82cc017000 comp rx=0 tx=0).stop 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 msgr2=0x7f82d00c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 0x7f82d00c8350 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f82c000b5e0 tx=0x7f82c00090f0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 shutdown_connections 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82b4066f30 0x7f82b40693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d0157ca0 0x7f82d016a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d006d120 0x7f82d00b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 --2- 172.21.15.81:0/2413491430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d01578d0 0x7f82d00c8350 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 >> 172.21.15.81:0/2413491430 conn(0x7f82d006bb90 msgr2=0x7f82d0154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 shutdown_connections 2023-10-06T02:49:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.564+0000 7f82d7a50700 1 -- 172.21.15.81:0/2413491430 wait complete. 2023-10-06T02:49:45.568 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2023-10-06T02:49:45.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:49:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.690+0000 7f779b30f700 1 Processor -- start 2023-10-06T02:49:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.690+0000 7f779b30f700 1 -- start start 2023-10-06T02:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f779b30f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7794067640 0x7f7794067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f779b30f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f77940ce890 0x7f77940cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f779b30f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7794067ff0 con 0x7f77940add30 2023-10-06T02:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f779b30f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77940b37b0 con 0x7f7794067640 2023-10-06T02:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f779b30f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77940cf230 con 0x7f77940ce890 2023-10-06T02:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f7799b0c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7794067640 0x7f7794067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f779a30d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f77940add30 0x7f77940b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58372/0 (socket says 172.21.15.81:58372) 2023-10-06T02:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f779a30d700 1 -- 172.21.15.81:0/3009100019 learned_addr learned my addr 172.21.15.81:0/3009100019 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f779ab0e700 1 --2- 172.21.15.81:0/3009100019 >> v2:172.21.15.83:3300/0 conn(0x7f77940ce890 0x7f77940cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f7799b0c700 1 -- 172.21.15.81:0/3009100019 >> v2:172.21.15.83:3300/0 conn(0x7f77940ce890 msgr2=0x7f77940cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f7799b0c700 1 --2- 172.21.15.81:0/3009100019 >> v2:172.21.15.83:3300/0 conn(0x7f77940ce890 0x7f77940cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f7799b0c700 1 -- 172.21.15.81:0/3009100019 >> v1:172.21.15.81:6789/0 conn(0x7f77940add30 legacy=0x7f77940b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f7799b0c700 1 -- 172.21.15.81:0/3009100019 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77940b17c0 con 0x7f7794067640 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.691+0000 7f779930b700 1 -- 172.21.15.81:0/3009100019 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674200051 0 0) 0x7f7794067ff0 con 0x7f77940add30 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f7799b0c700 1 --2- 172.21.15.81:0/3009100019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 0x7f7794067ab0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f77940cfaf0 tx=0x7f77840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1bc3a433273065 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779930b700 1 -- 172.21.15.81:0/3009100019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400b6b0 con 0x7f7794067640 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779930b700 1 -- 172.21.15.81:0/3009100019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778400b810 con 0x7f7794067640 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779930b700 1 -- 172.21.15.81:0/3009100019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400bbb0 con 0x7f7794067640 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779b30f700 1 -- 172.21.15.81:0/3009100019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 msgr2=0x7f7794067ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779b30f700 1 --2- 172.21.15.81:0/3009100019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 0x7f7794067ab0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f77940cfaf0 tx=0x7f77840091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779b30f700 1 -- 172.21.15.81:0/3009100019 shutdown_connections 2023-10-06T02:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779b30f700 1 --2- 172.21.15.81:0/3009100019 >> v2:172.21.15.83:3300/0 conn(0x7f77940ce890 0x7f77940cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779b30f700 1 --2- 172.21.15.81:0/3009100019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 0x7f7794067ab0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779b30f700 1 -- 172.21.15.81:0/3009100019 >> 172.21.15.81:0/3009100019 conn(0x7f779406c620 msgr2=0x7f779406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779b30f700 1 -- 172.21.15.81:0/3009100019 shutdown_connections 2023-10-06T02:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.692+0000 7f779b30f700 1 -- 172.21.15.81:0/3009100019 wait complete. 2023-10-06T02:49:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.693+0000 7f779b30f700 1 Processor -- start 2023-10-06T02:49:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.693+0000 7f779b30f700 1 -- start start 2023-10-06T02:49:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779b30f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 0x7f77940ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779b30f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77940add30 0x7f7794144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779b30f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77940ce890 0x7f77940aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779b30f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779406e080 con 0x7f7794067640 2023-10-06T02:49:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779b30f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77940ad040 con 0x7f77940ce890 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779b30f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779406d750 con 0x7f77940add30 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779a30d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 0x7f77940ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779a30d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 0x7f77940ac9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55680/0 (socket says 172.21.15.81:55680) 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779a30d700 1 -- 172.21.15.81:0/1803765311 learned_addr learned my addr 172.21.15.81:0/1803765311 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f779a30d700 1 -- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77940add30 msgr2=0x7f7794144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.694+0000 7f7799b0c700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77940add30 0x7f7794144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f779a30d700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77940add30 0x7f7794144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f779ab0e700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77940ce890 0x7f77940aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f779a30d700 1 -- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77940ce890 msgr2=0x7f77940aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f779a30d700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77940ce890 0x7f77940aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f779a30d700 1 -- 172.21.15.81:0/1803765311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7784009420 con 0x7f7794067640 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f779a30d700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 0x7f77940ac9a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f779000c7e0 tx=0x7f7790007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f778a7fc700 1 -- 172.21.15.81:0/1803765311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790005b30 con 0x7f7794067640 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f778a7fc700 1 -- 172.21.15.81:0/1803765311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790005c90 con 0x7f7794067640 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779406da30 con 0x7f7794067640 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f778a7fc700 1 -- 172.21.15.81:0/1803765311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790007300 con 0x7f7794067640 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.695+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779406e510 con 0x7f7794067640 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.696+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7794069920 con 0x7f7794067640 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.696+0000 7f778a7fc700 1 -- 172.21.15.81:0/1803765311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f779001b400 con 0x7f7794067640 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.697+0000 7f778a7fc700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7778066f30 0x7f77780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.697+0000 7f778a7fc700 1 -- 172.21.15.81:0/1803765311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f7790084230 con 0x7f7794067640 2023-10-06T02:49:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.697+0000 7f778a7fc700 1 -- 172.21.15.81:0/1803765311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f777806f2d0 con 0x7f7794067640 2023-10-06T02:49:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.697+0000 7f7799b0c700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7778066f30 0x7f77780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.697+0000 7f7799b0c700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7778066f30 0x7f77780693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f779416d3c0 tx=0x7f7784017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.701+0000 7f778a7fc700 1 -- 172.21.15.81:0/1803765311 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7790051330 con 0x7f7794067640 2023-10-06T02:49:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.882+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7794071b10 con 0x7f7794067640 2023-10-06T02:49:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.883+0000 7f778a7fc700 1 -- 172.21.15.81:0/1803765311 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+17116 (secure 0 0 0) 0x7f7790054950 con 0x7f7794067640 2023-10-06T02:49:45.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:49:44.604453+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:48:14.055897+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:48:15.392030+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.39","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:49:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7778066f30 msgr2=0x7f77780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7778066f30 0x7f77780693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f779416d3c0 tx=0x7f7784017000 comp rx=0 tx=0).stop 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 msgr2=0x7f77940ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 0x7f77940ac9a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f779000c7e0 tx=0x7f7790007df0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 shutdown_connections 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7778066f30 0x7f77780693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77940ce890 0x7f77940aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794067640 0x7f77940ac9a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 --2- 172.21.15.81:0/1803765311 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77940add30 0x7f7794144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 >> 172.21.15.81:0/1803765311 conn(0x7f779406c620 msgr2=0x7f77940b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 shutdown_connections 2023-10-06T02:49:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:45.885+0000 7f779b30f700 1 -- 172.21.15.81:0/1803765311 wait complete. 2023-10-06T02:49:45.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:49:46.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.011+0000 7feed6894700 1 Processor -- start 2023-10-06T02:49:46.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.011+0000 7feed6894700 1 -- start start 2023-10-06T02:49:46.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed6894700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7feed0157ca0 0x7feed00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed6894700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feed006d120 0x7feed006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed6894700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed00d07c0 con 0x7feed01578d0 2023-10-06T02:49:46.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed6894700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed006da50 con 0x7feed006d120 2023-10-06T02:49:46.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed6894700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed00cfbb0 con 0x7feed0157ca0 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed4e31700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feed006d120 0x7feed006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed4e31700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feed006d120 0x7feed006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55696/0 (socket says 172.21.15.81:55696) 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed4e31700 1 -- 172.21.15.81:0/4147505177 learned_addr learned my addr 172.21.15.81:0/4147505177 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feecf7fe700 1 --2- 172.21.15.81:0/4147505177 >> v2:172.21.15.83:3300/0 conn(0x7feed0157ca0 0x7feed00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed4e31700 1 -- 172.21.15.81:0/4147505177 >> v2:172.21.15.83:3300/0 conn(0x7feed0157ca0 msgr2=0x7feed00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed4e31700 1 --2- 172.21.15.81:0/4147505177 >> v2:172.21.15.83:3300/0 conn(0x7feed0157ca0 0x7feed00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed4e31700 1 -- 172.21.15.81:0/4147505177 >> v1:172.21.15.83:6789/0 conn(0x7feed01578d0 legacy=0x7feed015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed4e31700 1 -- 172.21.15.81:0/4147505177 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00cfe90 con 0x7feed006d120 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feed4e31700 1 --2- 172.21.15.81:0/4147505177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 0x7feed006d510 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feed0068510 tx=0x7feec8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e30ebbce2ccf79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.012+0000 7feeceffd700 1 -- 172.21.15.81:0/4147505177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec800e070 con 0x7feed006d120 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feeceffd700 1 -- 172.21.15.81:0/4147505177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec800ba20 con 0x7feed006d120 2023-10-06T02:49:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feeceffd700 1 -- 172.21.15.81:0/4147505177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80092e0 con 0x7feed006d120 2023-10-06T02:49:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feed6894700 1 -- 172.21.15.81:0/4147505177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 msgr2=0x7feed006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feed6894700 1 --2- 172.21.15.81:0/4147505177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 0x7feed006d510 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feed0068510 tx=0x7feec8009840 comp rx=0 tx=0).stop 2023-10-06T02:49:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feed6894700 1 -- 172.21.15.81:0/4147505177 shutdown_connections 2023-10-06T02:49:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feed6894700 1 --2- 172.21.15.81:0/4147505177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 0x7feed006d510 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feed6894700 1 --2- 172.21.15.81:0/4147505177 >> v2:172.21.15.83:3300/0 conn(0x7feed0157ca0 0x7feed00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feed6894700 1 -- 172.21.15.81:0/4147505177 >> 172.21.15.81:0/4147505177 conn(0x7feed006bb90 msgr2=0x7feed006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feed6894700 1 -- 172.21.15.81:0/4147505177 shutdown_connections 2023-10-06T02:49:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.013+0000 7feed6894700 1 -- 172.21.15.81:0/4147505177 wait complete. 2023-10-06T02:49:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.014+0000 7feed6894700 1 Processor -- start 2023-10-06T02:49:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.014+0000 7feed6894700 1 -- start start 2023-10-06T02:49:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feed6894700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 0x7feed00b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feed6894700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feed01578d0 0x7feed01548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feed6894700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feed0157ca0 0x7feed0069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feed6894700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00b62a0 con 0x7feed006d120 2023-10-06T02:49:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feed6894700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00b5b10 con 0x7feed01578d0 2023-10-06T02:49:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feed6894700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00b4f90 con 0x7feed0157ca0 2023-10-06T02:49:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feecffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 0x7feed00b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feecffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 0x7feed00b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55708/0 (socket says 172.21.15.81:55708) 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feecffff700 1 -- 172.21.15.81:0/1133464934 learned_addr learned my addr 172.21.15.81:0/1133464934 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feecf7fe700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feed01578d0 0x7feed01548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feed4e31700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feed0157ca0 0x7feed0069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feecffff700 1 -- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feed0157ca0 msgr2=0x7feed0069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feecffff700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feed0157ca0 0x7feed0069e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feecffff700 1 -- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feed01578d0 msgr2=0x7feed01548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.015+0000 7feecffff700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feed01578d0 0x7feed01548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.016+0000 7feecffff700 1 -- 172.21.15.81:0/1133464934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8009ae0 con 0x7feed006d120 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.016+0000 7feed4e31700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feed0157ca0 0x7feed0069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.016+0000 7feecffff700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 0x7feed00b6600 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feec000c590 tx=0x7feec000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.016+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0011590 con 0x7feed006d120 2023-10-06T02:49:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.016+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0011710 con 0x7feed006d120 2023-10-06T02:49:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.016+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed00b5270 con 0x7feed006d120 2023-10-06T02:49:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.016+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0011ad0 con 0x7feed006d120 2023-10-06T02:49:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.016+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed00b5830 con 0x7feed006d120 2023-10-06T02:49:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.017+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed016a070 con 0x7feed006d120 2023-10-06T02:49:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.018+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feec001c440 con 0x7feed006d120 2023-10-06T02:49:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.018+0000 7feeb7fff700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feebc066f30 0x7feebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.018+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6203+0+0 (secure 0 0 0) 0x7feec00841a0 con 0x7feed006d120 2023-10-06T02:49:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.018+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7feebc06f2d0 con 0x7feed006d120 2023-10-06T02:49:46.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.018+0000 7feecf7fe700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feebc066f30 0x7feebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.019+0000 7feecf7fe700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feebc066f30 0x7feebc0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feed0071cd0 tx=0x7feec40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:46.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.022+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feec0017060 con 0x7feed006d120 2023-10-06T02:49:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.247+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feed016a070 con 0x7feed006d120 2023-10-06T02:49:46.250 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:49:46.248+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-06T02:49:46.250 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:49:46.248+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:49:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.250+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(73..73 src has 1..73) v4 ==== 382+0+0 (secure 0 0 0) 0x7feec0055660 con 0x7feed006d120 2023-10-06T02:49:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.250+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7feebc06fc90 con 0x7feed006d120 2023-10-06T02:49:46.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.252+0000 7feeb7fff700 1 -- 172.21.15.81:0/1133464934 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7feed016a070 con 0x7feed006d120 2023-10-06T02:49:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feebc066f30 msgr2=0x7feebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feebc066f30 0x7feebc0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feed0071cd0 tx=0x7feec40091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 msgr2=0x7feed00b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 0x7feed00b6600 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feec000c590 tx=0x7feec000c8a0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 shutdown_connections 2023-10-06T02:49:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feed0157ca0 0x7feed0069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feed006d120 0x7feed00b6600 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feebc066f30 0x7feebc0693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 --2- 172.21.15.81:0/1133464934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feed01578d0 0x7feed01548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 >> 172.21.15.81:0/1133464934 conn(0x7feed006bb90 msgr2=0x7feed0156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.255+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 shutdown_connections 2023-10-06T02:49:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.256+0000 7feed6894700 1 -- 172.21.15.81:0/1133464934 wait complete. 2023-10-06T02:49:46.259 INFO:tasks.ceph.mds.a.smithi081.stderr: -9240> 2023-10-06T02:48:22.019+0000 7f390bc79700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:49:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:49:46.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:49:46.288 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:49:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.385+0000 7ff2ccc0c700 1 Processor -- start 2023-10-06T02:49:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.385+0000 7ff2ccc0c700 1 -- start start 2023-10-06T02:49:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.386+0000 7ff2ccc0c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2c8156310 0x7ff2c806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.386+0000 7ff2ccc0c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff2c80ac830 0x7ff2c806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.386+0000 7ff2ccc0c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c80acdf0 con 0x7ff2c8155f40 2023-10-06T02:49:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.386+0000 7ff2ccc0c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c80ad970 con 0x7ff2c8156310 2023-10-06T02:49:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.386+0000 7ff2ccc0c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c80ad0d0 con 0x7ff2c80ac830 2023-10-06T02:49:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.386+0000 7ff2c6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2c8156310 0x7ff2c806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.386+0000 7ff2c6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2c8156310 0x7ff2c806cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55728/0 (socket says 172.21.15.81:55728) 2023-10-06T02:49:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.386+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2877732880 learned_addr learned my addr 172.21.15.81:0/2877732880 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.386+0000 7ff2c7fff700 1 --2- 172.21.15.81:0/2877732880 >> v2:172.21.15.83:3300/0 conn(0x7ff2c80ac830 0x7ff2c806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2877732880 >> v2:172.21.15.83:3300/0 conn(0x7ff2c80ac830 msgr2=0x7ff2c806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2c6ffd700 1 --2- 172.21.15.81:0/2877732880 >> v2:172.21.15.83:3300/0 conn(0x7ff2c80ac830 0x7ff2c806d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2877732880 >> v1:172.21.15.83:6789/0 conn(0x7ff2c8155f40 legacy=0x7ff2c80aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2877732880 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c80ad3b0 con 0x7ff2c8156310 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2c7fff700 1 --2- 172.21.15.81:0/2877732880 >> v2:172.21.15.83:3300/0 conn(0x7ff2c80ac830 0x7ff2c806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2c6ffd700 1 --2- 172.21.15.81:0/2877732880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8156310 0x7ff2c806cba0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff2c806e390 tx=0x7ff2bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115648e22a3d0ac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2c67fc700 1 -- 172.21.15.81:0/2877732880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00b860 con 0x7ff2c8156310 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2c67fc700 1 -- 172.21.15.81:0/2877732880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc00b9c0 con 0x7ff2c8156310 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2c67fc700 1 -- 172.21.15.81:0/2877732880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00bd60 con 0x7ff2c8156310 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/2877732880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8156310 msgr2=0x7ff2c806cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2ccc0c700 1 --2- 172.21.15.81:0/2877732880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8156310 0x7ff2c806cba0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff2c806e390 tx=0x7ff2bc009250 comp rx=0 tx=0).stop 2023-10-06T02:49:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/2877732880 shutdown_connections 2023-10-06T02:49:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2ccc0c700 1 --2- 172.21.15.81:0/2877732880 >> v2:172.21.15.83:3300/0 conn(0x7ff2c80ac830 0x7ff2c806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2ccc0c700 1 --2- 172.21.15.81:0/2877732880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8156310 0x7ff2c806cba0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/2877732880 >> 172.21.15.81:0/2877732880 conn(0x7ff2c80cdb30 msgr2=0x7ff2c806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/2877732880 shutdown_connections 2023-10-06T02:49:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.387+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/2877732880 wait complete. 2023-10-06T02:49:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.389+0000 7ff2ccc0c700 1 Processor -- start 2023-10-06T02:49:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.389+0000 7ff2ccc0c700 1 -- start start 2023-10-06T02:49:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.389+0000 7ff2ccc0c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2c80ac830 0x7ff2c814a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.389+0000 7ff2ccc0c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8155f40 0x7ff2c816b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.389+0000 7ff2ccc0c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2c8156310 0x7ff2c8157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.389+0000 7ff2ccc0c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c8157b10 con 0x7ff2c8155f40 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.389+0000 7ff2ccc0c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c8157680 con 0x7ff2c8156310 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.389+0000 7ff2ccc0c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c816ba50 con 0x7ff2c80ac830 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.389+0000 7ff2c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8155f40 0x7ff2c816b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8155f40 0x7ff2c816b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55744/0 (socket says 172.21.15.81:55744) 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/1394921763 learned_addr learned my addr 172.21.15.81:0/1394921763 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c7fff700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2c8156310 0x7ff2c8157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c77fe700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2c80ac830 0x7ff2c814a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2c80ac830 msgr2=0x7ff2c814a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c6ffd700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2c80ac830 0x7ff2c814a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2c8156310 msgr2=0x7ff2c8157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c6ffd700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2c8156310 0x7ff2c8157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/1394921763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc0094f0 con 0x7ff2c8155f40 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c7fff700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2c8156310 0x7ff2c8157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2c6ffd700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8155f40 0x7ff2c816b510 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009290 tx=0x7ff2bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2af7fe700 1 -- 172.21.15.81:0/1394921763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc011e60 con 0x7ff2c8155f40 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2af7fe700 1 -- 172.21.15.81:0/1394921763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc01f070 con 0x7ff2c8155f40 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c8156a70 con 0x7ff2c8155f40 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2af7fe700 1 -- 172.21.15.81:0/1394921763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc01a870 con 0x7ff2c8155f40 2023-10-06T02:49:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.390+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c8157030 con 0x7ff2c8155f40 2023-10-06T02:49:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.391+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c80682b0 con 0x7ff2c8155f40 2023-10-06T02:49:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.391+0000 7ff2af7fe700 1 -- 172.21.15.81:0/1394921763 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2bc01abe0 con 0x7ff2c8155f40 2023-10-06T02:49:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.392+0000 7ff2af7fe700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2b4066f30 0x7ff2b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.392+0000 7ff2af7fe700 1 -- 172.21.15.81:0/1394921763 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6289+0+0 (secure 0 0 0) 0x7ff2bc021070 con 0x7ff2c8155f40 2023-10-06T02:49:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.392+0000 7ff2af7fe700 1 -- 172.21.15.81:0/1394921763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7ff2b406f390 con 0x7ff2c8155f40 2023-10-06T02:49:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.392+0000 7ff2c77fe700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2b4066f30 0x7ff2b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.392+0000 7ff2c77fe700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2b4066f30 0x7ff2b40693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8001760 tx=0x7ff2b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.396+0000 7ff2af7fe700 1 -- 172.21.15.81:0/1394921763 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2bc015060 con 0x7ff2c8155f40 2023-10-06T02:49:46.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:46.621+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff2c81577c0 con 0x7ff2c8155f40 2023-10-06T02:49:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.253+0000 7ff2af7fe700 1 -- 172.21.15.81:0/1394921763 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff2bc053750 con 0x7ff2c8155f40 2023-10-06T02:49:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2b4066f30 msgr2=0x7ff2b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2b4066f30 0x7ff2b40693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8001760 tx=0x7ff2b8009040 comp rx=0 tx=0).stop 2023-10-06T02:49:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8155f40 msgr2=0x7ff2c816b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8155f40 0x7ff2c816b510 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009290 tx=0x7ff2bc017000 comp rx=0 tx=0).stop 2023-10-06T02:49:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 shutdown_connections 2023-10-06T02:49:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2b4066f30 0x7ff2b40693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2c8156310 0x7ff2c8157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2c80ac830 0x7ff2c814a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 --2- 172.21.15.81:0/1394921763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8155f40 0x7ff2c816b510 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 >> 172.21.15.81:0/1394921763 conn(0x7ff2c80cdb30 msgr2=0x7ff2c8069070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 shutdown_connections 2023-10-06T02:49:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.255+0000 7ff2ccc0c700 1 -- 172.21.15.81:0/1394921763 wait complete. 2023-10-06T02:49:47.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:49:47.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.426+0000 7f2c4f86c700 1 Processor -- start 2023-10-06T02:49:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.426+0000 7f2c4f86c700 1 -- start start 2023-10-06T02:49:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.427+0000 7f2c4f86c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815a2a0 0x7f2c480b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.427+0000 7f2c4f86c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2c480ceb30 0x7f2c480cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.427+0000 7f2c4f86c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c480cf4e0 con 0x7f2c4806d650 2023-10-06T02:49:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.427+0000 7f2c4f86c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4806ea90 con 0x7f2c480ceb30 2023-10-06T02:49:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.427+0000 7f2c4f86c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480b0ca0 con 0x7f2c4815a2a0 2023-10-06T02:49:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.427+0000 7f2c4de09700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2c4806d650 0x7f2c4806da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58384/0 (socket says 172.21.15.81:58384) 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.427+0000 7f2c4de09700 1 -- 172.21.15.81:0/3949780578 learned_addr learned my addr 172.21.15.81:0/3949780578 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4ce07700 1 --2- 172.21.15.81:0/3949780578 >> v2:172.21.15.83:3300/0 conn(0x7f2c480ceb30 0x7f2c480cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4d608700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815a2a0 0x7f2c480b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898915925 0 0) 0x7f2c480cf4e0 con 0x7f2c4806d650 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c34003570 con 0x7f2c4806d650 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1618950459 0 0) 0x7f2c34003570 con 0x7f2c4806d650 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815a2a0 msgr2=0x7f2c480b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815a2a0 0x7f2c480b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 >> v2:172.21.15.83:3300/0 conn(0x7f2c480ceb30 msgr2=0x7f2c480cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 --2- 172.21.15.81:0/3949780578 >> v2:172.21.15.83:3300/0 conn(0x7f2c480ceb30 0x7f2c480cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480b00d0 con 0x7f2c4806d650 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f2c40001470 con 0x7f2c4806d650 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 >> v1:172.21.15.81:6789/0 conn(0x7f2c4806d650 legacy=0x7f2c4806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815a2a0 0x7f2c34003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c34003fe0 0x7f2c34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c34004d50 0x7f2c340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4806ea90 con 0x7f2c34004d50 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480b0ca0 con 0x7f2c34003fe0 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3400ba90 con 0x7f2c4815a2a0 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4de09700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c34004d50 0x7f2c340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4d608700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815a2a0 0x7f2c34003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4ce07700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c34003fe0 0x7f2c34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4de09700 1 -- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815a2a0 msgr2=0x7f2c34003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4de09700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815a2a0 0x7f2c34003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4de09700 1 -- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c34003fe0 msgr2=0x7f2c34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4de09700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c34003fe0 0x7f2c34004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4de09700 1 -- 172.21.15.81:0/3949780578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c34003570 con 0x7f2c34004d50 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.428+0000 7f2c4ce07700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c34003fe0 0x7f2c34004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c4de09700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c34004d50 0x7f2c340051c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000c3c0 tx=0x7f2c40001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac4c98ab0072ff3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000cc30 con 0x7f2c34004d50 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000cdd0 con 0x7f2c34004d50 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c3ffff700 1 -- 172.21.15.81:0/3949780578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40005b70 con 0x7f2c34004d50 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c4f86c700 1 -- 172.21.15.81:0/3949780578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c34004d50 msgr2=0x7f2c340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c4f86c700 1 --2- 172.21.15.81:0/3949780578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c34004d50 0x7f2c340051c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000c3c0 tx=0x7f2c40001e90 comp rx=0 tx=0).stop 2023-10-06T02:49:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c4de09700 1 -- 172.21.15.81:0/3949780578 reap_dead start 2023-10-06T02:49:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c4f86c700 1 -- 172.21.15.81:0/3949780578 shutdown_connections 2023-10-06T02:49:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c4f86c700 1 -- 172.21.15.81:0/3949780578 >> 172.21.15.81:0/3949780578 conn(0x7f2c48067640 msgr2=0x7f2c48067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c4f86c700 1 -- 172.21.15.81:0/3949780578 shutdown_connections 2023-10-06T02:49:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.429+0000 7f2c4f86c700 1 -- 172.21.15.81:0/3949780578 wait complete. 2023-10-06T02:49:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.430+0000 7f2c4f86c700 1 Processor -- start 2023-10-06T02:49:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.430+0000 7f2c4f86c700 1 -- start start 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4f86c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c48149990 0x7f2c4815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4f86c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815ad10 0x7f2c480c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4f86c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c480c8290 0x7f2c4816dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4f86c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480c8710 con 0x7f2c480c8290 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4f86c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815e040 con 0x7f2c48149990 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4f86c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815d710 con 0x7f2c4815ad10 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4de09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c480c8290 0x7f2c4816dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4de09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c480c8290 0x7f2c4816dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55768/0 (socket says 172.21.15.81:55768) 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4de09700 1 -- 172.21.15.81:0/2242585753 learned_addr learned my addr 172.21.15.81:0/2242585753 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4d608700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c48149990 0x7f2c4815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.431+0000 7f2c4ce07700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815ad10 0x7f2c480c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c4de09700 1 -- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815ad10 msgr2=0x7f2c480c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c4de09700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815ad10 0x7f2c480c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c4de09700 1 -- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c48149990 msgr2=0x7f2c4815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c4de09700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c48149990 0x7f2c4815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c4de09700 1 -- 172.21.15.81:0/2242585753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4815d9f0 con 0x7f2c480c8290 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c4de09700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c480c8290 0x7f2c4816dcc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2c40007d10 tx=0x7f2c40015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000c9e0 con 0x7f2c480c8290 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000cc30 con 0x7f2c480c8290 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4815dcd0 con 0x7f2c480c8290 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40007510 con 0x7f2c480c8290 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.432+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4815c4c0 con 0x7f2c480c8290 2023-10-06T02:49:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.433+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4815e1b0 con 0x7f2c480c8290 2023-10-06T02:49:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.433+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c40027460 con 0x7f2c480c8290 2023-10-06T02:49:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.434+0000 7f2c3d7fa700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.434+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f2c400859e0 con 0x7f2c480c8290 2023-10-06T02:49:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.434+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f2c2c06f390 con 0x7f2c480c8290 2023-10-06T02:49:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.434+0000 7f2c4d608700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.434+0000 7f2c4d608700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2c440094d0 tx=0x7f2c4400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.439+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c40052a00 con 0x7f2c480c8290 2023-10-06T02:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.616+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(74..74 src has 1..74) v4 ==== 1806+0+0 (secure 0 0 0) 0x7f2c40056dc0 con 0x7f2c480c8290 2023-10-06T02:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.616+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7f2c2c0707e0 con 0x7f2c480c8290 2023-10-06T02:49:47.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:47.621+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2c4815c6b0 con 0x7f2c480c8290 2023-10-06T02:49:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.618+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 <== mon.0 v2:172.21.15.81:3300/0 8 ==== osd_map(75..75 src has 1..75) v4 ==== 305+0+0 (secure 0 0 0) 0x7f2c400566c0 con 0x7f2c480c8290 2023-10-06T02:49:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.620+0000 7f2c3d7fa700 1 -- 172.21.15.81:0/2242585753 <== mon.0 v2:172.21.15.81:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2c40017020 con 0x7f2c480c8290 2023-10-06T02:49:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 msgr2=0x7f2c2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2c440094d0 tx=0x7f2c4400b040 comp rx=0 tx=0).stop 2023-10-06T02:49:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c480c8290 msgr2=0x7f2c4816dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c480c8290 0x7f2c4816dcc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2c40007d10 tx=0x7f2c40015000 comp rx=0 tx=0).stop 2023-10-06T02:49:48.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 shutdown_connections 2023-10-06T02:49:48.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c480c8290 0x7f2c4816dcc0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2c2c066f30 0x7f2c2c0693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c48149990 0x7f2c4815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 --2- 172.21.15.81:0/2242585753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2c4815ad10 0x7f2c480c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.624+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 >> 172.21.15.81:0/2242585753 conn(0x7f2c48067640 msgr2=0x7f2c480cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:48.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.625+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 shutdown_connections 2023-10-06T02:49:48.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.627+0000 7f2c4f86c700 1 -- 172.21.15.81:0/2242585753 wait complete. 2023-10-06T02:49:48.629 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:49:48.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:49:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.758+0000 7f0b96adf700 1 Processor -- start 2023-10-06T02:49:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.758+0000 7f0b96adf700 1 -- start start 2023-10-06T02:49:48.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b96adf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b900d0b80 0x7f0b900cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b96adf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0b9006d700 0x7f0b9015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b96adf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b900cf2d0 con 0x7f0b900d02b0 2023-10-06T02:49:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b96adf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9015a690 con 0x7f0b9006d700 2023-10-06T02:49:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b96adf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9006dc00 con 0x7f0b900d0b80 2023-10-06T02:49:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b952dc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0b900d02b0 0x7f0b9006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58398/0 (socket says 172.21.15.81:58398) 2023-10-06T02:49:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b952dc700 1 -- 172.21.15.81:0/310108818 learned_addr learned my addr 172.21.15.81:0/310108818 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219954044 0 0) 0x7f0b900cf2d0 con 0x7f0b900d02b0 2023-10-06T02:49:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b962de700 1 --2- 172.21.15.81:0/310108818 >> v2:172.21.15.83:3300/0 conn(0x7f0b9006d700 0x7f0b9015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b7c003570 con 0x7f0b900d02b0 2023-10-06T02:49:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.759+0000 7f0b95add700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b900d0b80 0x7f0b900cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2465358035 0 0) 0x7f0b7c003570 con 0x7f0b900d02b0 2023-10-06T02:49:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b900d0b80 msgr2=0x7f0b900cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b900d0b80 0x7f0b900cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 >> v2:172.21.15.83:3300/0 conn(0x7f0b9006d700 msgr2=0x7f0b9015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 --2- 172.21.15.81:0/310108818 >> v2:172.21.15.83:3300/0 conn(0x7f0b9006d700 0x7f0b9015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900cf570 con 0x7f0b900d02b0 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f0b80001470 con 0x7f0b900d02b0 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 >> v1:172.21.15.81:6789/0 conn(0x7f0b900d02b0 legacy=0x7f0b9006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b7c003a60 0x7f0b7c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c004810 0x7f0b7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b900d0b80 0x7f0b7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9015a690 con 0x7f0b7c004810 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9006dc00 con 0x7f0b7c003a60 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c00ba60 con 0x7f0b900d0b80 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b952dc700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c004810 0x7f0b7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b95add700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b7c003a60 0x7f0b7c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b962de700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b900d0b80 0x7f0b7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b952dc700 1 -- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b900d0b80 msgr2=0x7f0b7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b952dc700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b900d0b80 0x7f0b7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b952dc700 1 -- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b7c003a60 msgr2=0x7f0b7c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b952dc700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b7c003a60 0x7f0b7c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b952dc700 1 -- 172.21.15.81:0/310108818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c003570 con 0x7f0b7c004810 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b952dc700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c004810 0x7f0b7c004c80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c3f0 tx=0x7f0b80001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf029b9c2c69d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000cc80 con 0x7f0b7c004810 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8000ce00 con 0x7f0b7c004810 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.760+0000 7f0b94adb700 1 -- 172.21.15.81:0/310108818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80005b70 con 0x7f0b7c004810 2023-10-06T02:49:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.761+0000 7f0b96adf700 1 -- 172.21.15.81:0/310108818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c004810 msgr2=0x7f0b7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.761+0000 7f0b96adf700 1 --2- 172.21.15.81:0/310108818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c004810 0x7f0b7c004c80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c3f0 tx=0x7f0b80001e90 comp rx=0 tx=0).stop 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.761+0000 7f0b962de700 1 -- 172.21.15.81:0/310108818 reap_dead start 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.761+0000 7f0b96adf700 1 -- 172.21.15.81:0/310108818 shutdown_connections 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.761+0000 7f0b96adf700 1 -- 172.21.15.81:0/310108818 >> 172.21.15.81:0/310108818 conn(0x7f0b90063230 msgr2=0x7f0b90063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.761+0000 7f0b96adf700 1 -- 172.21.15.81:0/310108818 shutdown_connections 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.761+0000 7f0b96adf700 1 -- 172.21.15.81:0/310108818 wait complete. 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.762+0000 7f0b96adf700 1 Processor -- start 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.762+0000 7f0b96adf700 1 -- start start 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b96adf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b7c004810 0x7f0b901475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b96adf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b900c8830 0x7f0b900c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b96adf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b9015f3d0 0x7f0b9015f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b96adf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b90160140 con 0x7f0b900c8830 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b96adf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900c91e0 con 0x7f0b7c004810 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b96adf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900c6910 con 0x7f0b9015f3d0 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b952dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b900c8830 0x7f0b900c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b952dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b900c8830 0x7f0b900c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55790/0 (socket says 172.21.15.81:55790) 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b952dc700 1 -- 172.21.15.81:0/3783729633 learned_addr learned my addr 172.21.15.81:0/3783729633 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b95add700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b7c004810 0x7f0b901475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b962de700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b9015f3d0 0x7f0b9015f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b952dc700 1 -- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b9015f3d0 msgr2=0x7f0b9015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b952dc700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b9015f3d0 0x7f0b9015f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b952dc700 1 -- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b7c004810 msgr2=0x7f0b901475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b952dc700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b7c004810 0x7f0b901475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b952dc700 1 -- 172.21.15.81:0/3783729633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900c6020 con 0x7f0b900c8830 2023-10-06T02:49:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b952dc700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b900c8830 0x7f0b900c8ca0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0b80001ed0 tx=0x7f0b80015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b85ffb700 1 -- 172.21.15.81:0/3783729633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80001430 con 0x7f0b900c8830 2023-10-06T02:49:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b85ffb700 1 -- 172.21.15.81:0/3783729633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b800072e0 con 0x7f0b900c8830 2023-10-06T02:49:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b900c62c0 con 0x7f0b900c8830 2023-10-06T02:49:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.763+0000 7f0b85ffb700 1 -- 172.21.15.81:0/3783729633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b800076a0 con 0x7f0b900c8830 2023-10-06T02:49:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.764+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b90147b30 con 0x7f0b900c8830 2023-10-06T02:49:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.765+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b900676e0 con 0x7f0b900c8830 2023-10-06T02:49:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.765+0000 7f0b85ffb700 1 -- 172.21.15.81:0/3783729633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b80019030 con 0x7f0b900c8830 2023-10-06T02:49:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.765+0000 7f0b85ffb700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b74066f30 0x7f0b740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.765+0000 7f0b85ffb700 1 -- 172.21.15.81:0/3783729633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5822+0+0 (secure 0 0 0) 0x7f0b800855b0 con 0x7f0b900c8830 2023-10-06T02:49:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.765+0000 7f0b95add700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b74066f30 0x7f0b740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.766+0000 7f0b95add700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b74066f30 0x7f0b740693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0094d0 tx=0x7f0b8c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.770+0000 7f0b85ffb700 1 -- 172.21.15.81:0/3783729633 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b80052710 con 0x7f0b900c8830 2023-10-06T02:49:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:48.948+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0b900c6a50 con 0x7f0b900c8830 2023-10-06T02:49:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.637+0000 7f0b85ffb700 1 -- 172.21.15.81:0/3783729633 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0b80055d30 con 0x7f0b900c8830 2023-10-06T02:49:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b74066f30 msgr2=0x7f0b740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b74066f30 0x7f0b740693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0094d0 tx=0x7f0b8c00b040 comp rx=0 tx=0).stop 2023-10-06T02:49:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b900c8830 msgr2=0x7f0b900c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:49.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b900c8830 0x7f0b900c8ca0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0b80001ed0 tx=0x7f0b80015000 comp rx=0 tx=0).stop 2023-10-06T02:49:49.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 shutdown_connections 2023-10-06T02:49:49.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b9015f3d0 0x7f0b9015f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0b74066f30 0x7f0b740693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b7c004810 0x7f0b901475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 --2- 172.21.15.81:0/3783729633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b900c8830 0x7f0b900c8ca0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.640+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 >> 172.21.15.81:0/3783729633 conn(0x7f0b90063230 msgr2=0x7f0b90063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:49.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.641+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 shutdown_connections 2023-10-06T02:49:49.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.641+0000 7f0b96adf700 1 -- 172.21.15.81:0/3783729633 wait complete. 2023-10-06T02:49:49.644 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:49:49.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:49:49.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.770+0000 7f926ef2e700 1 Processor -- start 2023-10-06T02:49:49.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.771+0000 7f926ef2e700 1 -- start start 2023-10-06T02:49:49.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.771+0000 7f926ef2e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92680b3bd0 0x7f92680ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:49.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.771+0000 7f926ef2e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92680b2890 con 0x7f9268157fe0 2023-10-06T02:49:49.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.771+0000 7f926ef2e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92680b4070 con 0x7f92681583b0 2023-10-06T02:49:49.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.771+0000 7f926ef2e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92680b4350 con 0x7f92680b3bd0 2023-10-06T02:49:49.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.771+0000 7f926ccca700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9268157fe0 0x7f92680b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58414/0 (socket says 172.21.15.81:58414) 2023-10-06T02:49:49.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.771+0000 7f926ccca700 1 -- 172.21.15.81:0/3477825638 learned_addr learned my addr 172.21.15.81:0/3477825638 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:49.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f9267fff700 1 --2- 172.21.15.81:0/3477825638 >> v2:172.21.15.83:3300/0 conn(0x7f92680b3bd0 0x7f92680ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:49.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84554028 0 0) 0x7f92680b2890 con 0x7f9268157fe0 2023-10-06T02:49:49.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9254003570 con 0x7f9268157fe0 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323201147 0 0) 0x7f9254003570 con 0x7f9268157fe0 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 >> v2:172.21.15.83:3300/0 conn(0x7f92680b3bd0 msgr2=0x7f92680ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 --2- 172.21.15.81:0/3477825638 >> v2:172.21.15.83:3300/0 conn(0x7f92680b3bd0 0x7f92680ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 >> v1:172.21.15.83:6789/0 conn(0x7f92681583b0 legacy=0x7f9268158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680b4630 con 0x7f9268157fe0 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f92580017f0 con 0x7f9268157fe0 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 >> v1:172.21.15.81:6789/0 conn(0x7f9268157fe0 legacy=0x7f92680b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254003a60 0x7f9254003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9254004810 0x7f9254004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92540051c0 0x7f925400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:49.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680b4350 con 0x7f9254004810 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925400c0e0 con 0x7f92540051c0 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925400c2a0 con 0x7f9254003a60 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f9267fff700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9254004810 0x7f9254004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f926ccca700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254003a60 0x7f9254003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f926d4cb700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92540051c0 0x7f925400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f9267fff700 1 -- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254003a60 msgr2=0x7f9254003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f9267fff700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254003a60 0x7f9254003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f9267fff700 1 -- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92540051c0 msgr2=0x7f925400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f9267fff700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92540051c0 0x7f925400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f9267fff700 1 -- 172.21.15.81:0/3477825638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254003570 con 0x7f9254004810 2023-10-06T02:49:49.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f926ccca700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254003a60 0x7f9254003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f926d4cb700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92540051c0 0x7f925400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.772+0000 7f926d4cb700 1 -- 172.21.15.81:0/3477825638 reap_dead start 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f9267fff700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9254004810 0x7f9254004c80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f92680b3fa0 tx=0x7f92500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1efb43d988855fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925000e710 con 0x7f9254004810 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925000e870 con 0x7f9254004810 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f92677fe700 1 -- 172.21.15.81:0/3477825638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925000ec30 con 0x7f9254004810 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f926ef2e700 1 -- 172.21.15.81:0/3477825638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9254004810 msgr2=0x7f9254004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f926ef2e700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9254004810 0x7f9254004c80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f92680b3fa0 tx=0x7f92500091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f926ef2e700 1 -- 172.21.15.81:0/3477825638 shutdown_connections 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f926ef2e700 1 --2- 172.21.15.81:0/3477825638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9254004810 0x7f9254004c80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f926ef2e700 1 -- 172.21.15.81:0/3477825638 >> 172.21.15.81:0/3477825638 conn(0x7f9268067640 msgr2=0x7f9268067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:49.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f926ef2e700 1 -- 172.21.15.81:0/3477825638 shutdown_connections 2023-10-06T02:49:49.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.773+0000 7f926ef2e700 1 -- 172.21.15.81:0/3477825638 wait complete. 2023-10-06T02:49:49.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.774+0000 7f926ef2e700 1 Processor -- start 2023-10-06T02:49:49.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f926ef2e700 1 -- start start 2023-10-06T02:49:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f926ef2e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254004810 0x7f926806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f926ef2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92680cd370 0x7f9268147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f926ef2e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92680cd7e0 0x7f9268147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f926ef2e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926806da50 con 0x7f92680cd370 2023-10-06T02:49:49.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f926ef2e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9268147ad0 con 0x7f92680cd7e0 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f926ef2e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926806ce40 con 0x7f9254004810 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f9267fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92680cd370 0x7f9268147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f9267fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92680cd370 0x7f9268147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55810/0 (socket says 172.21.15.81:55810) 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.775+0000 7f9267fff700 1 -- 172.21.15.81:0/1539135263 learned_addr learned my addr 172.21.15.81:0/1539135263 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f926d4cb700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92680cd7e0 0x7f9268147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f926ccca700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254004810 0x7f926806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f9267fff700 1 -- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254004810 msgr2=0x7f926806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f9267fff700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254004810 0x7f926806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f9267fff700 1 -- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92680cd7e0 msgr2=0x7f9268147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f9267fff700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92680cd7e0 0x7f9268147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f9267fff700 1 -- 172.21.15.81:0/1539135263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926806d120 con 0x7f92680cd370 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f9267fff700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92680cd370 0x7f9268147050 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f925400c0b0 tx=0x7f925001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f9264ff9700 1 -- 172.21.15.81:0/1539135263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250022070 con 0x7f92680cd370 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f9264ff9700 1 -- 172.21.15.81:0/1539135263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925000e9e0 con 0x7f92680cd370 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f9264ff9700 1 -- 172.21.15.81:0/1539135263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925001c450 con 0x7f92680cd370 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926806d400 con 0x7f92680cd370 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.776+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926815b6f0 con 0x7f92680cd370 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.777+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926806dc00 con 0x7f92680cd370 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.777+0000 7f9264ff9700 1 -- 172.21.15.81:0/1539135263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f925001c8a0 con 0x7f92680cd370 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.778+0000 7f9264ff9700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9248066f30 0x7f92480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.778+0000 7f9264ff9700 1 -- 172.21.15.81:0/1539135263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9250085aa0 con 0x7f92680cd370 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.778+0000 7f926ccca700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9248066f30 0x7f92480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.778+0000 7f926ccca700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9248066f30 0x7f92480693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9258001190 tx=0x7f92580012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:49.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.782+0000 7f9264ff9700 1 -- 172.21.15.81:0/1539135263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f926806dc00 con 0x7f92680cd370 2023-10-06T02:49:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.962+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f926806da50 con 0x7f92680cd370 2023-10-06T02:49:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.965+0000 7f9264ff9700 1 -- 172.21.15.81:0/1539135263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9250052f70 con 0x7f92680cd370 2023-10-06T02:49:49.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9248066f30 msgr2=0x7f92480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:49.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9248066f30 0x7f92480693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9258001190 tx=0x7f92580012e0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92680cd370 msgr2=0x7f9268147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:49.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92680cd370 0x7f9268147050 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f925400c0b0 tx=0x7f925001a000 comp rx=0 tx=0).stop 2023-10-06T02:49:49.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 shutdown_connections 2023-10-06T02:49:49.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9248066f30 0x7f92480693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92680cd7e0 0x7f9268147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9254004810 0x7f926806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 --2- 172.21.15.81:0/1539135263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92680cd370 0x7f9268147050 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:49.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 >> 172.21.15.81:0/1539135263 conn(0x7f9268067640 msgr2=0x7f926814a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:49.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 shutdown_connections 2023-10-06T02:49:49.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:49.968+0000 7f926ef2e700 1 -- 172.21.15.81:0/1539135263 wait complete. 2023-10-06T02:49:49.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-06T02:49:50.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.094+0000 7fa9e65e8700 1 Processor -- start 2023-10-06T02:49:50.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.094+0000 7fa9e65e8700 1 -- start start 2023-10-06T02:49:50.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.094+0000 7fa9e65e8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa9e0157fe0 0x7fa9e00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.094+0000 7fa9e65e8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa9e00cf240 0x7fa9e00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.094+0000 7fa9e65e8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e00b2890 con 0x7fa9e01583b0 2023-10-06T02:49:50.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.094+0000 7fa9e65e8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e00b4070 con 0x7fa9e0157fe0 2023-10-06T02:49:50.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.094+0000 7fa9e65e8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e00b4350 con 0x7fa9e00cf240 2023-10-06T02:49:50.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9dffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa9e0157fe0 0x7fa9e00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9df7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa9e01583b0 0x7fa9e00ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58428/0 (socket says 172.21.15.81:58428) 2023-10-06T02:49:50.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9df7fe700 1 -- 172.21.15.81:0/3933396144 learned_addr learned my addr 172.21.15.81:0/3933396144 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:50.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9dffff700 1 -- 172.21.15.81:0/3933396144 >> v2:172.21.15.83:3300/0 conn(0x7fa9e00cf240 msgr2=0x7fa9e00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:50.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9e4b85700 1 --2- 172.21.15.81:0/3933396144 >> v2:172.21.15.83:3300/0 conn(0x7fa9e00cf240 0x7fa9e00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9dffff700 1 --2- 172.21.15.81:0/3933396144 >> v2:172.21.15.83:3300/0 conn(0x7fa9e00cf240 0x7fa9e00b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9dffff700 1 -- 172.21.15.81:0/3933396144 >> v1:172.21.15.81:6789/0 conn(0x7fa9e01583b0 legacy=0x7fa9e00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9deffd700 1 -- 172.21.15.81:0/3933396144 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107551533 0 0) 0x7fa9e00b2890 con 0x7fa9e01583b0 2023-10-06T02:49:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9dffff700 1 -- 172.21.15.81:0/3933396144 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00b4630 con 0x7fa9e0157fe0 2023-10-06T02:49:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9dffff700 1 --2- 172.21.15.81:0/3933396144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 0x7fa9e00b34c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0069790 tx=0x7fa9d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a3df36a49ac893 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9deffd700 1 -- 172.21.15.81:0/3933396144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000b6b0 con 0x7fa9e0157fe0 2023-10-06T02:49:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9deffd700 1 -- 172.21.15.81:0/3933396144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d000b810 con 0x7fa9e0157fe0 2023-10-06T02:49:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.095+0000 7fa9deffd700 1 -- 172.21.15.81:0/3933396144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000bbb0 con 0x7fa9e0157fe0 2023-10-06T02:49:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.096+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3933396144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 msgr2=0x7fa9e00b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.096+0000 7fa9e65e8700 1 --2- 172.21.15.81:0/3933396144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 0x7fa9e00b34c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0069790 tx=0x7fa9d00091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.096+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3933396144 shutdown_connections 2023-10-06T02:49:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.096+0000 7fa9e65e8700 1 --2- 172.21.15.81:0/3933396144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 0x7fa9e00b34c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.096+0000 7fa9e65e8700 1 --2- 172.21.15.81:0/3933396144 >> v2:172.21.15.83:3300/0 conn(0x7fa9e00cf240 0x7fa9e00b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.096+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3933396144 >> 172.21.15.81:0/3933396144 conn(0x7fa9e0067640 msgr2=0x7fa9e0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:50.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.096+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3933396144 shutdown_connections 2023-10-06T02:49:50.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.096+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3933396144 wait complete. 2023-10-06T02:49:50.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.097+0000 7fa9e65e8700 1 Processor -- start 2023-10-06T02:49:50.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.097+0000 7fa9e65e8700 1 -- start start 2023-10-06T02:49:50.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9e65e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9e00cf240 0x7fa9e00c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9e65e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 0x7fa9e0153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9e65e8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9e01583b0 0x7fa9e01538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9e65e8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e006d5d0 con 0x7fa9e0157fe0 2023-10-06T02:49:50.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9e65e8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00ca540 con 0x7fa9e01583b0 2023-10-06T02:49:50.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9e65e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e006cca0 con 0x7fa9e00cf240 2023-10-06T02:49:50.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 0x7fa9e0153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 0x7fa9e0153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55834/0 (socket says 172.21.15.81:55834) 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9df7fe700 1 -- 172.21.15.81:0/3474920942 learned_addr learned my addr 172.21.15.81:0/3474920942 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9e4b85700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9e01583b0 0x7fa9e01538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9dffff700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9e00cf240 0x7fa9e00c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9df7fe700 1 -- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9e00cf240 msgr2=0x7fa9e00c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9df7fe700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9e00cf240 0x7fa9e00c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9df7fe700 1 -- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9e01583b0 msgr2=0x7fa9e01538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9df7fe700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9e01583b0 0x7fa9e01538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9df7fe700 1 -- 172.21.15.81:0/3474920942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0009420 con 0x7fa9e0157fe0 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9df7fe700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 0x7fa9e0153370 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400c7e0 tx=0x7fa9d4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9c7fff700 1 -- 172.21.15.81:0/3474920942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4005b30 con 0x7fa9e0157fe0 2023-10-06T02:49:50.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9c7fff700 1 -- 172.21.15.81:0/3474920942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4005c90 con 0x7fa9e0157fe0 2023-10-06T02:49:50.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e006cf80 con 0x7fa9e0157fe0 2023-10-06T02:49:50.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.098+0000 7fa9c7fff700 1 -- 172.21.15.81:0/3474920942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4007300 con 0x7fa9e0157fe0 2023-10-06T02:49:50.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.099+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e006da60 con 0x7fa9e0157fe0 2023-10-06T02:49:50.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.099+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e0069e40 con 0x7fa9e0157fe0 2023-10-06T02:49:50.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.100+0000 7fa9c7fff700 1 -- 172.21.15.81:0/3474920942 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9d401b400 con 0x7fa9e0157fe0 2023-10-06T02:49:50.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.100+0000 7fa9c7fff700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9cc066f30 0x7fa9cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.100+0000 7fa9c7fff700 1 -- 172.21.15.81:0/3474920942 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa9d4083ea0 con 0x7fa9e0157fe0 2023-10-06T02:49:50.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.100+0000 7fa9dffff700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9cc066f30 0x7fa9cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.101+0000 7fa9dffff700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9cc066f30 0x7fa9cc0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00c9570 tx=0x7fa9d0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:50.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.104+0000 7fa9c7fff700 1 -- 172.21.15.81:0/3474920942 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9d4051330 con 0x7fa9e0157fe0 2023-10-06T02:49:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.364+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fa9e006d710 con 0x7fa9e0157fe0 2023-10-06T02:49:50.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.637+0000 7fa9c7fff700 1 -- 172.21.15.81:0/3474920942 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v200) v1 ==== 134+0+0 (secure 0 0 0) 0x7fa9d4054950 con 0x7fa9e0157fe0 2023-10-06T02:49:50.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9cc066f30 msgr2=0x7fa9cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9cc066f30 0x7fa9cc0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00c9570 tx=0x7fa9d0017000 comp rx=0 tx=0).stop 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 msgr2=0x7fa9e0153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 0x7fa9e0153370 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400c7e0 tx=0x7fa9d4007df0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 shutdown_connections 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa9cc066f30 0x7fa9cc0693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9e01583b0 0x7fa9e01538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9e00cf240 0x7fa9e00c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 --2- 172.21.15.81:0/3474920942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0157fe0 0x7fa9e0153370 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 >> 172.21.15.81:0/3474920942 conn(0x7fa9e0067640 msgr2=0x7fa9e00ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 shutdown_connections 2023-10-06T02:49:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.639+0000 7fa9e65e8700 1 -- 172.21.15.81:0/3474920942 wait complete. 2023-10-06T02:49:50.652 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-06T02:49:50.652 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-10-06T02:49:50.652 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-10-06T02:49:50.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-06T02:49:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.766+0000 7ff535b09700 1 Processor -- start 2023-10-06T02:49:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.766+0000 7ff535b09700 1 -- start start 2023-10-06T02:49:50.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff535b09700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5301578d0 0x7ff5300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff535b09700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff530157ca0 0x7ff53015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff535b09700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5300d07c0 con 0x7ff53006d120 2023-10-06T02:49:50.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff535b09700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5300cfbb0 con 0x7ff530157ca0 2023-10-06T02:49:50.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff535b09700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300cfe90 con 0x7ff5301578d0 2023-10-06T02:49:50.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff52effd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff530157ca0 0x7ff53015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff52f7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5301578d0 0x7ff5300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff52ffff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff53006d120 0x7ff53015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:49018/0 (socket says 172.21.15.81:49018) 2023-10-06T02:49:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff52ffff700 1 -- 172.21.15.81:0/1563319757 learned_addr learned my addr 172.21.15.81:0/1563319757 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff52f7fe700 1 -- 172.21.15.81:0/1563319757 >> v2:172.21.15.83:3300/0 conn(0x7ff530157ca0 msgr2=0x7ff53015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff52f7fe700 1 --2- 172.21.15.81:0/1563319757 >> v2:172.21.15.83:3300/0 conn(0x7ff530157ca0 0x7ff53015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff52f7fe700 1 -- 172.21.15.81:0/1563319757 >> v1:172.21.15.83:6789/0 conn(0x7ff53006d120 legacy=0x7ff53015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff52f7fe700 1 -- 172.21.15.81:0/1563319757 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5300d0170 con 0x7ff5301578d0 2023-10-06T02:49:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.767+0000 7ff52effd700 1 --2- 172.21.15.81:0/1563319757 >> v2:172.21.15.83:3300/0 conn(0x7ff530157ca0 0x7ff53015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:49:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff52f7fe700 1 --2- 172.21.15.81:0/1563319757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5301578d0 0x7ff5300cf4f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff520009e60 tx=0x7ff520009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcc08fbd193b5aad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff52e7fc700 1 -- 172.21.15.81:0/1563319757 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52000e070 con 0x7ff5301578d0 2023-10-06T02:49:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff52e7fc700 1 -- 172.21.15.81:0/1563319757 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52000bb60 con 0x7ff5301578d0 2023-10-06T02:49:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff52e7fc700 1 -- 172.21.15.81:0/1563319757 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520012430 con 0x7ff5301578d0 2023-10-06T02:49:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff535b09700 1 -- 172.21.15.81:0/1563319757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5301578d0 msgr2=0x7ff5300cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff535b09700 1 --2- 172.21.15.81:0/1563319757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5301578d0 0x7ff5300cf4f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff520009e60 tx=0x7ff520009780 comp rx=0 tx=0).stop 2023-10-06T02:49:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff535b09700 1 -- 172.21.15.81:0/1563319757 shutdown_connections 2023-10-06T02:49:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff535b09700 1 --2- 172.21.15.81:0/1563319757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5301578d0 0x7ff5300cf4f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff535b09700 1 --2- 172.21.15.81:0/1563319757 >> v2:172.21.15.83:3300/0 conn(0x7ff530157ca0 0x7ff53015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff535b09700 1 -- 172.21.15.81:0/1563319757 >> 172.21.15.81:0/1563319757 conn(0x7ff53006bb90 msgr2=0x7ff53006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff535b09700 1 -- 172.21.15.81:0/1563319757 shutdown_connections 2023-10-06T02:49:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.768+0000 7ff535b09700 1 -- 172.21.15.81:0/1563319757 wait complete. 2023-10-06T02:49:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.770+0000 7ff535b09700 1 Processor -- start 2023-10-06T02:49:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.770+0000 7ff535b09700 1 -- start start 2023-10-06T02:49:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.770+0000 7ff535b09700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff53006d120 0x7ff530154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.770+0000 7ff535b09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5301578d0 0x7ff5300ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.770+0000 7ff535b09700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff530157ca0 0x7ff53016b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.770+0000 7ff535b09700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300b1510 con 0x7ff5301578d0 2023-10-06T02:49:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.770+0000 7ff535b09700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5301550d0 con 0x7ff530157ca0 2023-10-06T02:49:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.770+0000 7ff535b09700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300b0890 con 0x7ff53006d120 2023-10-06T02:49:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52f7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff53006d120 0x7ff530154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5301578d0 0x7ff5300ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff530157ca0 0x7ff53016b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52f7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff53006d120 0x7ff530154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:41550/0 (socket says 172.21.15.81:41550) 2023-10-06T02:49:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52f7fe700 1 -- 172.21.15.81:0/746822268 learned_addr learned my addr 172.21.15.81:0/746822268 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52effd700 1 -- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff53006d120 msgr2=0x7ff530154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52effd700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff53006d120 0x7ff530154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52effd700 1 -- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff530157ca0 msgr2=0x7ff53016b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52effd700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff530157ca0 0x7ff53016b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52effd700 1 -- 172.21.15.81:0/746822268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524009420 con 0x7ff5301578d0 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52f7fe700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff53006d120 0x7ff530154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52ffff700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff530157ca0 0x7ff53016b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff52effd700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5301578d0 0x7ff5300ab240 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff52400ea30 tx=0x7ff5240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff5177fe700 1 -- 172.21.15.81:0/746822268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400ee70 con 0x7ff5301578d0 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff5177fe700 1 -- 172.21.15.81:0/746822268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52400c850 con 0x7ff5301578d0 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff520009a20 con 0x7ff5301578d0 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff5177fe700 1 -- 172.21.15.81:0/746822268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400cbf0 con 0x7ff5301578d0 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.771+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5300b0e50 con 0x7ff5301578d0 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.772+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5300b1650 con 0x7ff5301578d0 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.772+0000 7ff5177fe700 1 -- 172.21.15.81:0/746822268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff524013470 con 0x7ff5301578d0 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.773+0000 7ff5177fe700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff51c066f30 0x7ff51c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.773+0000 7ff5177fe700 1 -- 172.21.15.81:0/746822268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff5240844b0 con 0x7ff5301578d0 2023-10-06T02:49:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.773+0000 7ff52f7fe700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff51c066f30 0x7ff51c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.773+0000 7ff52f7fe700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff51c066f30 0x7ff51c0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff5200099a0 tx=0x7ff520019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:50.777+0000 7ff5177fe700 1 -- 172.21.15.81:0/746822268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5300b1650 con 0x7ff5301578d0 2023-10-06T02:49:51.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.033+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7ff5300b1650 con 0x7ff5301578d0 2023-10-06T02:49:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.640+0000 7ff5177fe700 1 -- 172.21.15.81:0/746822268 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v201) v1 ==== 136+0+0 (secure 0 0 0) 0x7ff5300b1650 con 0x7ff5301578d0 2023-10-06T02:49:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.642+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff51c066f30 msgr2=0x7ff51c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.642+0000 7ff535b09700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff51c066f30 0x7ff51c0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff5200099a0 tx=0x7ff520019000 comp rx=0 tx=0).stop 2023-10-06T02:49:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.642+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5301578d0 msgr2=0x7ff5300ab240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.642+0000 7ff535b09700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5301578d0 0x7ff5300ab240 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff52400ea30 tx=0x7ff5240091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.643+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 shutdown_connections 2023-10-06T02:49:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.643+0000 7ff535b09700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff51c066f30 0x7ff51c0693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.643+0000 7ff535b09700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff530157ca0 0x7ff53016b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.643+0000 7ff535b09700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff53006d120 0x7ff530154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.643+0000 7ff535b09700 1 --2- 172.21.15.81:0/746822268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5301578d0 0x7ff5300ab240 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.643+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 >> 172.21.15.81:0/746822268 conn(0x7ff53006bb90 msgr2=0x7ff5301568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.643+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 shutdown_connections 2023-10-06T02:49:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.643+0000 7ff535b09700 1 -- 172.21.15.81:0/746822268 wait complete. 2023-10-06T02:49:51.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-06T02:49:51.785 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-06T02:49:51.786 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-06T02:49:51.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:49:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.901+0000 7ff3912b8700 1 Processor -- start 2023-10-06T02:49:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.901+0000 7ff3912b8700 1 -- start start 2023-10-06T02:49:51.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff3912b8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c157ca0 0x7ff38c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:51.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff3912b8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff38c06d120 0x7ff38c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:51.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff3912b8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38c06dac0 con 0x7ff38c1578d0 2023-10-06T02:49:51.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff3912b8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c0d07c0 con 0x7ff38c06d120 2023-10-06T02:49:51.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff3912b8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0cfbb0 con 0x7ff38c157ca0 2023-10-06T02:49:51.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff38affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff38c1578d0 0x7ff38c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48352/0 (socket says 172.21.15.81:48352) 2023-10-06T02:49:51.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff38affd700 1 -- 172.21.15.81:0/866571950 learned_addr learned my addr 172.21.15.81:0/866571950 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:51.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff3827fc700 1 --2- 172.21.15.81:0/866571950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c157ca0 0x7ff38c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:51.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff38b7fe700 1 --2- 172.21.15.81:0/866571950 >> v2:172.21.15.83:3300/0 conn(0x7ff38c06d120 0x7ff38c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:51.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.902+0000 7ff38a7fc700 1 -- 172.21.15.81:0/866571950 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276080216 0 0) 0x7ff37c001110 con 0x7ff38c1578d0 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff38a7fc700 1 -- 172.21.15.81:0/866571950 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff378003570 con 0x7ff38c1578d0 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff38b7fe700 1 -- 172.21.15.81:0/866571950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c157ca0 msgr2=0x7ff38c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff38b7fe700 1 --2- 172.21.15.81:0/866571950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c157ca0 0x7ff38c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff38b7fe700 1 -- 172.21.15.81:0/866571950 >> v1:172.21.15.81:6789/0 conn(0x7ff38c1578d0 legacy=0x7ff38c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff38b7fe700 1 -- 172.21.15.81:0/866571950 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0cfe90 con 0x7ff38c06d120 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff3827fc700 1 --2- 172.21.15.81:0/866571950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c157ca0 0x7ff38c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff38b7fe700 1 --2- 172.21.15.81:0/866571950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c06d120 0x7ff38c06d580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff384009e60 tx=0x7ff384009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94e0abb900d3b2bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff38a7fc700 1 -- 172.21.15.81:0/866571950 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400e070 con 0x7ff38c06d120 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff38a7fc700 1 -- 172.21.15.81:0/866571950 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38400bab0 con 0x7ff38c06d120 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.903+0000 7ff38a7fc700 1 -- 172.21.15.81:0/866571950 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400be30 con 0x7ff38c06d120 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.904+0000 7ff3912b8700 1 -- 172.21.15.81:0/866571950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c06d120 msgr2=0x7ff38c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.904+0000 7ff3912b8700 1 --2- 172.21.15.81:0/866571950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c06d120 0x7ff38c06d580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff384009e60 tx=0x7ff384009780 comp rx=0 tx=0).stop 2023-10-06T02:49:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.904+0000 7ff3912b8700 1 -- 172.21.15.81:0/866571950 shutdown_connections 2023-10-06T02:49:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.904+0000 7ff3912b8700 1 --2- 172.21.15.81:0/866571950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c06d120 0x7ff38c06d580 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.904+0000 7ff3912b8700 1 --2- 172.21.15.81:0/866571950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c157ca0 0x7ff38c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.904+0000 7ff3912b8700 1 -- 172.21.15.81:0/866571950 >> 172.21.15.81:0/866571950 conn(0x7ff38c06bb90 msgr2=0x7ff38c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.904+0000 7ff3912b8700 1 -- 172.21.15.81:0/866571950 shutdown_connections 2023-10-06T02:49:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.904+0000 7ff3912b8700 1 -- 172.21.15.81:0/866571950 wait complete. 2023-10-06T02:49:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.905+0000 7ff3912b8700 1 Processor -- start 2023-10-06T02:49:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.905+0000 7ff3912b8700 1 -- start start 2023-10-06T02:49:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3912b8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c06d120 0x7ff38c16a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3912b8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c1578d0 0x7ff38c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3912b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38c157ca0 0x7ff38c0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3912b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c150b10 con 0x7ff38c157ca0 2023-10-06T02:49:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3912b8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0b56f0 con 0x7ff38c1578d0 2023-10-06T02:49:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3912b8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c150cf0 con 0x7ff38c06d120 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38c157ca0 0x7ff38c0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38c157ca0 0x7ff38c0b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55486/0 (socket says 172.21.15.81:55486) 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38b7fe700 1 -- 172.21.15.81:0/2471428111 learned_addr learned my addr 172.21.15.81:0/2471428111 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3827fc700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c1578d0 0x7ff38c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38affd700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c06d120 0x7ff38c16a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38b7fe700 1 -- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c06d120 msgr2=0x7ff38c16a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38b7fe700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c06d120 0x7ff38c16a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38b7fe700 1 -- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c1578d0 msgr2=0x7ff38c14bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38b7fe700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c1578d0 0x7ff38c14bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38b7fe700 1 -- 172.21.15.81:0/2471428111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374009420 con 0x7ff38c157ca0 2023-10-06T02:49:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3827fc700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c1578d0 0x7ff38c14bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38affd700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c06d120 0x7ff38c16a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff38b7fe700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38c157ca0 0x7ff38c0b45b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff38c06fe20 tx=0x7ff384019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3837fe700 1 -- 172.21.15.81:0/2471428111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff384027470 con 0x7ff38c157ca0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3837fe700 1 -- 172.21.15.81:0/2471428111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3840275f0 con 0x7ff38c157ca0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff384009a20 con 0x7ff38c157ca0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3837fe700 1 -- 172.21.15.81:0/2471428111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840279b0 con 0x7ff38c157ca0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.906+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c1512b0 con 0x7ff38c157ca0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.907+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c067ac0 con 0x7ff38c157ca0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.908+0000 7ff3837fe700 1 -- 172.21.15.81:0/2471428111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff384024070 con 0x7ff38c157ca0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.908+0000 7ff3837fe700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff36c066f30 0x7ff36c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.908+0000 7ff3837fe700 1 -- 172.21.15.81:0/2471428111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff384086ec0 con 0x7ff38c157ca0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.908+0000 7ff38affd700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff36c066f30 0x7ff36c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.909+0000 7ff38affd700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff36c066f30 0x7ff36c0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001270 tx=0x7ff37c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:51.912+0000 7ff3837fe700 1 -- 172.21.15.81:0/2471428111 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3840542d0 con 0x7ff38c157ca0 2023-10-06T02:49:52.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.095+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff38c0d0170 con 0x7ff38c157ca0 2023-10-06T02:49:52.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.098+0000 7ff3837fe700 1 -- 172.21.15.81:0/2471428111 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff3840578f0 con 0x7ff38c157ca0 2023-10-06T02:49:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.100+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff36c066f30 msgr2=0x7ff36c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.100+0000 7ff3912b8700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff36c066f30 0x7ff36c0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001270 tx=0x7ff37c009040 comp rx=0 tx=0).stop 2023-10-06T02:49:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.100+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38c157ca0 msgr2=0x7ff38c0b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.100+0000 7ff3912b8700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38c157ca0 0x7ff38c0b45b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff38c06fe20 tx=0x7ff384019000 comp rx=0 tx=0).stop 2023-10-06T02:49:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.101+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 shutdown_connections 2023-10-06T02:49:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.101+0000 7ff3912b8700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38c157ca0 0x7ff38c0b45b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.101+0000 7ff3912b8700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38c06d120 0x7ff38c16a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.101+0000 7ff3912b8700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff36c066f30 0x7ff36c0693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.101+0000 7ff3912b8700 1 --2- 172.21.15.81:0/2471428111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff38c1578d0 0x7ff38c14bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.101+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 >> 172.21.15.81:0/2471428111 conn(0x7ff38c06bb90 msgr2=0x7ff38c155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.101+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 shutdown_connections 2023-10-06T02:49:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.101+0000 7ff3912b8700 1 -- 172.21.15.81:0/2471428111 wait complete. 2023-10-06T02:49:52.114 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:49:52.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:49:52.154 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:49:52.199 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:49:52.200 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:49:52.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:49:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.311+0000 7f245ed53700 1 Processor -- start 2023-10-06T02:49:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.311+0000 7f245ed53700 1 -- start start 2023-10-06T02:49:52.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.312+0000 7f245ed53700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2458157fe0 0x7f24580b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.312+0000 7f245ed53700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f24580cf240 0x7f24580b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.312+0000 7f245ed53700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580b2890 con 0x7f24581583b0 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.312+0000 7f245ed53700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580b4070 con 0x7f2458157fe0 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.312+0000 7f245ed53700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580b4350 con 0x7f24580cf240 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.312+0000 7f245caef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2458157fe0 0x7f24580b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.312+0000 7f244ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f24581583b0 0x7f24580ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48360/0 (socket says 172.21.15.81:48360) 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.312+0000 7f244ffff700 1 -- 172.21.15.81:0/3278995921 learned_addr learned my addr 172.21.15.81:0/3278995921 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245d2f0700 1 --2- 172.21.15.81:0/3278995921 >> v2:172.21.15.83:3300/0 conn(0x7f24580cf240 0x7f24580b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245caef700 1 -- 172.21.15.81:0/3278995921 >> v2:172.21.15.83:3300/0 conn(0x7f24580cf240 msgr2=0x7f24580b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245caef700 1 --2- 172.21.15.81:0/3278995921 >> v2:172.21.15.83:3300/0 conn(0x7f24580cf240 0x7f24580b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245caef700 1 -- 172.21.15.81:0/3278995921 >> v1:172.21.15.81:6789/0 conn(0x7f24581583b0 legacy=0x7f24580ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245caef700 1 -- 172.21.15.81:0/3278995921 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24580b4630 con 0x7f2458157fe0 2023-10-06T02:49:52.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f244f7fe700 1 -- 172.21.15.81:0/3278995921 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047727713 0 0) 0x7f24580b2890 con 0x7f24581583b0 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245caef700 1 --2- 172.21.15.81:0/3278995921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2458157fe0 0x7f24580b34c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2458069790 tx=0x7f24540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c5ff705ef3d3ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f244f7fe700 1 -- 172.21.15.81:0/3278995921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400b6b0 con 0x7f2458157fe0 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f244f7fe700 1 -- 172.21.15.81:0/3278995921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400b810 con 0x7f2458157fe0 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f244f7fe700 1 -- 172.21.15.81:0/3278995921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400bbb0 con 0x7f2458157fe0 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245ed53700 1 -- 172.21.15.81:0/3278995921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2458157fe0 msgr2=0x7f24580b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245ed53700 1 --2- 172.21.15.81:0/3278995921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2458157fe0 0x7f24580b34c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2458069790 tx=0x7f24540091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245ed53700 1 -- 172.21.15.81:0/3278995921 shutdown_connections 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245ed53700 1 --2- 172.21.15.81:0/3278995921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2458157fe0 0x7f24580b34c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245ed53700 1 --2- 172.21.15.81:0/3278995921 >> v2:172.21.15.83:3300/0 conn(0x7f24580cf240 0x7f24580b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.313+0000 7f245ed53700 1 -- 172.21.15.81:0/3278995921 >> 172.21.15.81:0/3278995921 conn(0x7f2458067640 msgr2=0x7f2458067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.314+0000 7f245ed53700 1 -- 172.21.15.81:0/3278995921 shutdown_connections 2023-10-06T02:49:52.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.314+0000 7f245ed53700 1 -- 172.21.15.81:0/3278995921 wait complete. 2023-10-06T02:49:52.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.315+0000 7f245ed53700 1 Processor -- start 2023-10-06T02:49:52.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.315+0000 7f245ed53700 1 -- start start 2023-10-06T02:49:52.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.315+0000 7f245ed53700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24580cf240 0x7f245816af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.315+0000 7f245ed53700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2458157fe0 0x7f2458155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.315+0000 7f245ed53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24581583b0 0x7f2458156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245ed53700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245814e160 con 0x7f24581583b0 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245ed53700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245816b4a0 con 0x7f2458157fe0 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245ed53700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245814d550 con 0x7f24580cf240 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245d2f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24581583b0 0x7f2458156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245d2f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24581583b0 0x7f2458156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55502/0 (socket says 172.21.15.81:55502) 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245d2f0700 1 -- 172.21.15.81:0/1842970790 learned_addr learned my addr 172.21.15.81:0/1842970790 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f244ffff700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2458157fe0 0x7f2458155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245caef700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24580cf240 0x7f245816af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245d2f0700 1 -- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24580cf240 msgr2=0x7f245816af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245d2f0700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24580cf240 0x7f245816af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245d2f0700 1 -- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2458157fe0 msgr2=0x7f2458155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245d2f0700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2458157fe0 0x7f2458155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245d2f0700 1 -- 172.21.15.81:0/1842970790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454009420 con 0x7f24581583b0 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245d2f0700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24581583b0 0x7f2458156000 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2450007ef0 tx=0x7f2450009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f244cff9700 1 -- 172.21.15.81:0/1842970790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245000eb30 con 0x7f24581583b0 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f244cff9700 1 -- 172.21.15.81:0/1842970790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245000ec90 con 0x7f24581583b0 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245814d830 con 0x7f24581583b0 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f244cff9700 1 -- 172.21.15.81:0/1842970790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450014670 con 0x7f24581583b0 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.316+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245814ddf0 con 0x7f24581583b0 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.317+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2458069e40 con 0x7f24581583b0 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.318+0000 7f244cff9700 1 -- 172.21.15.81:0/1842970790 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2450014a60 con 0x7f24581583b0 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.318+0000 7f244cff9700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2444066f30 0x7f24440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.318+0000 7f244cff9700 1 -- 172.21.15.81:0/1842970790 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f24500848e0 con 0x7f24581583b0 2023-10-06T02:49:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.318+0000 7f245caef700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2444066f30 0x7f24440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.319+0000 7f245caef700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2444066f30 0x7f24440693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24540093f0 tx=0x7f2454017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.322+0000 7f244cff9700 1 -- 172.21.15.81:0/1842970790 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2450051cf0 con 0x7f24581583b0 2023-10-06T02:49:52.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.546+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f245804bb80 con 0x7f24581583b0 2023-10-06T02:49:52.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.546+0000 7f244cff9700 1 -- 172.21.15.81:0/1842970790 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f2450055310 con 0x7f24581583b0 2023-10-06T02:49:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:52.548 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5192,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1289364984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1289364984},{"type":"v1","addr":"172.21.15.83:6836","nonce":1289364984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3185368649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3185368649},{"type":"v1","addr":"172.21.15.83:6837","nonce":3185368649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5817,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/869401920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":869401920},{"type":"v1","addr":"172.21.15.81:6834","nonce":869401920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6090,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3479004731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3479004731},{"type":"v1","addr":"172.21.15.81:6835","nonce":3479004731}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-10-06T02:49:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2444066f30 msgr2=0x7f24440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2444066f30 0x7f24440693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24540093f0 tx=0x7f2454017000 comp rx=0 tx=0).stop 2023-10-06T02:49:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24581583b0 msgr2=0x7f2458156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24581583b0 0x7f2458156000 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2450007ef0 tx=0x7f2450009840 comp rx=0 tx=0).stop 2023-10-06T02:49:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 shutdown_connections 2023-10-06T02:49:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24581583b0 0x7f2458156000 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24580cf240 0x7f245816af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2444066f30 0x7f24440693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 --2- 172.21.15.81:0/1842970790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2458157fe0 0x7f2458155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 >> 172.21.15.81:0/1842970790 conn(0x7f2458067640 msgr2=0x7f24580ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 shutdown_connections 2023-10-06T02:49:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.548+0000 7f245ed53700 1 -- 172.21.15.81:0/1842970790 wait complete. 2023-10-06T02:49:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2023-10-06T02:49:52.562 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:49:52.562 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:49:52.563 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:49:52.563 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:49:52.563 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:49:52.563 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:49:52.563 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:49:52.563 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:49:52.563 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:49:52.564 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:49:52.564 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:49:52.564 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:49:52.564 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:49:52.564 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:49:52.564 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:49:52.565 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:49:52.573 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:49:52.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:49:52.574 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:49:52.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:49:52.575 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:49:52.576 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:49:52.576 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:49:52.577 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:49:52.616 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:49:52.617 DEBUG:teuthology.parallel:result is None 2023-10-06T02:49:52.618 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:49:52.618 DEBUG:teuthology.parallel:result is None 2023-10-06T02:49:52.619 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:49:52.619 DEBUG:teuthology.parallel:result is None 2023-10-06T02:49:52.620 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:49:52.620 DEBUG:teuthology.parallel:result is None 2023-10-06T02:49:52.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:49:52.689 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:49:52.690 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:49:52.700 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:49:52.700 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:49:52.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.741+0000 7f33d4a56700 1 Processor -- start 2023-10-06T02:49:52.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.741+0000 7f33d4a56700 1 -- start start 2023-10-06T02:49:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33d4a56700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f33d01578d0 0x7f33d00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33d4a56700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f33d0157ca0 0x7f33d015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33d4a56700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00d07c0 con 0x7f33d006d120 2023-10-06T02:49:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33d4a56700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d00cfbb0 con 0x7f33d0157ca0 2023-10-06T02:49:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33d4a56700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d00cfe90 con 0x7f33d01578d0 2023-10-06T02:49:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33c5d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f33d0157ca0 0x7f33d015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33c5d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f33d0157ca0 0x7f33d015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55544/0 (socket says 172.21.15.81:55544) 2023-10-06T02:49:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33c5d9b700 1 -- 172.21.15.81:0/1578100198 learned_addr learned my addr 172.21.15.81:0/1578100198 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33ce59c700 1 --2- 172.21.15.81:0/1578100198 >> v2:172.21.15.83:3300/0 conn(0x7f33d01578d0 0x7f33d00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33c5d9b700 1 -- 172.21.15.81:0/1578100198 >> v2:172.21.15.83:3300/0 conn(0x7f33d01578d0 msgr2=0x7f33d00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33c5d9b700 1 --2- 172.21.15.81:0/1578100198 >> v2:172.21.15.83:3300/0 conn(0x7f33d01578d0 0x7f33d00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33c5d9b700 1 -- 172.21.15.81:0/1578100198 >> v1:172.21.15.83:6789/0 conn(0x7f33d006d120 legacy=0x7f33d006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.742+0000 7f33c5d9b700 1 -- 172.21.15.81:0/1578100198 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00d0170 con 0x7f33d0157ca0 2023-10-06T02:49:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33c5d9b700 1 --2- 172.21.15.81:0/1578100198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0157ca0 0x7f33d015af00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f33d00646b0 tx=0x7f33b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703d4c53cfc8c7a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33cdd9b700 1 -- 172.21.15.81:0/1578100198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8009e70 con 0x7f33d0157ca0 2023-10-06T02:49:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33cdd9b700 1 -- 172.21.15.81:0/1578100198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b800b860 con 0x7f33d0157ca0 2023-10-06T02:49:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33cdd9b700 1 -- 172.21.15.81:0/1578100198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b800bc00 con 0x7f33d0157ca0 2023-10-06T02:49:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33d4a56700 1 -- 172.21.15.81:0/1578100198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0157ca0 msgr2=0x7f33d015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33d4a56700 1 --2- 172.21.15.81:0/1578100198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0157ca0 0x7f33d015af00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f33d00646b0 tx=0x7f33b8009250 comp rx=0 tx=0).stop 2023-10-06T02:49:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33d4a56700 1 -- 172.21.15.81:0/1578100198 shutdown_connections 2023-10-06T02:49:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33d4a56700 1 --2- 172.21.15.81:0/1578100198 >> v2:172.21.15.83:3300/0 conn(0x7f33d01578d0 0x7f33d00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33d4a56700 1 --2- 172.21.15.81:0/1578100198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0157ca0 0x7f33d015af00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33d4a56700 1 -- 172.21.15.81:0/1578100198 >> 172.21.15.81:0/1578100198 conn(0x7f33d006bb90 msgr2=0x7f33d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33d4a56700 1 -- 172.21.15.81:0/1578100198 shutdown_connections 2023-10-06T02:49:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.743+0000 7f33d4a56700 1 -- 172.21.15.81:0/1578100198 wait complete. 2023-10-06T02:49:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33d4a56700 1 Processor -- start 2023-10-06T02:49:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33d4a56700 1 -- start start 2023-10-06T02:49:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33d4a56700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006d120 0x7f33d0144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33d4a56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d01578d0 0x7f33d00cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33d4a56700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d0157ca0 0x7f33d01595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33d4a56700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00ccf30 con 0x7f33d01578d0 2023-10-06T02:49:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33d4a56700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00cc080 con 0x7f33d006d120 2023-10-06T02:49:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33d4a56700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00cc320 con 0x7f33d0157ca0 2023-10-06T02:49:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33c5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d01578d0 0x7f33d00cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33c5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d01578d0 0x7f33d00cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55554/0 (socket says 172.21.15.81:55554) 2023-10-06T02:49:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33ce59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006d120 0x7f33d0144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.745+0000 7f33c5d9b700 1 -- 172.21.15.81:0/2264790129 learned_addr learned my addr 172.21.15.81:0/2264790129 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33ced9d700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d0157ca0 0x7f33d01595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33c5d9b700 1 -- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d0157ca0 msgr2=0x7f33d01595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33c5d9b700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d0157ca0 0x7f33d01595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33c5d9b700 1 -- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006d120 msgr2=0x7f33d0144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33c5d9b700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006d120 0x7f33d0144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33c5d9b700 1 -- 172.21.15.81:0/2264790129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80094f0 con 0x7f33d01578d0 2023-10-06T02:49:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33ce59c700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006d120 0x7f33d0144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:49:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33c5d9b700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d01578d0 0x7f33d00cd3c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f33d006fe20 tx=0x7f33b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33c6ffd700 1 -- 172.21.15.81:0/2264790129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b800bbe0 con 0x7f33d01578d0 2023-10-06T02:49:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33c6ffd700 1 -- 172.21.15.81:0/2264790129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8011420 con 0x7f33d01578d0 2023-10-06T02:49:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d00cc600 con 0x7f33d01578d0 2023-10-06T02:49:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33c6ffd700 1 -- 172.21.15.81:0/2264790129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80117e0 con 0x7f33d01578d0 2023-10-06T02:49:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.746+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d00ccbc0 con 0x7f33d01578d0 2023-10-06T02:49:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.747+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d00cd0e0 con 0x7f33d01578d0 2023-10-06T02:49:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.747+0000 7f33c6ffd700 1 -- 172.21.15.81:0/2264790129 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33b8011c10 con 0x7f33d01578d0 2023-10-06T02:49:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.748+0000 7f33c6ffd700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33b0066f30 0x7f33b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.748+0000 7f33c6ffd700 1 -- 172.21.15.81:0/2264790129 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f33b8085b40 con 0x7f33d01578d0 2023-10-06T02:49:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.748+0000 7f33ce59c700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33b0066f30 0x7f33b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.748+0000 7f33ce59c700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33b0066f30 0x7f33b00693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f33c0011480 tx=0x7f33c00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.752+0000 7f33c6ffd700 1 -- 172.21.15.81:0/2264790129 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33d00cd0e0 con 0x7f33d01578d0 2023-10-06T02:49:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:52.947+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f33d00cd070 con 0x7f33d01578d0 2023-10-06T02:49:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.650+0000 7f33c6ffd700 1 -- 172.21.15.81:0/2264790129 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v78) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33b8052f50 con 0x7f33d01578d0 2023-10-06T02:49:53.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33b0066f30 msgr2=0x7f33b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:53.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33b0066f30 0x7f33b00693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f33c0011480 tx=0x7f33c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d01578d0 msgr2=0x7f33d00cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:53.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d01578d0 0x7f33d00cd3c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f33d006fe20 tx=0x7f33b8017000 comp rx=0 tx=0).stop 2023-10-06T02:49:53.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 shutdown_connections 2023-10-06T02:49:53.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33d0157ca0 0x7f33d01595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f33b0066f30 0x7f33b00693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33d006d120 0x7f33d0144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 --2- 172.21.15.81:0/2264790129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d01578d0 0x7f33d00cd3c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 >> 172.21.15.81:0/2264790129 conn(0x7f33d006bb90 msgr2=0x7f33d015a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 shutdown_connections 2023-10-06T02:49:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.653+0000 7f33d4a56700 1 -- 172.21.15.81:0/2264790129 wait complete. 2023-10-06T02:49:53.656 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:49:53.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:49:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.781+0000 7f82f195e700 1 Processor -- start 2023-10-06T02:49:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.781+0000 7f82f195e700 1 -- start start 2023-10-06T02:49:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.782+0000 7f82f195e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82ec1578d0 0x7f82ec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.782+0000 7f82f195e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec06d120 0x7f82ec06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.782+0000 7f82f195e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ec0d07c0 con 0x7f82ec157ca0 2023-10-06T02:49:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.782+0000 7f82f195e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ec06daa0 con 0x7f82ec1578d0 2023-10-06T02:49:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.782+0000 7f82f195e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec0cfbb0 con 0x7f82ec06d120 2023-10-06T02:49:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.782+0000 7f82eaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82ec1578d0 0x7f82ec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:53.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.782+0000 7f82eaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82ec1578d0 0x7f82ec0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55560/0 (socket says 172.21.15.81:55560) 2023-10-06T02:49:53.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.782+0000 7f82eaffd700 1 -- 172.21.15.81:0/4160574580 learned_addr learned my addr 172.21.15.81:0/4160574580 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:53.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.782+0000 7f82eb7fe700 1 --2- 172.21.15.81:0/4160574580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec06d120 0x7f82ec06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:53.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82eaffd700 1 -- 172.21.15.81:0/4160574580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec06d120 msgr2=0x7f82ec06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:53.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82eaffd700 1 --2- 172.21.15.81:0/4160574580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec06d120 0x7f82ec06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82eaffd700 1 -- 172.21.15.81:0/4160574580 >> v1:172.21.15.83:6789/0 conn(0x7f82ec157ca0 legacy=0x7f82ec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:53.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82eaffd700 1 -- 172.21.15.81:0/4160574580 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0cfe90 con 0x7f82ec1578d0 2023-10-06T02:49:53.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82eb7fe700 1 --2- 172.21.15.81:0/4160574580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec06d120 0x7f82ec06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:53.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82eaffd700 1 --2- 172.21.15.81:0/4160574580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 0x7f82ec0cf4f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0099b0 tx=0x7f82dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a53a587a9fe5f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:53.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82ea7fc700 1 -- 172.21.15.81:0/4160574580 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00b860 con 0x7f82ec1578d0 2023-10-06T02:49:53.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82ea7fc700 1 -- 172.21.15.81:0/4160574580 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc00b9c0 con 0x7f82ec1578d0 2023-10-06T02:49:53.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82ea7fc700 1 -- 172.21.15.81:0/4160574580 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00bd60 con 0x7f82ec1578d0 2023-10-06T02:49:53.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82f195e700 1 -- 172.21.15.81:0/4160574580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 msgr2=0x7f82ec0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:53.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82f195e700 1 --2- 172.21.15.81:0/4160574580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 0x7f82ec0cf4f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0099b0 tx=0x7f82dc009250 comp rx=0 tx=0).stop 2023-10-06T02:49:53.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82f195e700 1 -- 172.21.15.81:0/4160574580 shutdown_connections 2023-10-06T02:49:53.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82f195e700 1 --2- 172.21.15.81:0/4160574580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec06d120 0x7f82ec06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82f195e700 1 --2- 172.21.15.81:0/4160574580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 0x7f82ec0cf4f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82f195e700 1 -- 172.21.15.81:0/4160574580 >> 172.21.15.81:0/4160574580 conn(0x7f82ec06bb90 msgr2=0x7f82ec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:53.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82f195e700 1 -- 172.21.15.81:0/4160574580 shutdown_connections 2023-10-06T02:49:53.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.783+0000 7f82f195e700 1 -- 172.21.15.81:0/4160574580 wait complete. 2023-10-06T02:49:53.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.785+0000 7f82f195e700 1 Processor -- start 2023-10-06T02:49:53.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.785+0000 7f82f195e700 1 -- start start 2023-10-06T02:49:53.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.785+0000 7f82f195e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ec06d120 0x7f82ec068fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:53.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.785+0000 7f82f195e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 0x7f82ec0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:53.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.785+0000 7f82f195e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec157ca0 0x7f82ec0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:53.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.785+0000 7f82f195e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec16e9c0 con 0x7f82ec1578d0 2023-10-06T02:49:53.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.785+0000 7f82f195e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec16ddb0 con 0x7f82ec06d120 2023-10-06T02:49:53.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.785+0000 7f82f195e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec16e090 con 0x7f82ec157ca0 2023-10-06T02:49:53.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.785+0000 7f82e27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 0x7f82ec0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:53.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82eaffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ec06d120 0x7f82ec068fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:53.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 0x7f82ec0b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55574/0 (socket says 172.21.15.81:55574) 2023-10-06T02:49:53.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82eaffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ec06d120 0x7f82ec068fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:58924/0 (socket says 172.21.15.81:58924) 2023-10-06T02:49:53.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e27fc700 1 -- 172.21.15.81:0/2035127074 learned_addr learned my addr 172.21.15.81:0/2035127074 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82eb7fe700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec157ca0 0x7f82ec0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e27fc700 1 -- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec157ca0 msgr2=0x7f82ec0b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e27fc700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec157ca0 0x7f82ec0b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e27fc700 1 -- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ec06d120 msgr2=0x7f82ec068fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e27fc700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ec06d120 0x7f82ec068fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e27fc700 1 -- 172.21.15.81:0/2035127074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc0094f0 con 0x7f82ec1578d0 2023-10-06T02:49:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e27fc700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 0x7f82ec0b5cf0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c590 tx=0x7f82d4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e37fe700 1 -- 172.21.15.81:0/2035127074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4011590 con 0x7f82ec1578d0 2023-10-06T02:49:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e37fe700 1 -- 172.21.15.81:0/2035127074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4011710 con 0x7f82ec1578d0 2023-10-06T02:49:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ec16e370 con 0x7f82ec1578d0 2023-10-06T02:49:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82e37fe700 1 -- 172.21.15.81:0/2035127074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4011ad0 con 0x7f82ec1578d0 2023-10-06T02:49:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.786+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ec0694e0 con 0x7f82ec1578d0 2023-10-06T02:49:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.787+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ec067ac0 con 0x7f82ec1578d0 2023-10-06T02:49:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.787+0000 7f82e37fe700 1 -- 172.21.15.81:0/2035127074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82d401a360 con 0x7f82ec1578d0 2023-10-06T02:49:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.788+0000 7f82e37fe700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82cc066fb0 0x7f82cc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.788+0000 7f82e37fe700 1 -- 172.21.15.81:0/2035127074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f82d4083210 con 0x7f82ec1578d0 2023-10-06T02:49:53.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.788+0000 7f82eaffd700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82cc066fb0 0x7f82cc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:53.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.788+0000 7f82eaffd700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82cc066fb0 0x7f82cc069460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0099b0 tx=0x7f82dc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:53.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:53.792+0000 7f82e37fe700 1 -- 172.21.15.81:0/2035127074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82d40505d0 con 0x7f82ec1578d0 2023-10-06T02:49:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.051+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f82ec157100 con 0x7f82ec1578d0 2023-10-06T02:49:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.051+0000 7f82e37fe700 1 -- 172.21.15.81:0/2035127074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f82d4053bf0 con 0x7f82ec1578d0 2023-10-06T02:49:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:54.053 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:49:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:49:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:49:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:49:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:49:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:49:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:49:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:49:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:49:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:49:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:49:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:49:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:49:54.068 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:49:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82cc066fb0 msgr2=0x7f82cc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82cc066fb0 0x7f82cc069460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0099b0 tx=0x7f82dc017000 comp rx=0 tx=0).stop 2023-10-06T02:49:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 msgr2=0x7f82ec0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 0x7f82ec0b5cf0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c590 tx=0x7f82d4007f50 comp rx=0 tx=0).stop 2023-10-06T02:49:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 shutdown_connections 2023-10-06T02:49:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82ec157ca0 0x7f82ec0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82cc066fb0 0x7f82cc069460 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82ec06d120 0x7f82ec068fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 --2- 172.21.15.81:0/2035127074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec1578d0 0x7f82ec0b5cf0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 >> 172.21.15.81:0/2035127074 conn(0x7f82ec06bb90 msgr2=0x7f82ec1558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.053+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 shutdown_connections 2023-10-06T02:49:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.054+0000 7f82f195e700 1 -- 172.21.15.81:0/2035127074 wait complete. 2023-10-06T02:49:54.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:49:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.185+0000 7fdd3753e700 1 Processor -- start 2023-10-06T02:49:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.185+0000 7fdd3753e700 1 -- start start 2023-10-06T02:49:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.186+0000 7fdd3753e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdd301578d0 0x7fdd300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.186+0000 7fdd3753e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd30157ca0 0x7fdd3015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.186+0000 7fdd3753e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd300d07c0 con 0x7fdd3006d120 2023-10-06T02:49:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.186+0000 7fdd3753e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd300cfbb0 con 0x7fdd30157ca0 2023-10-06T02:49:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.186+0000 7fdd3753e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd300cfe90 con 0x7fdd301578d0 2023-10-06T02:49:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.186+0000 7fdd34ad9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd30157ca0 0x7fdd3015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.186+0000 7fdd35adb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdd3006d120 0x7fdd3006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48370/0 (socket says 172.21.15.81:48370) 2023-10-06T02:49:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.186+0000 7fdd35adb700 1 -- 172.21.15.81:0/1689493355 learned_addr learned my addr 172.21.15.81:0/1689493355 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd352da700 1 --2- 172.21.15.81:0/1689493355 >> v2:172.21.15.83:3300/0 conn(0x7fdd301578d0 0x7fdd300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd34ad9700 1 -- 172.21.15.81:0/1689493355 >> v2:172.21.15.83:3300/0 conn(0x7fdd301578d0 msgr2=0x7fdd300cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd34ad9700 1 --2- 172.21.15.81:0/1689493355 >> v2:172.21.15.83:3300/0 conn(0x7fdd301578d0 0x7fdd300cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd34ad9700 1 -- 172.21.15.81:0/1689493355 >> v1:172.21.15.81:6789/0 conn(0x7fdd3006d120 legacy=0x7fdd3006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd27fff700 1 -- 172.21.15.81:0/1689493355 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076685937 0 0) 0x7fdd300d07c0 con 0x7fdd3006d120 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd34ad9700 1 -- 172.21.15.81:0/1689493355 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300d0170 con 0x7fdd30157ca0 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd34ad9700 1 --2- 172.21.15.81:0/1689493355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd30157ca0 0x7fdd3015af00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdd300646b0 tx=0x7fdd200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2838d7aeb6f9adb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd27fff700 1 -- 172.21.15.81:0/1689493355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000b6b0 con 0x7fdd30157ca0 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd27fff700 1 -- 172.21.15.81:0/1689493355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2000b810 con 0x7fdd30157ca0 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd27fff700 1 -- 172.21.15.81:0/1689493355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000bbb0 con 0x7fdd30157ca0 2023-10-06T02:49:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd3753e700 1 -- 172.21.15.81:0/1689493355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd30157ca0 msgr2=0x7fdd3015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd3753e700 1 --2- 172.21.15.81:0/1689493355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd30157ca0 0x7fdd3015af00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdd300646b0 tx=0x7fdd200091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd3753e700 1 -- 172.21.15.81:0/1689493355 shutdown_connections 2023-10-06T02:49:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd3753e700 1 --2- 172.21.15.81:0/1689493355 >> v2:172.21.15.83:3300/0 conn(0x7fdd301578d0 0x7fdd300cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd3753e700 1 --2- 172.21.15.81:0/1689493355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd30157ca0 0x7fdd3015af00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd3753e700 1 -- 172.21.15.81:0/1689493355 >> 172.21.15.81:0/1689493355 conn(0x7fdd3006bb90 msgr2=0x7fdd3006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.187+0000 7fdd3753e700 1 -- 172.21.15.81:0/1689493355 shutdown_connections 2023-10-06T02:49:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.188+0000 7fdd3753e700 1 -- 172.21.15.81:0/1689493355 wait complete. 2023-10-06T02:49:54.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.189+0000 7fdd3753e700 1 Processor -- start 2023-10-06T02:49:54.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.189+0000 7fdd3753e700 1 -- start start 2023-10-06T02:49:54.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.189+0000 7fdd3753e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3006d120 0x7fdd300c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.189+0000 7fdd3753e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301578d0 0x7fdd300c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.189+0000 7fdd3753e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd30157ca0 0x7fdd301433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.189+0000 7fdd3753e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300c7560 con 0x7fdd3006d120 2023-10-06T02:49:54.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.189+0000 7fdd3753e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300c6060 con 0x7fdd301578d0 2023-10-06T02:49:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.189+0000 7fdd3753e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd301438f0 con 0x7fdd30157ca0 2023-10-06T02:49:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd352da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3006d120 0x7fdd300c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd352da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3006d120 0x7fdd300c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55590/0 (socket says 172.21.15.81:55590) 2023-10-06T02:49:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd352da700 1 -- 172.21.15.81:0/585550379 learned_addr learned my addr 172.21.15.81:0/585550379 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd34ad9700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301578d0 0x7fdd300c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd352da700 1 -- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd30157ca0 msgr2=0x7fdd301433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd352da700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd30157ca0 0x7fdd301433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd352da700 1 -- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301578d0 msgr2=0x7fdd300c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd352da700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301578d0 0x7fdd300c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd352da700 1 -- 172.21.15.81:0/585550379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd20009420 con 0x7fdd3006d120 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd34ad9700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301578d0 0x7fdd300c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd352da700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3006d120 0x7fdd300c6370 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00d8c0 tx=0x7fdd2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd257fa700 1 -- 172.21.15.81:0/585550379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00de60 con 0x7fdd3006d120 2023-10-06T02:49:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd257fa700 1 -- 172.21.15.81:0/585550379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c00b780 con 0x7fdd3006d120 2023-10-06T02:49:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd300c6950 con 0x7fdd3006d120 2023-10-06T02:49:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd257fa700 1 -- 172.21.15.81:0/585550379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00bb20 con 0x7fdd3006d120 2023-10-06T02:49:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.190+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd300c6f10 con 0x7fdd3006d120 2023-10-06T02:49:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.191+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd30067ac0 con 0x7fdd3006d120 2023-10-06T02:49:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.191+0000 7fdd257fa700 1 -- 172.21.15.81:0/585550379 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd2c01e460 con 0x7fdd3006d120 2023-10-06T02:49:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.192+0000 7fdd257fa700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd14066f30 0x7fdd140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.192+0000 7fdd257fa700 1 -- 172.21.15.81:0/585550379 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdd2c0849c0 con 0x7fdd3006d120 2023-10-06T02:49:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.192+0000 7fdd34ad9700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd14066f30 0x7fdd140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.192+0000 7fdd34ad9700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd14066f30 0x7fdd140693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdd301580c0 tx=0x7fdd20017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.196+0000 7fdd257fa700 1 -- 172.21.15.81:0/585550379 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd2c051e20 con 0x7fdd3006d120 2023-10-06T02:49:54.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.378+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd300d0450 con 0x7fdd3006d120 2023-10-06T02:49:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.379+0000 7fdd257fa700 1 -- 172.21.15.81:0/585550379 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+13603 (secure 0 0 0) 0x7fdd2c055440 con 0x7fdd3006d120 2023-10-06T02:49:54.380 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:54.380 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:49:53.654676+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:49:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.381+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd14066f30 msgr2=0x7fdd140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.381+0000 7fdd3753e700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd14066f30 0x7fdd140693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdd301580c0 tx=0x7fdd20017000 comp rx=0 tx=0).stop 2023-10-06T02:49:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.381+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3006d120 msgr2=0x7fdd300c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.381+0000 7fdd3753e700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3006d120 0x7fdd300c6370 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00d8c0 tx=0x7fdd2c008040 comp rx=0 tx=0).stop 2023-10-06T02:49:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.382+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 shutdown_connections 2023-10-06T02:49:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.382+0000 7fdd3753e700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd30157ca0 0x7fdd301433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.382+0000 7fdd3753e700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3006d120 0x7fdd300c6370 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.382+0000 7fdd3753e700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd14066f30 0x7fdd140693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.382+0000 7fdd3753e700 1 --2- 172.21.15.81:0/585550379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301578d0 0x7fdd300c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.382+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 >> 172.21.15.81:0/585550379 conn(0x7fdd3006bb90 msgr2=0x7fdd3006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:54.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.382+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 shutdown_connections 2023-10-06T02:49:54.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.382+0000 7fdd3753e700 1 -- 172.21.15.81:0/585550379 wait complete. 2023-10-06T02:49:54.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:49:54.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:49:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.510+0000 7fae0f99b700 1 Processor -- start 2023-10-06T02:49:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.511+0000 7fae0f99b700 1 -- start start 2023-10-06T02:49:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.511+0000 7fae0f99b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fae081578d0 0x7fae080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.511+0000 7fae0f99b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 0x7fae0815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.511+0000 7fae0f99b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae080d07c0 con 0x7fae0806d120 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.511+0000 7fae0f99b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae080cfbb0 con 0x7fae081578d0 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.511+0000 7fae0f99b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae080cfe90 con 0x7fae08157ca0 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fae0df38700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fae0806d120 0x7fae0815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48372/0 (socket says 172.21.15.81:48372) 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fae0df38700 1 -- 172.21.15.81:0/1956829469 learned_addr learned my addr 172.21.15.81:0/1956829469 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fae0d737700 1 --2- 172.21.15.81:0/1956829469 >> v2:172.21.15.83:3300/0 conn(0x7fae081578d0 0x7fae080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fae0cf36700 1 --2- 172.21.15.81:0/1956829469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 0x7fae0815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fadfffff700 1 -- 172.21.15.81:0/1956829469 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829543404 0 0) 0x7fae080d07c0 con 0x7fae0806d120 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fadfffff700 1 -- 172.21.15.81:0/1956829469 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf4003570 con 0x7fae0806d120 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fae0cf36700 1 -- 172.21.15.81:0/1956829469 >> v2:172.21.15.83:3300/0 conn(0x7fae081578d0 msgr2=0x7fae080cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fae0cf36700 1 --2- 172.21.15.81:0/1956829469 >> v2:172.21.15.83:3300/0 conn(0x7fae081578d0 0x7fae080cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fae0cf36700 1 -- 172.21.15.81:0/1956829469 >> v1:172.21.15.81:6789/0 conn(0x7fae0806d120 legacy=0x7fae0815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fae0cf36700 1 -- 172.21.15.81:0/1956829469 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080d0170 con 0x7fae08157ca0 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fae0cf36700 1 --2- 172.21.15.81:0/1956829469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 0x7fae0815af00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fadf80098e0 tx=0x7fadf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f87de70243ff26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fadfffff700 1 -- 172.21.15.81:0/1956829469 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8011630 con 0x7fae08157ca0 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fadfffff700 1 -- 172.21.15.81:0/1956829469 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8011790 con 0x7fae08157ca0 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.512+0000 7fadfffff700 1 -- 172.21.15.81:0/1956829469 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8011b30 con 0x7fae08157ca0 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.513+0000 7fae0f99b700 1 -- 172.21.15.81:0/1956829469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 msgr2=0x7fae0815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.513+0000 7fae0f99b700 1 --2- 172.21.15.81:0/1956829469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 0x7fae0815af00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fadf80098e0 tx=0x7fadf80091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.513+0000 7fae0f99b700 1 -- 172.21.15.81:0/1956829469 shutdown_connections 2023-10-06T02:49:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.513+0000 7fae0f99b700 1 --2- 172.21.15.81:0/1956829469 >> v2:172.21.15.83:3300/0 conn(0x7fae081578d0 0x7fae080cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.513+0000 7fae0f99b700 1 --2- 172.21.15.81:0/1956829469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 0x7fae0815af00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.513+0000 7fae0f99b700 1 -- 172.21.15.81:0/1956829469 >> 172.21.15.81:0/1956829469 conn(0x7fae0806bb90 msgr2=0x7fae0806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.513+0000 7fae0f99b700 1 -- 172.21.15.81:0/1956829469 shutdown_connections 2023-10-06T02:49:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.513+0000 7fae0f99b700 1 -- 172.21.15.81:0/1956829469 wait complete. 2023-10-06T02:49:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.514+0000 7fae0f99b700 1 Processor -- start 2023-10-06T02:49:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.514+0000 7fae0f99b700 1 -- start start 2023-10-06T02:49:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0f99b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0806d120 0x7fae080b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0f99b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae081578d0 0x7fae08154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0f99b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 0x7fae080b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0f99b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080b6bc0 con 0x7fae081578d0 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0f99b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080b5c30 con 0x7fae0806d120 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0f99b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae080b68e0 con 0x7fae08157ca0 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0cf36700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae081578d0 0x7fae08154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0cf36700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae081578d0 0x7fae08154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55602/0 (socket says 172.21.15.81:55602) 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0cf36700 1 -- 172.21.15.81:0/2346817904 learned_addr learned my addr 172.21.15.81:0/2346817904 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0cf36700 1 -- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 msgr2=0x7fae080b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0cf36700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 0x7fae080b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0cf36700 1 -- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0806d120 msgr2=0x7fae080b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0cf36700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0806d120 0x7fae080b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.515+0000 7fae0cf36700 1 -- 172.21.15.81:0/2346817904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8009420 con 0x7fae081578d0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.516+0000 7fae0cf36700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae081578d0 0x7fae08154bf0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fae08068330 tx=0x7fadf8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.516+0000 7fadfd7fa700 1 -- 172.21.15.81:0/2346817904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8011b10 con 0x7fae081578d0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.516+0000 7fadfd7fa700 1 -- 172.21.15.81:0/2346817904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf80253f0 con 0x7fae081578d0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.516+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae080b4c10 con 0x7fae081578d0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.516+0000 7fadfd7fa700 1 -- 172.21.15.81:0/2346817904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8025790 con 0x7fae081578d0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.516+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae080b51d0 con 0x7fae081578d0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.517+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae08067ac0 con 0x7fae081578d0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.517+0000 7fadfd7fa700 1 -- 172.21.15.81:0/2346817904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadf8025b80 con 0x7fae081578d0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.518+0000 7fadfd7fa700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fadec066f30 0x7fadec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.518+0000 7fadfd7fa700 1 -- 172.21.15.81:0/2346817904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fadf8085b10 con 0x7fae081578d0 2023-10-06T02:49:54.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.518+0000 7fae0d737700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fadec066f30 0x7fadec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.518+0000 7fae0d737700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fadec066f30 0x7fadec0693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fae0400e2f0 tx=0x7fae0400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:54.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.522+0000 7fadfd7fa700 1 -- 172.21.15.81:0/2346817904 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadf8052f70 con 0x7fae081578d0 2023-10-06T02:49:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.705+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae080d0450 con 0x7fae081578d0 2023-10-06T02:49:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.706+0000 7fadfd7fa700 1 -- 172.21.15.81:0/2346817904 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadf80150a0 con 0x7fae081578d0 2023-10-06T02:49:54.707 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:49:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fadec066f30 msgr2=0x7fadec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fadec066f30 0x7fadec0693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fae0400e2f0 tx=0x7fae0400b040 comp rx=0 tx=0).stop 2023-10-06T02:49:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae081578d0 msgr2=0x7fae08154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae081578d0 0x7fae08154bf0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fae08068330 tx=0x7fadf8017000 comp rx=0 tx=0).stop 2023-10-06T02:49:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 shutdown_connections 2023-10-06T02:49:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae08157ca0 0x7fae080b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fadec066f30 0x7fadec0693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae0806d120 0x7fae080b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 --2- 172.21.15.81:0/2346817904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae081578d0 0x7fae08154bf0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 >> 172.21.15.81:0/2346817904 conn(0x7fae0806bb90 msgr2=0x7fae0815c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 shutdown_connections 2023-10-06T02:49:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.708+0000 7fae0f99b700 1 -- 172.21.15.81:0/2346817904 wait complete. 2023-10-06T02:49:54.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:49:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.836+0000 7f31c825a700 1 Processor -- start 2023-10-06T02:49:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.836+0000 7f31c825a700 1 -- start start 2023-10-06T02:49:54.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.837+0000 7f31c825a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 0x7f31c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.837+0000 7f31c825a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f31c006d120 0x7f31c006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.837+0000 7f31c825a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c006dac0 con 0x7f31c01578d0 2023-10-06T02:49:54.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.837+0000 7f31c825a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00d07c0 con 0x7f31c006d120 2023-10-06T02:49:54.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.837+0000 7f31c825a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00cfbb0 con 0x7f31c0157ca0 2023-10-06T02:49:54.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c57f5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 0x7f31c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c67f7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f31c006d120 0x7f31c006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c5ff6700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f31c01578d0 0x7f31c015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:49074/0 (socket says 172.21.15.81:49074) 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c5ff6700 1 -- 172.21.15.81:0/2747392116 learned_addr learned my addr 172.21.15.81:0/2747392116 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c4ff4700 1 -- 172.21.15.81:0/2747392116 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179980254 0 0) 0x7f31bc001490 con 0x7f31c01578d0 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c4ff4700 1 -- 172.21.15.81:0/2747392116 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ac003570 con 0x7f31c01578d0 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c67f7700 1 -- 172.21.15.81:0/2747392116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 msgr2=0x7f31c00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c67f7700 1 --2- 172.21.15.81:0/2747392116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 0x7f31c00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c67f7700 1 -- 172.21.15.81:0/2747392116 >> v1:172.21.15.83:6789/0 conn(0x7f31c01578d0 legacy=0x7f31c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c67f7700 1 -- 172.21.15.81:0/2747392116 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00cfe90 con 0x7f31c006d120 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c57f5700 1 --2- 172.21.15.81:0/2747392116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 0x7f31c00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c67f7700 1 --2- 172.21.15.81:0/2747392116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31c006d120 0x7f31c006d580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f31b80098e0 tx=0x7f31b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26df127562eddffd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c4ff4700 1 -- 172.21.15.81:0/2747392116 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8011630 con 0x7f31c006d120 2023-10-06T02:49:54.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c4ff4700 1 -- 172.21.15.81:0/2747392116 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8011790 con 0x7f31c006d120 2023-10-06T02:49:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.838+0000 7f31c4ff4700 1 -- 172.21.15.81:0/2747392116 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8011b30 con 0x7f31c006d120 2023-10-06T02:49:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.839+0000 7f31c825a700 1 -- 172.21.15.81:0/2747392116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31c006d120 msgr2=0x7f31c006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.839+0000 7f31c825a700 1 --2- 172.21.15.81:0/2747392116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31c006d120 0x7f31c006d580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f31b80098e0 tx=0x7f31b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.839+0000 7f31c825a700 1 -- 172.21.15.81:0/2747392116 shutdown_connections 2023-10-06T02:49:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.839+0000 7f31c825a700 1 --2- 172.21.15.81:0/2747392116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31c006d120 0x7f31c006d580 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.839+0000 7f31c825a700 1 --2- 172.21.15.81:0/2747392116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 0x7f31c00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.839+0000 7f31c825a700 1 -- 172.21.15.81:0/2747392116 >> 172.21.15.81:0/2747392116 conn(0x7f31c006bb90 msgr2=0x7f31c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.839+0000 7f31c825a700 1 -- 172.21.15.81:0/2747392116 shutdown_connections 2023-10-06T02:49:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.839+0000 7f31c825a700 1 -- 172.21.15.81:0/2747392116 wait complete. 2023-10-06T02:49:54.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.840+0000 7f31c825a700 1 Processor -- start 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.840+0000 7f31c825a700 1 -- start start 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c825a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c006d120 0x7f31c0149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c825a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31c01578d0 0x7f31c00c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c825a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 0x7f31c00c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c825a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0147030 con 0x7f31c006d120 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c825a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00c5b20 con 0x7f31c01578d0 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c825a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00c66a0 con 0x7f31c0157ca0 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c5ff6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c006d120 0x7f31c0149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c5ff6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c006d120 0x7f31c0149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55604/0 (socket says 172.21.15.81:55604) 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c5ff6700 1 -- 172.21.15.81:0/1491675566 learned_addr learned my addr 172.21.15.81:0/1491675566 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c67f7700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 0x7f31c00c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c5ff6700 1 -- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 msgr2=0x7f31c00c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c5ff6700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 0x7f31c00c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c57f5700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31c01578d0 0x7f31c00c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c5ff6700 1 -- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31c01578d0 msgr2=0x7f31c00c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c5ff6700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31c01578d0 0x7f31c00c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.841+0000 7f31c5ff6700 1 -- 172.21.15.81:0/1491675566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0009420 con 0x7f31c006d120 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.842+0000 7f31c5ff6700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c006d120 0x7f31c0149920 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00cd60 tx=0x7f31bc001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.842+0000 7f31b5ffb700 1 -- 172.21.15.81:0/1491675566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00ab30 con 0x7f31c006d120 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.842+0000 7f31b5ffb700 1 -- 172.21.15.81:0/1491675566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00acb0 con 0x7f31c006d120 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.842+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b8009420 con 0x7f31c006d120 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.842+0000 7f31b5ffb700 1 -- 172.21.15.81:0/1491675566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc007340 con 0x7f31c006d120 2023-10-06T02:49:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.842+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c00c6050 con 0x7f31c006d120 2023-10-06T02:49:54.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.843+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c00b2f00 con 0x7f31c006d120 2023-10-06T02:49:54.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.843+0000 7f31b5ffb700 1 -- 172.21.15.81:0/1491675566 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31bc007770 con 0x7f31c006d120 2023-10-06T02:49:54.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.843+0000 7f31b5ffb700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31a4066f30 0x7f31a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:54.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.844+0000 7f31b5ffb700 1 -- 172.21.15.81:0/1491675566 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f31bc0846d0 con 0x7f31c006d120 2023-10-06T02:49:54.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.844+0000 7f31c57f5700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31a4066f30 0x7f31a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:54.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.844+0000 7f31c57f5700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31a4066f30 0x7f31a40693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f31b0006f00 tx=0x7f31b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:54.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:54.848+0000 7f31b5ffb700 1 -- 172.21.15.81:0/1491675566 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31bc051bb0 con 0x7f31c006d120 2023-10-06T02:49:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.033+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f31c006dac0 con 0x7f31c006d120 2023-10-06T02:49:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.033+0000 7f31b5ffb700 1 -- 172.21.15.81:0/1491675566 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7f31c006dac0 con 0x7f31c006d120 2023-10-06T02:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31a4066f30 msgr2=0x7f31a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31a4066f30 0x7f31a40693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f31b0006f00 tx=0x7f31b0008040 comp rx=0 tx=0).stop 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c006d120 msgr2=0x7f31c0149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c006d120 0x7f31c0149920 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00cd60 tx=0x7f31bc001b10 comp rx=0 tx=0).stop 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 shutdown_connections 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31c0157ca0 0x7f31c00c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c006d120 0x7f31c0149920 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31a4066f30 0x7f31a40693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 --2- 172.21.15.81:0/1491675566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31c01578d0 0x7f31c00c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 >> 172.21.15.81:0/1491675566 conn(0x7f31c006bb90 msgr2=0x7f31c0155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 shutdown_connections 2023-10-06T02:49:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.035+0000 7f31c825a700 1 -- 172.21.15.81:0/1491675566 wait complete. 2023-10-06T02:49:55.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:49:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.162+0000 7fe60250d700 1 Processor -- start 2023-10-06T02:49:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.162+0000 7fe60250d700 1 -- start start 2023-10-06T02:49:55.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.163+0000 7fe60250d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe5fc06d830 0x7fe5fc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.163+0000 7fe60250d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc0d07c0 con 0x7fe5fc157ca0 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.163+0000 7fe60250d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc0cfbb0 con 0x7fe5fc1578d0 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.163+0000 7fe60250d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cfe90 con 0x7fe5fc06d830 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.163+0000 7fe5fb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe5fc157ca0 0x7fe5fc06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48376/0 (socket says 172.21.15.81:48376) 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.163+0000 7fe5fb7fe700 1 -- 172.21.15.81:0/3840492573 learned_addr learned my addr 172.21.15.81:0/3840492573 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.163+0000 7fe600aaa700 1 --2- 172.21.15.81:0/3840492573 >> v2:172.21.15.83:3300/0 conn(0x7fe5fc06d830 0x7fe5fc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.163+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303825273 0 0) 0x7fe5fc0d07c0 con 0x7fe5fc157ca0 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e4003570 con 0x7fe5fc157ca0 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2289816355 0 0) 0x7fe5e4003570 con 0x7fe5fc157ca0 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 >> v2:172.21.15.83:3300/0 conn(0x7fe5fc06d830 msgr2=0x7fe5fc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 --2- 172.21.15.81:0/3840492573 >> v2:172.21.15.83:3300/0 conn(0x7fe5fc06d830 0x7fe5fc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 >> v1:172.21.15.83:6789/0 conn(0x7fe5fc1578d0 legacy=0x7fe5fc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0d0170 con 0x7fe5fc157ca0 2023-10-06T02:49:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fe5f0001470 con 0x7fe5fc157ca0 2023-10-06T02:49:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 >> v1:172.21.15.81:6789/0 conn(0x7fe5fc157ca0 legacy=0x7fe5fc06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5e4003a60 0x7fe5e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5e4004810 0x7fe5e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5e40051c0 0x7fe5e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cfe90 con 0x7fe5e4004810 2023-10-06T02:49:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e400c0d0 con 0x7fe5e40051c0 2023-10-06T02:49:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e400c290 con 0x7fe5e4003a60 2023-10-06T02:49:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5fb7fe700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5e4004810 0x7fe5e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5fbfff700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5e4003a60 0x7fe5e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe600aaa700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5e40051c0 0x7fe5e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5fb7fe700 1 -- 172.21.15.81:0/3840492573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5e4003a60 msgr2=0x7fe5e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5fb7fe700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5e4003a60 0x7fe5e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5fb7fe700 1 -- 172.21.15.81:0/3840492573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5e40051c0 msgr2=0x7fe5e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5fb7fe700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5e40051c0 0x7fe5e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe600aaa700 1 -- 172.21.15.81:0/3840492573 reap_dead start 2023-10-06T02:49:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5fb7fe700 1 -- 172.21.15.81:0/3840492573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4003570 con 0x7fe5e4004810 2023-10-06T02:49:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5fbfff700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5e4003a60 0x7fe5e4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5fb7fe700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5e4004810 0x7fe5e4004c80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c390 tx=0x7fe5f0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669acef560a8e34f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000cc20 con 0x7fe5e4004810 2023-10-06T02:49:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f000cd80 con 0x7fe5e4004810 2023-10-06T02:49:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.164+0000 7fe5faffd700 1 -- 172.21.15.81:0/3840492573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0005b50 con 0x7fe5e4004810 2023-10-06T02:49:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.165+0000 7fe60250d700 1 -- 172.21.15.81:0/3840492573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5e4004810 msgr2=0x7fe5e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.165+0000 7fe60250d700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5e4004810 0x7fe5e4004c80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c390 tx=0x7fe5f0001e50 comp rx=0 tx=0).stop 2023-10-06T02:49:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.165+0000 7fe60250d700 1 -- 172.21.15.81:0/3840492573 shutdown_connections 2023-10-06T02:49:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.165+0000 7fe60250d700 1 --2- 172.21.15.81:0/3840492573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5e4004810 0x7fe5e4004c80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.165+0000 7fe60250d700 1 -- 172.21.15.81:0/3840492573 >> 172.21.15.81:0/3840492573 conn(0x7fe5fc06bb90 msgr2=0x7fe5fc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.165+0000 7fe60250d700 1 -- 172.21.15.81:0/3840492573 shutdown_connections 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.165+0000 7fe60250d700 1 -- 172.21.15.81:0/3840492573 wait complete. 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.166+0000 7fe60250d700 1 Processor -- start 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.166+0000 7fe60250d700 1 -- start start 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe60250d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5e4004810 0x7fe5fc1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe60250d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5fc0c7d10 0x7fe5fc16ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe60250d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5fc0c8180 0x7fe5fc0c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe60250d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0c8cb0 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe60250d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0c86f0 con 0x7fe5fc0c8180 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe60250d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0c89d0 con 0x7fe5e4004810 2023-10-06T02:49:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe5fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5fc0c7d10 0x7fe5fc16ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe5fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5fc0c7d10 0x7fe5fc16ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55634/0 (socket says 172.21.15.81:55634) 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe5fb7fe700 1 -- 172.21.15.81:0/3741949893 learned_addr learned my addr 172.21.15.81:0/3741949893 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe5fb7fe700 1 -- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5e4004810 msgr2=0x7fe5fc1538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe5fb7fe700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5e4004810 0x7fe5fc1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe5fb7fe700 1 -- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5fc0c8180 msgr2=0x7fe5fc0c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe5fb7fe700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5fc0c8180 0x7fe5fc0c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe5fb7fe700 1 -- 172.21.15.81:0/3741949893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0c6180 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.167+0000 7fe5fb7fe700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5fc0c7d10 0x7fe5fc16ab20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c0a0 tx=0x7fe5f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.168+0000 7fe5e3fff700 1 -- 172.21.15.81:0/3741949893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0000ed0 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.168+0000 7fe5e3fff700 1 -- 172.21.15.81:0/3741949893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f0001430 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.168+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc0c6460 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.168+0000 7fe5e3fff700 1 -- 172.21.15.81:0/3741949893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0007320 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.168+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc153fd0 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.169+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc067ac0 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.169+0000 7fe5e3fff700 1 -- 172.21.15.81:0/3741949893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5f0007710 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.169+0000 7fe5e3fff700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e8066f30 0x7fe5e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.169+0000 7fe5e3fff700 1 -- 172.21.15.81:0/3741949893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe5f0085710 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.169+0000 7fe5fbfff700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e8066f30 0x7fe5e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.170+0000 7fe5fbfff700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e8066f30 0x7fe5e80693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec007fd0 tx=0x7fe5ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.173+0000 7fe5e3fff700 1 -- 172.21.15.81:0/3741949893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5f0052b70 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.356+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5fc0c67d0 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.357+0000 7fe5e3fff700 1 -- 172.21.15.81:0/3741949893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe5f0017090 con 0x7fe5fc0c7d10 2023-10-06T02:49:55.359 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:55.359 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:49:55.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:55.359 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:49:55.359 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:49:55.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:49:55.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:49:55.359 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:49:55.359 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:49:55.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:49:55.360 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:49:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e8066f30 msgr2=0x7fe5e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e8066f30 0x7fe5e80693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec007fd0 tx=0x7fe5ec009040 comp rx=0 tx=0).stop 2023-10-06T02:49:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5fc0c7d10 msgr2=0x7fe5fc16ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5fc0c7d10 0x7fe5fc16ab20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c0a0 tx=0x7fe5f0015000 comp rx=0 tx=0).stop 2023-10-06T02:49:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 shutdown_connections 2023-10-06T02:49:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5e8066f30 0x7fe5e80693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5fc0c8180 0x7fe5fc0c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5e4004810 0x7fe5fc1538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 --2- 172.21.15.81:0/3741949893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5fc0c7d10 0x7fe5fc16ab20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 >> 172.21.15.81:0/3741949893 conn(0x7fe5fc06bb90 msgr2=0x7fe5fc1547c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:55.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 shutdown_connections 2023-10-06T02:49:55.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.359+0000 7fe60250d700 1 -- 172.21.15.81:0/3741949893 wait complete. 2023-10-06T02:49:55.372 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:49:55.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:49:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.488+0000 7fa2f89f0700 1 Processor -- start 2023-10-06T02:49:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.488+0000 7fa2f89f0700 1 -- start start 2023-10-06T02:49:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2f89f0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2f40cf240 0x7fa2f4162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2f89f0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f40b2890 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2f89f0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f40b4070 con 0x7fa2f4157fe0 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2f89f0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f40b4350 con 0x7fa2f40cf240 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2f2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2f40cf240 0x7fa2f4162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2e9d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa2f40b3bd0 0x7fa2f40ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48382/0 (socket says 172.21.15.81:48382) 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2e9d9b700 1 -- 172.21.15.81:0/1619037007 learned_addr learned my addr 172.21.15.81:0/1619037007 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2f2d9d700 1 -- 172.21.15.81:0/1619037007 >> v1:172.21.15.83:6789/0 conn(0x7fa2f4157fe0 legacy=0x7fa2f40b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2f2d9d700 1 -- 172.21.15.81:0/1619037007 >> v1:172.21.15.81:6789/0 conn(0x7fa2f40b3bd0 legacy=0x7fa2f40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2f1d9b700 1 -- 172.21.15.81:0/1619037007 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059635199 0 0) 0x7fa2f40b2890 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.489+0000 7fa2f2d9d700 1 -- 172.21.15.81:0/1619037007 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40b4630 con 0x7fa2f40cf240 2023-10-06T02:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f2d9d700 1 --2- 172.21.15.81:0/1619037007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40cf240 0x7fa2f4162cd0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009e60 tx=0x7fa2ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38435792b94a53c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f1d9b700 1 -- 172.21.15.81:0/1619037007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00e070 con 0x7fa2f40cf240 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f1d9b700 1 -- 172.21.15.81:0/1619037007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec00bc30 con 0x7fa2f40cf240 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f1d9b700 1 -- 172.21.15.81:0/1619037007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec012430 con 0x7fa2f40cf240 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f89f0700 1 -- 172.21.15.81:0/1619037007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40cf240 msgr2=0x7fa2f4162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f89f0700 1 --2- 172.21.15.81:0/1619037007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40cf240 0x7fa2f4162cd0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009e60 tx=0x7fa2ec009780 comp rx=0 tx=0).stop 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f89f0700 1 -- 172.21.15.81:0/1619037007 shutdown_connections 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f89f0700 1 --2- 172.21.15.81:0/1619037007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40cf240 0x7fa2f4162cd0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f89f0700 1 -- 172.21.15.81:0/1619037007 >> 172.21.15.81:0/1619037007 conn(0x7fa2f4067640 msgr2=0x7fa2f4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f89f0700 1 -- 172.21.15.81:0/1619037007 shutdown_connections 2023-10-06T02:49:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.490+0000 7fa2f89f0700 1 -- 172.21.15.81:0/1619037007 wait complete. 2023-10-06T02:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f89f0700 1 Processor -- start 2023-10-06T02:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f89f0700 1 -- start start 2023-10-06T02:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f89f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40b3bd0 0x7fa2f40cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f89f0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2f40cf240 0x7fa2f40c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f89f0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2f4157fe0 0x7fa2f40c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f89f0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40c4eb0 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f89f0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f415dd20 con 0x7fa2f4157fe0 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f89f0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f415e000 con 0x7fa2f40cf240 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40b3bd0 0x7fa2f40cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40b3bd0 0x7fa2f40cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55648/0 (socket says 172.21.15.81:55648) 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f259c700 1 -- 172.21.15.81:0/65884835 learned_addr learned my addr 172.21.15.81:0/65884835 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2e9d9b700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2f40cf240 0x7fa2f40c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.492+0000 7fa2f2d9d700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2f4157fe0 0x7fa2f40c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2f259c700 1 -- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2f40cf240 msgr2=0x7fa2f40c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2f259c700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2f40cf240 0x7fa2f40c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2f259c700 1 -- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2f4157fe0 msgr2=0x7fa2f40c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2f259c700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2f4157fe0 0x7fa2f40c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2f259c700 1 -- 172.21.15.81:0/65884835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec009a20 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2e9d9b700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2f40cf240 0x7fa2f40c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2f259c700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40b3bd0 0x7fa2f40cbc80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c790 tx=0x7fa2e4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2eaffd700 1 -- 172.21.15.81:0/65884835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4006820 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2eaffd700 1 -- 172.21.15.81:0/65884835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e4006980 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f415e2e0 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2eaffd700 1 -- 172.21.15.81:0/65884835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4006d40 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.493+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f40cc1c0 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.494+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f4069e40 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.494+0000 7fa2eaffd700 1 -- 172.21.15.81:0/65884835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2e4007240 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.495+0000 7fa2eaffd700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2d4066f30 0x7fa2d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.495+0000 7fa2eaffd700 1 -- 172.21.15.81:0/65884835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa2e40838d0 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.495+0000 7fa2e9d9b700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2d4066f30 0x7fa2d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:55.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.495+0000 7fa2e9d9b700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2d4066f30 0x7fa2d40693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40ce060 tx=0x7fa2dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:55.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.499+0000 7fa2eaffd700 1 -- 172.21.15.81:0/65884835 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2e4050d30 con 0x7fa2f40b3bd0 2023-10-06T02:49:55.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:55.686+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa2f40cc6b0 con 0x7fa2f40b3bd0 2023-10-06T02:49:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.674+0000 7fa2eaffd700 1 -- 172.21.15.81:0/65884835 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa2e4017070 con 0x7fa2f40b3bd0 2023-10-06T02:49:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.677+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2d4066f30 msgr2=0x7fa2d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.677+0000 7fa2f89f0700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2d4066f30 0x7fa2d40693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40ce060 tx=0x7fa2dc009040 comp rx=0 tx=0).stop 2023-10-06T02:49:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.677+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40b3bd0 msgr2=0x7fa2f40cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.677+0000 7fa2f89f0700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40b3bd0 0x7fa2f40cbc80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c790 tx=0x7fa2e4007f60 comp rx=0 tx=0).stop 2023-10-06T02:49:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.677+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 shutdown_connections 2023-10-06T02:49:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.677+0000 7fa2f89f0700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2d4066f30 0x7fa2d40693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.678+0000 7fa2f89f0700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2f4157fe0 0x7fa2f40c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.678+0000 7fa2f89f0700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40b3bd0 0x7fa2f40cbc80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.678+0000 7fa2f89f0700 1 --2- 172.21.15.81:0/65884835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2f40cf240 0x7fa2f40c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.678+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 >> 172.21.15.81:0/65884835 conn(0x7fa2f4067640 msgr2=0x7fa2f40ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.678+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 shutdown_connections 2023-10-06T02:49:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.678+0000 7fa2f89f0700 1 -- 172.21.15.81:0/65884835 wait complete. 2023-10-06T02:49:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:49:56.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:49:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.811+0000 7f6e7ddb7700 1 Processor -- start 2023-10-06T02:49:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.811+0000 7f6e7ddb7700 1 -- start start 2023-10-06T02:49:56.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.812+0000 7f6e7ddb7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6e781544f0 0x7f6e781582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:56.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.812+0000 7f6e7ddb7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e781548c0 0x7f6e780b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:56.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.812+0000 7f6e7ddb7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780aee70 con 0x7f6e78158830 2023-10-06T02:49:56.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.812+0000 7f6e7ddb7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780af710 con 0x7f6e781548c0 2023-10-06T02:49:56.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.812+0000 7f6e7ddb7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780b20b0 con 0x7f6e781544f0 2023-10-06T02:49:56.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.812+0000 7f6e76ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e781548c0 0x7f6e780b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:56.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.812+0000 7f6e76ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e781548c0 0x7f6e780b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55650/0 (socket says 172.21.15.81:55650) 2023-10-06T02:49:56.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.812+0000 7f6e76ffd700 1 -- 172.21.15.81:0/556853054 learned_addr learned my addr 172.21.15.81:0/556853054 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:56.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e777fe700 1 --2- 172.21.15.81:0/556853054 >> v2:172.21.15.83:3300/0 conn(0x7f6e781544f0 0x7f6e781582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:56.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e76ffd700 1 -- 172.21.15.81:0/556853054 >> v2:172.21.15.83:3300/0 conn(0x7f6e781544f0 msgr2=0x7f6e781582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:56.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e76ffd700 1 --2- 172.21.15.81:0/556853054 >> v2:172.21.15.83:3300/0 conn(0x7f6e781544f0 0x7f6e781582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e76ffd700 1 -- 172.21.15.81:0/556853054 >> v1:172.21.15.83:6789/0 conn(0x7f6e78158830 legacy=0x7f6e780afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:56.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e76ffd700 1 -- 172.21.15.81:0/556853054 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780af0c0 con 0x7f6e781548c0 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e76ffd700 1 --2- 172.21.15.81:0/556853054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781548c0 0x7f6e780b15f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6e780695a0 tx=0x7f6e6c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72699e531ecbc7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e767fc700 1 -- 172.21.15.81:0/556853054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00dc10 con 0x7f6e781548c0 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e767fc700 1 -- 172.21.15.81:0/556853054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c00dd70 con 0x7f6e781548c0 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e767fc700 1 -- 172.21.15.81:0/556853054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c0106c0 con 0x7f6e781548c0 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/556853054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781548c0 msgr2=0x7f6e780b15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.813+0000 7f6e7ddb7700 1 --2- 172.21.15.81:0/556853054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781548c0 0x7f6e780b15f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6e780695a0 tx=0x7f6e6c00b4f0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.814+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/556853054 shutdown_connections 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.814+0000 7f6e7ddb7700 1 --2- 172.21.15.81:0/556853054 >> v2:172.21.15.83:3300/0 conn(0x7f6e781544f0 0x7f6e781582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.814+0000 7f6e7ddb7700 1 --2- 172.21.15.81:0/556853054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781548c0 0x7f6e780b15f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.814+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/556853054 >> 172.21.15.81:0/556853054 conn(0x7f6e7806cca0 msgr2=0x7f6e7806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.814+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/556853054 shutdown_connections 2023-10-06T02:49:56.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.814+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/556853054 wait complete. 2023-10-06T02:49:56.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.815+0000 7f6e7ddb7700 1 Processor -- start 2023-10-06T02:49:56.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.815+0000 7f6e7ddb7700 1 -- start start 2023-10-06T02:49:56.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.815+0000 7f6e7ddb7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781544f0 0x7f6e780ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:56.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.815+0000 7f6e7ddb7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e781548c0 0x7f6e781507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:56.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.815+0000 7f6e7ddb7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e78158830 0x7f6e781525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:56.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.815+0000 7f6e7ddb7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780aa290 con 0x7f6e781544f0 2023-10-06T02:49:56.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e7ddb7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780ad0f0 con 0x7f6e78158830 2023-10-06T02:49:56.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e7ddb7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780abba0 con 0x7f6e781548c0 2023-10-06T02:49:56.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781544f0 0x7f6e780ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781544f0 0x7f6e780ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55658/0 (socket says 172.21.15.81:55658) 2023-10-06T02:49:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e777fe700 1 -- 172.21.15.81:0/3231816058 learned_addr learned my addr 172.21.15.81:0/3231816058 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e76ffd700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e781548c0 0x7f6e781507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e77fff700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e78158830 0x7f6e781525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e777fe700 1 -- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e781548c0 msgr2=0x7f6e781507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e777fe700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e781548c0 0x7f6e781507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e777fe700 1 -- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e78158830 msgr2=0x7f6e781525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e777fe700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e78158830 0x7f6e781525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e777fe700 1 -- 172.21.15.81:0/3231816058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c00b790 con 0x7f6e781544f0 2023-10-06T02:49:56.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e777fe700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781544f0 0x7f6e780ab660 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800e190 tx=0x7f6e68009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:56.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e5f7fe700 1 -- 172.21.15.81:0/3231816058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800ee30 con 0x7f6e781544f0 2023-10-06T02:49:56.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e5f7fe700 1 -- 172.21.15.81:0/3231816058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e68014420 con 0x7f6e781544f0 2023-10-06T02:49:56.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e780a9680 con 0x7f6e781544f0 2023-10-06T02:49:56.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e5f7fe700 1 -- 172.21.15.81:0/3231816058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e680147e0 con 0x7f6e781544f0 2023-10-06T02:49:56.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.816+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e780a9a10 con 0x7f6e781544f0 2023-10-06T02:49:56.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.817+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e78068890 con 0x7f6e781544f0 2023-10-06T02:49:56.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.818+0000 7f6e5f7fe700 1 -- 172.21.15.81:0/3231816058 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e68014b90 con 0x7f6e781544f0 2023-10-06T02:49:56.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.818+0000 7f6e5f7fe700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e64066f30 0x7f6e640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:56.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.818+0000 7f6e5f7fe700 1 -- 172.21.15.81:0/3231816058 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f6e68084ce0 con 0x7f6e781544f0 2023-10-06T02:49:56.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.818+0000 7f6e76ffd700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e64066f30 0x7f6e640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:56.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.819+0000 7f6e76ffd700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e64066f30 0x7f6e640693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e780695a0 tx=0x7f6e6c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:56.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:56.822+0000 7f6e5f7fe700 1 -- 172.21.15.81:0/3231816058 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e68051fd0 con 0x7f6e781544f0 2023-10-06T02:49:57.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.007+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6e780af3a0 con 0x7f6e781544f0 2023-10-06T02:49:57.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.685+0000 7f6e5f7fe700 1 -- 172.21.15.81:0/3231816058 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6e68009a60 con 0x7f6e781544f0 2023-10-06T02:49:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e64066f30 msgr2=0x7f6e640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e64066f30 0x7f6e640693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e780695a0 tx=0x7f6e6c01a000 comp rx=0 tx=0).stop 2023-10-06T02:49:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781544f0 msgr2=0x7f6e780ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781544f0 0x7f6e780ab660 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800e190 tx=0x7f6e68009920 comp rx=0 tx=0).stop 2023-10-06T02:49:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 shutdown_connections 2023-10-06T02:49:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e64066f30 0x7f6e640693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e78158830 0x7f6e781525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e781544f0 0x7f6e780ab660 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 --2- 172.21.15.81:0/3231816058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e781548c0 0x7f6e781507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 >> 172.21.15.81:0/3231816058 conn(0x7f6e7806cca0 msgr2=0x7f6e780cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 shutdown_connections 2023-10-06T02:49:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.694+0000 7f6e7ddb7700 1 -- 172.21.15.81:0/3231816058 wait complete. 2023-10-06T02:49:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:49:57.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:49:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.827+0000 7ff6b5be3700 1 Processor -- start 2023-10-06T02:49:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.827+0000 7ff6b5be3700 1 -- start start 2023-10-06T02:49:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6b5be3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6b0068980 0x7ff6b00ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6b5be3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 0x7ff6b01618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6b5be3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b00c8e20 con 0x7ff6b00c6fc0 2023-10-06T02:49:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6b5be3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b00c9100 con 0x7ff6b0068980 2023-10-06T02:49:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6b5be3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00c1810 con 0x7ff6b00c3020 2023-10-06T02:49:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6a7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6b0068980 0x7ff6b00ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6a7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6b0068980 0x7ff6b00ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55674/0 (socket says 172.21.15.81:55674) 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6a7fff700 1 -- 172.21.15.81:0/2510107381 learned_addr learned my addr 172.21.15.81:0/2510107381 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6a7fff700 1 -- 172.21.15.81:0/2510107381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 msgr2=0x7ff6b01618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6affff700 1 --2- 172.21.15.81:0/2510107381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 0x7ff6b01618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6a7fff700 1 --2- 172.21.15.81:0/2510107381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 0x7ff6b01618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.828+0000 7ff6a7fff700 1 -- 172.21.15.81:0/2510107381 >> v1:172.21.15.83:6789/0 conn(0x7ff6b00c6fc0 legacy=0x7ff6b00c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6a7fff700 1 -- 172.21.15.81:0/2510107381 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00c1af0 con 0x7ff6b0068980 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6a7fff700 1 --2- 172.21.15.81:0/2510107381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 0x7ff6b00ab6e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff6980099b0 tx=0x7ff698009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edfc5f90eff5ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6aeffd700 1 -- 172.21.15.81:0/2510107381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69800b820 con 0x7ff6b0068980 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6aeffd700 1 -- 172.21.15.81:0/2510107381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69800b980 con 0x7ff6b0068980 2023-10-06T02:49:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6aeffd700 1 -- 172.21.15.81:0/2510107381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69800bd20 con 0x7ff6b0068980 2023-10-06T02:49:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6b5be3700 1 -- 172.21.15.81:0/2510107381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 msgr2=0x7ff6b00ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6b5be3700 1 --2- 172.21.15.81:0/2510107381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 0x7ff6b00ab6e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff6980099b0 tx=0x7ff698009250 comp rx=0 tx=0).stop 2023-10-06T02:49:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6b5be3700 1 -- 172.21.15.81:0/2510107381 shutdown_connections 2023-10-06T02:49:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6b5be3700 1 --2- 172.21.15.81:0/2510107381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 0x7ff6b01618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6b5be3700 1 --2- 172.21.15.81:0/2510107381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 0x7ff6b00ab6e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6b5be3700 1 -- 172.21.15.81:0/2510107381 >> 172.21.15.81:0/2510107381 conn(0x7ff6b006c660 msgr2=0x7ff6b00cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6b5be3700 1 -- 172.21.15.81:0/2510107381 shutdown_connections 2023-10-06T02:49:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.829+0000 7ff6b5be3700 1 -- 172.21.15.81:0/2510107381 wait complete. 2023-10-06T02:49:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.831+0000 7ff6b5be3700 1 Processor -- start 2023-10-06T02:49:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.831+0000 7ff6b5be3700 1 -- start start 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.831+0000 7ff6b5be3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 0x7ff6b00cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.831+0000 7ff6b5be3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 0x7ff6b00c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.831+0000 7ff6b5be3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6b00c6fc0 0x7ff6b016da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.831+0000 7ff6b5be3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00cc490 con 0x7ff6b0068980 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6b5be3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00c6550 con 0x7ff6b00c6fc0 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6b5be3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b016e580 con 0x7ff6b00c3020 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 0x7ff6b00cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 0x7ff6b00cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55684/0 (socket says 172.21.15.81:55684) 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6af7fe700 1 -- 172.21.15.81:0/1688269005 learned_addr learned my addr 172.21.15.81:0/1688269005 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6a7fff700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 0x7ff6b00c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6affff700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6b00c6fc0 0x7ff6b016da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6af7fe700 1 -- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 msgr2=0x7ff6b00c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6af7fe700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 0x7ff6b00c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6af7fe700 1 -- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6b00c6fc0 msgr2=0x7ff6b016da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6af7fe700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6b00c6fc0 0x7ff6b016da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6af7fe700 1 -- 172.21.15.81:0/1688269005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6980094f0 con 0x7ff6b0068980 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6af7fe700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 0x7ff6b00cbf50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000b5e0 tx=0x7ff6a0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6a77fe700 1 -- 172.21.15.81:0/1688269005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000f510 con 0x7ff6b0068980 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6a77fe700 1 -- 172.21.15.81:0/1688269005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a000f670 con 0x7ff6b0068980 2023-10-06T02:49:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b016e860 con 0x7ff6b0068980 2023-10-06T02:49:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6a77fe700 1 -- 172.21.15.81:0/1688269005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000fa30 con 0x7ff6b0068980 2023-10-06T02:49:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.832+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b00cb750 con 0x7ff6b0068980 2023-10-06T02:49:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.833+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b0067bc0 con 0x7ff6b0068980 2023-10-06T02:49:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.834+0000 7ff6a77fe700 1 -- 172.21.15.81:0/1688269005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6a001a400 con 0x7ff6b0068980 2023-10-06T02:49:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.834+0000 7ff6a77fe700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff690066f30 0x7ff6900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.834+0000 7ff6a77fe700 1 -- 172.21.15.81:0/1688269005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5958+0+0 (secure 0 0 0) 0x7ff6a0084020 con 0x7ff6b0068980 2023-10-06T02:49:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.834+0000 7ff6a7fff700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff690066f30 0x7ff6900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.835+0000 7ff6a7fff700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff690066f30 0x7ff6900693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff6980099b0 tx=0x7ff698016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:57.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:57.839+0000 7ff6a77fe700 1 -- 172.21.15.81:0/1688269005 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6a0051210 con 0x7ff6b0068980 2023-10-06T02:49:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.064+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff6b0068e10 con 0x7ff6b0068980 2023-10-06T02:49:58.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.682+0000 7ff6a77fe700 1 -- 172.21.15.81:0/1688269005 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v39) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff6a0058e60 con 0x7ff6b0068980 2023-10-06T02:49:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff690066f30 msgr2=0x7ff6900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff690066f30 0x7ff6900693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff6980099b0 tx=0x7ff698016000 comp rx=0 tx=0).stop 2023-10-06T02:49:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 msgr2=0x7ff6b00cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 0x7ff6b00cbf50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000b5e0 tx=0x7ff6a0009120 comp rx=0 tx=0).stop 2023-10-06T02:49:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 shutdown_connections 2023-10-06T02:49:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff690066f30 0x7ff6900693e0 secure :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff6980099b0 tx=0x7ff698016000 comp rx=0 tx=0).stop 2023-10-06T02:49:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6b00c6fc0 0x7ff6b016da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b0068980 0x7ff6b00cbf50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 --2- 172.21.15.81:0/1688269005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6b00c3020 0x7ff6b00c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.690+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 >> 172.21.15.81:0/1688269005 conn(0x7ff6b006c660 msgr2=0x7ff6b006d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:58.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.692+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 shutdown_connections 2023-10-06T02:49:58.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.695+0000 7ff6b5be3700 1 -- 172.21.15.81:0/1688269005 wait complete. 2023-10-06T02:49:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 11 and data pool 12 2023-10-06T02:49:58.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:49:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.828+0000 7fb7fb1c6700 1 Processor -- start 2023-10-06T02:49:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.828+0000 7fb7fb1c6700 1 -- start start 2023-10-06T02:49:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fb1c6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb7f4159b40 0x7fb7f40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fb1c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f4159f10 0x7fb7f4068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fb1c6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f40ccb40 0x7fb7f4068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fb1c6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f40cee10 con 0x7fb7f40ccb40 2023-10-06T02:49:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fb1c6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f40cd040 con 0x7fb7f4159b40 2023-10-06T02:49:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fb1c6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40cd320 con 0x7fb7f4159f10 2023-10-06T02:49:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fa9c5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f40ccb40 0x7fb7f4068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fa9c5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f40ccb40 0x7fb7f4068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55686/0 (socket says 172.21.15.81:55686) 2023-10-06T02:49:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fa9c5700 1 -- 172.21.15.81:0/641039313 learned_addr learned my addr 172.21.15.81:0/641039313 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fa1c4700 1 --2- 172.21.15.81:0/641039313 >> v2:172.21.15.83:3300/0 conn(0x7fb7f4159b40 0x7fb7f40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7f99c3700 1 --2- 172.21.15.81:0/641039313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f4159f10 0x7fb7f4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fa9c5700 1 -- 172.21.15.81:0/641039313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f4159f10 msgr2=0x7fb7f4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fa9c5700 1 --2- 172.21.15.81:0/641039313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f4159f10 0x7fb7f4068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fa9c5700 1 -- 172.21.15.81:0/641039313 >> v2:172.21.15.83:3300/0 conn(0x7fb7f4159b40 msgr2=0x7fb7f40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fa9c5700 1 --2- 172.21.15.81:0/641039313 >> v2:172.21.15.83:3300/0 conn(0x7fb7f4159b40 0x7fb7f40cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.829+0000 7fb7fa9c5700 1 -- 172.21.15.81:0/641039313 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40ce7c0 con 0x7fb7f40ccb40 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fa9c5700 1 --2- 172.21.15.81:0/641039313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f40ccb40 0x7fb7f4068cc0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40d0bc0 tx=0x7fb7ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c100eb72c2c2fd0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7f91c2700 1 -- 172.21.15.81:0/641039313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00b860 con 0x7fb7f40ccb40 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7f91c2700 1 -- 172.21.15.81:0/641039313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00b9c0 con 0x7fb7f40ccb40 2023-10-06T02:49:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7f91c2700 1 -- 172.21.15.81:0/641039313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00bd60 con 0x7fb7f40ccb40 2023-10-06T02:49:58.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/641039313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f40ccb40 msgr2=0x7fb7f4068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:58.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/641039313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f40ccb40 0x7fb7f4068cc0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40d0bc0 tx=0x7fb7ec009250 comp rx=0 tx=0).stop 2023-10-06T02:49:58.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/641039313 shutdown_connections 2023-10-06T02:49:58.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/641039313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f40ccb40 0x7fb7f4068cc0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/641039313 >> v2:172.21.15.83:3300/0 conn(0x7fb7f4159b40 0x7fb7f40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/641039313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f4159f10 0x7fb7f4068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/641039313 >> 172.21.15.81:0/641039313 conn(0x7fb7f40cd660 msgr2=0x7fb7f40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:58.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/641039313 shutdown_connections 2023-10-06T02:49:58.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.830+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/641039313 wait complete. 2023-10-06T02:49:58.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.831+0000 7fb7fb1c6700 1 Processor -- start 2023-10-06T02:49:58.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.831+0000 7fb7fb1c6700 1 -- start start 2023-10-06T02:49:58.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7fb1c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f40ccb40 0x7fb7f40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7fb1c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f4159b40 0x7fb7f40b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7fb1c6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f4159f10 0x7fb7f415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7fb1c6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415a810 con 0x7fb7f4159b40 2023-10-06T02:49:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7fb1c6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415aaf0 con 0x7fb7f4159f10 2023-10-06T02:49:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7fb1c6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415add0 con 0x7fb7f40ccb40 2023-10-06T02:49:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7f99c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f4159b40 0x7fb7f40b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7fa1c4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f40ccb40 0x7fb7f40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7f99c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f4159b40 0x7fb7f40b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55698/0 (socket says 172.21.15.81:55698) 2023-10-06T02:49:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7f99c3700 1 -- 172.21.15.81:0/3008331535 learned_addr learned my addr 172.21.15.81:0/3008331535 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.832+0000 7fb7fa9c5700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f4159f10 0x7fb7f415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7f99c3700 1 -- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f40ccb40 msgr2=0x7fb7f40b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7f99c3700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f40ccb40 0x7fb7f40b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7f99c3700 1 -- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f4159f10 msgr2=0x7fb7f415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7f99c3700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f4159f10 0x7fb7f415c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7f99c3700 1 -- 172.21.15.81:0/3008331535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec0094f0 con 0x7fb7f4159b40 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7f99c3700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f4159b40 0x7fb7f40b50f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400d860 tx=0x7fb7e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7ea7fc700 1 -- 172.21.15.81:0/3008331535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40125f0 con 0x7fb7f4159b40 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7ea7fc700 1 -- 172.21.15.81:0/3008331535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e4012750 con 0x7fb7f4159b40 2023-10-06T02:49:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f415b0b0 con 0x7fb7f4159b40 2023-10-06T02:49:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7ea7fc700 1 -- 172.21.15.81:0/3008331535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4012b10 con 0x7fb7f4159b40 2023-10-06T02:49:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.833+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f40b6720 con 0x7fb7f4159b40 2023-10-06T02:49:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.834+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f4063e90 con 0x7fb7f4159b40 2023-10-06T02:49:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.834+0000 7fb7ea7fc700 1 -- 172.21.15.81:0/3008331535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7e401e460 con 0x7fb7f4159b40 2023-10-06T02:49:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.835+0000 7fb7ea7fc700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7d8066f30 0x7fb7d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.835+0000 7fb7ea7fc700 1 -- 172.21.15.81:0/3008331535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb7e4084bc0 con 0x7fb7f4159b40 2023-10-06T02:49:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.835+0000 7fb7fa1c4700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7d8066f30 0x7fb7d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.835+0000 7fb7fa1c4700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7d8066f30 0x7fb7d80693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009fd0 tx=0x7fb7f0009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:58.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:58.839+0000 7fb7ea7fc700 1 -- 172.21.15.81:0/3008331535 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7e4051cd0 con 0x7fb7f4159b40 2023-10-06T02:49:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.023+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7f40ceaa0 con 0x7fb7f4159b40 2023-10-06T02:49:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.024+0000 7fb7ea7fc700 1 -- 172.21.15.81:0/3008331535 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16834 (secure 0 0 0) 0x7fb7e40552f0 con 0x7fb7f4159b40 2023-10-06T02:49:59.025 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:59.026 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:49:58.065813+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:49:55.704059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:49:57.024962+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7d8066f30 msgr2=0x7fb7d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7d8066f30 0x7fb7d80693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009fd0 tx=0x7fb7f0009880 comp rx=0 tx=0).stop 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f4159b40 msgr2=0x7fb7f40b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f4159b40 0x7fb7f40b50f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400d860 tx=0x7fb7e4008040 comp rx=0 tx=0).stop 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 shutdown_connections 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7d8066f30 0x7fb7d80693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7f4159f10 0x7fb7f415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7f40ccb40 0x7fb7f40b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 --2- 172.21.15.81:0/3008331535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f4159b40 0x7fb7f40b50f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 >> 172.21.15.81:0/3008331535 conn(0x7fb7f40cd660 msgr2=0x7fb7f4158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 shutdown_connections 2023-10-06T02:49:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.026+0000 7fb7fb1c6700 1 -- 172.21.15.81:0/3008331535 wait complete. 2023-10-06T02:49:59.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:49:59.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.153+0000 7f18849a8700 1 Processor -- start 2023-10-06T02:49:59.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.153+0000 7f18849a8700 1 -- start start 2023-10-06T02:49:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f18849a8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1880159f10 0x7f1880068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f18849a8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1880069120 con 0x7f1880068cc0 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f18849a8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18800cee10 con 0x7f1880159b40 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f18849a8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18800cd040 con 0x7f1880159f10 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f187effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1880159f10 0x7f1880068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f187ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1880068cc0 0x7f18800cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48390/0 (socket says 172.21.15.81:48390) 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f187ffff700 1 -- 172.21.15.81:0/2845477062 learned_addr learned my addr 172.21.15.81:0/2845477062 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f187effd700 1 -- 172.21.15.81:0/2845477062 >> v1:172.21.15.83:6789/0 conn(0x7f1880159b40 legacy=0x7f18800cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f187effd700 1 -- 172.21.15.81:0/2845477062 >> v1:172.21.15.81:6789/0 conn(0x7f1880068cc0 legacy=0x7f18800cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f187effd700 1 -- 172.21.15.81:0/2845477062 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18800cd320 con 0x7f1880159f10 2023-10-06T02:49:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.154+0000 7f187effd700 1 --2- 172.21.15.81:0/2845477062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880159f10 0x7f1880068780 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f18740098e0 tx=0x7f18740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82528948681dd808 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:59.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f187e7fc700 1 -- 172.21.15.81:0/2845477062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874009e80 con 0x7f1880159f10 2023-10-06T02:49:59.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f187e7fc700 1 -- 172.21.15.81:0/2845477062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187400b760 con 0x7f1880159f10 2023-10-06T02:49:59.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f187e7fc700 1 -- 172.21.15.81:0/2845477062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187400bae0 con 0x7f1880159f10 2023-10-06T02:49:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f18849a8700 1 -- 172.21.15.81:0/2845477062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880159f10 msgr2=0x7f1880068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f18849a8700 1 --2- 172.21.15.81:0/2845477062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880159f10 0x7f1880068780 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f18740098e0 tx=0x7f18740091a0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f18849a8700 1 -- 172.21.15.81:0/2845477062 shutdown_connections 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f18849a8700 1 --2- 172.21.15.81:0/2845477062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880159f10 0x7f1880068780 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f18849a8700 1 -- 172.21.15.81:0/2845477062 >> 172.21.15.81:0/2845477062 conn(0x7f18800cd660 msgr2=0x7f18800cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f18849a8700 1 -- 172.21.15.81:0/2845477062 shutdown_connections 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.155+0000 7f18849a8700 1 -- 172.21.15.81:0/2845477062 wait complete. 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.156+0000 7f18849a8700 1 Processor -- start 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f18849a8700 1 -- start start 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f18849a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880068cc0 0x7f1880169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f18849a8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1880159b40 0x7f188016bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f18849a8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1880159f10 0x7f188006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f18849a8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188016a2c0 con 0x7f1880068cc0 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f18849a8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188016c980 con 0x7f1880159b40 2023-10-06T02:49:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f18849a8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188016cc60 con 0x7f1880159f10 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f187f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880068cc0 0x7f1880169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f187f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880068cc0 0x7f1880169d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55724/0 (socket says 172.21.15.81:55724) 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f187f7fe700 1 -- 172.21.15.81:0/4218238943 learned_addr learned my addr 172.21.15.81:0/4218238943 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f187effd700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1880159b40 0x7f188016bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.157+0000 7f187ffff700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1880159f10 0x7f188006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f187f7fe700 1 -- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1880159f10 msgr2=0x7f188006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f187f7fe700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1880159f10 0x7f188006d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f187f7fe700 1 -- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1880159b40 msgr2=0x7f188016bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f187f7fe700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1880159b40 0x7f188016bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f187f7fe700 1 -- 172.21.15.81:0/4218238943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1874009420 con 0x7f1880068cc0 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f187ffff700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1880159f10 0x7f188006d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:49:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f187f7fe700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880068cc0 0x7f1880169d80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f187000cb10 tx=0x7f18700017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f18677fe700 1 -- 172.21.15.81:0/4218238943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700020c0 con 0x7f1880068cc0 2023-10-06T02:49:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f18677fe700 1 -- 172.21.15.81:0/4218238943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000a7e0 con 0x7f1880068cc0 2023-10-06T02:49:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188016cf40 con 0x7f1880068cc0 2023-10-06T02:49:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f18677fe700 1 -- 172.21.15.81:0/4218238943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000ab80 con 0x7f1880068cc0 2023-10-06T02:49:59.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.158+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188016d500 con 0x7f1880068cc0 2023-10-06T02:49:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.159+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188016d6f0 con 0x7f1880068cc0 2023-10-06T02:49:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.159+0000 7f18677fe700 1 -- 172.21.15.81:0/4218238943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1870003030 con 0x7f1880068cc0 2023-10-06T02:49:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.160+0000 7f18677fe700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f186c066f30 0x7f186c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.160+0000 7f18677fe700 1 -- 172.21.15.81:0/4218238943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f18700846e0 con 0x7f1880068cc0 2023-10-06T02:49:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.160+0000 7f187effd700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f186c066f30 0x7f186c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.160+0000 7f187effd700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f186c066f30 0x7f186c0693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f18740093f0 tx=0x7f1874016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:59.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.164+0000 7f18677fe700 1 -- 172.21.15.81:0/4218238943 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18700517f0 con 0x7f1880068cc0 2023-10-06T02:49:59.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.347+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18800cb890 con 0x7f1880068cc0 2023-10-06T02:49:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.348+0000 7f18677fe700 1 -- 172.21.15.81:0/4218238943 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16834 (secure 0 0 0) 0x7f1870054e10 con 0x7f1880068cc0 2023-10-06T02:49:59.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:49:59.350 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:49:58.065813+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:49:55.704059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:49:57.024962+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:49:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f186c066f30 msgr2=0x7f186c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f186c066f30 0x7f186c0693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f18740093f0 tx=0x7f1874016000 comp rx=0 tx=0).stop 2023-10-06T02:49:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880068cc0 msgr2=0x7f1880169d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880068cc0 0x7f1880169d80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f187000cb10 tx=0x7f18700017b0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 shutdown_connections 2023-10-06T02:49:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1880159f10 0x7f188006d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1880068cc0 0x7f1880169d80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f186c066f30 0x7f186c0693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 --2- 172.21.15.81:0/4218238943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1880159b40 0x7f188016bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 >> 172.21.15.81:0/4218238943 conn(0x7f18800cd660 msgr2=0x7f18800cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 shutdown_connections 2023-10-06T02:49:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.350+0000 7f18849a8700 1 -- 172.21.15.81:0/4218238943 wait complete. 2023-10-06T02:49:59.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:49:59.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.480+0000 7f6f14dde700 1 Processor -- start 2023-10-06T02:49:59.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.480+0000 7f6f14dde700 1 -- start start 2023-10-06T02:49:59.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.480+0000 7f6f14dde700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f101578d0 0x7f6f100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.480+0000 7f6f14dde700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6f1006d120 0x7f6f1006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.480+0000 7f6f14dde700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f100d07c0 con 0x7f6f10157ca0 2023-10-06T02:49:59.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.480+0000 7f6f14dde700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1006da50 con 0x7f6f101578d0 2023-10-06T02:49:59.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.480+0000 7f6f14dde700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f100cfbb0 con 0x7f6f1006d120 2023-10-06T02:49:59.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f101578d0 0x7f6f100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:59.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f101578d0 0x7f6f100cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55726/0 (socket says 172.21.15.81:55726) 2023-10-06T02:49:59.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0e59c700 1 -- 172.21.15.81:0/1407539955 learned_addr learned my addr 172.21.15.81:0/1407539955 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:59.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0ed9d700 1 --2- 172.21.15.81:0/1407539955 >> v2:172.21.15.83:3300/0 conn(0x7f6f1006d120 0x7f6f1006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:59.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0e59c700 1 -- 172.21.15.81:0/1407539955 >> v2:172.21.15.83:3300/0 conn(0x7f6f1006d120 msgr2=0x7f6f1006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:49:59.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0e59c700 1 --2- 172.21.15.81:0/1407539955 >> v2:172.21.15.83:3300/0 conn(0x7f6f1006d120 0x7f6f1006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0e59c700 1 -- 172.21.15.81:0/1407539955 >> v1:172.21.15.83:6789/0 conn(0x7f6f10157ca0 legacy=0x7f6f1015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0e59c700 1 -- 172.21.15.81:0/1407539955 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f100cfe90 con 0x7f6f101578d0 2023-10-06T02:49:59.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0e59c700 1 --2- 172.21.15.81:0/1407539955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f101578d0 0x7f6f100cf4f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6f10068300 tx=0x7f6f00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8d9da82c9ee854 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:59.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0dd9b700 1 -- 172.21.15.81:0/1407539955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000b860 con 0x7f6f101578d0 2023-10-06T02:49:59.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0dd9b700 1 -- 172.21.15.81:0/1407539955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0000b9c0 con 0x7f6f101578d0 2023-10-06T02:49:59.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.481+0000 7f6f0dd9b700 1 -- 172.21.15.81:0/1407539955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000bd60 con 0x7f6f101578d0 2023-10-06T02:49:59.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.482+0000 7f6f14dde700 1 -- 172.21.15.81:0/1407539955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f101578d0 msgr2=0x7f6f100cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.482+0000 7f6f14dde700 1 --2- 172.21.15.81:0/1407539955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f101578d0 0x7f6f100cf4f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6f10068300 tx=0x7f6f00009250 comp rx=0 tx=0).stop 2023-10-06T02:49:59.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.482+0000 7f6f14dde700 1 -- 172.21.15.81:0/1407539955 shutdown_connections 2023-10-06T02:49:59.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.482+0000 7f6f14dde700 1 --2- 172.21.15.81:0/1407539955 >> v2:172.21.15.83:3300/0 conn(0x7f6f1006d120 0x7f6f1006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.482+0000 7f6f14dde700 1 --2- 172.21.15.81:0/1407539955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f101578d0 0x7f6f100cf4f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.482+0000 7f6f14dde700 1 -- 172.21.15.81:0/1407539955 >> 172.21.15.81:0/1407539955 conn(0x7f6f1006bb90 msgr2=0x7f6f1006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:49:59.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.482+0000 7f6f14dde700 1 -- 172.21.15.81:0/1407539955 shutdown_connections 2023-10-06T02:49:59.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.482+0000 7f6f14dde700 1 -- 172.21.15.81:0/1407539955 wait complete. 2023-10-06T02:49:59.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.483+0000 7f6f14dde700 1 Processor -- start 2023-10-06T02:49:59.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.483+0000 7f6f14dde700 1 -- start start 2023-10-06T02:49:59.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f14dde700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f1006d120 0x7f6f101550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f14dde700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f101578d0 0x7f6f100aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f14dde700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f10157ca0 0x7f6f100b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f14dde700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100acbf0 con 0x7f6f1006d120 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f14dde700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100abfe0 con 0x7f6f101578d0 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f14dde700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100ac2c0 con 0x7f6f10157ca0 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f0e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f1006d120 0x7f6f101550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f0e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f1006d120 0x7f6f101550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55734/0 (socket says 172.21.15.81:55734) 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f0e59c700 1 -- 172.21.15.81:0/1479502263 learned_addr learned my addr 172.21.15.81:0/1479502263 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f0e59c700 1 -- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f10157ca0 msgr2=0x7f6f100b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f0e59c700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f10157ca0 0x7f6f100b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f0e59c700 1 -- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f101578d0 msgr2=0x7f6f100aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f0e59c700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f101578d0 0x7f6f100aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:49:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f0e59c700 1 -- 172.21.15.81:0/1479502263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f000094f0 con 0x7f6f1006d120 2023-10-06T02:49:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f0e59c700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f1006d120 0x7f6f101550f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6f1006fe20 tx=0x7f6f00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f06ffd700 1 -- 172.21.15.81:0/1479502263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00011e60 con 0x7f6f1006d120 2023-10-06T02:49:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f06ffd700 1 -- 172.21.15.81:0/1479502263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0001a630 con 0x7f6f1006d120 2023-10-06T02:49:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f100ac5a0 con 0x7f6f1006d120 2023-10-06T02:49:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f06ffd700 1 -- 172.21.15.81:0/1479502263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0001a9f0 con 0x7f6f1006d120 2023-10-06T02:49:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.484+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f10155630 con 0x7f6f1006d120 2023-10-06T02:49:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.485+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f10067ac0 con 0x7f6f1006d120 2023-10-06T02:49:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.486+0000 7f6f06ffd700 1 -- 172.21.15.81:0/1479502263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f0002d440 con 0x7f6f1006d120 2023-10-06T02:49:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.486+0000 7f6f06ffd700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ef0066f30 0x7f6ef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:49:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.486+0000 7f6f06ffd700 1 -- 172.21.15.81:0/1479502263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f000862c0 con 0x7f6f1006d120 2023-10-06T02:49:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.486+0000 7f6f05d9b700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ef0066f30 0x7f6ef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:49:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.487+0000 7f6f05d9b700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ef0066f30 0x7f6ef00693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6f100b0770 tx=0x7f6ef8007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:49:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.490+0000 7f6f06ffd700 1 -- 172.21.15.81:0/1479502263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f000533d0 con 0x7f6f1006d120 2023-10-06T02:49:59.666 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-10-06T02:49:59.665+0000 7f53ff9a2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:49:59.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:49:59.720+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6f100d0170 con 0x7f6f1006d120 2023-10-06T02:50:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.694+0000 7f6f06ffd700 1 -- 172.21.15.81:0/1479502263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6f000569f0 con 0x7f6f1006d120 2023-10-06T02:50:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ef0066f30 msgr2=0x7f6ef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ef0066f30 0x7f6ef00693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6f100b0770 tx=0x7f6ef8007b40 comp rx=0 tx=0).stop 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f1006d120 msgr2=0x7f6f101550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f1006d120 0x7f6f101550f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6f1006fe20 tx=0x7f6f00017000 comp rx=0 tx=0).stop 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 shutdown_connections 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f10157ca0 0x7f6f100b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f1006d120 0x7f6f101550f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ef0066f30 0x7f6ef00693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 --2- 172.21.15.81:0/1479502263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f101578d0 0x7f6f100aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 >> 172.21.15.81:0/1479502263 conn(0x7f6f1006bb90 msgr2=0x7f6f10069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 shutdown_connections 2023-10-06T02:50:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.696+0000 7f6f14dde700 1 -- 172.21.15.81:0/1479502263 wait complete. 2023-10-06T02:50:00.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:50:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.831+0000 7ff685131700 1 Processor -- start 2023-10-06T02:50:00.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.831+0000 7ff685131700 1 -- start start 2023-10-06T02:50:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.832+0000 7ff685131700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff6801578d0 0x7ff6800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.832+0000 7ff685131700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6800d07c0 con 0x7ff680157ca0 2023-10-06T02:50:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.832+0000 7ff685131700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6800cfbb0 con 0x7ff68006d120 2023-10-06T02:50:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.832+0000 7ff685131700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800cfe90 con 0x7ff6801578d0 2023-10-06T02:50:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.832+0000 7ff677fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff680157ca0 0x7ff68015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39600/0 (socket says 172.21.15.81:39600) 2023-10-06T02:50:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.832+0000 7ff677fff700 1 -- 172.21.15.81:0/2600126258 learned_addr learned my addr 172.21.15.81:0/2600126258 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.832+0000 7ff67ed9d700 1 --2- 172.21.15.81:0/2600126258 >> v2:172.21.15.83:3300/0 conn(0x7ff6801578d0 0x7ff6800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.832+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173851715 0 0) 0x7ff6800d07c0 con 0x7ff680157ca0 2023-10-06T02:50:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.832+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff66c003570 con 0x7ff680157ca0 2023-10-06T02:50:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 149259905 0 0) 0x7ff66c003570 con 0x7ff680157ca0 2023-10-06T02:50:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 >> v2:172.21.15.83:3300/0 conn(0x7ff6801578d0 msgr2=0x7ff6800cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 --2- 172.21.15.81:0/2600126258 >> v2:172.21.15.83:3300/0 conn(0x7ff6801578d0 0x7ff6800cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 >> v1:172.21.15.83:6789/0 conn(0x7ff68006d120 legacy=0x7ff68006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6800d0170 con 0x7ff680157ca0 2023-10-06T02:50:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7ff668001470 con 0x7ff680157ca0 2023-10-06T02:50:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 >> v1:172.21.15.81:6789/0 conn(0x7ff680157ca0 legacy=0x7ff68015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c003a60 0x7ff66c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff66c004810 0x7ff66c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0051c0 0x7ff66c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800cfe90 con 0x7ff66c0051c0 2023-10-06T02:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c00c0d0 con 0x7ff66c003a60 2023-10-06T02:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c00c290 con 0x7ff66c004810 2023-10-06T02:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67f59e700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0051c0 0x7ff66c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67ed9d700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c003a60 0x7ff66c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff677fff700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff66c004810 0x7ff66c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67f59e700 1 -- 172.21.15.81:0/2600126258 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff66c004810 msgr2=0x7ff66c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67f59e700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff66c004810 0x7ff66c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67f59e700 1 -- 172.21.15.81:0/2600126258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c003a60 msgr2=0x7ff66c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67f59e700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c003a60 0x7ff66c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67f59e700 1 -- 172.21.15.81:0/2600126258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c003570 con 0x7ff66c0051c0 2023-10-06T02:50:00.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67f59e700 1 -- 172.21.15.81:0/2600126258 reap_dead start 2023-10-06T02:50:00.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67f59e700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0051c0 0x7ff66c00ba60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff678001fc0 tx=0x7ff678001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c9d90d646d68ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:00.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.833+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678001950 con 0x7ff66c0051c0 2023-10-06T02:50:00.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.834+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67800c8b0 con 0x7ff66c0051c0 2023-10-06T02:50:00.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.834+0000 7ff67e59c700 1 -- 172.21.15.81:0/2600126258 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800cc90 con 0x7ff66c0051c0 2023-10-06T02:50:00.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.834+0000 7ff685131700 1 -- 172.21.15.81:0/2600126258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0051c0 msgr2=0x7ff66c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:00.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.834+0000 7ff685131700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0051c0 0x7ff66c00ba60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff678001fc0 tx=0x7ff678001640 comp rx=0 tx=0).stop 2023-10-06T02:50:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.834+0000 7ff685131700 1 -- 172.21.15.81:0/2600126258 shutdown_connections 2023-10-06T02:50:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.834+0000 7ff685131700 1 --2- 172.21.15.81:0/2600126258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0051c0 0x7ff66c00ba60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.834+0000 7ff685131700 1 -- 172.21.15.81:0/2600126258 >> 172.21.15.81:0/2600126258 conn(0x7ff68006bb90 msgr2=0x7ff68006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.834+0000 7ff685131700 1 -- 172.21.15.81:0/2600126258 shutdown_connections 2023-10-06T02:50:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.834+0000 7ff685131700 1 -- 172.21.15.81:0/2600126258 wait complete. 2023-10-06T02:50:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.835+0000 7ff685131700 1 Processor -- start 2023-10-06T02:50:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.835+0000 7ff685131700 1 -- start start 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff685131700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c0051c0 0x7ff680144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff685131700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6800ab2e0 0x7ff6800ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff685131700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680158f90 0x7ff680159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff685131700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800b4c50 con 0x7ff6800ab2e0 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff685131700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff680144d90 con 0x7ff66c0051c0 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff685131700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800abc90 con 0x7ff680158f90 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff677fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6800ab2e0 0x7ff6800ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff677fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6800ab2e0 0x7ff6800ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39200/0 (socket says 172.21.15.81:39200) 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff677fff700 1 -- 172.21.15.81:0/3558466586 learned_addr learned my addr 172.21.15.81:0/3558466586 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff67ed9d700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c0051c0 0x7ff680144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff67f59e700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680158f90 0x7ff680159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff677fff700 1 -- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680158f90 msgr2=0x7ff680159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff677fff700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680158f90 0x7ff680159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff677fff700 1 -- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c0051c0 msgr2=0x7ff680144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff677fff700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c0051c0 0x7ff680144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.836+0000 7ff677fff700 1 -- 172.21.15.81:0/3558466586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680159d10 con 0x7ff6800ab2e0 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.837+0000 7ff677fff700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6800ab2e0 0x7ff6800ab750 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff6680073f0 tx=0x7ff668001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.837+0000 7ff676ffd700 1 -- 172.21.15.81:0/3558466586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800f660 con 0x7ff6800ab2e0 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.837+0000 7ff676ffd700 1 -- 172.21.15.81:0/3558466586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66800f7c0 con 0x7ff6800ab2e0 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.837+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6800b4e60 con 0x7ff6800ab2e0 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.837+0000 7ff676ffd700 1 -- 172.21.15.81:0/3558466586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800fb80 con 0x7ff6800ab2e0 2023-10-06T02:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.837+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800b5420 con 0x7ff6800ab2e0 2023-10-06T02:50:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.838+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6800b5640 con 0x7ff6800ab2e0 2023-10-06T02:50:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.838+0000 7ff676ffd700 1 -- 172.21.15.81:0/3558466586 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff66801e3b0 con 0x7ff6800ab2e0 2023-10-06T02:50:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.838+0000 7ff676ffd700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff660066f30 0x7ff6600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.838+0000 7ff676ffd700 1 -- 172.21.15.81:0/3558466586 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff668084300 con 0x7ff6800ab2e0 2023-10-06T02:50:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.839+0000 7ff67ed9d700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff660066f30 0x7ff6600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.839+0000 7ff67ed9d700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff660066f30 0x7ff6600693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff680065400 tx=0x7ff6700091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:00.842+0000 7ff676ffd700 1 -- 172.21.15.81:0/3558466586 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff668051410 con 0x7ff6800ab2e0 2023-10-06T02:50:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.063+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff6800d0450 con 0x7ff6800ab2e0 2023-10-06T02:50:01.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.700+0000 7ff676ffd700 1 -- 172.21.15.81:0/3558466586 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff66801a0c0 con 0x7ff6800ab2e0 2023-10-06T02:50:01.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff660066f30 msgr2=0x7ff6600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:01.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff660066f30 0x7ff6600693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff680065400 tx=0x7ff6700091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6800ab2e0 msgr2=0x7ff6800ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6800ab2e0 0x7ff6800ab750 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff6680073f0 tx=0x7ff668001e50 comp rx=0 tx=0).stop 2023-10-06T02:50:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 shutdown_connections 2023-10-06T02:50:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680158f90 0x7ff680159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff660066f30 0x7ff6600693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c0051c0 0x7ff680144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 --2- 172.21.15.81:0/3558466586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6800ab2e0 0x7ff6800ab750 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 >> 172.21.15.81:0/3558466586 conn(0x7ff68006bb90 msgr2=0x7ff680068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 shutdown_connections 2023-10-06T02:50:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.702+0000 7ff685131700 1 -- 172.21.15.81:0/3558466586 wait complete. 2023-10-06T02:50:01.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:50:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.830+0000 7f0af4799700 1 Processor -- start 2023-10-06T02:50:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.830+0000 7f0af4799700 1 -- start start 2023-10-06T02:50:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.831+0000 7f0af4799700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0aec157fe0 0x7f0aec0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.831+0000 7f0af4799700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0b2890 con 0x7f0aec1583b0 2023-10-06T02:50:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.831+0000 7f0af4799700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0b4070 con 0x7f0aec0cf240 2023-10-06T02:50:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.831+0000 7f0af4799700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec0b4350 con 0x7f0aec157fe0 2023-10-06T02:50:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.831+0000 7f0af2535700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0aec157fe0 0x7f0aec0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.831+0000 7f0af1d34700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0aec1583b0 0x7f0aec0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39604/0 (socket says 172.21.15.81:39604) 2023-10-06T02:50:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.831+0000 7f0af1d34700 1 -- 172.21.15.81:0/3578383404 learned_addr learned my addr 172.21.15.81:0/3578383404 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af2535700 1 -- 172.21.15.81:0/3578383404 >> v1:172.21.15.83:6789/0 conn(0x7f0aec0cf240 legacy=0x7f0aec158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af2535700 1 -- 172.21.15.81:0/3578383404 >> v1:172.21.15.81:6789/0 conn(0x7f0aec1583b0 legacy=0x7f0aec0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af2535700 1 -- 172.21.15.81:0/3578383404 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0b4630 con 0x7f0aec157fe0 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af1533700 1 -- 172.21.15.81:0/3578383404 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375151553 0 0) 0x7f0aec0b2890 con 0x7f0aec1583b0 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af2535700 1 --2- 172.21.15.81:0/3578383404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec157fe0 0x7f0aec0b34c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009e60 tx=0x7f0ae8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df7128817e89bf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af1533700 1 -- 172.21.15.81:0/3578383404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800e070 con 0x7f0aec157fe0 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af1533700 1 -- 172.21.15.81:0/3578383404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae800bc30 con 0x7f0aec157fe0 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af1533700 1 -- 172.21.15.81:0/3578383404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8012430 con 0x7f0aec157fe0 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af4799700 1 -- 172.21.15.81:0/3578383404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec157fe0 msgr2=0x7f0aec0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.832+0000 7f0af4799700 1 --2- 172.21.15.81:0/3578383404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec157fe0 0x7f0aec0b34c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009e60 tx=0x7f0ae8009780 comp rx=0 tx=0).stop 2023-10-06T02:50:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.833+0000 7f0af4799700 1 -- 172.21.15.81:0/3578383404 shutdown_connections 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.833+0000 7f0af4799700 1 --2- 172.21.15.81:0/3578383404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec157fe0 0x7f0aec0b34c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.833+0000 7f0af4799700 1 -- 172.21.15.81:0/3578383404 >> 172.21.15.81:0/3578383404 conn(0x7f0aec067640 msgr2=0x7f0aec067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.833+0000 7f0af4799700 1 -- 172.21.15.81:0/3578383404 shutdown_connections 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.833+0000 7f0af4799700 1 -- 172.21.15.81:0/3578383404 wait complete. 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.834+0000 7f0af4799700 1 Processor -- start 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.834+0000 7f0af4799700 1 -- start start 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.834+0000 7f0af4799700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec0cf240 0x7f0aec14d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.834+0000 7f0af4799700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0aec157fe0 0x7f0aec149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.834+0000 7f0af4799700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aec1583b0 0x7f0aec16b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.834+0000 7f0af4799700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec149820 con 0x7f0aec0cf240 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.834+0000 7f0af4799700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec14af40 con 0x7f0aec1583b0 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.834+0000 7f0af4799700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec16c4d0 con 0x7f0aec157fe0 2023-10-06T02:50:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2535700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec0cf240 0x7f0aec14d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2535700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec0cf240 0x7f0aec14d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39220/0 (socket says 172.21.15.81:39220) 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2535700 1 -- 172.21.15.81:0/3495120910 learned_addr learned my addr 172.21.15.81:0/3495120910 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af1d34700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0aec157fe0 0x7f0aec149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2d36700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aec1583b0 0x7f0aec16b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2535700 1 -- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0aec157fe0 msgr2=0x7f0aec149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2535700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0aec157fe0 0x7f0aec149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2535700 1 -- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aec1583b0 msgr2=0x7f0aec16b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2535700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aec1583b0 0x7f0aec16b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2535700 1 -- 172.21.15.81:0/3495120910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8009a20 con 0x7f0aec0cf240 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2d36700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aec1583b0 0x7f0aec16b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af2535700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec0cf240 0x7f0aec14d060 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80099f0 tx=0x7f0ae8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0ae27fc700 1 -- 172.21.15.81:0/3495120910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8012ea0 con 0x7f0aec0cf240 2023-10-06T02:50:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0ae27fc700 1 -- 172.21.15.81:0/3495120910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae8027470 con 0x7f0aec0cf240 2023-10-06T02:50:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec16c7b0 con 0x7f0aec0cf240 2023-10-06T02:50:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0ae27fc700 1 -- 172.21.15.81:0/3495120910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8027830 con 0x7f0aec0cf240 2023-10-06T02:50:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.835+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec1494b0 con 0x7f0aec0cf240 2023-10-06T02:50:01.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.836+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec069e40 con 0x7f0aec0cf240 2023-10-06T02:50:01.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.836+0000 7f0ae27fc700 1 -- 172.21.15.81:0/3495120910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ae8024070 con 0x7f0aec0cf240 2023-10-06T02:50:01.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.837+0000 7f0ae27fc700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ad0066f30 0x7f0ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:01.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.837+0000 7f0ae27fc700 1 -- 172.21.15.81:0/3495120910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ae8086e20 con 0x7f0aec0cf240 2023-10-06T02:50:01.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.837+0000 7f0af1d34700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ad0066f30 0x7f0ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:01.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.837+0000 7f0af1d34700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ad0066f30 0x7f0ad00693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0aec14e1f0 tx=0x7f0adc007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:01.841+0000 7f0ae27fc700 1 -- 172.21.15.81:0/3495120910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ae8053f30 con 0x7f0aec0cf240 2023-10-06T02:50:02.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.066+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0aec0cc6b0 con 0x7f0aec0cf240 2023-10-06T02:50:02.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.066+0000 7f0ae27fc700 1 -- 172.21.15.81:0/3495120910 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0ae8057550 con 0x7f0aec0cf240 2023-10-06T02:50:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:02.068 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2330757810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2330757810},{"type":"v1","addr":"172.21.15.83:6837","nonce":2330757810}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2957658297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2957658297},{"type":"v1","addr":"172.21.15.81:6834","nonce":2957658297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4153630712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4153630712},{"type":"v1","addr":"172.21.15.81:6835","nonce":4153630712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:49:58.066126+0000","modified":"2023-10-06T02:50:01.693730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/1398848175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1398848175},{"type":"v1","addr":"172.21.15.83:6836","nonce":1398848175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:50:02.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ad0066f30 msgr2=0x7f0ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ad0066f30 0x7f0ad00693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0aec14e1f0 tx=0x7f0adc007d10 comp rx=0 tx=0).stop 2023-10-06T02:50:02.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec0cf240 msgr2=0x7f0aec14d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec0cf240 0x7f0aec14d060 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80099f0 tx=0x7f0ae8019000 comp rx=0 tx=0).stop 2023-10-06T02:50:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 shutdown_connections 2023-10-06T02:50:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ad0066f30 0x7f0ad00693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0aec1583b0 0x7f0aec16b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aec0cf240 0x7f0aec14d060 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 --2- 172.21.15.81:0/3495120910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0aec157fe0 0x7f0aec149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 >> 172.21.15.81:0/3495120910 conn(0x7f0aec067640 msgr2=0x7f0aec1552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 shutdown_connections 2023-10-06T02:50:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.068+0000 7f0af4799700 1 -- 172.21.15.81:0/3495120910 wait complete. 2023-10-06T02:50:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2023-10-06T02:50:02.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:50:02.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.194+0000 7f1a397f1700 1 Processor -- start 2023-10-06T02:50:02.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.194+0000 7f1a397f1700 1 -- start start 2023-10-06T02:50:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.194+0000 7f1a397f1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1a341578d0 0x7f1a340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a397f1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a397f1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a340d07c0 con 0x7f1a34157ca0 2023-10-06T02:50:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a397f1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3406daa0 con 0x7f1a341578d0 2023-10-06T02:50:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a397f1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340cfbb0 con 0x7f1a3406d120 2023-10-06T02:50:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a337fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a32ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1a341578d0 0x7f1a340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a327fc700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f1a34157ca0 0x7f1a3415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55716/0 (socket says 172.21.15.81:55716) 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a327fc700 1 -- 172.21.15.81:0/2230413443 learned_addr learned my addr 172.21.15.81:0/2230413443 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a32ffd700 1 -- 172.21.15.81:0/2230413443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 msgr2=0x7f1a3406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a32ffd700 1 --2- 172.21.15.81:0/2230413443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a32ffd700 1 -- 172.21.15.81:0/2230413443 >> v1:172.21.15.83:6789/0 conn(0x7f1a34157ca0 legacy=0x7f1a3415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a31ffb700 1 -- 172.21.15.81:0/2230413443 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056407928 0 0) 0x7f1a340d07c0 con 0x7f1a34157ca0 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a32ffd700 1 -- 172.21.15.81:0/2230413443 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a340cfe90 con 0x7f1a341578d0 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.195+0000 7f1a337fe700 1 --2- 172.21.15.81:0/2230413443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a32ffd700 1 --2- 172.21.15.81:0/2230413443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a341578d0 0x7f1a340cf4f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009e60 tx=0x7f1a2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24bc8869984e13fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a31ffb700 1 -- 172.21.15.81:0/2230413443 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c00e070 con 0x7f1a341578d0 2023-10-06T02:50:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a31ffb700 1 -- 172.21.15.81:0/2230413443 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c00bb60 con 0x7f1a341578d0 2023-10-06T02:50:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a31ffb700 1 -- 172.21.15.81:0/2230413443 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c012430 con 0x7f1a341578d0 2023-10-06T02:50:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a397f1700 1 -- 172.21.15.81:0/2230413443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a341578d0 msgr2=0x7f1a340cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a397f1700 1 --2- 172.21.15.81:0/2230413443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a341578d0 0x7f1a340cf4f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009e60 tx=0x7f1a2c009780 comp rx=0 tx=0).stop 2023-10-06T02:50:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a397f1700 1 -- 172.21.15.81:0/2230413443 shutdown_connections 2023-10-06T02:50:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a397f1700 1 --2- 172.21.15.81:0/2230413443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a397f1700 1 --2- 172.21.15.81:0/2230413443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a341578d0 0x7f1a340cf4f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a397f1700 1 -- 172.21.15.81:0/2230413443 >> 172.21.15.81:0/2230413443 conn(0x7f1a3406bb90 msgr2=0x7f1a3406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a397f1700 1 -- 172.21.15.81:0/2230413443 shutdown_connections 2023-10-06T02:50:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.196+0000 7f1a397f1700 1 -- 172.21.15.81:0/2230413443 wait complete. 2023-10-06T02:50:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.197+0000 7f1a397f1700 1 Processor -- start 2023-10-06T02:50:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a397f1700 1 -- start start 2023-10-06T02:50:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a397f1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a397f1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a341578d0 0x7f1a340b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a397f1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a34157ca0 0x7f1a3416a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a397f1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3414fed0 con 0x7f1a341578d0 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a397f1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a34150d30 con 0x7f1a34157ca0 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a397f1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3414ce80 con 0x7f1a3406d120 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a327fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a341578d0 0x7f1a340b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a327fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a341578d0 0x7f1a340b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39222/0 (socket says 172.21.15.81:39222) 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.198+0000 7f1a327fc700 1 -- 172.21.15.81:0/3538352700 learned_addr learned my addr 172.21.15.81:0/3538352700 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a32ffd700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a337fe700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a34157ca0 0x7f1a3416a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a327fc700 1 -- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 msgr2=0x7f1a3414c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a327fc700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3414c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a327fc700 1 -- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a34157ca0 msgr2=0x7f1a3416a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a327fc700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a34157ca0 0x7f1a3416a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a327fc700 1 -- 172.21.15.81:0/3538352700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a24009420 con 0x7f1a341578d0 2023-10-06T02:50:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a337fe700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a34157ca0 0x7f1a3416a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a32ffd700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a327fc700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a341578d0 0x7f1a340b4580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c610 tx=0x7f1a1c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a2affd700 1 -- 172.21.15.81:0/3538352700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c005b30 con 0x7f1a341578d0 2023-10-06T02:50:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a2affd700 1 -- 172.21.15.81:0/3538352700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c005c90 con 0x7f1a341578d0 2023-10-06T02:50:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c009a20 con 0x7f1a341578d0 2023-10-06T02:50:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a2affd700 1 -- 172.21.15.81:0/3538352700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c007300 con 0x7f1a341578d0 2023-10-06T02:50:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.199+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a341506e0 con 0x7f1a341578d0 2023-10-06T02:50:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.200+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3406e7e0 con 0x7f1a341578d0 2023-10-06T02:50:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.200+0000 7f1a2affd700 1 -- 172.21.15.81:0/3538352700 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a1c01b3b0 con 0x7f1a341578d0 2023-10-06T02:50:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.201+0000 7f1a2affd700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a14066f30 0x7f1a140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.201+0000 7f1a2affd700 1 -- 172.21.15.81:0/3538352700 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1a1c083c90 con 0x7f1a341578d0 2023-10-06T02:50:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.201+0000 7f1a32ffd700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a14066f30 0x7f1a140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.201+0000 7f1a32ffd700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a14066f30 0x7f1a140693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0097c0 tx=0x7f1a2c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.205+0000 7f1a2affd700 1 -- 172.21.15.81:0/3538352700 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a1c050da0 con 0x7f1a341578d0 2023-10-06T02:50:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.387+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a340d0170 con 0x7f1a341578d0 2023-10-06T02:50:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.388+0000 7f1a2affd700 1 -- 172.21.15.81:0/3538352700 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16821 (secure 0 0 0) 0x7f1a1c017020 con 0x7f1a341578d0 2023-10-06T02:50:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:02.390 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:49:59.680736+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:49:55.704059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:49:57.024962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:50:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a14066f30 msgr2=0x7f1a140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a14066f30 0x7f1a140693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0097c0 tx=0x7f1a2c019000 comp rx=0 tx=0).stop 2023-10-06T02:50:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a341578d0 msgr2=0x7f1a340b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a341578d0 0x7f1a340b4580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c610 tx=0x7f1a1c000fe0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 shutdown_connections 2023-10-06T02:50:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a14066f30 0x7f1a140693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a34157ca0 0x7f1a3416a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a3406d120 0x7f1a3414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 --2- 172.21.15.81:0/3538352700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a341578d0 0x7f1a340b4580 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 >> 172.21.15.81:0/3538352700 conn(0x7f1a3406bb90 msgr2=0x7f1a34156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 shutdown_connections 2023-10-06T02:50:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.390+0000 7f1a397f1700 1 -- 172.21.15.81:0/3538352700 wait complete. 2023-10-06T02:50:02.403 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:50:02.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:50:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.516+0000 7ff33a4f6700 1 Processor -- start 2023-10-06T02:50:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.516+0000 7ff33a4f6700 1 -- start start 2023-10-06T02:50:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff33a4f6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff3341578d0 0x7ff3340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff33a4f6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3340d07c0 con 0x7ff334157ca0 2023-10-06T02:50:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff33a4f6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3340cfbb0 con 0x7ff33406d120 2023-10-06T02:50:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff33a4f6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3340cfe90 con 0x7ff3341578d0 2023-10-06T02:50:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff3337fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff334157ca0 0x7ff33415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39610/0 (socket says 172.21.15.81:39610) 2023-10-06T02:50:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff3337fe700 1 -- 172.21.15.81:0/2848518106 learned_addr learned my addr 172.21.15.81:0/2848518106 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff333fff700 1 --2- 172.21.15.81:0/2848518106 >> v2:172.21.15.83:3300/0 conn(0x7ff3341578d0 0x7ff3340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff332ffd700 1 -- 172.21.15.81:0/2848518106 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866814018 0 0) 0x7ff3340d07c0 con 0x7ff334157ca0 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff332ffd700 1 -- 172.21.15.81:0/2848518106 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff31c003570 con 0x7ff334157ca0 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff332ffd700 1 -- 172.21.15.81:0/2848518106 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826483958 0 0) 0x7ff3340cfbb0 con 0x7ff33406d120 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff332ffd700 1 -- 172.21.15.81:0/2848518106 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3340d07c0 con 0x7ff33406d120 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff332ffd700 1 -- 172.21.15.81:0/2848518106 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1806216616 0 0) 0x7ff31c003570 con 0x7ff334157ca0 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff333fff700 1 -- 172.21.15.81:0/2848518106 >> v1:172.21.15.83:6789/0 conn(0x7ff33406d120 legacy=0x7ff33406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff333fff700 1 -- 172.21.15.81:0/2848518106 >> v1:172.21.15.81:6789/0 conn(0x7ff334157ca0 legacy=0x7ff33415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff333fff700 1 -- 172.21.15.81:0/2848518106 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3340d0170 con 0x7ff3341578d0 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.517+0000 7ff333fff700 1 --2- 172.21.15.81:0/2848518106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3341578d0 0x7ff3340cf4f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff3240098e0 tx=0x7ff3240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2df0782554fe9dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff332ffd700 1 -- 172.21.15.81:0/2848518106 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328001470 con 0x7ff3341578d0 2023-10-06T02:50:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff332ffd700 1 -- 172.21.15.81:0/2848518106 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff324011420 con 0x7ff3341578d0 2023-10-06T02:50:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff332ffd700 1 -- 172.21.15.81:0/2848518106 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3240117c0 con 0x7ff3341578d0 2023-10-06T02:50:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff33a4f6700 1 -- 172.21.15.81:0/2848518106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3341578d0 msgr2=0x7ff3340cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff33a4f6700 1 --2- 172.21.15.81:0/2848518106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3341578d0 0x7ff3340cf4f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff3240098e0 tx=0x7ff3240091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff33a4f6700 1 -- 172.21.15.81:0/2848518106 shutdown_connections 2023-10-06T02:50:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff33a4f6700 1 --2- 172.21.15.81:0/2848518106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3341578d0 0x7ff3340cf4f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff33a4f6700 1 -- 172.21.15.81:0/2848518106 >> 172.21.15.81:0/2848518106 conn(0x7ff33406bb90 msgr2=0x7ff33406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff33a4f6700 1 -- 172.21.15.81:0/2848518106 shutdown_connections 2023-10-06T02:50:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.518+0000 7ff33a4f6700 1 -- 172.21.15.81:0/2848518106 wait complete. 2023-10-06T02:50:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.519+0000 7ff33a4f6700 1 Processor -- start 2023-10-06T02:50:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff33a4f6700 1 -- start start 2023-10-06T02:50:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff33a4f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff33406d120 0x7ff3340b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff33a4f6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3341578d0 0x7ff3340b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff33a4f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334157ca0 0x7ff334152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff33a4f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33416a880 con 0x7ff334157ca0 2023-10-06T02:50:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff33a4f6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33416ab20 con 0x7ff3341578d0 2023-10-06T02:50:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff33a4f6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340b43f0 con 0x7ff33406d120 2023-10-06T02:50:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff338a93700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334157ca0 0x7ff334152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff338a93700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334157ca0 0x7ff334152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39238/0 (socket says 172.21.15.81:39238) 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.520+0000 7ff338a93700 1 -- 172.21.15.81:0/3712749866 learned_addr learned my addr 172.21.15.81:0/3712749866 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff3337fe700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3341578d0 0x7ff3340b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff333fff700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff33406d120 0x7ff3340b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff338a93700 1 -- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff33406d120 msgr2=0x7ff3340b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff338a93700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff33406d120 0x7ff3340b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff338a93700 1 -- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3341578d0 msgr2=0x7ff3340b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff338a93700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3341578d0 0x7ff3340b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff338a93700 1 -- 172.21.15.81:0/3712749866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324009420 con 0x7ff334157ca0 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff338a93700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334157ca0 0x7ff334152960 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00c910 tx=0x7ff32c0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff31bfff700 1 -- 172.21.15.81:0/3712749866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00a870 con 0x7ff334157ca0 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff31bfff700 1 -- 172.21.15.81:0/3712749866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00a9f0 con 0x7ff334157ca0 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3340b46d0 con 0x7ff334157ca0 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff31bfff700 1 -- 172.21.15.81:0/3712749866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00adb0 con 0x7ff334157ca0 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.521+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3340b40e0 con 0x7ff334157ca0 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.522+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3340b4bf0 con 0x7ff334157ca0 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.522+0000 7ff31bfff700 1 -- 172.21.15.81:0/3712749866 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff32c012630 con 0x7ff334157ca0 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.523+0000 7ff31bfff700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.523+0000 7ff31bfff700 1 -- 172.21.15.81:0/3712749866 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff32c084c90 con 0x7ff334157ca0 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.523+0000 7ff333fff700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.523+0000 7ff333fff700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff3240093f0 tx=0x7ff324016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:02.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.527+0000 7ff31bfff700 1 -- 172.21.15.81:0/3712749866 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3340b4bf0 con 0x7ff334157ca0 2023-10-06T02:50:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.707+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3340b4bf0 con 0x7ff320066f30 2023-10-06T02:50:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.717+0000 7ff31bfff700 1 -- 172.21.15.81:0/3712749866 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305456 (secure 0 0 0) 0x7ff3340b4bf0 con 0x7ff320066f30 2023-10-06T02:50:02.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 msgr2=0x7ff3200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff3240093f0 tx=0x7ff324016000 comp rx=0 tx=0).stop 2023-10-06T02:50:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334157ca0 msgr2=0x7ff334152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334157ca0 0x7ff334152960 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00c910 tx=0x7ff32c0027a0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 shutdown_connections 2023-10-06T02:50:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff334157ca0 0x7ff334152960 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff33406d120 0x7ff3340b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 --2- 172.21.15.81:0/3712749866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3341578d0 0x7ff3340b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 >> 172.21.15.81:0/3712749866 conn(0x7ff33406bb90 msgr2=0x7ff334069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:02.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 shutdown_connections 2023-10-06T02:50:02.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.720+0000 7ff33a4f6700 1 -- 172.21.15.81:0/3712749866 wait complete. 2023-10-06T02:50:02.725 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:50:02.733 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2023-10-06T02:50:01.548608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557667,"statfs":{"total":1600000000,"available":1595051404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.871348"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696401+0000","last_change":"2023-10-06T02:49:58.695750+0000","last_active":"2023-10-06T02:49:58.696401+0000","last_peered":"2023-10-06T02:49:58.696401+0000","last_clean":"2023-10-06T02:49:58.696401+0000","last_became_active":"2023-10-06T02:49:58.694876+0000","last_became_peered":"2023-10-06T02:49:58.694876+0000","last_unstale":"2023-10-06T02:49:58.696401+0000","last_undegraded":"2023-10-06T02:49:58.696401+0000","last_fullsized":"2023-10-06T02:49:58.696401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:03.647505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686373+0000","last_change":"2023-10-06T02:49:58.686311+0000","last_active":"2023-10-06T02:49:58.686373+0000","last_peered":"2023-10-06T02:49:58.686373+0000","last_clean":"2023-10-06T02:49:58.686373+0000","last_became_active":"2023-10-06T02:49:58.686087+0000","last_became_peered":"2023-10-06T02:49:58.686087+0000","last_unstale":"2023-10-06T02:49:58.686373+0000","last_undegraded":"2023-10-06T02:49:58.686373+0000","last_fullsized":"2023-10-06T02:49:58.686373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:16.338439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693931+0000","last_change":"2023-10-06T02:49:58.693707+0000","last_active":"2023-10-06T02:49:58.693931+0000","last_peered":"2023-10-06T02:49:58.693931+0000","last_clean":"2023-10-06T02:49:58.693931+0000","last_became_active":"2023-10-06T02:49:58.693057+0000","last_became_peered":"2023-10-06T02:49:58.693057+0000","last_unstale":"2023-10-06T02:49:58.693931+0000","last_undegraded":"2023-10-06T02:49:58.693931+0000","last_fullsized":"2023-10-06T02:49:58.693931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:41.033955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696343+0000","last_change":"2023-10-06T02:49:58.694541+0000","last_active":"2023-10-06T02:49:58.696343+0000","last_peered":"2023-10-06T02:49:58.696343+0000","last_clean":"2023-10-06T02:49:58.696343+0000","last_became_active":"2023-10-06T02:49:58.694028+0000","last_became_peered":"2023-10-06T02:49:58.694028+0000","last_unstale":"2023-10-06T02:49:58.696343+0000","last_undegraded":"2023-10-06T02:49:58.696343+0000","last_fullsized":"2023-10-06T02:49:58.696343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:03.143280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698338+0000","last_change":"2023-10-06T02:49:58.697417+0000","last_active":"2023-10-06T02:49:58.698338+0000","last_peered":"2023-10-06T02:49:58.698338+0000","last_clean":"2023-10-06T02:49:58.698338+0000","last_became_active":"2023-10-06T02:49:58.696936+0000","last_became_peered":"2023-10-06T02:49:58.696936+0000","last_unstale":"2023-10-06T02:49:58.698338+0000","last_undegraded":"2023-10-06T02:49:58.698338+0000","last_fullsized":"2023-10-06T02:49:58.698338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:49.892904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691318+0000","last_change":"2023-10-06T02:49:58.691258+0000","last_active":"2023-10-06T02:49:58.691318+0000","last_peered":"2023-10-06T02:49:58.691318+0000","last_clean":"2023-10-06T02:49:58.691318+0000","last_became_active":"2023-10-06T02:49:58.691026+0000","last_became_peered":"2023-10-06T02:49:58.691026+0000","last_unstale":"2023-10-06T02:49:58.691318+0000","last_undegraded":"2023-10-06T02:49:58.691318+0000","last_fullsized":"2023-10-06T02:49:58.691318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:12.617623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.697263+0000","last_change":"2023-10-06T02:49:58.697216+0000","last_active":"2023-10-06T02:49:58.697263+0000","last_peered":"2023-10-06T02:49:58.697263+0000","last_clean":"2023-10-06T02:49:58.697263+0000","last_became_active":"2023-10-06T02:49:58.696853+0000","last_became_peered":"2023-10-06T02:49:58.696853+0000","last_unstale":"2023-10-06T02:49:58.697263+0000","last_undegraded":"2023-10-06T02:49:58.697263+0000","last_fullsized":"2023-10-06T02:49:58.697263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:01.633495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698644+0000","last_change":"2023-10-06T02:49:58.698182+0000","last_active":"2023-10-06T02:49:58.698644+0000","last_peered":"2023-10-06T02:49:58.698644+0000","last_clean":"2023-10-06T02:49:58.698644+0000","last_became_active":"2023-10-06T02:49:58.697323+0000","last_became_peered":"2023-10-06T02:49:58.697323+0000","last_unstale":"2023-10-06T02:49:58.698644+0000","last_undegraded":"2023-10-06T02:49:58.698644+0000","last_fullsized":"2023-10-06T02:49:58.698644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:31.839770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691928+0000","last_change":"2023-10-06T02:49:58.691775+0000","last_active":"2023-10-06T02:49:58.691928+0000","last_peered":"2023-10-06T02:49:58.691928+0000","last_clean":"2023-10-06T02:49:58.691928+0000","last_became_active":"2023-10-06T02:49:58.691416+0000","last_became_peered":"2023-10-06T02:49:58.691416+0000","last_unstale":"2023-10-06T02:49:58.691928+0000","last_undegraded":"2023-10-06T02:49:58.691928+0000","last_fullsized":"2023-10-06T02:49:58.691928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:15.647974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.692836+0000","last_change":"2023-10-06T02:49:58.692740+0000","last_active":"2023-10-06T02:49:58.692836+0000","last_peered":"2023-10-06T02:49:58.692836+0000","last_clean":"2023-10-06T02:49:58.692836+0000","last_became_active":"2023-10-06T02:49:58.692550+0000","last_became_peered":"2023-10-06T02:49:58.692550+0000","last_unstale":"2023-10-06T02:49:58.692836+0000","last_undegraded":"2023-10-06T02:49:58.692836+0000","last_fullsized":"2023-10-06T02:49:58.692836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:41.033955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687448+0000","last_change":"2023-10-06T02:49:58.687392+0000","last_active":"2023-10-06T02:49:58.687448+0000","last_peered":"2023-10-06T02:49:58.687448+0000","last_clean":"2023-10-06T02:49:58.687448+0000","last_became_active":"2023-10-06T02:49:58.686944+0000","last_became_peered":"2023-10-06T02:49:58.686944+0000","last_unstale":"2023-10-06T02:49:58.687448+0000","last_undegraded":"2023-10-06T02:49:58.687448+0000","last_fullsized":"2023-10-06T02:49:58.687448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:00.240551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687717+0000","last_change":"2023-10-06T02:49:58.687547+0000","last_active":"2023-10-06T02:49:58.687717+0000","last_peered":"2023-10-06T02:49:58.687717+0000","last_clean":"2023-10-06T02:49:58.687717+0000","last_became_active":"2023-10-06T02:49:58.687336+0000","last_became_peered":"2023-10-06T02:49:58.687336+0000","last_unstale":"2023-10-06T02:49:58.687717+0000","last_undegraded":"2023-10-06T02:49:58.687717+0000","last_fullsized":"2023-10-06T02:49:58.687717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:48.815667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698629+0000","last_change":"2023-10-06T02:49:58.698046+0000","last_active":"2023-10-06T02:49:58.698629+0000","last_peered":"2023-10-06T02:49:58.698629+0000","last_clean":"2023-10-06T02:49:58.698629+0000","last_became_active":"2023-10-06T02:49:58.697033+0000","last_became_peered":"2023-10-06T02:49:58.697033+0000","last_unstale":"2023-10-06T02:49:58.698629+0000","last_undegraded":"2023-10-06T02:49:58.698629+0000","last_fullsized":"2023-10-06T02:49:58.698629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:14.332752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693723+0000","last_change":"2023-10-06T02:49:58.693586+0000","last_active":"2023-10-06T02:49:58.693723+0000","last_peered":"2023-10-06T02:49:58.693723+0000","last_clean":"2023-10-06T02:49:58.693723+0000","last_became_active":"2023-10-06T02:49:58.692879+0000","last_became_peered":"2023-10-06T02:49:58.692879+0000","last_unstale":"2023-10-06T02:49:58.693723+0000","last_undegraded":"2023-10-06T02:49:58.693723+0000","last_fullsized":"2023-10-06T02:49:58.693723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:49.767874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.692888+0000","last_change":"2023-10-06T02:49:58.692815+0000","last_active":"2023-10-06T02:49:58.692888+0000","last_peered":"2023-10-06T02:49:58.692888+0000","last_clean":"2023-10-06T02:49:58.692888+0000","last_became_active":"2023-10-06T02:49:58.692341+0000","last_became_peered":"2023-10-06T02:49:58.692341+0000","last_unstale":"2023-10-06T02:49:58.692888+0000","last_undegraded":"2023-10-06T02:49:58.692888+0000","last_fullsized":"2023-10-06T02:49:58.692888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:22.895260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696425+0000","last_change":"2023-10-06T02:49:58.695953+0000","last_active":"2023-10-06T02:49:58.696425+0000","last_peered":"2023-10-06T02:49:58.696425+0000","last_clean":"2023-10-06T02:49:58.696425+0000","last_became_active":"2023-10-06T02:49:58.695181+0000","last_became_peered":"2023-10-06T02:49:58.695181+0000","last_unstale":"2023-10-06T02:49:58.696425+0000","last_undegraded":"2023-10-06T02:49:58.696425+0000","last_fullsized":"2023-10-06T02:49:58.696425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:38.542270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696417+0000","last_change":"2023-10-06T02:49:58.696232+0000","last_active":"2023-10-06T02:49:58.696417+0000","last_peered":"2023-10-06T02:49:58.696417+0000","last_clean":"2023-10-06T02:49:58.696417+0000","last_became_active":"2023-10-06T02:49:58.695876+0000","last_became_peered":"2023-10-06T02:49:58.695876+0000","last_unstale":"2023-10-06T02:49:58.696417+0000","last_undegraded":"2023-10-06T02:49:58.696417+0000","last_fullsized":"2023-10-06T02:49:58.696417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:24.104628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693915+0000","last_change":"2023-10-06T02:49:58.693571+0000","last_active":"2023-10-06T02:49:58.693915+0000","last_peered":"2023-10-06T02:49:58.693915+0000","last_clean":"2023-10-06T02:49:58.693915+0000","last_became_active":"2023-10-06T02:49:58.692824+0000","last_became_peered":"2023-10-06T02:49:58.692824+0000","last_unstale":"2023-10-06T02:49:58.693915+0000","last_undegraded":"2023-10-06T02:49:58.693915+0000","last_fullsized":"2023-10-06T02:49:58.693915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:48.815667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699420+0000","last_change":"2023-10-06T02:49:58.699357+0000","last_active":"2023-10-06T02:49:58.699420+0000","last_peered":"2023-10-06T02:49:58.699420+0000","last_clean":"2023-10-06T02:49:58.699420+0000","last_became_active":"2023-10-06T02:49:58.699133+0000","last_became_peered":"2023-10-06T02:49:58.699133+0000","last_unstale":"2023-10-06T02:49:58.699420+0000","last_undegraded":"2023-10-06T02:49:58.699420+0000","last_fullsized":"2023-10-06T02:49:58.699420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:42.247967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.694571+0000","last_change":"2023-10-06T02:49:58.694506+0000","last_active":"2023-10-06T02:49:58.694571+0000","last_peered":"2023-10-06T02:49:58.694571+0000","last_clean":"2023-10-06T02:49:58.694571+0000","last_became_active":"2023-10-06T02:49:58.694269+0000","last_became_peered":"2023-10-06T02:49:58.694269+0000","last_unstale":"2023-10-06T02:49:58.694571+0000","last_undegraded":"2023-10-06T02:49:58.694571+0000","last_fullsized":"2023-10-06T02:49:58.694571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:49.506613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693662+0000","last_change":"2023-10-06T02:49:58.693603+0000","last_active":"2023-10-06T02:49:58.693662+0000","last_peered":"2023-10-06T02:49:58.693662+0000","last_clean":"2023-10-06T02:49:58.693662+0000","last_became_active":"2023-10-06T02:49:58.692528+0000","last_became_peered":"2023-10-06T02:49:58.692528+0000","last_unstale":"2023-10-06T02:49:58.693662+0000","last_undegraded":"2023-10-06T02:49:58.693662+0000","last_fullsized":"2023-10-06T02:49:58.693662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:25.630505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696154+0000","last_change":"2023-10-06T02:49:58.696094+0000","last_active":"2023-10-06T02:49:58.696154+0000","last_peered":"2023-10-06T02:49:58.696154+0000","last_clean":"2023-10-06T02:49:58.696154+0000","last_became_active":"2023-10-06T02:49:58.695244+0000","last_became_peered":"2023-10-06T02:49:58.695244+0000","last_unstale":"2023-10-06T02:49:58.696154+0000","last_undegraded":"2023-10-06T02:49:58.696154+0000","last_fullsized":"2023-10-06T02:49:58.696154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:31.788936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693470+0000","last_change":"2023-10-06T02:49:58.693353+0000","last_active":"2023-10-06T02:49:58.693470+0000","last_peered":"2023-10-06T02:49:58.693470+0000","last_clean":"2023-10-06T02:49:58.693470+0000","last_became_active":"2023-10-06T02:49:58.692974+0000","last_became_peered":"2023-10-06T02:49:58.692974+0000","last_unstale":"2023-10-06T02:49:58.693470+0000","last_undegraded":"2023-10-06T02:49:58.693470+0000","last_fullsized":"2023-10-06T02:49:58.693470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:03.170434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691066+0000","last_change":"2023-10-06T02:49:58.690877+0000","last_active":"2023-10-06T02:49:58.691066+0000","last_peered":"2023-10-06T02:49:58.691066+0000","last_clean":"2023-10-06T02:49:58.691066+0000","last_became_active":"2023-10-06T02:49:58.690386+0000","last_became_peered":"2023-10-06T02:49:58.690386+0000","last_unstale":"2023-10-06T02:49:58.691066+0000","last_undegraded":"2023-10-06T02:49:58.691066+0000","last_fullsized":"2023-10-06T02:49:58.691066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:56.674803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.690678+0000","last_change":"2023-10-06T02:49:58.690607+0000","last_active":"2023-10-06T02:49:58.690678+0000","last_peered":"2023-10-06T02:49:58.690678+0000","last_clean":"2023-10-06T02:49:58.690678+0000","last_became_active":"2023-10-06T02:49:58.690321+0000","last_became_peered":"2023-10-06T02:49:58.690321+0000","last_unstale":"2023-10-06T02:49:58.690678+0000","last_undegraded":"2023-10-06T02:49:58.690678+0000","last_fullsized":"2023-10-06T02:49:58.690678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:01.044432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691442+0000","last_change":"2023-10-06T02:49:58.690154+0000","last_active":"2023-10-06T02:49:58.691442+0000","last_peered":"2023-10-06T02:49:58.691442+0000","last_clean":"2023-10-06T02:49:58.691442+0000","last_became_active":"2023-10-06T02:49:58.689929+0000","last_became_peered":"2023-10-06T02:49:58.689929+0000","last_unstale":"2023-10-06T02:49:58.691442+0000","last_undegraded":"2023-10-06T02:49:58.691442+0000","last_fullsized":"2023-10-06T02:49:58.691442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:41.207115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.688916+0000","last_change":"2023-10-06T02:49:58.688482+0000","last_active":"2023-10-06T02:49:58.688916+0000","last_peered":"2023-10-06T02:49:58.688916+0000","last_clean":"2023-10-06T02:49:58.688916+0000","last_became_active":"2023-10-06T02:49:58.687460+0000","last_became_peered":"2023-10-06T02:49:58.687460+0000","last_unstale":"2023-10-06T02:49:58.688916+0000","last_undegraded":"2023-10-06T02:49:58.688916+0000","last_fullsized":"2023-10-06T02:49:58.688916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:12.617623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698611+0000","last_change":"2023-10-06T02:49:58.697919+0000","last_active":"2023-10-06T02:49:58.698611+0000","last_peered":"2023-10-06T02:49:58.698611+0000","last_clean":"2023-10-06T02:49:58.698611+0000","last_became_active":"2023-10-06T02:49:58.696710+0000","last_became_peered":"2023-10-06T02:49:58.696710+0000","last_unstale":"2023-10-06T02:49:58.698611+0000","last_undegraded":"2023-10-06T02:49:58.698611+0000","last_fullsized":"2023-10-06T02:49:58.698611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:05.075958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691075+0000","last_change":"2023-10-06T02:49:58.691008+0000","last_active":"2023-10-06T02:49:58.691075+0000","last_peered":"2023-10-06T02:49:58.691075+0000","last_clean":"2023-10-06T02:49:58.691075+0000","last_became_active":"2023-10-06T02:49:58.690668+0000","last_became_peered":"2023-10-06T02:49:58.690668+0000","last_unstale":"2023-10-06T02:49:58.691075+0000","last_undegraded":"2023-10-06T02:49:58.691075+0000","last_fullsized":"2023-10-06T02:49:58.691075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:10.980054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686452+0000","last_change":"2023-10-06T02:49:58.686191+0000","last_active":"2023-10-06T02:49:58.686452+0000","last_peered":"2023-10-06T02:49:58.686452+0000","last_clean":"2023-10-06T02:49:58.686452+0000","last_became_active":"2023-10-06T02:49:58.685971+0000","last_became_peered":"2023-10-06T02:49:58.685971+0000","last_unstale":"2023-10-06T02:49:58.686452+0000","last_undegraded":"2023-10-06T02:49:58.686452+0000","last_fullsized":"2023-10-06T02:49:58.686452+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:49.767874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.695385+0000","last_change":"2023-10-06T02:49:58.694903+0000","last_active":"2023-10-06T02:49:58.695385+0000","last_peered":"2023-10-06T02:49:58.695385+0000","last_clean":"2023-10-06T02:49:58.695385+0000","last_became_active":"2023-10-06T02:49:58.694531+0000","last_became_peered":"2023-10-06T02:49:58.694531+0000","last_unstale":"2023-10-06T02:49:58.695385+0000","last_undegraded":"2023-10-06T02:49:58.695385+0000","last_fullsized":"2023-10-06T02:49:58.695385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:53.197453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.690022+0000","last_change":"2023-10-06T02:49:58.689964+0000","last_active":"2023-10-06T02:49:58.690022+0000","last_peered":"2023-10-06T02:49:58.690022+0000","last_clean":"2023-10-06T02:49:58.690022+0000","last_became_active":"2023-10-06T02:49:58.688790+0000","last_became_peered":"2023-10-06T02:49:58.688790+0000","last_unstale":"2023-10-06T02:49:58.690022+0000","last_undegraded":"2023-10-06T02:49:58.690022+0000","last_fullsized":"2023-10-06T02:49:58.690022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:27.673007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691838+0000","last_change":"2023-10-06T02:49:58.691600+0000","last_active":"2023-10-06T02:49:58.691838+0000","last_peered":"2023-10-06T02:49:58.691838+0000","last_clean":"2023-10-06T02:49:58.691838+0000","last_became_active":"2023-10-06T02:49:58.691061+0000","last_became_peered":"2023-10-06T02:49:58.691061+0000","last_unstale":"2023-10-06T02:49:58.691838+0000","last_undegraded":"2023-10-06T02:49:58.691838+0000","last_fullsized":"2023-10-06T02:49:58.691838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:03.143280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"83'4","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.703622+0000","last_change":"2023-10-06T02:49:57.693474+0000","last_active":"2023-10-06T02:49:58.703622+0000","last_peered":"2023-10-06T02:49:58.703622+0000","last_clean":"2023-10-06T02:49:58.703622+0000","last_became_active":"2023-10-06T02:49:57.693069+0000","last_became_peered":"2023-10-06T02:49:57.693069+0000","last_unstale":"2023-10-06T02:49:58.703622+0000","last_undegraded":"2023-10-06T02:49:58.703622+0000","last_fullsized":"2023-10-06T02:49:58.703622+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:55.729532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686965+0000","last_change":"2023-10-06T02:49:58.686900+0000","last_active":"2023-10-06T02:49:58.686965+0000","last_peered":"2023-10-06T02:49:58.686965+0000","last_clean":"2023-10-06T02:49:58.686965+0000","last_became_active":"2023-10-06T02:49:58.686671+0000","last_became_peered":"2023-10-06T02:49:58.686671+0000","last_unstale":"2023-10-06T02:49:58.686965+0000","last_undegraded":"2023-10-06T02:49:58.686965+0000","last_fullsized":"2023-10-06T02:49:58.686965+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:42.247967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699162+0000","last_change":"2023-10-06T02:49:57.692719+0000","last_active":"2023-10-06T02:49:58.699162+0000","last_peered":"2023-10-06T02:49:58.699162+0000","last_clean":"2023-10-06T02:49:58.699162+0000","last_became_active":"2023-10-06T02:49:57.692490+0000","last_became_peered":"2023-10-06T02:49:57.692490+0000","last_unstale":"2023-10-06T02:49:58.699162+0000","last_undegraded":"2023-10-06T02:49:58.699162+0000","last_fullsized":"2023-10-06T02:49:58.699162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:02.136224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691893+0000","last_change":"2023-10-06T02:49:58.691360+0000","last_active":"2023-10-06T02:49:58.691893+0000","last_peered":"2023-10-06T02:49:58.691893+0000","last_clean":"2023-10-06T02:49:58.691893+0000","last_became_active":"2023-10-06T02:49:58.691127+0000","last_became_peered":"2023-10-06T02:49:58.691127+0000","last_unstale":"2023-10-06T02:49:58.691893+0000","last_undegraded":"2023-10-06T02:49:58.691893+0000","last_fullsized":"2023-10-06T02:49:58.691893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:01.633495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.700399+0000","last_change":"2023-10-06T02:49:57.694721+0000","last_active":"2023-10-06T02:49:58.700399+0000","last_peered":"2023-10-06T02:49:58.700399+0000","last_clean":"2023-10-06T02:49:58.700399+0000","last_became_active":"2023-10-06T02:49:57.694507+0000","last_became_peered":"2023-10-06T02:49:57.694507+0000","last_unstale":"2023-10-06T02:49:58.700399+0000","last_undegraded":"2023-10-06T02:49:58.700399+0000","last_fullsized":"2023-10-06T02:49:58.700399+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:19.782192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693213+0000","last_change":"2023-10-06T02:49:58.693113+0000","last_active":"2023-10-06T02:49:58.693213+0000","last_peered":"2023-10-06T02:49:58.693213+0000","last_clean":"2023-10-06T02:49:58.693213+0000","last_became_active":"2023-10-06T02:49:58.692740+0000","last_became_peered":"2023-10-06T02:49:58.692740+0000","last_unstale":"2023-10-06T02:49:58.693213+0000","last_undegraded":"2023-10-06T02:49:58.693213+0000","last_fullsized":"2023-10-06T02:49:58.693213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:47.438011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.701878+0000","last_change":"2023-10-06T02:49:57.692706+0000","last_active":"2023-10-06T02:49:58.701878+0000","last_peered":"2023-10-06T02:49:58.701878+0000","last_clean":"2023-10-06T02:49:58.701878+0000","last_became_active":"2023-10-06T02:49:57.692361+0000","last_became_peered":"2023-10-06T02:49:57.692361+0000","last_unstale":"2023-10-06T02:49:58.701878+0000","last_undegraded":"2023-10-06T02:49:58.701878+0000","last_fullsized":"2023-10-06T02:49:58.701878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:02.962978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687519+0000","last_change":"2023-10-06T02:49:58.687486+0000","last_active":"2023-10-06T02:49:58.687519+0000","last_peered":"2023-10-06T02:49:58.687519+0000","last_clean":"2023-10-06T02:49:58.687519+0000","last_became_active":"2023-10-06T02:49:58.687233+0000","last_became_peered":"2023-10-06T02:49:58.687233+0000","last_unstale":"2023-10-06T02:49:58.687519+0000","last_undegraded":"2023-10-06T02:49:58.687519+0000","last_fullsized":"2023-10-06T02:49:58.687519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:32.805940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.697324+0000","last_change":"2023-10-06T02:49:57.690974+0000","last_active":"2023-10-06T02:49:58.697324+0000","last_peered":"2023-10-06T02:49:58.697324+0000","last_clean":"2023-10-06T02:49:58.697324+0000","last_became_active":"2023-10-06T02:49:57.690754+0000","last_became_peered":"2023-10-06T02:49:57.690754+0000","last_unstale":"2023-10-06T02:49:58.697324+0000","last_undegraded":"2023-10-06T02:49:58.697324+0000","last_fullsized":"2023-10-06T02:49:58.697324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:22.205606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.695031+0000","last_change":"2023-10-06T02:49:58.694671+0000","last_active":"2023-10-06T02:49:58.695031+0000","last_peered":"2023-10-06T02:49:58.695031+0000","last_clean":"2023-10-06T02:49:58.695031+0000","last_became_active":"2023-10-06T02:49:58.694465+0000","last_became_peered":"2023-10-06T02:49:58.694465+0000","last_unstale":"2023-10-06T02:49:58.695031+0000","last_undegraded":"2023-10-06T02:49:58.695031+0000","last_fullsized":"2023-10-06T02:49:58.695031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:14.036312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696694+0000","last_change":"2023-10-06T02:49:57.693324+0000","last_active":"2023-10-06T02:49:58.696694+0000","last_peered":"2023-10-06T02:49:58.696694+0000","last_clean":"2023-10-06T02:49:58.696694+0000","last_became_active":"2023-10-06T02:49:57.693055+0000","last_became_peered":"2023-10-06T02:49:57.693055+0000","last_unstale":"2023-10-06T02:49:58.696694+0000","last_undegraded":"2023-10-06T02:49:58.696694+0000","last_fullsized":"2023-10-06T02:49:58.696694+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:00.626438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691910+0000","last_change":"2023-10-06T02:49:58.691629+0000","last_active":"2023-10-06T02:49:58.691910+0000","last_peered":"2023-10-06T02:49:58.691910+0000","last_clean":"2023-10-06T02:49:58.691910+0000","last_became_active":"2023-10-06T02:49:58.690939+0000","last_became_peered":"2023-10-06T02:49:58.690939+0000","last_unstale":"2023-10-06T02:49:58.691910+0000","last_undegraded":"2023-10-06T02:49:58.691910+0000","last_fullsized":"2023-10-06T02:49:58.691910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:12.428178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.682780+0000","last_change":"2023-10-06T02:49:57.692825+0000","last_active":"2023-10-06T02:49:58.682780+0000","last_peered":"2023-10-06T02:49:58.682780+0000","last_clean":"2023-10-06T02:49:58.682780+0000","last_became_active":"2023-10-06T02:49:57.692396+0000","last_became_peered":"2023-10-06T02:49:57.692396+0000","last_unstale":"2023-10-06T02:49:58.682780+0000","last_undegraded":"2023-10-06T02:49:58.682780+0000","last_fullsized":"2023-10-06T02:49:58.682780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:32.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.700885+0000","last_change":"2023-10-06T02:49:58.700657+0000","last_active":"2023-10-06T02:49:58.700885+0000","last_peered":"2023-10-06T02:49:58.700885+0000","last_clean":"2023-10-06T02:49:58.700885+0000","last_became_active":"2023-10-06T02:49:58.700476+0000","last_became_peered":"2023-10-06T02:49:58.700476+0000","last_unstale":"2023-10-06T02:49:58.700885+0000","last_undegraded":"2023-10-06T02:49:58.700885+0000","last_fullsized":"2023-10-06T02:49:58.700885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:47.438011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.692249+0000","last_change":"2023-10-06T02:49:57.692516+0000","last_active":"2023-10-06T02:49:58.692249+0000","last_peered":"2023-10-06T02:49:58.692249+0000","last_clean":"2023-10-06T02:49:58.692249+0000","last_became_active":"2023-10-06T02:49:57.692076+0000","last_became_peered":"2023-10-06T02:49:57.692076+0000","last_unstale":"2023-10-06T02:49:58.692249+0000","last_undegraded":"2023-10-06T02:49:58.692249+0000","last_fullsized":"2023-10-06T02:49:58.692249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:12.516287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686303+0000","last_change":"2023-10-06T02:49:58.686238+0000","last_active":"2023-10-06T02:49:58.686303+0000","last_peered":"2023-10-06T02:49:58.686303+0000","last_clean":"2023-10-06T02:49:58.686303+0000","last_became_active":"2023-10-06T02:49:58.686012+0000","last_became_peered":"2023-10-06T02:49:58.686012+0000","last_unstale":"2023-10-06T02:49:58.686303+0000","last_undegraded":"2023-10-06T02:49:58.686303+0000","last_fullsized":"2023-10-06T02:49:58.686303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:10.461749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686068+0000","last_change":"2023-10-06T02:49:57.692785+0000","last_active":"2023-10-06T02:49:58.686068+0000","last_peered":"2023-10-06T02:49:58.686068+0000","last_clean":"2023-10-06T02:49:58.686068+0000","last_became_active":"2023-10-06T02:49:57.692466+0000","last_became_peered":"2023-10-06T02:49:57.692466+0000","last_unstale":"2023-10-06T02:49:58.686068+0000","last_undegraded":"2023-10-06T02:49:58.686068+0000","last_fullsized":"2023-10-06T02:49:58.686068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:16.809204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691403+0000","last_change":"2023-10-06T02:49:58.688988+0000","last_active":"2023-10-06T02:49:58.691403+0000","last_peered":"2023-10-06T02:49:58.691403+0000","last_clean":"2023-10-06T02:49:58.691403+0000","last_became_active":"2023-10-06T02:49:58.688775+0000","last_became_peered":"2023-10-06T02:49:58.688775+0000","last_unstale":"2023-10-06T02:49:58.691403+0000","last_undegraded":"2023-10-06T02:49:58.691403+0000","last_fullsized":"2023-10-06T02:49:58.691403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:33.039092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685187+0000","last_change":"2023-10-06T02:49:57.691447+0000","last_active":"2023-10-06T02:49:58.685187+0000","last_peered":"2023-10-06T02:49:58.685187+0000","last_clean":"2023-10-06T02:49:58.685187+0000","last_became_active":"2023-10-06T02:49:57.691226+0000","last_became_peered":"2023-10-06T02:49:57.691226+0000","last_unstale":"2023-10-06T02:49:58.685187+0000","last_undegraded":"2023-10-06T02:49:58.685187+0000","last_fullsized":"2023-10-06T02:49:58.685187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:14.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.689527+0000","last_change":"2023-10-06T02:49:58.689409+0000","last_active":"2023-10-06T02:49:58.689527+0000","last_peered":"2023-10-06T02:49:58.689527+0000","last_clean":"2023-10-06T02:49:58.689527+0000","last_became_active":"2023-10-06T02:49:58.688811+0000","last_became_peered":"2023-10-06T02:49:58.688811+0000","last_unstale":"2023-10-06T02:49:58.689527+0000","last_undegraded":"2023-10-06T02:49:58.689527+0000","last_fullsized":"2023-10-06T02:49:58.689527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:38.542270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.703579+0000","last_change":"2023-10-06T02:49:57.685933+0000","last_active":"2023-10-06T02:49:58.703579+0000","last_peered":"2023-10-06T02:49:58.703579+0000","last_clean":"2023-10-06T02:49:58.703579+0000","last_became_active":"2023-10-06T02:49:57.685697+0000","last_became_peered":"2023-10-06T02:49:57.685697+0000","last_unstale":"2023-10-06T02:49:58.703579+0000","last_undegraded":"2023-10-06T02:49:58.703579+0000","last_fullsized":"2023-10-06T02:49:58.703579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:00.862990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691856+0000","last_change":"2023-10-06T02:49:58.691722+0000","last_active":"2023-10-06T02:49:58.691856+0000","last_peered":"2023-10-06T02:49:58.691856+0000","last_clean":"2023-10-06T02:49:58.691856+0000","last_became_active":"2023-10-06T02:49:58.691409+0000","last_became_peered":"2023-10-06T02:49:58.691409+0000","last_unstale":"2023-10-06T02:49:58.691856+0000","last_undegraded":"2023-10-06T02:49:58.691856+0000","last_fullsized":"2023-10-06T02:49:58.691856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:41.207115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"83'6","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.700840+0000","last_change":"2023-10-06T02:49:57.686073+0000","last_active":"2023-10-06T02:49:58.700840+0000","last_peered":"2023-10-06T02:49:58.700840+0000","last_clean":"2023-10-06T02:49:58.700840+0000","last_became_active":"2023-10-06T02:49:57.685435+0000","last_became_peered":"2023-10-06T02:49:57.685435+0000","last_unstale":"2023-10-06T02:49:58.700840+0000","last_undegraded":"2023-10-06T02:49:58.700840+0000","last_fullsized":"2023-10-06T02:49:58.700840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:13.325696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696361+0000","last_change":"2023-10-06T02:49:58.694743+0000","last_active":"2023-10-06T02:49:58.696361+0000","last_peered":"2023-10-06T02:49:58.696361+0000","last_clean":"2023-10-06T02:49:58.696361+0000","last_became_active":"2023-10-06T02:49:58.694329+0000","last_became_peered":"2023-10-06T02:49:58.694329+0000","last_unstale":"2023-10-06T02:49:58.696361+0000","last_undegraded":"2023-10-06T02:49:58.696361+0000","last_fullsized":"2023-10-06T02:49:58.696361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:37.308414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.695038+0000","last_change":"2023-10-06T02:49:57.689450+0000","last_active":"2023-10-06T02:49:58.695038+0000","last_peered":"2023-10-06T02:49:58.695038+0000","last_clean":"2023-10-06T02:49:58.695038+0000","last_became_active":"2023-10-06T02:49:57.689211+0000","last_became_peered":"2023-10-06T02:49:57.689211+0000","last_unstale":"2023-10-06T02:49:58.695038+0000","last_undegraded":"2023-10-06T02:49:58.695038+0000","last_fullsized":"2023-10-06T02:49:58.695038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:11.421121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.694314+0000","last_change":"2023-10-06T02:49:58.694238+0000","last_active":"2023-10-06T02:49:58.694314+0000","last_peered":"2023-10-06T02:49:58.694314+0000","last_clean":"2023-10-06T02:49:58.694314+0000","last_became_active":"2023-10-06T02:49:58.694024+0000","last_became_peered":"2023-10-06T02:49:58.694024+0000","last_unstale":"2023-10-06T02:49:58.694314+0000","last_undegraded":"2023-10-06T02:49:58.694314+0000","last_fullsized":"2023-10-06T02:49:58.694314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:53.197453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686233+0000","last_change":"2023-10-06T02:49:57.694822+0000","last_active":"2023-10-06T02:49:58.686233+0000","last_peered":"2023-10-06T02:49:58.686233+0000","last_clean":"2023-10-06T02:49:58.686233+0000","last_became_active":"2023-10-06T02:49:57.694588+0000","last_became_peered":"2023-10-06T02:49:57.694588+0000","last_unstale":"2023-10-06T02:49:58.686233+0000","last_undegraded":"2023-10-06T02:49:58.686233+0000","last_fullsized":"2023-10-06T02:49:58.686233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.430954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691532+0000","last_change":"2023-10-06T02:49:58.690541+0000","last_active":"2023-10-06T02:49:58.691532+0000","last_peered":"2023-10-06T02:49:58.691532+0000","last_clean":"2023-10-06T02:49:58.691532+0000","last_became_active":"2023-10-06T02:49:58.690324+0000","last_became_peered":"2023-10-06T02:49:58.690324+0000","last_unstale":"2023-10-06T02:49:58.691532+0000","last_undegraded":"2023-10-06T02:49:58.691532+0000","last_fullsized":"2023-10-06T02:49:58.691532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:26.406703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.684925+0000","last_change":"2023-10-06T02:49:57.690351+0000","last_active":"2023-10-06T02:49:58.684925+0000","last_peered":"2023-10-06T02:49:58.684925+0000","last_clean":"2023-10-06T02:49:58.684925+0000","last_became_active":"2023-10-06T02:49:57.689849+0000","last_became_peered":"2023-10-06T02:49:57.689849+0000","last_unstale":"2023-10-06T02:49:58.684925+0000","last_undegraded":"2023-10-06T02:49:58.684925+0000","last_fullsized":"2023-10-06T02:49:58.684925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.873213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693694+0000","last_change":"2023-10-06T02:49:58.692520+0000","last_active":"2023-10-06T02:49:58.693694+0000","last_peered":"2023-10-06T02:49:58.693694+0000","last_clean":"2023-10-06T02:49:58.693694+0000","last_became_active":"2023-10-06T02:49:58.692291+0000","last_became_peered":"2023-10-06T02:49:58.692291+0000","last_unstale":"2023-10-06T02:49:58.693694+0000","last_undegraded":"2023-10-06T02:49:58.693694+0000","last_fullsized":"2023-10-06T02:49:58.693694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:20.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"83'8","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.702846+0000","last_change":"2023-10-06T02:49:57.690347+0000","last_active":"2023-10-06T02:49:58.702846+0000","last_peered":"2023-10-06T02:49:58.702846+0000","last_clean":"2023-10-06T02:49:58.702846+0000","last_became_active":"2023-10-06T02:49:57.686473+0000","last_became_peered":"2023-10-06T02:49:57.686473+0000","last_unstale":"2023-10-06T02:49:58.702846+0000","last_undegraded":"2023-10-06T02:49:58.702846+0000","last_fullsized":"2023-10-06T02:49:58.702846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:40.026899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691876+0000","last_change":"2023-10-06T02:49:58.691197+0000","last_active":"2023-10-06T02:49:58.691876+0000","last_peered":"2023-10-06T02:49:58.691876+0000","last_clean":"2023-10-06T02:49:58.691876+0000","last_became_active":"2023-10-06T02:49:58.690599+0000","last_became_peered":"2023-10-06T02:49:58.690599+0000","last_unstale":"2023-10-06T02:49:58.691876+0000","last_undegraded":"2023-10-06T02:49:58.691876+0000","last_fullsized":"2023-10-06T02:49:58.691876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:26.406703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699691+0000","last_change":"2023-10-06T02:49:57.687675+0000","last_active":"2023-10-06T02:49:58.699691+0000","last_peered":"2023-10-06T02:49:58.699691+0000","last_clean":"2023-10-06T02:49:58.699691+0000","last_became_active":"2023-10-06T02:49:57.687235+0000","last_became_peered":"2023-10-06T02:49:57.687235+0000","last_unstale":"2023-10-06T02:49:58.699691+0000","last_undegraded":"2023-10-06T02:49:58.699691+0000","last_fullsized":"2023-10-06T02:49:58.699691+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:24.623448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698941+0000","last_change":"2023-10-06T02:49:58.698415+0000","last_active":"2023-10-06T02:49:58.698941+0000","last_peered":"2023-10-06T02:49:58.698941+0000","last_clean":"2023-10-06T02:49:58.698941+0000","last_became_active":"2023-10-06T02:49:58.698194+0000","last_became_peered":"2023-10-06T02:49:58.698194+0000","last_unstale":"2023-10-06T02:49:58.698941+0000","last_undegraded":"2023-10-06T02:49:58.698941+0000","last_fullsized":"2023-10-06T02:49:58.698941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:27.311753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.682362+0000","last_change":"2023-10-06T02:49:57.690854+0000","last_active":"2023-10-06T02:49:58.682362+0000","last_peered":"2023-10-06T02:49:58.682362+0000","last_clean":"2023-10-06T02:49:58.682362+0000","last_became_active":"2023-10-06T02:49:57.690511+0000","last_became_peered":"2023-10-06T02:49:57.690511+0000","last_unstale":"2023-10-06T02:49:58.682362+0000","last_undegraded":"2023-10-06T02:49:58.682362+0000","last_fullsized":"2023-10-06T02:49:58.682362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:02.136224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693196+0000","last_change":"2023-10-06T02:49:58.692972+0000","last_active":"2023-10-06T02:49:58.693196+0000","last_peered":"2023-10-06T02:49:58.693196+0000","last_clean":"2023-10-06T02:49:58.693196+0000","last_became_active":"2023-10-06T02:49:58.692343+0000","last_became_peered":"2023-10-06T02:49:58.692343+0000","last_unstale":"2023-10-06T02:49:58.693196+0000","last_undegraded":"2023-10-06T02:49:58.693196+0000","last_fullsized":"2023-10-06T02:49:58.693196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:53.197453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683233+0000","last_change":"2023-10-06T02:49:57.693589+0000","last_active":"2023-10-06T02:49:58.683233+0000","last_peered":"2023-10-06T02:49:58.683233+0000","last_clean":"2023-10-06T02:49:58.683233+0000","last_became_active":"2023-10-06T02:49:57.693409+0000","last_became_peered":"2023-10-06T02:49:57.693409+0000","last_unstale":"2023-10-06T02:49:58.683233+0000","last_undegraded":"2023-10-06T02:49:58.683233+0000","last_fullsized":"2023-10-06T02:49:58.683233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:47.808611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.695192+0000","last_change":"2023-10-06T02:49:58.695124+0000","last_active":"2023-10-06T02:49:58.695192+0000","last_peered":"2023-10-06T02:49:58.695192+0000","last_clean":"2023-10-06T02:49:58.695192+0000","last_became_active":"2023-10-06T02:49:58.694914+0000","last_became_peered":"2023-10-06T02:49:58.694914+0000","last_unstale":"2023-10-06T02:49:58.695192+0000","last_undegraded":"2023-10-06T02:49:58.695192+0000","last_fullsized":"2023-10-06T02:49:58.695192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:59.780628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683608+0000","last_change":"2023-10-06T02:49:57.692666+0000","last_active":"2023-10-06T02:49:58.683608+0000","last_peered":"2023-10-06T02:49:58.683608+0000","last_clean":"2023-10-06T02:49:58.683608+0000","last_became_active":"2023-10-06T02:49:57.692432+0000","last_became_peered":"2023-10-06T02:49:57.692432+0000","last_unstale":"2023-10-06T02:49:58.683608+0000","last_undegraded":"2023-10-06T02:49:58.683608+0000","last_fullsized":"2023-10-06T02:49:58.683608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:32.798696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693714+0000","last_change":"2023-10-06T02:49:58.693004+0000","last_active":"2023-10-06T02:49:58.693714+0000","last_peered":"2023-10-06T02:49:58.693714+0000","last_clean":"2023-10-06T02:49:58.693714+0000","last_became_active":"2023-10-06T02:49:58.692801+0000","last_became_peered":"2023-10-06T02:49:58.692801+0000","last_unstale":"2023-10-06T02:49:58.693714+0000","last_undegraded":"2023-10-06T02:49:58.693714+0000","last_fullsized":"2023-10-06T02:49:58.693714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:12.428178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.689882+0000","last_change":"2023-10-06T02:49:57.692567+0000","last_active":"2023-10-06T02:49:58.689882+0000","last_peered":"2023-10-06T02:49:58.689882+0000","last_clean":"2023-10-06T02:49:58.689882+0000","last_became_active":"2023-10-06T02:49:57.692060+0000","last_became_peered":"2023-10-06T02:49:57.692060+0000","last_unstale":"2023-10-06T02:49:58.689882+0000","last_undegraded":"2023-10-06T02:49:58.689882+0000","last_fullsized":"2023-10-06T02:49:58.689882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:22.205606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696927+0000","last_change":"2023-10-06T02:49:58.696837+0000","last_active":"2023-10-06T02:49:58.696927+0000","last_peered":"2023-10-06T02:49:58.696927+0000","last_clean":"2023-10-06T02:49:58.696927+0000","last_became_active":"2023-10-06T02:49:58.696634+0000","last_became_peered":"2023-10-06T02:49:58.696634+0000","last_unstale":"2023-10-06T02:49:58.696927+0000","last_undegraded":"2023-10-06T02:49:58.696927+0000","last_fullsized":"2023-10-06T02:49:58.696927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:15.647974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.684831+0000","last_change":"2023-10-06T02:49:57.690513+0000","last_active":"2023-10-06T02:49:58.684831+0000","last_peered":"2023-10-06T02:49:58.684831+0000","last_clean":"2023-10-06T02:49:58.684831+0000","last_became_active":"2023-10-06T02:49:57.690131+0000","last_became_peered":"2023-10-06T02:49:57.690131+0000","last_unstale":"2023-10-06T02:49:58.684831+0000","last_undegraded":"2023-10-06T02:49:58.684831+0000","last_fullsized":"2023-10-06T02:49:58.684831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:38.817005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693945+0000","last_change":"2023-10-06T02:49:58.693846+0000","last_active":"2023-10-06T02:49:58.693945+0000","last_peered":"2023-10-06T02:49:58.693945+0000","last_clean":"2023-10-06T02:49:58.693945+0000","last_became_active":"2023-10-06T02:49:58.693335+0000","last_became_peered":"2023-10-06T02:49:58.693335+0000","last_unstale":"2023-10-06T02:49:58.693945+0000","last_undegraded":"2023-10-06T02:49:58.693945+0000","last_fullsized":"2023-10-06T02:49:58.693945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:17.816261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.690943+0000","last_change":"2023-10-06T02:49:57.693258+0000","last_active":"2023-10-06T02:49:58.690943+0000","last_peered":"2023-10-06T02:49:58.690943+0000","last_clean":"2023-10-06T02:49:58.690943+0000","last_became_active":"2023-10-06T02:49:57.693088+0000","last_became_peered":"2023-10-06T02:49:57.693088+0000","last_unstale":"2023-10-06T02:49:58.690943+0000","last_undegraded":"2023-10-06T02:49:58.690943+0000","last_fullsized":"2023-10-06T02:49:58.690943+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:30.832713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691889+0000","last_change":"2023-10-06T02:49:58.691829+0000","last_active":"2023-10-06T02:49:58.691889+0000","last_peered":"2023-10-06T02:49:58.691889+0000","last_clean":"2023-10-06T02:49:58.691889+0000","last_became_active":"2023-10-06T02:49:58.691222+0000","last_became_peered":"2023-10-06T02:49:58.691222+0000","last_unstale":"2023-10-06T02:49:58.691889+0000","last_undegraded":"2023-10-06T02:49:58.691889+0000","last_fullsized":"2023-10-06T02:49:58.691889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:33.805753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.684850+0000","last_change":"2023-10-06T02:49:57.693366+0000","last_active":"2023-10-06T02:49:58.684850+0000","last_peered":"2023-10-06T02:49:58.684850+0000","last_clean":"2023-10-06T02:49:58.684850+0000","last_became_active":"2023-10-06T02:49:57.692914+0000","last_became_peered":"2023-10-06T02:49:57.692914+0000","last_unstale":"2023-10-06T02:49:58.684850+0000","last_undegraded":"2023-10-06T02:49:58.684850+0000","last_fullsized":"2023-10-06T02:49:58.684850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:25.399646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696172+0000","last_change":"2023-10-06T02:49:58.696127+0000","last_active":"2023-10-06T02:49:58.696172+0000","last_peered":"2023-10-06T02:49:58.696172+0000","last_clean":"2023-10-06T02:49:58.696172+0000","last_became_active":"2023-10-06T02:49:58.695958+0000","last_became_peered":"2023-10-06T02:49:58.695958+0000","last_unstale":"2023-10-06T02:49:58.696172+0000","last_undegraded":"2023-10-06T02:49:58.696172+0000","last_fullsized":"2023-10-06T02:49:58.696172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:39:43.001636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.701482+0000","last_change":"2023-10-06T02:49:57.688145+0000","last_active":"2023-10-06T02:49:58.701482+0000","last_peered":"2023-10-06T02:49:58.701482+0000","last_clean":"2023-10-06T02:49:58.701482+0000","last_became_active":"2023-10-06T02:49:57.687934+0000","last_became_peered":"2023-10-06T02:49:57.687934+0000","last_unstale":"2023-10-06T02:49:58.701482+0000","last_undegraded":"2023-10-06T02:49:58.701482+0000","last_fullsized":"2023-10-06T02:49:58.701482+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:58.929863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687491+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:49:58.687491+0000","last_peered":"2023-10-06T02:49:58.687491+0000","last_clean":"2023-10-06T02:49:58.687491+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:49:58.687491+0000","last_undegraded":"2023-10-06T02:49:58.687491+0000","last_fullsized":"2023-10-06T02:49:58.687491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687430+0000","last_change":"2023-10-06T02:49:58.687371+0000","last_active":"2023-10-06T02:49:58.687430+0000","last_peered":"2023-10-06T02:49:58.687430+0000","last_clean":"2023-10-06T02:49:58.687430+0000","last_became_active":"2023-10-06T02:49:58.687160+0000","last_became_peered":"2023-10-06T02:49:58.687160+0000","last_unstale":"2023-10-06T02:49:58.687430+0000","last_undegraded":"2023-10-06T02:49:58.687430+0000","last_fullsized":"2023-10-06T02:49:58.687430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:46.973678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.702180+0000","last_change":"2023-10-06T02:49:57.687072+0000","last_active":"2023-10-06T02:49:58.702180+0000","last_peered":"2023-10-06T02:49:58.702180+0000","last_clean":"2023-10-06T02:49:58.702180+0000","last_became_active":"2023-10-06T02:49:57.686276+0000","last_became_peered":"2023-10-06T02:49:57.686276+0000","last_unstale":"2023-10-06T02:49:58.702180+0000","last_undegraded":"2023-10-06T02:49:58.702180+0000","last_fullsized":"2023-10-06T02:49:58.702180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:16.809204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685352+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:49:58.685352+0000","last_peered":"2023-10-06T02:49:58.685352+0000","last_clean":"2023-10-06T02:49:58.685352+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:49:58.685352+0000","last_undegraded":"2023-10-06T02:49:58.685352+0000","last_fullsized":"2023-10-06T02:49:58.685352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696011+0000","last_change":"2023-10-06T02:49:58.695959+0000","last_active":"2023-10-06T02:49:58.696011+0000","last_peered":"2023-10-06T02:49:58.696011+0000","last_clean":"2023-10-06T02:49:58.696011+0000","last_became_active":"2023-10-06T02:49:58.695785+0000","last_became_peered":"2023-10-06T02:49:58.695785+0000","last_unstale":"2023-10-06T02:49:58.696011+0000","last_undegraded":"2023-10-06T02:49:58.696011+0000","last_fullsized":"2023-10-06T02:49:58.696011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.375741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686533+0000","last_change":"2023-10-06T02:49:57.687772+0000","last_active":"2023-10-06T02:49:58.686533+0000","last_peered":"2023-10-06T02:49:58.686533+0000","last_clean":"2023-10-06T02:49:58.686533+0000","last_became_active":"2023-10-06T02:49:57.687581+0000","last_became_peered":"2023-10-06T02:49:57.687581+0000","last_unstale":"2023-10-06T02:49:58.686533+0000","last_undegraded":"2023-10-06T02:49:58.686533+0000","last_fullsized":"2023-10-06T02:49:58.686533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:40.026899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.692051+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:49:58.692051+0000","last_peered":"2023-10-06T02:49:58.692051+0000","last_clean":"2023-10-06T02:49:58.692051+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:49:58.692051+0000","last_undegraded":"2023-10-06T02:49:58.692051+0000","last_fullsized":"2023-10-06T02:49:58.692051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696440+0000","last_change":"2023-10-06T02:49:58.696075+0000","last_active":"2023-10-06T02:49:58.696440+0000","last_peered":"2023-10-06T02:49:58.696440+0000","last_clean":"2023-10-06T02:49:58.696440+0000","last_became_active":"2023-10-06T02:49:58.695528+0000","last_became_peered":"2023-10-06T02:49:58.695528+0000","last_unstale":"2023-10-06T02:49:58.696440+0000","last_undegraded":"2023-10-06T02:49:58.696440+0000","last_fullsized":"2023-10-06T02:49:58.696440+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:42.247967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.688435+0000","last_change":"2023-10-06T02:49:57.691229+0000","last_active":"2023-10-06T02:49:58.688435+0000","last_peered":"2023-10-06T02:49:58.688435+0000","last_clean":"2023-10-06T02:49:58.688435+0000","last_became_active":"2023-10-06T02:49:57.690997+0000","last_became_peered":"2023-10-06T02:49:57.690997+0000","last_unstale":"2023-10-06T02:49:58.688435+0000","last_undegraded":"2023-10-06T02:49:58.688435+0000","last_fullsized":"2023-10-06T02:49:58.688435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:02.136224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.684584+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:49:58.684584+0000","last_peered":"2023-10-06T02:49:58.684584+0000","last_clean":"2023-10-06T02:49:58.684584+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:49:58.684584+0000","last_undegraded":"2023-10-06T02:49:58.684584+0000","last_fullsized":"2023-10-06T02:49:58.684584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683460+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:49:58.683460+0000","last_peered":"2023-10-06T02:49:58.683460+0000","last_clean":"2023-10-06T02:49:58.683460+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:49:58.683460+0000","last_undegraded":"2023-10-06T02:49:58.683460+0000","last_fullsized":"2023-10-06T02:49:58.683460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.688021+0000","last_change":"2023-10-06T02:49:58.687963+0000","last_active":"2023-10-06T02:49:58.688021+0000","last_peered":"2023-10-06T02:49:58.688021+0000","last_clean":"2023-10-06T02:49:58.688021+0000","last_became_active":"2023-10-06T02:49:58.687759+0000","last_became_peered":"2023-10-06T02:49:58.687759+0000","last_unstale":"2023-10-06T02:49:58.688021+0000","last_undegraded":"2023-10-06T02:49:58.688021+0000","last_fullsized":"2023-10-06T02:49:58.688021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:40.098886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685397+0000","last_change":"2023-10-06T02:49:57.686132+0000","last_active":"2023-10-06T02:49:58.685397+0000","last_peered":"2023-10-06T02:49:58.685397+0000","last_clean":"2023-10-06T02:49:58.685397+0000","last_became_active":"2023-10-06T02:49:57.685905+0000","last_became_peered":"2023-10-06T02:49:57.685905+0000","last_unstale":"2023-10-06T02:49:58.685397+0000","last_undegraded":"2023-10-06T02:49:58.685397+0000","last_fullsized":"2023-10-06T02:49:58.685397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:40.200059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683307+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:49:58.683307+0000","last_peered":"2023-10-06T02:49:58.683307+0000","last_clean":"2023-10-06T02:49:58.683307+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:49:58.683307+0000","last_undegraded":"2023-10-06T02:49:58.683307+0000","last_fullsized":"2023-10-06T02:49:58.683307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699912+0000","last_change":"2023-10-06T02:49:58.699852+0000","last_active":"2023-10-06T02:49:58.699912+0000","last_peered":"2023-10-06T02:49:58.699912+0000","last_clean":"2023-10-06T02:49:58.699912+0000","last_became_active":"2023-10-06T02:49:58.699435+0000","last_became_peered":"2023-10-06T02:49:58.699435+0000","last_unstale":"2023-10-06T02:49:58.699912+0000","last_undegraded":"2023-10-06T02:49:58.699912+0000","last_fullsized":"2023-10-06T02:49:58.699912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:03.647505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685594+0000","last_change":"2023-10-06T02:49:57.689981+0000","last_active":"2023-10-06T02:49:58.685594+0000","last_peered":"2023-10-06T02:49:58.685594+0000","last_clean":"2023-10-06T02:49:58.685594+0000","last_became_active":"2023-10-06T02:49:57.689586+0000","last_became_peered":"2023-10-06T02:49:57.689586+0000","last_unstale":"2023-10-06T02:49:58.685594+0000","last_undegraded":"2023-10-06T02:49:58.685594+0000","last_fullsized":"2023-10-06T02:49:58.685594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:54.064486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683514+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:49:58.683514+0000","last_peered":"2023-10-06T02:49:58.683514+0000","last_clean":"2023-10-06T02:49:58.683514+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:49:58.683514+0000","last_undegraded":"2023-10-06T02:49:58.683514+0000","last_fullsized":"2023-10-06T02:49:58.683514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.700599+0000","last_change":"2023-10-06T02:49:58.699961+0000","last_active":"2023-10-06T02:49:58.700599+0000","last_peered":"2023-10-06T02:49:58.700599+0000","last_clean":"2023-10-06T02:49:58.700599+0000","last_became_active":"2023-10-06T02:49:58.699726+0000","last_became_peered":"2023-10-06T02:49:58.699726+0000","last_unstale":"2023-10-06T02:49:58.700599+0000","last_undegraded":"2023-10-06T02:49:58.700599+0000","last_fullsized":"2023-10-06T02:49:58.700599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:54.094683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699083+0000","last_change":"2023-10-06T02:49:57.692268+0000","last_active":"2023-10-06T02:49:58.699083+0000","last_peered":"2023-10-06T02:49:58.699083+0000","last_clean":"2023-10-06T02:49:58.699083+0000","last_became_active":"2023-10-06T02:49:57.692085+0000","last_became_peered":"2023-10-06T02:49:57.692085+0000","last_unstale":"2023-10-06T02:49:58.699083+0000","last_undegraded":"2023-10-06T02:49:58.699083+0000","last_fullsized":"2023-10-06T02:49:58.699083+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:40.200059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685107+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:49:58.685107+0000","last_peered":"2023-10-06T02:49:58.685107+0000","last_clean":"2023-10-06T02:49:58.685107+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:49:58.685107+0000","last_undegraded":"2023-10-06T02:49:58.685107+0000","last_fullsized":"2023-10-06T02:49:58.685107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698357+0000","last_change":"2023-10-06T02:49:58.697546+0000","last_active":"2023-10-06T02:49:58.698357+0000","last_peered":"2023-10-06T02:49:58.698357+0000","last_clean":"2023-10-06T02:49:58.698357+0000","last_became_active":"2023-10-06T02:49:58.697154+0000","last_became_peered":"2023-10-06T02:49:58.697154+0000","last_unstale":"2023-10-06T02:49:58.698357+0000","last_undegraded":"2023-10-06T02:49:58.698357+0000","last_fullsized":"2023-10-06T02:49:58.698357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:48.179124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698315+0000","last_change":"2023-10-06T02:49:57.687838+0000","last_active":"2023-10-06T02:49:58.698315+0000","last_peered":"2023-10-06T02:49:58.698315+0000","last_clean":"2023-10-06T02:49:58.698315+0000","last_became_active":"2023-10-06T02:49:57.687126+0000","last_became_peered":"2023-10-06T02:49:57.687126+0000","last_unstale":"2023-10-06T02:49:58.698315+0000","last_undegraded":"2023-10-06T02:49:58.698315+0000","last_fullsized":"2023-10-06T02:49:58.698315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:02.962978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.689075+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:49:58.689075+0000","last_peered":"2023-10-06T02:49:58.689075+0000","last_clean":"2023-10-06T02:49:58.689075+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:49:58.689075+0000","last_undegraded":"2023-10-06T02:49:58.689075+0000","last_fullsized":"2023-10-06T02:49:58.689075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194276,"statfs":{"total":200000000,"available":198939204,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.753,"5min":1.393,"15min":1.393},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30499999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73599999999999999,"5min":1.081,"15min":1.081},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.32700000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.79900000000000004,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.501}]},{"osd":2,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.373,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77300000000000002,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78600000000000003,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.42499999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.35899999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.66200000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39400000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.746,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.76100000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.442},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.34599999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194851,"statfs":{"total":200000000,"available":199528058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60599999999999998,"15min":0.63600000000000001},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":1.879,"15min":1.879},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.90700000000000003,"15min":1.069},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69399999999999995,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.40699999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.433}]},{"osd":3,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70199999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80100000000000005,"5min":1.163,"15min":1.163},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.53800000000000003,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68799999999999994,"5min":1.05,"15min":1.05},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53000000000000003,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65100000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.59399999999999997,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77900000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60699999999999998,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":459,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194853,"statfs":{"total":200000000,"available":199529482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.308,"15min":0.311},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.32600000000000001},"min":{"1min":0.251,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.26200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.318,"15min":0.317},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.497,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.38}]},{"osd":3,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.27400000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.37,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.41399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71299999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82099999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77800000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.442,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.67700000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78300000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194276,"statfs":{"total":200000000,"available":198939226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34999999999999998},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47999999999999998,"5min":1.177,"15min":1.177},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38800000000000001,"15min":0.39800000000000002},"min":{"1min":0.23499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65100000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.26500000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.75800000000000001,"15min":1.181},"min":{"1min":0.216,"5min":0.188,"15min":0.188},"max":{"1min":0.56000000000000005,"5min":22.038,"15min":22.038},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.23000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.26200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.60399999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.79600000000000004,"15min":1.2110000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.63300000000000001,"5min":21.942,"15min":21.942},"last":0.255}]},{"osd":4,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.91000000000000003,"15min":1.264},"min":{"1min":0.46400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86499999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.96899999999999997,"15min":1.367},"min":{"1min":0.46300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.47699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":1.401,"15min":1.401},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.93899999999999995,"15min":1.294},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.98999999999999999,"15min":1.3939999999999999},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80900000000000005,"5min":21.98,"15min":21.98},"last":0.52200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.88800000000000001,"5min":1.425,"15min":1.425},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.78300000000000003,"15min":0.96599999999999997},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81899999999999995,"5min":11.154,"15min":11.154},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194852,"statfs":{"total":200000000,"available":199528880,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52900000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.20999999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.51500000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.34699999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"min":{"1min":0.25700000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.63,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.434}]},{"osd":4,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80000000000000004,"5min":0.875,"15min":0.875},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59399999999999997,"15min":0.57799999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79500000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.75}]},{"osd":6,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57699999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":459,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194852,"statfs":{"total":200000000,"available":199529040,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.30299999999999999,"15min":0.30199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.42399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.318},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.501,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.32200000000000001},"min":{"1min":0.245,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.34599999999999997,"15min":0.33800000000000002},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.372}]},{"osd":2,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.38500000000000001,"15min":0.36499999999999999},"min":{"1min":0.26300000000000001,"5min":0.216,"15min":0.216},"max":{"1min":3.044,"5min":3.044,"15min":3.044},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.33500000000000002},"min":{"1min":0.30099999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77500000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68100000000000005,"5min":2.25,"15min":2.25},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.66300000000000003,"15min":0.71399999999999997},"min":{"1min":0.371,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71399999999999997,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79200000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.48699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.90500000000000003,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84199999999999997,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.626},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.54200000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73599999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.753}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194851,"statfs":{"total":200000000,"available":199527954,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.752,"15min":0.86499999999999999},"min":{"1min":0.27800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71699999999999997,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.60499999999999998,"15min":0.65500000000000003},"min":{"1min":0.33700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.66100000000000003,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.78000000000000003,"15min":0.89900000000000002},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70199999999999996,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.74199999999999999,"15min":0.84099999999999997},"min":{"1min":0.32700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.80000000000000004,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.625,"15min":0.67700000000000005},"min":{"1min":0.35199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75900000000000001,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.65900000000000003,"15min":0.71199999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70499999999999996,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.57599999999999996,"15min":0.60899999999999999},"min":{"1min":0.37,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72799999999999998,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59899999999999998,"15min":0.63200000000000001},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.748,"5min":3.456,"15min":3.456},"last":0.48299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.66100000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.50900000000000001,"15min":0.51500000000000001},"min":{"1min":0.36899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.35499999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52200000000000002,"15min":0.52700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.309},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69099999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.33400000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76400000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.96099999999999997,"15min":1.129},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78400000000000003,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.374}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":459,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194853,"statfs":{"total":200000000,"available":199529560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72499999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40699999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.627},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.66500000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.33200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.372,"5min":0.31,"15min":0.31},"max":{"1min":0.72399999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71199999999999997,"5min":0.879,"15min":0.879},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.79700000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57699999999999996}]}]}],"pool_statfs":[]}} 2023-10-06T02:50:02.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:50:02.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.886+0000 7fe1381d5700 1 Processor -- start 2023-10-06T02:50:02.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.886+0000 7fe1381d5700 1 -- start start 2023-10-06T02:50:02.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe1381d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1301578d0 0x7fe1300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe1381d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe130157ca0 0x7fe13015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe1381d5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe13006d120 0x7fe13006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe1381d5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13006dac0 con 0x7fe1301578d0 2023-10-06T02:50:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe1381d5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1300d07c0 con 0x7fe13006d120 2023-10-06T02:50:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe1381d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300cfbb0 con 0x7fe130157ca0 2023-10-06T02:50:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe135f71700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1301578d0 0x7fe1300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe135f71700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1301578d0 0x7fe1300cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39242/0 (socket says 172.21.15.81:39242) 2023-10-06T02:50:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe135f71700 1 -- 172.21.15.81:0/2387563231 learned_addr learned my addr 172.21.15.81:0/2387563231 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe135770700 1 --2- 172.21.15.81:0/2387563231 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe130157ca0 0x7fe13015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe136772700 1 --2- 172.21.15.81:0/2387563231 >> v2:172.21.15.83:3300/0 conn(0x7fe13006d120 0x7fe13006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe135f71700 1 -- 172.21.15.81:0/2387563231 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe130157ca0 msgr2=0x7fe13015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.887+0000 7fe135f71700 1 --2- 172.21.15.81:0/2387563231 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe130157ca0 0x7fe13015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe135f71700 1 -- 172.21.15.81:0/2387563231 >> v2:172.21.15.83:3300/0 conn(0x7fe13006d120 msgr2=0x7fe13006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe135f71700 1 --2- 172.21.15.81:0/2387563231 >> v2:172.21.15.83:3300/0 conn(0x7fe13006d120 0x7fe13006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe135f71700 1 -- 172.21.15.81:0/2387563231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1300cfe90 con 0x7fe1301578d0 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe135770700 1 --2- 172.21.15.81:0/2387563231 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe130157ca0 0x7fe13015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe136772700 1 --2- 172.21.15.81:0/2387563231 >> v2:172.21.15.83:3300/0 conn(0x7fe13006d120 0x7fe13006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe135f71700 1 --2- 172.21.15.81:0/2387563231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 0x7fe1300cf4f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe1300b3940 tx=0x7fe12c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da75eed77f5bbb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe134f6f700 1 -- 172.21.15.81:0/2387563231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00e070 con 0x7fe1301578d0 2023-10-06T02:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe134f6f700 1 -- 172.21.15.81:0/2387563231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c00ba50 con 0x7fe1301578d0 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe134f6f700 1 -- 172.21.15.81:0/2387563231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0092e0 con 0x7fe1301578d0 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe1381d5700 1 -- 172.21.15.81:0/2387563231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 msgr2=0x7fe1300cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe1381d5700 1 --2- 172.21.15.81:0/2387563231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 0x7fe1300cf4f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe1300b3940 tx=0x7fe12c009840 comp rx=0 tx=0).stop 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe1381d5700 1 -- 172.21.15.81:0/2387563231 shutdown_connections 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe1381d5700 1 --2- 172.21.15.81:0/2387563231 >> v2:172.21.15.83:3300/0 conn(0x7fe13006d120 0x7fe13006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe1381d5700 1 --2- 172.21.15.81:0/2387563231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 0x7fe1300cf4f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe1381d5700 1 --2- 172.21.15.81:0/2387563231 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe130157ca0 0x7fe13015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe1381d5700 1 -- 172.21.15.81:0/2387563231 >> 172.21.15.81:0/2387563231 conn(0x7fe13006bb90 msgr2=0x7fe13006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe1381d5700 1 -- 172.21.15.81:0/2387563231 shutdown_connections 2023-10-06T02:50:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.888+0000 7fe1381d5700 1 -- 172.21.15.81:0/2387563231 wait complete. 2023-10-06T02:50:02.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.889+0000 7fe1381d5700 1 Processor -- start 2023-10-06T02:50:02.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe1381d5700 1 -- start start 2023-10-06T02:50:02.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe1381d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe13006d120 0x7fe130149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe1381d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 0x7fe130069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe1381d5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe130157ca0 0x7fe13006a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe1381d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300b1760 con 0x7fe1301578d0 2023-10-06T02:50:02.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe1381d5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300b0b50 con 0x7fe130157ca0 2023-10-06T02:50:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe1381d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300b0e30 con 0x7fe13006d120 2023-10-06T02:50:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe135770700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 0x7fe130069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe135770700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 0x7fe130069b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39254/0 (socket says 172.21.15.81:39254) 2023-10-06T02:50:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe135770700 1 -- 172.21.15.81:0/1953262873 learned_addr learned my addr 172.21.15.81:0/1953262873 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe136772700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe130157ca0 0x7fe13006a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.890+0000 7fe135f71700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe13006d120 0x7fe130149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe135770700 1 -- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe13006d120 msgr2=0x7fe130149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe135770700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe13006d120 0x7fe130149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe135770700 1 -- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe130157ca0 msgr2=0x7fe13006a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe135770700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe130157ca0 0x7fe13006a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe135770700 1 -- 172.21.15.81:0/1953262873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c009ae0 con 0x7fe1301578d0 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe135770700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 0x7fe130069b70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe12000d860 tx=0x7fe120008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe125ffb700 1 -- 172.21.15.81:0/1953262873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200125f0 con 0x7fe1301578d0 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe125ffb700 1 -- 172.21.15.81:0/1953262873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120012750 con 0x7fe1301578d0 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe125ffb700 1 -- 172.21.15.81:0/1953262873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120012af0 con 0x7fe1301578d0 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1300b1110 con 0x7fe1301578d0 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.891+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1301551c0 con 0x7fe1301578d0 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.892+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1300b1910 con 0x7fe1301578d0 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.892+0000 7fe125ffb700 1 -- 172.21.15.81:0/1953262873 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe120014430 con 0x7fe1301578d0 2023-10-06T02:50:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.893+0000 7fe125ffb700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe114066f30 0x7fe1140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:02.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.893+0000 7fe125ffb700 1 -- 172.21.15.81:0/1953262873 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe120084900 con 0x7fe1301578d0 2023-10-06T02:50:02.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.893+0000 7fe135f71700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe114066f30 0x7fe1140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:02.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.893+0000 7fe135f71700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe114066f30 0x7fe1140693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009880 tx=0x7fe12c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:02.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:02.897+0000 7fe125ffb700 1 -- 172.21.15.81:0/1953262873 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1300b1910 con 0x7fe1301578d0 2023-10-06T02:50:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.074+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1300b1910 con 0x7fe114066f30 2023-10-06T02:50:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.082+0000 7fe125ffb700 1 -- 172.21.15.81:0/1953262873 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305456 (secure 0 0 0) 0x7fe1300b1910 con 0x7fe114066f30 2023-10-06T02:50:03.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:03.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe114066f30 msgr2=0x7fe1140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe114066f30 0x7fe1140693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009880 tx=0x7fe12c018000 comp rx=0 tx=0).stop 2023-10-06T02:50:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 msgr2=0x7fe130069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 0x7fe130069b70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe12000d860 tx=0x7fe120008040 comp rx=0 tx=0).stop 2023-10-06T02:50:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 shutdown_connections 2023-10-06T02:50:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe114066f30 0x7fe1140693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe130157ca0 0x7fe13006a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe13006d120 0x7fe130149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 --2- 172.21.15.81:0/1953262873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1301578d0 0x7fe130069b70 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 >> 172.21.15.81:0/1953262873 conn(0x7fe13006bb90 msgr2=0x7fe130069120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 shutdown_connections 2023-10-06T02:50:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.086+0000 7fe1381d5700 1 -- 172.21.15.81:0/1953262873 wait complete. 2023-10-06T02:50:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:50:03.099 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2023-10-06T02:50:01.548608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557667,"statfs":{"total":1600000000,"available":1595051404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.871348"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696401+0000","last_change":"2023-10-06T02:49:58.695750+0000","last_active":"2023-10-06T02:49:58.696401+0000","last_peered":"2023-10-06T02:49:58.696401+0000","last_clean":"2023-10-06T02:49:58.696401+0000","last_became_active":"2023-10-06T02:49:58.694876+0000","last_became_peered":"2023-10-06T02:49:58.694876+0000","last_unstale":"2023-10-06T02:49:58.696401+0000","last_undegraded":"2023-10-06T02:49:58.696401+0000","last_fullsized":"2023-10-06T02:49:58.696401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:03.647505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686373+0000","last_change":"2023-10-06T02:49:58.686311+0000","last_active":"2023-10-06T02:49:58.686373+0000","last_peered":"2023-10-06T02:49:58.686373+0000","last_clean":"2023-10-06T02:49:58.686373+0000","last_became_active":"2023-10-06T02:49:58.686087+0000","last_became_peered":"2023-10-06T02:49:58.686087+0000","last_unstale":"2023-10-06T02:49:58.686373+0000","last_undegraded":"2023-10-06T02:49:58.686373+0000","last_fullsized":"2023-10-06T02:49:58.686373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:16.338439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693931+0000","last_change":"2023-10-06T02:49:58.693707+0000","last_active":"2023-10-06T02:49:58.693931+0000","last_peered":"2023-10-06T02:49:58.693931+0000","last_clean":"2023-10-06T02:49:58.693931+0000","last_became_active":"2023-10-06T02:49:58.693057+0000","last_became_peered":"2023-10-06T02:49:58.693057+0000","last_unstale":"2023-10-06T02:49:58.693931+0000","last_undegraded":"2023-10-06T02:49:58.693931+0000","last_fullsized":"2023-10-06T02:49:58.693931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:41.033955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696343+0000","last_change":"2023-10-06T02:49:58.694541+0000","last_active":"2023-10-06T02:49:58.696343+0000","last_peered":"2023-10-06T02:49:58.696343+0000","last_clean":"2023-10-06T02:49:58.696343+0000","last_became_active":"2023-10-06T02:49:58.694028+0000","last_became_peered":"2023-10-06T02:49:58.694028+0000","last_unstale":"2023-10-06T02:49:58.696343+0000","last_undegraded":"2023-10-06T02:49:58.696343+0000","last_fullsized":"2023-10-06T02:49:58.696343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:03.143280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698338+0000","last_change":"2023-10-06T02:49:58.697417+0000","last_active":"2023-10-06T02:49:58.698338+0000","last_peered":"2023-10-06T02:49:58.698338+0000","last_clean":"2023-10-06T02:49:58.698338+0000","last_became_active":"2023-10-06T02:49:58.696936+0000","last_became_peered":"2023-10-06T02:49:58.696936+0000","last_unstale":"2023-10-06T02:49:58.698338+0000","last_undegraded":"2023-10-06T02:49:58.698338+0000","last_fullsized":"2023-10-06T02:49:58.698338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:49.892904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691318+0000","last_change":"2023-10-06T02:49:58.691258+0000","last_active":"2023-10-06T02:49:58.691318+0000","last_peered":"2023-10-06T02:49:58.691318+0000","last_clean":"2023-10-06T02:49:58.691318+0000","last_became_active":"2023-10-06T02:49:58.691026+0000","last_became_peered":"2023-10-06T02:49:58.691026+0000","last_unstale":"2023-10-06T02:49:58.691318+0000","last_undegraded":"2023-10-06T02:49:58.691318+0000","last_fullsized":"2023-10-06T02:49:58.691318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:12.617623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.697263+0000","last_change":"2023-10-06T02:49:58.697216+0000","last_active":"2023-10-06T02:49:58.697263+0000","last_peered":"2023-10-06T02:49:58.697263+0000","last_clean":"2023-10-06T02:49:58.697263+0000","last_became_active":"2023-10-06T02:49:58.696853+0000","last_became_peered":"2023-10-06T02:49:58.696853+0000","last_unstale":"2023-10-06T02:49:58.697263+0000","last_undegraded":"2023-10-06T02:49:58.697263+0000","last_fullsized":"2023-10-06T02:49:58.697263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:01.633495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698644+0000","last_change":"2023-10-06T02:49:58.698182+0000","last_active":"2023-10-06T02:49:58.698644+0000","last_peered":"2023-10-06T02:49:58.698644+0000","last_clean":"2023-10-06T02:49:58.698644+0000","last_became_active":"2023-10-06T02:49:58.697323+0000","last_became_peered":"2023-10-06T02:49:58.697323+0000","last_unstale":"2023-10-06T02:49:58.698644+0000","last_undegraded":"2023-10-06T02:49:58.698644+0000","last_fullsized":"2023-10-06T02:49:58.698644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:31.839770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691928+0000","last_change":"2023-10-06T02:49:58.691775+0000","last_active":"2023-10-06T02:49:58.691928+0000","last_peered":"2023-10-06T02:49:58.691928+0000","last_clean":"2023-10-06T02:49:58.691928+0000","last_became_active":"2023-10-06T02:49:58.691416+0000","last_became_peered":"2023-10-06T02:49:58.691416+0000","last_unstale":"2023-10-06T02:49:58.691928+0000","last_undegraded":"2023-10-06T02:49:58.691928+0000","last_fullsized":"2023-10-06T02:49:58.691928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:15.647974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.692836+0000","last_change":"2023-10-06T02:49:58.692740+0000","last_active":"2023-10-06T02:49:58.692836+0000","last_peered":"2023-10-06T02:49:58.692836+0000","last_clean":"2023-10-06T02:49:58.692836+0000","last_became_active":"2023-10-06T02:49:58.692550+0000","last_became_peered":"2023-10-06T02:49:58.692550+0000","last_unstale":"2023-10-06T02:49:58.692836+0000","last_undegraded":"2023-10-06T02:49:58.692836+0000","last_fullsized":"2023-10-06T02:49:58.692836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:41.033955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687448+0000","last_change":"2023-10-06T02:49:58.687392+0000","last_active":"2023-10-06T02:49:58.687448+0000","last_peered":"2023-10-06T02:49:58.687448+0000","last_clean":"2023-10-06T02:49:58.687448+0000","last_became_active":"2023-10-06T02:49:58.686944+0000","last_became_peered":"2023-10-06T02:49:58.686944+0000","last_unstale":"2023-10-06T02:49:58.687448+0000","last_undegraded":"2023-10-06T02:49:58.687448+0000","last_fullsized":"2023-10-06T02:49:58.687448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:00.240551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687717+0000","last_change":"2023-10-06T02:49:58.687547+0000","last_active":"2023-10-06T02:49:58.687717+0000","last_peered":"2023-10-06T02:49:58.687717+0000","last_clean":"2023-10-06T02:49:58.687717+0000","last_became_active":"2023-10-06T02:49:58.687336+0000","last_became_peered":"2023-10-06T02:49:58.687336+0000","last_unstale":"2023-10-06T02:49:58.687717+0000","last_undegraded":"2023-10-06T02:49:58.687717+0000","last_fullsized":"2023-10-06T02:49:58.687717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:48.815667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698629+0000","last_change":"2023-10-06T02:49:58.698046+0000","last_active":"2023-10-06T02:49:58.698629+0000","last_peered":"2023-10-06T02:49:58.698629+0000","last_clean":"2023-10-06T02:49:58.698629+0000","last_became_active":"2023-10-06T02:49:58.697033+0000","last_became_peered":"2023-10-06T02:49:58.697033+0000","last_unstale":"2023-10-06T02:49:58.698629+0000","last_undegraded":"2023-10-06T02:49:58.698629+0000","last_fullsized":"2023-10-06T02:49:58.698629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:14.332752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693723+0000","last_change":"2023-10-06T02:49:58.693586+0000","last_active":"2023-10-06T02:49:58.693723+0000","last_peered":"2023-10-06T02:49:58.693723+0000","last_clean":"2023-10-06T02:49:58.693723+0000","last_became_active":"2023-10-06T02:49:58.692879+0000","last_became_peered":"2023-10-06T02:49:58.692879+0000","last_unstale":"2023-10-06T02:49:58.693723+0000","last_undegraded":"2023-10-06T02:49:58.693723+0000","last_fullsized":"2023-10-06T02:49:58.693723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:49.767874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.692888+0000","last_change":"2023-10-06T02:49:58.692815+0000","last_active":"2023-10-06T02:49:58.692888+0000","last_peered":"2023-10-06T02:49:58.692888+0000","last_clean":"2023-10-06T02:49:58.692888+0000","last_became_active":"2023-10-06T02:49:58.692341+0000","last_became_peered":"2023-10-06T02:49:58.692341+0000","last_unstale":"2023-10-06T02:49:58.692888+0000","last_undegraded":"2023-10-06T02:49:58.692888+0000","last_fullsized":"2023-10-06T02:49:58.692888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:22.895260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696425+0000","last_change":"2023-10-06T02:49:58.695953+0000","last_active":"2023-10-06T02:49:58.696425+0000","last_peered":"2023-10-06T02:49:58.696425+0000","last_clean":"2023-10-06T02:49:58.696425+0000","last_became_active":"2023-10-06T02:49:58.695181+0000","last_became_peered":"2023-10-06T02:49:58.695181+0000","last_unstale":"2023-10-06T02:49:58.696425+0000","last_undegraded":"2023-10-06T02:49:58.696425+0000","last_fullsized":"2023-10-06T02:49:58.696425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:38.542270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696417+0000","last_change":"2023-10-06T02:49:58.696232+0000","last_active":"2023-10-06T02:49:58.696417+0000","last_peered":"2023-10-06T02:49:58.696417+0000","last_clean":"2023-10-06T02:49:58.696417+0000","last_became_active":"2023-10-06T02:49:58.695876+0000","last_became_peered":"2023-10-06T02:49:58.695876+0000","last_unstale":"2023-10-06T02:49:58.696417+0000","last_undegraded":"2023-10-06T02:49:58.696417+0000","last_fullsized":"2023-10-06T02:49:58.696417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:24.104628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693915+0000","last_change":"2023-10-06T02:49:58.693571+0000","last_active":"2023-10-06T02:49:58.693915+0000","last_peered":"2023-10-06T02:49:58.693915+0000","last_clean":"2023-10-06T02:49:58.693915+0000","last_became_active":"2023-10-06T02:49:58.692824+0000","last_became_peered":"2023-10-06T02:49:58.692824+0000","last_unstale":"2023-10-06T02:49:58.693915+0000","last_undegraded":"2023-10-06T02:49:58.693915+0000","last_fullsized":"2023-10-06T02:49:58.693915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:48.815667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699420+0000","last_change":"2023-10-06T02:49:58.699357+0000","last_active":"2023-10-06T02:49:58.699420+0000","last_peered":"2023-10-06T02:49:58.699420+0000","last_clean":"2023-10-06T02:49:58.699420+0000","last_became_active":"2023-10-06T02:49:58.699133+0000","last_became_peered":"2023-10-06T02:49:58.699133+0000","last_unstale":"2023-10-06T02:49:58.699420+0000","last_undegraded":"2023-10-06T02:49:58.699420+0000","last_fullsized":"2023-10-06T02:49:58.699420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:42.247967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.694571+0000","last_change":"2023-10-06T02:49:58.694506+0000","last_active":"2023-10-06T02:49:58.694571+0000","last_peered":"2023-10-06T02:49:58.694571+0000","last_clean":"2023-10-06T02:49:58.694571+0000","last_became_active":"2023-10-06T02:49:58.694269+0000","last_became_peered":"2023-10-06T02:49:58.694269+0000","last_unstale":"2023-10-06T02:49:58.694571+0000","last_undegraded":"2023-10-06T02:49:58.694571+0000","last_fullsized":"2023-10-06T02:49:58.694571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:49.506613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693662+0000","last_change":"2023-10-06T02:49:58.693603+0000","last_active":"2023-10-06T02:49:58.693662+0000","last_peered":"2023-10-06T02:49:58.693662+0000","last_clean":"2023-10-06T02:49:58.693662+0000","last_became_active":"2023-10-06T02:49:58.692528+0000","last_became_peered":"2023-10-06T02:49:58.692528+0000","last_unstale":"2023-10-06T02:49:58.693662+0000","last_undegraded":"2023-10-06T02:49:58.693662+0000","last_fullsized":"2023-10-06T02:49:58.693662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:25.630505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696154+0000","last_change":"2023-10-06T02:49:58.696094+0000","last_active":"2023-10-06T02:49:58.696154+0000","last_peered":"2023-10-06T02:49:58.696154+0000","last_clean":"2023-10-06T02:49:58.696154+0000","last_became_active":"2023-10-06T02:49:58.695244+0000","last_became_peered":"2023-10-06T02:49:58.695244+0000","last_unstale":"2023-10-06T02:49:58.696154+0000","last_undegraded":"2023-10-06T02:49:58.696154+0000","last_fullsized":"2023-10-06T02:49:58.696154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:31.788936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693470+0000","last_change":"2023-10-06T02:49:58.693353+0000","last_active":"2023-10-06T02:49:58.693470+0000","last_peered":"2023-10-06T02:49:58.693470+0000","last_clean":"2023-10-06T02:49:58.693470+0000","last_became_active":"2023-10-06T02:49:58.692974+0000","last_became_peered":"2023-10-06T02:49:58.692974+0000","last_unstale":"2023-10-06T02:49:58.693470+0000","last_undegraded":"2023-10-06T02:49:58.693470+0000","last_fullsized":"2023-10-06T02:49:58.693470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:03.170434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691066+0000","last_change":"2023-10-06T02:49:58.690877+0000","last_active":"2023-10-06T02:49:58.691066+0000","last_peered":"2023-10-06T02:49:58.691066+0000","last_clean":"2023-10-06T02:49:58.691066+0000","last_became_active":"2023-10-06T02:49:58.690386+0000","last_became_peered":"2023-10-06T02:49:58.690386+0000","last_unstale":"2023-10-06T02:49:58.691066+0000","last_undegraded":"2023-10-06T02:49:58.691066+0000","last_fullsized":"2023-10-06T02:49:58.691066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:56.674803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.690678+0000","last_change":"2023-10-06T02:49:58.690607+0000","last_active":"2023-10-06T02:49:58.690678+0000","last_peered":"2023-10-06T02:49:58.690678+0000","last_clean":"2023-10-06T02:49:58.690678+0000","last_became_active":"2023-10-06T02:49:58.690321+0000","last_became_peered":"2023-10-06T02:49:58.690321+0000","last_unstale":"2023-10-06T02:49:58.690678+0000","last_undegraded":"2023-10-06T02:49:58.690678+0000","last_fullsized":"2023-10-06T02:49:58.690678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:01.044432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691442+0000","last_change":"2023-10-06T02:49:58.690154+0000","last_active":"2023-10-06T02:49:58.691442+0000","last_peered":"2023-10-06T02:49:58.691442+0000","last_clean":"2023-10-06T02:49:58.691442+0000","last_became_active":"2023-10-06T02:49:58.689929+0000","last_became_peered":"2023-10-06T02:49:58.689929+0000","last_unstale":"2023-10-06T02:49:58.691442+0000","last_undegraded":"2023-10-06T02:49:58.691442+0000","last_fullsized":"2023-10-06T02:49:58.691442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:41.207115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.688916+0000","last_change":"2023-10-06T02:49:58.688482+0000","last_active":"2023-10-06T02:49:58.688916+0000","last_peered":"2023-10-06T02:49:58.688916+0000","last_clean":"2023-10-06T02:49:58.688916+0000","last_became_active":"2023-10-06T02:49:58.687460+0000","last_became_peered":"2023-10-06T02:49:58.687460+0000","last_unstale":"2023-10-06T02:49:58.688916+0000","last_undegraded":"2023-10-06T02:49:58.688916+0000","last_fullsized":"2023-10-06T02:49:58.688916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:12.617623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698611+0000","last_change":"2023-10-06T02:49:58.697919+0000","last_active":"2023-10-06T02:49:58.698611+0000","last_peered":"2023-10-06T02:49:58.698611+0000","last_clean":"2023-10-06T02:49:58.698611+0000","last_became_active":"2023-10-06T02:49:58.696710+0000","last_became_peered":"2023-10-06T02:49:58.696710+0000","last_unstale":"2023-10-06T02:49:58.698611+0000","last_undegraded":"2023-10-06T02:49:58.698611+0000","last_fullsized":"2023-10-06T02:49:58.698611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:05.075958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691075+0000","last_change":"2023-10-06T02:49:58.691008+0000","last_active":"2023-10-06T02:49:58.691075+0000","last_peered":"2023-10-06T02:49:58.691075+0000","last_clean":"2023-10-06T02:49:58.691075+0000","last_became_active":"2023-10-06T02:49:58.690668+0000","last_became_peered":"2023-10-06T02:49:58.690668+0000","last_unstale":"2023-10-06T02:49:58.691075+0000","last_undegraded":"2023-10-06T02:49:58.691075+0000","last_fullsized":"2023-10-06T02:49:58.691075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:10.980054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686452+0000","last_change":"2023-10-06T02:49:58.686191+0000","last_active":"2023-10-06T02:49:58.686452+0000","last_peered":"2023-10-06T02:49:58.686452+0000","last_clean":"2023-10-06T02:49:58.686452+0000","last_became_active":"2023-10-06T02:49:58.685971+0000","last_became_peered":"2023-10-06T02:49:58.685971+0000","last_unstale":"2023-10-06T02:49:58.686452+0000","last_undegraded":"2023-10-06T02:49:58.686452+0000","last_fullsized":"2023-10-06T02:49:58.686452+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:49.767874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.695385+0000","last_change":"2023-10-06T02:49:58.694903+0000","last_active":"2023-10-06T02:49:58.695385+0000","last_peered":"2023-10-06T02:49:58.695385+0000","last_clean":"2023-10-06T02:49:58.695385+0000","last_became_active":"2023-10-06T02:49:58.694531+0000","last_became_peered":"2023-10-06T02:49:58.694531+0000","last_unstale":"2023-10-06T02:49:58.695385+0000","last_undegraded":"2023-10-06T02:49:58.695385+0000","last_fullsized":"2023-10-06T02:49:58.695385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:53.197453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.690022+0000","last_change":"2023-10-06T02:49:58.689964+0000","last_active":"2023-10-06T02:49:58.690022+0000","last_peered":"2023-10-06T02:49:58.690022+0000","last_clean":"2023-10-06T02:49:58.690022+0000","last_became_active":"2023-10-06T02:49:58.688790+0000","last_became_peered":"2023-10-06T02:49:58.688790+0000","last_unstale":"2023-10-06T02:49:58.690022+0000","last_undegraded":"2023-10-06T02:49:58.690022+0000","last_fullsized":"2023-10-06T02:49:58.690022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:27.673007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691838+0000","last_change":"2023-10-06T02:49:58.691600+0000","last_active":"2023-10-06T02:49:58.691838+0000","last_peered":"2023-10-06T02:49:58.691838+0000","last_clean":"2023-10-06T02:49:58.691838+0000","last_became_active":"2023-10-06T02:49:58.691061+0000","last_became_peered":"2023-10-06T02:49:58.691061+0000","last_unstale":"2023-10-06T02:49:58.691838+0000","last_undegraded":"2023-10-06T02:49:58.691838+0000","last_fullsized":"2023-10-06T02:49:58.691838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:03.143280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"83'4","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.703622+0000","last_change":"2023-10-06T02:49:57.693474+0000","last_active":"2023-10-06T02:49:58.703622+0000","last_peered":"2023-10-06T02:49:58.703622+0000","last_clean":"2023-10-06T02:49:58.703622+0000","last_became_active":"2023-10-06T02:49:57.693069+0000","last_became_peered":"2023-10-06T02:49:57.693069+0000","last_unstale":"2023-10-06T02:49:58.703622+0000","last_undegraded":"2023-10-06T02:49:58.703622+0000","last_fullsized":"2023-10-06T02:49:58.703622+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:55.729532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686965+0000","last_change":"2023-10-06T02:49:58.686900+0000","last_active":"2023-10-06T02:49:58.686965+0000","last_peered":"2023-10-06T02:49:58.686965+0000","last_clean":"2023-10-06T02:49:58.686965+0000","last_became_active":"2023-10-06T02:49:58.686671+0000","last_became_peered":"2023-10-06T02:49:58.686671+0000","last_unstale":"2023-10-06T02:49:58.686965+0000","last_undegraded":"2023-10-06T02:49:58.686965+0000","last_fullsized":"2023-10-06T02:49:58.686965+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:42.247967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699162+0000","last_change":"2023-10-06T02:49:57.692719+0000","last_active":"2023-10-06T02:49:58.699162+0000","last_peered":"2023-10-06T02:49:58.699162+0000","last_clean":"2023-10-06T02:49:58.699162+0000","last_became_active":"2023-10-06T02:49:57.692490+0000","last_became_peered":"2023-10-06T02:49:57.692490+0000","last_unstale":"2023-10-06T02:49:58.699162+0000","last_undegraded":"2023-10-06T02:49:58.699162+0000","last_fullsized":"2023-10-06T02:49:58.699162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:02.136224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691893+0000","last_change":"2023-10-06T02:49:58.691360+0000","last_active":"2023-10-06T02:49:58.691893+0000","last_peered":"2023-10-06T02:49:58.691893+0000","last_clean":"2023-10-06T02:49:58.691893+0000","last_became_active":"2023-10-06T02:49:58.691127+0000","last_became_peered":"2023-10-06T02:49:58.691127+0000","last_unstale":"2023-10-06T02:49:58.691893+0000","last_undegraded":"2023-10-06T02:49:58.691893+0000","last_fullsized":"2023-10-06T02:49:58.691893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:01.633495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.700399+0000","last_change":"2023-10-06T02:49:57.694721+0000","last_active":"2023-10-06T02:49:58.700399+0000","last_peered":"2023-10-06T02:49:58.700399+0000","last_clean":"2023-10-06T02:49:58.700399+0000","last_became_active":"2023-10-06T02:49:57.694507+0000","last_became_peered":"2023-10-06T02:49:57.694507+0000","last_unstale":"2023-10-06T02:49:58.700399+0000","last_undegraded":"2023-10-06T02:49:58.700399+0000","last_fullsized":"2023-10-06T02:49:58.700399+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:19.782192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693213+0000","last_change":"2023-10-06T02:49:58.693113+0000","last_active":"2023-10-06T02:49:58.693213+0000","last_peered":"2023-10-06T02:49:58.693213+0000","last_clean":"2023-10-06T02:49:58.693213+0000","last_became_active":"2023-10-06T02:49:58.692740+0000","last_became_peered":"2023-10-06T02:49:58.692740+0000","last_unstale":"2023-10-06T02:49:58.693213+0000","last_undegraded":"2023-10-06T02:49:58.693213+0000","last_fullsized":"2023-10-06T02:49:58.693213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:47.438011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.701878+0000","last_change":"2023-10-06T02:49:57.692706+0000","last_active":"2023-10-06T02:49:58.701878+0000","last_peered":"2023-10-06T02:49:58.701878+0000","last_clean":"2023-10-06T02:49:58.701878+0000","last_became_active":"2023-10-06T02:49:57.692361+0000","last_became_peered":"2023-10-06T02:49:57.692361+0000","last_unstale":"2023-10-06T02:49:58.701878+0000","last_undegraded":"2023-10-06T02:49:58.701878+0000","last_fullsized":"2023-10-06T02:49:58.701878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:02.962978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687519+0000","last_change":"2023-10-06T02:49:58.687486+0000","last_active":"2023-10-06T02:49:58.687519+0000","last_peered":"2023-10-06T02:49:58.687519+0000","last_clean":"2023-10-06T02:49:58.687519+0000","last_became_active":"2023-10-06T02:49:58.687233+0000","last_became_peered":"2023-10-06T02:49:58.687233+0000","last_unstale":"2023-10-06T02:49:58.687519+0000","last_undegraded":"2023-10-06T02:49:58.687519+0000","last_fullsized":"2023-10-06T02:49:58.687519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:32.805940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.697324+0000","last_change":"2023-10-06T02:49:57.690974+0000","last_active":"2023-10-06T02:49:58.697324+0000","last_peered":"2023-10-06T02:49:58.697324+0000","last_clean":"2023-10-06T02:49:58.697324+0000","last_became_active":"2023-10-06T02:49:57.690754+0000","last_became_peered":"2023-10-06T02:49:57.690754+0000","last_unstale":"2023-10-06T02:49:58.697324+0000","last_undegraded":"2023-10-06T02:49:58.697324+0000","last_fullsized":"2023-10-06T02:49:58.697324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:22.205606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.695031+0000","last_change":"2023-10-06T02:49:58.694671+0000","last_active":"2023-10-06T02:49:58.695031+0000","last_peered":"2023-10-06T02:49:58.695031+0000","last_clean":"2023-10-06T02:49:58.695031+0000","last_became_active":"2023-10-06T02:49:58.694465+0000","last_became_peered":"2023-10-06T02:49:58.694465+0000","last_unstale":"2023-10-06T02:49:58.695031+0000","last_undegraded":"2023-10-06T02:49:58.695031+0000","last_fullsized":"2023-10-06T02:49:58.695031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:14.036312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696694+0000","last_change":"2023-10-06T02:49:57.693324+0000","last_active":"2023-10-06T02:49:58.696694+0000","last_peered":"2023-10-06T02:49:58.696694+0000","last_clean":"2023-10-06T02:49:58.696694+0000","last_became_active":"2023-10-06T02:49:57.693055+0000","last_became_peered":"2023-10-06T02:49:57.693055+0000","last_unstale":"2023-10-06T02:49:58.696694+0000","last_undegraded":"2023-10-06T02:49:58.696694+0000","last_fullsized":"2023-10-06T02:49:58.696694+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:00.626438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691910+0000","last_change":"2023-10-06T02:49:58.691629+0000","last_active":"2023-10-06T02:49:58.691910+0000","last_peered":"2023-10-06T02:49:58.691910+0000","last_clean":"2023-10-06T02:49:58.691910+0000","last_became_active":"2023-10-06T02:49:58.690939+0000","last_became_peered":"2023-10-06T02:49:58.690939+0000","last_unstale":"2023-10-06T02:49:58.691910+0000","last_undegraded":"2023-10-06T02:49:58.691910+0000","last_fullsized":"2023-10-06T02:49:58.691910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:12.428178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.682780+0000","last_change":"2023-10-06T02:49:57.692825+0000","last_active":"2023-10-06T02:49:58.682780+0000","last_peered":"2023-10-06T02:49:58.682780+0000","last_clean":"2023-10-06T02:49:58.682780+0000","last_became_active":"2023-10-06T02:49:57.692396+0000","last_became_peered":"2023-10-06T02:49:57.692396+0000","last_unstale":"2023-10-06T02:49:58.682780+0000","last_undegraded":"2023-10-06T02:49:58.682780+0000","last_fullsized":"2023-10-06T02:49:58.682780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:32.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.700885+0000","last_change":"2023-10-06T02:49:58.700657+0000","last_active":"2023-10-06T02:49:58.700885+0000","last_peered":"2023-10-06T02:49:58.700885+0000","last_clean":"2023-10-06T02:49:58.700885+0000","last_became_active":"2023-10-06T02:49:58.700476+0000","last_became_peered":"2023-10-06T02:49:58.700476+0000","last_unstale":"2023-10-06T02:49:58.700885+0000","last_undegraded":"2023-10-06T02:49:58.700885+0000","last_fullsized":"2023-10-06T02:49:58.700885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:47.438011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.692249+0000","last_change":"2023-10-06T02:49:57.692516+0000","last_active":"2023-10-06T02:49:58.692249+0000","last_peered":"2023-10-06T02:49:58.692249+0000","last_clean":"2023-10-06T02:49:58.692249+0000","last_became_active":"2023-10-06T02:49:57.692076+0000","last_became_peered":"2023-10-06T02:49:57.692076+0000","last_unstale":"2023-10-06T02:49:58.692249+0000","last_undegraded":"2023-10-06T02:49:58.692249+0000","last_fullsized":"2023-10-06T02:49:58.692249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:12.516287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686303+0000","last_change":"2023-10-06T02:49:58.686238+0000","last_active":"2023-10-06T02:49:58.686303+0000","last_peered":"2023-10-06T02:49:58.686303+0000","last_clean":"2023-10-06T02:49:58.686303+0000","last_became_active":"2023-10-06T02:49:58.686012+0000","last_became_peered":"2023-10-06T02:49:58.686012+0000","last_unstale":"2023-10-06T02:49:58.686303+0000","last_undegraded":"2023-10-06T02:49:58.686303+0000","last_fullsized":"2023-10-06T02:49:58.686303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:10.461749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686068+0000","last_change":"2023-10-06T02:49:57.692785+0000","last_active":"2023-10-06T02:49:58.686068+0000","last_peered":"2023-10-06T02:49:58.686068+0000","last_clean":"2023-10-06T02:49:58.686068+0000","last_became_active":"2023-10-06T02:49:57.692466+0000","last_became_peered":"2023-10-06T02:49:57.692466+0000","last_unstale":"2023-10-06T02:49:58.686068+0000","last_undegraded":"2023-10-06T02:49:58.686068+0000","last_fullsized":"2023-10-06T02:49:58.686068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:16.809204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691403+0000","last_change":"2023-10-06T02:49:58.688988+0000","last_active":"2023-10-06T02:49:58.691403+0000","last_peered":"2023-10-06T02:49:58.691403+0000","last_clean":"2023-10-06T02:49:58.691403+0000","last_became_active":"2023-10-06T02:49:58.688775+0000","last_became_peered":"2023-10-06T02:49:58.688775+0000","last_unstale":"2023-10-06T02:49:58.691403+0000","last_undegraded":"2023-10-06T02:49:58.691403+0000","last_fullsized":"2023-10-06T02:49:58.691403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:33.039092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685187+0000","last_change":"2023-10-06T02:49:57.691447+0000","last_active":"2023-10-06T02:49:58.685187+0000","last_peered":"2023-10-06T02:49:58.685187+0000","last_clean":"2023-10-06T02:49:58.685187+0000","last_became_active":"2023-10-06T02:49:57.691226+0000","last_became_peered":"2023-10-06T02:49:57.691226+0000","last_unstale":"2023-10-06T02:49:58.685187+0000","last_undegraded":"2023-10-06T02:49:58.685187+0000","last_fullsized":"2023-10-06T02:49:58.685187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:14.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.689527+0000","last_change":"2023-10-06T02:49:58.689409+0000","last_active":"2023-10-06T02:49:58.689527+0000","last_peered":"2023-10-06T02:49:58.689527+0000","last_clean":"2023-10-06T02:49:58.689527+0000","last_became_active":"2023-10-06T02:49:58.688811+0000","last_became_peered":"2023-10-06T02:49:58.688811+0000","last_unstale":"2023-10-06T02:49:58.689527+0000","last_undegraded":"2023-10-06T02:49:58.689527+0000","last_fullsized":"2023-10-06T02:49:58.689527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:38.542270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.703579+0000","last_change":"2023-10-06T02:49:57.685933+0000","last_active":"2023-10-06T02:49:58.703579+0000","last_peered":"2023-10-06T02:49:58.703579+0000","last_clean":"2023-10-06T02:49:58.703579+0000","last_became_active":"2023-10-06T02:49:57.685697+0000","last_became_peered":"2023-10-06T02:49:57.685697+0000","last_unstale":"2023-10-06T02:49:58.703579+0000","last_undegraded":"2023-10-06T02:49:58.703579+0000","last_fullsized":"2023-10-06T02:49:58.703579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:00.862990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691856+0000","last_change":"2023-10-06T02:49:58.691722+0000","last_active":"2023-10-06T02:49:58.691856+0000","last_peered":"2023-10-06T02:49:58.691856+0000","last_clean":"2023-10-06T02:49:58.691856+0000","last_became_active":"2023-10-06T02:49:58.691409+0000","last_became_peered":"2023-10-06T02:49:58.691409+0000","last_unstale":"2023-10-06T02:49:58.691856+0000","last_undegraded":"2023-10-06T02:49:58.691856+0000","last_fullsized":"2023-10-06T02:49:58.691856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:41.207115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"83'6","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.700840+0000","last_change":"2023-10-06T02:49:57.686073+0000","last_active":"2023-10-06T02:49:58.700840+0000","last_peered":"2023-10-06T02:49:58.700840+0000","last_clean":"2023-10-06T02:49:58.700840+0000","last_became_active":"2023-10-06T02:49:57.685435+0000","last_became_peered":"2023-10-06T02:49:57.685435+0000","last_unstale":"2023-10-06T02:49:58.700840+0000","last_undegraded":"2023-10-06T02:49:58.700840+0000","last_fullsized":"2023-10-06T02:49:58.700840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:13.325696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696361+0000","last_change":"2023-10-06T02:49:58.694743+0000","last_active":"2023-10-06T02:49:58.696361+0000","last_peered":"2023-10-06T02:49:58.696361+0000","last_clean":"2023-10-06T02:49:58.696361+0000","last_became_active":"2023-10-06T02:49:58.694329+0000","last_became_peered":"2023-10-06T02:49:58.694329+0000","last_unstale":"2023-10-06T02:49:58.696361+0000","last_undegraded":"2023-10-06T02:49:58.696361+0000","last_fullsized":"2023-10-06T02:49:58.696361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:37.308414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.695038+0000","last_change":"2023-10-06T02:49:57.689450+0000","last_active":"2023-10-06T02:49:58.695038+0000","last_peered":"2023-10-06T02:49:58.695038+0000","last_clean":"2023-10-06T02:49:58.695038+0000","last_became_active":"2023-10-06T02:49:57.689211+0000","last_became_peered":"2023-10-06T02:49:57.689211+0000","last_unstale":"2023-10-06T02:49:58.695038+0000","last_undegraded":"2023-10-06T02:49:58.695038+0000","last_fullsized":"2023-10-06T02:49:58.695038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:11.421121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.694314+0000","last_change":"2023-10-06T02:49:58.694238+0000","last_active":"2023-10-06T02:49:58.694314+0000","last_peered":"2023-10-06T02:49:58.694314+0000","last_clean":"2023-10-06T02:49:58.694314+0000","last_became_active":"2023-10-06T02:49:58.694024+0000","last_became_peered":"2023-10-06T02:49:58.694024+0000","last_unstale":"2023-10-06T02:49:58.694314+0000","last_undegraded":"2023-10-06T02:49:58.694314+0000","last_fullsized":"2023-10-06T02:49:58.694314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:53.197453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686233+0000","last_change":"2023-10-06T02:49:57.694822+0000","last_active":"2023-10-06T02:49:58.686233+0000","last_peered":"2023-10-06T02:49:58.686233+0000","last_clean":"2023-10-06T02:49:58.686233+0000","last_became_active":"2023-10-06T02:49:57.694588+0000","last_became_peered":"2023-10-06T02:49:57.694588+0000","last_unstale":"2023-10-06T02:49:58.686233+0000","last_undegraded":"2023-10-06T02:49:58.686233+0000","last_fullsized":"2023-10-06T02:49:58.686233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.430954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691532+0000","last_change":"2023-10-06T02:49:58.690541+0000","last_active":"2023-10-06T02:49:58.691532+0000","last_peered":"2023-10-06T02:49:58.691532+0000","last_clean":"2023-10-06T02:49:58.691532+0000","last_became_active":"2023-10-06T02:49:58.690324+0000","last_became_peered":"2023-10-06T02:49:58.690324+0000","last_unstale":"2023-10-06T02:49:58.691532+0000","last_undegraded":"2023-10-06T02:49:58.691532+0000","last_fullsized":"2023-10-06T02:49:58.691532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:26.406703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.684925+0000","last_change":"2023-10-06T02:49:57.690351+0000","last_active":"2023-10-06T02:49:58.684925+0000","last_peered":"2023-10-06T02:49:58.684925+0000","last_clean":"2023-10-06T02:49:58.684925+0000","last_became_active":"2023-10-06T02:49:57.689849+0000","last_became_peered":"2023-10-06T02:49:57.689849+0000","last_unstale":"2023-10-06T02:49:58.684925+0000","last_undegraded":"2023-10-06T02:49:58.684925+0000","last_fullsized":"2023-10-06T02:49:58.684925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.873213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693694+0000","last_change":"2023-10-06T02:49:58.692520+0000","last_active":"2023-10-06T02:49:58.693694+0000","last_peered":"2023-10-06T02:49:58.693694+0000","last_clean":"2023-10-06T02:49:58.693694+0000","last_became_active":"2023-10-06T02:49:58.692291+0000","last_became_peered":"2023-10-06T02:49:58.692291+0000","last_unstale":"2023-10-06T02:49:58.693694+0000","last_undegraded":"2023-10-06T02:49:58.693694+0000","last_fullsized":"2023-10-06T02:49:58.693694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:20.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"83'8","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.702846+0000","last_change":"2023-10-06T02:49:57.690347+0000","last_active":"2023-10-06T02:49:58.702846+0000","last_peered":"2023-10-06T02:49:58.702846+0000","last_clean":"2023-10-06T02:49:58.702846+0000","last_became_active":"2023-10-06T02:49:57.686473+0000","last_became_peered":"2023-10-06T02:49:57.686473+0000","last_unstale":"2023-10-06T02:49:58.702846+0000","last_undegraded":"2023-10-06T02:49:58.702846+0000","last_fullsized":"2023-10-06T02:49:58.702846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:40.026899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691876+0000","last_change":"2023-10-06T02:49:58.691197+0000","last_active":"2023-10-06T02:49:58.691876+0000","last_peered":"2023-10-06T02:49:58.691876+0000","last_clean":"2023-10-06T02:49:58.691876+0000","last_became_active":"2023-10-06T02:49:58.690599+0000","last_became_peered":"2023-10-06T02:49:58.690599+0000","last_unstale":"2023-10-06T02:49:58.691876+0000","last_undegraded":"2023-10-06T02:49:58.691876+0000","last_fullsized":"2023-10-06T02:49:58.691876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:26.406703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699691+0000","last_change":"2023-10-06T02:49:57.687675+0000","last_active":"2023-10-06T02:49:58.699691+0000","last_peered":"2023-10-06T02:49:58.699691+0000","last_clean":"2023-10-06T02:49:58.699691+0000","last_became_active":"2023-10-06T02:49:57.687235+0000","last_became_peered":"2023-10-06T02:49:57.687235+0000","last_unstale":"2023-10-06T02:49:58.699691+0000","last_undegraded":"2023-10-06T02:49:58.699691+0000","last_fullsized":"2023-10-06T02:49:58.699691+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:24.623448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698941+0000","last_change":"2023-10-06T02:49:58.698415+0000","last_active":"2023-10-06T02:49:58.698941+0000","last_peered":"2023-10-06T02:49:58.698941+0000","last_clean":"2023-10-06T02:49:58.698941+0000","last_became_active":"2023-10-06T02:49:58.698194+0000","last_became_peered":"2023-10-06T02:49:58.698194+0000","last_unstale":"2023-10-06T02:49:58.698941+0000","last_undegraded":"2023-10-06T02:49:58.698941+0000","last_fullsized":"2023-10-06T02:49:58.698941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:27.311753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.682362+0000","last_change":"2023-10-06T02:49:57.690854+0000","last_active":"2023-10-06T02:49:58.682362+0000","last_peered":"2023-10-06T02:49:58.682362+0000","last_clean":"2023-10-06T02:49:58.682362+0000","last_became_active":"2023-10-06T02:49:57.690511+0000","last_became_peered":"2023-10-06T02:49:57.690511+0000","last_unstale":"2023-10-06T02:49:58.682362+0000","last_undegraded":"2023-10-06T02:49:58.682362+0000","last_fullsized":"2023-10-06T02:49:58.682362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:02.136224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693196+0000","last_change":"2023-10-06T02:49:58.692972+0000","last_active":"2023-10-06T02:49:58.693196+0000","last_peered":"2023-10-06T02:49:58.693196+0000","last_clean":"2023-10-06T02:49:58.693196+0000","last_became_active":"2023-10-06T02:49:58.692343+0000","last_became_peered":"2023-10-06T02:49:58.692343+0000","last_unstale":"2023-10-06T02:49:58.693196+0000","last_undegraded":"2023-10-06T02:49:58.693196+0000","last_fullsized":"2023-10-06T02:49:58.693196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:53.197453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683233+0000","last_change":"2023-10-06T02:49:57.693589+0000","last_active":"2023-10-06T02:49:58.683233+0000","last_peered":"2023-10-06T02:49:58.683233+0000","last_clean":"2023-10-06T02:49:58.683233+0000","last_became_active":"2023-10-06T02:49:57.693409+0000","last_became_peered":"2023-10-06T02:49:57.693409+0000","last_unstale":"2023-10-06T02:49:58.683233+0000","last_undegraded":"2023-10-06T02:49:58.683233+0000","last_fullsized":"2023-10-06T02:49:58.683233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:47.808611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.695192+0000","last_change":"2023-10-06T02:49:58.695124+0000","last_active":"2023-10-06T02:49:58.695192+0000","last_peered":"2023-10-06T02:49:58.695192+0000","last_clean":"2023-10-06T02:49:58.695192+0000","last_became_active":"2023-10-06T02:49:58.694914+0000","last_became_peered":"2023-10-06T02:49:58.694914+0000","last_unstale":"2023-10-06T02:49:58.695192+0000","last_undegraded":"2023-10-06T02:49:58.695192+0000","last_fullsized":"2023-10-06T02:49:58.695192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:59.780628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683608+0000","last_change":"2023-10-06T02:49:57.692666+0000","last_active":"2023-10-06T02:49:58.683608+0000","last_peered":"2023-10-06T02:49:58.683608+0000","last_clean":"2023-10-06T02:49:58.683608+0000","last_became_active":"2023-10-06T02:49:57.692432+0000","last_became_peered":"2023-10-06T02:49:57.692432+0000","last_unstale":"2023-10-06T02:49:58.683608+0000","last_undegraded":"2023-10-06T02:49:58.683608+0000","last_fullsized":"2023-10-06T02:49:58.683608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:32.798696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693714+0000","last_change":"2023-10-06T02:49:58.693004+0000","last_active":"2023-10-06T02:49:58.693714+0000","last_peered":"2023-10-06T02:49:58.693714+0000","last_clean":"2023-10-06T02:49:58.693714+0000","last_became_active":"2023-10-06T02:49:58.692801+0000","last_became_peered":"2023-10-06T02:49:58.692801+0000","last_unstale":"2023-10-06T02:49:58.693714+0000","last_undegraded":"2023-10-06T02:49:58.693714+0000","last_fullsized":"2023-10-06T02:49:58.693714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:12.428178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.689882+0000","last_change":"2023-10-06T02:49:57.692567+0000","last_active":"2023-10-06T02:49:58.689882+0000","last_peered":"2023-10-06T02:49:58.689882+0000","last_clean":"2023-10-06T02:49:58.689882+0000","last_became_active":"2023-10-06T02:49:57.692060+0000","last_became_peered":"2023-10-06T02:49:57.692060+0000","last_unstale":"2023-10-06T02:49:58.689882+0000","last_undegraded":"2023-10-06T02:49:58.689882+0000","last_fullsized":"2023-10-06T02:49:58.689882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:22.205606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696927+0000","last_change":"2023-10-06T02:49:58.696837+0000","last_active":"2023-10-06T02:49:58.696927+0000","last_peered":"2023-10-06T02:49:58.696927+0000","last_clean":"2023-10-06T02:49:58.696927+0000","last_became_active":"2023-10-06T02:49:58.696634+0000","last_became_peered":"2023-10-06T02:49:58.696634+0000","last_unstale":"2023-10-06T02:49:58.696927+0000","last_undegraded":"2023-10-06T02:49:58.696927+0000","last_fullsized":"2023-10-06T02:49:58.696927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:15.647974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.684831+0000","last_change":"2023-10-06T02:49:57.690513+0000","last_active":"2023-10-06T02:49:58.684831+0000","last_peered":"2023-10-06T02:49:58.684831+0000","last_clean":"2023-10-06T02:49:58.684831+0000","last_became_active":"2023-10-06T02:49:57.690131+0000","last_became_peered":"2023-10-06T02:49:57.690131+0000","last_unstale":"2023-10-06T02:49:58.684831+0000","last_undegraded":"2023-10-06T02:49:58.684831+0000","last_fullsized":"2023-10-06T02:49:58.684831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:38.817005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.693945+0000","last_change":"2023-10-06T02:49:58.693846+0000","last_active":"2023-10-06T02:49:58.693945+0000","last_peered":"2023-10-06T02:49:58.693945+0000","last_clean":"2023-10-06T02:49:58.693945+0000","last_became_active":"2023-10-06T02:49:58.693335+0000","last_became_peered":"2023-10-06T02:49:58.693335+0000","last_unstale":"2023-10-06T02:49:58.693945+0000","last_undegraded":"2023-10-06T02:49:58.693945+0000","last_fullsized":"2023-10-06T02:49:58.693945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:17.816261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.690943+0000","last_change":"2023-10-06T02:49:57.693258+0000","last_active":"2023-10-06T02:49:58.690943+0000","last_peered":"2023-10-06T02:49:58.690943+0000","last_clean":"2023-10-06T02:49:58.690943+0000","last_became_active":"2023-10-06T02:49:57.693088+0000","last_became_peered":"2023-10-06T02:49:57.693088+0000","last_unstale":"2023-10-06T02:49:58.690943+0000","last_undegraded":"2023-10-06T02:49:58.690943+0000","last_fullsized":"2023-10-06T02:49:58.690943+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:30.832713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.691889+0000","last_change":"2023-10-06T02:49:58.691829+0000","last_active":"2023-10-06T02:49:58.691889+0000","last_peered":"2023-10-06T02:49:58.691889+0000","last_clean":"2023-10-06T02:49:58.691889+0000","last_became_active":"2023-10-06T02:49:58.691222+0000","last_became_peered":"2023-10-06T02:49:58.691222+0000","last_unstale":"2023-10-06T02:49:58.691889+0000","last_undegraded":"2023-10-06T02:49:58.691889+0000","last_fullsized":"2023-10-06T02:49:58.691889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:33.805753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.684850+0000","last_change":"2023-10-06T02:49:57.693366+0000","last_active":"2023-10-06T02:49:58.684850+0000","last_peered":"2023-10-06T02:49:58.684850+0000","last_clean":"2023-10-06T02:49:58.684850+0000","last_became_active":"2023-10-06T02:49:57.692914+0000","last_became_peered":"2023-10-06T02:49:57.692914+0000","last_unstale":"2023-10-06T02:49:58.684850+0000","last_undegraded":"2023-10-06T02:49:58.684850+0000","last_fullsized":"2023-10-06T02:49:58.684850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:25.399646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696172+0000","last_change":"2023-10-06T02:49:58.696127+0000","last_active":"2023-10-06T02:49:58.696172+0000","last_peered":"2023-10-06T02:49:58.696172+0000","last_clean":"2023-10-06T02:49:58.696172+0000","last_became_active":"2023-10-06T02:49:58.695958+0000","last_became_peered":"2023-10-06T02:49:58.695958+0000","last_unstale":"2023-10-06T02:49:58.696172+0000","last_undegraded":"2023-10-06T02:49:58.696172+0000","last_fullsized":"2023-10-06T02:49:58.696172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:39:43.001636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.701482+0000","last_change":"2023-10-06T02:49:57.688145+0000","last_active":"2023-10-06T02:49:58.701482+0000","last_peered":"2023-10-06T02:49:58.701482+0000","last_clean":"2023-10-06T02:49:58.701482+0000","last_became_active":"2023-10-06T02:49:57.687934+0000","last_became_peered":"2023-10-06T02:49:57.687934+0000","last_unstale":"2023-10-06T02:49:58.701482+0000","last_undegraded":"2023-10-06T02:49:58.701482+0000","last_fullsized":"2023-10-06T02:49:58.701482+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:58.929863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687491+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:49:58.687491+0000","last_peered":"2023-10-06T02:49:58.687491+0000","last_clean":"2023-10-06T02:49:58.687491+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:49:58.687491+0000","last_undegraded":"2023-10-06T02:49:58.687491+0000","last_fullsized":"2023-10-06T02:49:58.687491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.687430+0000","last_change":"2023-10-06T02:49:58.687371+0000","last_active":"2023-10-06T02:49:58.687430+0000","last_peered":"2023-10-06T02:49:58.687430+0000","last_clean":"2023-10-06T02:49:58.687430+0000","last_became_active":"2023-10-06T02:49:58.687160+0000","last_became_peered":"2023-10-06T02:49:58.687160+0000","last_unstale":"2023-10-06T02:49:58.687430+0000","last_undegraded":"2023-10-06T02:49:58.687430+0000","last_fullsized":"2023-10-06T02:49:58.687430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:46.973678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.702180+0000","last_change":"2023-10-06T02:49:57.687072+0000","last_active":"2023-10-06T02:49:58.702180+0000","last_peered":"2023-10-06T02:49:58.702180+0000","last_clean":"2023-10-06T02:49:58.702180+0000","last_became_active":"2023-10-06T02:49:57.686276+0000","last_became_peered":"2023-10-06T02:49:57.686276+0000","last_unstale":"2023-10-06T02:49:58.702180+0000","last_undegraded":"2023-10-06T02:49:58.702180+0000","last_fullsized":"2023-10-06T02:49:58.702180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:16.809204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685352+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:49:58.685352+0000","last_peered":"2023-10-06T02:49:58.685352+0000","last_clean":"2023-10-06T02:49:58.685352+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:49:58.685352+0000","last_undegraded":"2023-10-06T02:49:58.685352+0000","last_fullsized":"2023-10-06T02:49:58.685352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696011+0000","last_change":"2023-10-06T02:49:58.695959+0000","last_active":"2023-10-06T02:49:58.696011+0000","last_peered":"2023-10-06T02:49:58.696011+0000","last_clean":"2023-10-06T02:49:58.696011+0000","last_became_active":"2023-10-06T02:49:58.695785+0000","last_became_peered":"2023-10-06T02:49:58.695785+0000","last_unstale":"2023-10-06T02:49:58.696011+0000","last_undegraded":"2023-10-06T02:49:58.696011+0000","last_fullsized":"2023-10-06T02:49:58.696011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.375741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.686533+0000","last_change":"2023-10-06T02:49:57.687772+0000","last_active":"2023-10-06T02:49:58.686533+0000","last_peered":"2023-10-06T02:49:58.686533+0000","last_clean":"2023-10-06T02:49:58.686533+0000","last_became_active":"2023-10-06T02:49:57.687581+0000","last_became_peered":"2023-10-06T02:49:57.687581+0000","last_unstale":"2023-10-06T02:49:58.686533+0000","last_undegraded":"2023-10-06T02:49:58.686533+0000","last_fullsized":"2023-10-06T02:49:58.686533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:40.026899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.692051+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:49:58.692051+0000","last_peered":"2023-10-06T02:49:58.692051+0000","last_clean":"2023-10-06T02:49:58.692051+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:49:58.692051+0000","last_undegraded":"2023-10-06T02:49:58.692051+0000","last_fullsized":"2023-10-06T02:49:58.692051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.696440+0000","last_change":"2023-10-06T02:49:58.696075+0000","last_active":"2023-10-06T02:49:58.696440+0000","last_peered":"2023-10-06T02:49:58.696440+0000","last_clean":"2023-10-06T02:49:58.696440+0000","last_became_active":"2023-10-06T02:49:58.695528+0000","last_became_peered":"2023-10-06T02:49:58.695528+0000","last_unstale":"2023-10-06T02:49:58.696440+0000","last_undegraded":"2023-10-06T02:49:58.696440+0000","last_fullsized":"2023-10-06T02:49:58.696440+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:42.247967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.688435+0000","last_change":"2023-10-06T02:49:57.691229+0000","last_active":"2023-10-06T02:49:58.688435+0000","last_peered":"2023-10-06T02:49:58.688435+0000","last_clean":"2023-10-06T02:49:58.688435+0000","last_became_active":"2023-10-06T02:49:57.690997+0000","last_became_peered":"2023-10-06T02:49:57.690997+0000","last_unstale":"2023-10-06T02:49:58.688435+0000","last_undegraded":"2023-10-06T02:49:58.688435+0000","last_fullsized":"2023-10-06T02:49:58.688435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:02.136224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.684584+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:49:58.684584+0000","last_peered":"2023-10-06T02:49:58.684584+0000","last_clean":"2023-10-06T02:49:58.684584+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:49:58.684584+0000","last_undegraded":"2023-10-06T02:49:58.684584+0000","last_fullsized":"2023-10-06T02:49:58.684584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683460+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:49:58.683460+0000","last_peered":"2023-10-06T02:49:58.683460+0000","last_clean":"2023-10-06T02:49:58.683460+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:49:58.683460+0000","last_undegraded":"2023-10-06T02:49:58.683460+0000","last_fullsized":"2023-10-06T02:49:58.683460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.688021+0000","last_change":"2023-10-06T02:49:58.687963+0000","last_active":"2023-10-06T02:49:58.688021+0000","last_peered":"2023-10-06T02:49:58.688021+0000","last_clean":"2023-10-06T02:49:58.688021+0000","last_became_active":"2023-10-06T02:49:58.687759+0000","last_became_peered":"2023-10-06T02:49:58.687759+0000","last_unstale":"2023-10-06T02:49:58.688021+0000","last_undegraded":"2023-10-06T02:49:58.688021+0000","last_fullsized":"2023-10-06T02:49:58.688021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:40.098886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685397+0000","last_change":"2023-10-06T02:49:57.686132+0000","last_active":"2023-10-06T02:49:58.685397+0000","last_peered":"2023-10-06T02:49:58.685397+0000","last_clean":"2023-10-06T02:49:58.685397+0000","last_became_active":"2023-10-06T02:49:57.685905+0000","last_became_peered":"2023-10-06T02:49:57.685905+0000","last_unstale":"2023-10-06T02:49:58.685397+0000","last_undegraded":"2023-10-06T02:49:58.685397+0000","last_fullsized":"2023-10-06T02:49:58.685397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:40.200059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683307+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:49:58.683307+0000","last_peered":"2023-10-06T02:49:58.683307+0000","last_clean":"2023-10-06T02:49:58.683307+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:49:58.683307+0000","last_undegraded":"2023-10-06T02:49:58.683307+0000","last_fullsized":"2023-10-06T02:49:58.683307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699912+0000","last_change":"2023-10-06T02:49:58.699852+0000","last_active":"2023-10-06T02:49:58.699912+0000","last_peered":"2023-10-06T02:49:58.699912+0000","last_clean":"2023-10-06T02:49:58.699912+0000","last_became_active":"2023-10-06T02:49:58.699435+0000","last_became_peered":"2023-10-06T02:49:58.699435+0000","last_unstale":"2023-10-06T02:49:58.699912+0000","last_undegraded":"2023-10-06T02:49:58.699912+0000","last_fullsized":"2023-10-06T02:49:58.699912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:03.647505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685594+0000","last_change":"2023-10-06T02:49:57.689981+0000","last_active":"2023-10-06T02:49:58.685594+0000","last_peered":"2023-10-06T02:49:58.685594+0000","last_clean":"2023-10-06T02:49:58.685594+0000","last_became_active":"2023-10-06T02:49:57.689586+0000","last_became_peered":"2023-10-06T02:49:57.689586+0000","last_unstale":"2023-10-06T02:49:58.685594+0000","last_undegraded":"2023-10-06T02:49:58.685594+0000","last_fullsized":"2023-10-06T02:49:58.685594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:54.064486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.683514+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:49:58.683514+0000","last_peered":"2023-10-06T02:49:58.683514+0000","last_clean":"2023-10-06T02:49:58.683514+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:49:58.683514+0000","last_undegraded":"2023-10-06T02:49:58.683514+0000","last_fullsized":"2023-10-06T02:49:58.683514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.700599+0000","last_change":"2023-10-06T02:49:58.699961+0000","last_active":"2023-10-06T02:49:58.700599+0000","last_peered":"2023-10-06T02:49:58.700599+0000","last_clean":"2023-10-06T02:49:58.700599+0000","last_became_active":"2023-10-06T02:49:58.699726+0000","last_became_peered":"2023-10-06T02:49:58.699726+0000","last_unstale":"2023-10-06T02:49:58.700599+0000","last_undegraded":"2023-10-06T02:49:58.700599+0000","last_fullsized":"2023-10-06T02:49:58.700599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:54.094683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.699083+0000","last_change":"2023-10-06T02:49:57.692268+0000","last_active":"2023-10-06T02:49:58.699083+0000","last_peered":"2023-10-06T02:49:58.699083+0000","last_clean":"2023-10-06T02:49:58.699083+0000","last_became_active":"2023-10-06T02:49:57.692085+0000","last_became_peered":"2023-10-06T02:49:57.692085+0000","last_unstale":"2023-10-06T02:49:58.699083+0000","last_undegraded":"2023-10-06T02:49:58.699083+0000","last_fullsized":"2023-10-06T02:49:58.699083+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:40.200059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.685107+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:49:58.685107+0000","last_peered":"2023-10-06T02:49:58.685107+0000","last_clean":"2023-10-06T02:49:58.685107+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:49:58.685107+0000","last_undegraded":"2023-10-06T02:49:58.685107+0000","last_fullsized":"2023-10-06T02:49:58.685107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698357+0000","last_change":"2023-10-06T02:49:58.697546+0000","last_active":"2023-10-06T02:49:58.698357+0000","last_peered":"2023-10-06T02:49:58.698357+0000","last_clean":"2023-10-06T02:49:58.698357+0000","last_became_active":"2023-10-06T02:49:58.697154+0000","last_became_peered":"2023-10-06T02:49:58.697154+0000","last_unstale":"2023-10-06T02:49:58.698357+0000","last_undegraded":"2023-10-06T02:49:58.698357+0000","last_fullsized":"2023-10-06T02:49:58.698357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:57.674616+0000","last_clean_scrub_stamp":"2023-10-06T02:49:57.674616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:48.179124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.698315+0000","last_change":"2023-10-06T02:49:57.687838+0000","last_active":"2023-10-06T02:49:58.698315+0000","last_peered":"2023-10-06T02:49:58.698315+0000","last_clean":"2023-10-06T02:49:58.698315+0000","last_became_active":"2023-10-06T02:49:57.687126+0000","last_became_peered":"2023-10-06T02:49:57.687126+0000","last_unstale":"2023-10-06T02:49:58.698315+0000","last_undegraded":"2023-10-06T02:49:58.698315+0000","last_fullsized":"2023-10-06T02:49:58.698315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:49:56.667559+0000","last_clean_scrub_stamp":"2023-10-06T02:49:56.667559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:02.962978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-06T02:49:58.689075+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:49:58.689075+0000","last_peered":"2023-10-06T02:49:58.689075+0000","last_clean":"2023-10-06T02:49:58.689075+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:49:58.689075+0000","last_undegraded":"2023-10-06T02:49:58.689075+0000","last_fullsized":"2023-10-06T02:49:58.689075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194276,"statfs":{"total":200000000,"available":198939204,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.753,"5min":1.393,"15min":1.393},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30499999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73599999999999999,"5min":1.081,"15min":1.081},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.32700000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.79900000000000004,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.501}]},{"osd":2,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.373,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77300000000000002,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.61899999999999999,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78600000000000003,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.42499999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.35899999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.66200000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39400000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.746,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.76100000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.442},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.34599999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194851,"statfs":{"total":200000000,"available":199528058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60599999999999998,"15min":0.63600000000000001},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":1.879,"15min":1.879},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.90700000000000003,"15min":1.069},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69399999999999995,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.50900000000000001},"min":{"1min":0.40699999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.433}]},{"osd":3,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70199999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80100000000000005,"5min":1.163,"15min":1.163},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.53800000000000003,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68799999999999994,"5min":1.05,"15min":1.05},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53000000000000003,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65100000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.59399999999999997,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77900000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60699999999999998,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":459,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194853,"statfs":{"total":200000000,"available":199529482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.308,"15min":0.311},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.32600000000000001},"min":{"1min":0.251,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.26200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.318,"15min":0.317},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.497,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.38}]},{"osd":3,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.27400000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.37,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.41399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71299999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82099999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77800000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.442,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.67700000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78300000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194276,"statfs":{"total":200000000,"available":198939226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34999999999999998},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47999999999999998,"5min":1.177,"15min":1.177},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38800000000000001,"15min":0.39800000000000002},"min":{"1min":0.23499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65100000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.26500000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.75800000000000001,"15min":1.181},"min":{"1min":0.216,"5min":0.188,"15min":0.188},"max":{"1min":0.56000000000000005,"5min":22.038,"15min":22.038},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.23000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.26200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.60399999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.79600000000000004,"15min":1.2110000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.63300000000000001,"5min":21.942,"15min":21.942},"last":0.255}]},{"osd":4,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.91000000000000003,"15min":1.264},"min":{"1min":0.46400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86499999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.96899999999999997,"15min":1.367},"min":{"1min":0.46300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.47699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":1.401,"15min":1.401},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.93899999999999995,"15min":1.294},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.98999999999999999,"15min":1.3939999999999999},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80900000000000005,"5min":21.98,"15min":21.98},"last":0.52200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.88800000000000001,"5min":1.425,"15min":1.425},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.78300000000000003,"15min":0.96599999999999997},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81899999999999995,"5min":11.154,"15min":11.154},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194852,"statfs":{"total":200000000,"available":199528880,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52900000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.20999999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.51500000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.34699999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"min":{"1min":0.25700000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.63,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.434}]},{"osd":4,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80000000000000004,"5min":0.875,"15min":0.875},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59399999999999997,"15min":0.57799999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79500000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.75}]},{"osd":6,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57699999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":459,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194852,"statfs":{"total":200000000,"available":199529040,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.30299999999999999,"15min":0.30199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.42399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.318},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.501,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.32200000000000001},"min":{"1min":0.245,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.34599999999999997,"15min":0.33800000000000002},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.372}]},{"osd":2,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.38500000000000001,"15min":0.36499999999999999},"min":{"1min":0.26300000000000001,"5min":0.216,"15min":0.216},"max":{"1min":3.044,"5min":3.044,"15min":3.044},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.33500000000000002},"min":{"1min":0.30099999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77500000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68100000000000005,"5min":2.25,"15min":2.25},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.66300000000000003,"15min":0.71399999999999997},"min":{"1min":0.371,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71399999999999997,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79200000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.48699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.90500000000000003,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84199999999999997,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.626},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.54200000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73599999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.753}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194851,"statfs":{"total":200000000,"available":199527954,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.752,"15min":0.86499999999999999},"min":{"1min":0.27800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71699999999999997,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.60499999999999998,"15min":0.65500000000000003},"min":{"1min":0.33700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.66100000000000003,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.78000000000000003,"15min":0.89900000000000002},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70199999999999996,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.74199999999999999,"15min":0.84099999999999997},"min":{"1min":0.32700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.80000000000000004,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.625,"15min":0.67700000000000005},"min":{"1min":0.35199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.75900000000000001,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.65900000000000003,"15min":0.71199999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70499999999999996,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.57599999999999996,"15min":0.60899999999999999},"min":{"1min":0.37,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72799999999999998,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59899999999999998,"15min":0.63200000000000001},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.748,"5min":3.456,"15min":3.456},"last":0.48299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.66100000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.50900000000000001,"15min":0.51500000000000001},"min":{"1min":0.36899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.35499999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52200000000000002,"15min":0.52700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.309},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69099999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.33400000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76400000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.96099999999999997,"15min":1.129},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78400000000000003,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.374}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":459,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194853,"statfs":{"total":200000000,"available":199529560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72499999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40699999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.627},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.66500000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.33200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.372,"5min":0.31,"15min":0.31},"max":{"1min":0.72399999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71199999999999997,"5min":0.879,"15min":0.879},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.79700000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57699999999999996}]}]}],"pool_statfs":[]}} 2023-10-06T02:50:03.106 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:50:03.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:50:03.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.259+0000 7f4f2a1d0700 1 Processor -- start 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.259+0000 7f4f2a1d0700 1 -- start start 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f2a1d0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f240b29d0 0x7f4f24164c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f2a1d0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f24068d40 con 0x7f4f240b1ef0 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f2a1d0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2406a1e0 con 0x7f4f2406f4f0 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f2a1d0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2415a520 con 0x7f4f240b29d0 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f291ce700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4f240b1ef0 0x7f4f2406da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39616/0 (socket says 172.21.15.81:39616) 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f291ce700 1 -- 172.21.15.81:0/1185591302 learned_addr learned my addr 172.21.15.81:0/1185591302 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640790574 0 0) 0x7f4f24068d40 con 0x7f4f240b1ef0 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f0c003570 con 0x7f4f240b1ef0 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f299cf700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f240b29d0 0x7f4f24164c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1113438328 0 0) 0x7f4f0c003570 con 0x7f4f240b1ef0 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f240b29d0 msgr2=0x7f4f24164c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f240b29d0 0x7f4f24164c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 >> v1:172.21.15.83:6789/0 conn(0x7f4f2406f4f0 legacy=0x7f4f240b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2406e2d0 con 0x7f4f240b1ef0 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f4f1c001470 con 0x7f4f240b1ef0 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 >> v1:172.21.15.81:6789/0 conn(0x7f4f240b1ef0 legacy=0x7f4f2406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f240b29d0 0x7f4f0c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.260+0000 7f4f23fff700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c004010 0x7f4f0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f23fff700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f0c004d50 0x7f4f0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2415a520 con 0x7f4f0c004010 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c00bbf0 con 0x7f4f0c004d50 2023-10-06T02:50:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c00bdb0 con 0x7f4f240b29d0 2023-10-06T02:50:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f289cd700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c004010 0x7f4f0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f291ce700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f240b29d0 0x7f4f0c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f299cf700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f0c004d50 0x7f4f0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f289cd700 1 -- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f240b29d0 msgr2=0x7f4f0c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f289cd700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f240b29d0 0x7f4f0c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f289cd700 1 -- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f0c004d50 msgr2=0x7f4f0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f289cd700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f0c004d50 0x7f4f0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f289cd700 1 -- 172.21.15.81:0/1185591302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c003570 con 0x7f4f0c004010 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f299cf700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f0c004d50 0x7f4f0c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f289cd700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c004010 0x7f4f0c004810 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4f18001880 tx=0x7f4f18007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bdd5649b14ce9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18012420 con 0x7f4f0c004010 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18012580 con 0x7f4f0c004010 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.261+0000 7f4f23fff700 1 -- 172.21.15.81:0/1185591302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18012920 con 0x7f4f0c004010 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.262+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/1185591302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c004010 msgr2=0x7f4f0c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.262+0000 7f4f2a1d0700 1 --2- 172.21.15.81:0/1185591302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c004010 0x7f4f0c004810 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4f18001880 tx=0x7f4f18007d30 comp rx=0 tx=0).stop 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.262+0000 7f4f299cf700 1 -- 172.21.15.81:0/1185591302 reap_dead start 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.262+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/1185591302 shutdown_connections 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.262+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/1185591302 >> 172.21.15.81:0/1185591302 conn(0x7f4f240d0bb0 msgr2=0x7f4f240d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.262+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/1185591302 shutdown_connections 2023-10-06T02:50:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.262+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/1185591302 wait complete. 2023-10-06T02:50:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.263+0000 7f4f2a1d0700 1 Processor -- start 2023-10-06T02:50:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.263+0000 7f4f2a1d0700 1 -- start start 2023-10-06T02:50:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f2a1d0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f0c004010 0x7f4f2416ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f2a1d0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f2415b660 0x7f4f240acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f2a1d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f240ad750 0x7f4f240adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f2a1d0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240ae110 con 0x7f4f240ad750 2023-10-06T02:50:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f2a1d0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2415ca80 con 0x7f4f2415b660 2023-10-06T02:50:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f2a1d0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2415be70 con 0x7f4f0c004010 2023-10-06T02:50:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f299cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f240ad750 0x7f4f240adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f299cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f240ad750 0x7f4f240adbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39264/0 (socket says 172.21.15.81:39264) 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f299cf700 1 -- 172.21.15.81:0/966586014 learned_addr learned my addr 172.21.15.81:0/966586014 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f291ce700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f0c004010 0x7f4f2416ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f289cd700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f2415b660 0x7f4f240acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f299cf700 1 -- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f0c004010 msgr2=0x7f4f2416ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f299cf700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f0c004010 0x7f4f2416ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f299cf700 1 -- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f2415b660 msgr2=0x7f4f240acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f299cf700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f2415b660 0x7f4f240acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f299cf700 1 -- 172.21.15.81:0/966586014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2415c150 con 0x7f4f240ad750 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f299cf700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f240ad750 0x7f4f240adbd0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4f24065630 tx=0x7f4f1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f217fa700 1 -- 172.21.15.81:0/966586014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1401b070 con 0x7f4f240ad750 2023-10-06T02:50:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f217fa700 1 -- 172.21.15.81:0/966586014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1400f040 con 0x7f4f240ad750 2023-10-06T02:50:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f217fa700 1 -- 172.21.15.81:0/966586014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400e050 con 0x7f4f240ad750 2023-10-06T02:50:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.264+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2415c430 con 0x7f4f240ad750 2023-10-06T02:50:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.265+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2415cf10 con 0x7f4f240ad750 2023-10-06T02:50:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.265+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2415cc10 con 0x7f4f240ad750 2023-10-06T02:50:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.266+0000 7f4f217fa700 1 -- 172.21.15.81:0/966586014 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f14003020 con 0x7f4f240ad750 2023-10-06T02:50:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.266+0000 7f4f217fa700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f10066f30 0x7f4f100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.266+0000 7f4f217fa700 1 -- 172.21.15.81:0/966586014 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f14084ca0 con 0x7f4f240ad750 2023-10-06T02:50:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.266+0000 7f4f291ce700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f10066f30 0x7f4f100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.267+0000 7f4f291ce700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f10066f30 0x7f4f100693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c001ce0 tx=0x7f4f1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.270+0000 7f4f217fa700 1 -- 172.21.15.81:0/966586014 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f14051db0 con 0x7f4f240ad750 2023-10-06T02:50:03.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.528+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4f240b08f0 con 0x7f4f240ad750 2023-10-06T02:50:03.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.531+0000 7f4f217fa700 1 -- 172.21.15.81:0/966586014 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4f140553d0 con 0x7f4f240ad750 2023-10-06T02:50:03.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f10066f30 msgr2=0x7f4f100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f10066f30 0x7f4f100693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c001ce0 tx=0x7f4f1c009040 comp rx=0 tx=0).stop 2023-10-06T02:50:03.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f240ad750 msgr2=0x7f4f240adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f240ad750 0x7f4f240adbd0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4f24065630 tx=0x7f4f1400b040 comp rx=0 tx=0).stop 2023-10-06T02:50:03.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 shutdown_connections 2023-10-06T02:50:03.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f240ad750 0x7f4f240adbd0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f0c004010 0x7f4f2416ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4f10066f30 0x7f4f100693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 --2- 172.21.15.81:0/966586014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f2415b660 0x7f4f240acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 >> 172.21.15.81:0/966586014 conn(0x7f4f240d0bb0 msgr2=0x7f4f240b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:03.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 shutdown_connections 2023-10-06T02:50:03.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.534+0000 7f4f2a1d0700 1 -- 172.21.15.81:0/966586014 wait complete. 2023-10-06T02:50:03.536 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:50:03.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:50:03.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.659+0000 7f6cd5230700 1 Processor -- start 2023-10-06T02:50:03.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.659+0000 7f6cd5230700 1 -- start start 2023-10-06T02:50:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6cd5230700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6cd0157ca0 0x7f6cd00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6cd5230700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6cd006d120 0x7f6cd006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6cd5230700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd00d07c0 con 0x7f6cd01578d0 2023-10-06T02:50:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6cd5230700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd006da50 con 0x7f6cd006d120 2023-10-06T02:50:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6cd5230700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd00cfbb0 con 0x7f6cd0157ca0 2023-10-06T02:50:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6ccf59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6cd006d120 0x7f6cd006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6cced9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6cd01578d0 0x7f6cd015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39622/0 (socket says 172.21.15.81:39622) 2023-10-06T02:50:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6cced9d700 1 -- 172.21.15.81:0/4173742355 learned_addr learned my addr 172.21.15.81:0/4173742355 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6ccf59e700 1 -- 172.21.15.81:0/4173742355 >> v2:172.21.15.83:3300/0 conn(0x7f6cd0157ca0 msgr2=0x7f6cd00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6ccf59e700 1 --2- 172.21.15.81:0/4173742355 >> v2:172.21.15.83:3300/0 conn(0x7f6cd0157ca0 0x7f6cd00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6ccf59e700 1 -- 172.21.15.81:0/4173742355 >> v1:172.21.15.81:6789/0 conn(0x7f6cd01578d0 legacy=0x7f6cd015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6cce59c700 1 -- 172.21.15.81:0/4173742355 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690103392 0 0) 0x7f6cd00d07c0 con 0x7f6cd01578d0 2023-10-06T02:50:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.660+0000 7f6ccf59e700 1 -- 172.21.15.81:0/4173742355 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd00cfe90 con 0x7f6cd006d120 2023-10-06T02:50:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6ccf59e700 1 --2- 172.21.15.81:0/4173742355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd006d120 0x7f6cd006d510 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0068510 tx=0x7f6cc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82999934d9ce782e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cce59c700 1 -- 172.21.15.81:0/4173742355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc800e070 con 0x7f6cd006d120 2023-10-06T02:50:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cce59c700 1 -- 172.21.15.81:0/4173742355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc800bc30 con 0x7f6cd006d120 2023-10-06T02:50:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cce59c700 1 -- 172.21.15.81:0/4173742355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8012430 con 0x7f6cd006d120 2023-10-06T02:50:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cd5230700 1 -- 172.21.15.81:0/4173742355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd006d120 msgr2=0x7f6cd006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cd5230700 1 --2- 172.21.15.81:0/4173742355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd006d120 0x7f6cd006d510 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0068510 tx=0x7f6cc8009780 comp rx=0 tx=0).stop 2023-10-06T02:50:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cd5230700 1 -- 172.21.15.81:0/4173742355 shutdown_connections 2023-10-06T02:50:03.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cd5230700 1 --2- 172.21.15.81:0/4173742355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd006d120 0x7f6cd006d510 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cd5230700 1 --2- 172.21.15.81:0/4173742355 >> v2:172.21.15.83:3300/0 conn(0x7f6cd0157ca0 0x7f6cd00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cd5230700 1 -- 172.21.15.81:0/4173742355 >> 172.21.15.81:0/4173742355 conn(0x7f6cd006bb90 msgr2=0x7f6cd006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:03.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cd5230700 1 -- 172.21.15.81:0/4173742355 shutdown_connections 2023-10-06T02:50:03.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.661+0000 7f6cd5230700 1 -- 172.21.15.81:0/4173742355 wait complete. 2023-10-06T02:50:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.662+0000 7f6cd5230700 1 Processor -- start 2023-10-06T02:50:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.662+0000 7f6cd5230700 1 -- start start 2023-10-06T02:50:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6cd5230700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6cd006d120 0x7f6cd0169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6cd5230700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd01578d0 0x7f6cd015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6cd5230700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd0157ca0 0x7f6cd015f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6cd5230700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00c6170 con 0x7f6cd0157ca0 2023-10-06T02:50:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6cd5230700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00b65e0 con 0x7f6cd01578d0 2023-10-06T02:50:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6cd5230700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00b68c0 con 0x7f6cd006d120 2023-10-06T02:50:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6ccf59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd0157ca0 0x7f6cd015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6ccf59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd0157ca0 0x7f6cd015f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39274/0 (socket says 172.21.15.81:39274) 2023-10-06T02:50:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6ccf59e700 1 -- 172.21.15.81:0/1855402624 learned_addr learned my addr 172.21.15.81:0/1855402624 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6cc659c700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd01578d0 0x7f6cd015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6cced9d700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6cd006d120 0x7f6cd0169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6ccf59e700 1 -- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6cd006d120 msgr2=0x7f6cd0169490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6ccf59e700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6cd006d120 0x7f6cd0169490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6ccf59e700 1 -- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd01578d0 msgr2=0x7f6cd015f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6ccf59e700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd01578d0 0x7f6cd015f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.663+0000 7f6ccf59e700 1 -- 172.21.15.81:0/1855402624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8009a20 con 0x7f6cd0157ca0 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.664+0000 7f6ccf59e700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd0157ca0 0x7f6cd015f610 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8013000 tx=0x7f6cc8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.664+0000 7f6cc77fe700 1 -- 172.21.15.81:0/1855402624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8012ea0 con 0x7f6cd0157ca0 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.664+0000 7f6cc77fe700 1 -- 172.21.15.81:0/1855402624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc801e630 con 0x7f6cd0157ca0 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.664+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd00c5b20 con 0x7f6cd0157ca0 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.664+0000 7f6cc77fe700 1 -- 172.21.15.81:0/1855402624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc801ea10 con 0x7f6cd0157ca0 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.664+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd01699d0 con 0x7f6cd0157ca0 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.665+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd00c6320 con 0x7f6cd0157ca0 2023-10-06T02:50:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.665+0000 7f6cc77fe700 1 -- 172.21.15.81:0/1855402624 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cc8024070 con 0x7f6cd0157ca0 2023-10-06T02:50:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.665+0000 7f6cc77fe700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cb0066f30 0x7f6cb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.666+0000 7f6cc77fe700 1 -- 172.21.15.81:0/1855402624 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6cc8087040 con 0x7f6cd0157ca0 2023-10-06T02:50:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.666+0000 7f6cced9d700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cb0066f30 0x7f6cb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.666+0000 7f6cced9d700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cb0066f30 0x7f6cb00693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00011e0 tx=0x7f6cc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.670+0000 7f6cc77fe700 1 -- 172.21.15.81:0/1855402624 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cd00c6320 con 0x7f6cd0157ca0 2023-10-06T02:50:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.895+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cd00c62b0 con 0x7f6cd0157ca0 2023-10-06T02:50:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.895+0000 7f6cc77fe700 1 -- 172.21.15.81:0/1855402624 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6cc8054150 con 0x7f6cd0157ca0 2023-10-06T02:50:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:03.897 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2330757810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2330757810},{"type":"v1","addr":"172.21.15.83:6837","nonce":2330757810}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2957658297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2957658297},{"type":"v1","addr":"172.21.15.81:6834","nonce":2957658297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4153630712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4153630712},{"type":"v1","addr":"172.21.15.81:6835","nonce":4153630712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:49:58.066126+0000","modified":"2023-10-06T02:50:01.693730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/1398848175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1398848175},{"type":"v1","addr":"172.21.15.83:6836","nonce":1398848175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cb0066f30 msgr2=0x7f6cb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cb0066f30 0x7f6cb00693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00011e0 tx=0x7f6cc0009040 comp rx=0 tx=0).stop 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd0157ca0 msgr2=0x7f6cd015f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd0157ca0 0x7f6cd015f610 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8013000 tx=0x7f6cc8019000 comp rx=0 tx=0).stop 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 shutdown_connections 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd0157ca0 0x7f6cd015f610 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6cd006d120 0x7f6cd0169490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cb0066f30 0x7f6cb00693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 --2- 172.21.15.81:0/1855402624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cd01578d0 0x7f6cd015f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 >> 172.21.15.81:0/1855402624 conn(0x7f6cd006bb90 msgr2=0x7f6cd0068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 shutdown_connections 2023-10-06T02:50:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:03.897+0000 7f6cd5230700 1 -- 172.21.15.81:0/1855402624 wait complete. 2023-10-06T02:50:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2023-10-06T02:50:04.314 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:49:58.066126+0000', 'modified': '2023-10-06T02:50:01.693730+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6159}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6159': {'gid': 6159, 'name': 'b', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6836/1398848175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 1398848175}, {'type': 'v1', 'addr': '172.21.15.83:6836', 'nonce': 1398848175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:50:04.314 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:50:04.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T02:50:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.430+0000 7fe7ce4d5700 1 Processor -- start 2023-10-06T02:50:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.430+0000 7fe7ce4d5700 1 -- start start 2023-10-06T02:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.431+0000 7fe7ce4d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7c81578d0 0x7fe7c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.431+0000 7fe7ce4d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c8157ca0 0x7fe7c815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.431+0000 7fe7ce4d5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe7c806d120 0x7fe7c806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.431+0000 7fe7ce4d5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c806dac0 con 0x7fe7c81578d0 2023-10-06T02:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.431+0000 7fe7ce4d5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c80d07c0 con 0x7fe7c806d120 2023-10-06T02:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.431+0000 7fe7ce4d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80cfbb0 con 0x7fe7c8157ca0 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.431+0000 7fe7c7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7c81578d0 0x7fe7c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.431+0000 7fe7c7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7c81578d0 0x7fe7c80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39288/0 (socket says 172.21.15.81:39288) 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.431+0000 7fe7c7fff700 1 -- 172.21.15.81:0/411134298 learned_addr learned my addr 172.21.15.81:0/411134298 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c77fe700 1 --2- 172.21.15.81:0/411134298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c8157ca0 0x7fe7c815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7cca72700 1 --2- 172.21.15.81:0/411134298 >> v2:172.21.15.83:3300/0 conn(0x7fe7c806d120 0x7fe7c806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c7fff700 1 -- 172.21.15.81:0/411134298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c8157ca0 msgr2=0x7fe7c815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/411134298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c8157ca0 0x7fe7c815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c7fff700 1 -- 172.21.15.81:0/411134298 >> v2:172.21.15.83:3300/0 conn(0x7fe7c806d120 msgr2=0x7fe7c806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/411134298 >> v2:172.21.15.83:3300/0 conn(0x7fe7c806d120 0x7fe7c806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c7fff700 1 -- 172.21.15.81:0/411134298 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80cfe90 con 0x7fe7c81578d0 2023-10-06T02:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/411134298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c81578d0 0x7fe7c80cf4f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80b3940 tx=0x7fe7b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33cdaa4d37c15ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c6ffd700 1 -- 172.21.15.81:0/411134298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800b860 con 0x7fe7c81578d0 2023-10-06T02:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c6ffd700 1 -- 172.21.15.81:0/411134298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b800b9c0 con 0x7fe7c81578d0 2023-10-06T02:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7c6ffd700 1 -- 172.21.15.81:0/411134298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800bd60 con 0x7fe7c81578d0 2023-10-06T02:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/411134298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c81578d0 msgr2=0x7fe7c80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/411134298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c81578d0 0x7fe7c80cf4f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80b3940 tx=0x7fe7b8009250 comp rx=0 tx=0).stop 2023-10-06T02:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.432+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/411134298 shutdown_connections 2023-10-06T02:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.433+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/411134298 >> v2:172.21.15.83:3300/0 conn(0x7fe7c806d120 0x7fe7c806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.433+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/411134298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c81578d0 0x7fe7c80cf4f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.433+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/411134298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c8157ca0 0x7fe7c815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.433+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/411134298 >> 172.21.15.81:0/411134298 conn(0x7fe7c806bb90 msgr2=0x7fe7c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.433+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/411134298 shutdown_connections 2023-10-06T02:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.433+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/411134298 wait complete. 2023-10-06T02:50:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.434+0000 7fe7ce4d5700 1 Processor -- start 2023-10-06T02:50:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.434+0000 7fe7ce4d5700 1 -- start start 2023-10-06T02:50:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.434+0000 7fe7ce4d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c806d120 0x7fe7c8153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7ce4d5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c81578d0 0x7fe7c80c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7ce4d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c8157ca0 0x7fe7c8156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7ce4d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80c7070 con 0x7fe7c8157ca0 2023-10-06T02:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7ce4d5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80c6460 con 0x7fe7c81578d0 2023-10-06T02:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7ce4d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80c6740 con 0x7fe7c806d120 2023-10-06T02:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7cca72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c8157ca0 0x7fe7c8156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7cca72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c8157ca0 0x7fe7c8156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39298/0 (socket says 172.21.15.81:39298) 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7cca72700 1 -- 172.21.15.81:0/4139687470 learned_addr learned my addr 172.21.15.81:0/4139687470 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c806d120 0x7fe7c8153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7c77fe700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c81578d0 0x7fe7c80c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7cca72700 1 -- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c806d120 msgr2=0x7fe7c8153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7cca72700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c806d120 0x7fe7c8153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7cca72700 1 -- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c81578d0 msgr2=0x7fe7c80c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7cca72700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c81578d0 0x7fe7c80c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7cca72700 1 -- 172.21.15.81:0/4139687470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b80094f0 con 0x7fe7c8157ca0 2023-10-06T02:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7cca72700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c8157ca0 0x7fe7c8156740 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009fa0 tx=0x7fe7c0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7affff700 1 -- 172.21.15.81:0/4139687470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000ebc0 con 0x7fe7c8157ca0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7affff700 1 -- 172.21.15.81:0/4139687470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c000ed20 con 0x7fe7c8157ca0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7affff700 1 -- 172.21.15.81:0/4139687470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0014670 con 0x7fe7c8157ca0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/4139687470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c80c6a20 con 0x7fe7c8157ca0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.435+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/4139687470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c8153fb0 con 0x7fe7c8157ca0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.437+0000 7fe7affff700 1 -- 172.21.15.81:0/4139687470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7c00149e0 con 0x7fe7c8157ca0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.437+0000 7fe7affff700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe7b4066f30 0x7fe7b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.437+0000 7fe7affff700 1 -- 172.21.15.81:0/4139687470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7c0084d10 con 0x7fe7c8157ca0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.437+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe7b4066f30 0x7fe7b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.438+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe7b4066f30 0x7fe7b40693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80b3940 tx=0x7fe7b8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.439+0000 7fe7d77cdb80 1 Processor -- start 2023-10-06T02:50:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.439+0000 7fe7d77cdb80 1 -- start start 2023-10-06T02:50:04.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad71840 0x55daaad71c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 0x55daaadc16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaadc1c00 0x55daaadc2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaacc8a70 con 0x55daaad71840 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaacc6270 con 0x55daaad72cc0 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daaacc2060 con 0x55daaadc1c00 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad71840 0x55daaad71c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad71840 0x55daaad71c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39304/0 (socket says 172.21.15.81:39304) 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c7fff700 1 -- 172.21.15.81:0/3198532661 learned_addr learned my addr 172.21.15.81:0/3198532661 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c77fe700 1 --2- 172.21.15.81:0/3198532661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 0x55daaadc16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7cca72700 1 --2- 172.21.15.81:0/3198532661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaadc1c00 0x55daaadc2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c7fff700 1 -- 172.21.15.81:0/3198532661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaadc1c00 msgr2=0x55daaadc2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/3198532661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaadc1c00 0x55daaadc2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c7fff700 1 -- 172.21.15.81:0/3198532661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 msgr2=0x55daaadc16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/3198532661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 0x55daaadc16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c7fff700 1 -- 172.21.15.81:0/3198532661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daaab5c270 con 0x55daaad71840 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/3198532661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad71840 0x55daaad71c10 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800b3c0 tx=0x7fe7b8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178afccfed8bdded server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7ad7fa700 1 -- 172.21.15.81:0/3198532661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8021070 con 0x55daaad71840 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.440+0000 7fe7ad7fa700 1 -- 172.21.15.81:0/3198532661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8011ac0 con 0x55daaad71840 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7ad7fa700 1 -- 172.21.15.81:0/3198532661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800bee0 con 0x55daaad71840 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/3198532661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad71840 msgr2=0x55daaad71c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/3198532661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad71840 0x55daaad71c10 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800b3c0 tx=0x7fe7b8021000 comp rx=0 tx=0).stop 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/3198532661 shutdown_connections 2023-10-06T02:50:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/3198532661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaadc1c00 0x55daaadc2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/3198532661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad71840 0x55daaad71c10 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/3198532661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 0x55daaadc16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/3198532661 >> 172.21.15.81:0/3198532661 conn(0x55daaad73160 msgr2=0x55daaad73530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/3198532661 shutdown_connections 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.441+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/3198532661 wait complete. 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.442+0000 7fe7d77cdb80 1 -- start start 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.442+0000 7fe7d77cdb80 1 Processor -- start 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 0x55daaad6d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad72cc0 0x55daaad9c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaadc1c00 0x55daaad9cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaac6d890 con 0x55daaad72cc0 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaac88ea0 con 0x55daaadc1c00 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daaab44e30 con 0x55daaad71840 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 10 client.0 _ll_register_callbacks cb 0x55daaad34e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad72cc0 0x55daaad9c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad72cc0 0x55daaad9c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39306/0 (socket says 172.21.15.81:39306) 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c77fe700 1 -- 172.21.15.81:0/1190958888 learned_addr learned my addr 172.21.15.81:0/1190958888 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 0x55daaad6d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7cca72700 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaadc1c00 0x55daaad9cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c77fe700 1 -- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 msgr2=0x55daaad6d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c77fe700 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 0x55daaad6d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c77fe700 1 -- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaadc1c00 msgr2=0x55daaad9cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c77fe700 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaadc1c00 0x55daaad9cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c77fe700 1 -- 172.21.15.81:0/1190958888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c80cfe90 con 0x55daaad72cc0 2023-10-06T02:50:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7c77fe700 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad72cc0 0x55daaad9c7e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80b31a0 tx=0x7fe7bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f10377ee72d4c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7a67fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:50:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7a67fc700 1 -- 172.21.15.81:0/1190958888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc015700 con 0x55daaad72cc0 2023-10-06T02:50:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1190958888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55daaad66940 con 0x55daaad72cc0 2023-10-06T02:50:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7a67fc700 1 -- 172.21.15.81:0/1190958888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7bc01fc80 con 0x55daaad72cc0 2023-10-06T02:50:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7a67fc700 1 -- 172.21.15.81:0/1190958888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7bc01fe40 con 0x55daaad72cc0 2023-10-06T02:50:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 10 client.6297 fetch_fsmap learned FSMap version 42 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.443+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1190958888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55daaaafefe0 con 0x55daaad72cc0 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7a67fc700 1 -- 172.21.15.81:0/1190958888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daaad66940 con 0x55daaad72cc0 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7a67fc700 1 -- 172.21.15.81:0/1190958888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe7bc015a70 con 0x55daaad72cc0 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7d77cdb80 10 client.6297 fetch_fsmap finished waiting for FSMap version 42 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7d77cdb80 10 client.6297 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7d77cdb80 20 client.6297 populate_metadata read hostname 'smithi081' 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] conn(0x55daaadcbb00 0x55daaadcbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7d77cdb80 4 client.6297 mds_command: new command op to 6159 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1190958888 --> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55daaad43870 con 0x55daaadcbb00 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] conn(0x55daaadcbb00 0x55daaadcbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7a67fc700 10 client.6297 ms_handle_connect on v2:172.21.15.83:6834/1398848175 2023-10-06T02:50:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.444+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] conn(0x55daaadcbb00 0x55daaadcbed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfe9b9ed13b71933 server_cookie=21a144f43ee77053 in_seq=0 out_seq=0 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7a67fc700 1 -- 172.21.15.81:0/1190958888 <== mds.0 v2:172.21.15.83:6834/1398848175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55daaad43870 con 0x55daaadcbb00 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7a67fc700 10 client.6297 handle_command_reply: tid=0 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 client.6297 shutdown 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1190958888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad72cc0 msgr2=0x55daaad9c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad72cc0 0x55daaad9c7e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80b31a0 tx=0x7fe7bc008040 comp rx=0 tx=0).stop 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1190958888 shutdown_connections 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] conn(0x55daaadcbb00 0x55daaadcbed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaadc1c00 0x55daaad9cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7a67fc700 0 client.6297 ms_handle_reset on v2:172.21.15.83:6834/1398848175 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 0x55daaad6d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1190958888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaad72cc0 0x55daaad9c7e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1190958888 >> 172.21.15.81:0/1190958888 conn(0x55daaad73160 msgr2=0x55daaad721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:04.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1190958888 shutdown_connections 2023-10-06T02:50:04.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1190958888 wait complete. 2023-10-06T02:50:04.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.445+0000 7fe7d77cdb80 20 client.6297 trim_cache size 0 max 16384 2023-10-06T02:50:04.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.462+0000 7fe7d77cdb80 1 Processor -- start 2023-10-06T02:50:04.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.462+0000 7fe7d77cdb80 1 -- start start 2023-10-06T02:50:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad71840 0x55daaad9cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad72cc0 0x55daaadd20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaadb52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaadbb900 con 0x55daaadc1c00 2023-10-06T02:50:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaad70d70 con 0x55daaad71840 2023-10-06T02:50:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daaad39d90 con 0x55daaad72cc0 2023-10-06T02:50:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7cca72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaadb52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7cca72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaadb52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39316/0 (socket says 172.21.15.81:39316) 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7cca72700 1 -- 172.21.15.81:0/1047608231 learned_addr learned my addr 172.21.15.81:0/1047608231 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/1047608231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad71840 0x55daaad9cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7c77fe700 1 --2- 172.21.15.81:0/1047608231 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad72cc0 0x55daaadd20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7cca72700 1 -- 172.21.15.81:0/1047608231 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad72cc0 msgr2=0x55daaadd20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7cca72700 1 --2- 172.21.15.81:0/1047608231 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad72cc0 0x55daaadd20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7cca72700 1 -- 172.21.15.81:0/1047608231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad71840 msgr2=0x55daaad9cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7cca72700 1 --2- 172.21.15.81:0/1047608231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad71840 0x55daaad9cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7cca72700 1 -- 172.21.15.81:0/1047608231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daaac90780 con 0x55daaadc1c00 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7cca72700 1 --2- 172.21.15.81:0/1047608231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaadb52f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0051fe0 tx=0x7fe7c0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61548f74e7dbc141 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7adffb700 1 -- 172.21.15.81:0/1047608231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0058d30 con 0x55daaadc1c00 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7adffb700 1 -- 172.21.15.81:0/1047608231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c005ca80 con 0x55daaadc1c00 2023-10-06T02:50:04.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.463+0000 7fe7adffb700 1 -- 172.21.15.81:0/1047608231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0053e80 con 0x55daaadc1c00 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1047608231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 msgr2=0x55daaadb52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1047608231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaadb52f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0051fe0 tx=0x7fe7c0020040 comp rx=0 tx=0).stop 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1047608231 shutdown_connections 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1047608231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaadb52f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1047608231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad71840 0x55daaad9cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/1047608231 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad72cc0 0x55daaadd20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1047608231 >> 172.21.15.81:0/1047608231 conn(0x55daaad73160 msgr2=0x55daaad9dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1047608231 shutdown_connections 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/1047608231 wait complete. 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.464+0000 7fe7d77cdb80 1 -- start start 2023-10-06T02:50:04.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7d77cdb80 1 Processor -- start 2023-10-06T02:50:04.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 0x55daaae1b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 0x55daaae1e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7d77cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaad9c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaad997b0 con 0x55daaadc1c00 2023-10-06T02:50:04.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaae1f210 con 0x55daaad72cc0 2023-10-06T02:50:04.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7d77cdb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daaad9ba10 con 0x55daaad71840 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7d77cdb80 10 client.0 _ll_register_callbacks cb 0x55daaad34e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7cca72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaad9c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7cca72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaad9c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39328/0 (socket says 172.21.15.81:39328) 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7cca72700 1 -- 172.21.15.81:0/2353759358 learned_addr learned my addr 172.21.15.81:0/2353759358 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7c77fe700 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 0x55daaae1e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.465+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 0x55daaae1b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7cca72700 1 -- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 msgr2=0x55daaae1b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7cca72700 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 0x55daaae1b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7cca72700 1 -- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 msgr2=0x55daaae1e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7cca72700 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 0x55daaae1e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7cca72700 1 -- 172.21.15.81:0/2353759358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c8153fb0 con 0x55daaadc1c00 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7cca72700 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaad9c6b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00557e0 tx=0x7fe7c006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c77805361383ead server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7a67fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7a67fc700 1 -- 172.21.15.81:0/2353759358 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0058d30 con 0x55daaadc1c00 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7a67fc700 1 -- 172.21.15.81:0/2353759358 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7c0053e80 con 0x55daaadc1c00 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/2353759358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7b8011ac0 con 0x55daaadc1c00 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7a67fc700 1 -- 172.21.15.81:0/2353759358 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7c00551e0 con 0x55daaadc1c00 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7d77cdb80 10 client.6303 fetch_fsmap learned FSMap version 42 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/2353759358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55daaac77470 con 0x55daaadc1c00 2023-10-06T02:50:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7a67fc700 1 -- 172.21.15.81:0/2353759358 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0065080 con 0x55daaadc1c00 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7a67fc700 1 -- 172.21.15.81:0/2353759358 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe7c005c5f0 con 0x55daaadc1c00 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7d77cdb80 10 client.6303 fetch_fsmap finished waiting for FSMap version 42 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7d77cdb80 10 client.6303 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7d77cdb80 20 client.6303 populate_metadata read hostname 'smithi081' 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] conn(0x55daaadb59a0 0x55daaadb5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7d77cdb80 4 client.6303 mds_command: new command op to 6159 tid=0[{"prefix": "status"}] 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.466+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/2353759358 --> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55daaac64e00 con 0x55daaadb59a0 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] conn(0x55daaadb59a0 0x55daaadb5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7a67fc700 10 client.6303 ms_handle_connect on v2:172.21.15.83:6834/1398848175 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7c7fff700 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] conn(0x55daaadb59a0 0x55daaadb5d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86e92632cdf33806 server_cookie=e09445584a5bcbef in_seq=0 out_seq=0 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7a67fc700 1 -- 172.21.15.81:0/2353759358 <== mds.0 v2:172.21.15.83:6834/1398848175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55daaac64e00 con 0x55daaadb59a0 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7a67fc700 10 client.6303 handle_command_reply: tid=0 2023-10-06T02:50:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 client.6303 shutdown 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/2353759358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 msgr2=0x55daaad9c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaad9c6b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00557e0 tx=0x7fe7c006d000 comp rx=0 tx=0).stop 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/2353759358 shutdown_connections 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55daaadc1c00 0x55daaad9c6b0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55daaad71840 0x55daaae1b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:6834/1398848175,v1:172.21.15.83:6836/1398848175] conn(0x55daaadb59a0 0x55daaadb5d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 --2- 172.21.15.81:0/2353759358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55daaad72cc0 0x55daaae1e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7a67fc700 0 client.6303 ms_handle_reset on v2:172.21.15.83:6834/1398848175 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/2353759358 >> 172.21.15.81:0/2353759358 conn(0x55daaad73160 msgr2=0x55daaadd20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/2353759358 shutdown_connections 2023-10-06T02:50:04.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 1 -- 172.21.15.81:0/2353759358 wait complete. 2023-10-06T02:50:04.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.467+0000 7fe7d77cdb80 20 client.6303 trim_cache size 0 max 16384 2023-10-06T02:50:04.477 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:50:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:50:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:50:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6159, 2023-10-06T02:50:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:50:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:50:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:50:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.7869596630000002, 2023-10-06T02:50:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 42, 2023-10-06T02:50:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 84, 2023-10-06T02:50:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 84, 2023-10-06T02:50:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.766769651000001 2023-10-06T02:50:04.478 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:50:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe7b4066f30 msgr2=0x7fe7b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe7b4066f30 0x7fe7b40693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80b3940 tx=0x7fe7b8017000 comp rx=0 tx=0).stop 2023-10-06T02:50:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/4139687470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c8157ca0 msgr2=0x7fe7c8156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c8157ca0 0x7fe7c8156740 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009fa0 tx=0x7fe7c0009900 comp rx=0 tx=0).stop 2023-10-06T02:50:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/4139687470 shutdown_connections 2023-10-06T02:50:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7c8157ca0 0x7fe7c8156740 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7c806d120 0x7fe7c8153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe7b4066f30 0x7fe7b40693e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 --2- 172.21.15.81:0/4139687470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c81578d0 0x7fe7c80c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/4139687470 >> 172.21.15.81:0/4139687470 conn(0x7fe7c806bb90 msgr2=0x7fe7c8154890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:04.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/4139687470 shutdown_connections 2023-10-06T02:50:04.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.468+0000 7fe7ce4d5700 1 -- 172.21.15.81:0/4139687470 wait complete. 2023-10-06T02:50:04.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:50:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.593+0000 7f0e43615700 1 Processor -- start 2023-10-06T02:50:04.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.593+0000 7f0e43615700 1 -- start start 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.594+0000 7f0e43615700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c15a2a0 0x7f0e3c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.594+0000 7f0e43615700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e3c0ceb30 0x7f0e3c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.594+0000 7f0e43615700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0cf4e0 con 0x7f0e3c06d650 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.594+0000 7f0e43615700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c06ea90 con 0x7f0e3c0ceb30 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.594+0000 7f0e43615700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0b0ca0 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.594+0000 7f0e40bb0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e3c0ceb30 0x7f0e3c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.594+0000 7f0e40bb0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e3c0ceb30 0x7f0e3c0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39332/0 (socket says 172.21.15.81:39332) 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.594+0000 7f0e40bb0700 1 -- 172.21.15.81:0/624183720 learned_addr learned my addr 172.21.15.81:0/624183720 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.594+0000 7f0e413b1700 1 --2- 172.21.15.81:0/624183720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c15a2a0 0x7f0e3c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e40bb0700 1 -- 172.21.15.81:0/624183720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c15a2a0 msgr2=0x7f0e3c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e40bb0700 1 --2- 172.21.15.81:0/624183720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c15a2a0 0x7f0e3c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e40bb0700 1 -- 172.21.15.81:0/624183720 >> v1:172.21.15.83:6789/0 conn(0x7f0e3c06d650 legacy=0x7f0e3c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e40bb0700 1 -- 172.21.15.81:0/624183720 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0b00d0 con 0x7f0e3c0ceb30 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e413b1700 1 --2- 172.21.15.81:0/624183720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c15a2a0 0x7f0e3c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e40bb0700 1 --2- 172.21.15.81:0/624183720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c0ceb30 0x7f0e3c0cefa0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0099b0 tx=0x7f0e2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459a617a9e832ae7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e33fff700 1 -- 172.21.15.81:0/624183720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c00b860 con 0x7f0e3c0ceb30 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e33fff700 1 -- 172.21.15.81:0/624183720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c00b9c0 con 0x7f0e3c0ceb30 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e33fff700 1 -- 172.21.15.81:0/624183720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c00bd60 con 0x7f0e3c0ceb30 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e43615700 1 -- 172.21.15.81:0/624183720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c0ceb30 msgr2=0x7f0e3c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e43615700 1 --2- 172.21.15.81:0/624183720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c0ceb30 0x7f0e3c0cefa0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0099b0 tx=0x7f0e2c009250 comp rx=0 tx=0).stop 2023-10-06T02:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e43615700 1 -- 172.21.15.81:0/624183720 shutdown_connections 2023-10-06T02:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e43615700 1 --2- 172.21.15.81:0/624183720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c15a2a0 0x7f0e3c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e43615700 1 --2- 172.21.15.81:0/624183720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c0ceb30 0x7f0e3c0cefa0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.595+0000 7f0e43615700 1 -- 172.21.15.81:0/624183720 >> 172.21.15.81:0/624183720 conn(0x7f0e3c067640 msgr2=0x7f0e3c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.596+0000 7f0e43615700 1 -- 172.21.15.81:0/624183720 shutdown_connections 2023-10-06T02:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.596+0000 7f0e43615700 1 -- 172.21.15.81:0/624183720 wait complete. 2023-10-06T02:50:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.597+0000 7f0e43615700 1 Processor -- start 2023-10-06T02:50:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.597+0000 7f0e43615700 1 -- start start 2023-10-06T02:50:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.597+0000 7f0e43615700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e3c06d650 0x7f0e3c143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.597+0000 7f0e43615700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c0ceb30 0x7f0e3c15f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.597+0000 7f0e43615700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.597+0000 7f0e43615700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0b2a80 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.597+0000 7f0e43615700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0b25f0 con 0x7f0e3c06d650 2023-10-06T02:50:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.597+0000 7f0e43615700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c143d40 con 0x7f0e3c0ceb30 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e41bb2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e41bb2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c15d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39348/0 (socket says 172.21.15.81:39348) 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e41bb2700 1 -- 172.21.15.81:0/2370583768 learned_addr learned my addr 172.21.15.81:0/2370583768 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e413b1700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e3c06d650 0x7f0e3c143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e40bb0700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c0ceb30 0x7f0e3c15f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e41bb2700 1 -- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c0ceb30 msgr2=0x7f0e3c15f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e41bb2700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c0ceb30 0x7f0e3c15f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e41bb2700 1 -- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e3c06d650 msgr2=0x7f0e3c143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e41bb2700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e3c06d650 0x7f0e3c143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e41bb2700 1 -- 172.21.15.81:0/2370583768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c0094f0 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e41bb2700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c15d340 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400c8e0 tx=0x7f0e34001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e317fa700 1 -- 172.21.15.81:0/2370583768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34012630 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e317fa700 1 -- 172.21.15.81:0/2370583768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e34012790 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c0b19e0 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e317fa700 1 -- 172.21.15.81:0/2370583768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34012b50 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.598+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c0b1fa0 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.599+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c0b2780 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.600+0000 7f0e317fa700 1 -- 172.21.15.81:0/2370583768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e3401a3a0 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.600+0000 7f0e317fa700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e20066f30 0x7f0e200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.600+0000 7f0e317fa700 1 -- 172.21.15.81:0/2370583768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e34084800 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.600+0000 7f0e413b1700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e20066f30 0x7f0e200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.601+0000 7f0e413b1700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e20066f30 0x7f0e200693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0e38006f00 tx=0x7f0e38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.604+0000 7f0e317fa700 1 -- 172.21.15.81:0/2370583768 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e340553a0 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.832+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e3c04bb80 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.833+0000 7f0e317fa700 1 -- 172.21.15.81:0/2370583768 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0e34054f30 con 0x7f0e3c15a2a0 2023-10-06T02:50:04.834 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:50:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e20066f30 msgr2=0x7f0e200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e20066f30 0x7f0e200693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0e38006f00 tx=0x7f0e38008040 comp rx=0 tx=0).stop 2023-10-06T02:50:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c15a2a0 msgr2=0x7f0e3c15d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c15d340 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400c8e0 tx=0x7f0e34001710 comp rx=0 tx=0).stop 2023-10-06T02:50:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 shutdown_connections 2023-10-06T02:50:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c15d340 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e20066f30 0x7f0e200693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e3c06d650 0x7f0e3c143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 --2- 172.21.15.81:0/2370583768 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e3c0ceb30 0x7f0e3c15f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 >> 172.21.15.81:0/2370583768 conn(0x7f0e3c067640 msgr2=0x7f0e3c067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 shutdown_connections 2023-10-06T02:50:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:04.835+0000 7f0e43615700 1 -- 172.21.15.81:0/2370583768 wait complete. 2023-10-06T02:50:04.848 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:50:04.848 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:50:04.848 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:50:04.848 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:50:04.848 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:50:04.848 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:50:04.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:50:04.849 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:50:04.849 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:50:04.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:04.849 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42312sec preferred_lft 42312sec 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:50:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:50:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:50:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:04.867 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:50:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:50:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:50:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:04.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:04.867 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:50:04.927 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:50:04.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:04.928 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:50:04.984 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:50:04.984 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:50:04.984 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:50:04.984 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:50:04.984 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:50:04.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:04.985 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:50:04.985 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:50:04.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:50:04.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:50:04.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:50:04.985 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:50:05.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:05.084 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:50:05.098 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:50:05.099 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:50:05.099 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:50:05.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:05.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:50:05.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:50:05.163 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:50:05.218 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:50:05.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:50:05.218 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:50:05.272 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:50:05.272 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:50:05.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:50:05.351 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:50:05.351 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:50:05.370 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:50:05.370 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:50:05.371 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:50:05.371 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:50:05.371 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:50:05.371 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:50:05.371 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:50:05.371 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:50:05.392 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:50:05.392 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:50:05.392 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:50:05.392 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:50:05.392 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:50:05.393 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:50:05.393 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:50:05.393 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:50:05.393 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:50:05.393 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:50:05.393 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:50:05.395 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:50:05.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:05.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:50:05.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:50:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.613+0000 7f1f3dd4a700 1 Processor -- start 2023-10-06T02:50:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.613+0000 7f1f3dd4a700 1 -- start start 2023-10-06T02:50:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f3dd4a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f38157fe0 0x7f1f380b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f3dd4a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f381583b0 0x7f1f380b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f3dd4a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f380ceb30 0x7f1f380cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f3dd4a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f380cf4d0 con 0x7f1f380ceb30 2023-10-06T02:50:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f3dd4a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f380b2890 con 0x7f1f381583b0 2023-10-06T02:50:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f3dd4a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380b4070 con 0x7f1f38157fe0 2023-10-06T02:50:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f37fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f380ceb30 0x7f1f380cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f37fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f380ceb30 0x7f1f380cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39356/0 (socket says 172.21.15.81:39356) 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f37fff700 1 -- 172.21.15.81:0/1168398906 learned_addr learned my addr 172.21.15.81:0/1168398906 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f36ffd700 1 --2- 172.21.15.81:0/1168398906 >> v2:172.21.15.83:3300/0 conn(0x7f1f381583b0 0x7f1f380b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.614+0000 7f1f377fe700 1 --2- 172.21.15.81:0/1168398906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f38157fe0 0x7f1f380b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f37fff700 1 -- 172.21.15.81:0/1168398906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f38157fe0 msgr2=0x7f1f380b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f37fff700 1 --2- 172.21.15.81:0/1168398906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f38157fe0 0x7f1f380b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f37fff700 1 -- 172.21.15.81:0/1168398906 >> v2:172.21.15.83:3300/0 conn(0x7f1f381583b0 msgr2=0x7f1f380b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f37fff700 1 --2- 172.21.15.81:0/1168398906 >> v2:172.21.15.83:3300/0 conn(0x7f1f381583b0 0x7f1f380b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f37fff700 1 -- 172.21.15.81:0/1168398906 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f380b4350 con 0x7f1f380ceb30 2023-10-06T02:50:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f36ffd700 1 --2- 172.21.15.81:0/1168398906 >> v2:172.21.15.83:3300/0 conn(0x7f1f381583b0 0x7f1f380b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f377fe700 1 --2- 172.21.15.81:0/1168398906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f38157fe0 0x7f1f380b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f37fff700 1 --2- 172.21.15.81:0/1168398906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f380ceb30 0x7f1f380cef90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1f3806f9c0 tx=0x7f1f2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f81b7cc3c8d8b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f367fc700 1 -- 172.21.15.81:0/1168398906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00b860 con 0x7f1f380ceb30 2023-10-06T02:50:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f367fc700 1 -- 172.21.15.81:0/1168398906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00b9c0 con 0x7f1f380ceb30 2023-10-06T02:50:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f367fc700 1 -- 172.21.15.81:0/1168398906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00bd80 con 0x7f1f380ceb30 2023-10-06T02:50:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/1168398906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f380ceb30 msgr2=0x7f1f380cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/1168398906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f380ceb30 0x7f1f380cef90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1f3806f9c0 tx=0x7f1f2c009250 comp rx=0 tx=0).stop 2023-10-06T02:50:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/1168398906 shutdown_connections 2023-10-06T02:50:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/1168398906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f380ceb30 0x7f1f380cef90 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/1168398906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f38157fe0 0x7f1f380b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/1168398906 >> v2:172.21.15.83:3300/0 conn(0x7f1f381583b0 0x7f1f380b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/1168398906 >> 172.21.15.81:0/1168398906 conn(0x7f1f38067640 msgr2=0x7f1f38067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.615+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/1168398906 shutdown_connections 2023-10-06T02:50:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.616+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/1168398906 wait complete. 2023-10-06T02:50:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.617+0000 7f1f3dd4a700 1 Processor -- start 2023-10-06T02:50:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.617+0000 7f1f3dd4a700 1 -- start start 2023-10-06T02:50:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.617+0000 7f1f3dd4a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f380ceb30 0x7f1f38168230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.617+0000 7f1f3dd4a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38157fe0 0x7f1f380b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.617+0000 7f1f3dd4a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f381583b0 0x7f1f380c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f3dd4a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380c70c0 con 0x7f1f38157fe0 2023-10-06T02:50:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f3dd4a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380c7ae0 con 0x7f1f380ceb30 2023-10-06T02:50:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f3dd4a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380c6670 con 0x7f1f381583b0 2023-10-06T02:50:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f36ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38157fe0 0x7f1f380b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f36ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38157fe0 0x7f1f380b2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39358/0 (socket says 172.21.15.81:39358) 2023-10-06T02:50:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f36ffd700 1 -- 172.21.15.81:0/2667131378 learned_addr learned my addr 172.21.15.81:0/2667131378 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f377fe700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f380ceb30 0x7f1f38168230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f37fff700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f381583b0 0x7f1f380c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f36ffd700 1 -- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f381583b0 msgr2=0x7f1f380c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f36ffd700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f381583b0 0x7f1f380c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f36ffd700 1 -- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f380ceb30 msgr2=0x7f1f38168230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f36ffd700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f380ceb30 0x7f1f38168230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f36ffd700 1 -- 172.21.15.81:0/2667131378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c0094f0 con 0x7f1f38157fe0 2023-10-06T02:50:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f377fe700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f380ceb30 0x7f1f38168230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f36ffd700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38157fe0 0x7f1f380b2ff0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800e850 tx=0x7f1f28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f1f7fe700 1 -- 172.21.15.81:0/2667131378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28013410 con 0x7f1f38157fe0 2023-10-06T02:50:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f1f7fe700 1 -- 172.21.15.81:0/2667131378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28013570 con 0x7f1f38157fe0 2023-10-06T02:50:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f1f7fe700 1 -- 172.21.15.81:0/2667131378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28013910 con 0x7f1f38157fe0 2023-10-06T02:50:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f380c6950 con 0x7f1f38157fe0 2023-10-06T02:50:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.618+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f38168770 con 0x7f1f38157fe0 2023-10-06T02:50:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.619+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f380c7c90 con 0x7f1f38157fe0 2023-10-06T02:50:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.619+0000 7f1f1f7fe700 1 -- 172.21.15.81:0/2667131378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f28013d00 con 0x7f1f38157fe0 2023-10-06T02:50:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.620+0000 7f1f1f7fe700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f24066f30 0x7f1f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.620+0000 7f1f1f7fe700 1 -- 172.21.15.81:0/2667131378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f280843e0 con 0x7f1f38157fe0 2023-10-06T02:50:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.620+0000 7f1f377fe700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f24066f30 0x7f1f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.620+0000 7f1f377fe700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f24066f30 0x7f1f240693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1f300076e0 tx=0x7f1f300098f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.624+0000 7f1f1f7fe700 1 -- 172.21.15.81:0/2667131378 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f380c7c90 con 0x7f1f38157fe0 2023-10-06T02:50:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.854+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f380c7c90 con 0x7f1f38157fe0 2023-10-06T02:50:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.854+0000 7f1f1f7fe700 1 -- 172.21.15.81:0/2667131378 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f380c7c90 con 0x7f1f38157fe0 2023-10-06T02:50:05.856 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f24066f30 msgr2=0x7f1f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f24066f30 0x7f1f240693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1f300076e0 tx=0x7f1f300098f0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38157fe0 msgr2=0x7f1f380b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38157fe0 0x7f1f380b2ff0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800e850 tx=0x7f1f28008040 comp rx=0 tx=0).stop 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 shutdown_connections 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f381583b0 0x7f1f380c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f24066f30 0x7f1f240693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f380ceb30 0x7f1f38168230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 --2- 172.21.15.81:0/2667131378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38157fe0 0x7f1f380b2ff0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 >> 172.21.15.81:0/2667131378 conn(0x7f1f38067640 msgr2=0x7f1f380cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 shutdown_connections 2023-10-06T02:50:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:05.856+0000 7f1f3dd4a700 1 -- 172.21.15.81:0/2667131378 wait complete. 2023-10-06T02:50:05.869 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:50:05.869 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:50:05.869 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:50:05.869 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:50:05.869 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:50:05.870 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:50:05.870 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:50:05.870 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:50:05.870 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:50:05.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:05.870 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:50:05.889 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:50:05.889 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:50:05.889 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:50:05.889 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:05.889 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:50:05.889 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:05.889 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:50:05.889 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:50:05.890 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42311sec preferred_lft 42311sec 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:50:05.891 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:05.892 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:50:05.892 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:50:05.892 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:50:05.892 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:50:05.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:05.892 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:50:05.958 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:50:05.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:05.961 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:50:06.019 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:50:06.019 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:50:06.019 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:50:06.019 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:50:06.020 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:50:06.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:06.020 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:50:06.020 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:50:06.020 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:50:06.020 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:50:06.020 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:50:06.020 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:50:06.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:06.128 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:50:06.142 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:50:06.143 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:50:06.143 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:50:06.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:06.143 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:50:06.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:50:06.207 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:50:06.263 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:50:06.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:50:06.263 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:50:06.317 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:50:06.317 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:50:06.317 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:50:06.403 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:50:06.403 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:50:06.418 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:50:06.418 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:50:06.418 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:50:06.418 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:50:06.418 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:50:06.418 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:50:06.419 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:50:06.419 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:50:06.439 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:50:06.439 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:50:06.439 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:50:06.439 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:50:06.439 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:50:06.439 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:50:06.440 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:50:06.440 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:50:06.440 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:50:06.440 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:50:06.440 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:50:06.441 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:50:06.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:06.442 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:50:06.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:50:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.620+0000 7f85d759e700 1 Processor -- start 2023-10-06T02:50:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.620+0000 7f85d759e700 1 -- start start 2023-10-06T02:50:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159bc0 0x7f85d80b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85d8159f90 0x7f85d806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d8067640 con 0x7f85d8068370 2023-10-06T02:50:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d80b1e50 con 0x7f85d8159f90 2023-10-06T02:50:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d8067890 con 0x7f85d8159bc0 2023-10-06T02:50:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d5d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85d8159f90 0x7f85d806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d6d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f85d8068370 0x7f85d80ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39628/0 (socket says 172.21.15.81:39628) 2023-10-06T02:50:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d6d9d700 1 -- 172.21.15.81:0/1976978281 learned_addr learned my addr 172.21.15.81:0/1976978281 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d659c700 1 --2- 172.21.15.81:0/1976978281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159bc0 0x7f85d80b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d5d9b700 1 -- 172.21.15.81:0/1976978281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159bc0 msgr2=0x7f85d80b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d5d9b700 1 --2- 172.21.15.81:0/1976978281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159bc0 0x7f85d80b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d5d9b700 1 -- 172.21.15.81:0/1976978281 >> v1:172.21.15.81:6789/0 conn(0x7f85d8068370 legacy=0x7f85d80ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d5d9b700 1 -- 172.21.15.81:0/1976978281 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8067b70 con 0x7f85d8159f90 2023-10-06T02:50:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d559a700 1 -- 172.21.15.81:0/1976978281 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900428050 0 0) 0x7f85d8067640 con 0x7f85d8068370 2023-10-06T02:50:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.621+0000 7f85d5d9b700 1 --2- 172.21.15.81:0/1976978281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159f90 0x7f85d806b0d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0098e0 tx=0x7f85cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae48ff8bbc179ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d559a700 1 -- 172.21.15.81:0/1976978281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc009e80 con 0x7f85d8159f90 2023-10-06T02:50:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d559a700 1 -- 172.21.15.81:0/1976978281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00b860 con 0x7f85d8159f90 2023-10-06T02:50:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d559a700 1 -- 172.21.15.81:0/1976978281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00bbe0 con 0x7f85d8159f90 2023-10-06T02:50:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d759e700 1 -- 172.21.15.81:0/1976978281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159f90 msgr2=0x7f85d806b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d759e700 1 --2- 172.21.15.81:0/1976978281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159f90 0x7f85d806b0d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0098e0 tx=0x7f85cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d759e700 1 -- 172.21.15.81:0/1976978281 shutdown_connections 2023-10-06T02:50:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d759e700 1 --2- 172.21.15.81:0/1976978281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159bc0 0x7f85d80b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d759e700 1 --2- 172.21.15.81:0/1976978281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159f90 0x7f85d806b0d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d759e700 1 -- 172.21.15.81:0/1976978281 >> 172.21.15.81:0/1976978281 conn(0x7f85d806c620 msgr2=0x7f85d806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d759e700 1 -- 172.21.15.81:0/1976978281 shutdown_connections 2023-10-06T02:50:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.622+0000 7f85d759e700 1 -- 172.21.15.81:0/1976978281 wait complete. 2023-10-06T02:50:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.623+0000 7f85d759e700 1 Processor -- start 2023-10-06T02:50:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.623+0000 7f85d759e700 1 -- start start 2023-10-06T02:50:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d8068370 0x7f85d816b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159bc0 0x7f85d80b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159f90 0x7f85d815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d80b0860 con 0x7f85d8159bc0 2023-10-06T02:50:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d815b160 con 0x7f85d8068370 2023-10-06T02:50:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d815a590 con 0x7f85d8159f90 2023-10-06T02:50:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159bc0 0x7f85d80b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159bc0 0x7f85d80b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39366/0 (socket says 172.21.15.81:39366) 2023-10-06T02:50:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d5d9b700 1 -- 172.21.15.81:0/926713748 learned_addr learned my addr 172.21.15.81:0/926713748 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d659c700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d8068370 0x7f85d816b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d6d9d700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159f90 0x7f85d815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d5d9b700 1 -- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159f90 msgr2=0x7f85d815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d5d9b700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159f90 0x7f85d815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d5d9b700 1 -- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d8068370 msgr2=0x7f85d816b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d5d9b700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d8068370 0x7f85d816b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d5d9b700 1 -- 172.21.15.81:0/926713748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc009420 con 0x7f85d8159bc0 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.624+0000 7f85d6d9d700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159f90 0x7f85d815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.625+0000 7f85d5d9b700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159bc0 0x7f85d80b0320 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f85cc013000 tx=0x7f85cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.625+0000 7f85c67fc700 1 -- 172.21.15.81:0/926713748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00b9d0 con 0x7f85d8159bc0 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.625+0000 7f85c67fc700 1 -- 172.21.15.81:0/926713748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00bb50 con 0x7f85d8159bc0 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.625+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d815a830 con 0x7f85d8159bc0 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.625+0000 7f85c67fc700 1 -- 172.21.15.81:0/926713748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc025670 con 0x7f85d8159bc0 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.625+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d815adf0 con 0x7f85d8159bc0 2023-10-06T02:50:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.626+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d8069920 con 0x7f85d8159bc0 2023-10-06T02:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.626+0000 7f85c67fc700 1 -- 172.21.15.81:0/926713748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85cc023070 con 0x7f85d8159bc0 2023-10-06T02:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.626+0000 7f85c67fc700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85b8066f30 0x7f85b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.627+0000 7f85c67fc700 1 -- 172.21.15.81:0/926713748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f85cc085ba0 con 0x7f85d8159bc0 2023-10-06T02:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.627+0000 7f85d659c700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85b8066f30 0x7f85b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.627+0000 7f85d659c700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85b8066f30 0x7f85b80693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f85c8006fd0 tx=0x7f85c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.631+0000 7f85c67fc700 1 -- 172.21.15.81:0/926713748 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85cc052cb0 con 0x7f85d8159bc0 2023-10-06T02:50:06.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:50:06.806 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:50:06.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.863+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85d8071b10 con 0x7f85d8159bc0 2023-10-06T02:50:06.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.864+0000 7f85c67fc700 1 -- 172.21.15.81:0/926713748 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f85cc015090 con 0x7f85d8159bc0 2023-10-06T02:50:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:06.865 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2330757810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2330757810},{"type":"v1","addr":"172.21.15.83:6837","nonce":2330757810}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2957658297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2957658297},{"type":"v1","addr":"172.21.15.81:6834","nonce":2957658297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4153630712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4153630712},{"type":"v1","addr":"172.21.15.81:6835","nonce":4153630712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:49:58.066126+0000","modified":"2023-10-06T02:50:01.693730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/1398848175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1398848175},{"type":"v1","addr":"172.21.15.83:6836","nonce":1398848175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:50:06.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85b8066f30 msgr2=0x7f85b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85b8066f30 0x7f85b80693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f85c8006fd0 tx=0x7f85c8008040 comp rx=0 tx=0).stop 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159bc0 msgr2=0x7f85d80b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159bc0 0x7f85d80b0320 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f85cc013000 tx=0x7f85cc017000 comp rx=0 tx=0).stop 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 shutdown_connections 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85d8159f90 0x7f85d815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f85b8066f30 0x7f85b80693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d8068370 0x7f85d816b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 --2- 172.21.15.81:0/926713748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d8159bc0 0x7f85d80b0320 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 >> 172.21.15.81:0/926713748 conn(0x7f85d806c620 msgr2=0x7f85d8157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 shutdown_connections 2023-10-06T02:50:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:06.866+0000 7f85d759e700 1 -- 172.21.15.81:0/926713748 wait complete. 2023-10-06T02:50:06.869 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2023-10-06T02:50:06.879 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-06T02:50:07.012 INFO:teuthology.orchestra.run.smithi083.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":6159,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3216788279999996,"mdsmap_epoch":42,"osdmap_epoch":84,"osdmap_epoch_barrier":84,"uptime":14.301494782000001} 2023-10-06T02:50:07.013 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 6159, "mdsmap_epoch": 42, "osdmap_epoch": 84, "osdmap_epoch_barrier": 84, "rank_uptime": 8.321678828, "state": "up:active", "uptime": 14.301494782, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:50:07.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-06T02:50:07.142 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-06T02:50:07.143 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-06T02:50:07.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-06T02:50:07.264 INFO:teuthology.orchestra.run.smithi081.stdout:{"mon_tick_interval":"5"} 2023-10-06T02:50:07.264 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-06T02:50:07.265 INFO:tasks.cephfs.test_full:pool capacity 557004352, 531MB should be enough to fill it 2023-10-06T02:50:07.265 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:50:07.265 DEBUG:teuthology.orchestra.run.smithi081:> import time 2023-10-06T02:50:07.265 DEBUG:teuthology.orchestra.run.smithi081:> import datetime 2023-10-06T02:50:07.265 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-10-06T02:50:07.265 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:50:07.265 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:50:07.265 DEBUG:teuthology.orchestra.run.smithi081:> # Write some buffered data through before going full, all should be well 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> print("writing some data through which we expect to succeed") 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> bytes = 0 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> # buffered IO, the error should always only appear from fsync and not 2023-10-06T02:50:07.266 DEBUG:teuthology.orchestra.run.smithi081:> # from write 2023-10-06T02:50:07.267 DEBUG:teuthology.orchestra.run.smithi081:> full = False 2023-10-06T02:50:07.267 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:50:07.267 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(531 * 1.1)): 2023-10-06T02:50:07.267 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-06T02:50:07.267 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-06T02:50:07.267 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-06T02:50:07.267 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2023-10-06T02:50:07.268 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-06T02:50:07.268 DEBUG:teuthology.orchestra.run.smithi081:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-06T02:50:07.268 DEBUG:teuthology.orchestra.run.smithi081:> raise 2023-10-06T02:50:07.268 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-06T02:50:07.268 DEBUG:teuthology.orchestra.run.smithi081:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-06T02:50:07.268 DEBUG:teuthology.orchestra.run.smithi081:> full = True 2023-10-06T02:50:07.268 DEBUG:teuthology.orchestra.run.smithi081:> break 2023-10-06T02:50:07.268 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:50:07.268 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed successfully") 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> full = True 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> break 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> if n > 531 * 0.9: 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> # Be cautious in the last region where we expect to hit 2023-10-06T02:50:07.269 DEBUG:teuthology.orchestra.run.smithi081:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-06T02:50:07.270 DEBUG:teuthology.orchestra.run.smithi081:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-06T02:50:07.270 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(15.0) 2023-10-06T02:50:07.270 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:50:07.270 DEBUG:teuthology.orchestra.run.smithi081:> if not full: 2023-10-06T02:50:07.270 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-06T02:50:07.270 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:50:07.270 DEBUG:teuthology.orchestra.run.smithi081:> # close() should not raise an error because we already caught it in 2023-10-06T02:50:07.271 DEBUG:teuthology.orchestra.run.smithi081:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-06T02:50:07.271 DEBUG:teuthology.orchestra.run.smithi081:> # since then because all IOs got cancelled on the full flag. 2023-10-06T02:50:07.271 DEBUG:teuthology.orchestra.run.smithi081:> print("calling close") 2023-10-06T02:50:07.271 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-06T02:50:07.271 DEBUG:teuthology.orchestra.run.smithi081:> print("close() did not raise error") 2023-10-06T02:50:07.271 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:50:07.271 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-06T02:50:07.272 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:50:07.903 INFO:teuthology.orchestra.run.smithi081.stdout:writing some data through which we expect to succeed 2023-10-06T02:50:07.903 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-06T02:50:07.903 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.903 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.903 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 1.00 MB 2023-10-06T02:50:07.903 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.903 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 2.00 MB 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 3.00 MB 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 4.00 MB 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 5.00 MB 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 6.00 MB 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 7.00 MB 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 8.00 MB 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 9.00 MB 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.905 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 10.00 MB 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 11.00 MB 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 12.00 MB 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 13.00 MB 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.906 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 14.00 MB 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 15.00 MB 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 16.00 MB 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 17.00 MB 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.907 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 18.00 MB 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 19.00 MB 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 20.00 MB 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 21.00 MB 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.908 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 22.00 MB 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 23.00 MB 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 24.00 MB 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 25.00 MB 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.909 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 26.00 MB 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 27.00 MB 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 28.00 MB 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 29.00 MB 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 30.00 MB 2023-10-06T02:50:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 31.00 MB 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 32.00 MB 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 33.00 MB 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 34.00 MB 2023-10-06T02:50:07.911 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 35.00 MB 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 36.00 MB 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 37.00 MB 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.912 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 38.00 MB 2023-10-06T02:50:07.913 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.913 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.913 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 39.00 MB 2023-10-06T02:50:07.913 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.913 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.913 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 40.00 MB 2023-10-06T02:50:07.913 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.914 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.914 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 41.00 MB 2023-10-06T02:50:07.914 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.914 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.914 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 42.00 MB 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 43.00 MB 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 44.00 MB 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 45.00 MB 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.916 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 46.00 MB 2023-10-06T02:50:07.916 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.916 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.916 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 47.00 MB 2023-10-06T02:50:07.916 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.916 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.916 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 48.00 MB 2023-10-06T02:50:07.916 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.917 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.917 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 49.00 MB 2023-10-06T02:50:07.917 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.918 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.918 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 50.00 MB 2023-10-06T02:50:07.918 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.918 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.919 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 51.00 MB 2023-10-06T02:50:07.919 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.919 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.919 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 52.00 MB 2023-10-06T02:50:07.919 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.919 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.920 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 53.00 MB 2023-10-06T02:50:07.920 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.920 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.920 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 54.00 MB 2023-10-06T02:50:07.920 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.920 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.921 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 55.00 MB 2023-10-06T02:50:07.921 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.921 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.921 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 56.00 MB 2023-10-06T02:50:07.921 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.921 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.922 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 57.00 MB 2023-10-06T02:50:07.922 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.922 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.922 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 58.00 MB 2023-10-06T02:50:07.922 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.922 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.922 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 59.00 MB 2023-10-06T02:50:07.923 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.924 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.924 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 60.00 MB 2023-10-06T02:50:07.924 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.924 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.925 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 61.00 MB 2023-10-06T02:50:07.925 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.925 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.925 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 62.00 MB 2023-10-06T02:50:07.926 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.926 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.926 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 63.00 MB 2023-10-06T02:50:07.926 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.926 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.926 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 64.00 MB 2023-10-06T02:50:07.927 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.927 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.927 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 65.00 MB 2023-10-06T02:50:07.927 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.927 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.928 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 66.00 MB 2023-10-06T02:50:07.928 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.928 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.928 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 67.00 MB 2023-10-06T02:50:07.929 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.929 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.929 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 68.00 MB 2023-10-06T02:50:07.929 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.929 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.930 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 69.00 MB 2023-10-06T02:50:07.930 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.930 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.930 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 70.00 MB 2023-10-06T02:50:07.930 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.930 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.931 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 71.00 MB 2023-10-06T02:50:07.931 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.931 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.931 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 72.00 MB 2023-10-06T02:50:07.931 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.931 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.932 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 73.00 MB 2023-10-06T02:50:07.932 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.932 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.932 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 74.00 MB 2023-10-06T02:50:07.932 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.932 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.932 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 75.00 MB 2023-10-06T02:50:07.932 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.933 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.933 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 76.00 MB 2023-10-06T02:50:07.933 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.933 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.933 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 77.00 MB 2023-10-06T02:50:07.933 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.933 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.933 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 78.00 MB 2023-10-06T02:50:07.934 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.934 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.934 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 79.00 MB 2023-10-06T02:50:07.934 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:07.934 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:07.934 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 80.00 MB 2023-10-06T02:50:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 81.00 MB 2023-10-06T02:50:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 82.00 MB 2023-10-06T02:50:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 83.00 MB 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 84.00 MB 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 85.00 MB 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 86.00 MB 2023-10-06T02:50:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 87.00 MB 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 88.00 MB 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 89.00 MB 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 90.00 MB 2023-10-06T02:50:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 91.00 MB 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 92.00 MB 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 93.00 MB 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 94.00 MB 2023-10-06T02:50:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 95.00 MB 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 96.00 MB 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 97.00 MB 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 98.00 MB 2023-10-06T02:50:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 99.00 MB 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 100.00 MB 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 101.00 MB 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 102.00 MB 2023-10-06T02:50:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 103.00 MB 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 104.00 MB 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 105.00 MB 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.106 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 106.00 MB 2023-10-06T02:50:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 107.00 MB 2023-10-06T02:50:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 108.00 MB 2023-10-06T02:50:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 109.00 MB 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 110.00 MB 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 111.00 MB 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 112.00 MB 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 113.00 MB 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 114.00 MB 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 115.00 MB 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.109 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 116.00 MB 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 117.00 MB 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 118.00 MB 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 119.00 MB 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 120.00 MB 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 121.00 MB 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 122.00 MB 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 123.00 MB 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.111 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 124.00 MB 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 125.00 MB 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 126.00 MB 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 127.00 MB 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.112 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 128.00 MB 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 129.00 MB 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 130.00 MB 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 131.00 MB 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 132.00 MB 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 133.00 MB 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 134.00 MB 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 135.00 MB 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 136.00 MB 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 137.00 MB 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 138.00 MB 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 139.00 MB 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 140.00 MB 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 141.00 MB 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 142.00 MB 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 143.00 MB 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 144.00 MB 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 145.00 MB 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 146.00 MB 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 147.00 MB 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.117 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.118 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 148.00 MB 2023-10-06T02:50:08.118 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.118 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.118 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 149.00 MB 2023-10-06T02:50:08.118 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.118 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.118 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 150.00 MB 2023-10-06T02:50:08.118 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 151.00 MB 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 152.00 MB 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 153.00 MB 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.119 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 154.00 MB 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 155.00 MB 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 156.00 MB 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 157.00 MB 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 158.00 MB 2023-10-06T02:50:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 159.00 MB 2023-10-06T02:50:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 160.00 MB 2023-10-06T02:50:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 161.00 MB 2023-10-06T02:50:08.287 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 162.00 MB 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 163.00 MB 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 164.00 MB 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.288 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 165.00 MB 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 166.00 MB 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 167.00 MB 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 168.00 MB 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.289 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 169.00 MB 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 170.00 MB 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 171.00 MB 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 172.00 MB 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 173.00 MB 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 174.00 MB 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 175.00 MB 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.291 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 176.00 MB 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 177.00 MB 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 178.00 MB 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 179.00 MB 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.292 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 180.00 MB 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 181.00 MB 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 182.00 MB 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 183.00 MB 2023-10-06T02:50:08.293 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 184.00 MB 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 185.00 MB 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 186.00 MB 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 187.00 MB 2023-10-06T02:50:08.294 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 188.00 MB 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 189.00 MB 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 190.00 MB 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 191.00 MB 2023-10-06T02:50:08.295 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.296 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.296 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 192.00 MB 2023-10-06T02:50:08.296 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.296 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.296 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 193.00 MB 2023-10-06T02:50:08.296 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.296 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.296 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 194.00 MB 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 195.00 MB 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 196.00 MB 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 197.00 MB 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.297 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 198.00 MB 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 199.00 MB 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 200.00 MB 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 201.00 MB 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.298 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 202.00 MB 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 203.00 MB 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 204.00 MB 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 205.00 MB 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 206.00 MB 2023-10-06T02:50:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 207.00 MB 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 208.00 MB 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 209.00 MB 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 210.00 MB 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 211.00 MB 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 212.00 MB 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 213.00 MB 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 214.00 MB 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 215.00 MB 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 216.00 MB 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 217.00 MB 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 218.00 MB 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.302 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 219.00 MB 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 220.00 MB 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 221.00 MB 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 222.00 MB 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.303 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 223.00 MB 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 224.00 MB 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 225.00 MB 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 226.00 MB 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 227.00 MB 2023-10-06T02:50:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 228.00 MB 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 229.00 MB 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 230.00 MB 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 231.00 MB 2023-10-06T02:50:08.305 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 232.00 MB 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 233.00 MB 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 234.00 MB 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 235.00 MB 2023-10-06T02:50:08.306 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 236.00 MB 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 237.00 MB 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 238.00 MB 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 239.00 MB 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.307 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.308 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 240.00 MB 2023-10-06T02:50:08.308 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.308 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.308 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 241.00 MB 2023-10-06T02:50:08.484 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.484 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.484 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 242.00 MB 2023-10-06T02:50:08.484 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.484 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 243.00 MB 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 244.00 MB 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 245.00 MB 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 246.00 MB 2023-10-06T02:50:08.486 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.486 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.486 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 247.00 MB 2023-10-06T02:50:08.486 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.486 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.486 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 248.00 MB 2023-10-06T02:50:08.486 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.486 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.486 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 249.00 MB 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 250.00 MB 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 251.00 MB 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 252.00 MB 2023-10-06T02:50:08.487 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 253.00 MB 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 254.00 MB 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 255.00 MB 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.488 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 256.00 MB 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 257.00 MB 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 258.00 MB 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 259.00 MB 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 260.00 MB 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 261.00 MB 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 262.00 MB 2023-10-06T02:50:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 263.00 MB 2023-10-06T02:50:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 264.00 MB 2023-10-06T02:50:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 265.00 MB 2023-10-06T02:50:08.491 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 266.00 MB 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 267.00 MB 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 268.00 MB 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.492 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 269.00 MB 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 270.00 MB 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 271.00 MB 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.493 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 272.00 MB 2023-10-06T02:50:08.494 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.494 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.494 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 273.00 MB 2023-10-06T02:50:08.494 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.494 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.494 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 274.00 MB 2023-10-06T02:50:08.494 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.494 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.494 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 275.00 MB 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 276.00 MB 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 277.00 MB 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 278.00 MB 2023-10-06T02:50:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 279.00 MB 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 280.00 MB 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 281.00 MB 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.496 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 282.00 MB 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 283.00 MB 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 284.00 MB 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 285.00 MB 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 286.00 MB 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 287.00 MB 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 288.00 MB 2023-10-06T02:50:08.498 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.499 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.499 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 289.00 MB 2023-10-06T02:50:08.499 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.499 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.499 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 290.00 MB 2023-10-06T02:50:08.499 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.499 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.499 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 291.00 MB 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 292.00 MB 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 293.00 MB 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 294.00 MB 2023-10-06T02:50:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 295.00 MB 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 296.00 MB 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 297.00 MB 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 298.00 MB 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 299.00 MB 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 300.00 MB 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.502 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 301.00 MB 2023-10-06T02:50:08.503 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.503 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.503 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 302.00 MB 2023-10-06T02:50:08.503 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.503 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.503 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 303.00 MB 2023-10-06T02:50:08.503 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.503 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.503 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 304.00 MB 2023-10-06T02:50:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 305.00 MB 2023-10-06T02:50:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 306.00 MB 2023-10-06T02:50:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 307.00 MB 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 308.00 MB 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 309.00 MB 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 310.00 MB 2023-10-06T02:50:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 311.00 MB 2023-10-06T02:50:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 312.00 MB 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 313.00 MB 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 314.00 MB 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 315.00 MB 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 316.00 MB 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 317.00 MB 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 318.00 MB 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 319.00 MB 2023-10-06T02:50:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 320.00 MB 2023-10-06T02:50:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 321.00 MB 2023-10-06T02:50:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 322.00 MB 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 323.00 MB 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 324.00 MB 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 325.00 MB 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 326.00 MB 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 327.00 MB 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 328.00 MB 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 329.00 MB 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 330.00 MB 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 331.00 MB 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 332.00 MB 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 333.00 MB 2023-10-06T02:50:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 334.00 MB 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 335.00 MB 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 336.00 MB 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 337.00 MB 2023-10-06T02:50:08.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 338.00 MB 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 339.00 MB 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 340.00 MB 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.680 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 341.00 MB 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 342.00 MB 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 343.00 MB 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 344.00 MB 2023-10-06T02:50:08.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.682 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 345.00 MB 2023-10-06T02:50:08.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.682 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 346.00 MB 2023-10-06T02:50:08.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.682 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 347.00 MB 2023-10-06T02:50:08.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 348.00 MB 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 349.00 MB 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 350.00 MB 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 351.00 MB 2023-10-06T02:50:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 352.00 MB 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 353.00 MB 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 354.00 MB 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 355.00 MB 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 356.00 MB 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 357.00 MB 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 358.00 MB 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.685 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 359.00 MB 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 360.00 MB 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 361.00 MB 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 362.00 MB 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 363.00 MB 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 364.00 MB 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 365.00 MB 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 366.00 MB 2023-10-06T02:50:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 367.00 MB 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 368.00 MB 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 369.00 MB 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 370.00 MB 2023-10-06T02:50:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 371.00 MB 2023-10-06T02:50:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 372.00 MB 2023-10-06T02:50:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.690 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 373.00 MB 2023-10-06T02:50:08.690 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.690 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.690 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 374.00 MB 2023-10-06T02:50:08.693 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.693 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.693 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 375.00 MB 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 376.00 MB 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 377.00 MB 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 378.00 MB 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.694 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 379.00 MB 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 380.00 MB 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 381.00 MB 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 382.00 MB 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.695 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 383.00 MB 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 384.00 MB 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 385.00 MB 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 386.00 MB 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.696 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 387.00 MB 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 388.00 MB 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 389.00 MB 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 390.00 MB 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 391.00 MB 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 392.00 MB 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 393.00 MB 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 394.00 MB 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 395.00 MB 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 396.00 MB 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 397.00 MB 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 398.00 MB 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.699 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 399.00 MB 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 400.00 MB 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 401.00 MB 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:08.700 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 402.00 MB 2023-10-06T02:50:10.391 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:50:10.390+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-06T02:50:19.390 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:50:19.390+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-06T02:50:36.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:50:36.864 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:50:38.926 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.926 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.926 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 403.00 MB 2023-10-06T02:50:38.926 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.926 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.927 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 404.00 MB 2023-10-06T02:50:38.930 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.930 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.930 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 405.00 MB 2023-10-06T02:50:38.931 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.931 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.931 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 406.00 MB 2023-10-06T02:50:38.931 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.931 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.931 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 407.00 MB 2023-10-06T02:50:38.932 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.932 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.932 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 408.00 MB 2023-10-06T02:50:38.932 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.932 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.932 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 409.00 MB 2023-10-06T02:50:38.933 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.933 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.933 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 410.00 MB 2023-10-06T02:50:38.933 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.933 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.933 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 411.00 MB 2023-10-06T02:50:38.933 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.933 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 412.00 MB 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 413.00 MB 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 414.00 MB 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 415.00 MB 2023-10-06T02:50:38.934 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 416.00 MB 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 417.00 MB 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 418.00 MB 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.935 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 419.00 MB 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 420.00 MB 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 421.00 MB 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 422.00 MB 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 423.00 MB 2023-10-06T02:50:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 424.00 MB 2023-10-06T02:50:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 425.00 MB 2023-10-06T02:50:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 426.00 MB 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 427.00 MB 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 428.00 MB 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 429.00 MB 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.938 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 430.00 MB 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 431.00 MB 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 432.00 MB 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 433.00 MB 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 434.00 MB 2023-10-06T02:50:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 435.00 MB 2023-10-06T02:50:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 436.00 MB 2023-10-06T02:50:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 437.00 MB 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 438.00 MB 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 439.00 MB 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 440.00 MB 2023-10-06T02:50:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 441.00 MB 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 442.00 MB 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 443.00 MB 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.942 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 444.00 MB 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 445.00 MB 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 446.00 MB 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 447.00 MB 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 448.00 MB 2023-10-06T02:50:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 449.00 MB 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 450.00 MB 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 451.00 MB 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 452.00 MB 2023-10-06T02:50:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 453.00 MB 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 454.00 MB 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 455.00 MB 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 456.00 MB 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 457.00 MB 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 458.00 MB 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 459.00 MB 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 460.00 MB 2023-10-06T02:50:38.947 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.947 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.947 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 461.00 MB 2023-10-06T02:50:38.947 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.947 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.947 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 462.00 MB 2023-10-06T02:50:38.948 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.948 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.948 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 463.00 MB 2023-10-06T02:50:38.948 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.948 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.948 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 464.00 MB 2023-10-06T02:50:38.949 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.949 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.949 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 465.00 MB 2023-10-06T02:50:38.949 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.949 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.949 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 466.00 MB 2023-10-06T02:50:38.950 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.950 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.950 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 467.00 MB 2023-10-06T02:50:38.950 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.950 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.950 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 468.00 MB 2023-10-06T02:50:38.950 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.950 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.951 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 469.00 MB 2023-10-06T02:50:38.951 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.951 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.951 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 470.00 MB 2023-10-06T02:50:38.951 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.951 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.951 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 471.00 MB 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 472.00 MB 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 473.00 MB 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 474.00 MB 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 475.00 MB 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 476.00 MB 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 477.00 MB 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 478.00 MB 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.953 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 479.00 MB 2023-10-06T02:50:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:50:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:50:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:50:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 480.00 MB 2023-10-06T02:50:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:50:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:Reached fullness after 480.00 MB 2023-10-06T02:50:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:calling close 2023-10-06T02:50:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:close() did not raise error 2023-10-06T02:50:38.968 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:50:38.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:50:39.008 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:50:39.054 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:50:39.054 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:50:39.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:50:39.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:50:39.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:50:39.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:39.097 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:50:39.153 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:50:39.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:50:39.153 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:50:39.197 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:50:39.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:50:39.197 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:50:39.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:50:39.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.328+0000 7f9b6313e700 1 Processor -- start 2023-10-06T02:50:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.328+0000 7f9b6313e700 1 -- start start 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.329+0000 7f9b6313e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c159f10 0x7f9b5c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.329+0000 7f9b6313e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9b5c068cc0 0x7f9b5c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.329+0000 7f9b6313e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c0cee10 con 0x7f9b5c159b40 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.329+0000 7f9b6313e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c069140 con 0x7f9b5c068cc0 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.329+0000 7f9b6313e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0cd040 con 0x7f9b5c159f10 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.329+0000 7f9b6293d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9b5c068cc0 0x7f9b5c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.329+0000 7f9b6193b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c159f10 0x7f9b5c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.329+0000 7f9b6213c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9b5c159b40 0x7f9b5c0cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:50202/0 (socket says 172.21.15.81:50202) 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.329+0000 7f9b6213c700 1 -- 172.21.15.81:0/985610757 learned_addr learned my addr 172.21.15.81:0/985610757 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6193b700 1 -- 172.21.15.81:0/985610757 >> v2:172.21.15.83:3300/0 conn(0x7f9b5c068cc0 msgr2=0x7f9b5c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6193b700 1 --2- 172.21.15.81:0/985610757 >> v2:172.21.15.83:3300/0 conn(0x7f9b5c068cc0 0x7f9b5c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6193b700 1 -- 172.21.15.81:0/985610757 >> v1:172.21.15.83:6789/0 conn(0x7f9b5c159b40 legacy=0x7f9b5c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6193b700 1 -- 172.21.15.81:0/985610757 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0cd320 con 0x7f9b5c159f10 2023-10-06T02:50:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6113a700 1 -- 172.21.15.81:0/985610757 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086166624 0 0) 0x7f9b5c0cee10 con 0x7f9b5c159b40 2023-10-06T02:50:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6293d700 1 --2- 172.21.15.81:0/985610757 >> v2:172.21.15.83:3300/0 conn(0x7f9b5c068cc0 0x7f9b5c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:50:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6193b700 1 --2- 172.21.15.81:0/985610757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c159f10 0x7f9b5c068780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0098e0 tx=0x7f9b4c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3fdf3cf3b2f126c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6113a700 1 -- 172.21.15.81:0/985610757 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00b640 con 0x7f9b5c159f10 2023-10-06T02:50:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6113a700 1 -- 172.21.15.81:0/985610757 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c00b7a0 con 0x7f9b5c159f10 2023-10-06T02:50:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6113a700 1 -- 172.21.15.81:0/985610757 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00bb40 con 0x7f9b5c159f10 2023-10-06T02:50:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6313e700 1 -- 172.21.15.81:0/985610757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c159f10 msgr2=0x7f9b5c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.330+0000 7f9b6313e700 1 --2- 172.21.15.81:0/985610757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c159f10 0x7f9b5c068780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0098e0 tx=0x7f9b4c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.331+0000 7f9b6313e700 1 -- 172.21.15.81:0/985610757 shutdown_connections 2023-10-06T02:50:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.331+0000 7f9b6313e700 1 --2- 172.21.15.81:0/985610757 >> v2:172.21.15.83:3300/0 conn(0x7f9b5c068cc0 0x7f9b5c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.331+0000 7f9b6313e700 1 --2- 172.21.15.81:0/985610757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c159f10 0x7f9b5c068780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.331+0000 7f9b6313e700 1 -- 172.21.15.81:0/985610757 >> 172.21.15.81:0/985610757 conn(0x7f9b5c0cd660 msgr2=0x7f9b5c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.331+0000 7f9b6313e700 1 -- 172.21.15.81:0/985610757 shutdown_connections 2023-10-06T02:50:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.331+0000 7f9b6313e700 1 -- 172.21.15.81:0/985610757 wait complete. 2023-10-06T02:50:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.332+0000 7f9b6313e700 1 Processor -- start 2023-10-06T02:50:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.332+0000 7f9b6313e700 1 -- start start 2023-10-06T02:50:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.332+0000 7f9b6313e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c068cc0 0x7f9b5c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.332+0000 7f9b6313e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b5c159b40 0x7f9b5c14b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.332+0000 7f9b6313e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b5c159f10 0x7f9b5c160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.332+0000 7f9b6313e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c161300 con 0x7f9b5c159f10 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.332+0000 7f9b6313e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c15b970 con 0x7f9b5c159b40 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.332+0000 7f9b6313e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c160a60 con 0x7f9b5c068cc0 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.332+0000 7f9b6293d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b5c159f10 0x7f9b5c160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6293d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b5c159f10 0x7f9b5c160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39308/0 (socket says 172.21.15.81:39308) 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6293d700 1 -- 172.21.15.81:0/719535087 learned_addr learned my addr 172.21.15.81:0/719535087 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6193b700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b5c159b40 0x7f9b5c14b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6213c700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c068cc0 0x7f9b5c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6293d700 1 -- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c068cc0 msgr2=0x7f9b5c158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6293d700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c068cc0 0x7f9b5c158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6293d700 1 -- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b5c159b40 msgr2=0x7f9b5c14b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6293d700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b5c159b40 0x7f9b5c14b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6293d700 1 -- 172.21.15.81:0/719535087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009420 con 0x7f9b5c159f10 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6293d700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b5c159f10 0x7f9b5c160150 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400ec80 tx=0x7f9b540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b527fc700 1 -- 172.21.15.81:0/719535087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54009720 con 0x7f9b5c159f10 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b527fc700 1 -- 172.21.15.81:0/719535087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5400c850 con 0x7f9b5c159f10 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c009420 con 0x7f9b5c159f10 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b527fc700 1 -- 172.21.15.81:0/719535087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400cc10 con 0x7f9b5c159f10 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.333+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c161020 con 0x7f9b5c159f10 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.334+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c15bae0 con 0x7f9b5c159f10 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.335+0000 7f9b527fc700 1 -- 172.21.15.81:0/719535087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b54013470 con 0x7f9b5c159f10 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.335+0000 7f9b527fc700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b40066f30 0x7f9b400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.335+0000 7f9b527fc700 1 -- 172.21.15.81:0/719535087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b540845d0 con 0x7f9b5c159f10 2023-10-06T02:50:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.335+0000 7f9b6213c700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b40066f30 0x7f9b400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.335+0000 7f9b527fc700 1 -- 172.21.15.81:0/719535087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f9b4006f0f0 con 0x7f9b5c159f10 2023-10-06T02:50:39.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.336+0000 7f9b6213c700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b40066f30 0x7f9b400693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9b58002230 tx=0x7f9b58001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:39.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.339+0000 7f9b527fc700 1 -- 172.21.15.81:0/719535087 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b540516e0 con 0x7f9b5c159f10 2023-10-06T02:50:39.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.563+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b5c0cb890 con 0x7f9b5c159f10 2023-10-06T02:50:39.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.563+0000 7f9b527fc700 1 -- 172.21.15.81:0/719535087 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9b54020020 con 0x7f9b5c159f10 2023-10-06T02:50:39.566 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:39.566 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2330757810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2330757810},{"type":"v1","addr":"172.21.15.83:6837","nonce":2330757810}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2957658297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2957658297},{"type":"v1","addr":"172.21.15.81:6834","nonce":2957658297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4153630712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4153630712},{"type":"v1","addr":"172.21.15.81:6835","nonce":4153630712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:49:58.066126+0000","modified":"2023-10-06T02:50:01.693730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/1398848175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1398848175},{"type":"v1","addr":"172.21.15.83:6836","nonce":1398848175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:50:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b40066f30 msgr2=0x7f9b400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b40066f30 0x7f9b400693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9b58002230 tx=0x7f9b58001a20 comp rx=0 tx=0).stop 2023-10-06T02:50:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b5c159f10 msgr2=0x7f9b5c160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b5c159f10 0x7f9b5c160150 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400ec80 tx=0x7f9b540091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 shutdown_connections 2023-10-06T02:50:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b5c159f10 0x7f9b5c160150 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9b5c068cc0 0x7f9b5c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9b40066f30 0x7f9b400693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 --2- 172.21.15.81:0/719535087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b5c159b40 0x7f9b5c14b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 >> 172.21.15.81:0/719535087 conn(0x7f9b5c0cd660 msgr2=0x7f9b5c06de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:39.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 shutdown_connections 2023-10-06T02:50:39.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.565+0000 7f9b6313e700 1 -- 172.21.15.81:0/719535087 wait complete. 2023-10-06T02:50:39.569 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2023-10-06T02:50:39.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:50:39.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.691+0000 7f9c62905700 1 Processor -- start 2023-10-06T02:50:39.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.691+0000 7f9c62905700 1 -- start start 2023-10-06T02:50:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62905700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0add30 0x7f9c5c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62905700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9c5c067640 0x7f9c5c067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62905700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c5c0ce890 0x7f9c5c0ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62905700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b37b0 con 0x7f9c5c0ce890 2023-10-06T02:50:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62905700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cf250 con 0x7f9c5c067640 2023-10-06T02:50:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62905700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c067ff0 con 0x7f9c5c0add30 2023-10-06T02:50:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62104700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c5c0ce890 0x7f9c5c0ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62104700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c5c0ce890 0x7f9c5c0ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39318/0 (socket says 172.21.15.81:39318) 2023-10-06T02:50:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62104700 1 -- 172.21.15.81:0/527671153 learned_addr learned my addr 172.21.15.81:0/527671153 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c61102700 1 --2- 172.21.15.81:0/527671153 >> v2:172.21.15.83:3300/0 conn(0x7f9c5c067640 0x7f9c5c067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c61903700 1 --2- 172.21.15.81:0/527671153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0add30 0x7f9c5c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62104700 1 -- 172.21.15.81:0/527671153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0add30 msgr2=0x7f9c5c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62104700 1 --2- 172.21.15.81:0/527671153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0add30 0x7f9c5c0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62104700 1 -- 172.21.15.81:0/527671153 >> v2:172.21.15.83:3300/0 conn(0x7f9c5c067640 msgr2=0x7f9c5c067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62104700 1 --2- 172.21.15.81:0/527671153 >> v2:172.21.15.83:3300/0 conn(0x7f9c5c067640 0x7f9c5c067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62104700 1 -- 172.21.15.81:0/527671153 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c0b17c0 con 0x7f9c5c0ce890 2023-10-06T02:50:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c61102700 1 --2- 172.21.15.81:0/527671153 >> v2:172.21.15.83:3300/0 conn(0x7f9c5c067640 0x7f9c5c067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c61903700 1 --2- 172.21.15.81:0/527671153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0add30 0x7f9c5c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.692+0000 7f9c62104700 1 --2- 172.21.15.81:0/527671153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0ce890 0x7f9c5c0ced10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c05f3b0 tx=0x7f9c54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46237d2bef510143 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c60901700 1 -- 172.21.15.81:0/527671153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400e070 con 0x7f9c5c0ce890 2023-10-06T02:50:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c60901700 1 -- 172.21.15.81:0/527671153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400ba30 con 0x7f9c5c0ce890 2023-10-06T02:50:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c60901700 1 -- 172.21.15.81:0/527671153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540092e0 con 0x7f9c5c0ce890 2023-10-06T02:50:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c62905700 1 -- 172.21.15.81:0/527671153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0ce890 msgr2=0x7f9c5c0ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c62905700 1 --2- 172.21.15.81:0/527671153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0ce890 0x7f9c5c0ced10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c05f3b0 tx=0x7f9c54009840 comp rx=0 tx=0).stop 2023-10-06T02:50:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c62905700 1 -- 172.21.15.81:0/527671153 shutdown_connections 2023-10-06T02:50:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c62905700 1 --2- 172.21.15.81:0/527671153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0ce890 0x7f9c5c0ced10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c62905700 1 --2- 172.21.15.81:0/527671153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0add30 0x7f9c5c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c62905700 1 --2- 172.21.15.81:0/527671153 >> v2:172.21.15.83:3300/0 conn(0x7f9c5c067640 0x7f9c5c067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c62905700 1 -- 172.21.15.81:0/527671153 >> 172.21.15.81:0/527671153 conn(0x7f9c5c06c620 msgr2=0x7f9c5c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c62905700 1 -- 172.21.15.81:0/527671153 shutdown_connections 2023-10-06T02:50:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.693+0000 7f9c62905700 1 -- 172.21.15.81:0/527671153 wait complete. 2023-10-06T02:50:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.694+0000 7f9c62905700 1 Processor -- start 2023-10-06T02:50:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.694+0000 7f9c62905700 1 -- start start 2023-10-06T02:50:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c62905700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c5c067640 0x7f9c5c0acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c62905700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0add30 0x7f9c5c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c62905700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0ce890 0x7f9c5c0ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c62905700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c142d50 con 0x7f9c5c0add30 2023-10-06T02:50:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c62905700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0acb20 con 0x7f9c5c067640 2023-10-06T02:50:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c62905700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0abf10 con 0x7f9c5c0ce890 2023-10-06T02:50:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c61102700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0add30 0x7f9c5c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c61102700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0add30 0x7f9c5c1550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39330/0 (socket says 172.21.15.81:39330) 2023-10-06T02:50:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c61102700 1 -- 172.21.15.81:0/1284351333 learned_addr learned my addr 172.21.15.81:0/1284351333 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c61903700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c5c067640 0x7f9c5c0acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c62104700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0ce890 0x7f9c5c0ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c61102700 1 -- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0ce890 msgr2=0x7f9c5c0ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c61102700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0ce890 0x7f9c5c0ab810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c61102700 1 -- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c5c067640 msgr2=0x7f9c5c0acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c61102700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c5c067640 0x7f9c5c0acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c61102700 1 -- 172.21.15.81:0/1284351333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54009ae0 con 0x7f9c5c0add30 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.695+0000 7f9c62104700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0ce890 0x7f9c5c0ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.696+0000 7f9c61102700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0add30 0x7f9c5c1550e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00c880 tx=0x7f9c4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.696+0000 7f9c51ffb700 1 -- 172.21.15.81:0/1284351333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c011600 con 0x7f9c5c0add30 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.696+0000 7f9c51ffb700 1 -- 172.21.15.81:0/1284351333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c011760 con 0x7f9c5c0add30 2023-10-06T02:50:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.696+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c0ac1f0 con 0x7f9c5c0add30 2023-10-06T02:50:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.696+0000 7f9c51ffb700 1 -- 172.21.15.81:0/1284351333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c011b20 con 0x7f9c5c0add30 2023-10-06T02:50:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.696+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c0ac7b0 con 0x7f9c5c0add30 2023-10-06T02:50:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.697+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c069920 con 0x7f9c5c0add30 2023-10-06T02:50:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.697+0000 7f9c51ffb700 1 -- 172.21.15.81:0/1284351333 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c4c018360 con 0x7f9c5c0add30 2023-10-06T02:50:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.698+0000 7f9c51ffb700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c40066f30 0x7f9c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.698+0000 7f9c51ffb700 1 -- 172.21.15.81:0/1284351333 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c4c0846a0 con 0x7f9c5c0add30 2023-10-06T02:50:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.698+0000 7f9c51ffb700 1 -- 172.21.15.81:0/1284351333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f9c4006f0f0 con 0x7f9c5c0add30 2023-10-06T02:50:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.698+0000 7f9c61903700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c40066f30 0x7f9c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.698+0000 7f9c61903700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c40066f30 0x7f9c400693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9c58006fd0 tx=0x7f9c58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.702+0000 7f9c51ffb700 1 -- 172.21.15.81:0/1284351333 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c4c0551a0 con 0x7f9c5c0add30 2023-10-06T02:50:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.943+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c5c0acc60 con 0x7f9c5c0add30 2023-10-06T02:50:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.944+0000 7f9c51ffb700 1 -- 172.21.15.81:0/1284351333 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16885 (secure 0 0 0) 0x7f9c4c015090 con 0x7f9c5c0add30 2023-10-06T02:50:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:39.946 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":88,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:50:14.417251+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:49:55.704059+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:49:57.024962+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["backfillfull","exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:50:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c40066f30 msgr2=0x7f9c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c40066f30 0x7f9c400693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9c58006fd0 tx=0x7f9c58008040 comp rx=0 tx=0).stop 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0add30 msgr2=0x7f9c5c1550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0add30 0x7f9c5c1550e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00c880 tx=0x7f9c4c008040 comp rx=0 tx=0).stop 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 shutdown_connections 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c5c0ce890 0x7f9c5c0ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9c40066f30 0x7f9c400693e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c5c067640 0x7f9c5c0acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 --2- 172.21.15.81:0/1284351333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0add30 0x7f9c5c1550e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 >> 172.21.15.81:0/1284351333 conn(0x7f9c5c06c620 msgr2=0x7f9c5c0af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 shutdown_connections 2023-10-06T02:50:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:39.946+0000 7f9c62905700 1 -- 172.21.15.81:0/1284351333 wait complete. 2023-10-06T02:50:39.960 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:49:55.704059+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:49:57.024962+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:50:39.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:50:40.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.075+0000 7fcac526a700 1 Processor -- start 2023-10-06T02:50:40.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.075+0000 7fcac526a700 1 -- start start 2023-10-06T02:50:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.076+0000 7fcac526a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcac006d830 0x7fcac00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.076+0000 7fcac526a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac00d07c0 con 0x7fcac01578d0 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.076+0000 7fcac526a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac00cfbb0 con 0x7fcac0157ca0 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.076+0000 7fcac526a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cfe90 con 0x7fcac006d830 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.076+0000 7fcabeffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcac01578d0 0x7fcac015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43996/0 (socket says 172.21.15.81:43996) 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.076+0000 7fcabeffd700 1 -- 172.21.15.81:0/2338263511 learned_addr learned my addr 172.21.15.81:0/2338263511 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.076+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005974779 0 0) 0x7fcac00d07c0 con 0x7fcac01578d0 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.076+0000 7fcabf7fe700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcac006d830 0x7fcac00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaac003570 con 0x7fcac01578d0 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3355857019 0 0) 0x7fcaac003570 con 0x7fcac01578d0 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcac006d830 msgr2=0x7fcac00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcac006d830 0x7fcac00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 >> v1:172.21.15.83:6789/0 conn(0x7fcac0157ca0 legacy=0x7fcac006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00d0170 con 0x7fcac01578d0 2023-10-06T02:50:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fcab0001470 con 0x7fcac01578d0 2023-10-06T02:50:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 >> v1:172.21.15.81:6789/0 conn(0x7fcac01578d0 legacy=0x7fcac015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaac003a90 0x7fcaac003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcac006d830 0x7fcaac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaac004d50 0x7fcaac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cfe90 con 0x7fcaac003a90 2023-10-06T02:50:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac00bb10 con 0x7fcaac004d50 2023-10-06T02:50:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac00bcd0 con 0x7fcac006d830 2023-10-06T02:50:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabeffd700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaac003a90 0x7fcaac003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcab67fc700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcac006d830 0x7fcaac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabf7fe700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaac004d50 0x7fcaac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabeffd700 1 -- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcac006d830 msgr2=0x7fcaac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabeffd700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcac006d830 0x7fcaac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabeffd700 1 -- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaac004d50 msgr2=0x7fcaac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabeffd700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaac004d50 0x7fcaac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabeffd700 1 -- 172.21.15.81:0/2338263511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac003570 con 0x7fcaac003a90 2023-10-06T02:50:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.077+0000 7fcabeffd700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaac003a90 0x7fcaac003e60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c390 tx=0x7fcac015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a017f04f06e6953e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab000cc60 con 0x7fcaac003a90 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab000cde0 con 0x7fcaac003a90 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcabe7fc700 1 -- 172.21.15.81:0/2338263511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab0005b70 con 0x7fcaac003a90 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcac526a700 1 -- 172.21.15.81:0/2338263511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaac003a90 msgr2=0x7fcaac003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcac526a700 1 --2- 172.21.15.81:0/2338263511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaac003a90 0x7fcaac003e60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c390 tx=0x7fcac015b610 comp rx=0 tx=0).stop 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcabf7fe700 1 -- 172.21.15.81:0/2338263511 reap_dead start 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcac526a700 1 -- 172.21.15.81:0/2338263511 shutdown_connections 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcac526a700 1 -- 172.21.15.81:0/2338263511 >> 172.21.15.81:0/2338263511 conn(0x7fcac006bb90 msgr2=0x7fcac006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcac526a700 1 -- 172.21.15.81:0/2338263511 shutdown_connections 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.078+0000 7fcac526a700 1 -- 172.21.15.81:0/2338263511 wait complete. 2023-10-06T02:50:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.079+0000 7fcac526a700 1 Processor -- start 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.079+0000 7fcac526a700 1 -- start start 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcac526a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaac003a90 0x7fcac016e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcac526a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00cbca0 0x7fcac0144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcac526a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcac00c7290 0x7fcac0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcac526a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac016eb10 con 0x7fcac00cbca0 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcac526a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00ccd20 con 0x7fcac00c7290 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcac526a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cc110 con 0x7fcaac003a90 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcab67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00cbca0 0x7fcac0144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcab67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00cbca0 0x7fcac0144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39350/0 (socket says 172.21.15.81:39350) 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcab67fc700 1 -- 172.21.15.81:0/2875971636 learned_addr learned my addr 172.21.15.81:0/2875971636 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcabeffd700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaac003a90 0x7fcac016e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcabf7fe700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcac00c7290 0x7fcac0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcab67fc700 1 -- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaac003a90 msgr2=0x7fcac016e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcab67fc700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaac003a90 0x7fcac016e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcab67fc700 1 -- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcac00c7290 msgr2=0x7fcac0068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcab67fc700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcac00c7290 0x7fcac0068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.080+0000 7fcab67fc700 1 -- 172.21.15.81:0/2875971636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00cc3f0 con 0x7fcac00cbca0 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.081+0000 7fcab67fc700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00cbca0 0x7fcac0144770 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8002b70 tx=0x7fcaa8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.081+0000 7fcab77fe700 1 -- 172.21.15.81:0/2875971636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800f850 con 0x7fcac00cbca0 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.081+0000 7fcab77fe700 1 -- 172.21.15.81:0/2875971636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa800f9d0 con 0x7fcac00cbca0 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.081+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac00cc6d0 con 0x7fcac00cbca0 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.081+0000 7fcab77fe700 1 -- 172.21.15.81:0/2875971636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800fd90 con 0x7fcac00cbca0 2023-10-06T02:50:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.081+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac0144cb0 con 0x7fcac00cbca0 2023-10-06T02:50:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.082+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac0067ac0 con 0x7fcac00cbca0 2023-10-06T02:50:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.082+0000 7fcab77fe700 1 -- 172.21.15.81:0/2875971636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcaa8013600 con 0x7fcac00cbca0 2023-10-06T02:50:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.082+0000 7fcab77fe700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcaa0066f30 0x7fcaa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.083+0000 7fcab77fe700 1 -- 172.21.15.81:0/2875971636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcaa8084c40 con 0x7fcac00cbca0 2023-10-06T02:50:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.083+0000 7fcabeffd700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcaa0066f30 0x7fcaa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.083+0000 7fcab77fe700 1 -- 172.21.15.81:0/2875971636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7fcaa006f0f0 con 0x7fcac00cbca0 2023-10-06T02:50:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.083+0000 7fcabeffd700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcaa0066f30 0x7fcaa00693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcab0007d10 tx=0x7fcab0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.087+0000 7fcab77fe700 1 -- 172.21.15.81:0/2875971636 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaa8017060 con 0x7fcac00cbca0 2023-10-06T02:50:40.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.268+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcac00cce60 con 0x7fcac00cbca0 2023-10-06T02:50:40.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.268+0000 7fcab77fe700 1 -- 172.21.15.81:0/2875971636 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcaa8017030 con 0x7fcac00cbca0 2023-10-06T02:50:40.271 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:50:40.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcaa0066f30 msgr2=0x7fcaa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcaa0066f30 0x7fcaa00693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcab0007d10 tx=0x7fcab0015000 comp rx=0 tx=0).stop 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00cbca0 msgr2=0x7fcac0144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00cbca0 0x7fcac0144770 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8002b70 tx=0x7fcaa8007d10 comp rx=0 tx=0).stop 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 shutdown_connections 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcaa0066f30 0x7fcaa00693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcac00c7290 0x7fcac0068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaac003a90 0x7fcac016e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 --2- 172.21.15.81:0/2875971636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00cbca0 0x7fcac0144770 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 >> 172.21.15.81:0/2875971636 conn(0x7fcac006bb90 msgr2=0x7fcac015c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:40.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 shutdown_connections 2023-10-06T02:50:40.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.270+0000 7fcac526a700 1 -- 172.21.15.81:0/2875971636 wait complete. 2023-10-06T02:50:40.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:50:40.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.399+0000 7feae369d700 1 Processor -- start 2023-10-06T02:50:40.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.399+0000 7feae369d700 1 -- start start 2023-10-06T02:50:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7feae369d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7feadc1578d0 0x7feadc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7feae369d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc0d07c0 con 0x7feadc157ca0 2023-10-06T02:50:40.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7feae369d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc0cfbb0 con 0x7feadc06d120 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7feae369d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc0cfe90 con 0x7feadc1578d0 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7feae0c38700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feadc157ca0 0x7feadc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56918/0 (socket says 172.21.15.81:56918) 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7feae0c38700 1 -- 172.21.15.81:0/361877190 learned_addr learned my addr 172.21.15.81:0/361877190 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7feae1439700 1 --2- 172.21.15.81:0/361877190 >> v2:172.21.15.83:3300/0 conn(0x7feadc1578d0 0x7feadc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7fead3fff700 1 -- 172.21.15.81:0/361877190 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931989419 0 0) 0x7feadc0d07c0 con 0x7feadc157ca0 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7fead3fff700 1 -- 172.21.15.81:0/361877190 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac8003570 con 0x7feadc157ca0 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.400+0000 7fead3fff700 1 -- 172.21.15.81:0/361877190 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449365831 0 0) 0x7feadc0cfbb0 con 0x7feadc06d120 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7fead3fff700 1 -- 172.21.15.81:0/361877190 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feadc0d07c0 con 0x7feadc06d120 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7feae1439700 1 -- 172.21.15.81:0/361877190 >> v1:172.21.15.83:6789/0 conn(0x7feadc06d120 legacy=0x7feadc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7feae1439700 1 -- 172.21.15.81:0/361877190 >> v1:172.21.15.81:6789/0 conn(0x7feadc157ca0 legacy=0x7feadc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7feae1439700 1 -- 172.21.15.81:0/361877190 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0d0170 con 0x7feadc1578d0 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7feae1439700 1 --2- 172.21.15.81:0/361877190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc1578d0 0x7feadc0cf4f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fead8009e60 tx=0x7fead8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a129ce58fb2971 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7fead3fff700 1 -- 172.21.15.81:0/361877190 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800e070 con 0x7feadc1578d0 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7fead3fff700 1 -- 172.21.15.81:0/361877190 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead800bab0 con 0x7feadc1578d0 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7fead3fff700 1 -- 172.21.15.81:0/361877190 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800be70 con 0x7feadc1578d0 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7feae369d700 1 -- 172.21.15.81:0/361877190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc1578d0 msgr2=0x7feadc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7feae369d700 1 --2- 172.21.15.81:0/361877190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc1578d0 0x7feadc0cf4f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fead8009e60 tx=0x7fead8009780 comp rx=0 tx=0).stop 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7feae369d700 1 -- 172.21.15.81:0/361877190 shutdown_connections 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7feae369d700 1 --2- 172.21.15.81:0/361877190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc1578d0 0x7feadc0cf4f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.401+0000 7feae369d700 1 -- 172.21.15.81:0/361877190 >> 172.21.15.81:0/361877190 conn(0x7feadc06bb90 msgr2=0x7feadc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.402+0000 7feae369d700 1 -- 172.21.15.81:0/361877190 shutdown_connections 2023-10-06T02:50:40.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.402+0000 7feae369d700 1 -- 172.21.15.81:0/361877190 wait complete. 2023-10-06T02:50:40.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.403+0000 7feae369d700 1 Processor -- start 2023-10-06T02:50:40.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.403+0000 7feae369d700 1 -- start start 2023-10-06T02:50:40.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.403+0000 7feae369d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc06d120 0x7feadc154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.403+0000 7feae369d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feadc1578d0 0x7feadc0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.403+0000 7feae369d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc157ca0 0x7feadc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.403+0000 7feae369d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc155300 con 0x7feadc157ca0 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.403+0000 7feae369d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0ca2d0 con 0x7feadc06d120 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.403+0000 7feae369d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0c71e0 con 0x7feadc1578d0 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1c3a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc157ca0 0x7feadc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1c3a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc157ca0 0x7feadc068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53312/0 (socket says 172.21.15.81:53312) 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1c3a700 1 -- 172.21.15.81:0/4272156592 learned_addr learned my addr 172.21.15.81:0/4272156592 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1439700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc06d120 0x7feadc154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae0c38700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feadc1578d0 0x7feadc0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1c3a700 1 -- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feadc1578d0 msgr2=0x7feadc0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1c3a700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feadc1578d0 0x7feadc0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1c3a700 1 -- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc06d120 msgr2=0x7feadc154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1c3a700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc06d120 0x7feadc154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1c3a700 1 -- 172.21.15.81:0/4272156592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009a20 con 0x7feadc157ca0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1439700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc06d120 0x7feadc154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae1c3a700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc157ca0 0x7feadc068880 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fead400c590 tx=0x7fead4007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7fead17fa700 1 -- 172.21.15.81:0/4272156592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4016070 con 0x7feadc157ca0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7fead17fa700 1 -- 172.21.15.81:0/4272156592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead4011590 con 0x7feadc157ca0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc0c74c0 con 0x7feadc157ca0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7fead17fa700 1 -- 172.21.15.81:0/4272156592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4011970 con 0x7feadc157ca0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.404+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc0cbf20 con 0x7feadc157ca0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.405+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc0c7040 con 0x7feadc157ca0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.406+0000 7fead17fa700 1 -- 172.21.15.81:0/4272156592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fead4012420 con 0x7feadc157ca0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.406+0000 7fead17fa700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feac0066f30 0x7feac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.406+0000 7fead17fa700 1 -- 172.21.15.81:0/4272156592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fead4084190 con 0x7feadc157ca0 2023-10-06T02:50:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.406+0000 7fead17fa700 1 -- 172.21.15.81:0/4272156592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7feac006f0f0 con 0x7feadc157ca0 2023-10-06T02:50:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.406+0000 7feae1439700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feac0066f30 0x7feac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.407+0000 7feae1439700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feac0066f30 0x7feac00693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fead8009460 tx=0x7fead8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.410+0000 7fead17fa700 1 -- 172.21.15.81:0/4272156592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feadc0c7040 con 0x7feadc157ca0 2023-10-06T02:50:40.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.591+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feadc0c7040 con 0x7feadc157ca0 2023-10-06T02:50:40.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.591+0000 7fead17fa700 1 -- 172.21.15.81:0/4272156592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7feadc0c7040 con 0x7feadc157ca0 2023-10-06T02:50:40.594 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:50:40.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feac0066f30 msgr2=0x7feac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feac0066f30 0x7feac00693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fead8009460 tx=0x7fead8019000 comp rx=0 tx=0).stop 2023-10-06T02:50:40.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc157ca0 msgr2=0x7feadc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc157ca0 0x7feadc068880 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fead400c590 tx=0x7fead4007d80 comp rx=0 tx=0).stop 2023-10-06T02:50:40.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 shutdown_connections 2023-10-06T02:50:40.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc157ca0 0x7feadc068880 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feac0066f30 0x7feac00693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feadc06d120 0x7feadc154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 --2- 172.21.15.81:0/4272156592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feadc1578d0 0x7feadc0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 >> 172.21.15.81:0/4272156592 conn(0x7feadc06bb90 msgr2=0x7feadc15ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:40.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 shutdown_connections 2023-10-06T02:50:40.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.593+0000 7feae369d700 1 -- 172.21.15.81:0/4272156592 wait complete. 2023-10-06T02:50:40.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:50:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.723+0000 7f94938b7700 1 Processor -- start 2023-10-06T02:50:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.723+0000 7f94938b7700 1 -- start start 2023-10-06T02:50:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.723+0000 7f94938b7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f948c157ca0 0x7f948c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f94938b7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0d07c0 con 0x7f948c06d120 2023-10-06T02:50:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f94938b7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0cfbb0 con 0x7f948c1578d0 2023-10-06T02:50:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f94938b7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c0cfe90 con 0x7f948c157ca0 2023-10-06T02:50:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9490e52700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f948c157ca0 0x7f948c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9491e54700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f948c06d120 0x7f948c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56930/0 (socket says 172.21.15.81:56930) 2023-10-06T02:50:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9491e54700 1 -- 172.21.15.81:0/1557687909 learned_addr learned my addr 172.21.15.81:0/1557687909 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9490e52700 1 -- 172.21.15.81:0/1557687909 >> v1:172.21.15.83:6789/0 conn(0x7f948c1578d0 legacy=0x7f948c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9490e52700 1 -- 172.21.15.81:0/1557687909 >> v1:172.21.15.81:6789/0 conn(0x7f948c06d120 legacy=0x7f948c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9483fff700 1 -- 172.21.15.81:0/1557687909 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287919165 0 0) 0x7f948c0d07c0 con 0x7f948c06d120 2023-10-06T02:50:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9490e52700 1 -- 172.21.15.81:0/1557687909 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0d0170 con 0x7f948c157ca0 2023-10-06T02:50:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9490e52700 1 --2- 172.21.15.81:0/1557687909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 0x7f948c0cf4f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f947c0098e0 tx=0x7f947c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3660823b9a8ad2c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9483fff700 1 -- 172.21.15.81:0/1557687909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c009e80 con 0x7f948c157ca0 2023-10-06T02:50:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9483fff700 1 -- 172.21.15.81:0/1557687909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00b860 con 0x7f948c157ca0 2023-10-06T02:50:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.724+0000 7f9483fff700 1 -- 172.21.15.81:0/1557687909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00bbe0 con 0x7f948c157ca0 2023-10-06T02:50:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.725+0000 7f94938b7700 1 -- 172.21.15.81:0/1557687909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 msgr2=0x7f948c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.725+0000 7f94938b7700 1 --2- 172.21.15.81:0/1557687909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 0x7f948c0cf4f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f947c0098e0 tx=0x7f947c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.725+0000 7f94938b7700 1 -- 172.21.15.81:0/1557687909 shutdown_connections 2023-10-06T02:50:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.725+0000 7f94938b7700 1 --2- 172.21.15.81:0/1557687909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 0x7f948c0cf4f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.725+0000 7f94938b7700 1 -- 172.21.15.81:0/1557687909 >> 172.21.15.81:0/1557687909 conn(0x7f948c06bb90 msgr2=0x7f948c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.725+0000 7f94938b7700 1 -- 172.21.15.81:0/1557687909 shutdown_connections 2023-10-06T02:50:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.725+0000 7f94938b7700 1 -- 172.21.15.81:0/1557687909 wait complete. 2023-10-06T02:50:40.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.726+0000 7f94938b7700 1 Processor -- start 2023-10-06T02:50:40.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.726+0000 7f94938b7700 1 -- start start 2023-10-06T02:50:40.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f94938b7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f948c06d120 0x7f948c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f94938b7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f948c1578d0 0x7f948c0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f94938b7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 0x7f948c0b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f94938b7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0aebe0 con 0x7f948c157ca0 2023-10-06T02:50:40.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f94938b7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b1e50 con 0x7f948c06d120 2023-10-06T02:50:40.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f94938b7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b0fc0 con 0x7f948c1578d0 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491e54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 0x7f948c0b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491e54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 0x7f948c0b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53334/0 (socket says 172.21.15.81:53334) 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491e54700 1 -- 172.21.15.81:0/1676708180 learned_addr learned my addr 172.21.15.81:0/1676708180 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9490e52700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f948c1578d0 0x7f948c0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491653700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f948c06d120 0x7f948c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491e54700 1 -- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f948c1578d0 msgr2=0x7f948c0ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491e54700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f948c1578d0 0x7f948c0ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491e54700 1 -- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f948c06d120 msgr2=0x7f948c0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491e54700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f948c06d120 0x7f948c0b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491e54700 1 -- 172.21.15.81:0/1676708180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009420 con 0x7f948c157ca0 2023-10-06T02:50:40.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9490e52700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f948c1578d0 0x7f948c0ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491653700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f948c06d120 0x7f948c0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f9491e54700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 0x7f948c0b0a80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f948400cc90 tx=0x7f9484001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.727+0000 7f94817fa700 1 -- 172.21.15.81:0/1676708180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948400cea0 con 0x7f948c157ca0 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.728+0000 7f94817fa700 1 -- 172.21.15.81:0/1676708180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948400ab30 con 0x7f948c157ca0 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.728+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c0b1240 con 0x7f948c157ca0 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.728+0000 7f94817fa700 1 -- 172.21.15.81:0/1676708180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94840070f0 con 0x7f948c157ca0 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.728+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c0b1800 con 0x7f948c157ca0 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.728+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c0b2ff0 con 0x7f948c157ca0 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.729+0000 7f94817fa700 1 -- 172.21.15.81:0/1676708180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94840074a0 con 0x7f948c157ca0 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.729+0000 7f94817fa700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9470066f00 0x7f94700693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:40.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.729+0000 7f94817fa700 1 -- 172.21.15.81:0/1676708180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9484084c00 con 0x7f948c157ca0 2023-10-06T02:50:40.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.729+0000 7f94817fa700 1 -- 172.21.15.81:0/1676708180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f947006f0c0 con 0x7f948c157ca0 2023-10-06T02:50:40.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.729+0000 7f9491653700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9470066f00 0x7f94700693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:40.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.730+0000 7f9491653700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9470066f00 0x7f94700693b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9488001840 tx=0x7f9488009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:40.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.734+0000 7f94817fa700 1 -- 172.21.15.81:0/1676708180 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f948408b080 con 0x7f948c157ca0 2023-10-06T02:50:40.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.913+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f948c0d0450 con 0x7f948c157ca0 2023-10-06T02:50:40.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.913+0000 7f94817fa700 1 -- 172.21.15.81:0/1676708180 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9484051d00 con 0x7f948c157ca0 2023-10-06T02:50:40.916 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:50:40.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9470066f00 msgr2=0x7f94700693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9470066f00 0x7f94700693b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9488001840 tx=0x7f9488009040 comp rx=0 tx=0).stop 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 msgr2=0x7f948c0b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 0x7f948c0b0a80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f948400cc90 tx=0x7f9484001a20 comp rx=0 tx=0).stop 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 shutdown_connections 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948c157ca0 0x7f948c0b0a80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9470066f00 0x7f94700693b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f948c06d120 0x7f948c0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 --2- 172.21.15.81:0/1676708180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f948c1578d0 0x7f948c0ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 >> 172.21.15.81:0/1676708180 conn(0x7f948c06bb90 msgr2=0x7f948c15c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:40.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 shutdown_connections 2023-10-06T02:50:40.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:40.915+0000 7f94938b7700 1 -- 172.21.15.81:0/1676708180 wait complete. 2023-10-06T02:50:40.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:50:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.044+0000 7fbfa87b2700 1 Processor -- start 2023-10-06T02:50:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.044+0000 7fbfa87b2700 1 -- start start 2023-10-06T02:50:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbfa0157ca0 0x7fbfa00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbfa006d120 0x7fbfa006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa00d07c0 con 0x7fbfa01578d0 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa006da50 con 0x7fbfa0157ca0 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa00cfbb0 con 0x7fbfa006d120 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa5d4d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbfa0157ca0 0x7fbfa00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa654e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbfa01578d0 0x7fbfa015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56940/0 (socket says 172.21.15.81:56940) 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa654e700 1 -- 172.21.15.81:0/2707019785 learned_addr learned my addr 172.21.15.81:0/2707019785 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa6d4f700 1 --2- 172.21.15.81:0/2707019785 >> v2:172.21.15.83:3300/0 conn(0x7fbfa006d120 0x7fbfa006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa5d4d700 1 -- 172.21.15.81:0/2707019785 >> v2:172.21.15.83:3300/0 conn(0x7fbfa006d120 msgr2=0x7fbfa006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa5d4d700 1 --2- 172.21.15.81:0/2707019785 >> v2:172.21.15.83:3300/0 conn(0x7fbfa006d120 0x7fbfa006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa5d4d700 1 -- 172.21.15.81:0/2707019785 >> v1:172.21.15.81:6789/0 conn(0x7fbfa01578d0 legacy=0x7fbfa015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa5d4d700 1 -- 172.21.15.81:0/2707019785 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa00cfe90 con 0x7fbfa0157ca0 2023-10-06T02:50:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa554c700 1 -- 172.21.15.81:0/2707019785 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210285730 0 0) 0x7fbfa00d07c0 con 0x7fbfa01578d0 2023-10-06T02:50:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa5d4d700 1 --2- 172.21.15.81:0/2707019785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa0157ca0 0x7fbfa00cf4f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0068300 tx=0x7fbf900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70140042a1ebd5ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa554c700 1 -- 172.21.15.81:0/2707019785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000b6b0 con 0x7fbfa0157ca0 2023-10-06T02:50:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa554c700 1 -- 172.21.15.81:0/2707019785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9000b810 con 0x7fbfa0157ca0 2023-10-06T02:50:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa554c700 1 -- 172.21.15.81:0/2707019785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000bbb0 con 0x7fbfa0157ca0 2023-10-06T02:50:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 -- 172.21.15.81:0/2707019785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa0157ca0 msgr2=0x7fbfa00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 --2- 172.21.15.81:0/2707019785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa0157ca0 0x7fbfa00cf4f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0068300 tx=0x7fbf900091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 -- 172.21.15.81:0/2707019785 shutdown_connections 2023-10-06T02:50:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 --2- 172.21.15.81:0/2707019785 >> v2:172.21.15.83:3300/0 conn(0x7fbfa006d120 0x7fbfa006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 --2- 172.21.15.81:0/2707019785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa0157ca0 0x7fbfa00cf4f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 -- 172.21.15.81:0/2707019785 >> 172.21.15.81:0/2707019785 conn(0x7fbfa006bb90 msgr2=0x7fbfa006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 -- 172.21.15.81:0/2707019785 shutdown_connections 2023-10-06T02:50:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.046+0000 7fbfa87b2700 1 -- 172.21.15.81:0/2707019785 wait complete. 2023-10-06T02:50:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.047+0000 7fbfa87b2700 1 Processor -- start 2023-10-06T02:50:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.047+0000 7fbfa87b2700 1 -- start start 2023-10-06T02:50:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa87b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa006d120 0x7fbfa0153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa87b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa01578d0 0x7fbfa00b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa87b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa0157ca0 0x7fbfa016a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa87b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00b5f80 con 0x7fbfa01578d0 2023-10-06T02:50:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa87b2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00ab570 con 0x7fbfa0157ca0 2023-10-06T02:50:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa87b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00aac40 con 0x7fbfa006d120 2023-10-06T02:50:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa5d4d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa01578d0 0x7fbfa00b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa5d4d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa01578d0 0x7fbfa00b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53362/0 (socket says 172.21.15.81:53362) 2023-10-06T02:50:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa5d4d700 1 -- 172.21.15.81:0/3315751959 learned_addr learned my addr 172.21.15.81:0/3315751959 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa654e700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa006d120 0x7fbfa0153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa6d4f700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa0157ca0 0x7fbfa016a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa5d4d700 1 -- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa006d120 msgr2=0x7fbfa0153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.048+0000 7fbfa5d4d700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa006d120 0x7fbfa0153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.049+0000 7fbfa5d4d700 1 -- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa0157ca0 msgr2=0x7fbfa016a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.049+0000 7fbfa5d4d700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa0157ca0 0x7fbfa016a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.049+0000 7fbfa5d4d700 1 -- 172.21.15.81:0/3315751959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf90009420 con 0x7fbfa01578d0 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.049+0000 7fbfa5d4d700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa01578d0 0x7fbfa00b56d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbf90013000 tx=0x7fbf90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.049+0000 7fbf967fc700 1 -- 172.21.15.81:0/3315751959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000bb90 con 0x7fbfa01578d0 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.049+0000 7fbf967fc700 1 -- 172.21.15.81:0/3315751959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf90011420 con 0x7fbfa01578d0 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.049+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa00aaf20 con 0x7fbfa01578d0 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.049+0000 7fbf967fc700 1 -- 172.21.15.81:0/3315751959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900117c0 con 0x7fbfa01578d0 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.049+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa0153f40 con 0x7fbfa01578d0 2023-10-06T02:50:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.050+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa00ab6e0 con 0x7fbfa01578d0 2023-10-06T02:50:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.050+0000 7fbf967fc700 1 -- 172.21.15.81:0/3315751959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf90011b70 con 0x7fbfa01578d0 2023-10-06T02:50:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.051+0000 7fbf967fc700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf84066f30 0x7fbf840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.051+0000 7fbf967fc700 1 -- 172.21.15.81:0/3315751959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf90085e00 con 0x7fbfa01578d0 2023-10-06T02:50:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.051+0000 7fbfa654e700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf84066f30 0x7fbf840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.051+0000 7fbf967fc700 1 -- 172.21.15.81:0/3315751959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7fbf8406f0f0 con 0x7fbfa01578d0 2023-10-06T02:50:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.051+0000 7fbfa654e700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf84066f30 0x7fbf840693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c002250 tx=0x7fbf9c001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.056+0000 7fbf967fc700 1 -- 172.21.15.81:0/3315751959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf90052f10 con 0x7fbfa01578d0 2023-10-06T02:50:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.234+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfa00d0170 con 0x7fbfa01578d0 2023-10-06T02:50:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.234+0000 7fbf967fc700 1 -- 172.21.15.81:0/3315751959 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf90015020 con 0x7fbfa01578d0 2023-10-06T02:50:41.237 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:50:41.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf84066f30 msgr2=0x7fbf840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf84066f30 0x7fbf840693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c002250 tx=0x7fbf9c001a20 comp rx=0 tx=0).stop 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa01578d0 msgr2=0x7fbfa00b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa01578d0 0x7fbfa00b56d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbf90013000 tx=0x7fbf90017000 comp rx=0 tx=0).stop 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 shutdown_connections 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbf84066f30 0x7fbf840693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa0157ca0 0x7fbfa016a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa006d120 0x7fbfa0153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 --2- 172.21.15.81:0/3315751959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfa01578d0 0x7fbfa00b56d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 >> 172.21.15.81:0/3315751959 conn(0x7fbfa006bb90 msgr2=0x7fbfa006a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:41.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 shutdown_connections 2023-10-06T02:50:41.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.236+0000 7fbfa87b2700 1 -- 172.21.15.81:0/3315751959 wait complete. 2023-10-06T02:50:41.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:50:41.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.363+0000 7f929f3a1700 1 Processor -- start 2023-10-06T02:50:41.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.363+0000 7f929f3a1700 1 -- start start 2023-10-06T02:50:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.363+0000 7f929f3a1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92980add30 0x7f92980b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.363+0000 7f929f3a1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9298067640 0x7f9298067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.363+0000 7f929f3a1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92980ce890 0x7f92980ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.363+0000 7f929f3a1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980b37b0 con 0x7f9298067640 2023-10-06T02:50:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.363+0000 7f929f3a1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980cf250 con 0x7f92980ce890 2023-10-06T02:50:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.363+0000 7f929f3a1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9298067ff0 con 0x7f92980add30 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929db9e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9298067640 0x7f9298067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929db9e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9298067640 0x7f9298067ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53372/0 (socket says 172.21.15.81:53372) 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929db9e700 1 -- 172.21.15.81:0/3183792648 learned_addr learned my addr 172.21.15.81:0/3183792648 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929e39f700 1 --2- 172.21.15.81:0/3183792648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92980add30 0x7f92980b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929eba0700 1 --2- 172.21.15.81:0/3183792648 >> v2:172.21.15.83:3300/0 conn(0x7f92980ce890 0x7f92980ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929db9e700 1 -- 172.21.15.81:0/3183792648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92980add30 msgr2=0x7f92980b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929db9e700 1 --2- 172.21.15.81:0/3183792648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92980add30 0x7f92980b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929db9e700 1 -- 172.21.15.81:0/3183792648 >> v2:172.21.15.83:3300/0 conn(0x7f92980ce890 msgr2=0x7f92980ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929db9e700 1 --2- 172.21.15.81:0/3183792648 >> v2:172.21.15.83:3300/0 conn(0x7f92980ce890 0x7f92980ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929db9e700 1 -- 172.21.15.81:0/3183792648 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980b17c0 con 0x7f9298067640 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929db9e700 1 --2- 172.21.15.81:0/3183792648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 0x7f9298067ab0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f929806b710 tx=0x7f9288009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f00cc67fed6082b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929d39d700 1 -- 172.21.15.81:0/3183792648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288011630 con 0x7f9298067640 2023-10-06T02:50:41.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929d39d700 1 -- 172.21.15.81:0/3183792648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9288011790 con 0x7f9298067640 2023-10-06T02:50:41.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.364+0000 7f929d39d700 1 -- 172.21.15.81:0/3183792648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288011b30 con 0x7f9298067640 2023-10-06T02:50:41.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.365+0000 7f929f3a1700 1 -- 172.21.15.81:0/3183792648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 msgr2=0x7f9298067ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.365+0000 7f929f3a1700 1 --2- 172.21.15.81:0/3183792648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 0x7f9298067ab0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f929806b710 tx=0x7f9288009250 comp rx=0 tx=0).stop 2023-10-06T02:50:41.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.365+0000 7f929f3a1700 1 -- 172.21.15.81:0/3183792648 shutdown_connections 2023-10-06T02:50:41.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.365+0000 7f929f3a1700 1 --2- 172.21.15.81:0/3183792648 >> v2:172.21.15.83:3300/0 conn(0x7f92980ce890 0x7f92980ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.365+0000 7f929f3a1700 1 --2- 172.21.15.81:0/3183792648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92980add30 0x7f92980b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.365+0000 7f929f3a1700 1 --2- 172.21.15.81:0/3183792648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 0x7f9298067ab0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.365+0000 7f929f3a1700 1 -- 172.21.15.81:0/3183792648 >> 172.21.15.81:0/3183792648 conn(0x7f929806c620 msgr2=0x7f929806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:41.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.365+0000 7f929f3a1700 1 -- 172.21.15.81:0/3183792648 shutdown_connections 2023-10-06T02:50:41.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.365+0000 7f929f3a1700 1 -- 172.21.15.81:0/3183792648 wait complete. 2023-10-06T02:50:41.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.366+0000 7f929f3a1700 1 Processor -- start 2023-10-06T02:50:41.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.366+0000 7f929f3a1700 1 -- start start 2023-10-06T02:50:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929f3a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 0x7f929806d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929f3a1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92980add30 0x7f929806e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929f3a1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92980ce890 0x7f929814e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929f3a1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929806ed00 con 0x7f9298067640 2023-10-06T02:50:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929f3a1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980ac2c0 con 0x7f92980ce890 2023-10-06T02:50:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929f3a1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980ab990 con 0x7f92980add30 2023-10-06T02:50:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929e39f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 0x7f929806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929e39f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 0x7f929806d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53386/0 (socket says 172.21.15.81:53386) 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929e39f700 1 -- 172.21.15.81:0/703090546 learned_addr learned my addr 172.21.15.81:0/703090546 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929e39f700 1 -- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92980add30 msgr2=0x7f929806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929e39f700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92980add30 0x7f929806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929e39f700 1 -- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92980ce890 msgr2=0x7f929814e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929e39f700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92980ce890 0x7f929814e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929e39f700 1 -- 172.21.15.81:0/703090546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92880094f0 con 0x7f9298067640 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929e39f700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 0x7f929806d570 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f929400e960 tx=0x7f92940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f928e7fc700 1 -- 172.21.15.81:0/703090546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929400c850 con 0x7f9298067640 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f928e7fc700 1 -- 172.21.15.81:0/703090546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929400c9b0 con 0x7f9298067640 2023-10-06T02:50:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980abc70 con 0x7f9298067640 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f928e7fc700 1 -- 172.21.15.81:0/703090546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929400cd50 con 0x7f9298067640 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929814e9d0 con 0x7f9298067640 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.368+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9298069920 con 0x7f9298067640 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.369+0000 7f928e7fc700 1 -- 172.21.15.81:0/703090546 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9294013680 con 0x7f9298067640 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.369+0000 7f928e7fc700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f927c066f30 0x7f927c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.369+0000 7f928e7fc700 1 -- 172.21.15.81:0/703090546 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f92940848c0 con 0x7f9298067640 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.369+0000 7f928e7fc700 1 -- 172.21.15.81:0/703090546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f927c06f0f0 con 0x7f9298067640 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.369+0000 7f929db9e700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f927c066f30 0x7f927c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.370+0000 7f929db9e700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f927c066f30 0x7f927c0693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f929806b710 tx=0x7f9288017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.373+0000 7f928e7fc700 1 -- 172.21.15.81:0/703090546 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9294017060 con 0x7f9298067640 2023-10-06T02:50:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.598+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9298071b10 con 0x7f9298067640 2023-10-06T02:50:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.599+0000 7f928e7fc700 1 -- 172.21.15.81:0/703090546 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9294021090 con 0x7f9298067640 2023-10-06T02:50:41.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:41.601 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2330757810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2330757810},{"type":"v1","addr":"172.21.15.83:6837","nonce":2330757810}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2957658297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2957658297},{"type":"v1","addr":"172.21.15.81:6834","nonce":2957658297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4153630712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4153630712},{"type":"v1","addr":"172.21.15.81:6835","nonce":4153630712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:49:58.066126+0000","modified":"2023-10-06T02:50:01.693730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/1398848175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1398848175},{"type":"v1","addr":"172.21.15.83:6836","nonce":1398848175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:50:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f927c066f30 msgr2=0x7f927c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f927c066f30 0x7f927c0693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f929806b710 tx=0x7f9288017000 comp rx=0 tx=0).stop 2023-10-06T02:50:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 msgr2=0x7f929806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 0x7f929806d570 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f929400e960 tx=0x7f92940091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 shutdown_connections 2023-10-06T02:50:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f927c066f30 0x7f927c0693e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92980ce890 0x7f929814e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9298067640 0x7f929806d570 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 --2- 172.21.15.81:0/703090546 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92980add30 0x7f929806e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 >> 172.21.15.81:0/703090546 conn(0x7f929806c620 msgr2=0x7f9298157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 shutdown_connections 2023-10-06T02:50:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.601+0000 7f929f3a1700 1 -- 172.21.15.81:0/703090546 wait complete. 2023-10-06T02:50:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2023-10-06T02:50:41.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:50:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.728+0000 7f2ee232f700 1 Processor -- start 2023-10-06T02:50:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.728+0000 7f2ee232f700 1 -- start start 2023-10-06T02:50:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.728+0000 7f2ee232f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc0cf240 0x7f2edc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.728+0000 7f2ee232f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2edc06d650 0x7f2edc06da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.728+0000 7f2ee232f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2edc0b0ca0 con 0x7f2edc15a2a0 2023-10-06T02:50:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.728+0000 7f2ee232f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2edc06ea90 con 0x7f2edc06d650 2023-10-06T02:50:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.728+0000 7f2ee232f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc0b00d0 con 0x7f2edc0cf240 2023-10-06T02:50:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2ee08cc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2edc06d650 0x7f2edc06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2edb7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc0cf240 0x7f2edc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2edbfff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2edc15a2a0 0x7f2edc0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55416/0 (socket says 172.21.15.81:55416) 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2edbfff700 1 -- 172.21.15.81:0/391617410 learned_addr learned my addr 172.21.15.81:0/391617410 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2ee08cc700 1 -- 172.21.15.81:0/391617410 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc0cf240 msgr2=0x7f2edc0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2ee08cc700 1 --2- 172.21.15.81:0/391617410 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc0cf240 0x7f2edc0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2ee08cc700 1 -- 172.21.15.81:0/391617410 >> v1:172.21.15.83:6789/0 conn(0x7f2edc15a2a0 legacy=0x7f2edc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2ee08cc700 1 -- 172.21.15.81:0/391617410 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc0b0370 con 0x7f2edc06d650 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2edaffd700 1 -- 172.21.15.81:0/391617410 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840625981 0 0) 0x7f2edc0b0ca0 con 0x7f2edc15a2a0 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2ee08cc700 1 --2- 172.21.15.81:0/391617410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2edc06d650 0x7f2edc06da90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009e60 tx=0x7f2ed4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e6754ef8a6b385 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2edaffd700 1 -- 172.21.15.81:0/391617410 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed400e070 con 0x7f2edc06d650 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2edaffd700 1 -- 172.21.15.81:0/391617410 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed400bb60 con 0x7f2edc06d650 2023-10-06T02:50:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.729+0000 7f2edaffd700 1 -- 172.21.15.81:0/391617410 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4012430 con 0x7f2edc06d650 2023-10-06T02:50:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.730+0000 7f2ee232f700 1 -- 172.21.15.81:0/391617410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2edc06d650 msgr2=0x7f2edc06da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.730+0000 7f2ee232f700 1 --2- 172.21.15.81:0/391617410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2edc06d650 0x7f2edc06da90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009e60 tx=0x7f2ed4009780 comp rx=0 tx=0).stop 2023-10-06T02:50:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.730+0000 7f2ee232f700 1 -- 172.21.15.81:0/391617410 shutdown_connections 2023-10-06T02:50:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.730+0000 7f2ee232f700 1 --2- 172.21.15.81:0/391617410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2edc06d650 0x7f2edc06da90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.730+0000 7f2ee232f700 1 --2- 172.21.15.81:0/391617410 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc0cf240 0x7f2edc0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.730+0000 7f2ee232f700 1 -- 172.21.15.81:0/391617410 >> 172.21.15.81:0/391617410 conn(0x7f2edc067640 msgr2=0x7f2edc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.730+0000 7f2ee232f700 1 -- 172.21.15.81:0/391617410 shutdown_connections 2023-10-06T02:50:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.730+0000 7f2ee232f700 1 -- 172.21.15.81:0/391617410 wait complete. 2023-10-06T02:50:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.731+0000 7f2ee232f700 1 Processor -- start 2023-10-06T02:50:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.731+0000 7f2ee232f700 1 -- start start 2023-10-06T02:50:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2ee232f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2edc06d650 0x7f2edc140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2ee232f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc0cf240 0x7f2edc0ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2ee232f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc15a2a0 0x7f2edc0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2ee232f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc0b4310 con 0x7f2edc0cf240 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2ee232f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc0c8820 con 0x7f2edc06d650 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2ee232f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc1408d0 con 0x7f2edc15a2a0 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2edb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc0cf240 0x7f2edc0ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2edb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc0cf240 0x7f2edc0ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53390/0 (socket says 172.21.15.81:53390) 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2edb7fe700 1 -- 172.21.15.81:0/3659701274 learned_addr learned my addr 172.21.15.81:0/3659701274 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2ee08cc700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc15a2a0 0x7f2edc0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2edbfff700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2edc06d650 0x7f2edc140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2edb7fe700 1 -- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc15a2a0 msgr2=0x7f2edc0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2edb7fe700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc15a2a0 0x7f2edc0caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2edb7fe700 1 -- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2edc06d650 msgr2=0x7f2edc140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2edb7fe700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2edc06d650 0x7f2edc140390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.732+0000 7f2edb7fe700 1 -- 172.21.15.81:0/3659701274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed4009a20 con 0x7f2edc0cf240 2023-10-06T02:50:41.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.733+0000 7f2edb7fe700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc0cf240 0x7f2edc0ca5b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000ecb0 tx=0x7f2ed00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:41.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.733+0000 7f2ec3fff700 1 -- 172.21.15.81:0/3659701274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000c850 con 0x7f2edc0cf240 2023-10-06T02:50:41.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.733+0000 7f2ec3fff700 1 -- 172.21.15.81:0/3659701274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed000c9b0 con 0x7f2edc0cf240 2023-10-06T02:50:41.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.733+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2edc0c7ef0 con 0x7f2edc0cf240 2023-10-06T02:50:41.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.733+0000 7f2ec3fff700 1 -- 172.21.15.81:0/3659701274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000cd50 con 0x7f2edc0cf240 2023-10-06T02:50:41.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.733+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2edc0c84b0 con 0x7f2edc0cf240 2023-10-06T02:50:41.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.734+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2edc0c89b0 con 0x7f2edc0cf240 2023-10-06T02:50:41.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.734+0000 7f2ec3fff700 1 -- 172.21.15.81:0/3659701274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ed0013680 con 0x7f2edc0cf240 2023-10-06T02:50:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.735+0000 7f2ec3fff700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ec8066f30 0x7f2ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.735+0000 7f2ec3fff700 1 -- 172.21.15.81:0/3659701274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ed00848e0 con 0x7f2edc0cf240 2023-10-06T02:50:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.735+0000 7f2edbfff700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ec8066f30 0x7f2ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.735+0000 7f2ec3fff700 1 -- 172.21.15.81:0/3659701274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f2ec806f0f0 con 0x7f2edc0cf240 2023-10-06T02:50:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.735+0000 7f2edbfff700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ec8066f30 0x7f2ec80693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc007160 tx=0x7f2ecc007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.739+0000 7f2ec3fff700 1 -- 172.21.15.81:0/3659701274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ed0017060 con 0x7f2edc0cf240 2023-10-06T02:50:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.922+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2edc0ad740 con 0x7f2edc0cf240 2023-10-06T02:50:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.923+0000 7f2ec3fff700 1 -- 172.21.15.81:0/3659701274 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16885 (secure 0 0 0) 0x7f2ed0021090 con 0x7f2edc0cf240 2023-10-06T02:50:41.925 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:41.925 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":88,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:50:14.417251+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:49:55.704059+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:49:57.024962+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["backfillfull","exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ec8066f30 msgr2=0x7f2ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ec8066f30 0x7f2ec80693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc007160 tx=0x7f2ecc007f50 comp rx=0 tx=0).stop 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc0cf240 msgr2=0x7f2edc0ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc0cf240 0x7f2edc0ca5b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000ecb0 tx=0x7f2ed00091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 shutdown_connections 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2edc15a2a0 0x7f2edc0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ec8066f30 0x7f2ec80693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2edc06d650 0x7f2edc140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 --2- 172.21.15.81:0/3659701274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc0cf240 0x7f2edc0ca5b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 >> 172.21.15.81:0/3659701274 conn(0x7f2edc067640 msgr2=0x7f2edc0ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 shutdown_connections 2023-10-06T02:50:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:41.925+0000 7f2ee232f700 1 -- 172.21.15.81:0/3659701274 wait complete. 2023-10-06T02:50:41.940 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:50:41.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:50:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.051+0000 7f9aac45b700 1 Processor -- start 2023-10-06T02:50:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.051+0000 7f9aac45b700 1 -- start start 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.052+0000 7f9aac45b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9aa41578d0 0x7f9aa40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.052+0000 7f9aac45b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9aa406d120 0x7f9aa406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.052+0000 7f9aac45b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa40d07c0 con 0x7f9aa4157ca0 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.052+0000 7f9aac45b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa406da50 con 0x7f9aa406d120 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.052+0000 7f9aac45b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa40cfbb0 con 0x7f9aa41578d0 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.052+0000 7f9aaa9f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9aa406d120 0x7f9aa406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.052+0000 7f9aaa9f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9aa406d120 0x7f9aa406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53392/0 (socket says 172.21.15.81:53392) 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.052+0000 7f9aaa9f8700 1 -- 172.21.15.81:0/3387146297 learned_addr learned my addr 172.21.15.81:0/3387146297 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aaa1f7700 1 --2- 172.21.15.81:0/3387146297 >> v2:172.21.15.83:3300/0 conn(0x7f9aa41578d0 0x7f9aa40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aaa9f8700 1 -- 172.21.15.81:0/3387146297 >> v2:172.21.15.83:3300/0 conn(0x7f9aa41578d0 msgr2=0x7f9aa40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aaa9f8700 1 --2- 172.21.15.81:0/3387146297 >> v2:172.21.15.83:3300/0 conn(0x7f9aa41578d0 0x7f9aa40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aaa9f8700 1 -- 172.21.15.81:0/3387146297 >> v1:172.21.15.83:6789/0 conn(0x7f9aa4157ca0 legacy=0x7f9aa415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aaa9f8700 1 -- 172.21.15.81:0/3387146297 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa40cfe90 con 0x7f9aa406d120 2023-10-06T02:50:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aaa9f8700 1 --2- 172.21.15.81:0/3387146297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa406d120 0x7f9aa406d510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40646b0 tx=0x7f9a9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbba27e1064cace server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aa91f5700 1 -- 172.21.15.81:0/3387146297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00b860 con 0x7f9aa406d120 2023-10-06T02:50:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aa91f5700 1 -- 172.21.15.81:0/3387146297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c00b9c0 con 0x7f9aa406d120 2023-10-06T02:50:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aa91f5700 1 -- 172.21.15.81:0/3387146297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00bd60 con 0x7f9aa406d120 2023-10-06T02:50:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aac45b700 1 -- 172.21.15.81:0/3387146297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa406d120 msgr2=0x7f9aa406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.053+0000 7f9aac45b700 1 --2- 172.21.15.81:0/3387146297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa406d120 0x7f9aa406d510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40646b0 tx=0x7f9a9c009250 comp rx=0 tx=0).stop 2023-10-06T02:50:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.054+0000 7f9aac45b700 1 -- 172.21.15.81:0/3387146297 shutdown_connections 2023-10-06T02:50:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.054+0000 7f9aac45b700 1 --2- 172.21.15.81:0/3387146297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa406d120 0x7f9aa406d510 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.054+0000 7f9aac45b700 1 --2- 172.21.15.81:0/3387146297 >> v2:172.21.15.83:3300/0 conn(0x7f9aa41578d0 0x7f9aa40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.054+0000 7f9aac45b700 1 -- 172.21.15.81:0/3387146297 >> 172.21.15.81:0/3387146297 conn(0x7f9aa406bb90 msgr2=0x7f9aa406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.054+0000 7f9aac45b700 1 -- 172.21.15.81:0/3387146297 shutdown_connections 2023-10-06T02:50:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.054+0000 7f9aac45b700 1 -- 172.21.15.81:0/3387146297 wait complete. 2023-10-06T02:50:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.055+0000 7f9aac45b700 1 Processor -- start 2023-10-06T02:50:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.055+0000 7f9aac45b700 1 -- start start 2023-10-06T02:50:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.055+0000 7f9aac45b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aa406d120 0x7f9aa40b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.055+0000 7f9aac45b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aa41578d0 0x7f9aa414b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.055+0000 7f9aac45b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa4157ca0 0x7f9aa4159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.055+0000 7f9aac45b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40b15a0 con 0x7f9aa4157ca0 2023-10-06T02:50:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.055+0000 7f9aac45b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40b1840 con 0x7f9aa406d120 2023-10-06T02:50:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.055+0000 7f9aac45b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40b1b20 con 0x7f9aa41578d0 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa9f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa4157ca0 0x7f9aa4159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa9f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa4157ca0 0x7f9aa4159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53406/0 (socket says 172.21.15.81:53406) 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa9f8700 1 -- 172.21.15.81:0/3816425172 learned_addr learned my addr 172.21.15.81:0/3816425172 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa1f7700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aa406d120 0x7f9aa40b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aa99f6700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aa41578d0 0x7f9aa414b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa9f8700 1 -- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aa41578d0 msgr2=0x7f9aa414b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa9f8700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aa41578d0 0x7f9aa414b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa9f8700 1 -- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aa406d120 msgr2=0x7f9aa40b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa9f8700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aa406d120 0x7f9aa40b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa9f8700 1 -- 172.21.15.81:0/3816425172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c0094f0 con 0x7f9aa4157ca0 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aaa9f8700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa4157ca0 0x7f9aa4159420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009290 tx=0x7f9a9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9a9a7fc700 1 -- 172.21.15.81:0/3816425172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00b860 con 0x7f9aa4157ca0 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9a9a7fc700 1 -- 172.21.15.81:0/3816425172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c01a630 con 0x7f9aa4157ca0 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa40b1e00 con 0x7f9aa4157ca0 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9a9a7fc700 1 -- 172.21.15.81:0/3816425172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c01a9f0 con 0x7f9aa4157ca0 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.056+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa414bc60 con 0x7f9aa4157ca0 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.057+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa4067ac0 con 0x7f9aa4157ca0 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.057+0000 7f9a9a7fc700 1 -- 172.21.15.81:0/3816425172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a9c02d440 con 0x7f9aa4157ca0 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.058+0000 7f9a9a7fc700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a88066f30 0x7f9a880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.058+0000 7f9a9a7fc700 1 -- 172.21.15.81:0/3816425172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a9c086380 con 0x7f9aa4157ca0 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.058+0000 7f9aaa1f7700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a88066f30 0x7f9a880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.058+0000 7f9a9a7fc700 1 -- 172.21.15.81:0/3816425172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f9a8806f0f0 con 0x7f9aa4157ca0 2023-10-06T02:50:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.058+0000 7f9aaa1f7700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a88066f30 0x7f9a880693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009fd0 tx=0x7f9aa0009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.063+0000 7f9a9a7fc700 1 -- 172.21.15.81:0/3816425172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a9c053490 con 0x7f9aa4157ca0 2023-10-06T02:50:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.288+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9aa40d0170 con 0x7f9aa4157ca0 2023-10-06T02:50:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.288+0000 7f9a9a7fc700 1 -- 172.21.15.81:0/3816425172 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9a9c015070 con 0x7f9aa4157ca0 2023-10-06T02:50:42.290 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:42.290 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2330757810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2330757810},{"type":"v1","addr":"172.21.15.83:6837","nonce":2330757810}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2957658297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2957658297},{"type":"v1","addr":"172.21.15.81:6834","nonce":2957658297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4153630712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4153630712},{"type":"v1","addr":"172.21.15.81:6835","nonce":4153630712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:49:58.066126+0000","modified":"2023-10-06T02:50:01.693730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/1398848175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1398848175},{"type":"v1","addr":"172.21.15.83:6836","nonce":1398848175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:50:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a88066f30 msgr2=0x7f9a880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a88066f30 0x7f9a880693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009fd0 tx=0x7f9aa0009880 comp rx=0 tx=0).stop 2023-10-06T02:50:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa4157ca0 msgr2=0x7f9aa4159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa4157ca0 0x7f9aa4159420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009290 tx=0x7f9a9c017000 comp rx=0 tx=0).stop 2023-10-06T02:50:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 shutdown_connections 2023-10-06T02:50:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aa4157ca0 0x7f9aa4159420 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a88066f30 0x7f9a880693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aa406d120 0x7f9aa40b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 --2- 172.21.15.81:0/3816425172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aa41578d0 0x7f9aa414b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 >> 172.21.15.81:0/3816425172 conn(0x7f9aa406bb90 msgr2=0x7f9aa40b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 shutdown_connections 2023-10-06T02:50:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.290+0000 7f9aac45b700 1 -- 172.21.15.81:0/3816425172 wait complete. 2023-10-06T02:50:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2023-10-06T02:50:42.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:50:42.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.419+0000 7fe53dec6700 1 Processor -- start 2023-10-06T02:50:42.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.419+0000 7fe53dec6700 1 -- start start 2023-10-06T02:50:42.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe53dec6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe538159f10 0x7fe538068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe53dec6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 0x7fe5380cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe53dec6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5380cee10 con 0x7fe538159b40 2023-10-06T02:50:42.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe53dec6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe538069140 con 0x7fe538159f10 2023-10-06T02:50:42.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe53dec6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380cd040 con 0x7fe538068cc0 2023-10-06T02:50:42.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe53cec4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe538159b40 0x7fe5380cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56942/0 (socket says 172.21.15.81:56942) 2023-10-06T02:50:42.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe53cec4700 1 -- 172.21.15.81:0/142054144 learned_addr learned my addr 172.21.15.81:0/142054144 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:42.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354799520 0 0) 0x7fe5380cee10 con 0x7fe538159b40 2023-10-06T02:50:42.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe520003570 con 0x7fe538159b40 2023-10-06T02:50:42.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52ffff700 1 --2- 172.21.15.81:0/142054144 >> v2:172.21.15.83:3300/0 conn(0x7fe538159f10 0x7fe538068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe53d6c5700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 0x7fe5380cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1315905108 0 0) 0x7fe520003570 con 0x7fe538159b40 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 msgr2=0x7fe5380cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 0x7fe5380cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 >> v2:172.21.15.83:3300/0 conn(0x7fe538159f10 msgr2=0x7fe538068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 --2- 172.21.15.81:0/142054144 >> v2:172.21.15.83:3300/0 conn(0x7fe538159f10 0x7fe538068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380cd320 con 0x7fe538159b40 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fe5340017f0 con 0x7fe538159b40 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe53d6c5700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 0x7fe5380cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 >> v1:172.21.15.81:6789/0 conn(0x7fe538159b40 legacy=0x7fe5380cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.420+0000 7fe52f7fe700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe520003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe52f7fe700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe520004810 0x7fe520004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe52f7fe700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 0x7fe520005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538069140 con 0x7fe520003a60 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380cd040 con 0x7fe520004810 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52000bc40 con 0x7fe538068cc0 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe53cec4700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe520003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe53d6c5700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 0x7fe520005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe52ffff700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe520004810 0x7fe520004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe53cec4700 1 -- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 msgr2=0x7fe520005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe53cec4700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 0x7fe520005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe53cec4700 1 -- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe520004810 msgr2=0x7fe520004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe53cec4700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe520004810 0x7fe520004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe53cec4700 1 -- 172.21.15.81:0/142054144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe520003570 con 0x7fe520003a60 2023-10-06T02:50:42.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe53d6c5700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe538068cc0 0x7fe520005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe53cec4700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe520003e70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe53400a970 tx=0x7fe534002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2702847090808555 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5340070d0 con 0x7fe520003a60 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe534007230 con 0x7fe520003a60 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.421+0000 7fe52f7fe700 1 -- 172.21.15.81:0/142054144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5340075f0 con 0x7fe520003a60 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.422+0000 7fe53dec6700 1 -- 172.21.15.81:0/142054144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 msgr2=0x7fe520003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.422+0000 7fe53dec6700 1 --2- 172.21.15.81:0/142054144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe520003e70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe53400a970 tx=0x7fe534002210 comp rx=0 tx=0).stop 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.422+0000 7fe53d6c5700 1 -- 172.21.15.81:0/142054144 reap_dead start 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.422+0000 7fe53dec6700 1 -- 172.21.15.81:0/142054144 shutdown_connections 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.422+0000 7fe53dec6700 1 -- 172.21.15.81:0/142054144 >> 172.21.15.81:0/142054144 conn(0x7fe5380cd660 msgr2=0x7fe5380cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.422+0000 7fe53dec6700 1 -- 172.21.15.81:0/142054144 shutdown_connections 2023-10-06T02:50:42.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.422+0000 7fe53dec6700 1 -- 172.21.15.81:0/142054144 wait complete. 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.423+0000 7fe53dec6700 1 Processor -- start 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.423+0000 7fe53dec6700 1 -- start start 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53dec6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe5380b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53dec6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe53816ae70 0x7fe53815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53dec6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe53816b400 0x7fe5380c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53dec6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380b3600 con 0x7fe520003a60 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53dec6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53815d8f0 con 0x7fe53816b400 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53dec6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53815ab90 con 0x7fe53816ae70 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53cec4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe5380b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53cec4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe5380b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53424/0 (socket says 172.21.15.81:53424) 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53cec4700 1 -- 172.21.15.81:0/1434057660 learned_addr learned my addr 172.21.15.81:0/1434057660 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53d6c5700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe53816b400 0x7fe5380c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe52ffff700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe53816ae70 0x7fe53815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53cec4700 1 -- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe53816ae70 msgr2=0x7fe53815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53cec4700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe53816ae70 0x7fe53815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53cec4700 1 -- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe53816b400 msgr2=0x7fe5380c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53cec4700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe53816b400 0x7fe5380c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53cec4700 1 -- 172.21.15.81:0/1434057660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53815ae70 con 0x7fe520003a60 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe52ffff700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe53816ae70 0x7fe53815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.424+0000 7fe53cec4700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe5380b30c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe53400afd0 tx=0x7fe534015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.425+0000 7fe52cff9700 1 -- 172.21.15.81:0/1434057660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534007960 con 0x7fe520003a60 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.425+0000 7fe52cff9700 1 -- 172.21.15.81:0/1434057660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe534007ac0 con 0x7fe520003a60 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.425+0000 7fe52cff9700 1 -- 172.21.15.81:0/1434057660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5340073a0 con 0x7fe520003a60 2023-10-06T02:50:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.425+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53815b150 con 0x7fe520003a60 2023-10-06T02:50:42.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.425+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53815a880 con 0x7fe520003a60 2023-10-06T02:50:42.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.426+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5380cc060 con 0x7fe520003a60 2023-10-06T02:50:42.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.427+0000 7fe52cff9700 1 -- 172.21.15.81:0/1434057660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe534024020 con 0x7fe520003a60 2023-10-06T02:50:42.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.427+0000 7fe52cff9700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe524066f30 0x7fe5240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.427+0000 7fe52cff9700 1 -- 172.21.15.81:0/1434057660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe5340862e0 con 0x7fe520003a60 2023-10-06T02:50:42.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.427+0000 7fe52cff9700 1 -- 172.21.15.81:0/1434057660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fe52406f0f0 con 0x7fe520003a60 2023-10-06T02:50:42.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.427+0000 7fe52ffff700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe524066f30 0x7fe5240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.428+0000 7fe52ffff700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe524066f30 0x7fe5240693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe528006fd0 tx=0x7fe528008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:42.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.431+0000 7fe52cff9700 1 -- 172.21.15.81:0/1434057660 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe534053560 con 0x7fe520003a60 2023-10-06T02:50:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.658+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5380ce7c0 con 0x7fe520003a60 2023-10-06T02:50:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.659+0000 7fe52cff9700 1 -- 172.21.15.81:0/1434057660 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fe534016030 con 0x7fe520003a60 2023-10-06T02:50:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:42.660 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2330757810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2330757810},{"type":"v1","addr":"172.21.15.83:6837","nonce":2330757810}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2957658297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2957658297},{"type":"v1","addr":"172.21.15.81:6834","nonce":2957658297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4153630712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4153630712},{"type":"v1","addr":"172.21.15.81:6835","nonce":4153630712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:49:58.066126+0000","modified":"2023-10-06T02:50:01.693730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/1398848175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1398848175},{"type":"v1","addr":"172.21.15.83:6836","nonce":1398848175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:50:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe524066f30 msgr2=0x7fe5240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe524066f30 0x7fe5240693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe528006fd0 tx=0x7fe528008040 comp rx=0 tx=0).stop 2023-10-06T02:50:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 msgr2=0x7fe5380b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe5380b30c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe53400afd0 tx=0x7fe534015000 comp rx=0 tx=0).stop 2023-10-06T02:50:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 shutdown_connections 2023-10-06T02:50:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe524066f30 0x7fe5240693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe53816b400 0x7fe5380c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520003a60 0x7fe5380b30c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 --2- 172.21.15.81:0/1434057660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe53816ae70 0x7fe53815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 >> 172.21.15.81:0/1434057660 conn(0x7fe5380cd660 msgr2=0x7fe53806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 shutdown_connections 2023-10-06T02:50:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.661+0000 7fe53dec6700 1 -- 172.21.15.81:0/1434057660 wait complete. 2023-10-06T02:50:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2023-10-06T02:50:42.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:50:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.788+0000 7f6509c1a700 1 Processor -- start 2023-10-06T02:50:42.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.788+0000 7f6509c1a700 1 -- start start 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f6509c1a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504159f10 0x7f6504068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f6509c1a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6504068cc0 0x7f65040cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f6509c1a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65040cee10 con 0x7f6504159b40 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f6509c1a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6504069140 con 0x7f6504068cc0 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f6509c1a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040cd040 con 0x7f6504159f10 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f6508c18700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6504159b40 0x7f65040cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56948/0 (socket says 172.21.15.81:56948) 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f6508c18700 1 -- 172.21.15.81:0/4237325077 learned_addr learned my addr 172.21.15.81:0/4237325077 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f64fbfff700 1 --2- 172.21.15.81:0/4237325077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504159f10 0x7f6504068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f6509419700 1 --2- 172.21.15.81:0/4237325077 >> v2:172.21.15.83:3300/0 conn(0x7f6504068cc0 0x7f65040cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f64fb7fe700 1 -- 172.21.15.81:0/4237325077 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739357938 0 0) 0x7f65040cee10 con 0x7f6504159b40 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.789+0000 7f64fb7fe700 1 -- 172.21.15.81:0/4237325077 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64ec003570 con 0x7f6504159b40 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f6509419700 1 -- 172.21.15.81:0/4237325077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504159f10 msgr2=0x7f6504068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f6509419700 1 --2- 172.21.15.81:0/4237325077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504159f10 0x7f6504068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f64fb7fe700 1 -- 172.21.15.81:0/4237325077 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3954761879 0 0) 0x7f64ec003570 con 0x7f6504159b40 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f6509419700 1 -- 172.21.15.81:0/4237325077 >> v1:172.21.15.81:6789/0 conn(0x7f6504159b40 legacy=0x7f65040cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f6509419700 1 -- 172.21.15.81:0/4237325077 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65040cd320 con 0x7f6504068cc0 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f6509419700 1 --2- 172.21.15.81:0/4237325077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504068cc0 0x7f65040cf2a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0098e0 tx=0x7f64fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1e043f4ad9d8c6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f64fb7fe700 1 -- 172.21.15.81:0/4237325077 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000017f0 con 0x7f6504068cc0 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f64fb7fe700 1 -- 172.21.15.81:0/4237325077 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc011420 con 0x7f6504068cc0 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f64fb7fe700 1 -- 172.21.15.81:0/4237325077 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0117c0 con 0x7f6504068cc0 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f6509c1a700 1 -- 172.21.15.81:0/4237325077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504068cc0 msgr2=0x7f65040cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.790+0000 7f6509c1a700 1 --2- 172.21.15.81:0/4237325077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504068cc0 0x7f65040cf2a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0098e0 tx=0x7f64fc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.791+0000 7f6509c1a700 1 -- 172.21.15.81:0/4237325077 shutdown_connections 2023-10-06T02:50:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.791+0000 7f6509c1a700 1 --2- 172.21.15.81:0/4237325077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504068cc0 0x7f65040cf2a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.791+0000 7f6509c1a700 1 --2- 172.21.15.81:0/4237325077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504159f10 0x7f6504068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.791+0000 7f6509c1a700 1 -- 172.21.15.81:0/4237325077 >> 172.21.15.81:0/4237325077 conn(0x7f65040cd660 msgr2=0x7f65040cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.791+0000 7f6509c1a700 1 -- 172.21.15.81:0/4237325077 shutdown_connections 2023-10-06T02:50:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.791+0000 7f6509c1a700 1 -- 172.21.15.81:0/4237325077 wait complete. 2023-10-06T02:50:42.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.792+0000 7f6509c1a700 1 Processor -- start 2023-10-06T02:50:42.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.792+0000 7f6509c1a700 1 -- start start 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509c1a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504068cc0 0x7f650416ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509c1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6504159b40 0x7f65040b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509c1a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504159f10 0x7f65040aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509c1a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65041481a0 con 0x7f6504159b40 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509c1a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040b5850 con 0x7f6504159f10 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509c1a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040b5ae0 con 0x7f6504068cc0 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64fbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6504159b40 0x7f65040b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64fbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6504159b40 0x7f65040b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53440/0 (socket says 172.21.15.81:53440) 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64fbfff700 1 -- 172.21.15.81:0/642288012 learned_addr learned my addr 172.21.15.81:0/642288012 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6508c18700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504068cc0 0x7f650416ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509419700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504159f10 0x7f65040aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64fbfff700 1 -- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504068cc0 msgr2=0x7f650416ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64fbfff700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504068cc0 0x7f650416ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64fbfff700 1 -- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504159f10 msgr2=0x7f65040aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64fbfff700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504159f10 0x7f65040aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64fbfff700 1 -- 172.21.15.81:0/642288012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc009420 con 0x7f6504159b40 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509419700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504159f10 0x7f65040aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64fbfff700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6504159b40 0x7f65040b5310 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f64f400e950 tx=0x7f64f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64f8ff9700 1 -- 172.21.15.81:0/642288012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4013680 con 0x7f6504159b40 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64f8ff9700 1 -- 172.21.15.81:0/642288012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f40137e0 con 0x7f6504159b40 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65040b5dc0 con 0x7f6504159b40 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f64f8ff9700 1 -- 172.21.15.81:0/642288012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4013ba0 con 0x7f6504159b40 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.793+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65040b6380 con 0x7f6504159b40 2023-10-06T02:50:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.794+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6504063e90 con 0x7f6504159b40 2023-10-06T02:50:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.795+0000 7f64f8ff9700 1 -- 172.21.15.81:0/642288012 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64f400c490 con 0x7f6504159b40 2023-10-06T02:50:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.795+0000 7f64f8ff9700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64f0066f30 0x7f64f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.795+0000 7f64f8ff9700 1 -- 172.21.15.81:0/642288012 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f64f40848f0 con 0x7f6504159b40 2023-10-06T02:50:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.795+0000 7f64f8ff9700 1 -- 172.21.15.81:0/642288012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f64f006f070 con 0x7f6504159b40 2023-10-06T02:50:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.795+0000 7f6508c18700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64f0066f30 0x7f64f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.796+0000 7f6508c18700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64f0066f30 0x7f64f00693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6504158c60 tx=0x7f6500001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.799+0000 7f64f8ff9700 1 -- 172.21.15.81:0/642288012 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64f4017060 con 0x7f6504159b40 2023-10-06T02:50:42.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.981+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65040ce7c0 con 0x7f6504159b40 2023-10-06T02:50:42.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.982+0000 7f64f8ff9700 1 -- 172.21.15.81:0/642288012 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16870 (secure 0 0 0) 0x7f64f4021070 con 0x7f6504159b40 2023-10-06T02:50:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:42.984 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":89,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:50:42.400075+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:49:55.704059+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:49:57.024962+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:50:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64f0066f30 msgr2=0x7f64f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64f0066f30 0x7f64f00693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6504158c60 tx=0x7f6500001640 comp rx=0 tx=0).stop 2023-10-06T02:50:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6504159b40 msgr2=0x7f65040b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6504159b40 0x7f65040b5310 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f64f400e950 tx=0x7f64f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 shutdown_connections 2023-10-06T02:50:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64f0066f30 0x7f64f00693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6504159f10 0x7f65040aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6504068cc0 0x7f650416ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 --2- 172.21.15.81:0/642288012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6504159b40 0x7f65040b5310 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:42.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 >> 172.21.15.81:0/642288012 conn(0x7f65040cd660 msgr2=0x7f650406df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:42.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 shutdown_connections 2023-10-06T02:50:42.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:42.984+0000 7f6509c1a700 1 -- 172.21.15.81:0/642288012 wait complete. 2023-10-06T02:50:42.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:50:43.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.111+0000 7fe3bb34a700 1 Processor -- start 2023-10-06T02:50:43.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.111+0000 7fe3bb34a700 1 -- start start 2023-10-06T02:50:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3bb34a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41578d0 0x7fe3b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3bb34a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3b406d120 0x7fe3b406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3bb34a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b406dac0 con 0x7fe3b4157ca0 2023-10-06T02:50:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3bb34a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b40d07c0 con 0x7fe3b406d120 2023-10-06T02:50:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3bb34a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40cfbb0 con 0x7fe3b41578d0 2023-10-06T02:50:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b98e7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3b406d120 0x7fe3b406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b88e5700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe3b4157ca0 0x7fe3b415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55430/0 (socket says 172.21.15.81:55430) 2023-10-06T02:50:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b90e6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41578d0 0x7fe3b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b88e5700 1 -- 172.21.15.81:0/1743945380 learned_addr learned my addr 172.21.15.81:0/1743945380 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b98e7700 1 -- 172.21.15.81:0/1743945380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41578d0 msgr2=0x7fe3b40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b98e7700 1 --2- 172.21.15.81:0/1743945380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41578d0 0x7fe3b40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b98e7700 1 -- 172.21.15.81:0/1743945380 >> v1:172.21.15.83:6789/0 conn(0x7fe3b4157ca0 legacy=0x7fe3b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b98e7700 1 -- 172.21.15.81:0/1743945380 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40cfe90 con 0x7fe3b406d120 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b3fff700 1 -- 172.21.15.81:0/1743945380 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739774108 0 0) 0x7fe3a8001490 con 0x7fe3b4157ca0 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.112+0000 7fe3b98e7700 1 --2- 172.21.15.81:0/1743945380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b406d120 0x7fe3b406d580 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40098e0 tx=0x7fe3a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b34dbebf1d17a552 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3b3fff700 1 -- 172.21.15.81:0/1743945380 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a400b640 con 0x7fe3b406d120 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3b3fff700 1 -- 172.21.15.81:0/1743945380 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a400b7a0 con 0x7fe3b406d120 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3b3fff700 1 -- 172.21.15.81:0/1743945380 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a400bb40 con 0x7fe3b406d120 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3bb34a700 1 -- 172.21.15.81:0/1743945380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b406d120 msgr2=0x7fe3b406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3bb34a700 1 --2- 172.21.15.81:0/1743945380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b406d120 0x7fe3b406d580 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40098e0 tx=0x7fe3a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3bb34a700 1 -- 172.21.15.81:0/1743945380 shutdown_connections 2023-10-06T02:50:43.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3bb34a700 1 --2- 172.21.15.81:0/1743945380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b406d120 0x7fe3b406d580 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3bb34a700 1 --2- 172.21.15.81:0/1743945380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41578d0 0x7fe3b40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3bb34a700 1 -- 172.21.15.81:0/1743945380 >> 172.21.15.81:0/1743945380 conn(0x7fe3b406bb90 msgr2=0x7fe3b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:43.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3bb34a700 1 -- 172.21.15.81:0/1743945380 shutdown_connections 2023-10-06T02:50:43.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.113+0000 7fe3bb34a700 1 -- 172.21.15.81:0/1743945380 wait complete. 2023-10-06T02:50:43.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.114+0000 7fe3bb34a700 1 Processor -- start 2023-10-06T02:50:43.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.114+0000 7fe3bb34a700 1 -- start start 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.115+0000 7fe3bb34a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b406d120 0x7fe3b40b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.115+0000 7fe3bb34a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b41578d0 0x7fe3b40aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.115+0000 7fe3bb34a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4157ca0 0x7fe3b4153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.115+0000 7fe3bb34a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4159c90 con 0x7fe3b41578d0 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.115+0000 7fe3bb34a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4159110 con 0x7fe3b4157ca0 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.115+0000 7fe3bb34a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41593f0 con 0x7fe3b406d120 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.115+0000 7fe3b88e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b41578d0 0x7fe3b40aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.115+0000 7fe3b88e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b41578d0 0x7fe3b40aaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53446/0 (socket says 172.21.15.81:53446) 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.115+0000 7fe3b88e5700 1 -- 172.21.15.81:0/406704274 learned_addr learned my addr 172.21.15.81:0/406704274 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b98e7700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4157ca0 0x7fe3b4153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b90e6700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b406d120 0x7fe3b40b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b88e5700 1 -- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b406d120 msgr2=0x7fe3b40b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b88e5700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b406d120 0x7fe3b40b6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b88e5700 1 -- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4157ca0 msgr2=0x7fe3b4153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b88e5700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4157ca0 0x7fe3b4153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b88e5700 1 -- 172.21.15.81:0/406704274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a4009420 con 0x7fe3b41578d0 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b98e7700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4157ca0 0x7fe3b4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b88e5700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b41578d0 0x7fe3b40aaae0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800cc70 tx=0x7fe3a8001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800ce80 con 0x7fe3b41578d0 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a800ab70 con 0x7fe3b41578d0 2023-10-06T02:50:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b41596d0 con 0x7fe3b41578d0 2023-10-06T02:50:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80070f0 con 0x7fe3b41578d0 2023-10-06T02:50:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.116+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b4158da0 con 0x7fe3b41578d0 2023-10-06T02:50:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.117+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b4156f00 con 0x7fe3b41578d0 2023-10-06T02:50:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.118+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3a80074e0 con 0x7fe3b41578d0 2023-10-06T02:50:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.118+0000 7fe3b17fa700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3a0066f30 0x7fe3a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.118+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3a80853c0 con 0x7fe3b41578d0 2023-10-06T02:50:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.118+0000 7fe3b90e6700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3a0066f30 0x7fe3a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.118+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fe3a006f0f0 con 0x7fe3b41578d0 2023-10-06T02:50:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.119+0000 7fe3b90e6700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3a0066f30 0x7fe3a00693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0093f0 tx=0x7fe3ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:43.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.122+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3a8052630 con 0x7fe3b41578d0 2023-10-06T02:50:43.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.347+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe3b406dac0 con 0x7fe3b41578d0 2023-10-06T02:50:43.348 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:50:43.348+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:50:43.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.349+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(90..90 src has 1..90) v4 ==== 1900+0+0 (secure 0 0 0) 0x7fe3a80569f0 con 0x7fe3b41578d0 2023-10-06T02:50:43.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.349+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7fe3a0070790 con 0x7fe3b41578d0 2023-10-06T02:50:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.352+0000 7fe3b17fa700 1 -- 172.21.15.81:0/406704274 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe3b406dac0 con 0x7fe3b41578d0 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3a0066f30 msgr2=0x7fe3a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3a0066f30 0x7fe3a00693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0093f0 tx=0x7fe3ac008040 comp rx=0 tx=0).stop 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b41578d0 msgr2=0x7fe3b40aaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b41578d0 0x7fe3b40aaae0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800cc70 tx=0x7fe3a8001a30 comp rx=0 tx=0).stop 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 shutdown_connections 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe3a0066f30 0x7fe3a00693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4157ca0 0x7fe3b4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b406d120 0x7fe3b40b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 --2- 172.21.15.81:0/406704274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b41578d0 0x7fe3b40aaae0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 >> 172.21.15.81:0/406704274 conn(0x7fe3b406bb90 msgr2=0x7fe3b4155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 shutdown_connections 2023-10-06T02:50:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.354+0000 7fe3bb34a700 1 -- 172.21.15.81:0/406704274 wait complete. 2023-10-06T02:50:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:50:43.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:50:43.390 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:50:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.483+0000 7f05a9980700 1 Processor -- start 2023-10-06T02:50:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.483+0000 7f05a9980700 1 -- start start 2023-10-06T02:50:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a9980700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05a40c8b60 0x7f05a40c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a9980700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a415b2f0 0x7f05a40ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a9980700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a406ee10 con 0x7f05a406f2a0 2023-10-06T02:50:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a9980700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a406e200 con 0x7f05a40c8b60 2023-10-06T02:50:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a9980700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a406e4e0 con 0x7f05a415b2f0 2023-10-06T02:50:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a897e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05a40c8b60 0x7f05a40c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a897e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05a40c8b60 0x7f05a40c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53450/0 (socket says 172.21.15.81:53450) 2023-10-06T02:50:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a897e700 1 -- 172.21.15.81:0/685815031 learned_addr learned my addr 172.21.15.81:0/685815031 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f059bfff700 1 --2- 172.21.15.81:0/685815031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a415b2f0 0x7f05a40ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a897e700 1 -- 172.21.15.81:0/685815031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a415b2f0 msgr2=0x7f05a40ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a897e700 1 --2- 172.21.15.81:0/685815031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a415b2f0 0x7f05a40ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a897e700 1 -- 172.21.15.81:0/685815031 >> v1:172.21.15.83:6789/0 conn(0x7f05a406f2a0 legacy=0x7f05a40ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f05a897e700 1 -- 172.21.15.81:0/685815031 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a406e7c0 con 0x7f05a40c8b60 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.484+0000 7f059bfff700 1 --2- 172.21.15.81:0/685815031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a415b2f0 0x7f05a40ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f05a897e700 1 --2- 172.21.15.81:0/685815031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a40c8b60 0x7f05a40c8f30 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009f20 tx=0x7f05a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e8061b5e359fb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f059b7fe700 1 -- 172.21.15.81:0/685815031 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a000e070 con 0x7f05a40c8b60 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f059b7fe700 1 -- 172.21.15.81:0/685815031 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a000ba40 con 0x7f05a40c8b60 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f059b7fe700 1 -- 172.21.15.81:0/685815031 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00092e0 con 0x7f05a40c8b60 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f05a9980700 1 -- 172.21.15.81:0/685815031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a40c8b60 msgr2=0x7f05a40c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f05a9980700 1 --2- 172.21.15.81:0/685815031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a40c8b60 0x7f05a40c8f30 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009f20 tx=0x7f05a0009840 comp rx=0 tx=0).stop 2023-10-06T02:50:43.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f05a9980700 1 -- 172.21.15.81:0/685815031 shutdown_connections 2023-10-06T02:50:43.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f05a9980700 1 --2- 172.21.15.81:0/685815031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a40c8b60 0x7f05a40c8f30 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f05a9980700 1 --2- 172.21.15.81:0/685815031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a415b2f0 0x7f05a40ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f05a9980700 1 -- 172.21.15.81:0/685815031 >> 172.21.15.81:0/685815031 conn(0x7f05a406cca0 msgr2=0x7f05a406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:43.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f05a9980700 1 -- 172.21.15.81:0/685815031 shutdown_connections 2023-10-06T02:50:43.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.485+0000 7f05a9980700 1 -- 172.21.15.81:0/685815031 wait complete. 2023-10-06T02:50:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.486+0000 7f05a9980700 1 Processor -- start 2023-10-06T02:50:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a9980700 1 -- start start 2023-10-06T02:50:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a9980700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05a406f2a0 0x7f05a4153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a9980700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a40c8b60 0x7f05a40c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a9980700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a415b2f0 0x7f05a40ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a9980700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40cdd30 con 0x7f05a415b2f0 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a9980700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4153e70 con 0x7f05a406f2a0 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a9980700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40c83b0 con 0x7f05a40c8b60 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a917f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a415b2f0 0x7f05a40ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a917f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a415b2f0 0x7f05a40ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53460/0 (socket says 172.21.15.81:53460) 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a917f700 1 -- 172.21.15.81:0/1388790684 learned_addr learned my addr 172.21.15.81:0/1388790684 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.487+0000 7f05a897e700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05a406f2a0 0x7f05a4153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f059bfff700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a40c8b60 0x7f05a40c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f05a917f700 1 -- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a40c8b60 msgr2=0x7f05a40c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f05a917f700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a40c8b60 0x7f05a40c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f05a917f700 1 -- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05a406f2a0 msgr2=0x7f05a4153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f05a917f700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05a406f2a0 0x7f05a4153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f05a917f700 1 -- 172.21.15.81:0/1388790684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a0009ae0 con 0x7f05a415b2f0 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f05a917f700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a415b2f0 0x7f05a40ce1c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f059c00b5e0 tx=0x7f059c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f0598ff9700 1 -- 172.21.15.81:0/1388790684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00f510 con 0x7f05a415b2f0 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f0598ff9700 1 -- 172.21.15.81:0/1388790684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c00f670 con 0x7f05a415b2f0 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a40cce40 con 0x7f05a415b2f0 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f0598ff9700 1 -- 172.21.15.81:0/1388790684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00fa30 con 0x7f05a415b2f0 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.488+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a40cd400 con 0x7f05a415b2f0 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.489+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a40cdea0 con 0x7f05a415b2f0 2023-10-06T02:50:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.489+0000 7f0598ff9700 1 -- 172.21.15.81:0/1388790684 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f059c01a400 con 0x7f05a415b2f0 2023-10-06T02:50:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.490+0000 7f0598ff9700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0590066f30 0x7f05900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.490+0000 7f0598ff9700 1 -- 172.21.15.81:0/1388790684 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f059c084070 con 0x7f05a415b2f0 2023-10-06T02:50:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.490+0000 7f05a897e700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0590066f30 0x7f05900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.490+0000 7f05a897e700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0590066f30 0x7f05900693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009880 tx=0x7f05a0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.494+0000 7f0598ff9700 1 -- 172.21.15.81:0/1388790684 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f059c0511b0 con 0x7f05a415b2f0 2023-10-06T02:50:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:43.715+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f05a40684e0 con 0x7f05a415b2f0 2023-10-06T02:50:44.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.411+0000 7f0598ff9700 1 -- 172.21.15.81:0/1388790684 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f059c0547d0 con 0x7f05a415b2f0 2023-10-06T02:50:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0590066f30 msgr2=0x7f05900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0590066f30 0x7f05900693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009880 tx=0x7f05a0017000 comp rx=0 tx=0).stop 2023-10-06T02:50:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a415b2f0 msgr2=0x7f05a40ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a415b2f0 0x7f05a40ce1c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f059c00b5e0 tx=0x7f059c009060 comp rx=0 tx=0).stop 2023-10-06T02:50:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 shutdown_connections 2023-10-06T02:50:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a415b2f0 0x7f05a40ce1c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0590066f30 0x7f05900693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05a406f2a0 0x7f05a4153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 --2- 172.21.15.81:0/1388790684 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f05a40c8b60 0x7f05a40c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:44.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 >> 172.21.15.81:0/1388790684 conn(0x7f05a406cca0 msgr2=0x7f05a40ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:44.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 shutdown_connections 2023-10-06T02:50:44.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.414+0000 7f05a9980700 1 -- 172.21.15.81:0/1388790684 wait complete. 2023-10-06T02:50:44.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:50:44.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.546+0000 7f3eb3a19700 1 Processor -- start 2023-10-06T02:50:44.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.546+0000 7f3eb3a19700 1 -- start start 2023-10-06T02:50:44.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb3a19700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3eac1578d0 0x7f3eac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:44.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb3a19700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 0x7f3eac06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb3a19700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0d07c0 con 0x7f3eac157ca0 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb3a19700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac06daa0 con 0x7f3eac1578d0 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb3a19700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0cfbb0 con 0x7f3eac06d120 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb17b5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3eac1578d0 0x7f3eac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb17b5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3eac1578d0 0x7f3eac0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53464/0 (socket says 172.21.15.81:53464) 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb17b5700 1 -- 172.21.15.81:0/2654950308 learned_addr learned my addr 172.21.15.81:0/2654950308 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb17b5700 1 -- 172.21.15.81:0/2654950308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 msgr2=0x7f3eac06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb1fb6700 1 --2- 172.21.15.81:0/2654950308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 0x7f3eac06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb17b5700 1 --2- 172.21.15.81:0/2654950308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 0x7f3eac06d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb17b5700 1 -- 172.21.15.81:0/2654950308 >> v1:172.21.15.83:6789/0 conn(0x7f3eac157ca0 legacy=0x7f3eac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb17b5700 1 -- 172.21.15.81:0/2654950308 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0cfe90 con 0x7f3eac1578d0 2023-10-06T02:50:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3eb17b5700 1 --2- 172.21.15.81:0/2654950308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac1578d0 0x7f3eac0cf4f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80099b0 tx=0x7f3ea8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca0023387645fc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3ea3fff700 1 -- 172.21.15.81:0/2654950308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800b820 con 0x7f3eac1578d0 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3ea3fff700 1 -- 172.21.15.81:0/2654950308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea800b980 con 0x7f3eac1578d0 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.547+0000 7f3ea3fff700 1 -- 172.21.15.81:0/2654950308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800bd20 con 0x7f3eac1578d0 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.548+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2654950308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac1578d0 msgr2=0x7f3eac0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.548+0000 7f3eb3a19700 1 --2- 172.21.15.81:0/2654950308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac1578d0 0x7f3eac0cf4f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80099b0 tx=0x7f3ea8009250 comp rx=0 tx=0).stop 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.548+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2654950308 shutdown_connections 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.548+0000 7f3eb3a19700 1 --2- 172.21.15.81:0/2654950308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 0x7f3eac06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.548+0000 7f3eb3a19700 1 --2- 172.21.15.81:0/2654950308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac1578d0 0x7f3eac0cf4f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.548+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2654950308 >> 172.21.15.81:0/2654950308 conn(0x7f3eac06bb90 msgr2=0x7f3eac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.548+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2654950308 shutdown_connections 2023-10-06T02:50:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.548+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2654950308 wait complete. 2023-10-06T02:50:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.549+0000 7f3eb3a19700 1 Processor -- start 2023-10-06T02:50:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.549+0000 7f3eb3a19700 1 -- start start 2023-10-06T02:50:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb3a19700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 0x7f3eac154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb3a19700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eac1578d0 0x7f3eac154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb3a19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac157ca0 0x7f3eac16dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb3a19700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac16b2d0 con 0x7f3eac157ca0 2023-10-06T02:50:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb3a19700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac16a440 con 0x7f3eac1578d0 2023-10-06T02:50:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb3a19700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac16a6c0 con 0x7f3eac06d120 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb1fb6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac157ca0 0x7f3eac16dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb1fb6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac157ca0 0x7f3eac16dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53474/0 (socket says 172.21.15.81:53474) 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb1fb6700 1 -- 172.21.15.81:0/2908789735 learned_addr learned my addr 172.21.15.81:0/2908789735 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb0fb4700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eac1578d0 0x7f3eac154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.550+0000 7f3eb17b5700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 0x7f3eac154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3eb1fb6700 1 -- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 msgr2=0x7f3eac154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3eb1fb6700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 0x7f3eac154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3eb1fb6700 1 -- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eac1578d0 msgr2=0x7f3eac154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3eb1fb6700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eac1578d0 0x7f3eac154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3eb1fb6700 1 -- 172.21.15.81:0/2908789735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80094f0 con 0x7f3eac157ca0 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3eb0fb4700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eac1578d0 0x7f3eac154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3eb1fb6700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac157ca0 0x7f3eac16dc90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400cee0 tx=0x7f3ea4007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3ea17fa700 1 -- 172.21.15.81:0/2908789735 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400ae60 con 0x7f3eac157ca0 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3ea17fa700 1 -- 172.21.15.81:0/2908789735 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4016430 con 0x7f3eac157ca0 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3ea17fa700 1 -- 172.21.15.81:0/2908789735 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40167d0 con 0x7f3eac157ca0 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac16a9a0 con 0x7f3eac157ca0 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.551+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac16af60 con 0x7f3eac157ca0 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.552+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac14ec60 con 0x7f3eac157ca0 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.552+0000 7f3ea17fa700 1 -- 172.21.15.81:0/2908789735 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ea4003020 con 0x7f3eac157ca0 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.553+0000 7f3ea17fa700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3e90066f30 0x7f3e900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.553+0000 7f3ea17fa700 1 -- 172.21.15.81:0/2908789735 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f3ea4012070 con 0x7f3eac157ca0 2023-10-06T02:50:44.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.553+0000 7f3eb17b5700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3e90066f30 0x7f3e900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:44.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.553+0000 7f3eb17b5700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3e90066f30 0x7f3e900693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80099b0 tx=0x7f3ea8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:44.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.557+0000 7f3ea17fa700 1 -- 172.21.15.81:0/2908789735 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ea40526b0 con 0x7f3eac157ca0 2023-10-06T02:50:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:44.738+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3eac0d0170 con 0x7f3eac157ca0 2023-10-06T02:50:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.415+0000 7f3ea17fa700 1 -- 172.21.15.81:0/2908789735 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3ea4055cd0 con 0x7f3eac157ca0 2023-10-06T02:50:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.418+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3e90066f30 msgr2=0x7f3e900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.419+0000 7f3eb3a19700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3e90066f30 0x7f3e900693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80099b0 tx=0x7f3ea8016000 comp rx=0 tx=0).stop 2023-10-06T02:50:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.419+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac157ca0 msgr2=0x7f3eac16dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.419+0000 7f3eb3a19700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac157ca0 0x7f3eac16dc90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400cee0 tx=0x7f3ea4007870 comp rx=0 tx=0).stop 2023-10-06T02:50:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.420+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 shutdown_connections 2023-10-06T02:50:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.420+0000 7f3eb3a19700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eac157ca0 0x7f3eac16dc90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.420+0000 7f3eb3a19700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3eac06d120 0x7f3eac154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.420+0000 7f3eb3a19700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3e90066f30 0x7f3e900693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.420+0000 7f3eb3a19700 1 --2- 172.21.15.81:0/2908789735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3eac1578d0 0x7f3eac154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.420+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 >> 172.21.15.81:0/2908789735 conn(0x7f3eac06bb90 msgr2=0x7f3eac15a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.420+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 shutdown_connections 2023-10-06T02:50:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.420+0000 7f3eb3a19700 1 -- 172.21.15.81:0/2908789735 wait complete. 2023-10-06T02:50:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:50:45.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:50:45.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.553+0000 7ff2b1d64700 1 Processor -- start 2023-10-06T02:50:45.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.553+0000 7ff2b1d64700 1 -- start start 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2b1d64700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac157ca0 0x7ff2ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2b1d64700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ac0d07c0 con 0x7ff2ac1578d0 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2b1d64700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ac0cfbb0 con 0x7ff2ac06d120 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2b1d64700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac0cfe90 con 0x7ff2ac157ca0 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2ab7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff2ac1578d0 0x7ff2ac15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56952/0 (socket says 172.21.15.81:56952) 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2ab7fe700 1 -- 172.21.15.81:0/150413396 learned_addr learned my addr 172.21.15.81:0/150413396 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2aaffd700 1 --2- 172.21.15.81:0/150413396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac157ca0 0x7ff2ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2aa7fc700 1 -- 172.21.15.81:0/150413396 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753787880 0 0) 0x7ff2ac0d07c0 con 0x7ff2ac1578d0 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2aa7fc700 1 -- 172.21.15.81:0/150413396 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff294003570 con 0x7ff2ac1578d0 2023-10-06T02:50:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2aa7fc700 1 -- 172.21.15.81:0/150413396 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886413616 0 0) 0x7ff2ac0cfbb0 con 0x7ff2ac06d120 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2aa7fc700 1 -- 172.21.15.81:0/150413396 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ac0d07c0 con 0x7ff2ac06d120 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2aaffd700 1 -- 172.21.15.81:0/150413396 >> v1:172.21.15.83:6789/0 conn(0x7ff2ac06d120 legacy=0x7ff2ac15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2aaffd700 1 -- 172.21.15.81:0/150413396 >> v1:172.21.15.81:6789/0 conn(0x7ff2ac1578d0 legacy=0x7ff2ac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.554+0000 7ff2aaffd700 1 -- 172.21.15.81:0/150413396 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac0d0170 con 0x7ff2ac157ca0 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2aaffd700 1 --2- 172.21.15.81:0/150413396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac157ca0 0x7ff2ac0cf4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009910 tx=0x7ff2a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf845e26b8744ffa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2aa7fc700 1 -- 172.21.15.81:0/150413396 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0011630 con 0x7ff2ac157ca0 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2aa7fc700 1 -- 172.21.15.81:0/150413396 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a0011790 con 0x7ff2ac157ca0 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2aa7fc700 1 -- 172.21.15.81:0/150413396 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0011b30 con 0x7ff2ac157ca0 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2b1d64700 1 -- 172.21.15.81:0/150413396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac157ca0 msgr2=0x7ff2ac0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2b1d64700 1 --2- 172.21.15.81:0/150413396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac157ca0 0x7ff2ac0cf4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009910 tx=0x7ff2a00091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2b1d64700 1 -- 172.21.15.81:0/150413396 shutdown_connections 2023-10-06T02:50:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2b1d64700 1 --2- 172.21.15.81:0/150413396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac157ca0 0x7ff2ac0cf4f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2b1d64700 1 -- 172.21.15.81:0/150413396 >> 172.21.15.81:0/150413396 conn(0x7ff2ac06bb90 msgr2=0x7ff2ac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2b1d64700 1 -- 172.21.15.81:0/150413396 shutdown_connections 2023-10-06T02:50:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.555+0000 7ff2b1d64700 1 -- 172.21.15.81:0/150413396 wait complete. 2023-10-06T02:50:45.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.556+0000 7ff2b1d64700 1 Processor -- start 2023-10-06T02:50:45.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2b1d64700 1 -- start start 2023-10-06T02:50:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2b1d64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ac06d120 0x7ff2ac0c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2b1d64700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2ac1578d0 0x7ff2ac0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2b1d64700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac0c6a40 0x7ff2ac153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2b1d64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac0c6ed0 con 0x7ff2ac06d120 2023-10-06T02:50:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2b1d64700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac0c82f0 con 0x7ff2ac1578d0 2023-10-06T02:50:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2b1d64700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac0c79c0 con 0x7ff2ac0c6a40 2023-10-06T02:50:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ac06d120 0x7ff2ac0c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ac06d120 0x7ff2ac0c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53482/0 (socket says 172.21.15.81:53482) 2023-10-06T02:50:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2ab7fe700 1 -- 172.21.15.81:0/3798903976 learned_addr learned my addr 172.21.15.81:0/3798903976 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2aaffd700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2ac1578d0 0x7ff2ac0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.557+0000 7ff2abfff700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac0c6a40 0x7ff2ac153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2ab7fe700 1 -- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac0c6a40 msgr2=0x7ff2ac153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2ab7fe700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac0c6a40 0x7ff2ac153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2ab7fe700 1 -- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2ac1578d0 msgr2=0x7ff2ac0b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2ab7fe700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2ac1578d0 0x7ff2ac0b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2ab7fe700 1 -- 172.21.15.81:0/3798903976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0009420 con 0x7ff2ac06d120 2023-10-06T02:50:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2ab7fe700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ac06d120 0x7ff2ac0c8780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00cce0 tx=0x7ff29c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2937fe700 1 -- 172.21.15.81:0/3798903976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00a8d0 con 0x7ff2ac06d120 2023-10-06T02:50:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2937fe700 1 -- 172.21.15.81:0/3798903976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00aa30 con 0x7ff2ac06d120 2023-10-06T02:50:45.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ac0c7ca0 con 0x7ff2ac06d120 2023-10-06T02:50:45.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2937fe700 1 -- 172.21.15.81:0/3798903976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00add0 con 0x7ff2ac06d120 2023-10-06T02:50:45.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.558+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ac153780 con 0x7ff2ac06d120 2023-10-06T02:50:45.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.559+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ac067ac0 con 0x7ff2ac06d120 2023-10-06T02:50:45.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.559+0000 7ff2937fe700 1 -- 172.21.15.81:0/3798903976 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff29c007300 con 0x7ff2ac06d120 2023-10-06T02:50:45.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.560+0000 7ff2937fe700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff298066f30 0x7ff2980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:45.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.560+0000 7ff2937fe700 1 -- 172.21.15.81:0/3798903976 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5706+0+0 (secure 0 0 0) 0x7ff29c084860 con 0x7ff2ac06d120 2023-10-06T02:50:45.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.560+0000 7ff2aaffd700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff298066f30 0x7ff2980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:45.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.560+0000 7ff2aaffd700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff298066f30 0x7ff2980693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0d1db0 tx=0x7ff2a0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:45.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.564+0000 7ff2937fe700 1 -- 172.21.15.81:0/3798903976 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff29c051b50 con 0x7ff2ac06d120 2023-10-06T02:50:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:45.748+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff2ac0d0450 con 0x7ff2ac06d120 2023-10-06T02:50:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.428+0000 7ff2937fe700 1 -- 172.21.15.81:0/3798903976 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff29c055170 con 0x7ff2ac06d120 2023-10-06T02:50:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.430+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff298066f30 msgr2=0x7ff2980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.430+0000 7ff2b1d64700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff298066f30 0x7ff2980693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0d1db0 tx=0x7ff2a0017000 comp rx=0 tx=0).stop 2023-10-06T02:50:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.430+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ac06d120 msgr2=0x7ff2ac0c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.430+0000 7ff2b1d64700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ac06d120 0x7ff2ac0c8780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00cce0 tx=0x7ff29c001b10 comp rx=0 tx=0).stop 2023-10-06T02:50:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.431+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 shutdown_connections 2023-10-06T02:50:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.431+0000 7ff2b1d64700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2ac0c6a40 0x7ff2ac153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.431+0000 7ff2b1d64700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ac06d120 0x7ff2ac0c8780 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.431+0000 7ff2b1d64700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff298066f30 0x7ff2980693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.431+0000 7ff2b1d64700 1 --2- 172.21.15.81:0/3798903976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2ac1578d0 0x7ff2ac0b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.431+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 >> 172.21.15.81:0/3798903976 conn(0x7ff2ac06bb90 msgr2=0x7ff2ac069170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.431+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 shutdown_connections 2023-10-06T02:50:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.431+0000 7ff2b1d64700 1 -- 172.21.15.81:0/3798903976 wait complete. 2023-10-06T02:50:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:50:46.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:50:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.563+0000 7fabd1d24700 1 Processor -- start 2023-10-06T02:50:46.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.563+0000 7fabd1d24700 1 -- start start 2023-10-06T02:50:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.564+0000 7fabd1d24700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabcc157ca0 0x7fabcc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.564+0000 7fabd1d24700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fabcc06d120 0x7fabcc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.564+0000 7fabd1d24700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabcc0d07c0 con 0x7fabcc1578d0 2023-10-06T02:50:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.564+0000 7fabd1d24700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc06da50 con 0x7fabcc157ca0 2023-10-06T02:50:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.564+0000 7fabd1d24700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc0cfbb0 con 0x7fabcc06d120 2023-10-06T02:50:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.564+0000 7fabcaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabcc157ca0 0x7fabcc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:46.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.564+0000 7fabcb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fabcc1578d0 0x7fabcc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56956/0 (socket says 172.21.15.81:56956) 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.564+0000 7fabcb7fe700 1 -- 172.21.15.81:0/839846516 learned_addr learned my addr 172.21.15.81:0/839846516 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabcbfff700 1 --2- 172.21.15.81:0/839846516 >> v2:172.21.15.83:3300/0 conn(0x7fabcc06d120 0x7fabcc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabcaffd700 1 -- 172.21.15.81:0/839846516 >> v2:172.21.15.83:3300/0 conn(0x7fabcc06d120 msgr2=0x7fabcc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabcaffd700 1 --2- 172.21.15.81:0/839846516 >> v2:172.21.15.83:3300/0 conn(0x7fabcc06d120 0x7fabcc06d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabcaffd700 1 -- 172.21.15.81:0/839846516 >> v1:172.21.15.81:6789/0 conn(0x7fabcc1578d0 legacy=0x7fabcc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabcaffd700 1 -- 172.21.15.81:0/839846516 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0cfe90 con 0x7fabcc157ca0 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabcbfff700 1 --2- 172.21.15.81:0/839846516 >> v2:172.21.15.83:3300/0 conn(0x7fabcc06d120 0x7fabcc06d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabca7fc700 1 -- 172.21.15.81:0/839846516 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212469374 0 0) 0x7fabcc0d07c0 con 0x7fabcc1578d0 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabcaffd700 1 --2- 172.21.15.81:0/839846516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc157ca0 0x7fabcc0cf4f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fabcc068300 tx=0x7fabb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71fe61d61fcb81f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabca7fc700 1 -- 172.21.15.81:0/839846516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400b6b0 con 0x7fabcc157ca0 2023-10-06T02:50:46.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabca7fc700 1 -- 172.21.15.81:0/839846516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb400b810 con 0x7fabcc157ca0 2023-10-06T02:50:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabca7fc700 1 -- 172.21.15.81:0/839846516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400bbb0 con 0x7fabcc157ca0 2023-10-06T02:50:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabd1d24700 1 -- 172.21.15.81:0/839846516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc157ca0 msgr2=0x7fabcc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabd1d24700 1 --2- 172.21.15.81:0/839846516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc157ca0 0x7fabcc0cf4f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fabcc068300 tx=0x7fabb40091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabd1d24700 1 -- 172.21.15.81:0/839846516 shutdown_connections 2023-10-06T02:50:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabd1d24700 1 --2- 172.21.15.81:0/839846516 >> v2:172.21.15.83:3300/0 conn(0x7fabcc06d120 0x7fabcc06d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabd1d24700 1 --2- 172.21.15.81:0/839846516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc157ca0 0x7fabcc0cf4f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabd1d24700 1 -- 172.21.15.81:0/839846516 >> 172.21.15.81:0/839846516 conn(0x7fabcc06bb90 msgr2=0x7fabcc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabd1d24700 1 -- 172.21.15.81:0/839846516 shutdown_connections 2023-10-06T02:50:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.565+0000 7fabd1d24700 1 -- 172.21.15.81:0/839846516 wait complete. 2023-10-06T02:50:46.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabd1d24700 1 Processor -- start 2023-10-06T02:50:46.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabd1d24700 1 -- start start 2023-10-06T02:50:46.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabd1d24700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabcc06d120 0x7fabcc0b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:46.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabd1d24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc1578d0 0x7fabcc0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:46.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabd1d24700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc157ca0 0x7fabcc0ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:46.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabd1d24700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0aaee0 con 0x7fabcc1578d0 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabd1d24700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0b2250 con 0x7fabcc157ca0 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabd1d24700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0b24f0 con 0x7fabcc06d120 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc1578d0 0x7fabcc0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc1578d0 0x7fabcc0b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53498/0 (socket says 172.21.15.81:53498) 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.567+0000 7fabcaffd700 1 -- 172.21.15.81:0/1633167561 learned_addr learned my addr 172.21.15.81:0/1633167561 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabcbfff700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc157ca0 0x7fabcc0ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabcb7fe700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabcc06d120 0x7fabcc0b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabcaffd700 1 -- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabcc06d120 msgr2=0x7fabcc0b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabcaffd700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabcc06d120 0x7fabcc0b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabcaffd700 1 -- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc157ca0 msgr2=0x7fabcc0ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabcaffd700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc157ca0 0x7fabcc0ab370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabcaffd700 1 -- 172.21.15.81:0/1633167561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009420 con 0x7fabcc1578d0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabcaffd700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc1578d0 0x7fabcc0b1d10 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fabb4013000 tx=0x7fabb4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabc37fe700 1 -- 172.21.15.81:0/1633167561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400bb90 con 0x7fabcc1578d0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabc37fe700 1 -- 172.21.15.81:0/1633167561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb4011420 con 0x7fabcc1578d0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc0b27d0 con 0x7fabcc1578d0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabc37fe700 1 -- 172.21.15.81:0/1633167561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40117a0 con 0x7fabcc1578d0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.568+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc0aab70 con 0x7fabcc1578d0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.569+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc0ab050 con 0x7fabcc1578d0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.569+0000 7fabc37fe700 1 -- 172.21.15.81:0/1633167561 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabb4011b90 con 0x7fabcc1578d0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.570+0000 7fabc37fe700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fabac066f30 0x7fabac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.570+0000 7fabc37fe700 1 -- 172.21.15.81:0/1633167561 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fabb4085cf0 con 0x7fabcc1578d0 2023-10-06T02:50:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.570+0000 7fabcb7fe700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fabac066f30 0x7fabac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.571+0000 7fabcb7fe700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fabac066f30 0x7fabac0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fabbc001560 tx=0x7fabbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.574+0000 7fabc37fe700 1 -- 172.21.15.81:0/1633167561 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabb408a070 con 0x7fabcc1578d0 2023-10-06T02:50:46.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.759+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fabcc0d0170 con 0x7fabcc1578d0 2023-10-06T02:50:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.762+0000 7fabc37fe700 1 -- 172.21.15.81:0/1633167561 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fabb4053100 con 0x7fabcc1578d0 2023-10-06T02:50:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fabac066f30 msgr2=0x7fabac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fabac066f30 0x7fabac0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fabbc001560 tx=0x7fabbc009040 comp rx=0 tx=0).stop 2023-10-06T02:50:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc1578d0 msgr2=0x7fabcc0b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc1578d0 0x7fabcc0b1d10 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fabb4013000 tx=0x7fabb4017000 comp rx=0 tx=0).stop 2023-10-06T02:50:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 shutdown_connections 2023-10-06T02:50:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fabac066f30 0x7fabac0693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc157ca0 0x7fabcc0ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fabcc06d120 0x7fabcc0b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 --2- 172.21.15.81:0/1633167561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabcc1578d0 0x7fabcc0b1d10 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 >> 172.21.15.81:0/1633167561 conn(0x7fabcc06bb90 msgr2=0x7fabcc155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:46.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 shutdown_connections 2023-10-06T02:50:46.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.764+0000 7fabd1d24700 1 -- 172.21.15.81:0/1633167561 wait complete. 2023-10-06T02:50:46.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-06T02:50:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.890+0000 7fc05139f700 1 Processor -- start 2023-10-06T02:50:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.890+0000 7fc05139f700 1 -- start start 2023-10-06T02:50:46.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.891+0000 7fc05139f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc04c1579f0 0x7fc04c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:46.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.891+0000 7fc05139f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c157dc0 0x7fc04c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:46.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.891+0000 7fc05139f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c0c9bd0 con 0x7fc04c06a2c0 2023-10-06T02:50:46.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.891+0000 7fc05139f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c06e330 con 0x7fc04c1579f0 2023-10-06T02:50:46.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.891+0000 7fc05139f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c06e5d0 con 0x7fc04c157dc0 2023-10-06T02:50:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.891+0000 7fc04affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc04c1579f0 0x7fc04c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.891+0000 7fc04b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc04c06a2c0 0x7fc04c0af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56958/0 (socket says 172.21.15.81:56958) 2023-10-06T02:50:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.891+0000 7fc04b7fe700 1 -- 172.21.15.81:0/1775190946 learned_addr learned my addr 172.21.15.81:0/1775190946 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc04a7fc700 1 --2- 172.21.15.81:0/1775190946 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c157dc0 0x7fc04c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc04affd700 1 -- 172.21.15.81:0/1775190946 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c157dc0 msgr2=0x7fc04c06a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc04affd700 1 --2- 172.21.15.81:0/1775190946 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c157dc0 0x7fc04c06a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc04affd700 1 -- 172.21.15.81:0/1775190946 >> v1:172.21.15.81:6789/0 conn(0x7fc04c06a2c0 legacy=0x7fc04c0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc049ffb700 1 -- 172.21.15.81:0/1775190946 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309418725 0 0) 0x7fc04c0c9bd0 con 0x7fc04c06a2c0 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc04affd700 1 -- 172.21.15.81:0/1775190946 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c06e8b0 con 0x7fc04c1579f0 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc04affd700 1 --2- 172.21.15.81:0/1775190946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 0x7fc04c0b07a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009e60 tx=0x7fc03c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf4e3769934f59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc049ffb700 1 -- 172.21.15.81:0/1775190946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00e070 con 0x7fc04c1579f0 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc049ffb700 1 -- 172.21.15.81:0/1775190946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c00bc30 con 0x7fc04c1579f0 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc049ffb700 1 -- 172.21.15.81:0/1775190946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c012430 con 0x7fc04c1579f0 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc05139f700 1 -- 172.21.15.81:0/1775190946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 msgr2=0x7fc04c0b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.892+0000 7fc05139f700 1 --2- 172.21.15.81:0/1775190946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 0x7fc04c0b07a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009e60 tx=0x7fc03c009780 comp rx=0 tx=0).stop 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.893+0000 7fc05139f700 1 -- 172.21.15.81:0/1775190946 shutdown_connections 2023-10-06T02:50:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.893+0000 7fc05139f700 1 --2- 172.21.15.81:0/1775190946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 0x7fc04c0b07a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.893+0000 7fc05139f700 1 --2- 172.21.15.81:0/1775190946 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c157dc0 0x7fc04c06a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.893+0000 7fc05139f700 1 -- 172.21.15.81:0/1775190946 >> 172.21.15.81:0/1775190946 conn(0x7fc04c06cca0 msgr2=0x7fc04c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.893+0000 7fc05139f700 1 -- 172.21.15.81:0/1775190946 shutdown_connections 2023-10-06T02:50:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.893+0000 7fc05139f700 1 -- 172.21.15.81:0/1775190946 wait complete. 2023-10-06T02:50:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.894+0000 7fc05139f700 1 Processor -- start 2023-10-06T02:50:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.894+0000 7fc05139f700 1 -- start start 2023-10-06T02:50:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc05139f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c06a2c0 0x7fc04c151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc05139f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 0x7fc04c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc05139f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc04c157dc0 0x7fc04c15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc05139f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c158450 con 0x7fc04c1579f0 2023-10-06T02:50:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc05139f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c15c9d0 con 0x7fc04c157dc0 2023-10-06T02:50:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc05139f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c15c130 con 0x7fc04c06a2c0 2023-10-06T02:50:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 0x7fc04c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 0x7fc04c15b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53512/0 (socket says 172.21.15.81:53512) 2023-10-06T02:50:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04a7fc700 1 -- 172.21.15.81:0/378824492 learned_addr learned my addr 172.21.15.81:0/378824492 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04affd700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c06a2c0 0x7fc04c151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04b7fe700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc04c157dc0 0x7fc04c15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04a7fc700 1 -- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c06a2c0 msgr2=0x7fc04c151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04a7fc700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c06a2c0 0x7fc04c151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04a7fc700 1 -- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc04c157dc0 msgr2=0x7fc04c15a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04a7fc700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc04c157dc0 0x7fc04c15a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04a7fc700 1 -- 172.21.15.81:0/378824492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c009a20 con 0x7fc04c1579f0 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc04a7fc700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 0x7fc04c15b6e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc03400d8c0 tx=0x7fc034008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc042ffd700 1 -- 172.21.15.81:0/378824492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034018070 con 0x7fc04c1579f0 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc042ffd700 1 -- 172.21.15.81:0/378824492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc034005a00 con 0x7fc04c1579f0 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c15c410 con 0x7fc04c1579f0 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc042ffd700 1 -- 172.21.15.81:0/378824492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034005dc0 con 0x7fc04c1579f0 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.895+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c152970 con 0x7fc04c1579f0 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.896+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c158220 con 0x7fc04c1579f0 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.897+0000 7fc042ffd700 1 -- 172.21.15.81:0/378824492 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc034012800 con 0x7fc04c1579f0 2023-10-06T02:50:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.897+0000 7fc042ffd700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc02c066f30 0x7fc02c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.897+0000 7fc042ffd700 1 -- 172.21.15.81:0/378824492 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc034084430 con 0x7fc04c1579f0 2023-10-06T02:50:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.897+0000 7fc04affd700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc02c066f30 0x7fc02c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.898+0000 7fc04affd700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc02c066f30 0x7fc02c0693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009e60 tx=0x7fc03c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:46.901+0000 7fc042ffd700 1 -- 172.21.15.81:0/378824492 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc04c158220 con 0x7fc04c1579f0 2023-10-06T02:50:47.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.165+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7fc04c158220 con 0x7fc04c1579f0 2023-10-06T02:50:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.429+0000 7fc042ffd700 1 -- 172.21.15.81:0/378824492 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v244) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc04c158220 con 0x7fc04c1579f0 2023-10-06T02:50:47.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc02c066f30 msgr2=0x7fc02c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:47.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc02c066f30 0x7fc02c0693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009e60 tx=0x7fc03c019000 comp rx=0 tx=0).stop 2023-10-06T02:50:47.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 msgr2=0x7fc04c15b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:47.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 0x7fc04c15b6e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc03400d8c0 tx=0x7fc034008040 comp rx=0 tx=0).stop 2023-10-06T02:50:47.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 shutdown_connections 2023-10-06T02:50:47.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc02c066f30 0x7fc02c0693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:47.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc04c157dc0 0x7fc04c15a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:47.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc04c06a2c0 0x7fc04c151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:47.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 --2- 172.21.15.81:0/378824492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c1579f0 0x7fc04c15b6e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:47.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 >> 172.21.15.81:0/378824492 conn(0x7fc04c06cca0 msgr2=0x7fc04c0c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:47.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 shutdown_connections 2023-10-06T02:50:47.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:47.431+0000 7fc05139f700 1 -- 172.21.15.81:0/378824492 wait complete. 2023-10-06T02:50:47.964 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-06T02:50:47.965 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-06T02:50:47.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-06T02:50:48.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.082+0000 7fe5c5405700 1 Processor -- start 2023-10-06T02:50:48.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.082+0000 7fe5c5405700 1 -- start start 2023-10-06T02:50:48.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5c5405700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5c01578d0 0x7fe5c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5c5405700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c0157ca0 0x7fe5c015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5c5405700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c00d07c0 con 0x7fe5c006d120 2023-10-06T02:50:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5c5405700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c00cfbb0 con 0x7fe5c01578d0 2023-10-06T02:50:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5c5405700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00cfe90 con 0x7fe5c0157ca0 2023-10-06T02:50:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5beffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5c01578d0 0x7fe5c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5beffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5c01578d0 0x7fe5c00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53520/0 (socket says 172.21.15.81:53520) 2023-10-06T02:50:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5beffd700 1 -- 172.21.15.81:0/3254032176 learned_addr learned my addr 172.21.15.81:0/3254032176 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5be7fc700 1 --2- 172.21.15.81:0/3254032176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c0157ca0 0x7fe5c015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5beffd700 1 -- 172.21.15.81:0/3254032176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c0157ca0 msgr2=0x7fe5c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5beffd700 1 --2- 172.21.15.81:0/3254032176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c0157ca0 0x7fe5c015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5beffd700 1 -- 172.21.15.81:0/3254032176 >> v1:172.21.15.83:6789/0 conn(0x7fe5c006d120 legacy=0x7fe5c015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5beffd700 1 -- 172.21.15.81:0/3254032176 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c00d0170 con 0x7fe5c01578d0 2023-10-06T02:50:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5beffd700 1 --2- 172.21.15.81:0/3254032176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 0x7fe5c00cf4f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00099b0 tx=0x7fe5b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f937dfefa219d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5bdffb700 1 -- 172.21.15.81:0/3254032176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0009ea0 con 0x7fe5c01578d0 2023-10-06T02:50:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5bdffb700 1 -- 172.21.15.81:0/3254032176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000b860 con 0x7fe5c01578d0 2023-10-06T02:50:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.083+0000 7fe5bdffb700 1 -- 172.21.15.81:0/3254032176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000bc00 con 0x7fe5c01578d0 2023-10-06T02:50:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.084+0000 7fe5c5405700 1 -- 172.21.15.81:0/3254032176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 msgr2=0x7fe5c00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.084+0000 7fe5c5405700 1 --2- 172.21.15.81:0/3254032176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 0x7fe5c00cf4f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00099b0 tx=0x7fe5b0009250 comp rx=0 tx=0).stop 2023-10-06T02:50:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.084+0000 7fe5c5405700 1 -- 172.21.15.81:0/3254032176 shutdown_connections 2023-10-06T02:50:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.084+0000 7fe5c5405700 1 --2- 172.21.15.81:0/3254032176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 0x7fe5c00cf4f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.084+0000 7fe5c5405700 1 --2- 172.21.15.81:0/3254032176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c0157ca0 0x7fe5c015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.084+0000 7fe5c5405700 1 -- 172.21.15.81:0/3254032176 >> 172.21.15.81:0/3254032176 conn(0x7fe5c006bb90 msgr2=0x7fe5c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.084+0000 7fe5c5405700 1 -- 172.21.15.81:0/3254032176 shutdown_connections 2023-10-06T02:50:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.084+0000 7fe5c5405700 1 -- 172.21.15.81:0/3254032176 wait complete. 2023-10-06T02:50:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.085+0000 7fe5c5405700 1 Processor -- start 2023-10-06T02:50:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.085+0000 7fe5c5405700 1 -- start start 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5c5405700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c006d120 0x7fe5c00b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5c5405700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 0x7fe5c0153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5c5405700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c0157ca0 0x7fe5c015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5c5405700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c014e2b0 con 0x7fe5c01578d0 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5c5405700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00b4af0 con 0x7fe5c0157ca0 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5c5405700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00b58f0 con 0x7fe5c006d120 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5be7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 0x7fe5c0153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5be7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 0x7fe5c0153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53526/0 (socket says 172.21.15.81:53526) 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5be7fc700 1 -- 172.21.15.81:0/1529483388 learned_addr learned my addr 172.21.15.81:0/1529483388 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5beffd700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c006d120 0x7fe5c00b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5bf7fe700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c0157ca0 0x7fe5c015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5be7fc700 1 -- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c006d120 msgr2=0x7fe5c00b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5be7fc700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c006d120 0x7fe5c00b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5be7fc700 1 -- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c0157ca0 msgr2=0x7fe5c015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5be7fc700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c0157ca0 0x7fe5c015b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5be7fc700 1 -- 172.21.15.81:0/1529483388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b00094f0 con 0x7fe5c01578d0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.086+0000 7fe5be7fc700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 0x7fe5c0153570 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e930 tx=0x7fe5b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.087+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/1529483388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400eed0 con 0x7fe5c01578d0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.087+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/1529483388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b400c8e0 con 0x7fe5c01578d0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.087+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c00b4ce0 con 0x7fe5c01578d0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.087+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/1529483388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400cc80 con 0x7fe5c01578d0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.087+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c00b52a0 con 0x7fe5c01578d0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.088+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c0067ac0 con 0x7fe5c01578d0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.088+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/1529483388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5b4013470 con 0x7fe5c01578d0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.088+0000 7fe5a6ffd700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5ac066f30 0x7fe5ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.088+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/1529483388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fe5b4084660 con 0x7fe5c01578d0 2023-10-06T02:50:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.088+0000 7fe5beffd700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5ac066f30 0x7fe5ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.089+0000 7fe5beffd700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5ac066f30 0x7fe5ac0693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00099b0 tx=0x7fe5b0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.093+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/1529483388 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5b4051a70 con 0x7fe5c01578d0 2023-10-06T02:50:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.347+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7fe5c00b5640 con 0x7fe5c01578d0 2023-10-06T02:50:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.433+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/1529483388 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v245) v1 ==== 140+0+0 (secure 0 0 0) 0x7fe5b4055090 con 0x7fe5c01578d0 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5ac066f30 msgr2=0x7fe5ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5ac066f30 0x7fe5ac0693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00099b0 tx=0x7fe5b0017000 comp rx=0 tx=0).stop 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 msgr2=0x7fe5c0153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 0x7fe5c0153570 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e930 tx=0x7fe5b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 shutdown_connections 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe5ac066f30 0x7fe5ac0693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c0157ca0 0x7fe5c015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5c006d120 0x7fe5c00b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 --2- 172.21.15.81:0/1529483388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c01578d0 0x7fe5c0153570 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 >> 172.21.15.81:0/1529483388 conn(0x7fe5c006bb90 msgr2=0x7fe5c006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 shutdown_connections 2023-10-06T02:50:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.435+0000 7fe5c5405700 1 -- 172.21.15.81:0/1529483388 wait complete. 2023-10-06T02:50:48.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-06T02:50:48.577 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-06T02:50:48.577 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-06T02:50:48.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:50:48.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.694+0000 7f8e9f11b700 1 Processor -- start 2023-10-06T02:50:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.694+0000 7f8e9f11b700 1 -- start start 2023-10-06T02:50:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9f11b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e981578d0 0x7f8e980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9f11b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e9806d120 0x7f8e9806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9f11b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980d07c0 con 0x7f8e98157ca0 2023-10-06T02:50:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9f11b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9806daa0 con 0x7f8e981578d0 2023-10-06T02:50:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9f11b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980cfbb0 con 0x7f8e9806d120 2023-10-06T02:50:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9ceb7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e981578d0 0x7f8e980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9ceb7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e981578d0 0x7f8e980cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53540/0 (socket says 172.21.15.81:53540) 2023-10-06T02:50:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9ceb7700 1 -- 172.21.15.81:0/164184833 learned_addr learned my addr 172.21.15.81:0/164184833 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9d6b8700 1 --2- 172.21.15.81:0/164184833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e9806d120 0x7f8e9806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9ceb7700 1 -- 172.21.15.81:0/164184833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e9806d120 msgr2=0x7f8e9806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9ceb7700 1 --2- 172.21.15.81:0/164184833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e9806d120 0x7f8e9806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9ceb7700 1 -- 172.21.15.81:0/164184833 >> v1:172.21.15.83:6789/0 conn(0x7f8e98157ca0 legacy=0x7f8e9815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.695+0000 7f8e9ceb7700 1 -- 172.21.15.81:0/164184833 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980cfe90 con 0x7f8e981578d0 2023-10-06T02:50:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e9ceb7700 1 --2- 172.21.15.81:0/164184833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 0x7f8e980cf4f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009f20 tx=0x7f8e94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876e0d5f76aa1291 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e8f7fe700 1 -- 172.21.15.81:0/164184833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400e070 con 0x7f8e981578d0 2023-10-06T02:50:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e8f7fe700 1 -- 172.21.15.81:0/164184833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9400ba40 con 0x7f8e981578d0 2023-10-06T02:50:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e8f7fe700 1 -- 172.21.15.81:0/164184833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940092e0 con 0x7f8e981578d0 2023-10-06T02:50:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e9f11b700 1 -- 172.21.15.81:0/164184833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 msgr2=0x7f8e980cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e9f11b700 1 --2- 172.21.15.81:0/164184833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 0x7f8e980cf4f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009f20 tx=0x7f8e94009840 comp rx=0 tx=0).stop 2023-10-06T02:50:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e9f11b700 1 -- 172.21.15.81:0/164184833 shutdown_connections 2023-10-06T02:50:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e9f11b700 1 --2- 172.21.15.81:0/164184833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e9806d120 0x7f8e9806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e9f11b700 1 --2- 172.21.15.81:0/164184833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 0x7f8e980cf4f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e9f11b700 1 -- 172.21.15.81:0/164184833 >> 172.21.15.81:0/164184833 conn(0x7f8e9806bb90 msgr2=0x7f8e9806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e9f11b700 1 -- 172.21.15.81:0/164184833 shutdown_connections 2023-10-06T02:50:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.696+0000 7f8e9f11b700 1 -- 172.21.15.81:0/164184833 wait complete. 2023-10-06T02:50:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.697+0000 7f8e9f11b700 1 Processor -- start 2023-10-06T02:50:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e9f11b700 1 -- start start 2023-10-06T02:50:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e9f11b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e9806d120 0x7f8e98153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e9f11b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 0x7f8e9815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e9f11b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e98157ca0 0x7f8e9815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e9f11b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9816e6d0 con 0x7f8e981578d0 2023-10-06T02:50:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e9f11b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9816f250 con 0x7f8e9806d120 2023-10-06T02:50:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e9f11b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9816e920 con 0x7f8e98157ca0 2023-10-06T02:50:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 0x7f8e9815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 0x7f8e9815c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53554/0 (socket says 172.21.15.81:53554) 2023-10-06T02:50:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e8ffff700 1 -- 172.21.15.81:0/2276393263 learned_addr learned my addr 172.21.15.81:0/2276393263 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e9ceb7700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e9806d120 0x7f8e98153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.698+0000 7f8e9d6b8700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e98157ca0 0x7f8e9815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e8ffff700 1 -- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e98157ca0 msgr2=0x7f8e9815cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e8ffff700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e98157ca0 0x7f8e9815cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e8ffff700 1 -- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e9806d120 msgr2=0x7f8e98153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e8ffff700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e9806d120 0x7f8e98153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e8ffff700 1 -- 172.21.15.81:0/2276393263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e94009ae0 con 0x7f8e981578d0 2023-10-06T02:50:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e8ffff700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 0x7f8e9815c7e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800b5e0 tx=0x7f8e880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e8cff9700 1 -- 172.21.15.81:0/2276393263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800f510 con 0x7f8e981578d0 2023-10-06T02:50:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e8cff9700 1 -- 172.21.15.81:0/2276393263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8800f690 con 0x7f8e981578d0 2023-10-06T02:50:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e8cff9700 1 -- 172.21.15.81:0/2276393263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800fa50 con 0x7f8e981578d0 2023-10-06T02:50:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9816ec00 con 0x7f8e981578d0 2023-10-06T02:50:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.699+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9816b340 con 0x7f8e981578d0 2023-10-06T02:50:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.700+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9816f400 con 0x7f8e981578d0 2023-10-06T02:50:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.700+0000 7f8e8cff9700 1 -- 172.21.15.81:0/2276393263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e8801a400 con 0x7f8e981578d0 2023-10-06T02:50:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.701+0000 7f8e8cff9700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8e84066f30 0x7f8e840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.701+0000 7f8e8cff9700 1 -- 172.21.15.81:0/2276393263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8e88083cb0 con 0x7f8e981578d0 2023-10-06T02:50:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.701+0000 7f8e9ceb7700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8e84066f30 0x7f8e840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.701+0000 7f8e9ceb7700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8e84066f30 0x7f8e840693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009880 tx=0x7f8e94017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.705+0000 7f8e8cff9700 1 -- 172.21.15.81:0/2276393263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e9816f400 con 0x7f8e981578d0 2023-10-06T02:50:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.886+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8e9806a7f0 con 0x7f8e981578d0 2023-10-06T02:50:48.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.892+0000 7f8e8cff9700 1 -- 172.21.15.81:0/2276393263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8e88051140 con 0x7f8e981578d0 2023-10-06T02:50:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8e84066f30 msgr2=0x7f8e840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8e84066f30 0x7f8e840693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009880 tx=0x7f8e94017000 comp rx=0 tx=0).stop 2023-10-06T02:50:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 msgr2=0x7f8e9815c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 0x7f8e9815c7e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800b5e0 tx=0x7f8e880090f0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 shutdown_connections 2023-10-06T02:50:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e98157ca0 0x7f8e9815cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8e84066f30 0x7f8e840693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e9806d120 0x7f8e98153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 --2- 172.21.15.81:0/2276393263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e981578d0 0x7f8e9815c7e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 >> 172.21.15.81:0/2276393263 conn(0x7f8e9806bb90 msgr2=0x7f8e98068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 shutdown_connections 2023-10-06T02:50:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:48.894+0000 7f8e9f11b700 1 -- 172.21.15.81:0/2276393263 wait complete. 2023-10-06T02:50:48.908 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:50:48.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:50:48.942 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:50:48.988 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:50:48.989 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:50:48.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:50:49.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.102+0000 7efcc87dd700 1 Processor -- start 2023-10-06T02:50:49.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.102+0000 7efcc87dd700 1 -- start start 2023-10-06T02:50:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc87dd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efcc0156db0 0x7efcc006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc87dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc87dd700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc006ebd0 con 0x7efcc01569e0 2023-10-06T02:50:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc87dd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc00b2290 con 0x7efcc0156db0 2023-10-06T02:50:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc87dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc0157c00 con 0x7efcc006e770 2023-10-06T02:50:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc6d7a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc5d78700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efcc0156db0 0x7efcc006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc6579700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7efcc01569e0 0x7efcc00b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55490/0 (socket says 172.21.15.81:55490) 2023-10-06T02:50:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc6579700 1 -- 172.21.15.81:0/129267847 learned_addr learned my addr 172.21.15.81:0/129267847 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc6d7a700 1 --2- 172.21.15.81:0/129267847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:55054/0 (socket says 172.21.15.81:55054) 2023-10-06T02:50:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc5d78700 1 --2- 172.21.15.81:0/129267847 >> v2:172.21.15.83:3300/0 conn(0x7efcc0156db0 0x7efcc006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:58028/0 (socket says 172.21.15.81:58028) 2023-10-06T02:50:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc5d78700 1 -- 172.21.15.81:0/129267847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 msgr2=0x7efcc00cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc5d78700 1 --2- 172.21.15.81:0/129267847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc5d78700 1 -- 172.21.15.81:0/129267847 >> v1:172.21.15.83:6789/0 conn(0x7efcc01569e0 legacy=0x7efcc00b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc5d78700 1 -- 172.21.15.81:0/129267847 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc01572d0 con 0x7efcc0156db0 2023-10-06T02:50:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.103+0000 7efcc6d7a700 1 --2- 172.21.15.81:0/129267847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:50:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc5d78700 1 --2- 172.21.15.81:0/129267847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc0156db0 0x7efcc006e230 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009e60 tx=0x7efcb4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=729f991acd7cd0a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc5577700 1 -- 172.21.15.81:0/129267847 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400e070 con 0x7efcc0156db0 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc5577700 1 -- 172.21.15.81:0/129267847 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb400bb60 con 0x7efcc0156db0 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc5577700 1 -- 172.21.15.81:0/129267847 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4012430 con 0x7efcc0156db0 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc87dd700 1 -- 172.21.15.81:0/129267847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc0156db0 msgr2=0x7efcc006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc87dd700 1 --2- 172.21.15.81:0/129267847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc0156db0 0x7efcc006e230 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009e60 tx=0x7efcb4009780 comp rx=0 tx=0).stop 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc87dd700 1 -- 172.21.15.81:0/129267847 shutdown_connections 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc87dd700 1 --2- 172.21.15.81:0/129267847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc87dd700 1 --2- 172.21.15.81:0/129267847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc0156db0 0x7efcc006e230 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc87dd700 1 -- 172.21.15.81:0/129267847 >> 172.21.15.81:0/129267847 conn(0x7efcc006cca0 msgr2=0x7efcc006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc87dd700 1 -- 172.21.15.81:0/129267847 shutdown_connections 2023-10-06T02:50:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.104+0000 7efcc87dd700 1 -- 172.21.15.81:0/129267847 wait complete. 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.105+0000 7efcc87dd700 1 Processor -- start 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.105+0000 7efcc87dd700 1 -- start start 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc87dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc87dd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc01569e0 0x7efcc00cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc87dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc0156db0 0x7efcc013fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc87dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00cb830 con 0x7efcc0156db0 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc87dd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00c3550 con 0x7efcc01569e0 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc87dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00cac20 con 0x7efcc006e770 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc6d7a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc0156db0 0x7efcc013fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc6d7a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc0156db0 0x7efcc013fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53556/0 (socket says 172.21.15.81:53556) 2023-10-06T02:50:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc6d7a700 1 -- 172.21.15.81:0/3016648875 learned_addr learned my addr 172.21.15.81:0/3016648875 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc6579700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.106+0000 7efcc5d78700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc01569e0 0x7efcc00cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcc6d7a700 1 -- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 msgr2=0x7efcc00c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcc6d7a700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcc6d7a700 1 -- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc01569e0 msgr2=0x7efcc00cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcc6d7a700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc01569e0 0x7efcc00cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcc6d7a700 1 -- 172.21.15.81:0/3016648875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0009420 con 0x7efcc0156db0 2023-10-06T02:50:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcc5d78700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc01569e0 0x7efcc00cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcc6d7a700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc0156db0 0x7efcc013fdf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efcb000ec80 tx=0x7efcb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcbe7fc700 1 -- 172.21.15.81:0/3016648875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb000c9d0 con 0x7efcc0156db0 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcbe7fc700 1 -- 172.21.15.81:0/3016648875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb000cb30 con 0x7efcc0156db0 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb4009a20 con 0x7efcc0156db0 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcbe7fc700 1 -- 172.21.15.81:0/3016648875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0013470 con 0x7efcc0156db0 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.107+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc00cb1e0 con 0x7efcc0156db0 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.108+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc00cb9a0 con 0x7efcc0156db0 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.108+0000 7efcbe7fc700 1 -- 172.21.15.81:0/3016648875 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcb0013860 con 0x7efcc0156db0 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.108+0000 7efcbe7fc700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efcac066f30 0x7efcac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.108+0000 7efcbe7fc700 1 -- 172.21.15.81:0/3016648875 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7efcb0084530 con 0x7efcc0156db0 2023-10-06T02:50:49.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.109+0000 7efcc6579700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efcac066f30 0x7efcac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:49.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.109+0000 7efcc6579700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efcac066f30 0x7efcac0693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efcb8001820 tx=0x7efcb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:49.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.113+0000 7efcbe7fc700 1 -- 172.21.15.81:0/3016648875 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcb0051940 con 0x7efcc0156db0 2023-10-06T02:50:49.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.337+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcc01575b0 con 0x7efcc0156db0 2023-10-06T02:50:49.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.337+0000 7efcbe7fc700 1 -- 172.21.15.81:0/3016648875 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3529 (secure 0 0 0) 0x7efcb0017de0 con 0x7efcc0156db0 2023-10-06T02:50:49.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:49.339 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5531,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3214804399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3214804399},{"type":"v1","addr":"172.21.15.83:6836","nonce":3214804399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5845,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2330757810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2330757810},{"type":"v1","addr":"172.21.15.83:6837","nonce":2330757810}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2957658297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2957658297},{"type":"v1","addr":"172.21.15.81:6834","nonce":2957658297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4153630712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4153630712},{"type":"v1","addr":"172.21.15.81:6835","nonce":4153630712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[]} 2023-10-06T02:50:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efcac066f30 msgr2=0x7efcac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efcac066f30 0x7efcac0693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efcb8001820 tx=0x7efcb8009040 comp rx=0 tx=0).stop 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc0156db0 msgr2=0x7efcc013fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc0156db0 0x7efcc013fdf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efcb000ec80 tx=0x7efcb00091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 shutdown_connections 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc0156db0 0x7efcc013fdf0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efcc006e770 0x7efcc00c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efcac066f30 0x7efcac0693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 --2- 172.21.15.81:0/3016648875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efcc01569e0 0x7efcc00cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 >> 172.21.15.81:0/3016648875 conn(0x7efcc006cca0 msgr2=0x7efcc0154460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 shutdown_connections 2023-10-06T02:50:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:49.339+0000 7efcc87dd700 1 -- 172.21.15.81:0/3016648875 wait complete. 2023-10-06T02:50:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2023-10-06T02:50:49.353 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:50:49.353 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:50:49.353 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:50:49.353 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:50:49.353 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:50:49.353 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:50:49.353 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:50:49.354 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:50:49.354 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:50:49.354 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:50:49.354 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:50:49.354 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:50:49.354 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:50:49.354 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:50:49.355 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:50:49.355 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:50:49.361 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:50:49.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:50:49.362 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:50:49.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:50:49.365 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:50:49.365 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:50:49.404 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:50:49.405 DEBUG:teuthology.parallel:result is None 2023-10-06T02:50:49.405 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:50:49.405 DEBUG:teuthology.parallel:result is None 2023-10-06T02:50:49.407 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:50:49.408 DEBUG:teuthology.parallel:result is None 2023-10-06T02:50:49.477 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:50:49.477 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:50:49.477 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-06T02:50:49.476+0000 7fcbf9260700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-06T02:50:49.488 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:50:55.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T02:50:55.365 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:50:55.365 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:50:55.368 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:50:55.368 DEBUG:teuthology.parallel:result is None 2023-10-06T02:50:55.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:50:55.448 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:50:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.487+0000 7f0e5864d700 1 Processor -- start 2023-10-06T02:50:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.487+0000 7f0e5864d700 1 -- start start 2023-10-06T02:50:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.488+0000 7f0e5864d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0e500aeea0 0x7f0e500c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.488+0000 7f0e5864d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500af270 0x7f0e500c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.488+0000 7f0e5864d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5006aae0 con 0x7f0e500c7d00 2023-10-06T02:50:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.488+0000 7f0e5864d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e50069ed0 con 0x7f0e500aeea0 2023-10-06T02:50:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.488+0000 7f0e5864d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5006a1b0 con 0x7f0e500af270 2023-10-06T02:50:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.488+0000 7f0e56bea700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0e500c7d00 0x7f0e500c8140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51832/0 (socket says 172.21.15.81:51832) 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e56bea700 1 -- 172.21.15.81:0/602669214 learned_addr learned my addr 172.21.15.81:0/602669214 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e55be8700 1 --2- 172.21.15.81:0/602669214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500af270 0x7f0e500c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e563e9700 1 --2- 172.21.15.81:0/602669214 >> v2:172.21.15.83:3300/0 conn(0x7f0e500aeea0 0x7f0e500c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e553e7700 1 -- 172.21.15.81:0/602669214 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747062200 0 0) 0x7f0e5006aae0 con 0x7f0e500c7d00 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e553e7700 1 -- 172.21.15.81:0/602669214 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e3c003570 con 0x7f0e500c7d00 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e55be8700 1 -- 172.21.15.81:0/602669214 >> v2:172.21.15.83:3300/0 conn(0x7f0e500aeea0 msgr2=0x7f0e500c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e55be8700 1 --2- 172.21.15.81:0/602669214 >> v2:172.21.15.83:3300/0 conn(0x7f0e500aeea0 0x7f0e500c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e55be8700 1 -- 172.21.15.81:0/602669214 >> v1:172.21.15.81:6789/0 conn(0x7f0e500c7d00 legacy=0x7f0e500c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e55be8700 1 -- 172.21.15.81:0/602669214 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5006a490 con 0x7f0e500af270 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e563e9700 1 --2- 172.21.15.81:0/602669214 >> v2:172.21.15.83:3300/0 conn(0x7f0e500aeea0 0x7f0e500c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e55be8700 1 --2- 172.21.15.81:0/602669214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500af270 0x7f0e500c2e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e400098e0 tx=0x7f0e400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e815129f5ea27f27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e553e7700 1 -- 172.21.15.81:0/602669214 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011630 con 0x7f0e500af270 2023-10-06T02:50:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e553e7700 1 -- 172.21.15.81:0/602669214 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40011790 con 0x7f0e500af270 2023-10-06T02:50:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.489+0000 7f0e553e7700 1 -- 172.21.15.81:0/602669214 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011b30 con 0x7f0e500af270 2023-10-06T02:50:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.490+0000 7f0e5864d700 1 -- 172.21.15.81:0/602669214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500af270 msgr2=0x7f0e500c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.490+0000 7f0e5864d700 1 --2- 172.21.15.81:0/602669214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500af270 0x7f0e500c2e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e400098e0 tx=0x7f0e400091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.490+0000 7f0e5864d700 1 -- 172.21.15.81:0/602669214 shutdown_connections 2023-10-06T02:50:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.490+0000 7f0e5864d700 1 --2- 172.21.15.81:0/602669214 >> v2:172.21.15.83:3300/0 conn(0x7f0e500aeea0 0x7f0e500c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.490+0000 7f0e5864d700 1 --2- 172.21.15.81:0/602669214 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500af270 0x7f0e500c2e60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.490+0000 7f0e5864d700 1 -- 172.21.15.81:0/602669214 >> 172.21.15.81:0/602669214 conn(0x7f0e5006c660 msgr2=0x7f0e500cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.490+0000 7f0e5864d700 1 -- 172.21.15.81:0/602669214 shutdown_connections 2023-10-06T02:50:55.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.490+0000 7f0e5864d700 1 -- 172.21.15.81:0/602669214 wait complete. 2023-10-06T02:50:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.491+0000 7f0e5864d700 1 Processor -- start 2023-10-06T02:50:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.491+0000 7f0e5864d700 1 -- start start 2023-10-06T02:50:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e5864d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e500aeea0 0x7f0e5014d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e5864d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500af270 0x7f0e500c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e5864d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500c7d00 0x7f0e50168240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e5864d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5014db40 con 0x7f0e500af270 2023-10-06T02:50:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e5864d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5014e980 con 0x7f0e500aeea0 2023-10-06T02:50:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e5864d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500c6120 con 0x7f0e500c7d00 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e55be8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500af270 0x7f0e500c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e55be8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500af270 0x7f0e500c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55314/0 (socket says 172.21.15.81:55314) 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e55be8700 1 -- 172.21.15.81:0/3910674089 learned_addr learned my addr 172.21.15.81:0/3910674089 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e563e9700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e500aeea0 0x7f0e5014d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e56bea700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500c7d00 0x7f0e50168240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e55be8700 1 -- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500c7d00 msgr2=0x7f0e50168240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e55be8700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500c7d00 0x7f0e50168240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e55be8700 1 -- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e500aeea0 msgr2=0x7f0e5014d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e55be8700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e500aeea0 0x7f0e5014d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e55be8700 1 -- 172.21.15.81:0/3910674089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c009420 con 0x7f0e500af270 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e55be8700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500af270 0x7f0e500c5be0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0e5006a2f0 tx=0x7f0e40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e467fc700 1 -- 172.21.15.81:0/3910674089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011b10 con 0x7f0e500af270 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e467fc700 1 -- 172.21.15.81:0/3910674089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e400253f0 con 0x7f0e500af270 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e40009420 con 0x7f0e500af270 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e467fc700 1 -- 172.21.15.81:0/3910674089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40025790 con 0x7f0e500af270 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.492+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5014e0d0 con 0x7f0e500af270 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.493+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5014eb10 con 0x7f0e500af270 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.494+0000 7f0e467fc700 1 -- 172.21.15.81:0/3910674089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e40025b80 con 0x7f0e500af270 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.494+0000 7f0e467fc700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e34066f30 0x7f0e340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.494+0000 7f0e467fc700 1 -- 172.21.15.81:0/3910674089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0e40085c60 con 0x7f0e500af270 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.494+0000 7f0e563e9700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e34066f30 0x7f0e340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.495+0000 7f0e563e9700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e34066f30 0x7f0e340693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0093f0 tx=0x7f0e4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:55.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.498+0000 7f0e467fc700 1 -- 172.21.15.81:0/3910674089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e40053070 con 0x7f0e500af270 2023-10-06T02:50:55.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:55.696+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0e5004bb80 con 0x7f0e500af270 2023-10-06T02:50:56.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.630+0000 7f0e467fc700 1 -- 172.21.15.81:0/3910674089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0e40056690 con 0x7f0e500af270 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e34066f30 msgr2=0x7f0e340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e34066f30 0x7f0e340693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0093f0 tx=0x7f0e4c008040 comp rx=0 tx=0).stop 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500af270 msgr2=0x7f0e500c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500af270 0x7f0e500c5be0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0e5006a2f0 tx=0x7f0e40017000 comp rx=0 tx=0).stop 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 shutdown_connections 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e500c7d00 0x7f0e50168240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e34066f30 0x7f0e340693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e500aeea0 0x7f0e5014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 --2- 172.21.15.81:0/3910674089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500af270 0x7f0e500c5be0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 >> 172.21.15.81:0/3910674089 conn(0x7f0e5006c660 msgr2=0x7f0e5006d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 shutdown_connections 2023-10-06T02:50:56.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.632+0000 7f0e5864d700 1 -- 172.21.15.81:0/3910674089 wait complete. 2023-10-06T02:50:56.635 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:50:56.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:50:56.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.759+0000 7f2d2d743700 1 Processor -- start 2023-10-06T02:50:56.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.759+0000 7f2d2d743700 1 -- start start 2023-10-06T02:50:56.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.760+0000 7f2d2d743700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2d2815a2a0 0x7f2d280b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:56.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.760+0000 7f2d2d743700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d280ceb30 0x7f2d280cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:56.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.760+0000 7f2d2d743700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d280b0ca0 con 0x7f2d2806d650 2023-10-06T02:50:56.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.760+0000 7f2d2d743700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2806e160 con 0x7f2d280ceb30 2023-10-06T02:50:56.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.760+0000 7f2d2d743700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2806ea90 con 0x7f2d2815a2a0 2023-10-06T02:50:56.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.760+0000 7f2d1e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d280ceb30 0x7f2d280cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.760+0000 7f2d277fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2d2806d650 0x7f2d2806da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51838/0 (socket says 172.21.15.81:51838) 2023-10-06T02:50:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.760+0000 7f2d277fe700 1 -- 172.21.15.81:0/187928186 learned_addr learned my addr 172.21.15.81:0/187928186 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d1e7fc700 1 -- 172.21.15.81:0/187928186 >> v2:172.21.15.83:3300/0 conn(0x7f2d2815a2a0 msgr2=0x7f2d280b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d26ffd700 1 --2- 172.21.15.81:0/187928186 >> v2:172.21.15.83:3300/0 conn(0x7f2d2815a2a0 0x7f2d280b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d1e7fc700 1 --2- 172.21.15.81:0/187928186 >> v2:172.21.15.83:3300/0 conn(0x7f2d2815a2a0 0x7f2d280b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d267fc700 1 -- 172.21.15.81:0/187928186 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416106554 0 0) 0x7f2d280b0ca0 con 0x7f2d2806d650 2023-10-06T02:50:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d1e7fc700 1 -- 172.21.15.81:0/187928186 >> v1:172.21.15.81:6789/0 conn(0x7f2d2806d650 legacy=0x7f2d2806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d1e7fc700 1 -- 172.21.15.81:0/187928186 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d280b00d0 con 0x7f2d280ceb30 2023-10-06T02:50:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d26ffd700 1 --2- 172.21.15.81:0/187928186 >> v2:172.21.15.83:3300/0 conn(0x7f2d2815a2a0 0x7f2d280b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d1e7fc700 1 --2- 172.21.15.81:0/187928186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d280ceb30 0x7f2d280cefb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2d280637a0 tx=0x7f2d100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546d58dd5c1665ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d267fc700 1 -- 172.21.15.81:0/187928186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000b6b0 con 0x7f2d280ceb30 2023-10-06T02:50:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d267fc700 1 -- 172.21.15.81:0/187928186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1000b810 con 0x7f2d280ceb30 2023-10-06T02:50:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.761+0000 7f2d267fc700 1 -- 172.21.15.81:0/187928186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000bbb0 con 0x7f2d280ceb30 2023-10-06T02:50:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.762+0000 7f2d2d743700 1 -- 172.21.15.81:0/187928186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d280ceb30 msgr2=0x7f2d280cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.762+0000 7f2d2d743700 1 --2- 172.21.15.81:0/187928186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d280ceb30 0x7f2d280cefb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2d280637a0 tx=0x7f2d100091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.762+0000 7f2d2d743700 1 -- 172.21.15.81:0/187928186 shutdown_connections 2023-10-06T02:50:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.762+0000 7f2d2d743700 1 --2- 172.21.15.81:0/187928186 >> v2:172.21.15.83:3300/0 conn(0x7f2d2815a2a0 0x7f2d280b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.762+0000 7f2d2d743700 1 --2- 172.21.15.81:0/187928186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d280ceb30 0x7f2d280cefb0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.762+0000 7f2d2d743700 1 -- 172.21.15.81:0/187928186 >> 172.21.15.81:0/187928186 conn(0x7f2d28067640 msgr2=0x7f2d28067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.762+0000 7f2d2d743700 1 -- 172.21.15.81:0/187928186 shutdown_connections 2023-10-06T02:50:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.762+0000 7f2d2d743700 1 -- 172.21.15.81:0/187928186 wait complete. 2023-10-06T02:50:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.763+0000 7f2d2d743700 1 Processor -- start 2023-10-06T02:50:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.763+0000 7f2d2d743700 1 -- start start 2023-10-06T02:50:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d2d743700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d2806d650 0x7f2d28145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d2d743700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d280ceb30 0x7f2d2816b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d2d743700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d2815a2a0 0x7f2d28167f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d2d743700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2816c8e0 con 0x7f2d2815a2a0 2023-10-06T02:50:56.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d2d743700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2816bcd0 con 0x7f2d280ceb30 2023-10-06T02:50:56.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d2d743700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2816bfb0 con 0x7f2d2806d650 2023-10-06T02:50:56.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d2815a2a0 0x7f2d28167f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:56.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d2815a2a0 0x7f2d28167f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55322/0 (socket says 172.21.15.81:55322) 2023-10-06T02:50:56.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d277fe700 1 -- 172.21.15.81:0/1522971674 learned_addr learned my addr 172.21.15.81:0/1522971674 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:56.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d26ffd700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d2806d650 0x7f2d28145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d1e7fc700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d280ceb30 0x7f2d2816b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d277fe700 1 -- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d2806d650 msgr2=0x7f2d28145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d277fe700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d2806d650 0x7f2d28145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d277fe700 1 -- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d280ceb30 msgr2=0x7f2d2816b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d277fe700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d280ceb30 0x7f2d2816b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d277fe700 1 -- 172.21.15.81:0/1522971674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10009420 con 0x7f2d2815a2a0 2023-10-06T02:50:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d26ffd700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d2806d650 0x7f2d28145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d277fe700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d2815a2a0 0x7f2d28167f10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000cc90 tx=0x7f2d20001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d1f7fe700 1 -- 172.21.15.81:0/1522971674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000cea0 con 0x7f2d2815a2a0 2023-10-06T02:50:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d1f7fe700 1 -- 172.21.15.81:0/1522971674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000ab70 con 0x7f2d2815a2a0 2023-10-06T02:50:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2816c290 con 0x7f2d2815a2a0 2023-10-06T02:50:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d1f7fe700 1 -- 172.21.15.81:0/1522971674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200070f0 con 0x7f2d2815a2a0 2023-10-06T02:50:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.764+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2816b9e0 con 0x7f2d2815a2a0 2023-10-06T02:50:56.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.765+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2816ca90 con 0x7f2d2815a2a0 2023-10-06T02:50:56.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.766+0000 7f2d1f7fe700 1 -- 172.21.15.81:0/1522971674 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d200074a0 con 0x7f2d2815a2a0 2023-10-06T02:50:56.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.766+0000 7f2d1f7fe700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d08066f30 0x7f2d080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:56.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.766+0000 7f2d1f7fe700 1 -- 172.21.15.81:0/1522971674 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2d200847b0 con 0x7f2d2815a2a0 2023-10-06T02:50:56.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.766+0000 7f2d26ffd700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d08066f30 0x7f2d080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.767+0000 7f2d26ffd700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d08066f30 0x7f2d080693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2d18006fd0 tx=0x7f2d18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:56.770+0000 7f2d1f7fe700 1 -- 172.21.15.81:0/1522971674 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d2816ca90 con 0x7f2d2815a2a0 2023-10-06T02:50:57.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.028+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2d2816ca20 con 0x7f2d2815a2a0 2023-10-06T02:50:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.029+0000 7f2d1f7fe700 1 -- 172.21.15.81:0/1522971674 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2d20051c90 con 0x7f2d2815a2a0 2023-10-06T02:50:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:57.030 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:50:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:50:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:50:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:50:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:50:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:50:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:50:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:50:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:50:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:50:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:50:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:50:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:50:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:50:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:50:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:50:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:50:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:50:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:50:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:50:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:50:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:50:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:50:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:50:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:50:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:50:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:50:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:50:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:50:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:50:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:50:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:50:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:50:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:50:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:50:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:50:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:50:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:50:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:50:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:50:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:50:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:50:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:50:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:50:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-06T02:50:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:50:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:50:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:50:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:50:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:50:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:50:57.056 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:50:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d08066f30 msgr2=0x7f2d080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d08066f30 0x7f2d080693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2d18006fd0 tx=0x7f2d18008040 comp rx=0 tx=0).stop 2023-10-06T02:50:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d2815a2a0 msgr2=0x7f2d28167f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d2815a2a0 0x7f2d28167f10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000cc90 tx=0x7f2d20001a80 comp rx=0 tx=0).stop 2023-10-06T02:50:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 shutdown_connections 2023-10-06T02:50:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d2815a2a0 0x7f2d28167f10 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d2806d650 0x7f2d28145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d08066f30 0x7f2d080693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 --2- 172.21.15.81:0/1522971674 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d280ceb30 0x7f2d2816b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 >> 172.21.15.81:0/1522971674 conn(0x7f2d28067640 msgr2=0x7f2d280ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 shutdown_connections 2023-10-06T02:50:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.031+0000 7f2d2d743700 1 -- 172.21.15.81:0/1522971674 wait complete. 2023-10-06T02:50:57.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:50:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.173+0000 7f3745b9a700 1 Processor -- start 2023-10-06T02:50:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.173+0000 7f3745b9a700 1 -- start start 2023-10-06T02:50:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745b9a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3740159b40 0x7f37400cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745b9a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 0x7f3740068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745b9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f37400ccb40 0x7f3740068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745b9a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400cee10 con 0x7f37400ccb40 2023-10-06T02:50:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745b9a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400cd040 con 0x7f3740159b40 2023-10-06T02:50:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745b9a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37400cd320 con 0x7f3740159f10 2023-10-06T02:50:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745399700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f37400ccb40 0x7f3740068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745399700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f37400ccb40 0x7f3740068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55336/0 (socket says 172.21.15.81:55336) 2023-10-06T02:50:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745399700 1 -- 172.21.15.81:0/973607963 learned_addr learned my addr 172.21.15.81:0/973607963 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f373ffff700 1 --2- 172.21.15.81:0/973607963 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 0x7f3740068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3744b98700 1 --2- 172.21.15.81:0/973607963 >> v2:172.21.15.83:3300/0 conn(0x7f3740159b40 0x7f37400cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745399700 1 -- 172.21.15.81:0/973607963 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 msgr2=0x7f3740068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745399700 1 --2- 172.21.15.81:0/973607963 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 0x7f3740068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745399700 1 -- 172.21.15.81:0/973607963 >> v2:172.21.15.83:3300/0 conn(0x7f3740159b40 msgr2=0x7f37400cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745399700 1 --2- 172.21.15.81:0/973607963 >> v2:172.21.15.83:3300/0 conn(0x7f3740159b40 0x7f37400cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.174+0000 7f3745399700 1 -- 172.21.15.81:0/973607963 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400ce7c0 con 0x7f37400ccb40 2023-10-06T02:50:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745399700 1 --2- 172.21.15.81:0/973607963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 0x7f3740068cc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f37400d0bc0 tx=0x7f3730009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f633bbdda41e0c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f373f7fe700 1 -- 172.21.15.81:0/973607963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000b860 con 0x7f37400ccb40 2023-10-06T02:50:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f373f7fe700 1 -- 172.21.15.81:0/973607963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000b9c0 con 0x7f37400ccb40 2023-10-06T02:50:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f373f7fe700 1 -- 172.21.15.81:0/973607963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000bd60 con 0x7f37400ccb40 2023-10-06T02:50:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745b9a700 1 -- 172.21.15.81:0/973607963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 msgr2=0x7f3740068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745b9a700 1 --2- 172.21.15.81:0/973607963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 0x7f3740068cc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f37400d0bc0 tx=0x7f3730009250 comp rx=0 tx=0).stop 2023-10-06T02:50:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745b9a700 1 -- 172.21.15.81:0/973607963 shutdown_connections 2023-10-06T02:50:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745b9a700 1 --2- 172.21.15.81:0/973607963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 0x7f3740068cc0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745b9a700 1 --2- 172.21.15.81:0/973607963 >> v2:172.21.15.83:3300/0 conn(0x7f3740159b40 0x7f37400cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745b9a700 1 --2- 172.21.15.81:0/973607963 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 0x7f3740068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745b9a700 1 -- 172.21.15.81:0/973607963 >> 172.21.15.81:0/973607963 conn(0x7f37400cd660 msgr2=0x7f37400cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745b9a700 1 -- 172.21.15.81:0/973607963 shutdown_connections 2023-10-06T02:50:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.175+0000 7f3745b9a700 1 -- 172.21.15.81:0/973607963 wait complete. 2023-10-06T02:50:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.176+0000 7f3745b9a700 1 Processor -- start 2023-10-06T02:50:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3745b9a700 1 -- start start 2023-10-06T02:50:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3745b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 0x7f37400b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3745b9a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3740159b40 0x7f37400b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3745b9a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 0x7f374015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3745b9a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374015a810 con 0x7f37400ccb40 2023-10-06T02:50:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3745b9a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374015aaf0 con 0x7f3740159b40 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3745b9a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374015add0 con 0x7f3740159f10 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3744b98700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 0x7f37400b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3744b98700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 0x7f37400b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55340/0 (socket says 172.21.15.81:55340) 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.177+0000 7f3744b98700 1 -- 172.21.15.81:0/3809243199 learned_addr learned my addr 172.21.15.81:0/3809243199 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f3745399700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 0x7f374015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f373ffff700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3740159b40 0x7f37400b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f3744b98700 1 -- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 msgr2=0x7f374015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f3744b98700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 0x7f374015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f3744b98700 1 -- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3740159b40 msgr2=0x7f37400b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f3744b98700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3740159b40 0x7f37400b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f3744b98700 1 -- 172.21.15.81:0/3809243199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37300094f0 con 0x7f37400ccb40 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f3744b98700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 0x7f37400b61e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f373800e190 tx=0x7f3738009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f373cff9700 1 -- 172.21.15.81:0/3809243199 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373800ecd0 con 0x7f37400ccb40 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f373cff9700 1 -- 172.21.15.81:0/3809243199 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373800ee30 con 0x7f37400ccb40 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374015b0b0 con 0x7f37400ccb40 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f373cff9700 1 -- 172.21.15.81:0/3809243199 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738014670 con 0x7f37400ccb40 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.178+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37400b6720 con 0x7f37400ccb40 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.179+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3740063e90 con 0x7f37400ccb40 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.179+0000 7f373cff9700 1 -- 172.21.15.81:0/3809243199 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3738014a20 con 0x7f37400ccb40 2023-10-06T02:50:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.180+0000 7f373cff9700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f372c066f30 0x7f372c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.180+0000 7f373cff9700 1 -- 172.21.15.81:0/3809243199 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f37380849d0 con 0x7f37400ccb40 2023-10-06T02:50:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.180+0000 7f373ffff700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f372c066f30 0x7f372c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.180+0000 7f373ffff700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f372c066f30 0x7f372c0693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f374015bf20 tx=0x7f3734008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.184+0000 7f373cff9700 1 -- 172.21.15.81:0/3809243199 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3738051e30 con 0x7f37400ccb40 2023-10-06T02:50:57.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.366+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37400ceaa0 con 0x7f37400ccb40 2023-10-06T02:50:57.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.367+0000 7f373cff9700 1 -- 172.21.15.81:0/3809243199 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+13603 (secure 0 0 0) 0x7f3738009a60 con 0x7f37400ccb40 2023-10-06T02:50:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:50:56.625105+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:50:57.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f372c066f30 msgr2=0x7f372c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f372c066f30 0x7f372c0693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f374015bf20 tx=0x7f3734008040 comp rx=0 tx=0).stop 2023-10-06T02:50:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 msgr2=0x7f37400b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 0x7f37400b61e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f373800e190 tx=0x7f3738009920 comp rx=0 tx=0).stop 2023-10-06T02:50:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 shutdown_connections 2023-10-06T02:50:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3740159f10 0x7f374015c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37400ccb40 0x7f37400b61e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f372c066f30 0x7f372c0693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 --2- 172.21.15.81:0/3809243199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3740159b40 0x7f37400b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 >> 172.21.15.81:0/3809243199 conn(0x7f37400cd660 msgr2=0x7f3740158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:57.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 shutdown_connections 2023-10-06T02:50:57.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.369+0000 7f3745b9a700 1 -- 172.21.15.81:0/3809243199 wait complete. 2023-10-06T02:50:57.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:50:57.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:50:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.498+0000 7f6b7e97b700 1 Processor -- start 2023-10-06T02:50:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.498+0000 7f6b7e97b700 1 -- start start 2023-10-06T02:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.499+0000 7f6b7e97b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b78160750 0x7f6b78162b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.499+0000 7f6b7e97b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780cadb0 con 0x7f6b780cddd0 2023-10-06T02:50:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.499+0000 7f6b7e97b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780cd3d0 con 0x7f6b780b43c0 2023-10-06T02:50:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.499+0000 7f6b7e97b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780cc250 con 0x7f6b78160750 2023-10-06T02:50:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.499+0000 7f6b7d178700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6b780cddd0 0x7f6b780cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51842/0 (socket says 172.21.15.81:51842) 2023-10-06T02:50:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.499+0000 7f6b7d178700 1 -- 172.21.15.81:0/2760091816 learned_addr learned my addr 172.21.15.81:0/2760091816 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7e17a700 1 --2- 172.21.15.81:0/2760091816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b78160750 0x7f6b78162b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7c977700 1 -- 172.21.15.81:0/2760091816 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745203565 0 0) 0x7f6b780cadb0 con 0x7f6b780cddd0 2023-10-06T02:50:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7c977700 1 -- 172.21.15.81:0/2760091816 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b60003570 con 0x7f6b780cddd0 2023-10-06T02:50:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7c977700 1 -- 172.21.15.81:0/2760091816 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956974187 0 0) 0x7f6b780cd3d0 con 0x7f6b780b43c0 2023-10-06T02:50:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7c977700 1 -- 172.21.15.81:0/2760091816 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b780cadb0 con 0x7f6b780b43c0 2023-10-06T02:50:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7e17a700 1 -- 172.21.15.81:0/2760091816 >> v1:172.21.15.83:6789/0 conn(0x7f6b780b43c0 legacy=0x7f6b780cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7c977700 1 -- 172.21.15.81:0/2760091816 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1642325648 0 0) 0x7f6b60003570 con 0x7f6b780cddd0 2023-10-06T02:50:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7e17a700 1 -- 172.21.15.81:0/2760091816 >> v1:172.21.15.81:6789/0 conn(0x7f6b780cddd0 legacy=0x7f6b780cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7e17a700 1 -- 172.21.15.81:0/2760091816 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780cf000 con 0x7f6b78160750 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7e17a700 1 --2- 172.21.15.81:0/2760091816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b78160750 0x7f6b78162b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b78069530 tx=0x7f6b700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa9b8f296b3c5ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7c977700 1 -- 172.21.15.81:0/2760091816 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c001470 con 0x7f6b78160750 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7c977700 1 -- 172.21.15.81:0/2760091816 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70011420 con 0x7f6b78160750 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.500+0000 7f6b7c977700 1 -- 172.21.15.81:0/2760091816 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700117c0 con 0x7f6b78160750 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.501+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2760091816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b78160750 msgr2=0x7f6b78162b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.501+0000 7f6b7e97b700 1 --2- 172.21.15.81:0/2760091816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b78160750 0x7f6b78162b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b78069530 tx=0x7f6b700091a0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.501+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2760091816 shutdown_connections 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.501+0000 7f6b7e97b700 1 --2- 172.21.15.81:0/2760091816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b78160750 0x7f6b78162b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.501+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2760091816 >> 172.21.15.81:0/2760091816 conn(0x7f6b78068110 msgr2=0x7f6b7806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:57.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.501+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2760091816 shutdown_connections 2023-10-06T02:50:57.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.501+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2760091816 wait complete. 2023-10-06T02:50:57.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.502+0000 7f6b7e97b700 1 Processor -- start 2023-10-06T02:50:57.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.502+0000 7f6b7e97b700 1 -- start start 2023-10-06T02:50:57.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e97b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b780b43c0 0x7f6b7815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e97b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b780cddd0 0x7f6b78159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e97b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b78160750 0x7f6b78159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e97b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7815a5e0 con 0x7f6b78160750 2023-10-06T02:50:57.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e97b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7815a8c0 con 0x7f6b780cddd0 2023-10-06T02:50:57.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e97b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7815aba0 con 0x7f6b780b43c0 2023-10-06T02:50:57.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e17a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b78160750 0x7f6b78159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e17a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b78160750 0x7f6b78159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55354/0 (socket says 172.21.15.81:55354) 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e17a700 1 -- 172.21.15.81:0/2873504615 learned_addr learned my addr 172.21.15.81:0/2873504615 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7d178700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b780cddd0 0x7f6b78159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7d979700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b780b43c0 0x7f6b7815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e17a700 1 -- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b780b43c0 msgr2=0x7f6b7815fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e17a700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b780b43c0 0x7f6b7815fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e17a700 1 -- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b780cddd0 msgr2=0x7f6b78159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e17a700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b780cddd0 0x7f6b78159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e17a700 1 -- 172.21.15.81:0/2873504615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70009420 con 0x7f6b78160750 2023-10-06T02:50:57.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7d979700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b780b43c0 0x7f6b7815fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.503+0000 7f6b7e17a700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b78160750 0x7f6b78159fd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6b700030c0 tx=0x7f6b70016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.504+0000 7f6b75ffb700 1 -- 172.21.15.81:0/2873504615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7001a450 con 0x7f6b78160750 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.504+0000 7f6b75ffb700 1 -- 172.21.15.81:0/2873504615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7001a5d0 con 0x7f6b78160750 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.504+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7815ae80 con 0x7f6b78160750 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.504+0000 7f6b75ffb700 1 -- 172.21.15.81:0/2873504615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7001a990 con 0x7f6b78160750 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.504+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b78158360 con 0x7f6b78160750 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.505+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b78069c00 con 0x7f6b78160750 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.505+0000 7f6b75ffb700 1 -- 172.21.15.81:0/2873504615 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b7001ad00 con 0x7f6b78160750 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.505+0000 7f6b75ffb700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6b64066f30 0x7f6b640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.505+0000 7f6b75ffb700 1 -- 172.21.15.81:0/2873504615 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6b70085b30 con 0x7f6b78160750 2023-10-06T02:50:57.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.506+0000 7f6b7d979700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6b64066f30 0x7f6b640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.506+0000 7f6b7d979700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6b64066f30 0x7f6b640693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6b68002fc0 tx=0x7f6b68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:57.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.510+0000 7f6b75ffb700 1 -- 172.21.15.81:0/2873504615 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b70052f90 con 0x7f6b78160750 2023-10-06T02:50:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.693+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b780b3b60 con 0x7f6b78160750 2023-10-06T02:50:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.693+0000 7f6b75ffb700 1 -- 172.21.15.81:0/2873504615 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b70029020 con 0x7f6b78160750 2023-10-06T02:50:57.695 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:50:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6b64066f30 msgr2=0x7f6b640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6b64066f30 0x7f6b640693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6b68002fc0 tx=0x7f6b68009040 comp rx=0 tx=0).stop 2023-10-06T02:50:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b78160750 msgr2=0x7f6b78159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b78160750 0x7f6b78159fd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6b700030c0 tx=0x7f6b70016000 comp rx=0 tx=0).stop 2023-10-06T02:50:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 shutdown_connections 2023-10-06T02:50:57.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b78160750 0x7f6b78159fd0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b780b43c0 0x7f6b7815fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6b64066f30 0x7f6b640693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 --2- 172.21.15.81:0/2873504615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b780cddd0 0x7f6b78159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 >> 172.21.15.81:0/2873504615 conn(0x7f6b78068110 msgr2=0x7f6b780b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:57.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 shutdown_connections 2023-10-06T02:50:57.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.696+0000 7f6b7e97b700 1 -- 172.21.15.81:0/2873504615 wait complete. 2023-10-06T02:50:57.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:50:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.825+0000 7fb677fff700 1 Processor -- start 2023-10-06T02:50:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.825+0000 7fb677fff700 1 -- start start 2023-10-06T02:50:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb677fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d0b80 0x7fb6780cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb677fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb67806d700 0x7fb67815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb677fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780cf2d0 con 0x7fb6780d02b0 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb677fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67815a690 con 0x7fb67806d700 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb677fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67806dc00 con 0x7fb6780d0b80 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb6777fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb67806d700 0x7fb67815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb6777fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb67806d700 0x7fb67815b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55358/0 (socket says 172.21.15.81:55358) 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb6777fe700 1 -- 172.21.15.81:0/2107393983 learned_addr learned my addr 172.21.15.81:0/2107393983 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb676ffd700 1 --2- 172.21.15.81:0/2107393983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d0b80 0x7fb6780cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb6777fe700 1 -- 172.21.15.81:0/2107393983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d0b80 msgr2=0x7fb6780cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb6777fe700 1 --2- 172.21.15.81:0/2107393983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d0b80 0x7fb6780cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb6777fe700 1 -- 172.21.15.81:0/2107393983 >> v1:172.21.15.83:6789/0 conn(0x7fb6780d02b0 legacy=0x7fb67806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb6777fe700 1 -- 172.21.15.81:0/2107393983 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780cf570 con 0x7fb67806d700 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb6777fe700 1 --2- 172.21.15.81:0/2107393983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 0x7fb67815b320 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb6700099b0 tx=0x7fb670009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da53e2db095914be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.826+0000 7fb675ffb700 1 -- 172.21.15.81:0/2107393983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000b860 con 0x7fb67806d700 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb675ffb700 1 -- 172.21.15.81:0/2107393983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67000b9c0 con 0x7fb67806d700 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb675ffb700 1 -- 172.21.15.81:0/2107393983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000bd60 con 0x7fb67806d700 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb677fff700 1 -- 172.21.15.81:0/2107393983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 msgr2=0x7fb67815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb677fff700 1 --2- 172.21.15.81:0/2107393983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 0x7fb67815b320 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb6700099b0 tx=0x7fb670009250 comp rx=0 tx=0).stop 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb677fff700 1 -- 172.21.15.81:0/2107393983 shutdown_connections 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb677fff700 1 --2- 172.21.15.81:0/2107393983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 0x7fb67815b320 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb677fff700 1 --2- 172.21.15.81:0/2107393983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d0b80 0x7fb6780cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb677fff700 1 -- 172.21.15.81:0/2107393983 >> 172.21.15.81:0/2107393983 conn(0x7fb678063230 msgr2=0x7fb678063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb677fff700 1 -- 172.21.15.81:0/2107393983 shutdown_connections 2023-10-06T02:50:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.827+0000 7fb677fff700 1 -- 172.21.15.81:0/2107393983 wait complete. 2023-10-06T02:50:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.828+0000 7fb677fff700 1 Processor -- start 2023-10-06T02:50:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.828+0000 7fb677fff700 1 -- start start 2023-10-06T02:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb677fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 0x7fb678139cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb677fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d02b0 0x7fb6781539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb677fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6780d0b80 0x7fb678153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb677fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6781529c0 con 0x7fb67806d700 2023-10-06T02:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb677fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678154530 con 0x7fb6780d0b80 2023-10-06T02:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb677fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb678154810 con 0x7fb6780d02b0 2023-10-06T02:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb676ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 0x7fb678139cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb676ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 0x7fb678139cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55366/0 (socket says 172.21.15.81:55366) 2023-10-06T02:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb676ffd700 1 -- 172.21.15.81:0/2717285114 learned_addr learned my addr 172.21.15.81:0/2717285114 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb6767fc700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d02b0 0x7fb6781539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb6777fe700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6780d0b80 0x7fb678153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb676ffd700 1 -- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d02b0 msgr2=0x7fb6781539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb676ffd700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d02b0 0x7fb6781539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb676ffd700 1 -- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6780d0b80 msgr2=0x7fb678153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.829+0000 7fb676ffd700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6780d0b80 0x7fb678153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.830+0000 7fb676ffd700 1 -- 172.21.15.81:0/2717285114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6700094f0 con 0x7fb67806d700 2023-10-06T02:50:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.830+0000 7fb676ffd700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 0x7fb678139cd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb668009fa0 tx=0x7fb668009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.830+0000 7fb66effd700 1 -- 172.21.15.81:0/2717285114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800ebc0 con 0x7fb67806d700 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.830+0000 7fb66effd700 1 -- 172.21.15.81:0/2717285114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66800ed20 con 0x7fb67806d700 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.830+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb678154af0 con 0x7fb67806d700 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.830+0000 7fb66effd700 1 -- 172.21.15.81:0/2717285114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668014670 con 0x7fb67806d700 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.830+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6781550b0 con 0x7fb67806d700 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.831+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6780676e0 con 0x7fb67806d700 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.831+0000 7fb66effd700 1 -- 172.21.15.81:0/2717285114 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6680149e0 con 0x7fb67806d700 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.831+0000 7fb66effd700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb658066f30 0x7fb6580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.831+0000 7fb66effd700 1 -- 172.21.15.81:0/2717285114 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb668084920 con 0x7fb67806d700 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.832+0000 7fb6767fc700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb658066f30 0x7fb6580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.832+0000 7fb6767fc700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb658066f30 0x7fb6580693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb660003a80 tx=0x7fb660007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:57.835+0000 7fb66effd700 1 -- 172.21.15.81:0/2717285114 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb668051d80 con 0x7fb67806d700 2023-10-06T02:50:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.015+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb678071b10 con 0x7fb67806d700 2023-10-06T02:50:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.015+0000 7fb66effd700 1 -- 172.21.15.81:0/2717285114 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6680553a0 con 0x7fb67806d700 2023-10-06T02:50:58.016 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:50:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb658066f30 msgr2=0x7fb6580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb658066f30 0x7fb6580693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb660003a80 tx=0x7fb660007ec0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 msgr2=0x7fb678139cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 0x7fb678139cd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb668009fa0 tx=0x7fb668009880 comp rx=0 tx=0).stop 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 shutdown_connections 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb658066f30 0x7fb6580693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6780d0b80 0x7fb678153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb67806d700 0x7fb678139cd0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 --2- 172.21.15.81:0/2717285114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6780d02b0 0x7fb6781539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 >> 172.21.15.81:0/2717285114 conn(0x7fb678063230 msgr2=0x7fb6781574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 shutdown_connections 2023-10-06T02:50:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.017+0000 7fb677fff700 1 -- 172.21.15.81:0/2717285114 wait complete. 2023-10-06T02:50:58.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:50:58.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.143+0000 7f177f59e700 1 Processor -- start 2023-10-06T02:50:58.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.143+0000 7f177f59e700 1 -- start start 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1780068e90 0x7f1780164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17800cee10 con 0x7f1780159b40 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177f59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17800cd040 con 0x7f1780159f10 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17800cd320 con 0x7f1780068e90 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1780159b40 0x7f17800cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51848/0 (socket says 172.21.15.81:51848) 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1780068e90 0x7f1780164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177e59c700 1 -- 172.21.15.81:0/860355953 learned_addr learned my addr 172.21.15.81:0/860355953 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177ed9d700 1 -- 172.21.15.81:0/860355953 >> v1:172.21.15.83:6789/0 conn(0x7f1780159f10 legacy=0x7f1780068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177ed9d700 1 -- 172.21.15.81:0/860355953 >> v1:172.21.15.81:6789/0 conn(0x7f1780159b40 legacy=0x7f17800cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177ed9d700 1 -- 172.21.15.81:0/860355953 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17800ce7c0 con 0x7f1780068e90 2023-10-06T02:50:58.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.144+0000 7f177d59a700 1 -- 172.21.15.81:0/860355953 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105068071 0 0) 0x7f17800cee10 con 0x7f1780159b40 2023-10-06T02:50:58.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177ed9d700 1 --2- 172.21.15.81:0/860355953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780068e90 0x7f1780164c70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1770009e60 tx=0x7f1770009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96fa05b79569c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:58.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177d59a700 1 -- 172.21.15.81:0/860355953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177000e070 con 0x7f1780068e90 2023-10-06T02:50:58.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177d59a700 1 -- 172.21.15.81:0/860355953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177000bc30 con 0x7f1780068e90 2023-10-06T02:50:58.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177d59a700 1 -- 172.21.15.81:0/860355953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770012430 con 0x7f1780068e90 2023-10-06T02:50:58.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177f59e700 1 -- 172.21.15.81:0/860355953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780068e90 msgr2=0x7f1780164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177f59e700 1 --2- 172.21.15.81:0/860355953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780068e90 0x7f1780164c70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1770009e60 tx=0x7f1770009780 comp rx=0 tx=0).stop 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177f59e700 1 -- 172.21.15.81:0/860355953 shutdown_connections 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177f59e700 1 --2- 172.21.15.81:0/860355953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780068e90 0x7f1780164c70 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177f59e700 1 -- 172.21.15.81:0/860355953 >> 172.21.15.81:0/860355953 conn(0x7f17800cd660 msgr2=0x7f17800cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177f59e700 1 -- 172.21.15.81:0/860355953 shutdown_connections 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.145+0000 7f177f59e700 1 -- 172.21.15.81:0/860355953 wait complete. 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.146+0000 7f177f59e700 1 Processor -- start 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.146+0000 7f177f59e700 1 -- start start 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1780068e90 0x7f17800c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1780159b40 0x7f17800ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780159f10 0x7f178006f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800cabd0 con 0x7f1780159f10 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800ca670 con 0x7f1780068e90 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17800ca8f0 con 0x7f1780159b40 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780159f10 0x7f178006f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780159f10 0x7f178006f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55384/0 (socket says 172.21.15.81:55384) 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177ed9d700 1 -- 172.21.15.81:0/441070871 learned_addr learned my addr 172.21.15.81:0/441070871 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177e59c700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1780068e90 0x7f17800c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.147+0000 7f177dd9b700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1780159b40 0x7f17800ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f177ed9d700 1 -- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1780159b40 msgr2=0x7f17800ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f177ed9d700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1780159b40 0x7f17800ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f177ed9d700 1 -- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1780068e90 msgr2=0x7f17800c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f177ed9d700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1780068e90 0x7f17800c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f177ed9d700 1 -- 172.21.15.81:0/441070871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1770009a20 con 0x7f1780159f10 2023-10-06T02:50:58.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f177dd9b700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1780159b40 0x7f17800ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:50:58.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f177ed9d700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780159f10 0x7f178006f000 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f178006fe10 tx=0x7f1770019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:58.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f17767fc700 1 -- 172.21.15.81:0/441070871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177001b630 con 0x7f1780159f10 2023-10-06T02:50:58.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f17767fc700 1 -- 172.21.15.81:0/441070871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177001b790 con 0x7f1780159f10 2023-10-06T02:50:58.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178015a4e0 con 0x7f1780159f10 2023-10-06T02:50:58.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f17767fc700 1 -- 172.21.15.81:0/441070871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177001bb30 con 0x7f1780159f10 2023-10-06T02:50:58.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.148+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178015aaa0 con 0x7f1780159f10 2023-10-06T02:50:58.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.149+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1780063e90 con 0x7f1780159f10 2023-10-06T02:50:58.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.149+0000 7f17767fc700 1 -- 172.21.15.81:0/441070871 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f177001c400 con 0x7f1780159f10 2023-10-06T02:50:58.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.150+0000 7f17767fc700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1760066f30 0x7f17600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.150+0000 7f17767fc700 1 -- 172.21.15.81:0/441070871 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f17700862d0 con 0x7f1780159f10 2023-10-06T02:50:58.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.150+0000 7f177e59c700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1760066f30 0x7f17600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.150+0000 7f177e59c700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1760066f30 0x7f17600693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f17780011e0 tx=0x7f1778009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:58.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.154+0000 7f17767fc700 1 -- 172.21.15.81:0/441070871 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1770053730 con 0x7f1780159f10 2023-10-06T02:50:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.337+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f17800ceaa0 con 0x7f1780159f10 2023-10-06T02:50:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.337+0000 7f17767fc700 1 -- 172.21.15.81:0/441070871 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) v1 ==== 84+0+126 (secure 0 0 0) 0x7f177002a090 con 0x7f1780159f10 2023-10-06T02:50:58.338 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:50:58.339 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1760066f30 msgr2=0x7f17600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1760066f30 0x7f17600693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f17780011e0 tx=0x7f1778009040 comp rx=0 tx=0).stop 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780159f10 msgr2=0x7f178006f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780159f10 0x7f178006f000 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f178006fe10 tx=0x7f1770019000 comp rx=0 tx=0).stop 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 shutdown_connections 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1780159f10 0x7f178006f000 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1760066f30 0x7f17600693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1780068e90 0x7f17800c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 --2- 172.21.15.81:0/441070871 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1780159b40 0x7f17800ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 >> 172.21.15.81:0/441070871 conn(0x7f17800cd660 msgr2=0x7f17800c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 shutdown_connections 2023-10-06T02:50:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.339+0000 7f177f59e700 1 -- 172.21.15.81:0/441070871 wait complete. 2023-10-06T02:50:58.352 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:50:58.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:50:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.469+0000 7f6e70f1b700 1 Processor -- start 2023-10-06T02:50:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.469+0000 7f6e70f1b700 1 -- start start 2023-10-06T02:50:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e70f1b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6e6c157ca0 0x7f6e6c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e70f1b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c06d120 0x7f6e6c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e70f1b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c0d07c0 con 0x7f6e6c1578d0 2023-10-06T02:50:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e70f1b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c06daa0 con 0x7f6e6c157ca0 2023-10-06T02:50:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e70f1b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0cfbb0 con 0x7f6e6c06d120 2023-10-06T02:50:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e6a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6e6c1578d0 0x7f6e6c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51856/0 (socket says 172.21.15.81:51856) 2023-10-06T02:50:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e6a59c700 1 -- 172.21.15.81:0/3218215115 learned_addr learned my addr 172.21.15.81:0/3218215115 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:50:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859414004 0 0) 0x7f6e6c0d07c0 con 0x7f6e6c1578d0 2023-10-06T02:50:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e58003570 con 0x7f6e6c1578d0 2023-10-06T02:50:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e61d9b700 1 --2- 172.21.15.81:0/3218215115 >> v2:172.21.15.83:3300/0 conn(0x7f6e6c157ca0 0x7f6e6c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.470+0000 7f6e6ad9d700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c06d120 0x7f6e6c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224879008 0 0) 0x7f6e58003570 con 0x7f6e6c1578d0 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c06d120 msgr2=0x7f6e6c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c06d120 0x7f6e6c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 >> v2:172.21.15.83:3300/0 conn(0x7f6e6c157ca0 msgr2=0x7f6e6c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 --2- 172.21.15.81:0/3218215115 >> v2:172.21.15.83:3300/0 conn(0x7f6e6c157ca0 0x7f6e6c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0cfe90 con 0x7f6e6c1578d0 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f6e5c001470 con 0x7f6e6c1578d0 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 >> v1:172.21.15.81:6789/0 conn(0x7f6e6c1578d0 legacy=0x7f6e6c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e58003a60 0x7f6e58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e58004810 0x7f6e58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c06d120 0x7f6e580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c06daa0 con 0x7f6e58004810 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0cfbb0 con 0x7f6e58003a60 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5800bb90 con 0x7f6e6c06d120 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e61d9b700 1 --2- 172.21.15.81:0/3218215115 >> v2:172.21.15.83:3300/0 conn(0x7f6e6c157ca0 0x7f6e6c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e6a59c700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e58003a60 0x7f6e58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e61d9b700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e58004810 0x7f6e58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e6ad9d700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c06d120 0x7f6e580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e61d9b700 1 -- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c06d120 msgr2=0x7f6e580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e61d9b700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c06d120 0x7f6e580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e61d9b700 1 -- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e58003a60 msgr2=0x7f6e58003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e61d9b700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e58003a60 0x7f6e58003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e61d9b700 1 -- 172.21.15.81:0/3218215115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58003570 con 0x7f6e58004810 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e61d9b700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e58004810 0x7f6e58004c80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c1580c0 tx=0x7f6e54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26d929005aec16d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400c070 con 0x7f6e58004810 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5400e5e0 con 0x7f6e58004810 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.471+0000 7f6e69d9b700 1 -- 172.21.15.81:0/3218215115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400e790 con 0x7f6e58004810 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.472+0000 7f6e70f1b700 1 -- 172.21.15.81:0/3218215115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e58004810 msgr2=0x7f6e58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.472+0000 7f6e70f1b700 1 --2- 172.21.15.81:0/3218215115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e58004810 0x7f6e58004c80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c1580c0 tx=0x7f6e54008040 comp rx=0 tx=0).stop 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.472+0000 7f6e6ad9d700 1 -- 172.21.15.81:0/3218215115 reap_dead start 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.472+0000 7f6e70f1b700 1 -- 172.21.15.81:0/3218215115 shutdown_connections 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.472+0000 7f6e70f1b700 1 -- 172.21.15.81:0/3218215115 >> 172.21.15.81:0/3218215115 conn(0x7f6e6c06bb90 msgr2=0x7f6e6c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.472+0000 7f6e70f1b700 1 -- 172.21.15.81:0/3218215115 shutdown_connections 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.472+0000 7f6e70f1b700 1 -- 172.21.15.81:0/3218215115 wait complete. 2023-10-06T02:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.473+0000 7f6e70f1b700 1 Processor -- start 2023-10-06T02:50:58.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.473+0000 7f6e70f1b700 1 -- start start 2023-10-06T02:50:58.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e70f1b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e58004810 0x7f6e6c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e70f1b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0aa890 0x7f6e6c0b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e70f1b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c15da40 0x7f6e6c15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e70f1b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c15e3f0 con 0x7f6e6c0aa890 2023-10-06T02:50:58.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e70f1b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c16a350 con 0x7f6e58004810 2023-10-06T02:50:58.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e70f1b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0aae00 con 0x7f6e6c15da40 2023-10-06T02:50:58.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e61d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0aa890 0x7f6e6c0b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e61d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0aa890 0x7f6e6c0b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55404/0 (socket says 172.21.15.81:55404) 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e61d9b700 1 -- 172.21.15.81:0/1659609209 learned_addr learned my addr 172.21.15.81:0/1659609209 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e6ad9d700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c15da40 0x7f6e6c15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e6a59c700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e58004810 0x7f6e6c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e61d9b700 1 -- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c15da40 msgr2=0x7f6e6c15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e61d9b700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c15da40 0x7f6e6c15deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e61d9b700 1 -- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e58004810 msgr2=0x7f6e6c148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e61d9b700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e58004810 0x7f6e6c148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e61d9b700 1 -- 172.21.15.81:0/1659609209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0ab0e0 con 0x7f6e6c0aa890 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e6ad9d700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c15da40 0x7f6e6c15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.474+0000 7f6e61d9b700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0aa890 0x7f6e6c0b5dc0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400e450 tx=0x7f6e5401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:58.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.475+0000 7f6e62ffd700 1 -- 172.21.15.81:0/1659609209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54013e30 con 0x7f6e6c0aa890 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.475+0000 7f6e62ffd700 1 -- 172.21.15.81:0/1659609209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5400e750 con 0x7f6e6c0aa890 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.475+0000 7f6e62ffd700 1 -- 172.21.15.81:0/1659609209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5401c8a0 con 0x7f6e6c0aa890 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.475+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c0ab3c0 con 0x7f6e6c0aa890 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.475+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c0b6300 con 0x7f6e6c0aa890 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.475+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c16a4c0 con 0x7f6e6c0aa890 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.476+0000 7f6e62ffd700 1 -- 172.21.15.81:0/1659609209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e5401ccd0 con 0x7f6e6c0aa890 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.476+0000 7f6e62ffd700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e4c066f30 0x7f6e4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.476+0000 7f6e62ffd700 1 -- 172.21.15.81:0/1659609209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6e54086110 con 0x7f6e6c0aa890 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.476+0000 7f6e6a59c700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e4c066f30 0x7f6e4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:58.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.477+0000 7f6e6a59c700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e4c066f30 0x7f6e4c0693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c001050 tx=0x7f6e5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.481+0000 7f6e62ffd700 1 -- 172.21.15.81:0/1659609209 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e54053570 con 0x7f6e6c0aa890 2023-10-06T02:50:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:58.663+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6e6c0d0170 con 0x7f6e6c0aa890 2023-10-06T02:50:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.640+0000 7f6e62ffd700 1 -- 172.21.15.81:0/1659609209 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6e54006d90 con 0x7f6e6c0aa890 2023-10-06T02:50:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e4c066f30 msgr2=0x7f6e4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e4c066f30 0x7f6e4c0693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c001050 tx=0x7f6e5c009040 comp rx=0 tx=0).stop 2023-10-06T02:50:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0aa890 msgr2=0x7f6e6c0b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0aa890 0x7f6e6c0b5dc0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400e450 tx=0x7f6e5401a000 comp rx=0 tx=0).stop 2023-10-06T02:50:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 shutdown_connections 2023-10-06T02:50:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e6c15da40 0x7f6e6c15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6e4c066f30 0x7f6e4c0693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e58004810 0x7f6e6c148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 --2- 172.21.15.81:0/1659609209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0aa890 0x7f6e6c0b5dc0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 >> 172.21.15.81:0/1659609209 conn(0x7f6e6c06bb90 msgr2=0x7f6e6c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 shutdown_connections 2023-10-06T02:50:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.644+0000 7f6e70f1b700 1 -- 172.21.15.81:0/1659609209 wait complete. 2023-10-06T02:50:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:50:59.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:50:59.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.787+0000 7f2125068700 1 Processor -- start 2023-10-06T02:50:59.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.787+0000 7f2125068700 1 -- start start 2023-10-06T02:50:59.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f2125068700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f21200b34d0 0x7f21200ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:59.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f2125068700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21200add40 0x7f21200b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f2125068700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200b4370 con 0x7f21200ad970 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f2125068700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21200b1980 con 0x7f21200add40 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f2125068700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21200b1c60 con 0x7f21200b34d0 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f211f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21200add40 0x7f21200b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f211f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21200add40 0x7f21200b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55412/0 (socket says 172.21.15.81:55412) 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f211f59e700 1 -- 172.21.15.81:0/1394216006 learned_addr learned my addr 172.21.15.81:0/1394216006 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f211659c700 1 --2- 172.21.15.81:0/1394216006 >> v2:172.21.15.83:3300/0 conn(0x7f21200b34d0 0x7f21200ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f211f59e700 1 -- 172.21.15.81:0/1394216006 >> v2:172.21.15.83:3300/0 conn(0x7f21200b34d0 msgr2=0x7f21200ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f211f59e700 1 --2- 172.21.15.81:0/1394216006 >> v2:172.21.15.83:3300/0 conn(0x7f21200b34d0 0x7f21200ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f211f59e700 1 -- 172.21.15.81:0/1394216006 >> v1:172.21.15.83:6789/0 conn(0x7f21200ad970 legacy=0x7f2120158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f211f59e700 1 -- 172.21.15.81:0/1394216006 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120158af0 con 0x7f21200add40 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.788+0000 7f211f59e700 1 --2- 172.21.15.81:0/1394216006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 0x7f21200b0590 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f212006aa10 tx=0x7f2118009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb94ac58cd2e2a54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f211e59c700 1 -- 172.21.15.81:0/1394216006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800e070 con 0x7f21200add40 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f211e59c700 1 -- 172.21.15.81:0/1394216006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211800ba20 con 0x7f21200add40 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f211e59c700 1 -- 172.21.15.81:0/1394216006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180092e0 con 0x7f21200add40 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f2125068700 1 -- 172.21.15.81:0/1394216006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 msgr2=0x7f21200b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f2125068700 1 --2- 172.21.15.81:0/1394216006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 0x7f21200b0590 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f212006aa10 tx=0x7f2118009840 comp rx=0 tx=0).stop 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f2125068700 1 -- 172.21.15.81:0/1394216006 shutdown_connections 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f2125068700 1 --2- 172.21.15.81:0/1394216006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 0x7f21200b0590 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f2125068700 1 --2- 172.21.15.81:0/1394216006 >> v2:172.21.15.83:3300/0 conn(0x7f21200b34d0 0x7f21200ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f2125068700 1 -- 172.21.15.81:0/1394216006 >> 172.21.15.81:0/1394216006 conn(0x7f212006b530 msgr2=0x7f2120067640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f2125068700 1 -- 172.21.15.81:0/1394216006 shutdown_connections 2023-10-06T02:50:59.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.789+0000 7f2125068700 1 -- 172.21.15.81:0/1394216006 wait complete. 2023-10-06T02:50:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.790+0000 7f2125068700 1 Processor -- start 2023-10-06T02:50:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.790+0000 7f2125068700 1 -- start start 2023-10-06T02:50:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f2125068700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21200ad970 0x7f212014c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f2125068700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 0x7f21200ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f2125068700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21200b34d0 0x7f2120159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f2125068700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212014cd20 con 0x7f21200add40 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f2125068700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212014e5d0 con 0x7f21200ad970 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f2125068700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212014d2e0 con 0x7f21200b34d0 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f211659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 0x7f21200ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f211659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 0x7f21200ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55418/0 (socket says 172.21.15.81:55418) 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f211659c700 1 -- 172.21.15.81:0/25788572 learned_addr learned my addr 172.21.15.81:0/25788572 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f211659c700 1 -- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21200b34d0 msgr2=0x7f2120159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f211659c700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21200b34d0 0x7f2120159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f211ed9d700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21200ad970 0x7f212014c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f211659c700 1 -- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21200ad970 msgr2=0x7f212014c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.791+0000 7f211659c700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21200ad970 0x7f212014c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.792+0000 7f211659c700 1 -- 172.21.15.81:0/25788572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118009ae0 con 0x7f21200add40 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.792+0000 7f211659c700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 0x7f21200ce7b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f210800e930 tx=0x7f21080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.792+0000 7f21177fe700 1 -- 172.21.15.81:0/25788572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800eed0 con 0x7f21200add40 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.792+0000 7f21177fe700 1 -- 172.21.15.81:0/25788572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800c850 con 0x7f21200add40 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.792+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212014e140 con 0x7f21200add40 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.792+0000 7f21177fe700 1 -- 172.21.15.81:0/25788572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800cbf0 con 0x7f21200add40 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.792+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212014d810 con 0x7f21200add40 2023-10-06T02:50:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.793+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212014e2d0 con 0x7f21200add40 2023-10-06T02:50:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.793+0000 7f21177fe700 1 -- 172.21.15.81:0/25788572 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2108013470 con 0x7f21200add40 2023-10-06T02:50:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.794+0000 7f21177fe700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2100066f30 0x7f21000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:50:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.794+0000 7f21177fe700 1 -- 172.21.15.81:0/25788572 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f2108084670 con 0x7f21200add40 2023-10-06T02:50:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.794+0000 7f211ed9d700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2100066f30 0x7f21000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:50:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.794+0000 7f211ed9d700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2100066f30 0x7f21000693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2110001760 tx=0x7f2110009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:50:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.798+0000 7f21177fe700 1 -- 172.21.15.81:0/25788572 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2108051960 con 0x7f21200add40 2023-10-06T02:50:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:50:59.980+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2120069760 con 0x7f21200add40 2023-10-06T02:51:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.642+0000 7f21177fe700 1 -- 172.21.15.81:0/25788572 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2108054f80 con 0x7f21200add40 2023-10-06T02:51:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.653+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2100066f30 msgr2=0x7f21000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.653+0000 7f2125068700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2100066f30 0x7f21000693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2110001760 tx=0x7f2110009040 comp rx=0 tx=0).stop 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.653+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 msgr2=0x7f21200ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.653+0000 7f2125068700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 0x7f21200ce7b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f210800e930 tx=0x7f21080091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.654+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 shutdown_connections 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.654+0000 7f2125068700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21200b34d0 0x7f2120159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.654+0000 7f2125068700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2100066f30 0x7f21000693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.654+0000 7f2125068700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21200ad970 0x7f212014c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.654+0000 7f2125068700 1 --2- 172.21.15.81:0/25788572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21200add40 0x7f21200ce7b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.654+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 >> 172.21.15.81:0/25788572 conn(0x7f212006b530 msgr2=0x7f212015a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.654+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 shutdown_connections 2023-10-06T02:51:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.654+0000 7f2125068700 1 -- 172.21.15.81:0/25788572 wait complete. 2023-10-06T02:51:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:51:00.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.784+0000 7f6168b0f700 1 Processor -- start 2023-10-06T02:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.784+0000 7f6168b0f700 1 -- start start 2023-10-06T02:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.785+0000 7f6168b0f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f616415a2a0 0x7f61640b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.785+0000 7f6168b0f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616406dd60 0x7f61640cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.785+0000 7f6168b0f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61640b0ca0 con 0x7f61640ceb30 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.785+0000 7f6168b0f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616406e160 con 0x7f616415a2a0 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.785+0000 7f6168b0f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616406ea90 con 0x7f616406dd60 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f6161d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61640ceb30 0x7f616406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52184/0 (socket says 172.21.15.81:52184) 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f6161d9b700 1 -- 172.21.15.81:0/2307898219 learned_addr learned my addr 172.21.15.81:0/2307898219 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616259c700 1 --2- 172.21.15.81:0/2307898219 >> v2:172.21.15.83:3300/0 conn(0x7f616415a2a0 0x7f61640b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f6162d9d700 1 --2- 172.21.15.81:0/2307898219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616406dd60 0x7f61640cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616159a700 1 -- 172.21.15.81:0/2307898219 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057236360 0 0) 0x7f61640b0ca0 con 0x7f61640ceb30 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616159a700 1 -- 172.21.15.81:0/2307898219 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6150003570 con 0x7f61640ceb30 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616259c700 1 -- 172.21.15.81:0/2307898219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616406dd60 msgr2=0x7f61640cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616259c700 1 --2- 172.21.15.81:0/2307898219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616406dd60 0x7f61640cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616259c700 1 -- 172.21.15.81:0/2307898219 >> v1:172.21.15.81:6789/0 conn(0x7f61640ceb30 legacy=0x7f616406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616259c700 1 -- 172.21.15.81:0/2307898219 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640b00d0 con 0x7f616415a2a0 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f6162d9d700 1 --2- 172.21.15.81:0/2307898219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616406dd60 0x7f61640cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616259c700 1 --2- 172.21.15.81:0/2307898219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616415a2a0 0x7f61640b1130 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6154009e60 tx=0x7f6154009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85674e546d2a93d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616159a700 1 -- 172.21.15.81:0/2307898219 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400e070 con 0x7f616415a2a0 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.786+0000 7f616159a700 1 -- 172.21.15.81:0/2307898219 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615400bab0 con 0x7f616415a2a0 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.787+0000 7f616159a700 1 -- 172.21.15.81:0/2307898219 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400be70 con 0x7f616415a2a0 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.787+0000 7f6168b0f700 1 -- 172.21.15.81:0/2307898219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616415a2a0 msgr2=0x7f61640b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.787+0000 7f6168b0f700 1 --2- 172.21.15.81:0/2307898219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616415a2a0 0x7f61640b1130 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6154009e60 tx=0x7f6154009780 comp rx=0 tx=0).stop 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.787+0000 7f6168b0f700 1 -- 172.21.15.81:0/2307898219 shutdown_connections 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.787+0000 7f6168b0f700 1 --2- 172.21.15.81:0/2307898219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616406dd60 0x7f61640cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.787+0000 7f6168b0f700 1 --2- 172.21.15.81:0/2307898219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616415a2a0 0x7f61640b1130 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.787+0000 7f6168b0f700 1 -- 172.21.15.81:0/2307898219 >> 172.21.15.81:0/2307898219 conn(0x7f6164067640 msgr2=0x7f6164067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:00.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.787+0000 7f6168b0f700 1 -- 172.21.15.81:0/2307898219 shutdown_connections 2023-10-06T02:51:00.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.787+0000 7f6168b0f700 1 -- 172.21.15.81:0/2307898219 wait complete. 2023-10-06T02:51:00.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.788+0000 7f6168b0f700 1 Processor -- start 2023-10-06T02:51:00.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.788+0000 7f6168b0f700 1 -- start start 2023-10-06T02:51:00.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6168b0f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616406dd60 0x7f616414f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:00.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6168b0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61640ceb30 0x7f6164153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:00.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6168b0f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616415a2a0 0x7f61640b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:00.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6168b0f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616415e2a0 con 0x7f61640ceb30 2023-10-06T02:51:00.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6168b0f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616414fe20 con 0x7f616406dd60 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6168b0f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6164153c30 con 0x7f616415a2a0 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6161d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61640ceb30 0x7f6164153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6161d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61640ceb30 0x7f6164153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37600/0 (socket says 172.21.15.81:37600) 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6161d9b700 1 -- 172.21.15.81:0/2253096491 learned_addr learned my addr 172.21.15.81:0/2253096491 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6162d9d700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616415a2a0 0x7f61640b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f616259c700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616406dd60 0x7f616414f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6161d9b700 1 -- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616415a2a0 msgr2=0x7f61640b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6161d9b700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616415a2a0 0x7f61640b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6161d9b700 1 -- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616406dd60 msgr2=0x7f616414f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6161d9b700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616406dd60 0x7f616414f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6161d9b700 1 -- 172.21.15.81:0/2253096491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c009420 con 0x7f61640ceb30 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f616259c700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616406dd60 0x7f616414f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.789+0000 7f6161d9b700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61640ceb30 0x7f6164153150 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c7c0 tx=0x7f614c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.790+0000 7f615a7fc700 1 -- 172.21.15.81:0/2253096491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c005b30 con 0x7f61640ceb30 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.790+0000 7f615a7fc700 1 -- 172.21.15.81:0/2253096491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c005c90 con 0x7f61640ceb30 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.790+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6154009a20 con 0x7f61640ceb30 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.790+0000 7f615a7fc700 1 -- 172.21.15.81:0/2253096491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c007340 con 0x7f61640ceb30 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.790+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616415df30 con 0x7f61640ceb30 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.791+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616415dab0 con 0x7f61640ceb30 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.791+0000 7f615a7fc700 1 -- 172.21.15.81:0/2253096491 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f614c01b400 con 0x7f61640ceb30 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.791+0000 7f615a7fc700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6144066f30 0x7f61440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.791+0000 7f615a7fc700 1 -- 172.21.15.81:0/2253096491 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f614c084180 con 0x7f61640ceb30 2023-10-06T02:51:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.792+0000 7f616259c700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6144066f30 0x7f61440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:00.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.792+0000 7f616259c700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6144066f30 0x7f61440693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f61540097c0 tx=0x7f6154019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:00.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:00.796+0000 7f615a7fc700 1 -- 172.21.15.81:0/2253096491 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f616415dab0 con 0x7f61640ceb30 2023-10-06T02:51:01.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.018+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f616415dab0 con 0x7f61640ceb30 2023-10-06T02:51:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.672+0000 7f615a7fc700 1 -- 172.21.15.81:0/2253096491 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v48) v1 ==== 174+0+0 (secure 0 0 0) 0x7f616415dab0 con 0x7f61640ceb30 2023-10-06T02:51:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.676+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6144066f30 msgr2=0x7f61440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.676+0000 7f6168b0f700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6144066f30 0x7f61440693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f61540097c0 tx=0x7f6154019000 comp rx=0 tx=0).stop 2023-10-06T02:51:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.676+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61640ceb30 msgr2=0x7f6164153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.676+0000 7f6168b0f700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61640ceb30 0x7f6164153150 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c7c0 tx=0x7f614c007e00 comp rx=0 tx=0).stop 2023-10-06T02:51:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.677+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 shutdown_connections 2023-10-06T02:51:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.677+0000 7f6168b0f700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616415a2a0 0x7f61640b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.677+0000 7f6168b0f700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6144066f30 0x7f61440693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.677+0000 7f6168b0f700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616406dd60 0x7f616414f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.677+0000 7f6168b0f700 1 --2- 172.21.15.81:0/2253096491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61640ceb30 0x7f6164153150 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.677+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 >> 172.21.15.81:0/2253096491 conn(0x7f6164067640 msgr2=0x7f61640ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.677+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 shutdown_connections 2023-10-06T02:51:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.677+0000 7f6168b0f700 1 -- 172.21.15.81:0/2253096491 wait complete. 2023-10-06T02:51:01.679 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 13 and data pool 14 2023-10-06T02:51:01.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:01.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.805+0000 7f381118d700 1 Processor -- start 2023-10-06T02:51:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.805+0000 7f381118d700 1 -- start start 2023-10-06T02:51:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f381118d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f380c157fe0 0x7f380c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f381118d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f380c1583b0 0x7f380c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f381118d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c0b2890 con 0x7f380c0ceb30 2023-10-06T02:51:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f381118d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380c0b4070 con 0x7f380c157fe0 2023-10-06T02:51:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f381118d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0b4350 con 0x7f380c1583b0 2023-10-06T02:51:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f380ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f380c157fe0 0x7f380c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f380b59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f380c0ceb30 0x7f380c0cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52194/0 (socket says 172.21.15.81:52194) 2023-10-06T02:51:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f380b59e700 1 -- 172.21.15.81:0/3273654040 learned_addr learned my addr 172.21.15.81:0/3273654040 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f380ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f380c157fe0 0x7f380c0b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37606/0 (socket says 172.21.15.81:37606) 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f380ad9d700 1 -- 172.21.15.81:0/3273654040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f380c1583b0 msgr2=0x7f380c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f380ad9d700 1 --2- 172.21.15.81:0/3273654040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f380c1583b0 0x7f380c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f380ad9d700 1 -- 172.21.15.81:0/3273654040 >> v1:172.21.15.81:6789/0 conn(0x7f380c0ceb30 legacy=0x7f380c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f380ad9d700 1 -- 172.21.15.81:0/3273654040 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c0b4630 con 0x7f380c157fe0 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.806+0000 7f3809d9b700 1 -- 172.21.15.81:0/3273654040 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428009509 0 0) 0x7f380c0b2890 con 0x7f380c0ceb30 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f380ad9d700 1 --2- 172.21.15.81:0/3273654040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c157fe0 0x7f380c0b34c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009e60 tx=0x7f37fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ae0aec3fe683b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f3809d9b700 1 -- 172.21.15.81:0/3273654040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc00e070 con 0x7f380c157fe0 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f3809d9b700 1 -- 172.21.15.81:0/3273654040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc00bc30 con 0x7f380c157fe0 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f3809d9b700 1 -- 172.21.15.81:0/3273654040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc012430 con 0x7f380c157fe0 2023-10-06T02:51:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f381118d700 1 -- 172.21.15.81:0/3273654040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c157fe0 msgr2=0x7f380c0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f381118d700 1 --2- 172.21.15.81:0/3273654040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c157fe0 0x7f380c0b34c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009e60 tx=0x7f37fc009780 comp rx=0 tx=0).stop 2023-10-06T02:51:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f381118d700 1 -- 172.21.15.81:0/3273654040 shutdown_connections 2023-10-06T02:51:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f381118d700 1 --2- 172.21.15.81:0/3273654040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c157fe0 0x7f380c0b34c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f381118d700 1 --2- 172.21.15.81:0/3273654040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f380c1583b0 0x7f380c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f381118d700 1 -- 172.21.15.81:0/3273654040 >> 172.21.15.81:0/3273654040 conn(0x7f380c067640 msgr2=0x7f380c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f381118d700 1 -- 172.21.15.81:0/3273654040 shutdown_connections 2023-10-06T02:51:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.807+0000 7f381118d700 1 -- 172.21.15.81:0/3273654040 wait complete. 2023-10-06T02:51:01.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.808+0000 7f381118d700 1 Processor -- start 2023-10-06T02:51:01.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f381118d700 1 -- start start 2023-10-06T02:51:01.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f381118d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f380c0ceb30 0x7f380c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:01.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f381118d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380c157fe0 0x7f380c152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:01.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f381118d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c1583b0 0x7f380c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:01.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f381118d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c40a0 con 0x7f380c1583b0 2023-10-06T02:51:01.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f381118d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c6e50 con 0x7f380c157fe0 2023-10-06T02:51:01.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f381118d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c6b70 con 0x7f380c0ceb30 2023-10-06T02:51:01.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f380b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c1583b0 0x7f380c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:01.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f380b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c1583b0 0x7f380c0c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37618/0 (socket says 172.21.15.81:37618) 2023-10-06T02:51:01.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.809+0000 7f380b59e700 1 -- 172.21.15.81:0/821318492 learned_addr learned my addr 172.21.15.81:0/821318492 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:01.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f380b59e700 1 -- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f380c0ceb30 msgr2=0x7f380c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:01.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f380b59e700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f380c0ceb30 0x7f380c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:01.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f380b59e700 1 -- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380c157fe0 msgr2=0x7f380c152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f380a59c700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380c157fe0 0x7f380c152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f380b59e700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380c157fe0 0x7f380c152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f380b59e700 1 -- 172.21.15.81:0/821318492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc009a20 con 0x7f380c1583b0 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f380b59e700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c1583b0 0x7f380c0c6120 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f380400c530 tx=0x7f3804007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f37f2ffd700 1 -- 172.21.15.81:0/821318492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804005b30 con 0x7f380c1583b0 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f37f2ffd700 1 -- 172.21.15.81:0/821318492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804005c90 con 0x7f380c1583b0 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f37f2ffd700 1 -- 172.21.15.81:0/821318492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804007320 con 0x7f380c1583b0 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c0c3a50 con 0x7f380c1583b0 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.810+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c16c890 con 0x7f380c1583b0 2023-10-06T02:51:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.811+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c069e40 con 0x7f380c1583b0 2023-10-06T02:51:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.811+0000 7f37f2ffd700 1 -- 172.21.15.81:0/821318492 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f380401b3b0 con 0x7f380c1583b0 2023-10-06T02:51:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.812+0000 7f37f2ffd700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f37f8066f30 0x7f37f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.812+0000 7f37f2ffd700 1 -- 172.21.15.81:0/821318492 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3804083bc0 con 0x7f380c1583b0 2023-10-06T02:51:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.812+0000 7f380ad9d700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f37f8066f30 0x7f37f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.812+0000 7f380ad9d700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f37f8066f30 0x7f37f80693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009e60 tx=0x7f37fc019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.816+0000 7f37f2ffd700 1 -- 172.21.15.81:0/821318492 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3804050cd0 con 0x7f380c1583b0 2023-10-06T02:51:01.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T02:51:01.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.998+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f380c0cc6b0 con 0x7f380c1583b0 2023-10-06T02:51:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:01.999+0000 7f37f2ffd700 1 -- 172.21.15.81:0/821318492 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16837 (secure 0 0 0) 0x7f3804017020 con 0x7f380c1583b0 2023-10-06T02:51:02.001 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:02.001 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":100,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:01.019295+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:50:58.681047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T02:50:59.998500+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f37f8066f30 msgr2=0x7f37f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f37f8066f30 0x7f37f80693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009e60 tx=0x7f37fc019000 comp rx=0 tx=0).stop 2023-10-06T02:51:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c1583b0 msgr2=0x7f380c0c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c1583b0 0x7f380c0c6120 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f380400c530 tx=0x7f3804007f90 comp rx=0 tx=0).stop 2023-10-06T02:51:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 shutdown_connections 2023-10-06T02:51:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f380c1583b0 0x7f380c0c6120 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f380c0ceb30 0x7f380c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f37f8066f30 0x7f37f80693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 --2- 172.21.15.81:0/821318492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f380c157fe0 0x7f380c152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 >> 172.21.15.81:0/821318492 conn(0x7f380c067640 msgr2=0x7f380c15bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 shutdown_connections 2023-10-06T02:51:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.001+0000 7f381118d700 1 -- 172.21.15.81:0/821318492 wait complete. 2023-10-06T02:51:02.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.127+0000 7f21d2c30700 1 Processor -- start 2023-10-06T02:51:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.127+0000 7f21d2c30700 1 -- start start 2023-10-06T02:51:02.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.128+0000 7f21d2c30700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f21cc15e0a0 0x7f21cc0abea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.128+0000 7f21d2c30700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc0aae00 con 0x7f21cc0aa890 2023-10-06T02:51:02.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.128+0000 7f21d2c30700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc0ab0e0 con 0x7f21cc15dcd0 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.128+0000 7f21d2c30700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc0ab3c0 con 0x7f21cc15e0a0 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.128+0000 7f21c3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f21cc0aa890 0x7f21cc159880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52200/0 (socket says 172.21.15.81:52200) 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.128+0000 7f21c3fff700 1 -- 172.21.15.81:0/1360921099 learned_addr learned my addr 172.21.15.81:0/1360921099 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d11cd700 1 --2- 172.21.15.81:0/1360921099 >> v2:172.21.15.83:3300/0 conn(0x7f21cc15e0a0 0x7f21cc0abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964855999 0 0) 0x7f21cc0aae00 con 0x7f21cc0aa890 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b4003570 con 0x7f21cc0aa890 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1400186887 0 0) 0x7f21b4003570 con 0x7f21cc0aa890 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 >> v2:172.21.15.83:3300/0 conn(0x7f21cc15e0a0 msgr2=0x7f21cc0abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 --2- 172.21.15.81:0/1360921099 >> v2:172.21.15.83:3300/0 conn(0x7f21cc15e0a0 0x7f21cc0abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 >> v1:172.21.15.83:6789/0 conn(0x7f21cc15dcd0 legacy=0x7f21cc0c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc0ab6a0 con 0x7f21cc0aa890 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f21bc001470 con 0x7f21cc0aa890 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 >> v1:172.21.15.81:6789/0 conn(0x7f21cc0aa890 legacy=0x7f21cc159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b4003a60 0x7f21b4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4004810 0x7f21b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21b40051c0 0x7f21b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0ab3c0 con 0x7f21b4003a60 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b400c050 con 0x7f21b40051c0 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b400c210 con 0x7f21b4004810 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d09cc700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b4003a60 0x7f21b4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c3fff700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4004810 0x7f21b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d11cd700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21b40051c0 0x7f21b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d09cc700 1 -- 172.21.15.81:0/1360921099 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4004810 msgr2=0x7f21b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d09cc700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4004810 0x7f21b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d09cc700 1 -- 172.21.15.81:0/1360921099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21b40051c0 msgr2=0x7f21b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d09cc700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21b40051c0 0x7f21b400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d11cd700 1 -- 172.21.15.81:0/1360921099 reap_dead start 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d09cc700 1 -- 172.21.15.81:0/1360921099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b4003570 con 0x7f21b4003a60 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21c3fff700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4004810 0x7f21b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.129+0000 7f21d09cc700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b4003a60 0x7f21b4003e30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f21c80019a0 tx=0x7f21c8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad11fb233ab83fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800c5d0 con 0x7f21b4003a60 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c800c750 con 0x7f21b4003a60 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21c37fe700 1 -- 172.21.15.81:0/1360921099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800cb10 con 0x7f21b4003a60 2023-10-06T02:51:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21d2c30700 1 -- 172.21.15.81:0/1360921099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b4003a60 msgr2=0x7f21b4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21d2c30700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b4003a60 0x7f21b4003e30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f21c80019a0 tx=0x7f21c8007d10 comp rx=0 tx=0).stop 2023-10-06T02:51:02.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21d2c30700 1 -- 172.21.15.81:0/1360921099 shutdown_connections 2023-10-06T02:51:02.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21d2c30700 1 --2- 172.21.15.81:0/1360921099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b4003a60 0x7f21b4003e30 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21d2c30700 1 -- 172.21.15.81:0/1360921099 >> 172.21.15.81:0/1360921099 conn(0x7f21cc0ccdb0 msgr2=0x7f21cc0cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:02.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21d2c30700 1 -- 172.21.15.81:0/1360921099 shutdown_connections 2023-10-06T02:51:02.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.130+0000 7f21d2c30700 1 -- 172.21.15.81:0/1360921099 wait complete. 2023-10-06T02:51:02.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.131+0000 7f21d2c30700 1 Processor -- start 2023-10-06T02:51:02.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21d2c30700 1 -- start start 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21d2c30700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4003a60 0x7f21cc1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21d2c30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc0c4090 0x7f21cc0c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21d2c30700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21cc0c64c0 0x7f21cc0c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21d2c30700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0b22a0 con 0x7f21cc0c4090 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21d2c30700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc156d00 con 0x7f21cc0c64c0 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21d2c30700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0b1970 con 0x7f21b4003a60 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc0c4090 0x7f21cc0c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc0c4090 0x7f21cc0c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37628/0 (socket says 172.21.15.81:37628) 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21c3fff700 1 -- 172.21.15.81:0/2543970937 learned_addr learned my addr 172.21.15.81:0/2543970937 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21d09cc700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4003a60 0x7f21cc1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.132+0000 7f21d11cd700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21cc0c64c0 0x7f21cc0c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21c3fff700 1 -- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4003a60 msgr2=0x7f21cc1567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21c3fff700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4003a60 0x7f21cc1567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21c3fff700 1 -- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21cc0c64c0 msgr2=0x7f21cc0c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21c3fff700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21cc0c64c0 0x7f21cc0c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21c3fff700 1 -- 172.21.15.81:0/2543970937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc0b1c50 con 0x7f21cc0c4090 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21d11cd700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21cc0c64c0 0x7f21cc0c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21c3fff700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc0c4090 0x7f21cc0c4820 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00eb90 tx=0x7f21bc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21c0ff9700 1 -- 172.21.15.81:0/2543970937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00c5d0 con 0x7f21cc0c4090 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21c0ff9700 1 -- 172.21.15.81:0/2543970937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc00c730 con 0x7f21cc0c4090 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc0b1f30 con 0x7f21cc0c4090 2023-10-06T02:51:02.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21c0ff9700 1 -- 172.21.15.81:0/2543970937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00cad0 con 0x7f21cc0c4090 2023-10-06T02:51:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.133+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc0c6e70 con 0x7f21cc0c4090 2023-10-06T02:51:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.134+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc0b2410 con 0x7f21cc0c4090 2023-10-06T02:51:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.135+0000 7f21c0ff9700 1 -- 172.21.15.81:0/2543970937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21bc01d460 con 0x7f21cc0c4090 2023-10-06T02:51:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.135+0000 7f21c0ff9700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.135+0000 7f21c0ff9700 1 -- 172.21.15.81:0/2543970937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21bc084570 con 0x7f21cc0c4090 2023-10-06T02:51:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.135+0000 7f21d09cc700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.135+0000 7f21d09cc700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21b8066f30 0x7f21b80693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000fd0 tx=0x7f21c8015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:02.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.139+0000 7f21c0ff9700 1 -- 172.21.15.81:0/2543970937 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21bc051680 con 0x7f21cc0c4090 2023-10-06T02:51:02.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.323+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21cc0ab980 con 0x7f21cc0c4090 2023-10-06T02:51:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.324+0000 7f21c0ff9700 1 -- 172.21.15.81:0/2543970937 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16837 (secure 0 0 0) 0x7f21bc054ca0 con 0x7f21cc0c4090 2023-10-06T02:51:02.325 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:02.326 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":100,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:01.019295+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:50:58.681047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T02:50:59.998500+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:02.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21b8066f30 msgr2=0x7f21b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21b8066f30 0x7f21b80693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000fd0 tx=0x7f21c8015000 comp rx=0 tx=0).stop 2023-10-06T02:51:02.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc0c4090 msgr2=0x7f21cc0c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc0c4090 0x7f21cc0c4820 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00eb90 tx=0x7f21bc001e70 comp rx=0 tx=0).stop 2023-10-06T02:51:02.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 shutdown_connections 2023-10-06T02:51:02.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21cc0c64c0 0x7f21cc0c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21b4003a60 0x7f21cc1567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 --2- 172.21.15.81:0/2543970937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc0c4090 0x7f21cc0c4820 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 >> 172.21.15.81:0/2543970937 conn(0x7f21cc0ccdb0 msgr2=0x7f21cc158d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:02.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 shutdown_connections 2023-10-06T02:51:02.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.326+0000 7f21d2c30700 1 -- 172.21.15.81:0/2543970937 wait complete. 2023-10-06T02:51:02.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:51:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.456+0000 7fd1b6461700 1 Processor -- start 2023-10-06T02:51:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.456+0000 7fd1b6461700 1 -- start start 2023-10-06T02:51:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1b6461700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1b015a2a0 0x7fd1b00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1b6461700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 0x7fd1b00cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1b6461700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b00b0ca0 con 0x7fd1b006d650 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1b6461700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b006ea90 con 0x7fd1b015a2a0 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1b6461700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b00cf4c0 con 0x7fd1b00ceb30 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1affff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1b015a2a0 0x7fd1b00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1b49fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd1b006d650 0x7fd1b006da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52204/0 (socket says 172.21.15.81:52204) 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1b49fe700 1 -- 172.21.15.81:0/2636419683 learned_addr learned my addr 172.21.15.81:0/2636419683 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1af7fe700 1 --2- 172.21.15.81:0/2636419683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 0x7fd1b00cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1affff700 1 -- 172.21.15.81:0/2636419683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 msgr2=0x7fd1b00cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1affff700 1 --2- 172.21.15.81:0/2636419683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 0x7fd1b00cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1affff700 1 -- 172.21.15.81:0/2636419683 >> v1:172.21.15.81:6789/0 conn(0x7fd1b006d650 legacy=0x7fd1b006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1aeffd700 1 -- 172.21.15.81:0/2636419683 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122768732 0 0) 0x7fd1b00b0ca0 con 0x7fd1b006d650 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1affff700 1 -- 172.21.15.81:0/2636419683 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b00b00d0 con 0x7fd1b015a2a0 2023-10-06T02:51:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1af7fe700 1 --2- 172.21.15.81:0/2636419683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 0x7fd1b00cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.457+0000 7fd1affff700 1 --2- 172.21.15.81:0/2636419683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b015a2a0 0x7fd1b00b1130 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00098e0 tx=0x7fd1a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fef0df64f6668f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1aeffd700 1 -- 172.21.15.81:0/2636419683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0009e80 con 0x7fd1b015a2a0 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1aeffd700 1 -- 172.21.15.81:0/2636419683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a000b860 con 0x7fd1b015a2a0 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1aeffd700 1 -- 172.21.15.81:0/2636419683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000bbe0 con 0x7fd1b015a2a0 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1b6461700 1 -- 172.21.15.81:0/2636419683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b015a2a0 msgr2=0x7fd1b00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1b6461700 1 --2- 172.21.15.81:0/2636419683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b015a2a0 0x7fd1b00b1130 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00098e0 tx=0x7fd1a00091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1b6461700 1 -- 172.21.15.81:0/2636419683 shutdown_connections 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1b6461700 1 --2- 172.21.15.81:0/2636419683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b015a2a0 0x7fd1b00b1130 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1b6461700 1 --2- 172.21.15.81:0/2636419683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 0x7fd1b00cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1b6461700 1 -- 172.21.15.81:0/2636419683 >> 172.21.15.81:0/2636419683 conn(0x7fd1b0067640 msgr2=0x7fd1b0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1b6461700 1 -- 172.21.15.81:0/2636419683 shutdown_connections 2023-10-06T02:51:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.458+0000 7fd1b6461700 1 -- 172.21.15.81:0/2636419683 wait complete. 2023-10-06T02:51:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.459+0000 7fd1b6461700 1 Processor -- start 2023-10-06T02:51:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.459+0000 7fd1b6461700 1 -- start start 2023-10-06T02:51:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1b6461700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b006d650 0x7fd1b00c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1b6461700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 0x7fd1b0146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1b6461700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1b015a2a0 0x7fd1b015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1b6461700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b01473f0 con 0x7fd1b006d650 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1b6461700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b00cc010 con 0x7fd1b015a2a0 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1b6461700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b00cc2f0 con 0x7fd1b00ceb30 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b006d650 0x7fd1b00c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b006d650 0x7fd1b00c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37644/0 (socket says 172.21.15.81:37644) 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1affff700 1 -- 172.21.15.81:0/3536263735 learned_addr learned my addr 172.21.15.81:0/3536263735 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.460+0000 7fd1af7fe700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 0x7fd1b0146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd1b49fe700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1b015a2a0 0x7fd1b015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd1affff700 1 -- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 msgr2=0x7fd1b0146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd1affff700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 0x7fd1b0146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd1affff700 1 -- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1b015a2a0 msgr2=0x7fd1b015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd1affff700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1b015a2a0 0x7fd1b015aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd1affff700 1 -- 172.21.15.81:0/3536263735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a0009420 con 0x7fd1b006d650 2023-10-06T02:51:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd1affff700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b006d650 0x7fd1b00c8740 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd1b006f990 tx=0x7fd1a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd197fff700 1 -- 172.21.15.81:0/3536263735 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000bbe0 con 0x7fd1b006d650 2023-10-06T02:51:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd197fff700 1 -- 172.21.15.81:0/3536263735 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a0011420 con 0x7fd1b006d650 2023-10-06T02:51:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b00cc5d0 con 0x7fd1b006d650 2023-10-06T02:51:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd197fff700 1 -- 172.21.15.81:0/3536263735 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00117a0 con 0x7fd1b006d650 2023-10-06T02:51:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.461+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b00cbc90 con 0x7fd1b006d650 2023-10-06T02:51:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.462+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b006b6d0 con 0x7fd1b006d650 2023-10-06T02:51:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.462+0000 7fd197fff700 1 -- 172.21.15.81:0/3536263735 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1a0011bd0 con 0x7fd1b006d650 2023-10-06T02:51:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.463+0000 7fd197fff700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd19c066f30 0x7fd19c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.463+0000 7fd197fff700 1 -- 172.21.15.81:0/3536263735 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd1a00867e0 con 0x7fd1b006d650 2023-10-06T02:51:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.463+0000 7fd1af7fe700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd19c066f30 0x7fd19c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.463+0000 7fd1af7fe700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd19c066f30 0x7fd19c0693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4006f00 tx=0x7fd1a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:02.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.466+0000 7fd197fff700 1 -- 172.21.15.81:0/3536263735 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1a00539b0 con 0x7fd1b006d650 2023-10-06T02:51:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:02.699+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd1b00afb10 con 0x7fd1b006d650 2023-10-06T02:51:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.690+0000 7fd197fff700 1 -- 172.21.15.81:0/3536263735 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd1a0056f90 con 0x7fd1b006d650 2023-10-06T02:51:03.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd19c066f30 msgr2=0x7fd19c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:03.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd19c066f30 0x7fd19c0693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4006f00 tx=0x7fd1a4008040 comp rx=0 tx=0).stop 2023-10-06T02:51:03.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b006d650 msgr2=0x7fd1b00c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:03.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b006d650 0x7fd1b00c8740 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd1b006f990 tx=0x7fd1a0017000 comp rx=0 tx=0).stop 2023-10-06T02:51:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 shutdown_connections 2023-10-06T02:51:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd19c066f30 0x7fd19c0693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1b015a2a0 0x7fd1b015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b006d650 0x7fd1b00c8740 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 --2- 172.21.15.81:0/3536263735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd1b00ceb30 0x7fd1b0146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 >> 172.21.15.81:0/3536263735 conn(0x7fd1b0067640 msgr2=0x7fd1b00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 shutdown_connections 2023-10-06T02:51:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.693+0000 7fd1b6461700 1 -- 172.21.15.81:0/3536263735 wait complete. 2023-10-06T02:51:03.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:51:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.827+0000 7f0ec5be0700 1 Processor -- start 2023-10-06T02:51:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.827+0000 7f0ec5be0700 1 -- start start 2023-10-06T02:51:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ec5be0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ec00d0f50 0x7f0ec006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ec5be0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ec5be0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec006d990 con 0x7f0ec00d0b80 2023-10-06T02:51:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ec5be0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec015a690 con 0x7f0ec00d0f50 2023-10-06T02:51:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ec5be0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00cf2d0 con 0x7f0ec006d530 2023-10-06T02:51:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ebffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ec00d0f50 0x7f0ec006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ec53df700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ec53df700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:41652/0 (socket says 172.21.15.81:41652) 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ec4bde700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f0ec00d0b80 0x7f0ec00cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:38174/0 (socket says 172.21.15.81:38174) 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ebffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ec00d0f50 0x7f0ec006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:46588/0 (socket says 172.21.15.81:46588) 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.828+0000 7f0ec53df700 1 -- 172.21.15.81:0/596455563 learned_addr learned my addr 172.21.15.81:0/596455563 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.829+0000 7f0ec53df700 1 -- 172.21.15.81:0/596455563 >> v2:172.21.15.83:3300/0 conn(0x7f0ec00d0f50 msgr2=0x7f0ec006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.829+0000 7f0ec53df700 1 --2- 172.21.15.81:0/596455563 >> v2:172.21.15.83:3300/0 conn(0x7f0ec00d0f50 0x7f0ec006cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.829+0000 7f0ec53df700 1 -- 172.21.15.81:0/596455563 >> v1:172.21.15.83:6789/0 conn(0x7f0ec00d0b80 legacy=0x7f0ec00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.829+0000 7f0ec53df700 1 -- 172.21.15.81:0/596455563 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00d0480 con 0x7f0ec006d530 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.829+0000 7f0ebffff700 1 --2- 172.21.15.81:0/596455563 >> v2:172.21.15.83:3300/0 conn(0x7f0ec00d0f50 0x7f0ec006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.829+0000 7f0ec53df700 1 --2- 172.21.15.81:0/596455563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec015b320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80099b0 tx=0x7f0eb8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=654acba10dd3efaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:03.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.829+0000 7f0ebf7fe700 1 -- 172.21.15.81:0/596455563 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8009ea0 con 0x7f0ec006d530 2023-10-06T02:51:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.829+0000 7f0ebf7fe700 1 -- 172.21.15.81:0/596455563 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb800b860 con 0x7f0ec006d530 2023-10-06T02:51:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.829+0000 7f0ebf7fe700 1 -- 172.21.15.81:0/596455563 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800bc00 con 0x7f0ec006d530 2023-10-06T02:51:03.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.830+0000 7f0ec5be0700 1 -- 172.21.15.81:0/596455563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 msgr2=0x7f0ec015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.830+0000 7f0ec5be0700 1 --2- 172.21.15.81:0/596455563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec015b320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80099b0 tx=0x7f0eb8009250 comp rx=0 tx=0).stop 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.830+0000 7f0ec5be0700 1 -- 172.21.15.81:0/596455563 shutdown_connections 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.830+0000 7f0ec5be0700 1 --2- 172.21.15.81:0/596455563 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec015b320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.830+0000 7f0ec5be0700 1 --2- 172.21.15.81:0/596455563 >> v2:172.21.15.83:3300/0 conn(0x7f0ec00d0f50 0x7f0ec006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.830+0000 7f0ec5be0700 1 -- 172.21.15.81:0/596455563 >> 172.21.15.81:0/596455563 conn(0x7f0ec0063230 msgr2=0x7f0ec0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.830+0000 7f0ec5be0700 1 -- 172.21.15.81:0/596455563 shutdown_connections 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.830+0000 7f0ec5be0700 1 -- 172.21.15.81:0/596455563 wait complete. 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.831+0000 7f0ec5be0700 1 Processor -- start 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.831+0000 7f0ec5be0700 1 -- start start 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ec5be0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec0155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ec5be0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00d0b80 0x7f0ec00c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ec5be0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ec00d0f50 0x7f0ec00c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ec5be0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00ccc50 con 0x7f0ec00d0b80 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ec5be0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00cc0b0 con 0x7f0ec00d0f50 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ec5be0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00cc320 con 0x7f0ec006d530 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00d0b80 0x7f0ec00c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00d0b80 0x7f0ec00c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37660/0 (socket says 172.21.15.81:37660) 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebffff700 1 -- 172.21.15.81:0/739645543 learned_addr learned my addr 172.21.15.81:0/739645543 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ec53df700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ec00d0f50 0x7f0ec00c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ec4bde700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebffff700 1 -- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 msgr2=0x7f0ec0155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebffff700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec0155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebffff700 1 -- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ec00d0f50 msgr2=0x7f0ec00c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebffff700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ec00d0f50 0x7f0ec00c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:03.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebffff700 1 -- 172.21.15.81:0/739645543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8009420 con 0x7f0ec00d0b80 2023-10-06T02:51:03.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebffff700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00d0b80 0x7f0ec00c7570 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800ecb0 tx=0x7f0ea80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:03.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebcff9700 1 -- 172.21.15.81:0/739645543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea800c850 con 0x7f0ec00d0b80 2023-10-06T02:51:03.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebcff9700 1 -- 172.21.15.81:0/739645543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea800c9b0 con 0x7f0ec00d0b80 2023-10-06T02:51:03.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb80094f0 con 0x7f0ec00d0b80 2023-10-06T02:51:03.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.832+0000 7f0ebcff9700 1 -- 172.21.15.81:0/739645543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea800cd30 con 0x7f0ec00d0b80 2023-10-06T02:51:03.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.833+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec00cc8e0 con 0x7f0ec00d0b80 2023-10-06T02:51:03.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.834+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec00676e0 con 0x7f0ec00d0b80 2023-10-06T02:51:03.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.834+0000 7f0ebcff9700 1 -- 172.21.15.81:0/739645543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ea8013680 con 0x7f0ec00d0b80 2023-10-06T02:51:03.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.834+0000 7f0ebcff9700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea0066f30 0x7f0ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:03.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.834+0000 7f0ebcff9700 1 -- 172.21.15.81:0/739645543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ea8084910 con 0x7f0ec00d0b80 2023-10-06T02:51:03.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.834+0000 7f0ec4bde700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea0066f30 0x7f0ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:03.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.835+0000 7f0ec4bde700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea0066f30 0x7f0ea00693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00020c0 tx=0x7f0eb0001ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:03.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:03.838+0000 7f0ebcff9700 1 -- 172.21.15.81:0/739645543 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ea80554b0 con 0x7f0ec00d0b80 2023-10-06T02:51:04.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.066+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0ec00ccd90 con 0x7f0ec00d0b80 2023-10-06T02:51:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.691+0000 7f0ebcff9700 1 -- 172.21.15.81:0/739645543 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ea8055040 con 0x7f0ec00d0b80 2023-10-06T02:51:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea0066f30 msgr2=0x7f0ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea0066f30 0x7f0ea00693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00020c0 tx=0x7f0eb0001ad0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00d0b80 msgr2=0x7f0ec00c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00d0b80 0x7f0ec00c7570 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800ecb0 tx=0x7f0ea80091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 shutdown_connections 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea0066f30 0x7f0ea00693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ec00d0f50 0x7f0ec00c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec006d530 0x7f0ec0155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 --2- 172.21.15.81:0/739645543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00d0b80 0x7f0ec00c7570 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 >> 172.21.15.81:0/739645543 conn(0x7f0ec0063230 msgr2=0x7f0ec0068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 shutdown_connections 2023-10-06T02:51:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.693+0000 7f0ec5be0700 1 -- 172.21.15.81:0/739645543 wait complete. 2023-10-06T02:51:04.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:04.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.820+0000 7f63e8d46700 1 Processor -- start 2023-10-06T02:51:04.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.820+0000 7f63e8d46700 1 -- start start 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63e8d46700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f63e41578d0 0x7f63e40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63e8d46700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63e4157ca0 0x7f63e415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63e8d46700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e40d07c0 con 0x7f63e406d120 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63e8d46700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e40cfbb0 con 0x7f63e4157ca0 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63e8d46700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e40cfe90 con 0x7f63e41578d0 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63d9d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63e4157ca0 0x7f63e415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63e2d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f63e406d120 0x7f63e406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52212/0 (socket says 172.21.15.81:52212) 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63e2d9d700 1 -- 172.21.15.81:0/884776969 learned_addr learned my addr 172.21.15.81:0/884776969 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63e259c700 1 --2- 172.21.15.81:0/884776969 >> v2:172.21.15.83:3300/0 conn(0x7f63e41578d0 0x7f63e40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:04.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63d9d9b700 1 -- 172.21.15.81:0/884776969 >> v2:172.21.15.83:3300/0 conn(0x7f63e41578d0 msgr2=0x7f63e40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63d9d9b700 1 --2- 172.21.15.81:0/884776969 >> v2:172.21.15.83:3300/0 conn(0x7f63e41578d0 0x7f63e40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63d9d9b700 1 -- 172.21.15.81:0/884776969 >> v1:172.21.15.81:6789/0 conn(0x7f63e406d120 legacy=0x7f63e406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.821+0000 7f63d9d9b700 1 -- 172.21.15.81:0/884776969 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e40d0170 con 0x7f63e4157ca0 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63d9d9b700 1 --2- 172.21.15.81:0/884776969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e4157ca0 0x7f63e415af00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f63e40646b0 tx=0x7f63cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688865e88395222d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e1d9b700 1 -- 172.21.15.81:0/884776969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00b6b0 con 0x7f63e4157ca0 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e1d9b700 1 -- 172.21.15.81:0/884776969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc00b810 con 0x7f63e4157ca0 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e1d9b700 1 -- 172.21.15.81:0/884776969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00bbb0 con 0x7f63e4157ca0 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e8d46700 1 -- 172.21.15.81:0/884776969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e4157ca0 msgr2=0x7f63e415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e8d46700 1 --2- 172.21.15.81:0/884776969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e4157ca0 0x7f63e415af00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f63e40646b0 tx=0x7f63cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e8d46700 1 -- 172.21.15.81:0/884776969 shutdown_connections 2023-10-06T02:51:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e8d46700 1 --2- 172.21.15.81:0/884776969 >> v2:172.21.15.83:3300/0 conn(0x7f63e41578d0 0x7f63e40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e8d46700 1 --2- 172.21.15.81:0/884776969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e4157ca0 0x7f63e415af00 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e8d46700 1 -- 172.21.15.81:0/884776969 >> 172.21.15.81:0/884776969 conn(0x7f63e406bb90 msgr2=0x7f63e406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e8d46700 1 -- 172.21.15.81:0/884776969 shutdown_connections 2023-10-06T02:51:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.822+0000 7f63e8d46700 1 -- 172.21.15.81:0/884776969 wait complete. 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63e8d46700 1 Processor -- start 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63e8d46700 1 -- start start 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63e8d46700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63e406d120 0x7f63e40c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63e8d46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e41578d0 0x7f63e40ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63e8d46700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63e4157ca0 0x7f63e4159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63e8d46700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40caa40 con 0x7f63e41578d0 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63e8d46700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40c8730 con 0x7f63e406d120 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63e8d46700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40cac60 con 0x7f63e4157ca0 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63d9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e41578d0 0x7f63e40ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.824+0000 7f63d9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e41578d0 0x7f63e40ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37680/0 (socket says 172.21.15.81:37680) 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63d9d9b700 1 -- 172.21.15.81:0/4099805575 learned_addr learned my addr 172.21.15.81:0/4099805575 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63e259c700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63e406d120 0x7f63e40c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63e2d9d700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63e4157ca0 0x7f63e4159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63d9d9b700 1 -- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63e4157ca0 msgr2=0x7f63e4159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63d9d9b700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63e4157ca0 0x7f63e4159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63d9d9b700 1 -- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63e406d120 msgr2=0x7f63e40c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63d9d9b700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63e406d120 0x7f63e40c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63d9d9b700 1 -- 172.21.15.81:0/4099805575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc009420 con 0x7f63e41578d0 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63d9d9b700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e41578d0 0x7f63e40ca500 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f63cc013000 tx=0x7f63cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63daffd700 1 -- 172.21.15.81:0/4099805575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00bb90 con 0x7f63e41578d0 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63daffd700 1 -- 172.21.15.81:0/4099805575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc011420 con 0x7f63e41578d0 2023-10-06T02:51:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e40c7e00 con 0x7f63e41578d0 2023-10-06T02:51:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63daffd700 1 -- 172.21.15.81:0/4099805575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0117c0 con 0x7f63e41578d0 2023-10-06T02:51:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.825+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e40c83c0 con 0x7f63e41578d0 2023-10-06T02:51:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.826+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e40c88e0 con 0x7f63e41578d0 2023-10-06T02:51:04.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.827+0000 7f63daffd700 1 -- 172.21.15.81:0/4099805575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63cc011bb0 con 0x7f63e41578d0 2023-10-06T02:51:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.827+0000 7f63daffd700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f63c4066f30 0x7f63c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.827+0000 7f63daffd700 1 -- 172.21.15.81:0/4099805575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f63cc085f80 con 0x7f63e41578d0 2023-10-06T02:51:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.827+0000 7f63e259c700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f63c4066f30 0x7f63c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.828+0000 7f63e259c700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f63c4066f30 0x7f63c40693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f63d4006fd0 tx=0x7f63d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:04.831+0000 7f63daffd700 1 -- 172.21.15.81:0/4099805575 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63cc0b75a0 con 0x7f63e41578d0 2023-10-06T02:51:05.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.053+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63e40d0450 con 0x7f63e41578d0 2023-10-06T02:51:05.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.053+0000 7f63daffd700 1 -- 172.21.15.81:0/4099805575 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f63cc011e60 con 0x7f63e41578d0 2023-10-06T02:51:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:05.055 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:01.019609+0000","modified":"2023-10-06T02:51:04.689923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/907018385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":907018385},{"type":"v1","addr":"172.21.15.81:6835","nonce":907018385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:51:05.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f63c4066f30 msgr2=0x7f63c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f63c4066f30 0x7f63c40693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f63d4006fd0 tx=0x7f63d4008040 comp rx=0 tx=0).stop 2023-10-06T02:51:05.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e41578d0 msgr2=0x7f63e40ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e41578d0 0x7f63e40ca500 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f63cc013000 tx=0x7f63cc017000 comp rx=0 tx=0).stop 2023-10-06T02:51:05.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 shutdown_connections 2023-10-06T02:51:05.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63e4157ca0 0x7f63e4159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f63c4066f30 0x7f63c40693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63e406d120 0x7f63e40c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 --2- 172.21.15.81:0/4099805575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e41578d0 0x7f63e40ca500 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 >> 172.21.15.81:0/4099805575 conn(0x7f63e406bb90 msgr2=0x7f63e415a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:05.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 shutdown_connections 2023-10-06T02:51:05.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.055+0000 7f63e8d46700 1 -- 172.21.15.81:0/4099805575 wait complete. 2023-10-06T02:51:05.059 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-06T02:51:05.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.181+0000 7f292d348700 1 Processor -- start 2023-10-06T02:51:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.181+0000 7f292d348700 1 -- start start 2023-10-06T02:51:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.182+0000 7f292d348700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2928157fe0 0x7f29280b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.182+0000 7f292d348700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 0x7f29280b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.182+0000 7f292d348700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29280b2890 con 0x7f29281583b0 2023-10-06T02:51:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.182+0000 7f292d348700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29280b4070 con 0x7f2928157fe0 2023-10-06T02:51:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.182+0000 7f292d348700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29280b4350 con 0x7f29280cf240 2023-10-06T02:51:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.182+0000 7f2926ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2928157fe0 0x7f29280b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.182+0000 7f2926ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2928157fe0 0x7f29280b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37690/0 (socket says 172.21.15.81:37690) 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.182+0000 7f2926ffd700 1 -- 172.21.15.81:0/1661992141 learned_addr learned my addr 172.21.15.81:0/1661992141 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f29277fe700 1 --2- 172.21.15.81:0/1661992141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 0x7f29280b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f2926ffd700 1 -- 172.21.15.81:0/1661992141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 msgr2=0x7f29280b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f2926ffd700 1 --2- 172.21.15.81:0/1661992141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 0x7f29280b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f2926ffd700 1 -- 172.21.15.81:0/1661992141 >> v1:172.21.15.83:6789/0 conn(0x7f29281583b0 legacy=0x7f29280ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f2926ffd700 1 -- 172.21.15.81:0/1661992141 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29280b4630 con 0x7f2928157fe0 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f2926ffd700 1 --2- 172.21.15.81:0/1661992141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2928157fe0 0x7f29280b34c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2918009f20 tx=0x7f2918009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738284102d501b5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f2925ffb700 1 -- 172.21.15.81:0/1661992141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291800e070 con 0x7f2928157fe0 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f2925ffb700 1 -- 172.21.15.81:0/1661992141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291800ba40 con 0x7f2928157fe0 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f2925ffb700 1 -- 172.21.15.81:0/1661992141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29180092e0 con 0x7f2928157fe0 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f292d348700 1 -- 172.21.15.81:0/1661992141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2928157fe0 msgr2=0x7f29280b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.183+0000 7f292d348700 1 --2- 172.21.15.81:0/1661992141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2928157fe0 0x7f29280b34c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2918009f20 tx=0x7f2918009840 comp rx=0 tx=0).stop 2023-10-06T02:51:05.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.184+0000 7f292d348700 1 -- 172.21.15.81:0/1661992141 shutdown_connections 2023-10-06T02:51:05.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.184+0000 7f292d348700 1 --2- 172.21.15.81:0/1661992141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 0x7f29280b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.184+0000 7f292d348700 1 --2- 172.21.15.81:0/1661992141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2928157fe0 0x7f29280b34c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.184+0000 7f292d348700 1 -- 172.21.15.81:0/1661992141 >> 172.21.15.81:0/1661992141 conn(0x7f2928067640 msgr2=0x7f2928067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:05.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.184+0000 7f292d348700 1 -- 172.21.15.81:0/1661992141 shutdown_connections 2023-10-06T02:51:05.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.184+0000 7f292d348700 1 -- 172.21.15.81:0/1661992141 wait complete. 2023-10-06T02:51:05.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.185+0000 7f292d348700 1 Processor -- start 2023-10-06T02:51:05.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.185+0000 7f292d348700 1 -- start start 2023-10-06T02:51:05.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.185+0000 7f292d348700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 0x7f292814c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f292d348700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928157fe0 0x7f2928159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f292d348700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29281583b0 0x7f29280b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f292d348700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292815afa0 con 0x7f29281583b0 2023-10-06T02:51:05.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f292d348700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292815a110 con 0x7f2928157fe0 2023-10-06T02:51:05.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f292d348700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292815a390 con 0x7f29280cf240 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29281583b0 0x7f29280b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29281583b0 0x7f29280b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37700/0 (socket says 172.21.15.81:37700) 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29277fe700 1 -- 172.21.15.81:0/4215520530 learned_addr learned my addr 172.21.15.81:0/4215520530 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f2926ffd700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 0x7f292814c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29267fc700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928157fe0 0x7f2928159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29277fe700 1 -- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 msgr2=0x7f292814c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29277fe700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 0x7f292814c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29277fe700 1 -- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928157fe0 msgr2=0x7f2928159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29277fe700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928157fe0 0x7f2928159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29277fe700 1 -- 172.21.15.81:0/4215520530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2918009ae0 con 0x7f29281583b0 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f29277fe700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29281583b0 0x7f29280b0750 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f292000d8c0 tx=0x7f2920008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:05.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f290effd700 1 -- 172.21.15.81:0/4215520530 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920018070 con 0x7f29281583b0 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f290effd700 1 -- 172.21.15.81:0/4215520530 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29200125f0 con 0x7f29281583b0 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292815a670 con 0x7f29281583b0 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f290effd700 1 -- 172.21.15.81:0/4215520530 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920012990 con 0x7f29281583b0 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.186+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292815ac30 con 0x7f29281583b0 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.187+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29280b3ad0 con 0x7f29281583b0 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.188+0000 7f290effd700 1 -- 172.21.15.81:0/4215520530 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2920014430 con 0x7f29281583b0 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.188+0000 7f290effd700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2914066f30 0x7f29140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.188+0000 7f290effd700 1 -- 172.21.15.81:0/4215520530 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2920084720 con 0x7f29281583b0 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.188+0000 7f2926ffd700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2914066f30 0x7f29140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.189+0000 7f2926ffd700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2914066f30 0x7f29140693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2918009ab0 tx=0x7f2918017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:05.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.192+0000 7f290effd700 1 -- 172.21.15.81:0/4215520530 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2920051830 con 0x7f29281583b0 2023-10-06T02:51:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.374+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29280cc6b0 con 0x7f29281583b0 2023-10-06T02:51:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.375+0000 7f290effd700 1 -- 172.21.15.81:0/4215520530 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16824 (secure 0 0 0) 0x7f2920054e50 con 0x7f29281583b0 2023-10-06T02:51:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:05.377 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":101,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:02.654144+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:50:58.681047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T02:50:59.998500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2914066f30 msgr2=0x7f29140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2914066f30 0x7f29140693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2918009ab0 tx=0x7f2918017000 comp rx=0 tx=0).stop 2023-10-06T02:51:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29281583b0 msgr2=0x7f29280b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29281583b0 0x7f29280b0750 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f292000d8c0 tx=0x7f2920008040 comp rx=0 tx=0).stop 2023-10-06T02:51:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 shutdown_connections 2023-10-06T02:51:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29281583b0 0x7f29280b0750 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29280cf240 0x7f292814c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2914066f30 0x7f29140693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 --2- 172.21.15.81:0/4215520530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2928157fe0 0x7f2928159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 >> 172.21.15.81:0/4215520530 conn(0x7f2928067640 msgr2=0x7f2928155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:05.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 shutdown_connections 2023-10-06T02:51:05.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.378+0000 7f292d348700 1 -- 172.21.15.81:0/4215520530 wait complete. 2023-10-06T02:51:05.391 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:51:05.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:51:05.451 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-06T02:51:05.450+0000 7fcbf3254700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:51:05.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.505+0000 7f92294a4700 1 Processor -- start 2023-10-06T02:51:05.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.505+0000 7f92294a4700 1 -- start start 2023-10-06T02:51:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92294a4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f922406d830 0x7f92240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92294a4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92240d07c0 con 0x7f9224157ca0 2023-10-06T02:51:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92294a4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92240cfbb0 con 0x7f92241578d0 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92294a4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92240cfe90 con 0x7f922406d830 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92237fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f922406d830 0x7f92240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92227fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9224157ca0 0x7f922406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52222/0 (socket says 172.21.15.81:52222) 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92227fc700 1 -- 172.21.15.81:0/1651408479 learned_addr learned my addr 172.21.15.81:0/1651408479 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92237fe700 1 -- 172.21.15.81:0/1651408479 >> v1:172.21.15.83:6789/0 conn(0x7f92241578d0 legacy=0x7f922415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92237fe700 1 -- 172.21.15.81:0/1651408479 >> v1:172.21.15.81:6789/0 conn(0x7f9224157ca0 legacy=0x7f922406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92237fe700 1 -- 172.21.15.81:0/1651408479 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92240d0170 con 0x7f922406d830 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f9221ffb700 1 -- 172.21.15.81:0/1651408479 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158781594 0 0) 0x7f92240d07c0 con 0x7f9224157ca0 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f92237fe700 1 --2- 172.21.15.81:0/1651408479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922406d830 0x7f92240cf4f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f92140098e0 tx=0x7f92140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d215a791cf058e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f9221ffb700 1 -- 172.21.15.81:0/1651408479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214009e80 con 0x7f922406d830 2023-10-06T02:51:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f9221ffb700 1 -- 172.21.15.81:0/1651408479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921400b820 con 0x7f922406d830 2023-10-06T02:51:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.506+0000 7f9221ffb700 1 -- 172.21.15.81:0/1651408479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921400bba0 con 0x7f922406d830 2023-10-06T02:51:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.507+0000 7f92294a4700 1 -- 172.21.15.81:0/1651408479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922406d830 msgr2=0x7f92240cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.507+0000 7f92294a4700 1 --2- 172.21.15.81:0/1651408479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922406d830 0x7f92240cf4f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f92140098e0 tx=0x7f92140091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.507+0000 7f92294a4700 1 -- 172.21.15.81:0/1651408479 shutdown_connections 2023-10-06T02:51:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.507+0000 7f92294a4700 1 --2- 172.21.15.81:0/1651408479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922406d830 0x7f92240cf4f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.507+0000 7f92294a4700 1 -- 172.21.15.81:0/1651408479 >> 172.21.15.81:0/1651408479 conn(0x7f922406bb90 msgr2=0x7f922406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:05.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.507+0000 7f92294a4700 1 -- 172.21.15.81:0/1651408479 shutdown_connections 2023-10-06T02:51:05.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.507+0000 7f92294a4700 1 -- 172.21.15.81:0/1651408479 wait complete. 2023-10-06T02:51:05.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.508+0000 7f92294a4700 1 Processor -- start 2023-10-06T02:51:05.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.508+0000 7f92294a4700 1 -- start start 2023-10-06T02:51:05.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92294a4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f922406d830 0x7f92240aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92294a4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92241578d0 0x7f92241591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92294a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9224157ca0 0x7f92241548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92294a4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922416a240 con 0x7f9224157ca0 2023-10-06T02:51:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92294a4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92241596e0 con 0x7f922406d830 2023-10-06T02:51:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92294a4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92240aaf20 con 0x7f92241578d0 2023-10-06T02:51:05.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9224157ca0 0x7f92241548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9224157ca0 0x7f92241548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37706/0 (socket says 172.21.15.81:37706) 2023-10-06T02:51:05.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92237fe700 1 -- 172.21.15.81:0/3730438830 learned_addr learned my addr 172.21.15.81:0/3730438830 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:05.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f9222ffd700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f922406d830 0x7f92240aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92227fc700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92241578d0 0x7f92241591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92237fe700 1 -- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92241578d0 msgr2=0x7f92241591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92237fe700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92241578d0 0x7f92241591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92237fe700 1 -- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f922406d830 msgr2=0x7f92240aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92237fe700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f922406d830 0x7f92240aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92237fe700 1 -- 172.21.15.81:0/3730438830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214009420 con 0x7f9224157ca0 2023-10-06T02:51:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f9222ffd700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f922406d830 0x7f92240aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f92237fe700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9224157ca0 0x7f92241548e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f92140093f0 tx=0x7f9214016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f920affd700 1 -- 172.21.15.81:0/3730438830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921401b450 con 0x7f9224157ca0 2023-10-06T02:51:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.509+0000 7f920affd700 1 -- 172.21.15.81:0/3730438830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9214020070 con 0x7f9224157ca0 2023-10-06T02:51:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.510+0000 7f920affd700 1 -- 172.21.15.81:0/3730438830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921401b820 con 0x7f9224157ca0 2023-10-06T02:51:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.510+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92240ab200 con 0x7f9224157ca0 2023-10-06T02:51:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.510+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92240ab7c0 con 0x7f9224157ca0 2023-10-06T02:51:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.510+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922416a3d0 con 0x7f9224157ca0 2023-10-06T02:51:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.511+0000 7f920affd700 1 -- 172.21.15.81:0/3730438830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9214022030 con 0x7f9224157ca0 2023-10-06T02:51:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.511+0000 7f920affd700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9210066f30 0x7f92100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.511+0000 7f920affd700 1 -- 172.21.15.81:0/3730438830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f92140869f0 con 0x7f9224157ca0 2023-10-06T02:51:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.511+0000 7f9222ffd700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9210066f30 0x7f92100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.512+0000 7f9222ffd700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9210066f30 0x7f92100693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f921c001410 tx=0x7f921c0096a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.515+0000 7f920affd700 1 -- 172.21.15.81:0/3730438830 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f922416a3d0 con 0x7f9224157ca0 2023-10-06T02:51:05.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.695+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f922416a380 con 0x7f9210066f30 2023-10-06T02:51:05.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.705+0000 7f920affd700 1 -- 172.21.15.81:0/3730438830 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302834 (secure 0 0 0) 0x7f922416a380 con 0x7f9210066f30 2023-10-06T02:51:05.710 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.708+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9210066f30 msgr2=0x7f92100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9210066f30 0x7f92100693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f921c001410 tx=0x7f921c0096a0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9224157ca0 msgr2=0x7f92241548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9224157ca0 0x7f92241548e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f92140093f0 tx=0x7f9214016000 comp rx=0 tx=0).stop 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 shutdown_connections 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9224157ca0 0x7f92241548e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9210066f30 0x7f92100693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f922406d830 0x7f92240aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 --2- 172.21.15.81:0/3730438830 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92241578d0 0x7f92241591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 >> 172.21.15.81:0/3730438830 conn(0x7f922406bb90 msgr2=0x7f922406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 shutdown_connections 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.709+0000 7f92294a4700 1 -- 172.21.15.81:0/3730438830 wait complete. 2023-10-06T02:51:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:51:05.722 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-10-06T02:51:05.564344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5556,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556943,"statfs":{"total":1600000000,"available":1594310544,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.924741"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643417+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.457598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645560+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643652+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:44.811795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645573+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646029+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647039+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:22.096231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645884+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:44.963828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.650244+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648134+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645467+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:47.447725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645220+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645626+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:09.179906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.649918+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646354+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646379+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646688+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:12.065393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647128+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:44.674521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643324+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:07.867628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647131+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646152+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646135+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646071+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646783+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:20.118823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642945+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:56.664986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645395+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645758+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645312+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:25.945455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.649612+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648721+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:44.030445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645178+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645819+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646808+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:39.957393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646363+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:38.226167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652649+0000","last_change":"2023-10-06T02:51:00.652649+0000","last_active":"2023-10-06T02:51:00.652649+0000","last_peered":"2023-10-06T02:51:00.652649+0000","last_clean":"2023-10-06T02:51:00.652649+0000","last_became_active":"2023-10-06T02:51:00.652282+0000","last_became_peered":"2023-10-06T02:51:00.652282+0000","last_unstale":"2023-10-06T02:51:00.652649+0000","last_undegraded":"2023-10-06T02:51:00.652649+0000","last_fullsized":"2023-10-06T02:51:00.652649+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645071+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:02:16.943289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.655589+0000","last_change":"2023-10-06T02:51:00.655589+0000","last_active":"2023-10-06T02:51:00.655589+0000","last_peered":"2023-10-06T02:51:00.655589+0000","last_clean":"2023-10-06T02:51:00.655589+0000","last_became_active":"2023-10-06T02:51:00.655326+0000","last_became_peered":"2023-10-06T02:51:00.655326+0000","last_unstale":"2023-10-06T02:51:00.655589+0000","last_undegraded":"2023-10-06T02:51:00.655589+0000","last_fullsized":"2023-10-06T02:51:00.655589+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648297+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:50.512311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650807+0000","last_change":"2023-10-06T02:51:00.650807+0000","last_active":"2023-10-06T02:51:00.650807+0000","last_peered":"2023-10-06T02:51:00.650807+0000","last_clean":"2023-10-06T02:51:00.650807+0000","last_became_active":"2023-10-06T02:51:00.650541+0000","last_became_peered":"2023-10-06T02:51:00.650541+0000","last_unstale":"2023-10-06T02:51:00.650807+0000","last_undegraded":"2023-10-06T02:51:00.650807+0000","last_fullsized":"2023-10-06T02:51:00.650807+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:06.863934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646428+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:42.974701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.655112+0000","last_change":"2023-10-06T02:51:00.655112+0000","last_active":"2023-10-06T02:51:00.655112+0000","last_peered":"2023-10-06T02:51:00.655112+0000","last_clean":"2023-10-06T02:51:00.655112+0000","last_became_active":"2023-10-06T02:51:00.654869+0000","last_became_peered":"2023-10-06T02:51:00.654869+0000","last_unstale":"2023-10-06T02:51:00.655112+0000","last_undegraded":"2023-10-06T02:51:00.655112+0000","last_fullsized":"2023-10-06T02:51:00.655112+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:37.828589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645818+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.648859+0000","last_change":"2023-10-06T02:51:00.648859+0000","last_active":"2023-10-06T02:51:00.648859+0000","last_peered":"2023-10-06T02:51:00.648859+0000","last_clean":"2023-10-06T02:51:00.648859+0000","last_became_active":"2023-10-06T02:51:00.648625+0000","last_became_peered":"2023-10-06T02:51:00.648625+0000","last_unstale":"2023-10-06T02:51:00.648859+0000","last_undegraded":"2023-10-06T02:51:00.648859+0000","last_fullsized":"2023-10-06T02:51:00.648859+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648735+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653298+0000","last_change":"2023-10-06T02:51:00.653298+0000","last_active":"2023-10-06T02:51:00.653298+0000","last_peered":"2023-10-06T02:51:00.653298+0000","last_clean":"2023-10-06T02:51:00.653298+0000","last_became_active":"2023-10-06T02:51:00.652806+0000","last_became_peered":"2023-10-06T02:51:00.652806+0000","last_unstale":"2023-10-06T02:51:00.653298+0000","last_undegraded":"2023-10-06T02:51:00.653298+0000","last_fullsized":"2023-10-06T02:51:00.653298+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646089+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:28.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650485+0000","last_change":"2023-10-06T02:51:00.650485+0000","last_active":"2023-10-06T02:51:00.650485+0000","last_peered":"2023-10-06T02:51:00.650485+0000","last_clean":"2023-10-06T02:51:00.650485+0000","last_became_active":"2023-10-06T02:51:00.650261+0000","last_became_peered":"2023-10-06T02:51:00.650261+0000","last_unstale":"2023-10-06T02:51:00.650485+0000","last_undegraded":"2023-10-06T02:51:00.650485+0000","last_fullsized":"2023-10-06T02:51:00.650485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:01.366512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645862+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654402+0000","last_change":"2023-10-06T02:51:00.654402+0000","last_active":"2023-10-06T02:51:00.654402+0000","last_peered":"2023-10-06T02:51:00.654402+0000","last_clean":"2023-10-06T02:51:00.654402+0000","last_became_active":"2023-10-06T02:51:00.653618+0000","last_became_peered":"2023-10-06T02:51:00.653618+0000","last_unstale":"2023-10-06T02:51:00.654402+0000","last_undegraded":"2023-10-06T02:51:00.654402+0000","last_fullsized":"2023-10-06T02:51:00.654402+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:43.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646792+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651057+0000","last_change":"2023-10-06T02:51:00.651057+0000","last_active":"2023-10-06T02:51:00.651057+0000","last_peered":"2023-10-06T02:51:00.651057+0000","last_clean":"2023-10-06T02:51:00.651057+0000","last_became_active":"2023-10-06T02:51:00.650684+0000","last_became_peered":"2023-10-06T02:51:00.650684+0000","last_unstale":"2023-10-06T02:51:00.651057+0000","last_undegraded":"2023-10-06T02:51:00.651057+0000","last_fullsized":"2023-10-06T02:51:00.651057+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:03.696166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646701+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:12.319008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647297+0000","last_change":"2023-10-06T02:51:00.647297+0000","last_active":"2023-10-06T02:51:00.647297+0000","last_peered":"2023-10-06T02:51:00.647297+0000","last_clean":"2023-10-06T02:51:00.647297+0000","last_became_active":"2023-10-06T02:51:00.646978+0000","last_became_peered":"2023-10-06T02:51:00.646978+0000","last_unstale":"2023-10-06T02:51:00.647297+0000","last_undegraded":"2023-10-06T02:51:00.647297+0000","last_fullsized":"2023-10-06T02:51:00.647297+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:38.756816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642911+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650607+0000","last_change":"2023-10-06T02:51:00.650607+0000","last_active":"2023-10-06T02:51:00.650607+0000","last_peered":"2023-10-06T02:51:00.650607+0000","last_clean":"2023-10-06T02:51:00.650607+0000","last_became_active":"2023-10-06T02:51:00.650350+0000","last_became_peered":"2023-10-06T02:51:00.650350+0000","last_unstale":"2023-10-06T02:51:00.650607+0000","last_undegraded":"2023-10-06T02:51:00.650607+0000","last_fullsized":"2023-10-06T02:51:00.650607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645885+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654538+0000","last_change":"2023-10-06T02:51:00.654538+0000","last_active":"2023-10-06T02:51:00.654538+0000","last_peered":"2023-10-06T02:51:00.654538+0000","last_clean":"2023-10-06T02:51:00.654538+0000","last_became_active":"2023-10-06T02:51:00.654180+0000","last_became_peered":"2023-10-06T02:51:00.654180+0000","last_unstale":"2023-10-06T02:51:00.654538+0000","last_undegraded":"2023-10-06T02:51:00.654538+0000","last_fullsized":"2023-10-06T02:51:00.654538+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:27.687050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647782+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654543+0000","last_change":"2023-10-06T02:51:00.654543+0000","last_active":"2023-10-06T02:51:00.654543+0000","last_peered":"2023-10-06T02:51:00.654543+0000","last_clean":"2023-10-06T02:51:00.654543+0000","last_became_active":"2023-10-06T02:51:00.653929+0000","last_became_peered":"2023-10-06T02:51:00.653929+0000","last_unstale":"2023-10-06T02:51:00.654543+0000","last_undegraded":"2023-10-06T02:51:00.654543+0000","last_fullsized":"2023-10-06T02:51:00.654543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:55.661291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645615+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651432+0000","last_change":"2023-10-06T02:51:00.651432+0000","last_active":"2023-10-06T02:51:00.651432+0000","last_peered":"2023-10-06T02:51:00.651432+0000","last_clean":"2023-10-06T02:51:00.651432+0000","last_became_active":"2023-10-06T02:51:00.650760+0000","last_became_peered":"2023-10-06T02:51:00.650760+0000","last_unstale":"2023-10-06T02:51:00.651432+0000","last_undegraded":"2023-10-06T02:51:00.651432+0000","last_fullsized":"2023-10-06T02:51:00.651432+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:01.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646945+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:25.683904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654687+0000","last_change":"2023-10-06T02:51:00.654687+0000","last_active":"2023-10-06T02:51:00.654687+0000","last_peered":"2023-10-06T02:51:00.654687+0000","last_clean":"2023-10-06T02:51:00.654687+0000","last_became_active":"2023-10-06T02:51:00.654476+0000","last_became_peered":"2023-10-06T02:51:00.654476+0000","last_unstale":"2023-10-06T02:51:00.654687+0000","last_undegraded":"2023-10-06T02:51:00.654687+0000","last_fullsized":"2023-10-06T02:51:00.654687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645017+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:53.419446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653428+0000","last_change":"2023-10-06T02:51:00.653428+0000","last_active":"2023-10-06T02:51:00.653428+0000","last_peered":"2023-10-06T02:51:00.653428+0000","last_clean":"2023-10-06T02:51:00.653428+0000","last_became_active":"2023-10-06T02:51:00.653084+0000","last_became_peered":"2023-10-06T02:51:00.653084+0000","last_unstale":"2023-10-06T02:51:00.653428+0000","last_undegraded":"2023-10-06T02:51:00.653428+0000","last_fullsized":"2023-10-06T02:51:00.653428+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647601+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652974+0000","last_change":"2023-10-06T02:51:00.652974+0000","last_active":"2023-10-06T02:51:00.652974+0000","last_peered":"2023-10-06T02:51:00.652974+0000","last_clean":"2023-10-06T02:51:00.652974+0000","last_became_active":"2023-10-06T02:51:00.652757+0000","last_became_peered":"2023-10-06T02:51:00.652757+0000","last_unstale":"2023-10-06T02:51:00.652974+0000","last_undegraded":"2023-10-06T02:51:00.652974+0000","last_fullsized":"2023-10-06T02:51:00.652974+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:25.453904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646303+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:21.195790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.646008+0000","last_change":"2023-10-06T02:51:00.646008+0000","last_active":"2023-10-06T02:51:00.646008+0000","last_peered":"2023-10-06T02:51:00.646008+0000","last_clean":"2023-10-06T02:51:00.646008+0000","last_became_active":"2023-10-06T02:51:00.645802+0000","last_became_peered":"2023-10-06T02:51:00.645802+0000","last_unstale":"2023-10-06T02:51:00.646008+0000","last_undegraded":"2023-10-06T02:51:00.646008+0000","last_fullsized":"2023-10-06T02:51:00.646008+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:36.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645358+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:05.854516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654291+0000","last_change":"2023-10-06T02:51:00.654291+0000","last_active":"2023-10-06T02:51:00.654291+0000","last_peered":"2023-10-06T02:51:00.654291+0000","last_clean":"2023-10-06T02:51:00.654291+0000","last_became_active":"2023-10-06T02:51:00.653786+0000","last_became_peered":"2023-10-06T02:51:00.653786+0000","last_unstale":"2023-10-06T02:51:00.654291+0000","last_undegraded":"2023-10-06T02:51:00.654291+0000","last_fullsized":"2023-10-06T02:51:00.654291+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644507+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653380+0000","last_change":"2023-10-06T02:51:00.653380+0000","last_active":"2023-10-06T02:51:00.653380+0000","last_peered":"2023-10-06T02:51:00.653380+0000","last_clean":"2023-10-06T02:51:00.653380+0000","last_became_active":"2023-10-06T02:51:00.652913+0000","last_became_peered":"2023-10-06T02:51:00.652913+0000","last_unstale":"2023-10-06T02:51:00.653380+0000","last_undegraded":"2023-10-06T02:51:00.653380+0000","last_fullsized":"2023-10-06T02:51:00.653380+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645022+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:21.511509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654738+0000","last_change":"2023-10-06T02:51:00.654738+0000","last_active":"2023-10-06T02:51:00.654738+0000","last_peered":"2023-10-06T02:51:00.654738+0000","last_clean":"2023-10-06T02:51:00.654738+0000","last_became_active":"2023-10-06T02:51:00.654487+0000","last_became_peered":"2023-10-06T02:51:00.654487+0000","last_unstale":"2023-10-06T02:51:00.654738+0000","last_undegraded":"2023-10-06T02:51:00.654738+0000","last_fullsized":"2023-10-06T02:51:00.654738+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:43.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642914+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:39.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647402+0000","last_change":"2023-10-06T02:51:00.647402+0000","last_active":"2023-10-06T02:51:00.647402+0000","last_peered":"2023-10-06T02:51:00.647402+0000","last_clean":"2023-10-06T02:51:00.647402+0000","last_became_active":"2023-10-06T02:51:00.646818+0000","last_became_peered":"2023-10-06T02:51:00.646818+0000","last_unstale":"2023-10-06T02:51:00.647402+0000","last_undegraded":"2023-10-06T02:51:00.647402+0000","last_fullsized":"2023-10-06T02:51:00.647402+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:31.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647716+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652500+0000","last_change":"2023-10-06T02:51:00.652500+0000","last_active":"2023-10-06T02:51:00.652500+0000","last_peered":"2023-10-06T02:51:00.652500+0000","last_clean":"2023-10-06T02:51:00.652500+0000","last_became_active":"2023-10-06T02:51:00.651985+0000","last_became_peered":"2023-10-06T02:51:00.651985+0000","last_unstale":"2023-10-06T02:51:00.652500+0000","last_undegraded":"2023-10-06T02:51:00.652500+0000","last_fullsized":"2023-10-06T02:51:00.652500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645676+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:40.127983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652502+0000","last_change":"2023-10-06T02:51:00.652502+0000","last_active":"2023-10-06T02:51:00.652502+0000","last_peered":"2023-10-06T02:51:00.652502+0000","last_clean":"2023-10-06T02:51:00.652502+0000","last_became_active":"2023-10-06T02:51:00.652287+0000","last_became_peered":"2023-10-06T02:51:00.652287+0000","last_unstale":"2023-10-06T02:51:00.652502+0000","last_undegraded":"2023-10-06T02:51:00.652502+0000","last_fullsized":"2023-10-06T02:51:00.652502+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:38.913069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646009+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:45.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.649652+0000","last_change":"2023-10-06T02:51:00.649652+0000","last_active":"2023-10-06T02:51:00.649652+0000","last_peered":"2023-10-06T02:51:00.649652+0000","last_clean":"2023-10-06T02:51:00.649652+0000","last_became_active":"2023-10-06T02:51:00.649414+0000","last_became_peered":"2023-10-06T02:51:00.649414+0000","last_unstale":"2023-10-06T02:51:00.649652+0000","last_undegraded":"2023-10-06T02:51:00.649652+0000","last_fullsized":"2023-10-06T02:51:00.649652+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:10.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643973+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:50:59.643973+0000","last_peered":"2023-10-06T02:50:59.643973+0000","last_clean":"2023-10-06T02:50:59.643973+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:50:59.643973+0000","last_undegraded":"2023-10-06T02:50:59.643973+0000","last_fullsized":"2023-10-06T02:50:59.643973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644444+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652167+0000","last_change":"2023-10-06T02:51:00.652167+0000","last_active":"2023-10-06T02:51:00.652167+0000","last_peered":"2023-10-06T02:51:00.652167+0000","last_clean":"2023-10-06T02:51:00.652167+0000","last_became_active":"2023-10-06T02:51:00.651572+0000","last_became_peered":"2023-10-06T02:51:00.651572+0000","last_unstale":"2023-10-06T02:51:00.652167+0000","last_undegraded":"2023-10-06T02:51:00.652167+0000","last_fullsized":"2023-10-06T02:51:00.652167+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641162+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:50:59.641162+0000","last_peered":"2023-10-06T02:50:59.641162+0000","last_clean":"2023-10-06T02:50:59.641162+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:50:59.641162+0000","last_undegraded":"2023-10-06T02:50:59.641162+0000","last_fullsized":"2023-10-06T02:50:59.641162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647253+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654701+0000","last_change":"2023-10-06T02:51:00.654701+0000","last_active":"2023-10-06T02:51:00.654701+0000","last_peered":"2023-10-06T02:51:00.654701+0000","last_clean":"2023-10-06T02:51:00.654701+0000","last_became_active":"2023-10-06T02:51:00.654174+0000","last_became_peered":"2023-10-06T02:51:00.654174+0000","last_unstale":"2023-10-06T02:51:00.654701+0000","last_undegraded":"2023-10-06T02:51:00.654701+0000","last_fullsized":"2023-10-06T02:51:00.654701+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:22.851612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641963+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:50:59.641963+0000","last_peered":"2023-10-06T02:50:59.641963+0000","last_clean":"2023-10-06T02:50:59.641963+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:50:59.641963+0000","last_undegraded":"2023-10-06T02:50:59.641963+0000","last_fullsized":"2023-10-06T02:50:59.641963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647542+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:02.670341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651643+0000","last_change":"2023-10-06T02:51:00.651643+0000","last_active":"2023-10-06T02:51:00.651643+0000","last_peered":"2023-10-06T02:51:00.651643+0000","last_clean":"2023-10-06T02:51:00.651643+0000","last_became_active":"2023-10-06T02:51:00.651163+0000","last_became_peered":"2023-10-06T02:51:00.651163+0000","last_unstale":"2023-10-06T02:51:00.651643+0000","last_undegraded":"2023-10-06T02:51:00.651643+0000","last_fullsized":"2023-10-06T02:51:00.651643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641285+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:50:59.641285+0000","last_peered":"2023-10-06T02:50:59.641285+0000","last_clean":"2023-10-06T02:50:59.641285+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:50:59.641285+0000","last_undegraded":"2023-10-06T02:50:59.641285+0000","last_fullsized":"2023-10-06T02:50:59.641285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":232,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643465+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:50:59.643465+0000","last_peered":"2023-10-06T02:50:59.643465+0000","last_clean":"2023-10-06T02:50:59.643465+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:50:59.643465+0000","last_undegraded":"2023-10-06T02:50:59.643465+0000","last_fullsized":"2023-10-06T02:50:59.643465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645438+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:12.718116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653681+0000","last_change":"2023-10-06T02:51:00.653681+0000","last_active":"2023-10-06T02:51:00.653681+0000","last_peered":"2023-10-06T02:51:00.653681+0000","last_clean":"2023-10-06T02:51:00.653681+0000","last_became_active":"2023-10-06T02:51:00.653235+0000","last_became_peered":"2023-10-06T02:51:00.653235+0000","last_unstale":"2023-10-06T02:51:00.653681+0000","last_undegraded":"2023-10-06T02:51:00.653681+0000","last_fullsized":"2023-10-06T02:51:00.653681+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643369+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:50:59.643369+0000","last_peered":"2023-10-06T02:50:59.643369+0000","last_clean":"2023-10-06T02:50:59.643369+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:50:59.643369+0000","last_undegraded":"2023-10-06T02:50:59.643369+0000","last_fullsized":"2023-10-06T02:50:59.643369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644923+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.644728+0000","last_change":"2023-10-06T02:51:00.644728+0000","last_active":"2023-10-06T02:51:00.644728+0000","last_peered":"2023-10-06T02:51:00.644728+0000","last_clean":"2023-10-06T02:51:00.644728+0000","last_became_active":"2023-10-06T02:51:00.644509+0000","last_became_peered":"2023-10-06T02:51:00.644509+0000","last_unstale":"2023-10-06T02:51:00.644728+0000","last_undegraded":"2023-10-06T02:51:00.644728+0000","last_fullsized":"2023-10-06T02:51:00.644728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:33.751928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643554+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:50:59.643554+0000","last_peered":"2023-10-06T02:50:59.643554+0000","last_clean":"2023-10-06T02:50:59.643554+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:50:59.643554+0000","last_undegraded":"2023-10-06T02:50:59.643554+0000","last_fullsized":"2023-10-06T02:50:59.643554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644390+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651716+0000","last_change":"2023-10-06T02:51:00.651716+0000","last_active":"2023-10-06T02:51:00.651716+0000","last_peered":"2023-10-06T02:51:00.651716+0000","last_clean":"2023-10-06T02:51:00.651716+0000","last_became_active":"2023-10-06T02:51:00.651468+0000","last_became_peered":"2023-10-06T02:51:00.651468+0000","last_unstale":"2023-10-06T02:51:00.651716+0000","last_undegraded":"2023-10-06T02:51:00.651716+0000","last_fullsized":"2023-10-06T02:51:00.651716+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:48.405419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.644380+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:50:59.644380+0000","last_peered":"2023-10-06T02:50:59.644380+0000","last_clean":"2023-10-06T02:50:59.644380+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:50:59.644380+0000","last_undegraded":"2023-10-06T02:50:59.644380+0000","last_fullsized":"2023-10-06T02:50:59.644380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645711+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:17.134930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647127+0000","last_change":"2023-10-06T02:51:00.647127+0000","last_active":"2023-10-06T02:51:00.647127+0000","last_peered":"2023-10-06T02:51:00.647127+0000","last_clean":"2023-10-06T02:51:00.647127+0000","last_became_active":"2023-10-06T02:51:00.646586+0000","last_became_peered":"2023-10-06T02:51:00.646586+0000","last_unstale":"2023-10-06T02:51:00.647127+0000","last_undegraded":"2023-10-06T02:51:00.647127+0000","last_fullsized":"2023-10-06T02:51:00.647127+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:08.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.644712+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:50:59.644712+0000","last_peered":"2023-10-06T02:50:59.644712+0000","last_clean":"2023-10-06T02:50:59.644712+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:50:59.644712+0000","last_undegraded":"2023-10-06T02:50:59.644712+0000","last_fullsized":"2023-10-06T02:50:59.644712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198846042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":1.393,"15min":1.393},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67400000000000004,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.504}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":1.081,"15min":1.081},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.70999999999999996,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48099999999999998},"min":{"1min":0.46200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70099999999999996,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.63200000000000001},"min":{"1min":0.41799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70499999999999996,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61899999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68300000000000005,"5min":0.879,"15min":0.879},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68700000000000006,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69499999999999995,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":1.879,"15min":1.879},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67400000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.78300000000000003,"15min":1.028},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68700000000000006,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67400000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67900000000000005,"5min":1.163,"15min":1.163},"last":0.626}]},{"osd":4,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":1.05,"15min":1.05},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.753},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.61899999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72799999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.63},"min":{"1min":0.39200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.60599999999999998},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.31,"15min":0.312},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.247},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.26900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34200000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38900000000000001,"15min":0.38},"min":{"1min":0.313,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.374},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.36599999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69399999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46700000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77800000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.47399999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.443,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.47799999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198846042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34999999999999998},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47999999999999998,"5min":1.177,"15min":1.177},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38800000000000001,"15min":0.39800000000000002},"min":{"1min":0.23499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65100000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.75800000000000001,"15min":1.181},"min":{"1min":0.216,"5min":0.188,"15min":0.188},"max":{"1min":0.56000000000000005,"5min":22.038,"15min":22.038},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.26200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.60399999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.311},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.79600000000000004,"15min":1.2110000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.63300000000000001,"5min":21.942,"15min":21.942},"last":0.503}]},{"osd":4,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.91000000000000003,"15min":1.264},"min":{"1min":0.46400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86499999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.96899999999999997,"15min":1.367},"min":{"1min":0.46300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.441},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.47699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":1.401,"15min":1.401},"last":0.47199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.93899999999999995,"15min":1.294},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.98999999999999999,"15min":1.3939999999999999},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80900000000000005,"5min":21.98,"15min":21.98},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.88800000000000001,"5min":1.425,"15min":1.425},"last":0.753},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.78300000000000003,"15min":0.96599999999999997},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81899999999999995,"5min":11.154,"15min":11.154},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52900000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.20999999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.51500000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.498}]},{"osd":1,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"min":{"1min":0.25700000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.63,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.439},{"interface":"front","average":{"1min":0.433,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80000000000000004,"5min":0.875,"15min":0.875},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59399999999999997,"15min":0.57799999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79500000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57699999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.626},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.70199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.22700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.32300000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.371}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.309},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27900000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39200000000000002,"15min":0.36799999999999999},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.64800000000000002,"5min":3.044,"15min":3.044},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35599999999999998,"15min":0.33900000000000002},"min":{"1min":0.29899999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74099999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72999999999999998,"5min":2.25,"15min":2.25},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.70399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83599999999999997,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.80500000000000005,"15min":1.0049999999999999},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84199999999999997,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.66900000000000004,"15min":0.83699999999999997},"min":{"1min":0.33600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71699999999999997,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.56899999999999995,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.61599999999999999,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.69399999999999995,"15min":0.87},"min":{"1min":0.41399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70599999999999996,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.66600000000000004,"15min":0.81599999999999995},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.66800000000000004,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.376}]},{"osd":2,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.504},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61799999999999999,"15min":0.69799999999999995},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66100000000000003,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55300000000000005,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64700000000000002,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.626},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73799999999999999,"5min":3.456,"15min":3.456},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.49399999999999999},"min":{"1min":0.27500000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.499,"15min":0.51200000000000001},"min":{"1min":0.32900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.624}]},{"osd":6,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64200000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.83499999999999996,"15min":1.087},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73099999999999998,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.315,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.755,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.38500000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45700000000000002,"15min":0.45000000000000001},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.73699999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.879,"15min":0.879},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59399999999999997}]}]}],"pool_statfs":[]}} 2023-10-06T02:51:05.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:51:05.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.875+0000 7f1f74364700 1 Processor -- start 2023-10-06T02:51:05.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.875+0000 7f1f74364700 1 -- start start 2023-10-06T02:51:05.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.876+0000 7f1f74364700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f6c1569e0 0x7f1f6c0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.876+0000 7f1f74364700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c06e940 0x7f1f6c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.876+0000 7f1f74364700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6c0b2290 con 0x7f1f6c156db0 2023-10-06T02:51:05.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.876+0000 7f1f74364700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6c157c00 con 0x7f1f6c1569e0 2023-10-06T02:51:05.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.876+0000 7f1f74364700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c1572d0 con 0x7f1f6c06e940 2023-10-06T02:51:05.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.876+0000 7f1f72100700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f6c1569e0 0x7f1f6c0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72901700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c06e940 0x7f1f6c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72100700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f6c1569e0 0x7f1f6c0b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:46634/0 (socket says 172.21.15.81:46634) 2023-10-06T02:51:05.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72901700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c06e940 0x7f1f6c0cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:41716/0 (socket says 172.21.15.81:41716) 2023-10-06T02:51:05.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72100700 1 -- 172.21.15.81:0/3662173583 learned_addr learned my addr 172.21.15.81:0/3662173583 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f718ff700 1 --1- 172.21.15.81:0/3662173583 >> v1:172.21.15.83:6789/0 conn(0x7f1f6c156db0 0x7f1f6c06e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:38198/0 (socket says 172.21.15.81:38198) 2023-10-06T02:51:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72901700 1 -- 172.21.15.81:0/3662173583 >> v2:172.21.15.83:3300/0 conn(0x7f1f6c1569e0 msgr2=0x7f1f6c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72901700 1 --2- 172.21.15.81:0/3662173583 >> v2:172.21.15.83:3300/0 conn(0x7f1f6c1569e0 0x7f1f6c0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72901700 1 -- 172.21.15.81:0/3662173583 >> v1:172.21.15.83:6789/0 conn(0x7f1f6c156db0 legacy=0x7f1f6c06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72901700 1 -- 172.21.15.81:0/3662173583 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c1575b0 con 0x7f1f6c06e940 2023-10-06T02:51:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f710fe700 1 -- 172.21.15.81:0/3662173583 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256691155 0 0) 0x7f1f6c0b2290 con 0x7f1f6c156db0 2023-10-06T02:51:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72100700 1 --2- 172.21.15.81:0/3662173583 >> v2:172.21.15.83:3300/0 conn(0x7f1f6c1569e0 0x7f1f6c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f72901700 1 --2- 172.21.15.81:0/3662173583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c06e940 0x7f1f6c0cd920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400bb90 tx=0x7f1f6400b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894b66bac55f79c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f710fe700 1 -- 172.21.15.81:0/3662173583 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400db40 con 0x7f1f6c06e940 2023-10-06T02:51:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f710fe700 1 -- 172.21.15.81:0/3662173583 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6400dca0 con 0x7f1f6c06e940 2023-10-06T02:51:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.877+0000 7f1f710fe700 1 -- 172.21.15.81:0/3662173583 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f640196b0 con 0x7f1f6c06e940 2023-10-06T02:51:05.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.878+0000 7f1f74364700 1 -- 172.21.15.81:0/3662173583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c06e940 msgr2=0x7f1f6c0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.878+0000 7f1f74364700 1 --2- 172.21.15.81:0/3662173583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c06e940 0x7f1f6c0cd920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400bb90 tx=0x7f1f6400b430 comp rx=0 tx=0).stop 2023-10-06T02:51:05.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.878+0000 7f1f74364700 1 -- 172.21.15.81:0/3662173583 shutdown_connections 2023-10-06T02:51:05.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.878+0000 7f1f74364700 1 --2- 172.21.15.81:0/3662173583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c06e940 0x7f1f6c0cd920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.878+0000 7f1f74364700 1 --2- 172.21.15.81:0/3662173583 >> v2:172.21.15.83:3300/0 conn(0x7f1f6c1569e0 0x7f1f6c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.878+0000 7f1f74364700 1 -- 172.21.15.81:0/3662173583 >> 172.21.15.81:0/3662173583 conn(0x7f1f6c06cca0 msgr2=0x7f1f6c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:05.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.878+0000 7f1f74364700 1 -- 172.21.15.81:0/3662173583 shutdown_connections 2023-10-06T02:51:05.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.878+0000 7f1f74364700 1 -- 172.21.15.81:0/3662173583 wait complete. 2023-10-06T02:51:05.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.879+0000 7f1f74364700 1 Processor -- start 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.879+0000 7f1f74364700 1 -- start start 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f74364700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f6c06e940 0x7f1f6c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f74364700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c1569e0 0x7f1f6c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f74364700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c156db0 0x7f1f6c152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f74364700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c158d90 con 0x7f1f6c1569e0 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f74364700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c1581c0 con 0x7f1f6c06e940 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f74364700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c158460 con 0x7f1f6c156db0 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f718ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c1569e0 0x7f1f6c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f718ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c1569e0 0x7f1f6c15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37718/0 (socket says 172.21.15.81:37718) 2023-10-06T02:51:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f718ff700 1 -- 172.21.15.81:0/3924777629 learned_addr learned my addr 172.21.15.81:0/3924777629 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f72901700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c156db0 0x7f1f6c152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f72100700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f6c06e940 0x7f1f6c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f718ff700 1 -- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c156db0 msgr2=0x7f1f6c152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f718ff700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c156db0 0x7f1f6c152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f718ff700 1 -- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f6c06e940 msgr2=0x7f1f6c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f718ff700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f6c06e940 0x7f1f6c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f718ff700 1 -- 172.21.15.81:0/3924777629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c009ae0 con 0x7f1f6c1569e0 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f718ff700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c1569e0 0x7f1f6c15a540 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000c510 tx=0x7f1f6000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f6a7fc700 1 -- 172.21.15.81:0/3924777629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f60005a70 con 0x7f1f6c1569e0 2023-10-06T02:51:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f6a7fc700 1 -- 172.21.15.81:0/3924777629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f60005bf0 con 0x7f1f6c1569e0 2023-10-06T02:51:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6400b6d0 con 0x7f1f6c1569e0 2023-10-06T02:51:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.880+0000 7f1f6a7fc700 1 -- 172.21.15.81:0/3924777629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f600070d0 con 0x7f1f6c1569e0 2023-10-06T02:51:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.881+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c158a20 con 0x7f1f6c1569e0 2023-10-06T02:51:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.881+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c159120 con 0x7f1f6c1569e0 2023-10-06T02:51:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.882+0000 7f1f6a7fc700 1 -- 172.21.15.81:0/3924777629 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f60007480 con 0x7f1f6c1569e0 2023-10-06T02:51:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.882+0000 7f1f6a7fc700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f58066fb0 0x7f1f58069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.882+0000 7f1f6a7fc700 1 -- 172.21.15.81:0/3924777629 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f60083b50 con 0x7f1f6c1569e0 2023-10-06T02:51:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.882+0000 7f1f72100700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f58066fb0 0x7f1f58069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.883+0000 7f1f72100700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f58066fb0 0x7f1f58069460 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0072d0 tx=0x7f1f5c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:05.886+0000 7f1f6a7fc700 1 -- 172.21.15.81:0/3924777629 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f60050bc0 con 0x7f1f6c1569e0 2023-10-06T02:51:06.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.064+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f6c158be0 con 0x7f1f58066fb0 2023-10-06T02:51:06.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.072+0000 7f1f6a7fc700 1 -- 172.21.15.81:0/3924777629 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302834 (secure 0 0 0) 0x7f1f6c158be0 con 0x7f1f58066fb0 2023-10-06T02:51:06.077 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f58066fb0 msgr2=0x7f1f58069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f58066fb0 0x7f1f58069460 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0072d0 tx=0x7f1f5c00b040 comp rx=0 tx=0).stop 2023-10-06T02:51:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c1569e0 msgr2=0x7f1f6c15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c1569e0 0x7f1f6c15a540 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000c510 tx=0x7f1f6000c820 comp rx=0 tx=0).stop 2023-10-06T02:51:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 shutdown_connections 2023-10-06T02:51:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f6c156db0 0x7f1f6c152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1f58066fb0 0x7f1f58069460 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f6c06e940 0x7f1f6c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 --2- 172.21.15.81:0/3924777629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c1569e0 0x7f1f6c15a540 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 >> 172.21.15.81:0/3924777629 conn(0x7f1f6c06cca0 msgr2=0x7f1f6c0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:06.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 shutdown_connections 2023-10-06T02:51:06.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.076+0000 7f1f74364700 1 -- 172.21.15.81:0/3924777629 wait complete. 2023-10-06T02:51:06.081 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:51:06.089 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-10-06T02:51:05.564344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5556,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556943,"statfs":{"total":1600000000,"available":1594310544,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.924741"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643417+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.457598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645560+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643652+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:44.811795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645573+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646029+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647039+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:22.096231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645884+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:44.963828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.650244+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648134+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645467+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:47.447725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645220+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645626+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:09.179906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.649918+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646354+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646379+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646688+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:12.065393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647128+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:44.674521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643324+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:07.867628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647131+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646152+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646135+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646071+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646783+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:20.118823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642945+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:56.664986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645395+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645758+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645312+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:25.945455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.649612+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648721+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:44.030445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645178+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645819+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646808+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:39.957393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646363+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:38.226167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652649+0000","last_change":"2023-10-06T02:51:00.652649+0000","last_active":"2023-10-06T02:51:00.652649+0000","last_peered":"2023-10-06T02:51:00.652649+0000","last_clean":"2023-10-06T02:51:00.652649+0000","last_became_active":"2023-10-06T02:51:00.652282+0000","last_became_peered":"2023-10-06T02:51:00.652282+0000","last_unstale":"2023-10-06T02:51:00.652649+0000","last_undegraded":"2023-10-06T02:51:00.652649+0000","last_fullsized":"2023-10-06T02:51:00.652649+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645071+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:02:16.943289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.655589+0000","last_change":"2023-10-06T02:51:00.655589+0000","last_active":"2023-10-06T02:51:00.655589+0000","last_peered":"2023-10-06T02:51:00.655589+0000","last_clean":"2023-10-06T02:51:00.655589+0000","last_became_active":"2023-10-06T02:51:00.655326+0000","last_became_peered":"2023-10-06T02:51:00.655326+0000","last_unstale":"2023-10-06T02:51:00.655589+0000","last_undegraded":"2023-10-06T02:51:00.655589+0000","last_fullsized":"2023-10-06T02:51:00.655589+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648297+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:50.512311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650807+0000","last_change":"2023-10-06T02:51:00.650807+0000","last_active":"2023-10-06T02:51:00.650807+0000","last_peered":"2023-10-06T02:51:00.650807+0000","last_clean":"2023-10-06T02:51:00.650807+0000","last_became_active":"2023-10-06T02:51:00.650541+0000","last_became_peered":"2023-10-06T02:51:00.650541+0000","last_unstale":"2023-10-06T02:51:00.650807+0000","last_undegraded":"2023-10-06T02:51:00.650807+0000","last_fullsized":"2023-10-06T02:51:00.650807+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:06.863934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646428+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:42.974701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.655112+0000","last_change":"2023-10-06T02:51:00.655112+0000","last_active":"2023-10-06T02:51:00.655112+0000","last_peered":"2023-10-06T02:51:00.655112+0000","last_clean":"2023-10-06T02:51:00.655112+0000","last_became_active":"2023-10-06T02:51:00.654869+0000","last_became_peered":"2023-10-06T02:51:00.654869+0000","last_unstale":"2023-10-06T02:51:00.655112+0000","last_undegraded":"2023-10-06T02:51:00.655112+0000","last_fullsized":"2023-10-06T02:51:00.655112+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:37.828589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645818+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.648859+0000","last_change":"2023-10-06T02:51:00.648859+0000","last_active":"2023-10-06T02:51:00.648859+0000","last_peered":"2023-10-06T02:51:00.648859+0000","last_clean":"2023-10-06T02:51:00.648859+0000","last_became_active":"2023-10-06T02:51:00.648625+0000","last_became_peered":"2023-10-06T02:51:00.648625+0000","last_unstale":"2023-10-06T02:51:00.648859+0000","last_undegraded":"2023-10-06T02:51:00.648859+0000","last_fullsized":"2023-10-06T02:51:00.648859+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648735+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653298+0000","last_change":"2023-10-06T02:51:00.653298+0000","last_active":"2023-10-06T02:51:00.653298+0000","last_peered":"2023-10-06T02:51:00.653298+0000","last_clean":"2023-10-06T02:51:00.653298+0000","last_became_active":"2023-10-06T02:51:00.652806+0000","last_became_peered":"2023-10-06T02:51:00.652806+0000","last_unstale":"2023-10-06T02:51:00.653298+0000","last_undegraded":"2023-10-06T02:51:00.653298+0000","last_fullsized":"2023-10-06T02:51:00.653298+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646089+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:28.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650485+0000","last_change":"2023-10-06T02:51:00.650485+0000","last_active":"2023-10-06T02:51:00.650485+0000","last_peered":"2023-10-06T02:51:00.650485+0000","last_clean":"2023-10-06T02:51:00.650485+0000","last_became_active":"2023-10-06T02:51:00.650261+0000","last_became_peered":"2023-10-06T02:51:00.650261+0000","last_unstale":"2023-10-06T02:51:00.650485+0000","last_undegraded":"2023-10-06T02:51:00.650485+0000","last_fullsized":"2023-10-06T02:51:00.650485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:01.366512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645862+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654402+0000","last_change":"2023-10-06T02:51:00.654402+0000","last_active":"2023-10-06T02:51:00.654402+0000","last_peered":"2023-10-06T02:51:00.654402+0000","last_clean":"2023-10-06T02:51:00.654402+0000","last_became_active":"2023-10-06T02:51:00.653618+0000","last_became_peered":"2023-10-06T02:51:00.653618+0000","last_unstale":"2023-10-06T02:51:00.654402+0000","last_undegraded":"2023-10-06T02:51:00.654402+0000","last_fullsized":"2023-10-06T02:51:00.654402+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:43.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646792+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651057+0000","last_change":"2023-10-06T02:51:00.651057+0000","last_active":"2023-10-06T02:51:00.651057+0000","last_peered":"2023-10-06T02:51:00.651057+0000","last_clean":"2023-10-06T02:51:00.651057+0000","last_became_active":"2023-10-06T02:51:00.650684+0000","last_became_peered":"2023-10-06T02:51:00.650684+0000","last_unstale":"2023-10-06T02:51:00.651057+0000","last_undegraded":"2023-10-06T02:51:00.651057+0000","last_fullsized":"2023-10-06T02:51:00.651057+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:03.696166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646701+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:12.319008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647297+0000","last_change":"2023-10-06T02:51:00.647297+0000","last_active":"2023-10-06T02:51:00.647297+0000","last_peered":"2023-10-06T02:51:00.647297+0000","last_clean":"2023-10-06T02:51:00.647297+0000","last_became_active":"2023-10-06T02:51:00.646978+0000","last_became_peered":"2023-10-06T02:51:00.646978+0000","last_unstale":"2023-10-06T02:51:00.647297+0000","last_undegraded":"2023-10-06T02:51:00.647297+0000","last_fullsized":"2023-10-06T02:51:00.647297+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:38.756816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642911+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650607+0000","last_change":"2023-10-06T02:51:00.650607+0000","last_active":"2023-10-06T02:51:00.650607+0000","last_peered":"2023-10-06T02:51:00.650607+0000","last_clean":"2023-10-06T02:51:00.650607+0000","last_became_active":"2023-10-06T02:51:00.650350+0000","last_became_peered":"2023-10-06T02:51:00.650350+0000","last_unstale":"2023-10-06T02:51:00.650607+0000","last_undegraded":"2023-10-06T02:51:00.650607+0000","last_fullsized":"2023-10-06T02:51:00.650607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645885+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654538+0000","last_change":"2023-10-06T02:51:00.654538+0000","last_active":"2023-10-06T02:51:00.654538+0000","last_peered":"2023-10-06T02:51:00.654538+0000","last_clean":"2023-10-06T02:51:00.654538+0000","last_became_active":"2023-10-06T02:51:00.654180+0000","last_became_peered":"2023-10-06T02:51:00.654180+0000","last_unstale":"2023-10-06T02:51:00.654538+0000","last_undegraded":"2023-10-06T02:51:00.654538+0000","last_fullsized":"2023-10-06T02:51:00.654538+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:27.687050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647782+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654543+0000","last_change":"2023-10-06T02:51:00.654543+0000","last_active":"2023-10-06T02:51:00.654543+0000","last_peered":"2023-10-06T02:51:00.654543+0000","last_clean":"2023-10-06T02:51:00.654543+0000","last_became_active":"2023-10-06T02:51:00.653929+0000","last_became_peered":"2023-10-06T02:51:00.653929+0000","last_unstale":"2023-10-06T02:51:00.654543+0000","last_undegraded":"2023-10-06T02:51:00.654543+0000","last_fullsized":"2023-10-06T02:51:00.654543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:55.661291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645615+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651432+0000","last_change":"2023-10-06T02:51:00.651432+0000","last_active":"2023-10-06T02:51:00.651432+0000","last_peered":"2023-10-06T02:51:00.651432+0000","last_clean":"2023-10-06T02:51:00.651432+0000","last_became_active":"2023-10-06T02:51:00.650760+0000","last_became_peered":"2023-10-06T02:51:00.650760+0000","last_unstale":"2023-10-06T02:51:00.651432+0000","last_undegraded":"2023-10-06T02:51:00.651432+0000","last_fullsized":"2023-10-06T02:51:00.651432+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:01.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646945+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:25.683904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654687+0000","last_change":"2023-10-06T02:51:00.654687+0000","last_active":"2023-10-06T02:51:00.654687+0000","last_peered":"2023-10-06T02:51:00.654687+0000","last_clean":"2023-10-06T02:51:00.654687+0000","last_became_active":"2023-10-06T02:51:00.654476+0000","last_became_peered":"2023-10-06T02:51:00.654476+0000","last_unstale":"2023-10-06T02:51:00.654687+0000","last_undegraded":"2023-10-06T02:51:00.654687+0000","last_fullsized":"2023-10-06T02:51:00.654687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645017+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:53.419446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653428+0000","last_change":"2023-10-06T02:51:00.653428+0000","last_active":"2023-10-06T02:51:00.653428+0000","last_peered":"2023-10-06T02:51:00.653428+0000","last_clean":"2023-10-06T02:51:00.653428+0000","last_became_active":"2023-10-06T02:51:00.653084+0000","last_became_peered":"2023-10-06T02:51:00.653084+0000","last_unstale":"2023-10-06T02:51:00.653428+0000","last_undegraded":"2023-10-06T02:51:00.653428+0000","last_fullsized":"2023-10-06T02:51:00.653428+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647601+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652974+0000","last_change":"2023-10-06T02:51:00.652974+0000","last_active":"2023-10-06T02:51:00.652974+0000","last_peered":"2023-10-06T02:51:00.652974+0000","last_clean":"2023-10-06T02:51:00.652974+0000","last_became_active":"2023-10-06T02:51:00.652757+0000","last_became_peered":"2023-10-06T02:51:00.652757+0000","last_unstale":"2023-10-06T02:51:00.652974+0000","last_undegraded":"2023-10-06T02:51:00.652974+0000","last_fullsized":"2023-10-06T02:51:00.652974+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:25.453904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646303+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:21.195790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.646008+0000","last_change":"2023-10-06T02:51:00.646008+0000","last_active":"2023-10-06T02:51:00.646008+0000","last_peered":"2023-10-06T02:51:00.646008+0000","last_clean":"2023-10-06T02:51:00.646008+0000","last_became_active":"2023-10-06T02:51:00.645802+0000","last_became_peered":"2023-10-06T02:51:00.645802+0000","last_unstale":"2023-10-06T02:51:00.646008+0000","last_undegraded":"2023-10-06T02:51:00.646008+0000","last_fullsized":"2023-10-06T02:51:00.646008+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:36.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645358+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:05.854516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654291+0000","last_change":"2023-10-06T02:51:00.654291+0000","last_active":"2023-10-06T02:51:00.654291+0000","last_peered":"2023-10-06T02:51:00.654291+0000","last_clean":"2023-10-06T02:51:00.654291+0000","last_became_active":"2023-10-06T02:51:00.653786+0000","last_became_peered":"2023-10-06T02:51:00.653786+0000","last_unstale":"2023-10-06T02:51:00.654291+0000","last_undegraded":"2023-10-06T02:51:00.654291+0000","last_fullsized":"2023-10-06T02:51:00.654291+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644507+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653380+0000","last_change":"2023-10-06T02:51:00.653380+0000","last_active":"2023-10-06T02:51:00.653380+0000","last_peered":"2023-10-06T02:51:00.653380+0000","last_clean":"2023-10-06T02:51:00.653380+0000","last_became_active":"2023-10-06T02:51:00.652913+0000","last_became_peered":"2023-10-06T02:51:00.652913+0000","last_unstale":"2023-10-06T02:51:00.653380+0000","last_undegraded":"2023-10-06T02:51:00.653380+0000","last_fullsized":"2023-10-06T02:51:00.653380+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645022+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:21.511509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654738+0000","last_change":"2023-10-06T02:51:00.654738+0000","last_active":"2023-10-06T02:51:00.654738+0000","last_peered":"2023-10-06T02:51:00.654738+0000","last_clean":"2023-10-06T02:51:00.654738+0000","last_became_active":"2023-10-06T02:51:00.654487+0000","last_became_peered":"2023-10-06T02:51:00.654487+0000","last_unstale":"2023-10-06T02:51:00.654738+0000","last_undegraded":"2023-10-06T02:51:00.654738+0000","last_fullsized":"2023-10-06T02:51:00.654738+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:43.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642914+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:39.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647402+0000","last_change":"2023-10-06T02:51:00.647402+0000","last_active":"2023-10-06T02:51:00.647402+0000","last_peered":"2023-10-06T02:51:00.647402+0000","last_clean":"2023-10-06T02:51:00.647402+0000","last_became_active":"2023-10-06T02:51:00.646818+0000","last_became_peered":"2023-10-06T02:51:00.646818+0000","last_unstale":"2023-10-06T02:51:00.647402+0000","last_undegraded":"2023-10-06T02:51:00.647402+0000","last_fullsized":"2023-10-06T02:51:00.647402+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:31.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647716+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652500+0000","last_change":"2023-10-06T02:51:00.652500+0000","last_active":"2023-10-06T02:51:00.652500+0000","last_peered":"2023-10-06T02:51:00.652500+0000","last_clean":"2023-10-06T02:51:00.652500+0000","last_became_active":"2023-10-06T02:51:00.651985+0000","last_became_peered":"2023-10-06T02:51:00.651985+0000","last_unstale":"2023-10-06T02:51:00.652500+0000","last_undegraded":"2023-10-06T02:51:00.652500+0000","last_fullsized":"2023-10-06T02:51:00.652500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645676+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:40.127983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652502+0000","last_change":"2023-10-06T02:51:00.652502+0000","last_active":"2023-10-06T02:51:00.652502+0000","last_peered":"2023-10-06T02:51:00.652502+0000","last_clean":"2023-10-06T02:51:00.652502+0000","last_became_active":"2023-10-06T02:51:00.652287+0000","last_became_peered":"2023-10-06T02:51:00.652287+0000","last_unstale":"2023-10-06T02:51:00.652502+0000","last_undegraded":"2023-10-06T02:51:00.652502+0000","last_fullsized":"2023-10-06T02:51:00.652502+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:38.913069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646009+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:45.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.649652+0000","last_change":"2023-10-06T02:51:00.649652+0000","last_active":"2023-10-06T02:51:00.649652+0000","last_peered":"2023-10-06T02:51:00.649652+0000","last_clean":"2023-10-06T02:51:00.649652+0000","last_became_active":"2023-10-06T02:51:00.649414+0000","last_became_peered":"2023-10-06T02:51:00.649414+0000","last_unstale":"2023-10-06T02:51:00.649652+0000","last_undegraded":"2023-10-06T02:51:00.649652+0000","last_fullsized":"2023-10-06T02:51:00.649652+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:10.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643973+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:50:59.643973+0000","last_peered":"2023-10-06T02:50:59.643973+0000","last_clean":"2023-10-06T02:50:59.643973+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:50:59.643973+0000","last_undegraded":"2023-10-06T02:50:59.643973+0000","last_fullsized":"2023-10-06T02:50:59.643973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644444+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652167+0000","last_change":"2023-10-06T02:51:00.652167+0000","last_active":"2023-10-06T02:51:00.652167+0000","last_peered":"2023-10-06T02:51:00.652167+0000","last_clean":"2023-10-06T02:51:00.652167+0000","last_became_active":"2023-10-06T02:51:00.651572+0000","last_became_peered":"2023-10-06T02:51:00.651572+0000","last_unstale":"2023-10-06T02:51:00.652167+0000","last_undegraded":"2023-10-06T02:51:00.652167+0000","last_fullsized":"2023-10-06T02:51:00.652167+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641162+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:50:59.641162+0000","last_peered":"2023-10-06T02:50:59.641162+0000","last_clean":"2023-10-06T02:50:59.641162+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:50:59.641162+0000","last_undegraded":"2023-10-06T02:50:59.641162+0000","last_fullsized":"2023-10-06T02:50:59.641162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647253+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654701+0000","last_change":"2023-10-06T02:51:00.654701+0000","last_active":"2023-10-06T02:51:00.654701+0000","last_peered":"2023-10-06T02:51:00.654701+0000","last_clean":"2023-10-06T02:51:00.654701+0000","last_became_active":"2023-10-06T02:51:00.654174+0000","last_became_peered":"2023-10-06T02:51:00.654174+0000","last_unstale":"2023-10-06T02:51:00.654701+0000","last_undegraded":"2023-10-06T02:51:00.654701+0000","last_fullsized":"2023-10-06T02:51:00.654701+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:22.851612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641963+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:50:59.641963+0000","last_peered":"2023-10-06T02:50:59.641963+0000","last_clean":"2023-10-06T02:50:59.641963+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:50:59.641963+0000","last_undegraded":"2023-10-06T02:50:59.641963+0000","last_fullsized":"2023-10-06T02:50:59.641963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647542+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:02.670341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651643+0000","last_change":"2023-10-06T02:51:00.651643+0000","last_active":"2023-10-06T02:51:00.651643+0000","last_peered":"2023-10-06T02:51:00.651643+0000","last_clean":"2023-10-06T02:51:00.651643+0000","last_became_active":"2023-10-06T02:51:00.651163+0000","last_became_peered":"2023-10-06T02:51:00.651163+0000","last_unstale":"2023-10-06T02:51:00.651643+0000","last_undegraded":"2023-10-06T02:51:00.651643+0000","last_fullsized":"2023-10-06T02:51:00.651643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641285+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:50:59.641285+0000","last_peered":"2023-10-06T02:50:59.641285+0000","last_clean":"2023-10-06T02:50:59.641285+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:50:59.641285+0000","last_undegraded":"2023-10-06T02:50:59.641285+0000","last_fullsized":"2023-10-06T02:50:59.641285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":232,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643465+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:50:59.643465+0000","last_peered":"2023-10-06T02:50:59.643465+0000","last_clean":"2023-10-06T02:50:59.643465+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:50:59.643465+0000","last_undegraded":"2023-10-06T02:50:59.643465+0000","last_fullsized":"2023-10-06T02:50:59.643465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645438+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:12.718116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653681+0000","last_change":"2023-10-06T02:51:00.653681+0000","last_active":"2023-10-06T02:51:00.653681+0000","last_peered":"2023-10-06T02:51:00.653681+0000","last_clean":"2023-10-06T02:51:00.653681+0000","last_became_active":"2023-10-06T02:51:00.653235+0000","last_became_peered":"2023-10-06T02:51:00.653235+0000","last_unstale":"2023-10-06T02:51:00.653681+0000","last_undegraded":"2023-10-06T02:51:00.653681+0000","last_fullsized":"2023-10-06T02:51:00.653681+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643369+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:50:59.643369+0000","last_peered":"2023-10-06T02:50:59.643369+0000","last_clean":"2023-10-06T02:50:59.643369+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:50:59.643369+0000","last_undegraded":"2023-10-06T02:50:59.643369+0000","last_fullsized":"2023-10-06T02:50:59.643369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644923+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.644728+0000","last_change":"2023-10-06T02:51:00.644728+0000","last_active":"2023-10-06T02:51:00.644728+0000","last_peered":"2023-10-06T02:51:00.644728+0000","last_clean":"2023-10-06T02:51:00.644728+0000","last_became_active":"2023-10-06T02:51:00.644509+0000","last_became_peered":"2023-10-06T02:51:00.644509+0000","last_unstale":"2023-10-06T02:51:00.644728+0000","last_undegraded":"2023-10-06T02:51:00.644728+0000","last_fullsized":"2023-10-06T02:51:00.644728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:33.751928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643554+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:50:59.643554+0000","last_peered":"2023-10-06T02:50:59.643554+0000","last_clean":"2023-10-06T02:50:59.643554+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:50:59.643554+0000","last_undegraded":"2023-10-06T02:50:59.643554+0000","last_fullsized":"2023-10-06T02:50:59.643554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644390+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651716+0000","last_change":"2023-10-06T02:51:00.651716+0000","last_active":"2023-10-06T02:51:00.651716+0000","last_peered":"2023-10-06T02:51:00.651716+0000","last_clean":"2023-10-06T02:51:00.651716+0000","last_became_active":"2023-10-06T02:51:00.651468+0000","last_became_peered":"2023-10-06T02:51:00.651468+0000","last_unstale":"2023-10-06T02:51:00.651716+0000","last_undegraded":"2023-10-06T02:51:00.651716+0000","last_fullsized":"2023-10-06T02:51:00.651716+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:48.405419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.644380+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:50:59.644380+0000","last_peered":"2023-10-06T02:50:59.644380+0000","last_clean":"2023-10-06T02:50:59.644380+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:50:59.644380+0000","last_undegraded":"2023-10-06T02:50:59.644380+0000","last_fullsized":"2023-10-06T02:50:59.644380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645711+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:17.134930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647127+0000","last_change":"2023-10-06T02:51:00.647127+0000","last_active":"2023-10-06T02:51:00.647127+0000","last_peered":"2023-10-06T02:51:00.647127+0000","last_clean":"2023-10-06T02:51:00.647127+0000","last_became_active":"2023-10-06T02:51:00.646586+0000","last_became_peered":"2023-10-06T02:51:00.646586+0000","last_unstale":"2023-10-06T02:51:00.647127+0000","last_undegraded":"2023-10-06T02:51:00.647127+0000","last_fullsized":"2023-10-06T02:51:00.647127+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:08.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.644712+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:50:59.644712+0000","last_peered":"2023-10-06T02:50:59.644712+0000","last_clean":"2023-10-06T02:50:59.644712+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:50:59.644712+0000","last_undegraded":"2023-10-06T02:50:59.644712+0000","last_fullsized":"2023-10-06T02:50:59.644712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198846042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":1.393,"15min":1.393},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67400000000000004,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.504}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":1.081,"15min":1.081},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.70999999999999996,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48099999999999998},"min":{"1min":0.46200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70099999999999996,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.63200000000000001},"min":{"1min":0.41799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70499999999999996,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61899999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68300000000000005,"5min":0.879,"15min":0.879},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68700000000000006,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69499999999999995,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":1.879,"15min":1.879},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67400000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.78300000000000003,"15min":1.028},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68700000000000006,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67400000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67900000000000005,"5min":1.163,"15min":1.163},"last":0.626}]},{"osd":4,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":1.05,"15min":1.05},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.753},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.61899999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72799999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.63},"min":{"1min":0.39200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.60599999999999998},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.31,"15min":0.312},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.247},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.26900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34200000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38900000000000001,"15min":0.38},"min":{"1min":0.313,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.374},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.36599999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69399999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46700000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77800000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.47399999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.443,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.47799999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198846042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34999999999999998},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47999999999999998,"5min":1.177,"15min":1.177},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38800000000000001,"15min":0.39800000000000002},"min":{"1min":0.23499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65100000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.75800000000000001,"15min":1.181},"min":{"1min":0.216,"5min":0.188,"15min":0.188},"max":{"1min":0.56000000000000005,"5min":22.038,"15min":22.038},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.26200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.60399999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.311},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.79600000000000004,"15min":1.2110000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.63300000000000001,"5min":21.942,"15min":21.942},"last":0.503}]},{"osd":4,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.91000000000000003,"15min":1.264},"min":{"1min":0.46400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86499999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.96899999999999997,"15min":1.367},"min":{"1min":0.46300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.441},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.47699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":1.401,"15min":1.401},"last":0.47199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.93899999999999995,"15min":1.294},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.98999999999999999,"15min":1.3939999999999999},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80900000000000005,"5min":21.98,"15min":21.98},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.88800000000000001,"5min":1.425,"15min":1.425},"last":0.753},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.78300000000000003,"15min":0.96599999999999997},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81899999999999995,"5min":11.154,"15min":11.154},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52900000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.20999999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.51500000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.498}]},{"osd":1,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"min":{"1min":0.25700000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.63,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.439},{"interface":"front","average":{"1min":0.433,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80000000000000004,"5min":0.875,"15min":0.875},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59399999999999997,"15min":0.57799999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79500000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57699999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.626},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.70199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.22700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.32300000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.371}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.309},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27900000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39200000000000002,"15min":0.36799999999999999},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.64800000000000002,"5min":3.044,"15min":3.044},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35599999999999998,"15min":0.33900000000000002},"min":{"1min":0.29899999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74099999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72999999999999998,"5min":2.25,"15min":2.25},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.70399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83599999999999997,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.80500000000000005,"15min":1.0049999999999999},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84199999999999997,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.66900000000000004,"15min":0.83699999999999997},"min":{"1min":0.33600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71699999999999997,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.56899999999999995,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.61599999999999999,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.69399999999999995,"15min":0.87},"min":{"1min":0.41399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70599999999999996,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.66600000000000004,"15min":0.81599999999999995},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.66800000000000004,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.376}]},{"osd":2,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.504},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61799999999999999,"15min":0.69799999999999995},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66100000000000003,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55300000000000005,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64700000000000002,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.626},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73799999999999999,"5min":3.456,"15min":3.456},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.49399999999999999},"min":{"1min":0.27500000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.499,"15min":0.51200000000000001},"min":{"1min":0.32900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.624}]},{"osd":6,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64200000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.83499999999999996,"15min":1.087},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73099999999999998,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.315,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.755,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.38500000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45700000000000002,"15min":0.45000000000000001},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.73699999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.879,"15min":0.879},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59399999999999997}]}]}],"pool_statfs":[]}} 2023-10-06T02:51:06.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:51:06.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.241+0000 7fe8d4ce4700 1 Processor -- start 2023-10-06T02:51:06.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.241+0000 7fe8d4ce4700 1 -- start start 2023-10-06T02:51:06.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.242+0000 7fe8d4ce4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe8d00c3030 0x7fe8d00c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.242+0000 7fe8d4ce4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d006aae0 con 0x7fe8d00aeea0 2023-10-06T02:51:06.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.242+0000 7fe8d4ce4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d0069ed0 con 0x7fe8d00af270 2023-10-06T02:51:06.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.242+0000 7fe8d4ce4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d006a1b0 con 0x7fe8d00c3030 2023-10-06T02:51:06.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.242+0000 7fe8ce59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe8d00aeea0 0x7fe8d00c2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52234/0 (socket says 172.21.15.81:52234) 2023-10-06T02:51:06.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.242+0000 7fe8ce59c700 1 -- 172.21.15.81:0/3238536689 learned_addr learned my addr 172.21.15.81:0/3238536689 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:06.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ced9d700 1 --2- 172.21.15.81:0/3238536689 >> v2:172.21.15.83:3300/0 conn(0x7fe8d00c3030 0x7fe8d00c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316382430 0 0) 0x7fe8d006aae0 con 0x7fe8d00aeea0 2023-10-06T02:51:06.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8bc003570 con 0x7fe8d00aeea0 2023-10-06T02:51:06.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349523446 0 0) 0x7fe8d0069ed0 con 0x7fe8d00af270 2023-10-06T02:51:06.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d006aae0 con 0x7fe8d00af270 2023-10-06T02:51:06.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 934840647 0 0) 0x7fe8bc003570 con 0x7fe8d00aeea0 2023-10-06T02:51:06.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 >> v2:172.21.15.83:3300/0 conn(0x7fe8d00c3030 msgr2=0x7fe8d00c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 --2- 172.21.15.81:0/3238536689 >> v2:172.21.15.83:3300/0 conn(0x7fe8d00c3030 0x7fe8d00c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 >> v1:172.21.15.83:6789/0 conn(0x7fe8d00af270 legacy=0x7fe8d00c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d006a490 con 0x7fe8d00aeea0 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fe8c0001470 con 0x7fe8d00aeea0 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 >> v1:172.21.15.81:6789/0 conn(0x7fe8d00aeea0 legacy=0x7fe8d00c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc003bf0 0x7fe8bc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8bc004810 0x7fe8bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 0x7fe8bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d006a1b0 con 0x7fe8bc003bf0 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc00c0b0 con 0x7fe8bc0051c0 2023-10-06T02:51:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc00c270 con 0x7fe8bc004810 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ced9d700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 0x7fe8bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8c5d9b700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8bc004810 0x7fe8bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ce59c700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc003bf0 0x7fe8bc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ced9d700 1 -- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8bc004810 msgr2=0x7fe8bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ced9d700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8bc004810 0x7fe8bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ced9d700 1 -- 172.21.15.81:0/3238536689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc003bf0 msgr2=0x7fe8bc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ced9d700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc003bf0 0x7fe8bc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ced9d700 1 -- 172.21.15.81:0/3238536689 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc003570 con 0x7fe8bc0051c0 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ce59c700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc003bf0 0x7fe8bc003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.243+0000 7fe8ced9d700 1 -- 172.21.15.81:0/3238536689 reap_dead start 2023-10-06T02:51:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8ced9d700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 0x7fe8bc00ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800e210 tx=0x7fe8c800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e8963cd81e16d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800eac0 con 0x7fe8bc0051c0 2023-10-06T02:51:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c800f040 con 0x7fe8bc0051c0 2023-10-06T02:51:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8cdd9b700 1 -- 172.21.15.81:0/3238536689 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800ee70 con 0x7fe8bc0051c0 2023-10-06T02:51:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 msgr2=0x7fe8bc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8d4ce4700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 0x7fe8bc00ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800e210 tx=0x7fe8c800b040 comp rx=0 tx=0).stop 2023-10-06T02:51:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/3238536689 shutdown_connections 2023-10-06T02:51:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8d4ce4700 1 --2- 172.21.15.81:0/3238536689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 0x7fe8bc00ba60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/3238536689 >> 172.21.15.81:0/3238536689 conn(0x7fe8d006c660 msgr2=0x7fe8d00cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:06.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/3238536689 shutdown_connections 2023-10-06T02:51:06.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.244+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/3238536689 wait complete. 2023-10-06T02:51:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8d4ce4700 1 Processor -- start 2023-10-06T02:51:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8d4ce4700 1 -- start start 2023-10-06T02:51:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8d4ce4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 0x7fe8d016d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8d4ce4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8d00c4f00 0x7fe8d0154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8d4ce4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d00caca0 0x7fe8d00cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8d4ce4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d016a1d0 con 0x7fe8d00caca0 2023-10-06T02:51:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8d4ce4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cb660 con 0x7fe8bc0051c0 2023-10-06T02:51:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8d4ce4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d016dff0 con 0x7fe8d00c4f00 2023-10-06T02:51:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8ced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d00caca0 0x7fe8d00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8ced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d00caca0 0x7fe8d00cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37734/0 (socket says 172.21.15.81:37734) 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.246+0000 7fe8ced9d700 1 -- 172.21.15.81:0/92436008 learned_addr learned my addr 172.21.15.81:0/92436008 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8c5d9b700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8d00c4f00 0x7fe8d0154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8ce59c700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 0x7fe8d016d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8ced9d700 1 -- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8d00c4f00 msgr2=0x7fe8d0154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8ced9d700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8d00c4f00 0x7fe8d0154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8ced9d700 1 -- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 msgr2=0x7fe8d016d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8ced9d700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 0x7fe8d016d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8ced9d700 1 -- 172.21.15.81:0/92436008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d016e2d0 con 0x7fe8d00caca0 2023-10-06T02:51:06.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8ced9d700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d00caca0 0x7fe8d00cb120 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00c9350 tx=0x7fe8c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8c6ffd700 1 -- 172.21.15.81:0/92436008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8014e80 con 0x7fe8d00caca0 2023-10-06T02:51:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8c6ffd700 1 -- 172.21.15.81:0/92436008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c8022070 con 0x7fe8d00caca0 2023-10-06T02:51:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d016e5b0 con 0x7fe8d00caca0 2023-10-06T02:51:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8c6ffd700 1 -- 172.21.15.81:0/92436008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c801d8b0 con 0x7fe8d00caca0 2023-10-06T02:51:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.247+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d015d020 con 0x7fe8d00caca0 2023-10-06T02:51:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.248+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d015d240 con 0x7fe8d00caca0 2023-10-06T02:51:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.248+0000 7fe8c6ffd700 1 -- 172.21.15.81:0/92436008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8c8003020 con 0x7fe8d00caca0 2023-10-06T02:51:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.249+0000 7fe8c6ffd700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8b0066f30 0x7fe8b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.249+0000 7fe8c6ffd700 1 -- 172.21.15.81:0/92436008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe8c8024070 con 0x7fe8d00caca0 2023-10-06T02:51:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.249+0000 7fe8ce59c700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8b0066f30 0x7fe8b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.249+0000 7fe8ce59c700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8b0066f30 0x7fe8b00693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0000ff0 tx=0x7fe8d0069170 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.253+0000 7fe8c6ffd700 1 -- 172.21.15.81:0/92436008 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8c8053be0 con 0x7fe8d00caca0 2023-10-06T02:51:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.430+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8d006a770 con 0x7fe8b0066f30 2023-10-06T02:51:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.439+0000 7fe8c6ffd700 1 -- 172.21.15.81:0/92436008 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302834 (secure 0 0 0) 0x7fe8d006a770 con 0x7fe8b0066f30 2023-10-06T02:51:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8b0066f30 msgr2=0x7fe8b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8b0066f30 0x7fe8b00693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0000ff0 tx=0x7fe8d0069170 comp rx=0 tx=0).stop 2023-10-06T02:51:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d00caca0 msgr2=0x7fe8d00cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d00caca0 0x7fe8d00cb120 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00c9350 tx=0x7fe8c8019000 comp rx=0 tx=0).stop 2023-10-06T02:51:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 shutdown_connections 2023-10-06T02:51:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d00caca0 0x7fe8d00cb120 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe8b0066f30 0x7fe8b00693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8bc0051c0 0x7fe8d016d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 --2- 172.21.15.81:0/92436008 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8d00c4f00 0x7fe8d0154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 >> 172.21.15.81:0/92436008 conn(0x7fe8d006c660 msgr2=0x7fe8d015f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 shutdown_connections 2023-10-06T02:51:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.442+0000 7fe8d4ce4700 1 -- 172.21.15.81:0/92436008 wait complete. 2023-10-06T02:51:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:51:06.455 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-10-06T02:51:05.564344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5556,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556943,"statfs":{"total":1600000000,"available":1594310544,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.924741"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643417+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.457598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645560+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643652+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:44.811795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645573+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646029+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647039+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:22.096231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645884+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:44.963828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.650244+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648134+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645467+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:47.447725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645220+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645626+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:09.179906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.649918+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646354+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646379+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646688+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:12.065393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647128+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:44.674521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643324+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:07.867628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647131+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646152+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646135+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646071+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646783+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:20.118823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642945+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:56.664986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645395+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645758+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645312+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:25.945455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.649612+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648721+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:44.030445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645178+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645819+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646808+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:39.957393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646363+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:38.226167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652649+0000","last_change":"2023-10-06T02:51:00.652649+0000","last_active":"2023-10-06T02:51:00.652649+0000","last_peered":"2023-10-06T02:51:00.652649+0000","last_clean":"2023-10-06T02:51:00.652649+0000","last_became_active":"2023-10-06T02:51:00.652282+0000","last_became_peered":"2023-10-06T02:51:00.652282+0000","last_unstale":"2023-10-06T02:51:00.652649+0000","last_undegraded":"2023-10-06T02:51:00.652649+0000","last_fullsized":"2023-10-06T02:51:00.652649+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645071+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:02:16.943289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.655589+0000","last_change":"2023-10-06T02:51:00.655589+0000","last_active":"2023-10-06T02:51:00.655589+0000","last_peered":"2023-10-06T02:51:00.655589+0000","last_clean":"2023-10-06T02:51:00.655589+0000","last_became_active":"2023-10-06T02:51:00.655326+0000","last_became_peered":"2023-10-06T02:51:00.655326+0000","last_unstale":"2023-10-06T02:51:00.655589+0000","last_undegraded":"2023-10-06T02:51:00.655589+0000","last_fullsized":"2023-10-06T02:51:00.655589+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648297+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:50.512311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650807+0000","last_change":"2023-10-06T02:51:00.650807+0000","last_active":"2023-10-06T02:51:00.650807+0000","last_peered":"2023-10-06T02:51:00.650807+0000","last_clean":"2023-10-06T02:51:00.650807+0000","last_became_active":"2023-10-06T02:51:00.650541+0000","last_became_peered":"2023-10-06T02:51:00.650541+0000","last_unstale":"2023-10-06T02:51:00.650807+0000","last_undegraded":"2023-10-06T02:51:00.650807+0000","last_fullsized":"2023-10-06T02:51:00.650807+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:06.863934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646428+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:42.974701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.655112+0000","last_change":"2023-10-06T02:51:00.655112+0000","last_active":"2023-10-06T02:51:00.655112+0000","last_peered":"2023-10-06T02:51:00.655112+0000","last_clean":"2023-10-06T02:51:00.655112+0000","last_became_active":"2023-10-06T02:51:00.654869+0000","last_became_peered":"2023-10-06T02:51:00.654869+0000","last_unstale":"2023-10-06T02:51:00.655112+0000","last_undegraded":"2023-10-06T02:51:00.655112+0000","last_fullsized":"2023-10-06T02:51:00.655112+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:37.828589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645818+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.648859+0000","last_change":"2023-10-06T02:51:00.648859+0000","last_active":"2023-10-06T02:51:00.648859+0000","last_peered":"2023-10-06T02:51:00.648859+0000","last_clean":"2023-10-06T02:51:00.648859+0000","last_became_active":"2023-10-06T02:51:00.648625+0000","last_became_peered":"2023-10-06T02:51:00.648625+0000","last_unstale":"2023-10-06T02:51:00.648859+0000","last_undegraded":"2023-10-06T02:51:00.648859+0000","last_fullsized":"2023-10-06T02:51:00.648859+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648735+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653298+0000","last_change":"2023-10-06T02:51:00.653298+0000","last_active":"2023-10-06T02:51:00.653298+0000","last_peered":"2023-10-06T02:51:00.653298+0000","last_clean":"2023-10-06T02:51:00.653298+0000","last_became_active":"2023-10-06T02:51:00.652806+0000","last_became_peered":"2023-10-06T02:51:00.652806+0000","last_unstale":"2023-10-06T02:51:00.653298+0000","last_undegraded":"2023-10-06T02:51:00.653298+0000","last_fullsized":"2023-10-06T02:51:00.653298+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646089+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:28.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650485+0000","last_change":"2023-10-06T02:51:00.650485+0000","last_active":"2023-10-06T02:51:00.650485+0000","last_peered":"2023-10-06T02:51:00.650485+0000","last_clean":"2023-10-06T02:51:00.650485+0000","last_became_active":"2023-10-06T02:51:00.650261+0000","last_became_peered":"2023-10-06T02:51:00.650261+0000","last_unstale":"2023-10-06T02:51:00.650485+0000","last_undegraded":"2023-10-06T02:51:00.650485+0000","last_fullsized":"2023-10-06T02:51:00.650485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:01.366512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645862+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654402+0000","last_change":"2023-10-06T02:51:00.654402+0000","last_active":"2023-10-06T02:51:00.654402+0000","last_peered":"2023-10-06T02:51:00.654402+0000","last_clean":"2023-10-06T02:51:00.654402+0000","last_became_active":"2023-10-06T02:51:00.653618+0000","last_became_peered":"2023-10-06T02:51:00.653618+0000","last_unstale":"2023-10-06T02:51:00.654402+0000","last_undegraded":"2023-10-06T02:51:00.654402+0000","last_fullsized":"2023-10-06T02:51:00.654402+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:43.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646792+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651057+0000","last_change":"2023-10-06T02:51:00.651057+0000","last_active":"2023-10-06T02:51:00.651057+0000","last_peered":"2023-10-06T02:51:00.651057+0000","last_clean":"2023-10-06T02:51:00.651057+0000","last_became_active":"2023-10-06T02:51:00.650684+0000","last_became_peered":"2023-10-06T02:51:00.650684+0000","last_unstale":"2023-10-06T02:51:00.651057+0000","last_undegraded":"2023-10-06T02:51:00.651057+0000","last_fullsized":"2023-10-06T02:51:00.651057+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:03.696166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646701+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:12.319008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647297+0000","last_change":"2023-10-06T02:51:00.647297+0000","last_active":"2023-10-06T02:51:00.647297+0000","last_peered":"2023-10-06T02:51:00.647297+0000","last_clean":"2023-10-06T02:51:00.647297+0000","last_became_active":"2023-10-06T02:51:00.646978+0000","last_became_peered":"2023-10-06T02:51:00.646978+0000","last_unstale":"2023-10-06T02:51:00.647297+0000","last_undegraded":"2023-10-06T02:51:00.647297+0000","last_fullsized":"2023-10-06T02:51:00.647297+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:38.756816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642911+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650607+0000","last_change":"2023-10-06T02:51:00.650607+0000","last_active":"2023-10-06T02:51:00.650607+0000","last_peered":"2023-10-06T02:51:00.650607+0000","last_clean":"2023-10-06T02:51:00.650607+0000","last_became_active":"2023-10-06T02:51:00.650350+0000","last_became_peered":"2023-10-06T02:51:00.650350+0000","last_unstale":"2023-10-06T02:51:00.650607+0000","last_undegraded":"2023-10-06T02:51:00.650607+0000","last_fullsized":"2023-10-06T02:51:00.650607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645885+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654538+0000","last_change":"2023-10-06T02:51:00.654538+0000","last_active":"2023-10-06T02:51:00.654538+0000","last_peered":"2023-10-06T02:51:00.654538+0000","last_clean":"2023-10-06T02:51:00.654538+0000","last_became_active":"2023-10-06T02:51:00.654180+0000","last_became_peered":"2023-10-06T02:51:00.654180+0000","last_unstale":"2023-10-06T02:51:00.654538+0000","last_undegraded":"2023-10-06T02:51:00.654538+0000","last_fullsized":"2023-10-06T02:51:00.654538+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:27.687050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647782+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654543+0000","last_change":"2023-10-06T02:51:00.654543+0000","last_active":"2023-10-06T02:51:00.654543+0000","last_peered":"2023-10-06T02:51:00.654543+0000","last_clean":"2023-10-06T02:51:00.654543+0000","last_became_active":"2023-10-06T02:51:00.653929+0000","last_became_peered":"2023-10-06T02:51:00.653929+0000","last_unstale":"2023-10-06T02:51:00.654543+0000","last_undegraded":"2023-10-06T02:51:00.654543+0000","last_fullsized":"2023-10-06T02:51:00.654543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:55.661291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645615+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651432+0000","last_change":"2023-10-06T02:51:00.651432+0000","last_active":"2023-10-06T02:51:00.651432+0000","last_peered":"2023-10-06T02:51:00.651432+0000","last_clean":"2023-10-06T02:51:00.651432+0000","last_became_active":"2023-10-06T02:51:00.650760+0000","last_became_peered":"2023-10-06T02:51:00.650760+0000","last_unstale":"2023-10-06T02:51:00.651432+0000","last_undegraded":"2023-10-06T02:51:00.651432+0000","last_fullsized":"2023-10-06T02:51:00.651432+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:01.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646945+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:25.683904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654687+0000","last_change":"2023-10-06T02:51:00.654687+0000","last_active":"2023-10-06T02:51:00.654687+0000","last_peered":"2023-10-06T02:51:00.654687+0000","last_clean":"2023-10-06T02:51:00.654687+0000","last_became_active":"2023-10-06T02:51:00.654476+0000","last_became_peered":"2023-10-06T02:51:00.654476+0000","last_unstale":"2023-10-06T02:51:00.654687+0000","last_undegraded":"2023-10-06T02:51:00.654687+0000","last_fullsized":"2023-10-06T02:51:00.654687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645017+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:53.419446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653428+0000","last_change":"2023-10-06T02:51:00.653428+0000","last_active":"2023-10-06T02:51:00.653428+0000","last_peered":"2023-10-06T02:51:00.653428+0000","last_clean":"2023-10-06T02:51:00.653428+0000","last_became_active":"2023-10-06T02:51:00.653084+0000","last_became_peered":"2023-10-06T02:51:00.653084+0000","last_unstale":"2023-10-06T02:51:00.653428+0000","last_undegraded":"2023-10-06T02:51:00.653428+0000","last_fullsized":"2023-10-06T02:51:00.653428+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647601+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652974+0000","last_change":"2023-10-06T02:51:00.652974+0000","last_active":"2023-10-06T02:51:00.652974+0000","last_peered":"2023-10-06T02:51:00.652974+0000","last_clean":"2023-10-06T02:51:00.652974+0000","last_became_active":"2023-10-06T02:51:00.652757+0000","last_became_peered":"2023-10-06T02:51:00.652757+0000","last_unstale":"2023-10-06T02:51:00.652974+0000","last_undegraded":"2023-10-06T02:51:00.652974+0000","last_fullsized":"2023-10-06T02:51:00.652974+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:25.453904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646303+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:21.195790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.646008+0000","last_change":"2023-10-06T02:51:00.646008+0000","last_active":"2023-10-06T02:51:00.646008+0000","last_peered":"2023-10-06T02:51:00.646008+0000","last_clean":"2023-10-06T02:51:00.646008+0000","last_became_active":"2023-10-06T02:51:00.645802+0000","last_became_peered":"2023-10-06T02:51:00.645802+0000","last_unstale":"2023-10-06T02:51:00.646008+0000","last_undegraded":"2023-10-06T02:51:00.646008+0000","last_fullsized":"2023-10-06T02:51:00.646008+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:36.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645358+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:05.854516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654291+0000","last_change":"2023-10-06T02:51:00.654291+0000","last_active":"2023-10-06T02:51:00.654291+0000","last_peered":"2023-10-06T02:51:00.654291+0000","last_clean":"2023-10-06T02:51:00.654291+0000","last_became_active":"2023-10-06T02:51:00.653786+0000","last_became_peered":"2023-10-06T02:51:00.653786+0000","last_unstale":"2023-10-06T02:51:00.654291+0000","last_undegraded":"2023-10-06T02:51:00.654291+0000","last_fullsized":"2023-10-06T02:51:00.654291+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644507+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653380+0000","last_change":"2023-10-06T02:51:00.653380+0000","last_active":"2023-10-06T02:51:00.653380+0000","last_peered":"2023-10-06T02:51:00.653380+0000","last_clean":"2023-10-06T02:51:00.653380+0000","last_became_active":"2023-10-06T02:51:00.652913+0000","last_became_peered":"2023-10-06T02:51:00.652913+0000","last_unstale":"2023-10-06T02:51:00.653380+0000","last_undegraded":"2023-10-06T02:51:00.653380+0000","last_fullsized":"2023-10-06T02:51:00.653380+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645022+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:21.511509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654738+0000","last_change":"2023-10-06T02:51:00.654738+0000","last_active":"2023-10-06T02:51:00.654738+0000","last_peered":"2023-10-06T02:51:00.654738+0000","last_clean":"2023-10-06T02:51:00.654738+0000","last_became_active":"2023-10-06T02:51:00.654487+0000","last_became_peered":"2023-10-06T02:51:00.654487+0000","last_unstale":"2023-10-06T02:51:00.654738+0000","last_undegraded":"2023-10-06T02:51:00.654738+0000","last_fullsized":"2023-10-06T02:51:00.654738+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:43.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642914+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:39.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647402+0000","last_change":"2023-10-06T02:51:00.647402+0000","last_active":"2023-10-06T02:51:00.647402+0000","last_peered":"2023-10-06T02:51:00.647402+0000","last_clean":"2023-10-06T02:51:00.647402+0000","last_became_active":"2023-10-06T02:51:00.646818+0000","last_became_peered":"2023-10-06T02:51:00.646818+0000","last_unstale":"2023-10-06T02:51:00.647402+0000","last_undegraded":"2023-10-06T02:51:00.647402+0000","last_fullsized":"2023-10-06T02:51:00.647402+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:31.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647716+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652500+0000","last_change":"2023-10-06T02:51:00.652500+0000","last_active":"2023-10-06T02:51:00.652500+0000","last_peered":"2023-10-06T02:51:00.652500+0000","last_clean":"2023-10-06T02:51:00.652500+0000","last_became_active":"2023-10-06T02:51:00.651985+0000","last_became_peered":"2023-10-06T02:51:00.651985+0000","last_unstale":"2023-10-06T02:51:00.652500+0000","last_undegraded":"2023-10-06T02:51:00.652500+0000","last_fullsized":"2023-10-06T02:51:00.652500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645676+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:40.127983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652502+0000","last_change":"2023-10-06T02:51:00.652502+0000","last_active":"2023-10-06T02:51:00.652502+0000","last_peered":"2023-10-06T02:51:00.652502+0000","last_clean":"2023-10-06T02:51:00.652502+0000","last_became_active":"2023-10-06T02:51:00.652287+0000","last_became_peered":"2023-10-06T02:51:00.652287+0000","last_unstale":"2023-10-06T02:51:00.652502+0000","last_undegraded":"2023-10-06T02:51:00.652502+0000","last_fullsized":"2023-10-06T02:51:00.652502+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:38.913069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646009+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:45.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.649652+0000","last_change":"2023-10-06T02:51:00.649652+0000","last_active":"2023-10-06T02:51:00.649652+0000","last_peered":"2023-10-06T02:51:00.649652+0000","last_clean":"2023-10-06T02:51:00.649652+0000","last_became_active":"2023-10-06T02:51:00.649414+0000","last_became_peered":"2023-10-06T02:51:00.649414+0000","last_unstale":"2023-10-06T02:51:00.649652+0000","last_undegraded":"2023-10-06T02:51:00.649652+0000","last_fullsized":"2023-10-06T02:51:00.649652+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:10.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643973+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:50:59.643973+0000","last_peered":"2023-10-06T02:50:59.643973+0000","last_clean":"2023-10-06T02:50:59.643973+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:50:59.643973+0000","last_undegraded":"2023-10-06T02:50:59.643973+0000","last_fullsized":"2023-10-06T02:50:59.643973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644444+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652167+0000","last_change":"2023-10-06T02:51:00.652167+0000","last_active":"2023-10-06T02:51:00.652167+0000","last_peered":"2023-10-06T02:51:00.652167+0000","last_clean":"2023-10-06T02:51:00.652167+0000","last_became_active":"2023-10-06T02:51:00.651572+0000","last_became_peered":"2023-10-06T02:51:00.651572+0000","last_unstale":"2023-10-06T02:51:00.652167+0000","last_undegraded":"2023-10-06T02:51:00.652167+0000","last_fullsized":"2023-10-06T02:51:00.652167+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641162+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:50:59.641162+0000","last_peered":"2023-10-06T02:50:59.641162+0000","last_clean":"2023-10-06T02:50:59.641162+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:50:59.641162+0000","last_undegraded":"2023-10-06T02:50:59.641162+0000","last_fullsized":"2023-10-06T02:50:59.641162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647253+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654701+0000","last_change":"2023-10-06T02:51:00.654701+0000","last_active":"2023-10-06T02:51:00.654701+0000","last_peered":"2023-10-06T02:51:00.654701+0000","last_clean":"2023-10-06T02:51:00.654701+0000","last_became_active":"2023-10-06T02:51:00.654174+0000","last_became_peered":"2023-10-06T02:51:00.654174+0000","last_unstale":"2023-10-06T02:51:00.654701+0000","last_undegraded":"2023-10-06T02:51:00.654701+0000","last_fullsized":"2023-10-06T02:51:00.654701+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:22.851612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641963+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:50:59.641963+0000","last_peered":"2023-10-06T02:50:59.641963+0000","last_clean":"2023-10-06T02:50:59.641963+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:50:59.641963+0000","last_undegraded":"2023-10-06T02:50:59.641963+0000","last_fullsized":"2023-10-06T02:50:59.641963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647542+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:02.670341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651643+0000","last_change":"2023-10-06T02:51:00.651643+0000","last_active":"2023-10-06T02:51:00.651643+0000","last_peered":"2023-10-06T02:51:00.651643+0000","last_clean":"2023-10-06T02:51:00.651643+0000","last_became_active":"2023-10-06T02:51:00.651163+0000","last_became_peered":"2023-10-06T02:51:00.651163+0000","last_unstale":"2023-10-06T02:51:00.651643+0000","last_undegraded":"2023-10-06T02:51:00.651643+0000","last_fullsized":"2023-10-06T02:51:00.651643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641285+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:50:59.641285+0000","last_peered":"2023-10-06T02:50:59.641285+0000","last_clean":"2023-10-06T02:50:59.641285+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:50:59.641285+0000","last_undegraded":"2023-10-06T02:50:59.641285+0000","last_fullsized":"2023-10-06T02:50:59.641285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":232,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643465+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:50:59.643465+0000","last_peered":"2023-10-06T02:50:59.643465+0000","last_clean":"2023-10-06T02:50:59.643465+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:50:59.643465+0000","last_undegraded":"2023-10-06T02:50:59.643465+0000","last_fullsized":"2023-10-06T02:50:59.643465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645438+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:12.718116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653681+0000","last_change":"2023-10-06T02:51:00.653681+0000","last_active":"2023-10-06T02:51:00.653681+0000","last_peered":"2023-10-06T02:51:00.653681+0000","last_clean":"2023-10-06T02:51:00.653681+0000","last_became_active":"2023-10-06T02:51:00.653235+0000","last_became_peered":"2023-10-06T02:51:00.653235+0000","last_unstale":"2023-10-06T02:51:00.653681+0000","last_undegraded":"2023-10-06T02:51:00.653681+0000","last_fullsized":"2023-10-06T02:51:00.653681+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643369+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:50:59.643369+0000","last_peered":"2023-10-06T02:50:59.643369+0000","last_clean":"2023-10-06T02:50:59.643369+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:50:59.643369+0000","last_undegraded":"2023-10-06T02:50:59.643369+0000","last_fullsized":"2023-10-06T02:50:59.643369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644923+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.644728+0000","last_change":"2023-10-06T02:51:00.644728+0000","last_active":"2023-10-06T02:51:00.644728+0000","last_peered":"2023-10-06T02:51:00.644728+0000","last_clean":"2023-10-06T02:51:00.644728+0000","last_became_active":"2023-10-06T02:51:00.644509+0000","last_became_peered":"2023-10-06T02:51:00.644509+0000","last_unstale":"2023-10-06T02:51:00.644728+0000","last_undegraded":"2023-10-06T02:51:00.644728+0000","last_fullsized":"2023-10-06T02:51:00.644728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:33.751928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643554+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:50:59.643554+0000","last_peered":"2023-10-06T02:50:59.643554+0000","last_clean":"2023-10-06T02:50:59.643554+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:50:59.643554+0000","last_undegraded":"2023-10-06T02:50:59.643554+0000","last_fullsized":"2023-10-06T02:50:59.643554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644390+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651716+0000","last_change":"2023-10-06T02:51:00.651716+0000","last_active":"2023-10-06T02:51:00.651716+0000","last_peered":"2023-10-06T02:51:00.651716+0000","last_clean":"2023-10-06T02:51:00.651716+0000","last_became_active":"2023-10-06T02:51:00.651468+0000","last_became_peered":"2023-10-06T02:51:00.651468+0000","last_unstale":"2023-10-06T02:51:00.651716+0000","last_undegraded":"2023-10-06T02:51:00.651716+0000","last_fullsized":"2023-10-06T02:51:00.651716+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:48.405419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.644380+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:50:59.644380+0000","last_peered":"2023-10-06T02:50:59.644380+0000","last_clean":"2023-10-06T02:50:59.644380+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:50:59.644380+0000","last_undegraded":"2023-10-06T02:50:59.644380+0000","last_fullsized":"2023-10-06T02:50:59.644380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645711+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:17.134930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647127+0000","last_change":"2023-10-06T02:51:00.647127+0000","last_active":"2023-10-06T02:51:00.647127+0000","last_peered":"2023-10-06T02:51:00.647127+0000","last_clean":"2023-10-06T02:51:00.647127+0000","last_became_active":"2023-10-06T02:51:00.646586+0000","last_became_peered":"2023-10-06T02:51:00.646586+0000","last_unstale":"2023-10-06T02:51:00.647127+0000","last_undegraded":"2023-10-06T02:51:00.647127+0000","last_fullsized":"2023-10-06T02:51:00.647127+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:08.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.644712+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:50:59.644712+0000","last_peered":"2023-10-06T02:50:59.644712+0000","last_clean":"2023-10-06T02:50:59.644712+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:50:59.644712+0000","last_undegraded":"2023-10-06T02:50:59.644712+0000","last_fullsized":"2023-10-06T02:50:59.644712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198846042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":1.393,"15min":1.393},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67400000000000004,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.504}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":1.081,"15min":1.081},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.70999999999999996,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48099999999999998},"min":{"1min":0.46200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70099999999999996,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.63200000000000001},"min":{"1min":0.41799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70499999999999996,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61899999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68300000000000005,"5min":0.879,"15min":0.879},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68700000000000006,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69499999999999995,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":1.879,"15min":1.879},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67400000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.78300000000000003,"15min":1.028},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68700000000000006,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67400000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67900000000000005,"5min":1.163,"15min":1.163},"last":0.626}]},{"osd":4,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":1.05,"15min":1.05},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.753},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.61899999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72799999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.63},"min":{"1min":0.39200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.60599999999999998},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.31,"15min":0.312},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.247},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.26900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34200000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38900000000000001,"15min":0.38},"min":{"1min":0.313,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.374},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.36599999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69399999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46700000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77800000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.47399999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.443,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.47799999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198846042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34999999999999998},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47999999999999998,"5min":1.177,"15min":1.177},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38800000000000001,"15min":0.39800000000000002},"min":{"1min":0.23499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65100000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.75800000000000001,"15min":1.181},"min":{"1min":0.216,"5min":0.188,"15min":0.188},"max":{"1min":0.56000000000000005,"5min":22.038,"15min":22.038},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.26200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.60399999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.311},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.79600000000000004,"15min":1.2110000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.63300000000000001,"5min":21.942,"15min":21.942},"last":0.503}]},{"osd":4,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.91000000000000003,"15min":1.264},"min":{"1min":0.46400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86499999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.96899999999999997,"15min":1.367},"min":{"1min":0.46300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.441},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.47699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":1.401,"15min":1.401},"last":0.47199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.93899999999999995,"15min":1.294},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.98999999999999999,"15min":1.3939999999999999},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80900000000000005,"5min":21.98,"15min":21.98},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.88800000000000001,"5min":1.425,"15min":1.425},"last":0.753},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.78300000000000003,"15min":0.96599999999999997},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81899999999999995,"5min":11.154,"15min":11.154},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52900000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.20999999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.51500000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.498}]},{"osd":1,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"min":{"1min":0.25700000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.63,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.439},{"interface":"front","average":{"1min":0.433,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80000000000000004,"5min":0.875,"15min":0.875},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59399999999999997,"15min":0.57799999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79500000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57699999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.626},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.70199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.22700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.32300000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.371}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.309},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27900000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39200000000000002,"15min":0.36799999999999999},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.64800000000000002,"5min":3.044,"15min":3.044},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35599999999999998,"15min":0.33900000000000002},"min":{"1min":0.29899999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74099999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72999999999999998,"5min":2.25,"15min":2.25},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.70399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83599999999999997,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.80500000000000005,"15min":1.0049999999999999},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84199999999999997,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.66900000000000004,"15min":0.83699999999999997},"min":{"1min":0.33600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71699999999999997,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.56899999999999995,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.61599999999999999,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.69399999999999995,"15min":0.87},"min":{"1min":0.41399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70599999999999996,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.66600000000000004,"15min":0.81599999999999995},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.66800000000000004,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.376}]},{"osd":2,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.504},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61799999999999999,"15min":0.69799999999999995},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66100000000000003,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55300000000000005,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64700000000000002,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.626},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73799999999999999,"5min":3.456,"15min":3.456},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.49399999999999999},"min":{"1min":0.27500000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.499,"15min":0.51200000000000001},"min":{"1min":0.32900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.624}]},{"osd":6,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64200000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.83499999999999996,"15min":1.087},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73099999999999998,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.315,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.755,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.38500000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45700000000000002,"15min":0.45000000000000001},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.73699999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.879,"15min":0.879},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59399999999999997}]}]}],"pool_statfs":[]}} 2023-10-06T02:51:06.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-10-06T02:51:06.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.643417+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:24:26.457598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:51:06.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-10-06T02:51:06.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645560+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:51:06.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-10-06T02:51:06.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.643652+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:19:44.811795+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:51:06.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-10-06T02:51:06.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645573+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-10-06T02:51:06.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646029+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-10-06T02:51:06.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.647039+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:05:22.096231+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-10-06T02:51:06.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645884+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:22:44.963828+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:51:06.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-10-06T02:51:06.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.650244+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-10-06T02:51:06.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.648134+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-10-06T02:51:06.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645467+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:39:47.447725+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:51:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-10-06T02:51:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645220+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-10-06T02:51:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645626+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:29:09.179906+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:51:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-10-06T02:51:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.649918+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-10-06T02:51:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646354+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-10-06T02:51:06.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646379+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-10-06T02:51:06.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646688+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:57:12.065393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-10-06T02:51:06.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.647128+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:54:44.674521+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-10-06T02:51:06.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.643324+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:58:07.867628+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:51:06.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-10-06T02:51:06.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.647131+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-10-06T02:51:06.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646152+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-10-06T02:51:06.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646135+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-10-06T02:51:06.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646071+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-10-06T02:51:06.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646783+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:03:20.118823+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:51:06.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-10-06T02:51:06.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.642945+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:37:56.664986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:51:06.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-10-06T02:51:06.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645395+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:51:06.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-10-06T02:51:06.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645758+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-10-06T02:51:06.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645312+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:03:25.945455+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:51:06.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-10-06T02:51:06.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.649612+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-10-06T02:51:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.648721+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:18:44.030445+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:51:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-10-06T02:51:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645178+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-10-06T02:51:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645819+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:51:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-10-06T02:51:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646808+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:13:39.957393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-10-06T02:51:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646363+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:24:38.226167+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-10-06T02:51:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645071+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:02:16.943289+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-10-06T02:51:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.648297+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:32:50.512311+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:51:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-10-06T02:51:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646428+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:08:42.974701+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-10-06T02:51:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645818+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-10-06T02:51:06.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.648735+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:51:06.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-10-06T02:51:06.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646089+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:49:28.898095+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-10-06T02:51:06.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645862+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-10-06T02:51:06.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646792+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-10-06T02:51:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646701+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:53:12.319008+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:51:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-10-06T02:51:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.642911+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:51:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-10-06T02:51:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645885+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-10-06T02:51:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.647782+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:51:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-10-06T02:51:06.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645615+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-10-06T02:51:06.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646945+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:28:25.683904+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:51:06.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-10-06T02:51:06.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645017+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:34:53.419446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:51:06.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-10-06T02:51:06.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.647601+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:51:06.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-10-06T02:51:06.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646303+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:16:21.195790+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-10-06T02:51:06.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645358+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:16:05.854516+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-10-06T02:51:06.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.644507+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:51:06.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-10-06T02:51:06.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645022+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:49:21.511509+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:51:06.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-10-06T02:51:06.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.642914+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:57:39.916764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:51:06.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-10-06T02:51:06.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.647716+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:51:06.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-10-06T02:51:06.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645676+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:42:40.127983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-10-06T02:51:06.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.646009+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:13:45.035888+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-10-06T02:51:06.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.644444+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:51:06.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-10-06T02:51:06.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.647253+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:51:06.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-10-06T02:51:06.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.647542+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:03:02.670341+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:51:06.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-10-06T02:51:06.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645438+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:01:12.718116+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-10-06T02:51:06.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.644923+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:51:06.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-10-06T02:51:06.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.644390+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:51:06.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-10-06T02:51:06.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:51:00.638981+0000', 'last_change': '2023-10-06T02:51:00.645711+0000', 'last_active': '2023-10-06T02:51:00.638981+0000', 'last_peered': '2023-10-06T02:51:00.638981+0000', 'last_clean': '2023-10-06T02:51:00.638981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:51:00.638981+0000', 'last_undegraded': '2023-10-06T02:51:00.638981+0000', 'last_fullsized': '2023-10-06T02:51:00.638981+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'last_clean_scrub_stamp': '2023-10-06T02:51:00.638981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:24:17.134930+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:51:06.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:51:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.607+0000 7f7e1b81a700 1 Processor -- start 2023-10-06T02:51:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.607+0000 7f7e1b81a700 1 -- start start 2023-10-06T02:51:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e1b81a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7e14157bb0 0x7f7e1415b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e1b81a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1406d240 0x7f7e1406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e1b81a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1406dbe0 con 0x7f7e141577e0 2023-10-06T02:51:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e1b81a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140cfdd0 con 0x7f7e14157bb0 2023-10-06T02:51:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e1b81a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140d00b0 con 0x7f7e1406d240 2023-10-06T02:51:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e18db5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7e14157bb0 0x7f7e1415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e19db7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1406d240 0x7f7e1406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e19db7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1406d240 0x7f7e1406d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:41750/0 (socket says 172.21.15.81:41750) 2023-10-06T02:51:06.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e195b6700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7e141577e0 0x7f7e140cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:38222/0 (socket says 172.21.15.81:38222) 2023-10-06T02:51:06.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e19db7700 1 -- 172.21.15.81:0/1170670955 learned_addr learned my addr 172.21.15.81:0/1170670955 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:06.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e18db5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7e14157bb0 0x7f7e1415b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:46682/0 (socket says 172.21.15.81:46682) 2023-10-06T02:51:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e19db7700 1 -- 172.21.15.81:0/1170670955 >> v2:172.21.15.83:3300/0 conn(0x7f7e14157bb0 msgr2=0x7f7e1415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e19db7700 1 --2- 172.21.15.81:0/1170670955 >> v2:172.21.15.83:3300/0 conn(0x7f7e14157bb0 0x7f7e1415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e19db7700 1 -- 172.21.15.81:0/1170670955 >> v1:172.21.15.83:6789/0 conn(0x7f7e141577e0 legacy=0x7f7e140cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e19db7700 1 -- 172.21.15.81:0/1170670955 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140d0390 con 0x7f7e1406d240 2023-10-06T02:51:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e18db5700 1 --2- 172.21.15.81:0/1170670955 >> v2:172.21.15.83:3300/0 conn(0x7f7e14157bb0 0x7f7e1415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.608+0000 7f7e19db7700 1 --2- 172.21.15.81:0/1170670955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1406d240 0x7f7e1406d6a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009f20 tx=0x7f7e0c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba03cc7b36bf1a32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e0bfff700 1 -- 172.21.15.81:0/1170670955 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00e070 con 0x7f7e1406d240 2023-10-06T02:51:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e0bfff700 1 -- 172.21.15.81:0/1170670955 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c00b9d0 con 0x7f7e1406d240 2023-10-06T02:51:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e0bfff700 1 -- 172.21.15.81:0/1170670955 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0092e0 con 0x7f7e1406d240 2023-10-06T02:51:06.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e1b81a700 1 -- 172.21.15.81:0/1170670955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1406d240 msgr2=0x7f7e1406d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e1b81a700 1 --2- 172.21.15.81:0/1170670955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1406d240 0x7f7e1406d6a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009f20 tx=0x7f7e0c009840 comp rx=0 tx=0).stop 2023-10-06T02:51:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e1b81a700 1 -- 172.21.15.81:0/1170670955 shutdown_connections 2023-10-06T02:51:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e1b81a700 1 --2- 172.21.15.81:0/1170670955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1406d240 0x7f7e1406d6a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e1b81a700 1 --2- 172.21.15.81:0/1170670955 >> v2:172.21.15.83:3300/0 conn(0x7f7e14157bb0 0x7f7e1415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e1b81a700 1 -- 172.21.15.81:0/1170670955 >> 172.21.15.81:0/1170670955 conn(0x7f7e1406bb90 msgr2=0x7f7e1406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e1b81a700 1 -- 172.21.15.81:0/1170670955 shutdown_connections 2023-10-06T02:51:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.609+0000 7f7e1b81a700 1 -- 172.21.15.81:0/1170670955 wait complete. 2023-10-06T02:51:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.610+0000 7f7e1b81a700 1 Processor -- start 2023-10-06T02:51:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.610+0000 7f7e1b81a700 1 -- start start 2023-10-06T02:51:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e1b81a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1406d240 0x7f7e141548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e1b81a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e141577e0 0x7f7e140ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e1b81a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e14157bb0 0x7f7e140ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e1b81a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1415d870 con 0x7f7e1406d240 2023-10-06T02:51:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e1b81a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1415db50 con 0x7f7e141577e0 2023-10-06T02:51:06.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e1b81a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1415de30 con 0x7f7e14157bb0 2023-10-06T02:51:06.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e195b6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1406d240 0x7f7e141548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e195b6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1406d240 0x7f7e141548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37742/0 (socket says 172.21.15.81:37742) 2023-10-06T02:51:06.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e195b6700 1 -- 172.21.15.81:0/3906510564 learned_addr learned my addr 172.21.15.81:0/3906510564 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:06.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e19db7700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e14157bb0 0x7f7e140ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.611+0000 7f7e18db5700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e141577e0 0x7f7e140ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e195b6700 1 -- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e14157bb0 msgr2=0x7f7e140ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e195b6700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e14157bb0 0x7f7e140ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e195b6700 1 -- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e141577e0 msgr2=0x7f7e140ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e195b6700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e141577e0 0x7f7e140ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e195b6700 1 -- 172.21.15.81:0/3906510564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009420 con 0x7f7e1406d240 2023-10-06T02:51:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e195b6700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1406d240 0x7f7e141548c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000c7c0 tx=0x7f7e10007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e097fa700 1 -- 172.21.15.81:0/3906510564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10005a70 con 0x7f7e1406d240 2023-10-06T02:51:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e097fa700 1 -- 172.21.15.81:0/3906510564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e10005bd0 con 0x7f7e1406d240 2023-10-06T02:51:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c009ae0 con 0x7f7e1406d240 2023-10-06T02:51:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e097fa700 1 -- 172.21.15.81:0/3906510564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100070d0 con 0x7f7e1406d240 2023-10-06T02:51:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.612+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1416a440 con 0x7f7e1406d240 2023-10-06T02:51:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.613+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e140cee40 con 0x7f7e1406d240 2023-10-06T02:51:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.613+0000 7f7e097fa700 1 -- 172.21.15.81:0/3906510564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e10007440 con 0x7f7e1406d240 2023-10-06T02:51:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.614+0000 7f7e097fa700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7df8066f30 0x7f7df80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.614+0000 7f7e097fa700 1 -- 172.21.15.81:0/3906510564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7e100838d0 con 0x7f7e1406d240 2023-10-06T02:51:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.614+0000 7f7e18db5700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7df8066f30 0x7f7df80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.614+0000 7f7e18db5700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7df8066f30 0x7f7df80693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009ea0 tx=0x7f7e040091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.618+0000 7f7e097fa700 1 -- 172.21.15.81:0/3906510564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e100509e0 con 0x7f7e1406d240 2023-10-06T02:51:06.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.876+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7e1404bb80 con 0x7f7e1406d240 2023-10-06T02:51:06.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.877+0000 7f7e097fa700 1 -- 172.21.15.81:0/3906510564 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1450 (secure 0 0 0) 0x7f7e10017080 con 0x7f7e1406d240 2023-10-06T02:51:06.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:06.879 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":317,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560354,"num_in_osds":8,"osd_in_since":1696560351,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":5689456,"bytes_avail":1594310544,"bytes_total":1600000000,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":52,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6465}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-06T02:50:43.559768+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:51:06.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7df8066f30 msgr2=0x7f7df80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7df8066f30 0x7f7df80693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009ea0 tx=0x7f7e040091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1406d240 msgr2=0x7f7e141548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:06.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1406d240 0x7f7e141548c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000c7c0 tx=0x7f7e10007f30 comp rx=0 tx=0).stop 2023-10-06T02:51:06.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 shutdown_connections 2023-10-06T02:51:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e14157bb0 0x7f7e140ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1406d240 0x7f7e141548c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7df8066f30 0x7f7df80693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 --2- 172.21.15.81:0/3906510564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e141577e0 0x7f7e140ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 >> 172.21.15.81:0/3906510564 conn(0x7f7e1406bb90 msgr2=0x7f7e14156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 shutdown_connections 2023-10-06T02:51:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:06.879+0000 7f7e1b81a700 1 -- 172.21.15.81:0/3906510564 wait complete. 2023-10-06T02:51:06.892 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:51:06.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:51:06.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:51:06.937 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:51:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.008+0000 7fef27ccb700 1 Processor -- start 2023-10-06T02:51:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.008+0000 7fef27ccb700 1 -- start start 2023-10-06T02:51:07.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.009+0000 7fef27ccb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef201578d0 0x7fef200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:07.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.009+0000 7fef27ccb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef20157ca0 0x7fef2015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:07.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.009+0000 7fef27ccb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200d07c0 con 0x7fef2006d120 2023-10-06T02:51:07.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.009+0000 7fef27ccb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef200cfbb0 con 0x7fef201578d0 2023-10-06T02:51:07.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.009+0000 7fef27ccb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef200cfe90 con 0x7fef20157ca0 2023-10-06T02:51:07.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.009+0000 7fef25a67700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef201578d0 0x7fef200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:07.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.009+0000 7fef25a67700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef201578d0 0x7fef200cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37748/0 (socket says 172.21.15.81:37748) 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.009+0000 7fef25a67700 1 -- 172.21.15.81:0/1054616815 learned_addr learned my addr 172.21.15.81:0/1054616815 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef25a67700 1 -- 172.21.15.81:0/1054616815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef20157ca0 msgr2=0x7fef2015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef25a67700 1 --2- 172.21.15.81:0/1054616815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef20157ca0 0x7fef2015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef25a67700 1 -- 172.21.15.81:0/1054616815 >> v1:172.21.15.83:6789/0 conn(0x7fef2006d120 legacy=0x7fef2015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef25a67700 1 -- 172.21.15.81:0/1054616815 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200d0170 con 0x7fef201578d0 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef25a67700 1 --2- 172.21.15.81:0/1054616815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef201578d0 0x7fef200cf4f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009f20 tx=0x7fef1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4f8fbe8590c681 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef24a65700 1 -- 172.21.15.81:0/1054616815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00e070 con 0x7fef201578d0 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef24a65700 1 -- 172.21.15.81:0/1054616815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00ba40 con 0x7fef201578d0 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef24a65700 1 -- 172.21.15.81:0/1054616815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0092e0 con 0x7fef201578d0 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef27ccb700 1 -- 172.21.15.81:0/1054616815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef201578d0 msgr2=0x7fef200cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef27ccb700 1 --2- 172.21.15.81:0/1054616815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef201578d0 0x7fef200cf4f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009f20 tx=0x7fef1c009840 comp rx=0 tx=0).stop 2023-10-06T02:51:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef27ccb700 1 -- 172.21.15.81:0/1054616815 shutdown_connections 2023-10-06T02:51:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef27ccb700 1 --2- 172.21.15.81:0/1054616815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef201578d0 0x7fef200cf4f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef27ccb700 1 --2- 172.21.15.81:0/1054616815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef20157ca0 0x7fef2015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef27ccb700 1 -- 172.21.15.81:0/1054616815 >> 172.21.15.81:0/1054616815 conn(0x7fef2006bb90 msgr2=0x7fef2006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef27ccb700 1 -- 172.21.15.81:0/1054616815 shutdown_connections 2023-10-06T02:51:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.010+0000 7fef27ccb700 1 -- 172.21.15.81:0/1054616815 wait complete. 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.011+0000 7fef27ccb700 1 Processor -- start 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef27ccb700 1 -- start start 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef27ccb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef2006d120 0x7fef200b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef27ccb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef201578d0 0x7fef200b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef27ccb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef20157ca0 0x7fef2016a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef27ccb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200ac010 con 0x7fef20157ca0 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef27ccb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200ac2f0 con 0x7fef201578d0 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef27ccb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef200b5470 con 0x7fef2006d120 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef26268700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef20157ca0 0x7fef2016a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef26268700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef20157ca0 0x7fef2016a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37762/0 (socket says 172.21.15.81:37762) 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef26268700 1 -- 172.21.15.81:0/3772576479 learned_addr learned my addr 172.21.15.81:0/3772576479 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.012+0000 7fef25a67700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef2006d120 0x7fef200b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef25266700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef201578d0 0x7fef200b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef26268700 1 -- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef2006d120 msgr2=0x7fef200b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef26268700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef2006d120 0x7fef200b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef26268700 1 -- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef201578d0 msgr2=0x7fef200b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef26268700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef201578d0 0x7fef200b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef26268700 1 -- 172.21.15.81:0/3772576479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009ae0 con 0x7fef20157ca0 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef25a67700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef2006d120 0x7fef200b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef26268700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef20157ca0 0x7fef2016a7a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fef1800b610 tx=0x7fef18009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:07.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef15ffb700 1 -- 172.21.15.81:0/3772576479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800f510 con 0x7fef20157ca0 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef15ffb700 1 -- 172.21.15.81:0/3772576479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800f690 con 0x7fef20157ca0 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef200b5750 con 0x7fef20157ca0 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef15ffb700 1 -- 172.21.15.81:0/3772576479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800fa50 con 0x7fef20157ca0 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.013+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef200b50b0 con 0x7fef20157ca0 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.014+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef20067ac0 con 0x7fef20157ca0 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.014+0000 7fef15ffb700 1 -- 172.21.15.81:0/3772576479 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef1801a400 con 0x7fef20157ca0 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.015+0000 7fef15ffb700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066fb0 0x7fef04069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.015+0000 7fef15ffb700 1 -- 172.21.15.81:0/3772576479 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fef180841a0 con 0x7fef20157ca0 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.015+0000 7fef25a67700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066fb0 0x7fef04069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:07.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.016+0000 7fef25a67700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066fb0 0x7fef04069460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009880 tx=0x7fef1c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:07.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.019+0000 7fef15ffb700 1 -- 172.21.15.81:0/3772576479 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef18051290 con 0x7fef20157ca0 2023-10-06T02:51:07.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.197+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef200ac430 con 0x7fef04066fb0 2023-10-06T02:51:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.206+0000 7fef15ffb700 1 -- 172.21.15.81:0/3772576479 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302834 (secure 0 0 0) 0x7fef200ac430 con 0x7fef04066fb0 2023-10-06T02:51:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:07.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066fb0 msgr2=0x7fef04069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:07.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066fb0 0x7fef04069460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009880 tx=0x7fef1c017000 comp rx=0 tx=0).stop 2023-10-06T02:51:07.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef20157ca0 msgr2=0x7fef2016a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:07.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef20157ca0 0x7fef2016a7a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fef1800b610 tx=0x7fef18009120 comp rx=0 tx=0).stop 2023-10-06T02:51:07.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 shutdown_connections 2023-10-06T02:51:07.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef20157ca0 0x7fef2016a7a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef2006d120 0x7fef200b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef04066fb0 0x7fef04069460 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 --2- 172.21.15.81:0/3772576479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef201578d0 0x7fef200b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 >> 172.21.15.81:0/3772576479 conn(0x7fef2006bb90 msgr2=0x7fef2006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 shutdown_connections 2023-10-06T02:51:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:07.209+0000 7fef27ccb700 1 -- 172.21.15.81:0/3772576479 wait complete. 2023-10-06T02:51:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:51:07.223 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-10-06T02:51:05.564344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5556,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556943,"statfs":{"total":1600000000,"available":1594310544,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.924741"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643417+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.457598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645560+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643652+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:44.811795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645573+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646029+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647039+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:22.096231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645884+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:44.963828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.650244+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648134+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645467+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:47.447725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645220+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645626+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:09.179906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.649918+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646354+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646379+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646688+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:12.065393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647128+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:44.674521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.643324+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:07.867628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647131+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646152+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646135+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646071+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646783+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:20.118823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642945+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:56.664986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645395+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645758+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645312+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:25.945455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.649612+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:33.248109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648721+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:44.030445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645178+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645819+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:44.508746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646808+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:39.957393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646363+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:38.226167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652649+0000","last_change":"2023-10-06T02:51:00.652649+0000","last_active":"2023-10-06T02:51:00.652649+0000","last_peered":"2023-10-06T02:51:00.652649+0000","last_clean":"2023-10-06T02:51:00.652649+0000","last_became_active":"2023-10-06T02:51:00.652282+0000","last_became_peered":"2023-10-06T02:51:00.652282+0000","last_unstale":"2023-10-06T02:51:00.652649+0000","last_undegraded":"2023-10-06T02:51:00.652649+0000","last_fullsized":"2023-10-06T02:51:00.652649+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645071+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:02:16.943289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.655589+0000","last_change":"2023-10-06T02:51:00.655589+0000","last_active":"2023-10-06T02:51:00.655589+0000","last_peered":"2023-10-06T02:51:00.655589+0000","last_clean":"2023-10-06T02:51:00.655589+0000","last_became_active":"2023-10-06T02:51:00.655326+0000","last_became_peered":"2023-10-06T02:51:00.655326+0000","last_unstale":"2023-10-06T02:51:00.655589+0000","last_undegraded":"2023-10-06T02:51:00.655589+0000","last_fullsized":"2023-10-06T02:51:00.655589+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648297+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:50.512311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650807+0000","last_change":"2023-10-06T02:51:00.650807+0000","last_active":"2023-10-06T02:51:00.650807+0000","last_peered":"2023-10-06T02:51:00.650807+0000","last_clean":"2023-10-06T02:51:00.650807+0000","last_became_active":"2023-10-06T02:51:00.650541+0000","last_became_peered":"2023-10-06T02:51:00.650541+0000","last_unstale":"2023-10-06T02:51:00.650807+0000","last_undegraded":"2023-10-06T02:51:00.650807+0000","last_fullsized":"2023-10-06T02:51:00.650807+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:06.863934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646428+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:42.974701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.655112+0000","last_change":"2023-10-06T02:51:00.655112+0000","last_active":"2023-10-06T02:51:00.655112+0000","last_peered":"2023-10-06T02:51:00.655112+0000","last_clean":"2023-10-06T02:51:00.655112+0000","last_became_active":"2023-10-06T02:51:00.654869+0000","last_became_peered":"2023-10-06T02:51:00.654869+0000","last_unstale":"2023-10-06T02:51:00.655112+0000","last_undegraded":"2023-10-06T02:51:00.655112+0000","last_fullsized":"2023-10-06T02:51:00.655112+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:37.828589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645818+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.648859+0000","last_change":"2023-10-06T02:51:00.648859+0000","last_active":"2023-10-06T02:51:00.648859+0000","last_peered":"2023-10-06T02:51:00.648859+0000","last_clean":"2023-10-06T02:51:00.648859+0000","last_became_active":"2023-10-06T02:51:00.648625+0000","last_became_peered":"2023-10-06T02:51:00.648625+0000","last_unstale":"2023-10-06T02:51:00.648859+0000","last_undegraded":"2023-10-06T02:51:00.648859+0000","last_fullsized":"2023-10-06T02:51:00.648859+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.648735+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653298+0000","last_change":"2023-10-06T02:51:00.653298+0000","last_active":"2023-10-06T02:51:00.653298+0000","last_peered":"2023-10-06T02:51:00.653298+0000","last_clean":"2023-10-06T02:51:00.653298+0000","last_became_active":"2023-10-06T02:51:00.652806+0000","last_became_peered":"2023-10-06T02:51:00.652806+0000","last_unstale":"2023-10-06T02:51:00.653298+0000","last_undegraded":"2023-10-06T02:51:00.653298+0000","last_fullsized":"2023-10-06T02:51:00.653298+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646089+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:28.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650485+0000","last_change":"2023-10-06T02:51:00.650485+0000","last_active":"2023-10-06T02:51:00.650485+0000","last_peered":"2023-10-06T02:51:00.650485+0000","last_clean":"2023-10-06T02:51:00.650485+0000","last_became_active":"2023-10-06T02:51:00.650261+0000","last_became_peered":"2023-10-06T02:51:00.650261+0000","last_unstale":"2023-10-06T02:51:00.650485+0000","last_undegraded":"2023-10-06T02:51:00.650485+0000","last_fullsized":"2023-10-06T02:51:00.650485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:01.366512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645862+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654402+0000","last_change":"2023-10-06T02:51:00.654402+0000","last_active":"2023-10-06T02:51:00.654402+0000","last_peered":"2023-10-06T02:51:00.654402+0000","last_clean":"2023-10-06T02:51:00.654402+0000","last_became_active":"2023-10-06T02:51:00.653618+0000","last_became_peered":"2023-10-06T02:51:00.653618+0000","last_unstale":"2023-10-06T02:51:00.654402+0000","last_undegraded":"2023-10-06T02:51:00.654402+0000","last_fullsized":"2023-10-06T02:51:00.654402+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:43.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646792+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651057+0000","last_change":"2023-10-06T02:51:00.651057+0000","last_active":"2023-10-06T02:51:00.651057+0000","last_peered":"2023-10-06T02:51:00.651057+0000","last_clean":"2023-10-06T02:51:00.651057+0000","last_became_active":"2023-10-06T02:51:00.650684+0000","last_became_peered":"2023-10-06T02:51:00.650684+0000","last_unstale":"2023-10-06T02:51:00.651057+0000","last_undegraded":"2023-10-06T02:51:00.651057+0000","last_fullsized":"2023-10-06T02:51:00.651057+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:03.696166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646701+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:12.319008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647297+0000","last_change":"2023-10-06T02:51:00.647297+0000","last_active":"2023-10-06T02:51:00.647297+0000","last_peered":"2023-10-06T02:51:00.647297+0000","last_clean":"2023-10-06T02:51:00.647297+0000","last_became_active":"2023-10-06T02:51:00.646978+0000","last_became_peered":"2023-10-06T02:51:00.646978+0000","last_unstale":"2023-10-06T02:51:00.647297+0000","last_undegraded":"2023-10-06T02:51:00.647297+0000","last_fullsized":"2023-10-06T02:51:00.647297+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:38.756816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642911+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.650607+0000","last_change":"2023-10-06T02:51:00.650607+0000","last_active":"2023-10-06T02:51:00.650607+0000","last_peered":"2023-10-06T02:51:00.650607+0000","last_clean":"2023-10-06T02:51:00.650607+0000","last_became_active":"2023-10-06T02:51:00.650350+0000","last_became_peered":"2023-10-06T02:51:00.650350+0000","last_unstale":"2023-10-06T02:51:00.650607+0000","last_undegraded":"2023-10-06T02:51:00.650607+0000","last_fullsized":"2023-10-06T02:51:00.650607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645885+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654538+0000","last_change":"2023-10-06T02:51:00.654538+0000","last_active":"2023-10-06T02:51:00.654538+0000","last_peered":"2023-10-06T02:51:00.654538+0000","last_clean":"2023-10-06T02:51:00.654538+0000","last_became_active":"2023-10-06T02:51:00.654180+0000","last_became_peered":"2023-10-06T02:51:00.654180+0000","last_unstale":"2023-10-06T02:51:00.654538+0000","last_undegraded":"2023-10-06T02:51:00.654538+0000","last_fullsized":"2023-10-06T02:51:00.654538+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:27.687050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647782+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654543+0000","last_change":"2023-10-06T02:51:00.654543+0000","last_active":"2023-10-06T02:51:00.654543+0000","last_peered":"2023-10-06T02:51:00.654543+0000","last_clean":"2023-10-06T02:51:00.654543+0000","last_became_active":"2023-10-06T02:51:00.653929+0000","last_became_peered":"2023-10-06T02:51:00.653929+0000","last_unstale":"2023-10-06T02:51:00.654543+0000","last_undegraded":"2023-10-06T02:51:00.654543+0000","last_fullsized":"2023-10-06T02:51:00.654543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:55.661291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645615+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.409113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651432+0000","last_change":"2023-10-06T02:51:00.651432+0000","last_active":"2023-10-06T02:51:00.651432+0000","last_peered":"2023-10-06T02:51:00.651432+0000","last_clean":"2023-10-06T02:51:00.651432+0000","last_became_active":"2023-10-06T02:51:00.650760+0000","last_became_peered":"2023-10-06T02:51:00.650760+0000","last_unstale":"2023-10-06T02:51:00.651432+0000","last_undegraded":"2023-10-06T02:51:00.651432+0000","last_fullsized":"2023-10-06T02:51:00.651432+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:01.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646945+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:25.683904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654687+0000","last_change":"2023-10-06T02:51:00.654687+0000","last_active":"2023-10-06T02:51:00.654687+0000","last_peered":"2023-10-06T02:51:00.654687+0000","last_clean":"2023-10-06T02:51:00.654687+0000","last_became_active":"2023-10-06T02:51:00.654476+0000","last_became_peered":"2023-10-06T02:51:00.654476+0000","last_unstale":"2023-10-06T02:51:00.654687+0000","last_undegraded":"2023-10-06T02:51:00.654687+0000","last_fullsized":"2023-10-06T02:51:00.654687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645017+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:53.419446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653428+0000","last_change":"2023-10-06T02:51:00.653428+0000","last_active":"2023-10-06T02:51:00.653428+0000","last_peered":"2023-10-06T02:51:00.653428+0000","last_clean":"2023-10-06T02:51:00.653428+0000","last_became_active":"2023-10-06T02:51:00.653084+0000","last_became_peered":"2023-10-06T02:51:00.653084+0000","last_unstale":"2023-10-06T02:51:00.653428+0000","last_undegraded":"2023-10-06T02:51:00.653428+0000","last_fullsized":"2023-10-06T02:51:00.653428+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647601+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:11.919395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652974+0000","last_change":"2023-10-06T02:51:00.652974+0000","last_active":"2023-10-06T02:51:00.652974+0000","last_peered":"2023-10-06T02:51:00.652974+0000","last_clean":"2023-10-06T02:51:00.652974+0000","last_became_active":"2023-10-06T02:51:00.652757+0000","last_became_peered":"2023-10-06T02:51:00.652757+0000","last_unstale":"2023-10-06T02:51:00.652974+0000","last_undegraded":"2023-10-06T02:51:00.652974+0000","last_fullsized":"2023-10-06T02:51:00.652974+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:25.453904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646303+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:21.195790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.646008+0000","last_change":"2023-10-06T02:51:00.646008+0000","last_active":"2023-10-06T02:51:00.646008+0000","last_peered":"2023-10-06T02:51:00.646008+0000","last_clean":"2023-10-06T02:51:00.646008+0000","last_became_active":"2023-10-06T02:51:00.645802+0000","last_became_peered":"2023-10-06T02:51:00.645802+0000","last_unstale":"2023-10-06T02:51:00.646008+0000","last_undegraded":"2023-10-06T02:51:00.646008+0000","last_fullsized":"2023-10-06T02:51:00.646008+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:36.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645358+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:05.854516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654291+0000","last_change":"2023-10-06T02:51:00.654291+0000","last_active":"2023-10-06T02:51:00.654291+0000","last_peered":"2023-10-06T02:51:00.654291+0000","last_clean":"2023-10-06T02:51:00.654291+0000","last_became_active":"2023-10-06T02:51:00.653786+0000","last_became_peered":"2023-10-06T02:51:00.653786+0000","last_unstale":"2023-10-06T02:51:00.654291+0000","last_undegraded":"2023-10-06T02:51:00.654291+0000","last_fullsized":"2023-10-06T02:51:00.654291+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644507+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653380+0000","last_change":"2023-10-06T02:51:00.653380+0000","last_active":"2023-10-06T02:51:00.653380+0000","last_peered":"2023-10-06T02:51:00.653380+0000","last_clean":"2023-10-06T02:51:00.653380+0000","last_became_active":"2023-10-06T02:51:00.652913+0000","last_became_peered":"2023-10-06T02:51:00.652913+0000","last_unstale":"2023-10-06T02:51:00.653380+0000","last_undegraded":"2023-10-06T02:51:00.653380+0000","last_fullsized":"2023-10-06T02:51:00.653380+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645022+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:21.511509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654738+0000","last_change":"2023-10-06T02:51:00.654738+0000","last_active":"2023-10-06T02:51:00.654738+0000","last_peered":"2023-10-06T02:51:00.654738+0000","last_clean":"2023-10-06T02:51:00.654738+0000","last_became_active":"2023-10-06T02:51:00.654487+0000","last_became_peered":"2023-10-06T02:51:00.654487+0000","last_unstale":"2023-10-06T02:51:00.654738+0000","last_undegraded":"2023-10-06T02:51:00.654738+0000","last_fullsized":"2023-10-06T02:51:00.654738+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:43.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.642914+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:39.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647402+0000","last_change":"2023-10-06T02:51:00.647402+0000","last_active":"2023-10-06T02:51:00.647402+0000","last_peered":"2023-10-06T02:51:00.647402+0000","last_clean":"2023-10-06T02:51:00.647402+0000","last_became_active":"2023-10-06T02:51:00.646818+0000","last_became_peered":"2023-10-06T02:51:00.646818+0000","last_unstale":"2023-10-06T02:51:00.647402+0000","last_undegraded":"2023-10-06T02:51:00.647402+0000","last_fullsized":"2023-10-06T02:51:00.647402+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:31.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647716+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:32.956752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652500+0000","last_change":"2023-10-06T02:51:00.652500+0000","last_active":"2023-10-06T02:51:00.652500+0000","last_peered":"2023-10-06T02:51:00.652500+0000","last_clean":"2023-10-06T02:51:00.652500+0000","last_became_active":"2023-10-06T02:51:00.651985+0000","last_became_peered":"2023-10-06T02:51:00.651985+0000","last_unstale":"2023-10-06T02:51:00.652500+0000","last_undegraded":"2023-10-06T02:51:00.652500+0000","last_fullsized":"2023-10-06T02:51:00.652500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645676+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:40.127983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652502+0000","last_change":"2023-10-06T02:51:00.652502+0000","last_active":"2023-10-06T02:51:00.652502+0000","last_peered":"2023-10-06T02:51:00.652502+0000","last_clean":"2023-10-06T02:51:00.652502+0000","last_became_active":"2023-10-06T02:51:00.652287+0000","last_became_peered":"2023-10-06T02:51:00.652287+0000","last_unstale":"2023-10-06T02:51:00.652502+0000","last_undegraded":"2023-10-06T02:51:00.652502+0000","last_fullsized":"2023-10-06T02:51:00.652502+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:38.913069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.646009+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:45.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.649652+0000","last_change":"2023-10-06T02:51:00.649652+0000","last_active":"2023-10-06T02:51:00.649652+0000","last_peered":"2023-10-06T02:51:00.649652+0000","last_clean":"2023-10-06T02:51:00.649652+0000","last_became_active":"2023-10-06T02:51:00.649414+0000","last_became_peered":"2023-10-06T02:51:00.649414+0000","last_unstale":"2023-10-06T02:51:00.649652+0000","last_undegraded":"2023-10-06T02:51:00.649652+0000","last_fullsized":"2023-10-06T02:51:00.649652+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:10.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643973+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:50:59.643973+0000","last_peered":"2023-10-06T02:50:59.643973+0000","last_clean":"2023-10-06T02:50:59.643973+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:50:59.643973+0000","last_undegraded":"2023-10-06T02:50:59.643973+0000","last_fullsized":"2023-10-06T02:50:59.643973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644444+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.652167+0000","last_change":"2023-10-06T02:51:00.652167+0000","last_active":"2023-10-06T02:51:00.652167+0000","last_peered":"2023-10-06T02:51:00.652167+0000","last_clean":"2023-10-06T02:51:00.652167+0000","last_became_active":"2023-10-06T02:51:00.651572+0000","last_became_peered":"2023-10-06T02:51:00.651572+0000","last_unstale":"2023-10-06T02:51:00.652167+0000","last_undegraded":"2023-10-06T02:51:00.652167+0000","last_fullsized":"2023-10-06T02:51:00.652167+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641162+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:50:59.641162+0000","last_peered":"2023-10-06T02:50:59.641162+0000","last_clean":"2023-10-06T02:50:59.641162+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:50:59.641162+0000","last_undegraded":"2023-10-06T02:50:59.641162+0000","last_fullsized":"2023-10-06T02:50:59.641162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647253+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:23.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.654701+0000","last_change":"2023-10-06T02:51:00.654701+0000","last_active":"2023-10-06T02:51:00.654701+0000","last_peered":"2023-10-06T02:51:00.654701+0000","last_clean":"2023-10-06T02:51:00.654701+0000","last_became_active":"2023-10-06T02:51:00.654174+0000","last_became_peered":"2023-10-06T02:51:00.654174+0000","last_unstale":"2023-10-06T02:51:00.654701+0000","last_undegraded":"2023-10-06T02:51:00.654701+0000","last_fullsized":"2023-10-06T02:51:00.654701+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:22.851612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641963+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:50:59.641963+0000","last_peered":"2023-10-06T02:50:59.641963+0000","last_clean":"2023-10-06T02:50:59.641963+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:50:59.641963+0000","last_undegraded":"2023-10-06T02:50:59.641963+0000","last_fullsized":"2023-10-06T02:50:59.641963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.647542+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:02.670341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651643+0000","last_change":"2023-10-06T02:51:00.651643+0000","last_active":"2023-10-06T02:51:00.651643+0000","last_peered":"2023-10-06T02:51:00.651643+0000","last_clean":"2023-10-06T02:51:00.651643+0000","last_became_active":"2023-10-06T02:51:00.651163+0000","last_became_peered":"2023-10-06T02:51:00.651163+0000","last_unstale":"2023-10-06T02:51:00.651643+0000","last_undegraded":"2023-10-06T02:51:00.651643+0000","last_fullsized":"2023-10-06T02:51:00.651643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.641285+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:50:59.641285+0000","last_peered":"2023-10-06T02:50:59.641285+0000","last_clean":"2023-10-06T02:50:59.641285+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:50:59.641285+0000","last_undegraded":"2023-10-06T02:50:59.641285+0000","last_fullsized":"2023-10-06T02:50:59.641285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":232,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643465+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:50:59.643465+0000","last_peered":"2023-10-06T02:50:59.643465+0000","last_clean":"2023-10-06T02:50:59.643465+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:50:59.643465+0000","last_undegraded":"2023-10-06T02:50:59.643465+0000","last_fullsized":"2023-10-06T02:50:59.643465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645438+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:12.718116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.653681+0000","last_change":"2023-10-06T02:51:00.653681+0000","last_active":"2023-10-06T02:51:00.653681+0000","last_peered":"2023-10-06T02:51:00.653681+0000","last_clean":"2023-10-06T02:51:00.653681+0000","last_became_active":"2023-10-06T02:51:00.653235+0000","last_became_peered":"2023-10-06T02:51:00.653235+0000","last_unstale":"2023-10-06T02:51:00.653681+0000","last_undegraded":"2023-10-06T02:51:00.653681+0000","last_fullsized":"2023-10-06T02:51:00.653681+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643369+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:50:59.643369+0000","last_peered":"2023-10-06T02:50:59.643369+0000","last_clean":"2023-10-06T02:50:59.643369+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:50:59.643369+0000","last_undegraded":"2023-10-06T02:50:59.643369+0000","last_fullsized":"2023-10-06T02:50:59.643369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644923+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.644728+0000","last_change":"2023-10-06T02:51:00.644728+0000","last_active":"2023-10-06T02:51:00.644728+0000","last_peered":"2023-10-06T02:51:00.644728+0000","last_clean":"2023-10-06T02:51:00.644728+0000","last_became_active":"2023-10-06T02:51:00.644509+0000","last_became_peered":"2023-10-06T02:51:00.644509+0000","last_unstale":"2023-10-06T02:51:00.644728+0000","last_undegraded":"2023-10-06T02:51:00.644728+0000","last_fullsized":"2023-10-06T02:51:00.644728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:33.751928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.643554+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:50:59.643554+0000","last_peered":"2023-10-06T02:50:59.643554+0000","last_clean":"2023-10-06T02:50:59.643554+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:50:59.643554+0000","last_undegraded":"2023-10-06T02:50:59.643554+0000","last_fullsized":"2023-10-06T02:50:59.643554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.644390+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.651716+0000","last_change":"2023-10-06T02:51:00.651716+0000","last_active":"2023-10-06T02:51:00.651716+0000","last_peered":"2023-10-06T02:51:00.651716+0000","last_clean":"2023-10-06T02:51:00.651716+0000","last_became_active":"2023-10-06T02:51:00.651468+0000","last_became_peered":"2023-10-06T02:51:00.651468+0000","last_unstale":"2023-10-06T02:51:00.651716+0000","last_undegraded":"2023-10-06T02:51:00.651716+0000","last_fullsized":"2023-10-06T02:51:00.651716+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:48.405419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.644380+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:50:59.644380+0000","last_peered":"2023-10-06T02:50:59.644380+0000","last_clean":"2023-10-06T02:50:59.644380+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:50:59.644380+0000","last_undegraded":"2023-10-06T02:50:59.644380+0000","last_fullsized":"2023-10-06T02:50:59.644380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:51:00.638981+0000","last_change":"2023-10-06T02:51:00.645711+0000","last_active":"2023-10-06T02:51:00.638981+0000","last_peered":"2023-10-06T02:51:00.638981+0000","last_clean":"2023-10-06T02:51:00.638981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:51:00.638981+0000","last_undegraded":"2023-10-06T02:51:00.638981+0000","last_fullsized":"2023-10-06T02:51:00.638981+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:17.134930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T02:51:00.647127+0000","last_change":"2023-10-06T02:51:00.647127+0000","last_active":"2023-10-06T02:51:00.647127+0000","last_peered":"2023-10-06T02:51:00.647127+0000","last_clean":"2023-10-06T02:51:00.647127+0000","last_became_active":"2023-10-06T02:51:00.646586+0000","last_became_peered":"2023-10-06T02:51:00.646586+0000","last_unstale":"2023-10-06T02:51:00.647127+0000","last_undegraded":"2023-10-06T02:51:00.647127+0000","last_fullsized":"2023-10-06T02:51:00.647127+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:08.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-06T02:50:59.644712+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:50:59.644712+0000","last_peered":"2023-10-06T02:50:59.644712+0000","last_clean":"2023-10-06T02:50:59.644712+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:50:59.644712+0000","last_undegraded":"2023-10-06T02:50:59.644712+0000","last_fullsized":"2023-10-06T02:50:59.644712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198846042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":1.393,"15min":1.393},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67400000000000004,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.504}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":1.081,"15min":1.081},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.70999999999999996,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48099999999999998},"min":{"1min":0.46200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70099999999999996,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.63200000000000001},"min":{"1min":0.41799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70499999999999996,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61899999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68300000000000005,"5min":0.879,"15min":0.879},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68700000000000006,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69499999999999995,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":1.879,"15min":1.879},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67400000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.78300000000000003,"15min":1.028},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68700000000000006,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67400000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67900000000000005,"5min":1.163,"15min":1.163},"last":0.626}]},{"osd":4,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":1.05,"15min":1.05},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.753},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.61899999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72799999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.63},"min":{"1min":0.39200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.60599999999999998},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.31,"15min":0.312},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.247},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.26900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34200000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38900000000000001,"15min":0.38},"min":{"1min":0.313,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.374},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.36599999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69399999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46700000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77800000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.47399999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.443,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.47799999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198846042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34999999999999998},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47999999999999998,"5min":1.177,"15min":1.177},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38800000000000001,"15min":0.39800000000000002},"min":{"1min":0.23499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65100000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.75800000000000001,"15min":1.181},"min":{"1min":0.216,"5min":0.188,"15min":0.188},"max":{"1min":0.56000000000000005,"5min":22.038,"15min":22.038},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.36399999999999999},"min":{"1min":0.26200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.60399999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.311},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.79600000000000004,"15min":1.2110000000000001},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.63300000000000001,"5min":21.942,"15min":21.942},"last":0.503}]},{"osd":4,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.91000000000000003,"15min":1.264},"min":{"1min":0.46400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86499999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.96899999999999997,"15min":1.367},"min":{"1min":0.46300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.441},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.47699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":1.401,"15min":1.401},"last":0.47199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.93899999999999995,"15min":1.294},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.98999999999999999,"15min":1.3939999999999999},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80900000000000005,"5min":21.98,"15min":21.98},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.88800000000000001,"5min":1.425,"15min":1.425},"last":0.753},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.78300000000000003,"15min":0.96599999999999997},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81899999999999995,"5min":11.154,"15min":11.154},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52900000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.20999999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.51500000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.498}]},{"osd":1,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"min":{"1min":0.25700000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.63,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.439},{"interface":"front","average":{"1min":0.433,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80000000000000004,"5min":0.875,"15min":0.875},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59399999999999997,"15min":0.57799999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79500000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57699999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.626},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.70199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.22700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.32300000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.371}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.309},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27900000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39200000000000002,"15min":0.36799999999999999},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.64800000000000002,"5min":3.044,"15min":3.044},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35599999999999998,"15min":0.33900000000000002},"min":{"1min":0.29899999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74099999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72999999999999998,"5min":2.25,"15min":2.25},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.70399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83599999999999997,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.80500000000000005,"15min":1.0049999999999999},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84199999999999997,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.66900000000000004,"15min":0.83699999999999997},"min":{"1min":0.33600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71699999999999997,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.56899999999999995,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.61599999999999999,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.69399999999999995,"15min":0.87},"min":{"1min":0.41399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70599999999999996,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.66600000000000004,"15min":0.81599999999999995},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.66800000000000004,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.376}]},{"osd":2,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.504},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61799999999999999,"15min":0.69799999999999995},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66100000000000003,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55300000000000005,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64700000000000002,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.626},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73799999999999999,"5min":3.456,"15min":3.456},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.49399999999999999},"min":{"1min":0.27500000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.499,"15min":0.51200000000000001},"min":{"1min":0.32900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.624}]},{"osd":6,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64200000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.83499999999999996,"15min":1.087},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73099999999999998,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194762,"statfs":{"total":200000000,"available":199436410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.315,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.755,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.38500000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45700000000000002,"15min":0.45000000000000001},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.73699999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.879,"15min":0.879},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59399999999999997}]}]}],"pool_statfs":[]}} 2023-10-06T02:51:10.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:51:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.361+0000 7f35ac4b3700 1 Processor -- start 2023-10-06T02:51:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.361+0000 7f35ac4b3700 1 -- start start 2023-10-06T02:51:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35ac4b3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f35a40c6fc0 0x7f35a40ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35ac4b3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35a4068980 0x7f35a40c7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35ac4b3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40c8e20 con 0x7f35a40c78d0 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35ac4b3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40c9100 con 0x7f35a4068980 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35ac4b3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40c1810 con 0x7f35a40c6fc0 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35a9a4e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35a4068980 0x7f35a40c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35aaa50700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f35a40c78d0 0x7f35a40c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56066/0 (socket says 172.21.15.81:56066) 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35a9a4e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35a4068980 0x7f35a40c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47946/0 (socket says 172.21.15.81:47946) 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35aaa50700 1 -- 172.21.15.81:0/131928762 learned_addr learned my addr 172.21.15.81:0/131928762 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35aa24f700 1 --2- 172.21.15.81:0/131928762 >> v2:172.21.15.83:3300/0 conn(0x7f35a40c6fc0 0x7f35a40ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35a9a4e700 1 -- 172.21.15.81:0/131928762 >> v2:172.21.15.83:3300/0 conn(0x7f35a40c6fc0 msgr2=0x7f35a40ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35a9a4e700 1 --2- 172.21.15.81:0/131928762 >> v2:172.21.15.83:3300/0 conn(0x7f35a40c6fc0 0x7f35a40ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35a9a4e700 1 -- 172.21.15.81:0/131928762 >> v1:172.21.15.81:6789/0 conn(0x7f35a40c78d0 legacy=0x7f35a40c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35a9a4e700 1 -- 172.21.15.81:0/131928762 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40c1af0 con 0x7f35a4068980 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35aa24f700 1 --2- 172.21.15.81:0/131928762 >> v2:172.21.15.83:3300/0 conn(0x7f35a40c6fc0 0x7f35a40ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.362+0000 7f35a9a4e700 1 --2- 172.21.15.81:0/131928762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4068980 0x7f35a40c7390 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f35a4063fe0 tx=0x7f35980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806cf989e333cd85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35a924d700 1 -- 172.21.15.81:0/131928762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800b6b0 con 0x7f35a4068980 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35a924d700 1 -- 172.21.15.81:0/131928762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800b810 con 0x7f35a4068980 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35a924d700 1 -- 172.21.15.81:0/131928762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800bbb0 con 0x7f35a4068980 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35ac4b3700 1 -- 172.21.15.81:0/131928762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4068980 msgr2=0x7f35a40c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35ac4b3700 1 --2- 172.21.15.81:0/131928762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4068980 0x7f35a40c7390 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f35a4063fe0 tx=0x7f35980091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35ac4b3700 1 -- 172.21.15.81:0/131928762 shutdown_connections 2023-10-06T02:51:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35ac4b3700 1 --2- 172.21.15.81:0/131928762 >> v2:172.21.15.83:3300/0 conn(0x7f35a40c6fc0 0x7f35a40ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35ac4b3700 1 --2- 172.21.15.81:0/131928762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4068980 0x7f35a40c7390 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35ac4b3700 1 -- 172.21.15.81:0/131928762 >> 172.21.15.81:0/131928762 conn(0x7f35a406c660 msgr2=0x7f35a40cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35ac4b3700 1 -- 172.21.15.81:0/131928762 shutdown_connections 2023-10-06T02:51:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.363+0000 7f35ac4b3700 1 -- 172.21.15.81:0/131928762 wait complete. 2023-10-06T02:51:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.364+0000 7f35ac4b3700 1 Processor -- start 2023-10-06T02:51:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.364+0000 7f35ac4b3700 1 -- start start 2023-10-06T02:51:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35ac4b3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35a4068980 0x7f35a4143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35ac4b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35a40c6fc0 0x7f35a40acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35ac4b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40c78d0 0x7f35a40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35ac4b3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40c5fe0 con 0x7f35a40c78d0 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35ac4b3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40ae710 con 0x7f35a4068980 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35ac4b3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40adb00 con 0x7f35a40c6fc0 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35aaa50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40c78d0 0x7f35a40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35aaa50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40c78d0 0x7f35a40ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47958/0 (socket says 172.21.15.81:47958) 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35aaa50700 1 -- 172.21.15.81:0/863527630 learned_addr learned my addr 172.21.15.81:0/863527630 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35a9a4e700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35a40c6fc0 0x7f35a40acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35aa24f700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35a4068980 0x7f35a4143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35aaa50700 1 -- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35a40c6fc0 msgr2=0x7f35a40acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35aaa50700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35a40c6fc0 0x7f35a40acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35aaa50700 1 -- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35a4068980 msgr2=0x7f35a4143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.365+0000 7f35aaa50700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35a4068980 0x7f35a4143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.366+0000 7f35aaa50700 1 -- 172.21.15.81:0/863527630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009420 con 0x7f35a40c78d0 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.366+0000 7f35aa24f700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35a4068980 0x7f35a4143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.366+0000 7f35aaa50700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40c78d0 0x7f35a40ad460 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f359c00c560 tx=0x7f359c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.366+0000 7f35a27fc700 1 -- 172.21.15.81:0/863527630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c005b30 con 0x7f35a40c78d0 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.366+0000 7f35a27fc700 1 -- 172.21.15.81:0/863527630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c005c90 con 0x7f35a40c78d0 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.366+0000 7f35a27fc700 1 -- 172.21.15.81:0/863527630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0072e0 con 0x7f35a40c78d0 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.366+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a40adde0 con 0x7f35a40c78d0 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.366+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a40ae3a0 con 0x7f35a40c78d0 2023-10-06T02:51:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.367+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a4067bc0 con 0x7f35a40c78d0 2023-10-06T02:51:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.367+0000 7f35a27fc700 1 -- 172.21.15.81:0/863527630 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f359c007650 con 0x7f35a40c78d0 2023-10-06T02:51:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.367+0000 7f35a27fc700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3590066f30 0x7f35900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.368+0000 7f35a27fc700 1 -- 172.21.15.81:0/863527630 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f359c083a10 con 0x7f35a40c78d0 2023-10-06T02:51:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.368+0000 7f35aa24f700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3590066f30 0x7f35900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.368+0000 7f35aa24f700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3590066f30 0x7f35900693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f359400d640 tx=0x7f3594007670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.372+0000 7f35a27fc700 1 -- 172.21.15.81:0/863527630 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f359c04b5a0 con 0x7f35a40c78d0 2023-10-06T02:51:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.550+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35a40ae850 con 0x7f3590066f30 2023-10-06T02:51:10.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.559+0000 7f35a27fc700 1 -- 172.21.15.81:0/863527630 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305926 (secure 0 0 0) 0x7f35a40ae850 con 0x7f3590066f30 2023-10-06T02:51:10.565 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:10.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3590066f30 msgr2=0x7f35900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3590066f30 0x7f35900693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f359400d640 tx=0x7f3594007670 comp rx=0 tx=0).stop 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40c78d0 msgr2=0x7f35a40ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40c78d0 0x7f35a40ad460 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f359c00c560 tx=0x7f359c007f60 comp rx=0 tx=0).stop 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 shutdown_connections 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40c78d0 0x7f35a40ad460 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3590066f30 0x7f35900693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35a4068980 0x7f35a4143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 --2- 172.21.15.81:0/863527630 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35a40c6fc0 0x7f35a40acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 >> 172.21.15.81:0/863527630 conn(0x7f35a406c660 msgr2=0x7f35a406e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 shutdown_connections 2023-10-06T02:51:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.562+0000 7f35ac4b3700 1 -- 172.21.15.81:0/863527630 wait complete. 2023-10-06T02:51:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:51:10.575 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2023-10-06T02:51:09.565630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5668,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556831,"statfs":{"total":1600000000,"available":1594195876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002168"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660851+0000","last_change":"2023-10-06T02:51:01.660721+0000","last_active":"2023-10-06T02:51:01.660851+0000","last_peered":"2023-10-06T02:51:01.660851+0000","last_clean":"2023-10-06T02:51:01.660851+0000","last_became_active":"2023-10-06T02:51:01.660505+0000","last_became_peered":"2023-10-06T02:51:01.660505+0000","last_unstale":"2023-10-06T02:51:01.660851+0000","last_undegraded":"2023-10-06T02:51:01.660851+0000","last_fullsized":"2023-10-06T02:51:01.660851+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:36.370827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.658104+0000","last_change":"2023-10-06T02:51:01.658036+0000","last_active":"2023-10-06T02:51:01.658104+0000","last_peered":"2023-10-06T02:51:01.658104+0000","last_clean":"2023-10-06T02:51:01.658104+0000","last_became_active":"2023-10-06T02:51:01.657796+0000","last_became_peered":"2023-10-06T02:51:01.657796+0000","last_unstale":"2023-10-06T02:51:01.658104+0000","last_undegraded":"2023-10-06T02:51:01.658104+0000","last_fullsized":"2023-10-06T02:51:01.658104+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:44.811795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.665408+0000","last_change":"2023-10-06T02:51:01.665172+0000","last_active":"2023-10-06T02:51:01.665408+0000","last_peered":"2023-10-06T02:51:01.665408+0000","last_clean":"2023-10-06T02:51:01.665408+0000","last_became_active":"2023-10-06T02:51:01.664949+0000","last_became_peered":"2023-10-06T02:51:01.664949+0000","last_unstale":"2023-10-06T02:51:01.665408+0000","last_undegraded":"2023-10-06T02:51:01.665408+0000","last_fullsized":"2023-10-06T02:51:01.665408+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:02.670341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.664494+0000","last_change":"2023-10-06T02:51:01.664256+0000","last_active":"2023-10-06T02:51:01.664494+0000","last_peered":"2023-10-06T02:51:01.664494+0000","last_clean":"2023-10-06T02:51:01.664494+0000","last_became_active":"2023-10-06T02:51:01.664040+0000","last_became_peered":"2023-10-06T02:51:01.664040+0000","last_unstale":"2023-10-06T02:51:01.664494+0000","last_undegraded":"2023-10-06T02:51:01.664494+0000","last_fullsized":"2023-10-06T02:51:01.664494+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:36.370827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.664645+0000","last_change":"2023-10-06T02:51:01.664521+0000","last_active":"2023-10-06T02:51:01.664645+0000","last_peered":"2023-10-06T02:51:01.664645+0000","last_clean":"2023-10-06T02:51:01.664645+0000","last_became_active":"2023-10-06T02:51:01.664290+0000","last_became_peered":"2023-10-06T02:51:01.664290+0000","last_unstale":"2023-10-06T02:51:01.664645+0000","last_undegraded":"2023-10-06T02:51:01.664645+0000","last_fullsized":"2023-10-06T02:51:01.664645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:50.512311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668273+0000","last_change":"2023-10-06T02:51:01.667760+0000","last_active":"2023-10-06T02:51:01.668273+0000","last_peered":"2023-10-06T02:51:01.668273+0000","last_clean":"2023-10-06T02:51:01.668273+0000","last_became_active":"2023-10-06T02:51:01.667012+0000","last_became_peered":"2023-10-06T02:51:01.667012+0000","last_unstale":"2023-10-06T02:51:01.668273+0000","last_undegraded":"2023-10-06T02:51:01.668273+0000","last_fullsized":"2023-10-06T02:51:01.668273+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:05.579334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.670400+0000","last_change":"2023-10-06T02:51:01.670324+0000","last_active":"2023-10-06T02:51:01.670400+0000","last_peered":"2023-10-06T02:51:01.670400+0000","last_clean":"2023-10-06T02:51:01.670400+0000","last_became_active":"2023-10-06T02:51:01.670103+0000","last_became_peered":"2023-10-06T02:51:01.670103+0000","last_unstale":"2023-10-06T02:51:01.670400+0000","last_undegraded":"2023-10-06T02:51:01.670400+0000","last_fullsized":"2023-10-06T02:51:01.670400+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:33.024530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668231+0000","last_change":"2023-10-06T02:51:01.667658+0000","last_active":"2023-10-06T02:51:01.668231+0000","last_peered":"2023-10-06T02:51:01.668231+0000","last_clean":"2023-10-06T02:51:01.668231+0000","last_became_active":"2023-10-06T02:51:01.666975+0000","last_became_peered":"2023-10-06T02:51:01.666975+0000","last_unstale":"2023-10-06T02:51:01.668231+0000","last_undegraded":"2023-10-06T02:51:01.668231+0000","last_fullsized":"2023-10-06T02:51:01.668231+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:44.811795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.663593+0000","last_change":"2023-10-06T02:51:01.663522+0000","last_active":"2023-10-06T02:51:01.663593+0000","last_peered":"2023-10-06T02:51:01.663593+0000","last_clean":"2023-10-06T02:51:01.663593+0000","last_became_active":"2023-10-06T02:51:01.663298+0000","last_became_peered":"2023-10-06T02:51:01.663298+0000","last_unstale":"2023-10-06T02:51:01.663593+0000","last_undegraded":"2023-10-06T02:51:01.663593+0000","last_fullsized":"2023-10-06T02:51:01.663593+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.457598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.670523+0000","last_change":"2023-10-06T02:51:01.670409+0000","last_active":"2023-10-06T02:51:01.670523+0000","last_peered":"2023-10-06T02:51:01.670523+0000","last_clean":"2023-10-06T02:51:01.670523+0000","last_became_active":"2023-10-06T02:51:01.670182+0000","last_became_peered":"2023-10-06T02:51:01.670182+0000","last_unstale":"2023-10-06T02:51:01.670523+0000","last_undegraded":"2023-10-06T02:51:01.670523+0000","last_fullsized":"2023-10-06T02:51:01.670523+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:07.307656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.666479+0000","last_change":"2023-10-06T02:51:01.666271+0000","last_active":"2023-10-06T02:51:01.666479+0000","last_peered":"2023-10-06T02:51:01.666479+0000","last_clean":"2023-10-06T02:51:01.666479+0000","last_became_active":"2023-10-06T02:51:01.665750+0000","last_became_peered":"2023-10-06T02:51:01.665750+0000","last_unstale":"2023-10-06T02:51:01.666479+0000","last_undegraded":"2023-10-06T02:51:01.666479+0000","last_fullsized":"2023-10-06T02:51:01.666479+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:36.370827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.658891+0000","last_change":"2023-10-06T02:51:01.658635+0000","last_active":"2023-10-06T02:51:01.658891+0000","last_peered":"2023-10-06T02:51:01.658891+0000","last_clean":"2023-10-06T02:51:01.658891+0000","last_became_active":"2023-10-06T02:51:01.658399+0000","last_became_peered":"2023-10-06T02:51:01.658399+0000","last_unstale":"2023-10-06T02:51:01.658891+0000","last_undegraded":"2023-10-06T02:51:01.658891+0000","last_fullsized":"2023-10-06T02:51:01.658891+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:42.378485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668216+0000","last_change":"2023-10-06T02:51:01.667508+0000","last_active":"2023-10-06T02:51:01.668216+0000","last_peered":"2023-10-06T02:51:01.668216+0000","last_clean":"2023-10-06T02:51:01.668216+0000","last_became_active":"2023-10-06T02:51:01.666695+0000","last_became_peered":"2023-10-06T02:51:01.666695+0000","last_unstale":"2023-10-06T02:51:01.668216+0000","last_undegraded":"2023-10-06T02:51:01.668216+0000","last_fullsized":"2023-10-06T02:51:01.668216+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.457598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.667851+0000","last_change":"2023-10-06T02:51:01.667790+0000","last_active":"2023-10-06T02:51:01.667851+0000","last_peered":"2023-10-06T02:51:01.667851+0000","last_clean":"2023-10-06T02:51:01.667851+0000","last_became_active":"2023-10-06T02:51:01.667013+0000","last_became_peered":"2023-10-06T02:51:01.667013+0000","last_unstale":"2023-10-06T02:51:01.667851+0000","last_undegraded":"2023-10-06T02:51:01.667851+0000","last_fullsized":"2023-10-06T02:51:01.667851+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:44.811795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.670912+0000","last_change":"2023-10-06T02:51:01.670833+0000","last_active":"2023-10-06T02:51:01.670912+0000","last_peered":"2023-10-06T02:51:01.670912+0000","last_clean":"2023-10-06T02:51:01.670912+0000","last_became_active":"2023-10-06T02:51:01.670359+0000","last_became_peered":"2023-10-06T02:51:01.670359+0000","last_unstale":"2023-10-06T02:51:01.670912+0000","last_undegraded":"2023-10-06T02:51:01.670912+0000","last_fullsized":"2023-10-06T02:51:01.670912+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:39.760511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.663218+0000","last_change":"2023-10-06T02:51:01.663133+0000","last_active":"2023-10-06T02:51:01.663218+0000","last_peered":"2023-10-06T02:51:01.663218+0000","last_clean":"2023-10-06T02:51:01.663218+0000","last_became_active":"2023-10-06T02:51:01.662621+0000","last_became_peered":"2023-10-06T02:51:01.662621+0000","last_unstale":"2023-10-06T02:51:01.663218+0000","last_undegraded":"2023-10-06T02:51:01.663218+0000","last_fullsized":"2023-10-06T02:51:01.663218+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:34.095769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.662917+0000","last_change":"2023-10-06T02:51:01.662653+0000","last_active":"2023-10-06T02:51:01.662917+0000","last_peered":"2023-10-06T02:51:01.662917+0000","last_clean":"2023-10-06T02:51:01.662917+0000","last_became_active":"2023-10-06T02:51:01.661980+0000","last_became_peered":"2023-10-06T02:51:01.661980+0000","last_unstale":"2023-10-06T02:51:01.662917+0000","last_undegraded":"2023-10-06T02:51:01.662917+0000","last_fullsized":"2023-10-06T02:51:01.662917+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:49.770921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660783+0000","last_change":"2023-10-06T02:51:01.659106+0000","last_active":"2023-10-06T02:51:01.660783+0000","last_peered":"2023-10-06T02:51:01.660783+0000","last_clean":"2023-10-06T02:51:01.660783+0000","last_became_active":"2023-10-06T02:51:01.658900+0000","last_became_peered":"2023-10-06T02:51:01.658900+0000","last_unstale":"2023-10-06T02:51:01.660783+0000","last_undegraded":"2023-10-06T02:51:01.660783+0000","last_fullsized":"2023-10-06T02:51:01.660783+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:44.963828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668227+0000","last_change":"2023-10-06T02:51:01.667935+0000","last_active":"2023-10-06T02:51:01.668227+0000","last_peered":"2023-10-06T02:51:01.668227+0000","last_clean":"2023-10-06T02:51:01.668227+0000","last_became_active":"2023-10-06T02:51:01.667329+0000","last_became_peered":"2023-10-06T02:51:01.667329+0000","last_unstale":"2023-10-06T02:51:01.668227+0000","last_undegraded":"2023-10-06T02:51:01.668227+0000","last_fullsized":"2023-10-06T02:51:01.668227+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:33.024530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.670637+0000","last_change":"2023-10-06T02:51:01.670592+0000","last_active":"2023-10-06T02:51:01.670637+0000","last_peered":"2023-10-06T02:51:01.670637+0000","last_clean":"2023-10-06T02:51:01.670637+0000","last_became_active":"2023-10-06T02:51:01.670059+0000","last_became_peered":"2023-10-06T02:51:01.670059+0000","last_unstale":"2023-10-06T02:51:01.670637+0000","last_undegraded":"2023-10-06T02:51:01.670637+0000","last_fullsized":"2023-10-06T02:51:01.670637+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.666495+0000","last_change":"2023-10-06T02:51:01.666419+0000","last_active":"2023-10-06T02:51:01.666495+0000","last_peered":"2023-10-06T02:51:01.666495+0000","last_clean":"2023-10-06T02:51:01.666495+0000","last_became_active":"2023-10-06T02:51:01.666013+0000","last_became_peered":"2023-10-06T02:51:01.666013+0000","last_unstale":"2023-10-06T02:51:01.666495+0000","last_undegraded":"2023-10-06T02:51:01.666495+0000","last_fullsized":"2023-10-06T02:51:01.666495+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.665654+0000","last_change":"2023-10-06T02:51:01.665585+0000","last_active":"2023-10-06T02:51:01.665654+0000","last_peered":"2023-10-06T02:51:01.665654+0000","last_clean":"2023-10-06T02:51:01.665654+0000","last_became_active":"2023-10-06T02:51:01.665351+0000","last_became_peered":"2023-10-06T02:51:01.665351+0000","last_unstale":"2023-10-06T02:51:01.665654+0000","last_undegraded":"2023-10-06T02:51:01.665654+0000","last_fullsized":"2023-10-06T02:51:01.665654+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:44.963828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.670599+0000","last_change":"2023-10-06T02:51:01.670536+0000","last_active":"2023-10-06T02:51:01.670599+0000","last_peered":"2023-10-06T02:51:01.670599+0000","last_clean":"2023-10-06T02:51:01.670599+0000","last_became_active":"2023-10-06T02:51:01.670332+0000","last_became_peered":"2023-10-06T02:51:01.670332+0000","last_unstale":"2023-10-06T02:51:01.670599+0000","last_undegraded":"2023-10-06T02:51:01.670599+0000","last_fullsized":"2023-10-06T02:51:01.670599+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:02.370206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.666072+0000","last_change":"2023-10-06T02:51:01.665440+0000","last_active":"2023-10-06T02:51:01.666072+0000","last_peered":"2023-10-06T02:51:01.666072+0000","last_clean":"2023-10-06T02:51:01.666072+0000","last_became_active":"2023-10-06T02:51:01.665224+0000","last_became_peered":"2023-10-06T02:51:01.665224+0000","last_unstale":"2023-10-06T02:51:01.666072+0000","last_undegraded":"2023-10-06T02:51:01.666072+0000","last_fullsized":"2023-10-06T02:51:01.666072+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:50.512311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.661406+0000","last_change":"2023-10-06T02:51:01.661186+0000","last_active":"2023-10-06T02:51:01.661406+0000","last_peered":"2023-10-06T02:51:01.661406+0000","last_clean":"2023-10-06T02:51:01.661406+0000","last_became_active":"2023-10-06T02:51:01.660955+0000","last_became_peered":"2023-10-06T02:51:01.660955+0000","last_unstale":"2023-10-06T02:51:01.661406+0000","last_undegraded":"2023-10-06T02:51:01.661406+0000","last_fullsized":"2023-10-06T02:51:01.661406+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:26.457598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.667432+0000","last_change":"2023-10-06T02:51:01.667362+0000","last_active":"2023-10-06T02:51:01.667432+0000","last_peered":"2023-10-06T02:51:01.667432+0000","last_clean":"2023-10-06T02:51:01.667432+0000","last_became_active":"2023-10-06T02:51:01.667175+0000","last_became_peered":"2023-10-06T02:51:01.667175+0000","last_unstale":"2023-10-06T02:51:01.667432+0000","last_undegraded":"2023-10-06T02:51:01.667432+0000","last_fullsized":"2023-10-06T02:51:01.667432+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:07.867628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.662662+0000","last_change":"2023-10-06T02:51:01.662579+0000","last_active":"2023-10-06T02:51:01.662662+0000","last_peered":"2023-10-06T02:51:01.662662+0000","last_clean":"2023-10-06T02:51:01.662662+0000","last_became_active":"2023-10-06T02:51:01.662356+0000","last_became_peered":"2023-10-06T02:51:01.662356+0000","last_unstale":"2023-10-06T02:51:01.662662+0000","last_undegraded":"2023-10-06T02:51:01.662662+0000","last_fullsized":"2023-10-06T02:51:01.662662+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:12.795221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668183+0000","last_change":"2023-10-06T02:51:01.667209+0000","last_active":"2023-10-06T02:51:01.668183+0000","last_peered":"2023-10-06T02:51:01.668183+0000","last_clean":"2023-10-06T02:51:01.668183+0000","last_became_active":"2023-10-06T02:51:01.666116+0000","last_became_peered":"2023-10-06T02:51:01.666116+0000","last_unstale":"2023-10-06T02:51:01.668183+0000","last_undegraded":"2023-10-06T02:51:01.668183+0000","last_fullsized":"2023-10-06T02:51:01.668183+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:44.963828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.663218+0000","last_change":"2023-10-06T02:51:01.663152+0000","last_active":"2023-10-06T02:51:01.663218+0000","last_peered":"2023-10-06T02:51:01.663218+0000","last_clean":"2023-10-06T02:51:01.663218+0000","last_became_active":"2023-10-06T02:51:01.662878+0000","last_became_peered":"2023-10-06T02:51:01.662878+0000","last_unstale":"2023-10-06T02:51:01.663218+0000","last_undegraded":"2023-10-06T02:51:01.663218+0000","last_fullsized":"2023-10-06T02:51:01.663218+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:53.238274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668985+0000","last_change":"2023-10-06T02:51:01.668761+0000","last_active":"2023-10-06T02:51:01.668985+0000","last_peered":"2023-10-06T02:51:01.668985+0000","last_clean":"2023-10-06T02:51:01.668985+0000","last_became_active":"2023-10-06T02:51:01.668221+0000","last_became_peered":"2023-10-06T02:51:01.668221+0000","last_unstale":"2023-10-06T02:51:01.668985+0000","last_undegraded":"2023-10-06T02:51:01.668985+0000","last_fullsized":"2023-10-06T02:51:01.668985+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:02.670341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.666919+0000","last_change":"2023-10-06T02:51:01.666860+0000","last_active":"2023-10-06T02:51:01.666919+0000","last_peered":"2023-10-06T02:51:01.666919+0000","last_clean":"2023-10-06T02:51:01.666919+0000","last_became_active":"2023-10-06T02:51:01.666575+0000","last_became_peered":"2023-10-06T02:51:01.666575+0000","last_unstale":"2023-10-06T02:51:01.666919+0000","last_undegraded":"2023-10-06T02:51:01.666919+0000","last_fullsized":"2023-10-06T02:51:01.666919+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:56.664986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.665523+0000","last_change":"2023-10-06T02:51:01.665133+0000","last_active":"2023-10-06T02:51:01.665523+0000","last_peered":"2023-10-06T02:51:01.665523+0000","last_clean":"2023-10-06T02:51:01.665523+0000","last_became_active":"2023-10-06T02:51:01.662423+0000","last_became_peered":"2023-10-06T02:51:01.662423+0000","last_unstale":"2023-10-06T02:51:01.665523+0000","last_undegraded":"2023-10-06T02:51:01.665523+0000","last_fullsized":"2023-10-06T02:51:01.665523+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:19.853143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668289+0000","last_change":"2023-10-06T02:51:01.667899+0000","last_active":"2023-10-06T02:51:01.668289+0000","last_peered":"2023-10-06T02:51:01.668289+0000","last_clean":"2023-10-06T02:51:01.668289+0000","last_became_active":"2023-10-06T02:51:01.667294+0000","last_became_peered":"2023-10-06T02:51:01.667294+0000","last_unstale":"2023-10-06T02:51:01.668289+0000","last_undegraded":"2023-10-06T02:51:01.668289+0000","last_fullsized":"2023-10-06T02:51:01.668289+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:13.695855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"100'4","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.678931+0000","last_change":"2023-10-06T02:51:00.652649+0000","last_active":"2023-10-06T02:51:01.678931+0000","last_peered":"2023-10-06T02:51:01.678931+0000","last_clean":"2023-10-06T02:51:01.678931+0000","last_became_active":"2023-10-06T02:51:00.652282+0000","last_became_peered":"2023-10-06T02:51:00.652282+0000","last_unstale":"2023-10-06T02:51:01.678931+0000","last_undegraded":"2023-10-06T02:51:01.678931+0000","last_fullsized":"2023-10-06T02:51:01.678931+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.662897+0000","last_change":"2023-10-06T02:51:01.662031+0000","last_active":"2023-10-06T02:51:01.662897+0000","last_peered":"2023-10-06T02:51:01.662897+0000","last_clean":"2023-10-06T02:51:01.662897+0000","last_became_active":"2023-10-06T02:51:01.661817+0000","last_became_peered":"2023-10-06T02:51:01.661817+0000","last_unstale":"2023-10-06T02:51:01.662897+0000","last_undegraded":"2023-10-06T02:51:01.662897+0000","last_fullsized":"2023-10-06T02:51:01.662897+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:23.827138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.677556+0000","last_change":"2023-10-06T02:51:00.655589+0000","last_active":"2023-10-06T02:51:01.677556+0000","last_peered":"2023-10-06T02:51:01.677556+0000","last_clean":"2023-10-06T02:51:01.677556+0000","last_became_active":"2023-10-06T02:51:00.655326+0000","last_became_peered":"2023-10-06T02:51:00.655326+0000","last_unstale":"2023-10-06T02:51:01.677556+0000","last_undegraded":"2023-10-06T02:51:01.677556+0000","last_fullsized":"2023-10-06T02:51:01.677556+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.667295+0000","last_change":"2023-10-06T02:51:01.667202+0000","last_active":"2023-10-06T02:51:01.667295+0000","last_peered":"2023-10-06T02:51:01.667295+0000","last_clean":"2023-10-06T02:51:01.667295+0000","last_became_active":"2023-10-06T02:51:01.666843+0000","last_became_peered":"2023-10-06T02:51:01.666843+0000","last_unstale":"2023-10-06T02:51:01.667295+0000","last_undegraded":"2023-10-06T02:51:01.667295+0000","last_fullsized":"2023-10-06T02:51:01.667295+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:02:16.943289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.677372+0000","last_change":"2023-10-06T02:51:00.650807+0000","last_active":"2023-10-06T02:51:01.677372+0000","last_peered":"2023-10-06T02:51:01.677372+0000","last_clean":"2023-10-06T02:51:01.677372+0000","last_became_active":"2023-10-06T02:51:00.650541+0000","last_became_peered":"2023-10-06T02:51:00.650541+0000","last_unstale":"2023-10-06T02:51:01.677372+0000","last_undegraded":"2023-10-06T02:51:01.677372+0000","last_fullsized":"2023-10-06T02:51:01.677372+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:06.863934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.664164+0000","last_change":"2023-10-06T02:51:01.664107+0000","last_active":"2023-10-06T02:51:01.664164+0000","last_peered":"2023-10-06T02:51:01.664164+0000","last_clean":"2023-10-06T02:51:01.664164+0000","last_became_active":"2023-10-06T02:51:01.663630+0000","last_became_peered":"2023-10-06T02:51:01.663630+0000","last_unstale":"2023-10-06T02:51:01.664164+0000","last_undegraded":"2023-10-06T02:51:01.664164+0000","last_fullsized":"2023-10-06T02:51:01.664164+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:15.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.678577+0000","last_change":"2023-10-06T02:51:00.655112+0000","last_active":"2023-10-06T02:51:01.678577+0000","last_peered":"2023-10-06T02:51:01.678577+0000","last_clean":"2023-10-06T02:51:01.678577+0000","last_became_active":"2023-10-06T02:51:00.654869+0000","last_became_peered":"2023-10-06T02:51:00.654869+0000","last_unstale":"2023-10-06T02:51:01.678577+0000","last_undegraded":"2023-10-06T02:51:01.678577+0000","last_fullsized":"2023-10-06T02:51:01.678577+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:37.828589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.664476+0000","last_change":"2023-10-06T02:51:01.664098+0000","last_active":"2023-10-06T02:51:01.664476+0000","last_peered":"2023-10-06T02:51:01.664476+0000","last_clean":"2023-10-06T02:51:01.664476+0000","last_became_active":"2023-10-06T02:51:01.663874+0000","last_became_peered":"2023-10-06T02:51:01.663874+0000","last_unstale":"2023-10-06T02:51:01.664476+0000","last_undegraded":"2023-10-06T02:51:01.664476+0000","last_fullsized":"2023-10-06T02:51:01.664476+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.677306+0000","last_change":"2023-10-06T02:51:00.648859+0000","last_active":"2023-10-06T02:51:01.677306+0000","last_peered":"2023-10-06T02:51:01.677306+0000","last_clean":"2023-10-06T02:51:01.677306+0000","last_became_active":"2023-10-06T02:51:00.648625+0000","last_became_peered":"2023-10-06T02:51:00.648625+0000","last_unstale":"2023-10-06T02:51:01.677306+0000","last_undegraded":"2023-10-06T02:51:01.677306+0000","last_fullsized":"2023-10-06T02:51:01.677306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.665806+0000","last_change":"2023-10-06T02:51:01.665648+0000","last_active":"2023-10-06T02:51:01.665806+0000","last_peered":"2023-10-06T02:51:01.665806+0000","last_clean":"2023-10-06T02:51:01.665806+0000","last_became_active":"2023-10-06T02:51:01.665342+0000","last_became_peered":"2023-10-06T02:51:01.665342+0000","last_unstale":"2023-10-06T02:51:01.665806+0000","last_undegraded":"2023-10-06T02:51:01.665806+0000","last_fullsized":"2023-10-06T02:51:01.665806+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:14.715567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.679903+0000","last_change":"2023-10-06T02:51:00.653298+0000","last_active":"2023-10-06T02:51:01.679903+0000","last_peered":"2023-10-06T02:51:01.679903+0000","last_clean":"2023-10-06T02:51:01.679903+0000","last_became_active":"2023-10-06T02:51:00.652806+0000","last_became_peered":"2023-10-06T02:51:00.652806+0000","last_unstale":"2023-10-06T02:51:01.679903+0000","last_undegraded":"2023-10-06T02:51:01.679903+0000","last_fullsized":"2023-10-06T02:51:01.679903+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668304+0000","last_change":"2023-10-06T02:51:01.668135+0000","last_active":"2023-10-06T02:51:01.668304+0000","last_peered":"2023-10-06T02:51:01.668304+0000","last_clean":"2023-10-06T02:51:01.668304+0000","last_became_active":"2023-10-06T02:51:01.667920+0000","last_became_peered":"2023-10-06T02:51:01.667920+0000","last_unstale":"2023-10-06T02:51:01.668304+0000","last_undegraded":"2023-10-06T02:51:01.668304+0000","last_fullsized":"2023-10-06T02:51:01.668304+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:06.481297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.656175+0000","last_change":"2023-10-06T02:51:00.650485+0000","last_active":"2023-10-06T02:51:01.656175+0000","last_peered":"2023-10-06T02:51:01.656175+0000","last_clean":"2023-10-06T02:51:01.656175+0000","last_became_active":"2023-10-06T02:51:00.650261+0000","last_became_peered":"2023-10-06T02:51:00.650261+0000","last_unstale":"2023-10-06T02:51:01.656175+0000","last_undegraded":"2023-10-06T02:51:01.656175+0000","last_fullsized":"2023-10-06T02:51:01.656175+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:01.366512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.666066+0000","last_change":"2023-10-06T02:51:01.665815+0000","last_active":"2023-10-06T02:51:01.666066+0000","last_peered":"2023-10-06T02:51:01.666066+0000","last_clean":"2023-10-06T02:51:01.666066+0000","last_became_active":"2023-10-06T02:51:01.664750+0000","last_became_peered":"2023-10-06T02:51:01.664750+0000","last_unstale":"2023-10-06T02:51:01.666066+0000","last_undegraded":"2023-10-06T02:51:01.666066+0000","last_fullsized":"2023-10-06T02:51:01.666066+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:07.867628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660460+0000","last_change":"2023-10-06T02:51:00.654402+0000","last_active":"2023-10-06T02:51:01.660460+0000","last_peered":"2023-10-06T02:51:01.660460+0000","last_clean":"2023-10-06T02:51:01.660460+0000","last_became_active":"2023-10-06T02:51:00.653618+0000","last_became_peered":"2023-10-06T02:51:00.653618+0000","last_unstale":"2023-10-06T02:51:01.660460+0000","last_undegraded":"2023-10-06T02:51:01.660460+0000","last_fullsized":"2023-10-06T02:51:01.660460+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:43.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668661+0000","last_change":"2023-10-06T02:51:01.668602+0000","last_active":"2023-10-06T02:51:01.668661+0000","last_peered":"2023-10-06T02:51:01.668661+0000","last_clean":"2023-10-06T02:51:01.668661+0000","last_became_active":"2023-10-06T02:51:01.668294+0000","last_became_peered":"2023-10-06T02:51:01.668294+0000","last_unstale":"2023-10-06T02:51:01.668661+0000","last_undegraded":"2023-10-06T02:51:01.668661+0000","last_fullsized":"2023-10-06T02:51:01.668661+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:56.664986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.656519+0000","last_change":"2023-10-06T02:51:00.651057+0000","last_active":"2023-10-06T02:51:01.656519+0000","last_peered":"2023-10-06T02:51:01.656519+0000","last_clean":"2023-10-06T02:51:01.656519+0000","last_became_active":"2023-10-06T02:51:00.650684+0000","last_became_peered":"2023-10-06T02:51:00.650684+0000","last_unstale":"2023-10-06T02:51:01.656519+0000","last_undegraded":"2023-10-06T02:51:01.656519+0000","last_fullsized":"2023-10-06T02:51:01.656519+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:03.696166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.665525+0000","last_change":"2023-10-06T02:51:01.665303+0000","last_active":"2023-10-06T02:51:01.665525+0000","last_peered":"2023-10-06T02:51:01.665525+0000","last_clean":"2023-10-06T02:51:01.665525+0000","last_became_active":"2023-10-06T02:51:01.665078+0000","last_became_peered":"2023-10-06T02:51:01.665078+0000","last_unstale":"2023-10-06T02:51:01.665525+0000","last_undegraded":"2023-10-06T02:51:01.665525+0000","last_fullsized":"2023-10-06T02:51:01.665525+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:28.690744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.656609+0000","last_change":"2023-10-06T02:51:00.647297+0000","last_active":"2023-10-06T02:51:01.656609+0000","last_peered":"2023-10-06T02:51:01.656609+0000","last_clean":"2023-10-06T02:51:01.656609+0000","last_became_active":"2023-10-06T02:51:00.646978+0000","last_became_peered":"2023-10-06T02:51:00.646978+0000","last_unstale":"2023-10-06T02:51:01.656609+0000","last_undegraded":"2023-10-06T02:51:01.656609+0000","last_fullsized":"2023-10-06T02:51:01.656609+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:38.756816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660828+0000","last_change":"2023-10-06T02:51:01.660074+0000","last_active":"2023-10-06T02:51:01.660828+0000","last_peered":"2023-10-06T02:51:01.660828+0000","last_clean":"2023-10-06T02:51:01.660828+0000","last_became_active":"2023-10-06T02:51:01.659831+0000","last_became_peered":"2023-10-06T02:51:01.659831+0000","last_unstale":"2023-10-06T02:51:01.660828+0000","last_undegraded":"2023-10-06T02:51:01.660828+0000","last_fullsized":"2023-10-06T02:51:01.660828+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:33.024530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"100'3","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.679006+0000","last_change":"2023-10-06T02:51:00.650607+0000","last_active":"2023-10-06T02:51:01.679006+0000","last_peered":"2023-10-06T02:51:01.679006+0000","last_clean":"2023-10-06T02:51:01.679006+0000","last_became_active":"2023-10-06T02:51:00.650350+0000","last_became_peered":"2023-10-06T02:51:00.650350+0000","last_unstale":"2023-10-06T02:51:01.679006+0000","last_undegraded":"2023-10-06T02:51:01.679006+0000","last_fullsized":"2023-10-06T02:51:01.679006+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668247+0000","last_change":"2023-10-06T02:51:01.667967+0000","last_active":"2023-10-06T02:51:01.668247+0000","last_peered":"2023-10-06T02:51:01.668247+0000","last_clean":"2023-10-06T02:51:01.668247+0000","last_became_active":"2023-10-06T02:51:01.667477+0000","last_became_peered":"2023-10-06T02:51:01.667477+0000","last_unstale":"2023-10-06T02:51:01.668247+0000","last_undegraded":"2023-10-06T02:51:01.668247+0000","last_fullsized":"2023-10-06T02:51:01.668247+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:56.664986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"100'6","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.679927+0000","last_change":"2023-10-06T02:51:00.654538+0000","last_active":"2023-10-06T02:51:01.679927+0000","last_peered":"2023-10-06T02:51:01.679927+0000","last_clean":"2023-10-06T02:51:01.679927+0000","last_became_active":"2023-10-06T02:51:00.654180+0000","last_became_peered":"2023-10-06T02:51:00.654180+0000","last_unstale":"2023-10-06T02:51:01.679927+0000","last_undegraded":"2023-10-06T02:51:01.679927+0000","last_fullsized":"2023-10-06T02:51:01.679927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:27.687050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.668201+0000","last_change":"2023-10-06T02:51:01.667350+0000","last_active":"2023-10-06T02:51:01.668201+0000","last_peered":"2023-10-06T02:51:01.668201+0000","last_clean":"2023-10-06T02:51:01.668201+0000","last_became_active":"2023-10-06T02:51:01.666479+0000","last_became_peered":"2023-10-06T02:51:01.666479+0000","last_unstale":"2023-10-06T02:51:01.668201+0000","last_undegraded":"2023-10-06T02:51:01.668201+0000","last_fullsized":"2023-10-06T02:51:01.668201+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:39.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.679013+0000","last_change":"2023-10-06T02:51:00.654543+0000","last_active":"2023-10-06T02:51:01.679013+0000","last_peered":"2023-10-06T02:51:01.679013+0000","last_clean":"2023-10-06T02:51:01.679013+0000","last_became_active":"2023-10-06T02:51:00.653929+0000","last_became_peered":"2023-10-06T02:51:00.653929+0000","last_unstale":"2023-10-06T02:51:01.679013+0000","last_undegraded":"2023-10-06T02:51:01.679013+0000","last_fullsized":"2023-10-06T02:51:01.679013+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:55.661291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.664473+0000","last_change":"2023-10-06T02:51:01.664409+0000","last_active":"2023-10-06T02:51:01.664473+0000","last_peered":"2023-10-06T02:51:01.664473+0000","last_clean":"2023-10-06T02:51:01.664473+0000","last_became_active":"2023-10-06T02:51:01.664177+0000","last_became_peered":"2023-10-06T02:51:01.664177+0000","last_unstale":"2023-10-06T02:51:01.664473+0000","last_undegraded":"2023-10-06T02:51:01.664473+0000","last_fullsized":"2023-10-06T02:51:01.664473+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:12.319008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.657909+0000","last_change":"2023-10-06T02:51:00.651432+0000","last_active":"2023-10-06T02:51:01.657909+0000","last_peered":"2023-10-06T02:51:01.657909+0000","last_clean":"2023-10-06T02:51:01.657909+0000","last_became_active":"2023-10-06T02:51:00.650760+0000","last_became_peered":"2023-10-06T02:51:00.650760+0000","last_unstale":"2023-10-06T02:51:01.657909+0000","last_undegraded":"2023-10-06T02:51:01.657909+0000","last_fullsized":"2023-10-06T02:51:01.657909+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:01.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.667386+0000","last_change":"2023-10-06T02:51:01.667297+0000","last_active":"2023-10-06T02:51:01.667386+0000","last_peered":"2023-10-06T02:51:01.667386+0000","last_clean":"2023-10-06T02:51:01.667386+0000","last_became_active":"2023-10-06T02:51:01.667084+0000","last_became_peered":"2023-10-06T02:51:01.667084+0000","last_unstale":"2023-10-06T02:51:01.667386+0000","last_undegraded":"2023-10-06T02:51:01.667386+0000","last_fullsized":"2023-10-06T02:51:01.667386+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:44.651323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.661515+0000","last_change":"2023-10-06T02:51:00.654687+0000","last_active":"2023-10-06T02:51:01.661515+0000","last_peered":"2023-10-06T02:51:01.661515+0000","last_clean":"2023-10-06T02:51:01.661515+0000","last_became_active":"2023-10-06T02:51:00.654476+0000","last_became_peered":"2023-10-06T02:51:00.654476+0000","last_unstale":"2023-10-06T02:51:01.661515+0000","last_undegraded":"2023-10-06T02:51:01.661515+0000","last_fullsized":"2023-10-06T02:51:01.661515+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.664101+0000","last_change":"2023-10-06T02:51:01.663986+0000","last_active":"2023-10-06T02:51:01.664101+0000","last_peered":"2023-10-06T02:51:01.664101+0000","last_clean":"2023-10-06T02:51:01.664101+0000","last_became_active":"2023-10-06T02:51:01.663789+0000","last_became_peered":"2023-10-06T02:51:01.663789+0000","last_unstale":"2023-10-06T02:51:01.664101+0000","last_undegraded":"2023-10-06T02:51:01.664101+0000","last_fullsized":"2023-10-06T02:51:01.664101+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:42.777540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"100'8","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.679822+0000","last_change":"2023-10-06T02:51:00.653428+0000","last_active":"2023-10-06T02:51:01.679822+0000","last_peered":"2023-10-06T02:51:01.679822+0000","last_clean":"2023-10-06T02:51:01.679822+0000","last_became_active":"2023-10-06T02:51:00.653084+0000","last_became_peered":"2023-10-06T02:51:00.653084+0000","last_unstale":"2023-10-06T02:51:01.679822+0000","last_undegraded":"2023-10-06T02:51:01.679822+0000","last_fullsized":"2023-10-06T02:51:01.679822+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.662786+0000","last_change":"2023-10-06T02:51:01.662634+0000","last_active":"2023-10-06T02:51:01.662786+0000","last_peered":"2023-10-06T02:51:01.662786+0000","last_clean":"2023-10-06T02:51:01.662786+0000","last_became_active":"2023-10-06T02:51:01.662386+0000","last_became_peered":"2023-10-06T02:51:01.662386+0000","last_unstale":"2023-10-06T02:51:01.662786+0000","last_undegraded":"2023-10-06T02:51:01.662786+0000","last_fullsized":"2023-10-06T02:51:01.662786+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.699860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.676928+0000","last_change":"2023-10-06T02:51:00.652974+0000","last_active":"2023-10-06T02:51:01.676928+0000","last_peered":"2023-10-06T02:51:01.676928+0000","last_clean":"2023-10-06T02:51:01.676928+0000","last_became_active":"2023-10-06T02:51:00.652757+0000","last_became_peered":"2023-10-06T02:51:00.652757+0000","last_unstale":"2023-10-06T02:51:01.676928+0000","last_undegraded":"2023-10-06T02:51:01.676928+0000","last_fullsized":"2023-10-06T02:51:01.676928+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:25.453904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.666097+0000","last_change":"2023-10-06T02:51:01.666012+0000","last_active":"2023-10-06T02:51:01.666097+0000","last_peered":"2023-10-06T02:51:01.666097+0000","last_clean":"2023-10-06T02:51:01.666097+0000","last_became_active":"2023-10-06T02:51:01.665785+0000","last_became_peered":"2023-10-06T02:51:01.665785+0000","last_unstale":"2023-10-06T02:51:01.666097+0000","last_undegraded":"2023-10-06T02:51:01.666097+0000","last_fullsized":"2023-10-06T02:51:01.666097+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:23.952304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T02:51:03.935646+0000","last_change":"2023-10-06T02:51:00.646008+0000","last_active":"2023-10-06T02:51:03.935646+0000","last_peered":"2023-10-06T02:51:03.935646+0000","last_clean":"2023-10-06T02:51:03.935646+0000","last_became_active":"2023-10-06T02:51:00.645802+0000","last_became_peered":"2023-10-06T02:51:00.645802+0000","last_unstale":"2023-10-06T02:51:03.935646+0000","last_undegraded":"2023-10-06T02:51:03.935646+0000","last_fullsized":"2023-10-06T02:51:03.935646+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:36.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.664126+0000","last_change":"2023-10-06T02:51:01.663983+0000","last_active":"2023-10-06T02:51:01.664126+0000","last_peered":"2023-10-06T02:51:01.664126+0000","last_clean":"2023-10-06T02:51:01.664126+0000","last_became_active":"2023-10-06T02:51:01.663353+0000","last_became_peered":"2023-10-06T02:51:01.663353+0000","last_unstale":"2023-10-06T02:51:01.664126+0000","last_undegraded":"2023-10-06T02:51:01.664126+0000","last_fullsized":"2023-10-06T02:51:01.664126+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:52.541204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660266+0000","last_change":"2023-10-06T02:51:00.654291+0000","last_active":"2023-10-06T02:51:01.660266+0000","last_peered":"2023-10-06T02:51:01.660266+0000","last_clean":"2023-10-06T02:51:01.660266+0000","last_became_active":"2023-10-06T02:51:00.653786+0000","last_became_peered":"2023-10-06T02:51:00.653786+0000","last_unstale":"2023-10-06T02:51:01.660266+0000","last_undegraded":"2023-10-06T02:51:01.660266+0000","last_fullsized":"2023-10-06T02:51:01.660266+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.665914+0000","last_change":"2023-10-06T02:51:01.665323+0000","last_active":"2023-10-06T02:51:01.665914+0000","last_peered":"2023-10-06T02:51:01.665914+0000","last_clean":"2023-10-06T02:51:01.665914+0000","last_became_active":"2023-10-06T02:51:01.665103+0000","last_became_peered":"2023-10-06T02:51:01.665103+0000","last_unstale":"2023-10-06T02:51:01.665914+0000","last_undegraded":"2023-10-06T02:51:01.665914+0000","last_fullsized":"2023-10-06T02:51:01.665914+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:07.867628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.659543+0000","last_change":"2023-10-06T02:51:00.653380+0000","last_active":"2023-10-06T02:51:01.659543+0000","last_peered":"2023-10-06T02:51:01.659543+0000","last_clean":"2023-10-06T02:51:01.659543+0000","last_became_active":"2023-10-06T02:51:00.652913+0000","last_became_peered":"2023-10-06T02:51:00.652913+0000","last_unstale":"2023-10-06T02:51:01.659543+0000","last_undegraded":"2023-10-06T02:51:01.659543+0000","last_fullsized":"2023-10-06T02:51:01.659543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:29.593116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.662643+0000","last_change":"2023-10-06T02:51:01.662210+0000","last_active":"2023-10-06T02:51:01.662643+0000","last_peered":"2023-10-06T02:51:01.662643+0000","last_clean":"2023-10-06T02:51:01.662643+0000","last_became_active":"2023-10-06T02:51:01.661945+0000","last_became_peered":"2023-10-06T02:51:01.661945+0000","last_unstale":"2023-10-06T02:51:01.662643+0000","last_undegraded":"2023-10-06T02:51:01.662643+0000","last_fullsized":"2023-10-06T02:51:01.662643+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:44.733777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.657823+0000","last_change":"2023-10-06T02:51:00.654738+0000","last_active":"2023-10-06T02:51:01.657823+0000","last_peered":"2023-10-06T02:51:01.657823+0000","last_clean":"2023-10-06T02:51:01.657823+0000","last_became_active":"2023-10-06T02:51:00.654487+0000","last_became_peered":"2023-10-06T02:51:00.654487+0000","last_unstale":"2023-10-06T02:51:01.657823+0000","last_undegraded":"2023-10-06T02:51:01.657823+0000","last_fullsized":"2023-10-06T02:51:01.657823+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:43.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.670526+0000","last_change":"2023-10-06T02:51:01.670467+0000","last_active":"2023-10-06T02:51:01.670526+0000","last_peered":"2023-10-06T02:51:01.670526+0000","last_clean":"2023-10-06T02:51:01.670526+0000","last_became_active":"2023-10-06T02:51:01.670260+0000","last_became_peered":"2023-10-06T02:51:01.670260+0000","last_unstale":"2023-10-06T02:51:01.670526+0000","last_undegraded":"2023-10-06T02:51:01.670526+0000","last_fullsized":"2023-10-06T02:51:01.670526+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:12.319008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.656771+0000","last_change":"2023-10-06T02:51:00.647402+0000","last_active":"2023-10-06T02:51:01.656771+0000","last_peered":"2023-10-06T02:51:01.656771+0000","last_clean":"2023-10-06T02:51:01.656771+0000","last_became_active":"2023-10-06T02:51:00.646818+0000","last_became_peered":"2023-10-06T02:51:00.646818+0000","last_unstale":"2023-10-06T02:51:01.656771+0000","last_undegraded":"2023-10-06T02:51:01.656771+0000","last_fullsized":"2023-10-06T02:51:01.656771+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:31.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.666301+0000","last_change":"2023-10-06T02:51:01.666175+0000","last_active":"2023-10-06T02:51:01.666301+0000","last_peered":"2023-10-06T02:51:01.666301+0000","last_clean":"2023-10-06T02:51:01.666301+0000","last_became_active":"2023-10-06T02:51:01.665947+0000","last_became_peered":"2023-10-06T02:51:01.665947+0000","last_unstale":"2023-10-06T02:51:01.666301+0000","last_undegraded":"2023-10-06T02:51:01.666301+0000","last_fullsized":"2023-10-06T02:51:01.666301+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:51.508604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.659671+0000","last_change":"2023-10-06T02:51:00.652500+0000","last_active":"2023-10-06T02:51:01.659671+0000","last_peered":"2023-10-06T02:51:01.659671+0000","last_clean":"2023-10-06T02:51:01.659671+0000","last_became_active":"2023-10-06T02:51:00.651985+0000","last_became_peered":"2023-10-06T02:51:00.651985+0000","last_unstale":"2023-10-06T02:51:01.659671+0000","last_undegraded":"2023-10-06T02:51:01.659671+0000","last_fullsized":"2023-10-06T02:51:01.659671+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:08.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.663739+0000","last_change":"2023-10-06T02:51:01.663657+0000","last_active":"2023-10-06T02:51:01.663739+0000","last_peered":"2023-10-06T02:51:01.663739+0000","last_clean":"2023-10-06T02:51:01.663739+0000","last_became_active":"2023-10-06T02:51:01.662922+0000","last_became_peered":"2023-10-06T02:51:01.662922+0000","last_unstale":"2023-10-06T02:51:01.663739+0000","last_undegraded":"2023-10-06T02:51:01.663739+0000","last_fullsized":"2023-10-06T02:51:01.663739+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:28.273031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660024+0000","last_change":"2023-10-06T02:51:00.652502+0000","last_active":"2023-10-06T02:51:01.660024+0000","last_peered":"2023-10-06T02:51:01.660024+0000","last_clean":"2023-10-06T02:51:01.660024+0000","last_became_active":"2023-10-06T02:51:00.652287+0000","last_became_peered":"2023-10-06T02:51:00.652287+0000","last_unstale":"2023-10-06T02:51:01.660024+0000","last_undegraded":"2023-10-06T02:51:01.660024+0000","last_fullsized":"2023-10-06T02:51:01.660024+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:38.913069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.667768+0000","last_change":"2023-10-06T02:51:01.667627+0000","last_active":"2023-10-06T02:51:01.667768+0000","last_peered":"2023-10-06T02:51:01.667768+0000","last_clean":"2023-10-06T02:51:01.667768+0000","last_became_active":"2023-10-06T02:51:01.666664+0000","last_became_peered":"2023-10-06T02:51:01.666664+0000","last_unstale":"2023-10-06T02:51:01.667768+0000","last_undegraded":"2023-10-06T02:51:01.667768+0000","last_fullsized":"2023-10-06T02:51:01.667768+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:30.304411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.678356+0000","last_change":"2023-10-06T02:51:00.649652+0000","last_active":"2023-10-06T02:51:01.678356+0000","last_peered":"2023-10-06T02:51:01.678356+0000","last_clean":"2023-10-06T02:51:01.678356+0000","last_became_active":"2023-10-06T02:51:00.649414+0000","last_became_peered":"2023-10-06T02:51:00.649414+0000","last_unstale":"2023-10-06T02:51:01.678356+0000","last_undegraded":"2023-10-06T02:51:01.678356+0000","last_fullsized":"2023-10-06T02:51:01.678356+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:10.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":82,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.663656+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:51:01.663656+0000","last_peered":"2023-10-06T02:51:01.663656+0000","last_clean":"2023-10-06T02:51:01.663656+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:51:01.663656+0000","last_undegraded":"2023-10-06T02:51:01.663656+0000","last_fullsized":"2023-10-06T02:51:01.663656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.669002+0000","last_change":"2023-10-06T02:51:01.668902+0000","last_active":"2023-10-06T02:51:01.669002+0000","last_peered":"2023-10-06T02:51:01.669002+0000","last_clean":"2023-10-06T02:51:01.669002+0000","last_became_active":"2023-10-06T02:51:01.668542+0000","last_became_peered":"2023-10-06T02:51:01.668542+0000","last_unstale":"2023-10-06T02:51:01.669002+0000","last_undegraded":"2023-10-06T02:51:01.669002+0000","last_fullsized":"2023-10-06T02:51:01.669002+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:39.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.678538+0000","last_change":"2023-10-06T02:51:00.652167+0000","last_active":"2023-10-06T02:51:01.678538+0000","last_peered":"2023-10-06T02:51:01.678538+0000","last_clean":"2023-10-06T02:51:01.678538+0000","last_became_active":"2023-10-06T02:51:00.651572+0000","last_became_peered":"2023-10-06T02:51:00.651572+0000","last_unstale":"2023-10-06T02:51:01.678538+0000","last_undegraded":"2023-10-06T02:51:01.678538+0000","last_fullsized":"2023-10-06T02:51:01.678538+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:40.995411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":91,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.656857+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:51:01.656857+0000","last_peered":"2023-10-06T02:51:01.656857+0000","last_clean":"2023-10-06T02:51:01.656857+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:51:01.656857+0000","last_undegraded":"2023-10-06T02:51:01.656857+0000","last_fullsized":"2023-10-06T02:51:01.656857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.661629+0000","last_change":"2023-10-06T02:51:01.661186+0000","last_active":"2023-10-06T02:51:01.661629+0000","last_peered":"2023-10-06T02:51:01.661629+0000","last_clean":"2023-10-06T02:51:01.661629+0000","last_became_active":"2023-10-06T02:51:01.660947+0000","last_became_peered":"2023-10-06T02:51:01.660947+0000","last_unstale":"2023-10-06T02:51:01.661629+0000","last_undegraded":"2023-10-06T02:51:01.661629+0000","last_fullsized":"2023-10-06T02:51:01.661629+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:53.829281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.678726+0000","last_change":"2023-10-06T02:51:00.654701+0000","last_active":"2023-10-06T02:51:01.678726+0000","last_peered":"2023-10-06T02:51:01.678726+0000","last_clean":"2023-10-06T02:51:01.678726+0000","last_became_active":"2023-10-06T02:51:00.654174+0000","last_became_peered":"2023-10-06T02:51:00.654174+0000","last_unstale":"2023-10-06T02:51:01.678726+0000","last_undegraded":"2023-10-06T02:51:01.678726+0000","last_fullsized":"2023-10-06T02:51:01.678726+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:22.851612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.655131+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:51:01.655131+0000","last_peered":"2023-10-06T02:51:01.655131+0000","last_clean":"2023-10-06T02:51:01.655131+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:51:01.655131+0000","last_undegraded":"2023-10-06T02:51:01.655131+0000","last_fullsized":"2023-10-06T02:51:01.655131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.667144+0000","last_change":"2023-10-06T02:51:01.667073+0000","last_active":"2023-10-06T02:51:01.667144+0000","last_peered":"2023-10-06T02:51:01.667144+0000","last_clean":"2023-10-06T02:51:01.667144+0000","last_became_active":"2023-10-06T02:51:01.666498+0000","last_became_peered":"2023-10-06T02:51:01.666498+0000","last_unstale":"2023-10-06T02:51:01.667144+0000","last_undegraded":"2023-10-06T02:51:01.667144+0000","last_fullsized":"2023-10-06T02:51:01.667144+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:02.982360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.661620+0000","last_change":"2023-10-06T02:51:00.651643+0000","last_active":"2023-10-06T02:51:01.661620+0000","last_peered":"2023-10-06T02:51:01.661620+0000","last_clean":"2023-10-06T02:51:01.661620+0000","last_became_active":"2023-10-06T02:51:00.651163+0000","last_became_peered":"2023-10-06T02:51:00.651163+0000","last_unstale":"2023-10-06T02:51:01.661620+0000","last_undegraded":"2023-10-06T02:51:01.661620+0000","last_fullsized":"2023-10-06T02:51:01.661620+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:13.596236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":91,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.656605+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:51:01.656605+0000","last_peered":"2023-10-06T02:51:01.656605+0000","last_clean":"2023-10-06T02:51:01.656605+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:51:01.656605+0000","last_undegraded":"2023-10-06T02:51:01.656605+0000","last_fullsized":"2023-10-06T02:51:01.656605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":234,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660559+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:51:01.660559+0000","last_peered":"2023-10-06T02:51:01.660559+0000","last_clean":"2023-10-06T02:51:01.660559+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:51:01.660559+0000","last_undegraded":"2023-10-06T02:51:01.660559+0000","last_fullsized":"2023-10-06T02:51:01.660559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.665532+0000","last_change":"2023-10-06T02:51:01.665479+0000","last_active":"2023-10-06T02:51:01.665532+0000","last_peered":"2023-10-06T02:51:01.665532+0000","last_clean":"2023-10-06T02:51:01.665532+0000","last_became_active":"2023-10-06T02:51:01.665340+0000","last_became_peered":"2023-10-06T02:51:01.665340+0000","last_unstale":"2023-10-06T02:51:01.665532+0000","last_undegraded":"2023-10-06T02:51:01.665532+0000","last_fullsized":"2023-10-06T02:51:01.665532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:45.312536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.677132+0000","last_change":"2023-10-06T02:51:00.653681+0000","last_active":"2023-10-06T02:51:01.677132+0000","last_peered":"2023-10-06T02:51:01.677132+0000","last_clean":"2023-10-06T02:51:01.677132+0000","last_became_active":"2023-10-06T02:51:00.653235+0000","last_became_peered":"2023-10-06T02:51:00.653235+0000","last_unstale":"2023-10-06T02:51:01.677132+0000","last_undegraded":"2023-10-06T02:51:01.677132+0000","last_fullsized":"2023-10-06T02:51:01.677132+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.813740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660166+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:51:01.660166+0000","last_peered":"2023-10-06T02:51:01.660166+0000","last_clean":"2023-10-06T02:51:01.660166+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:51:01.660166+0000","last_undegraded":"2023-10-06T02:51:01.660166+0000","last_fullsized":"2023-10-06T02:51:01.660166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.658121+0000","last_change":"2023-10-06T02:51:01.658074+0000","last_active":"2023-10-06T02:51:01.658121+0000","last_peered":"2023-10-06T02:51:01.658121+0000","last_clean":"2023-10-06T02:51:01.658121+0000","last_became_active":"2023-10-06T02:51:01.657852+0000","last_became_peered":"2023-10-06T02:51:01.657852+0000","last_unstale":"2023-10-06T02:51:01.658121+0000","last_undegraded":"2023-10-06T02:51:01.658121+0000","last_fullsized":"2023-10-06T02:51:01.658121+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:39.916764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.655250+0000","last_change":"2023-10-06T02:51:00.644728+0000","last_active":"2023-10-06T02:51:01.655250+0000","last_peered":"2023-10-06T02:51:01.655250+0000","last_clean":"2023-10-06T02:51:01.655250+0000","last_became_active":"2023-10-06T02:51:00.644509+0000","last_became_peered":"2023-10-06T02:51:00.644509+0000","last_unstale":"2023-10-06T02:51:01.655250+0000","last_undegraded":"2023-10-06T02:51:01.655250+0000","last_fullsized":"2023-10-06T02:51:01.655250+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:33.751928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660656+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:51:01.660656+0000","last_peered":"2023-10-06T02:51:01.660656+0000","last_clean":"2023-10-06T02:51:01.660656+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:51:01.660656+0000","last_undegraded":"2023-10-06T02:51:01.660656+0000","last_fullsized":"2023-10-06T02:51:01.660656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.666790+0000","last_change":"2023-10-06T02:51:01.666726+0000","last_active":"2023-10-06T02:51:01.666790+0000","last_peered":"2023-10-06T02:51:01.666790+0000","last_clean":"2023-10-06T02:51:01.666790+0000","last_became_active":"2023-10-06T02:51:01.666448+0000","last_became_peered":"2023-10-06T02:51:01.666448+0000","last_unstale":"2023-10-06T02:51:01.666790+0000","last_undegraded":"2023-10-06T02:51:01.666790+0000","last_fullsized":"2023-10-06T02:51:01.666790+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:23.855306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.656994+0000","last_change":"2023-10-06T02:51:00.651716+0000","last_active":"2023-10-06T02:51:01.656994+0000","last_peered":"2023-10-06T02:51:01.656994+0000","last_clean":"2023-10-06T02:51:01.656994+0000","last_became_active":"2023-10-06T02:51:00.651468+0000","last_became_peered":"2023-10-06T02:51:00.651468+0000","last_unstale":"2023-10-06T02:51:01.656994+0000","last_undegraded":"2023-10-06T02:51:01.656994+0000","last_fullsized":"2023-10-06T02:51:01.656994+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:48.405419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.661562+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:51:01.661562+0000","last_peered":"2023-10-06T02:51:01.661562+0000","last_clean":"2023-10-06T02:51:01.661562+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:51:01.661562+0000","last_undegraded":"2023-10-06T02:51:01.661562+0000","last_fullsized":"2023-10-06T02:51:01.661562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.664109+0000","last_change":"2023-10-06T02:51:01.663848+0000","last_active":"2023-10-06T02:51:01.664109+0000","last_peered":"2023-10-06T02:51:01.664109+0000","last_clean":"2023-10-06T02:51:01.664109+0000","last_became_active":"2023-10-06T02:51:01.663063+0000","last_became_peered":"2023-10-06T02:51:01.663063+0000","last_unstale":"2023-10-06T02:51:01.664109+0000","last_undegraded":"2023-10-06T02:51:01.664109+0000","last_fullsized":"2023-10-06T02:51:01.664109+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:00.638981+0000","last_clean_scrub_stamp":"2023-10-06T02:51:00.638981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:04.025976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.655335+0000","last_change":"2023-10-06T02:51:00.647127+0000","last_active":"2023-10-06T02:51:01.655335+0000","last_peered":"2023-10-06T02:51:01.655335+0000","last_clean":"2023-10-06T02:51:01.655335+0000","last_became_active":"2023-10-06T02:51:00.646586+0000","last_became_peered":"2023-10-06T02:51:00.646586+0000","last_unstale":"2023-10-06T02:51:01.655335+0000","last_undegraded":"2023-10-06T02:51:01.655335+0000","last_fullsized":"2023-10-06T02:51:01.655335+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:50:59.635286+0000","last_clean_scrub_stamp":"2023-10-06T02:50:59.635286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:08.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T02:51:01.660862+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:51:01.660862+0000","last_peered":"2023-10-06T02:51:01.660862+0000","last_clean":"2023-10-06T02:51:01.660862+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:51:01.660862+0000","last_undegraded":"2023-10-06T02:51:01.660862+0000","last_fullsized":"2023-10-06T02:51:01.660862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1140,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194172,"statfs":{"total":200000000,"available":198832229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":1.393,"15min":1.393},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67400000000000004,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":1.081,"15min":1.081},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.70999999999999996,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48099999999999998},"min":{"1min":0.46200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.435},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70099999999999996,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.63200000000000001},"min":{"1min":0.41799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70499999999999996,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61899999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68300000000000005,"5min":0.879,"15min":0.879},"last":0.311},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68700000000000006,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":565,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194746,"statfs":{"total":200000000,"available":199420541,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.629},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69499999999999995,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":1.879,"15min":1.879},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67400000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.78300000000000003,"15min":1.028},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.505}]},{"osd":2,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68700000000000006,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.442},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.58299999999999996},"min":{"1min":0.35799999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67400000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67900000000000005,"5min":1.163,"15min":1.163},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.56399999999999995},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":1.05,"15min":1.05},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.61899999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72799999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.63},"min":{"1min":0.39200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.60599999999999998},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":38,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":563,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194748,"statfs":{"total":200000000,"available":199422583,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.31,"15min":0.312},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.35099999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38900000000000001,"15min":0.38},"min":{"1min":0.313,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.36599999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69399999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46700000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77800000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.47399999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.443,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80100000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.47799999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.72299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194169,"statfs":{"total":200000000,"available":198830071,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33700000000000002,"15min":0.34899999999999998},"min":{"1min":0.21199999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.439,"5min":1.177,"15min":1.177},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38100000000000001,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51300000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.54400000000000004,"15min":1.1100000000000001},"min":{"1min":0.23899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.56899999999999995,"5min":22.038,"15min":22.038},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.247,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56499999999999995,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35499999999999998,"15min":0.36199999999999999},"min":{"1min":0.22600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.495,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.312},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.58599999999999997,"15min":1.141},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.503,"5min":21.942,"15min":21.942},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.72199999999999998,"15min":1.202},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59899999999999998,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.76000000000000001,"15min":1.2969999999999999},"min":{"1min":0.40999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.433,"5min":0.311,"15min":0.311},"max":{"1min":0.70699999999999996,"5min":1.401,"15min":1.401},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.755,"15min":1.2330000000000001},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68899999999999995,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.624},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.77900000000000003,"15min":1.323},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69899999999999995,"5min":21.98,"15min":21.98},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58099999999999996,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.79900000000000004,"5min":1.425,"15min":1.425},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.68799999999999994,"15min":0.93400000000000005},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73499999999999999,"5min":11.154,"15min":11.154},"last":0.68700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":563,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194748,"statfs":{"total":200000000,"available":199422653,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.33600000000000002},"min":{"1min":0.27700000000000002,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52200000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.309},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.34399999999999997},"min":{"1min":0.22,"5min":0.186,"15min":0.186},"max":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.37,"15min":0.35799999999999998},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56200000000000006,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.28199999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.63300000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39700000000000002,"15min":0.376},"min":{"1min":0.33300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60999999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.372},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61399999999999999,"15min":0.58399999999999996},"min":{"1min":0.47499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59499999999999997,"15min":0.55900000000000005},"min":{"1min":0.40000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61599999999999999,"15min":0.59899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.93899999999999995,"5min":1.002,"15min":1.002},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.433,"5min":0.375,"15min":0.375},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61899999999999999,"15min":0.59499999999999997},"min":{"1min":0.52500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.67500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":563,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194748,"statfs":{"total":200000000,"available":199422653,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.22700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.32300000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.375},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.34200000000000003},"min":{"1min":0.27900000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39200000000000002,"15min":0.36799999999999999},"min":{"1min":0.28299999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.64800000000000002,"5min":3.044,"15min":3.044},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.35599999999999998,"15min":0.33900000000000002},"min":{"1min":0.29899999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74099999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72999999999999998,"5min":2.25,"15min":2.25},"last":0.623}]},{"osd":5,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.70399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83599999999999997,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76800000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.80500000000000005,"15min":1.0049999999999999},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84199999999999997,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":563,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194748,"statfs":{"total":200000000,"available":199422493,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.58199999999999996,"15min":0.80800000000000005},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63100000000000001,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.63400000000000001},"min":{"1min":0.38800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.72499999999999998,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.628}]},{"osd":1,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61299999999999999,"15min":0.84299999999999997},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65300000000000002,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59299999999999997,"15min":0.79100000000000004},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.65500000000000003},"min":{"1min":0.312,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70799999999999996,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.68500000000000005},"min":{"1min":0.378,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69499999999999995,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.60299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53200000000000003,"15min":0.59399999999999997},"min":{"1min":0.38500000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64700000000000002,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.62},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77000000000000002,"5min":3.456,"15min":3.456},"last":0.502}]},{"osd":5,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46999999999999997,"15min":0.48999999999999999},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.67300000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49399999999999999,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.624,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.52200000000000002},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.39900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.42299999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.71499999999999997,"15min":1.0469999999999999},"min":{"1min":0.49099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.747,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.61299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":563,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194748,"statfs":{"total":200000000,"available":199422653,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.315,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.755,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.38500000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55300000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65600000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45700000000000002,"15min":0.45000000000000001},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.73699999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.879,"15min":0.879},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73299999999999998}]}]}],"pool_statfs":[]}} 2023-10-06T02:51:10.584 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:51:10.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:51:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.736+0000 7f2bcbfff700 1 Processor -- start 2023-10-06T02:51:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.736+0000 7f2bcbfff700 1 -- start start 2023-10-06T02:51:10.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2bcc0b1ef0 0x7f2bcc06da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2bcc06f4f0 0x7f2bcc0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcbfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bcc068d40 con 0x7f2bcc0b2800 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcbfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bcc15a520 con 0x7f2bcc0b1ef0 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcbfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bcc06e2d0 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2bcc0b1ef0 0x7f2bcc06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2bcc0b2800 0x7f2bcc0691d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56078/0 (socket says 172.21.15.81:56078) 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcb7fe700 1 -- 172.21.15.81:0/821195448 learned_addr learned my addr 172.21.15.81:0/821195448 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bca7fc700 1 --2- 172.21.15.81:0/821195448 >> v2:172.21.15.83:3300/0 conn(0x7f2bcc06f4f0 0x7f2bcc0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcaffd700 1 -- 172.21.15.81:0/821195448 >> v2:172.21.15.83:3300/0 conn(0x7f2bcc06f4f0 msgr2=0x7f2bcc0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcaffd700 1 --2- 172.21.15.81:0/821195448 >> v2:172.21.15.83:3300/0 conn(0x7f2bcc06f4f0 0x7f2bcc0b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcaffd700 1 -- 172.21.15.81:0/821195448 >> v1:172.21.15.81:6789/0 conn(0x7f2bcc0b2800 legacy=0x7f2bcc0691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcaffd700 1 -- 172.21.15.81:0/821195448 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc0686f0 con 0x7f2bcc0b1ef0 2023-10-06T02:51:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bc9ffb700 1 -- 172.21.15.81:0/821195448 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227002310 0 0) 0x7f2bcc068d40 con 0x7f2bcc0b2800 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bcaffd700 1 --2- 172.21.15.81:0/821195448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc0b1ef0 0x7f2bcc06da20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0d1c90 tx=0x7f2bbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25391a6b7b074f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.737+0000 7f2bc9ffb700 1 -- 172.21.15.81:0/821195448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc00e070 con 0x7f2bcc0b1ef0 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bc9ffb700 1 -- 172.21.15.81:0/821195448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc00bc30 con 0x7f2bcc0b1ef0 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bc9ffb700 1 -- 172.21.15.81:0/821195448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc012430 con 0x7f2bcc0b1ef0 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bcbfff700 1 -- 172.21.15.81:0/821195448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc0b1ef0 msgr2=0x7f2bcc06da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bcbfff700 1 --2- 172.21.15.81:0/821195448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc0b1ef0 0x7f2bcc06da20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0d1c90 tx=0x7f2bbc009780 comp rx=0 tx=0).stop 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bcbfff700 1 -- 172.21.15.81:0/821195448 shutdown_connections 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bcbfff700 1 --2- 172.21.15.81:0/821195448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc0b1ef0 0x7f2bcc06da20 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bcbfff700 1 --2- 172.21.15.81:0/821195448 >> v2:172.21.15.83:3300/0 conn(0x7f2bcc06f4f0 0x7f2bcc0b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bcbfff700 1 -- 172.21.15.81:0/821195448 >> 172.21.15.81:0/821195448 conn(0x7f2bcc0d0bb0 msgr2=0x7f2bcc0d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bcbfff700 1 -- 172.21.15.81:0/821195448 shutdown_connections 2023-10-06T02:51:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.738+0000 7f2bcbfff700 1 -- 172.21.15.81:0/821195448 wait complete. 2023-10-06T02:51:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.739+0000 7f2bcbfff700 1 Processor -- start 2023-10-06T02:51:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.739+0000 7f2bcbfff700 1 -- start start 2023-10-06T02:51:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc06f4f0 0x7f2bcc15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bcc0b1ef0 0x7f2bcc0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bcc0b2800 0x7f2bcc0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcbfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc15c810 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc15be40 con 0x7f2bcc0b2800 2023-10-06T02:51:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc16e6e0 con 0x7f2bcc0b1ef0 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc06f4f0 0x7f2bcc15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc06f4f0 0x7f2bcc15c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47986/0 (socket says 172.21.15.81:47986) 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcaffd700 1 -- 172.21.15.81:0/568742702 learned_addr learned my addr 172.21.15.81:0/568742702 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bca7fc700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bcc0b1ef0 0x7f2bcc0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcb7fe700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bcc0b2800 0x7f2bcc0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcaffd700 1 -- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bcc0b1ef0 msgr2=0x7f2bcc0b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcaffd700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bcc0b1ef0 0x7f2bcc0b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcaffd700 1 -- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bcc0b2800 msgr2=0x7f2bcc0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcaffd700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bcc0b2800 0x7f2bcc0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcaffd700 1 -- 172.21.15.81:0/568742702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc009a20 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bca7fc700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bcc0b1ef0 0x7f2bcc0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.740+0000 7f2bcaffd700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc06f4f0 0x7f2bcc15c2d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0099f0 tx=0x7f2bbc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.741+0000 7f2bc2ffd700 1 -- 172.21.15.81:0/568742702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc027470 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.741+0000 7f2bc2ffd700 1 -- 172.21.15.81:0/568742702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc027610 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.741+0000 7f2bc2ffd700 1 -- 172.21.15.81:0/568742702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0279d0 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.741+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bcc15b7f0 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.741+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bcc0b5f00 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.741+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bcc15c120 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.742+0000 7f2bc2ffd700 1 -- 172.21.15.81:0/568742702 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2bbc024070 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.742+0000 7f2bc2ffd700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bac066f30 0x7f2bac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.742+0000 7f2bc2ffd700 1 -- 172.21.15.81:0/568742702 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2bbc086cd0 con 0x7f2bcc06f4f0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.742+0000 7f2bca7fc700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bac066f30 0x7f2bac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.743+0000 7f2bca7fc700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bac066f30 0x7f2bac0693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc158220 tx=0x7f2bb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:10.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:10.747+0000 7f2bc2ffd700 1 -- 172.21.15.81:0/568742702 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bbc053de0 con 0x7f2bcc06f4f0 2023-10-06T02:51:11.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.001+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2bcc15b630 con 0x7f2bcc06f4f0 2023-10-06T02:51:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.005+0000 7f2bc2ffd700 1 -- 172.21.15.81:0/568742702 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2bbc02c020 con 0x7f2bcc06f4f0 2023-10-06T02:51:11.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bac066f30 msgr2=0x7f2bac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bac066f30 0x7f2bac0693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc158220 tx=0x7f2bb4008040 comp rx=0 tx=0).stop 2023-10-06T02:51:11.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc06f4f0 msgr2=0x7f2bcc15c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc06f4f0 0x7f2bcc15c2d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0099f0 tx=0x7f2bbc019000 comp rx=0 tx=0).stop 2023-10-06T02:51:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 shutdown_connections 2023-10-06T02:51:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bac066f30 0x7f2bac0693e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bcc0b2800 0x7f2bcc0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bcc06f4f0 0x7f2bcc15c2d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 --2- 172.21.15.81:0/568742702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bcc0b1ef0 0x7f2bcc0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 >> 172.21.15.81:0/568742702 conn(0x7f2bcc0d0bb0 msgr2=0x7f2bcc0b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 shutdown_connections 2023-10-06T02:51:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.007+0000 7f2bcbfff700 1 -- 172.21.15.81:0/568742702 wait complete. 2023-10-06T02:51:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:51:11.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:11.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.132+0000 7f4251b44700 1 Processor -- start 2023-10-06T02:51:11.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.132+0000 7f4251b44700 1 -- start start 2023-10-06T02:51:11.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.133+0000 7f4251b44700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f424c06d830 0x7f424c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.133+0000 7f4251b44700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424c0d07c0 con 0x7f424c157ca0 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.133+0000 7f4251b44700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424c0cfbb0 con 0x7f424c1578d0 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.133+0000 7f4251b44700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424c0cfe90 con 0x7f424c06d830 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.133+0000 7f424affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f424c157ca0 0x7f424c06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56082/0 (socket says 172.21.15.81:56082) 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.133+0000 7f424affd700 1 -- 172.21.15.81:0/3410265638 learned_addr learned my addr 172.21.15.81:0/3410265638 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.133+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468431881 0 0) 0x7f424c0d07c0 con 0x7f424c157ca0 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.133+0000 7f424bfff700 1 --2- 172.21.15.81:0/3410265638 >> v2:172.21.15.83:3300/0 conn(0x7f424c06d830 0x7f424c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.133+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4234003570 con 0x7f424c157ca0 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1312086766 0 0) 0x7f4234003570 con 0x7f424c157ca0 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 >> v2:172.21.15.83:3300/0 conn(0x7f424c06d830 msgr2=0x7f424c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 --2- 172.21.15.81:0/3410265638 >> v2:172.21.15.83:3300/0 conn(0x7f424c06d830 0x7f424c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 >> v1:172.21.15.83:6789/0 conn(0x7f424c1578d0 legacy=0x7f424c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c0d0170 con 0x7f424c157ca0 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f4240001470 con 0x7f424c157ca0 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 >> v1:172.21.15.81:6789/0 conn(0x7f424c157ca0 legacy=0x7f424c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234003a60 0x7f4234003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4234004810 0x7f4234004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42340051c0 0x7f423400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c0cfe90 con 0x7f4234004810 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423400c0d0 con 0x7f4234003a60 2023-10-06T02:51:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423400c290 con 0x7f42340051c0 2023-10-06T02:51:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424affd700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4234004810 0x7f4234004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424b7fe700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234003a60 0x7f4234003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424bfff700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42340051c0 0x7f423400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424affd700 1 -- 172.21.15.81:0/3410265638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42340051c0 msgr2=0x7f423400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424affd700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42340051c0 0x7f423400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424affd700 1 -- 172.21.15.81:0/3410265638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234003a60 msgr2=0x7f4234003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424affd700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234003a60 0x7f4234003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424bfff700 1 -- 172.21.15.81:0/3410265638 reap_dead start 2023-10-06T02:51:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424affd700 1 -- 172.21.15.81:0/3410265638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4234003570 con 0x7f4234004810 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424affd700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4234004810 0x7f4234004c80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f424000c390 tx=0x7f4240001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4d70cced1c467d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000cbe0 con 0x7f4234004810 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424000cd40 con 0x7f4234004810 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.134+0000 7f424a7fc700 1 -- 172.21.15.81:0/3410265638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240005b50 con 0x7f4234004810 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.135+0000 7f4251b44700 1 -- 172.21.15.81:0/3410265638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4234004810 msgr2=0x7f4234004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.135+0000 7f4251b44700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4234004810 0x7f4234004c80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f424000c390 tx=0x7f4240001e50 comp rx=0 tx=0).stop 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.135+0000 7f4251b44700 1 -- 172.21.15.81:0/3410265638 shutdown_connections 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.135+0000 7f4251b44700 1 --2- 172.21.15.81:0/3410265638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4234004810 0x7f4234004c80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.135+0000 7f4251b44700 1 -- 172.21.15.81:0/3410265638 >> 172.21.15.81:0/3410265638 conn(0x7f424c06bb90 msgr2=0x7f424c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.135+0000 7f4251b44700 1 -- 172.21.15.81:0/3410265638 shutdown_connections 2023-10-06T02:51:11.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.135+0000 7f4251b44700 1 -- 172.21.15.81:0/3410265638 wait complete. 2023-10-06T02:51:11.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.136+0000 7f4251b44700 1 Processor -- start 2023-10-06T02:51:11.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.136+0000 7f4251b44700 1 -- start start 2023-10-06T02:51:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f4251b44700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234004810 0x7f424c16a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f4251b44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f424c0b65c0 0x7f424c16d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f4251b44700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f424c0b3ba0 0x7f424c15c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f4251b44700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c0c5c50 con 0x7f424c0b65c0 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f4251b44700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c0b43d0 con 0x7f4234004810 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f4251b44700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424c0b46b0 con 0x7f424c0b3ba0 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f424c0b65c0 0x7f424c16d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f424c0b65c0 0x7f424c16d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48004/0 (socket says 172.21.15.81:48004) 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424affd700 1 -- 172.21.15.81:0/1574909246 learned_addr learned my addr 172.21.15.81:0/1574909246 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424bfff700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f424c0b3ba0 0x7f424c15c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424b7fe700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234004810 0x7f424c16a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424affd700 1 -- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f424c0b3ba0 msgr2=0x7f424c15c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424affd700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f424c0b3ba0 0x7f424c15c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424affd700 1 -- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234004810 msgr2=0x7f424c16a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424affd700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234004810 0x7f424c16a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424affd700 1 -- 172.21.15.81:0/1574909246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c0b4990 con 0x7f424c0b65c0 2023-10-06T02:51:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424b7fe700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234004810 0x7f424c16a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.137+0000 7f424affd700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f424c0b65c0 0x7f424c16d5a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f424000c980 tx=0x7f4240015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.138+0000 7f42337fe700 1 -- 172.21.15.81:0/1574909246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240022070 con 0x7f424c0b65c0 2023-10-06T02:51:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.138+0000 7f42337fe700 1 -- 172.21.15.81:0/1574909246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4240001430 con 0x7f424c0b65c0 2023-10-06T02:51:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.138+0000 7f42337fe700 1 -- 172.21.15.81:0/1574909246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240007300 con 0x7f424c0b65c0 2023-10-06T02:51:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.138+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424c0b4c70 con 0x7f424c0b65c0 2023-10-06T02:51:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.138+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424c15cd60 con 0x7f424c0b65c0 2023-10-06T02:51:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.138+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424c067ac0 con 0x7f424c0b65c0 2023-10-06T02:51:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.139+0000 7f42337fe700 1 -- 172.21.15.81:0/1574909246 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f424001e430 con 0x7f424c0b65c0 2023-10-06T02:51:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.139+0000 7f42337fe700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4238066f30 0x7f42380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.139+0000 7f42337fe700 1 -- 172.21.15.81:0/1574909246 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4240085210 con 0x7f424c0b65c0 2023-10-06T02:51:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.140+0000 7f424b7fe700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4238066f30 0x7f42380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.140+0000 7f424b7fe700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4238066f30 0x7f42380693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f423c000f80 tx=0x7f423c001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.144+0000 7f42337fe700 1 -- 172.21.15.81:0/1574909246 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4240052320 con 0x7f424c0b65c0 2023-10-06T02:51:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.367+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f424c0c5d90 con 0x7f424c0b65c0 2023-10-06T02:51:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.368+0000 7f42337fe700 1 -- 172.21.15.81:0/1574909246 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f4240055940 con 0x7f424c0b65c0 2023-10-06T02:51:11.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:11.369 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:01.019609+0000","modified":"2023-10-06T02:51:04.689923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/907018385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":907018385},{"type":"v1","addr":"172.21.15.81:6835","nonce":907018385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:51:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4238066f30 msgr2=0x7f42380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4238066f30 0x7f42380693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f423c000f80 tx=0x7f423c001640 comp rx=0 tx=0).stop 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f424c0b65c0 msgr2=0x7f424c16d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f424c0b65c0 0x7f424c16d5a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f424000c980 tx=0x7f4240015000 comp rx=0 tx=0).stop 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 shutdown_connections 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f424c0b3ba0 0x7f424c15c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4238066f30 0x7f42380693e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234004810 0x7f424c16a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 --2- 172.21.15.81:0/1574909246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f424c0b65c0 0x7f424c16d5a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 >> 172.21.15.81:0/1574909246 conn(0x7f424c06bb90 msgr2=0x7f424c15da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 shutdown_connections 2023-10-06T02:51:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.370+0000 7f4251b44700 1 -- 172.21.15.81:0/1574909246 wait complete. 2023-10-06T02:51:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-06T02:51:11.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:51:01.019609+0000', 'modified': '2023-10-06T02:51:04.689923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6465}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6465': {'gid': 6465, 'name': 'c', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.81:6835/907018385', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 907018385}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 907018385}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:51:11.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:51:11.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:51:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.900+0000 7f2539397700 1 Processor -- start 2023-10-06T02:51:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.900+0000 7f2539397700 1 -- start start 2023-10-06T02:51:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2539397700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2534159b40 0x7f25340cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2539397700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2534159f10 0x7f2534068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2539397700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f25340ccb40 0x7f2534068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2539397700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25340cee10 con 0x7f2534159b40 2023-10-06T02:51:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2539397700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25340cd040 con 0x7f25340ccb40 2023-10-06T02:51:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2539397700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340cd320 con 0x7f2534159f10 2023-10-06T02:51:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2533fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2534159b40 0x7f25340cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2533fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2534159b40 0x7f25340cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48010/0 (socket says 172.21.15.81:48010) 2023-10-06T02:51:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2533fff700 1 -- 172.21.15.81:0/1845502467 learned_addr learned my addr 172.21.15.81:0/1845502467 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2533fff700 1 -- 172.21.15.81:0/1845502467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2534159f10 msgr2=0x7f2534068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2533fff700 1 --2- 172.21.15.81:0/1845502467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2534159f10 0x7f2534068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2533fff700 1 -- 172.21.15.81:0/1845502467 >> v2:172.21.15.83:3300/0 conn(0x7f25340ccb40 msgr2=0x7f2534068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2538b96700 1 --2- 172.21.15.81:0/1845502467 >> v2:172.21.15.83:3300/0 conn(0x7f25340ccb40 0x7f2534068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2533fff700 1 --2- 172.21.15.81:0/1845502467 >> v2:172.21.15.83:3300/0 conn(0x7f25340ccb40 0x7f2534068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.901+0000 7f2533fff700 1 -- 172.21.15.81:0/1845502467 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25340ce7c0 con 0x7f2534159b40 2023-10-06T02:51:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2533fff700 1 --2- 172.21.15.81:0/1845502467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159b40 0x7f25340cc600 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f25340b6bf0 tx=0x7f2524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4137263a12b54e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2532ffd700 1 -- 172.21.15.81:0/1845502467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252400b860 con 0x7f2534159b40 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2532ffd700 1 -- 172.21.15.81:0/1845502467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252400b9c0 con 0x7f2534159b40 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2532ffd700 1 -- 172.21.15.81:0/1845502467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252400bd60 con 0x7f2534159b40 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2539397700 1 -- 172.21.15.81:0/1845502467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159b40 msgr2=0x7f25340cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2539397700 1 --2- 172.21.15.81:0/1845502467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159b40 0x7f25340cc600 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f25340b6bf0 tx=0x7f2524009250 comp rx=0 tx=0).stop 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2539397700 1 -- 172.21.15.81:0/1845502467 shutdown_connections 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2539397700 1 --2- 172.21.15.81:0/1845502467 >> v2:172.21.15.83:3300/0 conn(0x7f25340ccb40 0x7f2534068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2539397700 1 --2- 172.21.15.81:0/1845502467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159b40 0x7f25340cc600 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2539397700 1 --2- 172.21.15.81:0/1845502467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2534159f10 0x7f2534068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2539397700 1 -- 172.21.15.81:0/1845502467 >> 172.21.15.81:0/1845502467 conn(0x7f25340cd660 msgr2=0x7f25340cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2539397700 1 -- 172.21.15.81:0/1845502467 shutdown_connections 2023-10-06T02:51:11.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.902+0000 7f2539397700 1 -- 172.21.15.81:0/1845502467 wait complete. 2023-10-06T02:51:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.903+0000 7f2539397700 1 Processor -- start 2023-10-06T02:51:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2539397700 1 -- start start 2023-10-06T02:51:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2539397700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25340ccb40 0x7f25340ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2539397700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2534159b40 0x7f2534158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2539397700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159f10 0x7f2534155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2539397700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25341590c0 con 0x7f2534159f10 2023-10-06T02:51:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2539397700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2534157f00 con 0x7f2534159b40 2023-10-06T02:51:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2539397700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340c92b0 con 0x7f25340ccb40 2023-10-06T02:51:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2538b96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159f10 0x7f2534155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2538b96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159f10 0x7f2534155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48016/0 (socket says 172.21.15.81:48016) 2023-10-06T02:51:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2538b96700 1 -- 172.21.15.81:0/1932792030 learned_addr learned my addr 172.21.15.81:0/1932792030 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f25337fe700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2534159b40 0x7f2534158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.904+0000 7f2533fff700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25340ccb40 0x7f25340ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f2538b96700 1 -- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25340ccb40 msgr2=0x7f25340ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f2538b96700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25340ccb40 0x7f25340ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f2538b96700 1 -- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2534159b40 msgr2=0x7f2534158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f2538b96700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2534159b40 0x7f2534158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f2538b96700 1 -- 172.21.15.81:0/1932792030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25240094f0 con 0x7f2534159f10 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f25337fe700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2534159b40 0x7f2534158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f2538b96700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159f10 0x7f2534155b90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f252c00ceb0 tx=0x7f252c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f251bfff700 1 -- 172.21.15.81:0/1932792030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00ae40 con 0x7f2534159f10 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f251bfff700 1 -- 172.21.15.81:0/1932792030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c016430 con 0x7f2534159f10 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f2539397700 1 -- 172.21.15.81:0/1932792030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25340c9590 con 0x7f2534159f10 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f251bfff700 1 -- 172.21.15.81:0/1932792030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c0167d0 con 0x7f2534159f10 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.905+0000 7f2539397700 1 -- 172.21.15.81:0/1932792030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25340c9b50 con 0x7f2534159f10 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.906+0000 7f251bfff700 1 -- 172.21.15.81:0/1932792030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f252c003020 con 0x7f2534159f10 2023-10-06T02:51:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.907+0000 7f251bfff700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2520066fb0 0x7f2520069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.907+0000 7f251bfff700 1 -- 172.21.15.81:0/1932792030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f252c012070 con 0x7f2534159f10 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.907+0000 7f2533fff700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2520066fb0 0x7f2520069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.907+0000 7f2533fff700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2520066fb0 0x7f2520069460 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f25340b6bf0 tx=0x7f2524017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.909+0000 7f25438f1b80 1 Processor -- start 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.909+0000 7f25438f1b80 1 -- start start 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.909+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836aaacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.909+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836aab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.909+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836aab740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.909+0000 7f25438f1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557836a05a70 con 0x557836acfe50 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.909+0000 7f25438f1b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x557836a03270 con 0x557836ab1a10 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.909+0000 7f25438f1b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578369ff060 con 0x557836ab02c0 2023-10-06T02:51:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2533fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836aaacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2533fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836aaacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48020/0 (socket says 172.21.15.81:48020) 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2533fff700 1 -- 172.21.15.81:0/1810843159 learned_addr learned my addr 172.21.15.81:0/1810843159 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2538b96700 1 --2- 172.21.15.81:0/1810843159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836aab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f25337fe700 1 --2- 172.21.15.81:0/1810843159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836aab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2533fff700 1 -- 172.21.15.81:0/1810843159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 msgr2=0x557836aab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2533fff700 1 --2- 172.21.15.81:0/1810843159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836aab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2533fff700 1 -- 172.21.15.81:0/1810843159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 msgr2=0x557836aab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2533fff700 1 --2- 172.21.15.81:0/1810843159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836aab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2533fff700 1 -- 172.21.15.81:0/1810843159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557836899270 con 0x557836acfe50 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f2533fff700 1 --2- 172.21.15.81:0/1810843159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836aaacc0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f25240090b0 tx=0x7f252401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6001fb7cc445959 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f25197fa700 1 -- 172.21.15.81:0/1810843159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252402b070 con 0x557836acfe50 2023-10-06T02:51:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f25197fa700 1 -- 172.21.15.81:0/1810843159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524011a90 con 0x557836acfe50 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.910+0000 7f25197fa700 1 -- 172.21.15.81:0/1810843159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252401f070 con 0x557836acfe50 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.911+0000 7f25438f1b80 1 -- 172.21.15.81:0/1810843159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 msgr2=0x557836aaacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.911+0000 7f25438f1b80 1 --2- 172.21.15.81:0/1810843159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836aaacc0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f25240090b0 tx=0x7f252401f000 comp rx=0 tx=0).stop 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.911+0000 7f25438f1b80 1 -- 172.21.15.81:0/1810843159 shutdown_connections 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.911+0000 7f25438f1b80 1 --2- 172.21.15.81:0/1810843159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836aab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.911+0000 7f25438f1b80 1 --2- 172.21.15.81:0/1810843159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836aaacc0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.911+0000 7f25438f1b80 1 --2- 172.21.15.81:0/1810843159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836aab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.911+0000 7f25438f1b80 1 -- 172.21.15.81:0/1810843159 >> 172.21.15.81:0/1810843159 conn(0x557836aafe80 msgr2=0x557836ab06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.911+0000 7f25438f1b80 1 -- 172.21.15.81:0/1810843159 shutdown_connections 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.911+0000 7f25438f1b80 1 -- 172.21.15.81:0/1810843159 wait complete. 2023-10-06T02:51:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25438f1b80 1 -- start start 2023-10-06T02:51:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25438f1b80 1 Processor -- start 2023-10-06T02:51:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab02c0 0x557836b08580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836ab1a10 0x557836aab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836acfe50 0x557836ad76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25438f1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578369aa890 con 0x557836ab1a10 2023-10-06T02:51:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25438f1b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578369c5ea0 con 0x557836ab02c0 2023-10-06T02:51:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25438f1b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x557836881e30 con 0x557836acfe50 2023-10-06T02:51:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25438f1b80 10 client.0 _ll_register_callbacks cb 0x557836a72020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:51:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836ab1a10 0x557836aab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.912+0000 7f25337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836ab1a10 0x557836aab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48032/0 (socket says 172.21.15.81:48032) 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25337fe700 1 -- 172.21.15.81:0/144385747 learned_addr learned my addr 172.21.15.81:0/144385747 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f2533fff700 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab02c0 0x557836b08580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f2538b96700 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836acfe50 0x557836ad76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25337fe700 1 -- 172.21.15.81:0/144385747 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836acfe50 msgr2=0x557836ad76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25337fe700 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836acfe50 0x557836ad76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25337fe700 1 -- 172.21.15.81:0/144385747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab02c0 msgr2=0x557836b08580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25337fe700 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab02c0 0x557836b08580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25337fe700 1 -- 172.21.15.81:0/144385747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25340ce7c0 con 0x557836ab1a10 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25337fe700 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836ab1a10 0x557836aab3f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2528010600 tx=0x7f2528008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581baaffa084e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25127fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:51:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25127fc700 1 -- 172.21.15.81:0/144385747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800b5a0 con 0x557836ab1a10 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25127fc700 1 -- 172.21.15.81:0/144385747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f25280135e0 con 0x557836ab1a10 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25438f1b80 1 -- 172.21.15.81:0/144385747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557836aa3940 con 0x557836ab1a10 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25127fc700 1 -- 172.21.15.81:0/144385747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25280139b0 con 0x557836ab1a10 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25438f1b80 10 client.6642 fetch_fsmap learned FSMap version 52 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25438f1b80 1 -- 172.21.15.81:0/144385747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x55783683bfe0 con 0x557836ab1a10 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25127fc700 1 -- 172.21.15.81:0/144385747 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557836aa3940 con 0x557836ab1a10 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25127fc700 1 -- 172.21.15.81:0/144385747 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2528013b10 con 0x557836ab1a10 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25438f1b80 10 client.6642 fetch_fsmap finished waiting for FSMap version 52 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25438f1b80 10 client.6642 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25438f1b80 20 client.6642 populate_metadata read hostname 'smithi081' 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25438f1b80 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] conn(0x557836af85b0 0x557836af8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25438f1b80 4 client.6642 mds_command: new command op to 6465 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:51:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.913+0000 7f25438f1b80 1 -- 172.21.15.81:0/144385747 --> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557836a80870 con 0x557836af85b0 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f2533fff700 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] conn(0x557836af85b0 0x557836af8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f2533fff700 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] conn(0x557836af85b0 0x557836af8980 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6abbd0eff636eb1a server_cookie=a4b5fa67bbc00e8f in_seq=0 out_seq=0 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f25127fc700 10 client.6642 ms_handle_connect on v2:172.21.15.81:6833/907018385 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f25127fc700 1 -- 172.21.15.81:0/144385747 <== mds.0 v2:172.21.15.81:6833/907018385 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557836a80870 con 0x557836af85b0 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f25127fc700 10 client.6642 handle_command_reply: tid=0 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f25438f1b80 1 client.6642 shutdown 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f25438f1b80 1 -- 172.21.15.81:0/144385747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836ab1a10 msgr2=0x557836aab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f25438f1b80 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836ab1a10 0x557836aab3f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2528010600 tx=0x7f2528008040 comp rx=0 tx=0).stop 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f25438f1b80 1 -- 172.21.15.81:0/144385747 shutdown_connections 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.914+0000 7f25438f1b80 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] conn(0x557836af85b0 0x557836af8980 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.915+0000 7f25438f1b80 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836acfe50 0x557836ad76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.915+0000 7f25127fc700 0 client.6642 ms_handle_reset on v2:172.21.15.81:6833/907018385 2023-10-06T02:51:11.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.915+0000 7f25438f1b80 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab02c0 0x557836b08580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.915+0000 7f25438f1b80 1 --2- 172.21.15.81:0/144385747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836ab1a10 0x557836aab3f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.915+0000 7f25438f1b80 1 -- 172.21.15.81:0/144385747 >> 172.21.15.81:0/144385747 conn(0x557836aafe80 msgr2=0x557836ab0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:11.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.915+0000 7f25438f1b80 1 -- 172.21.15.81:0/144385747 shutdown_connections 2023-10-06T02:51:11.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.915+0000 7f25438f1b80 1 -- 172.21.15.81:0/144385747 wait complete. 2023-10-06T02:51:11.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.915+0000 7f25438f1b80 20 client.6642 trim_cache size 0 max 16384 2023-10-06T02:51:11.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.931+0000 7f25438f1b80 1 Processor -- start 2023-10-06T02:51:11.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.931+0000 7f25438f1b80 1 -- start start 2023-10-06T02:51:11.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836ad1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836b07840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836b07d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f25438f1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557836b17ae0 con 0x557836acfe50 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f25438f1b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x557836af6e70 con 0x557836ab1a10 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f25438f1b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x557836aa77b0 con 0x557836ab02c0 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f2538b96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836b07d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f2538b96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836b07d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48042/0 (socket says 172.21.15.81:48042) 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f2538b96700 1 -- 172.21.15.81:0/2896254557 learned_addr learned my addr 172.21.15.81:0/2896254557 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f2538b96700 1 -- 172.21.15.81:0/2896254557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 msgr2=0x557836ad1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f2538b96700 1 --2- 172.21.15.81:0/2896254557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836ad1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f2538b96700 1 -- 172.21.15.81:0/2896254557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 msgr2=0x557836b07840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.932+0000 7f25337fe700 1 --2- 172.21.15.81:0/2896254557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836b07840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f2538b96700 1 --2- 172.21.15.81:0/2896254557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836b07840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f2538b96700 1 -- 172.21.15.81:0/2896254557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578369cd780 con 0x557836acfe50 2023-10-06T02:51:11.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f2538b96700 1 --2- 172.21.15.81:0/2896254557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836b07d80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f252c00ce80 tx=0x7f252c06a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85ef976e51ecbb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f2519ffb700 1 -- 172.21.15.81:0/2896254557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c054550 con 0x557836acfe50 2023-10-06T02:51:11.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f2519ffb700 1 -- 172.21.15.81:0/2896254557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c083a90 con 0x557836acfe50 2023-10-06T02:51:11.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f2519ffb700 1 -- 172.21.15.81:0/2896254557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c068e10 con 0x557836acfe50 2023-10-06T02:51:11.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f25438f1b80 1 -- 172.21.15.81:0/2896254557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 msgr2=0x557836b07d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2896254557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836b07d80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f252c00ce80 tx=0x7f252c06a040 comp rx=0 tx=0).stop 2023-10-06T02:51:11.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f25438f1b80 1 -- 172.21.15.81:0/2896254557 shutdown_connections 2023-10-06T02:51:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2896254557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836b07d80 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2896254557 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836ad1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2896254557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836b07840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f25438f1b80 1 -- 172.21.15.81:0/2896254557 >> 172.21.15.81:0/2896254557 conn(0x557836aafe80 msgr2=0x557836b08380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.933+0000 7f25438f1b80 1 -- 172.21.15.81:0/2896254557 shutdown_connections 2023-10-06T02:51:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.934+0000 7f25438f1b80 1 -- 172.21.15.81:0/2896254557 wait complete. 2023-10-06T02:51:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.934+0000 7f25438f1b80 1 -- start start 2023-10-06T02:51:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.934+0000 7f25438f1b80 1 Processor -- start 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836b5dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836ace0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25438f1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836ace630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25438f1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557836b08da0 con 0x557836acfe50 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25438f1b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x557836b64b40 con 0x557836ab1a10 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25438f1b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x557836ad6f80 con 0x557836ab02c0 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25438f1b80 10 client.0 _ll_register_callbacks cb 0x557836a72020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2538b96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836ace630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2538b96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836ace630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48046/0 (socket says 172.21.15.81:48046) 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2538b96700 1 -- 172.21.15.81:0/2935048366 learned_addr learned my addr 172.21.15.81:0/2935048366 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2533fff700 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836b5dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25337fe700 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836ace0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2538b96700 1 -- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 msgr2=0x557836b5dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2538b96700 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836b5dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2538b96700 1 -- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 msgr2=0x557836ace0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2538b96700 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836ace0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2538b96700 1 -- 172.21.15.81:0/2935048366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25340c9b50 con 0x557836acfe50 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2533fff700 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836b5dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25337fe700 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836ace0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f2538b96700 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836ace630 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f252c00ce80 tx=0x7f252c070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe64c3d91972ce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25127fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25127fc700 1 -- 172.21.15.81:0/2935048366 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c055880 con 0x557836acfe50 2023-10-06T02:51:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25127fc700 1 -- 172.21.15.81:0/2935048366 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f252c0559e0 con 0x557836acfe50 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.935+0000 7f25438f1b80 1 -- 172.21.15.81:0/2935048366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2524011a90 con 0x557836acfe50 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25127fc700 1 -- 172.21.15.81:0/2935048366 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f252c05d0b0 con 0x557836acfe50 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 10 client.6648 fetch_fsmap learned FSMap version 52 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 1 -- 172.21.15.81:0/2935048366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x5578369b4470 con 0x557836acfe50 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25127fc700 1 -- 172.21.15.81:0/2935048366 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524011a90 con 0x557836acfe50 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25127fc700 1 -- 172.21.15.81:0/2935048366 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f252c01d020 con 0x557836acfe50 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 10 client.6648 fetch_fsmap finished waiting for FSMap version 52 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 10 client.6648 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 20 client.6648 populate_metadata read hostname 'smithi081' 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] conn(0x557836b63c20 0x557836b63ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 4 client.6648 mds_command: new command op to 6465 tid=0[{"prefix": "status"}] 2023-10-06T02:51:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 1 -- 172.21.15.81:0/2935048366 --> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5578369a1e00 con 0x557836b63c20 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f2533fff700 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] conn(0x557836b63c20 0x557836b63ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25127fc700 10 client.6648 ms_handle_connect on v2:172.21.15.81:6833/907018385 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f2533fff700 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] conn(0x557836b63c20 0x557836b63ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79690e4bdae2cc4 server_cookie=f1ced5813d0ec61b in_seq=0 out_seq=0 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25127fc700 1 -- 172.21.15.81:0/2935048366 <== mds.0 v2:172.21.15.81:6833/907018385 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5578369a1e00 con 0x557836b63c20 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25127fc700 10 client.6648 handle_command_reply: tid=0 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 1 client.6648 shutdown 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 1 -- 172.21.15.81:0/2935048366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 msgr2=0x557836ace630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.936+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836ace630 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f252c00ce80 tx=0x7f252c070000 comp rx=0 tx=0).stop 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25438f1b80 1 -- 172.21.15.81:0/2935048366 shutdown_connections 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.81:6833/907018385,v1:172.21.15.81:6835/907018385] conn(0x557836b63c20 0x557836b63ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557836acfe50 0x557836ace630 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25127fc700 0 client.6648 ms_handle_reset on v2:172.21.15.81:6833/907018385 2023-10-06T02:51:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x557836ab02c0 0x557836b5dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25438f1b80 1 --2- 172.21.15.81:0/2935048366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557836ab1a10 0x557836ace0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25438f1b80 1 -- 172.21.15.81:0/2935048366 >> 172.21.15.81:0/2935048366 conn(0x557836aafe80 msgr2=0x557836ad1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25438f1b80 1 -- 172.21.15.81:0/2935048366 shutdown_connections 2023-10-06T02:51:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25438f1b80 1 -- 172.21.15.81:0/2935048366 wait complete. 2023-10-06T02:51:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f25438f1b80 20 client.6648 trim_cache size 0 max 16384 2023-10-06T02:51:11.947 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:51:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6465, 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 10.266451242, 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 52, 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 101, 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 101, 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 22.459094365999999 2023-10-06T02:51:11.948 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:51:11.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 -- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2520066fb0 msgr2=0x7f2520069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2520066fb0 0x7f2520069460 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f25340b6bf0 tx=0x7f2524017000 comp rx=0 tx=0).stop 2023-10-06T02:51:11.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 -- 172.21.15.81:0/1932792030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159f10 msgr2=0x7f2534155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:11.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159f10 0x7f2534155b90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f252c00ceb0 tx=0x7f252c007870 comp rx=0 tx=0).stop 2023-10-06T02:51:11.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 -- 172.21.15.81:0/1932792030 shutdown_connections 2023-10-06T02:51:11.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534159f10 0x7f2534155b90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25340ccb40 0x7f25340ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2520066fb0 0x7f2520069460 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 --2- 172.21.15.81:0/1932792030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2534159b40 0x7f2534158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:11.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 -- 172.21.15.81:0/1932792030 >> 172.21.15.81:0/1932792030 conn(0x7f25340cd660 msgr2=0x7f253406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:11.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 -- 172.21.15.81:0/1932792030 shutdown_connections 2023-10-06T02:51:11.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:11.937+0000 7f2539397700 1 -- 172.21.15.81:0/1932792030 wait complete. 2023-10-06T02:51:11.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:51:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.065+0000 7fba949fc700 1 Processor -- start 2023-10-06T02:51:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.065+0000 7fba949fc700 1 -- start start 2023-10-06T02:51:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba949fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fba90159f10 0x7fba90068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba949fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba90068cc0 0x7fba900cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba949fc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba90069120 con 0x7fba90159b40 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba949fc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900cee10 con 0x7fba90068cc0 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba949fc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900cd040 con 0x7fba90159f10 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba8f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba90068cc0 0x7fba900cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba8f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba90068cc0 0x7fba900cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48056/0 (socket says 172.21.15.81:48056) 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba8f59e700 1 -- 172.21.15.81:0/1076105510 learned_addr learned my addr 172.21.15.81:0/1076105510 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba8659c700 1 --2- 172.21.15.81:0/1076105510 >> v2:172.21.15.83:3300/0 conn(0x7fba90159f10 0x7fba90068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba8f59e700 1 -- 172.21.15.81:0/1076105510 >> v2:172.21.15.83:3300/0 conn(0x7fba90159f10 msgr2=0x7fba90068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba8f59e700 1 --2- 172.21.15.81:0/1076105510 >> v2:172.21.15.83:3300/0 conn(0x7fba90159f10 0x7fba90068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba8f59e700 1 -- 172.21.15.81:0/1076105510 >> v1:172.21.15.83:6789/0 conn(0x7fba90159b40 legacy=0x7fba900cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba8f59e700 1 -- 172.21.15.81:0/1076105510 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900cd320 con 0x7fba90068cc0 2023-10-06T02:51:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.066+0000 7fba8f59e700 1 --2- 172.21.15.81:0/1076105510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90068cc0 0x7fba900cf2a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fba9006fd80 tx=0x7fba88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd481001d735b8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba8e59c700 1 -- 172.21.15.81:0/1076105510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8800e070 con 0x7fba90068cc0 2023-10-06T02:51:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba8e59c700 1 -- 172.21.15.81:0/1076105510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8800ba10 con 0x7fba90068cc0 2023-10-06T02:51:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba8e59c700 1 -- 172.21.15.81:0/1076105510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba880092e0 con 0x7fba90068cc0 2023-10-06T02:51:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba949fc700 1 -- 172.21.15.81:0/1076105510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90068cc0 msgr2=0x7fba900cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba949fc700 1 --2- 172.21.15.81:0/1076105510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90068cc0 0x7fba900cf2a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fba9006fd80 tx=0x7fba88009840 comp rx=0 tx=0).stop 2023-10-06T02:51:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba949fc700 1 -- 172.21.15.81:0/1076105510 shutdown_connections 2023-10-06T02:51:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba949fc700 1 --2- 172.21.15.81:0/1076105510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90068cc0 0x7fba900cf2a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba949fc700 1 --2- 172.21.15.81:0/1076105510 >> v2:172.21.15.83:3300/0 conn(0x7fba90159f10 0x7fba90068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba949fc700 1 -- 172.21.15.81:0/1076105510 >> 172.21.15.81:0/1076105510 conn(0x7fba900cd660 msgr2=0x7fba900cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba949fc700 1 -- 172.21.15.81:0/1076105510 shutdown_connections 2023-10-06T02:51:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.067+0000 7fba949fc700 1 -- 172.21.15.81:0/1076105510 wait complete. 2023-10-06T02:51:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.068+0000 7fba949fc700 1 Processor -- start 2023-10-06T02:51:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.068+0000 7fba949fc700 1 -- start start 2023-10-06T02:51:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba949fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba90068cc0 0x7fba9016b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba949fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90159b40 0x7fba9016d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba949fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba90159f10 0x7fba90155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba949fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9016da50 con 0x7fba90159b40 2023-10-06T02:51:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba949fc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba90144f20 con 0x7fba90068cc0 2023-10-06T02:51:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba949fc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba90158f60 con 0x7fba90159f10 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90159b40 0x7fba9016d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90159b40 0x7fba9016d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48060/0 (socket says 172.21.15.81:48060) 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8659c700 1 -- 172.21.15.81:0/617921262 learned_addr learned my addr 172.21.15.81:0/617921262 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8f59e700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba90159f10 0x7fba90155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8ed9d700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba90068cc0 0x7fba9016b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8659c700 1 -- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba90159f10 msgr2=0x7fba90155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8659c700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba90159f10 0x7fba90155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8659c700 1 -- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba90068cc0 msgr2=0x7fba9016b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8659c700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba90068cc0 0x7fba9016b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.069+0000 7fba8659c700 1 -- 172.21.15.81:0/617921262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88009ae0 con 0x7fba90159b40 2023-10-06T02:51:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.070+0000 7fba8659c700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90159b40 0x7fba9016d510 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fba7800c880 tx=0x7fba78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.070+0000 7fba877fe700 1 -- 172.21.15.81:0/617921262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78011600 con 0x7fba90159b40 2023-10-06T02:51:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.070+0000 7fba877fe700 1 -- 172.21.15.81:0/617921262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba78011760 con 0x7fba90159b40 2023-10-06T02:51:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.070+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba900b4c90 con 0x7fba90159b40 2023-10-06T02:51:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.070+0000 7fba877fe700 1 -- 172.21.15.81:0/617921262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78011b20 con 0x7fba90159b40 2023-10-06T02:51:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.070+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba900b5250 con 0x7fba90159b40 2023-10-06T02:51:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.071+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba900b5470 con 0x7fba90159b40 2023-10-06T02:51:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.071+0000 7fba877fe700 1 -- 172.21.15.81:0/617921262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba780223a0 con 0x7fba90159b40 2023-10-06T02:51:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.071+0000 7fba877fe700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba70066f30 0x7fba700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.072+0000 7fba877fe700 1 -- 172.21.15.81:0/617921262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fba78084650 con 0x7fba90159b40 2023-10-06T02:51:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.072+0000 7fba8ed9d700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba70066f30 0x7fba700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.072+0000 7fba8ed9d700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba70066f30 0x7fba700693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fba80003870 tx=0x7fba80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.076+0000 7fba877fe700 1 -- 172.21.15.81:0/617921262 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba78051760 con 0x7fba90159b40 2023-10-06T02:51:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.300+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba90063e90 con 0x7fba90159b40 2023-10-06T02:51:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.301+0000 7fba877fe700 1 -- 172.21.15.81:0/617921262 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7fba78054d80 con 0x7fba90159b40 2023-10-06T02:51:12.302 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:51:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba70066f30 msgr2=0x7fba700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba70066f30 0x7fba700693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fba80003870 tx=0x7fba80009040 comp rx=0 tx=0).stop 2023-10-06T02:51:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90159b40 msgr2=0x7fba9016d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90159b40 0x7fba9016d510 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fba7800c880 tx=0x7fba78008040 comp rx=0 tx=0).stop 2023-10-06T02:51:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 shutdown_connections 2023-10-06T02:51:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba90159f10 0x7fba90155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba70066f30 0x7fba700693e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba90068cc0 0x7fba9016b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 --2- 172.21.15.81:0/617921262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba90159b40 0x7fba9016d510 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:12.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 >> 172.21.15.81:0/617921262 conn(0x7fba900cd660 msgr2=0x7fba900cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:12.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 shutdown_connections 2023-10-06T02:51:12.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:12.302+0000 7fba949fc700 1 -- 172.21.15.81:0/617921262 wait complete. 2023-10-06T02:51:12.315 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:51:12.316 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:51:12.316 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:51:12.316 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:51:12.316 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:51:12.316 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:51:12.316 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:51:12.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:51:12.316 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:51:12.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:12.316 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:51:12.332 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:51:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:51:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:51:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:51:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:12.332 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:51:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:51:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42244sec preferred_lft 42244sec 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:51:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:51:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:51:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:12.335 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:51:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:51:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:51:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:12.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:12.335 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:51:12.395 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:51:12.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:12.396 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:51:12.452 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:51:12.452 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:51:12.452 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:51:12.452 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:51:12.452 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:51:12.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:12.453 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:51:12.453 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:51:12.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:51:12.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:51:12.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:51:12.453 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:51:12.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:12.551 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:51:12.566 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:51:12.566 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:51:12.566 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:51:12.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:12.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:51:12.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:51:12.631 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:51:12.686 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:51:12.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:51:12.686 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:51:12.740 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:51:12.741 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:51:12.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:51:12.820 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:51:12.821 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:51:12.839 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:51:12.839 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:51:12.839 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:51:12.840 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:51:12.840 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:51:12.840 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:51:12.840 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:51:12.840 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:51:12.862 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:51:12.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:12.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:51:12.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:51:13.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.080+0000 7f94a9fac700 1 Processor -- start 2023-10-06T02:51:13.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.080+0000 7f94a9fac700 1 -- start start 2023-10-06T02:51:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.080+0000 7f94a9fac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a41578d0 0x7f94a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a9fac700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f94a4157ca0 0x7f94a415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a9fac700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94a406d120 0x7f94a406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a9fac700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a406dac0 con 0x7f94a406d120 2023-10-06T02:51:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a9fac700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a40d07c0 con 0x7f94a4157ca0 2023-10-06T02:51:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a9fac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40cfbb0 con 0x7f94a41578d0 2023-10-06T02:51:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94a406d120 0x7f94a406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94a406d120 0x7f94a406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48074/0 (socket says 172.21.15.81:48074) 2023-10-06T02:51:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a3fff700 1 -- 172.21.15.81:0/4129173773 learned_addr learned my addr 172.21.15.81:0/4129173773 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a37fe700 1 --2- 172.21.15.81:0/4129173773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a41578d0 0x7f94a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a3fff700 1 -- 172.21.15.81:0/4129173773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a41578d0 msgr2=0x7f94a40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a2ffd700 1 --2- 172.21.15.81:0/4129173773 >> v2:172.21.15.83:3300/0 conn(0x7f94a4157ca0 0x7f94a415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a3fff700 1 --2- 172.21.15.81:0/4129173773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a41578d0 0x7f94a40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a3fff700 1 -- 172.21.15.81:0/4129173773 >> v2:172.21.15.83:3300/0 conn(0x7f94a4157ca0 msgr2=0x7f94a415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a3fff700 1 --2- 172.21.15.81:0/4129173773 >> v2:172.21.15.83:3300/0 conn(0x7f94a4157ca0 0x7f94a415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a3fff700 1 -- 172.21.15.81:0/4129173773 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40cfe90 con 0x7f94a406d120 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a37fe700 1 --2- 172.21.15.81:0/4129173773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a41578d0 0x7f94a40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a2ffd700 1 --2- 172.21.15.81:0/4129173773 >> v2:172.21.15.83:3300/0 conn(0x7f94a4157ca0 0x7f94a415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a3fff700 1 --2- 172.21.15.81:0/4129173773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a406d120 0x7f94a406d580 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f94a406cb70 tx=0x7f949c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69173c91c4b7aa99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a27fc700 1 -- 172.21.15.81:0/4129173773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00e070 con 0x7f94a406d120 2023-10-06T02:51:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a27fc700 1 -- 172.21.15.81:0/4129173773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c00ba50 con 0x7f94a406d120 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.081+0000 7f94a27fc700 1 -- 172.21.15.81:0/4129173773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0092e0 con 0x7f94a406d120 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.082+0000 7f94a9fac700 1 -- 172.21.15.81:0/4129173773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a406d120 msgr2=0x7f94a406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.082+0000 7f94a9fac700 1 --2- 172.21.15.81:0/4129173773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a406d120 0x7f94a406d580 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f94a406cb70 tx=0x7f949c009840 comp rx=0 tx=0).stop 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.082+0000 7f94a9fac700 1 -- 172.21.15.81:0/4129173773 shutdown_connections 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.082+0000 7f94a9fac700 1 --2- 172.21.15.81:0/4129173773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a406d120 0x7f94a406d580 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.082+0000 7f94a9fac700 1 --2- 172.21.15.81:0/4129173773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a41578d0 0x7f94a40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.082+0000 7f94a9fac700 1 --2- 172.21.15.81:0/4129173773 >> v2:172.21.15.83:3300/0 conn(0x7f94a4157ca0 0x7f94a415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.082+0000 7f94a9fac700 1 -- 172.21.15.81:0/4129173773 >> 172.21.15.81:0/4129173773 conn(0x7f94a406bb90 msgr2=0x7f94a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.082+0000 7f94a9fac700 1 -- 172.21.15.81:0/4129173773 shutdown_connections 2023-10-06T02:51:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.082+0000 7f94a9fac700 1 -- 172.21.15.81:0/4129173773 wait complete. 2023-10-06T02:51:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.083+0000 7f94a9fac700 1 Processor -- start 2023-10-06T02:51:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.083+0000 7f94a9fac700 1 -- start start 2023-10-06T02:51:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a9fac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a406d120 0x7f94a416b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a9fac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a41578d0 0x7f94a4154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a9fac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94a4157ca0 0x7f94a40c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a9fac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40b4290 con 0x7f94a41578d0 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a9fac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40c7e00 con 0x7f94a4157ca0 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a9fac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40c8360 con 0x7f94a406d120 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a41578d0 0x7f94a4154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a41578d0 0x7f94a4154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48078/0 (socket says 172.21.15.81:48078) 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a2ffd700 1 -- 172.21.15.81:0/2318599718 learned_addr learned my addr 172.21.15.81:0/2318599718 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a37fe700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a406d120 0x7f94a416b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a3fff700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94a4157ca0 0x7f94a40c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a2ffd700 1 -- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a406d120 msgr2=0x7f94a416b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a2ffd700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a406d120 0x7f94a416b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a2ffd700 1 -- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94a4157ca0 msgr2=0x7f94a40c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a2ffd700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94a4157ca0 0x7f94a40c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a2ffd700 1 -- 172.21.15.81:0/2318599718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009ae0 con 0x7f94a41578d0 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a3fff700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94a4157ca0 0x7f94a40c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a37fe700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a406d120 0x7f94a416b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.084+0000 7f94a2ffd700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a41578d0 0x7f94a4154a80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f949800c880 tx=0x7f9498008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.085+0000 7f948b7fe700 1 -- 172.21.15.81:0/2318599718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498011600 con 0x7f94a41578d0 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.085+0000 7f948b7fe700 1 -- 172.21.15.81:0/2318599718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9498011760 con 0x7f94a41578d0 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.085+0000 7f948b7fe700 1 -- 172.21.15.81:0/2318599718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498011b00 con 0x7f94a41578d0 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.085+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a40c8080 con 0x7f94a41578d0 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.085+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a40b3f20 con 0x7f94a41578d0 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.085+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a4067ac0 con 0x7f94a41578d0 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.086+0000 7f948b7fe700 1 -- 172.21.15.81:0/2318599718 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9498018350 con 0x7f94a41578d0 2023-10-06T02:51:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.086+0000 7f948b7fe700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9490066f30 0x7f94900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:13.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.086+0000 7f948b7fe700 1 -- 172.21.15.81:0/2318599718 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f94980846a0 con 0x7f94a41578d0 2023-10-06T02:51:13.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.086+0000 7f94a37fe700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9490066f30 0x7f94900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:13.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.087+0000 7f94a37fe700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9490066f30 0x7f94900693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f949400ab50 tx=0x7f9494008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:13.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.090+0000 7f948b7fe700 1 -- 172.21.15.81:0/2318599718 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9498055240 con 0x7f94a41578d0 2023-10-06T02:51:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.312+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94a40d0170 con 0x7f94a41578d0 2023-10-06T02:51:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.313+0000 7f948b7fe700 1 -- 172.21.15.81:0/2318599718 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9498054dd0 con 0x7f94a41578d0 2023-10-06T02:51:13.314 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:51:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9490066f30 msgr2=0x7f94900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9490066f30 0x7f94900693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f949400ab50 tx=0x7f9494008040 comp rx=0 tx=0).stop 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a41578d0 msgr2=0x7f94a4154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a41578d0 0x7f94a4154a80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f949800c880 tx=0x7f9498008040 comp rx=0 tx=0).stop 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 shutdown_connections 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9490066f30 0x7f94900693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94a4157ca0 0x7f94a40c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94a406d120 0x7f94a416b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 --2- 172.21.15.81:0/2318599718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a41578d0 0x7f94a4154a80 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 >> 172.21.15.81:0/2318599718 conn(0x7f94a406bb90 msgr2=0x7f94a4068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 shutdown_connections 2023-10-06T02:51:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:13.315+0000 7f94a9fac700 1 -- 172.21.15.81:0/2318599718 wait complete. 2023-10-06T02:51:13.328 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:51:13.328 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:51:13.328 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:51:13.328 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:51:13.328 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:51:13.329 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:51:13.329 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:51:13.329 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:51:13.329 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:51:13.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:13.329 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:51:13.348 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:51:13.348 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:51:13.348 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:51:13.348 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:13.348 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:51:13.349 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:51:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42243sec preferred_lft 42243sec 2023-10-06T02:51:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:51:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:13.350 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:51:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:51:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:51:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:51:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:13.351 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:51:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:51:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:51:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:13.351 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:51:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:51:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:51:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:51:13.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:13.352 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:51:13.416 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:51:13.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:13.418 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:51:13.477 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:51:13.477 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:51:13.477 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:51:13.477 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:51:13.477 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:51:13.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:13.478 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:51:13.478 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:51:13.478 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:51:13.478 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:51:13.478 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:51:13.478 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:51:13.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:13.581 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:51:13.596 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:51:13.596 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:51:13.596 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:51:13.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:13.597 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:51:13.660 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:51:13.660 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:51:13.716 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:51:13.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:51:13.716 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:51:13.769 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:51:13.769 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:51:13.770 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:51:13.849 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:51:13.849 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:51:13.868 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:51:13.868 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:51:13.868 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:51:13.868 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:51:13.868 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:51:13.868 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:51:13.869 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:51:13.869 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:51:13.891 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:51:13.891 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:51:13.891 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:51:13.891 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:51:13.891 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:51:13.891 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:51:13.891 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:51:13.891 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:51:13.892 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:51:13.892 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:51:13.892 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:51:13.893 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:51:13.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:13.893 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:51:13.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:14.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.071+0000 7f5d4e9ee700 1 Processor -- start 2023-10-06T02:51:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.071+0000 7f5d4e9ee700 1 -- start start 2023-10-06T02:51:14.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d4e9ee700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 0x7f5d480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d4e9ee700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d480d07c0 con 0x7f5d4806d120 2023-10-06T02:51:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d4e9ee700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d480cfbb0 con 0x7f5d481578d0 2023-10-06T02:51:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d4e9ee700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480cfe90 con 0x7f5d48157ca0 2023-10-06T02:51:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d4cf8b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5d4806d120 0x7f5d4815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56094/0 (socket says 172.21.15.81:56094) 2023-10-06T02:51:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d4cf8b700 1 -- 172.21.15.81:0/885710364 learned_addr learned my addr 172.21.15.81:0/885710364 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d477fe700 1 --2- 172.21.15.81:0/885710364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 0x7f5d480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d46ffd700 1 -- 172.21.15.81:0/885710364 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239014190 0 0) 0x7f5d480d07c0 con 0x7f5d4806d120 2023-10-06T02:51:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d46ffd700 1 -- 172.21.15.81:0/885710364 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d30003570 con 0x7f5d4806d120 2023-10-06T02:51:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d46ffd700 1 -- 172.21.15.81:0/885710364 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564343621 0 0) 0x7f5d480cfbb0 con 0x7f5d481578d0 2023-10-06T02:51:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d46ffd700 1 -- 172.21.15.81:0/885710364 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d480d07c0 con 0x7f5d481578d0 2023-10-06T02:51:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d477fe700 1 -- 172.21.15.81:0/885710364 >> v1:172.21.15.83:6789/0 conn(0x7f5d481578d0 legacy=0x7f5d4815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d46ffd700 1 -- 172.21.15.81:0/885710364 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 804135887 0 0) 0x7f5d30003570 con 0x7f5d4806d120 2023-10-06T02:51:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d477fe700 1 -- 172.21.15.81:0/885710364 >> v1:172.21.15.81:6789/0 conn(0x7f5d4806d120 legacy=0x7f5d4815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d477fe700 1 -- 172.21.15.81:0/885710364 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d480d0170 con 0x7f5d48157ca0 2023-10-06T02:51:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.072+0000 7f5d477fe700 1 --2- 172.21.15.81:0/885710364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 0x7f5d480cf4f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009910 tx=0x7f5d3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4866a725755d0e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d46ffd700 1 -- 172.21.15.81:0/885710364 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d400017f0 con 0x7f5d48157ca0 2023-10-06T02:51:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d46ffd700 1 -- 172.21.15.81:0/885710364 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c011420 con 0x7f5d48157ca0 2023-10-06T02:51:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d46ffd700 1 -- 172.21.15.81:0/885710364 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0117c0 con 0x7f5d48157ca0 2023-10-06T02:51:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/885710364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 msgr2=0x7f5d480cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d4e9ee700 1 --2- 172.21.15.81:0/885710364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 0x7f5d480cf4f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009910 tx=0x7f5d3c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/885710364 shutdown_connections 2023-10-06T02:51:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d4e9ee700 1 --2- 172.21.15.81:0/885710364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 0x7f5d480cf4f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/885710364 >> 172.21.15.81:0/885710364 conn(0x7f5d4806bb90 msgr2=0x7f5d4806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/885710364 shutdown_connections 2023-10-06T02:51:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.073+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/885710364 wait complete. 2023-10-06T02:51:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.074+0000 7f5d4e9ee700 1 Processor -- start 2023-10-06T02:51:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.074+0000 7f5d4e9ee700 1 -- start start 2023-10-06T02:51:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d4e9ee700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d4806d120 0x7f5d4816b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d4e9ee700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d481578d0 0x7f5d480abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d4e9ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d48153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d4e9ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d481539b0 con 0x7f5d48157ca0 2023-10-06T02:51:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d4e9ee700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4816e8d0 con 0x7f5d481578d0 2023-10-06T02:51:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d4e9ee700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4816dcc0 con 0x7f5d4806d120 2023-10-06T02:51:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d4cf8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d48153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d4cf8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d48153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48086/0 (socket says 172.21.15.81:48086) 2023-10-06T02:51:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d4cf8b700 1 -- 172.21.15.81:0/442585305 learned_addr learned my addr 172.21.15.81:0/442585305 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d477fe700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d481578d0 0x7f5d480abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.075+0000 7f5d47fff700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d4806d120 0x7f5d4816b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d4cf8b700 1 -- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d4806d120 msgr2=0x7f5d4816b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d4cf8b700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d4806d120 0x7f5d4816b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d4cf8b700 1 -- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d481578d0 msgr2=0x7f5d480abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d4cf8b700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d481578d0 0x7f5d480abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d4cf8b700 1 -- 172.21.15.81:0/442585305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c009420 con 0x7f5d48157ca0 2023-10-06T02:51:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d477fe700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d481578d0 0x7f5d480abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d4cf8b700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d48153470 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000ccc0 tx=0x7f5d40007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d2ffff700 1 -- 172.21.15.81:0/442585305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40004dc0 con 0x7f5d48157ca0 2023-10-06T02:51:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d2ffff700 1 -- 172.21.15.81:0/442585305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4000a5f0 con 0x7f5d48157ca0 2023-10-06T02:51:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4816dfa0 con 0x7f5d48157ca0 2023-10-06T02:51:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d2ffff700 1 -- 172.21.15.81:0/442585305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000a9b0 con 0x7f5d48157ca0 2023-10-06T02:51:14.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.076+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4816e560 con 0x7f5d48157ca0 2023-10-06T02:51:14.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.077+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4816ea10 con 0x7f5d48157ca0 2023-10-06T02:51:14.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.077+0000 7f5d2ffff700 1 -- 172.21.15.81:0/442585305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d4000ad20 con 0x7f5d48157ca0 2023-10-06T02:51:14.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.078+0000 7f5d2ffff700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d34066f30 0x7f5d340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:14.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.078+0000 7f5d2ffff700 1 -- 172.21.15.81:0/442585305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d40083fc0 con 0x7f5d48157ca0 2023-10-06T02:51:14.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.078+0000 7f5d47fff700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d34066f30 0x7f5d340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:14.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.078+0000 7f5d47fff700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d34066f30 0x7f5d340693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5d4806a670 tx=0x7f5d38007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:14.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.082+0000 7f5d2ffff700 1 -- 172.21.15.81:0/442585305 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d4816ea10 con 0x7f5d48157ca0 2023-10-06T02:51:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.305+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d4816ea10 con 0x7f5d48157ca0 2023-10-06T02:51:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.305+0000 7f5d2ffff700 1 -- 172.21.15.81:0/442585305 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f5d4816ea10 con 0x7f5d48157ca0 2023-10-06T02:51:14.307 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:14.307 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:01.019609+0000","modified":"2023-10-06T02:51:04.689923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/907018385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":907018385},{"type":"v1","addr":"172.21.15.81:6835","nonce":907018385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:51:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d34066f30 msgr2=0x7f5d340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d34066f30 0x7f5d340693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5d4806a670 tx=0x7f5d38007d50 comp rx=0 tx=0).stop 2023-10-06T02:51:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 msgr2=0x7f5d48153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d48153470 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000ccc0 tx=0x7f5d40007d20 comp rx=0 tx=0).stop 2023-10-06T02:51:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 shutdown_connections 2023-10-06T02:51:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d48153470 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d4806d120 0x7f5d4816b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d34066f30 0x7f5d340693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 --2- 172.21.15.81:0/442585305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d481578d0 0x7f5d480abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 >> 172.21.15.81:0/442585305 conn(0x7f5d4806bb90 msgr2=0x7f5d48154810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.307+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 shutdown_connections 2023-10-06T02:51:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:14.308+0000 7f5d4e9ee700 1 -- 172.21.15.81:0/442585305 wait complete. 2023-10-06T02:51:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-06T02:51:14.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:51:14.457 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":6465,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.77603777,"mdsmap_epoch":52,"osdmap_epoch":101,"osdmap_epoch_barrier":101,"uptime":24.968681841999999} 2023-10-06T02:51:14.458 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 6465, "mdsmap_epoch": 52, "osdmap_epoch": 101, "osdmap_epoch_barrier": 101, "rank_uptime": 12.77603777, "state": "up:active", "uptime": 24.968681842, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:51:14.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-06T02:51:14.589 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-06T02:51:14.589 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-06T02:51:14.590 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-06T02:51:14.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:51:14.590 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-06T02:51:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:265+0 records in 2023-10-06T02:51:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:265+0 records out 2023-10-06T02:51:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.34839 s, 206 MB/s 2023-10-06T02:51:15.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:51:15.957 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-06T02:51:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:292+0 records in 2023-10-06T02:51:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:292+0 records out 2023-10-06T02:51:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.43063 s, 214 MB/s 2023-10-06T02:51:17.404 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-06T02:51:17.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:51:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.517+0000 7fca455e3700 1 Processor -- start 2023-10-06T02:51:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.517+0000 7fca455e3700 1 -- start start 2023-10-06T02:51:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.518+0000 7fca455e3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce1f0 0x7fca400aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.518+0000 7fca455e3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fca400ce5c0 0x7fca4015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.518+0000 7fca455e3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fca400ac570 0x7fca4006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.518+0000 7fca455e3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4015dfb0 con 0x7fca400ce5c0 2023-10-06T02:51:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.518+0000 7fca455e3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca400acec0 con 0x7fca400ac570 2023-10-06T02:51:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.518+0000 7fca455e3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400ad1a0 con 0x7fca400ce1f0 2023-10-06T02:51:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.518+0000 7fca3e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fca400ce5c0 0x7fca4015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.518+0000 7fca3e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fca400ce5c0 0x7fca4015e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48100/0 (socket says 172.21.15.81:48100) 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.518+0000 7fca3e7fc700 1 -- 172.21.15.81:0/1745915898 learned_addr learned my addr 172.21.15.81:0/1745915898 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3f7fe700 1 --2- 172.21.15.81:0/1745915898 >> v2:172.21.15.83:3300/0 conn(0x7fca400ac570 0x7fca4006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3effd700 1 --2- 172.21.15.81:0/1745915898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce1f0 0x7fca400aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3e7fc700 1 -- 172.21.15.81:0/1745915898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce1f0 msgr2=0x7fca400aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3e7fc700 1 --2- 172.21.15.81:0/1745915898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce1f0 0x7fca400aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3e7fc700 1 -- 172.21.15.81:0/1745915898 >> v2:172.21.15.83:3300/0 conn(0x7fca400ac570 msgr2=0x7fca4006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3e7fc700 1 --2- 172.21.15.81:0/1745915898 >> v2:172.21.15.83:3300/0 conn(0x7fca400ac570 0x7fca4006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3e7fc700 1 -- 172.21.15.81:0/1745915898 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4015dc40 con 0x7fca400ce5c0 2023-10-06T02:51:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3f7fe700 1 --2- 172.21.15.81:0/1745915898 >> v2:172.21.15.83:3300/0 conn(0x7fca400ac570 0x7fca4006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3e7fc700 1 --2- 172.21.15.81:0/1745915898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ce5c0 0x7fca4015e440 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fca400695d0 tx=0x7fca28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c30efbcb0d56f64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3dffb700 1 -- 172.21.15.81:0/1745915898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800b860 con 0x7fca400ce5c0 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3dffb700 1 -- 172.21.15.81:0/1745915898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800b9c0 con 0x7fca400ce5c0 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca3dffb700 1 -- 172.21.15.81:0/1745915898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800bd60 con 0x7fca400ce5c0 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca455e3700 1 -- 172.21.15.81:0/1745915898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ce5c0 msgr2=0x7fca4015e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca455e3700 1 --2- 172.21.15.81:0/1745915898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ce5c0 0x7fca4015e440 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fca400695d0 tx=0x7fca28009250 comp rx=0 tx=0).stop 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca455e3700 1 -- 172.21.15.81:0/1745915898 shutdown_connections 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca455e3700 1 --2- 172.21.15.81:0/1745915898 >> v2:172.21.15.83:3300/0 conn(0x7fca400ac570 0x7fca4006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca455e3700 1 --2- 172.21.15.81:0/1745915898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce1f0 0x7fca400aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca455e3700 1 --2- 172.21.15.81:0/1745915898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ce5c0 0x7fca4015e440 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.519+0000 7fca455e3700 1 -- 172.21.15.81:0/1745915898 >> 172.21.15.81:0/1745915898 conn(0x7fca4006cca0 msgr2=0x7fca4006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.520+0000 7fca455e3700 1 -- 172.21.15.81:0/1745915898 shutdown_connections 2023-10-06T02:51:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.520+0000 7fca455e3700 1 -- 172.21.15.81:0/1745915898 wait complete. 2023-10-06T02:51:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.521+0000 7fca455e3700 1 Processor -- start 2023-10-06T02:51:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.521+0000 7fca455e3700 1 -- start start 2023-10-06T02:51:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.521+0000 7fca455e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ac570 0x7fca4016d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.521+0000 7fca455e3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca400ce1f0 0x7fca4016a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.521+0000 7fca455e3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce5c0 0x7fca400c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.521+0000 7fca455e3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40155a10 con 0x7fca400ac570 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.521+0000 7fca455e3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400ae630 con 0x7fca400ce1f0 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.521+0000 7fca455e3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400ae910 con 0x7fca400ce5c0 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ac570 0x7fca4016d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ac570 0x7fca4016d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48116/0 (socket says 172.21.15.81:48116) 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3effd700 1 -- 172.21.15.81:0/166789791 learned_addr learned my addr 172.21.15.81:0/166789791 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3f7fe700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce5c0 0x7fca400c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3e7fc700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca400ce1f0 0x7fca4016a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3effd700 1 -- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce5c0 msgr2=0x7fca400c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3effd700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce5c0 0x7fca400c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3effd700 1 -- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca400ce1f0 msgr2=0x7fca4016a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3effd700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca400ce1f0 0x7fca4016a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3effd700 1 -- 172.21.15.81:0/166789791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca280094f0 con 0x7fca400ac570 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca3effd700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ac570 0x7fca4016d1a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fca3000cfc0 tx=0x7fca300078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca36ffd700 1 -- 172.21.15.81:0/166789791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3000ad90 con 0x7fca400ac570 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca36ffd700 1 -- 172.21.15.81:0/166789791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca30016430 con 0x7fca400ac570 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca400aec50 con 0x7fca400ac570 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca36ffd700 1 -- 172.21.15.81:0/166789791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300167d0 con 0x7fca400ac570 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.522+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca400c37c0 con 0x7fca400ac570 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.523+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca40068900 con 0x7fca400ac570 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.523+0000 7fca36ffd700 1 -- 172.21.15.81:0/166789791 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca30003020 con 0x7fca400ac570 2023-10-06T02:51:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.524+0000 7fca36ffd700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:17.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.524+0000 7fca36ffd700 1 -- 172.21.15.81:0/166789791 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca30012070 con 0x7fca400ac570 2023-10-06T02:51:17.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.524+0000 7fca3e7fc700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:17.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.524+0000 7fca3e7fc700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca20066f30 0x7fca200693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca400695d0 tx=0x7fca28017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:17.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.528+0000 7fca36ffd700 1 -- 172.21.15.81:0/166789791 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca300525e0 con 0x7fca400ac570 2023-10-06T02:51:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.714+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fca4015ea10 con 0x7fca400ac570 2023-10-06T02:51:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.715+0000 7fca36ffd700 1 -- 172.21.15.81:0/166789791 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v101) v1 ==== 81+0+34775 (secure 0 0 0) 0x7fca30055c00 con 0x7fca400ac570 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 101, 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:51:02.654144+0000", 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:51:17.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:51:17.718 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 14, 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:17.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:51:17.720 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "90", 2023-10-06T02:51:17.721 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:17.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:17.724 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:51:17.727 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "90", 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:17.728 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:17.729 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:17.730 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:17.731 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:58.681047+0000", 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:17.732 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:51:17.733 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:17.734 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:17.734 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:17.734 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:17.734 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:17.734 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:17.734 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:17.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.734 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "100", 2023-10-06T02:51:17.734 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:17.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:17.737 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:17.738 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 14, 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:59.998500+0000", 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:51:17.740 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "101", 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:17.741 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:17.742 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:17.743 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:17.743 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:17.745 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:17.745 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:17.745 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:17.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:17.747 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:17.748 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:17.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.751 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:51:17.753 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:17.754 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:17.755 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:51:17.757 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:17.759 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:51:17.761 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:51:17.761 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:51:17.761 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:51:17.761 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:17.761 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:17.761 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:17.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:17.762 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:51:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:51:17.767 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:17.768 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:51:17.770 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:17.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.770 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:51:17.770 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:17.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:51:17.771 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:51:17.774 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:51:17.776 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.778 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:51:17.778 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:17.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.778 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:51:17.778 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:17.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:51:17.781 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:17.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:17.783 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:17.783 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:17.783 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:17.783 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:17.783 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:17.783 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:17.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:51:17.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:17.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:51:17.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:17.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:51:17.785 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:17.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:51:17.788 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:17.789 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:51:17.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:51:17.794 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:17.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:51:17.794 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:17.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.799 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:17.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.801 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.802 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:17.803 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:17.804 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:51:17.805 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:17.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:17.807 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:17.808 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:51:17.809 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:51:17.810 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:17.811 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:51:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca20066f30 msgr2=0x7fca200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca20066f30 0x7fca200693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca400695d0 tx=0x7fca28017000 comp rx=0 tx=0).stop 2023-10-06T02:51:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ac570 msgr2=0x7fca4016d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ac570 0x7fca4016d1a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fca3000cfc0 tx=0x7fca300078b0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 shutdown_connections 2023-10-06T02:51:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca400ce5c0 0x7fca400c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca400ac570 0x7fca4016d1a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 --2- 172.21.15.81:0/166789791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca400ce1f0 0x7fca4016a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 >> 172.21.15.81:0/166789791 conn(0x7fca4006cca0 msgr2=0x7fca401565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 shutdown_connections 2023-10-06T02:51:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:17.717+0000 7fca455e3700 1 -- 172.21.15.81:0/166789791 wait complete. 2023-10-06T02:51:17.815 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:51:20.404 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:51:20.402+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-06T02:51:22.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:51:22.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.941+0000 7fe3087e9700 1 Processor -- start 2023-10-06T02:51:22.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.941+0000 7fe3087e9700 1 -- start start 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.942+0000 7fe3087e9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3000aeea0 0x7fe3000c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.942+0000 7fe3087e9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3000af270 0x7fe3000c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.942+0000 7fe3087e9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30006aae0 con 0x7fe3000c7d00 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.942+0000 7fe3087e9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3000c8810 con 0x7fe3000aeea0 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.942+0000 7fe3087e9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe300069ed0 con 0x7fe3000af270 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.942+0000 7fe306585700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3000aeea0 0x7fe3000c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.942+0000 7fe306585700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3000aeea0 0x7fe3000c2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49404/0 (socket says 172.21.15.81:49404) 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.942+0000 7fe306585700 1 -- 172.21.15.81:0/394154057 learned_addr learned my addr 172.21.15.81:0/394154057 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe305d84700 1 --2- 172.21.15.81:0/394154057 >> v2:172.21.15.83:3300/0 conn(0x7fe3000af270 0x7fe3000c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe306585700 1 -- 172.21.15.81:0/394154057 >> v2:172.21.15.83:3300/0 conn(0x7fe3000af270 msgr2=0x7fe3000c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe306585700 1 --2- 172.21.15.81:0/394154057 >> v2:172.21.15.83:3300/0 conn(0x7fe3000af270 0x7fe3000c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe306585700 1 -- 172.21.15.81:0/394154057 >> v1:172.21.15.83:6789/0 conn(0x7fe3000c7d00 legacy=0x7fe3000c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe306585700 1 -- 172.21.15.81:0/394154057 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30006a1b0 con 0x7fe3000aeea0 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe305d84700 1 --2- 172.21.15.81:0/394154057 >> v2:172.21.15.83:3300/0 conn(0x7fe3000af270 0x7fe3000c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe306585700 1 --2- 172.21.15.81:0/394154057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 0x7fe3000c2920 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe3000c73a0 tx=0x7fe2fc00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c9e601290fa74c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe305583700 1 -- 172.21.15.81:0/394154057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc010070 con 0x7fe3000aeea0 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe305583700 1 -- 172.21.15.81:0/394154057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc00b0d0 con 0x7fe3000aeea0 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.943+0000 7fe305583700 1 -- 172.21.15.81:0/394154057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00b490 con 0x7fe3000aeea0 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.944+0000 7fe3087e9700 1 -- 172.21.15.81:0/394154057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 msgr2=0x7fe3000c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.944+0000 7fe3087e9700 1 --2- 172.21.15.81:0/394154057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 0x7fe3000c2920 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe3000c73a0 tx=0x7fe2fc00ba50 comp rx=0 tx=0).stop 2023-10-06T02:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.944+0000 7fe3087e9700 1 -- 172.21.15.81:0/394154057 shutdown_connections 2023-10-06T02:51:22.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.944+0000 7fe3087e9700 1 --2- 172.21.15.81:0/394154057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 0x7fe3000c2920 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:22.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.944+0000 7fe3087e9700 1 --2- 172.21.15.81:0/394154057 >> v2:172.21.15.83:3300/0 conn(0x7fe3000af270 0x7fe3000c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:22.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.944+0000 7fe3087e9700 1 -- 172.21.15.81:0/394154057 >> 172.21.15.81:0/394154057 conn(0x7fe30006c660 msgr2=0x7fe3000cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:22.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.944+0000 7fe3087e9700 1 -- 172.21.15.81:0/394154057 shutdown_connections 2023-10-06T02:51:22.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.944+0000 7fe3087e9700 1 -- 172.21.15.81:0/394154057 wait complete. 2023-10-06T02:51:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.945+0000 7fe3087e9700 1 Processor -- start 2023-10-06T02:51:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.945+0000 7fe3087e9700 1 -- start start 2023-10-06T02:51:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe3087e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 0x7fe3000b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe3087e9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3000af270 0x7fe3000c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe3087e9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3000c7d00 0x7fe3000c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe3087e9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000af940 con 0x7fe3000aeea0 2023-10-06T02:51:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe3087e9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000c6560 con 0x7fe3000af270 2023-10-06T02:51:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe3087e9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000b2160 con 0x7fe3000c7d00 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306585700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 0x7fe3000b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306585700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 0x7fe3000b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49418/0 (socket says 172.21.15.81:49418) 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306585700 1 -- 172.21.15.81:0/3651436374 learned_addr learned my addr 172.21.15.81:0/3651436374 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe305d84700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3000af270 0x7fe3000c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306d86700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3000c7d00 0x7fe3000c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306585700 1 -- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3000c7d00 msgr2=0x7fe3000c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306585700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3000c7d00 0x7fe3000c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306585700 1 -- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3000af270 msgr2=0x7fe3000c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306585700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3000af270 0x7fe3000c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306585700 1 -- 172.21.15.81:0/3651436374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc00bcf0 con 0x7fe3000aeea0 2023-10-06T02:51:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe306585700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 0x7fe3000b1c20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00ba90 tx=0x7fe2fc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe2f67fc700 1 -- 172.21.15.81:0/3651436374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc009b30 con 0x7fe3000aeea0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe2f67fc700 1 -- 172.21.15.81:0/3651436374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc009cb0 con 0x7fe3000aeea0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3000c5f40 con 0x7fe3000aeea0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe2f67fc700 1 -- 172.21.15.81:0/3651436374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc014680 con 0x7fe3000aeea0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.946+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3000afe30 con 0x7fe3000aeea0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.947+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe300067bc0 con 0x7fe3000aeea0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.948+0000 7fe2f67fc700 1 -- 172.21.15.81:0/3651436374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2fc014a30 con 0x7fe3000aeea0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.948+0000 7fe2f67fc700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe2e4066f30 0x7fe2e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.948+0000 7fe2f67fc700 1 -- 172.21.15.81:0/3651436374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2fc087f30 con 0x7fe3000aeea0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.948+0000 7fe2f67fc700 1 -- 172.21.15.81:0/3651436374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=104}) v3 -- 0x7fe2e406f0f0 con 0x7fe3000aeea0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.948+0000 7fe305d84700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe2e4066f30 0x7fe2e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.949+0000 7fe305d84700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe2e4066f30 0x7fe2e40693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3000b2810 tx=0x7fe2f0006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:22.952+0000 7fe2f67fc700 1 -- 172.21.15.81:0/3651436374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2fc055040 con 0x7fe3000aeea0 2023-10-06T02:51:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.133+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe30006a490 con 0x7fe3000aeea0 2023-10-06T02:51:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.134+0000 7fe2f67fc700 1 -- 172.21.15.81:0/3651436374 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) v1 ==== 81+0+34869 (secure 0 0 0) 0x7fe2fc02c020 con 0x7fe3000aeea0 2023-10-06T02:51:23.136 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 103, 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:51:22.408508+0000", 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:51:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 14, 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:51:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:51:23.140 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:23.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:23.144 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:23.145 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:23.146 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:23.149 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:23.150 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:58.681047+0000", 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:23.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:51:23.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:23.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:23.155 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:23.156 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.158 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 14, 2023-10-06T02:51:23.158 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:51:23.158 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:59.998500+0000", 2023-10-06T02:51:23.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:23.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:23.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:23.159 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:23.159 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:23.159 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:51:23.160 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:23.161 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:23.162 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:51:23.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.166 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:23.166 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.166 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.166 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.166 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.166 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.166 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:51:23.168 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:51:23.171 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.172 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:51:23.172 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.175 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:23.175 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.175 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.175 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.177 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:51:23.181 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:51:23.182 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.182 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.182 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:23.182 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:51:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.187 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.189 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.192 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.193 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.196 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.197 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.198 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.198 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.198 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.198 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.198 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:51:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:51:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:51:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:51:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:51:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:51:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:51:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:51:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:51:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:51:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:51:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:51:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:51:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:51:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:51:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:51:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:51:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:51:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:51:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:51:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:51:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.235 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe2e4066f30 msgr2=0x7fe2e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe2e4066f30 0x7fe2e40693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3000b2810 tx=0x7fe2f0006f90 comp rx=0 tx=0).stop 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 msgr2=0x7fe3000b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 0x7fe3000b1c20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00ba90 tx=0x7fe2fc019000 comp rx=0 tx=0).stop 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 shutdown_connections 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3000c7d00 0x7fe3000c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3000aeea0 0x7fe3000b1c20 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe2e4066f30 0x7fe2e40693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 --2- 172.21.15.81:0/3651436374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3000af270 0x7fe3000c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 >> 172.21.15.81:0/3651436374 conn(0x7fe30006c660 msgr2=0x7fe3000cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:23.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 shutdown_connections 2023-10-06T02:51:23.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.136+0000 7fe3087e9700 1 -- 172.21.15.81:0/3651436374 wait complete. 2023-10-06T02:51:23.238 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:51:23.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:51:23.239 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-06T02:51:23.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:51:23.494 INFO:teuthology.orchestra.run.smithi081.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-06T02:51:23.495 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-06T02:51:23.495 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-06T02:51:23.495 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.233949 s, 224 MB/s 2023-10-06T02:51:23.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:51:23.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.606+0000 7f536d308700 1 Processor -- start 2023-10-06T02:51:23.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.606+0000 7f536d308700 1 -- start start 2023-10-06T02:51:23.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.607+0000 7f536d308700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5368157ca0 0x7f53680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:23.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.607+0000 7f536d308700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f536806d120 0x7f536806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:23.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.607+0000 7f536d308700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53680d07c0 con 0x7f53681578d0 2023-10-06T02:51:23.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.607+0000 7f536d308700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536806da50 con 0x7f5368157ca0 2023-10-06T02:51:23.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.607+0000 7f536d308700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680cfbb0 con 0x7f536806d120 2023-10-06T02:51:23.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.607+0000 7f53667fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5368157ca0 0x7f53680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:23.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.607+0000 7f53667fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5368157ca0 0x7f53680cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49430/0 (socket says 172.21.15.81:49430) 2023-10-06T02:51:23.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.607+0000 7f53667fc700 1 -- 172.21.15.81:0/3475964389 learned_addr learned my addr 172.21.15.81:0/3475964389 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:23.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f53677fe700 1 --2- 172.21.15.81:0/3475964389 >> v2:172.21.15.83:3300/0 conn(0x7f536806d120 0x7f536806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f53667fc700 1 -- 172.21.15.81:0/3475964389 >> v2:172.21.15.83:3300/0 conn(0x7f536806d120 msgr2=0x7f536806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f53667fc700 1 --2- 172.21.15.81:0/3475964389 >> v2:172.21.15.83:3300/0 conn(0x7f536806d120 0x7f536806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f53667fc700 1 -- 172.21.15.81:0/3475964389 >> v1:172.21.15.83:6789/0 conn(0x7f53681578d0 legacy=0x7f536815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f53667fc700 1 -- 172.21.15.81:0/3475964389 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53680cfe90 con 0x7f5368157ca0 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f53667fc700 1 --2- 172.21.15.81:0/3475964389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368157ca0 0x7f53680cf4f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5368068300 tx=0x7f5350009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f084fe34948a2186 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f5365ffb700 1 -- 172.21.15.81:0/3475964389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000b820 con 0x7f5368157ca0 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f5365ffb700 1 -- 172.21.15.81:0/3475964389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000b980 con 0x7f5368157ca0 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f5365ffb700 1 -- 172.21.15.81:0/3475964389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000bd20 con 0x7f5368157ca0 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f536d308700 1 -- 172.21.15.81:0/3475964389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368157ca0 msgr2=0x7f53680cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.608+0000 7f536d308700 1 --2- 172.21.15.81:0/3475964389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368157ca0 0x7f53680cf4f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5368068300 tx=0x7f5350009250 comp rx=0 tx=0).stop 2023-10-06T02:51:23.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.609+0000 7f536d308700 1 -- 172.21.15.81:0/3475964389 shutdown_connections 2023-10-06T02:51:23.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.609+0000 7f536d308700 1 --2- 172.21.15.81:0/3475964389 >> v2:172.21.15.83:3300/0 conn(0x7f536806d120 0x7f536806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.609+0000 7f536d308700 1 --2- 172.21.15.81:0/3475964389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368157ca0 0x7f53680cf4f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.609+0000 7f536d308700 1 -- 172.21.15.81:0/3475964389 >> 172.21.15.81:0/3475964389 conn(0x7f536806bb90 msgr2=0x7f536806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:23.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.609+0000 7f536d308700 1 -- 172.21.15.81:0/3475964389 shutdown_connections 2023-10-06T02:51:23.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.609+0000 7f536d308700 1 -- 172.21.15.81:0/3475964389 wait complete. 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.610+0000 7f536d308700 1 Processor -- start 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.610+0000 7f536d308700 1 -- start start 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.610+0000 7f536d308700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536806d120 0x7f53681539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.610+0000 7f536d308700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53681578d0 0x7f53680b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f536d308700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5368157ca0 0x7f53680c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f536d308700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680b50b0 con 0x7f536806d120 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f536d308700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680b44a0 con 0x7f53681578d0 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f536d308700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53680b4780 con 0x7f5368157ca0 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f5366ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536806d120 0x7f53681539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f5366ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536806d120 0x7f53681539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49446/0 (socket says 172.21.15.81:49446) 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f5366ffd700 1 -- 172.21.15.81:0/1306681159 learned_addr learned my addr 172.21.15.81:0/1306681159 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f53677fe700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5368157ca0 0x7f53680c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f53667fc700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53681578d0 0x7f53680b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f5366ffd700 1 -- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5368157ca0 msgr2=0x7f53680c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f5366ffd700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5368157ca0 0x7f53680c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f5366ffd700 1 -- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53681578d0 msgr2=0x7f53680b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f5366ffd700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53681578d0 0x7f53680b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f5366ffd700 1 -- 172.21.15.81:0/1306681159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500094f0 con 0x7f536806d120 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f53677fe700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5368157ca0 0x7f53680c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f5366ffd700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536806d120 0x7f53681539b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f535800c950 tx=0x7f5358002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f535effd700 1 -- 172.21.15.81:0/1306681159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800a7e0 con 0x7f536806d120 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f535effd700 1 -- 172.21.15.81:0/1306681159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535800a940 con 0x7f536806d120 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53680b4a60 con 0x7f536806d120 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f535effd700 1 -- 172.21.15.81:0/1306681159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800ad00 con 0x7f536806d120 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.611+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5368153ef0 con 0x7f536806d120 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.612+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53680b2fb0 con 0x7f536806d120 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.612+0000 7f535effd700 1 -- 172.21.15.81:0/1306681159 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5358012630 con 0x7f536806d120 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.613+0000 7f535effd700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5348066f30 0x7f53480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.613+0000 7f535effd700 1 -- 172.21.15.81:0/1306681159 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5358084bf0 con 0x7f536806d120 2023-10-06T02:51:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.613+0000 7f535effd700 1 -- 172.21.15.81:0/1306681159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=105}) v3 -- 0x7f534806f0f0 con 0x7f536806d120 2023-10-06T02:51:23.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.613+0000 7f53667fc700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5348066f30 0x7f53480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:23.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.614+0000 7f53667fc700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5348066f30 0x7f53480693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5368068300 tx=0x7f5350016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:23.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.617+0000 7f535effd700 1 -- 172.21.15.81:0/1306681159 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5358016020 con 0x7f536806d120 2023-10-06T02:51:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.801+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f53680d0170 con 0x7f536806d120 2023-10-06T02:51:23.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.802+0000 7f535effd700 1 -- 172.21.15.81:0/1306681159 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) v1 ==== 81+0+34893 (secure 0 0 0) 0x7f5358051db0 con 0x7f536806d120 2023-10-06T02:51:23.804 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:23.804 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:51:23.804 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 104, 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:51:23.412598+0000", 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:51:23.805 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 14, 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:51:23.806 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:23.808 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:23.808 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:23.808 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:23.808 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:23.808 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:23.808 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:23.808 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:51:23.808 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:51:23.808 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:23.812 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.813 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:23.814 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:23.814 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:23.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:23.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:23.814 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:23.814 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:23.814 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:23.814 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:23.818 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:23.818 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:23.818 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:23.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:51:23.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:51:23.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.818 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:23.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:51:23.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.819 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:51:23.819 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:51:23.819 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:51:23.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:23.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:23.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:23.820 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:23.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:23.821 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:23.821 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:23.821 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:23.821 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:23.821 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:23.821 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:23.821 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:23.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:51:23.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:51:23.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:51:23.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:51:23.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:51:23.822 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:23.823 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:23.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:23.826 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:58.681047+0000", 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:23.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:23.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:23.828 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:23.828 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:23.828 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:23.829 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:23.829 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:23.829 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:23.829 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:23.829 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:23.829 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:23.829 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:51:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:51:23.831 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:51:23.831 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:51:23.831 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:51:23.831 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:23.831 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:23.831 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:23.832 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:23.834 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:23.834 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:23.834 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:23.834 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:23.834 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:23.835 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:51:23.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 14, 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:59.998500+0000", 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:51:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:23.841 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:23.841 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:23.841 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:23.841 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:23.842 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:23.842 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:23.842 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:23.842 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:23.842 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:23.842 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:23.843 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:23.844 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:51:23.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:51:23.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:51:23.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:51:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.854 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.854 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.854 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.854 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.854 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.854 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.854 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.854 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.854 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.860 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:51:23.863 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:51:23.864 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.864 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:51:23.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:51:23.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:51:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:51:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.868 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.868 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.868 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:51:23.868 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.869 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:51:23.869 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:23.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.869 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.870 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.871 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:51:23.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.874 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:51:23.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.875 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.875 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.875 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:51:23.875 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.876 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:51:23.876 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.878 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.879 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.880 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.880 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.880 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.880 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.880 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.880 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.880 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:51:23.882 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:51:23.884 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:51:23.885 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.885 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.885 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.886 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:51:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:51:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:51:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:51:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:51:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:51:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:51:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:51:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:51:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:51:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:51:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.901 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:51:23.901 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.904 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:51:23.907 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:51:23.910 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.916 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:23.917 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:51:23.918 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:51:23.919 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:51:23.920 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:51:23.920 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:51:23.920 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:51:23.920 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:51:23.920 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:51:23.920 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:51:23.920 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:51:23.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:23.920 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5348066f30 msgr2=0x7f53480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5348066f30 0x7f53480693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5368068300 tx=0x7f5350016000 comp rx=0 tx=0).stop 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536806d120 msgr2=0x7f53681539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536806d120 0x7f53681539b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f535800c950 tx=0x7f5358002760 comp rx=0 tx=0).stop 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 shutdown_connections 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5368157ca0 0x7f53680c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536806d120 0x7f53681539b0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5348066f30 0x7f53480693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 --2- 172.21.15.81:0/1306681159 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53681578d0 0x7f53680b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 >> 172.21.15.81:0/1306681159 conn(0x7f536806bb90 msgr2=0x7f536815e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 shutdown_connections 2023-10-06T02:51:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:23.804+0000 7f536d308700 1 -- 172.21.15.81:0/1306681159 wait complete. 2023-10-06T02:51:23.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.034+0000 7fcd4f59e700 1 Processor -- start 2023-10-06T02:51:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.034+0000 7fcd4f59e700 1 -- start start 2023-10-06T02:51:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.035+0000 7fcd4f59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcd50159f10 0x7fcd50068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.035+0000 7fcd4f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd50069120 con 0x7fcd50159b40 2023-10-06T02:51:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.035+0000 7fcd4f59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd500cee10 con 0x7fcd50068cc0 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.035+0000 7fcd4f59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd500cd040 con 0x7fcd50159f10 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.035+0000 7fcd4e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcd50159b40 0x7fcd500cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36934/0 (socket says 172.21.15.81:36934) 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.035+0000 7fcd4e59c700 1 -- 172.21.15.81:0/3615403041 learned_addr learned my addr 172.21.15.81:0/3615403041 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.035+0000 7fcd4dd9b700 1 --2- 172.21.15.81:0/3615403041 >> v2:172.21.15.83:3300/0 conn(0x7fcd50159f10 0x7fcd50068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.035+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553411867 0 0) 0x7fcd40001490 con 0x7fcd50159b40 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.035+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd38003570 con 0x7fcd50159b40 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3329153220 0 0) 0x7fcd38003570 con 0x7fcd50159b40 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 >> v2:172.21.15.83:3300/0 conn(0x7fcd50159f10 msgr2=0x7fcd50068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 --2- 172.21.15.81:0/3615403041 >> v2:172.21.15.83:3300/0 conn(0x7fcd50159f10 0x7fcd50068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 >> v1:172.21.15.83:6789/0 conn(0x7fcd50068cc0 legacy=0x7fcd500cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500cd320 con 0x7fcd50159b40 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fcd40001980 con 0x7fcd50159b40 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 >> v1:172.21.15.81:6789/0 conn(0x7fcd50159b40 legacy=0x7fcd500cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd38003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd38004810 0x7fcd38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd380051c0 0x7fcd3800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500cd040 con 0x7fcd38003a60 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3800c0d0 con 0x7fcd38004810 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3800c290 con 0x7fcd380051c0 2023-10-06T02:51:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4e59c700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd38003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4dd9b700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd38004810 0x7fcd38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4ed9d700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd380051c0 0x7fcd3800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4e59c700 1 -- 172.21.15.81:0/3615403041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd380051c0 msgr2=0x7fcd3800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4e59c700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd380051c0 0x7fcd3800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4e59c700 1 -- 172.21.15.81:0/3615403041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd38004810 msgr2=0x7fcd38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4e59c700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd38004810 0x7fcd38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4e59c700 1 -- 172.21.15.81:0/3615403041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38003570 con 0x7fcd38003a60 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4dd9b700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd38004810 0x7fcd38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4ed9d700 1 -- 172.21.15.81:0/3615403041 reap_dead start 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4e59c700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd38003e70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000aaa0 tx=0x7fcd4000a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb649cd6a7734b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000c5d0 con 0x7fcd38003a60 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4000c750 con 0x7fcd38003a60 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.036+0000 7fcd4d59a700 1 -- 172.21.15.81:0/3615403041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000cb10 con 0x7fcd38003a60 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.037+0000 7fcd4f59e700 1 -- 172.21.15.81:0/3615403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 msgr2=0x7fcd38003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.037+0000 7fcd4f59e700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd38003e70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000aaa0 tx=0x7fcd4000a170 comp rx=0 tx=0).stop 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.037+0000 7fcd4f59e700 1 -- 172.21.15.81:0/3615403041 shutdown_connections 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.037+0000 7fcd4f59e700 1 --2- 172.21.15.81:0/3615403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd38003e70 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.037+0000 7fcd4f59e700 1 -- 172.21.15.81:0/3615403041 >> 172.21.15.81:0/3615403041 conn(0x7fcd500cd660 msgr2=0x7fcd500cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.037+0000 7fcd4f59e700 1 -- 172.21.15.81:0/3615403041 shutdown_connections 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.037+0000 7fcd4f59e700 1 -- 172.21.15.81:0/3615403041 wait complete. 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.038+0000 7fcd4f59e700 1 Processor -- start 2023-10-06T02:51:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.038+0000 7fcd4f59e700 1 -- start start 2023-10-06T02:51:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd50158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd5015b8e0 0x7fcd5015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd500c9df0 0x7fcd500ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500ca7a0 con 0x7fcd38003a60 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5015cfb0 con 0x7fcd500c9df0 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50158880 con 0x7fcd5015b8e0 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd50158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd50158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49458/0 (socket says 172.21.15.81:49458) 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4e59c700 1 -- 172.21.15.81:0/1320413292 learned_addr learned my addr 172.21.15.81:0/1320413292 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4ed9d700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd500c9df0 0x7fcd500ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4dd9b700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd5015b8e0 0x7fcd5015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4e59c700 1 -- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd5015b8e0 msgr2=0x7fcd5015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4e59c700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd5015b8e0 0x7fcd5015bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4e59c700 1 -- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd500c9df0 msgr2=0x7fcd500ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4e59c700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd500c9df0 0x7fcd500ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4e59c700 1 -- 172.21.15.81:0/1320413292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5015c3a0 con 0x7fcd38003a60 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4e59c700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd50158340 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c3c0 tx=0x7fcd40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd3e7fc700 1 -- 172.21.15.81:0/1320413292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000ce80 con 0x7fcd38003a60 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd3e7fc700 1 -- 172.21.15.81:0/1320413292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4000c8c0 con 0x7fcd38003a60 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd3e7fc700 1 -- 172.21.15.81:0/1320413292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4001e430 con 0x7fcd38003a60 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5015c680 con 0x7fcd38003a60 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.039+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5015cc40 con 0x7fcd38003a60 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.040+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd500ca7a0 con 0x7fcd38003a60 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.041+0000 7fcd3e7fc700 1 -- 172.21.15.81:0/1320413292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd4001e7a0 con 0x7fcd38003a60 2023-10-06T02:51:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.041+0000 7fcd3e7fc700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcd30066f30 0x7fcd300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.041+0000 7fcd3e7fc700 1 -- 172.21.15.81:0/1320413292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcd40086c80 con 0x7fcd38003a60 2023-10-06T02:51:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.041+0000 7fcd3e7fc700 1 -- 172.21.15.81:0/1320413292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=105}) v3 -- 0x7fcd3006f0f0 con 0x7fcd38003a60 2023-10-06T02:51:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.041+0000 7fcd4dd9b700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcd30066f30 0x7fcd300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.042+0000 7fcd4dd9b700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcd30066f30 0x7fcd300693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcd44006dc0 tx=0x7fcd44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.045+0000 7fcd3e7fc700 1 -- 172.21.15.81:0/1320413292 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd40053d90 con 0x7fcd38003a60 2023-10-06T02:51:24.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.274+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd50069120 con 0x7fcd38003a60 2023-10-06T02:51:24.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.274+0000 7fcd3e7fc700 1 -- 172.21.15.81:0/1320413292 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fcd50069120 con 0x7fcd38003a60 2023-10-06T02:51:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:24.277 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:01.019609+0000","modified":"2023-10-06T02:51:04.689923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/907018385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":907018385},{"type":"v1","addr":"172.21.15.81:6835","nonce":907018385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcd30066f30 msgr2=0x7fcd300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcd30066f30 0x7fcd300693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcd44006dc0 tx=0x7fcd44008040 comp rx=0 tx=0).stop 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 msgr2=0x7fcd50158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd50158340 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c3c0 tx=0x7fcd40016000 comp rx=0 tx=0).stop 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 shutdown_connections 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcd30066f30 0x7fcd300693e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd500c9df0 0x7fcd500ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38003a60 0x7fcd50158340 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 --2- 172.21.15.81:0/1320413292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd5015b8e0 0x7fcd5015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 >> 172.21.15.81:0/1320413292 conn(0x7fcd500cd660 msgr2=0x7fcd5006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 shutdown_connections 2023-10-06T02:51:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.276+0000 7fcd4f59e700 1 -- 172.21.15.81:0/1320413292 wait complete. 2023-10-06T02:51:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-06T02:51:24.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:51:24.424 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":6465,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":22.742153688999998,"mdsmap_epoch":52,"osdmap_epoch":104,"osdmap_epoch_barrier":104,"uptime":34.934797467999999} 2023-10-06T02:51:24.424 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 6465, "mdsmap_epoch": 52, "osdmap_epoch": 104, "osdmap_epoch_barrier": 104, "rank_uptime": 22.742153689, "state": "up:active", "uptime": 34.934797468, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:51:24.424 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:51:24.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:51:24.425 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-06T02:51:24.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:51:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-06T02:51:24.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:51:24.440 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-06T02:51:24.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:51:24.495 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-06T02:51:24.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:51:24.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.726+0000 7fa60d950700 1 Processor -- start 2023-10-06T02:51:24.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.726+0000 7fa60d950700 1 -- start start 2023-10-06T02:51:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.727+0000 7fa60d950700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa608156db0 0x7fa60806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.727+0000 7fa60d950700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa60806e770 0x7fa6080cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.727+0000 7fa60d950700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60806ebd0 con 0x7fa6081569e0 2023-10-06T02:51:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.727+0000 7fa60d950700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6080b2290 con 0x7fa60806e770 2023-10-06T02:51:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.727+0000 7fa60d950700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa608157c00 con 0x7fa608156db0 2023-10-06T02:51:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.727+0000 7fa6077fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa60806e770 0x7fa6080cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.727+0000 7fa6077fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa60806e770 0x7fa6080cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49472/0 (socket says 172.21.15.81:49472) 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.727+0000 7fa6077fe700 1 -- 172.21.15.81:0/4236371461 learned_addr learned my addr 172.21.15.81:0/4236371461 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa6067fc700 1 --2- 172.21.15.81:0/4236371461 >> v2:172.21.15.83:3300/0 conn(0x7fa608156db0 0x7fa60806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa6077fe700 1 -- 172.21.15.81:0/4236371461 >> v2:172.21.15.83:3300/0 conn(0x7fa608156db0 msgr2=0x7fa60806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa6077fe700 1 --2- 172.21.15.81:0/4236371461 >> v2:172.21.15.83:3300/0 conn(0x7fa608156db0 0x7fa60806e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa6077fe700 1 -- 172.21.15.81:0/4236371461 >> v1:172.21.15.83:6789/0 conn(0x7fa6081569e0 legacy=0x7fa6080b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa6077fe700 1 -- 172.21.15.81:0/4236371461 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6081572d0 con 0x7fa60806e770 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa6077fe700 1 --2- 172.21.15.81:0/4236371461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60806e770 0x7fa6080cd920 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa608069450 tx=0x7fa600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e928b04bb7fd599f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa605ffb700 1 -- 172.21.15.81:0/4236371461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000b820 con 0x7fa60806e770 2023-10-06T02:51:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa605ffb700 1 -- 172.21.15.81:0/4236371461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60000b980 con 0x7fa60806e770 2023-10-06T02:51:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa605ffb700 1 -- 172.21.15.81:0/4236371461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000bd20 con 0x7fa60806e770 2023-10-06T02:51:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa60d950700 1 -- 172.21.15.81:0/4236371461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60806e770 msgr2=0x7fa6080cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa60d950700 1 --2- 172.21.15.81:0/4236371461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60806e770 0x7fa6080cd920 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa608069450 tx=0x7fa600009250 comp rx=0 tx=0).stop 2023-10-06T02:51:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa60d950700 1 -- 172.21.15.81:0/4236371461 shutdown_connections 2023-10-06T02:51:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.728+0000 7fa60d950700 1 --2- 172.21.15.81:0/4236371461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60806e770 0x7fa6080cd920 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.729+0000 7fa60d950700 1 --2- 172.21.15.81:0/4236371461 >> v2:172.21.15.83:3300/0 conn(0x7fa608156db0 0x7fa60806e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.729+0000 7fa60d950700 1 -- 172.21.15.81:0/4236371461 >> 172.21.15.81:0/4236371461 conn(0x7fa60806cca0 msgr2=0x7fa60806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.729+0000 7fa60d950700 1 -- 172.21.15.81:0/4236371461 shutdown_connections 2023-10-06T02:51:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.729+0000 7fa60d950700 1 -- 172.21.15.81:0/4236371461 wait complete. 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.730+0000 7fa60d950700 1 Processor -- start 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.730+0000 7fa60d950700 1 -- start start 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.730+0000 7fa60d950700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa60806e770 0x7fa608140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.730+0000 7fa60d950700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6081569e0 0x7fa60806bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa60d950700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa608156db0 0x7fa60806c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa60d950700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608141130 con 0x7fa608156db0 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa60d950700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608168000 con 0x7fa6081569e0 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa60d950700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa608168280 con 0x7fa60806e770 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa608156db0 0x7fa60806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa608156db0 0x7fa60806c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49480/0 (socket says 172.21.15.81:49480) 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6077fe700 1 -- 172.21.15.81:0/3087032201 learned_addr learned my addr 172.21.15.81:0/3087032201 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa606ffd700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa60806e770 0x7fa608140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6067fc700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6081569e0 0x7fa60806bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6077fe700 1 -- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa60806e770 msgr2=0x7fa608140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6077fe700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa60806e770 0x7fa608140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6077fe700 1 -- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6081569e0 msgr2=0x7fa60806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6077fe700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6081569e0 0x7fa60806bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6077fe700 1 -- 172.21.15.81:0/3087032201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6000094f0 con 0x7fa608156db0 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa6077fe700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa608156db0 0x7fa60806c160 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa608071450 tx=0x7fa600016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa5eeffd700 1 -- 172.21.15.81:0/3087032201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60001b450 con 0x7fa608156db0 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa5eeffd700 1 -- 172.21.15.81:0/3087032201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600020070 con 0x7fa608156db0 2023-10-06T02:51:24.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa608168560 con 0x7fa608156db0 2023-10-06T02:51:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa5eeffd700 1 -- 172.21.15.81:0/3087032201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60001b820 con 0x7fa608156db0 2023-10-06T02:51:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.731+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa608168b20 con 0x7fa608156db0 2023-10-06T02:51:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.732+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa608168d10 con 0x7fa608156db0 2023-10-06T02:51:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.733+0000 7fa5eeffd700 1 -- 172.21.15.81:0/3087032201 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa600022030 con 0x7fa608156db0 2023-10-06T02:51:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.733+0000 7fa5eeffd700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.733+0000 7fa5eeffd700 1 -- 172.21.15.81:0/3087032201 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa600086540 con 0x7fa608156db0 2023-10-06T02:51:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.733+0000 7fa5eeffd700 1 -- 172.21.15.81:0/3087032201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=105}) v3 -- 0x7fa5f406f0f0 con 0x7fa608156db0 2023-10-06T02:51:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.734+0000 7fa606ffd700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.734+0000 7fa606ffd700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8007fd0 tx=0x7fa5f80026a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.737+0000 7fa5eeffd700 1 -- 172.21.15.81:0/3087032201 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa600053650 con 0x7fa608156db0 2023-10-06T02:51:24.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.920+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa60806ebd0 con 0x7fa608156db0 2023-10-06T02:51:24.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.921+0000 7fa5eeffd700 1 -- 172.21.15.81:0/3087032201 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) v1 ==== 81+0+34893 (secure 0 0 0) 0x7fa60806ebd0 con 0x7fa608156db0 2023-10-06T02:51:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:24.926 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:51:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 104, 2023-10-06T02:51:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:51:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:51:23.412598+0000", 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:51:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 14, 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:51:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:51:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:51:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:51:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:51:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:51:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:51:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:51:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:51:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:51:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:51:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:51:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:51:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:51:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:51:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:58.681047+0000", 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 14, 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:59.998500+0000", 2023-10-06T02:51:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:51:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:51:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:51:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:51:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:51:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.985 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:24.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:51:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.992 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:24.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:51:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:51:24.996 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:24.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:24.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.003 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.004 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:25.005 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:25.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:51:25.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:25.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:51:25.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:25.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.010 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:25.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:51:25.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:25.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:51:25.011 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:25.012 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:51:25.013 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:25.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:51:25.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:25.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.018 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:51:25.018 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:51:25.018 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:25.020 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:25.020 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:25.020 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:25.020 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:25.022 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:51:25.022 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:25.024 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:25.025 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:25.026 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:51:25.028 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:25.030 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:51:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa5f4066f30 msgr2=0x7fa5f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8007fd0 tx=0x7fa5f80026a0 comp rx=0 tx=0).stop 2023-10-06T02:51:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa608156db0 msgr2=0x7fa60806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa608156db0 0x7fa60806c160 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa608071450 tx=0x7fa600016000 comp rx=0 tx=0).stop 2023-10-06T02:51:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 shutdown_connections 2023-10-06T02:51:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa608156db0 0x7fa60806c160 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa60806e770 0x7fa608140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 --2- 172.21.15.81:0/3087032201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6081569e0 0x7fa60806bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 >> 172.21.15.81:0/3087032201 conn(0x7fa60806cca0 msgr2=0x7fa608152420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 shutdown_connections 2023-10-06T02:51:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:24.923+0000 7fa60d950700 1 -- 172.21.15.81:0/3087032201 wait complete. 2023-10-06T02:51:25.033 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:51:27.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:51:27.430+0000 7f12cda80700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-06T02:51:30.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:51:30.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.155+0000 7f3bd5e11700 1 Processor -- start 2023-10-06T02:51:30.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.156+0000 7f3bd5e11700 1 -- start start 2023-10-06T02:51:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.156+0000 7f3bd5e11700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3bd0159b40 0x7f3bd00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.156+0000 7f3bd5e11700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 0x7f3bd0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.156+0000 7f3bd5e11700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bd00ccb40 0x7f3bd0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.156+0000 7f3bd5e11700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd00cee10 con 0x7f3bd00ccb40 2023-10-06T02:51:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.156+0000 7f3bd5e11700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd00cd040 con 0x7f3bd0159b40 2023-10-06T02:51:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.156+0000 7f3bd5e11700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00cd320 con 0x7f3bd0159f10 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.156+0000 7f3bd5610700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bd00ccb40 0x7f3bd0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bd5610700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bd00ccb40 0x7f3bd0068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49490/0 (socket says 172.21.15.81:49490) 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bd5610700 1 -- 172.21.15.81:0/2159568330 learned_addr learned my addr 172.21.15.81:0/2159568330 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bcffff700 1 --2- 172.21.15.81:0/2159568330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 0x7f3bd0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bd4e0f700 1 --2- 172.21.15.81:0/2159568330 >> v2:172.21.15.83:3300/0 conn(0x7f3bd0159b40 0x7f3bd00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bd5610700 1 -- 172.21.15.81:0/2159568330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 msgr2=0x7f3bd0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bd5610700 1 --2- 172.21.15.81:0/2159568330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 0x7f3bd0068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bd5610700 1 -- 172.21.15.81:0/2159568330 >> v2:172.21.15.83:3300/0 conn(0x7f3bd0159b40 msgr2=0x7f3bd00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bd5610700 1 --2- 172.21.15.81:0/2159568330 >> v2:172.21.15.83:3300/0 conn(0x7f3bd0159b40 0x7f3bd00cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bd5610700 1 -- 172.21.15.81:0/2159568330 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd00ce7c0 con 0x7f3bd00ccb40 2023-10-06T02:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bd5610700 1 --2- 172.21.15.81:0/2159568330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 0x7f3bd0068cc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00d0bc0 tx=0x7f3bc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33da557c36dc23fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bcf7fe700 1 -- 172.21.15.81:0/2159568330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc800b860 con 0x7f3bd00ccb40 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bcf7fe700 1 -- 172.21.15.81:0/2159568330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc800b9c0 con 0x7f3bd00ccb40 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.157+0000 7f3bcf7fe700 1 -- 172.21.15.81:0/2159568330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc800bd60 con 0x7f3bd00ccb40 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.158+0000 7f3bd5e11700 1 -- 172.21.15.81:0/2159568330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 msgr2=0x7f3bd0068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.158+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/2159568330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 0x7f3bd0068cc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00d0bc0 tx=0x7f3bc8009250 comp rx=0 tx=0).stop 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.158+0000 7f3bd5e11700 1 -- 172.21.15.81:0/2159568330 shutdown_connections 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.158+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/2159568330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 0x7f3bd0068cc0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.158+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/2159568330 >> v2:172.21.15.83:3300/0 conn(0x7f3bd0159b40 0x7f3bd00cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.158+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/2159568330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 0x7f3bd0068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.158+0000 7f3bd5e11700 1 -- 172.21.15.81:0/2159568330 >> 172.21.15.81:0/2159568330 conn(0x7f3bd00cd660 msgr2=0x7f3bd00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.158+0000 7f3bd5e11700 1 -- 172.21.15.81:0/2159568330 shutdown_connections 2023-10-06T02:51:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.158+0000 7f3bd5e11700 1 -- 172.21.15.81:0/2159568330 wait complete. 2023-10-06T02:51:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.159+0000 7f3bd5e11700 1 Processor -- start 2023-10-06T02:51:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.159+0000 7f3bd5e11700 1 -- start start 2023-10-06T02:51:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd5e11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 0x7f3bd01532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd5e11700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0159b40 0x7f3bd015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd5e11700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 0x7f3bd00c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd5e11700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0153820 con 0x7f3bd00ccb40 2023-10-06T02:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd5e11700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd015afe0 con 0x7f3bd0159b40 2023-10-06T02:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd5e11700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00ca050 con 0x7f3bd0159f10 2023-10-06T02:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd4e0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 0x7f3bd01532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd4e0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 0x7f3bd01532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49500/0 (socket says 172.21.15.81:49500) 2023-10-06T02:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd4e0f700 1 -- 172.21.15.81:0/506347917 learned_addr learned my addr 172.21.15.81:0/506347917 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bcffff700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0159b40 0x7f3bd015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd5610700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 0x7f3bd00c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd4e0f700 1 -- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 msgr2=0x7f3bd00c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd4e0f700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 0x7f3bd00c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd4e0f700 1 -- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0159b40 msgr2=0x7f3bd015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd4e0f700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0159b40 0x7f3bd015aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd4e0f700 1 -- 172.21.15.81:0/506347917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80094f0 con 0x7f3bd00ccb40 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd4e0f700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 0x7f3bd01532e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e190 tx=0x7f3bc0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bccff9700 1 -- 172.21.15.81:0/506347917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000ecd0 con 0x7f3bd00ccb40 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bccff9700 1 -- 172.21.15.81:0/506347917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc000ee30 con 0x7f3bd00ccb40 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bccff9700 1 -- 172.21.15.81:0/506347917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0014670 con 0x7f3bd00ccb40 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.160+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd00ca330 con 0x7f3bd00ccb40 2023-10-06T02:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.161+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd00ca8f0 con 0x7f3bd00ccb40 2023-10-06T02:51:30.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.161+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd0063e90 con 0x7f3bd00ccb40 2023-10-06T02:51:30.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.162+0000 7f3bccff9700 1 -- 172.21.15.81:0/506347917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bc0014a20 con 0x7f3bd00ccb40 2023-10-06T02:51:30.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.162+0000 7f3bccff9700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3bbc066f30 0x7f3bbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:30.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.162+0000 7f3bccff9700 1 -- 172.21.15.81:0/506347917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3bc0084d20 con 0x7f3bd00ccb40 2023-10-06T02:51:30.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.162+0000 7f3bccff9700 1 -- 172.21.15.81:0/506347917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=108}) v3 -- 0x7f3bbc06f0f0 con 0x7f3bd00ccb40 2023-10-06T02:51:30.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.162+0000 7f3bcffff700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3bbc066f30 0x7f3bbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:30.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.163+0000 7f3bcffff700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3bbc066f30 0x7f3bbc0693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3bd015c570 tx=0x7f3bc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:30.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.166+0000 7f3bccff9700 1 -- 172.21.15.81:0/506347917 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bc0051e30 con 0x7f3bd00ccb40 2023-10-06T02:51:30.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.352+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3bd016a620 con 0x7f3bd00ccb40 2023-10-06T02:51:30.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.353+0000 7f3bccff9700 1 -- 172.21.15.81:0/506347917 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) v1 ==== 81+0+34821 (secure 0 0 0) 0x7f3bc0009a60 con 0x7f3bd00ccb40 2023-10-06T02:51:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 107, 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:51:29.492681+0000", 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:51:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 14, 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:51:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:51:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:51:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:51:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:58.681047+0000", 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:51:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:51:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 14, 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:59.998500+0000", 2023-10-06T02:51:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:51:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:51:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:51:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:51:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:51:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:51:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:51:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:51:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:51:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:51:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:30.443 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:51:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3bbc066f30 msgr2=0x7f3bbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3bbc066f30 0x7f3bbc0693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3bd015c570 tx=0x7f3bc4008040 comp rx=0 tx=0).stop 2023-10-06T02:51:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 msgr2=0x7f3bd01532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 0x7f3bd01532e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e190 tx=0x7f3bc0009920 comp rx=0 tx=0).stop 2023-10-06T02:51:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 shutdown_connections 2023-10-06T02:51:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bd0159f10 0x7f3bd00c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd00ccb40 0x7f3bd01532e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3bbc066f30 0x7f3bbc0693e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 --2- 172.21.15.81:0/506347917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0159b40 0x7f3bd015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 >> 172.21.15.81:0/506347917 conn(0x7f3bd00cd660 msgr2=0x7f3bd00c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 shutdown_connections 2023-10-06T02:51:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:30.355+0000 7f3bd5e11700 1 -- 172.21.15.81:0/506347917 wait complete. 2023-10-06T02:51:30.447 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:51:35.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:51:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.570+0000 7f4a72534700 1 Processor -- start 2023-10-06T02:51:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.570+0000 7f4a72534700 1 -- start start 2023-10-06T02:51:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.571+0000 7f4a72534700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a6c1578d0 0x7f4a6c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.571+0000 7f4a72534700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 0x7f4a6c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.571+0000 7f4a72534700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c0d07c0 con 0x7f4a6c157ca0 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.571+0000 7f4a72534700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c06daa0 con 0x7f4a6c1578d0 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.571+0000 7f4a72534700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0cfbb0 con 0x7f4a6c06d120 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.571+0000 7f4a6bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a6c1578d0 0x7f4a6c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.571+0000 7f4a6bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a6c1578d0 0x7f4a6c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33190/0 (socket says 172.21.15.81:33190) 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.571+0000 7f4a6bfff700 1 -- 172.21.15.81:0/804771370 learned_addr learned my addr 172.21.15.81:0/804771370 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a70ad1700 1 --2- 172.21.15.81:0/804771370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 0x7f4a6c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a6bfff700 1 -- 172.21.15.81:0/804771370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 msgr2=0x7f4a6c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a6bfff700 1 --2- 172.21.15.81:0/804771370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 0x7f4a6c06d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a6bfff700 1 -- 172.21.15.81:0/804771370 >> v1:172.21.15.83:6789/0 conn(0x7f4a6c157ca0 legacy=0x7f4a6c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a6bfff700 1 -- 172.21.15.81:0/804771370 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c0cfe90 con 0x7f4a6c1578d0 2023-10-06T02:51:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a6bfff700 1 --2- 172.21.15.81:0/804771370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c1578d0 0x7f4a6c0cf4f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0099b0 tx=0x7f4a5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c1b09a155d8602 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a6affd700 1 -- 172.21.15.81:0/804771370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c00b820 con 0x7f4a6c1578d0 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a6affd700 1 -- 172.21.15.81:0/804771370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c00b980 con 0x7f4a6c1578d0 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a6affd700 1 -- 172.21.15.81:0/804771370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c00bd20 con 0x7f4a6c1578d0 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a72534700 1 -- 172.21.15.81:0/804771370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c1578d0 msgr2=0x7f4a6c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.572+0000 7f4a72534700 1 --2- 172.21.15.81:0/804771370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c1578d0 0x7f4a6c0cf4f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0099b0 tx=0x7f4a5c009250 comp rx=0 tx=0).stop 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.573+0000 7f4a72534700 1 -- 172.21.15.81:0/804771370 shutdown_connections 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.573+0000 7f4a72534700 1 --2- 172.21.15.81:0/804771370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 0x7f4a6c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.573+0000 7f4a72534700 1 --2- 172.21.15.81:0/804771370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c1578d0 0x7f4a6c0cf4f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.573+0000 7f4a72534700 1 -- 172.21.15.81:0/804771370 >> 172.21.15.81:0/804771370 conn(0x7f4a6c06bb90 msgr2=0x7f4a6c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.573+0000 7f4a72534700 1 -- 172.21.15.81:0/804771370 shutdown_connections 2023-10-06T02:51:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.573+0000 7f4a72534700 1 -- 172.21.15.81:0/804771370 wait complete. 2023-10-06T02:51:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.574+0000 7f4a72534700 1 Processor -- start 2023-10-06T02:51:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.574+0000 7f4a72534700 1 -- start start 2023-10-06T02:51:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.574+0000 7f4a72534700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 0x7f4a6c145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.574+0000 7f4a72534700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a6c1578d0 0x7f4a6c0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.574+0000 7f4a72534700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c157ca0 0x7f4a6c159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a72534700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0ca3d0 con 0x7f4a6c157ca0 2023-10-06T02:51:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a72534700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c16a660 con 0x7f4a6c1578d0 2023-10-06T02:51:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a72534700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0cd1e0 con 0x7f4a6c06d120 2023-10-06T02:51:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a70ad1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c157ca0 0x7f4a6c159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a70ad1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c157ca0 0x7f4a6c159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33196/0 (socket says 172.21.15.81:33196) 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a70ad1700 1 -- 172.21.15.81:0/1741561251 learned_addr learned my addr 172.21.15.81:0/1741561251 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a6bfff700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 0x7f4a6c145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a6b7fe700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a6c1578d0 0x7f4a6c0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a70ad1700 1 -- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 msgr2=0x7f4a6c145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a70ad1700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 0x7f4a6c145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a70ad1700 1 -- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a6c1578d0 msgr2=0x7f4a6c0c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a70ad1700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a6c1578d0 0x7f4a6c0c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a70ad1700 1 -- 172.21.15.81:0/1741561251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c0094f0 con 0x7f4a6c157ca0 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a70ad1700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c157ca0 0x7f4a6c159550 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400cee0 tx=0x7f4a64007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a53fff700 1 -- 172.21.15.81:0/1741561251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6400ad50 con 0x7f4a6c157ca0 2023-10-06T02:51:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a53fff700 1 -- 172.21.15.81:0/1741561251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64016430 con 0x7f4a6c157ca0 2023-10-06T02:51:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c0c6a70 con 0x7f4a6c157ca0 2023-10-06T02:51:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a53fff700 1 -- 172.21.15.81:0/1741561251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640167d0 con 0x7f4a6c157ca0 2023-10-06T02:51:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.575+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c0cc8b0 con 0x7f4a6c157ca0 2023-10-06T02:51:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.576+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c0cd390 con 0x7f4a6c157ca0 2023-10-06T02:51:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.577+0000 7f4a53fff700 1 -- 172.21.15.81:0/1741561251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a64003020 con 0x7f4a6c157ca0 2023-10-06T02:51:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.577+0000 7f4a53fff700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a58066f30 0x7f4a580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.577+0000 7f4a53fff700 1 -- 172.21.15.81:0/1741561251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a64012070 con 0x7f4a6c157ca0 2023-10-06T02:51:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.577+0000 7f4a6bfff700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a58066f30 0x7f4a580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.578+0000 7f4a6bfff700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a58066f30 0x7f4a580693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0099b0 tx=0x7f4a5c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.581+0000 7f4a53fff700 1 -- 172.21.15.81:0/1741561251 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a6c0cd390 con 0x7f4a6c157ca0 2023-10-06T02:51:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.766+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4a6c0cd350 con 0x7f4a6c157ca0 2023-10-06T02:51:35.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.767+0000 7f4a53fff700 1 -- 172.21.15.81:0/1741561251 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v108) v1 ==== 81+0+34777 (secure 0 0 0) 0x7f4a640525d0 con 0x7f4a6c157ca0 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 108, 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:51:30.499203+0000", 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:51:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 14, 2023-10-06T02:51:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:51:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:58.681047+0000", 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:51:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:51:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:51:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:51:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 14, 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:59.998500+0000", 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:51:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:35.797 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:35.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:35.799 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:35.801 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:51:35.804 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:35.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.804 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:35.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:51:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:51:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:51:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:51:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:51:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:51:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:51:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:51:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:51:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:51:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:51:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:51:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.831 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:51:35.831 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:51:35.831 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:35.832 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:35.833 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:35.833 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:35.833 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:35.833 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:35.833 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:35.833 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:35.833 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:35.833 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:35.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:51:35.834 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:35.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:51:35.834 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:51:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:35.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:51:35.836 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:35.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.836 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.836 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:51:35.837 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:35.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:35.840 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:35.841 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:35.841 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:35.841 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:35.842 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:35.842 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:35.842 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:35.842 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:35.842 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:35.842 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:35.842 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:35.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:51:35.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:35.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:51:35.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:35.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:35.848 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:35.849 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:35.850 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:35.850 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:35.850 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:35.850 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:35.850 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:35.850 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:35.850 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:35.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:51:35.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:35.857 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:35.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:51:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:51:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:35.863 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:35.864 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:35.865 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:35.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.867 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:35.868 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:35.869 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:51:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:51:35.871 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:51:35.872 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:51:35.872 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:51:35.872 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:51:35.872 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:51:35.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:35.872 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a58066f30 msgr2=0x7f4a580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a58066f30 0x7f4a580693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0099b0 tx=0x7f4a5c016000 comp rx=0 tx=0).stop 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c157ca0 msgr2=0x7f4a6c159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c157ca0 0x7f4a6c159550 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400cee0 tx=0x7f4a64007870 comp rx=0 tx=0).stop 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 shutdown_connections 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6c157ca0 0x7f4a6c159550 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a6c06d120 0x7f4a6c145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a58066f30 0x7f4a580693e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 --2- 172.21.15.81:0/1741561251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a6c1578d0 0x7f4a6c0c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 >> 172.21.15.81:0/1741561251 conn(0x7f4a6c06bb90 msgr2=0x7f4a6c06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:35.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 shutdown_connections 2023-10-06T02:51:35.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.769+0000 7f4a72534700 1 -- 172.21.15.81:0/1741561251 wait complete. 2023-10-06T02:51:35.875 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-06T02:51:35.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:51:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe62149a700 1 Processor -- start 2023-10-06T02:51:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe62149a700 1 -- start start 2023-10-06T02:51:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe62149a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c1578d0 0x7fe61c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe62149a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe61c06d120 0x7fe61c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe62149a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c06dac0 con 0x7fe61c157ca0 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe62149a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c0d07c0 con 0x7fe61c06d120 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe62149a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c0cfbb0 con 0x7fe61c1578d0 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe61b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe61c06d120 0x7fe61c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe61a7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe61c157ca0 0x7fe61c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35018/0 (socket says 172.21.15.81:35018) 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe61a7fc700 1 -- 172.21.15.81:0/1007883485 learned_addr learned my addr 172.21.15.81:0/1007883485 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe61affd700 1 --2- 172.21.15.81:0/1007883485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c1578d0 0x7fe61c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe61b7fe700 1 -- 172.21.15.81:0/1007883485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c1578d0 msgr2=0x7fe61c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe61b7fe700 1 --2- 172.21.15.81:0/1007883485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c1578d0 0x7fe61c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe61b7fe700 1 -- 172.21.15.81:0/1007883485 >> v1:172.21.15.81:6789/0 conn(0x7fe61c157ca0 legacy=0x7fe61c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe61b7fe700 1 -- 172.21.15.81:0/1007883485 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c0cfe90 con 0x7fe61c06d120 2023-10-06T02:51:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe619ffb700 1 -- 172.21.15.81:0/1007883485 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738479781 0 0) 0x7fe610001110 con 0x7fe61c157ca0 2023-10-06T02:51:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe61b7fe700 1 --2- 172.21.15.81:0/1007883485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 0x7fe61c06d580 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe614009e60 tx=0x7fe614009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527210c6b38fc80b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe619ffb700 1 -- 172.21.15.81:0/1007883485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400e070 con 0x7fe61c06d120 2023-10-06T02:51:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe619ffb700 1 -- 172.21.15.81:0/1007883485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61400bc30 con 0x7fe61c06d120 2023-10-06T02:51:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.988+0000 7fe619ffb700 1 -- 172.21.15.81:0/1007883485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614012430 con 0x7fe61c06d120 2023-10-06T02:51:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.989+0000 7fe62149a700 1 -- 172.21.15.81:0/1007883485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 msgr2=0x7fe61c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.989+0000 7fe62149a700 1 --2- 172.21.15.81:0/1007883485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 0x7fe61c06d580 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe614009e60 tx=0x7fe614009780 comp rx=0 tx=0).stop 2023-10-06T02:51:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.989+0000 7fe62149a700 1 -- 172.21.15.81:0/1007883485 shutdown_connections 2023-10-06T02:51:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.989+0000 7fe62149a700 1 --2- 172.21.15.81:0/1007883485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 0x7fe61c06d580 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.989+0000 7fe62149a700 1 --2- 172.21.15.81:0/1007883485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c1578d0 0x7fe61c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.989+0000 7fe62149a700 1 -- 172.21.15.81:0/1007883485 >> 172.21.15.81:0/1007883485 conn(0x7fe61c06bb90 msgr2=0x7fe61c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.989+0000 7fe62149a700 1 -- 172.21.15.81:0/1007883485 shutdown_connections 2023-10-06T02:51:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.989+0000 7fe62149a700 1 -- 172.21.15.81:0/1007883485 wait complete. 2023-10-06T02:51:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.990+0000 7fe62149a700 1 Processor -- start 2023-10-06T02:51:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.990+0000 7fe62149a700 1 -- start start 2023-10-06T02:51:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe62149a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 0x7fe61c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe62149a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c1578d0 0x7fe61c169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe62149a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c157ca0 0x7fe61c16a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe62149a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c16ae40 con 0x7fe61c06d120 2023-10-06T02:51:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe62149a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c159c10 con 0x7fe61c1578d0 2023-10-06T02:51:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe62149a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c16a7a0 con 0x7fe61c157ca0 2023-10-06T02:51:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 0x7fe61c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 0x7fe61c068a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33208/0 (socket says 172.21.15.81:33208) 2023-10-06T02:51:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61affd700 1 -- 172.21.15.81:0/3737042616 learned_addr learned my addr 172.21.15.81:0/3737042616 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61b7fe700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c157ca0 0x7fe61c16a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c1578d0 0x7fe61c169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61affd700 1 -- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c157ca0 msgr2=0x7fe61c16a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61affd700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c157ca0 0x7fe61c16a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61affd700 1 -- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c1578d0 msgr2=0x7fe61c169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61affd700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c1578d0 0x7fe61c169c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61affd700 1 -- 172.21.15.81:0/3737042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe614009a20 con 0x7fe61c06d120 2023-10-06T02:51:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61b7fe700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c157ca0 0x7fe61c16a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c1578d0 0x7fe61c169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.991+0000 7fe61affd700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 0x7fe61c068a40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00d890 tx=0x7fe60c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.992+0000 7fe602ffd700 1 -- 172.21.15.81:0/3737042616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00b600 con 0x7fe61c06d120 2023-10-06T02:51:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.992+0000 7fe602ffd700 1 -- 172.21.15.81:0/3737042616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c00b760 con 0x7fe61c06d120 2023-10-06T02:51:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.992+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c16aa80 con 0x7fe61c06d120 2023-10-06T02:51:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.992+0000 7fe602ffd700 1 -- 172.21.15.81:0/3737042616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00bae0 con 0x7fe61c06d120 2023-10-06T02:51:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.992+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c16b370 con 0x7fe61c06d120 2023-10-06T02:51:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.993+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c16b6e0 con 0x7fe61c06d120 2023-10-06T02:51:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.993+0000 7fe602ffd700 1 -- 172.21.15.81:0/3737042616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe60c01e460 con 0x7fe61c06d120 2023-10-06T02:51:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.993+0000 7fe602ffd700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.993+0000 7fe602ffd700 1 -- 172.21.15.81:0/3737042616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe60c084d70 con 0x7fe61c06d120 2023-10-06T02:51:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.994+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.994+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe608066f30 0x7fe6080693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe61c15a310 tx=0x7fe610009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:35.998+0000 7fe602ffd700 1 -- 172.21.15.81:0/3737042616 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe60c051e80 con 0x7fe61c06d120 2023-10-06T02:51:36.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.179+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe61c0d0170 con 0x7fe61c06d120 2023-10-06T02:51:36.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.180+0000 7fe602ffd700 1 -- 172.21.15.81:0/3737042616 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v108) v1 ==== 81+0+34777 (secure 0 0 0) 0x7fe60c0554a0 con 0x7fe61c06d120 2023-10-06T02:51:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:36.183 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:51:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 108, 2023-10-06T02:51:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:51:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:51:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:51:30.499203+0000", 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:51:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 14, 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:51:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:51:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:58.681047+0000", 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:51:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 14, 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:50:59.998500+0000", 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:51:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:51:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:51:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:51:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:51:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:51:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:51:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:51:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:51:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:51:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:51:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:51:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:51:36.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:36.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:51:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:51:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:36.255 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:36.256 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:36.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:51:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:51:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 99, 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:51:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:51:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:51:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:51:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:51:36.272 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:36.273 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:36.274 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:51:36.275 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:51:36.276 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:51:36.277 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:51:36.278 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:51:36.278 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:51:36.278 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:51:36.278 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:51:36.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:36.278 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:51:36.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe608066f30 msgr2=0x7fe6080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe608066f30 0x7fe6080693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe61c15a310 tx=0x7fe610009040 comp rx=0 tx=0).stop 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 msgr2=0x7fe61c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 0x7fe61c068a40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00d890 tx=0x7fe60c008040 comp rx=0 tx=0).stop 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 shutdown_connections 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe61c157ca0 0x7fe61c16a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe61c06d120 0x7fe61c068a40 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 --2- 172.21.15.81:0/3737042616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe61c1578d0 0x7fe61c169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 >> 172.21.15.81:0/3737042616 conn(0x7fe61c06bb90 msgr2=0x7fe61c15c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 shutdown_connections 2023-10-06T02:51:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.182+0000 7fe62149a700 1 -- 172.21.15.81:0/3737042616 wait complete. 2023-10-06T02:51:36.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.394+0000 7f068a7d5700 1 Processor -- start 2023-10-06T02:51:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.394+0000 7f068a7d5700 1 -- start start 2023-10-06T02:51:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f068a7d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06841578d0 0x7f06840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f068a7d5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f068406d120 0x7f068406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f068a7d5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06840d07c0 con 0x7f0684157ca0 2023-10-06T02:51:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f068a7d5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068406da50 con 0x7f06841578d0 2023-10-06T02:51:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f068a7d5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06840cfbb0 con 0x7f068406d120 2023-10-06T02:51:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f0683fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06841578d0 0x7f06840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f0683fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06841578d0 0x7f06840cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33220/0 (socket says 172.21.15.81:33220) 2023-10-06T02:51:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f0683fff700 1 -- 172.21.15.81:0/192832678 learned_addr learned my addr 172.21.15.81:0/192832678 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f0683fff700 1 -- 172.21.15.81:0/192832678 >> v2:172.21.15.83:3300/0 conn(0x7f068406d120 msgr2=0x7f068406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f0688d72700 1 --2- 172.21.15.81:0/192832678 >> v2:172.21.15.83:3300/0 conn(0x7f068406d120 0x7f068406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f0683fff700 1 --2- 172.21.15.81:0/192832678 >> v2:172.21.15.83:3300/0 conn(0x7f068406d120 0x7f068406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f0683fff700 1 -- 172.21.15.81:0/192832678 >> v1:172.21.15.83:6789/0 conn(0x7f0684157ca0 legacy=0x7f068415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.395+0000 7f0683fff700 1 -- 172.21.15.81:0/192832678 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840cfe90 con 0x7f06841578d0 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f0683fff700 1 --2- 172.21.15.81:0/192832678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 0x7f06840cf4f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0684068300 tx=0x7f0674009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c881f7da788845 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f0682ffd700 1 -- 172.21.15.81:0/192832678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067400b820 con 0x7f06841578d0 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f0682ffd700 1 -- 172.21.15.81:0/192832678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067400b980 con 0x7f06841578d0 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f0682ffd700 1 -- 172.21.15.81:0/192832678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067400bd20 con 0x7f06841578d0 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f068a7d5700 1 -- 172.21.15.81:0/192832678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 msgr2=0x7f06840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f068a7d5700 1 --2- 172.21.15.81:0/192832678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 0x7f06840cf4f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0684068300 tx=0x7f0674009250 comp rx=0 tx=0).stop 2023-10-06T02:51:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f068a7d5700 1 -- 172.21.15.81:0/192832678 shutdown_connections 2023-10-06T02:51:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f068a7d5700 1 --2- 172.21.15.81:0/192832678 >> v2:172.21.15.83:3300/0 conn(0x7f068406d120 0x7f068406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f068a7d5700 1 --2- 172.21.15.81:0/192832678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 0x7f06840cf4f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f068a7d5700 1 -- 172.21.15.81:0/192832678 >> 172.21.15.81:0/192832678 conn(0x7f068406bb90 msgr2=0x7f068406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f068a7d5700 1 -- 172.21.15.81:0/192832678 shutdown_connections 2023-10-06T02:51:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.396+0000 7f068a7d5700 1 -- 172.21.15.81:0/192832678 wait complete. 2023-10-06T02:51:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.397+0000 7f068a7d5700 1 Processor -- start 2023-10-06T02:51:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.398+0000 7f068a7d5700 1 -- start start 2023-10-06T02:51:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.398+0000 7f068a7d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068406d120 0x7f06840c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.398+0000 7f068a7d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 0x7f06840c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.398+0000 7f068a7d5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0684157ca0 0x7f068416ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.398+0000 7f068a7d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06840c6b10 con 0x7f06841578d0 2023-10-06T02:51:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.398+0000 7f068a7d5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06840c5f00 con 0x7f0684157ca0 2023-10-06T02:51:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.398+0000 7f068a7d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06840c61e0 con 0x7f068406d120 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.398+0000 7f06837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 0x7f06840c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f06837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 0x7f06840c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33230/0 (socket says 172.21.15.81:33230) 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f06837fe700 1 -- 172.21.15.81:0/3174544661 learned_addr learned my addr 172.21.15.81:0/3174544661 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f0683fff700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068406d120 0x7f06840c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f0688d72700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0684157ca0 0x7f068416ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f06837fe700 1 -- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068406d120 msgr2=0x7f06840c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f06837fe700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068406d120 0x7f06840c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f06837fe700 1 -- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0684157ca0 msgr2=0x7f068416ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f06837fe700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0684157ca0 0x7f068416ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f06837fe700 1 -- 172.21.15.81:0/3174544661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06740094f0 con 0x7f06841578d0 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f06837fe700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 0x7f06840c8050 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f067800b5e0 tx=0x7f06780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f066bfff700 1 -- 172.21.15.81:0/3174544661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800f510 con 0x7f06841578d0 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f066bfff700 1 -- 172.21.15.81:0/3174544661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067800f6b0 con 0x7f06841578d0 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06840c64c0 con 0x7f06841578d0 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f066bfff700 1 -- 172.21.15.81:0/3174544661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800fa70 con 0x7f06841578d0 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.399+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06840c8800 con 0x7f06841578d0 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.400+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06840c6c80 con 0x7f06841578d0 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.400+0000 7f066bfff700 1 -- 172.21.15.81:0/3174544661 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f067801a400 con 0x7f06841578d0 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.401+0000 7f066bfff700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0670066f30 0x7f06700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.401+0000 7f066bfff700 1 -- 172.21.15.81:0/3174544661 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0678084010 con 0x7f06841578d0 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.401+0000 7f0683fff700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0670066f30 0x7f06700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.401+0000 7f0683fff700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0670066f30 0x7f06700693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0684068300 tx=0x7f0674016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.405+0000 7f066bfff700 1 -- 172.21.15.81:0/3174544661 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06780511a0 con 0x7f06841578d0 2023-10-06T02:51:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.627+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06840d0170 con 0x7f06841578d0 2023-10-06T02:51:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.629+0000 7f066bfff700 1 -- 172.21.15.81:0/3174544661 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f06780091f0 con 0x7f06841578d0 2023-10-06T02:51:36.631 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:36.631 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:01.019609+0000","modified":"2023-10-06T02:51:04.689923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/907018385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":907018385},{"type":"v1","addr":"172.21.15.81:6835","nonce":907018385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:51:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0670066f30 msgr2=0x7f06700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0670066f30 0x7f06700693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0684068300 tx=0x7f0674016000 comp rx=0 tx=0).stop 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 msgr2=0x7f06840c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 0x7f06840c8050 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f067800b5e0 tx=0x7f06780090f0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 shutdown_connections 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0670066f30 0x7f06700693e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0684157ca0 0x7f068416ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068406d120 0x7f06840c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 --2- 172.21.15.81:0/3174544661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06841578d0 0x7f06840c8050 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 >> 172.21.15.81:0/3174544661 conn(0x7f068406bb90 msgr2=0x7f0684069d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 shutdown_connections 2023-10-06T02:51:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:36.631+0000 7f068a7d5700 1 -- 172.21.15.81:0/3174544661 wait complete. 2023-10-06T02:51:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-06T02:51:36.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:51:36.777 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":6465,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.095984448999999,"mdsmap_epoch":52,"osdmap_epoch":108,"osdmap_epoch_barrier":104,"uptime":47.288630576999999} 2023-10-06T02:51:36.777 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 6465, "mdsmap_epoch": 52, "osdmap_epoch": 108, "osdmap_epoch_barrier": 104, "rank_uptime": 35.095984449, "state": "up:active", "uptime": 47.288630577, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:51:36.777 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:51:36.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:51:36.777 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-06T02:51:37.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:51:37.009 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:51:37.051 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-06T02:51:37.051 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-06T02:51:37.051 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.256562 s, 204 MB/s 2023-10-06T02:51:37.051 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:51:37.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:51:37.161 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:51:37.200 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:51:37.201 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:51:37.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:51:37.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:51:37.275 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:51:37.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:37.275 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:51:37.289 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:51:37.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:51:37.290 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:51:37.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:51:37.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:51:37.333 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:51:37.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.500+0000 7f54b07fc700 1 Processor -- start 2023-10-06T02:51:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.500+0000 7f54b07fc700 1 -- start start 2023-10-06T02:51:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.501+0000 7f54b07fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a81578d0 0x7f54a80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.501+0000 7f54b07fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f54a8157ca0 0x7f54a815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.501+0000 7f54b07fc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a80d07c0 con 0x7f54a806d120 2023-10-06T02:51:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.501+0000 7f54b07fc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a80cfbb0 con 0x7f54a8157ca0 2023-10-06T02:51:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.501+0000 7f54b07fc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80cfe90 con 0x7f54a81578d0 2023-10-06T02:51:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ae598700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a81578d0 0x7f54a80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54add97700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f54a8157ca0 0x7f54a815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ae598700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a81578d0 0x7f54a80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:33930/0 (socket says 172.21.15.81:33930) 2023-10-06T02:51:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ae598700 1 -- 172.21.15.81:0/3835149207 learned_addr learned my addr 172.21.15.81:0/3835149207 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ae598700 1 -- 172.21.15.81:0/3835149207 >> v2:172.21.15.83:3300/0 conn(0x7f54a8157ca0 msgr2=0x7f54a815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ae598700 1 --2- 172.21.15.81:0/3835149207 >> v2:172.21.15.83:3300/0 conn(0x7f54a8157ca0 0x7f54a815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ae598700 1 -- 172.21.15.81:0/3835149207 >> v1:172.21.15.83:6789/0 conn(0x7f54a806d120 legacy=0x7f54a815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ae598700 1 -- 172.21.15.81:0/3835149207 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a80d0170 con 0x7f54a81578d0 2023-10-06T02:51:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54add97700 1 --2- 172.21.15.81:0/3835149207 >> v2:172.21.15.83:3300/0 conn(0x7f54a8157ca0 0x7f54a815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ae598700 1 --2- 172.21.15.81:0/3835149207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a81578d0 0x7f54a80cf4f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f54a40099b0 tx=0x7f54a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bbd345c167d38d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ad596700 1 -- 172.21.15.81:0/3835149207 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4009ea0 con 0x7f54a81578d0 2023-10-06T02:51:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ad596700 1 -- 172.21.15.81:0/3835149207 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400b860 con 0x7f54a81578d0 2023-10-06T02:51:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.502+0000 7f54ad596700 1 -- 172.21.15.81:0/3835149207 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400bc00 con 0x7f54a81578d0 2023-10-06T02:51:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.503+0000 7f54b07fc700 1 -- 172.21.15.81:0/3835149207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a81578d0 msgr2=0x7f54a80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.503+0000 7f54b07fc700 1 --2- 172.21.15.81:0/3835149207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a81578d0 0x7f54a80cf4f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f54a40099b0 tx=0x7f54a4009250 comp rx=0 tx=0).stop 2023-10-06T02:51:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.503+0000 7f54b07fc700 1 -- 172.21.15.81:0/3835149207 shutdown_connections 2023-10-06T02:51:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.503+0000 7f54b07fc700 1 --2- 172.21.15.81:0/3835149207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a81578d0 0x7f54a80cf4f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.503+0000 7f54b07fc700 1 --2- 172.21.15.81:0/3835149207 >> v2:172.21.15.83:3300/0 conn(0x7f54a8157ca0 0x7f54a815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.503+0000 7f54b07fc700 1 -- 172.21.15.81:0/3835149207 >> 172.21.15.81:0/3835149207 conn(0x7f54a806bb90 msgr2=0x7f54a806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.503+0000 7f54b07fc700 1 -- 172.21.15.81:0/3835149207 shutdown_connections 2023-10-06T02:51:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.503+0000 7f54b07fc700 1 -- 172.21.15.81:0/3835149207 wait complete. 2023-10-06T02:51:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.504+0000 7f54b07fc700 1 Processor -- start 2023-10-06T02:51:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.504+0000 7f54b07fc700 1 -- start start 2023-10-06T02:51:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54b07fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a806d120 0x7f54a8154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54b07fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54a81578d0 0x7f54a80ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54b07fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8157ca0 0x7f54a816b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54b07fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80b1510 con 0x7f54a8157ca0 2023-10-06T02:51:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54b07fc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a81550d0 con 0x7f54a81578d0 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54b07fc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80b0890 con 0x7f54a806d120 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54aed99700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8157ca0 0x7f54a816b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54aed99700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8157ca0 0x7f54a816b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33246/0 (socket says 172.21.15.81:33246) 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54aed99700 1 -- 172.21.15.81:0/2893714590 learned_addr learned my addr 172.21.15.81:0/2893714590 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54ae598700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a806d120 0x7f54a8154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54add97700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54a81578d0 0x7f54a80ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54aed99700 1 -- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a806d120 msgr2=0x7f54a8154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54aed99700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a806d120 0x7f54a8154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54aed99700 1 -- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54a81578d0 msgr2=0x7f54a80ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54aed99700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54a81578d0 0x7f54a80ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.505+0000 7f54aed99700 1 -- 172.21.15.81:0/2893714590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5498009420 con 0x7f54a8157ca0 2023-10-06T02:51:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.506+0000 7f54aed99700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8157ca0 0x7f54a816b1e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c910 tx=0x7f54a0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.506+0000 7f549e7fc700 1 -- 172.21.15.81:0/2893714590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0012630 con 0x7f54a8157ca0 2023-10-06T02:51:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.506+0000 7f549e7fc700 1 -- 172.21.15.81:0/2893714590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a0012790 con 0x7f54a8157ca0 2023-10-06T02:51:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.506+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a40094f0 con 0x7f54a8157ca0 2023-10-06T02:51:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.506+0000 7f549e7fc700 1 -- 172.21.15.81:0/2893714590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0012b50 con 0x7f54a8157ca0 2023-10-06T02:51:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.506+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a80b0e50 con 0x7f54a8157ca0 2023-10-06T02:51:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.507+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a8067ac0 con 0x7f54a8157ca0 2023-10-06T02:51:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.507+0000 7f549e7fc700 1 -- 172.21.15.81:0/2893714590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54a001a3a0 con 0x7f54a8157ca0 2023-10-06T02:51:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.507+0000 7f549e7fc700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f548c066f30 0x7f548c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.507+0000 7f549e7fc700 1 -- 172.21.15.81:0/2893714590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f54a0084880 con 0x7f54a8157ca0 2023-10-06T02:51:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.508+0000 7f54ae598700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f548c066f30 0x7f548c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.508+0000 7f54ae598700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f548c066f30 0x7f548c0693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f54a40099b0 tx=0x7f54a4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.512+0000 7f549e7fc700 1 -- 172.21.15.81:0/2893714590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54a0055420 con 0x7f54a8157ca0 2023-10-06T02:51:37.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.738+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54a80d0450 con 0x7f54a8157ca0 2023-10-06T02:51:37.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.738+0000 7f549e7fc700 1 -- 172.21.15.81:0/2893714590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f54a0054fb0 con 0x7f54a8157ca0 2023-10-06T02:51:37.740 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:37.740 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:01.019609+0000","modified":"2023-10-06T02:51:04.689923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/907018385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":907018385},{"type":"v1","addr":"172.21.15.81:6835","nonce":907018385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:51:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f548c066f30 msgr2=0x7f548c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f548c066f30 0x7f548c0693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f54a40099b0 tx=0x7f54a4017000 comp rx=0 tx=0).stop 2023-10-06T02:51:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8157ca0 msgr2=0x7f54a816b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8157ca0 0x7f54a816b1e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c910 tx=0x7f54a0001710 comp rx=0 tx=0).stop 2023-10-06T02:51:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 shutdown_connections 2023-10-06T02:51:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8157ca0 0x7f54a816b1e0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54a806d120 0x7f54a8154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f548c066f30 0x7f548c0693e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 --2- 172.21.15.81:0/2893714590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54a81578d0 0x7f54a80ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 >> 172.21.15.81:0/2893714590 conn(0x7f54a806bb90 msgr2=0x7f54a81568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:37.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 shutdown_connections 2023-10-06T02:51:37.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.740+0000 7f54b07fc700 1 -- 172.21.15.81:0/2893714590 wait complete. 2023-10-06T02:51:37.743 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-06T02:51:37.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.866+0000 7f55c4e8b700 1 Processor -- start 2023-10-06T02:51:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.866+0000 7f55c4e8b700 1 -- start start 2023-10-06T02:51:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55c4e8b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f55c0159b40 0x7f55c00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55c4e8b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0068e90 0x7f55c00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55c4e8b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c00cee10 con 0x7f55c0159f10 2023-10-06T02:51:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55c4e8b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c00cd040 con 0x7f55c0159b40 2023-10-06T02:51:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55c4e8b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c00cd320 con 0x7f55c0068e90 2023-10-06T02:51:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55bf7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f55c0159b40 0x7f55c00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55bffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0068e90 0x7f55c00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55beffd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f55c0159f10 0x7f55c0068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:58264/0 (socket says 172.21.15.81:58264) 2023-10-06T02:51:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55bffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0068e90 0x7f55c00cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:33954/0 (socket says 172.21.15.81:33954) 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55beffd700 1 -- 172.21.15.81:0/507666708 learned_addr learned my addr 172.21.15.81:0/507666708 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.867+0000 7f55bf7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f55c0159b40 0x7f55c00cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:57534/0 (socket says 172.21.15.81:57534) 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55bffff700 1 -- 172.21.15.81:0/507666708 >> v2:172.21.15.83:3300/0 conn(0x7f55c0159b40 msgr2=0x7f55c00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55bffff700 1 --2- 172.21.15.81:0/507666708 >> v2:172.21.15.83:3300/0 conn(0x7f55c0159b40 0x7f55c00cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55bffff700 1 -- 172.21.15.81:0/507666708 >> v1:172.21.15.83:6789/0 conn(0x7f55c0159f10 legacy=0x7f55c0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55bffff700 1 -- 172.21.15.81:0/507666708 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c00ce7c0 con 0x7f55c0068e90 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55bffff700 1 --2- 172.21.15.81:0/507666708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0068e90 0x7f55c00cf2a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55b80098e0 tx=0x7f55b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac447a94d6886bf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55be7fc700 1 -- 172.21.15.81:0/507666708 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b800b640 con 0x7f55c0068e90 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55be7fc700 1 -- 172.21.15.81:0/507666708 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b800b7a0 con 0x7f55c0068e90 2023-10-06T02:51:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55be7fc700 1 -- 172.21.15.81:0/507666708 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b800bb40 con 0x7f55c0068e90 2023-10-06T02:51:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55c4e8b700 1 -- 172.21.15.81:0/507666708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0068e90 msgr2=0x7f55c00cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55c4e8b700 1 --2- 172.21.15.81:0/507666708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0068e90 0x7f55c00cf2a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55b80098e0 tx=0x7f55b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55c4e8b700 1 -- 172.21.15.81:0/507666708 shutdown_connections 2023-10-06T02:51:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55c4e8b700 1 --2- 172.21.15.81:0/507666708 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0068e90 0x7f55c00cf2a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55c4e8b700 1 --2- 172.21.15.81:0/507666708 >> v2:172.21.15.83:3300/0 conn(0x7f55c0159b40 0x7f55c00cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.868+0000 7f55c4e8b700 1 -- 172.21.15.81:0/507666708 >> 172.21.15.81:0/507666708 conn(0x7f55c00cd660 msgr2=0x7f55c00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:37.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.869+0000 7f55c4e8b700 1 -- 172.21.15.81:0/507666708 shutdown_connections 2023-10-06T02:51:37.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.869+0000 7f55c4e8b700 1 -- 172.21.15.81:0/507666708 wait complete. 2023-10-06T02:51:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.870+0000 7f55c4e8b700 1 Processor -- start 2023-10-06T02:51:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.870+0000 7f55c4e8b700 1 -- start start 2023-10-06T02:51:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.870+0000 7f55c4e8b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c0068e90 0x7f55c0147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.870+0000 7f55c4e8b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0159b40 0x7f55c01556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.870+0000 7f55c4e8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0159f10 0x7f55c0155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.870+0000 7f55c4e8b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0159070 con 0x7f55c0159f10 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.870+0000 7f55c4e8b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c01587d0 con 0x7f55c0068e90 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.870+0000 7f55c4e8b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0158ab0 con 0x7f55c0159b40 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0159f10 0x7f55c0155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0159f10 0x7f55c0155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33258/0 (socket says 172.21.15.81:33258) 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bffff700 1 -- 172.21.15.81:0/4053498535 learned_addr learned my addr 172.21.15.81:0/4053498535 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bf7fe700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c0068e90 0x7f55c0147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55beffd700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0159b40 0x7f55c01556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bffff700 1 -- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0159b40 msgr2=0x7f55c01556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bffff700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0159b40 0x7f55c01556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bffff700 1 -- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c0068e90 msgr2=0x7f55c0147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bffff700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c0068e90 0x7f55c0147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bffff700 1 -- 172.21.15.81:0/4053498535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b8009420 con 0x7f55c0159f10 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55bffff700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0159f10 0x7f55c0155be0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f55b8013000 tx=0x7f55b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55a77fe700 1 -- 172.21.15.81:0/4053498535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8011420 con 0x7f55c0159f10 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c0158d90 con 0x7f55c0159f10 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55a77fe700 1 -- 172.21.15.81:0/4053498535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b8011580 con 0x7f55c0159f10 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55a77fe700 1 -- 172.21.15.81:0/4053498535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8011940 con 0x7f55c0159f10 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.871+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c0147b50 con 0x7f55c0159f10 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.872+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c00c8fe0 con 0x7f55c0159f10 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.872+0000 7f55a77fe700 1 -- 172.21.15.81:0/4053498535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55b8011cb0 con 0x7f55c0159f10 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.873+0000 7f55a77fe700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55ac066f30 0x7f55ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.873+0000 7f55a77fe700 1 -- 172.21.15.81:0/4053498535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f55b8086260 con 0x7f55c0159f10 2023-10-06T02:51:37.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.873+0000 7f55bf7fe700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55ac066f30 0x7f55ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:37.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.873+0000 7f55bf7fe700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55ac066f30 0x7f55ac0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f55b000f570 tx=0x7f55b000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:37.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:37.877+0000 7f55a77fe700 1 -- 172.21.15.81:0/4053498535 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55c00c8fe0 con 0x7f55c0159f10 2023-10-06T02:51:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.059+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55c00c8fe0 con 0x7f55c0159f10 2023-10-06T02:51:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.059+0000 7f55a77fe700 1 -- 172.21.15.81:0/4053498535 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16826 (secure 0 0 0) 0x7f55c00c8fe0 con 0x7f55c0159f10 2023-10-06T02:51:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:38.061 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":108,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:30.499203+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:50:58.681047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T02:50:59.998500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.061+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55ac066f30 msgr2=0x7f55ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.061+0000 7f55c4e8b700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55ac066f30 0x7f55ac0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f55b000f570 tx=0x7f55b000b040 comp rx=0 tx=0).stop 2023-10-06T02:51:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.061+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0159f10 msgr2=0x7f55c0155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.061+0000 7f55c4e8b700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0159f10 0x7f55c0155be0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f55b8013000 tx=0x7f55b8017000 comp rx=0 tx=0).stop 2023-10-06T02:51:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.062+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 shutdown_connections 2023-10-06T02:51:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.062+0000 7f55c4e8b700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0159f10 0x7f55c0155be0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.062+0000 7f55c4e8b700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55ac066f30 0x7f55ac0693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.062+0000 7f55c4e8b700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c0068e90 0x7f55c0147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.062+0000 7f55c4e8b700 1 --2- 172.21.15.81:0/4053498535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c0159b40 0x7f55c01556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.062+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 >> 172.21.15.81:0/4053498535 conn(0x7f55c00cd660 msgr2=0x7f55c006e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.062+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 shutdown_connections 2023-10-06T02:51:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.062+0000 7f55c4e8b700 1 -- 172.21.15.81:0/4053498535 wait complete. 2023-10-06T02:51:38.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:50:58.681047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:50:59.998500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:51:38.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:51:38.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.192+0000 7fa28c9a6700 1 Processor -- start 2023-10-06T02:51:38.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.192+0000 7fa28c9a6700 1 -- start start 2023-10-06T02:51:38.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa28c9a6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2880d0b80 0x7fa2880cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa28c9a6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa2880d02b0 0x7fa28806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa28c9a6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2880cf2d0 con 0x7fa2880d0f50 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa28c9a6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28815a690 con 0x7fa2880d0b80 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa28c9a6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28806dc00 con 0x7fa2880d02b0 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa2877fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2880d0b80 0x7fa2880cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa287fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa2880d0f50 0x7fa28815b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35022/0 (socket says 172.21.15.81:35022) 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa287fff700 1 -- 172.21.15.81:0/2759081758 learned_addr learned my addr 172.21.15.81:0/2759081758 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa286ffd700 1 --2- 172.21.15.81:0/2759081758 >> v2:172.21.15.83:3300/0 conn(0x7fa2880d02b0 0x7fa28806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa2877fe700 1 -- 172.21.15.81:0/2759081758 >> v2:172.21.15.83:3300/0 conn(0x7fa2880d02b0 msgr2=0x7fa28806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa2877fe700 1 --2- 172.21.15.81:0/2759081758 >> v2:172.21.15.83:3300/0 conn(0x7fa2880d02b0 0x7fa28806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa2877fe700 1 -- 172.21.15.81:0/2759081758 >> v1:172.21.15.81:6789/0 conn(0x7fa2880d0f50 legacy=0x7fa28815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa2867fc700 1 -- 172.21.15.81:0/2759081758 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948865017 0 0) 0x7fa2880cf2d0 con 0x7fa2880d0f50 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa2877fe700 1 -- 172.21.15.81:0/2759081758 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880cf570 con 0x7fa2880d0b80 2023-10-06T02:51:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa2877fe700 1 --2- 172.21.15.81:0/2759081758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d0b80 0x7fa2880cfd70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa2880ce9b0 tx=0x7fa278009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa59c2e94cb3a6ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.193+0000 7fa2867fc700 1 -- 172.21.15.81:0/2759081758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800e070 con 0x7fa2880d0b80 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa2867fc700 1 -- 172.21.15.81:0/2759081758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800bc30 con 0x7fa2880d0b80 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa2867fc700 1 -- 172.21.15.81:0/2759081758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278012430 con 0x7fa2880d0b80 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa28c9a6700 1 -- 172.21.15.81:0/2759081758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d0b80 msgr2=0x7fa2880cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa28c9a6700 1 --2- 172.21.15.81:0/2759081758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d0b80 0x7fa2880cfd70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa2880ce9b0 tx=0x7fa278009780 comp rx=0 tx=0).stop 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa28c9a6700 1 -- 172.21.15.81:0/2759081758 shutdown_connections 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa28c9a6700 1 --2- 172.21.15.81:0/2759081758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d0b80 0x7fa2880cfd70 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa28c9a6700 1 --2- 172.21.15.81:0/2759081758 >> v2:172.21.15.83:3300/0 conn(0x7fa2880d02b0 0x7fa28806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa28c9a6700 1 -- 172.21.15.81:0/2759081758 >> 172.21.15.81:0/2759081758 conn(0x7fa288063230 msgr2=0x7fa288063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa28c9a6700 1 -- 172.21.15.81:0/2759081758 shutdown_connections 2023-10-06T02:51:38.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.194+0000 7fa28c9a6700 1 -- 172.21.15.81:0/2759081758 wait complete. 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.195+0000 7fa28c9a6700 1 Processor -- start 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.195+0000 7fa28c9a6700 1 -- start start 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa28c9a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d02b0 0x7fa28814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa28c9a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880d0b80 0x7fa288151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa28c9a6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880d0f50 0x7fa288068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa28c9a6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2881541a0 con 0x7fa2880d02b0 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa28c9a6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa288153590 con 0x7fa2880d0f50 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa28c9a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa288153870 con 0x7fa2880d0b80 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa2877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d02b0 0x7fa28814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa2877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d02b0 0x7fa28814e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33278/0 (socket says 172.21.15.81:33278) 2023-10-06T02:51:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa2877fe700 1 -- 172.21.15.81:0/868378297 learned_addr learned my addr 172.21.15.81:0/868378297 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa286ffd700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880d0b80 0x7fa288151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa287fff700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880d0f50 0x7fa288068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa2877fe700 1 -- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880d0b80 msgr2=0x7fa288151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa2877fe700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880d0b80 0x7fa288151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa2877fe700 1 -- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880d0f50 msgr2=0x7fa288068b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa2877fe700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880d0f50 0x7fa288068b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa2877fe700 1 -- 172.21.15.81:0/868378297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278009a20 con 0x7fa2880d02b0 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.196+0000 7fa286ffd700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880d0b80 0x7fa288151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.197+0000 7fa2877fe700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d02b0 0x7fa28814e680 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa278013000 tx=0x7fa278019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.197+0000 7fa26f7fe700 1 -- 172.21.15.81:0/868378297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278001090 con 0x7fa2880d02b0 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.197+0000 7fa26f7fe700 1 -- 172.21.15.81:0/868378297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa278012e20 con 0x7fa2880d02b0 2023-10-06T02:51:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.197+0000 7fa26f7fe700 1 -- 172.21.15.81:0/868378297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27801d860 con 0x7fa2880d02b0 2023-10-06T02:51:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.197+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa288153b50 con 0x7fa2880d02b0 2023-10-06T02:51:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.197+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28814ebc0 con 0x7fa2880d02b0 2023-10-06T02:51:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.198+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2880676e0 con 0x7fa2880d02b0 2023-10-06T02:51:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.198+0000 7fa26f7fe700 1 -- 172.21.15.81:0/868378297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa278024070 con 0x7fa2880d02b0 2023-10-06T02:51:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.199+0000 7fa26f7fe700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa274066f30 0x7fa2740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.199+0000 7fa26f7fe700 1 -- 172.21.15.81:0/868378297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa278086db0 con 0x7fa2880d02b0 2023-10-06T02:51:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.199+0000 7fa286ffd700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa274066f30 0x7fa2740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.199+0000 7fa286ffd700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa274066f30 0x7fa2740693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa288151920 tx=0x7fa27c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.203+0000 7fa26f7fe700 1 -- 172.21.15.81:0/868378297 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa278053ec0 con 0x7fa2880d02b0 2023-10-06T02:51:38.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.383+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2880cf850 con 0x7fa2880d02b0 2023-10-06T02:51:38.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.383+0000 7fa26f7fe700 1 -- 172.21.15.81:0/868378297 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa27802c0a0 con 0x7fa2880d02b0 2023-10-06T02:51:38.384 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:51:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa274066f30 msgr2=0x7fa2740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa274066f30 0x7fa2740693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa288151920 tx=0x7fa27c008040 comp rx=0 tx=0).stop 2023-10-06T02:51:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d02b0 msgr2=0x7fa28814e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d02b0 0x7fa28814e680 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa278013000 tx=0x7fa278019000 comp rx=0 tx=0).stop 2023-10-06T02:51:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 shutdown_connections 2023-10-06T02:51:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa274066f30 0x7fa2740693e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880d0f50 0x7fa288068b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2880d02b0 0x7fa28814e680 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 --2- 172.21.15.81:0/868378297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880d0b80 0x7fa288151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 >> 172.21.15.81:0/868378297 conn(0x7fa288063230 msgr2=0x7fa2880b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 shutdown_connections 2023-10-06T02:51:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.385+0000 7fa28c9a6700 1 -- 172.21.15.81:0/868378297 wait complete. 2023-10-06T02:51:38.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:51:38.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.513+0000 7f9a4b1d2700 1 Processor -- start 2023-10-06T02:51:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.513+0000 7f9a4b1d2700 1 -- start start 2023-10-06T02:51:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a4b1d2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 0x7f9a440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a4b1d2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a44157ca0 0x7f9a4415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a4b1d2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9a4406d120 0x7f9a4406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a4b1d2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4406dac0 con 0x7f9a44157ca0 2023-10-06T02:51:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a4b1d2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a440d07c0 con 0x7f9a4406d120 2023-10-06T02:51:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a4b1d2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440cfbb0 con 0x7f9a441578d0 2023-10-06T02:51:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a3bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a44157ca0 0x7f9a4415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a3bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a44157ca0 0x7f9a4415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33282/0 (socket says 172.21.15.81:33282) 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a3bfff700 1 -- 172.21.15.81:0/2712555289 learned_addr learned my addr 172.21.15.81:0/2712555289 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a4976f700 1 --2- 172.21.15.81:0/2712555289 >> v2:172.21.15.83:3300/0 conn(0x7f9a4406d120 0x7f9a4406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a48f6e700 1 --2- 172.21.15.81:0/2712555289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 0x7f9a440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a3bfff700 1 -- 172.21.15.81:0/2712555289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 msgr2=0x7f9a440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a3bfff700 1 --2- 172.21.15.81:0/2712555289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 0x7f9a440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a3bfff700 1 -- 172.21.15.81:0/2712555289 >> v2:172.21.15.83:3300/0 conn(0x7f9a4406d120 msgr2=0x7f9a4406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.514+0000 7f9a3bfff700 1 --2- 172.21.15.81:0/2712555289 >> v2:172.21.15.83:3300/0 conn(0x7f9a4406d120 0x7f9a4406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a3bfff700 1 -- 172.21.15.81:0/2712555289 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a440cfe90 con 0x7f9a44157ca0 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4976f700 1 --2- 172.21.15.81:0/2712555289 >> v2:172.21.15.83:3300/0 conn(0x7f9a4406d120 0x7f9a4406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a3bfff700 1 --2- 172.21.15.81:0/2712555289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a44157ca0 0x7f9a4415af00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9a440b3940 tx=0x7f9a34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0401b12e065a089 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a3b7fe700 1 -- 172.21.15.81:0/2712555289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400b860 con 0x7f9a44157ca0 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a3b7fe700 1 -- 172.21.15.81:0/2712555289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3400b9c0 con 0x7f9a44157ca0 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a3b7fe700 1 -- 172.21.15.81:0/2712555289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400bd60 con 0x7f9a44157ca0 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/2712555289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a44157ca0 msgr2=0x7f9a4415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/2712555289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a44157ca0 0x7f9a4415af00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9a440b3940 tx=0x7f9a34009250 comp rx=0 tx=0).stop 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/2712555289 shutdown_connections 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/2712555289 >> v2:172.21.15.83:3300/0 conn(0x7f9a4406d120 0x7f9a4406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/2712555289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 0x7f9a440cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/2712555289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a44157ca0 0x7f9a4415af00 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/2712555289 >> 172.21.15.81:0/2712555289 conn(0x7f9a4406bb90 msgr2=0x7f9a4406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/2712555289 shutdown_connections 2023-10-06T02:51:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.515+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/2712555289 wait complete. 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.516+0000 7f9a4b1d2700 1 Processor -- start 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a4b1d2700 1 -- start start 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a4b1d2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4406d120 0x7f9a44148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a4b1d2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 0x7f9a441580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a4b1d2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a44157ca0 0x7f9a441585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a4b1d2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4416a580 con 0x7f9a4406d120 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a4b1d2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440c5b20 con 0x7f9a44157ca0 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a4b1d2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440c5d70 con 0x7f9a441578d0 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a48f6e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4406d120 0x7f9a44148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a48f6e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4406d120 0x7f9a44148790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33296/0 (socket says 172.21.15.81:33296) 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.517+0000 7f9a48f6e700 1 -- 172.21.15.81:0/57984895 learned_addr learned my addr 172.21.15.81:0/57984895 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a3bfff700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 0x7f9a441580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a4976f700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a44157ca0 0x7f9a441585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a48f6e700 1 -- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 msgr2=0x7f9a441580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a48f6e700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 0x7f9a441580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a48f6e700 1 -- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a44157ca0 msgr2=0x7f9a441585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a48f6e700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a44157ca0 0x7f9a441585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a48f6e700 1 -- 172.21.15.81:0/57984895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a340094f0 con 0x7f9a4406d120 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a48f6e700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4406d120 0x7f9a44148790 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000d890 tx=0x7f9a40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a38ff9700 1 -- 172.21.15.81:0/57984895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a400125f0 con 0x7f9a4406d120 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a38ff9700 1 -- 172.21.15.81:0/57984895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a40012750 con 0x7f9a4406d120 2023-10-06T02:51:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a440c6050 con 0x7f9a4406d120 2023-10-06T02:51:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a38ff9700 1 -- 172.21.15.81:0/57984895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40012af0 con 0x7f9a4406d120 2023-10-06T02:51:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.518+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a440c6610 con 0x7f9a4406d120 2023-10-06T02:51:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.519+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a440c6980 con 0x7f9a4406d120 2023-10-06T02:51:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.519+0000 7f9a38ff9700 1 -- 172.21.15.81:0/57984895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a4001e460 con 0x7f9a4406d120 2023-10-06T02:51:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.520+0000 7f9a38ff9700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a30066f30 0x7f9a300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.520+0000 7f9a38ff9700 1 -- 172.21.15.81:0/57984895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a40084c50 con 0x7f9a4406d120 2023-10-06T02:51:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.520+0000 7f9a3bfff700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a30066f30 0x7f9a300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.520+0000 7f9a3bfff700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a30066f30 0x7f9a300693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9a440b3940 tx=0x7f9a34017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.524+0000 7f9a38ff9700 1 -- 172.21.15.81:0/57984895 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a4008a020 con 0x7f9a4406d120 2023-10-06T02:51:38.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.705+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a440d0170 con 0x7f9a4406d120 2023-10-06T02:51:38.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.706+0000 7f9a38ff9700 1 -- 172.21.15.81:0/57984895 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a400557f0 con 0x7f9a4406d120 2023-10-06T02:51:38.707 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:51:38.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a30066f30 msgr2=0x7f9a300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a30066f30 0x7f9a300693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9a440b3940 tx=0x7f9a34017000 comp rx=0 tx=0).stop 2023-10-06T02:51:38.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4406d120 msgr2=0x7f9a44148790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4406d120 0x7f9a44148790 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000d890 tx=0x7f9a40008040 comp rx=0 tx=0).stop 2023-10-06T02:51:38.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 shutdown_connections 2023-10-06T02:51:38.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a30066f30 0x7f9a300693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a44157ca0 0x7f9a441585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4406d120 0x7f9a44148790 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 --2- 172.21.15.81:0/57984895 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a441578d0 0x7f9a441580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 >> 172.21.15.81:0/57984895 conn(0x7f9a4406bb90 msgr2=0x7f9a44154720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:38.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 shutdown_connections 2023-10-06T02:51:38.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.708+0000 7f9a4b1d2700 1 -- 172.21.15.81:0/57984895 wait complete. 2023-10-06T02:51:38.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:51:38.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.836+0000 7f19f4bdd700 1 Processor -- start 2023-10-06T02:51:38.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.836+0000 7f19f4bdd700 1 -- start start 2023-10-06T02:51:38.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19f4bdd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f19f01578d0 0x7f19f00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19f4bdd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19f006d120 0x7f19f006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19f4bdd700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f00d07c0 con 0x7f19f0157ca0 2023-10-06T02:51:38.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19f4bdd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f006da50 con 0x7f19f006d120 2023-10-06T02:51:38.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19f4bdd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f00cfbb0 con 0x7f19f01578d0 2023-10-06T02:51:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19eed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19f006d120 0x7f19f006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19eed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19f006d120 0x7f19f006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33302/0 (socket says 172.21.15.81:33302) 2023-10-06T02:51:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19eed9d700 1 -- 172.21.15.81:0/117986980 learned_addr learned my addr 172.21.15.81:0/117986980 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19ee59c700 1 --2- 172.21.15.81:0/117986980 >> v2:172.21.15.83:3300/0 conn(0x7f19f01578d0 0x7f19f00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19eed9d700 1 -- 172.21.15.81:0/117986980 >> v2:172.21.15.83:3300/0 conn(0x7f19f01578d0 msgr2=0x7f19f00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19eed9d700 1 --2- 172.21.15.81:0/117986980 >> v2:172.21.15.83:3300/0 conn(0x7f19f01578d0 0x7f19f00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19eed9d700 1 -- 172.21.15.81:0/117986980 >> v1:172.21.15.83:6789/0 conn(0x7f19f0157ca0 legacy=0x7f19f015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.837+0000 7f19eed9d700 1 -- 172.21.15.81:0/117986980 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f00cfe90 con 0x7f19f006d120 2023-10-06T02:51:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19eed9d700 1 --2- 172.21.15.81:0/117986980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f006d120 0x7f19f006d510 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f19f00646b0 tx=0x7f19e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9237f120e4babe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19edd9b700 1 -- 172.21.15.81:0/117986980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e800e070 con 0x7f19f006d120 2023-10-06T02:51:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19edd9b700 1 -- 172.21.15.81:0/117986980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e800ba10 con 0x7f19f006d120 2023-10-06T02:51:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19edd9b700 1 -- 172.21.15.81:0/117986980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e80092e0 con 0x7f19f006d120 2023-10-06T02:51:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19f4bdd700 1 -- 172.21.15.81:0/117986980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f006d120 msgr2=0x7f19f006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19f4bdd700 1 --2- 172.21.15.81:0/117986980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f006d120 0x7f19f006d510 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f19f00646b0 tx=0x7f19e8009840 comp rx=0 tx=0).stop 2023-10-06T02:51:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19f4bdd700 1 -- 172.21.15.81:0/117986980 shutdown_connections 2023-10-06T02:51:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19f4bdd700 1 --2- 172.21.15.81:0/117986980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f006d120 0x7f19f006d510 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19f4bdd700 1 --2- 172.21.15.81:0/117986980 >> v2:172.21.15.83:3300/0 conn(0x7f19f01578d0 0x7f19f00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19f4bdd700 1 -- 172.21.15.81:0/117986980 >> 172.21.15.81:0/117986980 conn(0x7f19f006bb90 msgr2=0x7f19f006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19f4bdd700 1 -- 172.21.15.81:0/117986980 shutdown_connections 2023-10-06T02:51:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.838+0000 7f19f4bdd700 1 -- 172.21.15.81:0/117986980 wait complete. 2023-10-06T02:51:38.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.839+0000 7f19f4bdd700 1 Processor -- start 2023-10-06T02:51:38.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19f4bdd700 1 -- start start 2023-10-06T02:51:38.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19f4bdd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19f006d120 0x7f19f0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19f4bdd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f01578d0 0x7f19f016a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19f4bdd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19f0157ca0 0x7f19f00c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19f4bdd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f01550c0 con 0x7f19f01578d0 2023-10-06T02:51:38.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19f4bdd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00c6200 con 0x7f19f006d120 2023-10-06T02:51:38.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19f4bdd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00c8350 con 0x7f19f0157ca0 2023-10-06T02:51:38.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19e5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f01578d0 0x7f19f016a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19e5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f01578d0 0x7f19f016a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33318/0 (socket says 172.21.15.81:33318) 2023-10-06T02:51:38.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19e5d9b700 1 -- 172.21.15.81:0/2657019344 learned_addr learned my addr 172.21.15.81:0/2657019344 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:38.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19ee59c700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19f006d120 0x7f19f0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.840+0000 7f19eed9d700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19f0157ca0 0x7f19f00c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19e5d9b700 1 -- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19f0157ca0 msgr2=0x7f19f00c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19e5d9b700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19f0157ca0 0x7f19f00c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19e5d9b700 1 -- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19f006d120 msgr2=0x7f19f0154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19e5d9b700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19f006d120 0x7f19f0154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19e5d9b700 1 -- 172.21.15.81:0/2657019344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8009ae0 con 0x7f19f01578d0 2023-10-06T02:51:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19e5d9b700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f01578d0 0x7f19f016a4f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b5e0 tx=0x7f19d80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19e6ffd700 1 -- 172.21.15.81:0/2657019344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800f510 con 0x7f19f01578d0 2023-10-06T02:51:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19e6ffd700 1 -- 172.21.15.81:0/2657019344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d800f6b0 con 0x7f19f01578d0 2023-10-06T02:51:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f00c8630 con 0x7f19f01578d0 2023-10-06T02:51:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19e6ffd700 1 -- 172.21.15.81:0/2657019344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800fa70 con 0x7f19f01578d0 2023-10-06T02:51:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.841+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f00c5e90 con 0x7f19f01578d0 2023-10-06T02:51:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.842+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f00c6370 con 0x7f19f01578d0 2023-10-06T02:51:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.842+0000 7f19e6ffd700 1 -- 172.21.15.81:0/2657019344 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19d801a400 con 0x7f19f01578d0 2023-10-06T02:51:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.843+0000 7f19e6ffd700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f19d0066f30 0x7f19d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.843+0000 7f19e6ffd700 1 -- 172.21.15.81:0/2657019344 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f19d8084050 con 0x7f19f01578d0 2023-10-06T02:51:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.843+0000 7f19ee59c700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f19d0066f30 0x7f19d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.843+0000 7f19ee59c700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f19d0066f30 0x7f19d00693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f19e0006fd0 tx=0x7f19e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:38.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:38.847+0000 7f19e6ffd700 1 -- 172.21.15.81:0/2657019344 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19d80511e0 con 0x7f19f01578d0 2023-10-06T02:51:39.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.027+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19f00d0170 con 0x7f19f01578d0 2023-10-06T02:51:39.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.027+0000 7f19e6ffd700 1 -- 172.21.15.81:0/2657019344 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7f19d80091f0 con 0x7f19f01578d0 2023-10-06T02:51:39.029 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:51:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f19d0066f30 msgr2=0x7f19d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f19d0066f30 0x7f19d00693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f19e0006fd0 tx=0x7f19e0008040 comp rx=0 tx=0).stop 2023-10-06T02:51:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f01578d0 msgr2=0x7f19f016a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f01578d0 0x7f19f016a4f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b5e0 tx=0x7f19d80090f0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 shutdown_connections 2023-10-06T02:51:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19f0157ca0 0x7f19f00c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f19d0066f30 0x7f19d00693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19f006d120 0x7f19f0154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 --2- 172.21.15.81:0/2657019344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f01578d0 0x7f19f016a4f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 >> 172.21.15.81:0/2657019344 conn(0x7f19f006bb90 msgr2=0x7f19f0156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 shutdown_connections 2023-10-06T02:51:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.030+0000 7f19f4bdd700 1 -- 172.21.15.81:0/2657019344 wait complete. 2023-10-06T02:51:39.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:51:39.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.159+0000 7f2a6195f700 1 Processor -- start 2023-10-06T02:51:39.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.159+0000 7f2a6195f700 1 -- start start 2023-10-06T02:51:39.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6195f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a5c06d700 0x7f2a5c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6195f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c0cf2d0 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6195f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c0d0480 con 0x7f2a5c0d0b80 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6195f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5c15a690 con 0x7f2a5c06d700 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6115e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a5c06d700 0x7f2a5c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6115e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a5c06d700 0x7f2a5c15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33324/0 (socket says 172.21.15.81:33324) 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6115e700 1 -- 172.21.15.81:0/3070766536 learned_addr learned my addr 172.21.15.81:0/3070766536 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a5bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2a5c0d0f50 0x7f2a5c06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35034/0 (socket says 172.21.15.81:35034) 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6115e700 1 -- 172.21.15.81:0/3070766536 >> v1:172.21.15.83:6789/0 conn(0x7f2a5c0d0b80 legacy=0x7f2a5c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6115e700 1 -- 172.21.15.81:0/3070766536 >> v1:172.21.15.81:6789/0 conn(0x7f2a5c0d0f50 legacy=0x7f2a5c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6115e700 1 -- 172.21.15.81:0/3070766536 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c06dc00 con 0x7f2a5c06d700 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a5b7fe700 1 -- 172.21.15.81:0/3070766536 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365781674 0 0) 0x7f2a5c0cf2d0 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.160+0000 7f2a6115e700 1 --2- 172.21.15.81:0/3070766536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c06d700 0x7f2a5c15b320 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009f20 tx=0x7f2a54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be1038cf3ddf512 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a5b7fe700 1 -- 172.21.15.81:0/3070766536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400e070 con 0x7f2a5c06d700 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a5b7fe700 1 -- 172.21.15.81:0/3070766536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5400ba40 con 0x7f2a5c06d700 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a5b7fe700 1 -- 172.21.15.81:0/3070766536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540092e0 con 0x7f2a5c06d700 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a6195f700 1 -- 172.21.15.81:0/3070766536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c06d700 msgr2=0x7f2a5c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a6195f700 1 --2- 172.21.15.81:0/3070766536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c06d700 0x7f2a5c15b320 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009f20 tx=0x7f2a54009840 comp rx=0 tx=0).stop 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a6195f700 1 -- 172.21.15.81:0/3070766536 shutdown_connections 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a6195f700 1 --2- 172.21.15.81:0/3070766536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c06d700 0x7f2a5c15b320 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a6195f700 1 -- 172.21.15.81:0/3070766536 >> 172.21.15.81:0/3070766536 conn(0x7f2a5c063230 msgr2=0x7f2a5c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a6195f700 1 -- 172.21.15.81:0/3070766536 shutdown_connections 2023-10-06T02:51:39.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.161+0000 7f2a6195f700 1 -- 172.21.15.81:0/3070766536 wait complete. 2023-10-06T02:51:39.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.162+0000 7f2a6195f700 1 Processor -- start 2023-10-06T02:51:39.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.162+0000 7f2a6195f700 1 -- start start 2023-10-06T02:51:39.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6195f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a5c06d700 0x7f2a5c150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6195f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a5c0d0b80 0x7f2a5c16a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6195f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c0d0f50 0x7f2a5c139cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6195f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c151510 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6195f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c16ae10 con 0x7f2a5c0d0b80 2023-10-06T02:51:39.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6195f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c151720 con 0x7f2a5c06d700 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6115e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c0d0f50 0x7f2a5c139cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6115e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c0d0f50 0x7f2a5c139cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33326/0 (socket says 172.21.15.81:33326) 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6115e700 1 -- 172.21.15.81:0/844145376 learned_addr learned my addr 172.21.15.81:0/844145376 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6115e700 1 -- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a5c06d700 msgr2=0x7f2a5c150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6095d700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a5c06d700 0x7f2a5c150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a5bfff700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a5c0d0b80 0x7f2a5c16a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6115e700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a5c06d700 0x7f2a5c150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6115e700 1 -- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a5c0d0b80 msgr2=0x7f2a5c16a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.163+0000 7f2a6115e700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a5c0d0b80 0x7f2a5c16a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.164+0000 7f2a6115e700 1 -- 172.21.15.81:0/844145376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54009ae0 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.164+0000 7f2a6115e700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c0d0f50 0x7f2a5c139cd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c06fcc0 tx=0x7f2a54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.164+0000 7f2a58ff9700 1 -- 172.21.15.81:0/844145376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54012ea0 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.164+0000 7f2a58ff9700 1 -- 172.21.15.81:0/844145376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5400be50 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.164+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c151a00 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.164+0000 7f2a58ff9700 1 -- 172.21.15.81:0/844145376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5401e660 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.164+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c151fc0 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.165+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5c0676e0 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.165+0000 7f2a58ff9700 1 -- 172.21.15.81:0/844145376 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a5401ea90 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.166+0000 7f2a58ff9700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a40066f30 0x7f2a400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.166+0000 7f2a58ff9700 1 -- 172.21.15.81:0/844145376 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2a540864b0 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.166+0000 7f2a6095d700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a40066f30 0x7f2a400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.166+0000 7f2a6095d700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a40066f30 0x7f2a400693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2a500027e0 tx=0x7f2a50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:39.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.170+0000 7f2a58ff9700 1 -- 172.21.15.81:0/844145376 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a540535c0 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.350+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a5c0cf570 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.350+0000 7f2a58ff9700 1 -- 172.21.15.81:0/844145376 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a54056be0 con 0x7f2a5c0d0f50 2023-10-06T02:51:39.352 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:51:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a40066f30 msgr2=0x7f2a400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a40066f30 0x7f2a400693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2a500027e0 tx=0x7f2a50009040 comp rx=0 tx=0).stop 2023-10-06T02:51:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c0d0f50 msgr2=0x7f2a5c139cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c0d0f50 0x7f2a5c139cd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c06fcc0 tx=0x7f2a54017000 comp rx=0 tx=0).stop 2023-10-06T02:51:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 shutdown_connections 2023-10-06T02:51:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5c0d0f50 0x7f2a5c139cd0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a5c06d700 0x7f2a5c150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a40066f30 0x7f2a400693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 --2- 172.21.15.81:0/844145376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a5c0d0b80 0x7f2a5c16a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 >> 172.21.15.81:0/844145376 conn(0x7f2a5c063230 msgr2=0x7f2a5c14e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 shutdown_connections 2023-10-06T02:51:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.353+0000 7f2a6195f700 1 -- 172.21.15.81:0/844145376 wait complete. 2023-10-06T02:51:39.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:39.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.479+0000 7f2fca29c700 1 Processor -- start 2023-10-06T02:51:39.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.479+0000 7f2fca29c700 1 -- start start 2023-10-06T02:51:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.480+0000 7f2fca29c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2fc406d830 0x7f2fc40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.480+0000 7f2fca29c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40d07c0 con 0x7f2fc4157ca0 2023-10-06T02:51:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.480+0000 7f2fca29c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40cfbb0 con 0x7f2fc41578d0 2023-10-06T02:51:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.480+0000 7f2fca29c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc40cfe90 con 0x7f2fc406d830 2023-10-06T02:51:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.480+0000 7f2fc8839700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2fc406d830 0x7f2fc40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.480+0000 7f2fc37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2fc4157ca0 0x7f2fc406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35042/0 (socket says 172.21.15.81:35042) 2023-10-06T02:51:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.480+0000 7f2fc37fe700 1 -- 172.21.15.81:0/2055252427 learned_addr learned my addr 172.21.15.81:0/2055252427 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.481+0000 7f2fc8839700 1 -- 172.21.15.81:0/2055252427 >> v1:172.21.15.83:6789/0 conn(0x7f2fc41578d0 legacy=0x7f2fc415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.481+0000 7f2fc8839700 1 -- 172.21.15.81:0/2055252427 >> v1:172.21.15.81:6789/0 conn(0x7f2fc4157ca0 legacy=0x7f2fc406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.481+0000 7f2fc8839700 1 -- 172.21.15.81:0/2055252427 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40d0170 con 0x7f2fc406d830 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.481+0000 7f2fc8839700 1 --2- 172.21.15.81:0/2055252427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc406d830 0x7f2fc40cf4f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009e60 tx=0x7f2fbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4395f5f9466c9df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.481+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/2055252427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00e070 con 0x7f2fc406d830 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.481+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/2055252427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00bc30 con 0x7f2fc406d830 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.481+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/2055252427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc012430 con 0x7f2fc406d830 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.482+0000 7f2fca29c700 1 -- 172.21.15.81:0/2055252427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc406d830 msgr2=0x7f2fc40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.482+0000 7f2fca29c700 1 --2- 172.21.15.81:0/2055252427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc406d830 0x7f2fc40cf4f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009e60 tx=0x7f2fbc009780 comp rx=0 tx=0).stop 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.482+0000 7f2fca29c700 1 -- 172.21.15.81:0/2055252427 shutdown_connections 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.482+0000 7f2fca29c700 1 --2- 172.21.15.81:0/2055252427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc406d830 0x7f2fc40cf4f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.482+0000 7f2fca29c700 1 -- 172.21.15.81:0/2055252427 >> 172.21.15.81:0/2055252427 conn(0x7f2fc406bb90 msgr2=0x7f2fc406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.482+0000 7f2fca29c700 1 -- 172.21.15.81:0/2055252427 shutdown_connections 2023-10-06T02:51:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.482+0000 7f2fca29c700 1 -- 172.21.15.81:0/2055252427 wait complete. 2023-10-06T02:51:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.483+0000 7f2fca29c700 1 Processor -- start 2023-10-06T02:51:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.483+0000 7f2fca29c700 1 -- start start 2023-10-06T02:51:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.483+0000 7f2fca29c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2fc406d830 0x7f2fc40b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.483+0000 7f2fca29c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc41578d0 0x7f2fc40c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fca29c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fc4157ca0 0x7f2fc40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fca29c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40b4290 con 0x7f2fc41578d0 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fca29c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc416b6a0 con 0x7f2fc4157ca0 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fca29c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc416b3c0 con 0x7f2fc406d830 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc41578d0 0x7f2fc40c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc41578d0 0x7f2fc40c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33342/0 (socket says 172.21.15.81:33342) 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc37fe700 1 -- 172.21.15.81:0/2112695418 learned_addr learned my addr 172.21.15.81:0/2112695418 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc3fff700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2fc406d830 0x7f2fc40b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc8839700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fc4157ca0 0x7f2fc40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc37fe700 1 -- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2fc406d830 msgr2=0x7f2fc40b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc37fe700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2fc406d830 0x7f2fc40b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc37fe700 1 -- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fc4157ca0 msgr2=0x7f2fc40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc37fe700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fc4157ca0 0x7f2fc40b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc37fe700 1 -- 172.21.15.81:0/2112695418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009a20 con 0x7f2fc41578d0 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fc37fe700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc41578d0 0x7f2fc40c6530 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c590 tx=0x7f2fb8001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fabfff700 1 -- 172.21.15.81:0/2112695418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8005b30 con 0x7f2fc41578d0 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fabfff700 1 -- 172.21.15.81:0/2112695418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb8005cb0 con 0x7f2fc41578d0 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc40b3c40 con 0x7f2fc41578d0 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fabfff700 1 -- 172.21.15.81:0/2112695418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8007320 con 0x7f2fc41578d0 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.484+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc4159f10 con 0x7f2fc41578d0 2023-10-06T02:51:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.485+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc4067ac0 con 0x7f2fc41578d0 2023-10-06T02:51:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.486+0000 7f2fabfff700 1 -- 172.21.15.81:0/2112695418 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fb801b3b0 con 0x7f2fc41578d0 2023-10-06T02:51:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.486+0000 7f2fabfff700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2fb0066f30 0x7f2fb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.486+0000 7f2fabfff700 1 -- 172.21.15.81:0/2112695418 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2fb8083b70 con 0x7f2fc41578d0 2023-10-06T02:51:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.486+0000 7f2fc3fff700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2fb0066f30 0x7f2fb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.487+0000 7f2fc3fff700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2fb0066f30 0x7f2fb00693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2fc41594c0 tx=0x7f2fb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.490+0000 7f2fabfff700 1 -- 172.21.15.81:0/2112695418 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fb8050c80 con 0x7f2fc41578d0 2023-10-06T02:51:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.718+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fc40b43d0 con 0x7f2fc41578d0 2023-10-06T02:51:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.718+0000 7f2fabfff700 1 -- 172.21.15.81:0/2112695418 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f2fb8017070 con 0x7f2fc41578d0 2023-10-06T02:51:39.719 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:39.720 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:01.019609+0000","modified":"2023-10-06T02:51:04.689923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/907018385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":907018385},{"type":"v1","addr":"172.21.15.81:6835","nonce":907018385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:51:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2fb0066f30 msgr2=0x7f2fb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2fb0066f30 0x7f2fb00693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2fc41594c0 tx=0x7f2fb4009040 comp rx=0 tx=0).stop 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc41578d0 msgr2=0x7f2fc40c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc41578d0 0x7f2fc40c6530 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c590 tx=0x7f2fb8001020 comp rx=0 tx=0).stop 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 shutdown_connections 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2fb0066f30 0x7f2fb00693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fc4157ca0 0x7f2fc40b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2fc406d830 0x7f2fc40b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 --2- 172.21.15.81:0/2112695418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc41578d0 0x7f2fc40c6530 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 >> 172.21.15.81:0/2112695418 conn(0x7f2fc406bb90 msgr2=0x7f2fc406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 shutdown_connections 2023-10-06T02:51:39.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.720+0000 7f2fca29c700 1 -- 172.21.15.81:0/2112695418 wait complete. 2023-10-06T02:51:39.723 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-06T02:51:39.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:39.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.845+0000 7f6918246700 1 Processor -- start 2023-10-06T02:51:39.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.845+0000 7f6918246700 1 -- start start 2023-10-06T02:51:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.846+0000 7f6918246700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f691015a2a0 0x7f69100b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.846+0000 7f6918246700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f691006dd60 0x7f69100cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.846+0000 7f6918246700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69100b0ca0 con 0x7f69100ceb30 2023-10-06T02:51:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.846+0000 7f6918246700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691006e160 con 0x7f691006dd60 2023-10-06T02:51:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.846+0000 7f6918246700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691006ea90 con 0x7f691015a2a0 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.846+0000 7f69167e3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f691006dd60 0x7f69100cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.846+0000 7f69167e3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f691006dd60 0x7f69100cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33354/0 (socket says 172.21.15.81:33354) 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.846+0000 7f69167e3700 1 -- 172.21.15.81:0/3923280053 learned_addr learned my addr 172.21.15.81:0/3923280053 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f6915fe2700 1 --2- 172.21.15.81:0/3923280053 >> v2:172.21.15.83:3300/0 conn(0x7f691015a2a0 0x7f69100b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f69167e3700 1 -- 172.21.15.81:0/3923280053 >> v2:172.21.15.83:3300/0 conn(0x7f691015a2a0 msgr2=0x7f69100b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f69167e3700 1 --2- 172.21.15.81:0/3923280053 >> v2:172.21.15.83:3300/0 conn(0x7f691015a2a0 0x7f69100b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f69167e3700 1 -- 172.21.15.81:0/3923280053 >> v1:172.21.15.83:6789/0 conn(0x7f69100ceb30 legacy=0x7f691006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f69167e3700 1 -- 172.21.15.81:0/3923280053 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100b00d0 con 0x7f691006dd60 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f69167e3700 1 --2- 172.21.15.81:0/3923280053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691006dd60 0x7f69100cefb0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f69100637a0 tx=0x7f6908009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d6fdd3be0c588e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f6914fe0700 1 -- 172.21.15.81:0/3923280053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800e070 con 0x7f691006dd60 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f6914fe0700 1 -- 172.21.15.81:0/3923280053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690800ba10 con 0x7f691006dd60 2023-10-06T02:51:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f6914fe0700 1 -- 172.21.15.81:0/3923280053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080092e0 con 0x7f691006dd60 2023-10-06T02:51:39.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f6918246700 1 -- 172.21.15.81:0/3923280053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691006dd60 msgr2=0x7f69100cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.847+0000 7f6918246700 1 --2- 172.21.15.81:0/3923280053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691006dd60 0x7f69100cefb0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f69100637a0 tx=0x7f6908009840 comp rx=0 tx=0).stop 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.848+0000 7f6918246700 1 -- 172.21.15.81:0/3923280053 shutdown_connections 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.848+0000 7f6918246700 1 --2- 172.21.15.81:0/3923280053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691006dd60 0x7f69100cefb0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.848+0000 7f6918246700 1 --2- 172.21.15.81:0/3923280053 >> v2:172.21.15.83:3300/0 conn(0x7f691015a2a0 0x7f69100b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.848+0000 7f6918246700 1 -- 172.21.15.81:0/3923280053 >> 172.21.15.81:0/3923280053 conn(0x7f6910067640 msgr2=0x7f6910067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.848+0000 7f6918246700 1 -- 172.21.15.81:0/3923280053 shutdown_connections 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.848+0000 7f6918246700 1 -- 172.21.15.81:0/3923280053 wait complete. 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.849+0000 7f6918246700 1 Processor -- start 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.849+0000 7f6918246700 1 -- start start 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.849+0000 7f6918246700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f691006dd60 0x7f691016ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.849+0000 7f6918246700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69100ceb30 0x7f69100b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.849+0000 7f6918246700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691015a2a0 0x7f69100ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.849+0000 7f6918246700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69100b39b0 con 0x7f69100ceb30 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.849+0000 7f6918246700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691016b1d0 con 0x7f691015a2a0 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.849+0000 7f6918246700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69100b2ac0 con 0x7f691006dd60 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69157e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69100ceb30 0x7f69100b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69157e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69100ceb30 0x7f69100b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33364/0 (socket says 172.21.15.81:33364) 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69157e1700 1 -- 172.21.15.81:0/3191140843 learned_addr learned my addr 172.21.15.81:0/3191140843 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69167e3700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691015a2a0 0x7f69100ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f6915fe2700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f691006dd60 0x7f691016ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69157e1700 1 -- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f691006dd60 msgr2=0x7f691016ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69157e1700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f691006dd60 0x7f691016ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69157e1700 1 -- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691015a2a0 msgr2=0x7f69100ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69157e1700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691015a2a0 0x7f69100ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69157e1700 1 -- 172.21.15.81:0/3191140843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908009ae0 con 0x7f69100ceb30 2023-10-06T02:51:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f69157e1700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69100ceb30 0x7f69100b3e40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f690000c5d0 tx=0x7f6900007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f6905ffb700 1 -- 172.21.15.81:0/3191140843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900011590 con 0x7f69100ceb30 2023-10-06T02:51:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f6905ffb700 1 -- 172.21.15.81:0/3191140843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6900011710 con 0x7f69100ceb30 2023-10-06T02:51:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69100b2da0 con 0x7f69100ceb30 2023-10-06T02:51:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f6905ffb700 1 -- 172.21.15.81:0/3191140843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900011ad0 con 0x7f69100ceb30 2023-10-06T02:51:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.850+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69100b3360 con 0x7f69100ceb30 2023-10-06T02:51:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.851+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6910069e40 con 0x7f69100ceb30 2023-10-06T02:51:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.852+0000 7f6905ffb700 1 -- 172.21.15.81:0/3191140843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f690001c460 con 0x7f69100ceb30 2023-10-06T02:51:39.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.852+0000 7f6905ffb700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f68f4066f30 0x7f68f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:39.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.852+0000 7f6905ffb700 1 -- 172.21.15.81:0/3191140843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f69000842f0 con 0x7f69100ceb30 2023-10-06T02:51:39.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.852+0000 7f6915fe2700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f68f4066f30 0x7f68f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:39.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.853+0000 7f6915fe2700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f68f4066f30 0x7f68f40693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f690c006fd0 tx=0x7f690c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:39.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:39.856+0000 7f6905ffb700 1 -- 172.21.15.81:0/3191140843 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6900051400 con 0x7f69100ceb30 2023-10-06T02:51:40.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.040+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69100b3af0 con 0x7f69100ceb30 2023-10-06T02:51:40.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.041+0000 7f6905ffb700 1 -- 172.21.15.81:0/3191140843 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16826 (secure 0 0 0) 0x7f6900054a20 con 0x7f69100ceb30 2023-10-06T02:51:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:40.043 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":108,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:30.499203+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:50:58.681047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T02:50:59.998500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f68f4066f30 msgr2=0x7f68f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f68f4066f30 0x7f68f40693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f690c006fd0 tx=0x7f690c008040 comp rx=0 tx=0).stop 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69100ceb30 msgr2=0x7f69100b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69100ceb30 0x7f69100b3e40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f690000c5d0 tx=0x7f6900007f60 comp rx=0 tx=0).stop 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 shutdown_connections 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f68f4066f30 0x7f68f40693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f691015a2a0 0x7f69100ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f691006dd60 0x7f691016ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 --2- 172.21.15.81:0/3191140843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69100ceb30 0x7f69100b3e40 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 >> 172.21.15.81:0/3191140843 conn(0x7f6910067640 msgr2=0x7f6910156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 shutdown_connections 2023-10-06T02:51:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.043+0000 7f6918246700 1 -- 172.21.15.81:0/3191140843 wait complete. 2023-10-06T02:51:40.056 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:51:40.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.169+0000 7fa654f32700 1 Processor -- start 2023-10-06T02:51:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.169+0000 7fa654f32700 1 -- start start 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa654f32700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa6500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa654f32700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa65006d120 0x7fa65006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa654f32700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65006dac0 con 0x7fa6501578d0 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa654f32700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6500d07c0 con 0x7fa65006d120 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa654f32700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500cfbb0 con 0x7fa650157ca0 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa64ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa65006d120 0x7fa65006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa64e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa6501578d0 0x7fa65015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35054/0 (socket says 172.21.15.81:35054) 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa64e59c700 1 -- 172.21.15.81:0/4057197272 learned_addr learned my addr 172.21.15.81:0/4057197272 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa64ed9d700 1 -- 172.21.15.81:0/4057197272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 msgr2=0x7fa6500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.170+0000 7fa645d9b700 1 --2- 172.21.15.81:0/4057197272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa6500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa64ed9d700 1 --2- 172.21.15.81:0/4057197272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa6500cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa64dd9b700 1 -- 172.21.15.81:0/4057197272 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852939906 0 0) 0x7fa640001110 con 0x7fa6501578d0 2023-10-06T02:51:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa64ed9d700 1 -- 172.21.15.81:0/4057197272 >> v1:172.21.15.81:6789/0 conn(0x7fa6501578d0 legacy=0x7fa65015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa64ed9d700 1 -- 172.21.15.81:0/4057197272 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6500cfe90 con 0x7fa65006d120 2023-10-06T02:51:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa64ed9d700 1 --2- 172.21.15.81:0/4057197272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 0x7fa65006d580 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa648009e60 tx=0x7fa648009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4229705454a3e0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa64dd9b700 1 -- 172.21.15.81:0/4057197272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800e070 con 0x7fa65006d120 2023-10-06T02:51:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa64dd9b700 1 -- 172.21.15.81:0/4057197272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800bc30 con 0x7fa65006d120 2023-10-06T02:51:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa64dd9b700 1 -- 172.21.15.81:0/4057197272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648012430 con 0x7fa65006d120 2023-10-06T02:51:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa654f32700 1 -- 172.21.15.81:0/4057197272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 msgr2=0x7fa65006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa654f32700 1 --2- 172.21.15.81:0/4057197272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 0x7fa65006d580 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa648009e60 tx=0x7fa648009780 comp rx=0 tx=0).stop 2023-10-06T02:51:40.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa654f32700 1 -- 172.21.15.81:0/4057197272 shutdown_connections 2023-10-06T02:51:40.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa654f32700 1 --2- 172.21.15.81:0/4057197272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 0x7fa65006d580 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa654f32700 1 --2- 172.21.15.81:0/4057197272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa6500cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa654f32700 1 -- 172.21.15.81:0/4057197272 >> 172.21.15.81:0/4057197272 conn(0x7fa65006bb90 msgr2=0x7fa65006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:40.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa654f32700 1 -- 172.21.15.81:0/4057197272 shutdown_connections 2023-10-06T02:51:40.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.171+0000 7fa654f32700 1 -- 172.21.15.81:0/4057197272 wait complete. 2023-10-06T02:51:40.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa654f32700 1 Processor -- start 2023-10-06T02:51:40.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa654f32700 1 -- start start 2023-10-06T02:51:40.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa654f32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 0x7fa6500ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa654f32700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6501578d0 0x7fa6500adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa654f32700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650157ca0 0x7fa65016dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa654f32700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500abe80 con 0x7fa65006d120 2023-10-06T02:51:40.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa654f32700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500ab270 con 0x7fa650157ca0 2023-10-06T02:51:40.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa654f32700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500ab550 con 0x7fa6501578d0 2023-10-06T02:51:40.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa64e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 0x7fa6500ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa64e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 0x7fa6500ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33370/0 (socket says 172.21.15.81:33370) 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.173+0000 7fa64e59c700 1 -- 172.21.15.81:0/1779586869 learned_addr learned my addr 172.21.15.81:0/1779586869 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa645d9b700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6501578d0 0x7fa6500adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa64ed9d700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650157ca0 0x7fa65016dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa64e59c700 1 -- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6501578d0 msgr2=0x7fa6500adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa64e59c700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6501578d0 0x7fa6500adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa64e59c700 1 -- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650157ca0 msgr2=0x7fa65016dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa64e59c700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650157ca0 0x7fa65016dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa64e59c700 1 -- 172.21.15.81:0/1779586869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa648009a20 con 0x7fa65006d120 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa645d9b700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6501578d0 0x7fa6500adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa64ed9d700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650157ca0 0x7fa65016dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa64e59c700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 0x7fa6500ada90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c810 tx=0x7fa640007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa646ffd700 1 -- 172.21.15.81:0/1779586869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640005b30 con 0x7fa65006d120 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa646ffd700 1 -- 172.21.15.81:0/1779586869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640005c90 con 0x7fa65006d120 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6500ab830 con 0x7fa65006d120 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa646ffd700 1 -- 172.21.15.81:0/1779586869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640007300 con 0x7fa65006d120 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.174+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65016e1d0 con 0x7fa65006d120 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.175+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa650067ac0 con 0x7fa65006d120 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.175+0000 7fa646ffd700 1 -- 172.21.15.81:0/1779586869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6400076f0 con 0x7fa65006d120 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.176+0000 7fa646ffd700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.176+0000 7fa646ffd700 1 -- 172.21.15.81:0/1779586869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa6400840a0 con 0x7fa65006d120 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.176+0000 7fa645d9b700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.176+0000 7fa645d9b700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa638006fd0 tx=0x7fa638008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:40.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.180+0000 7fa646ffd700 1 -- 172.21.15.81:0/1779586869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa640054c40 con 0x7fa65006d120 2023-10-06T02:51:40.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.406+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa65006dac0 con 0x7fa65006d120 2023-10-06T02:51:40.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.406+0000 7fa646ffd700 1 -- 172.21.15.81:0/1779586869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa65006dac0 con 0x7fa65006d120 2023-10-06T02:51:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:40.408 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:01.019609+0000","modified":"2023-10-06T02:51:04.689923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/907018385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":907018385},{"type":"v1","addr":"172.21.15.81:6835","nonce":907018385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:51:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 msgr2=0x7fa6300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa638006fd0 tx=0x7fa638008040 comp rx=0 tx=0).stop 2023-10-06T02:51:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 msgr2=0x7fa6500ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 0x7fa6500ada90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c810 tx=0x7fa640007c50 comp rx=0 tx=0).stop 2023-10-06T02:51:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 shutdown_connections 2023-10-06T02:51:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650157ca0 0x7fa65016dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa65006d120 0x7fa6500ada90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 --2- 172.21.15.81:0/1779586869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6501578d0 0x7fa6500adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 >> 172.21.15.81:0/1779586869 conn(0x7fa65006bb90 msgr2=0x7fa650155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.408+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 shutdown_connections 2023-10-06T02:51:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.409+0000 7fa654f32700 1 -- 172.21.15.81:0/1779586869 wait complete. 2023-10-06T02:51:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-06T02:51:40.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.534+0000 7f32be0ee700 1 Processor -- start 2023-10-06T02:51:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.534+0000 7f32be0ee700 1 -- start start 2023-10-06T02:51:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.534+0000 7f32be0ee700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b81578d0 0x7f32b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.534+0000 7f32be0ee700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f32b8157ca0 0x7f32b815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.534+0000 7f32be0ee700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b80d07c0 con 0x7f32b806d120 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.534+0000 7f32be0ee700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80cfbb0 con 0x7f32b8157ca0 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.534+0000 7f32be0ee700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80cfe90 con 0x7f32b81578d0 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b6ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f32b8157ca0 0x7f32b815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b81578d0 0x7f32b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b7fff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f32b806d120 0x7f32b815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55076/0 (socket says 172.21.15.81:55076) 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b7fff700 1 -- 172.21.15.81:0/585754424 learned_addr learned my addr 172.21.15.81:0/585754424 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b77fe700 1 -- 172.21.15.81:0/585754424 >> v2:172.21.15.83:3300/0 conn(0x7f32b8157ca0 msgr2=0x7f32b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b77fe700 1 --2- 172.21.15.81:0/585754424 >> v2:172.21.15.83:3300/0 conn(0x7f32b8157ca0 0x7f32b815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b77fe700 1 -- 172.21.15.81:0/585754424 >> v1:172.21.15.83:6789/0 conn(0x7f32b806d120 legacy=0x7f32b815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b77fe700 1 -- 172.21.15.81:0/585754424 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80d0170 con 0x7f32b81578d0 2023-10-06T02:51:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b77fe700 1 --2- 172.21.15.81:0/585754424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b81578d0 0x7f32b80cf4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009e60 tx=0x7f32a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3805b9091f82e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b67fc700 1 -- 172.21.15.81:0/585754424 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800e070 con 0x7f32b81578d0 2023-10-06T02:51:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b67fc700 1 -- 172.21.15.81:0/585754424 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800bb60 con 0x7f32b81578d0 2023-10-06T02:51:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.535+0000 7f32b67fc700 1 -- 172.21.15.81:0/585754424 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8012430 con 0x7f32b81578d0 2023-10-06T02:51:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.536+0000 7f32be0ee700 1 -- 172.21.15.81:0/585754424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b81578d0 msgr2=0x7f32b80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.536+0000 7f32be0ee700 1 --2- 172.21.15.81:0/585754424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b81578d0 0x7f32b80cf4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009e60 tx=0x7f32a8009780 comp rx=0 tx=0).stop 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.536+0000 7f32be0ee700 1 -- 172.21.15.81:0/585754424 shutdown_connections 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.536+0000 7f32be0ee700 1 --2- 172.21.15.81:0/585754424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b81578d0 0x7f32b80cf4f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.536+0000 7f32be0ee700 1 --2- 172.21.15.81:0/585754424 >> v2:172.21.15.83:3300/0 conn(0x7f32b8157ca0 0x7f32b815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.536+0000 7f32be0ee700 1 -- 172.21.15.81:0/585754424 >> 172.21.15.81:0/585754424 conn(0x7f32b806bb90 msgr2=0x7f32b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.536+0000 7f32be0ee700 1 -- 172.21.15.81:0/585754424 shutdown_connections 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.536+0000 7f32be0ee700 1 -- 172.21.15.81:0/585754424 wait complete. 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.537+0000 7f32be0ee700 1 Processor -- start 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.537+0000 7f32be0ee700 1 -- start start 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32be0ee700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b806d120 0x7f32b814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32be0ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b81578d0 0x7f32b813d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32be0ee700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32b8157ca0 0x7f32b814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32be0ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b813d620 con 0x7f32b81578d0 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32be0ee700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b816a990 con 0x7f32b8157ca0 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32be0ee700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b813dec0 con 0x7f32b806d120 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b81578d0 0x7f32b813d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b81578d0 0x7f32b813d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60426/0 (socket says 172.21.15.81:60426) 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b6ffd700 1 -- 172.21.15.81:0/1064420668 learned_addr learned my addr 172.21.15.81:0/1064420668 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b77fe700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b806d120 0x7f32b814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b7fff700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32b8157ca0 0x7f32b814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b6ffd700 1 -- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b806d120 msgr2=0x7f32b814fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b6ffd700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b806d120 0x7f32b814fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b6ffd700 1 -- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32b8157ca0 msgr2=0x7f32b814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b6ffd700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32b8157ca0 0x7f32b814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.538+0000 7f32b6ffd700 1 -- 172.21.15.81:0/1064420668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a8009a20 con 0x7f32b81578d0 2023-10-06T02:51:40.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.539+0000 7f32b6ffd700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b81578d0 0x7f32b813d0e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00e980 tx=0x7f32ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:40.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.539+0000 7f329f7fe700 1 -- 172.21.15.81:0/1064420668 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac013680 con 0x7f32b81578d0 2023-10-06T02:51:40.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.539+0000 7f329f7fe700 1 -- 172.21.15.81:0/1064420668 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac0137e0 con 0x7f32b81578d0 2023-10-06T02:51:40.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.539+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b81503d0 con 0x7f32b81578d0 2023-10-06T02:51:40.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.539+0000 7f329f7fe700 1 -- 172.21.15.81:0/1064420668 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac013ba0 con 0x7f32b81578d0 2023-10-06T02:51:40.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.539+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b813d8f0 con 0x7f32b81578d0 2023-10-06T02:51:40.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.540+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b806d790 con 0x7f32b81578d0 2023-10-06T02:51:40.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.540+0000 7f329f7fe700 1 -- 172.21.15.81:0/1064420668 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32ac0123d0 con 0x7f32b81578d0 2023-10-06T02:51:40.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.540+0000 7f329f7fe700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32a4066f30 0x7f32a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.541+0000 7f329f7fe700 1 -- 172.21.15.81:0/1064420668 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f32ac0847d0 con 0x7f32b81578d0 2023-10-06T02:51:40.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.541+0000 7f32b77fe700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32a4066f30 0x7f32a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.541+0000 7f32b77fe700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32a4066f30 0x7f32a40693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f32a80097c0 tx=0x7f32a8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:40.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.545+0000 7f329f7fe700 1 -- 172.21.15.81:0/1064420668 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32ac0518e0 con 0x7f32b81578d0 2023-10-06T02:51:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.772+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32b813e050 con 0x7f32b81578d0 2023-10-06T02:51:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.772+0000 7f329f7fe700 1 -- 172.21.15.81:0/1064420668 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f32ac054f00 con 0x7f32b81578d0 2023-10-06T02:51:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:40.774 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:01.019609+0000","modified":"2023-10-06T02:51:04.689923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/907018385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":907018385},{"type":"v1","addr":"172.21.15.81:6835","nonce":907018385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:51:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32a4066f30 msgr2=0x7f32a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32a4066f30 0x7f32a40693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f32a80097c0 tx=0x7f32a8019000 comp rx=0 tx=0).stop 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b81578d0 msgr2=0x7f32b813d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b81578d0 0x7f32b813d0e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00e980 tx=0x7f32ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 shutdown_connections 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32a4066f30 0x7f32a40693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32b8157ca0 0x7f32b814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32b806d120 0x7f32b814fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 --2- 172.21.15.81:0/1064420668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b81578d0 0x7f32b813d0e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 >> 172.21.15.81:0/1064420668 conn(0x7f32b806bb90 msgr2=0x7f32b806a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 shutdown_connections 2023-10-06T02:51:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.774+0000 7f32be0ee700 1 -- 172.21.15.81:0/1064420668 wait complete. 2023-10-06T02:51:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-06T02:51:40.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:40.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.899+0000 7fc322bdd700 1 Processor -- start 2023-10-06T02:51:40.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.899+0000 7fc322bdd700 1 -- start start 2023-10-06T02:51:40.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.899+0000 7fc322bdd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc31c1578d0 0x7fc31c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.899+0000 7fc322bdd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0d07c0 con 0x7fc31c06d120 2023-10-06T02:51:40.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.899+0000 7fc322bdd700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0cfbb0 con 0x7fc31c157ca0 2023-10-06T02:51:40.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.899+0000 7fc322bdd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c0cfe90 con 0x7fc31c1578d0 2023-10-06T02:51:40.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc320979700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc31c1578d0 0x7fc31c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc32117a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc31c06d120 0x7fc31c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39812/0 (socket says 172.21.15.81:39812) 2023-10-06T02:51:40.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc32117a700 1 -- 172.21.15.81:0/3827336175 learned_addr learned my addr 172.21.15.81:0/3827336175 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc320979700 1 -- 172.21.15.81:0/3827336175 >> v1:172.21.15.83:6789/0 conn(0x7fc31c157ca0 legacy=0x7fc31c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc320979700 1 -- 172.21.15.81:0/3827336175 >> v1:172.21.15.81:6789/0 conn(0x7fc31c06d120 legacy=0x7fc31c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc320979700 1 -- 172.21.15.81:0/3827336175 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c0d0170 con 0x7fc31c1578d0 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc3137fe700 1 -- 172.21.15.81:0/3827336175 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164900416 0 0) 0x7fc31c0d07c0 con 0x7fc31c06d120 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc320979700 1 --2- 172.21.15.81:0/3827336175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c1578d0 0x7fc31c0cf4f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc3180098e0 tx=0x7fc3180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4e02356fb1c777 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc3137fe700 1 -- 172.21.15.81:0/3827336175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318009e80 con 0x7fc31c1578d0 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc3137fe700 1 -- 172.21.15.81:0/3827336175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800b860 con 0x7fc31c1578d0 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.900+0000 7fc3137fe700 1 -- 172.21.15.81:0/3827336175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800bbe0 con 0x7fc31c1578d0 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.901+0000 7fc322bdd700 1 -- 172.21.15.81:0/3827336175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c1578d0 msgr2=0x7fc31c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.901+0000 7fc322bdd700 1 --2- 172.21.15.81:0/3827336175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c1578d0 0x7fc31c0cf4f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc3180098e0 tx=0x7fc3180091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.901+0000 7fc322bdd700 1 -- 172.21.15.81:0/3827336175 shutdown_connections 2023-10-06T02:51:40.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.901+0000 7fc322bdd700 1 --2- 172.21.15.81:0/3827336175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c1578d0 0x7fc31c0cf4f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.901+0000 7fc322bdd700 1 -- 172.21.15.81:0/3827336175 >> 172.21.15.81:0/3827336175 conn(0x7fc31c06bb90 msgr2=0x7fc31c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:40.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.901+0000 7fc322bdd700 1 -- 172.21.15.81:0/3827336175 shutdown_connections 2023-10-06T02:51:40.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.901+0000 7fc322bdd700 1 -- 172.21.15.81:0/3827336175 wait complete. 2023-10-06T02:51:40.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.902+0000 7fc322bdd700 1 Processor -- start 2023-10-06T02:51:40.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.902+0000 7fc322bdd700 1 -- start start 2023-10-06T02:51:40.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc322bdd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c06d120 0x7fc31c0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc322bdd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc31c1578d0 0x7fc31c16e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc322bdd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc31c157ca0 0x7fc31c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc322bdd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0b5360 con 0x7fc31c06d120 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc322bdd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c16ea20 con 0x7fc31c1578d0 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc322bdd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0cdc40 con 0x7fc31c157ca0 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc320979700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c06d120 0x7fc31c0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc320979700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c06d120 0x7fc31c0cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60432/0 (socket says 172.21.15.81:60432) 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc320979700 1 -- 172.21.15.81:0/2942790947 learned_addr learned my addr 172.21.15.81:0/2942790947 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc320979700 1 -- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc31c157ca0 msgr2=0x7fc31c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc320979700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc31c157ca0 0x7fc31c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc320979700 1 -- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc31c1578d0 msgr2=0x7fc31c16e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc320979700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc31c1578d0 0x7fc31c16e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:40.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc320979700 1 -- 172.21.15.81:0/2942790947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009420 con 0x7fc31c06d120 2023-10-06T02:51:40.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc320979700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c06d120 0x7fc31c0cd5d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc31c06fe20 tx=0x7fc318017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:40.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc310ff9700 1 -- 172.21.15.81:0/2942790947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31801f070 con 0x7fc31c06d120 2023-10-06T02:51:40.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc310ff9700 1 -- 172.21.15.81:0/2942790947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800b9d0 con 0x7fc31c06d120 2023-10-06T02:51:40.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc310ff9700 1 -- 172.21.15.81:0/2942790947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318025670 con 0x7fc31c06d120 2023-10-06T02:51:40.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c0b4d10 con 0x7fc31c06d120 2023-10-06T02:51:40.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.903+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c152fa0 con 0x7fc31c06d120 2023-10-06T02:51:40.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.904+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c0b4b70 con 0x7fc31c06d120 2023-10-06T02:51:40.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.905+0000 7fc310ff9700 1 -- 172.21.15.81:0/2942790947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc318023070 con 0x7fc31c06d120 2023-10-06T02:51:40.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.905+0000 7fc310ff9700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc308066f30 0x7fc3080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:40.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.905+0000 7fc310ff9700 1 -- 172.21.15.81:0/2942790947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc318085cb0 con 0x7fc31c06d120 2023-10-06T02:51:40.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.905+0000 7fc313fff700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc308066f30 0x7fc3080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:40.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.906+0000 7fc313fff700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc308066f30 0x7fc3080693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc31c06e050 tx=0x7fc30c007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:40.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:40.909+0000 7fc310ff9700 1 -- 172.21.15.81:0/2942790947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc31c0b4b70 con 0x7fc31c06d120 2023-10-06T02:51:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.089+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc31c0b4b70 con 0x7fc31c06d120 2023-10-06T02:51:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.090+0000 7fc310ff9700 1 -- 172.21.15.81:0/2942790947 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16826 (secure 0 0 0) 0x7fc31c0b4b70 con 0x7fc31c06d120 2023-10-06T02:51:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:41.092 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":108,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:30.499203+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:50:58.681047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T02:50:59.998500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:41.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc308066f30 msgr2=0x7fc3080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc308066f30 0x7fc3080693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc31c06e050 tx=0x7fc30c007b40 comp rx=0 tx=0).stop 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c06d120 msgr2=0x7fc31c0cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c06d120 0x7fc31c0cd5d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc31c06fe20 tx=0x7fc318017000 comp rx=0 tx=0).stop 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 shutdown_connections 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc31c157ca0 0x7fc31c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c06d120 0x7fc31c0cd5d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc308066f30 0x7fc3080693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 --2- 172.21.15.81:0/2942790947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc31c1578d0 0x7fc31c16e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 >> 172.21.15.81:0/2942790947 conn(0x7fc31c06bb90 msgr2=0x7fc31c15a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 shutdown_connections 2023-10-06T02:51:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.092+0000 7fc322bdd700 1 -- 172.21.15.81:0/2942790947 wait complete. 2023-10-06T02:51:41.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:51:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.218+0000 7fd9b8aed700 1 Processor -- start 2023-10-06T02:51:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.218+0000 7fd9b8aed700 1 -- start start 2023-10-06T02:51:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b8aed700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd9b41578d0 0x7fd9b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b8aed700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9b406d120 0x7fd9b406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b8aed700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b40d07c0 con 0x7fd9b4157ca0 2023-10-06T02:51:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b8aed700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b406da50 con 0x7fd9b406d120 2023-10-06T02:51:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b8aed700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b40cfbb0 con 0x7fd9b41578d0 2023-10-06T02:51:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9b406d120 0x7fd9b406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9a9d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd9b4157ca0 0x7fd9b415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39820/0 (socket says 172.21.15.81:39820) 2023-10-06T02:51:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9a9d9b700 1 -- 172.21.15.81:0/881797572 learned_addr learned my addr 172.21.15.81:0/881797572 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b259c700 1 --2- 172.21.15.81:0/881797572 >> v2:172.21.15.83:3300/0 conn(0x7fd9b41578d0 0x7fd9b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b2d9d700 1 -- 172.21.15.81:0/881797572 >> v2:172.21.15.83:3300/0 conn(0x7fd9b41578d0 msgr2=0x7fd9b40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b2d9d700 1 --2- 172.21.15.81:0/881797572 >> v2:172.21.15.83:3300/0 conn(0x7fd9b41578d0 0x7fd9b40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b2d9d700 1 -- 172.21.15.81:0/881797572 >> v1:172.21.15.81:6789/0 conn(0x7fd9b4157ca0 legacy=0x7fd9b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b1d9b700 1 -- 172.21.15.81:0/881797572 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839591490 0 0) 0x7fd9b40d07c0 con 0x7fd9b4157ca0 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.219+0000 7fd9b2d9d700 1 -- 172.21.15.81:0/881797572 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b40cfe90 con 0x7fd9b406d120 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b2d9d700 1 --2- 172.21.15.81:0/881797572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b406d120 0x7fd9b406d510 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40646b0 tx=0x7fd9ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3acd7e9c276a1ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b1d9b700 1 -- 172.21.15.81:0/881797572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac00e070 con 0x7fd9b406d120 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b1d9b700 1 -- 172.21.15.81:0/881797572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac00bc30 con 0x7fd9b406d120 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b1d9b700 1 -- 172.21.15.81:0/881797572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac012430 con 0x7fd9b406d120 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b8aed700 1 -- 172.21.15.81:0/881797572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b406d120 msgr2=0x7fd9b406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b8aed700 1 --2- 172.21.15.81:0/881797572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b406d120 0x7fd9b406d510 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40646b0 tx=0x7fd9ac009780 comp rx=0 tx=0).stop 2023-10-06T02:51:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b8aed700 1 -- 172.21.15.81:0/881797572 shutdown_connections 2023-10-06T02:51:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b8aed700 1 --2- 172.21.15.81:0/881797572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b406d120 0x7fd9b406d510 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b8aed700 1 --2- 172.21.15.81:0/881797572 >> v2:172.21.15.83:3300/0 conn(0x7fd9b41578d0 0x7fd9b40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b8aed700 1 -- 172.21.15.81:0/881797572 >> 172.21.15.81:0/881797572 conn(0x7fd9b406bb90 msgr2=0x7fd9b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b8aed700 1 -- 172.21.15.81:0/881797572 shutdown_connections 2023-10-06T02:51:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.220+0000 7fd9b8aed700 1 -- 172.21.15.81:0/881797572 wait complete. 2023-10-06T02:51:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.221+0000 7fd9b8aed700 1 Processor -- start 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.221+0000 7fd9b8aed700 1 -- start start 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b8aed700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9b406d120 0x7fd9b40b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b8aed700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9b41578d0 0x7fd9b40ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b8aed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4157ca0 0x7fd9b4159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b8aed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40b6240 con 0x7fd9b4157ca0 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b8aed700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40b6490 con 0x7fd9b406d120 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b8aed700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40b6770 con 0x7fd9b41578d0 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4157ca0 0x7fd9b4159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4157ca0 0x7fd9b4159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60446/0 (socket says 172.21.15.81:60446) 2023-10-06T02:51:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b2d9d700 1 -- 172.21.15.81:0/3653750401 learned_addr learned my addr 172.21.15.81:0/3653750401 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9a9d9b700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9b41578d0 0x7fd9b40ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.222+0000 7fd9b259c700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9b406d120 0x7fd9b40b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9b2d9d700 1 -- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9b41578d0 msgr2=0x7fd9b40ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9b2d9d700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9b41578d0 0x7fd9b40ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9b2d9d700 1 -- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9b406d120 msgr2=0x7fd9b40b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9b2d9d700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9b406d120 0x7fd9b40b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9b2d9d700 1 -- 172.21.15.81:0/3653750401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac009a20 con 0x7fd9b4157ca0 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9b259c700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9b406d120 0x7fd9b40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9a9d9b700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9b41578d0 0x7fd9b40ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9b2d9d700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4157ca0 0x7fd9b4159380 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd9b406fe20 tx=0x7fd9ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9aaffd700 1 -- 172.21.15.81:0/3653750401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac012ea0 con 0x7fd9b4157ca0 2023-10-06T02:51:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9aaffd700 1 -- 172.21.15.81:0/3653750401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac01d630 con 0x7fd9b4157ca0 2023-10-06T02:51:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9aaffd700 1 -- 172.21.15.81:0/3653750401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac01d9f0 con 0x7fd9b4157ca0 2023-10-06T02:51:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b40b6a50 con 0x7fd9b4157ca0 2023-10-06T02:51:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.223+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b40ab910 con 0x7fd9b4157ca0 2023-10-06T02:51:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.224+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b4067ac0 con 0x7fd9b4157ca0 2023-10-06T02:51:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.224+0000 7fd9aaffd700 1 -- 172.21.15.81:0/3653750401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9ac024070 con 0x7fd9b4157ca0 2023-10-06T02:51:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.224+0000 7fd9aaffd700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.224+0000 7fd9aaffd700 1 -- 172.21.15.81:0/3653750401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd9ac086ec0 con 0x7fd9b4157ca0 2023-10-06T02:51:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.225+0000 7fd9b259c700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.225+0000 7fd9b259c700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4006fd0 tx=0x7fd9a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:41.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.229+0000 7fd9aaffd700 1 -- 172.21.15.81:0/3653750401 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9ac053fd0 con 0x7fd9b4157ca0 2023-10-06T02:51:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.453+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd9b40d0170 con 0x7fd9b4157ca0 2023-10-06T02:51:41.454 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:51:41.454+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:51:41.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.458+0000 7fd9aaffd700 1 -- 172.21.15.81:0/3653750401 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd9ac0575f0 con 0x7fd9b4157ca0 2023-10-06T02:51:41.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 msgr2=0x7fd9940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4006fd0 tx=0x7fd9a4008040 comp rx=0 tx=0).stop 2023-10-06T02:51:41.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4157ca0 msgr2=0x7fd9b4159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4157ca0 0x7fd9b4159380 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd9b406fe20 tx=0x7fd9ac019000 comp rx=0 tx=0).stop 2023-10-06T02:51:41.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 shutdown_connections 2023-10-06T02:51:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4157ca0 0x7fd9b4159380 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd994066f30 0x7fd9940693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9b406d120 0x7fd9b40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 --2- 172.21.15.81:0/3653750401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9b41578d0 0x7fd9b40ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 >> 172.21.15.81:0/3653750401 conn(0x7fd9b406bb90 msgr2=0x7fd9b41554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 shutdown_connections 2023-10-06T02:51:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.461+0000 7fd9b8aed700 1 -- 172.21.15.81:0/3653750401 wait complete. 2023-10-06T02:51:41.463 INFO:tasks.ceph.mds.c.smithi081.stderr: -9138> 2023-10-06T02:51:05.450+0000 7fcbf3254700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:51:41.464 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:51:41.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:51:41.494 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:51:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.591+0000 7fcb7433d700 1 Processor -- start 2023-10-06T02:51:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.591+0000 7fcb7433d700 1 -- start start 2023-10-06T02:51:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.592+0000 7fcb7433d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcb6c1578d0 0x7fcb6c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.592+0000 7fcb7433d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c0d07c0 con 0x7fcb6c157ca0 2023-10-06T02:51:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.592+0000 7fcb7433d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c0cfbb0 con 0x7fcb6c06d120 2023-10-06T02:51:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.592+0000 7fcb7433d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c0cfe90 con 0x7fcb6c1578d0 2023-10-06T02:51:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.592+0000 7fcb718d8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcb6c157ca0 0x7fcb6c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39834/0 (socket says 172.21.15.81:39834) 2023-10-06T02:51:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.592+0000 7fcb718d8700 1 -- 172.21.15.81:0/3103718929 learned_addr learned my addr 172.21.15.81:0/3103718929 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb720d9700 1 --2- 172.21.15.81:0/3103718929 >> v2:172.21.15.83:3300/0 conn(0x7fcb6c1578d0 0x7fcb6c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb710d7700 1 -- 172.21.15.81:0/3103718929 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753489527 0 0) 0x7fcb6c0d07c0 con 0x7fcb6c157ca0 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb710d7700 1 -- 172.21.15.81:0/3103718929 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb58003570 con 0x7fcb6c157ca0 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb720d9700 1 -- 172.21.15.81:0/3103718929 >> v1:172.21.15.83:6789/0 conn(0x7fcb6c06d120 legacy=0x7fcb6c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb720d9700 1 -- 172.21.15.81:0/3103718929 >> v1:172.21.15.81:6789/0 conn(0x7fcb6c157ca0 legacy=0x7fcb6c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb720d9700 1 -- 172.21.15.81:0/3103718929 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0d0170 con 0x7fcb6c1578d0 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb720d9700 1 --2- 172.21.15.81:0/3103718929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c1578d0 0x7fcb6c0cf4f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0098e0 tx=0x7fcb5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f8c22cc3476fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb710d7700 1 -- 172.21.15.81:0/3103718929 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00b640 con 0x7fcb6c1578d0 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb710d7700 1 -- 172.21.15.81:0/3103718929 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c00b7a0 con 0x7fcb6c1578d0 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.593+0000 7fcb710d7700 1 -- 172.21.15.81:0/3103718929 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00bb20 con 0x7fcb6c1578d0 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.594+0000 7fcb7433d700 1 -- 172.21.15.81:0/3103718929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c1578d0 msgr2=0x7fcb6c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.594+0000 7fcb7433d700 1 --2- 172.21.15.81:0/3103718929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c1578d0 0x7fcb6c0cf4f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0098e0 tx=0x7fcb5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.594+0000 7fcb7433d700 1 -- 172.21.15.81:0/3103718929 shutdown_connections 2023-10-06T02:51:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.594+0000 7fcb7433d700 1 --2- 172.21.15.81:0/3103718929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c1578d0 0x7fcb6c0cf4f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.594+0000 7fcb7433d700 1 -- 172.21.15.81:0/3103718929 >> 172.21.15.81:0/3103718929 conn(0x7fcb6c06bb90 msgr2=0x7fcb6c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.594+0000 7fcb7433d700 1 -- 172.21.15.81:0/3103718929 shutdown_connections 2023-10-06T02:51:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.594+0000 7fcb7433d700 1 -- 172.21.15.81:0/3103718929 wait complete. 2023-10-06T02:51:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.595+0000 7fcb7433d700 1 Processor -- start 2023-10-06T02:51:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.595+0000 7fcb7433d700 1 -- start start 2023-10-06T02:51:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb7433d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c06d120 0x7fcb6c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb7433d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb6c1578d0 0x7fcb6c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb7433d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c157ca0 0x7fcb6c1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb7433d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c16b000 con 0x7fcb6c06d120 2023-10-06T02:51:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb7433d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0c6580 con 0x7fcb6c157ca0 2023-10-06T02:51:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb7433d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0c5c50 con 0x7fcb6c1578d0 2023-10-06T02:51:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb720d9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c06d120 0x7fcb6c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb720d9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c06d120 0x7fcb6c0cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60456/0 (socket says 172.21.15.81:60456) 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb720d9700 1 -- 172.21.15.81:0/1752854601 learned_addr learned my addr 172.21.15.81:0/1752854601 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb718d8700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb6c1578d0 0x7fcb6c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb728da700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c157ca0 0x7fcb6c1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb720d9700 1 -- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb6c1578d0 msgr2=0x7fcb6c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb720d9700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb6c1578d0 0x7fcb6c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb720d9700 1 -- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c157ca0 msgr2=0x7fcb6c1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb720d9700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c157ca0 0x7fcb6c1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb720d9700 1 -- 172.21.15.81:0/1752854601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c009420 con 0x7fcb6c06d120 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb728da700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c157ca0 0x7fcb6c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb718d8700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb6c1578d0 0x7fcb6c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb720d9700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c06d120 0x7fcb6c0cd330 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009f80 tx=0x7fcb5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb627fc700 1 -- 172.21.15.81:0/1752854601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00b910 con 0x7fcb6c06d120 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb627fc700 1 -- 172.21.15.81:0/1752854601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c00bab0 con 0x7fcb6c06d120 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c0c5f30 con 0x7fcb6c06d120 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb627fc700 1 -- 172.21.15.81:0/1752854601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c025670 con 0x7fcb6c06d120 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.596+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c0cd870 con 0x7fcb6c06d120 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.597+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c067ac0 con 0x7fcb6c06d120 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.598+0000 7fcb627fc700 1 -- 172.21.15.81:0/1752854601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb5c023070 con 0x7fcb6c06d120 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.598+0000 7fcb627fc700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb50066f30 0x7fcb500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.598+0000 7fcb627fc700 1 -- 172.21.15.81:0/1752854601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fcb5c085b60 con 0x7fcb6c06d120 2023-10-06T02:51:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.598+0000 7fcb718d8700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb50066f30 0x7fcb500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:41.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.599+0000 7fcb718d8700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb50066f30 0x7fcb500693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcb68007fd0 tx=0x7fcb68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:41.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.602+0000 7fcb627fc700 1 -- 172.21.15.81:0/1752854601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb5c052cd0 con 0x7fcb6c06d120 2023-10-06T02:51:41.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:41.828+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcb6c0d0450 con 0x7fcb6c06d120 2023-10-06T02:51:42.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.460+0000 7fcb627fc700 1 -- 172.21.15.81:0/1752854601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcb5c0562f0 con 0x7fcb6c06d120 2023-10-06T02:51:42.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.462+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb50066f30 msgr2=0x7fcb500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:42.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.462+0000 7fcb7433d700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb50066f30 0x7fcb500693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcb68007fd0 tx=0x7fcb68009040 comp rx=0 tx=0).stop 2023-10-06T02:51:42.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.462+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c06d120 msgr2=0x7fcb6c0cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:42.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.462+0000 7fcb7433d700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c06d120 0x7fcb6c0cd330 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009f80 tx=0x7fcb5c017000 comp rx=0 tx=0).stop 2023-10-06T02:51:42.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.462+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 shutdown_connections 2023-10-06T02:51:42.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.462+0000 7fcb7433d700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcb50066f30 0x7fcb500693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:42.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.462+0000 7fcb7433d700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb6c157ca0 0x7fcb6c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:42.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.462+0000 7fcb7433d700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c06d120 0x7fcb6c0cd330 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:42.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.462+0000 7fcb7433d700 1 --2- 172.21.15.81:0/1752854601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcb6c1578d0 0x7fcb6c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:42.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.463+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 >> 172.21.15.81:0/1752854601 conn(0x7fcb6c06bb90 msgr2=0x7fcb6c15ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:42.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.463+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 shutdown_connections 2023-10-06T02:51:42.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.463+0000 7fcb7433d700 1 -- 172.21.15.81:0/1752854601 wait complete. 2023-10-06T02:51:42.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:51:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.633+0000 7fb021b27700 1 Processor -- start 2023-10-06T02:51:42.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.633+0000 7fb021b27700 1 -- start start 2023-10-06T02:51:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.634+0000 7fb021b27700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb01c1578d0 0x7fb01c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.634+0000 7fb021b27700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c06d120 0x7fb01c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.634+0000 7fb021b27700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c0d07c0 con 0x7fb01c157ca0 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.634+0000 7fb021b27700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c06daa0 con 0x7fb01c1578d0 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.634+0000 7fb021b27700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0cfbb0 con 0x7fb01c06d120 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.634+0000 7fb01affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb01c157ca0 0x7fb01c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39848/0 (socket says 172.21.15.81:39848) 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.634+0000 7fb01affd700 1 -- 172.21.15.81:0/1356233398 learned_addr learned my addr 172.21.15.81:0/1356233398 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.634+0000 7fb01b7fe700 1 --2- 172.21.15.81:0/1356233398 >> v2:172.21.15.83:3300/0 conn(0x7fb01c1578d0 0x7fb01c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.634+0000 7fb01bfff700 1 --2- 172.21.15.81:0/1356233398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c06d120 0x7fb01c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01a7fc700 1 -- 172.21.15.81:0/1356233398 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287456587 0 0) 0x7fb01c0d07c0 con 0x7fb01c157ca0 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01a7fc700 1 -- 172.21.15.81:0/1356233398 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb004003570 con 0x7fb01c157ca0 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01b7fe700 1 -- 172.21.15.81:0/1356233398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c06d120 msgr2=0x7fb01c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01b7fe700 1 --2- 172.21.15.81:0/1356233398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c06d120 0x7fb01c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01b7fe700 1 -- 172.21.15.81:0/1356233398 >> v1:172.21.15.81:6789/0 conn(0x7fb01c157ca0 legacy=0x7fb01c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:42.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01b7fe700 1 -- 172.21.15.81:0/1356233398 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0cfe90 con 0x7fb01c1578d0 2023-10-06T02:51:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01bfff700 1 --2- 172.21.15.81:0/1356233398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c06d120 0x7fb01c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01b7fe700 1 --2- 172.21.15.81:0/1356233398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb01c1578d0 0x7fb01c0cf4f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009e60 tx=0x7fb00c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7690f863f504bac5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01a7fc700 1 -- 172.21.15.81:0/1356233398 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00e070 con 0x7fb01c1578d0 2023-10-06T02:51:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01a7fc700 1 -- 172.21.15.81:0/1356233398 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00bab0 con 0x7fb01c1578d0 2023-10-06T02:51:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.635+0000 7fb01a7fc700 1 -- 172.21.15.81:0/1356233398 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00be30 con 0x7fb01c1578d0 2023-10-06T02:51:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.636+0000 7fb021b27700 1 -- 172.21.15.81:0/1356233398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb01c1578d0 msgr2=0x7fb01c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.636+0000 7fb021b27700 1 --2- 172.21.15.81:0/1356233398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb01c1578d0 0x7fb01c0cf4f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009e60 tx=0x7fb00c009780 comp rx=0 tx=0).stop 2023-10-06T02:51:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.636+0000 7fb021b27700 1 -- 172.21.15.81:0/1356233398 shutdown_connections 2023-10-06T02:51:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.636+0000 7fb021b27700 1 --2- 172.21.15.81:0/1356233398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c06d120 0x7fb01c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.636+0000 7fb021b27700 1 --2- 172.21.15.81:0/1356233398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb01c1578d0 0x7fb01c0cf4f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.636+0000 7fb021b27700 1 -- 172.21.15.81:0/1356233398 >> 172.21.15.81:0/1356233398 conn(0x7fb01c06bb90 msgr2=0x7fb01c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.636+0000 7fb021b27700 1 -- 172.21.15.81:0/1356233398 shutdown_connections 2023-10-06T02:51:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.636+0000 7fb021b27700 1 -- 172.21.15.81:0/1356233398 wait complete. 2023-10-06T02:51:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.637+0000 7fb021b27700 1 Processor -- start 2023-10-06T02:51:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.637+0000 7fb021b27700 1 -- start start 2023-10-06T02:51:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb021b27700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb01c06d120 0x7fb01c16a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb021b27700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c1578d0 0x7fb01c15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb021b27700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb01c157ca0 0x7fb01c0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb021b27700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c16aa10 con 0x7fb01c157ca0 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb021b27700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c6f10 con 0x7fb01c06d120 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb021b27700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c71f0 con 0x7fb01c1578d0 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb01c157ca0 0x7fb01c0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb01c157ca0 0x7fb01c0c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60468/0 (socket says 172.21.15.81:60468) 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01bfff700 1 -- 172.21.15.81:0/715917147 learned_addr learned my addr 172.21.15.81:0/715917147 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01affd700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c1578d0 0x7fb01c15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01b7fe700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb01c06d120 0x7fb01c16a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01bfff700 1 -- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c1578d0 msgr2=0x7fb01c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01bfff700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c1578d0 0x7fb01c15dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01bfff700 1 -- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb01c06d120 msgr2=0x7fb01c16a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01bfff700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb01c06d120 0x7fb01c16a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01bfff700 1 -- 172.21.15.81:0/715917147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014009420 con 0x7fb01c157ca0 2023-10-06T02:51:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb01bfff700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb01c157ca0 0x7fb01c0c64e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb01400ec80 tx=0x7fb0140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.638+0000 7fb0037fe700 1 -- 172.21.15.81:0/715917147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400c850 con 0x7fb01c157ca0 2023-10-06T02:51:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.639+0000 7fb0037fe700 1 -- 172.21.15.81:0/715917147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400c9b0 con 0x7fb01c157ca0 2023-10-06T02:51:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.639+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c009a20 con 0x7fb01c157ca0 2023-10-06T02:51:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.639+0000 7fb0037fe700 1 -- 172.21.15.81:0/715917147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400cd50 con 0x7fb01c157ca0 2023-10-06T02:51:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.639+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c0c7580 con 0x7fb01c157ca0 2023-10-06T02:51:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.640+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c067ac0 con 0x7fb01c157ca0 2023-10-06T02:51:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.640+0000 7fb0037fe700 1 -- 172.21.15.81:0/715917147 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb014013680 con 0x7fb01c157ca0 2023-10-06T02:51:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.640+0000 7fb0037fe700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb008066f30 0x7fb0080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.640+0000 7fb0037fe700 1 -- 172.21.15.81:0/715917147 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb0140846c0 con 0x7fb01c157ca0 2023-10-06T02:51:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.640+0000 7fb01b7fe700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb008066f30 0x7fb0080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.641+0000 7fb01b7fe700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb008066f30 0x7fb0080693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0097c0 tx=0x7fb00c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.644+0000 7fb0037fe700 1 -- 172.21.15.81:0/715917147 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb014051780 con 0x7fb01c157ca0 2023-10-06T02:51:42.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:42.826+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb01c0d0170 con 0x7fb01c157ca0 2023-10-06T02:51:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.644+0000 7fb0037fe700 1 -- 172.21.15.81:0/715917147 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb014054da0 con 0x7fb01c157ca0 2023-10-06T02:51:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb008066f30 msgr2=0x7fb0080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb008066f30 0x7fb0080693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0097c0 tx=0x7fb00c019000 comp rx=0 tx=0).stop 2023-10-06T02:51:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb01c157ca0 msgr2=0x7fb01c0c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb01c157ca0 0x7fb01c0c64e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb01400ec80 tx=0x7fb0140091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 shutdown_connections 2023-10-06T02:51:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb01c157ca0 0x7fb01c0c64e0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb008066f30 0x7fb0080693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb01c06d120 0x7fb01c16a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 --2- 172.21.15.81:0/715917147 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb01c1578d0 0x7fb01c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 >> 172.21.15.81:0/715917147 conn(0x7fb01c06bb90 msgr2=0x7fb01c068f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 shutdown_connections 2023-10-06T02:51:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.647+0000 7fb021b27700 1 -- 172.21.15.81:0/715917147 wait complete. 2023-10-06T02:51:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:51:43.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:51:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.781+0000 7fe70dc1d700 1 Processor -- start 2023-10-06T02:51:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.782+0000 7fe70dc1d700 1 -- start start 2023-10-06T02:51:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.782+0000 7fe70dc1d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe70806dd60 0x7fe7080b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.782+0000 7fe70dc1d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7080b0ca0 con 0x7fe70815a2a0 2023-10-06T02:51:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.782+0000 7fe70dc1d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7080b00d0 con 0x7fe7080cf240 2023-10-06T02:51:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.782+0000 7fe70dc1d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70806ea90 con 0x7fe70806dd60 2023-10-06T02:51:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.782+0000 7fe707fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe70806dd60 0x7fe7080b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.782+0000 7fe7077fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe70815a2a0 0x7fe7080ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39856/0 (socket says 172.21.15.81:39856) 2023-10-06T02:51:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.782+0000 7fe7077fe700 1 -- 172.21.15.81:0/4025632530 learned_addr learned my addr 172.21.15.81:0/4025632530 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe707fff700 1 -- 172.21.15.81:0/4025632530 >> v1:172.21.15.83:6789/0 conn(0x7fe7080cf240 legacy=0x7fe70806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe707fff700 1 -- 172.21.15.81:0/4025632530 >> v1:172.21.15.81:6789/0 conn(0x7fe70815a2a0 legacy=0x7fe7080ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe707fff700 1 -- 172.21.15.81:0/4025632530 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7080b0370 con 0x7fe70806dd60 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe7067fc700 1 -- 172.21.15.81:0/4025632530 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549345333 0 0) 0x7fe7080b0ca0 con 0x7fe70815a2a0 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe707fff700 1 --2- 172.21.15.81:0/4025632530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70806dd60 0x7fe7080b1130 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fe700009e60 tx=0x7fe700009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7a006d157f5719 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe7067fc700 1 -- 172.21.15.81:0/4025632530 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70000e070 con 0x7fe70806dd60 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe7067fc700 1 -- 172.21.15.81:0/4025632530 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70000bbf0 con 0x7fe70806dd60 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe7067fc700 1 -- 172.21.15.81:0/4025632530 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700012430 con 0x7fe70806dd60 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe70dc1d700 1 -- 172.21.15.81:0/4025632530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70806dd60 msgr2=0x7fe7080b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.783+0000 7fe70dc1d700 1 --2- 172.21.15.81:0/4025632530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70806dd60 0x7fe7080b1130 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fe700009e60 tx=0x7fe700009780 comp rx=0 tx=0).stop 2023-10-06T02:51:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.784+0000 7fe70dc1d700 1 -- 172.21.15.81:0/4025632530 shutdown_connections 2023-10-06T02:51:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.784+0000 7fe70dc1d700 1 --2- 172.21.15.81:0/4025632530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70806dd60 0x7fe7080b1130 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.784+0000 7fe70dc1d700 1 -- 172.21.15.81:0/4025632530 >> 172.21.15.81:0/4025632530 conn(0x7fe708067640 msgr2=0x7fe708067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.784+0000 7fe70dc1d700 1 -- 172.21.15.81:0/4025632530 shutdown_connections 2023-10-06T02:51:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.784+0000 7fe70dc1d700 1 -- 172.21.15.81:0/4025632530 wait complete. 2023-10-06T02:51:43.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.785+0000 7fe70dc1d700 1 Processor -- start 2023-10-06T02:51:43.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.785+0000 7fe70dc1d700 1 -- start start 2023-10-06T02:51:43.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.785+0000 7fe70dc1d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe70806dd60 0x7fe70816afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:43.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe70dc1d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7080cf240 0x7fe7081423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:43.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe70dc1d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70815a2a0 0x7fe70816b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe70dc1d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70816bb20 con 0x7fe70815a2a0 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe70dc1d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70816c960 con 0x7fe70806dd60 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe70dc1d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70816bd50 con 0x7fe7080cf240 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe707fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70815a2a0 0x7fe70816b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe707fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70815a2a0 0x7fe70816b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60472/0 (socket says 172.21.15.81:60472) 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe707fff700 1 -- 172.21.15.81:0/1149713210 learned_addr learned my addr 172.21.15.81:0/1149713210 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe7077fe700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe70806dd60 0x7fe70816afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe706ffd700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7080cf240 0x7fe7081423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe707fff700 1 -- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7080cf240 msgr2=0x7fe7081423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe707fff700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7080cf240 0x7fe7081423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe707fff700 1 -- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe70806dd60 msgr2=0x7fe70816afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe707fff700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe70806dd60 0x7fe70816afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe707fff700 1 -- 172.21.15.81:0/1149713210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe700009a20 con 0x7fe70815a2a0 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe706ffd700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7080cf240 0x7fe7081423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe7077fe700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe70806dd60 0x7fe70816afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe707fff700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70815a2a0 0x7fe70816b5e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe70806f990 tx=0x7fe700018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe6ef7fe700 1 -- 172.21.15.81:0/1149713210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70001d640 con 0x7fe70815a2a0 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe6ef7fe700 1 -- 172.21.15.81:0/1149713210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70001d7a0 con 0x7fe70815a2a0 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe6ef7fe700 1 -- 172.21.15.81:0/1149713210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70001db60 con 0x7fe70815a2a0 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.786+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70816c030 con 0x7fe70815a2a0 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.787+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70816c5f0 con 0x7fe70815a2a0 2023-10-06T02:51:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.788+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe708064650 con 0x7fe70815a2a0 2023-10-06T02:51:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.788+0000 7fe6ef7fe700 1 -- 172.21.15.81:0/1149713210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe700024070 con 0x7fe70815a2a0 2023-10-06T02:51:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.788+0000 7fe6ef7fe700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6f4066f30 0x7fe6f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.788+0000 7fe6ef7fe700 1 -- 172.21.15.81:0/1149713210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe700086fe0 con 0x7fe70815a2a0 2023-10-06T02:51:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.789+0000 7fe7077fe700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6f4066f30 0x7fe6f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.789+0000 7fe7077fe700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6f4066f30 0x7fe6f40693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe70815c1f0 tx=0x7fe6f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:43.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.792+0000 7fe6ef7fe700 1 -- 172.21.15.81:0/1149713210 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe700054250 con 0x7fe70815a2a0 2023-10-06T02:51:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:43.971+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7080683d0 con 0x7fe70815a2a0 2023-10-06T02:51:44.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.649+0000 7fe6ef7fe700 1 -- 172.21.15.81:0/1149713210 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe700057870 con 0x7fe70815a2a0 2023-10-06T02:51:44.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6f4066f30 msgr2=0x7fe6f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:44.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6f4066f30 0x7fe6f40693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe70815c1f0 tx=0x7fe6f8009040 comp rx=0 tx=0).stop 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70815a2a0 msgr2=0x7fe70816b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70815a2a0 0x7fe70816b5e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe70806f990 tx=0x7fe700018000 comp rx=0 tx=0).stop 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 shutdown_connections 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70815a2a0 0x7fe70816b5e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe6f4066f30 0x7fe6f40693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe70806dd60 0x7fe70816afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 --2- 172.21.15.81:0/1149713210 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7080cf240 0x7fe7081423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 >> 172.21.15.81:0/1149713210 conn(0x7fe708067640 msgr2=0x7fe7080cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 shutdown_connections 2023-10-06T02:51:44.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.653+0000 7fe70dc1d700 1 -- 172.21.15.81:0/1149713210 wait complete. 2023-10-06T02:51:44.656 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:51:44.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:51:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.782+0000 7f353e8fe700 1 Processor -- start 2023-10-06T02:51:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.782+0000 7f353e8fe700 1 -- start start 2023-10-06T02:51:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.783+0000 7f353e8fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f35381578d0 0x7f35380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.783+0000 7f353e8fe700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380d07c0 con 0x7f353806d120 2023-10-06T02:51:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.783+0000 7f353e8fe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380cfbb0 con 0x7f3538157ca0 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.783+0000 7f353e8fe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35380cfe90 con 0x7f35381578d0 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.783+0000 7f353ce9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f353806d120 0x7f353806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39868/0 (socket says 172.21.15.81:39868) 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.783+0000 7f353ce9b700 1 -- 172.21.15.81:0/3108873014 learned_addr learned my addr 172.21.15.81:0/3108873014 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.783+0000 7f3537fff700 1 --2- 172.21.15.81:0/3108873014 >> v2:172.21.15.83:3300/0 conn(0x7f35381578d0 0x7f35380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3536ffd700 1 -- 172.21.15.81:0/3108873014 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717776609 0 0) 0x7f35380d07c0 con 0x7f353806d120 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3536ffd700 1 -- 172.21.15.81:0/3108873014 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3520003570 con 0x7f353806d120 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3537fff700 1 -- 172.21.15.81:0/3108873014 >> v1:172.21.15.83:6789/0 conn(0x7f3538157ca0 legacy=0x7f353815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3537fff700 1 -- 172.21.15.81:0/3108873014 >> v1:172.21.15.81:6789/0 conn(0x7f353806d120 legacy=0x7f353806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3536ffd700 1 -- 172.21.15.81:0/3108873014 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3957565537 0 0) 0x7f3520003570 con 0x7f353806d120 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3537fff700 1 -- 172.21.15.81:0/3108873014 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380d0170 con 0x7f35381578d0 2023-10-06T02:51:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3537fff700 1 --2- 172.21.15.81:0/3108873014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35381578d0 0x7f35380cf4f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f35280098e0 tx=0x7f35280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7971d2d85a014df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3536ffd700 1 -- 172.21.15.81:0/3108873014 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800b640 con 0x7f35381578d0 2023-10-06T02:51:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3536ffd700 1 -- 172.21.15.81:0/3108873014 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352800b7a0 con 0x7f35381578d0 2023-10-06T02:51:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.784+0000 7f3536ffd700 1 -- 172.21.15.81:0/3108873014 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800bb20 con 0x7f35381578d0 2023-10-06T02:51:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.785+0000 7f353e8fe700 1 -- 172.21.15.81:0/3108873014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35381578d0 msgr2=0x7f35380cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.785+0000 7f353e8fe700 1 --2- 172.21.15.81:0/3108873014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35381578d0 0x7f35380cf4f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f35280098e0 tx=0x7f35280091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.785+0000 7f353e8fe700 1 -- 172.21.15.81:0/3108873014 shutdown_connections 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.785+0000 7f353e8fe700 1 --2- 172.21.15.81:0/3108873014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35381578d0 0x7f35380cf4f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.785+0000 7f353e8fe700 1 -- 172.21.15.81:0/3108873014 >> 172.21.15.81:0/3108873014 conn(0x7f353806bb90 msgr2=0x7f353806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.785+0000 7f353e8fe700 1 -- 172.21.15.81:0/3108873014 shutdown_connections 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.785+0000 7f353e8fe700 1 -- 172.21.15.81:0/3108873014 wait complete. 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.786+0000 7f353e8fe700 1 Processor -- start 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.786+0000 7f353e8fe700 1 -- start start 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353e8fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f353806d120 0x7f353816b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353e8fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35381578d0 0x7f353816b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353e8fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3538157ca0 0x7f353814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353e8fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538151f60 con 0x7f353806d120 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353e8fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538152520 con 0x7f3538157ca0 2023-10-06T02:51:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353e8fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3538151890 con 0x7f35381578d0 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f3537fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f353806d120 0x7f353816b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f3537fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f353806d120 0x7f353816b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60484/0 (socket says 172.21.15.81:60484) 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f3537fff700 1 -- 172.21.15.81:0/2303893933 learned_addr learned my addr 172.21.15.81:0/2303893933 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353ce9b700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3538157ca0 0x7f353814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f35377fe700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35381578d0 0x7f353816b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f3537fff700 1 -- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35381578d0 msgr2=0x7f353816b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f3537fff700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35381578d0 0x7f353816b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f3537fff700 1 -- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3538157ca0 msgr2=0x7f353814e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f3537fff700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3538157ca0 0x7f353814e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f3537fff700 1 -- 172.21.15.81:0/2303893933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528009420 con 0x7f353806d120 2023-10-06T02:51:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353ce9b700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3538157ca0 0x7f353814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f3537fff700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f353806d120 0x7f353816b2b0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f353806fe20 tx=0x7f3528017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f351ffff700 1 -- 172.21.15.81:0/2303893933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800bb20 con 0x7f353806d120 2023-10-06T02:51:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f351ffff700 1 -- 172.21.15.81:0/2303893933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352801a450 con 0x7f353806d120 2023-10-06T02:51:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3538151b70 con 0x7f353806d120 2023-10-06T02:51:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f351ffff700 1 -- 172.21.15.81:0/2303893933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352801a810 con 0x7f353806d120 2023-10-06T02:51:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.787+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353814ef10 con 0x7f353806d120 2023-10-06T02:51:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.788+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353815ea50 con 0x7f353806d120 2023-10-06T02:51:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.789+0000 7f351ffff700 1 -- 172.21.15.81:0/2303893933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f352801ac40 con 0x7f353806d120 2023-10-06T02:51:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.789+0000 7f351ffff700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3524066f30 0x7f35240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.789+0000 7f351ffff700 1 -- 172.21.15.81:0/2303893933 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3528085d10 con 0x7f353806d120 2023-10-06T02:51:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.789+0000 7f35377fe700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3524066f30 0x7f35240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.790+0000 7f35377fe700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3524066f30 0x7f35240693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f353814f630 tx=0x7f352c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.794+0000 7f351ffff700 1 -- 172.21.15.81:0/2303893933 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3528053120 con 0x7f353806d120 2023-10-06T02:51:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.976+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f35380d0450 con 0x7f353806d120 2023-10-06T02:51:44.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.980+0000 7f351ffff700 1 -- 172.21.15.81:0/2303893933 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3528056740 con 0x7f353806d120 2023-10-06T02:51:44.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3524066f30 msgr2=0x7f35240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3524066f30 0x7f35240693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f353814f630 tx=0x7f352c009040 comp rx=0 tx=0).stop 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f353806d120 msgr2=0x7f353816b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f353806d120 0x7f353816b2b0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f353806fe20 tx=0x7f3528017000 comp rx=0 tx=0).stop 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 shutdown_connections 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3524066f30 0x7f35240693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3538157ca0 0x7f353814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f353806d120 0x7f353816b2b0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 --2- 172.21.15.81:0/2303893933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35381578d0 0x7f353816b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 >> 172.21.15.81:0/2303893933 conn(0x7f353806bb90 msgr2=0x7f353815a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 shutdown_connections 2023-10-06T02:51:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:44.982+0000 7f353e8fe700 1 -- 172.21.15.81:0/2303893933 wait complete. 2023-10-06T02:51:44.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-06T02:51:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.108+0000 7f2a0359e700 1 Processor -- start 2023-10-06T02:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.108+0000 7f2a0359e700 1 -- start start 2023-10-06T02:51:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.109+0000 7f2a0359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2a04159b40 0x7f2a040cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.109+0000 7f2a0359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a04159f10 0x7f2a04068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.109+0000 7f2a0359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a040cee10 con 0x7f2a040ccb40 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.109+0000 7f2a0359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a040cd040 con 0x7f2a04159f10 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.109+0000 7f2a0359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a040cd320 con 0x7f2a04159b40 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.109+0000 7f2a01d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a04159f10 0x7f2a04068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.109+0000 7f2a02d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2a040ccb40 0x7f2a0415d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39872/0 (socket says 172.21.15.81:39872) 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.109+0000 7f2a02d9d700 1 -- 172.21.15.81:0/369102721 learned_addr learned my addr 172.21.15.81:0/369102721 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.109+0000 7f2a01d9b700 1 -- 172.21.15.81:0/369102721 >> v2:172.21.15.83:3300/0 conn(0x7f2a04159b40 msgr2=0x7f2a040cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0259c700 1 --2- 172.21.15.81:0/369102721 >> v2:172.21.15.83:3300/0 conn(0x7f2a04159b40 0x7f2a040cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a01d9b700 1 --2- 172.21.15.81:0/369102721 >> v2:172.21.15.83:3300/0 conn(0x7f2a04159b40 0x7f2a040cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0159a700 1 -- 172.21.15.81:0/369102721 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632562100 0 0) 0x7f2a040cee10 con 0x7f2a040ccb40 2023-10-06T02:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a01d9b700 1 -- 172.21.15.81:0/369102721 >> v1:172.21.15.81:6789/0 conn(0x7f2a040ccb40 legacy=0x7f2a0415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a01d9b700 1 -- 172.21.15.81:0/369102721 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040ce7c0 con 0x7f2a04159f10 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a01d9b700 1 --2- 172.21.15.81:0/369102721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04159f10 0x7f2a04068780 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2a040d0bc0 tx=0x7f29f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd044b8275e4fe02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0159a700 1 -- 172.21.15.81:0/369102721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800b6b0 con 0x7f2a04159f10 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0159a700 1 -- 172.21.15.81:0/369102721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f800b810 con 0x7f2a04159f10 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0159a700 1 -- 172.21.15.81:0/369102721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800bbb0 con 0x7f2a04159f10 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0359e700 1 -- 172.21.15.81:0/369102721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04159f10 msgr2=0x7f2a04068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0359e700 1 --2- 172.21.15.81:0/369102721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04159f10 0x7f2a04068780 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2a040d0bc0 tx=0x7f29f80091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0359e700 1 -- 172.21.15.81:0/369102721 shutdown_connections 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0359e700 1 --2- 172.21.15.81:0/369102721 >> v2:172.21.15.83:3300/0 conn(0x7f2a04159b40 0x7f2a040cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0359e700 1 --2- 172.21.15.81:0/369102721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04159f10 0x7f2a04068780 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.110+0000 7f2a0359e700 1 -- 172.21.15.81:0/369102721 >> 172.21.15.81:0/369102721 conn(0x7f2a040cd660 msgr2=0x7f2a040cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.111+0000 7f2a0359e700 1 -- 172.21.15.81:0/369102721 shutdown_connections 2023-10-06T02:51:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.111+0000 7f2a0359e700 1 -- 172.21.15.81:0/369102721 wait complete. 2023-10-06T02:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0359e700 1 Processor -- start 2023-10-06T02:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0359e700 1 -- start start 2023-10-06T02:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040ccb40 0x7f2a04154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a04159b40 0x7f2a04157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a04159f10 0x7f2a040c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04157180 con 0x7f2a040ccb40 2023-10-06T02:51:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04154fc0 con 0x7f2a04159f10 2023-10-06T02:51:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a041562d0 con 0x7f2a04159b40 2023-10-06T02:51:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040ccb40 0x7f2a04154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.112+0000 7f2a0259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040ccb40 0x7f2a04154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60504/0 (socket says 172.21.15.81:60504) 2023-10-06T02:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a0259c700 1 -- 172.21.15.81:0/3487128100 learned_addr learned my addr 172.21.15.81:0/3487128100 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a02d9d700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a04159f10 0x7f2a040c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a01d9b700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a04159b40 0x7f2a04157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a0259c700 1 -- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a04159b40 msgr2=0x7f2a04157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a0259c700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a04159b40 0x7f2a04157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a0259c700 1 -- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a04159f10 msgr2=0x7f2a040c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a0259c700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a04159f10 0x7f2a040c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a0259c700 1 -- 172.21.15.81:0/3487128100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f8009420 con 0x7f2a040ccb40 2023-10-06T02:51:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a0259c700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040ccb40 0x7f2a04154a80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f29f4007fc0 tx=0x7f29f40078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f29f27fc700 1 -- 172.21.15.81:0/3487128100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f400adb0 con 0x7f2a040ccb40 2023-10-06T02:51:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f29f27fc700 1 -- 172.21.15.81:0/3487128100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f4016430 con 0x7f2a040ccb40 2023-10-06T02:51:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a04156570 con 0x7f2a040ccb40 2023-10-06T02:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f29f27fc700 1 -- 172.21.15.81:0/3487128100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f40167d0 con 0x7f2a040ccb40 2023-10-06T02:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.113+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a04156b30 con 0x7f2a040ccb40 2023-10-06T02:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.114+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a04157460 con 0x7f2a040ccb40 2023-10-06T02:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.114+0000 7f29f27fc700 1 -- 172.21.15.81:0/3487128100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29f4003020 con 0x7f2a040ccb40 2023-10-06T02:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.115+0000 7f29f27fc700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f29e4066f30 0x7f29e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.115+0000 7f29f27fc700 1 -- 172.21.15.81:0/3487128100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f29f4012070 con 0x7f2a040ccb40 2023-10-06T02:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.115+0000 7f2a01d9b700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f29e4066f30 0x7f29e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.115+0000 7f2a01d9b700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f29e4066f30 0x7f29e40693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f29f80093f0 tx=0x7f29f8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.119+0000 7f29f27fc700 1 -- 172.21.15.81:0/3487128100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29f40525c0 con 0x7f2a040ccb40 2023-10-06T02:51:45.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.382+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f2a040cb980 con 0x7f2a040ccb40 2023-10-06T02:51:45.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.652+0000 7f29f27fc700 1 -- 172.21.15.81:0/3487128100 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v294) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2a040cb980 con 0x7f2a040ccb40 2023-10-06T02:51:45.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f29e4066f30 msgr2=0x7f29e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f29e4066f30 0x7f29e40693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f29f80093f0 tx=0x7f29f8017000 comp rx=0 tx=0).stop 2023-10-06T02:51:45.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040ccb40 msgr2=0x7f2a04154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040ccb40 0x7f2a04154a80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f29f4007fc0 tx=0x7f29f40078b0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 shutdown_connections 2023-10-06T02:51:45.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f29e4066f30 0x7f29e40693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a04159f10 0x7f2a040c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040ccb40 0x7f2a04154a80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 --2- 172.21.15.81:0/3487128100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a04159b40 0x7f2a04157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 >> 172.21.15.81:0/3487128100 conn(0x7f2a040cd660 msgr2=0x7f2a040b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:45.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 shutdown_connections 2023-10-06T02:51:45.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.655+0000 7f2a0359e700 1 -- 172.21.15.81:0/3487128100 wait complete. 2023-10-06T02:51:45.668 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-06T02:51:45.668 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-06T02:51:45.668 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-10-06T02:51:45.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-06T02:51:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.781+0000 7f944a36e700 1 Processor -- start 2023-10-06T02:51:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.781+0000 7f944a36e700 1 -- start start 2023-10-06T02:51:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f944a36e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9444157ca0 0x7f94440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f944a36e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94440d07c0 con 0x7f94441578d0 2023-10-06T02:51:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f944a36e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94440cfbb0 con 0x7f944406d120 2023-10-06T02:51:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f944a36e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94440cfe90 con 0x7f9444157ca0 2023-10-06T02:51:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f94437fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9444157ca0 0x7f94440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f9443fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f94441578d0 0x7f944415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39886/0 (socket says 172.21.15.81:39886) 2023-10-06T02:51:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f9443fff700 1 -- 172.21.15.81:0/4251859332 learned_addr learned my addr 172.21.15.81:0/4251859332 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f94437fe700 1 -- 172.21.15.81:0/4251859332 >> v1:172.21.15.83:6789/0 conn(0x7f944406d120 legacy=0x7f944406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f94437fe700 1 -- 172.21.15.81:0/4251859332 >> v1:172.21.15.81:6789/0 conn(0x7f94441578d0 legacy=0x7f944415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f94437fe700 1 -- 172.21.15.81:0/4251859332 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94440d0170 con 0x7f9444157ca0 2023-10-06T02:51:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f9442ffd700 1 -- 172.21.15.81:0/4251859332 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272625220 0 0) 0x7f94440d07c0 con 0x7f94441578d0 2023-10-06T02:51:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.782+0000 7f94437fe700 1 --2- 172.21.15.81:0/4251859332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9444157ca0 0x7f94440cf4f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f94380098e0 tx=0x7f94380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a28de8c59db4c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f9442ffd700 1 -- 172.21.15.81:0/4251859332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438009e80 con 0x7f9444157ca0 2023-10-06T02:51:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f9442ffd700 1 -- 172.21.15.81:0/4251859332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943800b820 con 0x7f9444157ca0 2023-10-06T02:51:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f9442ffd700 1 -- 172.21.15.81:0/4251859332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943800bba0 con 0x7f9444157ca0 2023-10-06T02:51:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f944a36e700 1 -- 172.21.15.81:0/4251859332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9444157ca0 msgr2=0x7f94440cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f944a36e700 1 --2- 172.21.15.81:0/4251859332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9444157ca0 0x7f94440cf4f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f94380098e0 tx=0x7f94380091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f944a36e700 1 -- 172.21.15.81:0/4251859332 shutdown_connections 2023-10-06T02:51:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f944a36e700 1 --2- 172.21.15.81:0/4251859332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9444157ca0 0x7f94440cf4f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f944a36e700 1 -- 172.21.15.81:0/4251859332 >> 172.21.15.81:0/4251859332 conn(0x7f944406bb90 msgr2=0x7f944406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f944a36e700 1 -- 172.21.15.81:0/4251859332 shutdown_connections 2023-10-06T02:51:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.783+0000 7f944a36e700 1 -- 172.21.15.81:0/4251859332 wait complete. 2023-10-06T02:51:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.784+0000 7f944a36e700 1 Processor -- start 2023-10-06T02:51:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.784+0000 7f944a36e700 1 -- start start 2023-10-06T02:51:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.785+0000 7f944a36e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f944406d120 0x7f9444154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.785+0000 7f944a36e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94441578d0 0x7f944416b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.785+0000 7f944a36e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9444157ca0 0x7f94441590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.785+0000 7f944a36e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9444155150 con 0x7f944406d120 2023-10-06T02:51:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.785+0000 7f944a36e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440ac420 con 0x7f94441578d0 2023-10-06T02:51:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.785+0000 7f944a36e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944416b7b0 con 0x7f9444157ca0 2023-10-06T02:51:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.785+0000 7f9443fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f944406d120 0x7f9444154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.785+0000 7f9443fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f944406d120 0x7f9444154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60516/0 (socket says 172.21.15.81:60516) 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.785+0000 7f9443fff700 1 -- 172.21.15.81:0/675064964 learned_addr learned my addr 172.21.15.81:0/675064964 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f9443fff700 1 -- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9444157ca0 msgr2=0x7f94441590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f9443fff700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9444157ca0 0x7f94441590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f94437fe700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94441578d0 0x7f944416b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f9443fff700 1 -- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94441578d0 msgr2=0x7f944416b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f9443fff700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94441578d0 0x7f944416b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f9443fff700 1 -- 172.21.15.81:0/675064964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438009420 con 0x7f944406d120 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f9443fff700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f944406d120 0x7f9444154c10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f943400c7e0 tx=0x7f9434007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f942bfff700 1 -- 172.21.15.81:0/675064964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434005b30 con 0x7f944406d120 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f942bfff700 1 -- 172.21.15.81:0/675064964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9434005c90 con 0x7f944406d120 2023-10-06T02:51:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94440abaf0 con 0x7f944406d120 2023-10-06T02:51:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f942bfff700 1 -- 172.21.15.81:0/675064964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434007300 con 0x7f944406d120 2023-10-06T02:51:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.786+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94440ac0b0 con 0x7f944406d120 2023-10-06T02:51:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.787+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944415a180 con 0x7f944406d120 2023-10-06T02:51:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.787+0000 7f942bfff700 1 -- 172.21.15.81:0/675064964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f943401b400 con 0x7f944406d120 2023-10-06T02:51:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.787+0000 7f942bfff700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9430066f30 0x7f94300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.787+0000 7f942bfff700 1 -- 172.21.15.81:0/675064964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9434083fb0 con 0x7f944406d120 2023-10-06T02:51:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.788+0000 7f94437fe700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9430066f30 0x7f94300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.788+0000 7f94437fe700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9430066f30 0x7f94300693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f94441580c0 tx=0x7f9438016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:45.792+0000 7f942bfff700 1 -- 172.21.15.81:0/675064964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94340513a0 con 0x7f944406d120 2023-10-06T02:51:46.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.049+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f94440d0450 con 0x7f944406d120 2023-10-06T02:51:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.651+0000 7f942bfff700 1 -- 172.21.15.81:0/675064964 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v295) v1 ==== 131+0+0 (secure 0 0 0) 0x7f94340549c0 con 0x7f944406d120 2023-10-06T02:51:46.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9430066f30 msgr2=0x7f94300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9430066f30 0x7f94300693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f94441580c0 tx=0x7f9438016000 comp rx=0 tx=0).stop 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f944406d120 msgr2=0x7f9444154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f944406d120 0x7f9444154c10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f943400c7e0 tx=0x7f9434007df0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 shutdown_connections 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9444157ca0 0x7f94441590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f944406d120 0x7f9444154c10 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9430066f30 0x7f94300693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 --2- 172.21.15.81:0/675064964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94441578d0 0x7f944416b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 >> 172.21.15.81:0/675064964 conn(0x7f944406bb90 msgr2=0x7f9444069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 shutdown_connections 2023-10-06T02:51:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.653+0000 7f944a36e700 1 -- 172.21.15.81:0/675064964 wait complete. 2023-10-06T02:51:46.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:51:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.782+0000 7fb1c1b94700 1 Processor -- start 2023-10-06T02:51:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.782+0000 7fb1c1b94700 1 -- start start 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1c1b94700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1bc0d0b80 0x7fb1bc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1c1b94700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc0cf2d0 con 0x7fb1bc06d700 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1c1b94700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc06dc00 con 0x7fb1bc0d02b0 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1c1b94700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc15a690 con 0x7fb1bc0d0b80 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1c1393700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb1bc06d700 0x7fb1bc15b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39890/0 (socket says 172.21.15.81:39890) 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1c1393700 1 -- 172.21.15.81:0/766875862 learned_addr learned my addr 172.21.15.81:0/766875862 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722387066 0 0) 0x7fb1bc0cf2d0 con 0x7fb1bc06d700 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1ac003570 con 0x7fb1bc06d700 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1c0b92700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1bc0d0b80 0x7fb1bc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1374000348 0 0) 0x7fb1ac003570 con 0x7fb1bc06d700 2023-10-06T02:51:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1bc0d0b80 msgr2=0x7fb1bc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1bb7fe700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1bc0d0b80 0x7fb1bc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.783+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 >> v1:172.21.15.83:6789/0 conn(0x7fb1bc0d02b0 legacy=0x7fb1bc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc0cf570 con 0x7fb1bc06d700 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fb1b40017f0 con 0x7fb1bc06d700 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 >> v1:172.21.15.81:6789/0 conn(0x7fb1bc06d700 legacy=0x7fb1bc15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac003a90 0x7fb1ac003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1ac004810 0x7fb1ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1bc0d0b80 0x7fb1ac0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc15a690 con 0x7fb1ac003a90 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac00bb60 con 0x7fb1ac004810 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac00bd20 con 0x7fb1bc0d0b80 2023-10-06T02:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1c0b92700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac003a90 0x7fb1ac003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1c1393700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1bc0d0b80 0x7fb1ac0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bbfff700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1ac004810 0x7fb1ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1c0b92700 1 -- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1bc0d0b80 msgr2=0x7fb1ac0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1c0b92700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1bc0d0b80 0x7fb1ac0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1c0b92700 1 -- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1ac004810 msgr2=0x7fb1ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1c0b92700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1ac004810 0x7fb1ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1c0b92700 1 -- 172.21.15.81:0/766875862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac003570 con 0x7fb1ac003a90 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1c0b92700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac003a90 0x7fb1ac003ea0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009c00 tx=0x7fb1b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac3d84d344cee7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b000e710 con 0x7fb1ac003a90 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b000e870 con 0x7fb1ac003a90 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.784+0000 7fb1bb7fe700 1 -- 172.21.15.81:0/766875862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b000ec30 con 0x7fb1ac003a90 2023-10-06T02:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.785+0000 7fb1c1b94700 1 -- 172.21.15.81:0/766875862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac003a90 msgr2=0x7fb1ac003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.785+0000 7fb1c1b94700 1 --2- 172.21.15.81:0/766875862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac003a90 0x7fb1ac003ea0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009c00 tx=0x7fb1b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.785+0000 7fb1c1393700 1 -- 172.21.15.81:0/766875862 reap_dead start 2023-10-06T02:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.785+0000 7fb1c1b94700 1 -- 172.21.15.81:0/766875862 shutdown_connections 2023-10-06T02:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.785+0000 7fb1c1b94700 1 -- 172.21.15.81:0/766875862 >> 172.21.15.81:0/766875862 conn(0x7fb1bc063230 msgr2=0x7fb1bc063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.785+0000 7fb1c1b94700 1 -- 172.21.15.81:0/766875862 shutdown_connections 2023-10-06T02:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.785+0000 7fb1c1b94700 1 -- 172.21.15.81:0/766875862 wait complete. 2023-10-06T02:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.786+0000 7fb1c1b94700 1 Processor -- start 2023-10-06T02:51:46.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.786+0000 7fb1c1b94700 1 -- start start 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1b94700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1ac003a90 0x7fb1bc16b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1b94700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0adef0 0x7fb1bc1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1b94700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1bc16a030 0x7fb1bc069a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1b94700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc16ba50 con 0x7fb1bc16a030 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1b94700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc156a10 con 0x7fb1bc0adef0 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1b94700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc16b1f0 con 0x7fb1ac003a90 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1393700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1bc16a030 0x7fb1bc069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1393700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1bc16a030 0x7fb1bc069a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60536/0 (socket says 172.21.15.81:60536) 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1393700 1 -- 172.21.15.81:0/1027453454 learned_addr learned my addr 172.21.15.81:0/1027453454 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1bbfff700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0adef0 0x7fb1bc1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c0b92700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1ac003a90 0x7fb1bc16b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1393700 1 -- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1ac003a90 msgr2=0x7fb1bc16b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1393700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1ac003a90 0x7fb1bc16b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1393700 1 -- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0adef0 msgr2=0x7fb1bc1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1393700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0adef0 0x7fb1bc1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1393700 1 -- 172.21.15.81:0/1027453454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc16a950 con 0x7fb1bc16a030 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1393700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1bc16a030 0x7fb1bc069a30 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4001350 tx=0x7fb1b400e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1b8ff9700 1 -- 172.21.15.81:0/1027453454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b400eb80 con 0x7fb1bc16a030 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1b8ff9700 1 -- 172.21.15.81:0/1027453454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b400ece0 con 0x7fb1bc16a030 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1bc16ac30 con 0x7fb1bc16a030 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.787+0000 7fb1b8ff9700 1 -- 172.21.15.81:0/1027453454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4013670 con 0x7fb1bc16a030 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.788+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc0ab7b0 con 0x7fb1bc16a030 2023-10-06T02:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.788+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc0ab600 con 0x7fb1bc16a030 2023-10-06T02:51:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.789+0000 7fb1b8ff9700 1 -- 172.21.15.81:0/1027453454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1b4013a20 con 0x7fb1bc16a030 2023-10-06T02:51:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.789+0000 7fb1b8ff9700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1a0066f30 0x7fb1a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.789+0000 7fb1b8ff9700 1 -- 172.21.15.81:0/1027453454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb1b4084930 con 0x7fb1bc16a030 2023-10-06T02:51:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.789+0000 7fb1c0b92700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1a0066f30 0x7fb1a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.790+0000 7fb1c0b92700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1a0066f30 0x7fb1a00693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00091e0 tx=0x7fb1b001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.793+0000 7fb1b8ff9700 1 -- 172.21.15.81:0/1027453454 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1b4051d40 con 0x7fb1bc16a030 2023-10-06T02:51:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.973+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb1bc0676e0 con 0x7fb1bc16a030 2023-10-06T02:51:46.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.976+0000 7fb1b8ff9700 1 -- 172.21.15.81:0/1027453454 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb1b4055360 con 0x7fb1bc16a030 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1a0066f30 msgr2=0x7fb1a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1a0066f30 0x7fb1a00693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00091e0 tx=0x7fb1b001a000 comp rx=0 tx=0).stop 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1bc16a030 msgr2=0x7fb1bc069a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1bc16a030 0x7fb1bc069a30 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4001350 tx=0x7fb1b400e440 comp rx=0 tx=0).stop 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 shutdown_connections 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1bc16a030 0x7fb1bc069a30 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1ac003a90 0x7fb1bc16b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1a0066f30 0x7fb1a00693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 --2- 172.21.15.81:0/1027453454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1bc0adef0 0x7fb1bc1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 >> 172.21.15.81:0/1027453454 conn(0x7fb1bc063230 msgr2=0x7fb1bc1582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:46.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 shutdown_connections 2023-10-06T02:51:46.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:46.978+0000 7fb1c1b94700 1 -- 172.21.15.81:0/1027453454 wait complete. 2023-10-06T02:51:46.991 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:51:46.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:51:47.040 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:51:47.082 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:51:47.082 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:51:47.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:47.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.195+0000 7f3b3b892700 1 Processor -- start 2023-10-06T02:51:47.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.195+0000 7f3b3b892700 1 -- start start 2023-10-06T02:51:47.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b3b892700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b34157ca0 0x7f3b340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b3b892700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3b3406d120 0x7f3b3406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b3b892700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340d07c0 con 0x7f3b341578d0 2023-10-06T02:51:47.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b3b892700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3406da50 con 0x7f3b34157ca0 2023-10-06T02:51:47.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b3b892700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b340cfbb0 con 0x7f3b3406d120 2023-10-06T02:51:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b38e2d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b34157ca0 0x7f3b340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b38e2d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b34157ca0 0x7f3b340cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60552/0 (socket says 172.21.15.81:60552) 2023-10-06T02:51:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b38e2d700 1 -- 172.21.15.81:0/1595041283 learned_addr learned my addr 172.21.15.81:0/1595041283 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b39e2f700 1 --2- 172.21.15.81:0/1595041283 >> v2:172.21.15.83:3300/0 conn(0x7f3b3406d120 0x7f3b3406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b38e2d700 1 -- 172.21.15.81:0/1595041283 >> v2:172.21.15.83:3300/0 conn(0x7f3b3406d120 msgr2=0x7f3b3406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b38e2d700 1 --2- 172.21.15.81:0/1595041283 >> v2:172.21.15.83:3300/0 conn(0x7f3b3406d120 0x7f3b3406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b38e2d700 1 -- 172.21.15.81:0/1595041283 >> v1:172.21.15.83:6789/0 conn(0x7f3b341578d0 legacy=0x7f3b3415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.196+0000 7f3b38e2d700 1 -- 172.21.15.81:0/1595041283 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340cfe90 con 0x7f3b34157ca0 2023-10-06T02:51:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b38e2d700 1 --2- 172.21.15.81:0/1595041283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 0x7f3b340cf4f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f3b34068300 tx=0x7f3b24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5d8de9a8abdc7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b2bfff700 1 -- 172.21.15.81:0/1595041283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400b820 con 0x7f3b34157ca0 2023-10-06T02:51:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b2bfff700 1 -- 172.21.15.81:0/1595041283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400b980 con 0x7f3b34157ca0 2023-10-06T02:51:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b2bfff700 1 -- 172.21.15.81:0/1595041283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400bd20 con 0x7f3b34157ca0 2023-10-06T02:51:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b3b892700 1 -- 172.21.15.81:0/1595041283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 msgr2=0x7f3b340cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b3b892700 1 --2- 172.21.15.81:0/1595041283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 0x7f3b340cf4f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f3b34068300 tx=0x7f3b24009250 comp rx=0 tx=0).stop 2023-10-06T02:51:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b3b892700 1 -- 172.21.15.81:0/1595041283 shutdown_connections 2023-10-06T02:51:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b3b892700 1 --2- 172.21.15.81:0/1595041283 >> v2:172.21.15.83:3300/0 conn(0x7f3b3406d120 0x7f3b3406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b3b892700 1 --2- 172.21.15.81:0/1595041283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 0x7f3b340cf4f0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b3b892700 1 -- 172.21.15.81:0/1595041283 >> 172.21.15.81:0/1595041283 conn(0x7f3b3406bb90 msgr2=0x7f3b3406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:47.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b3b892700 1 -- 172.21.15.81:0/1595041283 shutdown_connections 2023-10-06T02:51:47.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.197+0000 7f3b3b892700 1 -- 172.21.15.81:0/1595041283 wait complete. 2023-10-06T02:51:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.198+0000 7f3b3b892700 1 Processor -- start 2023-10-06T02:51:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.199+0000 7f3b3b892700 1 -- start start 2023-10-06T02:51:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.199+0000 7f3b3b892700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b3406d120 0x7f3b341539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.199+0000 7f3b3b892700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b341578d0 0x7f3b340b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.199+0000 7f3b3b892700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 0x7f3b340c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.199+0000 7f3b3b892700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340b50b0 con 0x7f3b34157ca0 2023-10-06T02:51:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.199+0000 7f3b3b892700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340b44a0 con 0x7f3b341578d0 2023-10-06T02:51:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.199+0000 7f3b3b892700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340b4780 con 0x7f3b3406d120 2023-10-06T02:51:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b39e2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 0x7f3b340c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b39e2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 0x7f3b340c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60566/0 (socket says 172.21.15.81:60566) 2023-10-06T02:51:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b39e2f700 1 -- 172.21.15.81:0/2623182089 learned_addr learned my addr 172.21.15.81:0/2623182089 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b38e2d700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b341578d0 0x7f3b340b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b3962e700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b3406d120 0x7f3b341539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b39e2f700 1 -- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b3406d120 msgr2=0x7f3b341539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b39e2f700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b3406d120 0x7f3b341539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b39e2f700 1 -- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b341578d0 msgr2=0x7f3b340b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b39e2f700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b341578d0 0x7f3b340b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b39e2f700 1 -- 172.21.15.81:0/2623182089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b240094f0 con 0x7f3b34157ca0 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b3962e700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b3406d120 0x7f3b341539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b39e2f700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 0x7f3b340c5b20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00d890 tx=0x7f3b2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b297fa700 1 -- 172.21.15.81:0/2623182089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0125f0 con 0x7f3b34157ca0 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b297fa700 1 -- 172.21.15.81:0/2623182089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c012770 con 0x7f3b34157ca0 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b340b4a60 con 0x7f3b34157ca0 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b297fa700 1 -- 172.21.15.81:0/2623182089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c012b30 con 0x7f3b34157ca0 2023-10-06T02:51:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.200+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b34153ef0 con 0x7f3b34157ca0 2023-10-06T02:51:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.201+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b340b5260 con 0x7f3b34157ca0 2023-10-06T02:51:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.201+0000 7f3b297fa700 1 -- 172.21.15.81:0/2623182089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b2c01e460 con 0x7f3b34157ca0 2023-10-06T02:51:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.202+0000 7f3b297fa700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b18066f30 0x7f3b180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.202+0000 7f3b297fa700 1 -- 172.21.15.81:0/2623182089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3b2c084980 con 0x7f3b34157ca0 2023-10-06T02:51:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.202+0000 7f3b3962e700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b18066f30 0x7f3b180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.203+0000 7f3b3962e700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b18066f30 0x7f3b180693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3b30007fd0 tx=0x7f3b30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.206+0000 7f3b297fa700 1 -- 172.21.15.81:0/2623182089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b340b5260 con 0x7f3b34157ca0 2023-10-06T02:51:47.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.428+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b340b5260 con 0x7f3b34157ca0 2023-10-06T02:51:47.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.429+0000 7f3b297fa700 1 -- 172.21.15.81:0/2623182089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f3b340b5260 con 0x7f3b34157ca0 2023-10-06T02:51:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:47.431 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3534447953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3534447953},{"type":"v1","addr":"172.21.15.83:6835","nonce":3534447953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2182532684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2182532684},{"type":"v1","addr":"172.21.15.83:6837","nonce":2182532684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6462,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2327685121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2327685121},{"type":"v1","addr":"172.21.15.81:6834","nonce":2327685121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6813,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1351800068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1351800068},{"type":"v1","addr":"172.21.15.81:6835","nonce":1351800068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[]} 2023-10-06T02:51:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b18066f30 msgr2=0x7f3b180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b18066f30 0x7f3b180693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3b30007fd0 tx=0x7f3b30009040 comp rx=0 tx=0).stop 2023-10-06T02:51:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 msgr2=0x7f3b340c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 0x7f3b340c5b20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00d890 tx=0x7f3b2c008040 comp rx=0 tx=0).stop 2023-10-06T02:51:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 shutdown_connections 2023-10-06T02:51:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b34157ca0 0x7f3b340c5b20 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3b3406d120 0x7f3b341539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3b18066f30 0x7f3b180693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 --2- 172.21.15.81:0/2623182089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b341578d0 0x7f3b340b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 >> 172.21.15.81:0/2623182089 conn(0x7f3b3406bb90 msgr2=0x7f3b3415e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 shutdown_connections 2023-10-06T02:51:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.431+0000 7f3b3b892700 1 -- 172.21.15.81:0/2623182089 wait complete. 2023-10-06T02:51:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 54 2023-10-06T02:51:47.444 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:51:47.444 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:51:47.444 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:51:47.445 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:51:47.445 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:51:47.445 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:51:47.445 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:51:47.445 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:51:47.445 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:51:47.446 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:51:47.446 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:51:47.446 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:51:47.446 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:51:47.446 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:51:47.446 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:51:47.447 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:51:47.453 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:51:47.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:51:47.454 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:51:47.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:51:47.456 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:51:47.456 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:51:47.457 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:51:47.457 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:51:47.496 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:51:47.496 DEBUG:teuthology.parallel:result is None 2023-10-06T02:51:47.496 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:51:47.497 DEBUG:teuthology.parallel:result is None 2023-10-06T02:51:47.499 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:51:47.499 DEBUG:teuthology.parallel:result is None 2023-10-06T02:51:47.500 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:51:47.500 DEBUG:teuthology.parallel:result is None 2023-10-06T02:51:47.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:51:47.568 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:51:47.569 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:51:47.579 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:51:47.580 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:51:47.580 INFO:tasks.ceph.mds.d.smithi083.stderr:2023-10-06T02:51:47.578+0000 7f2a2fa97700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T02:51:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.619+0000 7ff06345f700 1 Processor -- start 2023-10-06T02:51:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.619+0000 7ff06345f700 1 -- start start 2023-10-06T02:51:47.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff06345f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c157ca0 0x7ff05c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff06345f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff05c06d120 0x7ff05c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff06345f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c06dac0 con 0x7ff05c1578d0 2023-10-06T02:51:47.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff06345f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c0d07c0 con 0x7ff05c06d120 2023-10-06T02:51:47.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff06345f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0cfbb0 con 0x7ff05c157ca0 2023-10-06T02:51:47.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0609fa700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c157ca0 0x7ff05c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0619fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff05c06d120 0x7ff05c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0619fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff05c06d120 0x7ff05c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38432/0 (socket says 172.21.15.81:38432) 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0611fb700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff05c1578d0 0x7ff05c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:55170/0 (socket says 172.21.15.81:55170) 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0619fc700 1 -- 172.21.15.81:0/3742577163 learned_addr learned my addr 172.21.15.81:0/3742577163 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0609fa700 1 --2- 172.21.15.81:0/3742577163 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c157ca0 0x7ff05c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:47222/0 (socket says 172.21.15.81:47222) 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0619fc700 1 -- 172.21.15.81:0/3742577163 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c157ca0 msgr2=0x7ff05c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0619fc700 1 --2- 172.21.15.81:0/3742577163 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c157ca0 0x7ff05c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0619fc700 1 -- 172.21.15.81:0/3742577163 >> v1:172.21.15.83:6789/0 conn(0x7ff05c1578d0 legacy=0x7ff05c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff053fff700 1 -- 172.21.15.81:0/3742577163 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198024199 0 0) 0x7ff054001490 con 0x7ff05c1578d0 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.620+0000 7ff0619fc700 1 -- 172.21.15.81:0/3742577163 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0cfe90 con 0x7ff05c06d120 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff0619fc700 1 --2- 172.21.15.81:0/3742577163 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c06d120 0x7ff05c06d580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff0580099b0 tx=0x7ff058009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b779596c21ef77b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:47.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff053fff700 1 -- 172.21.15.81:0/3742577163 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058009ea0 con 0x7ff05c06d120 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff053fff700 1 -- 172.21.15.81:0/3742577163 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800b860 con 0x7ff05c06d120 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff053fff700 1 -- 172.21.15.81:0/3742577163 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800bc00 con 0x7ff05c06d120 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff06345f700 1 -- 172.21.15.81:0/3742577163 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c06d120 msgr2=0x7ff05c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff06345f700 1 --2- 172.21.15.81:0/3742577163 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c06d120 0x7ff05c06d580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff0580099b0 tx=0x7ff058009250 comp rx=0 tx=0).stop 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff06345f700 1 -- 172.21.15.81:0/3742577163 shutdown_connections 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff06345f700 1 --2- 172.21.15.81:0/3742577163 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c06d120 0x7ff05c06d580 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff06345f700 1 --2- 172.21.15.81:0/3742577163 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c157ca0 0x7ff05c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff06345f700 1 -- 172.21.15.81:0/3742577163 >> 172.21.15.81:0/3742577163 conn(0x7ff05c06bb90 msgr2=0x7ff05c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff06345f700 1 -- 172.21.15.81:0/3742577163 shutdown_connections 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.621+0000 7ff06345f700 1 -- 172.21.15.81:0/3742577163 wait complete. 2023-10-06T02:51:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.622+0000 7ff06345f700 1 Processor -- start 2023-10-06T02:51:47.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.622+0000 7ff06345f700 1 -- start start 2023-10-06T02:51:47.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff06345f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c06d120 0x7ff05c0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff06345f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c1578d0 0x7ff05c0adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff06345f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c157ca0 0x7ff05c16dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff06345f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0abe80 con 0x7ff05c157ca0 2023-10-06T02:51:47.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff06345f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0ab270 con 0x7ff05c1578d0 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff06345f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0ab550 con 0x7ff05c06d120 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff0619fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c157ca0 0x7ff05c16dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff0619fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c157ca0 0x7ff05c16dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60618/0 (socket says 172.21.15.81:60618) 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff0611fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c06d120 0x7ff05c0ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff0619fc700 1 -- 172.21.15.81:0/1764313346 learned_addr learned my addr 172.21.15.81:0/1764313346 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.623+0000 7ff0609fa700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c1578d0 0x7ff05c0adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0619fc700 1 -- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c06d120 msgr2=0x7ff05c0ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0619fc700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c06d120 0x7ff05c0ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0619fc700 1 -- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c1578d0 msgr2=0x7ff05c0adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:47.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0619fc700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c1578d0 0x7ff05c0adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0619fc700 1 -- 172.21.15.81:0/1764313346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580094f0 con 0x7ff05c157ca0 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0611fb700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c06d120 0x7ff05c0ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0609fa700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c1578d0 0x7ff05c0adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0619fc700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c157ca0 0x7ff05c16dc90 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff058006fd0 tx=0x7ff058017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0517fa700 1 -- 172.21.15.81:0/1764313346 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800baa0 con 0x7ff05c157ca0 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0517fa700 1 -- 172.21.15.81:0/1764313346 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff058025420 con 0x7ff05c157ca0 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff0517fa700 1 -- 172.21.15.81:0/1764313346 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0580257e0 con 0x7ff05c157ca0 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c0ab830 con 0x7ff05c157ca0 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.624+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c16e1d0 con 0x7ff05c157ca0 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.625+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c0ac030 con 0x7ff05c157ca0 2023-10-06T02:51:47.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.625+0000 7ff0517fa700 1 -- 172.21.15.81:0/1764313346 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff058023070 con 0x7ff05c157ca0 2023-10-06T02:51:47.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.626+0000 7ff0517fa700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff040066f30 0x7ff0400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:47.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.626+0000 7ff0517fa700 1 -- 172.21.15.81:0/1764313346 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff058085a70 con 0x7ff05c157ca0 2023-10-06T02:51:47.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.626+0000 7ff0611fb700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff040066f30 0x7ff0400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:47.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.626+0000 7ff0611fb700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff040066f30 0x7ff0400693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff054007320 tx=0x7ff054001ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:47.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.630+0000 7ff0517fa700 1 -- 172.21.15.81:0/1764313346 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff058052de0 con 0x7ff05c157ca0 2023-10-06T02:51:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:47.834+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff05c0d0170 con 0x7ff05c157ca0 2023-10-06T02:51:48.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.666+0000 7ff0517fa700 1 -- 172.21.15.81:0/1764313346 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v116) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff058056400 con 0x7ff05c157ca0 2023-10-06T02:51:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff040066f30 msgr2=0x7ff0400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff040066f30 0x7ff0400693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff054007320 tx=0x7ff054001ad0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c157ca0 msgr2=0x7ff05c16dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c157ca0 0x7ff05c16dc90 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff058006fd0 tx=0x7ff058017000 comp rx=0 tx=0).stop 2023-10-06T02:51:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 shutdown_connections 2023-10-06T02:51:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c157ca0 0x7ff05c16dc90 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff05c06d120 0x7ff05c0ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff040066f30 0x7ff0400693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 --2- 172.21.15.81:0/1764313346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff05c1578d0 0x7ff05c0adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 >> 172.21.15.81:0/1764313346 conn(0x7ff05c06bb90 msgr2=0x7ff05c155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 shutdown_connections 2023-10-06T02:51:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.668+0000 7ff06345f700 1 -- 172.21.15.81:0/1764313346 wait complete. 2023-10-06T02:51:48.671 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:51:48.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:51:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.798+0000 7f25e6d39700 1 Processor -- start 2023-10-06T02:51:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.798+0000 7f25e6d39700 1 -- start start 2023-10-06T02:51:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e6d39700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f25e0159b40 0x7f25e00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e6d39700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0068e90 0x7f25e00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e6d39700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e00cee10 con 0x7f25e0159f10 2023-10-06T02:51:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e6d39700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e00cd040 con 0x7f25e0159b40 2023-10-06T02:51:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e6d39700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00cd320 con 0x7f25e0068e90 2023-10-06T02:51:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e5536700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f25e0159f10 0x7f25e0068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39918/0 (socket says 172.21.15.81:39918) 2023-10-06T02:51:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e5536700 1 -- 172.21.15.81:0/3720248562 learned_addr learned my addr 172.21.15.81:0/3720248562 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e6538700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0068e90 0x7f25e00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e5d37700 1 --2- 172.21.15.81:0/3720248562 >> v2:172.21.15.83:3300/0 conn(0x7f25e0159b40 0x7f25e00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622708330 0 0) 0x7f25e00cee10 con 0x7f25e0159f10 2023-10-06T02:51:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25cc003570 con 0x7f25e0159f10 2023-10-06T02:51:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3123931431 0 0) 0x7f25cc003570 con 0x7f25e0159f10 2023-10-06T02:51:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0068e90 msgr2=0x7f25e00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e4d35700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0068e90 0x7f25e00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 >> v2:172.21.15.83:3300/0 conn(0x7f25e0159b40 msgr2=0x7f25e00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e4d35700 1 --2- 172.21.15.81:0/3720248562 >> v2:172.21.15.83:3300/0 conn(0x7f25e0159b40 0x7f25e00cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00ce7c0 con 0x7f25e0159f10 2023-10-06T02:51:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.799+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f25d0001470 con 0x7f25e0159f10 2023-10-06T02:51:48.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 >> v1:172.21.15.81:6789/0 conn(0x7f25e0159f10 legacy=0x7f25e0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25cc003a60 0x7f25cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0068e90 0x7f25cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc004d50 0x7f25cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00cd040 con 0x7f25cc004d50 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00cd320 con 0x7f25cc003a60 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc00ba60 con 0x7f25e0068e90 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e6538700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc004d50 0x7f25cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e5536700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0068e90 0x7f25cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e5d37700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25cc003a60 0x7f25cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:48.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e6538700 1 -- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0068e90 msgr2=0x7f25cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e6538700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0068e90 0x7f25cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e6538700 1 -- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25cc003a60 msgr2=0x7f25cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e6538700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25cc003a60 0x7f25cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e6538700 1 -- 172.21.15.81:0/3720248562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc003570 con 0x7f25cc004d50 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e6538700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc004d50 0x7f25cc0051c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f25e0069290 tx=0x7f25d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5a116bfef3aaed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800e9a0 con 0x7f25cc004d50 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d800f040 con 0x7f25cc004d50 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.800+0000 7f25e4d35700 1 -- 172.21.15.81:0/3720248562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800ed50 con 0x7f25cc004d50 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.801+0000 7f25e6d39700 1 -- 172.21.15.81:0/3720248562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc004d50 msgr2=0x7f25cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.801+0000 7f25e6d39700 1 --2- 172.21.15.81:0/3720248562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc004d50 0x7f25cc0051c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f25e0069290 tx=0x7f25d800b040 comp rx=0 tx=0).stop 2023-10-06T02:51:48.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.801+0000 7f25e6538700 1 -- 172.21.15.81:0/3720248562 reap_dead start 2023-10-06T02:51:48.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.801+0000 7f25e6d39700 1 -- 172.21.15.81:0/3720248562 shutdown_connections 2023-10-06T02:51:48.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.801+0000 7f25e6d39700 1 -- 172.21.15.81:0/3720248562 >> 172.21.15.81:0/3720248562 conn(0x7f25e00cd660 msgr2=0x7f25e00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:48.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.801+0000 7f25e6d39700 1 -- 172.21.15.81:0/3720248562 shutdown_connections 2023-10-06T02:51:48.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.801+0000 7f25e6d39700 1 -- 172.21.15.81:0/3720248562 wait complete. 2023-10-06T02:51:48.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.802+0000 7f25e6d39700 1 Processor -- start 2023-10-06T02:51:48.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.802+0000 7f25e6d39700 1 -- start start 2023-10-06T02:51:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6d39700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25cc004d50 0x7f25e016ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6d39700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0167780 0x7f25e0156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6d39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e016b410 0x7f25e016b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6d39700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00c9a30 con 0x7f25e016b410 2023-10-06T02:51:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6d39700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00c8e20 con 0x7f25cc004d50 2023-10-06T02:51:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6d39700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00c9100 con 0x7f25e0167780 2023-10-06T02:51:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6538700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e016b410 0x7f25e016b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6538700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e016b410 0x7f25e016b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60646/0 (socket says 172.21.15.81:60646) 2023-10-06T02:51:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6538700 1 -- 172.21.15.81:0/3305446 learned_addr learned my addr 172.21.15.81:0/3305446 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e5d37700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25cc004d50 0x7f25e016ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e5536700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0167780 0x7f25e0156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6538700 1 -- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0167780 msgr2=0x7f25e0156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6538700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0167780 0x7f25e0156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6538700 1 -- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25cc004d50 msgr2=0x7f25e016ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6538700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25cc004d50 0x7f25e016ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6538700 1 -- 172.21.15.81:0/3305446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00c93e0 con 0x7f25e016b410 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25e6538700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e016b410 0x7f25e016b860 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f25d8016000 tx=0x7f25d801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.803+0000 7f25d5ffb700 1 -- 172.21.15.81:0/3305446 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800ee40 con 0x7f25e016b410 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.804+0000 7f25d5ffb700 1 -- 172.21.15.81:0/3305446 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d801d630 con 0x7f25e016b410 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.804+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e00c96c0 con 0x7f25e016b410 2023-10-06T02:51:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.804+0000 7f25d5ffb700 1 -- 172.21.15.81:0/3305446 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d801d9f0 con 0x7f25e016b410 2023-10-06T02:51:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.804+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e0156bb0 con 0x7f25e016b410 2023-10-06T02:51:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.805+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e00c9ba0 con 0x7f25e016b410 2023-10-06T02:51:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.805+0000 7f25d5ffb700 1 -- 172.21.15.81:0/3305446 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25d80133e0 con 0x7f25e016b410 2023-10-06T02:51:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.805+0000 7f25d5ffb700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f25c4066f30 0x7f25c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.805+0000 7f25d5ffb700 1 -- 172.21.15.81:0/3305446 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f25d80856b0 con 0x7f25e016b410 2023-10-06T02:51:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.806+0000 7f25e5d37700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f25c4066f30 0x7f25c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.806+0000 7f25e5d37700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f25c4066f30 0x7f25c40693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006ed0 tx=0x7f25dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:48.809+0000 7f25d5ffb700 1 -- 172.21.15.81:0/3305446 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25d8052af0 con 0x7f25e016b410 2023-10-06T02:51:49.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.066+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f25e0063e90 con 0x7f25e016b410 2023-10-06T02:51:49.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.067+0000 7f25d5ffb700 1 -- 172.21.15.81:0/3305446 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f25d8056110 con 0x7f25e016b410 2023-10-06T02:51:49.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:49.068 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:51:49.068 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:51:49.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.068 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:51:49.068 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:51:49.068 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:51:49.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:51:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:51:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:51:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:51:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:51:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:51:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:51:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:51:49.083 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:51:49.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f25c4066f30 msgr2=0x7f25c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f25c4066f30 0x7f25c40693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006ed0 tx=0x7f25dc008040 comp rx=0 tx=0).stop 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e016b410 msgr2=0x7f25e016b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e016b410 0x7f25e016b860 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f25d8016000 tx=0x7f25d801a000 comp rx=0 tx=0).stop 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 shutdown_connections 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e016b410 0x7f25e016b860 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f25c4066f30 0x7f25c40693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25cc004d50 0x7f25e016ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 --2- 172.21.15.81:0/3305446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f25e0167780 0x7f25e0156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 >> 172.21.15.81:0/3305446 conn(0x7f25e00cd660 msgr2=0x7f25e00cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 shutdown_connections 2023-10-06T02:51:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.069+0000 7f25e6d39700 1 -- 172.21.15.81:0/3305446 wait complete. 2023-10-06T02:51:49.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.198+0000 7f9edb64c700 1 Processor -- start 2023-10-06T02:51:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.199+0000 7f9edb64c700 1 -- start start 2023-10-06T02:51:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.199+0000 7f9edb64c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9ed40c2f80 0x7f9ed40c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.199+0000 7f9edb64c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed40c9120 con 0x7f9ed40af190 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.199+0000 7f9edb64c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed40c7620 con 0x7f9ed40aedc0 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.199+0000 7f9edb64c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed415e840 con 0x7f9ed40c2f80 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ed8be7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9ed40af190 0x7f9ed40c2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39920/0 (socket says 172.21.15.81:39920) 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ed8be7700 1 -- 172.21.15.81:0/3488432798 learned_addr learned my addr 172.21.15.81:0/3488432798 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ed9be9700 1 --2- 172.21.15.81:0/3488432798 >> v2:172.21.15.83:3300/0 conn(0x7f9ed40c2f80 0x7f9ed40c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ecbfff700 1 -- 172.21.15.81:0/3488432798 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193961868 0 0) 0x7f9ed40c9120 con 0x7f9ed40af190 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ecbfff700 1 -- 172.21.15.81:0/3488432798 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec0003570 con 0x7f9ed40af190 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ecbfff700 1 -- 172.21.15.81:0/3488432798 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263390389 0 0) 0x7f9ed40c7620 con 0x7f9ed40aedc0 2023-10-06T02:51:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ecbfff700 1 -- 172.21.15.81:0/3488432798 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed40c9120 con 0x7f9ed40aedc0 2023-10-06T02:51:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ed9be9700 1 -- 172.21.15.81:0/3488432798 >> v1:172.21.15.83:6789/0 conn(0x7f9ed40aedc0 legacy=0x7f9ed4068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ed9be9700 1 -- 172.21.15.81:0/3488432798 >> v1:172.21.15.81:6789/0 conn(0x7f9ed40af190 legacy=0x7f9ed40c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ecbfff700 1 -- 172.21.15.81:0/3488432798 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 806007213 0 0) 0x7f9ec0003570 con 0x7f9ed40af190 2023-10-06T02:51:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ed9be9700 1 -- 172.21.15.81:0/3488432798 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40c23e0 con 0x7f9ed40c2f80 2023-10-06T02:51:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ed9be9700 1 --2- 172.21.15.81:0/3488432798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40c2f80 0x7f9ed40c8b20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009e60 tx=0x7f9ecc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4655d09e3e90766a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.200+0000 7f9ecbfff700 1 -- 172.21.15.81:0/3488432798 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00e070 con 0x7f9ed40c2f80 2023-10-06T02:51:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.201+0000 7f9ecbfff700 1 -- 172.21.15.81:0/3488432798 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc00b7a0 con 0x7f9ed40c2f80 2023-10-06T02:51:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.201+0000 7f9ecbfff700 1 -- 172.21.15.81:0/3488432798 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4001470 con 0x7f9ed40c2f80 2023-10-06T02:51:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.201+0000 7f9edb64c700 1 -- 172.21.15.81:0/3488432798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40c2f80 msgr2=0x7f9ed40c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.201+0000 7f9edb64c700 1 --2- 172.21.15.81:0/3488432798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40c2f80 0x7f9ed40c8b20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009e60 tx=0x7f9ecc009780 comp rx=0 tx=0).stop 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.201+0000 7f9edb64c700 1 -- 172.21.15.81:0/3488432798 shutdown_connections 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.201+0000 7f9edb64c700 1 --2- 172.21.15.81:0/3488432798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40c2f80 0x7f9ed40c8b20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.201+0000 7f9edb64c700 1 -- 172.21.15.81:0/3488432798 >> 172.21.15.81:0/3488432798 conn(0x7f9ed406c660 msgr2=0x7f9ed40cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.201+0000 7f9edb64c700 1 -- 172.21.15.81:0/3488432798 shutdown_connections 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.201+0000 7f9edb64c700 1 -- 172.21.15.81:0/3488432798 wait complete. 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.202+0000 7f9edb64c700 1 Processor -- start 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.202+0000 7f9edb64c700 1 -- start start 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9edb64c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40aedc0 0x7f9ed40c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9edb64c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ed40af190 0x7f9ed416fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9edb64c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed40c2f80 0x7f9ed40adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9edb64c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4170e70 con 0x7f9ed40c2f80 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9edb64c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4170260 con 0x7f9ed40aedc0 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9edb64c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4170540 con 0x7f9ed40af190 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed9be9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed40c2f80 0x7f9ed40adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed9be9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed40c2f80 0x7f9ed40adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60652/0 (socket says 172.21.15.81:60652) 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed9be9700 1 -- 172.21.15.81:0/2500074601 learned_addr learned my addr 172.21.15.81:0/2500074601 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed93e8700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40aedc0 0x7f9ed40c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed8be7700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ed40af190 0x7f9ed416fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed9be9700 1 -- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ed40af190 msgr2=0x7f9ed416fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed9be9700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ed40af190 0x7f9ed416fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed9be9700 1 -- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40aedc0 msgr2=0x7f9ed40c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed9be9700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40aedc0 0x7f9ed40c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed9be9700 1 -- 172.21.15.81:0/2500074601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc009a20 con 0x7f9ed40c2f80 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.203+0000 7f9ed93e8700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40aedc0 0x7f9ed40c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.204+0000 7f9ed9be9700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed40c2f80 0x7f9ed40adcd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0099f0 tx=0x7f9ecc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.204+0000 7f9ec97fa700 1 -- 172.21.15.81:0/2500074601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc012d60 con 0x7f9ed40c2f80 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.204+0000 7f9ec97fa700 1 -- 172.21.15.81:0/2500074601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc01e450 con 0x7f9ed40c2f80 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.204+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed4170820 con 0x7f9ed40c2f80 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.204+0000 7f9ec97fa700 1 -- 172.21.15.81:0/2500074601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc01e810 con 0x7f9ed40c2f80 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.204+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed416ff50 con 0x7f9ed40c2f80 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.205+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed4067bc0 con 0x7f9ed40c2f80 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.205+0000 7f9ec97fa700 1 -- 172.21.15.81:0/2500074601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ecc01ebc0 con 0x7f9ed40c2f80 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.205+0000 7f9ec97fa700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9eb8066f30 0x7f9eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.205+0000 7f9ec97fa700 1 -- 172.21.15.81:0/2500074601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9ecc086830 con 0x7f9ed40c2f80 2023-10-06T02:51:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.206+0000 7f9ed93e8700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9eb8066f30 0x7f9eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.206+0000 7f9ed93e8700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9eb8066f30 0x7f9eb80693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.210+0000 7f9ec97fa700 1 -- 172.21.15.81:0/2500074601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ecc053c90 con 0x7f9ed40c2f80 2023-10-06T02:51:49.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.394+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ed4170fb0 con 0x7f9ed40c2f80 2023-10-06T02:51:49.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.395+0000 7f9ec97fa700 1 -- 172.21.15.81:0/2500074601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+13606 (secure 0 0 0) 0x7f9ecc0572b0 con 0x7f9ed40c2f80 2023-10-06T02:51:49.397 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:49.397 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":116,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:48.663003+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9eb8066f30 msgr2=0x7f9eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9eb8066f30 0x7f9eb80693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed0009040 comp rx=0 tx=0).stop 2023-10-06T02:51:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed40c2f80 msgr2=0x7f9ed40adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed40c2f80 0x7f9ed40adcd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0099f0 tx=0x7f9ecc017000 comp rx=0 tx=0).stop 2023-10-06T02:51:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 shutdown_connections 2023-10-06T02:51:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed40c2f80 0x7f9ed40adcd0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9eb8066f30 0x7f9eb80693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ed40aedc0 0x7f9ed40c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 --2- 172.21.15.81:0/2500074601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9ed40af190 0x7f9ed416fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 >> 172.21.15.81:0/2500074601 conn(0x7f9ed406c660 msgr2=0x7f9ed415ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:49.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 shutdown_connections 2023-10-06T02:51:49.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.397+0000 7f9edb64c700 1 -- 172.21.15.81:0/2500074601 wait complete. 2023-10-06T02:51:49.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:51:49.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:51:49.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.527+0000 7f9f23e26700 1 Processor -- start 2023-10-06T02:51:49.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.528+0000 7f9f23e26700 1 -- start start 2023-10-06T02:51:49.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.528+0000 7f9f23e26700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f1c157ab0 0x7f9f1c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.528+0000 7f9f23e26700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9f1c06c2a0 0x7f9f1c06a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.528+0000 7f9f23e26700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c15bc10 con 0x7f9f1c15c5e0 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.528+0000 7f9f23e26700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1c158ba0 con 0x7f9f1c157ab0 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.528+0000 7f9f23e26700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1c158e80 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.528+0000 7f9f21bc2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f1c157ab0 0x7f9f1c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.528+0000 7f9f213c1700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9f1c15c5e0 0x7f9f1c06bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39934/0 (socket says 172.21.15.81:39934) 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f213c1700 1 -- 172.21.15.81:0/4075484881 learned_addr learned my addr 172.21.15.81:0/4075484881 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f21bc2700 1 -- 172.21.15.81:0/4075484881 >> v2:172.21.15.83:3300/0 conn(0x7f9f1c06c2a0 msgr2=0x7f9f1c06a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f223c3700 1 --2- 172.21.15.81:0/4075484881 >> v2:172.21.15.83:3300/0 conn(0x7f9f1c06c2a0 0x7f9f1c06a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f21bc2700 1 --2- 172.21.15.81:0/4075484881 >> v2:172.21.15.83:3300/0 conn(0x7f9f1c06c2a0 0x7f9f1c06a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f20bc0700 1 -- 172.21.15.81:0/4075484881 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582977430 0 0) 0x7f9f1c15bc10 con 0x7f9f1c15c5e0 2023-10-06T02:51:49.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f21bc2700 1 -- 172.21.15.81:0/4075484881 >> v1:172.21.15.81:6789/0 conn(0x7f9f1c15c5e0 legacy=0x7f9f1c06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f21bc2700 1 -- 172.21.15.81:0/4075484881 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c159160 con 0x7f9f1c157ab0 2023-10-06T02:51:49.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f223c3700 1 --2- 172.21.15.81:0/4075484881 >> v2:172.21.15.83:3300/0 conn(0x7f9f1c06c2a0 0x7f9f1c06a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:49.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f21bc2700 1 --2- 172.21.15.81:0/4075484881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157ab0 0x7f9f1c15c0a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c068570 tx=0x7f9f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9717b994d0d54a99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:49.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f20bc0700 1 -- 172.21.15.81:0/4075484881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800b6b0 con 0x7f9f1c157ab0 2023-10-06T02:51:49.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f20bc0700 1 -- 172.21.15.81:0/4075484881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1800b810 con 0x7f9f1c157ab0 2023-10-06T02:51:49.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.529+0000 7f9f20bc0700 1 -- 172.21.15.81:0/4075484881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800bbb0 con 0x7f9f1c157ab0 2023-10-06T02:51:49.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.530+0000 7f9f23e26700 1 -- 172.21.15.81:0/4075484881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157ab0 msgr2=0x7f9f1c15c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.530+0000 7f9f23e26700 1 --2- 172.21.15.81:0/4075484881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157ab0 0x7f9f1c15c0a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c068570 tx=0x7f9f180091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.530+0000 7f9f23e26700 1 -- 172.21.15.81:0/4075484881 shutdown_connections 2023-10-06T02:51:49.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.530+0000 7f9f23e26700 1 --2- 172.21.15.81:0/4075484881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c157ab0 0x7f9f1c15c0a0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.530+0000 7f9f23e26700 1 --2- 172.21.15.81:0/4075484881 >> v2:172.21.15.83:3300/0 conn(0x7f9f1c06c2a0 0x7f9f1c06a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.530+0000 7f9f23e26700 1 -- 172.21.15.81:0/4075484881 >> 172.21.15.81:0/4075484881 conn(0x7f9f1c0c9ca0 msgr2=0x7f9f1c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:49.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.530+0000 7f9f23e26700 1 -- 172.21.15.81:0/4075484881 shutdown_connections 2023-10-06T02:51:49.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.530+0000 7f9f23e26700 1 -- 172.21.15.81:0/4075484881 wait complete. 2023-10-06T02:51:49.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.531+0000 7f9f23e26700 1 Processor -- start 2023-10-06T02:51:49.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.531+0000 7f9f23e26700 1 -- start start 2023-10-06T02:51:49.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.531+0000 7f9f23e26700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c06c2a0 0x7f9f1c0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.531+0000 7f9f23e26700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c157ab0 0x7f9f1c167fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.531+0000 7f9f23e26700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c15c5e0 0x7f9f1c153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.531+0000 7f9f23e26700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0c4770 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.531+0000 7f9f23e26700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0c4a50 con 0x7f9f1c157ab0 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.531+0000 7f9f23e26700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0c4d30 con 0x7f9f1c15c5e0 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f21bc2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c06c2a0 0x7f9f1c0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f21bc2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c06c2a0 0x7f9f1c0b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60668/0 (socket says 172.21.15.81:60668) 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f21bc2700 1 -- 172.21.15.81:0/590368634 learned_addr learned my addr 172.21.15.81:0/590368634 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f213c1700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c157ab0 0x7f9f1c167fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f223c3700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c15c5e0 0x7f9f1c153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f21bc2700 1 -- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c15c5e0 msgr2=0x7f9f1c153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f21bc2700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c15c5e0 0x7f9f1c153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f21bc2700 1 -- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c157ab0 msgr2=0x7f9f1c167fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f21bc2700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c157ab0 0x7f9f1c167fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f21bc2700 1 -- 172.21.15.81:0/590368634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18009420 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f21bc2700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c06c2a0 0x7f9f1c0b1ec0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c06ebb0 tx=0x7f9f18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f11ffb700 1 -- 172.21.15.81:0/590368634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18011420 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f11ffb700 1 -- 172.21.15.81:0/590368634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f18011580 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c0c5010 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f11ffb700 1 -- 172.21.15.81:0/590368634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18011920 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.532+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c168510 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.533+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c068080 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.534+0000 7f9f11ffb700 1 -- 172.21.15.81:0/590368634 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f18011d10 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.534+0000 7f9f11ffb700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.534+0000 7f9f11ffb700 1 -- 172.21.15.81:0/590368634 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9f18085de0 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.534+0000 7f9f213c1700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.535+0000 7f9f213c1700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c8f0 tx=0x7f9f0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:49.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.538+0000 7f9f11ffb700 1 -- 172.21.15.81:0/590368634 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f180532c0 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.722+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f1c15b8a0 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.723+0000 7f9f11ffb700 1 -- 172.21.15.81:0/590368634 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f180150a0 con 0x7f9f1c06c2a0 2023-10-06T02:51:49.724 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:51:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.724+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 msgr2=0x7f9f000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.724+0000 7f9f23e26700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c8f0 tx=0x7f9f0c009040 comp rx=0 tx=0).stop 2023-10-06T02:51:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.724+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c06c2a0 msgr2=0x7f9f1c0b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.724+0000 7f9f23e26700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c06c2a0 0x7f9f1c0b1ec0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c06ebb0 tx=0x7f9f18017000 comp rx=0 tx=0).stop 2023-10-06T02:51:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.724+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 shutdown_connections 2023-10-06T02:51:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.724+0000 7f9f23e26700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f1c15c5e0 0x7f9f1c153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.724+0000 7f9f23e26700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c06c2a0 0x7f9f1c0b1ec0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.724+0000 7f9f23e26700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9f00066f30 0x7f9f000693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.724+0000 7f9f23e26700 1 --2- 172.21.15.81:0/590368634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f1c157ab0 0x7f9f1c167fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.725+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 >> 172.21.15.81:0/590368634 conn(0x7f9f1c0c9ca0 msgr2=0x7f9f1c0c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.725+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 shutdown_connections 2023-10-06T02:51:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.725+0000 7f9f23e26700 1 -- 172.21.15.81:0/590368634 wait complete. 2023-10-06T02:51:49.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:51:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.855+0000 7f8d18803700 1 Processor -- start 2023-10-06T02:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.855+0000 7f8d18803700 1 -- start start 2023-10-06T02:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d18803700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d140d0b80 0x7f8d140cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d18803700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8d1406d700 0x7f8d1415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d18803700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d140cf2d0 con 0x7f8d140d02b0 2023-10-06T02:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d18803700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1415a690 con 0x7f8d140d0b80 2023-10-06T02:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d18803700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1406dc00 con 0x7f8d1406d700 2023-10-06T02:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d12d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d140d0b80 0x7f8d140cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d0a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8d140d02b0 0x7f8d1406cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39938/0 (socket says 172.21.15.81:39938) 2023-10-06T02:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d0a59c700 1 -- 172.21.15.81:0/3802042291 learned_addr learned my addr 172.21.15.81:0/3802042291 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d1359e700 1 --2- 172.21.15.81:0/3802042291 >> v2:172.21.15.83:3300/0 conn(0x7f8d1406d700 0x7f8d1415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.856+0000 7f8d12d9d700 1 -- 172.21.15.81:0/3802042291 >> v2:172.21.15.83:3300/0 conn(0x7f8d1406d700 msgr2=0x7f8d1415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d12d9d700 1 --2- 172.21.15.81:0/3802042291 >> v2:172.21.15.83:3300/0 conn(0x7f8d1406d700 0x7f8d1415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d12d9d700 1 -- 172.21.15.81:0/3802042291 >> v1:172.21.15.81:6789/0 conn(0x7f8d140d02b0 legacy=0x7f8d1406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d12d9d700 1 -- 172.21.15.81:0/3802042291 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d140cf570 con 0x7f8d140d0b80 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d1359e700 1 --2- 172.21.15.81:0/3802042291 >> v2:172.21.15.83:3300/0 conn(0x7f8d1406d700 0x7f8d1415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d12d9d700 1 --2- 172.21.15.81:0/3802042291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d0b80 0x7f8d140cfd70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8d040098e0 tx=0x7f8d040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45a4476b3232387 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d1259c700 1 -- 172.21.15.81:0/3802042291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04009e80 con 0x7f8d140d0b80 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d1259c700 1 -- 172.21.15.81:0/3802042291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0400b820 con 0x7f8d140d0b80 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d1259c700 1 -- 172.21.15.81:0/3802042291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400bba0 con 0x7f8d140d0b80 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d18803700 1 -- 172.21.15.81:0/3802042291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d0b80 msgr2=0x7f8d140cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d18803700 1 --2- 172.21.15.81:0/3802042291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d0b80 0x7f8d140cfd70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8d040098e0 tx=0x7f8d040091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d18803700 1 -- 172.21.15.81:0/3802042291 shutdown_connections 2023-10-06T02:51:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d18803700 1 --2- 172.21.15.81:0/3802042291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d0b80 0x7f8d140cfd70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d18803700 1 --2- 172.21.15.81:0/3802042291 >> v2:172.21.15.83:3300/0 conn(0x7f8d1406d700 0x7f8d1415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d18803700 1 -- 172.21.15.81:0/3802042291 >> 172.21.15.81:0/3802042291 conn(0x7f8d14063230 msgr2=0x7f8d14063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d18803700 1 -- 172.21.15.81:0/3802042291 shutdown_connections 2023-10-06T02:51:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.857+0000 7f8d18803700 1 -- 172.21.15.81:0/3802042291 wait complete. 2023-10-06T02:51:49.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.858+0000 7f8d18803700 1 Processor -- start 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d18803700 1 -- start start 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d18803700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d1406d700 0x7f8d14157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d18803700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d02b0 0x7f8d140c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d18803700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d140d0b80 0x7f8d140cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d18803700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14157a90 con 0x7f8d140d02b0 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d18803700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140c8b60 con 0x7f8d1406d700 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d18803700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140c7c70 con 0x7f8d140d0b80 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d0a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d02b0 0x7f8d140c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d0a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d02b0 0x7f8d140c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60688/0 (socket says 172.21.15.81:60688) 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.859+0000 7f8d0a59c700 1 -- 172.21.15.81:0/526895221 learned_addr learned my addr 172.21.15.81:0/526895221 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d12d9d700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d1406d700 0x7f8d14157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d1359e700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d140d0b80 0x7f8d140cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d0a59c700 1 -- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d140d0b80 msgr2=0x7f8d140cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d0a59c700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d140d0b80 0x7f8d140cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d0a59c700 1 -- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d1406d700 msgr2=0x7f8d14157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d0a59c700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d1406d700 0x7f8d14157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d0a59c700 1 -- 172.21.15.81:0/526895221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04009420 con 0x7f8d140d02b0 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d0a59c700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d02b0 0x7f8d140c8ff0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00c7c0 tx=0x7f8cfc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d0b7fe700 1 -- 172.21.15.81:0/526895221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc005b30 con 0x7f8d140d02b0 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d0b7fe700 1 -- 172.21.15.81:0/526895221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc005cb0 con 0x7f8d140d02b0 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d140c7f50 con 0x7f8d140d02b0 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d0b7fe700 1 -- 172.21.15.81:0/526895221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc004a80 con 0x7f8d140d02b0 2023-10-06T02:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.860+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d140c8510 con 0x7f8d140d02b0 2023-10-06T02:51:49.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.861+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d140c8d10 con 0x7f8d140d02b0 2023-10-06T02:51:49.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.861+0000 7f8d0b7fe700 1 -- 172.21.15.81:0/526895221 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cfc0070f0 con 0x7f8d140d02b0 2023-10-06T02:51:49.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.862+0000 7f8d0b7fe700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8cf4066f30 0x7f8cf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:49.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.862+0000 7f8d0b7fe700 1 -- 172.21.15.81:0/526895221 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8cfc083750 con 0x7f8d140d02b0 2023-10-06T02:51:49.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.862+0000 7f8d12d9d700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8cf4066f30 0x7f8cf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:49.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.862+0000 7f8d12d9d700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8cf4066f30 0x7f8cf40693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8d040093f0 tx=0x7f8d04017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:49.866+0000 7f8d0b7fe700 1 -- 172.21.15.81:0/526895221 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cfc050c30 con 0x7f8d140d02b0 2023-10-06T02:51:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.046+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8d140676e0 con 0x7f8d140d02b0 2023-10-06T02:51:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.047+0000 7f8d0b7fe700 1 -- 172.21.15.81:0/526895221 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v116) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8cfc018020 con 0x7f8d140d02b0 2023-10-06T02:51:50.048 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:51:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8cf4066f30 msgr2=0x7f8cf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8cf4066f30 0x7f8cf40693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8d040093f0 tx=0x7f8d04017000 comp rx=0 tx=0).stop 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d02b0 msgr2=0x7f8d140c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d02b0 0x7f8d140c8ff0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00c7c0 tx=0x7f8cfc007f70 comp rx=0 tx=0).stop 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 shutdown_connections 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d140d0b80 0x7f8d140cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8cf4066f30 0x7f8cf40693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d1406d700 0x7f8d14157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 --2- 172.21.15.81:0/526895221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140d02b0 0x7f8d140c8ff0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 >> 172.21.15.81:0/526895221 conn(0x7f8d14063230 msgr2=0x7f8d1415b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 shutdown_connections 2023-10-06T02:51:50.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.049+0000 7f8d18803700 1 -- 172.21.15.81:0/526895221 wait complete. 2023-10-06T02:51:50.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:51:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.175+0000 7f42a5cb6700 1 Processor -- start 2023-10-06T02:51:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.175+0000 7f42a5cb6700 1 -- start start 2023-10-06T02:51:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f42a5cb6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42a0159f10 0x7f42a0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f42a5cb6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0068cc0 0x7f42a00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f42a5cb6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a00cee10 con 0x7f42a0159b40 2023-10-06T02:51:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f42a5cb6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a0069140 con 0x7f42a0159f10 2023-10-06T02:51:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f42a5cb6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00cd040 con 0x7f42a0068cc0 2023-10-06T02:51:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f429ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42a0159f10 0x7f42a0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f429ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42a0159f10 0x7f42a0068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60692/0 (socket says 172.21.15.81:60692) 2023-10-06T02:51:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f42a4cb4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f42a0159b40 0x7f42a00cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39940/0 (socket says 172.21.15.81:39940) 2023-10-06T02:51:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f429ffff700 1 -- 172.21.15.81:0/3567495355 learned_addr learned my addr 172.21.15.81:0/3567495355 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f42a54b5700 1 --2- 172.21.15.81:0/3567495355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0068cc0 0x7f42a00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f429ffff700 1 -- 172.21.15.81:0/3567495355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0068cc0 msgr2=0x7f42a00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f429ffff700 1 --2- 172.21.15.81:0/3567495355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0068cc0 0x7f42a00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f429ffff700 1 -- 172.21.15.81:0/3567495355 >> v1:172.21.15.81:6789/0 conn(0x7f42a0159b40 legacy=0x7f42a00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f429ffff700 1 -- 172.21.15.81:0/3567495355 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00cd320 con 0x7f42a0159f10 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.176+0000 7f429f7fe700 1 -- 172.21.15.81:0/3567495355 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713759318 0 0) 0x7f42a00cee10 con 0x7f42a0159b40 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f429ffff700 1 --2- 172.21.15.81:0/3567495355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 0x7f42a0068780 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f42880099b0 tx=0x7f4288009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ba8c0ffd9c7ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f429f7fe700 1 -- 172.21.15.81:0/3567495355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800b860 con 0x7f42a0159f10 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f429f7fe700 1 -- 172.21.15.81:0/3567495355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428800b9c0 con 0x7f42a0159f10 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f429f7fe700 1 -- 172.21.15.81:0/3567495355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800bd60 con 0x7f42a0159f10 2023-10-06T02:51:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3567495355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 msgr2=0x7f42a0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f42a5cb6700 1 --2- 172.21.15.81:0/3567495355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 0x7f42a0068780 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f42880099b0 tx=0x7f4288009250 comp rx=0 tx=0).stop 2023-10-06T02:51:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3567495355 shutdown_connections 2023-10-06T02:51:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f42a5cb6700 1 --2- 172.21.15.81:0/3567495355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0068cc0 0x7f42a00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f42a5cb6700 1 --2- 172.21.15.81:0/3567495355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 0x7f42a0068780 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3567495355 >> 172.21.15.81:0/3567495355 conn(0x7f42a00cd660 msgr2=0x7f42a00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3567495355 shutdown_connections 2023-10-06T02:51:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.177+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3567495355 wait complete. 2023-10-06T02:51:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.178+0000 7f42a5cb6700 1 Processor -- start 2023-10-06T02:51:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.178+0000 7f42a5cb6700 1 -- start start 2023-10-06T02:51:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a5cb6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42a0068cc0 0x7f42a014fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a5cb6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0159b40 0x7f42a015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a5cb6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 0x7f42a00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a5cb6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00c8c70 con 0x7f42a0159f10 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a5cb6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00c9ad0 con 0x7f42a0068cc0 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a5cb6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00c8ec0 con 0x7f42a0159b40 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a54b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 0x7f42a00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a54b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 0x7f42a00c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60698/0 (socket says 172.21.15.81:60698) 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a54b5700 1 -- 172.21.15.81:0/3886901623 learned_addr learned my addr 172.21.15.81:0/3886901623 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f429ffff700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0159b40 0x7f42a015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.179+0000 7f42a4cb4700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42a0068cc0 0x7f42a014fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f42a54b5700 1 -- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0159b40 msgr2=0x7f42a015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f42a54b5700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0159b40 0x7f42a015d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f42a54b5700 1 -- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42a0068cc0 msgr2=0x7f42a014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f42a54b5700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42a0068cc0 0x7f42a014fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f42a54b5700 1 -- 172.21.15.81:0/3886901623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880094f0 con 0x7f42a0159f10 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f42a54b5700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 0x7f42a00c9f60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f429800d890 tx=0x7f4298008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f429cff9700 1 -- 172.21.15.81:0/3886901623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42980125f0 con 0x7f42a0159f10 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f429cff9700 1 -- 172.21.15.81:0/3886901623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4298012770 con 0x7f42a0159f10 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a00c91a0 con 0x7f42a0159f10 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f429cff9700 1 -- 172.21.15.81:0/3886901623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298012b30 con 0x7f42a0159f10 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.180+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a00c9760 con 0x7f42a0159f10 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.181+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a00c9c40 con 0x7f42a0159f10 2023-10-06T02:51:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.181+0000 7f429cff9700 1 -- 172.21.15.81:0/3886901623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f429801e460 con 0x7f42a0159f10 2023-10-06T02:51:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.181+0000 7f429cff9700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4280066f30 0x7f42800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.182+0000 7f429cff9700 1 -- 172.21.15.81:0/3886901623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4298084890 con 0x7f42a0159f10 2023-10-06T02:51:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.182+0000 7f42a4cb4700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4280066f30 0x7f42800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.182+0000 7f42a4cb4700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4280066f30 0x7f42800693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4290001560 tx=0x7f4290001b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.186+0000 7f429cff9700 1 -- 172.21.15.81:0/3886901623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4298055780 con 0x7f42a0159f10 2023-10-06T02:51:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.368+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f42a00cca10 con 0x7f42a0159f10 2023-10-06T02:51:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.368+0000 7f429cff9700 1 -- 172.21.15.81:0/3886901623 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v116) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4298055310 con 0x7f42a0159f10 2023-10-06T02:51:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:50.370 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:51:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:51:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:51:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:51:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:51:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:51:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:51:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:51:50.371 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:51:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.370+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4280066f30 msgr2=0x7f42800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.370+0000 7f42a5cb6700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4280066f30 0x7f42800693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4290001560 tx=0x7f4290001b00 comp rx=0 tx=0).stop 2023-10-06T02:51:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.370+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 msgr2=0x7f42a00c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.370+0000 7f42a5cb6700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 0x7f42a00c9f60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f429800d890 tx=0x7f4298008040 comp rx=0 tx=0).stop 2023-10-06T02:51:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.370+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 shutdown_connections 2023-10-06T02:51:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.370+0000 7f42a5cb6700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a0159f10 0x7f42a00c9f60 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.370+0000 7f42a5cb6700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4280066f30 0x7f42800693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.370+0000 7f42a5cb6700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42a0068cc0 0x7f42a014fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.370+0000 7f42a5cb6700 1 --2- 172.21.15.81:0/3886901623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42a0159b40 0x7f42a015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.371+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 >> 172.21.15.81:0/3886901623 conn(0x7f42a00cd660 msgr2=0x7f42a00cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.371+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 shutdown_connections 2023-10-06T02:51:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.371+0000 7f42a5cb6700 1 -- 172.21.15.81:0/3886901623 wait complete. 2023-10-06T02:51:50.384 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:51:50.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:51:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.501+0000 7eff7ebf5700 1 Processor -- start 2023-10-06T02:51:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.501+0000 7eff7ebf5700 1 -- start start 2023-10-06T02:51:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff7ebf5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7eff78157ca0 0x7eff780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff7ebf5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 0x7eff7806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff7ebf5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff780d07c0 con 0x7eff781578d0 2023-10-06T02:51:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff7ebf5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7806daa0 con 0x7eff78157ca0 2023-10-06T02:51:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff7ebf5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff780cfbb0 con 0x7eff7806d120 2023-10-06T02:51:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff7c991700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7eff781578d0 0x7eff7815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58074/0 (socket says 172.21.15.81:58074) 2023-10-06T02:51:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff7c991700 1 -- 172.21.15.81:0/4214664014 learned_addr learned my addr 172.21.15.81:0/4214664014 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff7d192700 1 --2- 172.21.15.81:0/4214664014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 0x7eff7806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff77fff700 1 --2- 172.21.15.81:0/4214664014 >> v2:172.21.15.83:3300/0 conn(0x7eff78157ca0 0x7eff780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.502+0000 7eff777fe700 1 -- 172.21.15.81:0/4214664014 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68108041 0 0) 0x7eff780d07c0 con 0x7eff781578d0 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff777fe700 1 -- 172.21.15.81:0/4214664014 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff60003570 con 0x7eff781578d0 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7d192700 1 -- 172.21.15.81:0/4214664014 >> v2:172.21.15.83:3300/0 conn(0x7eff78157ca0 msgr2=0x7eff780cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7d192700 1 --2- 172.21.15.81:0/4214664014 >> v2:172.21.15.83:3300/0 conn(0x7eff78157ca0 0x7eff780cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7d192700 1 -- 172.21.15.81:0/4214664014 >> v1:172.21.15.81:6789/0 conn(0x7eff781578d0 legacy=0x7eff7815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7d192700 1 -- 172.21.15.81:0/4214664014 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff780cfe90 con 0x7eff7806d120 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7d192700 1 --2- 172.21.15.81:0/4214664014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 0x7eff7806d560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff700098e0 tx=0x7eff700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5497888b7eae3831 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff777fe700 1 -- 172.21.15.81:0/4214664014 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70011630 con 0x7eff7806d120 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff777fe700 1 -- 172.21.15.81:0/4214664014 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff70011790 con 0x7eff7806d120 2023-10-06T02:51:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff777fe700 1 -- 172.21.15.81:0/4214664014 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70011b10 con 0x7eff7806d120 2023-10-06T02:51:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7ebf5700 1 -- 172.21.15.81:0/4214664014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 msgr2=0x7eff7806d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7ebf5700 1 --2- 172.21.15.81:0/4214664014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 0x7eff7806d560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff700098e0 tx=0x7eff700091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7ebf5700 1 -- 172.21.15.81:0/4214664014 shutdown_connections 2023-10-06T02:51:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7ebf5700 1 --2- 172.21.15.81:0/4214664014 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 0x7eff7806d560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.503+0000 7eff7ebf5700 1 --2- 172.21.15.81:0/4214664014 >> v2:172.21.15.83:3300/0 conn(0x7eff78157ca0 0x7eff780cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.504+0000 7eff7ebf5700 1 -- 172.21.15.81:0/4214664014 >> 172.21.15.81:0/4214664014 conn(0x7eff7806bb90 msgr2=0x7eff7806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.504+0000 7eff7ebf5700 1 -- 172.21.15.81:0/4214664014 shutdown_connections 2023-10-06T02:51:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.504+0000 7eff7ebf5700 1 -- 172.21.15.81:0/4214664014 wait complete. 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.505+0000 7eff7ebf5700 1 Processor -- start 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.505+0000 7eff7ebf5700 1 -- start start 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.505+0000 7eff7ebf5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 0x7eff781548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.505+0000 7eff7ebf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff781578d0 0x7eff780b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.505+0000 7eff7ebf5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff78157ca0 0x7eff780b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.505+0000 7eff7ebf5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff780ad220 con 0x7eff781578d0 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.505+0000 7eff7ebf5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff780b40b0 con 0x7eff78157ca0 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.505+0000 7eff7ebf5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff780acc60 con 0x7eff7806d120 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff781578d0 0x7eff780b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff781578d0 0x7eff780b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56792/0 (socket says 172.21.15.81:56792) 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff77fff700 1 -- 172.21.15.81:0/2094797435 learned_addr learned my addr 172.21.15.81:0/2094797435 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff7c991700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 0x7eff781548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff7d192700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff78157ca0 0x7eff780b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff77fff700 1 -- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 msgr2=0x7eff781548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff77fff700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 0x7eff781548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff77fff700 1 -- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff78157ca0 msgr2=0x7eff780b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff77fff700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff78157ca0 0x7eff780b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff77fff700 1 -- 172.21.15.81:0/2094797435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70009420 con 0x7eff781578d0 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff77fff700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff781578d0 0x7eff780b6050 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00e900 tx=0x7eff6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff74ff9700 1 -- 172.21.15.81:0/2094797435 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c013680 con 0x7eff781578d0 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff74ff9700 1 -- 172.21.15.81:0/2094797435 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c0137e0 con 0x7eff781578d0 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff780acf40 con 0x7eff781578d0 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff74ff9700 1 -- 172.21.15.81:0/2094797435 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c013ba0 con 0x7eff781578d0 2023-10-06T02:51:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.506+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff78154e30 con 0x7eff781578d0 2023-10-06T02:51:50.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.507+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff780b3ba0 con 0x7eff781578d0 2023-10-06T02:51:50.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.507+0000 7eff74ff9700 1 -- 172.21.15.81:0/2094797435 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff6c0123d0 con 0x7eff781578d0 2023-10-06T02:51:50.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.508+0000 7eff74ff9700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff64066f30 0x7eff640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:50.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.508+0000 7eff74ff9700 1 -- 172.21.15.81:0/2094797435 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5206+0+0 (secure 0 0 0) 0x7eff6c084430 con 0x7eff781578d0 2023-10-06T02:51:50.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.508+0000 7eff7c991700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff64066f30 0x7eff640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:50.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.508+0000 7eff7c991700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff64066f30 0x7eff640693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7eff68005c50 tx=0x7eff68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:50.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.512+0000 7eff74ff9700 1 -- 172.21.15.81:0/2094797435 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff780b3ba0 con 0x7eff781578d0 2023-10-06T02:51:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:50.696+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7eff780b3ba0 con 0x7eff781578d0 2023-10-06T02:51:51.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.679+0000 7eff74ff9700 1 -- 172.21.15.81:0/2094797435 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v117) v1 ==== 138+0+0 (secure 0 0 0) 0x7eff780b3ba0 con 0x7eff781578d0 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff64066f30 msgr2=0x7eff640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff64066f30 0x7eff640693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7eff68005c50 tx=0x7eff68009040 comp rx=0 tx=0).stop 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff781578d0 msgr2=0x7eff780b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff781578d0 0x7eff780b6050 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00e900 tx=0x7eff6c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 shutdown_connections 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7eff64066f30 0x7eff640693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff78157ca0 0x7eff780b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff7806d120 0x7eff781548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 --2- 172.21.15.81:0/2094797435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff781578d0 0x7eff780b6050 secure :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00e900 tx=0x7eff6c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.682+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 >> 172.21.15.81:0/2094797435 conn(0x7eff7806bb90 msgr2=0x7eff78156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:51.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.683+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 shutdown_connections 2023-10-06T02:51:51.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.683+0000 7eff7ebf5700 1 -- 172.21.15.81:0/2094797435 wait complete. 2023-10-06T02:51:51.685 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:51:51.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:51:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.818+0000 7f4e81c2f700 1 Processor -- start 2023-10-06T02:51:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.818+0000 7f4e81c2f700 1 -- start start 2023-10-06T02:51:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.819+0000 7f4e81c2f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e7c0adb30 0x7f4e7c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.819+0000 7f4e81c2f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4e7c06af30 0x7f4e7c06b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.819+0000 7f4e81c2f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7c06aaa0 con 0x7f4e7c158000 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.819+0000 7f4e81c2f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c15c500 con 0x7f4e7c0adb30 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.819+0000 7f4e81c2f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c06b890 con 0x7f4e7c06af30 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.819+0000 7f4e80c2d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e7c0adb30 0x7f4e7c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.819+0000 7f4e73fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4e7c158000 0x7f4e7c0b1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58078/0 (socket says 172.21.15.81:58078) 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.819+0000 7f4e73fff700 1 -- 172.21.15.81:0/3761159664 learned_addr learned my addr 172.21.15.81:0/3761159664 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.819+0000 7f4e8142e700 1 --2- 172.21.15.81:0/3761159664 >> v2:172.21.15.83:3300/0 conn(0x7f4e7c06af30 0x7f4e7c06b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e80c2d700 1 -- 172.21.15.81:0/3761159664 >> v2:172.21.15.83:3300/0 conn(0x7f4e7c06af30 msgr2=0x7f4e7c06b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e80c2d700 1 --2- 172.21.15.81:0/3761159664 >> v2:172.21.15.83:3300/0 conn(0x7f4e7c06af30 0x7f4e7c06b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e80c2d700 1 -- 172.21.15.81:0/3761159664 >> v1:172.21.15.81:6789/0 conn(0x7f4e7c158000 legacy=0x7f4e7c0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e80c2d700 1 -- 172.21.15.81:0/3761159664 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c158770 con 0x7f4e7c0adb30 2023-10-06T02:51:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e737fe700 1 -- 172.21.15.81:0/3761159664 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399425618 0 0) 0x7f4e7c06aaa0 con 0x7f4e7c158000 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e80c2d700 1 --2- 172.21.15.81:0/3761159664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c0adb30 0x7f4e7c15bfc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0b2ea0 tx=0x7f4e780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e81bc17b4f65ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e737fe700 1 -- 172.21.15.81:0/3761159664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800b6b0 con 0x7f4e7c0adb30 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e737fe700 1 -- 172.21.15.81:0/3761159664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7800b810 con 0x7f4e7c0adb30 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e737fe700 1 -- 172.21.15.81:0/3761159664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800bbb0 con 0x7f4e7c0adb30 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e81c2f700 1 -- 172.21.15.81:0/3761159664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c0adb30 msgr2=0x7f4e7c15bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e81c2f700 1 --2- 172.21.15.81:0/3761159664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c0adb30 0x7f4e7c15bfc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0b2ea0 tx=0x7f4e780091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e81c2f700 1 -- 172.21.15.81:0/3761159664 shutdown_connections 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e81c2f700 1 --2- 172.21.15.81:0/3761159664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c0adb30 0x7f4e7c15bfc0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e81c2f700 1 --2- 172.21.15.81:0/3761159664 >> v2:172.21.15.83:3300/0 conn(0x7f4e7c06af30 0x7f4e7c06b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e81c2f700 1 -- 172.21.15.81:0/3761159664 >> 172.21.15.81:0/3761159664 conn(0x7f4e7c0680b0 msgr2=0x7f4e7c06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e81c2f700 1 -- 172.21.15.81:0/3761159664 shutdown_connections 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.820+0000 7f4e81c2f700 1 -- 172.21.15.81:0/3761159664 wait complete. 2023-10-06T02:51:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.821+0000 7f4e81c2f700 1 Processor -- start 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.822+0000 7f4e81c2f700 1 -- start start 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.822+0000 7f4e81c2f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e7c06af30 0x7f4e7c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.822+0000 7f4e81c2f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e7c0adb30 0x7f4e7c0c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.822+0000 7f4e81c2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c158000 0x7f4e7c0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.822+0000 7f4e81c2f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c0b0100 con 0x7f4e7c158000 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.822+0000 7f4e81c2f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c154f50 con 0x7f4e7c06af30 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.822+0000 7f4e81c2f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c0af4f0 con 0x7f4e7c0adb30 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e8142e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c158000 0x7f4e7c0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e8142e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c158000 0x7f4e7c0b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56810/0 (socket says 172.21.15.81:56810) 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e8142e700 1 -- 172.21.15.81:0/1024063977 learned_addr learned my addr 172.21.15.81:0/1024063977 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e80c2d700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e7c06af30 0x7f4e7c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e73fff700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e7c0adb30 0x7f4e7c0c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e8142e700 1 -- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e7c0adb30 msgr2=0x7f4e7c0c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e8142e700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e7c0adb30 0x7f4e7c0c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e8142e700 1 -- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e7c06af30 msgr2=0x7f4e7c154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e8142e700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e7c06af30 0x7f4e7c154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e8142e700 1 -- 172.21.15.81:0/1024063977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78009420 con 0x7f4e7c158000 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e8142e700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c158000 0x7f4e7c0b0590 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007f20 tx=0x7f4e74009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e70ff9700 1 -- 172.21.15.81:0/1024063977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7400eb90 con 0x7f4e7c158000 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e70ff9700 1 -- 172.21.15.81:0/1024063977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7400ed10 con 0x7f4e7c158000 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7c0af7d0 con 0x7f4e7c158000 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e70ff9700 1 -- 172.21.15.81:0/1024063977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74014670 con 0x7f4e7c158000 2023-10-06T02:51:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.823+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7c0afd90 con 0x7f4e7c158000 2023-10-06T02:51:51.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.824+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7c069ab0 con 0x7f4e7c158000 2023-10-06T02:51:51.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.825+0000 7f4e70ff9700 1 -- 172.21.15.81:0/1024063977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e740149e0 con 0x7f4e7c158000 2023-10-06T02:51:51.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.825+0000 7f4e70ff9700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4e68066f30 0x7f4e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:51.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.825+0000 7f4e70ff9700 1 -- 172.21.15.81:0/1024063977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f4e74084a60 con 0x7f4e7c158000 2023-10-06T02:51:51.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.825+0000 7f4e80c2d700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4e68066f30 0x7f4e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:51.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.826+0000 7f4e80c2d700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4e68066f30 0x7f4e680693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4e780093f0 tx=0x7f4e78017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:51.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:51.829+0000 7f4e70ff9700 1 -- 172.21.15.81:0/1024063977 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e74051d50 con 0x7f4e7c158000 2023-10-06T02:51:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.010+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4e7c0ce300 con 0x7f4e7c158000 2023-10-06T02:51:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.683+0000 7f4e70ff9700 1 -- 172.21.15.81:0/1024063977 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v118) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4e74055370 con 0x7f4e7c158000 2023-10-06T02:51:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4e68066f30 msgr2=0x7f4e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4e68066f30 0x7f4e680693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4e780093f0 tx=0x7f4e78017000 comp rx=0 tx=0).stop 2023-10-06T02:51:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c158000 msgr2=0x7f4e7c0b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c158000 0x7f4e7c0b0590 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007f20 tx=0x7f4e74009860 comp rx=0 tx=0).stop 2023-10-06T02:51:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 shutdown_connections 2023-10-06T02:51:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e7c158000 0x7f4e7c0b0590 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4e68066f30 0x7f4e680693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e7c06af30 0x7f4e7c154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 --2- 172.21.15.81:0/1024063977 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e7c0adb30 0x7f4e7c0c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.687+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 >> 172.21.15.81:0/1024063977 conn(0x7f4e7c0680b0 msgr2=0x7f4e7c159650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.692+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 shutdown_connections 2023-10-06T02:51:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.692+0000 7f4e81c2f700 1 -- 172.21.15.81:0/1024063977 wait complete. 2023-10-06T02:51:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:51:52.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:51:52.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.822+0000 7f2ead5c6700 1 Processor -- start 2023-10-06T02:51:52.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.822+0000 7f2ead5c6700 1 -- start start 2023-10-06T02:51:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.823+0000 7f2ead5c6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2ea8157fe0 0x7f2ea80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.823+0000 7f2ead5c6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea80b2890 con 0x7f2ea81583b0 2023-10-06T02:51:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.823+0000 7f2ead5c6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea80b4070 con 0x7f2ea80cf240 2023-10-06T02:51:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.823+0000 7f2ead5c6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea80b4350 con 0x7f2ea8157fe0 2023-10-06T02:51:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.823+0000 7f2e9e7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2ea81583b0 0x7f2ea80ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58092/0 (socket says 172.21.15.81:58092) 2023-10-06T02:51:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.823+0000 7f2e9e7fc700 1 -- 172.21.15.81:0/3901716295 learned_addr learned my addr 172.21.15.81:0/3901716295 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea6ffd700 1 --2- 172.21.15.81:0/3901716295 >> v2:172.21.15.83:3300/0 conn(0x7f2ea8157fe0 0x7f2ea80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191218327 0 0) 0x7f2ea80b2890 con 0x7f2ea81583b0 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e94003570 con 0x7f2ea81583b0 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 37573579 0 0) 0x7f2e94003570 con 0x7f2ea81583b0 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 >> v2:172.21.15.83:3300/0 conn(0x7f2ea8157fe0 msgr2=0x7f2ea80b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 --2- 172.21.15.81:0/3901716295 >> v2:172.21.15.83:3300/0 conn(0x7f2ea8157fe0 0x7f2ea80b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 >> v1:172.21.15.83:6789/0 conn(0x7f2ea80cf240 legacy=0x7f2ea8158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80b4630 con 0x7f2ea81583b0 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f2e90001470 con 0x7f2ea81583b0 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 >> v1:172.21.15.81:6789/0 conn(0x7f2ea81583b0 legacy=0x7f2ea80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e94003a60 0x7f2e94003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2e94004810 0x7f2e94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e940051c0 0x7f2e9400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80b4350 con 0x7f2e940051c0 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9400c160 con 0x7f2e94003a60 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9400c320 con 0x7f2e94004810 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea77fe700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e940051c0 0x7f2e9400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea6ffd700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e94003a60 0x7f2e94003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2e9e7fc700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2e94004810 0x7f2e94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea77fe700 1 -- 172.21.15.81:0/3901716295 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2e94004810 msgr2=0x7f2e94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea77fe700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2e94004810 0x7f2e94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea77fe700 1 -- 172.21.15.81:0/3901716295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e94003a60 msgr2=0x7f2e94003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea77fe700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e94003a60 0x7f2e94003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea77fe700 1 -- 172.21.15.81:0/3901716295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e94003570 con 0x7f2e940051c0 2023-10-06T02:51:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.824+0000 7f2ea77fe700 1 -- 172.21.15.81:0/3901716295 reap_dead start 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ea77fe700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e940051c0 0x7f2e9400ba60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0001f90 tx=0x7f2ea0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65598f14201c47fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0001950 con 0x7f2e940051c0 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea000c8b0 con 0x7f2e940051c0 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ea67fc700 1 -- 172.21.15.81:0/3901716295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000cc50 con 0x7f2e940051c0 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ead5c6700 1 -- 172.21.15.81:0/3901716295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e940051c0 msgr2=0x7f2e9400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ead5c6700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e940051c0 0x7f2e9400ba60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0001f90 tx=0x7f2ea0001640 comp rx=0 tx=0).stop 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ead5c6700 1 -- 172.21.15.81:0/3901716295 shutdown_connections 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ead5c6700 1 --2- 172.21.15.81:0/3901716295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e940051c0 0x7f2e9400ba60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ead5c6700 1 -- 172.21.15.81:0/3901716295 >> 172.21.15.81:0/3901716295 conn(0x7f2ea8067640 msgr2=0x7f2ea8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ead5c6700 1 -- 172.21.15.81:0/3901716295 shutdown_connections 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.825+0000 7f2ead5c6700 1 -- 172.21.15.81:0/3901716295 wait complete. 2023-10-06T02:51:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.826+0000 7f2ead5c6700 1 Processor -- start 2023-10-06T02:51:52.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.826+0000 7f2ead5c6700 1 -- start start 2023-10-06T02:51:52.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2ead5c6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e940051c0 0x7f2ea8152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:52.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2ead5c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80c75b0 0x7f2ea80c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:52.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2ead5c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ea815ac70 0x7f2ea815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:52.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2ead5c6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea815b620 con 0x7f2ea80c75b0 2023-10-06T02:51:52.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2ead5c6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80c8000 con 0x7f2e940051c0 2023-10-06T02:51:52.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2ead5c6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80c82e0 con 0x7f2ea815ac70 2023-10-06T02:51:52.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2e9e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80c75b0 0x7f2ea80c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2e9e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80c75b0 0x7f2ea80c7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56820/0 (socket says 172.21.15.81:56820) 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2e9e7fc700 1 -- 172.21.15.81:0/1997740362 learned_addr learned my addr 172.21.15.81:0/1997740362 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2ea77fe700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ea815ac70 0x7f2ea815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2ea6ffd700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e940051c0 0x7f2ea8152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.827+0000 7f2e9e7fc700 1 -- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ea815ac70 msgr2=0x7f2ea815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2e9e7fc700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ea815ac70 0x7f2ea815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2e9e7fc700 1 -- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e940051c0 msgr2=0x7f2ea8152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2e9e7fc700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e940051c0 0x7f2ea8152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2e9e7fc700 1 -- 172.21.15.81:0/1997740362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80c85c0 con 0x7f2ea80c75b0 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2ea6ffd700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e940051c0 0x7f2ea8152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2e9e7fc700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80c75b0 0x7f2ea80c7a20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2e900011e0 tx=0x7f2e90001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2e9f7fe700 1 -- 172.21.15.81:0/1997740362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90018030 con 0x7f2ea80c75b0 2023-10-06T02:51:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2e9f7fe700 1 -- 172.21.15.81:0/1997740362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9000f6c0 con 0x7f2ea80c75b0 2023-10-06T02:51:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2e9f7fe700 1 -- 172.21.15.81:0/1997740362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9000fa80 con 0x7f2ea80c75b0 2023-10-06T02:51:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea80c88a0 con 0x7f2ea80c75b0 2023-10-06T02:51:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.828+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea80c5a90 con 0x7f2ea80c75b0 2023-10-06T02:51:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.829+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea8069e40 con 0x7f2ea80c75b0 2023-10-06T02:51:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.829+0000 7f2e9f7fe700 1 -- 172.21.15.81:0/1997740362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e9001b070 con 0x7f2ea80c75b0 2023-10-06T02:51:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.830+0000 7f2e9f7fe700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2e88066f30 0x7f2e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.830+0000 7f2e9f7fe700 1 -- 172.21.15.81:0/1997740362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f2e90019070 con 0x7f2ea80c75b0 2023-10-06T02:51:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.830+0000 7f2ea6ffd700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2e88066f30 0x7f2e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.830+0000 7f2ea6ffd700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2e88066f30 0x7f2e880693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2e98006f00 tx=0x7f2e98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:52.834+0000 7f2e9f7fe700 1 -- 172.21.15.81:0/1997740362 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e90051580 con 0x7f2ea80c75b0 2023-10-06T02:51:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.058+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2ea80cc6b0 con 0x7f2ea80c75b0 2023-10-06T02:51:53.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.710+0000 7f2e9f7fe700 1 -- 172.21.15.81:0/1997740362 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2e90054ba0 con 0x7f2ea80c75b0 2023-10-06T02:51:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2e88066f30 msgr2=0x7f2e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2e88066f30 0x7f2e880693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2e98006f00 tx=0x7f2e98008040 comp rx=0 tx=0).stop 2023-10-06T02:51:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80c75b0 msgr2=0x7f2ea80c7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80c75b0 0x7f2ea80c7a20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2e900011e0 tx=0x7f2e90001e50 comp rx=0 tx=0).stop 2023-10-06T02:51:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 shutdown_connections 2023-10-06T02:51:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ea815ac70 0x7f2ea815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2e88066f30 0x7f2e880693e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e940051c0 0x7f2ea8152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 --2- 172.21.15.81:0/1997740362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80c75b0 0x7f2ea80c7a20 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 >> 172.21.15.81:0/1997740362 conn(0x7f2ea8067640 msgr2=0x7f2ea8156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.714+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 shutdown_connections 2023-10-06T02:51:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.715+0000 7f2ead5c6700 1 -- 172.21.15.81:0/1997740362 wait complete. 2023-10-06T02:51:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 15 and data pool 16 2023-10-06T02:51:53.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.845+0000 7f95282a5700 1 Processor -- start 2023-10-06T02:51:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.845+0000 7f95282a5700 1 -- start start 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f95282a5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95201578d0 0x7f95200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f95282a5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9520157ca0 0x7f952015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f95282a5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f952006d120 0x7f952006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f95282a5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952006dac0 con 0x7f9520157ca0 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f95282a5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95200d07c0 con 0x7f952006d120 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f95282a5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95200cfbb0 con 0x7f95201578d0 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9525840700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9520157ca0 0x7f952015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9525840700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9520157ca0 0x7f952015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56824/0 (socket says 172.21.15.81:56824) 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9525840700 1 -- 172.21.15.81:0/338217526 learned_addr learned my addr 172.21.15.81:0/338217526 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9526842700 1 --2- 172.21.15.81:0/338217526 >> v2:172.21.15.83:3300/0 conn(0x7f952006d120 0x7f952006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9526041700 1 --2- 172.21.15.81:0/338217526 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95201578d0 0x7f95200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9525840700 1 -- 172.21.15.81:0/338217526 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95201578d0 msgr2=0x7f95200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9525840700 1 --2- 172.21.15.81:0/338217526 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95201578d0 0x7f95200cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9525840700 1 -- 172.21.15.81:0/338217526 >> v2:172.21.15.83:3300/0 conn(0x7f952006d120 msgr2=0x7f952006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9525840700 1 --2- 172.21.15.81:0/338217526 >> v2:172.21.15.83:3300/0 conn(0x7f952006d120 0x7f952006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.846+0000 7f9525840700 1 -- 172.21.15.81:0/338217526 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95200cfe90 con 0x7f9520157ca0 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f9525840700 1 --2- 172.21.15.81:0/338217526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9520157ca0 0x7f952015af00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f95200b3940 tx=0x7f9510009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7d1767b3241186 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f952503f700 1 -- 172.21.15.81:0/338217526 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000b640 con 0x7f9520157ca0 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f952503f700 1 -- 172.21.15.81:0/338217526 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000b7a0 con 0x7f9520157ca0 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f952503f700 1 -- 172.21.15.81:0/338217526 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000bb60 con 0x7f9520157ca0 2023-10-06T02:51:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f95282a5700 1 -- 172.21.15.81:0/338217526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9520157ca0 msgr2=0x7f952015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f95282a5700 1 --2- 172.21.15.81:0/338217526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9520157ca0 0x7f952015af00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f95200b3940 tx=0x7f9510009250 comp rx=0 tx=0).stop 2023-10-06T02:51:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f95282a5700 1 -- 172.21.15.81:0/338217526 shutdown_connections 2023-10-06T02:51:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f95282a5700 1 --2- 172.21.15.81:0/338217526 >> v2:172.21.15.83:3300/0 conn(0x7f952006d120 0x7f952006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f95282a5700 1 --2- 172.21.15.81:0/338217526 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95201578d0 0x7f95200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f95282a5700 1 --2- 172.21.15.81:0/338217526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9520157ca0 0x7f952015af00 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f95282a5700 1 -- 172.21.15.81:0/338217526 >> 172.21.15.81:0/338217526 conn(0x7f952006bb90 msgr2=0x7f952006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f95282a5700 1 -- 172.21.15.81:0/338217526 shutdown_connections 2023-10-06T02:51:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.847+0000 7f95282a5700 1 -- 172.21.15.81:0/338217526 wait complete. 2023-10-06T02:51:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.848+0000 7f95282a5700 1 Processor -- start 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.848+0000 7f95282a5700 1 -- start start 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f95282a5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952006d120 0x7f952016ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f95282a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95201578d0 0x7f95200b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f95282a5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9520157ca0 0x7f95200b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f95282a5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95200c9460 con 0x7f95201578d0 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f95282a5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95200c9670 con 0x7f9520157ca0 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f95282a5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95200c9950 con 0x7f952006d120 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f9525840700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95201578d0 0x7f95200b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f9525840700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95201578d0 0x7f95200b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56840/0 (socket says 172.21.15.81:56840) 2023-10-06T02:51:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f9525840700 1 -- 172.21.15.81:0/4138652866 learned_addr learned my addr 172.21.15.81:0/4138652866 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f9526842700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9520157ca0 0x7f95200b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.849+0000 7f9526041700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952006d120 0x7f952016ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f9525840700 1 -- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952006d120 msgr2=0x7f952016ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f9525840700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952006d120 0x7f952016ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f9525840700 1 -- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9520157ca0 msgr2=0x7f95200b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f9525840700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9520157ca0 0x7f95200b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f9525840700 1 -- 172.21.15.81:0/4138652866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95100094f0 con 0x7f95201578d0 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f9526041700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952006d120 0x7f952016ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f9525840700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95201578d0 0x7f95200b5cf0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f952006fe20 tx=0x7f9510017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f95167fc700 1 -- 172.21.15.81:0/4138652866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510000d10 con 0x7f95201578d0 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f95167fc700 1 -- 172.21.15.81:0/4138652866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000bb20 con 0x7f95201578d0 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95200c9c30 con 0x7f95201578d0 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f95167fc700 1 -- 172.21.15.81:0/4138652866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510011670 con 0x7f95201578d0 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.850+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95200ca430 con 0x7f95201578d0 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.851+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9520067ac0 con 0x7f95201578d0 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.851+0000 7f95167fc700 1 -- 172.21.15.81:0/4138652866 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95100119e0 con 0x7f95201578d0 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.852+0000 7f95167fc700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9504066f30 0x7f95040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.852+0000 7f95167fc700 1 -- 172.21.15.81:0/4138652866 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9510085e50 con 0x7f95201578d0 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.852+0000 7f9526041700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9504066f30 0x7f95040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.853+0000 7f9526041700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9504066f30 0x7f95040693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f951c0076c0 tx=0x7f951c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:53.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:53.856+0000 7f95167fc700 1 -- 172.21.15.81:0/4138652866 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9510052f60 con 0x7f95201578d0 2023-10-06T02:51:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.038+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95200d0170 con 0x7f95201578d0 2023-10-06T02:51:54.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.039+0000 7f95167fc700 1 -- 172.21.15.81:0/4138652866 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16847 (secure 0 0 0) 0x7f9510056580 con 0x7f95201578d0 2023-10-06T02:51:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:54.041 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":119,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:53.060033+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:51:50.714217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T02:51:52.027875+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9504066f30 msgr2=0x7f95040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9504066f30 0x7f95040693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f951c0076c0 tx=0x7f951c00b040 comp rx=0 tx=0).stop 2023-10-06T02:51:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95201578d0 msgr2=0x7f95200b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95201578d0 0x7f95200b5cf0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f952006fe20 tx=0x7f9510017000 comp rx=0 tx=0).stop 2023-10-06T02:51:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 shutdown_connections 2023-10-06T02:51:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9504066f30 0x7f95040693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9520157ca0 0x7f95200b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f952006d120 0x7f952016ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 --2- 172.21.15.81:0/4138652866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95201578d0 0x7f95200b5cf0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 >> 172.21.15.81:0/4138652866 conn(0x7f952006bb90 msgr2=0x7f9520156620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 shutdown_connections 2023-10-06T02:51:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.041+0000 7f95282a5700 1 -- 172.21.15.81:0/4138652866 wait complete. 2023-10-06T02:51:54.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:54.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.167+0000 7ff2e57a3700 1 Processor -- start 2023-10-06T02:51:54.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.167+0000 7ff2e57a3700 1 -- start start 2023-10-06T02:51:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.168+0000 7ff2e57a3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2e00cf240 0x7ff2e0162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.168+0000 7ff2e57a3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e00b2890 con 0x7ff2e00b3bd0 2023-10-06T02:51:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.168+0000 7ff2e57a3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e00b4070 con 0x7ff2e0157fe0 2023-10-06T02:51:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.168+0000 7ff2e57a3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00b4350 con 0x7ff2e00cf240 2023-10-06T02:51:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.168+0000 7ff2df7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2e00cf240 0x7ff2e0162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.168+0000 7ff2de7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff2e00b3bd0 0x7ff2e00ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58108/0 (socket says 172.21.15.81:58108) 2023-10-06T02:51:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.168+0000 7ff2de7fc700 1 -- 172.21.15.81:0/2661802631 learned_addr learned my addr 172.21.15.81:0/2661802631 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2df7fe700 1 -- 172.21.15.81:0/2661802631 >> v1:172.21.15.83:6789/0 conn(0x7ff2e0157fe0 legacy=0x7ff2e00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2df7fe700 1 -- 172.21.15.81:0/2661802631 >> v1:172.21.15.81:6789/0 conn(0x7ff2e00b3bd0 legacy=0x7ff2e00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2df7fe700 1 -- 172.21.15.81:0/2661802631 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00b4630 con 0x7ff2e00cf240 2023-10-06T02:51:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2df7fe700 1 --2- 172.21.15.81:0/2661802631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 0x7ff2e0162cd0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80098e0 tx=0x7ff2d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6037c378592965d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2ddffb700 1 -- 172.21.15.81:0/2661802631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8009e80 con 0x7ff2e00cf240 2023-10-06T02:51:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2ddffb700 1 -- 172.21.15.81:0/2661802631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d800b860 con 0x7ff2e00cf240 2023-10-06T02:51:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2ddffb700 1 -- 172.21.15.81:0/2661802631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800bbe0 con 0x7ff2e00cf240 2023-10-06T02:51:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2661802631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 msgr2=0x7ff2e0162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2e57a3700 1 --2- 172.21.15.81:0/2661802631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 0x7ff2e0162cd0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80098e0 tx=0x7ff2d80091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2661802631 shutdown_connections 2023-10-06T02:51:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2e57a3700 1 --2- 172.21.15.81:0/2661802631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 0x7ff2e0162cd0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2661802631 >> 172.21.15.81:0/2661802631 conn(0x7ff2e0067640 msgr2=0x7ff2e0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2661802631 shutdown_connections 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.169+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2661802631 wait complete. 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.171+0000 7ff2e57a3700 1 Processor -- start 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.171+0000 7ff2e57a3700 1 -- start start 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.171+0000 7ff2e57a3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e00b3bd0 0x7ff2e0148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.171+0000 7ff2e57a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 0x7ff2e01691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.171+0000 7ff2e57a3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e0157fe0 0x7ff2e014c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.171+0000 7ff2e57a3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e015abc0 con 0x7ff2e00cf240 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.171+0000 7ff2e57a3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e0169710 con 0x7ff2e0157fe0 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.171+0000 7ff2e57a3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e0159fb0 con 0x7ff2e00b3bd0 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.171+0000 7ff2de7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 0x7ff2e01691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2de7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 0x7ff2e01691d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56866/0 (socket says 172.21.15.81:56866) 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2de7fc700 1 -- 172.21.15.81:0/2753637348 learned_addr learned my addr 172.21.15.81:0/2753637348 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2df7fe700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e0157fe0 0x7ff2e014c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2deffd700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e00b3bd0 0x7ff2e0148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2de7fc700 1 -- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e00b3bd0 msgr2=0x7ff2e0148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2de7fc700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e00b3bd0 0x7ff2e0148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2de7fc700 1 -- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e0157fe0 msgr2=0x7ff2e014c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2de7fc700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e0157fe0 0x7ff2e014c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2de7fc700 1 -- 172.21.15.81:0/2753637348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009420 con 0x7ff2e00cf240 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2deffd700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e00b3bd0 0x7ff2e0148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2de7fc700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 0x7ff2e01691d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400c590 tx=0x7ff2d4001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2753637348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4005b30 con 0x7ff2e00cf240 2023-10-06T02:51:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2753637348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d4005cb0 con 0x7ff2e00cf240 2023-10-06T02:51:54.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e015a290 con 0x7ff2e00cf240 2023-10-06T02:51:54.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2753637348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4007320 con 0x7ff2e00cf240 2023-10-06T02:51:54.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.172+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e015a850 con 0x7ff2e00cf240 2023-10-06T02:51:54.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.173+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e015ad70 con 0x7ff2e00cf240 2023-10-06T02:51:54.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.173+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2753637348 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2d401b3b0 con 0x7ff2e00cf240 2023-10-06T02:51:54.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.174+0000 7ff2c6ffd700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2cc066f30 0x7ff2cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.174+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2753637348 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff2d4083b50 con 0x7ff2e00cf240 2023-10-06T02:51:54.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.174+0000 7ff2deffd700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2cc066f30 0x7ff2cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.175+0000 7ff2deffd700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2cc066f30 0x7ff2cc0693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0007fd0 tx=0x7ff2d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.178+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2753637348 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2e015ad70 con 0x7ff2e00cf240 2023-10-06T02:51:54.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.361+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2e015ba30 con 0x7ff2e00cf240 2023-10-06T02:51:54.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.362+0000 7ff2c6ffd700 1 -- 172.21.15.81:0/2753637348 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16847 (secure 0 0 0) 0x7ff2d4017090 con 0x7ff2e00cf240 2023-10-06T02:51:54.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:54.364 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":119,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:53.060033+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:51:50.714217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T02:51:52.027875+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:54.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2cc066f30 msgr2=0x7ff2cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2cc066f30 0x7ff2cc0693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0007fd0 tx=0x7ff2d0009040 comp rx=0 tx=0).stop 2023-10-06T02:51:54.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 msgr2=0x7ff2e01691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 0x7ff2e01691d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400c590 tx=0x7ff2d4001020 comp rx=0 tx=0).stop 2023-10-06T02:51:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 shutdown_connections 2023-10-06T02:51:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff2cc066f30 0x7ff2cc0693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2e0157fe0 0x7ff2e014c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2e00b3bd0 0x7ff2e0148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 --2- 172.21.15.81:0/2753637348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00cf240 0x7ff2e01691d0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 >> 172.21.15.81:0/2753637348 conn(0x7ff2e0067640 msgr2=0x7ff2e00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:54.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 shutdown_connections 2023-10-06T02:51:54.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.364+0000 7ff2e57a3700 1 -- 172.21.15.81:0/2753637348 wait complete. 2023-10-06T02:51:54.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:51:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.494+0000 7f2521261700 1 Processor -- start 2023-10-06T02:51:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.494+0000 7f2521261700 1 -- start start 2023-10-06T02:51:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.495+0000 7f2521261700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c0cf240 0x7f251c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.495+0000 7f2521261700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f251c06d650 0x7f251c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.495+0000 7f2521261700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c0b0ca0 con 0x7f251c15a2a0 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.495+0000 7f2521261700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c06ea90 con 0x7f251c06d650 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.495+0000 7f2521261700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0b00d0 con 0x7f251c0cf240 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.495+0000 7f251affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f251c15a2a0 0x7f251c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58118/0 (socket says 172.21.15.81:58118) 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.495+0000 7f251affd700 1 -- 172.21.15.81:0/174216368 learned_addr learned my addr 172.21.15.81:0/174216368 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251b7fe700 1 --2- 172.21.15.81:0/174216368 >> v2:172.21.15.83:3300/0 conn(0x7f251c06d650 0x7f251c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f25127fc700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c0cf240 0x7f251c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324876820 0 0) 0x7f251c0b0ca0 con 0x7f251c15a2a0 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2508003570 con 0x7f251c15a2a0 2023-10-06T02:51:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1597925346 0 0) 0x7f2508003570 con 0x7f251c15a2a0 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c0cf240 msgr2=0x7f251c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c0cf240 0x7f251c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 >> v2:172.21.15.83:3300/0 conn(0x7f251c06d650 msgr2=0x7f251c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 --2- 172.21.15.81:0/174216368 >> v2:172.21.15.83:3300/0 conn(0x7f251c06d650 0x7f251c06da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0b0370 con 0x7f251c15a2a0 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f250c001470 con 0x7f251c15a2a0 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 >> v1:172.21.15.81:6789/0 conn(0x7f251c15a2a0 legacy=0x7f251c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c0cf240 0x7f2508003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2508003fe0 0x7f2508004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2508004d50 0x7f25080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c06ea90 con 0x7f2508004d50 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0b00d0 con 0x7f2508003fe0 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250800ba90 con 0x7f251c0cf240 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251b7fe700 1 --2- 172.21.15.81:0/174216368 >> v2:172.21.15.83:3300/0 conn(0x7f251c06d650 0x7f251c06da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251b7fe700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2508004d50 0x7f25080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251affd700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c0cf240 0x7f2508003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f25127fc700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2508003fe0 0x7f2508004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251b7fe700 1 -- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c0cf240 msgr2=0x7f2508003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251b7fe700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c0cf240 0x7f2508003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251b7fe700 1 -- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2508003fe0 msgr2=0x7f2508004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251b7fe700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2508003fe0 0x7f2508004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.496+0000 7f251b7fe700 1 -- 172.21.15.81:0/174216368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2508003570 con 0x7f2508004d50 2023-10-06T02:51:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f251b7fe700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2508004d50 0x7f25080051c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f251400e3c0 tx=0x7f251400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2945c435a192c599 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400ec10 con 0x7f2508004d50 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400f040 con 0x7f2508004d50 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f251a7fc700 1 -- 172.21.15.81:0/174216368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514014480 con 0x7f2508004d50 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f2521261700 1 -- 172.21.15.81:0/174216368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2508004d50 msgr2=0x7f25080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f2521261700 1 --2- 172.21.15.81:0/174216368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2508004d50 0x7f25080051c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f251400e3c0 tx=0x7f251400b040 comp rx=0 tx=0).stop 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f251b7fe700 1 -- 172.21.15.81:0/174216368 reap_dead start 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f2521261700 1 -- 172.21.15.81:0/174216368 shutdown_connections 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f2521261700 1 -- 172.21.15.81:0/174216368 >> 172.21.15.81:0/174216368 conn(0x7f251c067640 msgr2=0x7f251c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f2521261700 1 -- 172.21.15.81:0/174216368 shutdown_connections 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.497+0000 7f2521261700 1 -- 172.21.15.81:0/174216368 wait complete. 2023-10-06T02:51:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.498+0000 7f2521261700 1 Processor -- start 2023-10-06T02:51:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f2521261700 1 -- start start 2023-10-06T02:51:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f2521261700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c152f50 0x7f251c0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f2521261700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f251c0b2e20 0x7f251c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f2521261700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c153860 0x7f251c150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f2521261700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c153ce0 con 0x7f251c153860 2023-10-06T02:51:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f2521261700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0b33c0 con 0x7f251c0b2e20 2023-10-06T02:51:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f2521261700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0b36a0 con 0x7f251c152f50 2023-10-06T02:51:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f251b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c153860 0x7f251c150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f251b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c153860 0x7f251c150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56886/0 (socket says 172.21.15.81:56886) 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f251b7fe700 1 -- 172.21.15.81:0/2257905734 learned_addr learned my addr 172.21.15.81:0/2257905734 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f25127fc700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f251c0b2e20 0x7f251c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.499+0000 7f251affd700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c152f50 0x7f251c0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f251b7fe700 1 -- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c152f50 msgr2=0x7f251c0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f251b7fe700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c152f50 0x7f251c0b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f251b7fe700 1 -- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f251c0b2e20 msgr2=0x7f251c153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f251b7fe700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f251c0b2e20 0x7f251c153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f251b7fe700 1 -- 172.21.15.81:0/2257905734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0b3980 con 0x7f251c153860 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f251affd700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c152f50 0x7f251c0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f251b7fe700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c153860 0x7f251c150950 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2514002230 tx=0x7f2514019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f25137fe700 1 -- 172.21.15.81:0/2257905734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514014480 con 0x7f251c153860 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f25137fe700 1 -- 172.21.15.81:0/2257905734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251401e440 con 0x7f251c153860 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f25137fe700 1 -- 172.21.15.81:0/2257905734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251401e7e0 con 0x7f251c153860 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c0b3c60 con 0x7f251c153860 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.500+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c150e90 con 0x7f251c153860 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.501+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c069e40 con 0x7f251c153860 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.501+0000 7f25137fe700 1 -- 172.21.15.81:0/2257905734 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f251401ebd0 con 0x7f251c153860 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.502+0000 7f25137fe700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24fc066f30 0x7f24fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.502+0000 7f25137fe700 1 -- 172.21.15.81:0/2257905734 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2514086850 con 0x7f251c153860 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.502+0000 7f251affd700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24fc066f30 0x7f24fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.502+0000 7f251affd700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24fc066f30 0x7f24fc0693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f250c000e10 tx=0x7f250c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:54.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.506+0000 7f25137fe700 1 -- 172.21.15.81:0/2257905734 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2514053960 con 0x7f251c153860 2023-10-06T02:51:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:54.735+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f251c153ce0 con 0x7f251c153860 2023-10-06T02:51:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.713+0000 7f25137fe700 1 -- 172.21.15.81:0/2257905734 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2514056f80 con 0x7f251c153860 2023-10-06T02:51:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24fc066f30 msgr2=0x7f24fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24fc066f30 0x7f24fc0693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f250c000e10 tx=0x7f250c009040 comp rx=0 tx=0).stop 2023-10-06T02:51:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c153860 msgr2=0x7f251c150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c153860 0x7f251c150950 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2514002230 tx=0x7f2514019000 comp rx=0 tx=0).stop 2023-10-06T02:51:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 shutdown_connections 2023-10-06T02:51:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c153860 0x7f251c150950 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f251c152f50 0x7f251c0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f24fc066f30 0x7f24fc0693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 --2- 172.21.15.81:0/2257905734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f251c0b2e20 0x7f251c153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 >> 172.21.15.81:0/2257905734 conn(0x7f251c067640 msgr2=0x7f251c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 shutdown_connections 2023-10-06T02:51:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.716+0000 7f2521261700 1 -- 172.21.15.81:0/2257905734 wait complete. 2023-10-06T02:51:55.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:51:55.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.850+0000 7f8d9e162700 1 Processor -- start 2023-10-06T02:51:55.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.850+0000 7f8d9e162700 1 -- start start 2023-10-06T02:51:55.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.851+0000 7f8d9e162700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d980aeea0 0x7f8d980c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:55.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.851+0000 7f8d9e162700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d980c8410 0x7f8d980c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:55.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.851+0000 7f8d9e162700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9806aae0 con 0x7f8d980af270 2023-10-06T02:51:55.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.851+0000 7f8d9e162700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980c8830 con 0x7f8d980aeea0 2023-10-06T02:51:55.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.851+0000 7f8d9e162700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98069ed0 con 0x7f8d980c8410 2023-10-06T02:51:55.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.851+0000 7f8d977fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d980aeea0 0x7f8d980c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.851+0000 7f8d96ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8d980af270 0x7f8d980c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58130/0 (socket says 172.21.15.81:58130) 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.851+0000 7f8d977fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d980aeea0 0x7f8d980c2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56888/0 (socket says 172.21.15.81:56888) 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.851+0000 7f8d96ffd700 1 -- 172.21.15.81:0/3774049835 learned_addr learned my addr 172.21.15.81:0/3774049835 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d97fff700 1 --2- 172.21.15.81:0/3774049835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d980c8410 0x7f8d980c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d977fe700 1 -- 172.21.15.81:0/3774049835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d980c8410 msgr2=0x7f8d980c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d977fe700 1 --2- 172.21.15.81:0/3774049835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d980c8410 0x7f8d980c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d977fe700 1 -- 172.21.15.81:0/3774049835 >> v1:172.21.15.81:6789/0 conn(0x7f8d980af270 legacy=0x7f8d980c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d977fe700 1 -- 172.21.15.81:0/3774049835 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9806a1b0 con 0x7f8d980aeea0 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d967fc700 1 -- 172.21.15.81:0/3774049835 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874492176 0 0) 0x7f8d9806aae0 con 0x7f8d980af270 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d977fe700 1 --2- 172.21.15.81:0/3774049835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 0x7f8d980c2920 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800d0d0 tx=0x7f8d8800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6714db16782589fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d967fc700 1 -- 172.21.15.81:0/3774049835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88010070 con 0x7f8d980aeea0 2023-10-06T02:51:55.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d967fc700 1 -- 172.21.15.81:0/3774049835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800de80 con 0x7f8d980aeea0 2023-10-06T02:51:55.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.852+0000 7f8d967fc700 1 -- 172.21.15.81:0/3774049835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800b320 con 0x7f8d980aeea0 2023-10-06T02:51:55.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.853+0000 7f8d9e162700 1 -- 172.21.15.81:0/3774049835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 msgr2=0x7f8d980c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:55.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.853+0000 7f8d9e162700 1 --2- 172.21.15.81:0/3774049835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 0x7f8d980c2920 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800d0d0 tx=0x7f8d8800b990 comp rx=0 tx=0).stop 2023-10-06T02:51:55.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.853+0000 7f8d9e162700 1 -- 172.21.15.81:0/3774049835 shutdown_connections 2023-10-06T02:51:55.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.853+0000 7f8d9e162700 1 --2- 172.21.15.81:0/3774049835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d980c8410 0x7f8d980c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:55.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.853+0000 7f8d9e162700 1 --2- 172.21.15.81:0/3774049835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 0x7f8d980c2920 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:55.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.853+0000 7f8d9e162700 1 -- 172.21.15.81:0/3774049835 >> 172.21.15.81:0/3774049835 conn(0x7f8d9806c660 msgr2=0x7f8d980cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:55.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.853+0000 7f8d9e162700 1 -- 172.21.15.81:0/3774049835 shutdown_connections 2023-10-06T02:51:55.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.853+0000 7f8d9e162700 1 -- 172.21.15.81:0/3774049835 wait complete. 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.854+0000 7f8d9e162700 1 Processor -- start 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.854+0000 7f8d9e162700 1 -- start start 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d9e162700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 0x7f8d98152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d9e162700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d980af270 0x7f8d9816bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d9e162700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d980c8410 0x7f8d9816b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d9e162700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9816bb30 con 0x7f8d980aeea0 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d9e162700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98155710 con 0x7f8d980c8410 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d9e162700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98152a40 con 0x7f8d980af270 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 0x7f8d98152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 0x7f8d98152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56894/0 (socket says 172.21.15.81:56894) 2023-10-06T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d977fe700 1 -- 172.21.15.81:0/2718821110 learned_addr learned my addr 172.21.15.81:0/2718821110 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d977fe700 1 -- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d980af270 msgr2=0x7f8d9816bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d977fe700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d980af270 0x7f8d9816bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d977fe700 1 -- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d980c8410 msgr2=0x7f8d9816b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d977fe700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d980c8410 0x7f8d9816b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d977fe700 1 -- 172.21.15.81:0/2718821110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8800bc30 con 0x7f8d980aeea0 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d977fe700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 0x7f8d98152360 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800d820 tx=0x7f8d8801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2718821110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800ab00 con 0x7f8d980aeea0 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2718821110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800ac60 con 0x7f8d980aeea0 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d98154de0 con 0x7f8d980aeea0 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2718821110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8801e690 con 0x7f8d980aeea0 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.855+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d981553a0 con 0x7f8d980aeea0 2023-10-06T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.856+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d980c8ee0 con 0x7f8d980aeea0 2023-10-06T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.857+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2718821110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d88003040 con 0x7f8d980aeea0 2023-10-06T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.857+0000 7f8d7f7fe700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d84066f30 0x7f8d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.857+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2718821110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d88086200 con 0x7f8d980aeea0 2023-10-06T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.857+0000 7f8d96ffd700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d84066f30 0x7f8d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.858+0000 7f8d96ffd700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d84066f30 0x7f8d840693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0011e0 tx=0x7f8d8c0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:55.861+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2718821110 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d88053310 con 0x7f8d980aeea0 2023-10-06T02:51:56.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.085+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8d9806a490 con 0x7f8d980aeea0 2023-10-06T02:51:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.714+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2718821110 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8d88056930 con 0x7f8d980aeea0 2023-10-06T02:51:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d84066f30 msgr2=0x7f8d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d84066f30 0x7f8d840693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0011e0 tx=0x7f8d8c0079d0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 msgr2=0x7f8d98152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 0x7f8d98152360 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800d820 tx=0x7f8d8801a000 comp rx=0 tx=0).stop 2023-10-06T02:51:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 shutdown_connections 2023-10-06T02:51:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d84066f30 0x7f8d840693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d980c8410 0x7f8d9816b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d980aeea0 0x7f8d98152360 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 --2- 172.21.15.81:0/2718821110 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d980af270 0x7f8d9816bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 >> 172.21.15.81:0/2718821110 conn(0x7f8d9806c660 msgr2=0x7f8d980c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 shutdown_connections 2023-10-06T02:51:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.717+0000 7f8d9e162700 1 -- 172.21.15.81:0/2718821110 wait complete. 2023-10-06T02:51:56.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:56.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.846+0000 7fc0304ea700 1 Processor -- start 2023-10-06T02:51:56.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.846+0000 7fc0304ea700 1 -- start start 2023-10-06T02:51:56.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.847+0000 7fc0304ea700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc0280b3340 0x7fc02806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:56.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.847+0000 7fc0304ea700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc028069d10 con 0x7fc02806c190 2023-10-06T02:51:56.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.847+0000 7fc0304ea700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02815c130 con 0x7fc028157a60 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.847+0000 7fc0304ea700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02815c410 con 0x7fc0280b3340 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.847+0000 7fc02da85700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc02806c190 0x7fc0280b2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58138/0 (socket says 172.21.15.81:58138) 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.847+0000 7fc02da85700 1 -- 172.21.15.81:0/3688014454 learned_addr learned my addr 172.21.15.81:0/3688014454 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02ea87700 1 --2- 172.21.15.81:0/3688014454 >> v2:172.21.15.83:3300/0 conn(0x7fc0280b3340 0x7fc02806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730869376 0 0) 0x7fc028069d10 con 0x7fc02806c190 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc014003570 con 0x7fc02806c190 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3464769272 0 0) 0x7fc014003570 con 0x7fc02806c190 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 >> v2:172.21.15.83:3300/0 conn(0x7fc0280b3340 msgr2=0x7fc02806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 --2- 172.21.15.81:0/3688014454 >> v2:172.21.15.83:3300/0 conn(0x7fc0280b3340 0x7fc02806a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 >> v1:172.21.15.83:6789/0 conn(0x7fc028157a60 legacy=0x7fc02815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02815c6f0 con 0x7fc02806c190 2023-10-06T02:51:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fc018001470 con 0x7fc02806c190 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 >> v1:172.21.15.81:6789/0 conn(0x7fc02806c190 legacy=0x7fc0280b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc014003a60 0x7fc014003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc014004810 0x7fc014004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0140051c0 0x7fc01400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02815c410 con 0x7fc014003a60 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01400c050 con 0x7fc014004810 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01400c210 con 0x7fc0140051c0 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02e286700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc014003a60 0x7fc014003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02da85700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc014004810 0x7fc014004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02ea87700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0140051c0 0x7fc01400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02e286700 1 -- 172.21.15.81:0/3688014454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0140051c0 msgr2=0x7fc01400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02e286700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0140051c0 0x7fc01400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02e286700 1 -- 172.21.15.81:0/3688014454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc014004810 msgr2=0x7fc014004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02e286700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc014004810 0x7fc014004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02e286700 1 -- 172.21.15.81:0/3688014454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014003570 con 0x7fc014003a60 2023-10-06T02:51:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02ea87700 1 -- 172.21.15.81:0/3688014454 reap_dead start 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.848+0000 7fc02e286700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc014003a60 0x7fc014003e30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fc0240019a0 tx=0x7fc024007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53834d0a549c370 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400c5d0 con 0x7fc014003a60 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02400c730 con 0x7fc014003a60 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc02d284700 1 -- 172.21.15.81:0/3688014454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400cad0 con 0x7fc014003a60 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc0304ea700 1 -- 172.21.15.81:0/3688014454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc014003a60 msgr2=0x7fc014003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc0304ea700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc014003a60 0x7fc014003e30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fc0240019a0 tx=0x7fc024007d10 comp rx=0 tx=0).stop 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc0304ea700 1 -- 172.21.15.81:0/3688014454 shutdown_connections 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc0304ea700 1 --2- 172.21.15.81:0/3688014454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc014003a60 0x7fc014003e30 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc0304ea700 1 -- 172.21.15.81:0/3688014454 >> 172.21.15.81:0/3688014454 conn(0x7fc02806cca0 msgr2=0x7fc02806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc0304ea700 1 -- 172.21.15.81:0/3688014454 shutdown_connections 2023-10-06T02:51:56.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.849+0000 7fc0304ea700 1 -- 172.21.15.81:0/3688014454 wait complete. 2023-10-06T02:51:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.850+0000 7fc0304ea700 1 Processor -- start 2023-10-06T02:51:56.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.850+0000 7fc0304ea700 1 -- start start 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc0304ea700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc014003a60 0x7fc028159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc0304ea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0281589e0 0x7fc0281534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc0304ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc028167cc0 0x7fc028168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc0304ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280ccfb0 con 0x7fc028167cc0 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc0304ea700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc028158570 con 0x7fc0281589e0 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc0304ea700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280cc3a0 con 0x7fc014003a60 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc02ea87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc028167cc0 0x7fc028168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc02ea87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc028167cc0 0x7fc028168160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56924/0 (socket says 172.21.15.81:56924) 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc02ea87700 1 -- 172.21.15.81:0/3618347594 learned_addr learned my addr 172.21.15.81:0/3618347594 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc02da85700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0281589e0 0x7fc0281534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc02e286700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc014003a60 0x7fc028159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc02ea87700 1 -- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc014003a60 msgr2=0x7fc028159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.851+0000 7fc02ea87700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc014003a60 0x7fc028159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc02ea87700 1 -- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0281589e0 msgr2=0x7fc0281534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc02ea87700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0281589e0 0x7fc0281534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc02ea87700 1 -- 172.21.15.81:0/3618347594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0280cc680 con 0x7fc028167cc0 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc02e286700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc014003a60 0x7fc028159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc02ea87700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc028167cc0 0x7fc028168160 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc028069c80 tx=0x7fc02000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc01e7fc700 1 -- 172.21.15.81:0/3618347594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02000e070 con 0x7fc028167cc0 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc01e7fc700 1 -- 172.21.15.81:0/3618347594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020011bd0 con 0x7fc028167cc0 2023-10-06T02:51:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0280cc960 con 0x7fc028167cc0 2023-10-06T02:51:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc01e7fc700 1 -- 172.21.15.81:0/3618347594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020016470 con 0x7fc028167cc0 2023-10-06T02:51:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.852+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc028153a30 con 0x7fc028167cc0 2023-10-06T02:51:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.853+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0280cd160 con 0x7fc028167cc0 2023-10-06T02:51:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.853+0000 7fc01e7fc700 1 -- 172.21.15.81:0/3618347594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0200168a0 con 0x7fc028167cc0 2023-10-06T02:51:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.853+0000 7fc01e7fc700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc00c066f30 0x7fc00c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.854+0000 7fc01e7fc700 1 -- 172.21.15.81:0/3618347594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc0200851a0 con 0x7fc028167cc0 2023-10-06T02:51:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.854+0000 7fc02e286700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc00c066f30 0x7fc00c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.854+0000 7fc02e286700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc00c066f30 0x7fc00c0693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc024000fd0 tx=0x7fc024015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:56.858+0000 7fc01e7fc700 1 -- 172.21.15.81:0/3618347594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0280cd160 con 0x7fc028167cc0 2023-10-06T02:51:57.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.082+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0280cd0f0 con 0x7fc028167cc0 2023-10-06T02:51:57.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.082+0000 7fc01e7fc700 1 -- 172.21.15.81:0/3618347594 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fc0200522b0 con 0x7fc028167cc0 2023-10-06T02:51:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:57.084 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3448648390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3448648390},{"type":"v1","addr":"172.21.15.83:6836","nonce":3448648390}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/259812660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":259812660},{"type":"v1","addr":"172.21.15.83:6837","nonce":259812660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4011741221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4011741221},{"type":"v1","addr":"172.21.15.81:6834","nonce":4011741221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:53.060344+0000","modified":"2023-10-06T02:51:56.712953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/3211565547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3211565547},{"type":"v1","addr":"172.21.15.81:6835","nonce":3211565547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:51:57.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc00c066f30 msgr2=0x7fc00c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc00c066f30 0x7fc00c0693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc024000fd0 tx=0x7fc024015000 comp rx=0 tx=0).stop 2023-10-06T02:51:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc028167cc0 msgr2=0x7fc028168160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc028167cc0 0x7fc028168160 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc028069c80 tx=0x7fc02000b040 comp rx=0 tx=0).stop 2023-10-06T02:51:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 shutdown_connections 2023-10-06T02:51:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc028167cc0 0x7fc028168160 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc014003a60 0x7fc028159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc00c066f30 0x7fc00c0693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 --2- 172.21.15.81:0/3618347594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0281589e0 0x7fc0281534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 >> 172.21.15.81:0/3618347594 conn(0x7fc02806cca0 msgr2=0x7fc02806e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 shutdown_connections 2023-10-06T02:51:57.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.085+0000 7fc0304ea700 1 -- 172.21.15.81:0/3618347594 wait complete. 2023-10-06T02:51:57.088 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2023-10-06T02:51:57.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:51:57.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.211+0000 7f8e0ca4b700 1 Processor -- start 2023-10-06T02:51:57.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.211+0000 7f8e0ca4b700 1 -- start start 2023-10-06T02:51:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0ca4b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 0x7f8e080cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0ca4b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8e08159f10 0x7f8e08068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0ca4b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e080ccb40 0x7f8e08068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0ca4b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e080cee10 con 0x7f8e080ccb40 2023-10-06T02:51:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0ca4b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e080cd040 con 0x7f8e08159f10 2023-10-06T02:51:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0ca4b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080cd320 con 0x7f8e08159b40 2023-10-06T02:51:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e080ccb40 0x7f8e08068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e080ccb40 0x7f8e08068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56928/0 (socket says 172.21.15.81:56928) 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0759e700 1 -- 172.21.15.81:0/1549770962 learned_addr learned my addr 172.21.15.81:0/1549770962 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e06d9d700 1 --2- 172.21.15.81:0/1549770962 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 0x7f8e080cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8dfe59c700 1 --2- 172.21.15.81:0/1549770962 >> v2:172.21.15.83:3300/0 conn(0x7f8e08159f10 0x7f8e08068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0759e700 1 -- 172.21.15.81:0/1549770962 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 msgr2=0x7f8e080cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0759e700 1 --2- 172.21.15.81:0/1549770962 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 0x7f8e080cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0759e700 1 -- 172.21.15.81:0/1549770962 >> v2:172.21.15.83:3300/0 conn(0x7f8e08159f10 msgr2=0x7f8e08068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0759e700 1 --2- 172.21.15.81:0/1549770962 >> v2:172.21.15.83:3300/0 conn(0x7f8e08159f10 0x7f8e08068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.212+0000 7f8e0759e700 1 -- 172.21.15.81:0/1549770962 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e080ce7c0 con 0x7f8e080ccb40 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0759e700 1 --2- 172.21.15.81:0/1549770962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 0x7f8e08068cc0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8e08068190 tx=0x7f8e00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995fa9f849a5c17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0659c700 1 -- 172.21.15.81:0/1549770962 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000e070 con 0x7f8e080ccb40 2023-10-06T02:51:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0659c700 1 -- 172.21.15.81:0/1549770962 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0000b970 con 0x7f8e080ccb40 2023-10-06T02:51:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0659c700 1 -- 172.21.15.81:0/1549770962 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e000092e0 con 0x7f8e080ccb40 2023-10-06T02:51:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1549770962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 msgr2=0x7f8e08068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1549770962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 0x7f8e08068cc0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8e08068190 tx=0x7f8e00009840 comp rx=0 tx=0).stop 2023-10-06T02:51:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1549770962 shutdown_connections 2023-10-06T02:51:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1549770962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 0x7f8e08068cc0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1549770962 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 0x7f8e080cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1549770962 >> v2:172.21.15.83:3300/0 conn(0x7f8e08159f10 0x7f8e08068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1549770962 >> 172.21.15.81:0/1549770962 conn(0x7f8e080cd660 msgr2=0x7f8e080cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1549770962 shutdown_connections 2023-10-06T02:51:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.213+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1549770962 wait complete. 2023-10-06T02:51:57.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.214+0000 7f8e0ca4b700 1 Processor -- start 2023-10-06T02:51:57.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.214+0000 7f8e0ca4b700 1 -- start start 2023-10-06T02:51:57.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e0ca4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 0x7f8e08157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e0ca4b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 0x7f8e08156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e0ca4b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e08159f10 0x7f8e0815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e0ca4b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e08157c40 con 0x7f8e080ccb40 2023-10-06T02:51:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e0ca4b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0816b590 con 0x7f8e08159f10 2023-10-06T02:51:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e0ca4b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e08156b60 con 0x7f8e08159b40 2023-10-06T02:51:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 0x7f8e08157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 0x7f8e08157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56932/0 (socket says 172.21.15.81:56932) 2023-10-06T02:51:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e06d9d700 1 -- 172.21.15.81:0/1629635259 learned_addr learned my addr 172.21.15.81:0/1629635259 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e0759e700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e08159f10 0x7f8e0815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8dfe59c700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 0x7f8e08156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e06d9d700 1 -- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 msgr2=0x7f8e08156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e06d9d700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 0x7f8e08156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e06d9d700 1 -- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e08159f10 msgr2=0x7f8e0815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e06d9d700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e08159f10 0x7f8e0815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.215+0000 7f8e06d9d700 1 -- 172.21.15.81:0/1629635259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00009ae0 con 0x7f8e080ccb40 2023-10-06T02:51:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.216+0000 7f8e06d9d700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 0x7f8e08157700 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8df800ec80 tx=0x7f8df80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.216+0000 7f8dff7fe700 1 -- 172.21.15.81:0/1629635259 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df800c9d0 con 0x7f8e080ccb40 2023-10-06T02:51:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.216+0000 7f8dff7fe700 1 -- 172.21.15.81:0/1629635259 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df800cb30 con 0x7f8e080ccb40 2023-10-06T02:51:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.216+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0816a980 con 0x7f8e080ccb40 2023-10-06T02:51:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.216+0000 7f8dff7fe700 1 -- 172.21.15.81:0/1629635259 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8013470 con 0x7f8e080ccb40 2023-10-06T02:51:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.216+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0816af40 con 0x7f8e080ccb40 2023-10-06T02:51:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.217+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0815b4d0 con 0x7f8e080ccb40 2023-10-06T02:51:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.217+0000 7f8dff7fe700 1 -- 172.21.15.81:0/1629635259 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8df8013820 con 0x7f8e080ccb40 2023-10-06T02:51:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.218+0000 7f8dff7fe700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8de8066f30 0x7f8de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.218+0000 7f8dff7fe700 1 -- 172.21.15.81:0/1629635259 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8df8084ac0 con 0x7f8e080ccb40 2023-10-06T02:51:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.218+0000 7f8dfe59c700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8de8066f30 0x7f8de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.218+0000 7f8dfe59c700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8de8066f30 0x7f8de80693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8e080b2e80 tx=0x7f8df0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.222+0000 7f8dff7fe700 1 -- 172.21.15.81:0/1629635259 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8df8051b30 con 0x7f8e080ccb40 2023-10-06T02:51:57.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.404+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e08063e90 con 0x7f8e080ccb40 2023-10-06T02:51:57.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.405+0000 7f8dff7fe700 1 -- 172.21.15.81:0/1629635259 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16834 (secure 0 0 0) 0x7f8df8055150 con 0x7f8e080ccb40 2023-10-06T02:51:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":120,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:51:54.693043+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:51:50.714217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T02:51:52.027875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:51:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8de8066f30 msgr2=0x7f8de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8de8066f30 0x7f8de80693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8e080b2e80 tx=0x7f8df0008040 comp rx=0 tx=0).stop 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 msgr2=0x7f8e08157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 0x7f8e08157700 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8df800ec80 tx=0x7f8df80091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 shutdown_connections 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8de8066f30 0x7f8de80693e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e08159f10 0x7f8e0815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e080ccb40 0x7f8e08157700 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 --2- 172.21.15.81:0/1629635259 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e08159b40 0x7f8e08156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 >> 172.21.15.81:0/1629635259 conn(0x7f8e080cd660 msgr2=0x7f8e080b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 shutdown_connections 2023-10-06T02:51:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.407+0000 7f8e0ca4b700 1 -- 172.21.15.81:0/1629635259 wait complete. 2023-10-06T02:51:57.420 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:51:57.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:51:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.534+0000 7f6abbff8700 1 Processor -- start 2023-10-06T02:51:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.534+0000 7f6abbff8700 1 -- start start 2023-10-06T02:51:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6abbff8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ab4157ca0 0x7f6ab40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6abbff8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab40d07c0 con 0x7f6ab41578d0 2023-10-06T02:51:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6abbff8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab40cfbb0 con 0x7f6ab406d120 2023-10-06T02:51:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6abbff8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab40cfe90 con 0x7f6ab4157ca0 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab9593700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ab4157ca0 0x7f6ab40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab9d94700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6ab41578d0 0x7f6ab415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58140/0 (socket says 172.21.15.81:58140) 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab9593700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ab4157ca0 0x7f6ab40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56940/0 (socket says 172.21.15.81:56940) 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab9d94700 1 -- 172.21.15.81:0/2830391809 learned_addr learned my addr 172.21.15.81:0/2830391809 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab9593700 1 -- 172.21.15.81:0/2830391809 >> v1:172.21.15.83:6789/0 conn(0x7f6ab406d120 legacy=0x7f6ab406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab9593700 1 -- 172.21.15.81:0/2830391809 >> v1:172.21.15.81:6789/0 conn(0x7f6ab41578d0 legacy=0x7f6ab415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab8d92700 1 -- 172.21.15.81:0/2830391809 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249120914 0 0) 0x7f6ab40d07c0 con 0x7f6ab41578d0 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab9593700 1 -- 172.21.15.81:0/2830391809 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40d0170 con 0x7f6ab4157ca0 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab9593700 1 --2- 172.21.15.81:0/2830391809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 0x7f6ab40cf4f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40098e0 tx=0x7f6aa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1dbc2bf7e49fdd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab8d92700 1 -- 172.21.15.81:0/2830391809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4009e80 con 0x7f6ab4157ca0 2023-10-06T02:51:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab8d92700 1 -- 172.21.15.81:0/2830391809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa400b820 con 0x7f6ab4157ca0 2023-10-06T02:51:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.535+0000 7f6ab8d92700 1 -- 172.21.15.81:0/2830391809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa400bba0 con 0x7f6ab4157ca0 2023-10-06T02:51:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.536+0000 7f6abbff8700 1 -- 172.21.15.81:0/2830391809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 msgr2=0x7f6ab40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.536+0000 7f6abbff8700 1 --2- 172.21.15.81:0/2830391809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 0x7f6ab40cf4f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40098e0 tx=0x7f6aa40091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.536+0000 7f6abbff8700 1 -- 172.21.15.81:0/2830391809 shutdown_connections 2023-10-06T02:51:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.536+0000 7f6abbff8700 1 --2- 172.21.15.81:0/2830391809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 0x7f6ab40cf4f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.536+0000 7f6abbff8700 1 -- 172.21.15.81:0/2830391809 >> 172.21.15.81:0/2830391809 conn(0x7f6ab406bb90 msgr2=0x7f6ab406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.536+0000 7f6abbff8700 1 -- 172.21.15.81:0/2830391809 shutdown_connections 2023-10-06T02:51:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.536+0000 7f6abbff8700 1 -- 172.21.15.81:0/2830391809 wait complete. 2023-10-06T02:51:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.537+0000 7f6abbff8700 1 Processor -- start 2023-10-06T02:51:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.537+0000 7f6abbff8700 1 -- start start 2023-10-06T02:51:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6abbff8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ab406d120 0x7f6ab413a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6abbff8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ab41578d0 0x7f6ab4151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6abbff8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 0x7f6ab41565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6abbff8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab413ab40 con 0x7f6ab4157ca0 2023-10-06T02:51:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6abbff8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab413a810 con 0x7f6ab41578d0 2023-10-06T02:51:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6abbff8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4152590 con 0x7f6ab406d120 2023-10-06T02:51:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6aba595700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 0x7f6ab41565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6aba595700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 0x7f6ab41565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56942/0 (socket says 172.21.15.81:56942) 2023-10-06T02:51:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6aba595700 1 -- 172.21.15.81:0/2719610454 learned_addr learned my addr 172.21.15.81:0/2719610454 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6ab9593700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ab41578d0 0x7f6ab4151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6ab9d94700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ab406d120 0x7f6ab413a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6aba595700 1 -- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ab406d120 msgr2=0x7f6ab413a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6aba595700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ab406d120 0x7f6ab413a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6aba595700 1 -- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ab41578d0 msgr2=0x7f6ab4151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6aba595700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ab41578d0 0x7f6ab4151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6aba595700 1 -- 172.21.15.81:0/2719610454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4009420 con 0x7f6ab4157ca0 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6ab9593700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ab41578d0 0x7f6ab4151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.538+0000 7f6aba595700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 0x7f6ab41565b0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c930 tx=0x7f6aac0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.539+0000 7f6aa9ffb700 1 -- 172.21.15.81:0/2719610454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00ce70 con 0x7f6ab4157ca0 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.539+0000 7f6aa9ffb700 1 -- 172.21.15.81:0/2719610454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac00a7e0 con 0x7f6ab4157ca0 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.539+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab4152870 con 0x7f6ab4157ca0 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.539+0000 7f6aa9ffb700 1 -- 172.21.15.81:0/2719610454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00aba0 con 0x7f6ab4157ca0 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.539+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab414f9e0 con 0x7f6ab4157ca0 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.540+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab414fc30 con 0x7f6ab4157ca0 2023-10-06T02:51:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.540+0000 7f6aa9ffb700 1 -- 172.21.15.81:0/2719610454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6aac012420 con 0x7f6ab4157ca0 2023-10-06T02:51:57.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.540+0000 7f6aa9ffb700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a98066f30 0x7f6a980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:57.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.540+0000 7f6aa9ffb700 1 -- 172.21.15.81:0/2719610454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6aac084a80 con 0x7f6ab4157ca0 2023-10-06T02:51:57.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.540+0000 7f6ab9d94700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a98066f30 0x7f6a980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:57.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.541+0000 7f6ab9d94700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a98066f30 0x7f6a980693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0007fd0 tx=0x7f6ab0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:57.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.544+0000 7f6aa9ffb700 1 -- 172.21.15.81:0/2719610454 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6aac0556d0 con 0x7f6ab4157ca0 2023-10-06T02:51:57.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.725+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ab413ac80 con 0x7f6a98066f30 2023-10-06T02:51:58.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.735+0000 7f6aa9ffb700 1 -- 172.21.15.81:0/2719610454 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305775 (secure 0 0 0) 0x7f6ab413ac80 con 0x7f6a98066f30 2023-10-06T02:51:58.084 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:58.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a98066f30 msgr2=0x7f6a980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:58.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a98066f30 0x7f6a980693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0007fd0 tx=0x7f6ab0009040 comp rx=0 tx=0).stop 2023-10-06T02:51:58.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 msgr2=0x7f6ab41565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:58.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 0x7f6ab41565b0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c930 tx=0x7f6aac0026e0 comp rx=0 tx=0).stop 2023-10-06T02:51:58.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 shutdown_connections 2023-10-06T02:51:58.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab4157ca0 0x7f6ab41565b0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:58.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ab406d120 0x7f6ab413a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:58.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a98066f30 0x7f6a980693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:58.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 --2- 172.21.15.81:0/2719610454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ab41578d0 0x7f6ab4151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:58.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 >> 172.21.15.81:0/2719610454 conn(0x7f6ab406bb90 msgr2=0x7f6ab4155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 shutdown_connections 2023-10-06T02:51:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:57.738+0000 7f6abbff8700 1 -- 172.21.15.81:0/2719610454 wait complete. 2023-10-06T02:51:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:51:58.091 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-10-06T02:51:57.576538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6601,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555898,"statfs":{"total":1600000000,"available":1593240348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.895596"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704093+0000","last_change":"2023-10-06T02:51:53.704019+0000","last_active":"2023-10-06T02:51:53.704093+0000","last_peered":"2023-10-06T02:51:53.704093+0000","last_clean":"2023-10-06T02:51:53.704093+0000","last_became_active":"2023-10-06T02:51:53.703774+0000","last_became_peered":"2023-10-06T02:51:53.703774+0000","last_unstale":"2023-10-06T02:51:53.704093+0000","last_undegraded":"2023-10-06T02:51:53.704093+0000","last_fullsized":"2023-10-06T02:51:53.704093+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:52.185517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.699807+0000","last_change":"2023-10-06T02:51:53.699193+0000","last_active":"2023-10-06T02:51:53.699807+0000","last_peered":"2023-10-06T02:51:53.699807+0000","last_clean":"2023-10-06T02:51:53.699807+0000","last_became_active":"2023-10-06T02:51:53.698740+0000","last_became_peered":"2023-10-06T02:51:53.698740+0000","last_unstale":"2023-10-06T02:51:53.699807+0000","last_undegraded":"2023-10-06T02:51:53.699807+0000","last_fullsized":"2023-10-06T02:51:53.699807+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:41.162467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709750+0000","last_change":"2023-10-06T02:51:53.709696+0000","last_active":"2023-10-06T02:51:53.709750+0000","last_peered":"2023-10-06T02:51:53.709750+0000","last_clean":"2023-10-06T02:51:53.709750+0000","last_became_active":"2023-10-06T02:51:53.706108+0000","last_became_peered":"2023-10-06T02:51:53.706108+0000","last_unstale":"2023-10-06T02:51:53.709750+0000","last_undegraded":"2023-10-06T02:51:53.709750+0000","last_fullsized":"2023-10-06T02:51:53.709750+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:00.823847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.708424+0000","last_change":"2023-10-06T02:51:53.708320+0000","last_active":"2023-10-06T02:51:53.708424+0000","last_peered":"2023-10-06T02:51:53.708424+0000","last_clean":"2023-10-06T02:51:53.708424+0000","last_became_active":"2023-10-06T02:51:53.708038+0000","last_became_peered":"2023-10-06T02:51:53.708038+0000","last_unstale":"2023-10-06T02:51:53.708424+0000","last_undegraded":"2023-10-06T02:51:53.708424+0000","last_fullsized":"2023-10-06T02:51:53.708424+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709089+0000","last_change":"2023-10-06T02:51:53.709026+0000","last_active":"2023-10-06T02:51:53.709089+0000","last_peered":"2023-10-06T02:51:53.709089+0000","last_clean":"2023-10-06T02:51:53.709089+0000","last_became_active":"2023-10-06T02:51:53.707949+0000","last_became_peered":"2023-10-06T02:51:53.707949+0000","last_unstale":"2023-10-06T02:51:53.709089+0000","last_undegraded":"2023-10-06T02:51:53.709089+0000","last_fullsized":"2023-10-06T02:51:53.709089+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:15.344452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707019+0000","last_change":"2023-10-06T02:51:53.706960+0000","last_active":"2023-10-06T02:51:53.707019+0000","last_peered":"2023-10-06T02:51:53.707019+0000","last_clean":"2023-10-06T02:51:53.707019+0000","last_became_active":"2023-10-06T02:51:53.706510+0000","last_became_peered":"2023-10-06T02:51:53.706510+0000","last_unstale":"2023-10-06T02:51:53.707019+0000","last_undegraded":"2023-10-06T02:51:53.707019+0000","last_fullsized":"2023-10-06T02:51:53.707019+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:20.881843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.699826+0000","last_change":"2023-10-06T02:51:53.699324+0000","last_active":"2023-10-06T02:51:53.699826+0000","last_peered":"2023-10-06T02:51:53.699826+0000","last_clean":"2023-10-06T02:51:53.699826+0000","last_became_active":"2023-10-06T02:51:53.698959+0000","last_became_peered":"2023-10-06T02:51:53.698959+0000","last_unstale":"2023-10-06T02:51:53.699826+0000","last_undegraded":"2023-10-06T02:51:53.699826+0000","last_fullsized":"2023-10-06T02:51:53.699826+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:05.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706852+0000","last_change":"2023-10-06T02:51:53.706713+0000","last_active":"2023-10-06T02:51:53.706852+0000","last_peered":"2023-10-06T02:51:53.706852+0000","last_clean":"2023-10-06T02:51:53.706852+0000","last_became_active":"2023-10-06T02:51:53.706364+0000","last_became_peered":"2023-10-06T02:51:53.706364+0000","last_unstale":"2023-10-06T02:51:53.706852+0000","last_undegraded":"2023-10-06T02:51:53.706852+0000","last_fullsized":"2023-10-06T02:51:53.706852+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:55.142334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704516+0000","last_change":"2023-10-06T02:51:53.704405+0000","last_active":"2023-10-06T02:51:53.704516+0000","last_peered":"2023-10-06T02:51:53.704516+0000","last_clean":"2023-10-06T02:51:53.704516+0000","last_became_active":"2023-10-06T02:51:53.704176+0000","last_became_peered":"2023-10-06T02:51:53.704176+0000","last_unstale":"2023-10-06T02:51:53.704516+0000","last_undegraded":"2023-10-06T02:51:53.704516+0000","last_fullsized":"2023-10-06T02:51:53.704516+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.082848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709217+0000","last_change":"2023-10-06T02:51:53.709164+0000","last_active":"2023-10-06T02:51:53.709217+0000","last_peered":"2023-10-06T02:51:53.709217+0000","last_clean":"2023-10-06T02:51:53.709217+0000","last_became_active":"2023-10-06T02:51:53.708483+0000","last_became_peered":"2023-10-06T02:51:53.708483+0000","last_unstale":"2023-10-06T02:51:53.709217+0000","last_undegraded":"2023-10-06T02:51:53.709217+0000","last_fullsized":"2023-10-06T02:51:53.709217+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:22.145536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706244+0000","last_change":"2023-10-06T02:51:53.706160+0000","last_active":"2023-10-06T02:51:53.706244+0000","last_peered":"2023-10-06T02:51:53.706244+0000","last_clean":"2023-10-06T02:51:53.706244+0000","last_became_active":"2023-10-06T02:51:53.705953+0000","last_became_peered":"2023-10-06T02:51:53.705953+0000","last_unstale":"2023-10-06T02:51:53.706244+0000","last_undegraded":"2023-10-06T02:51:53.706244+0000","last_fullsized":"2023-10-06T02:51:53.706244+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.082848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.705741+0000","last_change":"2023-10-06T02:51:53.705661+0000","last_active":"2023-10-06T02:51:53.705741+0000","last_peered":"2023-10-06T02:51:53.705741+0000","last_clean":"2023-10-06T02:51:53.705741+0000","last_became_active":"2023-10-06T02:51:53.705434+0000","last_became_peered":"2023-10-06T02:51:53.705434+0000","last_unstale":"2023-10-06T02:51:53.705741+0000","last_undegraded":"2023-10-06T02:51:53.705741+0000","last_fullsized":"2023-10-06T02:51:53.705741+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:27.951240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704283+0000","last_change":"2023-10-06T02:51:53.704103+0000","last_active":"2023-10-06T02:51:53.704283+0000","last_peered":"2023-10-06T02:51:53.704283+0000","last_clean":"2023-10-06T02:51:53.704283+0000","last_became_active":"2023-10-06T02:51:53.703882+0000","last_became_peered":"2023-10-06T02:51:53.703882+0000","last_unstale":"2023-10-06T02:51:53.704283+0000","last_undegraded":"2023-10-06T02:51:53.704283+0000","last_fullsized":"2023-10-06T02:51:53.704283+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:15.344452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703595+0000","last_change":"2023-10-06T02:51:53.703412+0000","last_active":"2023-10-06T02:51:53.703595+0000","last_peered":"2023-10-06T02:51:53.703595+0000","last_clean":"2023-10-06T02:51:53.703595+0000","last_became_active":"2023-10-06T02:51:53.703175+0000","last_became_peered":"2023-10-06T02:51:53.703175+0000","last_unstale":"2023-10-06T02:51:53.703595+0000","last_undegraded":"2023-10-06T02:51:53.703595+0000","last_fullsized":"2023-10-06T02:51:53.703595+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706695+0000","last_change":"2023-10-06T02:51:53.706624+0000","last_active":"2023-10-06T02:51:53.706695+0000","last_peered":"2023-10-06T02:51:53.706695+0000","last_clean":"2023-10-06T02:51:53.706695+0000","last_became_active":"2023-10-06T02:51:53.706411+0000","last_became_peered":"2023-10-06T02:51:53.706411+0000","last_unstale":"2023-10-06T02:51:53.706695+0000","last_undegraded":"2023-10-06T02:51:53.706695+0000","last_fullsized":"2023-10-06T02:51:53.706695+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:22.145536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701928+0000","last_change":"2023-10-06T02:51:53.701862+0000","last_active":"2023-10-06T02:51:53.701928+0000","last_peered":"2023-10-06T02:51:53.701928+0000","last_clean":"2023-10-06T02:51:53.701928+0000","last_became_active":"2023-10-06T02:51:53.701644+0000","last_became_peered":"2023-10-06T02:51:53.701644+0000","last_unstale":"2023-10-06T02:51:53.701928+0000","last_undegraded":"2023-10-06T02:51:53.701928+0000","last_fullsized":"2023-10-06T02:51:53.701928+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:50.118473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709356+0000","last_change":"2023-10-06T02:51:53.709283+0000","last_active":"2023-10-06T02:51:53.709356+0000","last_peered":"2023-10-06T02:51:53.709356+0000","last_clean":"2023-10-06T02:51:53.709356+0000","last_became_active":"2023-10-06T02:51:53.709003+0000","last_became_peered":"2023-10-06T02:51:53.709003+0000","last_unstale":"2023-10-06T02:51:53.709356+0000","last_undegraded":"2023-10-06T02:51:53.709356+0000","last_fullsized":"2023-10-06T02:51:53.709356+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:10.668370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706713+0000","last_change":"2023-10-06T02:51:53.706435+0000","last_active":"2023-10-06T02:51:53.706713+0000","last_peered":"2023-10-06T02:51:53.706713+0000","last_clean":"2023-10-06T02:51:53.706713+0000","last_became_active":"2023-10-06T02:51:53.706197+0000","last_became_peered":"2023-10-06T02:51:53.706197+0000","last_unstale":"2023-10-06T02:51:53.706713+0000","last_undegraded":"2023-10-06T02:51:53.706713+0000","last_fullsized":"2023-10-06T02:51:53.706713+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:18.608816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710246+0000","last_change":"2023-10-06T02:51:53.710213+0000","last_active":"2023-10-06T02:51:53.710246+0000","last_peered":"2023-10-06T02:51:53.710246+0000","last_clean":"2023-10-06T02:51:53.710246+0000","last_became_active":"2023-10-06T02:51:53.705816+0000","last_became_peered":"2023-10-06T02:51:53.705816+0000","last_unstale":"2023-10-06T02:51:53.710246+0000","last_undegraded":"2023-10-06T02:51:53.710246+0000","last_fullsized":"2023-10-06T02:51:53.710246+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:04.183516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702812+0000","last_change":"2023-10-06T02:51:53.702744+0000","last_active":"2023-10-06T02:51:53.702812+0000","last_peered":"2023-10-06T02:51:53.702812+0000","last_clean":"2023-10-06T02:51:53.702812+0000","last_became_active":"2023-10-06T02:51:53.702536+0000","last_became_peered":"2023-10-06T02:51:53.702536+0000","last_unstale":"2023-10-06T02:51:53.702812+0000","last_undegraded":"2023-10-06T02:51:53.702812+0000","last_fullsized":"2023-10-06T02:51:53.702812+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:13.286058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.705740+0000","last_change":"2023-10-06T02:51:53.705488+0000","last_active":"2023-10-06T02:51:53.705740+0000","last_peered":"2023-10-06T02:51:53.705740+0000","last_clean":"2023-10-06T02:51:53.705740+0000","last_became_active":"2023-10-06T02:51:53.705267+0000","last_became_peered":"2023-10-06T02:51:53.705267+0000","last_unstale":"2023-10-06T02:51:53.705740+0000","last_undegraded":"2023-10-06T02:51:53.705740+0000","last_fullsized":"2023-10-06T02:51:53.705740+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:57.502747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704311+0000","last_change":"2023-10-06T02:51:53.704214+0000","last_active":"2023-10-06T02:51:53.704311+0000","last_peered":"2023-10-06T02:51:53.704311+0000","last_clean":"2023-10-06T02:51:53.704311+0000","last_became_active":"2023-10-06T02:51:53.703974+0000","last_became_peered":"2023-10-06T02:51:53.703974+0000","last_unstale":"2023-10-06T02:51:53.704311+0000","last_undegraded":"2023-10-06T02:51:53.704311+0000","last_fullsized":"2023-10-06T02:51:53.704311+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.082848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709976+0000","last_change":"2023-10-06T02:51:53.709806+0000","last_active":"2023-10-06T02:51:53.709976+0000","last_peered":"2023-10-06T02:51:53.709976+0000","last_clean":"2023-10-06T02:51:53.709976+0000","last_became_active":"2023-10-06T02:51:53.709014+0000","last_became_peered":"2023-10-06T02:51:53.709014+0000","last_unstale":"2023-10-06T02:51:53.709976+0000","last_undegraded":"2023-10-06T02:51:53.709976+0000","last_fullsized":"2023-10-06T02:51:53.709976+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:43.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707528+0000","last_change":"2023-10-06T02:51:53.707461+0000","last_active":"2023-10-06T02:51:53.707528+0000","last_peered":"2023-10-06T02:51:53.707528+0000","last_clean":"2023-10-06T02:51:53.707528+0000","last_became_active":"2023-10-06T02:51:53.707215+0000","last_became_peered":"2023-10-06T02:51:53.707215+0000","last_unstale":"2023-10-06T02:51:53.707528+0000","last_undegraded":"2023-10-06T02:51:53.707528+0000","last_fullsized":"2023-10-06T02:51:53.707528+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704995+0000","last_change":"2023-10-06T02:51:53.704937+0000","last_active":"2023-10-06T02:51:53.704995+0000","last_peered":"2023-10-06T02:51:53.704995+0000","last_clean":"2023-10-06T02:51:53.704995+0000","last_became_active":"2023-10-06T02:51:53.704565+0000","last_became_peered":"2023-10-06T02:51:53.704565+0000","last_unstale":"2023-10-06T02:51:53.704995+0000","last_undegraded":"2023-10-06T02:51:53.704995+0000","last_fullsized":"2023-10-06T02:51:53.704995+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:12:09.910371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707118+0000","last_change":"2023-10-06T02:51:53.706820+0000","last_active":"2023-10-06T02:51:53.707118+0000","last_peered":"2023-10-06T02:51:53.707118+0000","last_clean":"2023-10-06T02:51:53.707118+0000","last_became_active":"2023-10-06T02:51:53.706608+0000","last_became_peered":"2023-10-06T02:51:53.706608+0000","last_unstale":"2023-10-06T02:51:53.707118+0000","last_undegraded":"2023-10-06T02:51:53.707118+0000","last_fullsized":"2023-10-06T02:51:53.707118+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:28.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.708383+0000","last_change":"2023-10-06T02:51:53.708317+0000","last_active":"2023-10-06T02:51:53.708383+0000","last_peered":"2023-10-06T02:51:53.708383+0000","last_clean":"2023-10-06T02:51:53.708383+0000","last_became_active":"2023-10-06T02:51:53.708091+0000","last_became_peered":"2023-10-06T02:51:53.708091+0000","last_unstale":"2023-10-06T02:51:53.708383+0000","last_undegraded":"2023-10-06T02:51:53.708383+0000","last_fullsized":"2023-10-06T02:51:53.708383+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:22.145536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706081+0000","last_change":"2023-10-06T02:51:53.705760+0000","last_active":"2023-10-06T02:51:53.706081+0000","last_peered":"2023-10-06T02:51:53.706081+0000","last_clean":"2023-10-06T02:51:53.706081+0000","last_became_active":"2023-10-06T02:51:53.705171+0000","last_became_peered":"2023-10-06T02:51:53.705171+0000","last_unstale":"2023-10-06T02:51:53.706081+0000","last_undegraded":"2023-10-06T02:51:53.706081+0000","last_fullsized":"2023-10-06T02:51:53.706081+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.697305+0000","last_change":"2023-10-06T02:51:53.697234+0000","last_active":"2023-10-06T02:51:53.697305+0000","last_peered":"2023-10-06T02:51:53.697305+0000","last_clean":"2023-10-06T02:51:53.697305+0000","last_became_active":"2023-10-06T02:51:53.696989+0000","last_became_peered":"2023-10-06T02:51:53.696989+0000","last_unstale":"2023-10-06T02:51:53.697305+0000","last_undegraded":"2023-10-06T02:51:53.697305+0000","last_fullsized":"2023-10-06T02:51:53.697305+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:15.843250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704858+0000","last_change":"2023-10-06T02:51:53.704797+0000","last_active":"2023-10-06T02:51:53.704858+0000","last_peered":"2023-10-06T02:51:53.704858+0000","last_clean":"2023-10-06T02:51:53.704858+0000","last_became_active":"2023-10-06T02:51:53.704251+0000","last_became_peered":"2023-10-06T02:51:53.704251+0000","last_unstale":"2023-10-06T02:51:53.704858+0000","last_undegraded":"2023-10-06T02:51:53.704858+0000","last_fullsized":"2023-10-06T02:51:53.704858+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:08.192099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701919+0000","last_change":"2023-10-06T02:51:53.701409+0000","last_active":"2023-10-06T02:51:53.701919+0000","last_peered":"2023-10-06T02:51:53.701919+0000","last_clean":"2023-10-06T02:51:53.701919+0000","last_became_active":"2023-10-06T02:51:53.699611+0000","last_became_peered":"2023-10-06T02:51:53.699611+0000","last_unstale":"2023-10-06T02:51:53.701919+0000","last_undegraded":"2023-10-06T02:51:53.701919+0000","last_fullsized":"2023-10-06T02:51:53.701919+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:38.673744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702602+0000","last_change":"2023-10-06T02:51:53.702504+0000","last_active":"2023-10-06T02:51:53.702602+0000","last_peered":"2023-10-06T02:51:53.702602+0000","last_clean":"2023-10-06T02:51:53.702602+0000","last_became_active":"2023-10-06T02:51:53.702291+0000","last_became_peered":"2023-10-06T02:51:53.702291+0000","last_unstale":"2023-10-06T02:51:53.702602+0000","last_undegraded":"2023-10-06T02:51:53.702602+0000","last_fullsized":"2023-10-06T02:51:53.702602+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:32.916544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710162+0000","last_change":"2023-10-06T02:51:53.710126+0000","last_active":"2023-10-06T02:51:53.710162+0000","last_peered":"2023-10-06T02:51:53.710162+0000","last_clean":"2023-10-06T02:51:53.710162+0000","last_became_active":"2023-10-06T02:51:53.705508+0000","last_became_peered":"2023-10-06T02:51:53.705508+0000","last_unstale":"2023-10-06T02:51:53.710162+0000","last_undegraded":"2023-10-06T02:51:53.710162+0000","last_fullsized":"2023-10-06T02:51:53.710162+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:05.172423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"119'4","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716683+0000","last_change":"2023-10-06T02:51:52.689600+0000","last_active":"2023-10-06T02:51:53.716683+0000","last_peered":"2023-10-06T02:51:53.716683+0000","last_clean":"2023-10-06T02:51:53.716683+0000","last_became_active":"2023-10-06T02:51:52.689016+0000","last_became_peered":"2023-10-06T02:51:52.689016+0000","last_unstale":"2023-10-06T02:51:53.716683+0000","last_undegraded":"2023-10-06T02:51:53.716683+0000","last_fullsized":"2023-10-06T02:51:53.716683+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:38.023715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706642+0000","last_change":"2023-10-06T02:51:53.706569+0000","last_active":"2023-10-06T02:51:53.706642+0000","last_peered":"2023-10-06T02:51:53.706642+0000","last_clean":"2023-10-06T02:51:53.706642+0000","last_became_active":"2023-10-06T02:51:53.706067+0000","last_became_peered":"2023-10-06T02:51:53.706067+0000","last_unstale":"2023-10-06T02:51:53.706642+0000","last_undegraded":"2023-10-06T02:51:53.706642+0000","last_fullsized":"2023-10-06T02:51:53.706642+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:12.569770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.715404+0000","last_change":"2023-10-06T02:51:52.688972+0000","last_active":"2023-10-06T02:51:53.715404+0000","last_peered":"2023-10-06T02:51:53.715404+0000","last_clean":"2023-10-06T02:51:53.715404+0000","last_became_active":"2023-10-06T02:51:52.688200+0000","last_became_peered":"2023-10-06T02:51:52.688200+0000","last_unstale":"2023-10-06T02:51:53.715404+0000","last_undegraded":"2023-10-06T02:51:53.715404+0000","last_fullsized":"2023-10-06T02:51:53.715404+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:55.648087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703206+0000","last_change":"2023-10-06T02:51:53.702924+0000","last_active":"2023-10-06T02:51:53.703206+0000","last_peered":"2023-10-06T02:51:53.703206+0000","last_clean":"2023-10-06T02:51:53.703206+0000","last_became_active":"2023-10-06T02:51:53.702492+0000","last_became_peered":"2023-10-06T02:51:53.702492+0000","last_unstale":"2023-10-06T02:51:53.703206+0000","last_undegraded":"2023-10-06T02:51:53.703206+0000","last_fullsized":"2023-10-06T02:51:53.703206+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:50.118473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.717527+0000","last_change":"2023-10-06T02:51:52.689772+0000","last_active":"2023-10-06T02:51:53.717527+0000","last_peered":"2023-10-06T02:51:53.717527+0000","last_clean":"2023-10-06T02:51:53.717527+0000","last_became_active":"2023-10-06T02:51:52.689489+0000","last_became_peered":"2023-10-06T02:51:52.689489+0000","last_unstale":"2023-10-06T02:51:53.717527+0000","last_undegraded":"2023-10-06T02:51:53.717527+0000","last_fullsized":"2023-10-06T02:51:53.717527+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:30.790374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703285+0000","last_change":"2023-10-06T02:51:53.703090+0000","last_active":"2023-10-06T02:51:53.703285+0000","last_peered":"2023-10-06T02:51:53.703285+0000","last_clean":"2023-10-06T02:51:53.703285+0000","last_became_active":"2023-10-06T02:51:53.702798+0000","last_became_peered":"2023-10-06T02:51:53.702798+0000","last_unstale":"2023-10-06T02:51:53.703285+0000","last_undegraded":"2023-10-06T02:51:53.703285+0000","last_fullsized":"2023-10-06T02:51:53.703285+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.717874+0000","last_change":"2023-10-06T02:51:52.685712+0000","last_active":"2023-10-06T02:51:53.717874+0000","last_peered":"2023-10-06T02:51:53.717874+0000","last_clean":"2023-10-06T02:51:53.717874+0000","last_became_active":"2023-10-06T02:51:52.685431+0000","last_became_peered":"2023-10-06T02:51:52.685431+0000","last_unstale":"2023-10-06T02:51:53.717874+0000","last_undegraded":"2023-10-06T02:51:53.717874+0000","last_fullsized":"2023-10-06T02:51:53.717874+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:26.811429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706204+0000","last_change":"2023-10-06T02:51:53.705906+0000","last_active":"2023-10-06T02:51:53.706204+0000","last_peered":"2023-10-06T02:51:53.706204+0000","last_clean":"2023-10-06T02:51:53.706204+0000","last_became_active":"2023-10-06T02:51:53.705468+0000","last_became_peered":"2023-10-06T02:51:53.705468+0000","last_unstale":"2023-10-06T02:51:53.706204+0000","last_undegraded":"2023-10-06T02:51:53.706204+0000","last_fullsized":"2023-10-06T02:51:53.706204+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716613+0000","last_change":"2023-10-06T02:51:52.687543+0000","last_active":"2023-10-06T02:51:53.716613+0000","last_peered":"2023-10-06T02:51:53.716613+0000","last_clean":"2023-10-06T02:51:53.716613+0000","last_became_active":"2023-10-06T02:51:52.687308+0000","last_became_peered":"2023-10-06T02:51:52.687308+0000","last_unstale":"2023-10-06T02:51:53.716613+0000","last_undegraded":"2023-10-06T02:51:53.716613+0000","last_fullsized":"2023-10-06T02:51:53.716613+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:37.667180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710073+0000","last_change":"2023-10-06T02:51:53.710028+0000","last_active":"2023-10-06T02:51:53.710073+0000","last_peered":"2023-10-06T02:51:53.710073+0000","last_clean":"2023-10-06T02:51:53.710073+0000","last_became_active":"2023-10-06T02:51:53.705214+0000","last_became_peered":"2023-10-06T02:51:53.705214+0000","last_unstale":"2023-10-06T02:51:53.710073+0000","last_undegraded":"2023-10-06T02:51:53.710073+0000","last_fullsized":"2023-10-06T02:51:53.710073+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:04.803600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.714621+0000","last_change":"2023-10-06T02:51:52.687007+0000","last_active":"2023-10-06T02:51:53.714621+0000","last_peered":"2023-10-06T02:51:53.714621+0000","last_clean":"2023-10-06T02:51:53.714621+0000","last_became_active":"2023-10-06T02:51:52.686722+0000","last_became_peered":"2023-10-06T02:51:52.686722+0000","last_unstale":"2023-10-06T02:51:53.714621+0000","last_undegraded":"2023-10-06T02:51:53.714621+0000","last_fullsized":"2023-10-06T02:51:53.714621+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:26.811429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706100+0000","last_change":"2023-10-06T02:51:53.705950+0000","last_active":"2023-10-06T02:51:53.706100+0000","last_peered":"2023-10-06T02:51:53.706100+0000","last_clean":"2023-10-06T02:51:53.706100+0000","last_became_active":"2023-10-06T02:51:53.705514+0000","last_became_peered":"2023-10-06T02:51:53.705514+0000","last_unstale":"2023-10-06T02:51:53.706100+0000","last_undegraded":"2023-10-06T02:51:53.706100+0000","last_fullsized":"2023-10-06T02:51:53.706100+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.699982+0000","last_change":"2023-10-06T02:51:52.690586+0000","last_active":"2023-10-06T02:51:53.699982+0000","last_peered":"2023-10-06T02:51:53.699982+0000","last_clean":"2023-10-06T02:51:53.699982+0000","last_became_active":"2023-10-06T02:51:52.688572+0000","last_became_peered":"2023-10-06T02:51:52.688572+0000","last_unstale":"2023-10-06T02:51:53.699982+0000","last_undegraded":"2023-10-06T02:51:53.699982+0000","last_fullsized":"2023-10-06T02:51:53.699982+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:40.155904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.711054+0000","last_change":"2023-10-06T02:51:53.710985+0000","last_active":"2023-10-06T02:51:53.711054+0000","last_peered":"2023-10-06T02:51:53.711054+0000","last_clean":"2023-10-06T02:51:53.711054+0000","last_became_active":"2023-10-06T02:51:53.710827+0000","last_became_peered":"2023-10-06T02:51:53.710827+0000","last_unstale":"2023-10-06T02:51:53.711054+0000","last_undegraded":"2023-10-06T02:51:53.711054+0000","last_fullsized":"2023-10-06T02:51:53.711054+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:05.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701811+0000","last_change":"2023-10-06T02:51:52.682197+0000","last_active":"2023-10-06T02:51:53.701811+0000","last_peered":"2023-10-06T02:51:53.701811+0000","last_clean":"2023-10-06T02:51:53.701811+0000","last_became_active":"2023-10-06T02:51:52.682021+0000","last_became_peered":"2023-10-06T02:51:52.682021+0000","last_unstale":"2023-10-06T02:51:53.701811+0000","last_undegraded":"2023-10-06T02:51:53.701811+0000","last_fullsized":"2023-10-06T02:51:53.701811+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:26.811429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704085+0000","last_change":"2023-10-06T02:51:53.703912+0000","last_active":"2023-10-06T02:51:53.704085+0000","last_peered":"2023-10-06T02:51:53.704085+0000","last_clean":"2023-10-06T02:51:53.704085+0000","last_became_active":"2023-10-06T02:51:53.703425+0000","last_became_peered":"2023-10-06T02:51:53.703425+0000","last_unstale":"2023-10-06T02:51:53.704085+0000","last_undegraded":"2023-10-06T02:51:53.704085+0000","last_fullsized":"2023-10-06T02:51:53.704085+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:10.477515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.700133+0000","last_change":"2023-10-06T02:51:52.689619+0000","last_active":"2023-10-06T02:51:53.700133+0000","last_peered":"2023-10-06T02:51:53.700133+0000","last_clean":"2023-10-06T02:51:53.700133+0000","last_became_active":"2023-10-06T02:51:52.689332+0000","last_became_peered":"2023-10-06T02:51:52.689332+0000","last_unstale":"2023-10-06T02:51:53.700133+0000","last_undegraded":"2023-10-06T02:51:53.700133+0000","last_fullsized":"2023-10-06T02:51:53.700133+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:37.667180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703167+0000","last_change":"2023-10-06T02:51:53.703102+0000","last_active":"2023-10-06T02:51:53.703167+0000","last_peered":"2023-10-06T02:51:53.703167+0000","last_clean":"2023-10-06T02:51:53.703167+0000","last_became_active":"2023-10-06T02:51:53.702788+0000","last_became_peered":"2023-10-06T02:51:53.702788+0000","last_unstale":"2023-10-06T02:51:53.703167+0000","last_undegraded":"2023-10-06T02:51:53.703167+0000","last_fullsized":"2023-10-06T02:51:53.703167+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:50.118473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.697511+0000","last_change":"2023-10-06T02:51:52.689772+0000","last_active":"2023-10-06T02:51:53.697511+0000","last_peered":"2023-10-06T02:51:53.697511+0000","last_clean":"2023-10-06T02:51:53.697511+0000","last_became_active":"2023-10-06T02:51:52.689542+0000","last_became_peered":"2023-10-06T02:51:52.689542+0000","last_unstale":"2023-10-06T02:51:53.697511+0000","last_undegraded":"2023-10-06T02:51:53.697511+0000","last_fullsized":"2023-10-06T02:51:53.697511+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.730994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703141+0000","last_change":"2023-10-06T02:51:53.702671+0000","last_active":"2023-10-06T02:51:53.703141+0000","last_peered":"2023-10-06T02:51:53.703141+0000","last_clean":"2023-10-06T02:51:53.703141+0000","last_became_active":"2023-10-06T02:51:53.702444+0000","last_became_peered":"2023-10-06T02:51:53.702444+0000","last_unstale":"2023-10-06T02:51:53.703141+0000","last_undegraded":"2023-10-06T02:51:53.703141+0000","last_fullsized":"2023-10-06T02:51:53.703141+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:02.581954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"119'3","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716901+0000","last_change":"2023-10-06T02:51:52.684897+0000","last_active":"2023-10-06T02:51:53.716901+0000","last_peered":"2023-10-06T02:51:53.716901+0000","last_clean":"2023-10-06T02:51:53.716901+0000","last_became_active":"2023-10-06T02:51:52.684655+0000","last_became_peered":"2023-10-06T02:51:52.684655+0000","last_unstale":"2023-10-06T02:51:53.716901+0000","last_undegraded":"2023-10-06T02:51:53.716901+0000","last_fullsized":"2023-10-06T02:51:53.716901+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:40.155904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707093+0000","last_change":"2023-10-06T02:51:53.706924+0000","last_active":"2023-10-06T02:51:53.707093+0000","last_peered":"2023-10-06T02:51:53.707093+0000","last_clean":"2023-10-06T02:51:53.707093+0000","last_became_active":"2023-10-06T02:51:53.706455+0000","last_became_peered":"2023-10-06T02:51:53.706455+0000","last_unstale":"2023-10-06T02:51:53.707093+0000","last_undegraded":"2023-10-06T02:51:53.707093+0000","last_fullsized":"2023-10-06T02:51:53.707093+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:05.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"119'6","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.718851+0000","last_change":"2023-10-06T02:51:52.688075+0000","last_active":"2023-10-06T02:51:53.718851+0000","last_peered":"2023-10-06T02:51:53.718851+0000","last_clean":"2023-10-06T02:51:53.718851+0000","last_became_active":"2023-10-06T02:51:52.687867+0000","last_became_peered":"2023-10-06T02:51:52.687867+0000","last_unstale":"2023-10-06T02:51:53.718851+0000","last_undegraded":"2023-10-06T02:51:53.718851+0000","last_fullsized":"2023-10-06T02:51:53.718851+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:31.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703274+0000","last_change":"2023-10-06T02:51:53.703080+0000","last_active":"2023-10-06T02:51:53.703274+0000","last_peered":"2023-10-06T02:51:53.703274+0000","last_clean":"2023-10-06T02:51:53.703274+0000","last_became_active":"2023-10-06T02:51:53.702294+0000","last_became_peered":"2023-10-06T02:51:53.702294+0000","last_unstale":"2023-10-06T02:51:53.703274+0000","last_undegraded":"2023-10-06T02:51:53.703274+0000","last_fullsized":"2023-10-06T02:51:53.703274+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:05.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.718536+0000","last_change":"2023-10-06T02:51:52.683306+0000","last_active":"2023-10-06T02:51:53.718536+0000","last_peered":"2023-10-06T02:51:53.718536+0000","last_clean":"2023-10-06T02:51:53.718536+0000","last_became_active":"2023-10-06T02:51:52.683091+0000","last_became_peered":"2023-10-06T02:51:52.683091+0000","last_unstale":"2023-10-06T02:51:53.718536+0000","last_undegraded":"2023-10-06T02:51:53.718536+0000","last_fullsized":"2023-10-06T02:51:53.718536+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:02.321446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.705289+0000","last_change":"2023-10-06T02:51:53.705154+0000","last_active":"2023-10-06T02:51:53.705289+0000","last_peered":"2023-10-06T02:51:53.705289+0000","last_clean":"2023-10-06T02:51:53.705289+0000","last_became_active":"2023-10-06T02:51:53.704930+0000","last_became_peered":"2023-10-06T02:51:53.704930+0000","last_unstale":"2023-10-06T02:51:53.705289+0000","last_undegraded":"2023-10-06T02:51:53.705289+0000","last_fullsized":"2023-10-06T02:51:53.705289+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:23.413373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701264+0000","last_change":"2023-10-06T02:51:52.687169+0000","last_active":"2023-10-06T02:51:53.701264+0000","last_peered":"2023-10-06T02:51:53.701264+0000","last_clean":"2023-10-06T02:51:53.701264+0000","last_became_active":"2023-10-06T02:51:52.686954+0000","last_became_peered":"2023-10-06T02:51:52.686954+0000","last_unstale":"2023-10-06T02:51:53.701264+0000","last_undegraded":"2023-10-06T02:51:53.701264+0000","last_fullsized":"2023-10-06T02:51:53.701264+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:27.703269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703158+0000","last_change":"2023-10-06T02:51:53.703023+0000","last_active":"2023-10-06T02:51:53.703158+0000","last_peered":"2023-10-06T02:51:53.703158+0000","last_clean":"2023-10-06T02:51:53.703158+0000","last_became_active":"2023-10-06T02:51:53.702811+0000","last_became_peered":"2023-10-06T02:51:53.702811+0000","last_unstale":"2023-10-06T02:51:53.703158+0000","last_undegraded":"2023-10-06T02:51:53.703158+0000","last_fullsized":"2023-10-06T02:51:53.703158+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:50.502200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694502+0000","last_change":"2023-10-06T02:51:52.687300+0000","last_active":"2023-10-06T02:51:53.694502+0000","last_peered":"2023-10-06T02:51:53.694502+0000","last_clean":"2023-10-06T02:51:53.694502+0000","last_became_active":"2023-10-06T02:51:52.686778+0000","last_became_peered":"2023-10-06T02:51:52.686778+0000","last_unstale":"2023-10-06T02:51:53.694502+0000","last_undegraded":"2023-10-06T02:51:53.694502+0000","last_fullsized":"2023-10-06T02:51:53.694502+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:46.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710592+0000","last_change":"2023-10-06T02:51:53.710558+0000","last_active":"2023-10-06T02:51:53.710592+0000","last_peered":"2023-10-06T02:51:53.710592+0000","last_clean":"2023-10-06T02:51:53.710592+0000","last_became_active":"2023-10-06T02:51:53.709840+0000","last_became_peered":"2023-10-06T02:51:53.709840+0000","last_unstale":"2023-10-06T02:51:53.710592+0000","last_undegraded":"2023-10-06T02:51:53.710592+0000","last_fullsized":"2023-10-06T02:51:53.710592+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:34.818764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"119'8","reported_seq":18,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.717885+0000","last_change":"2023-10-06T02:51:52.688799+0000","last_active":"2023-10-06T02:51:53.717885+0000","last_peered":"2023-10-06T02:51:53.717885+0000","last_clean":"2023-10-06T02:51:53.717885+0000","last_became_active":"2023-10-06T02:51:52.688387+0000","last_became_peered":"2023-10-06T02:51:52.688387+0000","last_unstale":"2023-10-06T02:51:53.717885+0000","last_undegraded":"2023-10-06T02:51:53.717885+0000","last_fullsized":"2023-10-06T02:51:53.717885+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:38.023715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704075+0000","last_change":"2023-10-06T02:51:53.703529+0000","last_active":"2023-10-06T02:51:53.704075+0000","last_peered":"2023-10-06T02:51:53.704075+0000","last_clean":"2023-10-06T02:51:53.704075+0000","last_became_active":"2023-10-06T02:51:53.703304+0000","last_became_peered":"2023-10-06T02:51:53.703304+0000","last_unstale":"2023-10-06T02:51:53.704075+0000","last_undegraded":"2023-10-06T02:51:53.704075+0000","last_fullsized":"2023-10-06T02:51:53.704075+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:15.117428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.718561+0000","last_change":"2023-10-06T02:51:52.683245+0000","last_active":"2023-10-06T02:51:53.718561+0000","last_peered":"2023-10-06T02:51:53.718561+0000","last_clean":"2023-10-06T02:51:53.718561+0000","last_became_active":"2023-10-06T02:51:52.682960+0000","last_became_peered":"2023-10-06T02:51:52.682960+0000","last_unstale":"2023-10-06T02:51:53.718561+0000","last_undegraded":"2023-10-06T02:51:53.718561+0000","last_fullsized":"2023-10-06T02:51:53.718561+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:49.495637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704786+0000","last_change":"2023-10-06T02:51:53.704671+0000","last_active":"2023-10-06T02:51:53.704786+0000","last_peered":"2023-10-06T02:51:53.704786+0000","last_clean":"2023-10-06T02:51:53.704786+0000","last_became_active":"2023-10-06T02:51:53.704418+0000","last_became_peered":"2023-10-06T02:51:53.704418+0000","last_unstale":"2023-10-06T02:51:53.704786+0000","last_undegraded":"2023-10-06T02:51:53.704786+0000","last_fullsized":"2023-10-06T02:51:53.704786+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:23.585623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.698414+0000","last_change":"2023-10-06T02:51:52.687357+0000","last_active":"2023-10-06T02:51:53.698414+0000","last_peered":"2023-10-06T02:51:53.698414+0000","last_clean":"2023-10-06T02:51:53.698414+0000","last_became_active":"2023-10-06T02:51:52.687139+0000","last_became_peered":"2023-10-06T02:51:52.687139+0000","last_unstale":"2023-10-06T02:51:53.698414+0000","last_undegraded":"2023-10-06T02:51:53.698414+0000","last_fullsized":"2023-10-06T02:51:53.698414+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:47.645693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.708847+0000","last_change":"2023-10-06T02:51:53.708788+0000","last_active":"2023-10-06T02:51:53.708847+0000","last_peered":"2023-10-06T02:51:53.708847+0000","last_clean":"2023-10-06T02:51:53.708847+0000","last_became_active":"2023-10-06T02:51:53.708576+0000","last_became_peered":"2023-10-06T02:51:53.708576+0000","last_unstale":"2023-10-06T02:51:53.708847+0000","last_undegraded":"2023-10-06T02:51:53.708847+0000","last_fullsized":"2023-10-06T02:51:53.708847+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:22.145536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.695180+0000","last_change":"2023-10-06T02:51:52.691973+0000","last_active":"2023-10-06T02:51:53.695180+0000","last_peered":"2023-10-06T02:51:53.695180+0000","last_clean":"2023-10-06T02:51:53.695180+0000","last_became_active":"2023-10-06T02:51:52.691260+0000","last_became_peered":"2023-10-06T02:51:52.691260+0000","last_unstale":"2023-10-06T02:51:53.695180+0000","last_undegraded":"2023-10-06T02:51:53.695180+0000","last_fullsized":"2023-10-06T02:51:53.695180+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:56.496184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703478+0000","last_change":"2023-10-06T02:51:53.703386+0000","last_active":"2023-10-06T02:51:53.703478+0000","last_peered":"2023-10-06T02:51:53.703478+0000","last_clean":"2023-10-06T02:51:53.703478+0000","last_became_active":"2023-10-06T02:51:53.702837+0000","last_became_peered":"2023-10-06T02:51:53.702837+0000","last_unstale":"2023-10-06T02:51:53.703478+0000","last_undegraded":"2023-10-06T02:51:53.703478+0000","last_fullsized":"2023-10-06T02:51:53.703478+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:50.118473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701941+0000","last_change":"2023-10-06T02:51:52.691101+0000","last_active":"2023-10-06T02:51:53.701941+0000","last_peered":"2023-10-06T02:51:53.701941+0000","last_clean":"2023-10-06T02:51:53.701941+0000","last_became_active":"2023-10-06T02:51:52.690647+0000","last_became_peered":"2023-10-06T02:51:52.690647+0000","last_unstale":"2023-10-06T02:51:53.701941+0000","last_undegraded":"2023-10-06T02:51:53.701941+0000","last_fullsized":"2023-10-06T02:51:53.701941+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:20.288432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702592+0000","last_change":"2023-10-06T02:51:53.702192+0000","last_active":"2023-10-06T02:51:53.702592+0000","last_peered":"2023-10-06T02:51:53.702592+0000","last_clean":"2023-10-06T02:51:53.702592+0000","last_became_active":"2023-10-06T02:51:53.701971+0000","last_became_peered":"2023-10-06T02:51:53.701971+0000","last_unstale":"2023-10-06T02:51:53.702592+0000","last_undegraded":"2023-10-06T02:51:53.702592+0000","last_fullsized":"2023-10-06T02:51:53.702592+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:15.638828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.700222+0000","last_change":"2023-10-06T02:51:52.689471+0000","last_active":"2023-10-06T02:51:53.700222+0000","last_peered":"2023-10-06T02:51:53.700222+0000","last_clean":"2023-10-06T02:51:53.700222+0000","last_became_active":"2023-10-06T02:51:52.689052+0000","last_became_peered":"2023-10-06T02:51:52.689052+0000","last_unstale":"2023-10-06T02:51:53.700222+0000","last_undegraded":"2023-10-06T02:51:53.700222+0000","last_fullsized":"2023-10-06T02:51:53.700222+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:03.028473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704816+0000","last_change":"2023-10-06T02:51:53.704750+0000","last_active":"2023-10-06T02:51:53.704816+0000","last_peered":"2023-10-06T02:51:53.704816+0000","last_clean":"2023-10-06T02:51:53.704816+0000","last_became_active":"2023-10-06T02:51:53.704391+0000","last_became_peered":"2023-10-06T02:51:53.704391+0000","last_unstale":"2023-10-06T02:51:53.704816+0000","last_undegraded":"2023-10-06T02:51:53.704816+0000","last_fullsized":"2023-10-06T02:51:53.704816+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:03.328009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694597+0000","last_change":"2023-10-06T02:51:52.687448+0000","last_active":"2023-10-06T02:51:53.694597+0000","last_peered":"2023-10-06T02:51:53.694597+0000","last_clean":"2023-10-06T02:51:53.694597+0000","last_became_active":"2023-10-06T02:51:52.687077+0000","last_became_peered":"2023-10-06T02:51:52.687077+0000","last_unstale":"2023-10-06T02:51:53.694597+0000","last_undegraded":"2023-10-06T02:51:53.694597+0000","last_fullsized":"2023-10-06T02:51:53.694597+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:16.159105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707074+0000","last_change":"2023-10-06T02:51:53.706986+0000","last_active":"2023-10-06T02:51:53.707074+0000","last_peered":"2023-10-06T02:51:53.707074+0000","last_clean":"2023-10-06T02:51:53.707074+0000","last_became_active":"2023-10-06T02:51:53.706757+0000","last_became_peered":"2023-10-06T02:51:53.706757+0000","last_unstale":"2023-10-06T02:51:53.707074+0000","last_undegraded":"2023-10-06T02:51:53.707074+0000","last_fullsized":"2023-10-06T02:51:53.707074+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:15.344452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696287+0000","last_change":"2023-10-06T02:51:52.687962+0000","last_active":"2023-10-06T02:51:53.696287+0000","last_peered":"2023-10-06T02:51:53.696287+0000","last_clean":"2023-10-06T02:51:53.696287+0000","last_became_active":"2023-10-06T02:51:52.687722+0000","last_became_peered":"2023-10-06T02:51:52.687722+0000","last_unstale":"2023-10-06T02:51:53.696287+0000","last_undegraded":"2023-10-06T02:51:53.696287+0000","last_fullsized":"2023-10-06T02:51:53.696287+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.836687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706311+0000","last_change":"2023-10-06T02:51:53.706232+0000","last_active":"2023-10-06T02:51:53.706311+0000","last_peered":"2023-10-06T02:51:53.706311+0000","last_clean":"2023-10-06T02:51:53.706311+0000","last_became_active":"2023-10-06T02:51:53.705620+0000","last_became_peered":"2023-10-06T02:51:53.705620+0000","last_unstale":"2023-10-06T02:51:53.706311+0000","last_undegraded":"2023-10-06T02:51:53.706311+0000","last_fullsized":"2023-10-06T02:51:53.706311+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694820+0000","last_change":"2023-10-06T02:51:52.688418+0000","last_active":"2023-10-06T02:51:53.694820+0000","last_peered":"2023-10-06T02:51:53.694820+0000","last_clean":"2023-10-06T02:51:53.694820+0000","last_became_active":"2023-10-06T02:51:52.687896+0000","last_became_peered":"2023-10-06T02:51:52.687896+0000","last_unstale":"2023-10-06T02:51:53.694820+0000","last_undegraded":"2023-10-06T02:51:53.694820+0000","last_fullsized":"2023-10-06T02:51:53.694820+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:29.876754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706643+0000","last_change":"2023-10-06T02:51:53.706484+0000","last_active":"2023-10-06T02:51:53.706643+0000","last_peered":"2023-10-06T02:51:53.706643+0000","last_clean":"2023-10-06T02:51:53.706643+0000","last_became_active":"2023-10-06T02:51:53.706087+0000","last_became_peered":"2023-10-06T02:51:53.706087+0000","last_unstale":"2023-10-06T02:51:53.706643+0000","last_undegraded":"2023-10-06T02:51:53.706643+0000","last_fullsized":"2023-10-06T02:51:53.706643+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.082848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.695091+0000","last_change":"2023-10-06T02:51:52.691065+0000","last_active":"2023-10-06T02:51:53.695091+0000","last_peered":"2023-10-06T02:51:53.695091+0000","last_clean":"2023-10-06T02:51:53.695091+0000","last_became_active":"2023-10-06T02:51:52.690764+0000","last_became_peered":"2023-10-06T02:51:52.690764+0000","last_unstale":"2023-10-06T02:51:53.695091+0000","last_undegraded":"2023-10-06T02:51:53.695091+0000","last_fullsized":"2023-10-06T02:51:53.695091+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:53.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":99,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702149+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:51:53.702149+0000","last_peered":"2023-10-06T02:51:53.702149+0000","last_clean":"2023-10-06T02:51:53.702149+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:51:53.702149+0000","last_undegraded":"2023-10-06T02:51:53.702149+0000","last_fullsized":"2023-10-06T02:51:53.702149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704128+0000","last_change":"2023-10-06T02:51:53.704014+0000","last_active":"2023-10-06T02:51:53.704128+0000","last_peered":"2023-10-06T02:51:53.704128+0000","last_clean":"2023-10-06T02:51:53.704128+0000","last_became_active":"2023-10-06T02:51:53.703373+0000","last_became_peered":"2023-10-06T02:51:53.703373+0000","last_unstale":"2023-10-06T02:51:53.704128+0000","last_undegraded":"2023-10-06T02:51:53.704128+0000","last_fullsized":"2023-10-06T02:51:53.704128+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:49.300018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716072+0000","last_change":"2023-10-06T02:51:52.691706+0000","last_active":"2023-10-06T02:51:53.716072+0000","last_peered":"2023-10-06T02:51:53.716072+0000","last_clean":"2023-10-06T02:51:53.716072+0000","last_became_active":"2023-10-06T02:51:52.690968+0000","last_became_peered":"2023-10-06T02:51:52.690968+0000","last_unstale":"2023-10-06T02:51:53.716072+0000","last_undegraded":"2023-10-06T02:51:53.716072+0000","last_fullsized":"2023-10-06T02:51:53.716072+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:04.275931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702156+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:51:53.702156+0000","last_peered":"2023-10-06T02:51:53.702156+0000","last_clean":"2023-10-06T02:51:53.702156+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:51:53.702156+0000","last_undegraded":"2023-10-06T02:51:53.702156+0000","last_fullsized":"2023-10-06T02:51:53.702156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709461+0000","last_change":"2023-10-06T02:51:53.709361+0000","last_active":"2023-10-06T02:51:53.709461+0000","last_peered":"2023-10-06T02:51:53.709461+0000","last_clean":"2023-10-06T02:51:53.709461+0000","last_became_active":"2023-10-06T02:51:53.708792+0000","last_became_peered":"2023-10-06T02:51:53.708792+0000","last_unstale":"2023-10-06T02:51:53.709461+0000","last_undegraded":"2023-10-06T02:51:53.709461+0000","last_fullsized":"2023-10-06T02:51:53.709461+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702079+0000","last_change":"2023-10-06T02:51:52.691528+0000","last_active":"2023-10-06T02:51:53.702079+0000","last_peered":"2023-10-06T02:51:53.702079+0000","last_clean":"2023-10-06T02:51:53.702079+0000","last_became_active":"2023-10-06T02:51:52.691033+0000","last_became_peered":"2023-10-06T02:51:52.691033+0000","last_unstale":"2023-10-06T02:51:53.702079+0000","last_undegraded":"2023-10-06T02:51:53.702079+0000","last_fullsized":"2023-10-06T02:51:53.702079+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:27.703269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.695150+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:51:53.695150+0000","last_peered":"2023-10-06T02:51:53.695150+0000","last_clean":"2023-10-06T02:51:53.695150+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:51:53.695150+0000","last_undegraded":"2023-10-06T02:51:53.695150+0000","last_fullsized":"2023-10-06T02:51:53.695150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703297+0000","last_change":"2023-10-06T02:51:53.703234+0000","last_active":"2023-10-06T02:51:53.703297+0000","last_peered":"2023-10-06T02:51:53.703297+0000","last_clean":"2023-10-06T02:51:53.703297+0000","last_became_active":"2023-10-06T02:51:53.702554+0000","last_became_peered":"2023-10-06T02:51:53.702554+0000","last_unstale":"2023-10-06T02:51:53.703297+0000","last_undegraded":"2023-10-06T02:51:53.703297+0000","last_fullsized":"2023-10-06T02:51:53.703297+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:15.344452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716455+0000","last_change":"2023-10-06T02:51:52.683613+0000","last_active":"2023-10-06T02:51:53.716455+0000","last_peered":"2023-10-06T02:51:53.716455+0000","last_clean":"2023-10-06T02:51:53.716455+0000","last_became_active":"2023-10-06T02:51:52.683395+0000","last_became_peered":"2023-10-06T02:51:52.683395+0000","last_unstale":"2023-10-06T02:51:53.716455+0000","last_undegraded":"2023-10-06T02:51:53.716455+0000","last_fullsized":"2023-10-06T02:51:53.716455+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:24.661218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702565+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:51:53.702565+0000","last_peered":"2023-10-06T02:51:53.702565+0000","last_clean":"2023-10-06T02:51:53.702565+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:51:53.702565+0000","last_undegraded":"2023-10-06T02:51:53.702565+0000","last_fullsized":"2023-10-06T02:51:53.702565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696302+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:51:53.696302+0000","last_peered":"2023-10-06T02:51:53.696302+0000","last_clean":"2023-10-06T02:51:53.696302+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:51:53.696302+0000","last_undegraded":"2023-10-06T02:51:53.696302+0000","last_fullsized":"2023-10-06T02:51:53.696302+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701888+0000","last_change":"2023-10-06T02:51:53.700744+0000","last_active":"2023-10-06T02:51:53.701888+0000","last_peered":"2023-10-06T02:51:53.701888+0000","last_clean":"2023-10-06T02:51:53.701888+0000","last_became_active":"2023-10-06T02:51:53.699304+0000","last_became_peered":"2023-10-06T02:51:53.699304+0000","last_unstale":"2023-10-06T02:51:53.701888+0000","last_undegraded":"2023-10-06T02:51:53.701888+0000","last_fullsized":"2023-10-06T02:51:53.701888+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:04.035037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716052+0000","last_change":"2023-10-06T02:51:52.689855+0000","last_active":"2023-10-06T02:51:53.716052+0000","last_peered":"2023-10-06T02:51:53.716052+0000","last_clean":"2023-10-06T02:51:53.716052+0000","last_became_active":"2023-10-06T02:51:52.689372+0000","last_became_peered":"2023-10-06T02:51:52.689372+0000","last_unstale":"2023-10-06T02:51:53.716052+0000","last_undegraded":"2023-10-06T02:51:53.716052+0000","last_fullsized":"2023-10-06T02:51:53.716052+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:03.028473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696216+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:51:53.696216+0000","last_peered":"2023-10-06T02:51:53.696216+0000","last_clean":"2023-10-06T02:51:53.696216+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:51:53.696216+0000","last_undegraded":"2023-10-06T02:51:53.696216+0000","last_fullsized":"2023-10-06T02:51:53.696216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.700814+0000","last_change":"2023-10-06T02:51:53.699929+0000","last_active":"2023-10-06T02:51:53.700814+0000","last_peered":"2023-10-06T02:51:53.700814+0000","last_clean":"2023-10-06T02:51:53.700814+0000","last_became_active":"2023-10-06T02:51:53.699696+0000","last_became_peered":"2023-10-06T02:51:53.699696+0000","last_unstale":"2023-10-06T02:51:53.700814+0000","last_undegraded":"2023-10-06T02:51:53.700814+0000","last_fullsized":"2023-10-06T02:51:53.700814+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.510103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694912+0000","last_change":"2023-10-06T02:51:52.684267+0000","last_active":"2023-10-06T02:51:53.694912+0000","last_peered":"2023-10-06T02:51:53.694912+0000","last_clean":"2023-10-06T02:51:53.694912+0000","last_became_active":"2023-10-06T02:51:52.684058+0000","last_became_peered":"2023-10-06T02:51:52.684058+0000","last_unstale":"2023-10-06T02:51:53.694912+0000","last_undegraded":"2023-10-06T02:51:53.694912+0000","last_fullsized":"2023-10-06T02:51:53.694912+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:09.404424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696378+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:51:53.696378+0000","last_peered":"2023-10-06T02:51:53.696378+0000","last_clean":"2023-10-06T02:51:53.696378+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:51:53.696378+0000","last_undegraded":"2023-10-06T02:51:53.696378+0000","last_fullsized":"2023-10-06T02:51:53.696378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710505+0000","last_change":"2023-10-06T02:51:53.710467+0000","last_active":"2023-10-06T02:51:53.710505+0000","last_peered":"2023-10-06T02:51:53.710505+0000","last_clean":"2023-10-06T02:51:53.710505+0000","last_became_active":"2023-10-06T02:51:53.706122+0000","last_became_peered":"2023-10-06T02:51:53.706122+0000","last_unstale":"2023-10-06T02:51:53.710505+0000","last_undegraded":"2023-10-06T02:51:53.710505+0000","last_fullsized":"2023-10-06T02:51:53.710505+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:55.432947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.718682+0000","last_change":"2023-10-06T02:51:52.683082+0000","last_active":"2023-10-06T02:51:53.718682+0000","last_peered":"2023-10-06T02:51:53.718682+0000","last_clean":"2023-10-06T02:51:53.718682+0000","last_became_active":"2023-10-06T02:51:52.682867+0000","last_became_peered":"2023-10-06T02:51:52.682867+0000","last_unstale":"2023-10-06T02:51:53.718682+0000","last_undegraded":"2023-10-06T02:51:53.718682+0000","last_fullsized":"2023-10-06T02:51:53.718682+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:56.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.699647+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:51:53.699647+0000","last_peered":"2023-10-06T02:51:53.699647+0000","last_clean":"2023-10-06T02:51:53.699647+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:51:53.699647+0000","last_undegraded":"2023-10-06T02:51:53.699647+0000","last_fullsized":"2023-10-06T02:51:53.699647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709986+0000","last_change":"2023-10-06T02:51:53.709908+0000","last_active":"2023-10-06T02:51:53.709986+0000","last_peered":"2023-10-06T02:51:53.709986+0000","last_clean":"2023-10-06T02:51:53.709986+0000","last_became_active":"2023-10-06T02:51:53.709510+0000","last_became_peered":"2023-10-06T02:51:53.709510+0000","last_unstale":"2023-10-06T02:51:53.709986+0000","last_undegraded":"2023-10-06T02:51:53.709986+0000","last_fullsized":"2023-10-06T02:51:53.709986+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:31.720053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694723+0000","last_change":"2023-10-06T02:51:52.684490+0000","last_active":"2023-10-06T02:51:53.694723+0000","last_peered":"2023-10-06T02:51:53.694723+0000","last_clean":"2023-10-06T02:51:53.694723+0000","last_became_active":"2023-10-06T02:51:52.684278+0000","last_became_peered":"2023-10-06T02:51:52.684278+0000","last_unstale":"2023-10-06T02:51:53.694723+0000","last_undegraded":"2023-10-06T02:51:53.694723+0000","last_fullsized":"2023-10-06T02:51:53.694723+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:53.801331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696413+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:51:53.696413+0000","last_peered":"2023-10-06T02:51:53.696413+0000","last_clean":"2023-10-06T02:51:53.696413+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:51:53.696413+0000","last_undegraded":"2023-10-06T02:51:53.696413+0000","last_fullsized":"2023-10-06T02:51:53.696413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1257,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194055,"statfs":{"total":200000000,"available":198712684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.52600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76100000000000001,"5min":1.393,"15min":1.393},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.28000000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.748,"5min":1.081,"15min":1.081},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72599999999999998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.48299999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56699999999999995,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66400000000000003,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45600000000000002,"15min":0.45500000000000002},"min":{"1min":0.32100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69199999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.49399999999999999,"15min":0.504},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.879,"15min":0.879},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77800000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.622},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71299999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":682,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194629,"statfs":{"total":200000000,"available":199301100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.62},"min":{"1min":0.36799999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66000000000000003,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.54400000000000004,"15min":0.57199999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.68100000000000005,"5min":1.879,"15min":1.879},"last":0.497}]},{"osd":1,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.66100000000000003,"15min":0.98699999999999999},"min":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71399999999999997,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65600000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70299999999999996,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55300000000000005,"15min":0.57999999999999996},"min":{"1min":0.32000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53300000000000003,"15min":0.55600000000000005},"min":{"1min":0.36199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68899999999999995,"5min":1.163,"15min":1.163},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.48799999999999999,"15min":0.55400000000000005},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79800000000000004,"5min":1.05,"15min":1.05},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.51700000000000002,"15min":0.56699999999999995},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76900000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.495,"15min":0.53800000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.54600000000000004,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83899999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41499999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.62},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73599999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.54800000000000004,"15min":0.59799999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194632,"statfs":{"total":200000000,"available":199303178,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.316,"15min":0.314},"min":{"1min":0.22900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.312},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.33200000000000002},"min":{"1min":0.26100000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54200000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.32300000000000001},"min":{"1min":0.25,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40000000000000002,"15min":0.38400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61699999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.378,"15min":0.36299999999999999},"min":{"1min":0.308,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.42399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.439,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.56999999999999995,"15min":0.53200000000000003},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89500000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.53900000000000003},"min":{"1min":0.45400000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.502,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59699999999999998,"15min":0.56699999999999995},"min":{"1min":0.44800000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1258,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194053,"statfs":{"total":200000000,"available":198711218,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33700000000000002,"15min":0.34899999999999998},"min":{"1min":0.21199999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.439,"5min":1.177,"15min":1.177},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38100000000000001,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51300000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.315}]},{"osd":2,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.54400000000000004,"15min":1.1100000000000001},"min":{"1min":0.23899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.56899999999999995,"5min":22.038,"15min":22.038},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.247,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56499999999999995,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.26000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35499999999999998,"15min":0.36199999999999999},"min":{"1min":0.22600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.495,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.58599999999999997,"15min":1.141},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.503,"5min":21.942,"15min":21.942},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.72199999999999998,"15min":1.202},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59899999999999998,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.76000000000000001,"15min":1.2969999999999999},"min":{"1min":0.40999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.433,"5min":0.311,"15min":0.311},"max":{"1min":0.70699999999999996,"5min":1.401,"15min":1.401},"last":0.69799999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.755,"15min":1.2330000000000001},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68899999999999995,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.77900000000000003,"15min":1.323},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69899999999999995,"5min":21.98,"15min":21.98},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58099999999999996,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.79900000000000004,"5min":1.425,"15min":1.425},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.68799999999999994,"15min":0.93400000000000005},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73499999999999999,"5min":11.154,"15min":11.154},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194632,"statfs":{"total":200000000,"available":199303178,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.33600000000000002},"min":{"1min":0.27700000000000002,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52200000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.34399999999999997},"min":{"1min":0.22,"5min":0.186,"15min":0.186},"max":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.373}]},{"osd":1,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.37,"15min":0.35799999999999998},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56200000000000006,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.28199999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.63300000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39700000000000002,"15min":0.376},"min":{"1min":0.33300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60999999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.312},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.33300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.46700000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61399999999999999,"15min":0.58399999999999996},"min":{"1min":0.47499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59499999999999997,"15min":0.55900000000000005},"min":{"1min":0.40000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61599999999999999,"15min":0.59899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.93899999999999995,"5min":1.002,"15min":1.002},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.433,"5min":0.375,"15min":0.375},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61899999999999999,"15min":0.59499999999999997},"min":{"1min":0.52500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.5}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302658,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.317,"15min":0.307},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.499,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.35999999999999999,"15min":0.33000000000000002},"min":{"1min":0.28299999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.27600000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34999999999999998,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.373,"15min":0.34699999999999998},"min":{"1min":0.28399999999999997,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.628,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.29599999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.40699999999999997,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.80400000000000005,"5min":3.044,"15min":3.044},"last":0.313},{"interface":"front","average":{"1min":0.435,"5min":0.377,"15min":0.34599999999999997},"min":{"1min":0.32200000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90800000000000003,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.46400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.93300000000000005,"5min":2.25,"15min":2.25},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60999999999999999,"15min":0.69599999999999995},"min":{"1min":0.48599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88200000000000001,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.47999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.46700000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94299999999999995,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.71099999999999997,"15min":0.97399999999999998},"min":{"1min":0.46800000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58899999999999997,"15min":0.55400000000000005},"min":{"1min":0.46700000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199303120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.58199999999999996,"15min":0.80800000000000005},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63100000000000001,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.63400000000000001},"min":{"1min":0.38800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.72499999999999998,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61299999999999999,"15min":0.84299999999999997},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65300000000000002,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59299999999999997,"15min":0.79100000000000004},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.65500000000000003},"min":{"1min":0.312,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70799999999999996,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.68500000000000005},"min":{"1min":0.378,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69499999999999995,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53200000000000003,"15min":0.59399999999999997},"min":{"1min":0.38500000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64700000000000002,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.62},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77000000000000002,"5min":3.456,"15min":3.456},"last":0.438}]},{"osd":5,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46999999999999997,"15min":0.48999999999999999},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.67300000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49399999999999999,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.624,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.52200000000000002},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.39900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.42299999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.71499999999999997,"15min":1.0469999999999999},"min":{"1min":0.49099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.747,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194632,"statfs":{"total":200000000,"available":199303212,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.315,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.755,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40899999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.38500000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45700000000000002,"15min":0.45000000000000001},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.73699999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.433},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.879,"15min":0.879},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66600000000000004}]}]}],"pool_statfs":[]}} 2023-10-06T02:51:58.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:51:58.730 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-06T02:51:57.984+0000 7f32e23d4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:51:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.850+0000 7f7311f12700 1 Processor -- start 2023-10-06T02:51:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.850+0000 7f7311f12700 1 -- start start 2023-10-06T02:51:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f7311f12700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f730c157ca0 0x7f730c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f7311f12700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f730c06d120 0x7f730c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f7311f12700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730c06dac0 con 0x7f730c1578d0 2023-10-06T02:51:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f7311f12700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730c0d07c0 con 0x7f730c06d120 2023-10-06T02:51:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f7311f12700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0cfbb0 con 0x7f730c157ca0 2023-10-06T02:51:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f730b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f730c1578d0 0x7f730c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58154/0 (socket says 172.21.15.81:58154) 2023-10-06T02:51:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f730b7fe700 1 -- 172.21.15.81:0/3541789568 learned_addr learned my addr 172.21.15.81:0/3541789568 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f730bfff700 1 --2- 172.21.15.81:0/3541789568 >> v2:172.21.15.83:3300/0 conn(0x7f730c06d120 0x7f730c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f730affd700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f730c157ca0 0x7f730c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888358141 0 0) 0x7f72fc001490 con 0x7f730c1578d0 2023-10-06T02:51:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.851+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f4003570 con 0x7f730c1578d0 2023-10-06T02:51:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1376999943 0 0) 0x7f72f4003570 con 0x7f730c1578d0 2023-10-06T02:51:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f730c157ca0 msgr2=0x7f730c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f730c157ca0 0x7f730c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 >> v2:172.21.15.83:3300/0 conn(0x7f730c06d120 msgr2=0x7f730c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 --2- 172.21.15.81:0/3541789568 >> v2:172.21.15.83:3300/0 conn(0x7f730c06d120 0x7f730c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c0cfe90 con 0x7f730c1578d0 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f72fc001980 con 0x7f730c1578d0 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 >> v1:172.21.15.81:6789/0 conn(0x7f730c1578d0 legacy=0x7f730c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f730c157ca0 0x7f72f4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4003fe0 0x7f72f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72f4004d50 0x7f72f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0d07c0 con 0x7f72f4003fe0 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0cfbb0 con 0x7f72f4004d50 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f400ba90 con 0x7f730c157ca0 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730affd700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4003fe0 0x7f72f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730b7fe700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f730c157ca0 0x7f72f4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730bfff700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72f4004d50 0x7f72f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730affd700 1 -- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f730c157ca0 msgr2=0x7f72f4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730affd700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f730c157ca0 0x7f72f4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730affd700 1 -- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72f4004d50 msgr2=0x7f72f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730affd700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72f4004d50 0x7f72f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730affd700 1 -- 172.21.15.81:0/3541789568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4003570 con 0x7f72f4003fe0 2023-10-06T02:51:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730affd700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4003fe0 0x7f72f4004810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f7300009c00 tx=0x7f73000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f7e39a8923559 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000e6b0 con 0x7f72f4003fe0 2023-10-06T02:51:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000e810 con 0x7f72f4003fe0 2023-10-06T02:51:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.852+0000 7f730a7fc700 1 -- 172.21.15.81:0/3541789568 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000ebd0 con 0x7f72f4003fe0 2023-10-06T02:51:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.853+0000 7f7311f12700 1 -- 172.21.15.81:0/3541789568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4003fe0 msgr2=0x7f72f4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.853+0000 7f7311f12700 1 --2- 172.21.15.81:0/3541789568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4003fe0 0x7f72f4004810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f7300009c00 tx=0x7f73000091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.853+0000 7f730bfff700 1 -- 172.21.15.81:0/3541789568 reap_dead start 2023-10-06T02:51:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.853+0000 7f7311f12700 1 -- 172.21.15.81:0/3541789568 shutdown_connections 2023-10-06T02:51:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.853+0000 7f7311f12700 1 -- 172.21.15.81:0/3541789568 >> 172.21.15.81:0/3541789568 conn(0x7f730c06bb90 msgr2=0x7f730c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.853+0000 7f7311f12700 1 -- 172.21.15.81:0/3541789568 shutdown_connections 2023-10-06T02:51:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.853+0000 7f7311f12700 1 -- 172.21.15.81:0/3541789568 wait complete. 2023-10-06T02:51:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.854+0000 7f7311f12700 1 Processor -- start 2023-10-06T02:51:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.854+0000 7f7311f12700 1 -- start start 2023-10-06T02:51:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f7311f12700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72f4003fe0 0x7f730c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f7311f12700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0c7ec0 0x7f730c16a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f7311f12700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f730c16a6d0 0x7f730c15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f7311f12700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c16ac30 con 0x7f730c0c7ec0 2023-10-06T02:51:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f7311f12700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0c8bf0 con 0x7f730c16a6d0 2023-10-06T02:51:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f7311f12700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c16c370 con 0x7f72f4003fe0 2023-10-06T02:51:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0c7ec0 0x7f730c16a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0c7ec0 0x7f730c16a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56968/0 (socket says 172.21.15.81:56968) 2023-10-06T02:51:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730affd700 1 -- 172.21.15.81:0/86540477 learned_addr learned my addr 172.21.15.81:0/86540477 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730b7fe700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72f4003fe0 0x7f730c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730bfff700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f730c16a6d0 0x7f730c15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730affd700 1 -- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72f4003fe0 msgr2=0x7f730c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730affd700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72f4003fe0 0x7f730c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730affd700 1 -- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f730c16a6d0 msgr2=0x7f730c15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730affd700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f730c16a6d0 0x7f730c15c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730affd700 1 -- 172.21.15.81:0/86540477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c0c8350 con 0x7f730c0c7ec0 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730b7fe700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72f4003fe0 0x7f730c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730bfff700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f730c16a6d0 0x7f730c15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.855+0000 7f730affd700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0c7ec0 0x7f730c16a190 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f72f4004730 tx=0x7f730001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.856+0000 7f72f37fe700 1 -- 172.21.15.81:0/86540477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300022070 con 0x7f730c0c7ec0 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.856+0000 7f72f37fe700 1 -- 172.21.15.81:0/86540477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000e980 con 0x7f730c0c7ec0 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.856+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c0c8630 con 0x7f730c0c7ec0 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.856+0000 7f72f37fe700 1 -- 172.21.15.81:0/86540477 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300027470 con 0x7f730c0c7ec0 2023-10-06T02:51:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.856+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730c0c70d0 con 0x7f730c0c7ec0 2023-10-06T02:51:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.857+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c067ac0 con 0x7f730c0c7ec0 2023-10-06T02:51:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.857+0000 7f72f37fe700 1 -- 172.21.15.81:0/86540477 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f730001c450 con 0x7f730c0c7ec0 2023-10-06T02:51:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.857+0000 7f72f37fe700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.857+0000 7f72f37fe700 1 -- 172.21.15.81:0/86540477 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f73000861f0 con 0x7f730c0c7ec0 2023-10-06T02:51:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.858+0000 7f730b7fe700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.858+0000 7f730b7fe700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f72f8066f30 0x7f72f80693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f72fc001190 tx=0x7f72fc006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:58.862+0000 7f72f37fe700 1 -- 172.21.15.81:0/86540477 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7300053480 con 0x7f730c0c7ec0 2023-10-06T02:51:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.043+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f730c0d0170 con 0x7f72f8066f30 2023-10-06T02:51:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.052+0000 7f72f37fe700 1 -- 172.21.15.81:0/86540477 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305775 (secure 0 0 0) 0x7f730c0d0170 con 0x7f72f8066f30 2023-10-06T02:51:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:51:59.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f72f8066f30 msgr2=0x7f72f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f72f8066f30 0x7f72f80693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f72fc001190 tx=0x7f72fc006040 comp rx=0 tx=0).stop 2023-10-06T02:51:59.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0c7ec0 msgr2=0x7f730c16a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0c7ec0 0x7f730c16a190 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f72f4004730 tx=0x7f730001a000 comp rx=0 tx=0).stop 2023-10-06T02:51:59.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 shutdown_connections 2023-10-06T02:51:59.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f730c16a6d0 0x7f730c15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72f4003fe0 0x7f730c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 --2- 172.21.15.81:0/86540477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0c7ec0 0x7f730c16a190 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 >> 172.21.15.81:0/86540477 conn(0x7f730c06bb90 msgr2=0x7f730c0688d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 shutdown_connections 2023-10-06T02:51:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.055+0000 7f7311f12700 1 -- 172.21.15.81:0/86540477 wait complete. 2023-10-06T02:51:59.200 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:51:59.200 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-10-06T02:51:57.576538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6601,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555898,"statfs":{"total":1600000000,"available":1593240348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.895596"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704093+0000","last_change":"2023-10-06T02:51:53.704019+0000","last_active":"2023-10-06T02:51:53.704093+0000","last_peered":"2023-10-06T02:51:53.704093+0000","last_clean":"2023-10-06T02:51:53.704093+0000","last_became_active":"2023-10-06T02:51:53.703774+0000","last_became_peered":"2023-10-06T02:51:53.703774+0000","last_unstale":"2023-10-06T02:51:53.704093+0000","last_undegraded":"2023-10-06T02:51:53.704093+0000","last_fullsized":"2023-10-06T02:51:53.704093+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:52.185517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.699807+0000","last_change":"2023-10-06T02:51:53.699193+0000","last_active":"2023-10-06T02:51:53.699807+0000","last_peered":"2023-10-06T02:51:53.699807+0000","last_clean":"2023-10-06T02:51:53.699807+0000","last_became_active":"2023-10-06T02:51:53.698740+0000","last_became_peered":"2023-10-06T02:51:53.698740+0000","last_unstale":"2023-10-06T02:51:53.699807+0000","last_undegraded":"2023-10-06T02:51:53.699807+0000","last_fullsized":"2023-10-06T02:51:53.699807+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:41.162467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709750+0000","last_change":"2023-10-06T02:51:53.709696+0000","last_active":"2023-10-06T02:51:53.709750+0000","last_peered":"2023-10-06T02:51:53.709750+0000","last_clean":"2023-10-06T02:51:53.709750+0000","last_became_active":"2023-10-06T02:51:53.706108+0000","last_became_peered":"2023-10-06T02:51:53.706108+0000","last_unstale":"2023-10-06T02:51:53.709750+0000","last_undegraded":"2023-10-06T02:51:53.709750+0000","last_fullsized":"2023-10-06T02:51:53.709750+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:00.823847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.708424+0000","last_change":"2023-10-06T02:51:53.708320+0000","last_active":"2023-10-06T02:51:53.708424+0000","last_peered":"2023-10-06T02:51:53.708424+0000","last_clean":"2023-10-06T02:51:53.708424+0000","last_became_active":"2023-10-06T02:51:53.708038+0000","last_became_peered":"2023-10-06T02:51:53.708038+0000","last_unstale":"2023-10-06T02:51:53.708424+0000","last_undegraded":"2023-10-06T02:51:53.708424+0000","last_fullsized":"2023-10-06T02:51:53.708424+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709089+0000","last_change":"2023-10-06T02:51:53.709026+0000","last_active":"2023-10-06T02:51:53.709089+0000","last_peered":"2023-10-06T02:51:53.709089+0000","last_clean":"2023-10-06T02:51:53.709089+0000","last_became_active":"2023-10-06T02:51:53.707949+0000","last_became_peered":"2023-10-06T02:51:53.707949+0000","last_unstale":"2023-10-06T02:51:53.709089+0000","last_undegraded":"2023-10-06T02:51:53.709089+0000","last_fullsized":"2023-10-06T02:51:53.709089+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:15.344452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707019+0000","last_change":"2023-10-06T02:51:53.706960+0000","last_active":"2023-10-06T02:51:53.707019+0000","last_peered":"2023-10-06T02:51:53.707019+0000","last_clean":"2023-10-06T02:51:53.707019+0000","last_became_active":"2023-10-06T02:51:53.706510+0000","last_became_peered":"2023-10-06T02:51:53.706510+0000","last_unstale":"2023-10-06T02:51:53.707019+0000","last_undegraded":"2023-10-06T02:51:53.707019+0000","last_fullsized":"2023-10-06T02:51:53.707019+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:20.881843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.699826+0000","last_change":"2023-10-06T02:51:53.699324+0000","last_active":"2023-10-06T02:51:53.699826+0000","last_peered":"2023-10-06T02:51:53.699826+0000","last_clean":"2023-10-06T02:51:53.699826+0000","last_became_active":"2023-10-06T02:51:53.698959+0000","last_became_peered":"2023-10-06T02:51:53.698959+0000","last_unstale":"2023-10-06T02:51:53.699826+0000","last_undegraded":"2023-10-06T02:51:53.699826+0000","last_fullsized":"2023-10-06T02:51:53.699826+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:05.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706852+0000","last_change":"2023-10-06T02:51:53.706713+0000","last_active":"2023-10-06T02:51:53.706852+0000","last_peered":"2023-10-06T02:51:53.706852+0000","last_clean":"2023-10-06T02:51:53.706852+0000","last_became_active":"2023-10-06T02:51:53.706364+0000","last_became_peered":"2023-10-06T02:51:53.706364+0000","last_unstale":"2023-10-06T02:51:53.706852+0000","last_undegraded":"2023-10-06T02:51:53.706852+0000","last_fullsized":"2023-10-06T02:51:53.706852+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:55.142334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704516+0000","last_change":"2023-10-06T02:51:53.704405+0000","last_active":"2023-10-06T02:51:53.704516+0000","last_peered":"2023-10-06T02:51:53.704516+0000","last_clean":"2023-10-06T02:51:53.704516+0000","last_became_active":"2023-10-06T02:51:53.704176+0000","last_became_peered":"2023-10-06T02:51:53.704176+0000","last_unstale":"2023-10-06T02:51:53.704516+0000","last_undegraded":"2023-10-06T02:51:53.704516+0000","last_fullsized":"2023-10-06T02:51:53.704516+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.082848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709217+0000","last_change":"2023-10-06T02:51:53.709164+0000","last_active":"2023-10-06T02:51:53.709217+0000","last_peered":"2023-10-06T02:51:53.709217+0000","last_clean":"2023-10-06T02:51:53.709217+0000","last_became_active":"2023-10-06T02:51:53.708483+0000","last_became_peered":"2023-10-06T02:51:53.708483+0000","last_unstale":"2023-10-06T02:51:53.709217+0000","last_undegraded":"2023-10-06T02:51:53.709217+0000","last_fullsized":"2023-10-06T02:51:53.709217+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:22.145536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706244+0000","last_change":"2023-10-06T02:51:53.706160+0000","last_active":"2023-10-06T02:51:53.706244+0000","last_peered":"2023-10-06T02:51:53.706244+0000","last_clean":"2023-10-06T02:51:53.706244+0000","last_became_active":"2023-10-06T02:51:53.705953+0000","last_became_peered":"2023-10-06T02:51:53.705953+0000","last_unstale":"2023-10-06T02:51:53.706244+0000","last_undegraded":"2023-10-06T02:51:53.706244+0000","last_fullsized":"2023-10-06T02:51:53.706244+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.082848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.705741+0000","last_change":"2023-10-06T02:51:53.705661+0000","last_active":"2023-10-06T02:51:53.705741+0000","last_peered":"2023-10-06T02:51:53.705741+0000","last_clean":"2023-10-06T02:51:53.705741+0000","last_became_active":"2023-10-06T02:51:53.705434+0000","last_became_peered":"2023-10-06T02:51:53.705434+0000","last_unstale":"2023-10-06T02:51:53.705741+0000","last_undegraded":"2023-10-06T02:51:53.705741+0000","last_fullsized":"2023-10-06T02:51:53.705741+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:27.951240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704283+0000","last_change":"2023-10-06T02:51:53.704103+0000","last_active":"2023-10-06T02:51:53.704283+0000","last_peered":"2023-10-06T02:51:53.704283+0000","last_clean":"2023-10-06T02:51:53.704283+0000","last_became_active":"2023-10-06T02:51:53.703882+0000","last_became_peered":"2023-10-06T02:51:53.703882+0000","last_unstale":"2023-10-06T02:51:53.704283+0000","last_undegraded":"2023-10-06T02:51:53.704283+0000","last_fullsized":"2023-10-06T02:51:53.704283+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:15.344452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703595+0000","last_change":"2023-10-06T02:51:53.703412+0000","last_active":"2023-10-06T02:51:53.703595+0000","last_peered":"2023-10-06T02:51:53.703595+0000","last_clean":"2023-10-06T02:51:53.703595+0000","last_became_active":"2023-10-06T02:51:53.703175+0000","last_became_peered":"2023-10-06T02:51:53.703175+0000","last_unstale":"2023-10-06T02:51:53.703595+0000","last_undegraded":"2023-10-06T02:51:53.703595+0000","last_fullsized":"2023-10-06T02:51:53.703595+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706695+0000","last_change":"2023-10-06T02:51:53.706624+0000","last_active":"2023-10-06T02:51:53.706695+0000","last_peered":"2023-10-06T02:51:53.706695+0000","last_clean":"2023-10-06T02:51:53.706695+0000","last_became_active":"2023-10-06T02:51:53.706411+0000","last_became_peered":"2023-10-06T02:51:53.706411+0000","last_unstale":"2023-10-06T02:51:53.706695+0000","last_undegraded":"2023-10-06T02:51:53.706695+0000","last_fullsized":"2023-10-06T02:51:53.706695+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:22.145536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701928+0000","last_change":"2023-10-06T02:51:53.701862+0000","last_active":"2023-10-06T02:51:53.701928+0000","last_peered":"2023-10-06T02:51:53.701928+0000","last_clean":"2023-10-06T02:51:53.701928+0000","last_became_active":"2023-10-06T02:51:53.701644+0000","last_became_peered":"2023-10-06T02:51:53.701644+0000","last_unstale":"2023-10-06T02:51:53.701928+0000","last_undegraded":"2023-10-06T02:51:53.701928+0000","last_fullsized":"2023-10-06T02:51:53.701928+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:50.118473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709356+0000","last_change":"2023-10-06T02:51:53.709283+0000","last_active":"2023-10-06T02:51:53.709356+0000","last_peered":"2023-10-06T02:51:53.709356+0000","last_clean":"2023-10-06T02:51:53.709356+0000","last_became_active":"2023-10-06T02:51:53.709003+0000","last_became_peered":"2023-10-06T02:51:53.709003+0000","last_unstale":"2023-10-06T02:51:53.709356+0000","last_undegraded":"2023-10-06T02:51:53.709356+0000","last_fullsized":"2023-10-06T02:51:53.709356+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:10.668370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706713+0000","last_change":"2023-10-06T02:51:53.706435+0000","last_active":"2023-10-06T02:51:53.706713+0000","last_peered":"2023-10-06T02:51:53.706713+0000","last_clean":"2023-10-06T02:51:53.706713+0000","last_became_active":"2023-10-06T02:51:53.706197+0000","last_became_peered":"2023-10-06T02:51:53.706197+0000","last_unstale":"2023-10-06T02:51:53.706713+0000","last_undegraded":"2023-10-06T02:51:53.706713+0000","last_fullsized":"2023-10-06T02:51:53.706713+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:18.608816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710246+0000","last_change":"2023-10-06T02:51:53.710213+0000","last_active":"2023-10-06T02:51:53.710246+0000","last_peered":"2023-10-06T02:51:53.710246+0000","last_clean":"2023-10-06T02:51:53.710246+0000","last_became_active":"2023-10-06T02:51:53.705816+0000","last_became_peered":"2023-10-06T02:51:53.705816+0000","last_unstale":"2023-10-06T02:51:53.710246+0000","last_undegraded":"2023-10-06T02:51:53.710246+0000","last_fullsized":"2023-10-06T02:51:53.710246+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:04.183516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702812+0000","last_change":"2023-10-06T02:51:53.702744+0000","last_active":"2023-10-06T02:51:53.702812+0000","last_peered":"2023-10-06T02:51:53.702812+0000","last_clean":"2023-10-06T02:51:53.702812+0000","last_became_active":"2023-10-06T02:51:53.702536+0000","last_became_peered":"2023-10-06T02:51:53.702536+0000","last_unstale":"2023-10-06T02:51:53.702812+0000","last_undegraded":"2023-10-06T02:51:53.702812+0000","last_fullsized":"2023-10-06T02:51:53.702812+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:13.286058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.705740+0000","last_change":"2023-10-06T02:51:53.705488+0000","last_active":"2023-10-06T02:51:53.705740+0000","last_peered":"2023-10-06T02:51:53.705740+0000","last_clean":"2023-10-06T02:51:53.705740+0000","last_became_active":"2023-10-06T02:51:53.705267+0000","last_became_peered":"2023-10-06T02:51:53.705267+0000","last_unstale":"2023-10-06T02:51:53.705740+0000","last_undegraded":"2023-10-06T02:51:53.705740+0000","last_fullsized":"2023-10-06T02:51:53.705740+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:57.502747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704311+0000","last_change":"2023-10-06T02:51:53.704214+0000","last_active":"2023-10-06T02:51:53.704311+0000","last_peered":"2023-10-06T02:51:53.704311+0000","last_clean":"2023-10-06T02:51:53.704311+0000","last_became_active":"2023-10-06T02:51:53.703974+0000","last_became_peered":"2023-10-06T02:51:53.703974+0000","last_unstale":"2023-10-06T02:51:53.704311+0000","last_undegraded":"2023-10-06T02:51:53.704311+0000","last_fullsized":"2023-10-06T02:51:53.704311+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.082848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709976+0000","last_change":"2023-10-06T02:51:53.709806+0000","last_active":"2023-10-06T02:51:53.709976+0000","last_peered":"2023-10-06T02:51:53.709976+0000","last_clean":"2023-10-06T02:51:53.709976+0000","last_became_active":"2023-10-06T02:51:53.709014+0000","last_became_peered":"2023-10-06T02:51:53.709014+0000","last_unstale":"2023-10-06T02:51:53.709976+0000","last_undegraded":"2023-10-06T02:51:53.709976+0000","last_fullsized":"2023-10-06T02:51:53.709976+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:43.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707528+0000","last_change":"2023-10-06T02:51:53.707461+0000","last_active":"2023-10-06T02:51:53.707528+0000","last_peered":"2023-10-06T02:51:53.707528+0000","last_clean":"2023-10-06T02:51:53.707528+0000","last_became_active":"2023-10-06T02:51:53.707215+0000","last_became_peered":"2023-10-06T02:51:53.707215+0000","last_unstale":"2023-10-06T02:51:53.707528+0000","last_undegraded":"2023-10-06T02:51:53.707528+0000","last_fullsized":"2023-10-06T02:51:53.707528+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704995+0000","last_change":"2023-10-06T02:51:53.704937+0000","last_active":"2023-10-06T02:51:53.704995+0000","last_peered":"2023-10-06T02:51:53.704995+0000","last_clean":"2023-10-06T02:51:53.704995+0000","last_became_active":"2023-10-06T02:51:53.704565+0000","last_became_peered":"2023-10-06T02:51:53.704565+0000","last_unstale":"2023-10-06T02:51:53.704995+0000","last_undegraded":"2023-10-06T02:51:53.704995+0000","last_fullsized":"2023-10-06T02:51:53.704995+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:12:09.910371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707118+0000","last_change":"2023-10-06T02:51:53.706820+0000","last_active":"2023-10-06T02:51:53.707118+0000","last_peered":"2023-10-06T02:51:53.707118+0000","last_clean":"2023-10-06T02:51:53.707118+0000","last_became_active":"2023-10-06T02:51:53.706608+0000","last_became_peered":"2023-10-06T02:51:53.706608+0000","last_unstale":"2023-10-06T02:51:53.707118+0000","last_undegraded":"2023-10-06T02:51:53.707118+0000","last_fullsized":"2023-10-06T02:51:53.707118+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:28.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.708383+0000","last_change":"2023-10-06T02:51:53.708317+0000","last_active":"2023-10-06T02:51:53.708383+0000","last_peered":"2023-10-06T02:51:53.708383+0000","last_clean":"2023-10-06T02:51:53.708383+0000","last_became_active":"2023-10-06T02:51:53.708091+0000","last_became_peered":"2023-10-06T02:51:53.708091+0000","last_unstale":"2023-10-06T02:51:53.708383+0000","last_undegraded":"2023-10-06T02:51:53.708383+0000","last_fullsized":"2023-10-06T02:51:53.708383+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:22.145536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706081+0000","last_change":"2023-10-06T02:51:53.705760+0000","last_active":"2023-10-06T02:51:53.706081+0000","last_peered":"2023-10-06T02:51:53.706081+0000","last_clean":"2023-10-06T02:51:53.706081+0000","last_became_active":"2023-10-06T02:51:53.705171+0000","last_became_peered":"2023-10-06T02:51:53.705171+0000","last_unstale":"2023-10-06T02:51:53.706081+0000","last_undegraded":"2023-10-06T02:51:53.706081+0000","last_fullsized":"2023-10-06T02:51:53.706081+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.697305+0000","last_change":"2023-10-06T02:51:53.697234+0000","last_active":"2023-10-06T02:51:53.697305+0000","last_peered":"2023-10-06T02:51:53.697305+0000","last_clean":"2023-10-06T02:51:53.697305+0000","last_became_active":"2023-10-06T02:51:53.696989+0000","last_became_peered":"2023-10-06T02:51:53.696989+0000","last_unstale":"2023-10-06T02:51:53.697305+0000","last_undegraded":"2023-10-06T02:51:53.697305+0000","last_fullsized":"2023-10-06T02:51:53.697305+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:15.843250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704858+0000","last_change":"2023-10-06T02:51:53.704797+0000","last_active":"2023-10-06T02:51:53.704858+0000","last_peered":"2023-10-06T02:51:53.704858+0000","last_clean":"2023-10-06T02:51:53.704858+0000","last_became_active":"2023-10-06T02:51:53.704251+0000","last_became_peered":"2023-10-06T02:51:53.704251+0000","last_unstale":"2023-10-06T02:51:53.704858+0000","last_undegraded":"2023-10-06T02:51:53.704858+0000","last_fullsized":"2023-10-06T02:51:53.704858+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:08.192099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701919+0000","last_change":"2023-10-06T02:51:53.701409+0000","last_active":"2023-10-06T02:51:53.701919+0000","last_peered":"2023-10-06T02:51:53.701919+0000","last_clean":"2023-10-06T02:51:53.701919+0000","last_became_active":"2023-10-06T02:51:53.699611+0000","last_became_peered":"2023-10-06T02:51:53.699611+0000","last_unstale":"2023-10-06T02:51:53.701919+0000","last_undegraded":"2023-10-06T02:51:53.701919+0000","last_fullsized":"2023-10-06T02:51:53.701919+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:38.673744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702602+0000","last_change":"2023-10-06T02:51:53.702504+0000","last_active":"2023-10-06T02:51:53.702602+0000","last_peered":"2023-10-06T02:51:53.702602+0000","last_clean":"2023-10-06T02:51:53.702602+0000","last_became_active":"2023-10-06T02:51:53.702291+0000","last_became_peered":"2023-10-06T02:51:53.702291+0000","last_unstale":"2023-10-06T02:51:53.702602+0000","last_undegraded":"2023-10-06T02:51:53.702602+0000","last_fullsized":"2023-10-06T02:51:53.702602+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:32.916544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710162+0000","last_change":"2023-10-06T02:51:53.710126+0000","last_active":"2023-10-06T02:51:53.710162+0000","last_peered":"2023-10-06T02:51:53.710162+0000","last_clean":"2023-10-06T02:51:53.710162+0000","last_became_active":"2023-10-06T02:51:53.705508+0000","last_became_peered":"2023-10-06T02:51:53.705508+0000","last_unstale":"2023-10-06T02:51:53.710162+0000","last_undegraded":"2023-10-06T02:51:53.710162+0000","last_fullsized":"2023-10-06T02:51:53.710162+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:05.172423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"119'4","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716683+0000","last_change":"2023-10-06T02:51:52.689600+0000","last_active":"2023-10-06T02:51:53.716683+0000","last_peered":"2023-10-06T02:51:53.716683+0000","last_clean":"2023-10-06T02:51:53.716683+0000","last_became_active":"2023-10-06T02:51:52.689016+0000","last_became_peered":"2023-10-06T02:51:52.689016+0000","last_unstale":"2023-10-06T02:51:53.716683+0000","last_undegraded":"2023-10-06T02:51:53.716683+0000","last_fullsized":"2023-10-06T02:51:53.716683+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:38.023715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706642+0000","last_change":"2023-10-06T02:51:53.706569+0000","last_active":"2023-10-06T02:51:53.706642+0000","last_peered":"2023-10-06T02:51:53.706642+0000","last_clean":"2023-10-06T02:51:53.706642+0000","last_became_active":"2023-10-06T02:51:53.706067+0000","last_became_peered":"2023-10-06T02:51:53.706067+0000","last_unstale":"2023-10-06T02:51:53.706642+0000","last_undegraded":"2023-10-06T02:51:53.706642+0000","last_fullsized":"2023-10-06T02:51:53.706642+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:12.569770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.715404+0000","last_change":"2023-10-06T02:51:52.688972+0000","last_active":"2023-10-06T02:51:53.715404+0000","last_peered":"2023-10-06T02:51:53.715404+0000","last_clean":"2023-10-06T02:51:53.715404+0000","last_became_active":"2023-10-06T02:51:52.688200+0000","last_became_peered":"2023-10-06T02:51:52.688200+0000","last_unstale":"2023-10-06T02:51:53.715404+0000","last_undegraded":"2023-10-06T02:51:53.715404+0000","last_fullsized":"2023-10-06T02:51:53.715404+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:55.648087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703206+0000","last_change":"2023-10-06T02:51:53.702924+0000","last_active":"2023-10-06T02:51:53.703206+0000","last_peered":"2023-10-06T02:51:53.703206+0000","last_clean":"2023-10-06T02:51:53.703206+0000","last_became_active":"2023-10-06T02:51:53.702492+0000","last_became_peered":"2023-10-06T02:51:53.702492+0000","last_unstale":"2023-10-06T02:51:53.703206+0000","last_undegraded":"2023-10-06T02:51:53.703206+0000","last_fullsized":"2023-10-06T02:51:53.703206+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:50.118473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.717527+0000","last_change":"2023-10-06T02:51:52.689772+0000","last_active":"2023-10-06T02:51:53.717527+0000","last_peered":"2023-10-06T02:51:53.717527+0000","last_clean":"2023-10-06T02:51:53.717527+0000","last_became_active":"2023-10-06T02:51:52.689489+0000","last_became_peered":"2023-10-06T02:51:52.689489+0000","last_unstale":"2023-10-06T02:51:53.717527+0000","last_undegraded":"2023-10-06T02:51:53.717527+0000","last_fullsized":"2023-10-06T02:51:53.717527+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:30.790374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703285+0000","last_change":"2023-10-06T02:51:53.703090+0000","last_active":"2023-10-06T02:51:53.703285+0000","last_peered":"2023-10-06T02:51:53.703285+0000","last_clean":"2023-10-06T02:51:53.703285+0000","last_became_active":"2023-10-06T02:51:53.702798+0000","last_became_peered":"2023-10-06T02:51:53.702798+0000","last_unstale":"2023-10-06T02:51:53.703285+0000","last_undegraded":"2023-10-06T02:51:53.703285+0000","last_fullsized":"2023-10-06T02:51:53.703285+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.717874+0000","last_change":"2023-10-06T02:51:52.685712+0000","last_active":"2023-10-06T02:51:53.717874+0000","last_peered":"2023-10-06T02:51:53.717874+0000","last_clean":"2023-10-06T02:51:53.717874+0000","last_became_active":"2023-10-06T02:51:52.685431+0000","last_became_peered":"2023-10-06T02:51:52.685431+0000","last_unstale":"2023-10-06T02:51:53.717874+0000","last_undegraded":"2023-10-06T02:51:53.717874+0000","last_fullsized":"2023-10-06T02:51:53.717874+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:26.811429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706204+0000","last_change":"2023-10-06T02:51:53.705906+0000","last_active":"2023-10-06T02:51:53.706204+0000","last_peered":"2023-10-06T02:51:53.706204+0000","last_clean":"2023-10-06T02:51:53.706204+0000","last_became_active":"2023-10-06T02:51:53.705468+0000","last_became_peered":"2023-10-06T02:51:53.705468+0000","last_unstale":"2023-10-06T02:51:53.706204+0000","last_undegraded":"2023-10-06T02:51:53.706204+0000","last_fullsized":"2023-10-06T02:51:53.706204+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716613+0000","last_change":"2023-10-06T02:51:52.687543+0000","last_active":"2023-10-06T02:51:53.716613+0000","last_peered":"2023-10-06T02:51:53.716613+0000","last_clean":"2023-10-06T02:51:53.716613+0000","last_became_active":"2023-10-06T02:51:52.687308+0000","last_became_peered":"2023-10-06T02:51:52.687308+0000","last_unstale":"2023-10-06T02:51:53.716613+0000","last_undegraded":"2023-10-06T02:51:53.716613+0000","last_fullsized":"2023-10-06T02:51:53.716613+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:37.667180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710073+0000","last_change":"2023-10-06T02:51:53.710028+0000","last_active":"2023-10-06T02:51:53.710073+0000","last_peered":"2023-10-06T02:51:53.710073+0000","last_clean":"2023-10-06T02:51:53.710073+0000","last_became_active":"2023-10-06T02:51:53.705214+0000","last_became_peered":"2023-10-06T02:51:53.705214+0000","last_unstale":"2023-10-06T02:51:53.710073+0000","last_undegraded":"2023-10-06T02:51:53.710073+0000","last_fullsized":"2023-10-06T02:51:53.710073+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:04.803600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.714621+0000","last_change":"2023-10-06T02:51:52.687007+0000","last_active":"2023-10-06T02:51:53.714621+0000","last_peered":"2023-10-06T02:51:53.714621+0000","last_clean":"2023-10-06T02:51:53.714621+0000","last_became_active":"2023-10-06T02:51:52.686722+0000","last_became_peered":"2023-10-06T02:51:52.686722+0000","last_unstale":"2023-10-06T02:51:53.714621+0000","last_undegraded":"2023-10-06T02:51:53.714621+0000","last_fullsized":"2023-10-06T02:51:53.714621+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:26.811429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706100+0000","last_change":"2023-10-06T02:51:53.705950+0000","last_active":"2023-10-06T02:51:53.706100+0000","last_peered":"2023-10-06T02:51:53.706100+0000","last_clean":"2023-10-06T02:51:53.706100+0000","last_became_active":"2023-10-06T02:51:53.705514+0000","last_became_peered":"2023-10-06T02:51:53.705514+0000","last_unstale":"2023-10-06T02:51:53.706100+0000","last_undegraded":"2023-10-06T02:51:53.706100+0000","last_fullsized":"2023-10-06T02:51:53.706100+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:54.639866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.699982+0000","last_change":"2023-10-06T02:51:52.690586+0000","last_active":"2023-10-06T02:51:53.699982+0000","last_peered":"2023-10-06T02:51:53.699982+0000","last_clean":"2023-10-06T02:51:53.699982+0000","last_became_active":"2023-10-06T02:51:52.688572+0000","last_became_peered":"2023-10-06T02:51:52.688572+0000","last_unstale":"2023-10-06T02:51:53.699982+0000","last_undegraded":"2023-10-06T02:51:53.699982+0000","last_fullsized":"2023-10-06T02:51:53.699982+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:40.155904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.711054+0000","last_change":"2023-10-06T02:51:53.710985+0000","last_active":"2023-10-06T02:51:53.711054+0000","last_peered":"2023-10-06T02:51:53.711054+0000","last_clean":"2023-10-06T02:51:53.711054+0000","last_became_active":"2023-10-06T02:51:53.710827+0000","last_became_peered":"2023-10-06T02:51:53.710827+0000","last_unstale":"2023-10-06T02:51:53.711054+0000","last_undegraded":"2023-10-06T02:51:53.711054+0000","last_fullsized":"2023-10-06T02:51:53.711054+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:05.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701811+0000","last_change":"2023-10-06T02:51:52.682197+0000","last_active":"2023-10-06T02:51:53.701811+0000","last_peered":"2023-10-06T02:51:53.701811+0000","last_clean":"2023-10-06T02:51:53.701811+0000","last_became_active":"2023-10-06T02:51:52.682021+0000","last_became_peered":"2023-10-06T02:51:52.682021+0000","last_unstale":"2023-10-06T02:51:53.701811+0000","last_undegraded":"2023-10-06T02:51:53.701811+0000","last_fullsized":"2023-10-06T02:51:53.701811+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:26.811429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704085+0000","last_change":"2023-10-06T02:51:53.703912+0000","last_active":"2023-10-06T02:51:53.704085+0000","last_peered":"2023-10-06T02:51:53.704085+0000","last_clean":"2023-10-06T02:51:53.704085+0000","last_became_active":"2023-10-06T02:51:53.703425+0000","last_became_peered":"2023-10-06T02:51:53.703425+0000","last_unstale":"2023-10-06T02:51:53.704085+0000","last_undegraded":"2023-10-06T02:51:53.704085+0000","last_fullsized":"2023-10-06T02:51:53.704085+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:10.477515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.700133+0000","last_change":"2023-10-06T02:51:52.689619+0000","last_active":"2023-10-06T02:51:53.700133+0000","last_peered":"2023-10-06T02:51:53.700133+0000","last_clean":"2023-10-06T02:51:53.700133+0000","last_became_active":"2023-10-06T02:51:52.689332+0000","last_became_peered":"2023-10-06T02:51:52.689332+0000","last_unstale":"2023-10-06T02:51:53.700133+0000","last_undegraded":"2023-10-06T02:51:53.700133+0000","last_fullsized":"2023-10-06T02:51:53.700133+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:37.667180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703167+0000","last_change":"2023-10-06T02:51:53.703102+0000","last_active":"2023-10-06T02:51:53.703167+0000","last_peered":"2023-10-06T02:51:53.703167+0000","last_clean":"2023-10-06T02:51:53.703167+0000","last_became_active":"2023-10-06T02:51:53.702788+0000","last_became_peered":"2023-10-06T02:51:53.702788+0000","last_unstale":"2023-10-06T02:51:53.703167+0000","last_undegraded":"2023-10-06T02:51:53.703167+0000","last_fullsized":"2023-10-06T02:51:53.703167+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:50.118473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.697511+0000","last_change":"2023-10-06T02:51:52.689772+0000","last_active":"2023-10-06T02:51:53.697511+0000","last_peered":"2023-10-06T02:51:53.697511+0000","last_clean":"2023-10-06T02:51:53.697511+0000","last_became_active":"2023-10-06T02:51:52.689542+0000","last_became_peered":"2023-10-06T02:51:52.689542+0000","last_unstale":"2023-10-06T02:51:53.697511+0000","last_undegraded":"2023-10-06T02:51:53.697511+0000","last_fullsized":"2023-10-06T02:51:53.697511+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:02.730994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703141+0000","last_change":"2023-10-06T02:51:53.702671+0000","last_active":"2023-10-06T02:51:53.703141+0000","last_peered":"2023-10-06T02:51:53.703141+0000","last_clean":"2023-10-06T02:51:53.703141+0000","last_became_active":"2023-10-06T02:51:53.702444+0000","last_became_peered":"2023-10-06T02:51:53.702444+0000","last_unstale":"2023-10-06T02:51:53.703141+0000","last_undegraded":"2023-10-06T02:51:53.703141+0000","last_fullsized":"2023-10-06T02:51:53.703141+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:02.581954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"119'3","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716901+0000","last_change":"2023-10-06T02:51:52.684897+0000","last_active":"2023-10-06T02:51:53.716901+0000","last_peered":"2023-10-06T02:51:53.716901+0000","last_clean":"2023-10-06T02:51:53.716901+0000","last_became_active":"2023-10-06T02:51:52.684655+0000","last_became_peered":"2023-10-06T02:51:52.684655+0000","last_unstale":"2023-10-06T02:51:53.716901+0000","last_undegraded":"2023-10-06T02:51:53.716901+0000","last_fullsized":"2023-10-06T02:51:53.716901+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:40.155904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707093+0000","last_change":"2023-10-06T02:51:53.706924+0000","last_active":"2023-10-06T02:51:53.707093+0000","last_peered":"2023-10-06T02:51:53.707093+0000","last_clean":"2023-10-06T02:51:53.707093+0000","last_became_active":"2023-10-06T02:51:53.706455+0000","last_became_peered":"2023-10-06T02:51:53.706455+0000","last_unstale":"2023-10-06T02:51:53.707093+0000","last_undegraded":"2023-10-06T02:51:53.707093+0000","last_fullsized":"2023-10-06T02:51:53.707093+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:05.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"119'6","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.718851+0000","last_change":"2023-10-06T02:51:52.688075+0000","last_active":"2023-10-06T02:51:53.718851+0000","last_peered":"2023-10-06T02:51:53.718851+0000","last_clean":"2023-10-06T02:51:53.718851+0000","last_became_active":"2023-10-06T02:51:52.687867+0000","last_became_peered":"2023-10-06T02:51:52.687867+0000","last_unstale":"2023-10-06T02:51:53.718851+0000","last_undegraded":"2023-10-06T02:51:53.718851+0000","last_fullsized":"2023-10-06T02:51:53.718851+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:31.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703274+0000","last_change":"2023-10-06T02:51:53.703080+0000","last_active":"2023-10-06T02:51:53.703274+0000","last_peered":"2023-10-06T02:51:53.703274+0000","last_clean":"2023-10-06T02:51:53.703274+0000","last_became_active":"2023-10-06T02:51:53.702294+0000","last_became_peered":"2023-10-06T02:51:53.702294+0000","last_unstale":"2023-10-06T02:51:53.703274+0000","last_undegraded":"2023-10-06T02:51:53.703274+0000","last_fullsized":"2023-10-06T02:51:53.703274+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:05.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.718536+0000","last_change":"2023-10-06T02:51:52.683306+0000","last_active":"2023-10-06T02:51:53.718536+0000","last_peered":"2023-10-06T02:51:53.718536+0000","last_clean":"2023-10-06T02:51:53.718536+0000","last_became_active":"2023-10-06T02:51:52.683091+0000","last_became_peered":"2023-10-06T02:51:52.683091+0000","last_unstale":"2023-10-06T02:51:53.718536+0000","last_undegraded":"2023-10-06T02:51:53.718536+0000","last_fullsized":"2023-10-06T02:51:53.718536+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:02.321446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.705289+0000","last_change":"2023-10-06T02:51:53.705154+0000","last_active":"2023-10-06T02:51:53.705289+0000","last_peered":"2023-10-06T02:51:53.705289+0000","last_clean":"2023-10-06T02:51:53.705289+0000","last_became_active":"2023-10-06T02:51:53.704930+0000","last_became_peered":"2023-10-06T02:51:53.704930+0000","last_unstale":"2023-10-06T02:51:53.705289+0000","last_undegraded":"2023-10-06T02:51:53.705289+0000","last_fullsized":"2023-10-06T02:51:53.705289+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:23.413373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701264+0000","last_change":"2023-10-06T02:51:52.687169+0000","last_active":"2023-10-06T02:51:53.701264+0000","last_peered":"2023-10-06T02:51:53.701264+0000","last_clean":"2023-10-06T02:51:53.701264+0000","last_became_active":"2023-10-06T02:51:52.686954+0000","last_became_peered":"2023-10-06T02:51:52.686954+0000","last_unstale":"2023-10-06T02:51:53.701264+0000","last_undegraded":"2023-10-06T02:51:53.701264+0000","last_fullsized":"2023-10-06T02:51:53.701264+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:27.703269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703158+0000","last_change":"2023-10-06T02:51:53.703023+0000","last_active":"2023-10-06T02:51:53.703158+0000","last_peered":"2023-10-06T02:51:53.703158+0000","last_clean":"2023-10-06T02:51:53.703158+0000","last_became_active":"2023-10-06T02:51:53.702811+0000","last_became_peered":"2023-10-06T02:51:53.702811+0000","last_unstale":"2023-10-06T02:51:53.703158+0000","last_undegraded":"2023-10-06T02:51:53.703158+0000","last_fullsized":"2023-10-06T02:51:53.703158+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:50.502200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694502+0000","last_change":"2023-10-06T02:51:52.687300+0000","last_active":"2023-10-06T02:51:53.694502+0000","last_peered":"2023-10-06T02:51:53.694502+0000","last_clean":"2023-10-06T02:51:53.694502+0000","last_became_active":"2023-10-06T02:51:52.686778+0000","last_became_peered":"2023-10-06T02:51:52.686778+0000","last_unstale":"2023-10-06T02:51:53.694502+0000","last_undegraded":"2023-10-06T02:51:53.694502+0000","last_fullsized":"2023-10-06T02:51:53.694502+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:46.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710592+0000","last_change":"2023-10-06T02:51:53.710558+0000","last_active":"2023-10-06T02:51:53.710592+0000","last_peered":"2023-10-06T02:51:53.710592+0000","last_clean":"2023-10-06T02:51:53.710592+0000","last_became_active":"2023-10-06T02:51:53.709840+0000","last_became_peered":"2023-10-06T02:51:53.709840+0000","last_unstale":"2023-10-06T02:51:53.710592+0000","last_undegraded":"2023-10-06T02:51:53.710592+0000","last_fullsized":"2023-10-06T02:51:53.710592+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:34.818764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"119'8","reported_seq":18,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.717885+0000","last_change":"2023-10-06T02:51:52.688799+0000","last_active":"2023-10-06T02:51:53.717885+0000","last_peered":"2023-10-06T02:51:53.717885+0000","last_clean":"2023-10-06T02:51:53.717885+0000","last_became_active":"2023-10-06T02:51:52.688387+0000","last_became_peered":"2023-10-06T02:51:52.688387+0000","last_unstale":"2023-10-06T02:51:53.717885+0000","last_undegraded":"2023-10-06T02:51:53.717885+0000","last_fullsized":"2023-10-06T02:51:53.717885+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:38.023715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704075+0000","last_change":"2023-10-06T02:51:53.703529+0000","last_active":"2023-10-06T02:51:53.704075+0000","last_peered":"2023-10-06T02:51:53.704075+0000","last_clean":"2023-10-06T02:51:53.704075+0000","last_became_active":"2023-10-06T02:51:53.703304+0000","last_became_peered":"2023-10-06T02:51:53.703304+0000","last_unstale":"2023-10-06T02:51:53.704075+0000","last_undegraded":"2023-10-06T02:51:53.704075+0000","last_fullsized":"2023-10-06T02:51:53.704075+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:15.117428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.718561+0000","last_change":"2023-10-06T02:51:52.683245+0000","last_active":"2023-10-06T02:51:53.718561+0000","last_peered":"2023-10-06T02:51:53.718561+0000","last_clean":"2023-10-06T02:51:53.718561+0000","last_became_active":"2023-10-06T02:51:52.682960+0000","last_became_peered":"2023-10-06T02:51:52.682960+0000","last_unstale":"2023-10-06T02:51:53.718561+0000","last_undegraded":"2023-10-06T02:51:53.718561+0000","last_fullsized":"2023-10-06T02:51:53.718561+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:49.495637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704786+0000","last_change":"2023-10-06T02:51:53.704671+0000","last_active":"2023-10-06T02:51:53.704786+0000","last_peered":"2023-10-06T02:51:53.704786+0000","last_clean":"2023-10-06T02:51:53.704786+0000","last_became_active":"2023-10-06T02:51:53.704418+0000","last_became_peered":"2023-10-06T02:51:53.704418+0000","last_unstale":"2023-10-06T02:51:53.704786+0000","last_undegraded":"2023-10-06T02:51:53.704786+0000","last_fullsized":"2023-10-06T02:51:53.704786+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:23.585623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.698414+0000","last_change":"2023-10-06T02:51:52.687357+0000","last_active":"2023-10-06T02:51:53.698414+0000","last_peered":"2023-10-06T02:51:53.698414+0000","last_clean":"2023-10-06T02:51:53.698414+0000","last_became_active":"2023-10-06T02:51:52.687139+0000","last_became_peered":"2023-10-06T02:51:52.687139+0000","last_unstale":"2023-10-06T02:51:53.698414+0000","last_undegraded":"2023-10-06T02:51:53.698414+0000","last_fullsized":"2023-10-06T02:51:53.698414+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:47.645693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.708847+0000","last_change":"2023-10-06T02:51:53.708788+0000","last_active":"2023-10-06T02:51:53.708847+0000","last_peered":"2023-10-06T02:51:53.708847+0000","last_clean":"2023-10-06T02:51:53.708847+0000","last_became_active":"2023-10-06T02:51:53.708576+0000","last_became_peered":"2023-10-06T02:51:53.708576+0000","last_unstale":"2023-10-06T02:51:53.708847+0000","last_undegraded":"2023-10-06T02:51:53.708847+0000","last_fullsized":"2023-10-06T02:51:53.708847+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:22.145536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.695180+0000","last_change":"2023-10-06T02:51:52.691973+0000","last_active":"2023-10-06T02:51:53.695180+0000","last_peered":"2023-10-06T02:51:53.695180+0000","last_clean":"2023-10-06T02:51:53.695180+0000","last_became_active":"2023-10-06T02:51:52.691260+0000","last_became_peered":"2023-10-06T02:51:52.691260+0000","last_unstale":"2023-10-06T02:51:53.695180+0000","last_undegraded":"2023-10-06T02:51:53.695180+0000","last_fullsized":"2023-10-06T02:51:53.695180+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:56.496184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703478+0000","last_change":"2023-10-06T02:51:53.703386+0000","last_active":"2023-10-06T02:51:53.703478+0000","last_peered":"2023-10-06T02:51:53.703478+0000","last_clean":"2023-10-06T02:51:53.703478+0000","last_became_active":"2023-10-06T02:51:53.702837+0000","last_became_peered":"2023-10-06T02:51:53.702837+0000","last_unstale":"2023-10-06T02:51:53.703478+0000","last_undegraded":"2023-10-06T02:51:53.703478+0000","last_fullsized":"2023-10-06T02:51:53.703478+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:50.118473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701941+0000","last_change":"2023-10-06T02:51:52.691101+0000","last_active":"2023-10-06T02:51:53.701941+0000","last_peered":"2023-10-06T02:51:53.701941+0000","last_clean":"2023-10-06T02:51:53.701941+0000","last_became_active":"2023-10-06T02:51:52.690647+0000","last_became_peered":"2023-10-06T02:51:52.690647+0000","last_unstale":"2023-10-06T02:51:53.701941+0000","last_undegraded":"2023-10-06T02:51:53.701941+0000","last_fullsized":"2023-10-06T02:51:53.701941+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:20.288432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702592+0000","last_change":"2023-10-06T02:51:53.702192+0000","last_active":"2023-10-06T02:51:53.702592+0000","last_peered":"2023-10-06T02:51:53.702592+0000","last_clean":"2023-10-06T02:51:53.702592+0000","last_became_active":"2023-10-06T02:51:53.701971+0000","last_became_peered":"2023-10-06T02:51:53.701971+0000","last_unstale":"2023-10-06T02:51:53.702592+0000","last_undegraded":"2023-10-06T02:51:53.702592+0000","last_fullsized":"2023-10-06T02:51:53.702592+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:15.638828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.700222+0000","last_change":"2023-10-06T02:51:52.689471+0000","last_active":"2023-10-06T02:51:53.700222+0000","last_peered":"2023-10-06T02:51:53.700222+0000","last_clean":"2023-10-06T02:51:53.700222+0000","last_became_active":"2023-10-06T02:51:52.689052+0000","last_became_peered":"2023-10-06T02:51:52.689052+0000","last_unstale":"2023-10-06T02:51:53.700222+0000","last_undegraded":"2023-10-06T02:51:53.700222+0000","last_fullsized":"2023-10-06T02:51:53.700222+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:03.028473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704816+0000","last_change":"2023-10-06T02:51:53.704750+0000","last_active":"2023-10-06T02:51:53.704816+0000","last_peered":"2023-10-06T02:51:53.704816+0000","last_clean":"2023-10-06T02:51:53.704816+0000","last_became_active":"2023-10-06T02:51:53.704391+0000","last_became_peered":"2023-10-06T02:51:53.704391+0000","last_unstale":"2023-10-06T02:51:53.704816+0000","last_undegraded":"2023-10-06T02:51:53.704816+0000","last_fullsized":"2023-10-06T02:51:53.704816+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:03.328009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694597+0000","last_change":"2023-10-06T02:51:52.687448+0000","last_active":"2023-10-06T02:51:53.694597+0000","last_peered":"2023-10-06T02:51:53.694597+0000","last_clean":"2023-10-06T02:51:53.694597+0000","last_became_active":"2023-10-06T02:51:52.687077+0000","last_became_peered":"2023-10-06T02:51:52.687077+0000","last_unstale":"2023-10-06T02:51:53.694597+0000","last_undegraded":"2023-10-06T02:51:53.694597+0000","last_fullsized":"2023-10-06T02:51:53.694597+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:16.159105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.707074+0000","last_change":"2023-10-06T02:51:53.706986+0000","last_active":"2023-10-06T02:51:53.707074+0000","last_peered":"2023-10-06T02:51:53.707074+0000","last_clean":"2023-10-06T02:51:53.707074+0000","last_became_active":"2023-10-06T02:51:53.706757+0000","last_became_peered":"2023-10-06T02:51:53.706757+0000","last_unstale":"2023-10-06T02:51:53.707074+0000","last_undegraded":"2023-10-06T02:51:53.707074+0000","last_fullsized":"2023-10-06T02:51:53.707074+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:15.344452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696287+0000","last_change":"2023-10-06T02:51:52.687962+0000","last_active":"2023-10-06T02:51:53.696287+0000","last_peered":"2023-10-06T02:51:53.696287+0000","last_clean":"2023-10-06T02:51:53.696287+0000","last_became_active":"2023-10-06T02:51:52.687722+0000","last_became_peered":"2023-10-06T02:51:52.687722+0000","last_unstale":"2023-10-06T02:51:53.696287+0000","last_undegraded":"2023-10-06T02:51:53.696287+0000","last_fullsized":"2023-10-06T02:51:53.696287+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.836687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706311+0000","last_change":"2023-10-06T02:51:53.706232+0000","last_active":"2023-10-06T02:51:53.706311+0000","last_peered":"2023-10-06T02:51:53.706311+0000","last_clean":"2023-10-06T02:51:53.706311+0000","last_became_active":"2023-10-06T02:51:53.705620+0000","last_became_peered":"2023-10-06T02:51:53.705620+0000","last_unstale":"2023-10-06T02:51:53.706311+0000","last_undegraded":"2023-10-06T02:51:53.706311+0000","last_fullsized":"2023-10-06T02:51:53.706311+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694820+0000","last_change":"2023-10-06T02:51:52.688418+0000","last_active":"2023-10-06T02:51:53.694820+0000","last_peered":"2023-10-06T02:51:53.694820+0000","last_clean":"2023-10-06T02:51:53.694820+0000","last_became_active":"2023-10-06T02:51:52.687896+0000","last_became_peered":"2023-10-06T02:51:52.687896+0000","last_unstale":"2023-10-06T02:51:53.694820+0000","last_undegraded":"2023-10-06T02:51:53.694820+0000","last_fullsized":"2023-10-06T02:51:53.694820+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:29.876754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.706643+0000","last_change":"2023-10-06T02:51:53.706484+0000","last_active":"2023-10-06T02:51:53.706643+0000","last_peered":"2023-10-06T02:51:53.706643+0000","last_clean":"2023-10-06T02:51:53.706643+0000","last_became_active":"2023-10-06T02:51:53.706087+0000","last_became_peered":"2023-10-06T02:51:53.706087+0000","last_unstale":"2023-10-06T02:51:53.706643+0000","last_undegraded":"2023-10-06T02:51:53.706643+0000","last_fullsized":"2023-10-06T02:51:53.706643+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:16.082848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.695091+0000","last_change":"2023-10-06T02:51:52.691065+0000","last_active":"2023-10-06T02:51:53.695091+0000","last_peered":"2023-10-06T02:51:53.695091+0000","last_clean":"2023-10-06T02:51:53.695091+0000","last_became_active":"2023-10-06T02:51:52.690764+0000","last_became_peered":"2023-10-06T02:51:52.690764+0000","last_unstale":"2023-10-06T02:51:53.695091+0000","last_undegraded":"2023-10-06T02:51:53.695091+0000","last_fullsized":"2023-10-06T02:51:53.695091+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:53.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":99,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702149+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:51:53.702149+0000","last_peered":"2023-10-06T02:51:53.702149+0000","last_clean":"2023-10-06T02:51:53.702149+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:51:53.702149+0000","last_undegraded":"2023-10-06T02:51:53.702149+0000","last_fullsized":"2023-10-06T02:51:53.702149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.704128+0000","last_change":"2023-10-06T02:51:53.704014+0000","last_active":"2023-10-06T02:51:53.704128+0000","last_peered":"2023-10-06T02:51:53.704128+0000","last_clean":"2023-10-06T02:51:53.704128+0000","last_became_active":"2023-10-06T02:51:53.703373+0000","last_became_peered":"2023-10-06T02:51:53.703373+0000","last_unstale":"2023-10-06T02:51:53.704128+0000","last_undegraded":"2023-10-06T02:51:53.704128+0000","last_fullsized":"2023-10-06T02:51:53.704128+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:33:49.300018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716072+0000","last_change":"2023-10-06T02:51:52.691706+0000","last_active":"2023-10-06T02:51:53.716072+0000","last_peered":"2023-10-06T02:51:53.716072+0000","last_clean":"2023-10-06T02:51:53.716072+0000","last_became_active":"2023-10-06T02:51:52.690968+0000","last_became_peered":"2023-10-06T02:51:52.690968+0000","last_unstale":"2023-10-06T02:51:53.716072+0000","last_undegraded":"2023-10-06T02:51:53.716072+0000","last_fullsized":"2023-10-06T02:51:53.716072+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:04.275931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702156+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:51:53.702156+0000","last_peered":"2023-10-06T02:51:53.702156+0000","last_clean":"2023-10-06T02:51:53.702156+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:51:53.702156+0000","last_undegraded":"2023-10-06T02:51:53.702156+0000","last_fullsized":"2023-10-06T02:51:53.702156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709461+0000","last_change":"2023-10-06T02:51:53.709361+0000","last_active":"2023-10-06T02:51:53.709461+0000","last_peered":"2023-10-06T02:51:53.709461+0000","last_clean":"2023-10-06T02:51:53.709461+0000","last_became_active":"2023-10-06T02:51:53.708792+0000","last_became_peered":"2023-10-06T02:51:53.708792+0000","last_unstale":"2023-10-06T02:51:53.709461+0000","last_undegraded":"2023-10-06T02:51:53.709461+0000","last_fullsized":"2023-10-06T02:51:53.709461+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702079+0000","last_change":"2023-10-06T02:51:52.691528+0000","last_active":"2023-10-06T02:51:53.702079+0000","last_peered":"2023-10-06T02:51:53.702079+0000","last_clean":"2023-10-06T02:51:53.702079+0000","last_became_active":"2023-10-06T02:51:52.691033+0000","last_became_peered":"2023-10-06T02:51:52.691033+0000","last_unstale":"2023-10-06T02:51:53.702079+0000","last_undegraded":"2023-10-06T02:51:53.702079+0000","last_fullsized":"2023-10-06T02:51:53.702079+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:27.703269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.695150+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:51:53.695150+0000","last_peered":"2023-10-06T02:51:53.695150+0000","last_clean":"2023-10-06T02:51:53.695150+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:51:53.695150+0000","last_undegraded":"2023-10-06T02:51:53.695150+0000","last_fullsized":"2023-10-06T02:51:53.695150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.703297+0000","last_change":"2023-10-06T02:51:53.703234+0000","last_active":"2023-10-06T02:51:53.703297+0000","last_peered":"2023-10-06T02:51:53.703297+0000","last_clean":"2023-10-06T02:51:53.703297+0000","last_became_active":"2023-10-06T02:51:53.702554+0000","last_became_peered":"2023-10-06T02:51:53.702554+0000","last_unstale":"2023-10-06T02:51:53.703297+0000","last_undegraded":"2023-10-06T02:51:53.703297+0000","last_fullsized":"2023-10-06T02:51:53.703297+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:15.344452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716455+0000","last_change":"2023-10-06T02:51:52.683613+0000","last_active":"2023-10-06T02:51:53.716455+0000","last_peered":"2023-10-06T02:51:53.716455+0000","last_clean":"2023-10-06T02:51:53.716455+0000","last_became_active":"2023-10-06T02:51:52.683395+0000","last_became_peered":"2023-10-06T02:51:52.683395+0000","last_unstale":"2023-10-06T02:51:53.716455+0000","last_undegraded":"2023-10-06T02:51:53.716455+0000","last_fullsized":"2023-10-06T02:51:53.716455+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:24.661218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.702565+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:51:53.702565+0000","last_peered":"2023-10-06T02:51:53.702565+0000","last_clean":"2023-10-06T02:51:53.702565+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:51:53.702565+0000","last_undegraded":"2023-10-06T02:51:53.702565+0000","last_fullsized":"2023-10-06T02:51:53.702565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696302+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:51:53.696302+0000","last_peered":"2023-10-06T02:51:53.696302+0000","last_clean":"2023-10-06T02:51:53.696302+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:51:53.696302+0000","last_undegraded":"2023-10-06T02:51:53.696302+0000","last_fullsized":"2023-10-06T02:51:53.696302+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.701888+0000","last_change":"2023-10-06T02:51:53.700744+0000","last_active":"2023-10-06T02:51:53.701888+0000","last_peered":"2023-10-06T02:51:53.701888+0000","last_clean":"2023-10-06T02:51:53.701888+0000","last_became_active":"2023-10-06T02:51:53.699304+0000","last_became_peered":"2023-10-06T02:51:53.699304+0000","last_unstale":"2023-10-06T02:51:53.701888+0000","last_undegraded":"2023-10-06T02:51:53.701888+0000","last_fullsized":"2023-10-06T02:51:53.701888+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:04.035037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"119'1","reported_seq":11,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.716052+0000","last_change":"2023-10-06T02:51:52.689855+0000","last_active":"2023-10-06T02:51:53.716052+0000","last_peered":"2023-10-06T02:51:53.716052+0000","last_clean":"2023-10-06T02:51:53.716052+0000","last_became_active":"2023-10-06T02:51:52.689372+0000","last_became_peered":"2023-10-06T02:51:52.689372+0000","last_unstale":"2023-10-06T02:51:53.716052+0000","last_undegraded":"2023-10-06T02:51:53.716052+0000","last_fullsized":"2023-10-06T02:51:53.716052+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:03.028473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696216+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:51:53.696216+0000","last_peered":"2023-10-06T02:51:53.696216+0000","last_clean":"2023-10-06T02:51:53.696216+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:51:53.696216+0000","last_undegraded":"2023-10-06T02:51:53.696216+0000","last_fullsized":"2023-10-06T02:51:53.696216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.700814+0000","last_change":"2023-10-06T02:51:53.699929+0000","last_active":"2023-10-06T02:51:53.700814+0000","last_peered":"2023-10-06T02:51:53.700814+0000","last_clean":"2023-10-06T02:51:53.700814+0000","last_became_active":"2023-10-06T02:51:53.699696+0000","last_became_peered":"2023-10-06T02:51:53.699696+0000","last_unstale":"2023-10-06T02:51:53.700814+0000","last_undegraded":"2023-10-06T02:51:53.700814+0000","last_fullsized":"2023-10-06T02:51:53.700814+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.510103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694912+0000","last_change":"2023-10-06T02:51:52.684267+0000","last_active":"2023-10-06T02:51:53.694912+0000","last_peered":"2023-10-06T02:51:53.694912+0000","last_clean":"2023-10-06T02:51:53.694912+0000","last_became_active":"2023-10-06T02:51:52.684058+0000","last_became_peered":"2023-10-06T02:51:52.684058+0000","last_unstale":"2023-10-06T02:51:53.694912+0000","last_undegraded":"2023-10-06T02:51:53.694912+0000","last_fullsized":"2023-10-06T02:51:53.694912+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:09.404424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696378+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:51:53.696378+0000","last_peered":"2023-10-06T02:51:53.696378+0000","last_clean":"2023-10-06T02:51:53.696378+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:51:53.696378+0000","last_undegraded":"2023-10-06T02:51:53.696378+0000","last_fullsized":"2023-10-06T02:51:53.696378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.710505+0000","last_change":"2023-10-06T02:51:53.710467+0000","last_active":"2023-10-06T02:51:53.710505+0000","last_peered":"2023-10-06T02:51:53.710505+0000","last_clean":"2023-10-06T02:51:53.710505+0000","last_became_active":"2023-10-06T02:51:53.706122+0000","last_became_peered":"2023-10-06T02:51:53.706122+0000","last_unstale":"2023-10-06T02:51:53.710505+0000","last_undegraded":"2023-10-06T02:51:53.710505+0000","last_fullsized":"2023-10-06T02:51:53.710505+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:55.432947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"119'2","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.718682+0000","last_change":"2023-10-06T02:51:52.683082+0000","last_active":"2023-10-06T02:51:53.718682+0000","last_peered":"2023-10-06T02:51:53.718682+0000","last_clean":"2023-10-06T02:51:53.718682+0000","last_became_active":"2023-10-06T02:51:52.682867+0000","last_became_peered":"2023-10-06T02:51:52.682867+0000","last_unstale":"2023-10-06T02:51:53.718682+0000","last_undegraded":"2023-10-06T02:51:53.718682+0000","last_fullsized":"2023-10-06T02:51:53.718682+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:56.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.699647+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:51:53.699647+0000","last_peered":"2023-10-06T02:51:53.699647+0000","last_clean":"2023-10-06T02:51:53.699647+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:51:53.699647+0000","last_undegraded":"2023-10-06T02:51:53.699647+0000","last_fullsized":"2023-10-06T02:51:53.699647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.709986+0000","last_change":"2023-10-06T02:51:53.709908+0000","last_active":"2023-10-06T02:51:53.709986+0000","last_peered":"2023-10-06T02:51:53.709986+0000","last_clean":"2023-10-06T02:51:53.709986+0000","last_became_active":"2023-10-06T02:51:53.709510+0000","last_became_peered":"2023-10-06T02:51:53.709510+0000","last_unstale":"2023-10-06T02:51:53.709986+0000","last_undegraded":"2023-10-06T02:51:53.709986+0000","last_fullsized":"2023-10-06T02:51:53.709986+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:52.675685+0000","last_clean_scrub_stamp":"2023-10-06T02:51:52.675685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:31.720053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.694723+0000","last_change":"2023-10-06T02:51:52.684490+0000","last_active":"2023-10-06T02:51:53.694723+0000","last_peered":"2023-10-06T02:51:53.694723+0000","last_clean":"2023-10-06T02:51:53.694723+0000","last_became_active":"2023-10-06T02:51:52.684278+0000","last_became_peered":"2023-10-06T02:51:52.684278+0000","last_unstale":"2023-10-06T02:51:53.694723+0000","last_undegraded":"2023-10-06T02:51:53.694723+0000","last_fullsized":"2023-10-06T02:51:53.694723+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:51:51.669122+0000","last_clean_scrub_stamp":"2023-10-06T02:51:51.669122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:53.801331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-06T02:51:53.696413+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:51:53.696413+0000","last_peered":"2023-10-06T02:51:53.696413+0000","last_clean":"2023-10-06T02:51:53.696413+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:51:53.696413+0000","last_undegraded":"2023-10-06T02:51:53.696413+0000","last_fullsized":"2023-10-06T02:51:53.696413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1257,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194055,"statfs":{"total":200000000,"available":198712684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.52600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76100000000000001,"5min":1.393,"15min":1.393},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.28000000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.748,"5min":1.081,"15min":1.081},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72599999999999998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.48299999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56699999999999995,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66400000000000003,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45600000000000002,"15min":0.45500000000000002},"min":{"1min":0.32100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69199999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.49399999999999999,"15min":0.504},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.879,"15min":0.879},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77800000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.622},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71299999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":682,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194629,"statfs":{"total":200000000,"available":199301100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.62},"min":{"1min":0.36799999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66000000000000003,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.54400000000000004,"15min":0.57199999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.68100000000000005,"5min":1.879,"15min":1.879},"last":0.497}]},{"osd":1,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.66100000000000003,"15min":0.98699999999999999},"min":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71399999999999997,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65600000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70299999999999996,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55300000000000005,"15min":0.57999999999999996},"min":{"1min":0.32000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53300000000000003,"15min":0.55600000000000005},"min":{"1min":0.36199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68899999999999995,"5min":1.163,"15min":1.163},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.48799999999999999,"15min":0.55400000000000005},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79800000000000004,"5min":1.05,"15min":1.05},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.51700000000000002,"15min":0.56699999999999995},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76900000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.495,"15min":0.53800000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.54600000000000004,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83899999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41499999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.62},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73599999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.54800000000000004,"15min":0.59799999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194632,"statfs":{"total":200000000,"available":199303178,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.316,"15min":0.314},"min":{"1min":0.22900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.312},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.33200000000000002},"min":{"1min":0.26100000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54200000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.32300000000000001},"min":{"1min":0.25,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40000000000000002,"15min":0.38400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61699999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.378,"15min":0.36299999999999999},"min":{"1min":0.308,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.42399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.439,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.56999999999999995,"15min":0.53200000000000003},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89500000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.53900000000000003},"min":{"1min":0.45400000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.502,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59699999999999998,"15min":0.56699999999999995},"min":{"1min":0.44800000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1258,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194053,"statfs":{"total":200000000,"available":198711218,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33700000000000002,"15min":0.34899999999999998},"min":{"1min":0.21199999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.439,"5min":1.177,"15min":1.177},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38100000000000001,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51300000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.315}]},{"osd":2,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.54400000000000004,"15min":1.1100000000000001},"min":{"1min":0.23899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.56899999999999995,"5min":22.038,"15min":22.038},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.247,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56499999999999995,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.26000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35499999999999998,"15min":0.36199999999999999},"min":{"1min":0.22600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.495,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.58599999999999997,"15min":1.141},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.503,"5min":21.942,"15min":21.942},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.72199999999999998,"15min":1.202},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59899999999999998,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.76000000000000001,"15min":1.2969999999999999},"min":{"1min":0.40999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":22.010999999999999,"15min":22.010999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.433,"5min":0.311,"15min":0.311},"max":{"1min":0.70699999999999996,"5min":1.401,"15min":1.401},"last":0.69799999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.755,"15min":1.2330000000000001},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68899999999999995,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.77900000000000003,"15min":1.323},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69899999999999995,"5min":21.98,"15min":21.98},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58099999999999996,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.79900000000000004,"5min":1.425,"15min":1.425},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.68799999999999994,"15min":0.93400000000000005},"min":{"1min":0.45100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73499999999999999,"5min":11.154,"15min":11.154},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194632,"statfs":{"total":200000000,"available":199303178,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34599999999999997,"15min":0.33600000000000002},"min":{"1min":0.27700000000000002,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52200000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.34399999999999997},"min":{"1min":0.22,"5min":0.186,"15min":0.186},"max":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.373}]},{"osd":1,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.37,"15min":0.35799999999999998},"min":{"1min":0.23699999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56200000000000006,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.38900000000000001},"min":{"1min":0.28199999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.63300000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39700000000000002,"15min":0.376},"min":{"1min":0.33300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60999999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.312},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.33300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.46700000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.61399999999999999,"15min":0.58399999999999996},"min":{"1min":0.47499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59499999999999997,"15min":0.55900000000000005},"min":{"1min":0.40000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61599999999999999,"15min":0.59899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.93899999999999995,"5min":1.002,"15min":1.002},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.433,"5min":0.375,"15min":0.375},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61899999999999999,"15min":0.59499999999999997},"min":{"1min":0.52500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.5}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302658,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.317,"15min":0.307},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.499,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.35999999999999999,"15min":0.33000000000000002},"min":{"1min":0.28299999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.27600000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34999999999999998,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.373,"15min":0.34699999999999998},"min":{"1min":0.28399999999999997,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.628,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.29599999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.40699999999999997,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.80400000000000005,"5min":3.044,"15min":3.044},"last":0.313},{"interface":"front","average":{"1min":0.435,"5min":0.377,"15min":0.34599999999999997},"min":{"1min":0.32200000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90800000000000003,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.46400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.93300000000000005,"5min":2.25,"15min":2.25},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60999999999999999,"15min":0.69599999999999995},"min":{"1min":0.48599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88200000000000001,"5min":6.4189999999999996,"15min":6.4189999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.47999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.46700000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94299999999999995,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.71099999999999997,"15min":0.97399999999999998},"min":{"1min":0.46800000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":14.912000000000001,"15min":14.912000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58899999999999997,"15min":0.55400000000000005},"min":{"1min":0.46700000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199303120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.58199999999999996,"15min":0.80800000000000005},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63100000000000001,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.63400000000000001},"min":{"1min":0.38800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.72499999999999998,"5min":5.3579999999999997,"15min":5.3579999999999997},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61299999999999999,"15min":0.84299999999999997},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65300000000000002,"5min":5.9329999999999998,"15min":5.9329999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59299999999999997,"15min":0.79100000000000004},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":5.9820000000000002,"15min":5.9820000000000002},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.65500000000000003},"min":{"1min":0.312,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70799999999999996,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.68500000000000005},"min":{"1min":0.378,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69499999999999995,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53200000000000003,"15min":0.59399999999999997},"min":{"1min":0.38500000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64700000000000002,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.62},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77000000000000002,"5min":3.456,"15min":3.456},"last":0.438}]},{"osd":5,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46999999999999997,"15min":0.48999999999999999},"min":{"1min":0.32500000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.67300000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49399999999999999,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.624,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.52200000000000002},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.39900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69199999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.42299999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.71499999999999997,"15min":1.0469999999999999},"min":{"1min":0.49099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.747,"5min":13.173999999999999,"15min":13.173999999999999},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194632,"statfs":{"total":200000000,"available":199303212,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.315,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.755,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40899999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.38500000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45700000000000002,"15min":0.45000000000000001},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.73699999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.433},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.879,"15min":0.879},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:51:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66600000000000004}]}]}],"pool_statfs":[]}} 2023-10-06T02:51:59.355 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:51:59.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:51:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.475+0000 7f8d5927f700 1 Processor -- start 2023-10-06T02:51:59.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.475+0000 7f8d5927f700 1 -- start start 2023-10-06T02:51:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.476+0000 7f8d5927f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d540ad970 0x7f8d54158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.476+0000 7f8d5927f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8d540b34d0 0x7f8d540ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.476+0000 7f8d5927f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d540b4370 con 0x7f8d540add40 2023-10-06T02:51:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.476+0000 7f8d5927f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d540b1980 con 0x7f8d540ad970 2023-10-06T02:51:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.476+0000 7f8d5927f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d540b1c60 con 0x7f8d540b34d0 2023-10-06T02:51:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.476+0000 7f8d52ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d540ad970 0x7f8d54158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.476+0000 7f8d52ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d540ad970 0x7f8d54158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56980/0 (socket says 172.21.15.81:56980) 2023-10-06T02:51:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.476+0000 7f8d52ffd700 1 -- 172.21.15.81:0/1506728813 learned_addr learned my addr 172.21.15.81:0/1506728813 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.477+0000 7f8d4bfff700 1 --2- 172.21.15.81:0/1506728813 >> v2:172.21.15.83:3300/0 conn(0x7f8d540b34d0 0x7f8d540ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.477+0000 7f8d52ffd700 1 -- 172.21.15.81:0/1506728813 >> v2:172.21.15.83:3300/0 conn(0x7f8d540b34d0 msgr2=0x7f8d540ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.477+0000 7f8d52ffd700 1 --2- 172.21.15.81:0/1506728813 >> v2:172.21.15.83:3300/0 conn(0x7f8d540b34d0 0x7f8d540ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.477+0000 7f8d52ffd700 1 -- 172.21.15.81:0/1506728813 >> v1:172.21.15.83:6789/0 conn(0x7f8d540add40 legacy=0x7f8d540b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.477+0000 7f8d52ffd700 1 -- 172.21.15.81:0/1506728813 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d54158af0 con 0x7f8d540ad970 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.477+0000 7f8d52ffd700 1 --2- 172.21.15.81:0/1506728813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540ad970 0x7f8d54158270 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8d5406aa10 tx=0x7f8d44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59205ce552e5ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.477+0000 7f8d527fc700 1 -- 172.21.15.81:0/1506728813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400b860 con 0x7f8d540ad970 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.477+0000 7f8d527fc700 1 -- 172.21.15.81:0/1506728813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4400b9c0 con 0x7f8d540ad970 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.477+0000 7f8d527fc700 1 -- 172.21.15.81:0/1506728813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400bd60 con 0x7f8d540ad970 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.478+0000 7f8d5927f700 1 -- 172.21.15.81:0/1506728813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540ad970 msgr2=0x7f8d54158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.478+0000 7f8d5927f700 1 --2- 172.21.15.81:0/1506728813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540ad970 0x7f8d54158270 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8d5406aa10 tx=0x7f8d44009250 comp rx=0 tx=0).stop 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.478+0000 7f8d5927f700 1 -- 172.21.15.81:0/1506728813 shutdown_connections 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.478+0000 7f8d5927f700 1 --2- 172.21.15.81:0/1506728813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540ad970 0x7f8d54158270 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.478+0000 7f8d5927f700 1 --2- 172.21.15.81:0/1506728813 >> v2:172.21.15.83:3300/0 conn(0x7f8d540b34d0 0x7f8d540ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.478+0000 7f8d5927f700 1 -- 172.21.15.81:0/1506728813 >> 172.21.15.81:0/1506728813 conn(0x7f8d5406b530 msgr2=0x7f8d54067640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.478+0000 7f8d5927f700 1 -- 172.21.15.81:0/1506728813 shutdown_connections 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.478+0000 7f8d5927f700 1 -- 172.21.15.81:0/1506728813 wait complete. 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.479+0000 7f8d5927f700 1 Processor -- start 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.479+0000 7f8d5927f700 1 -- start start 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.479+0000 7f8d5927f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d540ad970 0x7f8d5415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.479+0000 7f8d5927f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540add40 0x7f8d54141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.479+0000 7f8d5927f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d540b34d0 0x7f8d5414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.479+0000 7f8d5927f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d54168ed0 con 0x7f8d540add40 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.479+0000 7f8d5927f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540cdc70 con 0x7f8d540ad970 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.479+0000 7f8d5927f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540cd340 con 0x7f8d540b34d0 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540add40 0x7f8d54141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540add40 0x7f8d54141710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56992/0 (socket says 172.21.15.81:56992) 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4bfff700 1 -- 172.21.15.81:0/1398767236 learned_addr learned my addr 172.21.15.81:0/1398767236 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d52ffd700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d540ad970 0x7f8d5415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d537fe700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d540b34d0 0x7f8d5414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4bfff700 1 -- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d540b34d0 msgr2=0x7f8d5414ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4bfff700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d540b34d0 0x7f8d5414ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4bfff700 1 -- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d540ad970 msgr2=0x7f8d5415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4bfff700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d540ad970 0x7f8d5415ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4bfff700 1 -- 172.21.15.81:0/1398767236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d440094f0 con 0x7f8d540add40 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4bfff700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540add40 0x7f8d54141710 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00d860 tx=0x7f8d3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4affd700 1 -- 172.21.15.81:0/1398767236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0125f0 con 0x7f8d540add40 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4affd700 1 -- 172.21.15.81:0/1398767236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c012770 con 0x7f8d540add40 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d540cd620 con 0x7f8d540add40 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d4affd700 1 -- 172.21.15.81:0/1398767236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c012b30 con 0x7f8d540add40 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.480+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5414c7b0 con 0x7f8d540add40 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.481+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d540cdde0 con 0x7f8d540add40 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.481+0000 7f8d4affd700 1 -- 172.21.15.81:0/1398767236 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d3c01e460 con 0x7f8d540add40 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.482+0000 7f8d4affd700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d34066f30 0x7f8d340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.482+0000 7f8d4affd700 1 -- 172.21.15.81:0/1398767236 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d3c084ca0 con 0x7f8d540add40 2023-10-06T02:51:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.482+0000 7f8d52ffd700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d34066f30 0x7f8d340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.483+0000 7f8d52ffd700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d34066f30 0x7f8d340693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8d5406aa10 tx=0x7f8d44017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.486+0000 7f8d4affd700 1 -- 172.21.15.81:0/1398767236 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d3c051db0 con 0x7f8d540add40 2023-10-06T02:51:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.745+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8d54158dd0 con 0x7f8d540add40 2023-10-06T02:51:59.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.749+0000 7f8d4affd700 1 -- 172.21.15.81:0/1398767236 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8d3c0553d0 con 0x7f8d540add40 2023-10-06T02:51:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d34066f30 msgr2=0x7f8d340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d34066f30 0x7f8d340693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8d5406aa10 tx=0x7f8d44017000 comp rx=0 tx=0).stop 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540add40 msgr2=0x7f8d54141710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540add40 0x7f8d54141710 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00d860 tx=0x7f8d3c008040 comp rx=0 tx=0).stop 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 shutdown_connections 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d540b34d0 0x7f8d5414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8d34066f30 0x7f8d340693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d540ad970 0x7f8d5415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 --2- 172.21.15.81:0/1398767236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d540add40 0x7f8d54141710 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 >> 172.21.15.81:0/1398767236 conn(0x7f8d5406b530 msgr2=0x7f8d540cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 shutdown_connections 2023-10-06T02:51:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.751+0000 7f8d5927f700 1 -- 172.21.15.81:0/1398767236 wait complete. 2023-10-06T02:51:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:51:59.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:51:59.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.876+0000 7f49702d7700 1 Processor -- start 2023-10-06T02:51:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.876+0000 7f49702d7700 1 -- start start 2023-10-06T02:51:59.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.877+0000 7f49702d7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4968157ca0 0x7f49680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.877+0000 7f49702d7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49680d07c0 con 0x7f496806d120 2023-10-06T02:51:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.877+0000 7f49702d7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49680cfbb0 con 0x7f49681578d0 2023-10-06T02:51:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.877+0000 7f49702d7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680cfe90 con 0x7f4968157ca0 2023-10-06T02:51:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.877+0000 7f496e874700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f496806d120 0x7f496815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58160/0 (socket says 172.21.15.81:58160) 2023-10-06T02:51:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.877+0000 7f496e874700 1 -- 172.21.15.81:0/1128268009 learned_addr learned my addr 172.21.15.81:0/1128268009 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:51:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.877+0000 7f496d872700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4968157ca0 0x7f49680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.877+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243416216 0 0) 0x7f49680d07c0 con 0x7f496806d120 2023-10-06T02:51:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.877+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4954003570 con 0x7f496806d120 2023-10-06T02:51:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 196264877 0 0) 0x7f4954003570 con 0x7f496806d120 2023-10-06T02:51:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4968157ca0 msgr2=0x7f49680cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4968157ca0 0x7f49680cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 >> v1:172.21.15.83:6789/0 conn(0x7f49681578d0 legacy=0x7f496815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680d0170 con 0x7f496806d120 2023-10-06T02:51:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f4960001470 con 0x7f496806d120 2023-10-06T02:51:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 >> v1:172.21.15.81:6789/0 conn(0x7f496806d120 legacy=0x7f496815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4968157ca0 0x7f4954003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f4954004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4954004d50 0x7f49540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680cfe90 con 0x7f4954003fd0 2023-10-06T02:51:59.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495400bb40 con 0x7f4954004d50 2023-10-06T02:51:59.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495400bd00 con 0x7f4968157ca0 2023-10-06T02:51:59.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d872700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f4954004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496e073700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4968157ca0 0x7f4954003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496e874700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4954004d50 0x7f49540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d872700 1 -- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4968157ca0 msgr2=0x7f4954003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:59.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d872700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4968157ca0 0x7f4954003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d872700 1 -- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4954004d50 msgr2=0x7f49540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d872700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4954004d50 0x7f49540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d872700 1 -- 172.21.15.81:0/1128268009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4954003570 con 0x7f4954003fd0 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d872700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f4954004810 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f4958009be0 tx=0x7f49580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10a2edde2f33e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800e710 con 0x7f4954003fd0 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800e870 con 0x7f4954003fd0 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.878+0000 7f496d071700 1 -- 172.21.15.81:0/1128268009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800ec30 con 0x7f4954003fd0 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.879+0000 7f49702d7700 1 -- 172.21.15.81:0/1128268009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 msgr2=0x7f4954004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.879+0000 7f49702d7700 1 --2- 172.21.15.81:0/1128268009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f4954004810 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f4958009be0 tx=0x7f49580091a0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.879+0000 7f496e874700 1 -- 172.21.15.81:0/1128268009 reap_dead start 2023-10-06T02:51:59.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.879+0000 7f49702d7700 1 -- 172.21.15.81:0/1128268009 shutdown_connections 2023-10-06T02:51:59.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.879+0000 7f49702d7700 1 -- 172.21.15.81:0/1128268009 >> 172.21.15.81:0/1128268009 conn(0x7f496806bb90 msgr2=0x7f496806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:51:59.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.879+0000 7f49702d7700 1 -- 172.21.15.81:0/1128268009 shutdown_connections 2023-10-06T02:51:59.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.879+0000 7f49702d7700 1 -- 172.21.15.81:0/1128268009 wait complete. 2023-10-06T02:51:59.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.880+0000 7f49702d7700 1 Processor -- start 2023-10-06T02:51:59.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.880+0000 7f49702d7700 1 -- start start 2023-10-06T02:51:59.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f49702d7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f49680b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f49702d7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4968153470 0x7f49680c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f49702d7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49680c6060 0x7f496816a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f49702d7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c64e0 con 0x7f4954003fd0 2023-10-06T02:51:59.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f49702d7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496815eb10 con 0x7f4968153470 2023-10-06T02:51:59.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f49702d7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496816b280 con 0x7f49680c6060 2023-10-06T02:51:59.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e073700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f49680b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e073700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f49680b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56998/0 (socket says 172.21.15.81:56998) 2023-10-06T02:51:59.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e073700 1 -- 172.21.15.81:0/762397218 learned_addr learned my addr 172.21.15.81:0/762397218 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:51:59.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496d872700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4968153470 0x7f49680c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e874700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49680c6060 0x7f496816a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e073700 1 -- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49680c6060 msgr2=0x7f496816a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e073700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49680c6060 0x7f496816a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e073700 1 -- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4968153470 msgr2=0x7f49680c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:51:59.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e073700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4968153470 0x7f49680c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:51:59.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e073700 1 -- 172.21.15.81:0/762397218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496815e4c0 con 0x7f4954003fd0 2023-10-06T02:51:59.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496d872700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4968153470 0x7f49680c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:51:59.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f496e073700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f49680b4b70 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f496400ebc0 tx=0x7f49640016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:59.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.881+0000 7f495e7fc700 1 -- 172.21.15.81:0/762397218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964019070 con 0x7f4954003fd0 2023-10-06T02:51:59.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.882+0000 7f495e7fc700 1 -- 172.21.15.81:0/762397218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4964001a00 con 0x7f4954003fd0 2023-10-06T02:51:59.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.882+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496815e7a0 con 0x7f4954003fd0 2023-10-06T02:51:59.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.882+0000 7f495e7fc700 1 -- 172.21.15.81:0/762397218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964001dc0 con 0x7f4954003fd0 2023-10-06T02:51:59.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.882+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4968153aa0 con 0x7f4954003fd0 2023-10-06T02:51:59.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.882+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49680b3520 con 0x7f4954003fd0 2023-10-06T02:51:59.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.883+0000 7f495e7fc700 1 -- 172.21.15.81:0/762397218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f496400cb50 con 0x7f4954003fd0 2023-10-06T02:51:59.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.883+0000 7f495e7fc700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f494c066f30 0x7f494c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:51:59.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.883+0000 7f495e7fc700 1 -- 172.21.15.81:0/762397218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4964084b30 con 0x7f4954003fd0 2023-10-06T02:51:59.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.883+0000 7f496d872700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f494c066f30 0x7f494c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:51:59.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.884+0000 7f496d872700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f494c066f30 0x7f494c0693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49580091e0 tx=0x7f4958019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:51:59.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:51:59.887+0000 7f495e7fc700 1 -- 172.21.15.81:0/762397218 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4964051c40 con 0x7f4954003fd0 2023-10-06T02:52:00.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.113+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49680b2f00 con 0x7f4954003fd0 2023-10-06T02:52:00.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.114+0000 7f495e7fc700 1 -- 172.21.15.81:0/762397218 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f4964055260 con 0x7f4954003fd0 2023-10-06T02:52:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:00.115 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3448648390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3448648390},{"type":"v1","addr":"172.21.15.83:6836","nonce":3448648390}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/259812660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":259812660},{"type":"v1","addr":"172.21.15.83:6837","nonce":259812660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4011741221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4011741221},{"type":"v1","addr":"172.21.15.81:6834","nonce":4011741221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:53.060344+0000","modified":"2023-10-06T02:51:56.712953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/3211565547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3211565547},{"type":"v1","addr":"172.21.15.81:6835","nonce":3211565547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:52:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f494c066f30 msgr2=0x7f494c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f494c066f30 0x7f494c0693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49580091e0 tx=0x7f4958019000 comp rx=0 tx=0).stop 2023-10-06T02:52:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 msgr2=0x7f49680b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f49680b4b70 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f496400ebc0 tx=0x7f49640016d0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 shutdown_connections 2023-10-06T02:52:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49680c6060 0x7f496816a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4954003fd0 0x7f49680b4b70 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f494c066f30 0x7f494c0693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 --2- 172.21.15.81:0/762397218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4968153470 0x7f49680c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 >> 172.21.15.81:0/762397218 conn(0x7f496806bb90 msgr2=0x7f496806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 shutdown_connections 2023-10-06T02:52:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.116+0000 7f49702d7700 1 -- 172.21.15.81:0/762397218 wait complete. 2023-10-06T02:52:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2023-10-06T02:52:00.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:51:53.060344+0000', 'modified': '2023-10-06T02:51:56.712953+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6885}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6885': {'gid': 6885, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/3211565547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 3211565547}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 3211565547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:52:00.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:52:00.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:52:00.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.648+0000 7f9837dbe700 1 Processor -- start 2023-10-06T02:52:00.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.648+0000 7f9837dbe700 1 -- start start 2023-10-06T02:52:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9837dbe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9830157ca0 0x7f98300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9837dbe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f983006d120 0x7f983006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9837dbe700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98300d07c0 con 0x7f98301578d0 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9837dbe700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983006da50 con 0x7f9830157ca0 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9837dbe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98300cfbb0 con 0x7f983006d120 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9835359700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9830157ca0 0x7f98300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9835b5a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f98301578d0 0x7f983015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47256/0 (socket says 172.21.15.81:47256) 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9835359700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9830157ca0 0x7f98300cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46594/0 (socket says 172.21.15.81:46594) 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9835b5a700 1 -- 172.21.15.81:0/3816322124 learned_addr learned my addr 172.21.15.81:0/3816322124 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9835359700 1 -- 172.21.15.81:0/3816322124 >> v2:172.21.15.83:3300/0 conn(0x7f983006d120 msgr2=0x7f983006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9835359700 1 --2- 172.21.15.81:0/3816322124 >> v2:172.21.15.83:3300/0 conn(0x7f983006d120 0x7f983006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9835359700 1 -- 172.21.15.81:0/3816322124 >> v1:172.21.15.81:6789/0 conn(0x7f98301578d0 legacy=0x7f983015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9835359700 1 -- 172.21.15.81:0/3816322124 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98300cfe90 con 0x7f9830157ca0 2023-10-06T02:52:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9834b58700 1 -- 172.21.15.81:0/3816322124 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367759784 0 0) 0x7f98300d07c0 con 0x7f98301578d0 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9835359700 1 --2- 172.21.15.81:0/3816322124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9830157ca0 0x7f98300cf4f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f9830068300 tx=0x7f98200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74afad812092ea39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9834b58700 1 -- 172.21.15.81:0/3816322124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000b6b0 con 0x7f9830157ca0 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9834b58700 1 -- 172.21.15.81:0/3816322124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982000b810 con 0x7f9830157ca0 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.649+0000 7f9834b58700 1 -- 172.21.15.81:0/3816322124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000bbb0 con 0x7f9830157ca0 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.650+0000 7f9837dbe700 1 -- 172.21.15.81:0/3816322124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9830157ca0 msgr2=0x7f98300cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.650+0000 7f9837dbe700 1 --2- 172.21.15.81:0/3816322124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9830157ca0 0x7f98300cf4f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f9830068300 tx=0x7f98200091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.650+0000 7f9837dbe700 1 -- 172.21.15.81:0/3816322124 shutdown_connections 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.650+0000 7f9837dbe700 1 --2- 172.21.15.81:0/3816322124 >> v2:172.21.15.83:3300/0 conn(0x7f983006d120 0x7f983006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.650+0000 7f9837dbe700 1 --2- 172.21.15.81:0/3816322124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9830157ca0 0x7f98300cf4f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.650+0000 7f9837dbe700 1 -- 172.21.15.81:0/3816322124 >> 172.21.15.81:0/3816322124 conn(0x7f983006bb90 msgr2=0x7f983006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.650+0000 7f9837dbe700 1 -- 172.21.15.81:0/3816322124 shutdown_connections 2023-10-06T02:52:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.650+0000 7f9837dbe700 1 -- 172.21.15.81:0/3816322124 wait complete. 2023-10-06T02:52:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.651+0000 7f9837dbe700 1 Processor -- start 2023-10-06T02:52:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.651+0000 7f9837dbe700 1 -- start start 2023-10-06T02:52:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9837dbe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983006d120 0x7f98300cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9837dbe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98301578d0 0x7f98300c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9837dbe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9830157ca0 0x7f98300c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9837dbe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98300c7360 con 0x7f98301578d0 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9837dbe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98300c7ee0 con 0x7f9830157ca0 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9837dbe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98300c75b0 con 0x7f983006d120 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835359700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98301578d0 0x7f98300c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835359700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98301578d0 0x7f98300c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46596/0 (socket says 172.21.15.81:46596) 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835359700 1 -- 172.21.15.81:0/1751952157 learned_addr learned my addr 172.21.15.81:0/1751952157 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835b5a700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983006d120 0x7f98300cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f983635b700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9830157ca0 0x7f98300c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835359700 1 -- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983006d120 msgr2=0x7f98300cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835359700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983006d120 0x7f98300cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835359700 1 -- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9830157ca0 msgr2=0x7f98300c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835359700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9830157ca0 0x7f98300c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835359700 1 -- 172.21.15.81:0/1751952157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820009420 con 0x7f98301578d0 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9835359700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98301578d0 0x7f98300c8370 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f983006fe20 tx=0x7f9820017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9825ffb700 1 -- 172.21.15.81:0/1751952157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000bb90 con 0x7f98301578d0 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9825ffb700 1 -- 172.21.15.81:0/1751952157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820011420 con 0x7f98301578d0 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9825ffb700 1 -- 172.21.15.81:0/1751952157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98200117c0 con 0x7f98301578d0 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.652+0000 7f9837dbe700 1 -- 172.21.15.81:0/1751952157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98300c7890 con 0x7f98301578d0 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.653+0000 7f9837dbe700 1 -- 172.21.15.81:0/1751952157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98300cd7a0 con 0x7f98301578d0 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.654+0000 7f9825ffb700 1 -- 172.21.15.81:0/1751952157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9820011b30 con 0x7f98301578d0 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.654+0000 7f9825ffb700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9814066f30 0x7f98140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.654+0000 7f9825ffb700 1 -- 172.21.15.81:0/1751952157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9820086000 con 0x7f98301578d0 2023-10-06T02:52:00.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.654+0000 7f9835b5a700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9814066f30 0x7f98140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.655+0000 7f9835b5a700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9814066f30 0x7f98140693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f982c001560 tx=0x7f982c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.656+0000 7f98410b6b80 1 Processor -- start 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.656+0000 7f98410b6b80 1 -- start start 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 0x558e1daa1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daf16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 0x558e1daf2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f98410b6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1d9f8a70 con 0x558e1daa2cc0 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f98410b6b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1d9f6270 con 0x558e1daa1840 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f98410b6b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e1d9f2060 con 0x558e1daf1c00 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835359700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daf16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835359700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daf16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46608/0 (socket says 172.21.15.81:46608) 2023-10-06T02:52:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835359700 1 -- 172.21.15.81:0/1165615714 learned_addr learned my addr 172.21.15.81:0/1165615714 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835b5a700 1 --2- 172.21.15.81:0/1165615714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 0x558e1daa1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f983635b700 1 --2- 172.21.15.81:0/1165615714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 0x558e1daf2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835359700 1 -- 172.21.15.81:0/1165615714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 msgr2=0x558e1daf2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835359700 1 --2- 172.21.15.81:0/1165615714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 0x558e1daf2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835359700 1 -- 172.21.15.81:0/1165615714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 msgr2=0x558e1daa1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835359700 1 --2- 172.21.15.81:0/1165615714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 0x558e1daa1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835359700 1 -- 172.21.15.81:0/1165615714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e1d88c270 con 0x558e1daa2cc0 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.657+0000 7f9835359700 1 --2- 172.21.15.81:0/1165615714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daf16c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f98200093a0 tx=0x7f9820084320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e1f3cad112bb73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f9812ffd700 1 -- 172.21.15.81:0/1165615714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98200574d0 con 0x558e1daa2cc0 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f9812ffd700 1 -- 172.21.15.81:0/1165615714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982005c0f0 con 0x558e1daa2cc0 2023-10-06T02:52:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f9812ffd700 1 -- 172.21.15.81:0/1165615714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820056dd0 con 0x558e1daa2cc0 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f98410b6b80 1 -- 172.21.15.81:0/1165615714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 msgr2=0x558e1daf16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1165615714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daf16c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f98200093a0 tx=0x7f9820084320 comp rx=0 tx=0).stop 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f98410b6b80 1 -- 172.21.15.81:0/1165615714 shutdown_connections 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1165615714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 0x558e1daf2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1165615714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 0x558e1daa1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1165615714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daf16c0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f98410b6b80 1 -- 172.21.15.81:0/1165615714 >> 172.21.15.81:0/1165615714 conn(0x558e1daa3160 msgr2=0x558e1daa3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f98410b6b80 1 -- 172.21.15.81:0/1165615714 shutdown_connections 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.658+0000 7f98410b6b80 1 -- 172.21.15.81:0/1165615714 wait complete. 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.659+0000 7f98410b6b80 1 -- start start 2023-10-06T02:52:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.659+0000 7f98410b6b80 1 Processor -- start 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 0x558e1dae0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daf1c00 0x558e1daeab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1d99d890 con 0x558e1daa2cc0 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1d9b8ea0 con 0x558e1daf1c00 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e1d874e30 con 0x558e1daa1840 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 10 client.0 _ll_register_callbacks cb 0x558e1da64e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835359700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835359700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46612/0 (socket says 172.21.15.81:46612) 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835359700 1 -- 172.21.15.81:0/1238046832 learned_addr learned my addr 172.21.15.81:0/1238046832 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835b5a700 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 0x558e1dae0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f983635b700 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daf1c00 0x558e1daeab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835359700 1 -- 172.21.15.81:0/1238046832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 msgr2=0x558e1dae0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835359700 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 0x558e1dae0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835359700 1 -- 172.21.15.81:0/1238046832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daf1c00 msgr2=0x558e1daeab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835359700 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daf1c00 0x558e1daeab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835359700 1 -- 172.21.15.81:0/1238046832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98300cd7a0 con 0x558e1daa2cc0 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f9835359700 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5f0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9820059010 tx=0x7f9820026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d279f55bbfd268fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f980bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f980bfff700 1 -- 172.21.15.81:0/1238046832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982005dd70 con 0x558e1daa2cc0 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 1 -- 172.21.15.81:0/1238046832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e1da96940 con 0x558e1daa2cc0 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f980bfff700 1 -- 172.21.15.81:0/1238046832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9820056dd0 con 0x558e1daa2cc0 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f980bfff700 1 -- 172.21.15.81:0/1238046832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f982006d1a0 con 0x558e1daa2cc0 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 10 client.7047 fetch_fsmap learned FSMap version 59 2023-10-06T02:52:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.660+0000 7f98410b6b80 1 -- 172.21.15.81:0/1238046832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x558e1d82efe0 con 0x558e1daa2cc0 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f980bfff700 1 -- 172.21.15.81:0/1238046832 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e1da96940 con 0x558e1daa2cc0 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f980bfff700 1 -- 172.21.15.81:0/1238046832 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f982005d8e0 con 0x558e1daa2cc0 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f98410b6b80 10 client.7047 fetch_fsmap finished waiting for FSMap version 59 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f98410b6b80 10 client.7047 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f98410b6b80 20 client.7047 populate_metadata read hostname 'smithi081' 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] conn(0x558e1dadffd0 0x558e1dafb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f98410b6b80 4 client.7047 mds_command: new command op to 6885 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f98410b6b80 1 -- 172.21.15.81:0/1238046832 --> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e1da73870 con 0x558e1dadffd0 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f9835b5a700 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] conn(0x558e1dadffd0 0x558e1dafb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f980bfff700 10 client.7047 ms_handle_connect on v2:172.21.15.81:6833/3211565547 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.661+0000 7f9835b5a700 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] conn(0x558e1dadffd0 0x558e1dafb970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f01558e6546996 server_cookie=e053c6d5b6fa7274 in_seq=0 out_seq=0 2023-10-06T02:52:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f980bfff700 1 -- 172.21.15.81:0/1238046832 <== mds.0 v2:172.21.15.81:6833/3211565547 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558e1da73870 con 0x558e1dadffd0 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f980bfff700 10 client.7047 handle_command_reply: tid=0 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 client.7047 shutdown 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 -- 172.21.15.81:0/1238046832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 msgr2=0x558e1daea5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5f0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9820059010 tx=0x7f9820026000 comp rx=0 tx=0).stop 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 -- 172.21.15.81:0/1238046832 shutdown_connections 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] conn(0x558e1dadffd0 0x558e1dafb970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daf1c00 0x558e1daeab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f980bfff700 0 client.7047 ms_handle_reset on v2:172.21.15.81:6833/3211565547 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 0x558e1dae0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 --2- 172.21.15.81:0/1238046832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5f0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 -- 172.21.15.81:0/1238046832 >> 172.21.15.81:0/1238046832 conn(0x558e1daa3160 msgr2=0x558e1daa21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 -- 172.21.15.81:0/1238046832 shutdown_connections 2023-10-06T02:52:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 1 -- 172.21.15.81:0/1238046832 wait complete. 2023-10-06T02:52:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.662+0000 7f98410b6b80 20 client.7047 trim_cache size 0 max 16384 2023-10-06T02:52:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f98410b6b80 1 Processor -- start 2023-10-06T02:52:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f98410b6b80 1 -- start start 2023-10-06T02:52:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 0x558e1dae5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 0x558e1daeab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f98410b6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1da96970 con 0x558e1daa2cc0 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f98410b6b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1da69d90 con 0x558e1daa1840 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f98410b6b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e1d99d810 con 0x558e1daf1c00 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f9835359700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.679+0000 7f9835359700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46614/0 (socket says 172.21.15.81:46614) 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f9835359700 1 -- 172.21.15.81:0/255731392 learned_addr learned my addr 172.21.15.81:0/255731392 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f9835b5a700 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 0x558e1dae5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f983635b700 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 0x558e1daeab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f9835359700 1 -- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 msgr2=0x558e1daeab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f9835359700 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 0x558e1daeab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f9835359700 1 -- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 msgr2=0x558e1dae5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f9835359700 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 0x558e1dae5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f9835359700 1 -- 172.21.15.81:0/255731392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e1d9c0780 con 0x558e1daa2cc0 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f9835b5a700 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 0x558e1dae5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f983635b700 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 0x558e1daeab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f9835359700 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9820020040 tx=0x7f982006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43496eb906e3f818 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f98137fe700 1 -- 172.21.15.81:0/255731392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820056dd0 con 0x558e1daa2cc0 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f98137fe700 1 -- 172.21.15.81:0/255731392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982006d1a0 con 0x558e1daa2cc0 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f98137fe700 1 -- 172.21.15.81:0/255731392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982005dd70 con 0x558e1daa2cc0 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f98410b6b80 1 -- 172.21.15.81:0/255731392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 msgr2=0x558e1daea5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.680+0000 7f98410b6b80 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9820020040 tx=0x7f982006d000 comp rx=0 tx=0).stop 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.681+0000 7f98410b6b80 1 -- 172.21.15.81:0/255731392 shutdown_connections 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.681+0000 7f98410b6b80 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daf1c00 0x558e1daeab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.681+0000 7f98410b6b80 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa1840 0x558e1dae5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.681+0000 7f98410b6b80 1 --2- 172.21.15.81:0/255731392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daa2cc0 0x558e1daea5d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.681+0000 7f98410b6b80 1 -- 172.21.15.81:0/255731392 >> 172.21.15.81:0/255731392 conn(0x558e1daa3160 msgr2=0x558e1dae1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.681+0000 7f98410b6b80 1 -- 172.21.15.81:0/255731392 shutdown_connections 2023-10-06T02:52:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.681+0000 7f98410b6b80 1 -- 172.21.15.81:0/255731392 wait complete. 2023-10-06T02:52:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.681+0000 7f98410b6b80 1 -- start start 2023-10-06T02:52:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.681+0000 7f98410b6b80 1 Processor -- start 2023-10-06T02:52:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 0x558e1db4c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa2cc0 0x558e1daca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f98410b6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daf1c00 0x558e1db019a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f98410b6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1dadef40 con 0x558e1daf1c00 2023-10-06T02:52:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f98410b6b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1dacabd0 con 0x558e1daa2cc0 2023-10-06T02:52:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f98410b6b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e1dae7bb0 con 0x558e1daa1840 2023-10-06T02:52:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f98410b6b80 10 client.0 _ll_register_callbacks cb 0x558e1da64e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:52:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f9835b5a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 0x558e1db4c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f9835359700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa2cc0 0x558e1daca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f983635b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daf1c00 0x558e1db019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f983635b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daf1c00 0x558e1db019a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46618/0 (socket says 172.21.15.81:46618) 2023-10-06T02:52:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f983635b700 1 -- 172.21.15.81:0/2821605420 learned_addr learned my addr 172.21.15.81:0/2821605420 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.682+0000 7f9835b5a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 0x558e1db4c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:54972/0 (socket says 172.21.15.81:54972) 2023-10-06T02:52:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f983635b700 1 -- 172.21.15.81:0/2821605420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 msgr2=0x558e1db4c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f983635b700 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 0x558e1db4c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f983635b700 1 -- 172.21.15.81:0/2821605420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa2cc0 msgr2=0x558e1daca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f983635b700 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa2cc0 0x558e1daca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f983635b700 1 -- 172.21.15.81:0/2821605420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e1d82efe0 con 0x558e1daf1c00 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f983635b700 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daf1c00 0x558e1db019a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f982800be80 tx=0x7f9828008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba52cca9baacf374 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f980bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f980bfff700 1 -- 172.21.15.81:0/2821605420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828013cc0 con 0x558e1daf1c00 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f980bfff700 1 -- 172.21.15.81:0/2821605420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9828013e20 con 0x558e1daf1c00 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f98410b6b80 1 -- 172.21.15.81:0/2821605420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f982005c0f0 con 0x558e1daf1c00 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f980bfff700 1 -- 172.21.15.81:0/2821605420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9828016670 con 0x558e1daf1c00 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f98410b6b80 10 client.7053 fetch_fsmap learned FSMap version 59 2023-10-06T02:52:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f98410b6b80 1 -- 172.21.15.81:0/2821605420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x558e1d9a7470 con 0x558e1daf1c00 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.683+0000 7f980bfff700 1 -- 172.21.15.81:0/2821605420 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982005c0f0 con 0x558e1daf1c00 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f980bfff700 1 -- 172.21.15.81:0/2821605420 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f982801f430 con 0x558e1daf1c00 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 10 client.7053 fetch_fsmap finished waiting for FSMap version 59 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 10 client.7053 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 20 client.7053 populate_metadata read hostname 'smithi081' 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] conn(0x558e1dade350 0x558e1dade720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 4 client.7053 mds_command: new command op to 6885 tid=0[{"prefix": "status"}] 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 -- 172.21.15.81:0/2821605420 --> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558e1d994e00 con 0x558e1dade350 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f9835b5a700 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] conn(0x558e1dade350 0x558e1dade720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f980bfff700 10 client.7053 ms_handle_connect on v2:172.21.15.81:6833/3211565547 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f9835b5a700 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] conn(0x558e1dade350 0x558e1dade720 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ea7b00eeb9154e7 server_cookie=e0ac6f74aee48dc5 in_seq=0 out_seq=0 2023-10-06T02:52:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f980bfff700 1 -- 172.21.15.81:0/2821605420 <== mds.0 v2:172.21.15.81:6833/3211565547 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x558e1d994e00 con 0x558e1dade350 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f980bfff700 10 client.7053 handle_command_reply: tid=0 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 client.7053 shutdown 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 -- 172.21.15.81:0/2821605420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daf1c00 msgr2=0x558e1db019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daf1c00 0x558e1db019a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f982800be80 tx=0x7f9828008040 comp rx=0 tx=0).stop 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 -- 172.21.15.81:0/2821605420 shutdown_connections 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1daf1c00 0x558e1db019a0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558e1daa1840 0x558e1db4c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.81:6833/3211565547,v1:172.21.15.81:6835/3211565547] conn(0x558e1dade350 0x558e1dade720 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 --2- 172.21.15.81:0/2821605420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558e1daa2cc0 0x558e1daca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f98410b6b80 1 -- 172.21.15.81:0/2821605420 >> 172.21.15.81:0/2821605420 conn(0x558e1daa3160 msgr2=0x558e1daa3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.684+0000 7f980bfff700 0 client.7053 ms_handle_reset on v2:172.21.15.81:6833/3211565547 2023-10-06T02:52:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f98410b6b80 1 -- 172.21.15.81:0/2821605420 shutdown_connections 2023-10-06T02:52:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f98410b6b80 1 -- 172.21.15.81:0/2821605420 wait complete. 2023-10-06T02:52:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f98410b6b80 20 client.7053 trim_cache size 0 max 16384 2023-10-06T02:52:00.695 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:00.695 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:52:00.695 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:52:00.695 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6885, 2023-10-06T02:52:00.695 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:52:00.696 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:52:00.696 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:52:00.696 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 6.980237325, 2023-10-06T02:52:00.696 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 59, 2023-10-06T02:52:00.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 120, 2023-10-06T02:52:00.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 120, 2023-10-06T02:52:00.696 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.115742678 2023-10-06T02:52:00.697 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 -- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9814066f30 msgr2=0x7f98140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9814066f30 0x7f98140693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f982c001560 tx=0x7f982c009040 comp rx=0 tx=0).stop 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 -- 172.21.15.81:0/1751952157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98301578d0 msgr2=0x7f98300c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98301578d0 0x7f98300c8370 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f983006fe20 tx=0x7f9820017000 comp rx=0 tx=0).stop 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 -- 172.21.15.81:0/1751952157 shutdown_connections 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9814066f30 0x7f98140693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9830157ca0 0x7f98300c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983006d120 0x7f98300cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 --2- 172.21.15.81:0/1751952157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98301578d0 0x7f98300c8370 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 -- 172.21.15.81:0/1751952157 >> 172.21.15.81:0/1751952157 conn(0x7f983006bb90 msgr2=0x7f98301569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 -- 172.21.15.81:0/1751952157 shutdown_connections 2023-10-06T02:52:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.685+0000 7f9837dbe700 1 -- 172.21.15.81:0/1751952157 wait complete. 2023-10-06T02:52:00.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:52:00.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.812+0000 7ff2955bf700 1 Processor -- start 2023-10-06T02:52:00.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.812+0000 7ff2955bf700 1 -- start start 2023-10-06T02:52:00.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff2955bf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff290157ca0 0x7ff2900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff2955bf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 0x7ff29006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff2955bf700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2900d07c0 con 0x7ff2901578d0 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff2955bf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29006daa0 con 0x7ff290157ca0 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff2955bf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900cfbb0 con 0x7ff29006d120 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff290157ca0 0x7ff2900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff290157ca0 0x7ff2900cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46630/0 (socket says 172.21.15.81:46630) 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28e7fc700 1 -- 172.21.15.81:0/2469989178 learned_addr learned my addr 172.21.15.81:0/2469989178 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28f7fe700 1 --2- 172.21.15.81:0/2469989178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 0x7ff29006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28e7fc700 1 -- 172.21.15.81:0/2469989178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 msgr2=0x7ff29006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28e7fc700 1 --2- 172.21.15.81:0/2469989178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 0x7ff29006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28e7fc700 1 -- 172.21.15.81:0/2469989178 >> v1:172.21.15.83:6789/0 conn(0x7ff2901578d0 legacy=0x7ff29015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28e7fc700 1 -- 172.21.15.81:0/2469989178 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900cfe90 con 0x7ff290157ca0 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28e7fc700 1 --2- 172.21.15.81:0/2469989178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff290157ca0 0x7ff2900cf4f0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff2840099b0 tx=0x7ff284009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e0b5149da0980c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.813+0000 7ff28dffb700 1 -- 172.21.15.81:0/2469989178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28400b860 con 0x7ff290157ca0 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff28dffb700 1 -- 172.21.15.81:0/2469989178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28400b9c0 con 0x7ff290157ca0 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff28dffb700 1 -- 172.21.15.81:0/2469989178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28400bd60 con 0x7ff290157ca0 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff2955bf700 1 -- 172.21.15.81:0/2469989178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff290157ca0 msgr2=0x7ff2900cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff2955bf700 1 --2- 172.21.15.81:0/2469989178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff290157ca0 0x7ff2900cf4f0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff2840099b0 tx=0x7ff284009250 comp rx=0 tx=0).stop 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff2955bf700 1 -- 172.21.15.81:0/2469989178 shutdown_connections 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff2955bf700 1 --2- 172.21.15.81:0/2469989178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 0x7ff29006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff2955bf700 1 --2- 172.21.15.81:0/2469989178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff290157ca0 0x7ff2900cf4f0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff2955bf700 1 -- 172.21.15.81:0/2469989178 >> 172.21.15.81:0/2469989178 conn(0x7ff29006bb90 msgr2=0x7ff29006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:00.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff2955bf700 1 -- 172.21.15.81:0/2469989178 shutdown_connections 2023-10-06T02:52:00.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.814+0000 7ff2955bf700 1 -- 172.21.15.81:0/2469989178 wait complete. 2023-10-06T02:52:00.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.815+0000 7ff2955bf700 1 Processor -- start 2023-10-06T02:52:00.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.815+0000 7ff2955bf700 1 -- start start 2023-10-06T02:52:00.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff2955bf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 0x7ff290153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff2955bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2901578d0 0x7ff2900ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff2955bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff290157ca0 0x7ff2900aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff2955bf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900ad260 con 0x7ff2901578d0 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff2955bf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900acf80 con 0x7ff290157ca0 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff2955bf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900b3d40 con 0x7ff29006d120 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2901578d0 0x7ff2900ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2901578d0 0x7ff2900ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46636/0 (socket says 172.21.15.81:46636) 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28e7fc700 1 -- 172.21.15.81:0/1738401206 learned_addr learned my addr 172.21.15.81:0/1738401206 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28effd700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 0x7ff290153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28f7fe700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff290157ca0 0x7ff2900aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28e7fc700 1 -- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 msgr2=0x7ff290153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28e7fc700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 0x7ff290153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28e7fc700 1 -- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff290157ca0 msgr2=0x7ff2900aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28e7fc700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff290157ca0 0x7ff2900aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.816+0000 7ff28e7fc700 1 -- 172.21.15.81:0/1738401206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2840094f0 con 0x7ff2901578d0 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.817+0000 7ff28e7fc700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2901578d0 0x7ff2900ac470 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff29006fe20 tx=0x7ff284017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.817+0000 7ff276ffd700 1 -- 172.21.15.81:0/1738401206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284011e40 con 0x7ff2901578d0 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.817+0000 7ff276ffd700 1 -- 172.21.15.81:0/1738401206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff284024440 con 0x7ff2901578d0 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.817+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2900b4020 con 0x7ff2901578d0 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.817+0000 7ff276ffd700 1 -- 172.21.15.81:0/1738401206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284024800 con 0x7ff2901578d0 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.817+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2900b6620 con 0x7ff2901578d0 2023-10-06T02:52:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.818+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2900b3ba0 con 0x7ff2901578d0 2023-10-06T02:52:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.818+0000 7ff276ffd700 1 -- 172.21.15.81:0/1738401206 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff28401a420 con 0x7ff2901578d0 2023-10-06T02:52:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.819+0000 7ff276ffd700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff27c066f30 0x7ff27c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.819+0000 7ff276ffd700 1 -- 172.21.15.81:0/1738401206 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff284086480 con 0x7ff2901578d0 2023-10-06T02:52:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.819+0000 7ff28effd700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff27c066f30 0x7ff27c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.819+0000 7ff28effd700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff27c066f30 0x7ff27c0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff288007fd0 tx=0x7ff2880016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:00.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:00.823+0000 7ff276ffd700 1 -- 172.21.15.81:0/1738401206 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2900b3ba0 con 0x7ff2901578d0 2023-10-06T02:52:01.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.047+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff2900b4540 con 0x7ff2901578d0 2023-10-06T02:52:01.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.048+0000 7ff276ffd700 1 -- 172.21.15.81:0/1738401206 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff2900b4540 con 0x7ff2901578d0 2023-10-06T02:52:01.050 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:52:01.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff27c066f30 msgr2=0x7ff27c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:01.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff27c066f30 0x7ff27c0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff288007fd0 tx=0x7ff2880016f0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2901578d0 msgr2=0x7ff2900ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:01.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2901578d0 0x7ff2900ac470 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff29006fe20 tx=0x7ff284017000 comp rx=0 tx=0).stop 2023-10-06T02:52:01.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 shutdown_connections 2023-10-06T02:52:01.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff27c066f30 0x7ff27c0693e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff290157ca0 0x7ff2900aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff29006d120 0x7ff290153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 --2- 172.21.15.81:0/1738401206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2901578d0 0x7ff2900ac470 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 >> 172.21.15.81:0/1738401206 conn(0x7ff29006bb90 msgr2=0x7ff290068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:01.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 shutdown_connections 2023-10-06T02:52:01.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.050+0000 7ff2955bf700 1 -- 172.21.15.81:0/1738401206 wait complete. 2023-10-06T02:52:01.063 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:52:01.063 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:52:01.063 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:52:01.063 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:52:01.063 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:52:01.063 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:52:01.063 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:52:01.063 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:52:01.063 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:52:01.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:01.064 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:52:01.079 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:52:01.079 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:52:01.079 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:52:01.079 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:01.079 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:52:01.079 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:01.079 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42196sec preferred_lft 42196sec 2023-10-06T02:52:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:52:01.081 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:52:01.082 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:52:01.082 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:01.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:01.082 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:52:01.142 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:52:01.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:01.143 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:52:01.199 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:52:01.200 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:52:01.200 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:52:01.200 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:52:01.200 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:52:01.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:01.201 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:52:01.201 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:52:01.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:52:01.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:52:01.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:52:01.202 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:52:01.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:01.299 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:52:01.314 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:52:01.314 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:52:01.314 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:52:01.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:01.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:52:01.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:52:01.378 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:52:01.433 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:52:01.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:52:01.433 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:52:01.487 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:52:01.487 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:52:01.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:01.566 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:01.566 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:01.585 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:01.585 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:01.585 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:52:01.585 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:52:01.586 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:52:01.586 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:52:01.586 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:52:01.586 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:52:01.607 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:01.607 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:01.607 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:52:01.608 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:52:01.608 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:52:01.608 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:52:01.608 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:52:01.608 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:52:01.608 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:52:01.608 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:52:01.608 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:52:01.610 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:52:01.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:01.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:52:01.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:52:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.828+0000 7f2087387700 1 Processor -- start 2023-10-06T02:52:01.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.828+0000 7f2087387700 1 -- start start 2023-10-06T02:52:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.829+0000 7f2087387700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2080157fe0 0x7f20800b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.829+0000 7f2087387700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f20801583b0 0x7f20800b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.829+0000 7f2087387700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20800b2890 con 0x7f20800ceb30 2023-10-06T02:52:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.829+0000 7f2087387700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20800b4070 con 0x7f20801583b0 2023-10-06T02:52:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.829+0000 7f2087387700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20800b4350 con 0x7f2080157fe0 2023-10-06T02:52:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.829+0000 7f2085924700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f20800ceb30 0x7f20800cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47260/0 (socket says 172.21.15.81:47260) 2023-10-06T02:52:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.829+0000 7f2085924700 1 -- 172.21.15.81:0/2451383131 learned_addr learned my addr 172.21.15.81:0/2451383131 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949313649 0 0) 0x7f20800b2890 con 0x7f20800ceb30 2023-10-06T02:52:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2085123700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2080157fe0 0x7f20800b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2084922700 1 --2- 172.21.15.81:0/2451383131 >> v2:172.21.15.83:3300/0 conn(0x7f20801583b0 0x7f20800b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f206c003570 con 0x7f20800ceb30 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2376139288 0 0) 0x7f206c003570 con 0x7f20800ceb30 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2080157fe0 msgr2=0x7f20800b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2080157fe0 0x7f20800b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 >> v2:172.21.15.83:3300/0 conn(0x7f20801583b0 msgr2=0x7f20800b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 --2- 172.21.15.81:0/2451383131 >> v2:172.21.15.83:3300/0 conn(0x7f20801583b0 0x7f20800b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20800b4630 con 0x7f20800ceb30 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f2078001470 con 0x7f20800ceb30 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 >> v1:172.21.15.81:6789/0 conn(0x7f20800ceb30 legacy=0x7f20800cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2080157fe0 0x7f206c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c003fe0 0x7f206c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206c004d50 0x7f206c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20800b4070 con 0x7f206c003fe0 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20800b4350 con 0x7f206c004d50 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c00bb40 con 0x7f2080157fe0 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2084922700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c003fe0 0x7f206c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2085924700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206c004d50 0x7f206c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2085123700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2080157fe0 0x7f206c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2084922700 1 -- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2080157fe0 msgr2=0x7f206c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2084922700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2080157fe0 0x7f206c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2084922700 1 -- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206c004d50 msgr2=0x7f206c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2084922700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206c004d50 0x7f206c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2084922700 1 -- 172.21.15.81:0/2451383131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c003570 con 0x7f206c003fe0 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2085123700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2080157fe0 0x7f206c003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.830+0000 7f2085924700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206c004d50 0x7f206c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2084922700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c003fe0 0x7f206c004810 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2070006f00 tx=0x7f20700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bfed2073d483af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207000e710 con 0x7f206c003fe0 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207000e870 con 0x7f206c003fe0 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2077fff700 1 -- 172.21.15.81:0/2451383131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207000ec30 con 0x7f206c003fe0 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2087387700 1 -- 172.21.15.81:0/2451383131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c003fe0 msgr2=0x7f206c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2087387700 1 --2- 172.21.15.81:0/2451383131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c003fe0 0x7f206c004810 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2070006f00 tx=0x7f20700091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2085924700 1 -- 172.21.15.81:0/2451383131 reap_dead start 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2087387700 1 -- 172.21.15.81:0/2451383131 shutdown_connections 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2087387700 1 -- 172.21.15.81:0/2451383131 >> 172.21.15.81:0/2451383131 conn(0x7f2080067640 msgr2=0x7f2080067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2087387700 1 -- 172.21.15.81:0/2451383131 shutdown_connections 2023-10-06T02:52:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.831+0000 7f2087387700 1 -- 172.21.15.81:0/2451383131 wait complete. 2023-10-06T02:52:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.832+0000 7f2087387700 1 Processor -- start 2023-10-06T02:52:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2087387700 1 -- start start 2023-10-06T02:52:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2087387700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f208013d690 0x7f2080159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2087387700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f208013da60 0x7f208015de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2087387700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f208015e360 0x7f208015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:01.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2087387700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208015b210 con 0x7f208013da60 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2087387700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208015e7b0 con 0x7f208013d690 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2087387700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208015a600 con 0x7f208015e360 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2084922700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f208013da60 0x7f208015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2084922700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f208013da60 0x7f208015de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46652/0 (socket says 172.21.15.81:46652) 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.833+0000 7f2084922700 1 -- 172.21.15.81:0/2648893356 learned_addr learned my addr 172.21.15.81:0/2648893356 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2085123700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f208013d690 0x7f2080159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2085924700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f208015e360 0x7f208015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2084922700 1 -- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f208015e360 msgr2=0x7f208015cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2084922700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f208015e360 0x7f208015cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2084922700 1 -- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f208013d690 msgr2=0x7f2080159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2084922700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f208013d690 0x7f2080159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2084922700 1 -- 172.21.15.81:0/2648893356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208015a8e0 con 0x7f208013da60 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2085123700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f208013d690 0x7f2080159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2084922700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f208013da60 0x7f208015de20 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2070016000 tx=0x7f207001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f20757fa700 1 -- 172.21.15.81:0/2648893356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070022070 con 0x7f208013da60 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f20757fa700 1 -- 172.21.15.81:0/2648893356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207000e9e0 con 0x7f208013da60 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f20757fa700 1 -- 172.21.15.81:0/2648893356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207001c450 con 0x7f208013da60 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208015abc0 con 0x7f208013da60 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.834+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208015a290 con 0x7f208013da60 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.835+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208015b3c0 con 0x7f208013da60 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.835+0000 7f20757fa700 1 -- 172.21.15.81:0/2648893356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f207001c860 con 0x7f208013da60 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.836+0000 7f20757fa700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2064066f30 0x7f20640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.836+0000 7f20757fa700 1 -- 172.21.15.81:0/2648893356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2070085e70 con 0x7f208013da60 2023-10-06T02:52:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.836+0000 7f2085123700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2064066f30 0x7f20640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:01.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.837+0000 7f2085123700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2064066f30 0x7f20640693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f207c0076a0 tx=0x7f207c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:01.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:01.840+0000 7f20757fa700 1 -- 172.21.15.81:0/2648893356 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f208015b3c0 con 0x7f208013da60 2023-10-06T02:52:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.066+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f208015b3c0 con 0x7f208013da60 2023-10-06T02:52:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.067+0000 7f20757fa700 1 -- 172.21.15.81:0/2648893356 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7f208015b3c0 con 0x7f208013da60 2023-10-06T02:52:02.068 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:52:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2064066f30 msgr2=0x7f20640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2064066f30 0x7f20640693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f207c0076a0 tx=0x7f207c00b040 comp rx=0 tx=0).stop 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f208013da60 msgr2=0x7f208015de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f208013da60 0x7f208015de20 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2070016000 tx=0x7f207001a000 comp rx=0 tx=0).stop 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 shutdown_connections 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f208015e360 0x7f208015cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2064066f30 0x7f20640693e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f208013d690 0x7f2080159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 --2- 172.21.15.81:0/2648893356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f208013da60 0x7f208015de20 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 >> 172.21.15.81:0/2648893356 conn(0x7f2080067640 msgr2=0x7f20800cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:02.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 shutdown_connections 2023-10-06T02:52:02.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.069+0000 7f2087387700 1 -- 172.21.15.81:0/2648893356 wait complete. 2023-10-06T02:52:02.082 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:52:02.082 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:52:02.082 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:52:02.082 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:52:02.082 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:52:02.082 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:52:02.083 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:52:02.083 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:52:02.083 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:52:02.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:02.083 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:52:02.101 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:02.102 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:02.103 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:52:02.103 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:02.103 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:02.103 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:52:02.103 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:02.103 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:52:02.103 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42194sec preferred_lft 42194sec 2023-10-06T02:52:02.103 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:52:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:02.104 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:52:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:52:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:52:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:02.104 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:52:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:52:02.105 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:52:02.105 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:02.105 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:52:02.105 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:52:02.105 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:52:02.105 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:02.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:02.105 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:52:02.169 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:52:02.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:02.171 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:52:02.228 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:52:02.292 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:52:02.292 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:52:02.292 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:52:02.292 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:52:02.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:02.293 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:52:02.293 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:52:02.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:52:02.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:52:02.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:52:02.293 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:52:02.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:02.359 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:52:02.374 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:52:02.374 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:52:02.374 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:52:02.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:02.375 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:52:02.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:52:02.439 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:52:02.494 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:52:02.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:52:02.494 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:52:02.548 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:52:02.549 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:52:02.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:02.628 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:02.628 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:02.647 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:02.647 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:02.647 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:52:02.647 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:52:02.647 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:52:02.647 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:52:02.648 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:52:02.648 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:52:02.669 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:02.669 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:02.669 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:52:02.669 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:52:02.669 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:52:02.669 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:52:02.670 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:52:02.670 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:52:02.670 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:52:02.670 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:52:02.670 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:52:02.671 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:52:02.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:02.671 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:52:02.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.850+0000 7f8c4849f700 1 Processor -- start 2023-10-06T02:52:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.850+0000 7f8c4849f700 1 -- start start 2023-10-06T02:52:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c4849f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8c401578d0 0x7f8c400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c4849f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c40157ca0 0x7f8c4015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c4849f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c4006d120 0x7f8c4006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c4849f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c400d07c0 con 0x7f8c40157ca0 2023-10-06T02:52:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c4849f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4006daa0 con 0x7f8c401578d0 2023-10-06T02:52:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c4849f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400cfbb0 con 0x7f8c4006d120 2023-10-06T02:52:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c45a3a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c40157ca0 0x7f8c4015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c45a3a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c40157ca0 0x7f8c4015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46666/0 (socket says 172.21.15.81:46666) 2023-10-06T02:52:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c45a3a700 1 -- 172.21.15.81:0/2600207263 learned_addr learned my addr 172.21.15.81:0/2600207263 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c46a3c700 1 --2- 172.21.15.81:0/2600207263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c4006d120 0x7f8c4006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.851+0000 7f8c4623b700 1 --2- 172.21.15.81:0/2600207263 >> v2:172.21.15.83:3300/0 conn(0x7f8c401578d0 0x7f8c400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c45a3a700 1 -- 172.21.15.81:0/2600207263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c4006d120 msgr2=0x7f8c4006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c45a3a700 1 --2- 172.21.15.81:0/2600207263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c4006d120 0x7f8c4006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c45a3a700 1 -- 172.21.15.81:0/2600207263 >> v2:172.21.15.83:3300/0 conn(0x7f8c401578d0 msgr2=0x7f8c400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c45a3a700 1 --2- 172.21.15.81:0/2600207263 >> v2:172.21.15.83:3300/0 conn(0x7f8c401578d0 0x7f8c400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c45a3a700 1 -- 172.21.15.81:0/2600207263 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c400cfe90 con 0x7f8c40157ca0 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c45a3a700 1 --2- 172.21.15.81:0/2600207263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 0x7f8c4015af00 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f8c400646b0 tx=0x7f8c30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5795017990d4fa0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c45239700 1 -- 172.21.15.81:0/2600207263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000b640 con 0x7f8c40157ca0 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c45239700 1 -- 172.21.15.81:0/2600207263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000b7a0 con 0x7f8c40157ca0 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c45239700 1 -- 172.21.15.81:0/2600207263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000bb60 con 0x7f8c40157ca0 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c4849f700 1 -- 172.21.15.81:0/2600207263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 msgr2=0x7f8c4015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2600207263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 0x7f8c4015af00 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f8c400646b0 tx=0x7f8c30009250 comp rx=0 tx=0).stop 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c4849f700 1 -- 172.21.15.81:0/2600207263 shutdown_connections 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2600207263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c4006d120 0x7f8c4006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2600207263 >> v2:172.21.15.83:3300/0 conn(0x7f8c401578d0 0x7f8c400cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2600207263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 0x7f8c4015af00 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c4849f700 1 -- 172.21.15.81:0/2600207263 >> 172.21.15.81:0/2600207263 conn(0x7f8c4006bb90 msgr2=0x7f8c4006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c4849f700 1 -- 172.21.15.81:0/2600207263 shutdown_connections 2023-10-06T02:52:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.852+0000 7f8c4849f700 1 -- 172.21.15.81:0/2600207263 wait complete. 2023-10-06T02:52:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.853+0000 7f8c4849f700 1 Processor -- start 2023-10-06T02:52:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c4849f700 1 -- start start 2023-10-06T02:52:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c4849f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c4006d120 0x7f8c4016abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c4849f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c401578d0 0x7f8c40147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c4849f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 0x7f8c400ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c4849f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4016b110 con 0x7f8c40157ca0 2023-10-06T02:52:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c4849f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4016bfd0 con 0x7f8c4006d120 2023-10-06T02:52:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c4849f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4016b3c0 con 0x7f8c401578d0 2023-10-06T02:52:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c46a3c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 0x7f8c400ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c46a3c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 0x7f8c400ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46674/0 (socket says 172.21.15.81:46674) 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c46a3c700 1 -- 172.21.15.81:0/2892935612 learned_addr learned my addr 172.21.15.81:0/2892935612 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c4623b700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c4006d120 0x7f8c4016abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.854+0000 7f8c45a3a700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c401578d0 0x7f8c40147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c46a3c700 1 -- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c401578d0 msgr2=0x7f8c40147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c46a3c700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c401578d0 0x7f8c40147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c46a3c700 1 -- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c4006d120 msgr2=0x7f8c4016abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c46a3c700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c4006d120 0x7f8c4016abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c46a3c700 1 -- 172.21.15.81:0/2892935612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c300094f0 con 0x7f8c40157ca0 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c4623b700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c4006d120 0x7f8c4016abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c46a3c700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 0x7f8c400ae230 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800ea50 tx=0x7f8c380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c367fc700 1 -- 172.21.15.81:0/2892935612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800ee90 con 0x7f8c40157ca0 2023-10-06T02:52:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c367fc700 1 -- 172.21.15.81:0/2892935612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800c850 con 0x7f8c40157ca0 2023-10-06T02:52:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c367fc700 1 -- 172.21.15.81:0/2892935612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800cc10 con 0x7f8c40157ca0 2023-10-06T02:52:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4016b6a0 con 0x7f8c40157ca0 2023-10-06T02:52:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.855+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4016bc60 con 0x7f8c40157ca0 2023-10-06T02:52:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.856+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c400ce810 con 0x7f8c40157ca0 2023-10-06T02:52:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.856+0000 7f8c367fc700 1 -- 172.21.15.81:0/2892935612 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c38013470 con 0x7f8c40157ca0 2023-10-06T02:52:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.857+0000 7f8c367fc700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8c24066f30 0x7f8c240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.857+0000 7f8c367fc700 1 -- 172.21.15.81:0/2892935612 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c380848e0 con 0x7f8c40157ca0 2023-10-06T02:52:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.857+0000 7f8c4623b700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8c24066f30 0x7f8c240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.857+0000 7f8c4623b700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8c24066f30 0x7f8c240693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00e950 tx=0x7f8c3c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:02.861+0000 7f8c367fc700 1 -- 172.21.15.81:0/2892935612 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c380519f0 con 0x7f8c40157ca0 2023-10-06T02:52:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.085+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c4016c110 con 0x7f8c40157ca0 2023-10-06T02:52:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.085+0000 7f8c367fc700 1 -- 172.21.15.81:0/2892935612 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f8c38055010 con 0x7f8c40157ca0 2023-10-06T02:52:03.086 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:03.087 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3448648390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3448648390},{"type":"v1","addr":"172.21.15.83:6836","nonce":3448648390}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/259812660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":259812660},{"type":"v1","addr":"172.21.15.83:6837","nonce":259812660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4011741221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4011741221},{"type":"v1","addr":"172.21.15.81:6834","nonce":4011741221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:53.060344+0000","modified":"2023-10-06T02:51:56.712953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/3211565547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3211565547},{"type":"v1","addr":"172.21.15.81:6835","nonce":3211565547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:52:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8c24066f30 msgr2=0x7f8c240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8c24066f30 0x7f8c240693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00e950 tx=0x7f8c3c00b040 comp rx=0 tx=0).stop 2023-10-06T02:52:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 msgr2=0x7f8c400ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 0x7f8c400ae230 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800ea50 tx=0x7f8c380091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 shutdown_connections 2023-10-06T02:52:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c40157ca0 0x7f8c400ae230 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8c24066f30 0x7f8c240693e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c4006d120 0x7f8c4016abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 --2- 172.21.15.81:0/2892935612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c401578d0 0x7f8c40147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 >> 172.21.15.81:0/2892935612 conn(0x7f8c4006bb90 msgr2=0x7f8c40070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:03.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 shutdown_connections 2023-10-06T02:52:03.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.087+0000 7f8c4849f700 1 -- 172.21.15.81:0/2892935612 wait complete. 2023-10-06T02:52:03.090 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2023-10-06T02:52:03.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:52:03.236 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":6885,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.520374747,"mdsmap_epoch":59,"osdmap_epoch":120,"osdmap_epoch_barrier":120,"uptime":15.655882544000001} 2023-10-06T02:52:03.236 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 6885, "mdsmap_epoch": 59, "osdmap_epoch": 120, "osdmap_epoch_barrier": 120, "rank_uptime": 9.520374747, "state": "up:active", "uptime": 15.655882544, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:52:03.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-06T02:52:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.353+0000 7f1ca82cd700 1 Processor -- start 2023-10-06T02:52:03.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.353+0000 7f1ca82cd700 1 -- start start 2023-10-06T02:52:03.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca82cd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ca01578d0 0x7f1ca00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:03.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca82cd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca0157ca0 0x7f1ca015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:03.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca82cd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ca006d120 0x7f1ca006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:03.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca82cd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca006dac0 con 0x7f1ca01578d0 2023-10-06T02:52:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca82cd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca00d07c0 con 0x7f1ca006d120 2023-10-06T02:52:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca82cd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00cfbb0 con 0x7f1ca0157ca0 2023-10-06T02:52:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca6069700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ca01578d0 0x7f1ca00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:03.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca6069700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ca01578d0 0x7f1ca00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46688/0 (socket says 172.21.15.81:46688) 2023-10-06T02:52:03.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca6069700 1 -- 172.21.15.81:0/1072200275 learned_addr learned my addr 172.21.15.81:0/1072200275 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:03.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca686a700 1 --2- 172.21.15.81:0/1072200275 >> v2:172.21.15.83:3300/0 conn(0x7f1ca006d120 0x7f1ca006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:03.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca5868700 1 --2- 172.21.15.81:0/1072200275 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca0157ca0 0x7f1ca015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca6069700 1 -- 172.21.15.81:0/1072200275 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca0157ca0 msgr2=0x7f1ca015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca6069700 1 --2- 172.21.15.81:0/1072200275 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca0157ca0 0x7f1ca015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca6069700 1 -- 172.21.15.81:0/1072200275 >> v2:172.21.15.83:3300/0 conn(0x7f1ca006d120 msgr2=0x7f1ca006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca6069700 1 --2- 172.21.15.81:0/1072200275 >> v2:172.21.15.83:3300/0 conn(0x7f1ca006d120 0x7f1ca006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.354+0000 7f1ca6069700 1 -- 172.21.15.81:0/1072200275 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca00cfe90 con 0x7f1ca01578d0 2023-10-06T02:52:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca686a700 1 --2- 172.21.15.81:0/1072200275 >> v2:172.21.15.83:3300/0 conn(0x7f1ca006d120 0x7f1ca006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca6069700 1 --2- 172.21.15.81:0/1072200275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca01578d0 0x7f1ca00cf4f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00b3940 tx=0x7f1c9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce90fffde916ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca5067700 1 -- 172.21.15.81:0/1072200275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00e070 con 0x7f1ca01578d0 2023-10-06T02:52:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca5067700 1 -- 172.21.15.81:0/1072200275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c00ba50 con 0x7f1ca01578d0 2023-10-06T02:52:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca5067700 1 -- 172.21.15.81:0/1072200275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0092e0 con 0x7f1ca01578d0 2023-10-06T02:52:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca82cd700 1 -- 172.21.15.81:0/1072200275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca01578d0 msgr2=0x7f1ca00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/1072200275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca01578d0 0x7f1ca00cf4f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00b3940 tx=0x7f1c9c009840 comp rx=0 tx=0).stop 2023-10-06T02:52:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca82cd700 1 -- 172.21.15.81:0/1072200275 shutdown_connections 2023-10-06T02:52:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/1072200275 >> v2:172.21.15.83:3300/0 conn(0x7f1ca006d120 0x7f1ca006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/1072200275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca01578d0 0x7f1ca00cf4f0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/1072200275 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca0157ca0 0x7f1ca015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca82cd700 1 -- 172.21.15.81:0/1072200275 >> 172.21.15.81:0/1072200275 conn(0x7f1ca006bb90 msgr2=0x7f1ca006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca82cd700 1 -- 172.21.15.81:0/1072200275 shutdown_connections 2023-10-06T02:52:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.355+0000 7f1ca82cd700 1 -- 172.21.15.81:0/1072200275 wait complete. 2023-10-06T02:52:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.356+0000 7f1ca82cd700 1 Processor -- start 2023-10-06T02:52:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca82cd700 1 -- start start 2023-10-06T02:52:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca82cd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ca006d120 0x7f1ca00c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca82cd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca01578d0 0x7f1ca00c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca82cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0157ca0 0x7f1ca00c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca82cd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00694a0 con 0x7f1ca0157ca0 2023-10-06T02:52:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca82cd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0154590 con 0x7f1ca006d120 2023-10-06T02:52:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca82cd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00c9000 con 0x7f1ca01578d0 2023-10-06T02:52:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca686a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0157ca0 0x7f1ca00c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca686a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0157ca0 0x7f1ca00c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46692/0 (socket says 172.21.15.81:46692) 2023-10-06T02:52:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca686a700 1 -- 172.21.15.81:0/2390426691 learned_addr learned my addr 172.21.15.81:0/2390426691 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca5868700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca01578d0 0x7f1ca00c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.357+0000 7f1ca6069700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ca006d120 0x7f1ca00c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1ca686a700 1 -- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca01578d0 msgr2=0x7f1ca00c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1ca686a700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca01578d0 0x7f1ca00c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1ca686a700 1 -- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ca006d120 msgr2=0x7f1ca00c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1ca686a700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ca006d120 0x7f1ca00c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1ca686a700 1 -- 172.21.15.81:0/2390426691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c009ae0 con 0x7f1ca0157ca0 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1ca686a700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0157ca0 0x7f1ca00c8960 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800e870 tx=0x7f1c98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1c967fc700 1 -- 172.21.15.81:0/2390426691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98013410 con 0x7f1ca0157ca0 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1c967fc700 1 -- 172.21.15.81:0/2390426691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c98013570 con 0x7f1ca0157ca0 2023-10-06T02:52:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca00c92e0 con 0x7f1ca0157ca0 2023-10-06T02:52:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1c967fc700 1 -- 172.21.15.81:0/2390426691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c980138f0 con 0x7f1ca0157ca0 2023-10-06T02:52:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.358+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca00c98a0 con 0x7f1ca0157ca0 2023-10-06T02:52:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.359+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca0067ac0 con 0x7f1ca0157ca0 2023-10-06T02:52:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.359+0000 7f1c967fc700 1 -- 172.21.15.81:0/2390426691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c98013ca0 con 0x7f1ca0157ca0 2023-10-06T02:52:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.360+0000 7f1c967fc700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1c84066f30 0x7f1c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.360+0000 7f1c967fc700 1 -- 172.21.15.81:0/2390426691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1c98084350 con 0x7f1ca0157ca0 2023-10-06T02:52:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.360+0000 7f1ca6069700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1c84066f30 0x7f1c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.360+0000 7f1ca6069700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1c84066f30 0x7f1c840693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009880 tx=0x7f1c9c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.364+0000 7f1c967fc700 1 -- 172.21.15.81:0/2390426691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c98054ef0 con 0x7f1ca0157ca0 2023-10-06T02:52:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:03.547+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f1ca00d0170 con 0x7f1ca0157ca0 2023-10-06T02:52:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.436+0000 7f1c967fc700 1 -- 172.21.15.81:0/2390426691 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v121) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1c98054a80 con 0x7f1ca0157ca0 2023-10-06T02:52:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1c84066f30 msgr2=0x7f1c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1c84066f30 0x7f1c840693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009880 tx=0x7f1c9c018000 comp rx=0 tx=0).stop 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0157ca0 msgr2=0x7f1ca00c8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0157ca0 0x7f1ca00c8960 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800e870 tx=0x7f1c98008040 comp rx=0 tx=0).stop 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 shutdown_connections 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0157ca0 0x7f1ca00c8960 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1c84066f30 0x7f1c840693e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ca006d120 0x7f1ca00c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 --2- 172.21.15.81:0/2390426691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ca01578d0 0x7f1ca00c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 >> 172.21.15.81:0/2390426691 conn(0x7f1ca006bb90 msgr2=0x7f1ca0070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 shutdown_connections 2023-10-06T02:52:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:04.438+0000 7f1ca82cd700 1 -- 172.21.15.81:0/2390426691 wait complete. 2023-10-06T02:52:04.574 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-06T02:52:04.574 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:52:04.574 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:52:04.574 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-06T02:52:04.574 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-06T02:52:04.574 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-06T02:52:04.574 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-06T02:52:04.574 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:52:04.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:05.036 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-06T02:52:05.067 INFO:teuthology.orchestra.run.smithi081.stdout:client5909 2023-10-06T02:52:05.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:05.194 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/072ce422-278f-434c-8814-5b3ff2abcdfb.client5909/osdmap') 2023-10-06T02:52:05.231 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 120 barrier 120 flags 0x588000 2023-10-06T02:52:05.238 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:05.238 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:05.238 INFO:teuthology.orchestra.run.smithi081.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:05.238 INFO:teuthology.orchestra.run.smithi081.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:05.238 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-06T02:52:05.239 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-06T02:52:05.239 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-06T02:52:05.239 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6804 100% (exists, up) 100% -1 2023-10-06T02:52:05.239 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.83:6801 100% (exists, up) 100% -1 2023-10-06T02:52:05.239 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.83:6809 100% (exists, up) 100% -1 2023-10-06T02:52:05.239 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.83:6825 100% (exists, up) 100% -1 2023-10-06T02:52:05.239 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.83:6817 100% (exists, up) 100% -1 2023-10-06T02:52:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-06T02:52:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-06T02:52:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:900 bytes copied, 3.5603e-05 s, 25.3 MB/s 2023-10-06T02:52:05.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-06T02:52:05.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.394+0000 7f4cc9a23700 1 Processor -- start 2023-10-06T02:52:05.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.394+0000 7f4cc9a23700 1 -- start start 2023-10-06T02:52:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc9a23700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4cc4156420 0x7f4cc40cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc9a23700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4cc40c71d0 0x7f4cc40c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc9a23700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc40c7b70 con 0x7f4cc40cc250 2023-10-06T02:52:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc9a23700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc406aa10 con 0x7f4cc4156420 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc9a23700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc40cb880 con 0x7f4cc40c71d0 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc2ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4cc4156420 0x7f4cc40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4cc40cc250 0x7f4cc4069440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47272/0 (socket says 172.21.15.81:47272) 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc27fc700 1 -- 172.21.15.81:0/727457425 learned_addr learned my addr 172.21.15.81:0/727457425 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc2ffd700 1 -- 172.21.15.81:0/727457425 >> v2:172.21.15.83:3300/0 conn(0x7f4cc40c71d0 msgr2=0x7f4cc40c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc2ffd700 1 --2- 172.21.15.81:0/727457425 >> v2:172.21.15.83:3300/0 conn(0x7f4cc40c71d0 0x7f4cc40c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc2ffd700 1 -- 172.21.15.81:0/727457425 >> v1:172.21.15.81:6789/0 conn(0x7f4cc40cc250 legacy=0x7f4cc4069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc2ffd700 1 -- 172.21.15.81:0/727457425 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc40cac70 con 0x7f4cc4156420 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc1ffb700 1 -- 172.21.15.81:0/727457425 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697901343 0 0) 0x7f4cb8001110 con 0x7f4cc40cc250 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc2ffd700 1 --2- 172.21.15.81:0/727457425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 0x7f4cc40cbd10 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40c3680 tx=0x7f4cb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd146f6ddcf0f30f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc1ffb700 1 -- 172.21.15.81:0/727457425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400b6b0 con 0x7f4cc4156420 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc1ffb700 1 -- 172.21.15.81:0/727457425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb400b810 con 0x7f4cc4156420 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.395+0000 7f4cc1ffb700 1 -- 172.21.15.81:0/727457425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400bbb0 con 0x7f4cc4156420 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.396+0000 7f4cc9a23700 1 -- 172.21.15.81:0/727457425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 msgr2=0x7f4cc40cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.396+0000 7f4cc9a23700 1 --2- 172.21.15.81:0/727457425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 0x7f4cc40cbd10 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40c3680 tx=0x7f4cb40091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.396+0000 7f4cc9a23700 1 -- 172.21.15.81:0/727457425 shutdown_connections 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.396+0000 7f4cc9a23700 1 --2- 172.21.15.81:0/727457425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 0x7f4cc40cbd10 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.396+0000 7f4cc9a23700 1 --2- 172.21.15.81:0/727457425 >> v2:172.21.15.83:3300/0 conn(0x7f4cc40c71d0 0x7f4cc40c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.396+0000 7f4cc9a23700 1 -- 172.21.15.81:0/727457425 >> 172.21.15.81:0/727457425 conn(0x7f4cc406c660 msgr2=0x7f4cc40cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.396+0000 7f4cc9a23700 1 -- 172.21.15.81:0/727457425 shutdown_connections 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.396+0000 7f4cc9a23700 1 -- 172.21.15.81:0/727457425 wait complete. 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.397+0000 7f4cc9a23700 1 Processor -- start 2023-10-06T02:52:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.397+0000 7f4cc9a23700 1 -- start start 2023-10-06T02:52:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc9a23700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cc40c71d0 0x7f4cc40aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc9a23700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cc40cc250 0x7f4cc4150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc9a23700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 0x7f4cc4157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc9a23700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4157a10 con 0x7f4cc4156420 2023-10-06T02:52:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc9a23700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4156e00 con 0x7f4cc40c71d0 2023-10-06T02:52:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc9a23700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc41570e0 con 0x7f4cc40cc250 2023-10-06T02:52:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 0x7f4cc4157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 0x7f4cc4157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46706/0 (socket says 172.21.15.81:46706) 2023-10-06T02:52:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc37fe700 1 -- 172.21.15.81:0/2624799703 learned_addr learned my addr 172.21.15.81:0/2624799703 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc2ffd700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cc40c71d0 0x7f4cc40aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc27fc700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cc40cc250 0x7f4cc4150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc37fe700 1 -- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cc40cc250 msgr2=0x7f4cc4150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc37fe700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cc40cc250 0x7f4cc4150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc37fe700 1 -- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cc40c71d0 msgr2=0x7f4cc40aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc37fe700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cc40c71d0 0x7f4cc40aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc37fe700 1 -- 172.21.15.81:0/2624799703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb4009420 con 0x7f4cc4156420 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc2ffd700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cc40c71d0 0x7f4cc40aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4cc37fe700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 0x7f4cc4157ea0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009f90 tx=0x7f4cbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4caaffd700 1 -- 172.21.15.81:0/2624799703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0090d0 con 0x7f4cc4156420 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.398+0000 7f4caaffd700 1 -- 172.21.15.81:0/2624799703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cbc017070 con 0x7f4cc4156420 2023-10-06T02:52:05.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.399+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc41573c0 con 0x7f4cc4156420 2023-10-06T02:52:05.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.399+0000 7f4caaffd700 1 -- 172.21.15.81:0/2624799703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc01c430 con 0x7f4cc4156420 2023-10-06T02:52:05.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.399+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc40af350 con 0x7f4cc4156420 2023-10-06T02:52:05.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.399+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc4067bc0 con 0x7f4cc4156420 2023-10-06T02:52:05.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.400+0000 7f4caaffd700 1 -- 172.21.15.81:0/2624799703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cbc019030 con 0x7f4cc4156420 2023-10-06T02:52:05.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.400+0000 7f4caaffd700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4cb0066f30 0x7f4cb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:05.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.400+0000 7f4caaffd700 1 -- 172.21.15.81:0/2624799703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4cbc08cd60 con 0x7f4cc4156420 2023-10-06T02:52:05.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.400+0000 7f4cc2ffd700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4cb0066f30 0x7f4cb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:05.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.401+0000 7f4cc2ffd700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4cb0066f30 0x7f4cb00693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40093f0 tx=0x7f4cb4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:05.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.404+0000 7f4caaffd700 1 -- 172.21.15.81:0/2624799703 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cbc059e70 con 0x7f4cc4156420 2023-10-06T02:52:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:05.596+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f4cc40caf50 con 0x7f4cc4156420 2023-10-06T02:52:06.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.442+0000 7f4caaffd700 1 -- 172.21.15.81:0/2624799703 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v122) v1 ==== 93+0+0 (secure 0 0 0) 0x7f4cbc05d490 con 0x7f4cc4156420 2023-10-06T02:52:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4cb0066f30 msgr2=0x7f4cb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4cb0066f30 0x7f4cb00693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40093f0 tx=0x7f4cb4017000 comp rx=0 tx=0).stop 2023-10-06T02:52:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 msgr2=0x7f4cc4157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 0x7f4cc4157ea0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009f90 tx=0x7f4cbc009840 comp rx=0 tx=0).stop 2023-10-06T02:52:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 shutdown_connections 2023-10-06T02:52:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4156420 0x7f4cc4157ea0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4cb0066f30 0x7f4cb00693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cc40c71d0 0x7f4cc40aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 --2- 172.21.15.81:0/2624799703 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cc40cc250 0x7f4cc4150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 >> 172.21.15.81:0/2624799703 conn(0x7f4cc406c660 msgr2=0x7f4cc40afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 shutdown_connections 2023-10-06T02:52:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.445+0000 7f4cc9a23700 1 -- 172.21.15.81:0/2624799703 wait complete. 2023-10-06T02:52:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:pauserd,pausewr is set 2023-10-06T02:52:06.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-06T02:52:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.577+0000 7f1965ec2700 1 Processor -- start 2023-10-06T02:52:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.577+0000 7f1965ec2700 1 -- start start 2023-10-06T02:52:06.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f1965ec2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1960159f10 0x7f1960068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:06.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f1965ec2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1960068cc0 0x7f19600cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:06.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f1965ec2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1960069120 con 0x7f1960159b40 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f1965ec2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19600cee10 con 0x7f1960068cc0 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f1965ec2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19600cd040 con 0x7f1960159f10 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f19656c1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1960068cc0 0x7f19600cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f1964ec0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1960159b40 0x7f19600cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47282/0 (socket says 172.21.15.81:47282) 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f1964ec0700 1 -- 172.21.15.81:0/3854612592 learned_addr learned my addr 172.21.15.81:0/3854612592 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f195ffff700 1 --2- 172.21.15.81:0/3854612592 >> v2:172.21.15.83:3300/0 conn(0x7f1960159f10 0x7f1960068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f19656c1700 1 -- 172.21.15.81:0/3854612592 >> v2:172.21.15.83:3300/0 conn(0x7f1960159f10 msgr2=0x7f1960068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f19656c1700 1 --2- 172.21.15.81:0/3854612592 >> v2:172.21.15.83:3300/0 conn(0x7f1960159f10 0x7f1960068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f19656c1700 1 -- 172.21.15.81:0/3854612592 >> v1:172.21.15.81:6789/0 conn(0x7f1960159b40 legacy=0x7f19600cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f19656c1700 1 -- 172.21.15.81:0/3854612592 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19600cd320 con 0x7f1960068cc0 2023-10-06T02:52:06.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f195f7fe700 1 -- 172.21.15.81:0/3854612592 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232989873 0 0) 0x7f1958001490 con 0x7f1960159b40 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f19656c1700 1 --2- 172.21.15.81:0/3854612592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 0x7f19600cf2a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f196006fd80 tx=0x7f19480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b0dd4e46628fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.578+0000 7f195f7fe700 1 -- 172.21.15.81:0/3854612592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948011630 con 0x7f1960068cc0 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f195f7fe700 1 -- 172.21.15.81:0/3854612592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948011790 con 0x7f1960068cc0 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f195f7fe700 1 -- 172.21.15.81:0/3854612592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948011b30 con 0x7f1960068cc0 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f1965ec2700 1 -- 172.21.15.81:0/3854612592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 msgr2=0x7f19600cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f1965ec2700 1 --2- 172.21.15.81:0/3854612592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 0x7f19600cf2a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f196006fd80 tx=0x7f19480091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f1965ec2700 1 -- 172.21.15.81:0/3854612592 shutdown_connections 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f1965ec2700 1 --2- 172.21.15.81:0/3854612592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 0x7f19600cf2a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f1965ec2700 1 --2- 172.21.15.81:0/3854612592 >> v2:172.21.15.83:3300/0 conn(0x7f1960159f10 0x7f1960068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f1965ec2700 1 -- 172.21.15.81:0/3854612592 >> 172.21.15.81:0/3854612592 conn(0x7f19600cd660 msgr2=0x7f19600cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f1965ec2700 1 -- 172.21.15.81:0/3854612592 shutdown_connections 2023-10-06T02:52:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.579+0000 7f1965ec2700 1 -- 172.21.15.81:0/3854612592 wait complete. 2023-10-06T02:52:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.580+0000 7f1965ec2700 1 Processor -- start 2023-10-06T02:52:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.580+0000 7f1965ec2700 1 -- start start 2023-10-06T02:52:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1965ec2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 0x7f19600b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1965ec2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1960159b40 0x7f1960153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1965ec2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1960159f10 0x7f196015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1965ec2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1960157860 con 0x7f1960068cc0 2023-10-06T02:52:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1965ec2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1960157b40 con 0x7f1960159b40 2023-10-06T02:52:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1965ec2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1960157e20 con 0x7f1960159f10 2023-10-06T02:52:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1964ec0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 0x7f19600b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1964ec0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 0x7f19600b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46724/0 (socket says 172.21.15.81:46724) 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1964ec0700 1 -- 172.21.15.81:0/3157551681 learned_addr learned my addr 172.21.15.81:0/3157551681 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f195ffff700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1960159b40 0x7f1960153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f19656c1700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1960159f10 0x7f196015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1964ec0700 1 -- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1960159f10 msgr2=0x7f196015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1964ec0700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1960159f10 0x7f196015a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1964ec0700 1 -- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1960159b40 msgr2=0x7f1960153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1964ec0700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1960159b40 0x7f1960153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f1964ec0700 1 -- 172.21.15.81:0/3157551681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948009420 con 0x7f1960068cc0 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.581+0000 7f195ffff700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1960159b40 0x7f1960153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.582+0000 7f1964ec0700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 0x7f19600b6430 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f195800cd80 tx=0x7f1958001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.582+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800ab70 con 0x7f1960068cc0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.582+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195800acd0 con 0x7f1960068cc0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.582+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1960158100 con 0x7f1960068cc0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.582+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958007300 con 0x7f1960068cc0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.582+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19601574f0 con 0x7f1960068cc0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.583+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1960063e90 con 0x7f1960068cc0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.583+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19580076f0 con 0x7f1960068cc0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.583+0000 7f195cff9700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1940066f30 0x7f19400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.583+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1958084a10 con 0x7f1960068cc0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.584+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=123+}) v3 -- 0x7f194006f0f0 con 0x7f1960068cc0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.584+0000 7f195ffff700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1940066f30 0x7f19400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.584+0000 7f195ffff700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1940066f30 0x7f19400693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1960159320 tx=0x7f1950008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.588+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1958051ba0 con 0x7f1960068cc0 2023-10-06T02:52:06.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:06.780+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f1960069120 con 0x7f1960068cc0 2023-10-06T02:52:07.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:52:07.100 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:52:07.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.443+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(123..123 src has 1..123) v4 ==== 280+0+0 (secure 0 0 0) 0x7f195800ae40 con 0x7f1960068cc0 2023-10-06T02:52:07.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.443+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=124}) v3 -- 0x7f194006fa40 con 0x7f1960068cc0 2023-10-06T02:52:07.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.445+0000 7f195cff9700 1 -- 172.21.15.81:0/3157551681 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v123) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1960069120 con 0x7f1960068cc0 2023-10-06T02:52:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1940066f30 msgr2=0x7f19400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1940066f30 0x7f19400693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1960159320 tx=0x7f1950008040 comp rx=0 tx=0).stop 2023-10-06T02:52:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 msgr2=0x7f19600b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 0x7f19600b6430 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f195800cd80 tx=0x7f1958001ad0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 shutdown_connections 2023-10-06T02:52:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1960159f10 0x7f196015a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1960068cc0 0x7f19600b6430 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1940066f30 0x7f19400693e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 --2- 172.21.15.81:0/3157551681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1960159b40 0x7f1960153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 >> 172.21.15.81:0/3157551681 conn(0x7f19600cd660 msgr2=0x7f196006db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 shutdown_connections 2023-10-06T02:52:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.447+0000 7f1965ec2700 1 -- 172.21.15.81:0/3157551681 wait complete. 2023-10-06T02:52:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:pauserd,pausewr is unset 2023-10-06T02:52:07.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:52:07.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.574+0000 7f79bd233700 1 Processor -- start 2023-10-06T02:52:07.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.574+0000 7f79bd233700 1 -- start start 2023-10-06T02:52:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79bd233700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79b81578d0 0x7f79b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79bd233700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f79b8157ca0 0x7f79b815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79bd233700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b806d120 0x7f79b806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79bd233700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80d07c0 con 0x7f79b81578d0 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79bd233700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b806daa0 con 0x7f79b8157ca0 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79bd233700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80cfbb0 con 0x7f79b806d120 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79b81578d0 0x7f79b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79b81578d0 0x7f79b80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46734/0 (socket says 172.21.15.81:46734) 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b6d9d700 1 -- 172.21.15.81:0/4233928619 learned_addr learned my addr 172.21.15.81:0/4233928619 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b759e700 1 --2- 172.21.15.81:0/4233928619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b806d120 0x7f79b806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79ae59c700 1 --2- 172.21.15.81:0/4233928619 >> v2:172.21.15.83:3300/0 conn(0x7f79b8157ca0 0x7f79b815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b6d9d700 1 -- 172.21.15.81:0/4233928619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b806d120 msgr2=0x7f79b806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b6d9d700 1 --2- 172.21.15.81:0/4233928619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b806d120 0x7f79b806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b6d9d700 1 -- 172.21.15.81:0/4233928619 >> v2:172.21.15.83:3300/0 conn(0x7f79b8157ca0 msgr2=0x7f79b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b6d9d700 1 --2- 172.21.15.81:0/4233928619 >> v2:172.21.15.83:3300/0 conn(0x7f79b8157ca0 0x7f79b815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b6d9d700 1 -- 172.21.15.81:0/4233928619 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b80cfe90 con 0x7f79b81578d0 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.575+0000 7f79b6d9d700 1 --2- 172.21.15.81:0/4233928619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b81578d0 0x7f79b80cf4f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f79b8068510 tx=0x7f79a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a9aa0663104260 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79b659c700 1 -- 172.21.15.81:0/4233928619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800b860 con 0x7f79b81578d0 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79b659c700 1 -- 172.21.15.81:0/4233928619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800b9c0 con 0x7f79b81578d0 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79b659c700 1 -- 172.21.15.81:0/4233928619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800bd60 con 0x7f79b81578d0 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79bd233700 1 -- 172.21.15.81:0/4233928619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b81578d0 msgr2=0x7f79b80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79bd233700 1 --2- 172.21.15.81:0/4233928619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b81578d0 0x7f79b80cf4f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f79b8068510 tx=0x7f79a8009250 comp rx=0 tx=0).stop 2023-10-06T02:52:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79bd233700 1 -- 172.21.15.81:0/4233928619 shutdown_connections 2023-10-06T02:52:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79bd233700 1 --2- 172.21.15.81:0/4233928619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b806d120 0x7f79b806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79bd233700 1 --2- 172.21.15.81:0/4233928619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b81578d0 0x7f79b80cf4f0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79bd233700 1 --2- 172.21.15.81:0/4233928619 >> v2:172.21.15.83:3300/0 conn(0x7f79b8157ca0 0x7f79b815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79bd233700 1 -- 172.21.15.81:0/4233928619 >> 172.21.15.81:0/4233928619 conn(0x7f79b806bb90 msgr2=0x7f79b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79bd233700 1 -- 172.21.15.81:0/4233928619 shutdown_connections 2023-10-06T02:52:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.576+0000 7f79bd233700 1 -- 172.21.15.81:0/4233928619 wait complete. 2023-10-06T02:52:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.577+0000 7f79bd233700 1 Processor -- start 2023-10-06T02:52:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79bd233700 1 -- start start 2023-10-06T02:52:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79bd233700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b806d120 0x7f79b816b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79bd233700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b81578d0 0x7f79b813fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79bd233700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b8157ca0 0x7f79b8140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79bd233700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b816b720 con 0x7f79b8157ca0 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79bd233700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b816e300 con 0x7f79b806d120 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79bd233700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b816e5e0 con 0x7f79b81578d0 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79b759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b8157ca0 0x7f79b8140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79b759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b8157ca0 0x7f79b8140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46750/0 (socket says 172.21.15.81:46750) 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79b759e700 1 -- 172.21.15.81:0/93310570 learned_addr learned my addr 172.21.15.81:0/93310570 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79ae59c700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b81578d0 0x7f79b813fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.578+0000 7f79b6d9d700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b806d120 0x7f79b816b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79b759e700 1 -- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b81578d0 msgr2=0x7f79b813fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79b759e700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b81578d0 0x7f79b813fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79b759e700 1 -- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b806d120 msgr2=0x7f79b816b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79b759e700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b806d120 0x7f79b816b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79b759e700 1 -- 172.21.15.81:0/93310570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80094f0 con 0x7f79b8157ca0 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79b759e700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b8157ca0 0x7f79b8140400 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009fa0 tx=0x7f79b0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79af7fe700 1 -- 172.21.15.81:0/93310570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000ebc0 con 0x7f79b8157ca0 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79af7fe700 1 -- 172.21.15.81:0/93310570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b000ed20 con 0x7f79b8157ca0 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b816e8c0 con 0x7f79b8157ca0 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79af7fe700 1 -- 172.21.15.81:0/93310570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0014670 con 0x7f79b8157ca0 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.579+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b816b910 con 0x7f79b8157ca0 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.580+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b8067ac0 con 0x7f79b8157ca0 2023-10-06T02:52:07.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.580+0000 7f79af7fe700 1 -- 172.21.15.81:0/93310570 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79b00149e0 con 0x7f79b8157ca0 2023-10-06T02:52:07.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.581+0000 7f79af7fe700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7998066f30 0x7f79980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:07.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.581+0000 7f79af7fe700 1 -- 172.21.15.81:0/93310570 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f79b0084bc0 con 0x7f79b8157ca0 2023-10-06T02:52:07.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.581+0000 7f79b6d9d700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7998066f30 0x7f79980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:07.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.581+0000 7f79b6d9d700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7998066f30 0x7f79980693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f79b8068510 tx=0x7f79a8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:07.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.585+0000 7f79af7fe700 1 -- 172.21.15.81:0/93310570 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79b0051cd0 con 0x7f79b8157ca0 2023-10-06T02:52:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.766+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79b80d0170 con 0x7f79b8157ca0 2023-10-06T02:52:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.767+0000 7f79af7fe700 1 -- 172.21.15.81:0/93310570 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16841 (secure 0 0 0) 0x7f79b00552f0 con 0x7f79b8157ca0 2023-10-06T02:52:07.769 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:07.769 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":123,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:07.441658+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:51:50.714217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T02:51:52.027875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:52:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7998066f30 msgr2=0x7f79980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7998066f30 0x7f79980693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f79b8068510 tx=0x7f79a8017000 comp rx=0 tx=0).stop 2023-10-06T02:52:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b8157ca0 msgr2=0x7f79b8140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b8157ca0 0x7f79b8140400 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009fa0 tx=0x7f79b0009900 comp rx=0 tx=0).stop 2023-10-06T02:52:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 shutdown_connections 2023-10-06T02:52:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b8157ca0 0x7f79b8140400 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7998066f30 0x7f79980693e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b806d120 0x7f79b816b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 --2- 172.21.15.81:0/93310570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79b81578d0 0x7f79b813fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 >> 172.21.15.81:0/93310570 conn(0x7f79b806bb90 msgr2=0x7f79b806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 shutdown_connections 2023-10-06T02:52:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:07.769+0000 7f79bd233700 1 -- 172.21.15.81:0/93310570 wait complete. 2023-10-06T02:52:07.783 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:52:07.783 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:52:07.783 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-06T02:52:07.783 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-06T02:52:07.783 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-06T02:52:07.783 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-06T02:52:07.783 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:52:08.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:08.037 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-06T02:52:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:client5909 2023-10-06T02:52:08.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:08.106 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/072ce422-278f-434c-8814-5b3ff2abcdfb.client5909/osdmap') 2023-10-06T02:52:08.182 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 120 barrier 120 flags 0x588000 2023-10-06T02:52:08.182 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:08.182 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:08.182 INFO:teuthology.orchestra.run.smithi081.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:08.182 INFO:teuthology.orchestra.run.smithi081.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:08.183 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-06T02:52:08.183 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-06T02:52:08.183 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-06T02:52:08.183 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6804 100% (exists, up) 100% -1 2023-10-06T02:52:08.183 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.83:6801 100% (exists, up) 100% -1 2023-10-06T02:52:08.183 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.83:6809 100% (exists, up) 100% -1 2023-10-06T02:52:08.183 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.83:6825 100% (exists, up) 100% -1 2023-10-06T02:52:08.184 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.83:6817 100% (exists, up) 100% -1 2023-10-06T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-06T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-06T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:900 bytes copied, 3.6964e-05 s, 24.3 MB/s 2023-10-06T02:52:08.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.338+0000 7fd06b175700 1 Processor -- start 2023-10-06T02:52:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.338+0000 7fd06b175700 1 -- start start 2023-10-06T02:52:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd06b175700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd064157ca0 0x7fd0640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd06b175700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd06406d120 0x7fd06406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd06b175700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06406dac0 con 0x7fd0641578d0 2023-10-06T02:52:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd06b175700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0640d07c0 con 0x7fd06406d120 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd06b175700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640cfbb0 con 0x7fd064157ca0 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd05bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd064157ca0 0x7fd0640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd069712700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd06406d120 0x7fd06406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd068f11700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd0641578d0 0x7fd06415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:39200/0 (socket says 172.21.15.81:39200) 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd05bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd064157ca0 0x7fd0640cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:55078/0 (socket says 172.21.15.81:55078) 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.339+0000 7fd068f11700 1 -- 172.21.15.81:0/1166996216 learned_addr learned my addr 172.21.15.81:0/1166996216 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.340+0000 7fd05bfff700 1 -- 172.21.15.81:0/1166996216 >> v2:172.21.15.83:3300/0 conn(0x7fd06406d120 msgr2=0x7fd06406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.340+0000 7fd05bfff700 1 --2- 172.21.15.81:0/1166996216 >> v2:172.21.15.83:3300/0 conn(0x7fd06406d120 0x7fd06406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.340+0000 7fd05bfff700 1 -- 172.21.15.81:0/1166996216 >> v1:172.21.15.83:6789/0 conn(0x7fd0641578d0 legacy=0x7fd06415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.340+0000 7fd05bfff700 1 -- 172.21.15.81:0/1166996216 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640cfe90 con 0x7fd064157ca0 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.340+0000 7fd069712700 1 --2- 172.21.15.81:0/1166996216 >> v2:172.21.15.83:3300/0 conn(0x7fd06406d120 0x7fd06406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.340+0000 7fd05bfff700 1 --2- 172.21.15.81:0/1166996216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd064157ca0 0x7fd0640cf4f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0540098e0 tx=0x7fd0540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30fb1edea9637d5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:08.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.340+0000 7fd05b7fe700 1 -- 172.21.15.81:0/1166996216 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400b640 con 0x7fd064157ca0 2023-10-06T02:52:08.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.340+0000 7fd05b7fe700 1 -- 172.21.15.81:0/1166996216 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05400b7a0 con 0x7fd064157ca0 2023-10-06T02:52:08.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.340+0000 7fd05b7fe700 1 -- 172.21.15.81:0/1166996216 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400bb40 con 0x7fd064157ca0 2023-10-06T02:52:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.341+0000 7fd06b175700 1 -- 172.21.15.81:0/1166996216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd064157ca0 msgr2=0x7fd0640cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.341+0000 7fd06b175700 1 --2- 172.21.15.81:0/1166996216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd064157ca0 0x7fd0640cf4f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0540098e0 tx=0x7fd0540091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.341+0000 7fd06b175700 1 -- 172.21.15.81:0/1166996216 shutdown_connections 2023-10-06T02:52:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.341+0000 7fd06b175700 1 --2- 172.21.15.81:0/1166996216 >> v2:172.21.15.83:3300/0 conn(0x7fd06406d120 0x7fd06406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.341+0000 7fd06b175700 1 --2- 172.21.15.81:0/1166996216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd064157ca0 0x7fd0640cf4f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.341+0000 7fd06b175700 1 -- 172.21.15.81:0/1166996216 >> 172.21.15.81:0/1166996216 conn(0x7fd06406bb90 msgr2=0x7fd06406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.341+0000 7fd06b175700 1 -- 172.21.15.81:0/1166996216 shutdown_connections 2023-10-06T02:52:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.341+0000 7fd06b175700 1 -- 172.21.15.81:0/1166996216 wait complete. 2023-10-06T02:52:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.342+0000 7fd06b175700 1 Processor -- start 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.342+0000 7fd06b175700 1 -- start start 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd06b175700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd06406d120 0x7fd06415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd06b175700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0641578d0 0x7fd06416cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd06b175700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd064157ca0 0x7fd06416d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd06b175700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06416da60 con 0x7fd06406d120 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd06b175700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06416dcb0 con 0x7fd064157ca0 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd06b175700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06416df90 con 0x7fd0641578d0 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd068f11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd06406d120 0x7fd06415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd068f11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd06406d120 0x7fd06415b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46754/0 (socket says 172.21.15.81:46754) 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd068f11700 1 -- 172.21.15.81:0/3177000302 learned_addr learned my addr 172.21.15.81:0/3177000302 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd05bfff700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0641578d0 0x7fd06416cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd069712700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd064157ca0 0x7fd06416d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd068f11700 1 -- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0641578d0 msgr2=0x7fd06416cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd068f11700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0641578d0 0x7fd06416cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd068f11700 1 -- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd064157ca0 msgr2=0x7fd06416d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd068f11700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd064157ca0 0x7fd06416d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd068f11700 1 -- 172.21.15.81:0/3177000302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c009a20 con 0x7fd06406d120 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd068f11700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd06406d120 0x7fd06415b8d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c7c0 tx=0x7fd060007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.343+0000 7fd058ff9700 1 -- 172.21.15.81:0/3177000302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060005b30 con 0x7fd06406d120 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.344+0000 7fd058ff9700 1 -- 172.21.15.81:0/3177000302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060005cb0 con 0x7fd06406d120 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.344+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd054009420 con 0x7fd06406d120 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.344+0000 7fd058ff9700 1 -- 172.21.15.81:0/3177000302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060004a80 con 0x7fd06406d120 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.344+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06416e550 con 0x7fd06406d120 2023-10-06T02:52:08.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.344+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd064067ac0 con 0x7fd06406d120 2023-10-06T02:52:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.345+0000 7fd058ff9700 1 -- 172.21.15.81:0/3177000302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0600070f0 con 0x7fd06406d120 2023-10-06T02:52:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.345+0000 7fd058ff9700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd050066f30 0x7fd0500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.345+0000 7fd058ff9700 1 -- 172.21.15.81:0/3177000302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd060083960 con 0x7fd06406d120 2023-10-06T02:52:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.345+0000 7fd05bfff700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd050066f30 0x7fd0500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.346+0000 7fd05bfff700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd050066f30 0x7fd0500693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd0540093f0 tx=0x7fd054017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.349+0000 7fd058ff9700 1 -- 172.21.15.81:0/3177000302 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd060050af0 con 0x7fd06406d120 2023-10-06T02:52:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.572+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd06406dac0 con 0x7fd06406d120 2023-10-06T02:52:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.573+0000 7fd058ff9700 1 -- 172.21.15.81:0/3177000302 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fd06406dac0 con 0x7fd06406d120 2023-10-06T02:52:08.574 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:08.574 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3448648390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3448648390},{"type":"v1","addr":"172.21.15.83:6836","nonce":3448648390}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/259812660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":259812660},{"type":"v1","addr":"172.21.15.83:6837","nonce":259812660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4011741221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4011741221},{"type":"v1","addr":"172.21.15.81:6834","nonce":4011741221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:53.060344+0000","modified":"2023-10-06T02:51:56.712953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/3211565547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3211565547},{"type":"v1","addr":"172.21.15.81:6835","nonce":3211565547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:52:08.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd050066f30 msgr2=0x7fd0500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd050066f30 0x7fd0500693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd0540093f0 tx=0x7fd054017000 comp rx=0 tx=0).stop 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd06406d120 msgr2=0x7fd06415b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd06406d120 0x7fd06415b8d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c7c0 tx=0x7fd060007f70 comp rx=0 tx=0).stop 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 shutdown_connections 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd050066f30 0x7fd0500693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd064157ca0 0x7fd06416d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd06406d120 0x7fd06415b8d0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 --2- 172.21.15.81:0/3177000302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0641578d0 0x7fd06416cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 >> 172.21.15.81:0/3177000302 conn(0x7fd06406bb90 msgr2=0x7fd064070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 shutdown_connections 2023-10-06T02:52:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:08.575+0000 7fd06b175700 1 -- 172.21.15.81:0/3177000302 wait complete. 2023-10-06T02:52:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2023-10-06T02:52:08.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 123 2023-10-06T02:52:08.719 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-06T02:52:08.720 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:52:08.720 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:52:08.720 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-06T02:52:08.720 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-06T02:52:08.720 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-06T02:52:08.720 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-06T02:52:08.720 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:52:08.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:08.974 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-06T02:52:09.042 INFO:teuthology.orchestra.run.smithi081.stdout:client5909 2023-10-06T02:52:09.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:09.043 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/072ce422-278f-434c-8814-5b3ff2abcdfb.client5909/osdmap') 2023-10-06T02:52:09.118 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 123 barrier 123 flags 0x588000 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6804 100% (exists, up) 100% -1 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.83:6801 100% (exists, up) 100% -1 2023-10-06T02:52:09.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.83:6809 100% (exists, up) 100% -1 2023-10-06T02:52:09.120 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.83:6825 100% (exists, up) 100% -1 2023-10-06T02:52:09.120 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.83:6817 100% (exists, up) 100% -1 2023-10-06T02:52:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-06T02:52:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-06T02:52:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:900 bytes copied, 5.0532e-05 s, 17.8 MB/s 2023-10-06T02:52:09.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:09.121 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-06T02:52:09.188 INFO:teuthology.orchestra.run.smithi081.stdout:client5909 2023-10-06T02:52:09.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:09.189 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/072ce422-278f-434c-8814-5b3ff2abcdfb.client5909/osdmap') 2023-10-06T02:52:09.264 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 123 barrier 123 flags 0x588000 2023-10-06T02:52:09.264 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:09.265 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:09.265 INFO:teuthology.orchestra.run.smithi081.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:09.265 INFO:teuthology.orchestra.run.smithi081.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-06T02:52:09.265 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-06T02:52:09.265 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-06T02:52:09.265 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-06T02:52:09.266 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6804 100% (exists, up) 100% -1 2023-10-06T02:52:09.266 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.83:6801 100% (exists, up) 100% -1 2023-10-06T02:52:09.266 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.83:6809 100% (exists, up) 100% -1 2023-10-06T02:52:09.266 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.83:6825 100% (exists, up) 100% -1 2023-10-06T02:52:09.266 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.83:6817 100% (exists, up) 100% -1 2023-10-06T02:52:09.267 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-06T02:52:09.268 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-06T02:52:09.268 INFO:teuthology.orchestra.run.smithi081.stderr:900 bytes copied, 3.6776e-05 s, 24.5 MB/s 2023-10-06T02:52:09.268 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:52:09.268 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:52:09.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:52:09.346 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:52:09.389 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:52:09.389 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:52:09.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:09.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:52:09.442 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:52:09.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:09.793 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:52:09.808 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:52:09.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:09.809 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:52:09.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:52:09.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:09.945 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:52:09.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.075+0000 7f5d87961700 1 Processor -- start 2023-10-06T02:52:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.075+0000 7f5d87961700 1 -- start start 2023-10-06T02:52:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d87961700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d801578d0 0x7f5d800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d87961700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5d80157ca0 0x7f5d8015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d87961700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d800d07c0 con 0x7f5d8006d120 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d87961700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d800cfbb0 con 0x7f5d80157ca0 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d87961700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800cfe90 con 0x7f5d801578d0 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d856fd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d801578d0 0x7f5d800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d84efc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5d80157ca0 0x7f5d8015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d856fd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d801578d0 0x7f5d800cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:55098/0 (socket says 172.21.15.81:55098) 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d84efc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5d80157ca0 0x7f5d8015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:41088/0 (socket says 172.21.15.81:41088) 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d85efe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5d8006d120 0x7f5d8015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:39214/0 (socket says 172.21.15.81:39214) 2023-10-06T02:52:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.076+0000 7f5d856fd700 1 -- 172.21.15.81:0/2618416702 learned_addr learned my addr 172.21.15.81:0/2618416702 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d856fd700 1 -- 172.21.15.81:0/2618416702 >> v2:172.21.15.83:3300/0 conn(0x7f5d80157ca0 msgr2=0x7f5d8015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d856fd700 1 --2- 172.21.15.81:0/2618416702 >> v2:172.21.15.83:3300/0 conn(0x7f5d80157ca0 0x7f5d8015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d856fd700 1 -- 172.21.15.81:0/2618416702 >> v1:172.21.15.83:6789/0 conn(0x7f5d8006d120 legacy=0x7f5d8015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d856fd700 1 -- 172.21.15.81:0/2618416702 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800d0170 con 0x7f5d801578d0 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d84efc700 1 --2- 172.21.15.81:0/2618416702 >> v2:172.21.15.83:3300/0 conn(0x7f5d80157ca0 0x7f5d8015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d856fd700 1 --2- 172.21.15.81:0/2618416702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d801578d0 0x7f5d800cf4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009f20 tx=0x7f5d7c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c51ca284a174227a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d77fff700 1 -- 172.21.15.81:0/2618416702 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00e070 con 0x7f5d801578d0 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d77fff700 1 -- 172.21.15.81:0/2618416702 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c00b9d0 con 0x7f5d801578d0 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d77fff700 1 -- 172.21.15.81:0/2618416702 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0092e0 con 0x7f5d801578d0 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d87961700 1 -- 172.21.15.81:0/2618416702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d801578d0 msgr2=0x7f5d800cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.077+0000 7f5d87961700 1 --2- 172.21.15.81:0/2618416702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d801578d0 0x7f5d800cf4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009f20 tx=0x7f5d7c009840 comp rx=0 tx=0).stop 2023-10-06T02:52:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.078+0000 7f5d87961700 1 -- 172.21.15.81:0/2618416702 shutdown_connections 2023-10-06T02:52:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.078+0000 7f5d87961700 1 --2- 172.21.15.81:0/2618416702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d801578d0 0x7f5d800cf4f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.078+0000 7f5d87961700 1 --2- 172.21.15.81:0/2618416702 >> v2:172.21.15.83:3300/0 conn(0x7f5d80157ca0 0x7f5d8015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.078+0000 7f5d87961700 1 -- 172.21.15.81:0/2618416702 >> 172.21.15.81:0/2618416702 conn(0x7f5d8006bb90 msgr2=0x7f5d8006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.078+0000 7f5d87961700 1 -- 172.21.15.81:0/2618416702 shutdown_connections 2023-10-06T02:52:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.078+0000 7f5d87961700 1 -- 172.21.15.81:0/2618416702 wait complete. 2023-10-06T02:52:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.079+0000 7f5d87961700 1 Processor -- start 2023-10-06T02:52:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.079+0000 7f5d87961700 1 -- start start 2023-10-06T02:52:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d87961700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d8006d120 0x7f5d80154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d87961700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d801578d0 0x7f5d800ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d87961700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d80157ca0 0x7f5d8016b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d87961700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800b1510 con 0x7f5d801578d0 2023-10-06T02:52:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d87961700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d801550d0 con 0x7f5d80157ca0 2023-10-06T02:52:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d87961700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800b0890 con 0x7f5d8006d120 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d84efc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d801578d0 0x7f5d800ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d84efc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d801578d0 0x7f5d800ab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46766/0 (socket says 172.21.15.81:46766) 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d84efc700 1 -- 172.21.15.81:0/428451089 learned_addr learned my addr 172.21.15.81:0/428451089 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d856fd700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d8006d120 0x7f5d80154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d85efe700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d80157ca0 0x7f5d8016b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d84efc700 1 -- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d8006d120 msgr2=0x7f5d80154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d84efc700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d8006d120 0x7f5d80154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d84efc700 1 -- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d80157ca0 msgr2=0x7f5d8016b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d84efc700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d80157ca0 0x7f5d8016b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d84efc700 1 -- 172.21.15.81:0/428451089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d70009420 con 0x7f5d801578d0 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d84efc700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d801578d0 0x7f5d800ab240 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000ecb0 tx=0x7f5d700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d757fa700 1 -- 172.21.15.81:0/428451089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000c850 con 0x7f5d801578d0 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d757fa700 1 -- 172.21.15.81:0/428451089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000c9b0 con 0x7f5d801578d0 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c009ae0 con 0x7f5d801578d0 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d757fa700 1 -- 172.21.15.81:0/428451089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000cd30 con 0x7f5d801578d0 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.080+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d800b0e50 con 0x7f5d801578d0 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.081+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d800b1650 con 0x7f5d801578d0 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.082+0000 7f5d757fa700 1 -- 172.21.15.81:0/428451089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d70013680 con 0x7f5d801578d0 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.082+0000 7f5d757fa700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d64066f30 0x7f5d640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.082+0000 7f5d757fa700 1 -- 172.21.15.81:0/428451089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d70084930 con 0x7f5d801578d0 2023-10-06T02:52:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.082+0000 7f5d856fd700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d64066f30 0x7f5d640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.083+0000 7f5d856fd700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d64066f30 0x7f5d640693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5d800b6c80 tx=0x7f5d7c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:10.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.086+0000 7f5d757fa700 1 -- 172.21.15.81:0/428451089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d800b1650 con 0x7f5d801578d0 2023-10-06T02:52:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.308+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d800b1650 con 0x7f5d801578d0 2023-10-06T02:52:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.308+0000 7f5d757fa700 1 -- 172.21.15.81:0/428451089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f5d800b1650 con 0x7f5d801578d0 2023-10-06T02:52:10.432 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:10.432 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3448648390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3448648390},{"type":"v1","addr":"172.21.15.83:6836","nonce":3448648390}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/259812660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":259812660},{"type":"v1","addr":"172.21.15.83:6837","nonce":259812660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4011741221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4011741221},{"type":"v1","addr":"172.21.15.81:6834","nonce":4011741221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:53.060344+0000","modified":"2023-10-06T02:51:56.712953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/3211565547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3211565547},{"type":"v1","addr":"172.21.15.81:6835","nonce":3211565547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:52:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d64066f30 msgr2=0x7f5d640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d64066f30 0x7f5d640693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5d800b6c80 tx=0x7f5d7c018000 comp rx=0 tx=0).stop 2023-10-06T02:52:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d801578d0 msgr2=0x7f5d800ab240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d801578d0 0x7f5d800ab240 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000ecb0 tx=0x7f5d700091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 shutdown_connections 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d64066f30 0x7f5d640693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d80157ca0 0x7f5d8016b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d8006d120 0x7f5d80154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 --2- 172.21.15.81:0/428451089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d801578d0 0x7f5d800ab240 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.310+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 >> 172.21.15.81:0/428451089 conn(0x7f5d8006bb90 msgr2=0x7f5d801568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.311+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 shutdown_connections 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.311+0000 7f5d87961700 1 -- 172.21.15.81:0/428451089 wait complete. 2023-10-06T02:52:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2023-10-06T02:52:10.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:52:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.548+0000 7f1bd5b5d700 1 Processor -- start 2023-10-06T02:52:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.548+0000 7f1bd5b5d700 1 -- start start 2023-10-06T02:52:10.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.549+0000 7f1bd5b5d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0156420 0x7f1bd00cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.549+0000 7f1bd5b5d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1bd00cc250 0x7f1bd0069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.549+0000 7f1bd5b5d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bd0069980 0x7f1bd00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.549+0000 7f1bd5b5d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd006aa10 con 0x7f1bd0069980 2023-10-06T02:52:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.549+0000 7f1bd5b5d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd00cb880 con 0x7f1bd00cc250 2023-10-06T02:52:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.549+0000 7f1bd5b5d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00cac70 con 0x7f1bd0156420 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.549+0000 7f1bcffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bd0069980 0x7f1bd00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.549+0000 7f1bcffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bd0069980 0x7f1bd00cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49400/0 (socket says 172.21.15.81:49400) 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.549+0000 7f1bcffff700 1 -- 172.21.15.81:0/3248858396 learned_addr learned my addr 172.21.15.81:0/3248858396 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bcf7fe700 1 --2- 172.21.15.81:0/3248858396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0156420 0x7f1bd00cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bceffd700 1 --2- 172.21.15.81:0/3248858396 >> v2:172.21.15.83:3300/0 conn(0x7f1bd00cc250 0x7f1bd0069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bcffff700 1 -- 172.21.15.81:0/3248858396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0156420 msgr2=0x7f1bd00cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bcffff700 1 --2- 172.21.15.81:0/3248858396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0156420 0x7f1bd00cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bcffff700 1 -- 172.21.15.81:0/3248858396 >> v2:172.21.15.83:3300/0 conn(0x7f1bd00cc250 msgr2=0x7f1bd0069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bcffff700 1 --2- 172.21.15.81:0/3248858396 >> v2:172.21.15.83:3300/0 conn(0x7f1bd00cc250 0x7f1bd0069440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bcffff700 1 -- 172.21.15.81:0/3248858396 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00caf50 con 0x7f1bd0069980 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bcf7fe700 1 --2- 172.21.15.81:0/3248858396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0156420 0x7f1bd00cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bcffff700 1 --2- 172.21.15.81:0/3248858396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0069980 0x7f1bd00cd090 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0064680 tx=0x7f1bc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949d771f897bf197 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bce7fc700 1 -- 172.21.15.81:0/3248858396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800b860 con 0x7f1bd0069980 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bce7fc700 1 -- 172.21.15.81:0/3248858396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc800b9c0 con 0x7f1bd0069980 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bce7fc700 1 -- 172.21.15.81:0/3248858396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800bd60 con 0x7f1bd0069980 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3248858396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0069980 msgr2=0x7f1bd00cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3248858396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0069980 0x7f1bd00cd090 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0064680 tx=0x7f1bc8009250 comp rx=0 tx=0).stop 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3248858396 shutdown_connections 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3248858396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0069980 0x7f1bd00cd090 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3248858396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd0156420 0x7f1bd00cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3248858396 >> v2:172.21.15.83:3300/0 conn(0x7f1bd00cc250 0x7f1bd0069440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3248858396 >> 172.21.15.81:0/3248858396 conn(0x7f1bd006c660 msgr2=0x7f1bd00cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3248858396 shutdown_connections 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.550+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3248858396 wait complete. 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.552+0000 7f1bd5b5d700 1 Processor -- start 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.552+0000 7f1bd5b5d700 1 -- start start 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.552+0000 7f1bd5b5d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd0069980 0x7f1bd01522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.552+0000 7f1bd5b5d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd00cc250 0x7f1bd0169880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.552+0000 7f1bd5b5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0156420 0x7f1bd00c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.552+0000 7f1bd5b5d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd013ac70 con 0x7f1bd0156420 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.552+0000 7f1bd5b5d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd016d9a0 con 0x7f1bd0069980 2023-10-06T02:52:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.552+0000 7f1bd5b5d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd016dc80 con 0x7f1bd00cc250 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0156420 0x7f1bd00c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0156420 0x7f1bd00c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49416/0 (socket says 172.21.15.81:49416) 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcffff700 1 -- 172.21.15.81:0/3884374627 learned_addr learned my addr 172.21.15.81:0/3884374627 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bceffd700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd00cc250 0x7f1bd0169880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcf7fe700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd0069980 0x7f1bd01522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcffff700 1 -- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd00cc250 msgr2=0x7f1bd0169880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcffff700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd00cc250 0x7f1bd0169880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcffff700 1 -- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd0069980 msgr2=0x7f1bd01522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcffff700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd0069980 0x7f1bd01522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcffff700 1 -- 172.21.15.81:0/3884374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc80094f0 con 0x7f1bd0156420 2023-10-06T02:52:10.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bcffff700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0156420 0x7f1bd00c4e80 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0064700 tx=0x7f1bc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:10.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bb77fe700 1 -- 172.21.15.81:0/3884374627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc801a630 con 0x7f1bd0156420 2023-10-06T02:52:10.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bb77fe700 1 -- 172.21.15.81:0/3884374627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc801a7b0 con 0x7f1bd0156420 2023-10-06T02:52:10.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd016df60 con 0x7f1bd0156420 2023-10-06T02:52:10.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bb77fe700 1 -- 172.21.15.81:0/3884374627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc801ab70 con 0x7f1bd0156420 2023-10-06T02:52:10.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.553+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd0169dc0 con 0x7f1bd0156420 2023-10-06T02:52:10.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.554+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd00c8bc0 con 0x7f1bd0156420 2023-10-06T02:52:10.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.555+0000 7f1bb77fe700 1 -- 172.21.15.81:0/3884374627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bc802d440 con 0x7f1bd0156420 2023-10-06T02:52:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.555+0000 7f1bb77fe700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.555+0000 7f1bb77fe700 1 -- 172.21.15.81:0/3884374627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1bc80862d0 con 0x7f1bd0156420 2023-10-06T02:52:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.555+0000 7f1bcf7fe700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.555+0000 7f1bcf7fe700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000e4b0 tx=0x7f1bc0007670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.559+0000 7f1bb77fe700 1 -- 172.21.15.81:0/3884374627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bc8053460 con 0x7f1bd0156420 2023-10-06T02:52:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.742+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bd00af920 con 0x7f1bd0156420 2023-10-06T02:52:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.743+0000 7f1bb77fe700 1 -- 172.21.15.81:0/3884374627 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16841 (secure 0 0 0) 0x7f1bc8056a80 con 0x7f1bd0156420 2023-10-06T02:52:10.745 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:10.745 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":123,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:07.441658+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:51:50.714217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T02:51:52.027875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:52:10.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 msgr2=0x7f1bbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000e4b0 tx=0x7f1bc0007670 comp rx=0 tx=0).stop 2023-10-06T02:52:10.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0156420 msgr2=0x7f1bd00c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0156420 0x7f1bd00c4e80 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0064700 tx=0x7f1bc8017000 comp rx=0 tx=0).stop 2023-10-06T02:52:10.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 shutdown_connections 2023-10-06T02:52:10.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0156420 0x7f1bd00c4e80 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1bbc066f30 0x7f1bbc0693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bd0069980 0x7f1bd01522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 --2- 172.21.15.81:0/3884374627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1bd00cc250 0x7f1bd0169880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.745+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 >> 172.21.15.81:0/3884374627 conn(0x7f1bd006c660 msgr2=0x7f1bd00c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:10.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.746+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 shutdown_connections 2023-10-06T02:52:10.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.746+0000 7f1bd5b5d700 1 -- 172.21.15.81:0/3884374627 wait complete. 2023-10-06T02:52:10.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:51:50.714217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:51:52.027875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:52:10.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:52:10.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.874+0000 7fd6fd877700 1 Processor -- start 2023-10-06T02:52:10.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.874+0000 7fd6fd877700 1 -- start start 2023-10-06T02:52:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.875+0000 7fd6fd877700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f81578d0 0x7fd6f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.875+0000 7fd6fd877700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd6f8157ca0 0x7fd6f815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.875+0000 7fd6fd877700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f80d07c0 con 0x7fd6f806d120 2023-10-06T02:52:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.875+0000 7fd6fd877700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f80cfbb0 con 0x7fd6f8157ca0 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.875+0000 7fd6fd877700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80cfe90 con 0x7fd6f81578d0 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.875+0000 7fd6f6ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f81578d0 0x7fd6f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.875+0000 7fd6ee7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd6f8157ca0 0x7fd6f815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.875+0000 7fd6f77fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd6f806d120 0x7fd6f815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:49440/0 (socket says 172.21.15.81:49440) 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.875+0000 7fd6f77fe700 1 -- 172.21.15.81:0/2892271787 learned_addr learned my addr 172.21.15.81:0/2892271787 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6f6ffd700 1 -- 172.21.15.81:0/2892271787 >> v2:172.21.15.83:3300/0 conn(0x7fd6f8157ca0 msgr2=0x7fd6f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6f6ffd700 1 --2- 172.21.15.81:0/2892271787 >> v2:172.21.15.83:3300/0 conn(0x7fd6f8157ca0 0x7fd6f815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6f6ffd700 1 -- 172.21.15.81:0/2892271787 >> v1:172.21.15.83:6789/0 conn(0x7fd6f806d120 legacy=0x7fd6f815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6f6ffd700 1 -- 172.21.15.81:0/2892271787 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80d0170 con 0x7fd6f81578d0 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6f67fc700 1 -- 172.21.15.81:0/2892271787 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962968471 0 0) 0x7fd6f80d07c0 con 0x7fd6f806d120 2023-10-06T02:52:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6ee7fc700 1 --2- 172.21.15.81:0/2892271787 >> v2:172.21.15.83:3300/0 conn(0x7fd6f8157ca0 0x7fd6f815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6f6ffd700 1 --2- 172.21.15.81:0/2892271787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f81578d0 0x7fd6f80cf4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80098e0 tx=0x7fd6e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b209a740e7635f9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6f67fc700 1 -- 172.21.15.81:0/2892271787 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800b640 con 0x7fd6f81578d0 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6f67fc700 1 -- 172.21.15.81:0/2892271787 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800b7a0 con 0x7fd6f81578d0 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.876+0000 7fd6f67fc700 1 -- 172.21.15.81:0/2892271787 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800bb40 con 0x7fd6f81578d0 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.877+0000 7fd6fd877700 1 -- 172.21.15.81:0/2892271787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f81578d0 msgr2=0x7fd6f80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.877+0000 7fd6fd877700 1 --2- 172.21.15.81:0/2892271787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f81578d0 0x7fd6f80cf4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80098e0 tx=0x7fd6e80091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.877+0000 7fd6fd877700 1 -- 172.21.15.81:0/2892271787 shutdown_connections 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.877+0000 7fd6fd877700 1 --2- 172.21.15.81:0/2892271787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f81578d0 0x7fd6f80cf4f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.877+0000 7fd6fd877700 1 --2- 172.21.15.81:0/2892271787 >> v2:172.21.15.83:3300/0 conn(0x7fd6f8157ca0 0x7fd6f815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.877+0000 7fd6fd877700 1 -- 172.21.15.81:0/2892271787 >> 172.21.15.81:0/2892271787 conn(0x7fd6f806bb90 msgr2=0x7fd6f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.877+0000 7fd6fd877700 1 -- 172.21.15.81:0/2892271787 shutdown_connections 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.877+0000 7fd6fd877700 1 -- 172.21.15.81:0/2892271787 wait complete. 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.878+0000 7fd6fd877700 1 Processor -- start 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.878+0000 7fd6fd877700 1 -- start start 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6fd877700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f806d120 0x7fd6f8154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6fd877700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6f81578d0 0x7fd6f80b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6fd877700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f8157ca0 0x7fd6f80b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6fd877700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80b4f40 con 0x7fd6f81578d0 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6fd877700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80ca810 con 0x7fd6f8157ca0 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6fd877700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80c6740 con 0x7fd6f806d120 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ee7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6f81578d0 0x7fd6f80b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ee7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6f81578d0 0x7fd6f80b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49428/0 (socket says 172.21.15.81:49428) 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ee7fc700 1 -- 172.21.15.81:0/434870292 learned_addr learned my addr 172.21.15.81:0/434870292 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6f6ffd700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f806d120 0x7fd6f8154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6f77fe700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f8157ca0 0x7fd6f80b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ee7fc700 1 -- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f806d120 msgr2=0x7fd6f8154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ee7fc700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f806d120 0x7fd6f8154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ee7fc700 1 -- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f8157ca0 msgr2=0x7fd6f80b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ee7fc700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f8157ca0 0x7fd6f80b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ee7fc700 1 -- 172.21.15.81:0/434870292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0009420 con 0x7fd6f81578d0 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ee7fc700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6f81578d0 0x7fd6f80b5a90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000ec80 tx=0x7fd6e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ef7fe700 1 -- 172.21.15.81:0/434870292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000c9d0 con 0x7fd6f81578d0 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ef7fe700 1 -- 172.21.15.81:0/434870292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e000cb30 con 0x7fd6f81578d0 2023-10-06T02:52:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e8009420 con 0x7fd6f81578d0 2023-10-06T02:52:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6ef7fe700 1 -- 172.21.15.81:0/434870292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000ceb0 con 0x7fd6f81578d0 2023-10-06T02:52:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.879+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f816c270 con 0x7fd6f81578d0 2023-10-06T02:52:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.880+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f816c400 con 0x7fd6f81578d0 2023-10-06T02:52:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.881+0000 7fd6ef7fe700 1 -- 172.21.15.81:0/434870292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6e0013680 con 0x7fd6f81578d0 2023-10-06T02:52:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.881+0000 7fd6ef7fe700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6d8066f30 0x7fd6d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.881+0000 7fd6ef7fe700 1 -- 172.21.15.81:0/434870292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd6e00849e0 con 0x7fd6f81578d0 2023-10-06T02:52:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.881+0000 7fd6f6ffd700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6d8066f30 0x7fd6d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.882+0000 7fd6f6ffd700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6d8066f30 0x7fd6d80693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80093f0 tx=0x7fd6e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:10.886+0000 7fd6ef7fe700 1 -- 172.21.15.81:0/434870292 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6e0051af0 con 0x7fd6f81578d0 2023-10-06T02:52:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.068+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6f8067b50 con 0x7fd6f81578d0 2023-10-06T02:52:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.069+0000 7fd6ef7fe700 1 -- 172.21.15.81:0/434870292 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6e0055110 con 0x7fd6f81578d0 2023-10-06T02:52:11.070 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:52:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6d8066f30 msgr2=0x7fd6d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6d8066f30 0x7fd6d80693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80093f0 tx=0x7fd6e8017000 comp rx=0 tx=0).stop 2023-10-06T02:52:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6f81578d0 msgr2=0x7fd6f80b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6f81578d0 0x7fd6f80b5a90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000ec80 tx=0x7fd6e00091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 shutdown_connections 2023-10-06T02:52:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6d8066f30 0x7fd6d80693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6f8157ca0 0x7fd6f80b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6f806d120 0x7fd6f8154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 --2- 172.21.15.81:0/434870292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6f81578d0 0x7fd6f80b5a90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 >> 172.21.15.81:0/434870292 conn(0x7fd6f806bb90 msgr2=0x7fd6f806d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 shutdown_connections 2023-10-06T02:52:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.071+0000 7fd6fd877700 1 -- 172.21.15.81:0/434870292 wait complete. 2023-10-06T02:52:11.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:52:11.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.200+0000 7f1ec8136700 1 Processor -- start 2023-10-06T02:52:11.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.200+0000 7f1ec8136700 1 -- start start 2023-10-06T02:52:11.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec8136700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ec00cae00 0x7f1ec00aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec8136700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ec00cb2a0 0x7f1ec00aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec8136700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec006d350 con 0x7f1ec015daa0 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec8136700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec00c9ac0 con 0x7f1ec00cb2a0 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec8136700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec006c740 con 0x7f1ec00cae00 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec66d3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ec00cb2a0 0x7f1ec00aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec66d3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ec00cb2a0 0x7f1ec00aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49438/0 (socket says 172.21.15.81:49438) 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec66d3700 1 -- 172.21.15.81:0/874366998 learned_addr learned my addr 172.21.15.81:0/874366998 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec56d1700 1 --2- 172.21.15.81:0/874366998 >> v2:172.21.15.83:3300/0 conn(0x7f1ec00cae00 0x7f1ec00aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec66d3700 1 -- 172.21.15.81:0/874366998 >> v2:172.21.15.83:3300/0 conn(0x7f1ec00cae00 msgr2=0x7f1ec00aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec66d3700 1 --2- 172.21.15.81:0/874366998 >> v2:172.21.15.83:3300/0 conn(0x7f1ec00cae00 0x7f1ec00aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec66d3700 1 -- 172.21.15.81:0/874366998 >> v1:172.21.15.83:6789/0 conn(0x7f1ec015daa0 legacy=0x7f1ec015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.201+0000 7f1ec66d3700 1 -- 172.21.15.81:0/874366998 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec006ca20 con 0x7f1ec00cb2a0 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec66d3700 1 --2- 172.21.15.81:0/874366998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec00cb2a0 0x7f1ec00aadd0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0067cb0 tx=0x7f1eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ec0c9c42b00fcd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec4ed0700 1 -- 172.21.15.81:0/874366998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb800b860 con 0x7f1ec00cb2a0 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec4ed0700 1 -- 172.21.15.81:0/874366998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb800b9c0 con 0x7f1ec00cb2a0 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec4ed0700 1 -- 172.21.15.81:0/874366998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb800bd60 con 0x7f1ec00cb2a0 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec8136700 1 -- 172.21.15.81:0/874366998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec00cb2a0 msgr2=0x7f1ec00aadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec8136700 1 --2- 172.21.15.81:0/874366998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec00cb2a0 0x7f1ec00aadd0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0067cb0 tx=0x7f1eb8009250 comp rx=0 tx=0).stop 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec8136700 1 -- 172.21.15.81:0/874366998 shutdown_connections 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec8136700 1 --2- 172.21.15.81:0/874366998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec00cb2a0 0x7f1ec00aadd0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec8136700 1 --2- 172.21.15.81:0/874366998 >> v2:172.21.15.83:3300/0 conn(0x7f1ec00cae00 0x7f1ec00aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec8136700 1 -- 172.21.15.81:0/874366998 >> 172.21.15.81:0/874366998 conn(0x7f1ec00c9ca0 msgr2=0x7f1ec00ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec8136700 1 -- 172.21.15.81:0/874366998 shutdown_connections 2023-10-06T02:52:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.202+0000 7f1ec8136700 1 -- 172.21.15.81:0/874366998 wait complete. 2023-10-06T02:52:11.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.203+0000 7f1ec8136700 1 Processor -- start 2023-10-06T02:52:11.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.203+0000 7f1ec8136700 1 -- start start 2023-10-06T02:52:11.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec8136700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ec00cae00 0x7f1ec016abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec8136700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ec00cb2a0 0x7f1ec01699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec8136700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec015daa0 0x7f1ec00c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec8136700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec016b110 con 0x7f1ec015daa0 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec8136700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00b2b90 con 0x7f1ec00cae00 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec8136700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00c4750 con 0x7f1ec00cb2a0 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec66d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec015daa0 0x7f1ec00c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec66d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec015daa0 0x7f1ec00c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49452/0 (socket says 172.21.15.81:49452) 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec66d3700 1 -- 172.21.15.81:0/3188774098 learned_addr learned my addr 172.21.15.81:0/3188774098 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec66d3700 1 -- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ec00cb2a0 msgr2=0x7f1ec01699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec66d3700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ec00cb2a0 0x7f1ec01699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec66d3700 1 -- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ec00cae00 msgr2=0x7f1ec016abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec66d3700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ec00cae00 0x7f1ec016abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.204+0000 7f1ec66d3700 1 -- 172.21.15.81:0/3188774098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80094f0 con 0x7f1ec015daa0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.205+0000 7f1ec66d3700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec015daa0 0x7f1ec00c64c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009290 tx=0x7f1eb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.205+0000 7f1ebdffb700 1 -- 172.21.15.81:0/3188774098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb801a700 con 0x7f1ec015daa0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.205+0000 7f1ebdffb700 1 -- 172.21.15.81:0/3188774098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb801a860 con 0x7f1ec015daa0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.205+0000 7f1ebdffb700 1 -- 172.21.15.81:0/3188774098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb801ac20 con 0x7f1ec015daa0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.205+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec00c4a30 con 0x7f1ec015daa0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.205+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec00c4ff0 con 0x7f1ec015daa0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.206+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec0068080 con 0x7f1ec015daa0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.206+0000 7f1ebdffb700 1 -- 172.21.15.81:0/3188774098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eb802d440 con 0x7f1ec015daa0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.207+0000 7f1ebdffb700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.207+0000 7f1ebdffb700 1 -- 172.21.15.81:0/3188774098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1eb80864e0 con 0x7f1ec015daa0 2023-10-06T02:52:11.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.207+0000 7f1ec5ed2700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.207+0000 7f1ec5ed2700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1eac066f30 0x7f1eac0693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00c3c00 tx=0x7f1eb0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.211+0000 7f1ebdffb700 1 -- 172.21.15.81:0/3188774098 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1eb80535f0 con 0x7f1ec015daa0 2023-10-06T02:52:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.389+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1ec004bb80 con 0x7f1ec015daa0 2023-10-06T02:52:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.390+0000 7f1ebdffb700 1 -- 172.21.15.81:0/3188774098 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v123) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1eb8056c10 con 0x7f1ec015daa0 2023-10-06T02:52:11.391 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:52:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1eac066f30 msgr2=0x7f1eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1eac066f30 0x7f1eac0693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00c3c00 tx=0x7f1eb0007ec0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec015daa0 msgr2=0x7f1ec00c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec015daa0 0x7f1ec00c64c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009290 tx=0x7f1eb8017000 comp rx=0 tx=0).stop 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 shutdown_connections 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec015daa0 0x7f1ec00c64c0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ec00cae00 0x7f1ec016abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 --2- 172.21.15.81:0/3188774098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ec00cb2a0 0x7f1ec01699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 >> 172.21.15.81:0/3188774098 conn(0x7f1ec00c9ca0 msgr2=0x7f1ec00c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 shutdown_connections 2023-10-06T02:52:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.392+0000 7f1ec8136700 1 -- 172.21.15.81:0/3188774098 wait complete. 2023-10-06T02:52:11.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:52:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.521+0000 7f88c9496700 1 Processor -- start 2023-10-06T02:52:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.521+0000 7f88c9496700 1 -- start start 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c9496700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88c4157ca0 0x7f88c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c9496700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88c406d120 0x7f88c406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c9496700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c40d07c0 con 0x7f88c41578d0 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c9496700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c406daa0 con 0x7f88c4157ca0 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c9496700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40cfbb0 con 0x7f88c406d120 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88bbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88c4157ca0 0x7f88c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f88c41578d0 0x7f88c415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43168/0 (socket says 172.21.15.81:43168) 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88bbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88c4157ca0 0x7f88c40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49468/0 (socket says 172.21.15.81:49468) 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c2ffd700 1 -- 172.21.15.81:0/695688958 learned_addr learned my addr 172.21.15.81:0/695688958 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c37fe700 1 --2- 172.21.15.81:0/695688958 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88c406d120 0x7f88c406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88bbfff700 1 -- 172.21.15.81:0/695688958 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88c406d120 msgr2=0x7f88c406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88bbfff700 1 --2- 172.21.15.81:0/695688958 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88c406d120 0x7f88c406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88bbfff700 1 -- 172.21.15.81:0/695688958 >> v1:172.21.15.81:6789/0 conn(0x7f88c41578d0 legacy=0x7f88c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88bbfff700 1 -- 172.21.15.81:0/695688958 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40cfe90 con 0x7f88c4157ca0 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c27fc700 1 -- 172.21.15.81:0/695688958 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687822801 0 0) 0x7f88c40d07c0 con 0x7f88c41578d0 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88bbfff700 1 --2- 172.21.15.81:0/695688958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c4157ca0 0x7f88c40cf4f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0098e0 tx=0x7f88ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c7f535e64831c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c27fc700 1 -- 172.21.15.81:0/695688958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac009e80 con 0x7f88c4157ca0 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c27fc700 1 -- 172.21.15.81:0/695688958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac00b860 con 0x7f88c4157ca0 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.522+0000 7f88c27fc700 1 -- 172.21.15.81:0/695688958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac00bbe0 con 0x7f88c4157ca0 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.523+0000 7f88c9496700 1 -- 172.21.15.81:0/695688958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c4157ca0 msgr2=0x7f88c40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.523+0000 7f88c9496700 1 --2- 172.21.15.81:0/695688958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c4157ca0 0x7f88c40cf4f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0098e0 tx=0x7f88ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.523+0000 7f88c9496700 1 -- 172.21.15.81:0/695688958 shutdown_connections 2023-10-06T02:52:11.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.523+0000 7f88c9496700 1 --2- 172.21.15.81:0/695688958 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88c406d120 0x7f88c406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.523+0000 7f88c9496700 1 --2- 172.21.15.81:0/695688958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c4157ca0 0x7f88c40cf4f0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.523+0000 7f88c9496700 1 -- 172.21.15.81:0/695688958 >> 172.21.15.81:0/695688958 conn(0x7f88c406bb90 msgr2=0x7f88c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:11.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.523+0000 7f88c9496700 1 -- 172.21.15.81:0/695688958 shutdown_connections 2023-10-06T02:52:11.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.523+0000 7f88c9496700 1 -- 172.21.15.81:0/695688958 wait complete. 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.524+0000 7f88c9496700 1 Processor -- start 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.524+0000 7f88c9496700 1 -- start start 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88c9496700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88c406d120 0x7f88c4153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88c9496700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c41578d0 0x7f88c4069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88c9496700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c4157ca0 0x7f88c4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88c9496700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40b64b0 con 0x7f88c41578d0 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88c9496700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4154020 con 0x7f88c4157ca0 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88c9496700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4159630 con 0x7f88c406d120 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c41578d0 0x7f88c4069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c41578d0 0x7f88c4069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49476/0 (socket says 172.21.15.81:49476) 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88bbfff700 1 -- 172.21.15.81:0/3749305220 learned_addr learned my addr 172.21.15.81:0/3749305220 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88bbfff700 1 -- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88c406d120 msgr2=0x7f88c4153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88bbfff700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88c406d120 0x7f88c4153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88bbfff700 1 -- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c4157ca0 msgr2=0x7f88c4069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88bbfff700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c4157ca0 0x7f88c4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88bbfff700 1 -- 172.21.15.81:0/3749305220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac009420 con 0x7f88c41578d0 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88bbfff700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c41578d0 0x7f88c4069910 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f88ac013000 tx=0x7f88ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88baffd700 1 -- 172.21.15.81:0/3749305220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac00bbe0 con 0x7f88c41578d0 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88baffd700 1 -- 172.21.15.81:0/3749305220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac011420 con 0x7f88c41578d0 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88baffd700 1 -- 172.21.15.81:0/3749305220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0117e0 con 0x7f88c41578d0 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c40b5930 con 0x7f88c41578d0 2023-10-06T02:52:11.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.525+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c40b5ef0 con 0x7f88c41578d0 2023-10-06T02:52:11.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.526+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c4067ac0 con 0x7f88c41578d0 2023-10-06T02:52:11.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.527+0000 7f88baffd700 1 -- 172.21.15.81:0/3749305220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88ac011bd0 con 0x7f88c41578d0 2023-10-06T02:52:11.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.527+0000 7f88baffd700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f88a4066f30 0x7f88a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.527+0000 7f88baffd700 1 -- 172.21.15.81:0/3749305220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f88ac086020 con 0x7f88c41578d0 2023-10-06T02:52:11.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.527+0000 7f88c2ffd700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f88a4066f30 0x7f88a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.528+0000 7f88c2ffd700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f88a4066f30 0x7f88a40693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f88b40016f0 tx=0x7f88b40079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:11.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.531+0000 7f88baffd700 1 -- 172.21.15.81:0/3749305220 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88ac053130 con 0x7f88c41578d0 2023-10-06T02:52:11.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.712+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88c40d0170 con 0x7f88c41578d0 2023-10-06T02:52:11.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.712+0000 7f88baffd700 1 -- 172.21.15.81:0/3749305220 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88ac056750 con 0x7f88c41578d0 2023-10-06T02:52:11.714 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:52:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f88a4066f30 msgr2=0x7f88a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f88a4066f30 0x7f88a40693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f88b40016f0 tx=0x7f88b40079d0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c41578d0 msgr2=0x7f88c4069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c41578d0 0x7f88c4069910 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f88ac013000 tx=0x7f88ac017000 comp rx=0 tx=0).stop 2023-10-06T02:52:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 shutdown_connections 2023-10-06T02:52:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f88a4066f30 0x7f88a40693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88c4157ca0 0x7f88c4069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88c406d120 0x7f88c4153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 --2- 172.21.15.81:0/3749305220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c41578d0 0x7f88c4069910 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 >> 172.21.15.81:0/3749305220 conn(0x7f88c406bb90 msgr2=0x7f88c41584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 shutdown_connections 2023-10-06T02:52:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.714+0000 7f88c9496700 1 -- 172.21.15.81:0/3749305220 wait complete. 2023-10-06T02:52:11.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:52:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.842+0000 7f45d74a6700 1 Processor -- start 2023-10-06T02:52:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.842+0000 7f45d74a6700 1 -- start start 2023-10-06T02:52:11.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d74a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d00d0b80 0x7f45d00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d74a6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d00cf2d0 con 0x7f45d00d02b0 2023-10-06T02:52:11.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d74a6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d006dc00 con 0x7f45d006d700 2023-10-06T02:52:11.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d74a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d015a690 con 0x7f45d00d0b80 2023-10-06T02:52:11.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d5ca3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45d00d02b0 0x7f45d006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43174/0 (socket says 172.21.15.81:43174) 2023-10-06T02:52:11.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d5ca3700 1 -- 172.21.15.81:0/537276504 learned_addr learned my addr 172.21.15.81:0/537276504 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:11.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d64a4700 1 --2- 172.21.15.81:0/537276504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d00d0b80 0x7f45d00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d54a2700 1 -- 172.21.15.81:0/537276504 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915705372 0 0) 0x7f45d00cf2d0 con 0x7f45d00d02b0 2023-10-06T02:52:11.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d54a2700 1 -- 172.21.15.81:0/537276504 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45bc003570 con 0x7f45d00d02b0 2023-10-06T02:52:11.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d54a2700 1 -- 172.21.15.81:0/537276504 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221314224 0 0) 0x7f45d006dc00 con 0x7f45d006d700 2023-10-06T02:52:11.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.843+0000 7f45d54a2700 1 -- 172.21.15.81:0/537276504 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d00cf2d0 con 0x7f45d006d700 2023-10-06T02:52:11.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d64a4700 1 -- 172.21.15.81:0/537276504 >> v1:172.21.15.83:6789/0 conn(0x7f45d006d700 legacy=0x7f45d015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d64a4700 1 -- 172.21.15.81:0/537276504 >> v1:172.21.15.81:6789/0 conn(0x7f45d00d02b0 legacy=0x7f45d006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d64a4700 1 -- 172.21.15.81:0/537276504 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d00cf570 con 0x7f45d00d0b80 2023-10-06T02:52:11.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d64a4700 1 --2- 172.21.15.81:0/537276504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d00d0b80 0x7f45d00cfd70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009910 tx=0x7f45cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74ba0878f057d0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d54a2700 1 -- 172.21.15.81:0/537276504 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011630 con 0x7f45d00d0b80 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d54a2700 1 -- 172.21.15.81:0/537276504 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc011790 con 0x7f45d00d0b80 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d54a2700 1 -- 172.21.15.81:0/537276504 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011b10 con 0x7f45d00d0b80 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d74a6700 1 -- 172.21.15.81:0/537276504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d00d0b80 msgr2=0x7f45d00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d74a6700 1 --2- 172.21.15.81:0/537276504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d00d0b80 0x7f45d00cfd70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009910 tx=0x7f45cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d74a6700 1 -- 172.21.15.81:0/537276504 shutdown_connections 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d74a6700 1 --2- 172.21.15.81:0/537276504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d00d0b80 0x7f45d00cfd70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.844+0000 7f45d74a6700 1 -- 172.21.15.81:0/537276504 >> 172.21.15.81:0/537276504 conn(0x7f45d0063230 msgr2=0x7f45d0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.845+0000 7f45d74a6700 1 -- 172.21.15.81:0/537276504 shutdown_connections 2023-10-06T02:52:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.845+0000 7f45d74a6700 1 -- 172.21.15.81:0/537276504 wait complete. 2023-10-06T02:52:11.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d74a6700 1 Processor -- start 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d74a6700 1 -- start start 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d74a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d006d700 0x7f45d0169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d74a6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d00d02b0 0x7f45d00cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d74a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d00d0b80 0x7f45d00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d74a6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00b57f0 con 0x7f45d00d0b80 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d74a6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00cdab0 con 0x7f45d00d02b0 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d74a6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00c90e0 con 0x7f45d006d700 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d6ca5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d00d0b80 0x7f45d00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d6ca5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d00d0b80 0x7f45d00cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49482/0 (socket says 172.21.15.81:49482) 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d6ca5700 1 -- 172.21.15.81:0/814130656 learned_addr learned my addr 172.21.15.81:0/814130656 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d64a4700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d006d700 0x7f45d0169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.846+0000 7f45d5ca3700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d00d02b0 0x7f45d00cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45d6ca5700 1 -- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d006d700 msgr2=0x7f45d0169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45d6ca5700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d006d700 0x7f45d0169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45d6ca5700 1 -- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d00d02b0 msgr2=0x7f45d00cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45d6ca5700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d00d02b0 0x7f45d00cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45d6ca5700 1 -- 172.21.15.81:0/814130656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc009420 con 0x7f45d00d0b80 2023-10-06T02:52:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45d6ca5700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d00d0b80 0x7f45d00cd570 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f45c800c910 tx=0x7f45c8002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45c67fc700 1 -- 172.21.15.81:0/814130656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8012630 con 0x7f45d00d0b80 2023-10-06T02:52:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45c67fc700 1 -- 172.21.15.81:0/814130656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c8012790 con 0x7f45d00d0b80 2023-10-06T02:52:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d00c93c0 con 0x7f45d00d0b80 2023-10-06T02:52:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45c67fc700 1 -- 172.21.15.81:0/814130656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8012b50 con 0x7f45d00d0b80 2023-10-06T02:52:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.847+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d00c9a00 con 0x7f45d00d0b80 2023-10-06T02:52:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.848+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d0063810 con 0x7f45d00d0b80 2023-10-06T02:52:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.848+0000 7f45c67fc700 1 -- 172.21.15.81:0/814130656 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45c801a3a0 con 0x7f45d00d0b80 2023-10-06T02:52:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.848+0000 7f45c67fc700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f45b4066f30 0x7f45b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.849+0000 7f45c67fc700 1 -- 172.21.15.81:0/814130656 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f45c8084840 con 0x7f45d00d0b80 2023-10-06T02:52:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.849+0000 7f45d64a4700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f45b4066f30 0x7f45b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:11.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.849+0000 7f45d64a4700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f45b4066f30 0x7f45b40693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009860 tx=0x7f45cc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:11.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:11.853+0000 7f45c67fc700 1 -- 172.21.15.81:0/814130656 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45c8051950 con 0x7f45d00d0b80 2023-10-06T02:52:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.032+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45d016a440 con 0x7f45d00d0b80 2023-10-06T02:52:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.032+0000 7f45c67fc700 1 -- 172.21.15.81:0/814130656 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45c8054f70 con 0x7f45d00d0b80 2023-10-06T02:52:12.034 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:52:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f45b4066f30 msgr2=0x7f45b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f45b4066f30 0x7f45b40693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009860 tx=0x7f45cc017000 comp rx=0 tx=0).stop 2023-10-06T02:52:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d00d0b80 msgr2=0x7f45d00cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d00d0b80 0x7f45d00cd570 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f45c800c910 tx=0x7f45c8002720 comp rx=0 tx=0).stop 2023-10-06T02:52:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 shutdown_connections 2023-10-06T02:52:12.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d00d0b80 0x7f45d00cd570 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45d006d700 0x7f45d0169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f45b4066f30 0x7f45b40693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 --2- 172.21.15.81:0/814130656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d00d02b0 0x7f45d00cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 >> 172.21.15.81:0/814130656 conn(0x7f45d0063230 msgr2=0x7f45d0158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:12.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 shutdown_connections 2023-10-06T02:52:12.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.035+0000 7f45d74a6700 1 -- 172.21.15.81:0/814130656 wait complete. 2023-10-06T02:52:12.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.160+0000 7f1cf5989700 1 Processor -- start 2023-10-06T02:52:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.160+0000 7f1cf5989700 1 -- start start 2023-10-06T02:52:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf5989700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0159f10 0x7f1cf0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf5989700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1cf0068cc0 0x7f1cf00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf5989700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf00cee10 con 0x7f1cf0159b40 2023-10-06T02:52:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf5989700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf0069140 con 0x7f1cf0068cc0 2023-10-06T02:52:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf5989700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00cd040 con 0x7f1cf0159f10 2023-10-06T02:52:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf5188700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1cf0068cc0 0x7f1cf00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1ceffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0159f10 0x7f1cf0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf4987700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f1cf0159b40 0x7f1cf00cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:49466/0 (socket says 172.21.15.81:49466) 2023-10-06T02:52:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf4987700 1 -- 172.21.15.81:0/953636057 learned_addr learned my addr 172.21.15.81:0/953636057 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf5188700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1cf0068cc0 0x7f1cf00cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:60654/0 (socket says 172.21.15.81:60654) 2023-10-06T02:52:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1ceffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0159f10 0x7f1cf0068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:37912/0 (socket says 172.21.15.81:37912) 2023-10-06T02:52:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1ceffff700 1 -- 172.21.15.81:0/953636057 >> v2:172.21.15.83:3300/0 conn(0x7f1cf0068cc0 msgr2=0x7f1cf00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1ceffff700 1 --2- 172.21.15.81:0/953636057 >> v2:172.21.15.83:3300/0 conn(0x7f1cf0068cc0 0x7f1cf00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1ceffff700 1 -- 172.21.15.81:0/953636057 >> v1:172.21.15.83:6789/0 conn(0x7f1cf0159b40 legacy=0x7f1cf00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1ceffff700 1 -- 172.21.15.81:0/953636057 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf00cd320 con 0x7f1cf0159f10 2023-10-06T02:52:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.161+0000 7f1cf5188700 1 --2- 172.21.15.81:0/953636057 >> v2:172.21.15.83:3300/0 conn(0x7f1cf0068cc0 0x7f1cf00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1ceffff700 1 --2- 172.21.15.81:0/953636057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0159f10 0x7f1cf0068780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0098e0 tx=0x7f1cdc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd4f595373a8efb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cef7fe700 1 -- 172.21.15.81:0/953636057 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00b640 con 0x7f1cf0159f10 2023-10-06T02:52:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cef7fe700 1 -- 172.21.15.81:0/953636057 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc00b7a0 con 0x7f1cf0159f10 2023-10-06T02:52:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cef7fe700 1 -- 172.21.15.81:0/953636057 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00bb40 con 0x7f1cf0159f10 2023-10-06T02:52:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cf5989700 1 -- 172.21.15.81:0/953636057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0159f10 msgr2=0x7f1cf0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cf5989700 1 --2- 172.21.15.81:0/953636057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0159f10 0x7f1cf0068780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0098e0 tx=0x7f1cdc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cf5989700 1 -- 172.21.15.81:0/953636057 shutdown_connections 2023-10-06T02:52:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cf5989700 1 --2- 172.21.15.81:0/953636057 >> v2:172.21.15.83:3300/0 conn(0x7f1cf0068cc0 0x7f1cf00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cf5989700 1 --2- 172.21.15.81:0/953636057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0159f10 0x7f1cf0068780 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cf5989700 1 -- 172.21.15.81:0/953636057 >> 172.21.15.81:0/953636057 conn(0x7f1cf00cd660 msgr2=0x7f1cf00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cf5989700 1 -- 172.21.15.81:0/953636057 shutdown_connections 2023-10-06T02:52:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.162+0000 7f1cf5989700 1 -- 172.21.15.81:0/953636057 wait complete. 2023-10-06T02:52:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.163+0000 7f1cf5989700 1 Processor -- start 2023-10-06T02:52:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.164+0000 7f1cf5989700 1 -- start start 2023-10-06T02:52:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.164+0000 7f1cf5989700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0068cc0 0x7f1cf016d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.164+0000 7f1cf5989700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cf0159b40 0x7f1cf015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.164+0000 7f1cf5989700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf0159f10 0x7f1cf01485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.164+0000 7f1cf5989700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0149b10 con 0x7f1cf0159f10 2023-10-06T02:52:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.164+0000 7f1cf5989700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf016de80 con 0x7f1cf0159b40 2023-10-06T02:52:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.164+0000 7f1cf5989700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00c7ed0 con 0x7f1cf0068cc0 2023-10-06T02:52:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5188700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf0159f10 0x7f1cf01485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5188700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf0159f10 0x7f1cf01485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49496/0 (socket says 172.21.15.81:49496) 2023-10-06T02:52:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5188700 1 -- 172.21.15.81:0/3329099710 learned_addr learned my addr 172.21.15.81:0/3329099710 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf4987700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0068cc0 0x7f1cf016d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1ceffff700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cf0159b40 0x7f1cf015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5188700 1 -- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0068cc0 msgr2=0x7f1cf016d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5188700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0068cc0 0x7f1cf016d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5188700 1 -- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cf0159b40 msgr2=0x7f1cf015bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5188700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cf0159b40 0x7f1cf015bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5188700 1 -- 172.21.15.81:0/3329099710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce8009a20 con 0x7f1cf0159f10 2023-10-06T02:52:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5188700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf0159f10 0x7f1cf01485e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800c0f0 tx=0x7f1ce800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cecff9700 1 -- 172.21.15.81:0/3329099710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce800cc30 con 0x7f1cf0159f10 2023-10-06T02:52:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cecff9700 1 -- 172.21.15.81:0/3329099710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce800f040 con 0x7f1cf0159f10 2023-10-06T02:52:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc009420 con 0x7f1cf0159f10 2023-10-06T02:52:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cecff9700 1 -- 172.21.15.81:0/3329099710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8014480 con 0x7f1cf0159f10 2023-10-06T02:52:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.165+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf016e390 con 0x7f1cf0159f10 2023-10-06T02:52:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.166+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf00c7ca0 con 0x7f1cf0159f10 2023-10-06T02:52:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.167+0000 7f1cecff9700 1 -- 172.21.15.81:0/3329099710 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ce8003020 con 0x7f1cf0159f10 2023-10-06T02:52:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.167+0000 7f1cecff9700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.167+0000 7f1cecff9700 1 -- 172.21.15.81:0/3329099710 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ce8084fa0 con 0x7f1cf0159f10 2023-10-06T02:52:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.167+0000 7f1cf4987700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.167+0000 7f1cf4987700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4004fc0 tx=0x7f1ce4007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.171+0000 7f1cecff9700 1 -- 172.21.15.81:0/3329099710 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cf00c7ca0 con 0x7f1cf0159f10 2023-10-06T02:52:12.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.395+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cf00c7ca0 con 0x7f1cf0159f10 2023-10-06T02:52:12.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.396+0000 7f1cecff9700 1 -- 172.21.15.81:0/3329099710 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f1cf00c7ca0 con 0x7f1cf0159f10 2023-10-06T02:52:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:12.398 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3448648390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3448648390},{"type":"v1","addr":"172.21.15.83:6836","nonce":3448648390}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/259812660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":259812660},{"type":"v1","addr":"172.21.15.83:6837","nonce":259812660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4011741221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4011741221},{"type":"v1","addr":"172.21.15.81:6834","nonce":4011741221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:53.060344+0000","modified":"2023-10-06T02:51:56.712953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/3211565547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3211565547},{"type":"v1","addr":"172.21.15.81:6835","nonce":3211565547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:52:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd4066f30 msgr2=0x7f1cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4004fc0 tx=0x7f1ce4007eb0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf0159f10 msgr2=0x7f1cf01485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf0159f10 0x7f1cf01485e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800c0f0 tx=0x7f1ce800b040 comp rx=0 tx=0).stop 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 shutdown_connections 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf0159f10 0x7f1cf01485e0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cf0068cc0 0x7f1cf016d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 --2- 172.21.15.81:0/3329099710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cf0159b40 0x7f1cf015bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 >> 172.21.15.81:0/3329099710 conn(0x7f1cf00cd660 msgr2=0x7f1cf006e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 shutdown_connections 2023-10-06T02:52:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.398+0000 7f1cf5989700 1 -- 172.21.15.81:0/3329099710 wait complete. 2023-10-06T02:52:12.401 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2023-10-06T02:52:12.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:52:12.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.524+0000 7f1318255700 1 Processor -- start 2023-10-06T02:52:12.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.524+0000 7f1318255700 1 -- start start 2023-10-06T02:52:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.525+0000 7f1318255700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f131006d830 0x7f13100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.525+0000 7f1318255700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100d07c0 con 0x7f1310157ca0 2023-10-06T02:52:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.525+0000 7f1318255700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100cfbb0 con 0x7f13101578d0 2023-10-06T02:52:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.525+0000 7f1318255700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100cfe90 con 0x7f131006d830 2023-10-06T02:52:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.525+0000 7f13157f0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1310157ca0 0x7f131006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43184/0 (socket says 172.21.15.81:43184) 2023-10-06T02:52:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.525+0000 7f13157f0700 1 -- 172.21.15.81:0/2903964264 learned_addr learned my addr 172.21.15.81:0/2903964264 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.525+0000 7f13167f2700 1 --2- 172.21.15.81:0/2903964264 >> v2:172.21.15.83:3300/0 conn(0x7f131006d830 0x7f13100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f1314fef700 1 -- 172.21.15.81:0/2903964264 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826950751 0 0) 0x7f13100d07c0 con 0x7f1310157ca0 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f1314fef700 1 -- 172.21.15.81:0/2903964264 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12fc003570 con 0x7f1310157ca0 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f1314fef700 1 -- 172.21.15.81:0/2903964264 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461432109 0 0) 0x7f13100cfbb0 con 0x7f13101578d0 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f1314fef700 1 -- 172.21.15.81:0/2903964264 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13100d07c0 con 0x7f13101578d0 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f1314fef700 1 -- 172.21.15.81:0/2903964264 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 11407327 0 0) 0x7f12fc003570 con 0x7f1310157ca0 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f13167f2700 1 -- 172.21.15.81:0/2903964264 >> v1:172.21.15.83:6789/0 conn(0x7f13101578d0 legacy=0x7f131015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f13167f2700 1 -- 172.21.15.81:0/2903964264 >> v1:172.21.15.81:6789/0 conn(0x7f1310157ca0 legacy=0x7f131006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f13167f2700 1 -- 172.21.15.81:0/2903964264 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13100d0170 con 0x7f131006d830 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f13167f2700 1 --2- 172.21.15.81:0/2903964264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f131006d830 0x7f13100cf4f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f13080098e0 tx=0x7f13080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fda979470c226ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f1314fef700 1 -- 172.21.15.81:0/2903964264 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300001470 con 0x7f131006d830 2023-10-06T02:52:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f1314fef700 1 -- 172.21.15.81:0/2903964264 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308011420 con 0x7f131006d830 2023-10-06T02:52:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.526+0000 7f1314fef700 1 -- 172.21.15.81:0/2903964264 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080117c0 con 0x7f131006d830 2023-10-06T02:52:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.527+0000 7f1318255700 1 -- 172.21.15.81:0/2903964264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f131006d830 msgr2=0x7f13100cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.527+0000 7f1318255700 1 --2- 172.21.15.81:0/2903964264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f131006d830 0x7f13100cf4f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f13080098e0 tx=0x7f13080091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.527+0000 7f1318255700 1 -- 172.21.15.81:0/2903964264 shutdown_connections 2023-10-06T02:52:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.527+0000 7f1318255700 1 --2- 172.21.15.81:0/2903964264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f131006d830 0x7f13100cf4f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.527+0000 7f1318255700 1 -- 172.21.15.81:0/2903964264 >> 172.21.15.81:0/2903964264 conn(0x7f131006bb90 msgr2=0x7f131006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.527+0000 7f1318255700 1 -- 172.21.15.81:0/2903964264 shutdown_connections 2023-10-06T02:52:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.527+0000 7f1318255700 1 -- 172.21.15.81:0/2903964264 wait complete. 2023-10-06T02:52:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.528+0000 7f1318255700 1 Processor -- start 2023-10-06T02:52:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.528+0000 7f1318255700 1 -- start start 2023-10-06T02:52:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1318255700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131006d830 0x7f13100c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1318255700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13101578d0 0x7f131016bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1318255700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1310157ca0 0x7f1310155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1318255700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131016ba80 con 0x7f131006d830 2023-10-06T02:52:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1318255700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13100c62a0 con 0x7f1310157ca0 2023-10-06T02:52:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1318255700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131016b7a0 con 0x7f13101578d0 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1315ff1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131006d830 0x7f13100c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1315ff1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131006d830 0x7f13100c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49502/0 (socket says 172.21.15.81:49502) 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1315ff1700 1 -- 172.21.15.81:0/3788393134 learned_addr learned my addr 172.21.15.81:0/3788393134 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f13167f2700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1310157ca0 0x7f1310155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1315ff1700 1 -- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13101578d0 msgr2=0x7f131016bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f13157f0700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13101578d0 0x7f131016bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1315ff1700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13101578d0 0x7f131016bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1315ff1700 1 -- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1310157ca0 msgr2=0x7f1310155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1315ff1700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1310157ca0 0x7f1310155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1315ff1700 1 -- 172.21.15.81:0/3788393134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1308009420 con 0x7f131006d830 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1315ff1700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131006d830 0x7f13100c86a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f130c00cb40 tx=0x7f130c002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1305ffb700 1 -- 172.21.15.81:0/3788393134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00a7a0 con 0x7f131006d830 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1305ffb700 1 -- 172.21.15.81:0/3788393134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c00a900 con 0x7f131006d830 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13100c5c50 con 0x7f131006d830 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.529+0000 7f1305ffb700 1 -- 172.21.15.81:0/3788393134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00aca0 con 0x7f131006d830 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.530+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131016c1c0 con 0x7f131006d830 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.531+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1310067ac0 con 0x7f131006d830 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.531+0000 7f1305ffb700 1 -- 172.21.15.81:0/3788393134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f130c012630 con 0x7f131006d830 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.531+0000 7f1305ffb700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12f4066f30 0x7f12f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.531+0000 7f1305ffb700 1 -- 172.21.15.81:0/3788393134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f130c084ac0 con 0x7f131006d830 2023-10-06T02:52:12.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.531+0000 7f13157f0700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12f4066f30 0x7f12f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.532+0000 7f13157f0700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12f4066f30 0x7f12f40693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f13100b62e0 tx=0x7f1300009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:12.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.535+0000 7f1305ffb700 1 -- 172.21.15.81:0/3788393134 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f130c051bd0 con 0x7f131006d830 2023-10-06T02:52:12.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.717+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13100d0450 con 0x7f131006d830 2023-10-06T02:52:12.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.718+0000 7f1305ffb700 1 -- 172.21.15.81:0/3788393134 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16841 (secure 0 0 0) 0x7f130c084e60 con 0x7f131006d830 2023-10-06T02:52:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:12.720 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":123,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:07.441658+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:51:50.714217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T02:51:52.027875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:52:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.720+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12f4066f30 msgr2=0x7f12f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.720+0000 7f1318255700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12f4066f30 0x7f12f40693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f13100b62e0 tx=0x7f1300009040 comp rx=0 tx=0).stop 2023-10-06T02:52:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.720+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131006d830 msgr2=0x7f13100c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.720+0000 7f1318255700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131006d830 0x7f13100c86a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f130c00cb40 tx=0x7f130c002820 comp rx=0 tx=0).stop 2023-10-06T02:52:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.720+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 shutdown_connections 2023-10-06T02:52:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.720+0000 7f1318255700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12f4066f30 0x7f12f40693e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.720+0000 7f1318255700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1310157ca0 0x7f1310155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.720+0000 7f1318255700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131006d830 0x7f13100c86a0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.720+0000 7f1318255700 1 --2- 172.21.15.81:0/3788393134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13101578d0 0x7f131016bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.721+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 >> 172.21.15.81:0/3788393134 conn(0x7f131006bb90 msgr2=0x7f1310069970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.721+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 shutdown_connections 2023-10-06T02:52:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.721+0000 7f1318255700 1 -- 172.21.15.81:0/3788393134 wait complete. 2023-10-06T02:52:12.733 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:52:12.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.847+0000 7fac30c18700 1 Processor -- start 2023-10-06T02:52:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.847+0000 7fac30c18700 1 -- start start 2023-10-06T02:52:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.848+0000 7fac30c18700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac2c156420 0x7fac2c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.848+0000 7fac30c18700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac2c0c71d0 0x7fac2c0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.848+0000 7fac30c18700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0c7b70 con 0x7fac2c0cc250 2023-10-06T02:52:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.848+0000 7fac30c18700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c06aa10 con 0x7fac2c0c71d0 2023-10-06T02:52:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.848+0000 7fac30c18700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c0cb880 con 0x7fac2c156420 2023-10-06T02:52:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.848+0000 7fac2ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac2c0c71d0 0x7fac2c0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.848+0000 7fac21d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fac2c0cc250 0x7fac2c069440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43190/0 (socket says 172.21.15.81:43190) 2023-10-06T02:52:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.848+0000 7fac21d9b700 1 -- 172.21.15.81:0/2135967165 learned_addr learned my addr 172.21.15.81:0/2135967165 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac2a59c700 1 --2- 172.21.15.81:0/2135967165 >> v2:172.21.15.83:3300/0 conn(0x7fac2c156420 0x7fac2c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac2ad9d700 1 -- 172.21.15.81:0/2135967165 >> v2:172.21.15.83:3300/0 conn(0x7fac2c156420 msgr2=0x7fac2c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac2ad9d700 1 --2- 172.21.15.81:0/2135967165 >> v2:172.21.15.83:3300/0 conn(0x7fac2c156420 0x7fac2c0cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac2ad9d700 1 -- 172.21.15.81:0/2135967165 >> v1:172.21.15.81:6789/0 conn(0x7fac2c0cc250 legacy=0x7fac2c069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac2ad9d700 1 -- 172.21.15.81:0/2135967165 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c0cac70 con 0x7fac2c0c71d0 2023-10-06T02:52:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac2ad9d700 1 --2- 172.21.15.81:0/2135967165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0c71d0 0x7fac2c0c7630 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0c39e0 tx=0x7fac24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e950009f6187818 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac29d9b700 1 -- 172.21.15.81:0/2135967165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400e070 con 0x7fac2c0c71d0 2023-10-06T02:52:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac29d9b700 1 -- 172.21.15.81:0/2135967165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2400bc30 con 0x7fac2c0c71d0 2023-10-06T02:52:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac29d9b700 1 -- 172.21.15.81:0/2135967165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24012430 con 0x7fac2c0c71d0 2023-10-06T02:52:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac30c18700 1 -- 172.21.15.81:0/2135967165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0c71d0 msgr2=0x7fac2c0c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac30c18700 1 --2- 172.21.15.81:0/2135967165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0c71d0 0x7fac2c0c7630 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0c39e0 tx=0x7fac24009780 comp rx=0 tx=0).stop 2023-10-06T02:52:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac30c18700 1 -- 172.21.15.81:0/2135967165 shutdown_connections 2023-10-06T02:52:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac30c18700 1 --2- 172.21.15.81:0/2135967165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0c71d0 0x7fac2c0c7630 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac30c18700 1 --2- 172.21.15.81:0/2135967165 >> v2:172.21.15.83:3300/0 conn(0x7fac2c156420 0x7fac2c0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac30c18700 1 -- 172.21.15.81:0/2135967165 >> 172.21.15.81:0/2135967165 conn(0x7fac2c06c660 msgr2=0x7fac2c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac30c18700 1 -- 172.21.15.81:0/2135967165 shutdown_connections 2023-10-06T02:52:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.849+0000 7fac30c18700 1 -- 172.21.15.81:0/2135967165 wait complete. 2023-10-06T02:52:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac30c18700 1 Processor -- start 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac30c18700 1 -- start start 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac30c18700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac2c0c71d0 0x7fac2c167750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac30c18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0cc250 0x7fac2c0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac30c18700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac2c156420 0x7fac2c0c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac30c18700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c1483a0 con 0x7fac2c0cc250 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac30c18700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c167c90 con 0x7fac2c156420 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac30c18700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c147790 con 0x7fac2c0c71d0 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac21d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0cc250 0x7fac2c0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac21d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0cc250 0x7fac2c0c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49514/0 (socket says 172.21.15.81:49514) 2023-10-06T02:52:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.851+0000 7fac21d9b700 1 -- 172.21.15.81:0/1232133490 learned_addr learned my addr 172.21.15.81:0/1232133490 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac2ad9d700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac2c156420 0x7fac2c0c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac2a59c700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac2c0c71d0 0x7fac2c167750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac21d9b700 1 -- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac2c0c71d0 msgr2=0x7fac2c167750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac21d9b700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac2c0c71d0 0x7fac2c167750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac21d9b700 1 -- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac2c156420 msgr2=0x7fac2c0c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac21d9b700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac2c156420 0x7fac2c0c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac21d9b700 1 -- 172.21.15.81:0/1232133490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24009a20 con 0x7fac2c0cc250 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac21d9b700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0cc250 0x7fac2c0c5c40 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c7c0 tx=0x7fac14007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac22ffd700 1 -- 172.21.15.81:0/1232133490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14005b30 con 0x7fac2c0cc250 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac22ffd700 1 -- 172.21.15.81:0/1232133490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14005c90 con 0x7fac2c0cc250 2023-10-06T02:52:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c147a70 con 0x7fac2c0cc250 2023-10-06T02:52:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac22ffd700 1 -- 172.21.15.81:0/1232133490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14004a80 con 0x7fac2c0cc250 2023-10-06T02:52:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.852+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c148030 con 0x7fac2c0cc250 2023-10-06T02:52:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.853+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c0cbbf0 con 0x7fac2c0cc250 2023-10-06T02:52:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.853+0000 7fac22ffd700 1 -- 172.21.15.81:0/1232133490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac140070d0 con 0x7fac2c0cc250 2023-10-06T02:52:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.854+0000 7fac22ffd700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac0c066f30 0x7fac0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.854+0000 7fac22ffd700 1 -- 172.21.15.81:0/1232133490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fac140837e0 con 0x7fac2c0cc250 2023-10-06T02:52:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.854+0000 7fac2a59c700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac0c066f30 0x7fac0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.854+0000 7fac2a59c700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac0c066f30 0x7fac0c0693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fac1c006b00 tx=0x7fac1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:12.858+0000 7fac22ffd700 1 -- 172.21.15.81:0/1232133490 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac1404b5a0 con 0x7fac2c0cc250 2023-10-06T02:52:13.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.084+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac2c0c7b70 con 0x7fac2c0cc250 2023-10-06T02:52:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.085+0000 7fac22ffd700 1 -- 172.21.15.81:0/1232133490 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fac2c0c7b70 con 0x7fac2c0cc250 2023-10-06T02:52:13.086 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:13.086 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3448648390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3448648390},{"type":"v1","addr":"172.21.15.83:6836","nonce":3448648390}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/259812660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":259812660},{"type":"v1","addr":"172.21.15.83:6837","nonce":259812660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4011741221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4011741221},{"type":"v1","addr":"172.21.15.81:6834","nonce":4011741221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:53.060344+0000","modified":"2023-10-06T02:51:56.712953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/3211565547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3211565547},{"type":"v1","addr":"172.21.15.81:6835","nonce":3211565547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:52:13.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac0c066f30 msgr2=0x7fac0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac0c066f30 0x7fac0c0693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fac1c006b00 tx=0x7fac1c008040 comp rx=0 tx=0).stop 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0cc250 msgr2=0x7fac2c0c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0cc250 0x7fac2c0c5c40 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c7c0 tx=0x7fac14007f70 comp rx=0 tx=0).stop 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 shutdown_connections 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fac0c066f30 0x7fac0c0693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac2c156420 0x7fac2c0c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac2c0c71d0 0x7fac2c167750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 --2- 172.21.15.81:0/1232133490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c0cc250 0x7fac2c0c5c40 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 >> 172.21.15.81:0/1232133490 conn(0x7fac2c06c660 msgr2=0x7fac2c06d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 shutdown_connections 2023-10-06T02:52:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.087+0000 7fac30c18700 1 -- 172.21.15.81:0/1232133490 wait complete. 2023-10-06T02:52:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2023-10-06T02:52:13.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:13.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.214+0000 7fccb5959700 1 Processor -- start 2023-10-06T02:52:13.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.214+0000 7fccb5959700 1 -- start start 2023-10-06T02:52:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccb5959700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb01578d0 0x7fccb00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccb5959700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fccb0157ca0 0x7fccb015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccb5959700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fccb006d120 0x7fccb006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccb5959700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb006dac0 con 0x7fccb0157ca0 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccb5959700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb00d07c0 con 0x7fccb006d120 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccb5959700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00cfbb0 con 0x7fccb01578d0 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccae7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fccb0157ca0 0x7fccb015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccae7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fccb0157ca0 0x7fccb015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49530/0 (socket says 172.21.15.81:49530) 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccae7fc700 1 -- 172.21.15.81:0/1277697049 learned_addr learned my addr 172.21.15.81:0/1277697049 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccaeffd700 1 --2- 172.21.15.81:0/1277697049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb01578d0 0x7fccb00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccaf7fe700 1 --2- 172.21.15.81:0/1277697049 >> v2:172.21.15.83:3300/0 conn(0x7fccb006d120 0x7fccb006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccae7fc700 1 -- 172.21.15.81:0/1277697049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb01578d0 msgr2=0x7fccb00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccae7fc700 1 --2- 172.21.15.81:0/1277697049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb01578d0 0x7fccb00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccae7fc700 1 -- 172.21.15.81:0/1277697049 >> v2:172.21.15.83:3300/0 conn(0x7fccb006d120 msgr2=0x7fccb006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccae7fc700 1 --2- 172.21.15.81:0/1277697049 >> v2:172.21.15.83:3300/0 conn(0x7fccb006d120 0x7fccb006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccae7fc700 1 -- 172.21.15.81:0/1277697049 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00cfe90 con 0x7fccb0157ca0 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccaf7fe700 1 --2- 172.21.15.81:0/1277697049 >> v2:172.21.15.83:3300/0 conn(0x7fccb006d120 0x7fccb006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccaeffd700 1 --2- 172.21.15.81:0/1277697049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb01578d0 0x7fccb00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccae7fc700 1 --2- 172.21.15.81:0/1277697049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb0157ca0 0x7fccb015af00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fccb00b3940 tx=0x7fcc98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e56d4931420116 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.215+0000 7fccadffb700 1 -- 172.21.15.81:0/1277697049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800b860 con 0x7fccb0157ca0 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccadffb700 1 -- 172.21.15.81:0/1277697049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9800b9c0 con 0x7fccb0157ca0 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccadffb700 1 -- 172.21.15.81:0/1277697049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800bd60 con 0x7fccb0157ca0 2023-10-06T02:52:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccb5959700 1 -- 172.21.15.81:0/1277697049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb0157ca0 msgr2=0x7fccb015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccb5959700 1 --2- 172.21.15.81:0/1277697049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb0157ca0 0x7fccb015af00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fccb00b3940 tx=0x7fcc98009250 comp rx=0 tx=0).stop 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccb5959700 1 -- 172.21.15.81:0/1277697049 shutdown_connections 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccb5959700 1 --2- 172.21.15.81:0/1277697049 >> v2:172.21.15.83:3300/0 conn(0x7fccb006d120 0x7fccb006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccb5959700 1 --2- 172.21.15.81:0/1277697049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb01578d0 0x7fccb00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccb5959700 1 --2- 172.21.15.81:0/1277697049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb0157ca0 0x7fccb015af00 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccb5959700 1 -- 172.21.15.81:0/1277697049 >> 172.21.15.81:0/1277697049 conn(0x7fccb006bb90 msgr2=0x7fccb006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccb5959700 1 -- 172.21.15.81:0/1277697049 shutdown_connections 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.216+0000 7fccb5959700 1 -- 172.21.15.81:0/1277697049 wait complete. 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.217+0000 7fccb5959700 1 Processor -- start 2023-10-06T02:52:13.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.217+0000 7fccb5959700 1 -- start start 2023-10-06T02:52:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccb5959700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb006d120 0x7fccb014dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccb5959700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb01578d0 0x7fccb00b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccb5959700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0157ca0 0x7fccb01554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccb5959700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00b5b60 con 0x7fccb01578d0 2023-10-06T02:52:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccb5959700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00b4f50 con 0x7fccb0157ca0 2023-10-06T02:52:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccb5959700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00b5230 con 0x7fccb006d120 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccae7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb01578d0 0x7fccb00b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccae7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb01578d0 0x7fccb00b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49532/0 (socket says 172.21.15.81:49532) 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccae7fc700 1 -- 172.21.15.81:0/2336571532 learned_addr learned my addr 172.21.15.81:0/2336571532 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccaeffd700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb006d120 0x7fccb014dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccaf7fe700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0157ca0 0x7fccb01554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccae7fc700 1 -- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb006d120 msgr2=0x7fccb014dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccae7fc700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb006d120 0x7fccb014dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccae7fc700 1 -- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0157ca0 msgr2=0x7fccb01554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccae7fc700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0157ca0 0x7fccb01554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.218+0000 7fccae7fc700 1 -- 172.21.15.81:0/2336571532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980094f0 con 0x7fccb01578d0 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.219+0000 7fccae7fc700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb01578d0 0x7fccb00b4560 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fccb006fe20 tx=0x7fcc98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.219+0000 7fcca6ffd700 1 -- 172.21.15.81:0/2336571532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98024440 con 0x7fccb01578d0 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.219+0000 7fcca6ffd700 1 -- 172.21.15.81:0/2336571532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc980245a0 con 0x7fccb01578d0 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.219+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb00b5510 con 0x7fccb01578d0 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.219+0000 7fcca6ffd700 1 -- 172.21.15.81:0/2336571532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98024960 con 0x7fccb01578d0 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.219+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb014e0e0 con 0x7fccb01578d0 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.220+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb014e800 con 0x7fccb01578d0 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.220+0000 7fcca6ffd700 1 -- 172.21.15.81:0/2336571532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc9801a420 con 0x7fccb01578d0 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.221+0000 7fcca6ffd700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcc90066fb0 0x7fcc90069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.221+0000 7fcca6ffd700 1 -- 172.21.15.81:0/2336571532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcc980865c0 con 0x7fccb01578d0 2023-10-06T02:52:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.221+0000 7fccaeffd700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcc90066fb0 0x7fcc90069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.221+0000 7fccaeffd700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcc90066fb0 0x7fcc90069460 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcca000ac00 tx=0x7fcca0006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.225+0000 7fcca6ffd700 1 -- 172.21.15.81:0/2336571532 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc98053630 con 0x7fccb01578d0 2023-10-06T02:52:13.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.450+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccb00d0170 con 0x7fccb01578d0 2023-10-06T02:52:13.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.450+0000 7fcca6ffd700 1 -- 172.21.15.81:0/2336571532 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fcc98056c50 con 0x7fccb01578d0 2023-10-06T02:52:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:13.452 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3448648390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3448648390},{"type":"v1","addr":"172.21.15.83:6836","nonce":3448648390}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/259812660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":259812660},{"type":"v1","addr":"172.21.15.83:6837","nonce":259812660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4011741221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4011741221},{"type":"v1","addr":"172.21.15.81:6834","nonce":4011741221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:51:53.060344+0000","modified":"2023-10-06T02:51:56.712953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/3211565547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3211565547},{"type":"v1","addr":"172.21.15.81:6835","nonce":3211565547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:52:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcc90066fb0 msgr2=0x7fcc90069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcc90066fb0 0x7fcc90069460 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcca000ac00 tx=0x7fcca0006f90 comp rx=0 tx=0).stop 2023-10-06T02:52:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb01578d0 msgr2=0x7fccb00b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb01578d0 0x7fccb00b4560 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fccb006fe20 tx=0x7fcc98017000 comp rx=0 tx=0).stop 2023-10-06T02:52:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 shutdown_connections 2023-10-06T02:52:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcc90066fb0 0x7fcc90069460 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccb0157ca0 0x7fccb01554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fccb006d120 0x7fccb014dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 --2- 172.21.15.81:0/2336571532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb01578d0 0x7fccb00b4560 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 >> 172.21.15.81:0/2336571532 conn(0x7fccb006bb90 msgr2=0x7fccb0069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 shutdown_connections 2023-10-06T02:52:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.452+0000 7fccb5959700 1 -- 172.21.15.81:0/2336571532 wait complete. 2023-10-06T02:52:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2023-10-06T02:52:13.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:52:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.578+0000 7f16d56b0700 1 Processor -- start 2023-10-06T02:52:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.578+0000 7f16d56b0700 1 -- start start 2023-10-06T02:52:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.578+0000 7f16d56b0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16d0157ca0 0x7f16d00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.578+0000 7f16d56b0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d00d07c0 con 0x7f16d006d120 2023-10-06T02:52:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.578+0000 7f16d56b0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d00cfbb0 con 0x7f16d01578d0 2023-10-06T02:52:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.578+0000 7f16d56b0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d00cfe90 con 0x7f16d0157ca0 2023-10-06T02:52:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16ce7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16d0157ca0 0x7f16d00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16cf7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f16d006d120 0x7f16d006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43206/0 (socket says 172.21.15.81:43206) 2023-10-06T02:52:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16cf7fe700 1 -- 172.21.15.81:0/4222493907 learned_addr learned my addr 172.21.15.81:0/4222493907 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16ce7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16d0157ca0 0x7f16d00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49544/0 (socket says 172.21.15.81:49544) 2023-10-06T02:52:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16ce7fc700 1 -- 172.21.15.81:0/4222493907 >> v1:172.21.15.83:6789/0 conn(0x7f16d01578d0 legacy=0x7f16d015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16ce7fc700 1 -- 172.21.15.81:0/4222493907 >> v1:172.21.15.81:6789/0 conn(0x7f16d006d120 legacy=0x7f16d006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16ce7fc700 1 -- 172.21.15.81:0/4222493907 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00d0170 con 0x7f16d0157ca0 2023-10-06T02:52:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16cdffb700 1 -- 172.21.15.81:0/4222493907 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204478752 0 0) 0x7f16d00d07c0 con 0x7f16d006d120 2023-10-06T02:52:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16ce7fc700 1 --2- 172.21.15.81:0/4222493907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d0157ca0 0x7f16d00cf4f0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f16b80098e0 tx=0x7f16b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df20bb95bf7770b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16cdffb700 1 -- 172.21.15.81:0/4222493907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8009e80 con 0x7f16d0157ca0 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16cdffb700 1 -- 172.21.15.81:0/4222493907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b800b860 con 0x7f16d0157ca0 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.579+0000 7f16cdffb700 1 -- 172.21.15.81:0/4222493907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800bbe0 con 0x7f16d0157ca0 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.580+0000 7f16d56b0700 1 -- 172.21.15.81:0/4222493907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d0157ca0 msgr2=0x7f16d00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.580+0000 7f16d56b0700 1 --2- 172.21.15.81:0/4222493907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d0157ca0 0x7f16d00cf4f0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f16b80098e0 tx=0x7f16b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.580+0000 7f16d56b0700 1 -- 172.21.15.81:0/4222493907 shutdown_connections 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.580+0000 7f16d56b0700 1 --2- 172.21.15.81:0/4222493907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d0157ca0 0x7f16d00cf4f0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.580+0000 7f16d56b0700 1 -- 172.21.15.81:0/4222493907 >> 172.21.15.81:0/4222493907 conn(0x7f16d006bb90 msgr2=0x7f16d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.580+0000 7f16d56b0700 1 -- 172.21.15.81:0/4222493907 shutdown_connections 2023-10-06T02:52:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.580+0000 7f16d56b0700 1 -- 172.21.15.81:0/4222493907 wait complete. 2023-10-06T02:52:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.581+0000 7f16d56b0700 1 Processor -- start 2023-10-06T02:52:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.581+0000 7f16d56b0700 1 -- start start 2023-10-06T02:52:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16d56b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d006d120 0x7f16d00ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16d56b0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16d01578d0 0x7f16d006a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16d56b0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16d0157ca0 0x7f16d015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16d56b0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d016a910 con 0x7f16d006d120 2023-10-06T02:52:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16d56b0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00ad8e0 con 0x7f16d0157ca0 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16d56b0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d016b730 con 0x7f16d01578d0 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d006d120 0x7f16d00ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d006d120 0x7f16d00ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49546/0 (socket says 172.21.15.81:49546) 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ceffd700 1 -- 172.21.15.81:0/1483992879 learned_addr learned my addr 172.21.15.81:0/1483992879 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16cf7fe700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16d0157ca0 0x7f16d015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ce7fc700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16d01578d0 0x7f16d006a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ceffd700 1 -- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16d01578d0 msgr2=0x7f16d006a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ceffd700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16d01578d0 0x7f16d006a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ceffd700 1 -- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16d0157ca0 msgr2=0x7f16d015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ceffd700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16d0157ca0 0x7f16d015bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ceffd700 1 -- 172.21.15.81:0/1483992879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b8009420 con 0x7f16d006d120 2023-10-06T02:52:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16ceffd700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d006d120 0x7f16d00ad3a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f16c800cb10 tx=0x7f16c80017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16c6ffd700 1 -- 172.21.15.81:0/1483992879 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800ce20 con 0x7f16d006d120 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16c6ffd700 1 -- 172.21.15.81:0/1483992879 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c8006ba0 con 0x7f16d006d120 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d00abcf0 con 0x7f16d006d120 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.582+0000 7f16c6ffd700 1 -- 172.21.15.81:0/1483992879 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800a780 con 0x7f16d006d120 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.583+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d016ae80 con 0x7f16d006d120 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.583+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d0067ac0 con 0x7f16d006d120 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.584+0000 7f16c6ffd700 1 -- 172.21.15.81:0/1483992879 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16c800ab70 con 0x7f16d006d120 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.584+0000 7f16c6ffd700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16b0066f30 0x7f16b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.584+0000 7f16c6ffd700 1 -- 172.21.15.81:0/1483992879 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f16c80843c0 con 0x7f16d006d120 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.584+0000 7f16ce7fc700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16b0066f30 0x7f16b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.585+0000 7f16ce7fc700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16b0066f30 0x7f16b00693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f16d01580c0 tx=0x7f16b8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:13.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.588+0000 7f16c6ffd700 1 -- 172.21.15.81:0/1483992879 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16c80514d0 con 0x7f16d006d120 2023-10-06T02:52:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.770+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16d00d0450 con 0x7f16d006d120 2023-10-06T02:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.771+0000 7f16c6ffd700 1 -- 172.21.15.81:0/1483992879 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16841 (secure 0 0 0) 0x7f16c8054af0 con 0x7f16d006d120 2023-10-06T02:52:13.772 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:13.772 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":123,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:07.441658+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:51:50.714217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T02:51:52.027875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:52:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16b0066f30 msgr2=0x7f16b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16b0066f30 0x7f16b00693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f16d01580c0 tx=0x7f16b8017000 comp rx=0 tx=0).stop 2023-10-06T02:52:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d006d120 msgr2=0x7f16d00ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d006d120 0x7f16d00ad3a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f16c800cb10 tx=0x7f16c80017b0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 shutdown_connections 2023-10-06T02:52:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f16b0066f30 0x7f16b00693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16d0157ca0 0x7f16d015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d006d120 0x7f16d00ad3a0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 --2- 172.21.15.81:0/1483992879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16d01578d0 0x7f16d006a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 >> 172.21.15.81:0/1483992879 conn(0x7f16d006bb90 msgr2=0x7f16d015c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 shutdown_connections 2023-10-06T02:52:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.773+0000 7f16d56b0700 1 -- 172.21.15.81:0/1483992879 wait complete. 2023-10-06T02:52:13.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:52:13.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.900+0000 7fe640a88700 1 Processor -- start 2023-10-06T02:52:13.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.900+0000 7fe640a88700 1 -- start start 2023-10-06T02:52:13.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe640a88700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c1578d0 0x7fe63c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe640a88700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe63c157ca0 0x7fe63c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe640a88700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c0d07c0 con 0x7fe63c06d120 2023-10-06T02:52:13.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe640a88700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c0cfbb0 con 0x7fe63c157ca0 2023-10-06T02:52:13.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe640a88700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0cfe90 con 0x7fe63c1578d0 2023-10-06T02:52:13.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe639d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe63c157ca0 0x7fe63c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe63ad9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe63c06d120 0x7fe63c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43212/0 (socket says 172.21.15.81:43212) 2023-10-06T02:52:13.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe63ad9d700 1 -- 172.21.15.81:0/3215519359 learned_addr learned my addr 172.21.15.81:0/3215519359 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:13.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe639d9b700 1 -- 172.21.15.81:0/3215519359 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c1578d0 msgr2=0x7fe63c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:13.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe63a59c700 1 --2- 172.21.15.81:0/3215519359 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c1578d0 0x7fe63c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe63959a700 1 -- 172.21.15.81:0/3215519359 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531908516 0 0) 0x7fe63c0d07c0 con 0x7fe63c06d120 2023-10-06T02:52:13.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe639d9b700 1 --2- 172.21.15.81:0/3215519359 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c1578d0 0x7fe63c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe639d9b700 1 -- 172.21.15.81:0/3215519359 >> v1:172.21.15.81:6789/0 conn(0x7fe63c06d120 legacy=0x7fe63c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe639d9b700 1 -- 172.21.15.81:0/3215519359 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c0d0170 con 0x7fe63c157ca0 2023-10-06T02:52:13.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe639d9b700 1 --2- 172.21.15.81:0/3215519359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c157ca0 0x7fe63c15af00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe6300098e0 tx=0x7fe6300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3b3d48237ef1d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:13.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe63959a700 1 -- 172.21.15.81:0/3215519359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630009e80 con 0x7fe63c157ca0 2023-10-06T02:52:13.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe63959a700 1 -- 172.21.15.81:0/3215519359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000b860 con 0x7fe63c157ca0 2023-10-06T02:52:13.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.901+0000 7fe63959a700 1 -- 172.21.15.81:0/3215519359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000bbe0 con 0x7fe63c157ca0 2023-10-06T02:52:13.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.902+0000 7fe640a88700 1 -- 172.21.15.81:0/3215519359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c157ca0 msgr2=0x7fe63c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.902+0000 7fe640a88700 1 --2- 172.21.15.81:0/3215519359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c157ca0 0x7fe63c15af00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe6300098e0 tx=0x7fe6300091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.902+0000 7fe640a88700 1 -- 172.21.15.81:0/3215519359 shutdown_connections 2023-10-06T02:52:13.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.902+0000 7fe640a88700 1 --2- 172.21.15.81:0/3215519359 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c1578d0 0x7fe63c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.902+0000 7fe640a88700 1 --2- 172.21.15.81:0/3215519359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c157ca0 0x7fe63c15af00 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.902+0000 7fe640a88700 1 -- 172.21.15.81:0/3215519359 >> 172.21.15.81:0/3215519359 conn(0x7fe63c06bb90 msgr2=0x7fe63c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:13.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.902+0000 7fe640a88700 1 -- 172.21.15.81:0/3215519359 shutdown_connections 2023-10-06T02:52:13.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.902+0000 7fe640a88700 1 -- 172.21.15.81:0/3215519359 wait complete. 2023-10-06T02:52:13.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.903+0000 7fe640a88700 1 Processor -- start 2023-10-06T02:52:13.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.903+0000 7fe640a88700 1 -- start start 2023-10-06T02:52:13.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe640a88700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c06d120 0x7fe63c159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe640a88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c1578d0 0x7fe63c149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe640a88700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c157ca0 0x7fe63c156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe640a88700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0c7270 con 0x7fe63c1578d0 2023-10-06T02:52:13.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe640a88700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0c6660 con 0x7fe63c06d120 2023-10-06T02:52:13.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe640a88700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0c6940 con 0x7fe63c157ca0 2023-10-06T02:52:13.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe639d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c1578d0 0x7fe63c149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe639d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c1578d0 0x7fe63c149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49574/0 (socket says 172.21.15.81:49574) 2023-10-06T02:52:13.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe639d9b700 1 -- 172.21.15.81:0/2034701864 learned_addr learned my addr 172.21.15.81:0/2034701864 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:13.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe63a59c700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c06d120 0x7fe63c159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe63ad9d700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c157ca0 0x7fe63c156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe639d9b700 1 -- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c157ca0 msgr2=0x7fe63c156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe639d9b700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c157ca0 0x7fe63c156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe639d9b700 1 -- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c06d120 msgr2=0x7fe63c159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:13.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe639d9b700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c06d120 0x7fe63c159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:13.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe639d9b700 1 -- 172.21.15.81:0/2034701864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009420 con 0x7fe63c1578d0 2023-10-06T02:52:13.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe63a59c700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c06d120 0x7fe63c159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:13.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe63ad9d700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c157ca0 0x7fe63c156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:13.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.904+0000 7fe639d9b700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c1578d0 0x7fe63c149700 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe63c06fe20 tx=0x7fe630017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:13.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.905+0000 7fe62a7fc700 1 -- 172.21.15.81:0/2034701864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000bbe0 con 0x7fe63c1578d0 2023-10-06T02:52:13.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.905+0000 7fe62a7fc700 1 -- 172.21.15.81:0/2034701864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630011420 con 0x7fe63c1578d0 2023-10-06T02:52:13.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.905+0000 7fe62a7fc700 1 -- 172.21.15.81:0/2034701864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6300117c0 con 0x7fe63c1578d0 2023-10-06T02:52:13.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.905+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c0c6c20 con 0x7fe63c1578d0 2023-10-06T02:52:13.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.905+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c1595c0 con 0x7fe63c1578d0 2023-10-06T02:52:13.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.906+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c0c7420 con 0x7fe63c1578d0 2023-10-06T02:52:13.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.906+0000 7fe62a7fc700 1 -- 172.21.15.81:0/2034701864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe630011bb0 con 0x7fe63c1578d0 2023-10-06T02:52:13.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.906+0000 7fe62a7fc700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe61c066f30 0x7fe61c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:13.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.907+0000 7fe62a7fc700 1 -- 172.21.15.81:0/2034701864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe630085d30 con 0x7fe63c1578d0 2023-10-06T02:52:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.907+0000 7fe63a59c700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe61c066f30 0x7fe61c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.907+0000 7fe63a59c700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe61c066f30 0x7fe61c0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe63c06a840 tx=0x7fe62c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:13.911+0000 7fe62a7fc700 1 -- 172.21.15.81:0/2034701864 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe63c0c7420 con 0x7fe63c1578d0 2023-10-06T02:52:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.136+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe63c0c73b0 con 0x7fe63c1578d0 2023-10-06T02:52:14.137 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:52:14.136+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:52:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.141+0000 7fe62a7fc700 1 -- 172.21.15.81:0/2034701864 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe630011e60 con 0x7fe63c1578d0 2023-10-06T02:52:14.144 INFO:tasks.ceph.mds.c.smithi081.stderr: -3442> 2023-10-06T02:51:57.984+0000 7f32e23d4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:52:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe61c066f30 msgr2=0x7fe61c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe61c066f30 0x7fe61c0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe63c06a840 tx=0x7fe62c008040 comp rx=0 tx=0).stop 2023-10-06T02:52:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c1578d0 msgr2=0x7fe63c149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c1578d0 0x7fe63c149700 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe63c06fe20 tx=0x7fe630017000 comp rx=0 tx=0).stop 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 shutdown_connections 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe63c157ca0 0x7fe63c156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe61c066f30 0x7fe61c0693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c06d120 0x7fe63c159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 --2- 172.21.15.81:0/2034701864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c1578d0 0x7fe63c149700 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.143+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 >> 172.21.15.81:0/2034701864 conn(0x7fe63c06bb90 msgr2=0x7fe63c15a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.144+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 shutdown_connections 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.144+0000 7fe640a88700 1 -- 172.21.15.81:0/2034701864 wait complete. 2023-10-06T02:52:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:52:14.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:52:14.168 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:52:14.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.272+0000 7f4728aff700 1 Processor -- start 2023-10-06T02:52:14.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.272+0000 7f4728aff700 1 -- start start 2023-10-06T02:52:14.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f4728aff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47240d0b80 0x7f47240cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:14.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f4728aff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 0x7f472415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:14.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f4728aff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240cf2d0 con 0x7f47240d02b0 2023-10-06T02:52:14.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f4728aff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472415a690 con 0x7f47240d0b80 2023-10-06T02:52:14.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f4728aff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472406dc00 con 0x7f472406d700 2023-10-06T02:52:14.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f47237fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47240d0b80 0x7f47240cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:14.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f4722ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f47240d02b0 0x7f472406cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43230/0 (socket says 172.21.15.81:43230) 2023-10-06T02:52:14.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f4722ffd700 1 -- 172.21.15.81:0/1597327804 learned_addr learned my addr 172.21.15.81:0/1597327804 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f4723fff700 1 --2- 172.21.15.81:0/1597327804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 0x7f472415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f47237fe700 1 -- 172.21.15.81:0/1597327804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 msgr2=0x7f472415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f47237fe700 1 --2- 172.21.15.81:0/1597327804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 0x7f472415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f47237fe700 1 -- 172.21.15.81:0/1597327804 >> v1:172.21.15.81:6789/0 conn(0x7f47240d02b0 legacy=0x7f472406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f47227fc700 1 -- 172.21.15.81:0/1597327804 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240508084 0 0) 0x7f47240cf2d0 con 0x7f47240d02b0 2023-10-06T02:52:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f47237fe700 1 -- 172.21.15.81:0/1597327804 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240cf570 con 0x7f47240d0b80 2023-10-06T02:52:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.273+0000 7f47237fe700 1 --2- 172.21.15.81:0/1597327804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d0b80 0x7f47240cfd70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f4714009e60 tx=0x7f4714009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5290370529d8d1bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f47227fc700 1 -- 172.21.15.81:0/1597327804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400e070 con 0x7f47240d0b80 2023-10-06T02:52:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f47227fc700 1 -- 172.21.15.81:0/1597327804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471400bb60 con 0x7f47240d0b80 2023-10-06T02:52:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f47227fc700 1 -- 172.21.15.81:0/1597327804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714012430 con 0x7f47240d0b80 2023-10-06T02:52:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f4728aff700 1 -- 172.21.15.81:0/1597327804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d0b80 msgr2=0x7f47240cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f4728aff700 1 --2- 172.21.15.81:0/1597327804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d0b80 0x7f47240cfd70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f4714009e60 tx=0x7f4714009780 comp rx=0 tx=0).stop 2023-10-06T02:52:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f4728aff700 1 -- 172.21.15.81:0/1597327804 shutdown_connections 2023-10-06T02:52:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f4728aff700 1 --2- 172.21.15.81:0/1597327804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 0x7f472415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f4728aff700 1 --2- 172.21.15.81:0/1597327804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d0b80 0x7f47240cfd70 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f4728aff700 1 -- 172.21.15.81:0/1597327804 >> 172.21.15.81:0/1597327804 conn(0x7f4724063230 msgr2=0x7f4724063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f4728aff700 1 -- 172.21.15.81:0/1597327804 shutdown_connections 2023-10-06T02:52:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.274+0000 7f4728aff700 1 -- 172.21.15.81:0/1597327804 wait complete. 2023-10-06T02:52:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.275+0000 7f4728aff700 1 Processor -- start 2023-10-06T02:52:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4728aff700 1 -- start start 2023-10-06T02:52:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4728aff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 0x7f47241497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4728aff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d02b0 0x7f472416b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4728aff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240d0b80 0x7f472406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4728aff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472416b220 con 0x7f47240d02b0 2023-10-06T02:52:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4728aff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240ab360 con 0x7f47240d0b80 2023-10-06T02:52:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4728aff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240aaa30 con 0x7f472406d700 2023-10-06T02:52:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4722ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d02b0 0x7f472416b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4722ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d02b0 0x7f472416b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49622/0 (socket says 172.21.15.81:49622) 2023-10-06T02:52:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.276+0000 7f4722ffd700 1 -- 172.21.15.81:0/1413957041 learned_addr learned my addr 172.21.15.81:0/1413957041 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f47237fe700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 0x7f47241497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f4723fff700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240d0b80 0x7f472406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f4722ffd700 1 -- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 msgr2=0x7f47241497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f4722ffd700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 0x7f47241497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f4722ffd700 1 -- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240d0b80 msgr2=0x7f472406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f4722ffd700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240d0b80 0x7f472406bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f4722ffd700 1 -- 172.21.15.81:0/1413957041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714009a20 con 0x7f47240d02b0 2023-10-06T02:52:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f4722ffd700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d02b0 0x7f472416b390 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f471800c7e0 tx=0x7f4718007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f470b7fe700 1 -- 172.21.15.81:0/1413957041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718005b30 con 0x7f47240d02b0 2023-10-06T02:52:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f470b7fe700 1 -- 172.21.15.81:0/1413957041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718005c90 con 0x7f47240d02b0 2023-10-06T02:52:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240aad10 con 0x7f47240d02b0 2023-10-06T02:52:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f470b7fe700 1 -- 172.21.15.81:0/1413957041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718007300 con 0x7f47240d02b0 2023-10-06T02:52:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.277+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472416b8d0 con 0x7f47240d02b0 2023-10-06T02:52:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.278+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47240ab4f0 con 0x7f47240d02b0 2023-10-06T02:52:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.278+0000 7f470b7fe700 1 -- 172.21.15.81:0/1413957041 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f471801b400 con 0x7f47240d02b0 2023-10-06T02:52:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.279+0000 7f470b7fe700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4710066f30 0x7f47100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.279+0000 7f470b7fe700 1 -- 172.21.15.81:0/1413957041 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f47180841d0 con 0x7f47240d02b0 2023-10-06T02:52:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.279+0000 7f47237fe700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4710066f30 0x7f47100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.279+0000 7f47237fe700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4710066f30 0x7f47100693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f47140097c0 tx=0x7f4714019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:14.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.283+0000 7f470b7fe700 1 -- 172.21.15.81:0/1413957041 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4718051310 con 0x7f47240d02b0 2023-10-06T02:52:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:14.507+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f47240676e0 con 0x7f47240d02b0 2023-10-06T02:52:15.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.141+0000 7f470b7fe700 1 -- 172.21.15.81:0/1413957041 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4718007e60 con 0x7f47240d02b0 2023-10-06T02:52:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4710066f30 msgr2=0x7f47100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4710066f30 0x7f47100693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f47140097c0 tx=0x7f4714019000 comp rx=0 tx=0).stop 2023-10-06T02:52:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d02b0 msgr2=0x7f472416b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d02b0 0x7f472416b390 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f471800c7e0 tx=0x7f4718007df0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 shutdown_connections 2023-10-06T02:52:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4710066f30 0x7f47100693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47240d0b80 0x7f472406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472406d700 0x7f47241497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 --2- 172.21.15.81:0/1413957041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47240d02b0 0x7f472416b390 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.143+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 >> 172.21.15.81:0/1413957041 conn(0x7f4724063230 msgr2=0x7f4724063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:15.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.144+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 shutdown_connections 2023-10-06T02:52:15.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.144+0000 7f4728aff700 1 -- 172.21.15.81:0/1413957041 wait complete. 2023-10-06T02:52:15.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:52:15.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.318+0000 7f58a82dd700 1 Processor -- start 2023-10-06T02:52:15.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.318+0000 7f58a82dd700 1 -- start start 2023-10-06T02:52:15.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.318+0000 7f58a82dd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58a01578d0 0x7f58a00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:15.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.318+0000 7f58a82dd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f58a006d120 0x7f58a006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:15.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.318+0000 7f58a82dd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a00d07c0 con 0x7f58a0157ca0 2023-10-06T02:52:15.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.318+0000 7f58a82dd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a006da50 con 0x7f58a01578d0 2023-10-06T02:52:15.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a82dd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a00cfbb0 con 0x7f58a006d120 2023-10-06T02:52:15.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a6079700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58a01578d0 0x7f58a00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a5878700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f58a0157ca0 0x7f58a015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43236/0 (socket says 172.21.15.81:43236) 2023-10-06T02:52:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a6079700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58a01578d0 0x7f58a00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49624/0 (socket says 172.21.15.81:49624) 2023-10-06T02:52:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a5878700 1 -- 172.21.15.81:0/397521194 learned_addr learned my addr 172.21.15.81:0/397521194 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a687a700 1 --2- 172.21.15.81:0/397521194 >> v2:172.21.15.83:3300/0 conn(0x7f58a006d120 0x7f58a006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a6079700 1 -- 172.21.15.81:0/397521194 >> v2:172.21.15.83:3300/0 conn(0x7f58a006d120 msgr2=0x7f58a006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a6079700 1 --2- 172.21.15.81:0/397521194 >> v2:172.21.15.83:3300/0 conn(0x7f58a006d120 0x7f58a006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a6079700 1 -- 172.21.15.81:0/397521194 >> v1:172.21.15.81:6789/0 conn(0x7f58a0157ca0 legacy=0x7f58a015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a6079700 1 -- 172.21.15.81:0/397521194 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00cfe90 con 0x7f58a01578d0 2023-10-06T02:52:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a5077700 1 -- 172.21.15.81:0/397521194 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147489762 0 0) 0x7f58a00d07c0 con 0x7f58a0157ca0 2023-10-06T02:52:15.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a6079700 1 --2- 172.21.15.81:0/397521194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a01578d0 0x7f58a00cf4f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f58a0068300 tx=0x7f589c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150074ac4dd6568f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:15.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a5077700 1 -- 172.21.15.81:0/397521194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c00e070 con 0x7f58a01578d0 2023-10-06T02:52:15.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a5077700 1 -- 172.21.15.81:0/397521194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c00bb60 con 0x7f58a01578d0 2023-10-06T02:52:15.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.319+0000 7f58a5077700 1 -- 172.21.15.81:0/397521194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c012430 con 0x7f58a01578d0 2023-10-06T02:52:15.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.320+0000 7f58a82dd700 1 -- 172.21.15.81:0/397521194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a01578d0 msgr2=0x7f58a00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:15.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.320+0000 7f58a82dd700 1 --2- 172.21.15.81:0/397521194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a01578d0 0x7f58a00cf4f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f58a0068300 tx=0x7f589c009780 comp rx=0 tx=0).stop 2023-10-06T02:52:15.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.320+0000 7f58a82dd700 1 -- 172.21.15.81:0/397521194 shutdown_connections 2023-10-06T02:52:15.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.320+0000 7f58a82dd700 1 --2- 172.21.15.81:0/397521194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a01578d0 0x7f58a00cf4f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.320+0000 7f58a82dd700 1 --2- 172.21.15.81:0/397521194 >> v2:172.21.15.83:3300/0 conn(0x7f58a006d120 0x7f58a006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.320+0000 7f58a82dd700 1 -- 172.21.15.81:0/397521194 >> 172.21.15.81:0/397521194 conn(0x7f58a006bb90 msgr2=0x7f58a006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.320+0000 7f58a82dd700 1 -- 172.21.15.81:0/397521194 shutdown_connections 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.320+0000 7f58a82dd700 1 -- 172.21.15.81:0/397521194 wait complete. 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.321+0000 7f58a82dd700 1 Processor -- start 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.321+0000 7f58a82dd700 1 -- start start 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a82dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a006d120 0x7f58a00cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a82dd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a01578d0 0x7f58a00b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a82dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58a0157ca0 0x7f58a016cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a82dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00cb060 con 0x7f58a006d120 2023-10-06T02:52:15.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a82dd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a016bce0 con 0x7f58a01578d0 2023-10-06T02:52:15.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a82dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a016bfc0 con 0x7f58a0157ca0 2023-10-06T02:52:15.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a6079700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a006d120 0x7f58a00cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:15.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a6079700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a006d120 0x7f58a00cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49634/0 (socket says 172.21.15.81:49634) 2023-10-06T02:52:15.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a6079700 1 -- 172.21.15.81:0/2777232805 learned_addr learned my addr 172.21.15.81:0/2777232805 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:15.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a5878700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a01578d0 0x7f58a00b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:15.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a687a700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58a0157ca0 0x7f58a016cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:15.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a6079700 1 -- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58a0157ca0 msgr2=0x7f58a016cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:15.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a6079700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58a0157ca0 0x7f58a016cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a6079700 1 -- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a01578d0 msgr2=0x7f58a00b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:15.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a6079700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a01578d0 0x7f58a00b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:15.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a6079700 1 -- 172.21.15.81:0/2777232805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c009a20 con 0x7f58a006d120 2023-10-06T02:52:15.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a6079700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a006d120 0x7f58a00cab20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f589c009fd0 tx=0x7f589c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:15.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58967fc700 1 -- 172.21.15.81:0/2777232805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c012df0 con 0x7f58a006d120 2023-10-06T02:52:15.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58967fc700 1 -- 172.21.15.81:0/2777232805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c027470 con 0x7f58a006d120 2023-10-06T02:52:15.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a016c2a0 con 0x7f58a006d120 2023-10-06T02:52:15.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58967fc700 1 -- 172.21.15.81:0/2777232805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c027830 con 0x7f58a006d120 2023-10-06T02:52:15.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.322+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a016c8e0 con 0x7f58a006d120 2023-10-06T02:52:15.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.323+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a016ca70 con 0x7f58a006d120 2023-10-06T02:52:15.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.324+0000 7f58967fc700 1 -- 172.21.15.81:0/2777232805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f589c024070 con 0x7f58a006d120 2023-10-06T02:52:15.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.324+0000 7f58967fc700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5884066f30 0x7f58840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:15.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.324+0000 7f58967fc700 1 -- 172.21.15.81:0/2777232805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f589c087180 con 0x7f58a006d120 2023-10-06T02:52:15.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.324+0000 7f58a5878700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5884066f30 0x7f58840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:15.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.324+0000 7f58a5878700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5884066f30 0x7f58840693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f58a00ca910 tx=0x7f5890009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:15.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.328+0000 7f58967fc700 1 -- 172.21.15.81:0/2777232805 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f589c054240 con 0x7f58a006d120 2023-10-06T02:52:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:15.511+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f58a00d0170 con 0x7f58a006d120 2023-10-06T02:52:16.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.483+0000 7f58967fc700 1 -- 172.21.15.81:0/2777232805 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v125) v1 ==== 181+0+0 (secure 0 0 0) 0x7f589c057860 con 0x7f58a006d120 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5884066f30 msgr2=0x7f58840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5884066f30 0x7f58840693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f58a00ca910 tx=0x7f5890009040 comp rx=0 tx=0).stop 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a006d120 msgr2=0x7f58a00cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a006d120 0x7f58a00cab20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f589c009fd0 tx=0x7f589c019000 comp rx=0 tx=0).stop 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 shutdown_connections 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58a0157ca0 0x7f58a016cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a006d120 0x7f58a00cab20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5884066f30 0x7f58840693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 --2- 172.21.15.81:0/2777232805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a01578d0 0x7f58a00b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 >> 172.21.15.81:0/2777232805 conn(0x7f58a006bb90 msgr2=0x7f58a006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 shutdown_connections 2023-10-06T02:52:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.486+0000 7f58a82dd700 1 -- 172.21.15.81:0/2777232805 wait complete. 2023-10-06T02:52:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:52:16.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:52:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.617+0000 7f7710317700 1 Processor -- start 2023-10-06T02:52:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.617+0000 7f7710317700 1 -- start start 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.618+0000 7f7710317700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.618+0000 7f7710317700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7708157ca0 0x7f770815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.618+0000 7f7710317700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77080d07c0 con 0x7f770806d120 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.618+0000 7f7710317700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77080cfbb0 con 0x7f7708157ca0 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.618+0000 7f7710317700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77080cfe90 con 0x7f77081578d0 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770e0b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770d8b2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7708157ca0 0x7f770815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770e0b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:38054/0 (socket says 172.21.15.81:38054) 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770e0b3700 1 -- 172.21.15.81:0/1909223823 learned_addr learned my addr 172.21.15.81:0/1909223823 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770d8b2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7708157ca0 0x7f770815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:60794/0 (socket says 172.21.15.81:60794) 2023-10-06T02:52:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770e8b4700 1 --1- 172.21.15.81:0/1909223823 >> v1:172.21.15.83:6789/0 conn(0x7f770806d120 0x7f770815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:49500/0 (socket says 172.21.15.81:49500) 2023-10-06T02:52:16.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770e0b3700 1 -- 172.21.15.81:0/1909223823 >> v2:172.21.15.83:3300/0 conn(0x7f7708157ca0 msgr2=0x7f770815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:16.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770e0b3700 1 --2- 172.21.15.81:0/1909223823 >> v2:172.21.15.83:3300/0 conn(0x7f7708157ca0 0x7f770815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:16.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770e0b3700 1 -- 172.21.15.81:0/1909223823 >> v1:172.21.15.83:6789/0 conn(0x7f770806d120 legacy=0x7f770815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770e0b3700 1 -- 172.21.15.81:0/1909223823 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080d0170 con 0x7f77081578d0 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770d8b2700 1 --2- 172.21.15.81:0/1909223823 >> v2:172.21.15.83:3300/0 conn(0x7f7708157ca0 0x7f770815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770e0b3700 1 --2- 172.21.15.81:0/1909223823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080cf4f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7704009f20 tx=0x7f7704009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899a741ed0138501 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770d0b1700 1 -- 172.21.15.81:0/1909223823 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400e070 con 0x7f77081578d0 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770d0b1700 1 -- 172.21.15.81:0/1909223823 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770400b9d0 con 0x7f77081578d0 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.619+0000 7f770d0b1700 1 -- 172.21.15.81:0/1909223823 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77040092e0 con 0x7f77081578d0 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.620+0000 7f7710317700 1 -- 172.21.15.81:0/1909223823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 msgr2=0x7f77080cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.620+0000 7f7710317700 1 --2- 172.21.15.81:0/1909223823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080cf4f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7704009f20 tx=0x7f7704009840 comp rx=0 tx=0).stop 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.620+0000 7f7710317700 1 -- 172.21.15.81:0/1909223823 shutdown_connections 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.620+0000 7f7710317700 1 --2- 172.21.15.81:0/1909223823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080cf4f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.620+0000 7f7710317700 1 --2- 172.21.15.81:0/1909223823 >> v2:172.21.15.83:3300/0 conn(0x7f7708157ca0 0x7f770815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.620+0000 7f7710317700 1 -- 172.21.15.81:0/1909223823 >> 172.21.15.81:0/1909223823 conn(0x7f770806bb90 msgr2=0x7f770806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.620+0000 7f7710317700 1 -- 172.21.15.81:0/1909223823 shutdown_connections 2023-10-06T02:52:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.620+0000 7f7710317700 1 -- 172.21.15.81:0/1909223823 wait complete. 2023-10-06T02:52:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.621+0000 7f7710317700 1 Processor -- start 2023-10-06T02:52:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.621+0000 7f7710317700 1 -- start start 2023-10-06T02:52:16.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f7710317700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770806d120 0x7f7708155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:16.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f7710317700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:16.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f7710317700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7708157ca0 0x7f77080c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:16.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f7710317700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77080c6ba0 con 0x7f770806d120 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f7710317700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77080c65e0 con 0x7f7708157ca0 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f7710317700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77080c68c0 con 0x7f77081578d0 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e0b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770806d120 0x7f7708155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e0b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770806d120 0x7f7708155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49650/0 (socket says 172.21.15.81:49650) 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e0b3700 1 -- 172.21.15.81:0/3843355332 learned_addr learned my addr 172.21.15.81:0/3843355332 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e8b4700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7708157ca0 0x7f77080c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770d8b2700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e0b3700 1 -- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 msgr2=0x7f77080c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e0b3700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e0b3700 1 -- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7708157ca0 msgr2=0x7f77080c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e0b3700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7708157ca0 0x7f77080c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e0b3700 1 -- 172.21.15.81:0/3843355332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8009420 con 0x7f770806d120 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.622+0000 7f770e0b3700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770806d120 0x7f7708155080 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f770400b610 tx=0x7f7704018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.623+0000 7f76fe7fc700 1 -- 172.21.15.81:0/3843355332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704008a50 con 0x7f770806d120 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.623+0000 7f76fe7fc700 1 -- 172.21.15.81:0/3843355332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7704008bb0 con 0x7f770806d120 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.623+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7704009ae0 con 0x7f770806d120 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.623+0000 7f76fe7fc700 1 -- 172.21.15.81:0/3843355332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704026460 con 0x7f770806d120 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.623+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77080c7f80 con 0x7f770806d120 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.623+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77080c81a0 con 0x7f770806d120 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.624+0000 7f76fe7fc700 1 -- 172.21.15.81:0/3843355332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7704003040 con 0x7f770806d120 2023-10-06T02:52:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.624+0000 7f76fe7fc700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f76ec066f30 0x7f76ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.624+0000 7f76fe7fc700 1 -- 172.21.15.81:0/3843355332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f7704086470 con 0x7f770806d120 2023-10-06T02:52:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.624+0000 7f770d8b2700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f76ec066f30 0x7f76ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.625+0000 7f770d8b2700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f76ec066f30 0x7f76ec0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009da0 tx=0x7f76f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.628+0000 7f76fe7fc700 1 -- 172.21.15.81:0/3843355332 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77040536e0 con 0x7f770806d120 2023-10-06T02:52:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:16.810+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77080d0450 con 0x7f770806d120 2023-10-06T02:52:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.490+0000 7f76fe7fc700 1 -- 172.21.15.81:0/3843355332 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v126) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7704056d00 con 0x7f770806d120 2023-10-06T02:52:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f76ec066f30 msgr2=0x7f76ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f76ec066f30 0x7f76ec0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009da0 tx=0x7f76f8008040 comp rx=0 tx=0).stop 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770806d120 msgr2=0x7f7708155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770806d120 0x7f7708155080 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f770400b610 tx=0x7f7704018000 comp rx=0 tx=0).stop 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 shutdown_connections 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f76ec066f30 0x7f76ec0693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7708157ca0 0x7f77080c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770806d120 0x7f7708155080 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 --2- 172.21.15.81:0/3843355332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77081578d0 0x7f77080c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 >> 172.21.15.81:0/3843355332 conn(0x7f770806bb90 msgr2=0x7f770806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 shutdown_connections 2023-10-06T02:52:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.493+0000 7f7710317700 1 -- 172.21.15.81:0/3843355332 wait complete. 2023-10-06T02:52:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:52:17.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:52:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.621+0000 7f76ad44e700 1 Processor -- start 2023-10-06T02:52:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.621+0000 7f76ad44e700 1 -- start start 2023-10-06T02:52:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76ad44e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 0x7f76a806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76ad44e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76a806d530 0x7f76a815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76ad44e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a806d9b0 con 0x7f76a80d0b80 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76ad44e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a815a690 con 0x7f76a806d530 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76ad44e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80cf2d0 con 0x7f76a80d0f50 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76a7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f76a80d0b80 0x7f76a80cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43242/0 (socket says 172.21.15.81:43242) 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76a7fff700 1 -- 172.21.15.81:0/2432579636 learned_addr learned my addr 172.21.15.81:0/2432579636 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76acc4d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76a806d530 0x7f76a815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76a77fe700 1 --2- 172.21.15.81:0/2432579636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 0x7f76a806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76a6ffd700 1 -- 172.21.15.81:0/2432579636 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242363147 0 0) 0x7f76a806d9b0 con 0x7f76a80d0b80 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76acc4d700 1 -- 172.21.15.81:0/2432579636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 msgr2=0x7f76a806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76acc4d700 1 --2- 172.21.15.81:0/2432579636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 0x7f76a806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76acc4d700 1 -- 172.21.15.81:0/2432579636 >> v1:172.21.15.81:6789/0 conn(0x7f76a80d0b80 legacy=0x7f76a80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.622+0000 7f76acc4d700 1 -- 172.21.15.81:0/2432579636 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a80d0480 con 0x7f76a806d530 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76acc4d700 1 --2- 172.21.15.81:0/2432579636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a806d530 0x7f76a815b320 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009e60 tx=0x7f76a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18959f8aabe49a0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76a6ffd700 1 -- 172.21.15.81:0/2432579636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000e070 con 0x7f76a806d530 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76a6ffd700 1 -- 172.21.15.81:0/2432579636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a000bc30 con 0x7f76a806d530 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76a6ffd700 1 -- 172.21.15.81:0/2432579636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0012430 con 0x7f76a806d530 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76ad44e700 1 -- 172.21.15.81:0/2432579636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a806d530 msgr2=0x7f76a815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76ad44e700 1 --2- 172.21.15.81:0/2432579636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a806d530 0x7f76a815b320 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009e60 tx=0x7f76a0009780 comp rx=0 tx=0).stop 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76ad44e700 1 -- 172.21.15.81:0/2432579636 shutdown_connections 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76ad44e700 1 --2- 172.21.15.81:0/2432579636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a806d530 0x7f76a815b320 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76ad44e700 1 --2- 172.21.15.81:0/2432579636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 0x7f76a806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76ad44e700 1 -- 172.21.15.81:0/2432579636 >> 172.21.15.81:0/2432579636 conn(0x7f76a8063230 msgr2=0x7f76a8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76ad44e700 1 -- 172.21.15.81:0/2432579636 shutdown_connections 2023-10-06T02:52:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.623+0000 7f76ad44e700 1 -- 172.21.15.81:0/2432579636 wait complete. 2023-10-06T02:52:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.624+0000 7f76ad44e700 1 Processor -- start 2023-10-06T02:52:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76ad44e700 1 -- start start 2023-10-06T02:52:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76ad44e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76a806d530 0x7f76a80cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76ad44e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0b80 0x7f76a8156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76ad44e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 0x7f76a80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76ad44e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80c6eb0 con 0x7f76a80d0b80 2023-10-06T02:52:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76ad44e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80c7470 con 0x7f76a806d530 2023-10-06T02:52:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76ad44e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8156f70 con 0x7f76a80d0f50 2023-10-06T02:52:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0b80 0x7f76a8156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0b80 0x7f76a8156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49668/0 (socket says 172.21.15.81:49668) 2023-10-06T02:52:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76a77fe700 1 -- 172.21.15.81:0/99604888 learned_addr learned my addr 172.21.15.81:0/99604888 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76acc4d700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 0x7f76a80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.625+0000 7f76a7fff700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76a806d530 0x7f76a80cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f76a77fe700 1 -- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 msgr2=0x7f76a80c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f76a77fe700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 0x7f76a80c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f76a77fe700 1 -- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76a806d530 msgr2=0x7f76a80cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f76a77fe700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76a806d530 0x7f76a80cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f76a77fe700 1 -- 172.21.15.81:0/99604888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a0009a20 con 0x7f76a80d0b80 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f76a77fe700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0b80 0x7f76a8156a30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f769c00d860 tx=0x7f769c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f768ffff700 1 -- 172.21.15.81:0/99604888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c009610 con 0x7f76a80d0b80 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f768ffff700 1 -- 172.21.15.81:0/99604888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c009770 con 0x7f76a80d0b80 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a80c65e0 con 0x7f76a80d0b80 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f768ffff700 1 -- 172.21.15.81:0/99604888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c009b30 con 0x7f76a80d0b80 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.626+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a80c7100 con 0x7f76a80d0b80 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.627+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a80c75e0 con 0x7f76a80d0b80 2023-10-06T02:52:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.627+0000 7f768ffff700 1 -- 172.21.15.81:0/99604888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f769c01e460 con 0x7f76a80d0b80 2023-10-06T02:52:17.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.628+0000 7f768ffff700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7694066f30 0x7f76940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.628+0000 7f768ffff700 1 -- 172.21.15.81:0/99604888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f769c084a00 con 0x7f76a80d0b80 2023-10-06T02:52:17.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.628+0000 7f76a7fff700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7694066f30 0x7f76940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.628+0000 7f76a7fff700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7694066f30 0x7f76940693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f76a80b6440 tx=0x7f7698009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:17.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.632+0000 7f768ffff700 1 -- 172.21.15.81:0/99604888 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f769c051e10 con 0x7f76a80d0b80 2023-10-06T02:52:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.818+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f76a80676e0 con 0x7f76a80d0b80 2023-10-06T02:52:17.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.823+0000 7f768ffff700 1 -- 172.21.15.81:0/99604888 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f769c055430 con 0x7f76a80d0b80 2023-10-06T02:52:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7694066f30 msgr2=0x7f76940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7694066f30 0x7f76940693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f76a80b6440 tx=0x7f7698009040 comp rx=0 tx=0).stop 2023-10-06T02:52:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0b80 msgr2=0x7f76a8156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0b80 0x7f76a8156a30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f769c00d860 tx=0x7f769c008040 comp rx=0 tx=0).stop 2023-10-06T02:52:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 shutdown_connections 2023-10-06T02:52:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76a80d0f50 0x7f76a80c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7694066f30 0x7f76940693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76a806d530 0x7f76a80cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 --2- 172.21.15.81:0/99604888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0b80 0x7f76a8156a30 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.825+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 >> 172.21.15.81:0/99604888 conn(0x7f76a8063230 msgr2=0x7f76a81574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.826+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 shutdown_connections 2023-10-06T02:52:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.826+0000 7f76ad44e700 1 -- 172.21.15.81:0/99604888 wait complete. 2023-10-06T02:52:17.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-06T02:52:17.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.954+0000 7f535d6c1700 1 Processor -- start 2023-10-06T02:52:17.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.954+0000 7f535d6c1700 1 -- start start 2023-10-06T02:52:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.954+0000 7f535d6c1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.954+0000 7f535d6c1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5358157ca0 0x7f535815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.954+0000 7f535d6c1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53580d07c0 con 0x7f535806d120 2023-10-06T02:52:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.954+0000 7f535d6c1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53580cfbb0 con 0x7f5358157ca0 2023-10-06T02:52:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.954+0000 7f535d6c1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53580cfe90 con 0x7f53581578d0 2023-10-06T02:52:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.954+0000 7f534e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5358157ca0 0x7f535815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f534e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5358157ca0 0x7f535815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49676/0 (socket says 172.21.15.81:49676) 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f534e7fc700 1 -- 172.21.15.81:0/2494472542 learned_addr learned my addr 172.21.15.81:0/2494472542 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f534e7fc700 1 -- 172.21.15.81:0/2494472542 >> v2:172.21.15.83:3300/0 conn(0x7f53581578d0 msgr2=0x7f53580cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f5356ffd700 1 --2- 172.21.15.81:0/2494472542 >> v2:172.21.15.83:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f534e7fc700 1 --2- 172.21.15.81:0/2494472542 >> v2:172.21.15.83:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f534e7fc700 1 -- 172.21.15.81:0/2494472542 >> v1:172.21.15.83:6789/0 conn(0x7f535806d120 legacy=0x7f535806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f534e7fc700 1 -- 172.21.15.81:0/2494472542 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580d0170 con 0x7f5358157ca0 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f5356ffd700 1 --2- 172.21.15.81:0/2494472542 >> v2:172.21.15.83:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f534e7fc700 1 --2- 172.21.15.81:0/2494472542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358157ca0 0x7f535815af00 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f53580646b0 tx=0x7f5340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac04821c08202d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f53567fc700 1 -- 172.21.15.81:0/2494472542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000b820 con 0x7f5358157ca0 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f53567fc700 1 -- 172.21.15.81:0/2494472542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000b980 con 0x7f5358157ca0 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.955+0000 7f53567fc700 1 -- 172.21.15.81:0/2494472542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000bd20 con 0x7f5358157ca0 2023-10-06T02:52:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.956+0000 7f535d6c1700 1 -- 172.21.15.81:0/2494472542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358157ca0 msgr2=0x7f535815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.956+0000 7f535d6c1700 1 --2- 172.21.15.81:0/2494472542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358157ca0 0x7f535815af00 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f53580646b0 tx=0x7f5340009250 comp rx=0 tx=0).stop 2023-10-06T02:52:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.956+0000 7f535d6c1700 1 -- 172.21.15.81:0/2494472542 shutdown_connections 2023-10-06T02:52:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.956+0000 7f535d6c1700 1 --2- 172.21.15.81:0/2494472542 >> v2:172.21.15.83:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.956+0000 7f535d6c1700 1 --2- 172.21.15.81:0/2494472542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358157ca0 0x7f535815af00 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.956+0000 7f535d6c1700 1 -- 172.21.15.81:0/2494472542 >> 172.21.15.81:0/2494472542 conn(0x7f535806bb90 msgr2=0x7f535806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.956+0000 7f535d6c1700 1 -- 172.21.15.81:0/2494472542 shutdown_connections 2023-10-06T02:52:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.956+0000 7f535d6c1700 1 -- 172.21.15.81:0/2494472542 wait complete. 2023-10-06T02:52:17.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.957+0000 7f535d6c1700 1 Processor -- start 2023-10-06T02:52:17.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.957+0000 7f535d6c1700 1 -- start start 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f535d6c1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806d120 0x7f53580b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f535d6c1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53581578d0 0x7f53580ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f535d6c1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5358157ca0 0x7f53581539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f535d6c1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53580aa890 con 0x7f535806d120 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f535d6c1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53580aab30 con 0x7f53581578d0 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f535d6c1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53580acdf0 con 0x7f5358157ca0 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f5356ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806d120 0x7f53580b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f5356ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806d120 0x7f53580b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49682/0 (socket says 172.21.15.81:49682) 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f5356ffd700 1 -- 172.21.15.81:0/1010377585 learned_addr learned my addr 172.21.15.81:0/1010377585 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f534e7fc700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53581578d0 0x7f53580ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f53577fe700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5358157ca0 0x7f53581539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f5356ffd700 1 -- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5358157ca0 msgr2=0x7f53581539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f5356ffd700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5358157ca0 0x7f53581539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f5356ffd700 1 -- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53581578d0 msgr2=0x7f53580ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f5356ffd700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53581578d0 0x7f53580ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f5356ffd700 1 -- 172.21.15.81:0/1010377585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400094f0 con 0x7f535806d120 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f53577fe700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5358157ca0 0x7f53581539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f5356ffd700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806d120 0x7f53580b5f50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f534800c830 tx=0x7f5348008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f534f7fe700 1 -- 172.21.15.81:0/1010377585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348011600 con 0x7f535806d120 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f534f7fe700 1 -- 172.21.15.81:0/1010377585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5348011760 con 0x7f535806d120 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53580b6530 con 0x7f535806d120 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f534f7fe700 1 -- 172.21.15.81:0/1010377585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348011b20 con 0x7f535806d120 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.958+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53580b6af0 con 0x7f535806d120 2023-10-06T02:52:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.959+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53580b6ce0 con 0x7f535806d120 2023-10-06T02:52:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.960+0000 7f534f7fe700 1 -- 172.21.15.81:0/1010377585 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53480193b0 con 0x7f535806d120 2023-10-06T02:52:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.960+0000 7f534f7fe700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5338066f30 0x7f53380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.960+0000 7f534f7fe700 1 -- 172.21.15.81:0/1010377585 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f53480843e0 con 0x7f535806d120 2023-10-06T02:52:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.960+0000 7f534e7fc700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5338066f30 0x7f53380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.961+0000 7f534e7fc700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5338066f30 0x7f53380693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f53580646b0 tx=0x7f5340016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:17.964+0000 7f534f7fe700 1 -- 172.21.15.81:0/1010377585 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53480517f0 con 0x7f535806d120 2023-10-06T02:52:18.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.222+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f53580d0450 con 0x7f535806d120 2023-10-06T02:52:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.497+0000 7f534f7fe700 1 -- 172.21.15.81:0/1010377585 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v326) v1 ==== 128+0+0 (secure 0 0 0) 0x7f5348054e10 con 0x7f535806d120 2023-10-06T02:52:18.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5338066f30 msgr2=0x7f53380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:18.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5338066f30 0x7f53380693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f53580646b0 tx=0x7f5340016000 comp rx=0 tx=0).stop 2023-10-06T02:52:18.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806d120 msgr2=0x7f53580b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:18.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806d120 0x7f53580b5f50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f534800c830 tx=0x7f5348008040 comp rx=0 tx=0).stop 2023-10-06T02:52:18.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 shutdown_connections 2023-10-06T02:52:18.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5358157ca0 0x7f53581539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:18.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806d120 0x7f53580b5f50 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:18.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5338066f30 0x7f53380693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:18.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 --2- 172.21.15.81:0/1010377585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53581578d0 0x7f53580ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:18.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 >> 172.21.15.81:0/1010377585 conn(0x7f535806bb90 msgr2=0x7f5358154960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:18.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 shutdown_connections 2023-10-06T02:52:18.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.499+0000 7f535d6c1700 1 -- 172.21.15.81:0/1010377585 wait complete. 2023-10-06T02:52:18.513 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-06T02:52:18.514 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-06T02:52:18.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-06T02:52:18.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.627+0000 7fa094b68700 1 Processor -- start 2023-10-06T02:52:18.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.627+0000 7fa094b68700 1 -- start start 2023-10-06T02:52:18.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.627+0000 7fa094b68700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa09015a2a0 0x7fa0900b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:18.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.627+0000 7fa094b68700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 0x7fa0900cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:18.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa094b68700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0900b0ca0 con 0x7fa09006d650 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa094b68700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09006ea90 con 0x7fa09015a2a0 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa094b68700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900cf4c0 con 0x7fa0900ceb30 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa09015a2a0 0x7fa0900b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa09015a2a0 0x7fa0900b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49698/0 (socket says 172.21.15.81:49698) 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08e59c700 1 -- 172.21.15.81:0/1335249373 learned_addr learned my addr 172.21.15.81:0/1335249373 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08dd9b700 1 --2- 172.21.15.81:0/1335249373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 0x7fa0900cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08e59c700 1 -- 172.21.15.81:0/1335249373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 msgr2=0x7fa0900cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08e59c700 1 --2- 172.21.15.81:0/1335249373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 0x7fa0900cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08e59c700 1 -- 172.21.15.81:0/1335249373 >> v1:172.21.15.83:6789/0 conn(0x7fa09006d650 legacy=0x7fa09006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08e59c700 1 -- 172.21.15.81:0/1335249373 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900b00d0 con 0x7fa09015a2a0 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08dd9b700 1 --2- 172.21.15.81:0/1335249373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 0x7fa0900cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08e59c700 1 --2- 172.21.15.81:0/1335249373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09015a2a0 0x7fa0900b1130 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa080009f20 tx=0x7fa080009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a45f17da2cc077f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08d59a700 1 -- 172.21.15.81:0/1335249373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08000e070 con 0x7fa09015a2a0 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08d59a700 1 -- 172.21.15.81:0/1335249373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08000ba80 con 0x7fa09015a2a0 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.628+0000 7fa08d59a700 1 -- 172.21.15.81:0/1335249373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0800092e0 con 0x7fa09015a2a0 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.629+0000 7fa094b68700 1 -- 172.21.15.81:0/1335249373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09015a2a0 msgr2=0x7fa0900b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.629+0000 7fa094b68700 1 --2- 172.21.15.81:0/1335249373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09015a2a0 0x7fa0900b1130 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa080009f20 tx=0x7fa080009840 comp rx=0 tx=0).stop 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.629+0000 7fa094b68700 1 -- 172.21.15.81:0/1335249373 shutdown_connections 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.629+0000 7fa094b68700 1 --2- 172.21.15.81:0/1335249373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09015a2a0 0x7fa0900b1130 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.629+0000 7fa094b68700 1 --2- 172.21.15.81:0/1335249373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 0x7fa0900cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.629+0000 7fa094b68700 1 -- 172.21.15.81:0/1335249373 >> 172.21.15.81:0/1335249373 conn(0x7fa090067640 msgr2=0x7fa090067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.629+0000 7fa094b68700 1 -- 172.21.15.81:0/1335249373 shutdown_connections 2023-10-06T02:52:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.629+0000 7fa094b68700 1 -- 172.21.15.81:0/1335249373 wait complete. 2023-10-06T02:52:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.630+0000 7fa094b68700 1 Processor -- start 2023-10-06T02:52:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.630+0000 7fa094b68700 1 -- start start 2023-10-06T02:52:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa094b68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09006d650 0x7fa09016b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa094b68700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 0x7fa09014c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa094b68700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09015a2a0 0x7fa090153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa094b68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09015ddf0 con 0x7fa09006d650 2023-10-06T02:52:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa094b68700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09016b7e0 con 0x7fa09015a2a0 2023-10-06T02:52:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa094b68700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09016a7e0 con 0x7fa0900ceb30 2023-10-06T02:52:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09006d650 0x7fa09016b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09006d650 0x7fa09016b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49708/0 (socket says 172.21.15.81:49708) 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08e59c700 1 -- 172.21.15.81:0/874334758 learned_addr learned my addr 172.21.15.81:0/874334758 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08ed9d700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09015a2a0 0x7fa090153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08dd9b700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 0x7fa09014c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08e59c700 1 -- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 msgr2=0x7fa09014c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08e59c700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 0x7fa09014c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08e59c700 1 -- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09015a2a0 msgr2=0x7fa090153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08e59c700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09015a2a0 0x7fa090153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08e59c700 1 -- 172.21.15.81:0/874334758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa080009ae0 con 0x7fa09006d650 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.631+0000 7fa08e59c700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09006d650 0x7fa09016b2a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa08000b6c0 tx=0x7fa080018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.632+0000 7fa07e7fc700 1 -- 172.21.15.81:0/874334758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080008a80 con 0x7fa09006d650 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.632+0000 7fa07e7fc700 1 -- 172.21.15.81:0/874334758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa080008be0 con 0x7fa09006d650 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.632+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09015d830 con 0x7fa09006d650 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.632+0000 7fa07e7fc700 1 -- 172.21.15.81:0/874334758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08001c410 con 0x7fa09006d650 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.632+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09016aaa0 con 0x7fa09006d650 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.633+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa090069e40 con 0x7fa09006d650 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.633+0000 7fa07e7fc700 1 -- 172.21.15.81:0/874334758 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa080003040 con 0x7fa09006d650 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.633+0000 7fa07e7fc700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa070066f30 0x7fa0700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.633+0000 7fa07e7fc700 1 -- 172.21.15.81:0/874334758 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa080085b00 con 0x7fa09006d650 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.633+0000 7fa08dd9b700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa070066f30 0x7fa0700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.634+0000 7fa08dd9b700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa070066f30 0x7fa0700693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa08400adc0 tx=0x7fa084006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.637+0000 7fa07e7fc700 1 -- 172.21.15.81:0/874334758 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa080052f10 con 0x7fa09006d650 2023-10-06T02:52:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:18.899+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fa09004bb80 con 0x7fa09006d650 2023-10-06T02:52:19.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.498+0000 7fa07e7fc700 1 -- 172.21.15.81:0/874334758 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v327) v1 ==== 143+0+0 (secure 0 0 0) 0x7fa080056530 con 0x7fa09006d650 2023-10-06T02:52:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa070066f30 msgr2=0x7fa0700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa070066f30 0x7fa0700693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa08400adc0 tx=0x7fa084006f90 comp rx=0 tx=0).stop 2023-10-06T02:52:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09006d650 msgr2=0x7fa09016b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09006d650 0x7fa09016b2a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa08000b6c0 tx=0x7fa080018000 comp rx=0 tx=0).stop 2023-10-06T02:52:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 shutdown_connections 2023-10-06T02:52:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa070066f30 0x7fa0700693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09015a2a0 0x7fa090153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09006d650 0x7fa09016b2a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 --2- 172.21.15.81:0/874334758 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0900ceb30 0x7fa09014c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 >> 172.21.15.81:0/874334758 conn(0x7fa090067640 msgr2=0x7fa090067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 shutdown_connections 2023-10-06T02:52:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.501+0000 7fa094b68700 1 -- 172.21.15.81:0/874334758 wait complete. 2023-10-06T02:52:19.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:52:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.630+0000 7f4020261700 1 Processor -- start 2023-10-06T02:52:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.631+0000 7f4020261700 1 -- start start 2023-10-06T02:52:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f4020261700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f401806c190 0x7f40180b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f4020261700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40180b3170 0x7f401806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f4020261700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4018069d10 con 0x7f4018157a60 2023-10-06T02:52:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f4020261700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40180b35f0 con 0x7f401806c190 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f4020261700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401815c130 con 0x7f40180b3170 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401d7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f401806c190 0x7f40180b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401d7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f401806c190 0x7f40180b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49716/0 (socket says 172.21.15.81:49716) 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401d7fc700 1 -- 172.21.15.81:0/2114435145 learned_addr learned my addr 172.21.15.81:0/2114435145 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401e7fe700 1 --2- 172.21.15.81:0/2114435145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40180b3170 0x7f401806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401d7fc700 1 -- 172.21.15.81:0/2114435145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40180b3170 msgr2=0x7f401806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401d7fc700 1 --2- 172.21.15.81:0/2114435145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40180b3170 0x7f401806a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401d7fc700 1 -- 172.21.15.81:0/2114435145 >> v1:172.21.15.83:6789/0 conn(0x7f4018157a60 legacy=0x7f401815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401d7fc700 1 -- 172.21.15.81:0/2114435145 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401815c410 con 0x7f401806c190 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401d7fc700 1 --2- 172.21.15.81:0/2114435145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401806c190 0x7f40180b2c30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f40080099b0 tx=0x7f4008009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbe10889b69b26c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401cffb700 1 -- 172.21.15.81:0/2114435145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008009ea0 con 0x7f401806c190 2023-10-06T02:52:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401cffb700 1 -- 172.21.15.81:0/2114435145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400800b860 con 0x7f401806c190 2023-10-06T02:52:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.632+0000 7f401cffb700 1 -- 172.21.15.81:0/2114435145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800bc00 con 0x7f401806c190 2023-10-06T02:52:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.633+0000 7f4020261700 1 -- 172.21.15.81:0/2114435145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401806c190 msgr2=0x7f40180b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.633+0000 7f4020261700 1 --2- 172.21.15.81:0/2114435145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401806c190 0x7f40180b2c30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f40080099b0 tx=0x7f4008009250 comp rx=0 tx=0).stop 2023-10-06T02:52:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.633+0000 7f4020261700 1 -- 172.21.15.81:0/2114435145 shutdown_connections 2023-10-06T02:52:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.633+0000 7f4020261700 1 --2- 172.21.15.81:0/2114435145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40180b3170 0x7f401806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.633+0000 7f4020261700 1 --2- 172.21.15.81:0/2114435145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401806c190 0x7f40180b2c30 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.633+0000 7f4020261700 1 -- 172.21.15.81:0/2114435145 >> 172.21.15.81:0/2114435145 conn(0x7f401806cca0 msgr2=0x7f401806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.633+0000 7f4020261700 1 -- 172.21.15.81:0/2114435145 shutdown_connections 2023-10-06T02:52:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.633+0000 7f4020261700 1 -- 172.21.15.81:0/2114435145 wait complete. 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.634+0000 7f4020261700 1 Processor -- start 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.634+0000 7f4020261700 1 -- start start 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f4020261700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f401806c190 0x7f401815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f4020261700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40180b3170 0x7f4018157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f4020261700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018157a60 0x7f401815b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f4020261700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401815a940 con 0x7f4018157a60 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f4020261700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4018158de0 con 0x7f401806c190 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f4020261700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4018158370 con 0x7f40180b3170 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f401e7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018157a60 0x7f401815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f401e7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018157a60 0x7f401815b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49718/0 (socket says 172.21.15.81:49718) 2023-10-06T02:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f401e7fe700 1 -- 172.21.15.81:0/3621877756 learned_addr learned my addr 172.21.15.81:0/3621877756 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f401e7fe700 1 -- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40180b3170 msgr2=0x7f4018157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f401e7fe700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40180b3170 0x7f4018157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f401e7fe700 1 -- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f401806c190 msgr2=0x7f401815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f401e7fe700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f401806c190 0x7f401815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f401e7fe700 1 -- 172.21.15.81:0/3621877756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080094f0 con 0x7f4018157a60 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f401e7fe700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018157a60 0x7f401815b080 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f401000ea80 tx=0x7f40100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f400dffb700 1 -- 172.21.15.81:0/3621877756 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401000c920 con 0x7f4018157a60 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f400dffb700 1 -- 172.21.15.81:0/3621877756 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401000ca80 con 0x7f4018157a60 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40181587d0 con 0x7f4018157a60 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.635+0000 7f400dffb700 1 -- 172.21.15.81:0/3621877756 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401000ce40 con 0x7f4018157a60 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.636+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40180aaca0 con 0x7f4018157a60 2023-10-06T02:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.636+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4018068900 con 0x7f4018157a60 2023-10-06T02:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.637+0000 7f400dffb700 1 -- 172.21.15.81:0/3621877756 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4010013680 con 0x7f4018157a60 2023-10-06T02:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.637+0000 7f400dffb700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ffc066f30 0x7f3ffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.637+0000 7f400dffb700 1 -- 172.21.15.81:0/3621877756 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f40100847a0 con 0x7f4018157a60 2023-10-06T02:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.638+0000 7f401dffd700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ffc066f30 0x7f3ffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.638+0000 7f401dffd700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ffc066f30 0x7f3ffc0693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4014001cf0 tx=0x7f4014007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.642+0000 7f400dffb700 1 -- 172.21.15.81:0/3621877756 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4010051b10 con 0x7f4018157a60 2023-10-06T02:52:19.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.825+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f401815c6f0 con 0x7f4018157a60 2023-10-06T02:52:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.830+0000 7f400dffb700 1 -- 172.21.15.81:0/3621877756 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4010055130 con 0x7f4018157a60 2023-10-06T02:52:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ffc066f30 msgr2=0x7f3ffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ffc066f30 0x7f3ffc0693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4014001cf0 tx=0x7f4014007ec0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018157a60 msgr2=0x7f401815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018157a60 0x7f401815b080 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f401000ea80 tx=0x7f40100091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 shutdown_connections 2023-10-06T02:52:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018157a60 0x7f401815b080 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3ffc066f30 0x7f3ffc0693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f401806c190 0x7f401815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 --2- 172.21.15.81:0/3621877756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40180b3170 0x7f4018157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 >> 172.21.15.81:0/3621877756 conn(0x7f401806cca0 msgr2=0x7f4018154780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 shutdown_connections 2023-10-06T02:52:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:19.833+0000 7f4020261700 1 -- 172.21.15.81:0/3621877756 wait complete. 2023-10-06T02:52:19.847 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:52:19.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:52:19.887 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:52:19.933 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:52:19.933 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:52:19.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:20.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.046+0000 7f217f3a2700 1 Processor -- start 2023-10-06T02:52:20.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.046+0000 7f217f3a2700 1 -- start start 2023-10-06T02:52:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217f3a2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21781578d0 0x7f21780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217f3a2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2178157ca0 0x7f217815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217f3a2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21780d07c0 con 0x7f217806d120 2023-10-06T02:52:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217f3a2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780cfbb0 con 0x7f21781578d0 2023-10-06T02:52:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217f3a2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780cfe90 con 0x7f2178157ca0 2023-10-06T02:52:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217d13e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21781578d0 0x7f21780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217d93f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f217806d120 0x7f217806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43254/0 (socket says 172.21.15.81:43254) 2023-10-06T02:52:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217d93f700 1 -- 172.21.15.81:0/638783916 learned_addr learned my addr 172.21.15.81:0/638783916 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217d13e700 1 -- 172.21.15.81:0/638783916 >> v2:172.21.15.83:3300/0 conn(0x7f2178157ca0 msgr2=0x7f217815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217d13e700 1 --2- 172.21.15.81:0/638783916 >> v2:172.21.15.83:3300/0 conn(0x7f2178157ca0 0x7f217815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217d13e700 1 -- 172.21.15.81:0/638783916 >> v1:172.21.15.81:6789/0 conn(0x7f217806d120 legacy=0x7f217806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f216ffff700 1 -- 172.21.15.81:0/638783916 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436637859 0 0) 0x7f21780d07c0 con 0x7f217806d120 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217d13e700 1 -- 172.21.15.81:0/638783916 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780d0170 con 0x7f21781578d0 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f217d13e700 1 --2- 172.21.15.81:0/638783916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 0x7f21780cf4f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f2178068510 tx=0x7f2174009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed703b5410d0e7f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.047+0000 7f216ffff700 1 -- 172.21.15.81:0/638783916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217400e070 con 0x7f21781578d0 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f216ffff700 1 -- 172.21.15.81:0/638783916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217400bc30 con 0x7f21781578d0 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f216ffff700 1 -- 172.21.15.81:0/638783916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174012430 con 0x7f21781578d0 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f217f3a2700 1 -- 172.21.15.81:0/638783916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 msgr2=0x7f21780cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f217f3a2700 1 --2- 172.21.15.81:0/638783916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 0x7f21780cf4f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f2178068510 tx=0x7f2174009780 comp rx=0 tx=0).stop 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f217f3a2700 1 -- 172.21.15.81:0/638783916 shutdown_connections 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f217f3a2700 1 --2- 172.21.15.81:0/638783916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 0x7f21780cf4f0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f217f3a2700 1 --2- 172.21.15.81:0/638783916 >> v2:172.21.15.83:3300/0 conn(0x7f2178157ca0 0x7f217815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f217f3a2700 1 -- 172.21.15.81:0/638783916 >> 172.21.15.81:0/638783916 conn(0x7f217806bb90 msgr2=0x7f217806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f217f3a2700 1 -- 172.21.15.81:0/638783916 shutdown_connections 2023-10-06T02:52:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.048+0000 7f217f3a2700 1 -- 172.21.15.81:0/638783916 wait complete. 2023-10-06T02:52:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.049+0000 7f217f3a2700 1 Processor -- start 2023-10-06T02:52:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.049+0000 7f217f3a2700 1 -- start start 2023-10-06T02:52:20.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217f3a2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f217806d120 0x7f21780c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217f3a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 0x7f21780b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217f3a2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2178157ca0 0x7f21780cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217f3a2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780c6400 con 0x7f21781578d0 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217f3a2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780c66e0 con 0x7f2178157ca0 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217f3a2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21780c69c0 con 0x7f217806d120 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217c93d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 0x7f21780b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217c93d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 0x7f21780b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49734/0 (socket says 172.21.15.81:49734) 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217c93d700 1 -- 172.21.15.81:0/324215048 learned_addr learned my addr 172.21.15.81:0/324215048 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217c93d700 1 -- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f217806d120 msgr2=0x7f21780c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217d93f700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2178157ca0 0x7f21780cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217c93d700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f217806d120 0x7f21780c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217c93d700 1 -- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2178157ca0 msgr2=0x7f21780cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217c93d700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2178157ca0 0x7f21780cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217c93d700 1 -- 172.21.15.81:0/324215048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174009a20 con 0x7f21781578d0 2023-10-06T02:52:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.050+0000 7f217c93d700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 0x7f21780b5f40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f216800b5e0 tx=0x7f21680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.051+0000 7f216d7fa700 1 -- 172.21.15.81:0/324215048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800f510 con 0x7f21781578d0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.051+0000 7f216d7fa700 1 -- 172.21.15.81:0/324215048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216800f670 con 0x7f21781578d0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.051+0000 7f216d7fa700 1 -- 172.21.15.81:0/324215048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800fa30 con 0x7f21781578d0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.051+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21780c6ca0 con 0x7f21781578d0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.051+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21780c6060 con 0x7f21781578d0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.051+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21780c71c0 con 0x7f21781578d0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.052+0000 7f216d7fa700 1 -- 172.21.15.81:0/324215048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f216801a400 con 0x7f21781578d0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.052+0000 7f216d7fa700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f215c066f30 0x7f215c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.052+0000 7f216d7fa700 1 -- 172.21.15.81:0/324215048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2168083ef0 con 0x7f21781578d0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.053+0000 7f217d13e700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f215c066f30 0x7f215c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.053+0000 7f217d13e700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f215c066f30 0x7f215c0693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2178068510 tx=0x7f2174019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.056+0000 7f216d7fa700 1 -- 172.21.15.81:0/324215048 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21780c71c0 con 0x7f21781578d0 2023-10-06T02:52:20.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.279+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21780c71c0 con 0x7f21781578d0 2023-10-06T02:52:20.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.280+0000 7f216d7fa700 1 -- 172.21.15.81:0/324215048 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f21780c71c0 con 0x7f21781578d0 2023-10-06T02:52:20.282 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:20.282 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":61,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3448648390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3448648390},{"type":"v1","addr":"172.21.15.83:6836","nonce":3448648390}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/259812660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":259812660},{"type":"v1","addr":"172.21.15.83:6837","nonce":259812660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4011741221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4011741221},{"type":"v1","addr":"172.21.15.81:6834","nonce":4011741221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1447188012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1447188012},{"type":"v1","addr":"172.21.15.81:6835","nonce":1447188012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[]} 2023-10-06T02:52:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.281+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f215c066f30 msgr2=0x7f215c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.281+0000 7f217f3a2700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f215c066f30 0x7f215c0693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2178068510 tx=0x7f2174019000 comp rx=0 tx=0).stop 2023-10-06T02:52:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.281+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 msgr2=0x7f21780b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.282+0000 7f217f3a2700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 0x7f21780b5f40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f216800b5e0 tx=0x7f21680091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.282+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 shutdown_connections 2023-10-06T02:52:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.282+0000 7f217f3a2700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f215c066f30 0x7f215c0693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.282+0000 7f217f3a2700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2178157ca0 0x7f21780cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.282+0000 7f217f3a2700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f217806d120 0x7f21780c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.282+0000 7f217f3a2700 1 --2- 172.21.15.81:0/324215048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21781578d0 0x7f21780b5f40 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.282+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 >> 172.21.15.81:0/324215048 conn(0x7f217806bb90 msgr2=0x7f2178155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.282+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 shutdown_connections 2023-10-06T02:52:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.282+0000 7f217f3a2700 1 -- 172.21.15.81:0/324215048 wait complete. 2023-10-06T02:52:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 61 2023-10-06T02:52:20.296 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:52:20.296 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:52:20.296 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:52:20.296 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:52:20.297 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:52:20.297 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:52:20.297 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:52:20.297 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:52:20.297 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:52:20.297 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:52:20.298 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:52:20.298 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:52:20.298 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:52:20.298 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:52:20.298 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:52:20.298 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:52:20.305 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:52:20.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:52:20.306 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:52:20.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:52:20.308 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:52:20.308 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:52:20.309 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:52:20.309 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:52:20.348 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:52:20.348 DEBUG:teuthology.parallel:result is None 2023-10-06T02:52:20.349 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:52:20.350 DEBUG:teuthology.parallel:result is None 2023-10-06T02:52:20.350 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:52:20.351 DEBUG:teuthology.parallel:result is None 2023-10-06T02:52:20.351 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:52:20.351 DEBUG:teuthology.parallel:result is None 2023-10-06T02:52:20.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:52:20.420 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:52:20.421 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:52:20.421 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-06T02:52:20.419+0000 7f4782b3d700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-06T02:52:20.429 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:52:20.430 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:52:20.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.470+0000 7f2be5fc4700 1 Processor -- start 2023-10-06T02:52:20.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.470+0000 7f2be5fc4700 1 -- start start 2023-10-06T02:52:20.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.470+0000 7f2be5fc4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2be01578d0 0x7f2be00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.470+0000 7f2be5fc4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be006d120 0x7f2be006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.470+0000 7f2be5fc4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be00d07c0 con 0x7f2be0157ca0 2023-10-06T02:52:20.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.470+0000 7f2be5fc4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be006daa0 con 0x7f2be01578d0 2023-10-06T02:52:20.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.470+0000 7f2be5fc4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00cfbb0 con 0x7f2be006d120 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.470+0000 7f2bdf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2be01578d0 0x7f2be00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bdf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2be01578d0 0x7f2be00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56548/0 (socket says 172.21.15.81:56548) 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bdf7fe700 1 -- 172.21.15.81:0/1624523127 learned_addr learned my addr 172.21.15.81:0/1624523127 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bdffff700 1 --2- 172.21.15.81:0/1624523127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be006d120 0x7f2be006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bdf7fe700 1 -- 172.21.15.81:0/1624523127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be006d120 msgr2=0x7f2be006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bdf7fe700 1 --2- 172.21.15.81:0/1624523127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be006d120 0x7f2be006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bdf7fe700 1 -- 172.21.15.81:0/1624523127 >> v1:172.21.15.83:6789/0 conn(0x7f2be0157ca0 legacy=0x7f2be015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bdf7fe700 1 -- 172.21.15.81:0/1624523127 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be00cfe90 con 0x7f2be01578d0 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bdf7fe700 1 --2- 172.21.15.81:0/1624523127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 0x7f2be00cf4f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009f20 tx=0x7f2bd0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf47007ffff36dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bde7fc700 1 -- 172.21.15.81:0/1624523127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd000e070 con 0x7f2be01578d0 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bde7fc700 1 -- 172.21.15.81:0/1624523127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd000b9d0 con 0x7f2be01578d0 2023-10-06T02:52:20.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.471+0000 7f2bde7fc700 1 -- 172.21.15.81:0/1624523127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd00092e0 con 0x7f2be01578d0 2023-10-06T02:52:20.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.472+0000 7f2be5fc4700 1 -- 172.21.15.81:0/1624523127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 msgr2=0x7f2be00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.472+0000 7f2be5fc4700 1 --2- 172.21.15.81:0/1624523127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 0x7f2be00cf4f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009f20 tx=0x7f2bd0009840 comp rx=0 tx=0).stop 2023-10-06T02:52:20.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.472+0000 7f2be5fc4700 1 -- 172.21.15.81:0/1624523127 shutdown_connections 2023-10-06T02:52:20.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.472+0000 7f2be5fc4700 1 --2- 172.21.15.81:0/1624523127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be006d120 0x7f2be006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.472+0000 7f2be5fc4700 1 --2- 172.21.15.81:0/1624523127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 0x7f2be00cf4f0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.472+0000 7f2be5fc4700 1 -- 172.21.15.81:0/1624523127 >> 172.21.15.81:0/1624523127 conn(0x7f2be006bb90 msgr2=0x7f2be006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:20.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.472+0000 7f2be5fc4700 1 -- 172.21.15.81:0/1624523127 shutdown_connections 2023-10-06T02:52:20.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.472+0000 7f2be5fc4700 1 -- 172.21.15.81:0/1624523127 wait complete. 2023-10-06T02:52:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.473+0000 7f2be5fc4700 1 Processor -- start 2023-10-06T02:52:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.473+0000 7f2be5fc4700 1 -- start start 2023-10-06T02:52:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2be5fc4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be006d120 0x7f2be01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2be5fc4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 0x7f2be00ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2be5fc4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be0157ca0 0x7f2be00adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2be5fc4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00ab9c0 con 0x7f2be01578d0 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2be5fc4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00acee0 con 0x7f2be006d120 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2be5fc4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00ac7d0 con 0x7f2be0157ca0 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 0x7f2be00ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 0x7f2be00ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56564/0 (socket says 172.21.15.81:56564) 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdeffd700 1 -- 172.21.15.81:0/2746432382 learned_addr learned my addr 172.21.15.81:0/2746432382 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdffff700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be0157ca0 0x7f2be00adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdf7fe700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be006d120 0x7f2be01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdeffd700 1 -- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be0157ca0 msgr2=0x7f2be00adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdeffd700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be0157ca0 0x7f2be00adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdeffd700 1 -- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be006d120 msgr2=0x7f2be01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdeffd700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be006d120 0x7f2be01596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdeffd700 1 -- 172.21.15.81:0/2746432382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0009ae0 con 0x7f2be01578d0 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdf7fe700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be006d120 0x7f2be01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bdeffd700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 0x7f2be00ad6a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400c590 tx=0x7f2bd4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bc77fe700 1 -- 172.21.15.81:0/2746432382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4011590 con 0x7f2be01578d0 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bc77fe700 1 -- 172.21.15.81:0/2746432382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd4011710 con 0x7f2be01578d0 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be00ab400 con 0x7f2be01578d0 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2bc77fe700 1 -- 172.21.15.81:0/2746432382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4011ad0 con 0x7f2be01578d0 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.474+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be00ad180 con 0x7f2be01578d0 2023-10-06T02:52:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.475+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be00ad3a0 con 0x7f2be01578d0 2023-10-06T02:52:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.476+0000 7f2bc77fe700 1 -- 172.21.15.81:0/2746432382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2bd401a360 con 0x7f2be01578d0 2023-10-06T02:52:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.476+0000 7f2bc77fe700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bcc066f30 0x7f2bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.476+0000 7f2bc77fe700 1 -- 172.21.15.81:0/2746432382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2bd4083350 con 0x7f2be01578d0 2023-10-06T02:52:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.476+0000 7f2bdf7fe700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bcc066f30 0x7f2bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.477+0000 7f2bdf7fe700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bcc066f30 0x7f2bcc0693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009880 tx=0x7f2bd0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.480+0000 7f2bc77fe700 1 -- 172.21.15.81:0/2746432382 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bd4050760 con 0x7f2be01578d0 2023-10-06T02:52:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:20.681+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2be00d0170 con 0x7f2be01578d0 2023-10-06T02:52:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.510+0000 7f2bc77fe700 1 -- 172.21.15.81:0/2746432382 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v131) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2bd4053d80 con 0x7f2be01578d0 2023-10-06T02:52:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bcc066f30 msgr2=0x7f2bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bcc066f30 0x7f2bcc0693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009880 tx=0x7f2bd0018000 comp rx=0 tx=0).stop 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 msgr2=0x7f2be00ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 0x7f2be00ad6a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400c590 tx=0x7f2bd4007f50 comp rx=0 tx=0).stop 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 shutdown_connections 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2be0157ca0 0x7f2be00adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2bcc066f30 0x7f2bcc0693e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2be006d120 0x7f2be01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 --2- 172.21.15.81:0/2746432382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be01578d0 0x7f2be00ad6a0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 >> 172.21.15.81:0/2746432382 conn(0x7f2be006bb90 msgr2=0x7f2be00697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 shutdown_connections 2023-10-06T02:52:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.513+0000 7f2be5fc4700 1 -- 172.21.15.81:0/2746432382 wait complete. 2023-10-06T02:52:21.517 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:52:21.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:52:21.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.642+0000 7f47d9a03700 1 Processor -- start 2023-10-06T02:52:21.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.642+0000 7f47d9a03700 1 -- start start 2023-10-06T02:52:21.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.643+0000 7f47d9a03700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d4068e90 0x7f47d4164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.643+0000 7f47d9a03700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d40cee10 con 0x7f47d4159f10 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.643+0000 7f47d9a03700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d40cd040 con 0x7f47d4159b40 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.643+0000 7f47d9a03700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40cd320 con 0x7f47d4068e90 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.643+0000 7f47d3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f47d4159f10 0x7f47d4068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44476/0 (socket says 172.21.15.81:44476) 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.643+0000 7f47d3fff700 1 -- 172.21.15.81:0/3361378208 learned_addr learned my addr 172.21.15.81:0/3361378208 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d9202700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d4068e90 0x7f47d4164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536719720 0 0) 0x7f47d40cee10 con 0x7f47d4159f10 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c0003570 con 0x7f47d4159f10 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104251037 0 0) 0x7f47c0003570 con 0x7f47d4159f10 2023-10-06T02:52:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d4068e90 msgr2=0x7f47d4164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d4068e90 0x7f47d4164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 >> v1:172.21.15.83:6789/0 conn(0x7f47d4159b40 legacy=0x7f47d40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40ce7c0 con 0x7f47d4159f10 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f47bc0017f0 con 0x7f47d4159f10 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 >> v1:172.21.15.81:6789/0 conn(0x7f47d4159f10 legacy=0x7f47d4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47c0003a90 0x7f47c0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0004810 0x7f47c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d4068e90 0x7f47c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40cd320 con 0x7f47c0004810 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c000bb10 con 0x7f47c0003a90 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c000bcd0 con 0x7f47d4068e90 2023-10-06T02:52:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d3fff700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0004810 0x7f47c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d8a01700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47c0003a90 0x7f47c0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d9202700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d4068e90 0x7f47c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d3fff700 1 -- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d4068e90 msgr2=0x7f47c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d3fff700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d4068e90 0x7f47c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d3fff700 1 -- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47c0003a90 msgr2=0x7f47c0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d3fff700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47c0003a90 0x7f47c0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.644+0000 7f47d3fff700 1 -- 172.21.15.81:0/3361378208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c0003570 con 0x7f47c0004810 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d3fff700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0004810 0x7f47c0004c80 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00a950 tx=0x7f47bc0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63288d3e6a013be0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0070d0 con 0x7f47c0004810 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc007230 con 0x7f47c0004810 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d37fe700 1 -- 172.21.15.81:0/3361378208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0075f0 con 0x7f47c0004810 2023-10-06T02:52:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d9a03700 1 -- 172.21.15.81:0/3361378208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0004810 msgr2=0x7f47c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d9a03700 1 --2- 172.21.15.81:0/3361378208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0004810 0x7f47c0004c80 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00a950 tx=0x7f47bc0021f0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d9202700 1 -- 172.21.15.81:0/3361378208 reap_dead start 2023-10-06T02:52:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d9a03700 1 -- 172.21.15.81:0/3361378208 shutdown_connections 2023-10-06T02:52:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d9a03700 1 -- 172.21.15.81:0/3361378208 >> 172.21.15.81:0/3361378208 conn(0x7f47d40cd660 msgr2=0x7f47d40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d9a03700 1 -- 172.21.15.81:0/3361378208 shutdown_connections 2023-10-06T02:52:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.645+0000 7f47d9a03700 1 -- 172.21.15.81:0/3361378208 wait complete. 2023-10-06T02:52:21.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.646+0000 7f47d9a03700 1 Processor -- start 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.647+0000 7f47d9a03700 1 -- start start 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.647+0000 7f47d9a03700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47c0004810 0x7f47d40c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.647+0000 7f47d9a03700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d40c9b70 0x7f47d416abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.647+0000 7f47d9a03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d416b0f0 0x7f47d416b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.647+0000 7f47d9a03700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d416bab0 con 0x7f47d416b0f0 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.647+0000 7f47d9a03700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d416c430 con 0x7f47c0004810 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.647+0000 7f47d9a03700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d4154b70 con 0x7f47d40c9b70 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9202700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d416b0f0 0x7f47d416b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9202700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d416b0f0 0x7f47d416b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56580/0 (socket says 172.21.15.81:56580) 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9202700 1 -- 172.21.15.81:0/3453985748 learned_addr learned my addr 172.21.15.81:0/3453985748 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d8a01700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47c0004810 0x7f47d40c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d3fff700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d40c9b70 0x7f47d416abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9202700 1 -- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d40c9b70 msgr2=0x7f47d416abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9202700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d40c9b70 0x7f47d416abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9202700 1 -- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47c0004810 msgr2=0x7f47d40c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9202700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47c0004810 0x7f47d40c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9202700 1 -- 172.21.15.81:0/3453985748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40c9fe0 con 0x7f47d416b0f0 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9202700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d416b0f0 0x7f47d416b570 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f47d40cae30 tx=0x7f47cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d0ff9700 1 -- 172.21.15.81:0/3453985748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc013750 con 0x7f47d416b0f0 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d0ff9700 1 -- 172.21.15.81:0/3453985748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc0138d0 con 0x7f47d416b0f0 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d416be20 con 0x7f47d416b0f0 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d0ff9700 1 -- 172.21.15.81:0/3453985748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc013c90 con 0x7f47d416b0f0 2023-10-06T02:52:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.648+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d416c0c0 con 0x7f47d416b0f0 2023-10-06T02:52:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.649+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d416c5e0 con 0x7f47d416b0f0 2023-10-06T02:52:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.649+0000 7f47d0ff9700 1 -- 172.21.15.81:0/3453985748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47cc014650 con 0x7f47d416b0f0 2023-10-06T02:52:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.650+0000 7f47d0ff9700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f47b4066f30 0x7f47b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.650+0000 7f47d0ff9700 1 -- 172.21.15.81:0/3453985748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f47cc0848e0 con 0x7f47d416b0f0 2023-10-06T02:52:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.650+0000 7f47d8a01700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f47b4066f30 0x7f47b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.650+0000 7f47d8a01700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f47b4066f30 0x7f47b40693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47d41591b0 tx=0x7f47c4007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.654+0000 7f47d0ff9700 1 -- 172.21.15.81:0/3453985748 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47d416c5e0 con 0x7f47d416b0f0 2023-10-06T02:52:21.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.907+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f47d416c5a0 con 0x7f47d416b0f0 2023-10-06T02:52:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.908+0000 7f47d0ff9700 1 -- 172.21.15.81:0/3453985748 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f47cc022090 con 0x7f47d416b0f0 2023-10-06T02:52:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:21.910 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:52:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:52:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:52:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:52:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:52:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:52:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:52:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:52:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:52:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:52:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:52:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:52:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:52:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:52:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:52:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:52:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:52:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:52:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:52:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:52:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:52:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:52:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:21.928 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:21.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.909+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f47b4066f30 msgr2=0x7f47b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:21.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.909+0000 7f47d9a03700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f47b4066f30 0x7f47b40693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47d41591b0 tx=0x7f47c4007d10 comp rx=0 tx=0).stop 2023-10-06T02:52:21.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.909+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d416b0f0 msgr2=0x7f47d416b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:21.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.909+0000 7f47d9a03700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d416b0f0 0x7f47d416b570 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f47d40cae30 tx=0x7f47cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.910+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 shutdown_connections 2023-10-06T02:52:21.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.910+0000 7f47d9a03700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d416b0f0 0x7f47d416b570 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.910+0000 7f47d9a03700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f47b4066f30 0x7f47b40693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.910+0000 7f47d9a03700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47c0004810 0x7f47d40c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.910+0000 7f47d9a03700 1 --2- 172.21.15.81:0/3453985748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d40c9b70 0x7f47d416abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:21.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.910+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 >> 172.21.15.81:0/3453985748 conn(0x7f47d40cd660 msgr2=0x7f47d40b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:21.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.910+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 shutdown_connections 2023-10-06T02:52:21.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:21.910+0000 7f47d9a03700 1 -- 172.21.15.81:0/3453985748 wait complete. 2023-10-06T02:52:21.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:52:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.044+0000 7f091ffff700 1 Processor -- start 2023-10-06T02:52:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.044+0000 7f091ffff700 1 -- start start 2023-10-06T02:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0920159b40 0x7f09200cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0920159f10 0x7f0920068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09200cee10 con 0x7f09200ccb40 2023-10-06T02:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09200cd040 con 0x7f0920159b40 2023-10-06T02:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091ffff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09200cd320 con 0x7f0920159f10 2023-10-06T02:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0920159b40 0x7f09200cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f09200ccb40 0x7f092015d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44490/0 (socket says 172.21.15.81:44490) 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091f7fe700 1 -- 172.21.15.81:0/4222282771 learned_addr learned my addr 172.21.15.81:0/4222282771 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f09167fc700 1 --2- 172.21.15.81:0/4222282771 >> v2:172.21.15.83:3300/0 conn(0x7f0920159f10 0x7f0920068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091effd700 1 -- 172.21.15.81:0/4222282771 >> v2:172.21.15.83:3300/0 conn(0x7f0920159f10 msgr2=0x7f0920068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091effd700 1 --2- 172.21.15.81:0/4222282771 >> v2:172.21.15.83:3300/0 conn(0x7f0920159f10 0x7f0920068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091effd700 1 -- 172.21.15.81:0/4222282771 >> v1:172.21.15.81:6789/0 conn(0x7f09200ccb40 legacy=0x7f092015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091e7fc700 1 -- 172.21.15.81:0/4222282771 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097145299 0 0) 0x7f09200cee10 con 0x7f09200ccb40 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.045+0000 7f091effd700 1 -- 172.21.15.81:0/4222282771 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09200ce7c0 con 0x7f0920159b40 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091effd700 1 --2- 172.21.15.81:0/4222282771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 0x7f09200cc600 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f092006fd80 tx=0x7f09100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fba34ec34e91688 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091e7fc700 1 -- 172.21.15.81:0/4222282771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091000b6b0 con 0x7f0920159b40 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091e7fc700 1 -- 172.21.15.81:0/4222282771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091000b810 con 0x7f0920159b40 2023-10-06T02:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091e7fc700 1 -- 172.21.15.81:0/4222282771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091000bbb0 con 0x7f0920159b40 2023-10-06T02:52:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091ffff700 1 -- 172.21.15.81:0/4222282771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 msgr2=0x7f09200cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091ffff700 1 --2- 172.21.15.81:0/4222282771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 0x7f09200cc600 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f092006fd80 tx=0x7f09100091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091ffff700 1 -- 172.21.15.81:0/4222282771 shutdown_connections 2023-10-06T02:52:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091ffff700 1 --2- 172.21.15.81:0/4222282771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 0x7f09200cc600 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091ffff700 1 --2- 172.21.15.81:0/4222282771 >> v2:172.21.15.83:3300/0 conn(0x7f0920159f10 0x7f0920068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091ffff700 1 -- 172.21.15.81:0/4222282771 >> 172.21.15.81:0/4222282771 conn(0x7f09200cd660 msgr2=0x7f09200cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091ffff700 1 -- 172.21.15.81:0/4222282771 shutdown_connections 2023-10-06T02:52:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.046+0000 7f091ffff700 1 -- 172.21.15.81:0/4222282771 wait complete. 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.047+0000 7f091ffff700 1 Processor -- start 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f091ffff700 1 -- start start 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f091ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09200ccb40 0x7f09200ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f091ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 0x7f0920154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f091ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0920159f10 0x7f09200c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f091ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920156a30 con 0x7f0920159b40 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f091ffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09200c81e0 con 0x7f0920159f10 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f091ffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09200c8480 con 0x7f09200ccb40 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f09167fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 0x7f0920154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f09167fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 0x7f0920154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56606/0 (socket says 172.21.15.81:56606) 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f09167fc700 1 -- 172.21.15.81:0/576243219 learned_addr learned my addr 172.21.15.81:0/576243219 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f091f7fe700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0920159f10 0x7f09200c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.048+0000 7f091effd700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09200ccb40 0x7f09200ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f09167fc700 1 -- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09200ccb40 msgr2=0x7f09200ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f09167fc700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09200ccb40 0x7f09200ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f09167fc700 1 -- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0920159f10 msgr2=0x7f09200c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f09167fc700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0920159f10 0x7f09200c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f09167fc700 1 -- 172.21.15.81:0/576243219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910009420 con 0x7f0920159b40 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f09167fc700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 0x7f0920154980 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f090800d860 tx=0x7f0908008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f09177fe700 1 -- 172.21.15.81:0/576243219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080125f0 con 0x7f0920159b40 2023-10-06T02:52:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f09177fe700 1 -- 172.21.15.81:0/576243219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0908012750 con 0x7f0920159b40 2023-10-06T02:52:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09200c8760 con 0x7f0920159b40 2023-10-06T02:52:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f09177fe700 1 -- 172.21.15.81:0/576243219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908012b10 con 0x7f0920159b40 2023-10-06T02:52:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.049+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09200c8d20 con 0x7f0920159b40 2023-10-06T02:52:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.050+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09200697e0 con 0x7f0920159b40 2023-10-06T02:52:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.050+0000 7f09177fe700 1 -- 172.21.15.81:0/576243219 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f090801e460 con 0x7f0920159b40 2023-10-06T02:52:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.051+0000 7f09177fe700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0900066f30 0x7f09000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.051+0000 7f09177fe700 1 -- 172.21.15.81:0/576243219 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0908084830 con 0x7f0920159b40 2023-10-06T02:52:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.051+0000 7f091effd700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0900066f30 0x7f09000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.051+0000 7f091effd700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0900066f30 0x7f09000693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f09100093f0 tx=0x7f0910017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:22.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.055+0000 7f09177fe700 1 -- 172.21.15.81:0/576243219 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0908055720 con 0x7f0920159b40 2023-10-06T02:52:22.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.236+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09200c8eb0 con 0x7f0920159b40 2023-10-06T02:52:22.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.237+0000 7f09177fe700 1 -- 172.21.15.81:0/576243219 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+13614 (secure 0 0 0) 0x7f09080552b0 con 0x7f0920159b40 2023-10-06T02:52:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:22.239 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":131,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:21.507784+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:52:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0900066f30 msgr2=0x7f09000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0900066f30 0x7f09000693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f09100093f0 tx=0x7f0910017000 comp rx=0 tx=0).stop 2023-10-06T02:52:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 msgr2=0x7f0920154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 0x7f0920154980 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f090800d860 tx=0x7f0908008040 comp rx=0 tx=0).stop 2023-10-06T02:52:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 shutdown_connections 2023-10-06T02:52:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0900066f30 0x7f09000693e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0920159f10 0x7f09200c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09200ccb40 0x7f09200ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 --2- 172.21.15.81:0/576243219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0920159b40 0x7f0920154980 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 >> 172.21.15.81:0/576243219 conn(0x7f09200cd660 msgr2=0x7f092006f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 shutdown_connections 2023-10-06T02:52:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.239+0000 7f091ffff700 1 -- 172.21.15.81:0/576243219 wait complete. 2023-10-06T02:52:22.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:52:22.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:52:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.368+0000 7f64b9e1c700 1 Processor -- start 2023-10-06T02:52:22.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.368+0000 7f64b9e1c700 1 -- start start 2023-10-06T02:52:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b9e1c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64b40d0b80 0x7f64b40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b9e1c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b406d700 0x7f64b415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b9e1c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b40cf2d0 con 0x7f64b40d02b0 2023-10-06T02:52:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b9e1c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b415a690 con 0x7f64b40d0b80 2023-10-06T02:52:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b9e1c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b406dc00 con 0x7f64b406d700 2023-10-06T02:52:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b8e1a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64b40d0b80 0x7f64b40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b8e1a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64b40d0b80 0x7f64b40cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56618/0 (socket says 172.21.15.81:56618) 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b8e1a700 1 -- 172.21.15.81:0/2360123025 learned_addr learned my addr 172.21.15.81:0/2360123025 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b961b700 1 --2- 172.21.15.81:0/2360123025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b406d700 0x7f64b415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b8e1a700 1 -- 172.21.15.81:0/2360123025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b406d700 msgr2=0x7f64b415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b8e1a700 1 --2- 172.21.15.81:0/2360123025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b406d700 0x7f64b415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b8e1a700 1 -- 172.21.15.81:0/2360123025 >> v1:172.21.15.83:6789/0 conn(0x7f64b40d02b0 legacy=0x7f64b406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.369+0000 7f64b8e1a700 1 -- 172.21.15.81:0/2360123025 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40cf570 con 0x7f64b40d0b80 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b8e1a700 1 --2- 172.21.15.81:0/2360123025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b40d0b80 0x7f64b40cfd70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009f20 tx=0x7f64a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be7d8fb750f328a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b37fe700 1 -- 172.21.15.81:0/2360123025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a400e070 con 0x7f64b40d0b80 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b37fe700 1 -- 172.21.15.81:0/2360123025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a400ba40 con 0x7f64b40d0b80 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b37fe700 1 -- 172.21.15.81:0/2360123025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a40092e0 con 0x7f64b40d0b80 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2360123025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b40d0b80 msgr2=0x7f64b40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b9e1c700 1 --2- 172.21.15.81:0/2360123025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b40d0b80 0x7f64b40cfd70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009f20 tx=0x7f64a4009840 comp rx=0 tx=0).stop 2023-10-06T02:52:22.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2360123025 shutdown_connections 2023-10-06T02:52:22.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b9e1c700 1 --2- 172.21.15.81:0/2360123025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b406d700 0x7f64b415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b9e1c700 1 --2- 172.21.15.81:0/2360123025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b40d0b80 0x7f64b40cfd70 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2360123025 >> 172.21.15.81:0/2360123025 conn(0x7f64b4063230 msgr2=0x7f64b4063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:22.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2360123025 shutdown_connections 2023-10-06T02:52:22.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.370+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2360123025 wait complete. 2023-10-06T02:52:22.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.371+0000 7f64b9e1c700 1 Processor -- start 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b9e1c700 1 -- start start 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b9e1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b406d700 0x7f64b41570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b9e1c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b40d02b0 0x7f64b40af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b9e1c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b40d0b80 0x7f64b40ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b9e1c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40b1580 con 0x7f64b406d700 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b9e1c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4157630 con 0x7f64b40d02b0 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b9e1c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40aef80 con 0x7f64b40d0b80 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b8e1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b406d700 0x7f64b41570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b8e1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b406d700 0x7f64b41570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56628/0 (socket says 172.21.15.81:56628) 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b8e1a700 1 -- 172.21.15.81:0/2510383127 learned_addr learned my addr 172.21.15.81:0/2510383127 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b961b700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b40d0b80 0x7f64b40ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.372+0000 7f64b3fff700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b40d02b0 0x7f64b40af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b8e1a700 1 -- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b40d0b80 msgr2=0x7f64b40ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b8e1a700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b40d0b80 0x7f64b40ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b8e1a700 1 -- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b40d02b0 msgr2=0x7f64b40af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b8e1a700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b40d02b0 0x7f64b40af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b8e1a700 1 -- 172.21.15.81:0/2510383127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4009ae0 con 0x7f64b406d700 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b8e1a700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b406d700 0x7f64b41570f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f64b406fcc0 tx=0x7f64a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b0ff9700 1 -- 172.21.15.81:0/2510383127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4012950 con 0x7f64b406d700 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b0ff9700 1 -- 172.21.15.81:0/2510383127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a4012ab0 con 0x7f64b406d700 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b0ff9700 1 -- 172.21.15.81:0/2510383127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4012e50 con 0x7f64b406d700 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b40ae330 con 0x7f64b406d700 2023-10-06T02:52:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.373+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b40ad600 con 0x7f64b406d700 2023-10-06T02:52:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.374+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b40676e0 con 0x7f64b406d700 2023-10-06T02:52:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.374+0000 7f64b0ff9700 1 -- 172.21.15.81:0/2510383127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64a401d630 con 0x7f64b406d700 2023-10-06T02:52:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.375+0000 7f64b0ff9700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64a0066f30 0x7f64a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.375+0000 7f64b0ff9700 1 -- 172.21.15.81:0/2510383127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f64a4085940 con 0x7f64b406d700 2023-10-06T02:52:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.375+0000 7f64b3fff700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64a0066f30 0x7f64a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.375+0000 7f64b3fff700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64a0066f30 0x7f64a00693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f64b406a700 tx=0x7f64a8007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:22.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.379+0000 7f64b0ff9700 1 -- 172.21.15.81:0/2510383127 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64a4052da0 con 0x7f64b406d700 2023-10-06T02:52:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.559+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64b4071b10 con 0x7f64b406d700 2023-10-06T02:52:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.559+0000 7f64b0ff9700 1 -- 172.21.15.81:0/2510383127 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64a402a020 con 0x7f64b406d700 2023-10-06T02:52:22.562 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:52:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64a0066f30 msgr2=0x7f64a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64a0066f30 0x7f64a00693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f64b406a700 tx=0x7f64a8007ea0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b406d700 msgr2=0x7f64b41570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b406d700 0x7f64b41570f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f64b406fcc0 tx=0x7f64a4017000 comp rx=0 tx=0).stop 2023-10-06T02:52:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 shutdown_connections 2023-10-06T02:52:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64b40d0b80 0x7f64b40ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b406d700 0x7f64b41570f0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f64a0066f30 0x7f64a00693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 --2- 172.21.15.81:0/2510383127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b40d02b0 0x7f64b40af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 >> 172.21.15.81:0/2510383127 conn(0x7f64b4063230 msgr2=0x7f64b415c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.561+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 shutdown_connections 2023-10-06T02:52:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.562+0000 7f64b9e1c700 1 -- 172.21.15.81:0/2510383127 wait complete. 2023-10-06T02:52:22.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:52:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.692+0000 7f3676b9b700 1 Processor -- start 2023-10-06T02:52:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.692+0000 7f3676b9b700 1 -- start start 2023-10-06T02:52:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.693+0000 7f3676b9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f367006d830 0x7f36700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.693+0000 7f3676b9b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700d07c0 con 0x7f3670157ca0 2023-10-06T02:52:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.693+0000 7f3676b9b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700cfbb0 con 0x7f36701578d0 2023-10-06T02:52:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.693+0000 7f3676b9b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700cfe90 con 0x7f367006d830 2023-10-06T02:52:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.693+0000 7f3667fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3670157ca0 0x7f367006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44504/0 (socket says 172.21.15.81:44504) 2023-10-06T02:52:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.693+0000 7f3667fff700 1 -- 172.21.15.81:0/1970137742 learned_addr learned my addr 172.21.15.81:0/1970137742 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.693+0000 7f3675138700 1 --2- 172.21.15.81:0/1970137742 >> v2:172.21.15.83:3300/0 conn(0x7f367006d830 0x7f36700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.693+0000 7f36677fe700 1 -- 172.21.15.81:0/1970137742 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690870963 0 0) 0x7f36700d07c0 con 0x7f3670157ca0 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.694+0000 7f36677fe700 1 -- 172.21.15.81:0/1970137742 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3658003570 con 0x7f3670157ca0 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.694+0000 7f3675138700 1 -- 172.21.15.81:0/1970137742 >> v1:172.21.15.83:6789/0 conn(0x7f36701578d0 legacy=0x7f367015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.694+0000 7f3675138700 1 -- 172.21.15.81:0/1970137742 >> v1:172.21.15.81:6789/0 conn(0x7f3670157ca0 legacy=0x7f367006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.694+0000 7f3675138700 1 -- 172.21.15.81:0/1970137742 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700d0170 con 0x7f367006d830 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.694+0000 7f3675138700 1 --2- 172.21.15.81:0/1970137742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f367006d830 0x7f36700cf4f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f36680098e0 tx=0x7f36680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4af40f6a8e7147c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.694+0000 7f36677fe700 1 -- 172.21.15.81:0/1970137742 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800b640 con 0x7f367006d830 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.694+0000 7f36677fe700 1 -- 172.21.15.81:0/1970137742 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800b7a0 con 0x7f367006d830 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.694+0000 7f36677fe700 1 -- 172.21.15.81:0/1970137742 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800bb40 con 0x7f367006d830 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.695+0000 7f3676b9b700 1 -- 172.21.15.81:0/1970137742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f367006d830 msgr2=0x7f36700cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.695+0000 7f3676b9b700 1 --2- 172.21.15.81:0/1970137742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f367006d830 0x7f36700cf4f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f36680098e0 tx=0x7f36680091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.695+0000 7f3676b9b700 1 -- 172.21.15.81:0/1970137742 shutdown_connections 2023-10-06T02:52:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.695+0000 7f3676b9b700 1 --2- 172.21.15.81:0/1970137742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f367006d830 0x7f36700cf4f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.695+0000 7f3676b9b700 1 -- 172.21.15.81:0/1970137742 >> 172.21.15.81:0/1970137742 conn(0x7f367006bb90 msgr2=0x7f367006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.695+0000 7f3676b9b700 1 -- 172.21.15.81:0/1970137742 shutdown_connections 2023-10-06T02:52:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.695+0000 7f3676b9b700 1 -- 172.21.15.81:0/1970137742 wait complete. 2023-10-06T02:52:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.696+0000 7f3676b9b700 1 Processor -- start 2023-10-06T02:52:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.696+0000 7f3676b9b700 1 -- start start 2023-10-06T02:52:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3676b9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f367006d830 0x7f36700b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3676b9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36701578d0 0x7f36701418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3676b9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3670157ca0 0x7f36700b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3676b9b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670141e10 con 0x7f36701578d0 2023-10-06T02:52:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3676b9b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670159070 con 0x7f367006d830 2023-10-06T02:52:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3676b9b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3670159350 con 0x7f3670157ca0 2023-10-06T02:52:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3667fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36701578d0 0x7f36701418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3667fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36701578d0 0x7f36701418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56638/0 (socket says 172.21.15.81:56638) 2023-10-06T02:52:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3667fff700 1 -- 172.21.15.81:0/1576319007 learned_addr learned my addr 172.21.15.81:0/1576319007 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3675138700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3670157ca0 0x7f36700b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3674937700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f367006d830 0x7f36700b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3667fff700 1 -- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3670157ca0 msgr2=0x7f36700b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3667fff700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3670157ca0 0x7f36700b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3667fff700 1 -- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f367006d830 msgr2=0x7f36700b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3667fff700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f367006d830 0x7f36700b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3667fff700 1 -- 172.21.15.81:0/1576319007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668009420 con 0x7f36701578d0 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3667fff700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36701578d0 0x7f36701418d0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f366000c560 tx=0x7f3660007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3664ff9700 1 -- 172.21.15.81:0/1576319007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660005c00 con 0x7f36701578d0 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3664ff9700 1 -- 172.21.15.81:0/1576319007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3660005d60 con 0x7f36701578d0 2023-10-06T02:52:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3670159630 con 0x7f36701578d0 2023-10-06T02:52:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3664ff9700 1 -- 172.21.15.81:0/1576319007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660007300 con 0x7f36701578d0 2023-10-06T02:52:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.697+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3670158cb0 con 0x7f36701578d0 2023-10-06T02:52:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.698+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3670152040 con 0x7f36701578d0 2023-10-06T02:52:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.699+0000 7f3664ff9700 1 -- 172.21.15.81:0/1576319007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f366001b3b0 con 0x7f36701578d0 2023-10-06T02:52:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.699+0000 7f3664ff9700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f365c066f30 0x7f365c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.699+0000 7f3664ff9700 1 -- 172.21.15.81:0/1576319007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3660083890 con 0x7f36701578d0 2023-10-06T02:52:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.700+0000 7f3674937700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f365c066f30 0x7f365c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.700+0000 7f3674937700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f365c066f30 0x7f365c0693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f366c007fd0 tx=0x7f366c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.704+0000 7f3664ff9700 1 -- 172.21.15.81:0/1576319007 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3670152040 con 0x7f36701578d0 2023-10-06T02:52:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.885+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3670152040 con 0x7f36701578d0 2023-10-06T02:52:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.885+0000 7f3664ff9700 1 -- 172.21.15.81:0/1576319007 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v131) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3670152040 con 0x7f36701578d0 2023-10-06T02:52:22.887 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:52:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f365c066f30 msgr2=0x7f365c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f365c066f30 0x7f365c0693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f366c007fd0 tx=0x7f366c009040 comp rx=0 tx=0).stop 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36701578d0 msgr2=0x7f36701418d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36701578d0 0x7f36701418d0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f366000c560 tx=0x7f3660007dd0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 shutdown_connections 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3670157ca0 0x7f36700b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f365c066f30 0x7f365c0693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f367006d830 0x7f36700b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 --2- 172.21.15.81:0/1576319007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36701578d0 0x7f36701418d0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 >> 172.21.15.81:0/1576319007 conn(0x7f367006bb90 msgr2=0x7f3670155480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 shutdown_connections 2023-10-06T02:52:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:22.887+0000 7f3676b9b700 1 -- 172.21.15.81:0/1576319007 wait complete. 2023-10-06T02:52:22.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:52:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.013+0000 7fb90bfff700 1 Processor -- start 2023-10-06T02:52:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.013+0000 7fb90bfff700 1 -- start start 2023-10-06T02:52:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.014+0000 7fb90bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb90c0add30 0x7fb90c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.014+0000 7fb90bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c0b17c0 con 0x7fb90c0cefa0 2023-10-06T02:52:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.014+0000 7fb90bfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c0b1d80 con 0x7fb90c067640 2023-10-06T02:52:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.014+0000 7fb90bfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90c0b37b0 con 0x7fb90c0add30 2023-10-06T02:52:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.014+0000 7fb90b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb90c0cefa0 0x7fb90c0cc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44518/0 (socket says 172.21.15.81:44518) 2023-10-06T02:52:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.014+0000 7fb90b7fe700 1 -- 172.21.15.81:0/833969076 learned_addr learned my addr 172.21.15.81:0/833969076 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.014+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814708718 0 0) 0x7fb90c0b17c0 con 0x7fb90c0cefa0 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.014+0000 7fb90affd700 1 --2- 172.21.15.81:0/833969076 >> v2:172.21.15.83:3300/0 conn(0x7fb90c0add30 0x7fb90c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.014+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f8003570 con 0x7fb90c0cefa0 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498619383 0 0) 0x7fb8f8003570 con 0x7fb90c0cefa0 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 >> v2:172.21.15.83:3300/0 conn(0x7fb90c0add30 msgr2=0x7fb90c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 --2- 172.21.15.81:0/833969076 >> v2:172.21.15.83:3300/0 conn(0x7fb90c0add30 0x7fb90c0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 >> v1:172.21.15.83:6789/0 conn(0x7fb90c067640 legacy=0x7fb90c0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c068220 con 0x7fb90c0cefa0 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fb9040017f0 con 0x7fb90c0cefa0 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 >> v1:172.21.15.81:6789/0 conn(0x7fb90c0cefa0 legacy=0x7fb90c0cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8f8003a60 0x7fb8f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f8004810 0x7fb8f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f80051c0 0x7fb8f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f800c0a0 con 0x7fb8f80051c0 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f800c210 con 0x7fb8f8004810 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f800c3d0 con 0x7fb8f8003a60 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90b7fe700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f80051c0 0x7fb8f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb9027fc700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f8004810 0x7fb8f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90affd700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8f8003a60 0x7fb8f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90b7fe700 1 -- 172.21.15.81:0/833969076 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8f8003a60 msgr2=0x7fb8f8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90b7fe700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8f8003a60 0x7fb8f8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90b7fe700 1 -- 172.21.15.81:0/833969076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f8004810 msgr2=0x7fb8f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90b7fe700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f8004810 0x7fb8f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90b7fe700 1 -- 172.21.15.81:0/833969076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f8003570 con 0x7fb8f80051c0 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90affd700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8f8003a60 0x7fb8f8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90b7fe700 1 -- 172.21.15.81:0/833969076 reap_dead start 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90b7fe700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f80051c0 0x7fb8f800ba60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fb90400a900 tx=0x7fb9040021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76fed730cdfe9b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040070d0 con 0x7fb8f80051c0 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904007230 con 0x7fb8f80051c0 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.015+0000 7fb90a7fc700 1 -- 172.21.15.81:0/833969076 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040075d0 con 0x7fb8f80051c0 2023-10-06T02:52:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.016+0000 7fb90bfff700 1 -- 172.21.15.81:0/833969076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f80051c0 msgr2=0x7fb8f800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.016+0000 7fb90bfff700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f80051c0 0x7fb8f800ba60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fb90400a900 tx=0x7fb9040021d0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.016+0000 7fb90bfff700 1 -- 172.21.15.81:0/833969076 shutdown_connections 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.016+0000 7fb90bfff700 1 --2- 172.21.15.81:0/833969076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f80051c0 0x7fb8f800ba60 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.016+0000 7fb90bfff700 1 -- 172.21.15.81:0/833969076 >> 172.21.15.81:0/833969076 conn(0x7fb90c06c620 msgr2=0x7fb90c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.016+0000 7fb90bfff700 1 -- 172.21.15.81:0/833969076 shutdown_connections 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.016+0000 7fb90bfff700 1 -- 172.21.15.81:0/833969076 wait complete. 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.017+0000 7fb90bfff700 1 Processor -- start 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.017+0000 7fb90bfff700 1 -- start start 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb90bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f80051c0 0x7fb90c1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb90bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c0a67f0 0x7fb90c0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb90bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb90c0a6e70 0x7fb90c0a7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb90bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0a7850 con 0x7fb90c0a67f0 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb90bfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0a6c60 con 0x7fb8f80051c0 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb90bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0cd5c0 con 0x7fb90c0a6e70 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb9027fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c0a67f0 0x7fb90c0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb9027fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c0a67f0 0x7fb90c0cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56654/0 (socket says 172.21.15.81:56654) 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb9027fc700 1 -- 172.21.15.81:0/2324515538 learned_addr learned my addr 172.21.15.81:0/2324515538 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb90b7fe700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb90c0a6e70 0x7fb90c0a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb90affd700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f80051c0 0x7fb90c1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb9027fc700 1 -- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb90c0a6e70 msgr2=0x7fb90c0a7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb9027fc700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb90c0a6e70 0x7fb90c0a7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb9027fc700 1 -- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f80051c0 msgr2=0x7fb90c1541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb9027fc700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f80051c0 0x7fb90c1541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.018+0000 7fb9027fc700 1 -- 172.21.15.81:0/2324515538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0cd7d0 con 0x7fb90c0a67f0 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.019+0000 7fb9027fc700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c0a67f0 0x7fb90c0cd080 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4002950 tx=0x7fb8f4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.019+0000 7fb9037fe700 1 -- 172.21.15.81:0/2324515538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4006820 con 0x7fb90c0a67f0 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.019+0000 7fb9037fe700 1 -- 172.21.15.81:0/2324515538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4006980 con 0x7fb90c0a67f0 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.019+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c0cdab0 con 0x7fb90c0a67f0 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.019+0000 7fb9037fe700 1 -- 172.21.15.81:0/2324515538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4006d40 con 0x7fb90c0a67f0 2023-10-06T02:52:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.019+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c0ce070 con 0x7fb90c0a67f0 2023-10-06T02:52:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.020+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90c069920 con 0x7fb90c0a67f0 2023-10-06T02:52:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.020+0000 7fb9037fe700 1 -- 172.21.15.81:0/2324515538 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8f4007240 con 0x7fb90c0a67f0 2023-10-06T02:52:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.021+0000 7fb9037fe700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.021+0000 7fb9037fe700 1 -- 172.21.15.81:0/2324515538 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb8f4084340 con 0x7fb90c0a67f0 2023-10-06T02:52:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.021+0000 7fb90affd700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.021+0000 7fb90affd700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb8ec066f30 0x7fb8ec0693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009170 tx=0x7fb8fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.025+0000 7fb9037fe700 1 -- 172.21.15.81:0/2324515538 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8f4051860 con 0x7fb90c0a67f0 2023-10-06T02:52:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.209+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb90c068500 con 0x7fb90c0a67f0 2023-10-06T02:52:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.209+0000 7fb9037fe700 1 -- 172.21.15.81:0/2324515538 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v131) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb8f4054e80 con 0x7fb90c0a67f0 2023-10-06T02:52:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:23.212 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:52:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:52:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:52:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:52:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:52:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:23.213 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:52:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb8ec066f30 msgr2=0x7fb8ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb8ec066f30 0x7fb8ec0693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009170 tx=0x7fb8fc008040 comp rx=0 tx=0).stop 2023-10-06T02:52:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c0a67f0 msgr2=0x7fb90c0cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c0a67f0 0x7fb90c0cd080 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4002950 tx=0x7fb8f4007d30 comp rx=0 tx=0).stop 2023-10-06T02:52:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 shutdown_connections 2023-10-06T02:52:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb90c0a6e70 0x7fb90c0a7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f80051c0 0x7fb90c1541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 --2- 172.21.15.81:0/2324515538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c0a67f0 0x7fb90c0cd080 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.211+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 >> 172.21.15.81:0/2324515538 conn(0x7fb90c06c620 msgr2=0x7fb90c1574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.212+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 shutdown_connections 2023-10-06T02:52:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.212+0000 7fb90bfff700 1 -- 172.21.15.81:0/2324515538 wait complete. 2023-10-06T02:52:23.226 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:52:23.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:52:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.341+0000 7fd00af49700 1 Processor -- start 2023-10-06T02:52:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.341+0000 7fd00af49700 1 -- start start 2023-10-06T02:52:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.342+0000 7fd00af49700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd004157ca0 0x7fd0040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.342+0000 7fd00af49700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd00406d120 0x7fd00406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.342+0000 7fd00af49700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0040d07c0 con 0x7fd0041578d0 2023-10-06T02:52:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.342+0000 7fd00af49700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00406daa0 con 0x7fd004157ca0 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.342+0000 7fd00af49700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040cfbb0 con 0x7fd00406d120 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.342+0000 7fcffbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd004157ca0 0x7fd0040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.342+0000 7fcffbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd004157ca0 0x7fd0040cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:56418/0 (socket says 172.21.15.81:56418) 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.342+0000 7fcffbfff700 1 -- 172.21.15.81:0/1622674385 learned_addr learned my addr 172.21.15.81:0/1622674385 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.342+0000 7fd0094e6700 1 --2- 172.21.15.81:0/1622674385 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd00406d120 0x7fd00406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.343+0000 7fd0094e6700 1 -- 172.21.15.81:0/1622674385 >> v2:172.21.15.83:3300/0 conn(0x7fd004157ca0 msgr2=0x7fd0040cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.343+0000 7fd0094e6700 1 --2- 172.21.15.81:0/1622674385 >> v2:172.21.15.83:3300/0 conn(0x7fd004157ca0 0x7fd0040cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.343+0000 7fd0094e6700 1 -- 172.21.15.81:0/1622674385 >> v1:172.21.15.83:6789/0 conn(0x7fd0041578d0 legacy=0x7fd00415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.343+0000 7fd0094e6700 1 -- 172.21.15.81:0/1622674385 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0040cfe90 con 0x7fd00406d120 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.343+0000 7fd0094e6700 1 --2- 172.21.15.81:0/1622674385 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd00406d120 0x7fd00406d560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0098e0 tx=0x7fcffc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb303937c93d0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.343+0000 7fcffb7fe700 1 -- 172.21.15.81:0/1622674385 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00b640 con 0x7fd00406d120 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.343+0000 7fcffb7fe700 1 -- 172.21.15.81:0/1622674385 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc00b7a0 con 0x7fd00406d120 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.343+0000 7fcffb7fe700 1 -- 172.21.15.81:0/1622674385 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00bb40 con 0x7fd00406d120 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.344+0000 7fd00af49700 1 -- 172.21.15.81:0/1622674385 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd00406d120 msgr2=0x7fd00406d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.344+0000 7fd00af49700 1 --2- 172.21.15.81:0/1622674385 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd00406d120 0x7fd00406d560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0098e0 tx=0x7fcffc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.344+0000 7fd00af49700 1 -- 172.21.15.81:0/1622674385 shutdown_connections 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.344+0000 7fd00af49700 1 --2- 172.21.15.81:0/1622674385 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd00406d120 0x7fd00406d560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.344+0000 7fd00af49700 1 --2- 172.21.15.81:0/1622674385 >> v2:172.21.15.83:3300/0 conn(0x7fd004157ca0 0x7fd0040cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.344+0000 7fd00af49700 1 -- 172.21.15.81:0/1622674385 >> 172.21.15.81:0/1622674385 conn(0x7fd00406bb90 msgr2=0x7fd00406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.344+0000 7fd00af49700 1 -- 172.21.15.81:0/1622674385 shutdown_connections 2023-10-06T02:52:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.344+0000 7fd00af49700 1 -- 172.21.15.81:0/1622674385 wait complete. 2023-10-06T02:52:23.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.345+0000 7fd00af49700 1 Processor -- start 2023-10-06T02:52:23.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.345+0000 7fd00af49700 1 -- start start 2023-10-06T02:52:23.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd00af49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd00406d120 0x7fd0041487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd00af49700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0041578d0 0x7fd004156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd00af49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd004157ca0 0x7fd0041566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd00af49700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040b58e0 con 0x7fd00406d120 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd00af49700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040b4d10 con 0x7fd004157ca0 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd00af49700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040b4fb0 con 0x7fd0041578d0 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd008ce5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd00406d120 0x7fd0041487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd008ce5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd00406d120 0x7fd0041487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56660/0 (socket says 172.21.15.81:56660) 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd008ce5700 1 -- 172.21.15.81:0/4269773687 learned_addr learned my addr 172.21.15.81:0/4269773687 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fcffbfff700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0041578d0 0x7fd004156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd0094e6700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd004157ca0 0x7fd0041566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd008ce5700 1 -- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0041578d0 msgr2=0x7fd004156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd008ce5700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0041578d0 0x7fd004156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd008ce5700 1 -- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd004157ca0 msgr2=0x7fd0041566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:23.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd008ce5700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd004157ca0 0x7fd0041566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd008ce5700 1 -- 172.21.15.81:0/4269773687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc009420 con 0x7fd00406d120 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fcffbfff700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0041578d0 0x7fd004156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd0094e6700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd004157ca0 0x7fd0041566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.346+0000 7fd008ce5700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd00406d120 0x7fd0041487b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd00000cb10 tx=0x7fd0000017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.347+0000 7fcff8ff9700 1 -- 172.21.15.81:0/4269773687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000a760 con 0x7fd00406d120 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.347+0000 7fcff8ff9700 1 -- 172.21.15.81:0/4269773687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00000a8e0 con 0x7fd00406d120 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.347+0000 7fcff8ff9700 1 -- 172.21.15.81:0/4269773687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000aca0 con 0x7fd00406d120 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.347+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0040b5290 con 0x7fd00406d120 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.347+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd004148cf0 con 0x7fd00406d120 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.348+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0040b5bc0 con 0x7fd00406d120 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.348+0000 7fcff8ff9700 1 -- 172.21.15.81:0/4269773687 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd000003030 con 0x7fd00406d120 2023-10-06T02:52:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.348+0000 7fcff8ff9700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcff0066f30 0x7fcff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:23.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.349+0000 7fcff8ff9700 1 -- 172.21.15.81:0/4269773687 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd000084460 con 0x7fd00406d120 2023-10-06T02:52:23.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.349+0000 7fcffbfff700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcff0066f30 0x7fcff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:23.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.349+0000 7fcffbfff700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcff0066f30 0x7fcff00693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd0041560f0 tx=0x7fcff4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:23.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.353+0000 7fcff8ff9700 1 -- 172.21.15.81:0/4269773687 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd000051970 con 0x7fd00406d120 2023-10-06T02:52:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:23.536+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd0040d0170 con 0x7fd00406d120 2023-10-06T02:52:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.529+0000 7fcff8ff9700 1 -- 172.21.15.81:0/4269773687 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v132) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd000054f90 con 0x7fd00406d120 2023-10-06T02:52:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcff0066f30 msgr2=0x7fcff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcff0066f30 0x7fcff00693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd0041560f0 tx=0x7fcff4008040 comp rx=0 tx=0).stop 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd00406d120 msgr2=0x7fd0041487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd00406d120 0x7fd0041487b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd00000cb10 tx=0x7fd0000017b0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 shutdown_connections 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcff0066f30 0x7fcff00693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd004157ca0 0x7fd0041566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd00406d120 0x7fd0041487b0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 --2- 172.21.15.81:0/4269773687 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0041578d0 0x7fd004156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 >> 172.21.15.81:0/4269773687 conn(0x7fd00406bb90 msgr2=0x7fd004155570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 shutdown_connections 2023-10-06T02:52:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.533+0000 7fd00af49700 1 -- 172.21.15.81:0/4269773687 wait complete. 2023-10-06T02:52:24.537 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:52:24.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:52:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.669+0000 7f8565015700 1 Processor -- start 2023-10-06T02:52:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.669+0000 7f8565015700 1 -- start start 2023-10-06T02:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f8565015700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85601577c0 0x7f8560068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f8565015700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8560157b90 0x7f8560068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f8565015700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85600cca80 con 0x7f85600cb790 2023-10-06T02:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f8565015700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85600cc2e0 con 0x7f85601577c0 2023-10-06T02:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f8565015700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85600cedd0 con 0x7f8560157b90 2023-10-06T02:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f855ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85601577c0 0x7f8560068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f855ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85601577c0 0x7f8560068810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56676/0 (socket says 172.21.15.81:56676) 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f855ed9d700 1 -- 172.21.15.81:0/2122962033 learned_addr learned my addr 172.21.15.81:0/2122962033 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f855659c700 1 --2- 172.21.15.81:0/2122962033 >> v2:172.21.15.83:3300/0 conn(0x7f8560157b90 0x7f8560068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f855ed9d700 1 -- 172.21.15.81:0/2122962033 >> v2:172.21.15.83:3300/0 conn(0x7f8560157b90 msgr2=0x7f8560068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f855ed9d700 1 --2- 172.21.15.81:0/2122962033 >> v2:172.21.15.83:3300/0 conn(0x7f8560157b90 0x7f8560068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f855ed9d700 1 -- 172.21.15.81:0/2122962033 >> v1:172.21.15.83:6789/0 conn(0x7f85600cb790 legacy=0x7f85600cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f855ed9d700 1 -- 172.21.15.81:0/2122962033 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600cc4c0 con 0x7f85601577c0 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.670+0000 7f855659c700 1 --2- 172.21.15.81:0/2122962033 >> v2:172.21.15.83:3300/0 conn(0x7f8560157b90 0x7f8560068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f855ed9d700 1 --2- 172.21.15.81:0/2122962033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 0x7f8560068810 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f85600682c0 tx=0x7f8550009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a04013ed1e80a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f855e59c700 1 -- 172.21.15.81:0/2122962033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000b860 con 0x7f85601577c0 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f855e59c700 1 -- 172.21.15.81:0/2122962033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855000b9c0 con 0x7f85601577c0 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f855e59c700 1 -- 172.21.15.81:0/2122962033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000bd60 con 0x7f85601577c0 2023-10-06T02:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f8565015700 1 -- 172.21.15.81:0/2122962033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 msgr2=0x7f8560068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f8565015700 1 --2- 172.21.15.81:0/2122962033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 0x7f8560068810 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f85600682c0 tx=0x7f8550009250 comp rx=0 tx=0).stop 2023-10-06T02:52:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f8565015700 1 -- 172.21.15.81:0/2122962033 shutdown_connections 2023-10-06T02:52:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f8565015700 1 --2- 172.21.15.81:0/2122962033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 0x7f8560068810 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f8565015700 1 --2- 172.21.15.81:0/2122962033 >> v2:172.21.15.83:3300/0 conn(0x7f8560157b90 0x7f8560068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f8565015700 1 -- 172.21.15.81:0/2122962033 >> 172.21.15.81:0/2122962033 conn(0x7f85600d0df0 msgr2=0x7f85600d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f8565015700 1 -- 172.21.15.81:0/2122962033 shutdown_connections 2023-10-06T02:52:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.671+0000 7f8565015700 1 -- 172.21.15.81:0/2122962033 wait complete. 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.672+0000 7f8565015700 1 Processor -- start 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f8565015700 1 -- start start 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f8565015700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85600cb790 0x7f8560154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f8565015700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 0x7f85600b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f8565015700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8560157b90 0x7f85600b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f8565015700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856015da30 con 0x7f85601577c0 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f8565015700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600caa30 con 0x7f8560157b90 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f8565015700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85600cad10 con 0x7f85600cb790 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f855659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 0x7f85600b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f855659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 0x7f85600b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56688/0 (socket says 172.21.15.81:56688) 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f855659c700 1 -- 172.21.15.81:0/3620596876 learned_addr learned my addr 172.21.15.81:0/3620596876 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f855ed9d700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85600cb790 0x7f8560154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.673+0000 7f855f59e700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8560157b90 0x7f85600b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f855659c700 1 -- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85600cb790 msgr2=0x7f8560154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f855659c700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85600cb790 0x7f8560154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f855659c700 1 -- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8560157b90 msgr2=0x7f85600b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f855659c700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8560157b90 0x7f85600b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f855659c700 1 -- 172.21.15.81:0/3620596876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500094f0 con 0x7f85601577c0 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f855ed9d700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85600cb790 0x7f8560154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f855f59e700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8560157b90 0x7f85600b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f855659c700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 0x7f85600b3c30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f854800d890 tx=0x7f8548008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f85577fe700 1 -- 172.21.15.81:0/3620596876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85480125f0 con 0x7f85601577c0 2023-10-06T02:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f85577fe700 1 -- 172.21.15.81:0/3620596876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548012750 con 0x7f85601577c0 2023-10-06T02:52:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856015dc80 con 0x7f85601577c0 2023-10-06T02:52:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f85577fe700 1 -- 172.21.15.81:0/3620596876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548012af0 con 0x7f85601577c0 2023-10-06T02:52:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.674+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856016b8c0 con 0x7f85601577c0 2023-10-06T02:52:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.675+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85600caee0 con 0x7f85601577c0 2023-10-06T02:52:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.675+0000 7f85577fe700 1 -- 172.21.15.81:0/3620596876 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8548014430 con 0x7f85601577c0 2023-10-06T02:52:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.676+0000 7f85577fe700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8540066f30 0x7f85400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.676+0000 7f85577fe700 1 -- 172.21.15.81:0/3620596876 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f8548084950 con 0x7f85601577c0 2023-10-06T02:52:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.676+0000 7f855ed9d700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8540066f30 0x7f85400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.677+0000 7f855ed9d700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8540066f30 0x7f85400693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f85600682c0 tx=0x7f8550017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.680+0000 7f85577fe700 1 -- 172.21.15.81:0/3620596876 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8548051c40 con 0x7f85601577c0 2023-10-06T02:52:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:24.861+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f85600cc7a0 con 0x7f85601577c0 2023-10-06T02:52:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.534+0000 7f85577fe700 1 -- 172.21.15.81:0/3620596876 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v133) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8548055260 con 0x7f85601577c0 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8540066f30 msgr2=0x7f85400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8540066f30 0x7f85400693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f85600682c0 tx=0x7f8550017000 comp rx=0 tx=0).stop 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 msgr2=0x7f85600b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 0x7f85600b3c30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f854800d890 tx=0x7f8548008040 comp rx=0 tx=0).stop 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 shutdown_connections 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8540066f30 0x7f85400693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8560157b90 0x7f85600b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85600cb790 0x7f8560154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 --2- 172.21.15.81:0/3620596876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85601577c0 0x7f85600b3c30 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.541+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 >> 172.21.15.81:0/3620596876 conn(0x7f85600d0df0 msgr2=0x7f8560156790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.543+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 shutdown_connections 2023-10-06T02:52:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.544+0000 7f8565015700 1 -- 172.21.15.81:0/3620596876 wait complete. 2023-10-06T02:52:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:52:25.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:52:25.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.674+0000 7fe0e7fff700 1 Processor -- start 2023-10-06T02:52:25.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.674+0000 7fe0e7fff700 1 -- start start 2023-10-06T02:52:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e7fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe0e80d0f50 0x7fe0e806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e7fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e806d990 con 0x7fe0e806d530 2023-10-06T02:52:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e7fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e80cf2d0 con 0x7fe0e80d0b80 2023-10-06T02:52:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e7fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e815a690 con 0x7fe0e80d0f50 2023-10-06T02:52:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe0e806d530 0x7fe0e815b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44530/0 (socket says 172.21.15.81:44530) 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e77fe700 1 -- 172.21.15.81:0/1129395319 learned_addr learned my addr 172.21.15.81:0/1129395319 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e67fc700 1 --2- 172.21.15.81:0/1129395319 >> v2:172.21.15.83:3300/0 conn(0x7fe0e80d0f50 0x7fe0e806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299685597 0 0) 0x7fe0e806d990 con 0x7fe0e806d530 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d4003570 con 0x7fe0e806d530 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198015155 0 0) 0x7fe0e80cf2d0 con 0x7fe0e80d0b80 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e806d990 con 0x7fe0e80d0b80 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575519317 0 0) 0x7fe0d4003570 con 0x7fe0e806d530 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 >> v2:172.21.15.83:3300/0 conn(0x7fe0e80d0f50 msgr2=0x7fe0e806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 --2- 172.21.15.81:0/1129395319 >> v2:172.21.15.83:3300/0 conn(0x7fe0e80d0f50 0x7fe0e806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 >> v1:172.21.15.83:6789/0 conn(0x7fe0e80d0b80 legacy=0x7fe0e80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80d0480 con 0x7fe0e806d530 2023-10-06T02:52:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fe0d80017f0 con 0x7fe0e806d530 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 >> v1:172.21.15.81:6789/0 conn(0x7fe0e806d530 legacy=0x7fe0e815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4003bf0 0x7fe0d4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0d40051c0 0x7fe0d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e815a690 con 0x7fe0d4004810 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d400c0b0 con 0x7fe0d40051c0 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.675+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d400c270 con 0x7fe0d4003bf0 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e67fc700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e6ffd700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4003bf0 0x7fe0d4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e77fe700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0d40051c0 0x7fe0d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e67fc700 1 -- 172.21.15.81:0/1129395319 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4003bf0 msgr2=0x7fe0d4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e67fc700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4003bf0 0x7fe0d4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e67fc700 1 -- 172.21.15.81:0/1129395319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0d40051c0 msgr2=0x7fe0d400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e67fc700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0d40051c0 0x7fe0d400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e67fc700 1 -- 172.21.15.81:0/1129395319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d4003570 con 0x7fe0d4004810 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e77fe700 1 -- 172.21.15.81:0/1129395319 reap_dead start 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e67fc700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009c00 tx=0x7fe0d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc17f9ab23b4c2cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000e710 con 0x7fe0d4004810 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d000e870 con 0x7fe0d4004810 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.676+0000 7fe0e5ffb700 1 -- 172.21.15.81:0/1129395319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000ec30 con 0x7fe0d4004810 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.677+0000 7fe0e7fff700 1 -- 172.21.15.81:0/1129395319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 msgr2=0x7fe0d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.677+0000 7fe0e7fff700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009c00 tx=0x7fe0d00091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.677+0000 7fe0e7fff700 1 -- 172.21.15.81:0/1129395319 shutdown_connections 2023-10-06T02:52:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.677+0000 7fe0e7fff700 1 --2- 172.21.15.81:0/1129395319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.677+0000 7fe0e7fff700 1 -- 172.21.15.81:0/1129395319 >> 172.21.15.81:0/1129395319 conn(0x7fe0e8063230 msgr2=0x7fe0e8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.677+0000 7fe0e7fff700 1 -- 172.21.15.81:0/1129395319 shutdown_connections 2023-10-06T02:52:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.677+0000 7fe0e7fff700 1 -- 172.21.15.81:0/1129395319 wait complete. 2023-10-06T02:52:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.678+0000 7fe0e7fff700 1 Processor -- start 2023-10-06T02:52:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.678+0000 7fe0e7fff700 1 -- start start 2023-10-06T02:52:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e7fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4004810 0x7fe0e8154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80abbf0 0x7fe0e80b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e7fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0e815c9d0 0x7fe0e815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e815d390 con 0x7fe0e80abbf0 2023-10-06T02:52:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e7fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80ab760 con 0x7fe0e815c9d0 2023-10-06T02:52:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e7fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8155300 con 0x7fe0d4004810 2023-10-06T02:52:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80abbf0 0x7fe0e80b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80abbf0 0x7fe0e80b5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56698/0 (socket says 172.21.15.81:56698) 2023-10-06T02:52:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e67fc700 1 -- 172.21.15.81:0/2834856278 learned_addr learned my addr 172.21.15.81:0/2834856278 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e67fc700 1 -- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4004810 msgr2=0x7fe0e8154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e6ffd700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4004810 0x7fe0e8154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e67fc700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4004810 0x7fe0e8154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e77fe700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0e815c9d0 0x7fe0e815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e67fc700 1 -- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0e815c9d0 msgr2=0x7fe0e815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e67fc700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0e815c9d0 0x7fe0e815ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e67fc700 1 -- 172.21.15.81:0/2834856278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80b64d0 con 0x7fe0e80abbf0 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e6ffd700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4004810 0x7fe0e8154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e77fe700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0e815c9d0 0x7fe0e815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e67fc700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80abbf0 0x7fe0e80b5f90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0013f70 tx=0x7fe0d001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0deffd700 1 -- 172.21.15.81:0/2834856278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0022070 con 0x7fe0e80abbf0 2023-10-06T02:52:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0deffd700 1 -- 172.21.15.81:0/2834856278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d000ebf0 con 0x7fe0e80abbf0 2023-10-06T02:52:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e80aa890 con 0x7fe0e80abbf0 2023-10-06T02:52:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.679+0000 7fe0deffd700 1 -- 172.21.15.81:0/2834856278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d001c660 con 0x7fe0e80abbf0 2023-10-06T02:52:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.680+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e80aae30 con 0x7fe0e80abbf0 2023-10-06T02:52:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.680+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e80ab8f0 con 0x7fe0e80abbf0 2023-10-06T02:52:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.681+0000 7fe0deffd700 1 -- 172.21.15.81:0/2834856278 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0d001ca90 con 0x7fe0e80abbf0 2023-10-06T02:52:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.681+0000 7fe0deffd700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0c8066f30 0x7fe0c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.681+0000 7fe0deffd700 1 -- 172.21.15.81:0/2834856278 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fe0d0085e40 con 0x7fe0e80abbf0 2023-10-06T02:52:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.682+0000 7fe0e6ffd700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0c8066f30 0x7fe0c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.682+0000 7fe0e6ffd700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0c8066f30 0x7fe0c80693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0007bc0 tx=0x7fe0e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.686+0000 7fe0deffd700 1 -- 172.21.15.81:0/2834856278 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0d0052fc0 con 0x7fe0e80abbf0 2023-10-06T02:52:25.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:25.909+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe0e80676e0 con 0x7fe0e80abbf0 2023-10-06T02:52:26.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.552+0000 7fe0deffd700 1 -- 172.21.15.81:0/2834856278 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v63) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe0d0006cb0 con 0x7fe0e80abbf0 2023-10-06T02:52:26.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0c8066f30 msgr2=0x7fe0c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:26.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0c8066f30 0x7fe0c80693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0007bc0 tx=0x7fe0e0009040 comp rx=0 tx=0).stop 2023-10-06T02:52:26.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80abbf0 msgr2=0x7fe0e80b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:26.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80abbf0 0x7fe0e80b5f90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0013f70 tx=0x7fe0d001a000 comp rx=0 tx=0).stop 2023-10-06T02:52:26.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 shutdown_connections 2023-10-06T02:52:26.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0c8066f30 0x7fe0c80693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0e815c9d0 0x7fe0e815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0d4004810 0x7fe0e8154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 --2- 172.21.15.81:0/2834856278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80abbf0 0x7fe0e80b5f90 secure :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0013f70 tx=0x7fe0d001a000 comp rx=0 tx=0).stop 2023-10-06T02:52:26.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 >> 172.21.15.81:0/2834856278 conn(0x7fe0e8063230 msgr2=0x7fe0e81576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:26.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 shutdown_connections 2023-10-06T02:52:26.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.556+0000 7fe0e7fff700 1 -- 172.21.15.81:0/2834856278 wait complete. 2023-10-06T02:52:26.561 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 17 and data pool 18 2023-10-06T02:52:26.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:52:26.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.685+0000 7f6fc06cc700 1 Processor -- start 2023-10-06T02:52:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.685+0000 7f6fc06cc700 1 -- start start 2023-10-06T02:52:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.686+0000 7f6fc06cc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6fb815a2a0 0x7f6fb80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.686+0000 7f6fc06cc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fb80ceb30 0x7f6fb80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.686+0000 7f6fc06cc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb80b0ca0 con 0x7f6fb806d650 2023-10-06T02:52:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.686+0000 7f6fc06cc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb806e160 con 0x7f6fb80ceb30 2023-10-06T02:52:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.686+0000 7f6fc06cc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb806ea90 con 0x7f6fb815a2a0 2023-10-06T02:52:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.686+0000 7f6fbdc67700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fb80ceb30 0x7f6fb80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.686+0000 7f6fbec69700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6fb806d650 0x7f6fb806da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44546/0 (socket says 172.21.15.81:44546) 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.686+0000 7f6fbec69700 1 -- 172.21.15.81:0/1739303966 learned_addr learned my addr 172.21.15.81:0/1739303966 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbe468700 1 --2- 172.21.15.81:0/1739303966 >> v2:172.21.15.83:3300/0 conn(0x7f6fb815a2a0 0x7f6fb80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbdc67700 1 -- 172.21.15.81:0/1739303966 >> v2:172.21.15.83:3300/0 conn(0x7f6fb815a2a0 msgr2=0x7f6fb80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbdc67700 1 --2- 172.21.15.81:0/1739303966 >> v2:172.21.15.83:3300/0 conn(0x7f6fb815a2a0 0x7f6fb80b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbdc67700 1 -- 172.21.15.81:0/1739303966 >> v1:172.21.15.81:6789/0 conn(0x7f6fb806d650 legacy=0x7f6fb806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbd466700 1 -- 172.21.15.81:0/1739303966 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934934318 0 0) 0x7f6fb80b0ca0 con 0x7f6fb806d650 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbdc67700 1 -- 172.21.15.81:0/1739303966 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80b00d0 con 0x7f6fb80ceb30 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbdc67700 1 --2- 172.21.15.81:0/1739303966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 0x7f6fb80cefb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80637a0 tx=0x7f6fa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6dbb70fea5bfb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbd466700 1 -- 172.21.15.81:0/1739303966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8011630 con 0x7f6fb80ceb30 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbd466700 1 -- 172.21.15.81:0/1739303966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8011790 con 0x7f6fb80ceb30 2023-10-06T02:52:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.687+0000 7f6fbd466700 1 -- 172.21.15.81:0/1739303966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8011b30 con 0x7f6fb80ceb30 2023-10-06T02:52:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.688+0000 7f6fc06cc700 1 -- 172.21.15.81:0/1739303966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 msgr2=0x7f6fb80cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.688+0000 7f6fc06cc700 1 --2- 172.21.15.81:0/1739303966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 0x7f6fb80cefb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80637a0 tx=0x7f6fa80091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.688+0000 7f6fc06cc700 1 -- 172.21.15.81:0/1739303966 shutdown_connections 2023-10-06T02:52:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.688+0000 7f6fc06cc700 1 --2- 172.21.15.81:0/1739303966 >> v2:172.21.15.83:3300/0 conn(0x7f6fb815a2a0 0x7f6fb80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.688+0000 7f6fc06cc700 1 --2- 172.21.15.81:0/1739303966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 0x7f6fb80cefb0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.688+0000 7f6fc06cc700 1 -- 172.21.15.81:0/1739303966 >> 172.21.15.81:0/1739303966 conn(0x7f6fb8067640 msgr2=0x7f6fb8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.688+0000 7f6fc06cc700 1 -- 172.21.15.81:0/1739303966 shutdown_connections 2023-10-06T02:52:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.688+0000 7f6fc06cc700 1 -- 172.21.15.81:0/1739303966 wait complete. 2023-10-06T02:52:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.689+0000 7f6fc06cc700 1 Processor -- start 2023-10-06T02:52:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.689+0000 7f6fc06cc700 1 -- start start 2023-10-06T02:52:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.689+0000 7f6fc06cc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fb806d650 0x7f6fb815d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.689+0000 7f6fc06cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 0x7f6fb815eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fc06cc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fb815a2a0 0x7f6fb8147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fc06cc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8147da0 con 0x7f6fb80ceb30 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fc06cc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb815d8f0 con 0x7f6fb815a2a0 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fc06cc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80cb320 con 0x7f6fb806d650 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbdc67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 0x7f6fb815eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbdc67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 0x7f6fb815eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56704/0 (socket says 172.21.15.81:56704) 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbdc67700 1 -- 172.21.15.81:0/2342683870 learned_addr learned my addr 172.21.15.81:0/2342683870 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbe468700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fb806d650 0x7f6fb815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbec69700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fb815a2a0 0x7f6fb8147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbdc67700 1 -- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fb806d650 msgr2=0x7f6fb815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbdc67700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fb806d650 0x7f6fb815d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbdc67700 1 -- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fb815a2a0 msgr2=0x7f6fb8147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbdc67700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fb815a2a0 0x7f6fb8147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbdc67700 1 -- 172.21.15.81:0/2342683870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa8009420 con 0x7f6fb80ceb30 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fbdc67700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 0x7f6fb815eff0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f6fb806f990 tx=0x7f6fa8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fae7fc700 1 -- 172.21.15.81:0/2342683870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8000d10 con 0x7f6fb80ceb30 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fae7fc700 1 -- 172.21.15.81:0/2342683870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8011b10 con 0x7f6fb80ceb30 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb80cb600 con 0x7f6fb80ceb30 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fae7fc700 1 -- 172.21.15.81:0/2342683870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8025640 con 0x7f6fb80ceb30 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.690+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb80caf40 con 0x7f6fb80ceb30 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.691+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb8069e40 con 0x7f6fb80ceb30 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.691+0000 7f6fae7fc700 1 -- 172.21.15.81:0/2342683870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fa8025a30 con 0x7f6fb80ceb30 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.692+0000 7f6fae7fc700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f9c066f30 0x7f6f9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.692+0000 7f6fae7fc700 1 -- 172.21.15.81:0/2342683870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6fa8085e00 con 0x7f6fb80ceb30 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.692+0000 7f6fbe468700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f9c066f30 0x7f6f9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.692+0000 7f6fbe468700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f9c066f30 0x7f6f9c0693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009d10 tx=0x7f6fb40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.696+0000 7f6fae7fc700 1 -- 172.21.15.81:0/2342683870 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fa8052f10 con 0x7f6fb80ceb30 2023-10-06T02:52:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.880+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fb804bb80 con 0x7f6fb80ceb30 2023-10-06T02:52:26.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.881+0000 7f6fae7fc700 1 -- 172.21.15.81:0/2342683870 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16847 (secure 0 0 0) 0x7f6fa8056530 con 0x7f6fb80ceb30 2023-10-06T02:52:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:26.884 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":134,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:25.912033+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:52:23.555508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T02:52:24.879976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f9c066f30 msgr2=0x7f6f9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f9c066f30 0x7f6f9c0693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009d10 tx=0x7f6fb40091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 msgr2=0x7f6fb815eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 0x7f6fb815eff0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f6fb806f990 tx=0x7f6fa8017000 comp rx=0 tx=0).stop 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 shutdown_connections 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f9c066f30 0x7f6f9c0693e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fb815a2a0 0x7f6fb8147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fb806d650 0x7f6fb815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 --2- 172.21.15.81:0/2342683870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb80ceb30 0x7f6fb815eff0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 >> 172.21.15.81:0/2342683870 conn(0x7f6fb8067640 msgr2=0x7f6fb80cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 shutdown_connections 2023-10-06T02:52:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:26.883+0000 7f6fc06cc700 1 -- 172.21.15.81:0/2342683870 wait complete. 2023-10-06T02:52:26.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:52:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.009+0000 7f7ed2f70700 1 Processor -- start 2023-10-06T02:52:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.009+0000 7f7ed2f70700 1 -- start start 2023-10-06T02:52:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.010+0000 7f7ed2f70700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7ecc157ca0 0x7f7ecc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.010+0000 7f7ed2f70700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0d07c0 con 0x7f7ecc1578d0 2023-10-06T02:52:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.010+0000 7f7ed2f70700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0cfbb0 con 0x7f7ecc06d120 2023-10-06T02:52:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.010+0000 7f7ed2f70700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc0cfe90 con 0x7f7ecc157ca0 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.010+0000 7f7ed0d0c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7ecc1578d0 0x7f7ecc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44562/0 (socket says 172.21.15.81:44562) 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.010+0000 7f7ed0d0c700 1 -- 172.21.15.81:0/1413713728 learned_addr learned my addr 172.21.15.81:0/1413713728 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.010+0000 7f7ec3fff700 1 --2- 172.21.15.81:0/1413713728 >> v2:172.21.15.83:3300/0 conn(0x7f7ecc157ca0 0x7f7ecc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec37fe700 1 -- 172.21.15.81:0/1413713728 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458142259 0 0) 0x7f7ecc0d07c0 con 0x7f7ecc1578d0 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec37fe700 1 -- 172.21.15.81:0/1413713728 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb4003570 con 0x7f7ecc1578d0 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec3fff700 1 -- 172.21.15.81:0/1413713728 >> v1:172.21.15.83:6789/0 conn(0x7f7ecc06d120 legacy=0x7f7ecc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec3fff700 1 -- 172.21.15.81:0/1413713728 >> v1:172.21.15.81:6789/0 conn(0x7f7ecc1578d0 legacy=0x7f7ecc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec37fe700 1 -- 172.21.15.81:0/1413713728 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4293471959 0 0) 0x7f7eb4003570 con 0x7f7ecc1578d0 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec3fff700 1 -- 172.21.15.81:0/1413713728 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc0d0170 con 0x7f7ecc157ca0 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec3fff700 1 --2- 172.21.15.81:0/1413713728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc157ca0 0x7f7ecc0cf4f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0098e0 tx=0x7f7ebc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1775fff4aa16b58a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec37fe700 1 -- 172.21.15.81:0/1413713728 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80017f0 con 0x7f7ecc157ca0 2023-10-06T02:52:27.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec37fe700 1 -- 172.21.15.81:0/1413713728 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc011420 con 0x7f7ecc157ca0 2023-10-06T02:52:27.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.011+0000 7f7ec37fe700 1 -- 172.21.15.81:0/1413713728 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0117c0 con 0x7f7ecc157ca0 2023-10-06T02:52:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.012+0000 7f7ed2f70700 1 -- 172.21.15.81:0/1413713728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc157ca0 msgr2=0x7f7ecc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.012+0000 7f7ed2f70700 1 --2- 172.21.15.81:0/1413713728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc157ca0 0x7f7ecc0cf4f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0098e0 tx=0x7f7ebc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.012+0000 7f7ed2f70700 1 -- 172.21.15.81:0/1413713728 shutdown_connections 2023-10-06T02:52:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.012+0000 7f7ed2f70700 1 --2- 172.21.15.81:0/1413713728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc157ca0 0x7f7ecc0cf4f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.012+0000 7f7ed2f70700 1 -- 172.21.15.81:0/1413713728 >> 172.21.15.81:0/1413713728 conn(0x7f7ecc06bb90 msgr2=0x7f7ecc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.012+0000 7f7ed2f70700 1 -- 172.21.15.81:0/1413713728 shutdown_connections 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.012+0000 7f7ed2f70700 1 -- 172.21.15.81:0/1413713728 wait complete. 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.013+0000 7f7ed2f70700 1 Processor -- start 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.013+0000 7f7ed2f70700 1 -- start start 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed2f70700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ecc06d120 0x7f7ecc0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed2f70700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc1578d0 0x7f7ecc1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed2f70700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ecc157ca0 0x7f7ecc154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed2f70700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc16e680 con 0x7f7ecc06d120 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed2f70700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0c9860 con 0x7f7ecc1578d0 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed2f70700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0c9b40 con 0x7f7ecc157ca0 2023-10-06T02:52:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed0d0c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ecc06d120 0x7f7ecc0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed0d0c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ecc06d120 0x7f7ecc0ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56714/0 (socket says 172.21.15.81:56714) 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed0d0c700 1 -- 172.21.15.81:0/866186748 learned_addr learned my addr 172.21.15.81:0/866186748 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ec3fff700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc1578d0 0x7f7ecc1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed0d0c700 1 -- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ecc157ca0 msgr2=0x7f7ecc154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed150d700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ecc157ca0 0x7f7ecc154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed0d0c700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ecc157ca0 0x7f7ecc154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed0d0c700 1 -- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc1578d0 msgr2=0x7f7ecc1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed0d0c700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc1578d0 0x7f7ecc1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed0d0c700 1 -- 172.21.15.81:0/866186748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc009420 con 0x7f7ecc06d120 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ec3fff700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc1578d0 0x7f7ecc1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed0d0c700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ecc06d120 0x7f7ecc0ca340 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800ccc0 tx=0x7f7ec8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ec0ff9700 1 -- 172.21.15.81:0/866186748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800ce70 con 0x7f7ecc06d120 2023-10-06T02:52:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ec0ff9700 1 -- 172.21.15.81:0/866186748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec8004dc0 con 0x7f7ecc06d120 2023-10-06T02:52:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ec0ff9700 1 -- 172.21.15.81:0/866186748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800abd0 con 0x7f7ecc06d120 2023-10-06T02:52:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc0c9e20 con 0x7f7ecc06d120 2023-10-06T02:52:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.014+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc154bd0 con 0x7f7ecc06d120 2023-10-06T02:52:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.015+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc0ca060 con 0x7f7ecc06d120 2023-10-06T02:52:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.016+0000 7f7ec0ff9700 1 -- 172.21.15.81:0/866186748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ec8007150 con 0x7f7ecc06d120 2023-10-06T02:52:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.016+0000 7f7ec0ff9700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7eb8066f30 0x7f7eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.016+0000 7f7ec0ff9700 1 -- 172.21.15.81:0/866186748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ec8083e90 con 0x7f7ecc06d120 2023-10-06T02:52:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.016+0000 7f7ec3fff700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7eb8066f30 0x7f7eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.017+0000 7f7ec3fff700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7eb8066f30 0x7f7eb80693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc1580c0 tx=0x7f7ebc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.020+0000 7f7ec0ff9700 1 -- 172.21.15.81:0/866186748 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ecc0ca060 con 0x7f7ecc06d120 2023-10-06T02:52:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.202+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ecc0d0450 con 0x7f7ecc06d120 2023-10-06T02:52:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.203+0000 7f7ec0ff9700 1 -- 172.21.15.81:0/866186748 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16847 (secure 0 0 0) 0x7f7ec8018090 con 0x7f7ecc06d120 2023-10-06T02:52:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:27.206 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":134,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:25.912033+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:52:23.555508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T02:52:24.879976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7eb8066f30 msgr2=0x7f7eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7eb8066f30 0x7f7eb80693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc1580c0 tx=0x7f7ebc016000 comp rx=0 tx=0).stop 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ecc06d120 msgr2=0x7f7ecc0ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ecc06d120 0x7f7ecc0ca340 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800ccc0 tx=0x7f7ec8001670 comp rx=0 tx=0).stop 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 shutdown_connections 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7ecc157ca0 0x7f7ecc154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ecc06d120 0x7f7ecc0ca340 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7eb8066f30 0x7f7eb80693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 --2- 172.21.15.81:0/866186748 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ecc1578d0 0x7f7ecc1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 >> 172.21.15.81:0/866186748 conn(0x7f7ecc06bb90 msgr2=0x7f7ecc06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 shutdown_connections 2023-10-06T02:52:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.205+0000 7f7ed2f70700 1 -- 172.21.15.81:0/866186748 wait complete. 2023-10-06T02:52:27.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:52:27.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.334+0000 7f2ef9df3700 1 Processor -- start 2023-10-06T02:52:27.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.334+0000 7f2ef9df3700 1 -- start start 2023-10-06T02:52:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef9df3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef41578d0 0x7f2ef40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef9df3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2ef4157ca0 0x7f2ef415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef9df3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 0x7f2ef406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef9df3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40d07c0 con 0x7f2ef41578d0 2023-10-06T02:52:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef9df3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef406daa0 con 0x7f2ef4157ca0 2023-10-06T02:52:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef9df3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40cfbb0 con 0x7f2ef406d120 2023-10-06T02:52:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef41578d0 0x7f2ef40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef41578d0 0x7f2ef40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56716/0 (socket says 172.21.15.81:56716) 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef37fe700 1 -- 172.21.15.81:0/1756748835 learned_addr learned my addr 172.21.15.81:0/1756748835 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef2ffd700 1 --2- 172.21.15.81:0/1756748835 >> v2:172.21.15.83:3300/0 conn(0x7f2ef4157ca0 0x7f2ef415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.335+0000 7f2ef3fff700 1 --2- 172.21.15.81:0/1756748835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 0x7f2ef406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef37fe700 1 -- 172.21.15.81:0/1756748835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 msgr2=0x7f2ef406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef37fe700 1 --2- 172.21.15.81:0/1756748835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 0x7f2ef406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef37fe700 1 -- 172.21.15.81:0/1756748835 >> v2:172.21.15.83:3300/0 conn(0x7f2ef4157ca0 msgr2=0x7f2ef415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef37fe700 1 --2- 172.21.15.81:0/1756748835 >> v2:172.21.15.83:3300/0 conn(0x7f2ef4157ca0 0x7f2ef415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef37fe700 1 -- 172.21.15.81:0/1756748835 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef40cfe90 con 0x7f2ef41578d0 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef37fe700 1 --2- 172.21.15.81:0/1756748835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef41578d0 0x7f2ef40cf4f0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4068510 tx=0x7f2ee4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08cde2f9e6e511c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef27fc700 1 -- 172.21.15.81:0/1756748835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400e070 con 0x7f2ef41578d0 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef27fc700 1 -- 172.21.15.81:0/1756748835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400b970 con 0x7f2ef41578d0 2023-10-06T02:52:27.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef27fc700 1 -- 172.21.15.81:0/1756748835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40092e0 con 0x7f2ef41578d0 2023-10-06T02:52:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef9df3700 1 -- 172.21.15.81:0/1756748835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef41578d0 msgr2=0x7f2ef40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/1756748835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef41578d0 0x7f2ef40cf4f0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4068510 tx=0x7f2ee4009840 comp rx=0 tx=0).stop 2023-10-06T02:52:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef9df3700 1 -- 172.21.15.81:0/1756748835 shutdown_connections 2023-10-06T02:52:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/1756748835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 0x7f2ef406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/1756748835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef41578d0 0x7f2ef40cf4f0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/1756748835 >> v2:172.21.15.83:3300/0 conn(0x7f2ef4157ca0 0x7f2ef415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef9df3700 1 -- 172.21.15.81:0/1756748835 >> 172.21.15.81:0/1756748835 conn(0x7f2ef406bb90 msgr2=0x7f2ef406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef9df3700 1 -- 172.21.15.81:0/1756748835 shutdown_connections 2023-10-06T02:52:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.336+0000 7f2ef9df3700 1 -- 172.21.15.81:0/1756748835 wait complete. 2023-10-06T02:52:27.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef9df3700 1 Processor -- start 2023-10-06T02:52:27.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef9df3700 1 -- start start 2023-10-06T02:52:27.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef9df3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 0x7f2ef416a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef9df3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ef41578d0 0x7f2ef40b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef9df3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4157ca0 0x7f2ef4159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef9df3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4145a60 con 0x7f2ef4157ca0 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef9df3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40b2720 con 0x7f2ef41578d0 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef9df3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4145730 con 0x7f2ef406d120 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4157ca0 0x7f2ef4159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4157ca0 0x7f2ef4159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56724/0 (socket says 172.21.15.81:56724) 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.338+0000 7f2ef3fff700 1 -- 172.21.15.81:0/470531497 learned_addr learned my addr 172.21.15.81:0/470531497 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef37fe700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 0x7f2ef416a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef2ffd700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ef41578d0 0x7f2ef40b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef3fff700 1 -- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 msgr2=0x7f2ef416a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef3fff700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 0x7f2ef416a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef3fff700 1 -- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ef41578d0 msgr2=0x7f2ef40b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef3fff700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ef41578d0 0x7f2ef40b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef3fff700 1 -- 172.21.15.81:0/470531497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee4009ae0 con 0x7f2ef4157ca0 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef37fe700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 0x7f2ef416a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef2ffd700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ef41578d0 0x7f2ef40b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef3fff700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4157ca0 0x7f2ef4159430 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00ea50 tx=0x7f2eec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2edb7fe700 1 -- 172.21.15.81:0/470531497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00c920 con 0x7f2ef4157ca0 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2edb7fe700 1 -- 172.21.15.81:0/470531497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec00caa0 con 0x7f2ef4157ca0 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef40b2160 con 0x7f2ef4157ca0 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2edb7fe700 1 -- 172.21.15.81:0/470531497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00ce60 con 0x7f2ef4157ca0 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.339+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef416a730 con 0x7f2ef4157ca0 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.340+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef406e700 con 0x7f2ef4157ca0 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.340+0000 7f2edb7fe700 1 -- 172.21.15.81:0/470531497 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2eec013680 con 0x7f2ef4157ca0 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.341+0000 7f2edb7fe700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee0066f30 0x7f2ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.341+0000 7f2edb7fe700 1 -- 172.21.15.81:0/470531497 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2eec084a90 con 0x7f2ef4157ca0 2023-10-06T02:52:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.341+0000 7f2ef37fe700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee0066f30 0x7f2ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.341+0000 7f2ef37fe700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee0066f30 0x7f2ee00693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009880 tx=0x7f2ee4018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.345+0000 7f2edb7fe700 1 -- 172.21.15.81:0/470531497 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2eec051ba0 con 0x7f2ef4157ca0 2023-10-06T02:52:27.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:27.572+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2ef40d0170 con 0x7f2ef4157ca0 2023-10-06T02:52:28.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.566+0000 7f2edb7fe700 1 -- 172.21.15.81:0/470531497 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2eec0551c0 con 0x7f2ef4157ca0 2023-10-06T02:52:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee0066f30 msgr2=0x7f2ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee0066f30 0x7f2ee00693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009880 tx=0x7f2ee4018000 comp rx=0 tx=0).stop 2023-10-06T02:52:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4157ca0 msgr2=0x7f2ef4159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4157ca0 0x7f2ef4159430 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00ea50 tx=0x7f2eec0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 shutdown_connections 2023-10-06T02:52:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4157ca0 0x7f2ef4159430 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ef406d120 0x7f2ef416a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee0066f30 0x7f2ee00693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 --2- 172.21.15.81:0/470531497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ef41578d0 0x7f2ef40b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 >> 172.21.15.81:0/470531497 conn(0x7f2ef406bb90 msgr2=0x7f2ef415ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 shutdown_connections 2023-10-06T02:52:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.568+0000 7f2ef9df3700 1 -- 172.21.15.81:0/470531497 wait complete. 2023-10-06T02:52:28.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:52:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.696+0000 7f874bcd1700 1 Processor -- start 2023-10-06T02:52:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.696+0000 7f874bcd1700 1 -- start start 2023-10-06T02:52:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.697+0000 7f874bcd1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.697+0000 7f874bcd1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f874406d120 0x7f874406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.697+0000 7f874bcd1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874406dac0 con 0x7f8744157ca0 2023-10-06T02:52:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.697+0000 7f874bcd1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440d07c0 con 0x7f874406d120 2023-10-06T02:52:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.697+0000 7f874bcd1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87440cfbb0 con 0x7f87441578d0 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.697+0000 7f8749a6d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.697+0000 7f874a26e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f874406d120 0x7f874406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.697+0000 7f8749a6d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87440cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:57878/0 (socket says 172.21.15.81:57878) 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.697+0000 7f8749a6d700 1 -- 172.21.15.81:0/1256567662 learned_addr learned my addr 172.21.15.81:0/1256567662 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.698+0000 7f874a26e700 1 -- 172.21.15.81:0/1256567662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 msgr2=0x7f87440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.698+0000 7f874a26e700 1 --2- 172.21.15.81:0/1256567662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.698+0000 7f874a26e700 1 -- 172.21.15.81:0/1256567662 >> v1:172.21.15.83:6789/0 conn(0x7f8744157ca0 legacy=0x7f874415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.698+0000 7f874a26e700 1 -- 172.21.15.81:0/1256567662 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440cfe90 con 0x7f874406d120 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.698+0000 7f8749a6d700 1 --2- 172.21.15.81:0/1256567662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87440cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.698+0000 7f874a26e700 1 --2- 172.21.15.81:0/1256567662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f874406d120 0x7f874406d580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f873c0098e0 tx=0x7f873c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b5537b68226e921 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.698+0000 7f8748a6b700 1 -- 172.21.15.81:0/1256567662 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00b640 con 0x7f874406d120 2023-10-06T02:52:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.698+0000 7f8748a6b700 1 -- 172.21.15.81:0/1256567662 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00b7a0 con 0x7f874406d120 2023-10-06T02:52:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.698+0000 7f8748a6b700 1 -- 172.21.15.81:0/1256567662 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00bb40 con 0x7f874406d120 2023-10-06T02:52:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.699+0000 7f874bcd1700 1 -- 172.21.15.81:0/1256567662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f874406d120 msgr2=0x7f874406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.699+0000 7f874bcd1700 1 --2- 172.21.15.81:0/1256567662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f874406d120 0x7f874406d580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f873c0098e0 tx=0x7f873c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.699+0000 7f874bcd1700 1 -- 172.21.15.81:0/1256567662 shutdown_connections 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.699+0000 7f874bcd1700 1 --2- 172.21.15.81:0/1256567662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f874406d120 0x7f874406d580 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.699+0000 7f874bcd1700 1 --2- 172.21.15.81:0/1256567662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87440cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.699+0000 7f874bcd1700 1 -- 172.21.15.81:0/1256567662 >> 172.21.15.81:0/1256567662 conn(0x7f874406bb90 msgr2=0x7f874406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.699+0000 7f874bcd1700 1 -- 172.21.15.81:0/1256567662 shutdown_connections 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.699+0000 7f874bcd1700 1 -- 172.21.15.81:0/1256567662 wait complete. 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.700+0000 7f874bcd1700 1 Processor -- start 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.700+0000 7f874bcd1700 1 -- start start 2023-10-06T02:52:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.700+0000 7f874bcd1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874406d120 0x7f8744153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.700+0000 7f874bcd1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87441417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.700+0000 7f874bcd1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8744157ca0 0x7f8744068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.700+0000 7f874bcd1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8744141cf0 con 0x7f874406d120 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.700+0000 7f874bcd1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87441525d0 con 0x7f8744157ca0 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.700+0000 7f874bcd1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87441528b0 con 0x7f87441578d0 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8749a6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874406d120 0x7f8744153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8749a6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874406d120 0x7f8744153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56732/0 (socket says 172.21.15.81:56732) 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8749a6d700 1 -- 172.21.15.81:0/606665038 learned_addr learned my addr 172.21.15.81:0/606665038 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f874926c700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87441417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f874a26e700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8744157ca0 0x7f8744068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8749a6d700 1 -- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 msgr2=0x7f87441417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8749a6d700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87441417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8749a6d700 1 -- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8744157ca0 msgr2=0x7f8744068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8749a6d700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8744157ca0 0x7f8744068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8749a6d700 1 -- 172.21.15.81:0/606665038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740009ae0 con 0x7f874406d120 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8749a6d700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874406d120 0x7f8744153670 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f874000c170 tx=0x7f874000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8739ffb700 1 -- 172.21.15.81:0/606665038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874000cc90 con 0x7f874406d120 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8739ffb700 1 -- 172.21.15.81:0/606665038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874000f040 con 0x7f874406d120 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c009420 con 0x7f874406d120 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f8739ffb700 1 -- 172.21.15.81:0/606665038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740014480 con 0x7f874406d120 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.701+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8744152e70 con 0x7f874406d120 2023-10-06T02:52:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.702+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87441534c0 con 0x7f874406d120 2023-10-06T02:52:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.703+0000 7f8739ffb700 1 -- 172.21.15.81:0/606665038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87400147f0 con 0x7f874406d120 2023-10-06T02:52:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.703+0000 7f8739ffb700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8728066f30 0x7f87280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.703+0000 7f8739ffb700 1 -- 172.21.15.81:0/606665038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8740084ee0 con 0x7f874406d120 2023-10-06T02:52:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.703+0000 7f874926c700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8728066f30 0x7f87280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.704+0000 7f874926c700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8728066f30 0x7f87280693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f87440b4cd0 tx=0x7f8734009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.707+0000 7f8739ffb700 1 -- 172.21.15.81:0/606665038 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8740051ff0 con 0x7f874406d120 2023-10-06T02:52:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:28.931+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f87440d0170 con 0x7f874406d120 2023-10-06T02:52:29.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.567+0000 7f8739ffb700 1 -- 172.21.15.81:0/606665038 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8740055610 con 0x7f874406d120 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8728066f30 msgr2=0x7f87280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8728066f30 0x7f87280693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f87440b4cd0 tx=0x7f8734009040 comp rx=0 tx=0).stop 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874406d120 msgr2=0x7f8744153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874406d120 0x7f8744153670 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f874000c170 tx=0x7f874000b040 comp rx=0 tx=0).stop 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 shutdown_connections 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8728066f30 0x7f87280693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8744157ca0 0x7f8744068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874406d120 0x7f8744153670 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 --2- 172.21.15.81:0/606665038 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87441578d0 0x7f87441417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 >> 172.21.15.81:0/606665038 conn(0x7f874406bb90 msgr2=0x7f87440697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:29.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 shutdown_connections 2023-10-06T02:52:29.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.570+0000 7f874bcd1700 1 -- 172.21.15.81:0/606665038 wait complete. 2023-10-06T02:52:29.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:29.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.697+0000 7f045637d700 1 Processor -- start 2023-10-06T02:52:29.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.697+0000 7f045637d700 1 -- start start 2023-10-06T02:52:29.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f045637d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04501578d0 0x7f04500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:29.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f045637d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0450157ca0 0x7f045015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:29.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f045637d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04500d07c0 con 0x7f045006d120 2023-10-06T02:52:29.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f045637d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04500cfbb0 con 0x7f04501578d0 2023-10-06T02:52:29.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f045637d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04500cfe90 con 0x7f0450157ca0 2023-10-06T02:52:29.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f044ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04501578d0 0x7f04500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:29.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f045491a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f045006d120 0x7f045015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44568/0 (socket says 172.21.15.81:44568) 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f045491a700 1 -- 172.21.15.81:0/146454657 learned_addr learned my addr 172.21.15.81:0/146454657 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f044f7fe700 1 --2- 172.21.15.81:0/146454657 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0450157ca0 0x7f045015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f044ffff700 1 -- 172.21.15.81:0/146454657 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0450157ca0 msgr2=0x7f045015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f044ffff700 1 --2- 172.21.15.81:0/146454657 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0450157ca0 0x7f045015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f044ffff700 1 -- 172.21.15.81:0/146454657 >> v1:172.21.15.81:6789/0 conn(0x7f045006d120 legacy=0x7f045015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f044ffff700 1 -- 172.21.15.81:0/146454657 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04500d0170 con 0x7f04501578d0 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f044effd700 1 -- 172.21.15.81:0/146454657 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199952204 0 0) 0x7f04500d07c0 con 0x7f045006d120 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.698+0000 7f044f7fe700 1 --2- 172.21.15.81:0/146454657 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0450157ca0 0x7f045015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f044ffff700 1 --2- 172.21.15.81:0/146454657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04501578d0 0x7f04500cf4f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f04400098e0 tx=0x7f04400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97966d17cb5137f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f044effd700 1 -- 172.21.15.81:0/146454657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440009e80 con 0x7f04501578d0 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f044effd700 1 -- 172.21.15.81:0/146454657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044000b860 con 0x7f04501578d0 2023-10-06T02:52:29.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f044effd700 1 -- 172.21.15.81:0/146454657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044000bbe0 con 0x7f04501578d0 2023-10-06T02:52:29.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f045637d700 1 -- 172.21.15.81:0/146454657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04501578d0 msgr2=0x7f04500cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:29.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f045637d700 1 --2- 172.21.15.81:0/146454657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04501578d0 0x7f04500cf4f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f04400098e0 tx=0x7f04400091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f045637d700 1 -- 172.21.15.81:0/146454657 shutdown_connections 2023-10-06T02:52:29.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f045637d700 1 --2- 172.21.15.81:0/146454657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04501578d0 0x7f04500cf4f0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f045637d700 1 --2- 172.21.15.81:0/146454657 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0450157ca0 0x7f045015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f045637d700 1 -- 172.21.15.81:0/146454657 >> 172.21.15.81:0/146454657 conn(0x7f045006bb90 msgr2=0x7f045006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:29.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f045637d700 1 -- 172.21.15.81:0/146454657 shutdown_connections 2023-10-06T02:52:29.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.699+0000 7f045637d700 1 -- 172.21.15.81:0/146454657 wait complete. 2023-10-06T02:52:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.700+0000 7f045637d700 1 Processor -- start 2023-10-06T02:52:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f045637d700 1 -- start start 2023-10-06T02:52:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f045637d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f045006d120 0x7f045016ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f045637d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04501578d0 0x7f045015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f045637d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0450157ca0 0x7f04501684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f045637d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045016cc50 con 0x7f045006d120 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f045637d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045016c040 con 0x7f0450157ca0 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f045637d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045016c320 con 0x7f04501578d0 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f044ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f045006d120 0x7f045016ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f044ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f045006d120 0x7f045016ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56740/0 (socket says 172.21.15.81:56740) 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.701+0000 7f044ffff700 1 -- 172.21.15.81:0/2041188234 learned_addr learned my addr 172.21.15.81:0/2041188234 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f044f7fe700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04501578d0 0x7f045015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f045491a700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0450157ca0 0x7f04501684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f044ffff700 1 -- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04501578d0 msgr2=0x7f045015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f044ffff700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04501578d0 0x7f045015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f044ffff700 1 -- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0450157ca0 msgr2=0x7f04501684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:29.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f044ffff700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0450157ca0 0x7f04501684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f044ffff700 1 -- 172.21.15.81:0/2041188234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440009420 con 0x7f045006d120 2023-10-06T02:52:29.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f044ffff700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f045006d120 0x7f045016ba60 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f045006fe20 tx=0x7f0440017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:29.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f0437fff700 1 -- 172.21.15.81:0/2041188234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044000bbe0 con 0x7f045006d120 2023-10-06T02:52:29.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f0437fff700 1 -- 172.21.15.81:0/2041188234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0440011420 con 0x7f045006d120 2023-10-06T02:52:29.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f0437fff700 1 -- 172.21.15.81:0/2041188234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04400117e0 con 0x7f045006d120 2023-10-06T02:52:29.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045016c600 con 0x7f045006d120 2023-10-06T02:52:29.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.702+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045015d0c0 con 0x7f045006d120 2023-10-06T02:52:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.703+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045006ad60 con 0x7f045006d120 2023-10-06T02:52:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.703+0000 7f0437fff700 1 -- 172.21.15.81:0/2041188234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0440011bd0 con 0x7f045006d120 2023-10-06T02:52:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.704+0000 7f0437fff700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f043c066f30 0x7f043c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.704+0000 7f0437fff700 1 -- 172.21.15.81:0/2041188234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0440086220 con 0x7f045006d120 2023-10-06T02:52:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.704+0000 7f044f7fe700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f043c066f30 0x7f043c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.704+0000 7f044f7fe700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f043c066f30 0x7f043c0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0450159770 tx=0x7f0444008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.709+0000 7f0437fff700 1 -- 172.21.15.81:0/2041188234 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0440053330 con 0x7f045006d120 2023-10-06T02:52:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.932+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04500d0450 con 0x7f045006d120 2023-10-06T02:52:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.933+0000 7f0437fff700 1 -- 172.21.15.81:0/2041188234 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0440056950 con 0x7f045006d120 2023-10-06T02:52:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:29.935 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:52:25.912348+0000","modified":"2023-10-06T02:52:29.566702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7275":{"gid":7275,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/4039558742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":4039558742},{"type":"v1","addr":"172.21.15.83:6836","nonce":4039558742}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T02:52:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f043c066f30 msgr2=0x7f043c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f043c066f30 0x7f043c0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0450159770 tx=0x7f0444008040 comp rx=0 tx=0).stop 2023-10-06T02:52:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f045006d120 msgr2=0x7f045016ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f045006d120 0x7f045016ba60 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f045006fe20 tx=0x7f0440017000 comp rx=0 tx=0).stop 2023-10-06T02:52:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 shutdown_connections 2023-10-06T02:52:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f043c066f30 0x7f043c0693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0450157ca0 0x7f04501684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f045006d120 0x7f045016ba60 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 --2- 172.21.15.81:0/2041188234 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f04501578d0 0x7f045015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:29.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 >> 172.21.15.81:0/2041188234 conn(0x7f045006bb90 msgr2=0x7f0450156560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:29.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 shutdown_connections 2023-10-06T02:52:29.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:29.936+0000 7f045637d700 1 -- 172.21.15.81:0/2041188234 wait complete. 2023-10-06T02:52:29.939 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 67 2023-10-06T02:52:29.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:52:30.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.061+0000 7fa1ad529700 1 Processor -- start 2023-10-06T02:52:30.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.061+0000 7fa1ad529700 1 -- start start 2023-10-06T02:52:30.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1ad529700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa1a8159b40 0x7fa1a80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1ad529700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 0x7fa1a8068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1ad529700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1a80ccb40 0x7fa1a8068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1ad529700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a80cee10 con 0x7fa1a80ccb40 2023-10-06T02:52:30.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1ad529700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a80cd040 con 0x7fa1a8159b40 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1ad529700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80cd320 con 0x7fa1a8159f10 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1acd28700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1a80ccb40 0x7fa1a8068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1acd28700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1a80ccb40 0x7fa1a8068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56752/0 (socket says 172.21.15.81:56752) 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1acd28700 1 -- 172.21.15.81:0/128739589 learned_addr learned my addr 172.21.15.81:0/128739589 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1a7fff700 1 --2- 172.21.15.81:0/128739589 >> v2:172.21.15.83:3300/0 conn(0x7fa1a8159b40 0x7fa1a80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.062+0000 7fa1a77fe700 1 --2- 172.21.15.81:0/128739589 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 0x7fa1a8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1acd28700 1 -- 172.21.15.81:0/128739589 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 msgr2=0x7fa1a8068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1acd28700 1 --2- 172.21.15.81:0/128739589 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 0x7fa1a8068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1acd28700 1 -- 172.21.15.81:0/128739589 >> v2:172.21.15.83:3300/0 conn(0x7fa1a8159b40 msgr2=0x7fa1a80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1acd28700 1 --2- 172.21.15.81:0/128739589 >> v2:172.21.15.83:3300/0 conn(0x7fa1a8159b40 0x7fa1a80cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1acd28700 1 -- 172.21.15.81:0/128739589 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80ce7c0 con 0x7fa1a80ccb40 2023-10-06T02:52:30.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1acd28700 1 --2- 172.21.15.81:0/128739589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a80ccb40 0x7fa1a8068cc0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80d0bc0 tx=0x7fa1a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a75c42b096d6448 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1a6ffd700 1 -- 172.21.15.81:0/128739589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000e070 con 0x7fa1a80ccb40 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1a6ffd700 1 -- 172.21.15.81:0/128739589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a000b970 con 0x7fa1a80ccb40 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1a6ffd700 1 -- 172.21.15.81:0/128739589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00092e0 con 0x7fa1a80ccb40 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1ad529700 1 -- 172.21.15.81:0/128739589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a80ccb40 msgr2=0x7fa1a8068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1ad529700 1 --2- 172.21.15.81:0/128739589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a80ccb40 0x7fa1a8068cc0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80d0bc0 tx=0x7fa1a0009840 comp rx=0 tx=0).stop 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1ad529700 1 -- 172.21.15.81:0/128739589 shutdown_connections 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1ad529700 1 --2- 172.21.15.81:0/128739589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a80ccb40 0x7fa1a8068cc0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1ad529700 1 --2- 172.21.15.81:0/128739589 >> v2:172.21.15.83:3300/0 conn(0x7fa1a8159b40 0x7fa1a80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1ad529700 1 --2- 172.21.15.81:0/128739589 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 0x7fa1a8068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1ad529700 1 -- 172.21.15.81:0/128739589 >> 172.21.15.81:0/128739589 conn(0x7fa1a80cd660 msgr2=0x7fa1a80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1ad529700 1 -- 172.21.15.81:0/128739589 shutdown_connections 2023-10-06T02:52:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.063+0000 7fa1ad529700 1 -- 172.21.15.81:0/128739589 wait complete. 2023-10-06T02:52:30.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.065+0000 7fa1ad529700 1 Processor -- start 2023-10-06T02:52:30.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.065+0000 7fa1ad529700 1 -- start start 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.065+0000 7fa1ad529700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1a80ccb40 0x7fa1a815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.065+0000 7fa1ad529700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a8159b40 0x7fa1a8155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.065+0000 7fa1ad529700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 0x7fa1a816da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.065+0000 7fa1ad529700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8155bc0 con 0x7fa1a8159b40 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.065+0000 7fa1ad529700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a815b8f0 con 0x7fa1a80ccb40 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.065+0000 7fa1ad529700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a815bbd0 con 0x7fa1a8159f10 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a8159b40 0x7fa1a8155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a8159b40 0x7fa1a8155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56756/0 (socket says 172.21.15.81:56756) 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a77fe700 1 -- 172.21.15.81:0/1542680892 learned_addr learned my addr 172.21.15.81:0/1542680892 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a7fff700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1a80ccb40 0x7fa1a815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1acd28700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 0x7fa1a816da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a77fe700 1 -- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 msgr2=0x7fa1a816da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a77fe700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 0x7fa1a816da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a77fe700 1 -- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1a80ccb40 msgr2=0x7fa1a815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a77fe700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1a80ccb40 0x7fa1a815b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a77fe700 1 -- 172.21.15.81:0/1542680892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0009ae0 con 0x7fa1a8159b40 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1a77fe700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a8159b40 0x7fa1a8155680 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e950 tx=0x7fa19c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa18ffff700 1 -- 172.21.15.81:0/1542680892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00c850 con 0x7fa1a8159b40 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa18ffff700 1 -- 172.21.15.81:0/1542680892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c00c9b0 con 0x7fa1a8159b40 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a815beb0 con 0x7fa1a8159b40 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa18ffff700 1 -- 172.21.15.81:0/1542680892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00cdb0 con 0x7fa1a8159b40 2023-10-06T02:52:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.066+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a815c470 con 0x7fa1a8159b40 2023-10-06T02:52:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.067+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a815c660 con 0x7fa1a8159b40 2023-10-06T02:52:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.067+0000 7fa18ffff700 1 -- 172.21.15.81:0/1542680892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa19c013680 con 0x7fa1a8159b40 2023-10-06T02:52:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.068+0000 7fa18ffff700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa194066f30 0x7fa1940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.068+0000 7fa18ffff700 1 -- 172.21.15.81:0/1542680892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa19c0848c0 con 0x7fa1a8159b40 2023-10-06T02:52:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.068+0000 7fa1a7fff700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa194066f30 0x7fa1940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.070+0000 7fa1a7fff700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa194066f30 0x7fa1940693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa198009d40 tx=0x7fa198008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.073+0000 7fa18ffff700 1 -- 172.21.15.81:0/1542680892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa19c0519d0 con 0x7fa1a8159b40 2023-10-06T02:52:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.255+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1a8063e90 con 0x7fa1a8159b40 2023-10-06T02:52:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.256+0000 7fa18ffff700 1 -- 172.21.15.81:0/1542680892 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16834 (secure 0 0 0) 0x7fa19c054ff0 con 0x7fa1a8159b40 2023-10-06T02:52:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:30.258 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":135,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:27.535676+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:52:23.555508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T02:52:24.879976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:52:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.257+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa194066f30 msgr2=0x7fa1940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.257+0000 7fa1ad529700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa194066f30 0x7fa1940693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa198009d40 tx=0x7fa198008040 comp rx=0 tx=0).stop 2023-10-06T02:52:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.257+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a8159b40 msgr2=0x7fa1a8155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.257+0000 7fa1ad529700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a8159b40 0x7fa1a8155680 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e950 tx=0x7fa19c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.258+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 shutdown_connections 2023-10-06T02:52:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.258+0000 7fa1ad529700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1a8159f10 0x7fa1a816da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.258+0000 7fa1ad529700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa194066f30 0x7fa1940693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.258+0000 7fa1ad529700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1a80ccb40 0x7fa1a815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.258+0000 7fa1ad529700 1 --2- 172.21.15.81:0/1542680892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a8159b40 0x7fa1a8155680 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.258+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 >> 172.21.15.81:0/1542680892 conn(0x7fa1a80cd660 msgr2=0x7fa1a80b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.258+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 shutdown_connections 2023-10-06T02:52:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.258+0000 7fa1ad529700 1 -- 172.21.15.81:0/1542680892 wait complete. 2023-10-06T02:52:30.272 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:52:30.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:52:30.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.385+0000 7f08a05ac700 1 Processor -- start 2023-10-06T02:52:30.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.385+0000 7f08a05ac700 1 -- start start 2023-10-06T02:52:30.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.386+0000 7f08a05ac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0898157fe0 0x7f08980b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.386+0000 7f08a05ac700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08981583b0 0x7f08980b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.386+0000 7f08a05ac700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08980b2890 con 0x7f08980ceb30 2023-10-06T02:52:30.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.386+0000 7f08a05ac700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08980b4070 con 0x7f08981583b0 2023-10-06T02:52:30.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.386+0000 7f08a05ac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08980b4350 con 0x7f0898157fe0 2023-10-06T02:52:30.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089db47700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08981583b0 0x7f08980b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089db47700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08981583b0 0x7f08980b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55762/0 (socket says 172.21.15.81:55762) 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089db47700 1 -- 172.21.15.81:0/360017253 learned_addr learned my addr 172.21.15.81:0/360017253 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089e348700 1 --2- 172.21.15.81:0/360017253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0898157fe0 0x7f08980b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089db47700 1 -- 172.21.15.81:0/360017253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0898157fe0 msgr2=0x7f08980b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089db47700 1 --2- 172.21.15.81:0/360017253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0898157fe0 0x7f08980b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089db47700 1 -- 172.21.15.81:0/360017253 >> v1:172.21.15.83:6789/0 conn(0x7f08980ceb30 legacy=0x7f08980cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089db47700 1 -- 172.21.15.81:0/360017253 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08980b4630 con 0x7f08981583b0 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089db47700 1 --2- 172.21.15.81:0/360017253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08981583b0 0x7f08980b3a00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f08880099b0 tx=0x7f0888009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562ab65143a5c70b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089d346700 1 -- 172.21.15.81:0/360017253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800b820 con 0x7f08981583b0 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089d346700 1 -- 172.21.15.81:0/360017253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800b980 con 0x7f08981583b0 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.387+0000 7f089d346700 1 -- 172.21.15.81:0/360017253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800bd40 con 0x7f08981583b0 2023-10-06T02:52:30.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.388+0000 7f08a05ac700 1 -- 172.21.15.81:0/360017253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08981583b0 msgr2=0x7f08980b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.388+0000 7f08a05ac700 1 --2- 172.21.15.81:0/360017253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08981583b0 0x7f08980b3a00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f08880099b0 tx=0x7f0888009250 comp rx=0 tx=0).stop 2023-10-06T02:52:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.388+0000 7f08a05ac700 1 -- 172.21.15.81:0/360017253 shutdown_connections 2023-10-06T02:52:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.388+0000 7f08a05ac700 1 --2- 172.21.15.81:0/360017253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0898157fe0 0x7f08980b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.388+0000 7f08a05ac700 1 --2- 172.21.15.81:0/360017253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08981583b0 0x7f08980b3a00 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.388+0000 7f08a05ac700 1 -- 172.21.15.81:0/360017253 >> 172.21.15.81:0/360017253 conn(0x7f0898067640 msgr2=0x7f0898067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.388+0000 7f08a05ac700 1 -- 172.21.15.81:0/360017253 shutdown_connections 2023-10-06T02:52:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.388+0000 7f08a05ac700 1 -- 172.21.15.81:0/360017253 wait complete. 2023-10-06T02:52:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.389+0000 7f08a05ac700 1 Processor -- start 2023-10-06T02:52:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.389+0000 7f08a05ac700 1 -- start start 2023-10-06T02:52:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f08a05ac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08980ceb30 0x7f0898168680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f08a05ac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0898157fe0 0x7f089815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f08a05ac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08981583b0 0x7f089814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f08a05ac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0898169600 con 0x7f0898157fe0 2023-10-06T02:52:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f08a05ac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0898159730 con 0x7f08980ceb30 2023-10-06T02:52:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f08a05ac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089815ba30 con 0x7f08981583b0 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089db47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0898157fe0 0x7f089815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089db47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0898157fe0 0x7f089815b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55764/0 (socket says 172.21.15.81:55764) 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089db47700 1 -- 172.21.15.81:0/1440551753 learned_addr learned my addr 172.21.15.81:0/1440551753 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089e348700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08980ceb30 0x7f0898168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089eb49700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08981583b0 0x7f089814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089db47700 1 -- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08981583b0 msgr2=0x7f089814b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089db47700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08981583b0 0x7f089814b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089db47700 1 -- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08980ceb30 msgr2=0x7f0898168680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089db47700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08980ceb30 0x7f0898168680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089db47700 1 -- 172.21.15.81:0/1440551753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08880094f0 con 0x7f0898157fe0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089e348700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08980ceb30 0x7f0898168680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f089db47700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0898157fe0 0x7f089815b4f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f089806f990 tx=0x7f0888016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f088e7fc700 1 -- 172.21.15.81:0/1440551753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800b820 con 0x7f0898157fe0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f088e7fc700 1 -- 172.21.15.81:0/1440551753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0888020070 con 0x7f0898157fe0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0898168d60 con 0x7f0898157fe0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f088e7fc700 1 -- 172.21.15.81:0/1440551753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888011e50 con 0x7f0898157fe0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.390+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0898169320 con 0x7f0898157fe0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.391+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08981598a0 con 0x7f0898157fe0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.392+0000 7f088e7fc700 1 -- 172.21.15.81:0/1440551753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0888022030 con 0x7f0898157fe0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.392+0000 7f088e7fc700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f087c066f30 0x7f087c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.392+0000 7f088e7fc700 1 -- 172.21.15.81:0/1440551753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f08880864f0 con 0x7f0898157fe0 2023-10-06T02:52:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.392+0000 7f089e348700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f087c066f30 0x7f087c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.393+0000 7f089e348700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f087c066f30 0x7f087c0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0894007540 tx=0x7f089400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.396+0000 7f088e7fc700 1 -- 172.21.15.81:0/1440551753 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0888053600 con 0x7f0898157fe0 2023-10-06T02:52:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.575+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08981598a0 con 0x7f087c066f30 2023-10-06T02:52:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.584+0000 7f088e7fc700 1 -- 172.21.15.81:0/1440551753 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302895 (secure 0 0 0) 0x7f08981598a0 con 0x7f087c066f30 2023-10-06T02:52:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:30.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f087c066f30 msgr2=0x7f087c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f087c066f30 0x7f087c0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0894007540 tx=0x7f089400b040 comp rx=0 tx=0).stop 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0898157fe0 msgr2=0x7f089815b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0898157fe0 0x7f089815b4f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f089806f990 tx=0x7f0888016000 comp rx=0 tx=0).stop 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 shutdown_connections 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08981583b0 0x7f089814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f087c066f30 0x7f087c0693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08980ceb30 0x7f0898168680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 --2- 172.21.15.81:0/1440551753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0898157fe0 0x7f089815b4f0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 >> 172.21.15.81:0/1440551753 conn(0x7f0898067640 msgr2=0x7f08980cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:30.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.587+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 shutdown_connections 2023-10-06T02:52:30.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.588+0000 7f08a05ac700 1 -- 172.21.15.81:0/1440551753 wait complete. 2023-10-06T02:52:30.594 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:52:30.601 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2023-10-06T02:52:29.583639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7206,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555293,"statfs":{"total":1600000000,"available":1592621032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.055424"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539241+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538356+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540065+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538781+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539863+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539659+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:52.861165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541510+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:01.855585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539739+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:24.087056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538422+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539461+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:28.881920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538906+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541170+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:16.893240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538006+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:28.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538906+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539501+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539319+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:46.119876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540686+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539438+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540910+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540044+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:33.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539044+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541689+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541381+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.544340+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.542721+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539567+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.070249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539411+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.543794+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:28.700897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538818+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:49.401503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538453+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.543118+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.543527+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541485+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544754+0000","last_change":"2023-10-06T02:52:25.544754+0000","last_active":"2023-10-06T02:52:25.544754+0000","last_peered":"2023-10-06T02:52:25.544754+0000","last_clean":"2023-10-06T02:52:25.544754+0000","last_became_active":"2023-10-06T02:52:25.544522+0000","last_became_peered":"2023-10-06T02:52:25.544522+0000","last_unstale":"2023-10-06T02:52:25.544754+0000","last_undegraded":"2023-10-06T02:52:25.544754+0000","last_fullsized":"2023-10-06T02:52:25.544754+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:27.128855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541374+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:44.465768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.542191+0000","last_change":"2023-10-06T02:52:25.542191+0000","last_active":"2023-10-06T02:52:25.542191+0000","last_peered":"2023-10-06T02:52:25.542191+0000","last_clean":"2023-10-06T02:52:25.542191+0000","last_became_active":"2023-10-06T02:52:25.541967+0000","last_became_peered":"2023-10-06T02:52:25.541967+0000","last_unstale":"2023-10-06T02:52:25.542191+0000","last_undegraded":"2023-10-06T02:52:25.542191+0000","last_fullsized":"2023-10-06T02:52:25.542191+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537999+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545738+0000","last_change":"2023-10-06T02:52:25.545738+0000","last_active":"2023-10-06T02:52:25.545738+0000","last_peered":"2023-10-06T02:52:25.545738+0000","last_clean":"2023-10-06T02:52:25.545738+0000","last_became_active":"2023-10-06T02:52:25.545482+0000","last_became_peered":"2023-10-06T02:52:25.545482+0000","last_unstale":"2023-10-06T02:52:25.545738+0000","last_undegraded":"2023-10-06T02:52:25.545738+0000","last_fullsized":"2023-10-06T02:52:25.545738+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541022+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543504+0000","last_change":"2023-10-06T02:52:25.543504+0000","last_active":"2023-10-06T02:52:25.543504+0000","last_peered":"2023-10-06T02:52:25.543504+0000","last_clean":"2023-10-06T02:52:25.543504+0000","last_became_active":"2023-10-06T02:52:25.543294+0000","last_became_peered":"2023-10-06T02:52:25.543294+0000","last_unstale":"2023-10-06T02:52:25.543504+0000","last_undegraded":"2023-10-06T02:52:25.543504+0000","last_fullsized":"2023-10-06T02:52:25.543504+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.015668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537876+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:37.035449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547100+0000","last_change":"2023-10-06T02:52:25.547100+0000","last_active":"2023-10-06T02:52:25.547100+0000","last_peered":"2023-10-06T02:52:25.547100+0000","last_clean":"2023-10-06T02:52:25.547100+0000","last_became_active":"2023-10-06T02:52:25.546711+0000","last_became_peered":"2023-10-06T02:52:25.546711+0000","last_unstale":"2023-10-06T02:52:25.547100+0000","last_undegraded":"2023-10-06T02:52:25.547100+0000","last_fullsized":"2023-10-06T02:52:25.547100+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:55.222375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539450+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545503+0000","last_change":"2023-10-06T02:52:25.545503+0000","last_active":"2023-10-06T02:52:25.545503+0000","last_peered":"2023-10-06T02:52:25.545503+0000","last_clean":"2023-10-06T02:52:25.545503+0000","last_became_active":"2023-10-06T02:52:25.543328+0000","last_became_peered":"2023-10-06T02:52:25.543328+0000","last_unstale":"2023-10-06T02:52:25.545503+0000","last_undegraded":"2023-10-06T02:52:25.545503+0000","last_fullsized":"2023-10-06T02:52:25.545503+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:21.145420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539095+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544790+0000","last_change":"2023-10-06T02:52:25.544790+0000","last_active":"2023-10-06T02:52:25.544790+0000","last_peered":"2023-10-06T02:52:25.544790+0000","last_clean":"2023-10-06T02:52:25.544790+0000","last_became_active":"2023-10-06T02:52:25.544567+0000","last_became_peered":"2023-10-06T02:52:25.544567+0000","last_unstale":"2023-10-06T02:52:25.544790+0000","last_undegraded":"2023-10-06T02:52:25.544790+0000","last_fullsized":"2023-10-06T02:52:25.544790+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540356+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545963+0000","last_change":"2023-10-06T02:52:25.545963+0000","last_active":"2023-10-06T02:52:25.545963+0000","last_peered":"2023-10-06T02:52:25.545963+0000","last_clean":"2023-10-06T02:52:25.545963+0000","last_became_active":"2023-10-06T02:52:25.544613+0000","last_became_peered":"2023-10-06T02:52:25.544613+0000","last_unstale":"2023-10-06T02:52:25.545963+0000","last_undegraded":"2023-10-06T02:52:25.545963+0000","last_fullsized":"2023-10-06T02:52:25.545963+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:28.221311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537964+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544827+0000","last_change":"2023-10-06T02:52:25.544827+0000","last_active":"2023-10-06T02:52:25.544827+0000","last_peered":"2023-10-06T02:52:25.544827+0000","last_clean":"2023-10-06T02:52:25.544827+0000","last_became_active":"2023-10-06T02:52:25.544602+0000","last_became_peered":"2023-10-06T02:52:25.544602+0000","last_unstale":"2023-10-06T02:52:25.544827+0000","last_undegraded":"2023-10-06T02:52:25.544827+0000","last_fullsized":"2023-10-06T02:52:25.544827+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538561+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.542765+0000","last_change":"2023-10-06T02:52:25.542765+0000","last_active":"2023-10-06T02:52:25.542765+0000","last_peered":"2023-10-06T02:52:25.542765+0000","last_clean":"2023-10-06T02:52:25.542765+0000","last_became_active":"2023-10-06T02:52:25.542333+0000","last_became_peered":"2023-10-06T02:52:25.542333+0000","last_unstale":"2023-10-06T02:52:25.542765+0000","last_undegraded":"2023-10-06T02:52:25.542765+0000","last_fullsized":"2023-10-06T02:52:25.542765+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:48.265643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541050+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:18.233825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547169+0000","last_change":"2023-10-06T02:52:25.547169+0000","last_active":"2023-10-06T02:52:25.547169+0000","last_peered":"2023-10-06T02:52:25.547169+0000","last_clean":"2023-10-06T02:52:25.547169+0000","last_became_active":"2023-10-06T02:52:25.546959+0000","last_became_peered":"2023-10-06T02:52:25.546959+0000","last_unstale":"2023-10-06T02:52:25.547169+0000","last_undegraded":"2023-10-06T02:52:25.547169+0000","last_fullsized":"2023-10-06T02:52:25.547169+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537532+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:28.881920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.548463+0000","last_change":"2023-10-06T02:52:25.548463+0000","last_active":"2023-10-06T02:52:25.548463+0000","last_peered":"2023-10-06T02:52:25.548463+0000","last_clean":"2023-10-06T02:52:25.548463+0000","last_became_active":"2023-10-06T02:52:25.548237+0000","last_became_peered":"2023-10-06T02:52:25.548237+0000","last_unstale":"2023-10-06T02:52:25.548463+0000","last_undegraded":"2023-10-06T02:52:25.548463+0000","last_fullsized":"2023-10-06T02:52:25.548463+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538960+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:42.506920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545831+0000","last_change":"2023-10-06T02:52:25.545831+0000","last_active":"2023-10-06T02:52:25.545831+0000","last_peered":"2023-10-06T02:52:25.545831+0000","last_clean":"2023-10-06T02:52:25.545831+0000","last_became_active":"2023-10-06T02:52:25.544736+0000","last_became_peered":"2023-10-06T02:52:25.544736+0000","last_unstale":"2023-10-06T02:52:25.545831+0000","last_undegraded":"2023-10-06T02:52:25.545831+0000","last_fullsized":"2023-10-06T02:52:25.545831+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:04.384554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538103+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543505+0000","last_change":"2023-10-06T02:52:25.543505+0000","last_active":"2023-10-06T02:52:25.543505+0000","last_peered":"2023-10-06T02:52:25.543505+0000","last_clean":"2023-10-06T02:52:25.543505+0000","last_became_active":"2023-10-06T02:52:25.543320+0000","last_became_peered":"2023-10-06T02:52:25.543320+0000","last_unstale":"2023-10-06T02:52:25.543505+0000","last_undegraded":"2023-10-06T02:52:25.543505+0000","last_fullsized":"2023-10-06T02:52:25.543505+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538561+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.538954+0000","last_change":"2023-10-06T02:52:25.538954+0000","last_active":"2023-10-06T02:52:25.538954+0000","last_peered":"2023-10-06T02:52:25.538954+0000","last_clean":"2023-10-06T02:52:25.538954+0000","last_became_active":"2023-10-06T02:52:25.538719+0000","last_became_peered":"2023-10-06T02:52:25.538719+0000","last_unstale":"2023-10-06T02:52:25.538954+0000","last_undegraded":"2023-10-06T02:52:25.538954+0000","last_fullsized":"2023-10-06T02:52:25.538954+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537494+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:02.719347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545718+0000","last_change":"2023-10-06T02:52:25.545718+0000","last_active":"2023-10-06T02:52:25.545718+0000","last_peered":"2023-10-06T02:52:25.545718+0000","last_clean":"2023-10-06T02:52:25.545718+0000","last_became_active":"2023-10-06T02:52:25.545491+0000","last_became_peered":"2023-10-06T02:52:25.545491+0000","last_unstale":"2023-10-06T02:52:25.545718+0000","last_undegraded":"2023-10-06T02:52:25.545718+0000","last_fullsized":"2023-10-06T02:52:25.545718+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540677+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:37.422386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546086+0000","last_change":"2023-10-06T02:52:25.546086+0000","last_active":"2023-10-06T02:52:25.546086+0000","last_peered":"2023-10-06T02:52:25.546086+0000","last_clean":"2023-10-06T02:52:25.546086+0000","last_became_active":"2023-10-06T02:52:25.545594+0000","last_became_peered":"2023-10-06T02:52:25.545594+0000","last_unstale":"2023-10-06T02:52:25.546086+0000","last_undegraded":"2023-10-06T02:52:25.546086+0000","last_fullsized":"2023-10-06T02:52:25.546086+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:18.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539508+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547920+0000","last_change":"2023-10-06T02:52:25.547920+0000","last_active":"2023-10-06T02:52:25.547920+0000","last_peered":"2023-10-06T02:52:25.547920+0000","last_clean":"2023-10-06T02:52:25.547920+0000","last_became_active":"2023-10-06T02:52:25.547743+0000","last_became_peered":"2023-10-06T02:52:25.547743+0000","last_unstale":"2023-10-06T02:52:25.547920+0000","last_undegraded":"2023-10-06T02:52:25.547920+0000","last_fullsized":"2023-10-06T02:52:25.547920+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540664+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547752+0000","last_change":"2023-10-06T02:52:25.547752+0000","last_active":"2023-10-06T02:52:25.547752+0000","last_peered":"2023-10-06T02:52:25.547752+0000","last_clean":"2023-10-06T02:52:25.547752+0000","last_became_active":"2023-10-06T02:52:25.547526+0000","last_became_peered":"2023-10-06T02:52:25.547526+0000","last_unstale":"2023-10-06T02:52:25.547752+0000","last_undegraded":"2023-10-06T02:52:25.547752+0000","last_fullsized":"2023-10-06T02:52:25.547752+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:36.026761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540012+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:10.124283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545836+0000","last_change":"2023-10-06T02:52:25.545836+0000","last_active":"2023-10-06T02:52:25.545836+0000","last_peered":"2023-10-06T02:52:25.545836+0000","last_clean":"2023-10-06T02:52:25.545836+0000","last_became_active":"2023-10-06T02:52:25.544311+0000","last_became_peered":"2023-10-06T02:52:25.544311+0000","last_unstale":"2023-10-06T02:52:25.545836+0000","last_undegraded":"2023-10-06T02:52:25.545836+0000","last_fullsized":"2023-10-06T02:52:25.545836+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:51.912933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.542668+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:43.535260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545621+0000","last_change":"2023-10-06T02:52:25.545621+0000","last_active":"2023-10-06T02:52:25.545621+0000","last_peered":"2023-10-06T02:52:25.545621+0000","last_clean":"2023-10-06T02:52:25.545621+0000","last_became_active":"2023-10-06T02:52:25.545184+0000","last_became_peered":"2023-10-06T02:52:25.545184+0000","last_unstale":"2023-10-06T02:52:25.545621+0000","last_undegraded":"2023-10-06T02:52:25.545621+0000","last_fullsized":"2023-10-06T02:52:25.545621+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:08.888993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538770+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546929+0000","last_change":"2023-10-06T02:52:25.546929+0000","last_active":"2023-10-06T02:52:25.546929+0000","last_peered":"2023-10-06T02:52:25.546929+0000","last_clean":"2023-10-06T02:52:25.546929+0000","last_became_active":"2023-10-06T02:52:25.546386+0000","last_became_peered":"2023-10-06T02:52:25.546386+0000","last_unstale":"2023-10-06T02:52:25.546929+0000","last_undegraded":"2023-10-06T02:52:25.546929+0000","last_fullsized":"2023-10-06T02:52:25.546929+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:36.519223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539543+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545690+0000","last_change":"2023-10-06T02:52:25.545690+0000","last_active":"2023-10-06T02:52:25.545690+0000","last_peered":"2023-10-06T02:52:25.545690+0000","last_clean":"2023-10-06T02:52:25.545690+0000","last_became_active":"2023-10-06T02:52:25.544448+0000","last_became_peered":"2023-10-06T02:52:25.544448+0000","last_unstale":"2023-10-06T02:52:25.545690+0000","last_undegraded":"2023-10-06T02:52:25.545690+0000","last_fullsized":"2023-10-06T02:52:25.545690+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:52.270415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538048+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:02.719347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544210+0000","last_change":"2023-10-06T02:52:25.544210+0000","last_active":"2023-10-06T02:52:25.544210+0000","last_peered":"2023-10-06T02:52:25.544210+0000","last_clean":"2023-10-06T02:52:25.544210+0000","last_became_active":"2023-10-06T02:52:25.543966+0000","last_became_peered":"2023-10-06T02:52:25.543966+0000","last_unstale":"2023-10-06T02:52:25.544210+0000","last_undegraded":"2023-10-06T02:52:25.544210+0000","last_fullsized":"2023-10-06T02:52:25.544210+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540551+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543969+0000","last_change":"2023-10-06T02:52:25.543969+0000","last_active":"2023-10-06T02:52:25.543969+0000","last_peered":"2023-10-06T02:52:25.543969+0000","last_clean":"2023-10-06T02:52:25.543969+0000","last_became_active":"2023-10-06T02:52:25.543754+0000","last_became_peered":"2023-10-06T02:52:25.543754+0000","last_unstale":"2023-10-06T02:52:25.543969+0000","last_undegraded":"2023-10-06T02:52:25.543969+0000","last_fullsized":"2023-10-06T02:52:25.543969+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530277+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:52:24.530277+0000","last_peered":"2023-10-06T02:52:24.530277+0000","last_clean":"2023-10-06T02:52:24.530277+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:52:24.530277+0000","last_undegraded":"2023-10-06T02:52:24.530277+0000","last_fullsized":"2023-10-06T02:52:24.530277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539229+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:39:12.681495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544064+0000","last_change":"2023-10-06T02:52:25.544064+0000","last_active":"2023-10-06T02:52:25.544064+0000","last_peered":"2023-10-06T02:52:25.544064+0000","last_clean":"2023-10-06T02:52:25.544064+0000","last_became_active":"2023-10-06T02:52:25.543804+0000","last_became_peered":"2023-10-06T02:52:25.543804+0000","last_unstale":"2023-10-06T02:52:25.544064+0000","last_undegraded":"2023-10-06T02:52:25.544064+0000","last_fullsized":"2023-10-06T02:52:25.544064+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":122,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.529651+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:52:24.529651+0000","last_peered":"2023-10-06T02:52:24.529651+0000","last_clean":"2023-10-06T02:52:24.529651+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:52:24.529651+0000","last_undegraded":"2023-10-06T02:52:24.529651+0000","last_fullsized":"2023-10-06T02:52:24.529651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540031+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.538066+0000","last_change":"2023-10-06T02:52:25.538066+0000","last_active":"2023-10-06T02:52:25.538066+0000","last_peered":"2023-10-06T02:52:25.538066+0000","last_clean":"2023-10-06T02:52:25.538066+0000","last_became_active":"2023-10-06T02:52:25.537825+0000","last_became_peered":"2023-10-06T02:52:25.537825+0000","last_unstale":"2023-10-06T02:52:25.538066+0000","last_undegraded":"2023-10-06T02:52:25.538066+0000","last_fullsized":"2023-10-06T02:52:25.538066+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530954+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:52:24.530954+0000","last_peered":"2023-10-06T02:52:24.530954+0000","last_clean":"2023-10-06T02:52:24.530954+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:52:24.530954+0000","last_undegraded":"2023-10-06T02:52:24.530954+0000","last_fullsized":"2023-10-06T02:52:24.530954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539108+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543751+0000","last_change":"2023-10-06T02:52:25.543751+0000","last_active":"2023-10-06T02:52:25.543751+0000","last_peered":"2023-10-06T02:52:25.543751+0000","last_clean":"2023-10-06T02:52:25.543751+0000","last_became_active":"2023-10-06T02:52:25.543563+0000","last_became_peered":"2023-10-06T02:52:25.543563+0000","last_unstale":"2023-10-06T02:52:25.543751+0000","last_undegraded":"2023-10-06T02:52:25.543751+0000","last_fullsized":"2023-10-06T02:52:25.543751+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530727+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:52:24.530727+0000","last_peered":"2023-10-06T02:52:24.530727+0000","last_clean":"2023-10-06T02:52:24.530727+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:52:24.530727+0000","last_undegraded":"2023-10-06T02:52:24.530727+0000","last_fullsized":"2023-10-06T02:52:24.530727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":260,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531541+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:52:24.531541+0000","last_peered":"2023-10-06T02:52:24.531541+0000","last_clean":"2023-10-06T02:52:24.531541+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:52:24.531541+0000","last_undegraded":"2023-10-06T02:52:24.531541+0000","last_fullsized":"2023-10-06T02:52:24.531541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538931+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.541005+0000","last_change":"2023-10-06T02:52:25.541005+0000","last_active":"2023-10-06T02:52:25.541005+0000","last_peered":"2023-10-06T02:52:25.541005+0000","last_clean":"2023-10-06T02:52:25.541005+0000","last_became_active":"2023-10-06T02:52:25.540862+0000","last_became_peered":"2023-10-06T02:52:25.540862+0000","last_unstale":"2023-10-06T02:52:25.541005+0000","last_undegraded":"2023-10-06T02:52:25.541005+0000","last_fullsized":"2023-10-06T02:52:25.541005+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531456+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:52:24.531456+0000","last_peered":"2023-10-06T02:52:24.531456+0000","last_clean":"2023-10-06T02:52:24.531456+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:52:24.531456+0000","last_undegraded":"2023-10-06T02:52:24.531456+0000","last_fullsized":"2023-10-06T02:52:24.531456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537917+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546234+0000","last_change":"2023-10-06T02:52:25.546234+0000","last_active":"2023-10-06T02:52:25.546234+0000","last_peered":"2023-10-06T02:52:25.546234+0000","last_clean":"2023-10-06T02:52:25.546234+0000","last_became_active":"2023-10-06T02:52:25.545953+0000","last_became_peered":"2023-10-06T02:52:25.545953+0000","last_unstale":"2023-10-06T02:52:25.546234+0000","last_undegraded":"2023-10-06T02:52:25.546234+0000","last_fullsized":"2023-10-06T02:52:25.546234+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:42.320760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531644+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:52:24.531644+0000","last_peered":"2023-10-06T02:52:24.531644+0000","last_clean":"2023-10-06T02:52:24.531644+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:52:24.531644+0000","last_undegraded":"2023-10-06T02:52:24.531644+0000","last_fullsized":"2023-10-06T02:52:24.531644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537931+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546603+0000","last_change":"2023-10-06T02:52:25.546603+0000","last_active":"2023-10-06T02:52:25.546603+0000","last_peered":"2023-10-06T02:52:25.546603+0000","last_clean":"2023-10-06T02:52:25.546603+0000","last_became_active":"2023-10-06T02:52:25.546366+0000","last_became_peered":"2023-10-06T02:52:25.546366+0000","last_unstale":"2023-10-06T02:52:25.546603+0000","last_undegraded":"2023-10-06T02:52:25.546603+0000","last_fullsized":"2023-10-06T02:52:25.546603+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530278+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:52:24.530278+0000","last_peered":"2023-10-06T02:52:24.530278+0000","last_clean":"2023-10-06T02:52:24.530278+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:52:24.530278+0000","last_undegraded":"2023-10-06T02:52:24.530278+0000","last_fullsized":"2023-10-06T02:52:24.530278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537921+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543355+0000","last_change":"2023-10-06T02:52:25.543355+0000","last_active":"2023-10-06T02:52:25.543355+0000","last_peered":"2023-10-06T02:52:25.543355+0000","last_clean":"2023-10-06T02:52:25.543355+0000","last_became_active":"2023-10-06T02:52:25.543138+0000","last_became_peered":"2023-10-06T02:52:25.543138+0000","last_unstale":"2023-10-06T02:52:25.543355+0000","last_undegraded":"2023-10-06T02:52:25.543355+0000","last_fullsized":"2023-10-06T02:52:25.543355+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531363+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:52:24.531363+0000","last_peered":"2023-10-06T02:52:24.531363+0000","last_clean":"2023-10-06T02:52:24.531363+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:52:24.531363+0000","last_undegraded":"2023-10-06T02:52:24.531363+0000","last_fullsized":"2023-10-06T02:52:24.531363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193979,"statfs":{"total":200000000,"available":198634853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70799999999999996,"5min":0.80600000000000005,"15min":1.393},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.33800000000000002,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":1.5569999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.627,"5min":0.76400000000000001,"15min":1.081},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":1.4710000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.48699999999999999},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58899999999999997,"15min":0.63500000000000001},"min":{"1min":0.35899999999999999,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.65900000000000003,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.61199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.65700000000000003,"5min":3.0649999999999999,"15min":3.4870000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.58499999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.69999999999999996,"5min":0.97899999999999998,"15min":2.2349999999999999},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.498},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72599999999999998},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.879},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.751}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.44,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76300000000000001},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.60999999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64800000000000002,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.64100000000000001,"5min":0.75700000000000001,"15min":1.879},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53000000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67800000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53700000000000003,"15min":0.94599999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65700000000000003,"5min":0.80000000000000004,"15min":11.957000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.51000000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66900000000000004,"5min":1.042,"15min":1.0580000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.39400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69899999999999995,"5min":0.83399999999999996,"15min":0.95799999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.80100000000000005,"15min":1.163},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":1.05,"15min":1.05},"last":0.755},{"interface":"front","average":{"1min":0.501,"5min":0.498,"15min":0.56100000000000005},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48199999999999998,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.60199999999999998},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.61199999999999999},"min":{"1min":0.33600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.314,"15min":0.313},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.40799999999999997,"5min":0.501,"15min":0.501},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35199999999999998,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46300000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33300000000000002,"15min":0.32200000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.30399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.36299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.23400000000000001},"max":{"1min":0.42299999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.996,"15min":0.996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.43099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.53900000000000003},"min":{"1min":0.49399999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.434},{"interface":"front","average":{"1min":0.62,"5min":0.58699999999999997,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39000000000000001},"max":{"1min":0.71699999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60599999999999998,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.006},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.57399999999999995},"min":{"1min":0.54900000000000004,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":0.88200000000000001},"last":0.498}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193979,"statfs":{"total":200000000,"available":198634853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33100000000000002,"15min":0.34699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.45600000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.375,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":1.0389999999999999},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.188},"max":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":22.038},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":1.3779999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.36099999999999999},"min":{"1min":0.22,"5min":0.183,"15min":0.183},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":1.071},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.253},"max":{"1min":0.498,"5min":0.63300000000000001,"15min":21.942},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70499999999999996,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.75},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":1.1419999999999999},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.86499999999999999,"15min":11.122999999999999},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":1.2290000000000001},"min":{"1min":0.38400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71999999999999997,"5min":0.80200000000000005,"15min":22.010999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.69799999999999995,"5min":0.83899999999999997,"15min":1.401},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":1.171},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73499999999999999,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":1.254},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.84799999999999998,"15min":21.98},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.70899999999999996,"5min":0.91000000000000003,"15min":1.425},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.90300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.71999999999999997,"5min":0.81899999999999995,"15min":11.154},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"min":{"1min":0.215,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.41799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.316,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.24099999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.40200000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.39800000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.41699999999999998,"15min":0.38900000000000001},"min":{"1min":0.315,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.47499999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39400000000000002,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.499,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.314},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51300000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.056,"15min":1.056},"last":0.754},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81599999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.628,"15min":0.59199999999999997},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83399999999999996,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.56000000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68700000000000006,"5min":1.002,"15min":1.002},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60799999999999998,"15min":0.58699999999999997},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.86499999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.318,"15min":0.307},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.439,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.37,"15min":0.33300000000000002},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.56999999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.24399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.35299999999999998,"15min":0.33000000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.45100000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.378,"15min":0.34799999999999998},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.58499999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41199999999999998,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.65900000000000003,"5min":3.044,"15min":3.044},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.249},"max":{"1min":0.45100000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.26400000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.446,"5min":1.446,"15min":2.2120000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.327,"5min":1.327,"15min":2.25},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58599999999999997,"15min":0.68799999999999994},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.5}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.44500000000000001,"15min":0.38600000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.94099999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.442,"5min":0.372,"15min":0.372},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.5,"15min":0.78100000000000003},"min":{"1min":0.39600000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.62},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.221},"max":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52100000000000002,"15min":0.81299999999999994},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65900000000000003,"5min":0.70599999999999996,"15min":5.9329999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52000000000000002,"15min":0.76700000000000002},"min":{"1min":0.373,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.67800000000000005,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.75900000000000001,"15min":5.4390000000000001},"last":0.623},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.67100000000000004},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.61199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.77000000000000002,"15min":3.456},"last":0.499}]},{"osd":5,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.245},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.59699999999999998,"15min":1.0069999999999999},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":13.173999999999999},"last":0.64700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.69399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.27400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.41599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.6269999999999998,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.32700000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.63800000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68000000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71999999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73499999999999999,"5min":0.879,"15min":0.879},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.47599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.74299999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.81799999999999995}]}]}],"pool_statfs":[]}} 2023-10-06T02:52:30.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:52:30.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.754+0000 7fc9801c4700 1 Processor -- start 2023-10-06T02:52:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.754+0000 7fc9801c4700 1 -- start start 2023-10-06T02:52:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.755+0000 7fc9801c4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9781578d0 0x7fc9780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.755+0000 7fc9801c4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc97806d120 0x7fc97806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.755+0000 7fc9801c4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97806dac0 con 0x7fc978157ca0 2023-10-06T02:52:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.755+0000 7fc9801c4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9780d07c0 con 0x7fc97806d120 2023-10-06T02:52:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.755+0000 7fc9801c4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780cfbb0 con 0x7fc9781578d0 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.755+0000 7fc97e761700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc97806d120 0x7fc97806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97e761700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc97806d120 0x7fc97806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55778/0 (socket says 172.21.15.81:55778) 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97e761700 1 -- 172.21.15.81:0/1869737691 learned_addr learned my addr 172.21.15.81:0/1869737691 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97df60700 1 --2- 172.21.15.81:0/1869737691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9781578d0 0x7fc9780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97e761700 1 -- 172.21.15.81:0/1869737691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9781578d0 msgr2=0x7fc9780cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97e761700 1 --2- 172.21.15.81:0/1869737691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9781578d0 0x7fc9780cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97e761700 1 -- 172.21.15.81:0/1869737691 >> v1:172.21.15.83:6789/0 conn(0x7fc978157ca0 legacy=0x7fc97815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97e761700 1 -- 172.21.15.81:0/1869737691 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780cfe90 con 0x7fc97806d120 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97cf5e700 1 -- 172.21.15.81:0/1869737691 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715232037 0 0) 0x7fc968001110 con 0x7fc978157ca0 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97e761700 1 --2- 172.21.15.81:0/1869737691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc97806d120 0x7fc97806d580 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc970009f20 tx=0x7fc970009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0501b2955118d13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97cf5e700 1 -- 172.21.15.81:0/1869737691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000e070 con 0x7fc97806d120 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97cf5e700 1 -- 172.21.15.81:0/1869737691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000b9d0 con 0x7fc97806d120 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.756+0000 7fc97cf5e700 1 -- 172.21.15.81:0/1869737691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700092e0 con 0x7fc97806d120 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.757+0000 7fc9801c4700 1 -- 172.21.15.81:0/1869737691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc97806d120 msgr2=0x7fc97806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.757+0000 7fc9801c4700 1 --2- 172.21.15.81:0/1869737691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc97806d120 0x7fc97806d580 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc970009f20 tx=0x7fc970009840 comp rx=0 tx=0).stop 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.757+0000 7fc9801c4700 1 -- 172.21.15.81:0/1869737691 shutdown_connections 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.757+0000 7fc9801c4700 1 --2- 172.21.15.81:0/1869737691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc97806d120 0x7fc97806d580 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.757+0000 7fc9801c4700 1 --2- 172.21.15.81:0/1869737691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9781578d0 0x7fc9780cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.757+0000 7fc9801c4700 1 -- 172.21.15.81:0/1869737691 >> 172.21.15.81:0/1869737691 conn(0x7fc97806bb90 msgr2=0x7fc97806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.757+0000 7fc9801c4700 1 -- 172.21.15.81:0/1869737691 shutdown_connections 2023-10-06T02:52:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.757+0000 7fc9801c4700 1 -- 172.21.15.81:0/1869737691 wait complete. 2023-10-06T02:52:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.758+0000 7fc9801c4700 1 Processor -- start 2023-10-06T02:52:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.758+0000 7fc9801c4700 1 -- start start 2023-10-06T02:52:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc9801c4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc97806d120 0x7fc978068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc9801c4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9781578d0 0x7fc978169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc9801c4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc978157ca0 0x7fc97816a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc9801c4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97816ae40 con 0x7fc978157ca0 2023-10-06T02:52:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc9801c4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc978159c10 con 0x7fc9781578d0 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc9801c4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97816a7a0 con 0x7fc97806d120 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97e761700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc978157ca0 0x7fc97816a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97e761700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc978157ca0 0x7fc97816a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55792/0 (socket says 172.21.15.81:55792) 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97e761700 1 -- 172.21.15.81:0/1921182992 learned_addr learned my addr 172.21.15.81:0/1921182992 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97df60700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc97806d120 0x7fc978068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97d75f700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9781578d0 0x7fc978169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97e761700 1 -- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc97806d120 msgr2=0x7fc978068a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97e761700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc97806d120 0x7fc978068a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97e761700 1 -- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9781578d0 msgr2=0x7fc978169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97e761700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9781578d0 0x7fc978169c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97e761700 1 -- 172.21.15.81:0/1921182992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970009ae0 con 0x7fc978157ca0 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97d75f700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9781578d0 0x7fc978169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97df60700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc97806d120 0x7fc978068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc97e761700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc978157ca0 0x7fc97816a1b0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc97806fe20 tx=0x7fc970018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc96dffb700 1 -- 172.21.15.81:0/1921182992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970008c70 con 0x7fc978157ca0 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc96dffb700 1 -- 172.21.15.81:0/1921182992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970008df0 con 0x7fc978157ca0 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97816aa80 con 0x7fc978157ca0 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.759+0000 7fc96dffb700 1 -- 172.21.15.81:0/1921182992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700266b0 con 0x7fc978157ca0 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.760+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97816b370 con 0x7fc978157ca0 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.760+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc978067ac0 con 0x7fc978157ca0 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.761+0000 7fc96dffb700 1 -- 172.21.15.81:0/1921182992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc970003040 con 0x7fc978157ca0 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.761+0000 7fc96dffb700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc95c066f30 0x7fc95c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.761+0000 7fc96dffb700 1 -- 172.21.15.81:0/1921182992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc970086650 con 0x7fc978157ca0 2023-10-06T02:52:30.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.761+0000 7fc97df60700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc95c066f30 0x7fc95c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:30.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.762+0000 7fc97df60700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc95c066f30 0x7fc95c0693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc974006f00 tx=0x7fc974008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:30.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.766+0000 7fc96dffb700 1 -- 172.21.15.81:0/1921182992 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc970053760 con 0x7fc978157ca0 2023-10-06T02:52:30.838 INFO:tasks.ceph.mds.d.smithi083.stderr:2023-10-06T02:52:30.836+0000 7fd1e344e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:52:30.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.945+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9780d0170 con 0x7fc95c066f30 2023-10-06T02:52:30.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.953+0000 7fc96dffb700 1 -- 172.21.15.81:0/1921182992 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302895 (secure 0 0 0) 0x7fc9780d0170 con 0x7fc95c066f30 2023-10-06T02:52:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc95c066f30 msgr2=0x7fc95c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc95c066f30 0x7fc95c0693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc974006f00 tx=0x7fc974008040 comp rx=0 tx=0).stop 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc978157ca0 msgr2=0x7fc97816a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc978157ca0 0x7fc97816a1b0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc97806fe20 tx=0x7fc970018000 comp rx=0 tx=0).stop 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 shutdown_connections 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc978157ca0 0x7fc97816a1b0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc97806d120 0x7fc978068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc95c066f30 0x7fc95c0693e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 --2- 172.21.15.81:0/1921182992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9781578d0 0x7fc978169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 >> 172.21.15.81:0/1921182992 conn(0x7fc97806bb90 msgr2=0x7fc97815c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 shutdown_connections 2023-10-06T02:52:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:30.957+0000 7fc9801c4700 1 -- 172.21.15.81:0/1921182992 wait complete. 2023-10-06T02:52:30.962 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:52:30.970 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2023-10-06T02:52:29.583639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7206,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555293,"statfs":{"total":1600000000,"available":1592621032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.055424"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539241+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538356+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540065+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538781+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539863+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539659+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:52.861165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541510+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:01.855585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539739+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:24.087056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538422+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539461+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:28.881920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538906+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541170+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:16.893240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538006+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:28.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538906+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539501+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539319+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:46.119876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540686+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539438+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540910+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540044+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:33.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539044+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541689+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541381+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.544340+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.542721+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539567+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.070249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539411+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.543794+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:28.700897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538818+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:49.401503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538453+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.543118+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.543527+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541485+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544754+0000","last_change":"2023-10-06T02:52:25.544754+0000","last_active":"2023-10-06T02:52:25.544754+0000","last_peered":"2023-10-06T02:52:25.544754+0000","last_clean":"2023-10-06T02:52:25.544754+0000","last_became_active":"2023-10-06T02:52:25.544522+0000","last_became_peered":"2023-10-06T02:52:25.544522+0000","last_unstale":"2023-10-06T02:52:25.544754+0000","last_undegraded":"2023-10-06T02:52:25.544754+0000","last_fullsized":"2023-10-06T02:52:25.544754+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:27.128855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541374+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:44.465768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.542191+0000","last_change":"2023-10-06T02:52:25.542191+0000","last_active":"2023-10-06T02:52:25.542191+0000","last_peered":"2023-10-06T02:52:25.542191+0000","last_clean":"2023-10-06T02:52:25.542191+0000","last_became_active":"2023-10-06T02:52:25.541967+0000","last_became_peered":"2023-10-06T02:52:25.541967+0000","last_unstale":"2023-10-06T02:52:25.542191+0000","last_undegraded":"2023-10-06T02:52:25.542191+0000","last_fullsized":"2023-10-06T02:52:25.542191+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537999+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545738+0000","last_change":"2023-10-06T02:52:25.545738+0000","last_active":"2023-10-06T02:52:25.545738+0000","last_peered":"2023-10-06T02:52:25.545738+0000","last_clean":"2023-10-06T02:52:25.545738+0000","last_became_active":"2023-10-06T02:52:25.545482+0000","last_became_peered":"2023-10-06T02:52:25.545482+0000","last_unstale":"2023-10-06T02:52:25.545738+0000","last_undegraded":"2023-10-06T02:52:25.545738+0000","last_fullsized":"2023-10-06T02:52:25.545738+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541022+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543504+0000","last_change":"2023-10-06T02:52:25.543504+0000","last_active":"2023-10-06T02:52:25.543504+0000","last_peered":"2023-10-06T02:52:25.543504+0000","last_clean":"2023-10-06T02:52:25.543504+0000","last_became_active":"2023-10-06T02:52:25.543294+0000","last_became_peered":"2023-10-06T02:52:25.543294+0000","last_unstale":"2023-10-06T02:52:25.543504+0000","last_undegraded":"2023-10-06T02:52:25.543504+0000","last_fullsized":"2023-10-06T02:52:25.543504+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.015668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537876+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:37.035449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547100+0000","last_change":"2023-10-06T02:52:25.547100+0000","last_active":"2023-10-06T02:52:25.547100+0000","last_peered":"2023-10-06T02:52:25.547100+0000","last_clean":"2023-10-06T02:52:25.547100+0000","last_became_active":"2023-10-06T02:52:25.546711+0000","last_became_peered":"2023-10-06T02:52:25.546711+0000","last_unstale":"2023-10-06T02:52:25.547100+0000","last_undegraded":"2023-10-06T02:52:25.547100+0000","last_fullsized":"2023-10-06T02:52:25.547100+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:55.222375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539450+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545503+0000","last_change":"2023-10-06T02:52:25.545503+0000","last_active":"2023-10-06T02:52:25.545503+0000","last_peered":"2023-10-06T02:52:25.545503+0000","last_clean":"2023-10-06T02:52:25.545503+0000","last_became_active":"2023-10-06T02:52:25.543328+0000","last_became_peered":"2023-10-06T02:52:25.543328+0000","last_unstale":"2023-10-06T02:52:25.545503+0000","last_undegraded":"2023-10-06T02:52:25.545503+0000","last_fullsized":"2023-10-06T02:52:25.545503+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:21.145420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539095+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544790+0000","last_change":"2023-10-06T02:52:25.544790+0000","last_active":"2023-10-06T02:52:25.544790+0000","last_peered":"2023-10-06T02:52:25.544790+0000","last_clean":"2023-10-06T02:52:25.544790+0000","last_became_active":"2023-10-06T02:52:25.544567+0000","last_became_peered":"2023-10-06T02:52:25.544567+0000","last_unstale":"2023-10-06T02:52:25.544790+0000","last_undegraded":"2023-10-06T02:52:25.544790+0000","last_fullsized":"2023-10-06T02:52:25.544790+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540356+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545963+0000","last_change":"2023-10-06T02:52:25.545963+0000","last_active":"2023-10-06T02:52:25.545963+0000","last_peered":"2023-10-06T02:52:25.545963+0000","last_clean":"2023-10-06T02:52:25.545963+0000","last_became_active":"2023-10-06T02:52:25.544613+0000","last_became_peered":"2023-10-06T02:52:25.544613+0000","last_unstale":"2023-10-06T02:52:25.545963+0000","last_undegraded":"2023-10-06T02:52:25.545963+0000","last_fullsized":"2023-10-06T02:52:25.545963+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:28.221311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537964+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544827+0000","last_change":"2023-10-06T02:52:25.544827+0000","last_active":"2023-10-06T02:52:25.544827+0000","last_peered":"2023-10-06T02:52:25.544827+0000","last_clean":"2023-10-06T02:52:25.544827+0000","last_became_active":"2023-10-06T02:52:25.544602+0000","last_became_peered":"2023-10-06T02:52:25.544602+0000","last_unstale":"2023-10-06T02:52:25.544827+0000","last_undegraded":"2023-10-06T02:52:25.544827+0000","last_fullsized":"2023-10-06T02:52:25.544827+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538561+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.542765+0000","last_change":"2023-10-06T02:52:25.542765+0000","last_active":"2023-10-06T02:52:25.542765+0000","last_peered":"2023-10-06T02:52:25.542765+0000","last_clean":"2023-10-06T02:52:25.542765+0000","last_became_active":"2023-10-06T02:52:25.542333+0000","last_became_peered":"2023-10-06T02:52:25.542333+0000","last_unstale":"2023-10-06T02:52:25.542765+0000","last_undegraded":"2023-10-06T02:52:25.542765+0000","last_fullsized":"2023-10-06T02:52:25.542765+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:48.265643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541050+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:18.233825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547169+0000","last_change":"2023-10-06T02:52:25.547169+0000","last_active":"2023-10-06T02:52:25.547169+0000","last_peered":"2023-10-06T02:52:25.547169+0000","last_clean":"2023-10-06T02:52:25.547169+0000","last_became_active":"2023-10-06T02:52:25.546959+0000","last_became_peered":"2023-10-06T02:52:25.546959+0000","last_unstale":"2023-10-06T02:52:25.547169+0000","last_undegraded":"2023-10-06T02:52:25.547169+0000","last_fullsized":"2023-10-06T02:52:25.547169+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537532+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:28.881920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.548463+0000","last_change":"2023-10-06T02:52:25.548463+0000","last_active":"2023-10-06T02:52:25.548463+0000","last_peered":"2023-10-06T02:52:25.548463+0000","last_clean":"2023-10-06T02:52:25.548463+0000","last_became_active":"2023-10-06T02:52:25.548237+0000","last_became_peered":"2023-10-06T02:52:25.548237+0000","last_unstale":"2023-10-06T02:52:25.548463+0000","last_undegraded":"2023-10-06T02:52:25.548463+0000","last_fullsized":"2023-10-06T02:52:25.548463+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538960+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:42.506920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545831+0000","last_change":"2023-10-06T02:52:25.545831+0000","last_active":"2023-10-06T02:52:25.545831+0000","last_peered":"2023-10-06T02:52:25.545831+0000","last_clean":"2023-10-06T02:52:25.545831+0000","last_became_active":"2023-10-06T02:52:25.544736+0000","last_became_peered":"2023-10-06T02:52:25.544736+0000","last_unstale":"2023-10-06T02:52:25.545831+0000","last_undegraded":"2023-10-06T02:52:25.545831+0000","last_fullsized":"2023-10-06T02:52:25.545831+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:04.384554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538103+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543505+0000","last_change":"2023-10-06T02:52:25.543505+0000","last_active":"2023-10-06T02:52:25.543505+0000","last_peered":"2023-10-06T02:52:25.543505+0000","last_clean":"2023-10-06T02:52:25.543505+0000","last_became_active":"2023-10-06T02:52:25.543320+0000","last_became_peered":"2023-10-06T02:52:25.543320+0000","last_unstale":"2023-10-06T02:52:25.543505+0000","last_undegraded":"2023-10-06T02:52:25.543505+0000","last_fullsized":"2023-10-06T02:52:25.543505+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538561+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.538954+0000","last_change":"2023-10-06T02:52:25.538954+0000","last_active":"2023-10-06T02:52:25.538954+0000","last_peered":"2023-10-06T02:52:25.538954+0000","last_clean":"2023-10-06T02:52:25.538954+0000","last_became_active":"2023-10-06T02:52:25.538719+0000","last_became_peered":"2023-10-06T02:52:25.538719+0000","last_unstale":"2023-10-06T02:52:25.538954+0000","last_undegraded":"2023-10-06T02:52:25.538954+0000","last_fullsized":"2023-10-06T02:52:25.538954+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537494+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:02.719347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545718+0000","last_change":"2023-10-06T02:52:25.545718+0000","last_active":"2023-10-06T02:52:25.545718+0000","last_peered":"2023-10-06T02:52:25.545718+0000","last_clean":"2023-10-06T02:52:25.545718+0000","last_became_active":"2023-10-06T02:52:25.545491+0000","last_became_peered":"2023-10-06T02:52:25.545491+0000","last_unstale":"2023-10-06T02:52:25.545718+0000","last_undegraded":"2023-10-06T02:52:25.545718+0000","last_fullsized":"2023-10-06T02:52:25.545718+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540677+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:37.422386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546086+0000","last_change":"2023-10-06T02:52:25.546086+0000","last_active":"2023-10-06T02:52:25.546086+0000","last_peered":"2023-10-06T02:52:25.546086+0000","last_clean":"2023-10-06T02:52:25.546086+0000","last_became_active":"2023-10-06T02:52:25.545594+0000","last_became_peered":"2023-10-06T02:52:25.545594+0000","last_unstale":"2023-10-06T02:52:25.546086+0000","last_undegraded":"2023-10-06T02:52:25.546086+0000","last_fullsized":"2023-10-06T02:52:25.546086+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:18.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539508+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547920+0000","last_change":"2023-10-06T02:52:25.547920+0000","last_active":"2023-10-06T02:52:25.547920+0000","last_peered":"2023-10-06T02:52:25.547920+0000","last_clean":"2023-10-06T02:52:25.547920+0000","last_became_active":"2023-10-06T02:52:25.547743+0000","last_became_peered":"2023-10-06T02:52:25.547743+0000","last_unstale":"2023-10-06T02:52:25.547920+0000","last_undegraded":"2023-10-06T02:52:25.547920+0000","last_fullsized":"2023-10-06T02:52:25.547920+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540664+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547752+0000","last_change":"2023-10-06T02:52:25.547752+0000","last_active":"2023-10-06T02:52:25.547752+0000","last_peered":"2023-10-06T02:52:25.547752+0000","last_clean":"2023-10-06T02:52:25.547752+0000","last_became_active":"2023-10-06T02:52:25.547526+0000","last_became_peered":"2023-10-06T02:52:25.547526+0000","last_unstale":"2023-10-06T02:52:25.547752+0000","last_undegraded":"2023-10-06T02:52:25.547752+0000","last_fullsized":"2023-10-06T02:52:25.547752+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:36.026761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540012+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:10.124283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545836+0000","last_change":"2023-10-06T02:52:25.545836+0000","last_active":"2023-10-06T02:52:25.545836+0000","last_peered":"2023-10-06T02:52:25.545836+0000","last_clean":"2023-10-06T02:52:25.545836+0000","last_became_active":"2023-10-06T02:52:25.544311+0000","last_became_peered":"2023-10-06T02:52:25.544311+0000","last_unstale":"2023-10-06T02:52:25.545836+0000","last_undegraded":"2023-10-06T02:52:25.545836+0000","last_fullsized":"2023-10-06T02:52:25.545836+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:51.912933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.542668+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:43.535260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545621+0000","last_change":"2023-10-06T02:52:25.545621+0000","last_active":"2023-10-06T02:52:25.545621+0000","last_peered":"2023-10-06T02:52:25.545621+0000","last_clean":"2023-10-06T02:52:25.545621+0000","last_became_active":"2023-10-06T02:52:25.545184+0000","last_became_peered":"2023-10-06T02:52:25.545184+0000","last_unstale":"2023-10-06T02:52:25.545621+0000","last_undegraded":"2023-10-06T02:52:25.545621+0000","last_fullsized":"2023-10-06T02:52:25.545621+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:08.888993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538770+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546929+0000","last_change":"2023-10-06T02:52:25.546929+0000","last_active":"2023-10-06T02:52:25.546929+0000","last_peered":"2023-10-06T02:52:25.546929+0000","last_clean":"2023-10-06T02:52:25.546929+0000","last_became_active":"2023-10-06T02:52:25.546386+0000","last_became_peered":"2023-10-06T02:52:25.546386+0000","last_unstale":"2023-10-06T02:52:25.546929+0000","last_undegraded":"2023-10-06T02:52:25.546929+0000","last_fullsized":"2023-10-06T02:52:25.546929+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:36.519223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539543+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545690+0000","last_change":"2023-10-06T02:52:25.545690+0000","last_active":"2023-10-06T02:52:25.545690+0000","last_peered":"2023-10-06T02:52:25.545690+0000","last_clean":"2023-10-06T02:52:25.545690+0000","last_became_active":"2023-10-06T02:52:25.544448+0000","last_became_peered":"2023-10-06T02:52:25.544448+0000","last_unstale":"2023-10-06T02:52:25.545690+0000","last_undegraded":"2023-10-06T02:52:25.545690+0000","last_fullsized":"2023-10-06T02:52:25.545690+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:52.270415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538048+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:02.719347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544210+0000","last_change":"2023-10-06T02:52:25.544210+0000","last_active":"2023-10-06T02:52:25.544210+0000","last_peered":"2023-10-06T02:52:25.544210+0000","last_clean":"2023-10-06T02:52:25.544210+0000","last_became_active":"2023-10-06T02:52:25.543966+0000","last_became_peered":"2023-10-06T02:52:25.543966+0000","last_unstale":"2023-10-06T02:52:25.544210+0000","last_undegraded":"2023-10-06T02:52:25.544210+0000","last_fullsized":"2023-10-06T02:52:25.544210+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540551+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543969+0000","last_change":"2023-10-06T02:52:25.543969+0000","last_active":"2023-10-06T02:52:25.543969+0000","last_peered":"2023-10-06T02:52:25.543969+0000","last_clean":"2023-10-06T02:52:25.543969+0000","last_became_active":"2023-10-06T02:52:25.543754+0000","last_became_peered":"2023-10-06T02:52:25.543754+0000","last_unstale":"2023-10-06T02:52:25.543969+0000","last_undegraded":"2023-10-06T02:52:25.543969+0000","last_fullsized":"2023-10-06T02:52:25.543969+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530277+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:52:24.530277+0000","last_peered":"2023-10-06T02:52:24.530277+0000","last_clean":"2023-10-06T02:52:24.530277+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:52:24.530277+0000","last_undegraded":"2023-10-06T02:52:24.530277+0000","last_fullsized":"2023-10-06T02:52:24.530277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539229+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:39:12.681495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544064+0000","last_change":"2023-10-06T02:52:25.544064+0000","last_active":"2023-10-06T02:52:25.544064+0000","last_peered":"2023-10-06T02:52:25.544064+0000","last_clean":"2023-10-06T02:52:25.544064+0000","last_became_active":"2023-10-06T02:52:25.543804+0000","last_became_peered":"2023-10-06T02:52:25.543804+0000","last_unstale":"2023-10-06T02:52:25.544064+0000","last_undegraded":"2023-10-06T02:52:25.544064+0000","last_fullsized":"2023-10-06T02:52:25.544064+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":122,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.529651+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:52:24.529651+0000","last_peered":"2023-10-06T02:52:24.529651+0000","last_clean":"2023-10-06T02:52:24.529651+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:52:24.529651+0000","last_undegraded":"2023-10-06T02:52:24.529651+0000","last_fullsized":"2023-10-06T02:52:24.529651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540031+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.538066+0000","last_change":"2023-10-06T02:52:25.538066+0000","last_active":"2023-10-06T02:52:25.538066+0000","last_peered":"2023-10-06T02:52:25.538066+0000","last_clean":"2023-10-06T02:52:25.538066+0000","last_became_active":"2023-10-06T02:52:25.537825+0000","last_became_peered":"2023-10-06T02:52:25.537825+0000","last_unstale":"2023-10-06T02:52:25.538066+0000","last_undegraded":"2023-10-06T02:52:25.538066+0000","last_fullsized":"2023-10-06T02:52:25.538066+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530954+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:52:24.530954+0000","last_peered":"2023-10-06T02:52:24.530954+0000","last_clean":"2023-10-06T02:52:24.530954+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:52:24.530954+0000","last_undegraded":"2023-10-06T02:52:24.530954+0000","last_fullsized":"2023-10-06T02:52:24.530954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539108+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543751+0000","last_change":"2023-10-06T02:52:25.543751+0000","last_active":"2023-10-06T02:52:25.543751+0000","last_peered":"2023-10-06T02:52:25.543751+0000","last_clean":"2023-10-06T02:52:25.543751+0000","last_became_active":"2023-10-06T02:52:25.543563+0000","last_became_peered":"2023-10-06T02:52:25.543563+0000","last_unstale":"2023-10-06T02:52:25.543751+0000","last_undegraded":"2023-10-06T02:52:25.543751+0000","last_fullsized":"2023-10-06T02:52:25.543751+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530727+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:52:24.530727+0000","last_peered":"2023-10-06T02:52:24.530727+0000","last_clean":"2023-10-06T02:52:24.530727+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:52:24.530727+0000","last_undegraded":"2023-10-06T02:52:24.530727+0000","last_fullsized":"2023-10-06T02:52:24.530727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":260,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531541+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:52:24.531541+0000","last_peered":"2023-10-06T02:52:24.531541+0000","last_clean":"2023-10-06T02:52:24.531541+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:52:24.531541+0000","last_undegraded":"2023-10-06T02:52:24.531541+0000","last_fullsized":"2023-10-06T02:52:24.531541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538931+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.541005+0000","last_change":"2023-10-06T02:52:25.541005+0000","last_active":"2023-10-06T02:52:25.541005+0000","last_peered":"2023-10-06T02:52:25.541005+0000","last_clean":"2023-10-06T02:52:25.541005+0000","last_became_active":"2023-10-06T02:52:25.540862+0000","last_became_peered":"2023-10-06T02:52:25.540862+0000","last_unstale":"2023-10-06T02:52:25.541005+0000","last_undegraded":"2023-10-06T02:52:25.541005+0000","last_fullsized":"2023-10-06T02:52:25.541005+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531456+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:52:24.531456+0000","last_peered":"2023-10-06T02:52:24.531456+0000","last_clean":"2023-10-06T02:52:24.531456+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:52:24.531456+0000","last_undegraded":"2023-10-06T02:52:24.531456+0000","last_fullsized":"2023-10-06T02:52:24.531456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537917+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546234+0000","last_change":"2023-10-06T02:52:25.546234+0000","last_active":"2023-10-06T02:52:25.546234+0000","last_peered":"2023-10-06T02:52:25.546234+0000","last_clean":"2023-10-06T02:52:25.546234+0000","last_became_active":"2023-10-06T02:52:25.545953+0000","last_became_peered":"2023-10-06T02:52:25.545953+0000","last_unstale":"2023-10-06T02:52:25.546234+0000","last_undegraded":"2023-10-06T02:52:25.546234+0000","last_fullsized":"2023-10-06T02:52:25.546234+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:42.320760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531644+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:52:24.531644+0000","last_peered":"2023-10-06T02:52:24.531644+0000","last_clean":"2023-10-06T02:52:24.531644+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:52:24.531644+0000","last_undegraded":"2023-10-06T02:52:24.531644+0000","last_fullsized":"2023-10-06T02:52:24.531644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537931+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546603+0000","last_change":"2023-10-06T02:52:25.546603+0000","last_active":"2023-10-06T02:52:25.546603+0000","last_peered":"2023-10-06T02:52:25.546603+0000","last_clean":"2023-10-06T02:52:25.546603+0000","last_became_active":"2023-10-06T02:52:25.546366+0000","last_became_peered":"2023-10-06T02:52:25.546366+0000","last_unstale":"2023-10-06T02:52:25.546603+0000","last_undegraded":"2023-10-06T02:52:25.546603+0000","last_fullsized":"2023-10-06T02:52:25.546603+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530278+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:52:24.530278+0000","last_peered":"2023-10-06T02:52:24.530278+0000","last_clean":"2023-10-06T02:52:24.530278+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:52:24.530278+0000","last_undegraded":"2023-10-06T02:52:24.530278+0000","last_fullsized":"2023-10-06T02:52:24.530278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537921+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543355+0000","last_change":"2023-10-06T02:52:25.543355+0000","last_active":"2023-10-06T02:52:25.543355+0000","last_peered":"2023-10-06T02:52:25.543355+0000","last_clean":"2023-10-06T02:52:25.543355+0000","last_became_active":"2023-10-06T02:52:25.543138+0000","last_became_peered":"2023-10-06T02:52:25.543138+0000","last_unstale":"2023-10-06T02:52:25.543355+0000","last_undegraded":"2023-10-06T02:52:25.543355+0000","last_fullsized":"2023-10-06T02:52:25.543355+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531363+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:52:24.531363+0000","last_peered":"2023-10-06T02:52:24.531363+0000","last_clean":"2023-10-06T02:52:24.531363+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:52:24.531363+0000","last_undegraded":"2023-10-06T02:52:24.531363+0000","last_fullsized":"2023-10-06T02:52:24.531363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193979,"statfs":{"total":200000000,"available":198634853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70799999999999996,"5min":0.80600000000000005,"15min":1.393},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.33800000000000002,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":1.5569999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.627,"5min":0.76400000000000001,"15min":1.081},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":1.4710000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.48699999999999999},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58899999999999997,"15min":0.63500000000000001},"min":{"1min":0.35899999999999999,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.65900000000000003,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.61199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.65700000000000003,"5min":3.0649999999999999,"15min":3.4870000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.58499999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.69999999999999996,"5min":0.97899999999999998,"15min":2.2349999999999999},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.498},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72599999999999998},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.879},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.751}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.44,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76300000000000001},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.60999999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64800000000000002,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.64100000000000001,"5min":0.75700000000000001,"15min":1.879},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53000000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67800000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53700000000000003,"15min":0.94599999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65700000000000003,"5min":0.80000000000000004,"15min":11.957000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.51000000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66900000000000004,"5min":1.042,"15min":1.0580000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.39400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69899999999999995,"5min":0.83399999999999996,"15min":0.95799999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.80100000000000005,"15min":1.163},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":1.05,"15min":1.05},"last":0.755},{"interface":"front","average":{"1min":0.501,"5min":0.498,"15min":0.56100000000000005},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48199999999999998,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.60199999999999998},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.61199999999999999},"min":{"1min":0.33600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.314,"15min":0.313},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.40799999999999997,"5min":0.501,"15min":0.501},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35199999999999998,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46300000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33300000000000002,"15min":0.32200000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.30399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.36299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.23400000000000001},"max":{"1min":0.42299999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.996,"15min":0.996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.43099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.53900000000000003},"min":{"1min":0.49399999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.434},{"interface":"front","average":{"1min":0.62,"5min":0.58699999999999997,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39000000000000001},"max":{"1min":0.71699999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60599999999999998,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.006},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.57399999999999995},"min":{"1min":0.54900000000000004,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":0.88200000000000001},"last":0.498}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193979,"statfs":{"total":200000000,"available":198634853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33100000000000002,"15min":0.34699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.45600000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.375,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":1.0389999999999999},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.188},"max":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":22.038},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":1.3779999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.36099999999999999},"min":{"1min":0.22,"5min":0.183,"15min":0.183},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":1.071},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.253},"max":{"1min":0.498,"5min":0.63300000000000001,"15min":21.942},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70499999999999996,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.75},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":1.1419999999999999},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.86499999999999999,"15min":11.122999999999999},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":1.2290000000000001},"min":{"1min":0.38400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71999999999999997,"5min":0.80200000000000005,"15min":22.010999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.69799999999999995,"5min":0.83899999999999997,"15min":1.401},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":1.171},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73499999999999999,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":1.254},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.84799999999999998,"15min":21.98},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.70899999999999996,"5min":0.91000000000000003,"15min":1.425},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.90300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.71999999999999997,"5min":0.81899999999999995,"15min":11.154},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"min":{"1min":0.215,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.41799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.316,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.24099999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.40200000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.39800000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.41699999999999998,"15min":0.38900000000000001},"min":{"1min":0.315,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.47499999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39400000000000002,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.499,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.314},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51300000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.056,"15min":1.056},"last":0.754},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81599999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.628,"15min":0.59199999999999997},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83399999999999996,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.56000000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68700000000000006,"5min":1.002,"15min":1.002},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60799999999999998,"15min":0.58699999999999997},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.86499999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.318,"15min":0.307},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.439,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.37,"15min":0.33300000000000002},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.56999999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.24399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.35299999999999998,"15min":0.33000000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.45100000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.378,"15min":0.34799999999999998},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.58499999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41199999999999998,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.65900000000000003,"5min":3.044,"15min":3.044},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.249},"max":{"1min":0.45100000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.26400000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.446,"5min":1.446,"15min":2.2120000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.327,"5min":1.327,"15min":2.25},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58599999999999997,"15min":0.68799999999999994},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.5}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.44500000000000001,"15min":0.38600000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.94099999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.442,"5min":0.372,"15min":0.372},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.5,"15min":0.78100000000000003},"min":{"1min":0.39600000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.62},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.221},"max":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52100000000000002,"15min":0.81299999999999994},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65900000000000003,"5min":0.70599999999999996,"15min":5.9329999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52000000000000002,"15min":0.76700000000000002},"min":{"1min":0.373,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.67800000000000005,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.75900000000000001,"15min":5.4390000000000001},"last":0.623},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.67100000000000004},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.61199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.77000000000000002,"15min":3.456},"last":0.499}]},{"osd":5,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.245},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.59699999999999998,"15min":1.0069999999999999},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":13.173999999999999},"last":0.64700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.69399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.27400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.41599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.6269999999999998,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.32700000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.63800000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68000000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71999999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73499999999999999,"5min":0.879,"15min":0.879},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.47599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.74299999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.81799999999999995}]}]}],"pool_statfs":[]}} 2023-10-06T02:52:30.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:52:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.124+0000 7f1291d33700 1 Processor -- start 2023-10-06T02:52:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.124+0000 7f1291d33700 1 -- start start 2023-10-06T02:52:31.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.125+0000 7f1291d33700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c157ca0 0x7f128c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.125+0000 7f1291d33700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c0d07c0 con 0x7f128c1578d0 2023-10-06T02:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.125+0000 7f1291d33700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c0cfbb0 con 0x7f128c06d120 2023-10-06T02:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.125+0000 7f1291d33700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0cfe90 con 0x7f128c157ca0 2023-10-06T02:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.125+0000 7f128b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f128c1578d0 0x7f128c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54214/0 (socket says 172.21.15.81:54214) 2023-10-06T02:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.125+0000 7f128b7fe700 1 -- 172.21.15.81:0/3508039071 learned_addr learned my addr 172.21.15.81:0/3508039071 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.125+0000 7f128affd700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c157ca0 0x7f128c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.125+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263427345 0 0) 0x7f128c0d07c0 con 0x7f128c1578d0 2023-10-06T02:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1274003570 con 0x7f128c1578d0 2023-10-06T02:52:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176459653 0 0) 0x7f128c0cfbb0 con 0x7f128c06d120 2023-10-06T02:52:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f128c0d07c0 con 0x7f128c06d120 2023-10-06T02:52:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308613115 0 0) 0x7f1274003570 con 0x7f128c1578d0 2023-10-06T02:52:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c157ca0 msgr2=0x7f128c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c157ca0 0x7f128c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 >> v1:172.21.15.83:6789/0 conn(0x7f128c06d120 legacy=0x7f128c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0d0170 con 0x7f128c1578d0 2023-10-06T02:52:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f127c0017f0 con 0x7f128c1578d0 2023-10-06T02:52:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 >> v1:172.21.15.81:6789/0 conn(0x7f128c1578d0 legacy=0x7f128c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c157ca0 0x7f1274003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1274004180 0x7f1274004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1274004d50 0x7f12740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0cfe90 con 0x7f1274004d50 2023-10-06T02:52:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127400bba0 con 0x7f1274004180 2023-10-06T02:52:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127400bd60 con 0x7f128c157ca0 2023-10-06T02:52:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128bfff700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1274004d50 0x7f12740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128b7fe700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c157ca0 0x7f1274003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128affd700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1274004180 0x7f1274004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128bfff700 1 -- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c157ca0 msgr2=0x7f1274003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128bfff700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c157ca0 0x7f1274003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128bfff700 1 -- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1274004180 msgr2=0x7f1274004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128bfff700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1274004180 0x7f1274004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128bfff700 1 -- 172.21.15.81:0/3508039071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274003570 con 0x7f1274004d50 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128b7fe700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c157ca0 0x7f1274003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128affd700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1274004180 0x7f1274004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128bfff700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1274004d50 0x7f12740051c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1284001a10 tx=0x7f1284007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df98dd3c5b695ed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128400c5d0 con 0x7f1274004d50 2023-10-06T02:52:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128400c730 con 0x7f1274004d50 2023-10-06T02:52:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.126+0000 7f128a7fc700 1 -- 172.21.15.81:0/3508039071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128400cad0 con 0x7f1274004d50 2023-10-06T02:52:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.127+0000 7f1291d33700 1 -- 172.21.15.81:0/3508039071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1274004d50 msgr2=0x7f12740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.127+0000 7f1291d33700 1 --2- 172.21.15.81:0/3508039071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1274004d50 0x7f12740051c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1284001a10 tx=0x7f1284007d30 comp rx=0 tx=0).stop 2023-10-06T02:52:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.127+0000 7f128bfff700 1 -- 172.21.15.81:0/3508039071 reap_dead start 2023-10-06T02:52:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.127+0000 7f1291d33700 1 -- 172.21.15.81:0/3508039071 shutdown_connections 2023-10-06T02:52:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.127+0000 7f1291d33700 1 -- 172.21.15.81:0/3508039071 >> 172.21.15.81:0/3508039071 conn(0x7f128c06bb90 msgr2=0x7f128c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.127+0000 7f1291d33700 1 -- 172.21.15.81:0/3508039071 shutdown_connections 2023-10-06T02:52:31.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.127+0000 7f1291d33700 1 -- 172.21.15.81:0/3508039071 wait complete. 2023-10-06T02:52:31.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.128+0000 7f1291d33700 1 Processor -- start 2023-10-06T02:52:31.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.128+0000 7f1291d33700 1 -- start start 2023-10-06T02:52:31.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f1291d33700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c0cd440 0x7f128c0c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f1291d33700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c0c71d0 0x7f128c0b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f1291d33700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f128c0b5020 0x7f128c0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f1291d33700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0c7640 con 0x7f128c0c71d0 2023-10-06T02:52:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f1291d33700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0b6470 con 0x7f128c0b5020 2023-10-06T02:52:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f1291d33700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0b5860 con 0x7f128c0cd440 2023-10-06T02:52:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f128affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c0c71d0 0x7f128c0b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f128affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c0c71d0 0x7f128c0b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55818/0 (socket says 172.21.15.81:55818) 2023-10-06T02:52:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f128affd700 1 -- 172.21.15.81:0/1011201666 learned_addr learned my addr 172.21.15.81:0/1011201666 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f128affd700 1 -- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c0cd440 msgr2=0x7f128c0c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f128affd700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c0cd440 0x7f128c0c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f128affd700 1 -- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f128c0b5020 msgr2=0x7f128c0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f128affd700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f128c0b5020 0x7f128c0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f128affd700 1 -- 172.21.15.81:0/1011201666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0b5b40 con 0x7f128c0c71d0 2023-10-06T02:52:31.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.129+0000 7f128affd700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c0c71d0 0x7f128c0b4ae0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f1280011960 tx=0x7f1280008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:31.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.130+0000 7f12737fe700 1 -- 172.21.15.81:0/1011201666 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280011ea0 con 0x7f128c0c71d0 2023-10-06T02:52:31.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.130+0000 7f12737fe700 1 -- 172.21.15.81:0/1011201666 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128000f8e0 con 0x7f128c0c71d0 2023-10-06T02:52:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.130+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c0b5e20 con 0x7f128c0c71d0 2023-10-06T02:52:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.130+0000 7f12737fe700 1 -- 172.21.15.81:0/1011201666 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000fc60 con 0x7f128c0c71d0 2023-10-06T02:52:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.130+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c0cd810 con 0x7f128c0c71d0 2023-10-06T02:52:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.131+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c0b6750 con 0x7f128c0c71d0 2023-10-06T02:52:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.131+0000 7f12737fe700 1 -- 172.21.15.81:0/1011201666 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1280015460 con 0x7f128c0c71d0 2023-10-06T02:52:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.131+0000 7f12737fe700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1278066f30 0x7f12780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.131+0000 7f12737fe700 1 -- 172.21.15.81:0/1011201666 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1280084e60 con 0x7f128c0c71d0 2023-10-06T02:52:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.132+0000 7f128b7fe700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1278066f30 0x7f12780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.132+0000 7f128b7fe700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1278066f30 0x7f12780693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f127c002250 tx=0x7f128c15b610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:31.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.135+0000 7f12737fe700 1 -- 172.21.15.81:0/1011201666 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1280051f70 con 0x7f128c0c71d0 2023-10-06T02:52:31.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.313+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f128c0b65e0 con 0x7f1278066f30 2023-10-06T02:52:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.323+0000 7f12737fe700 1 -- 172.21.15.81:0/1011201666 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302895 (secure 0 0 0) 0x7f128c0b65e0 con 0x7f1278066f30 2023-10-06T02:52:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1278066f30 msgr2=0x7f12780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1278066f30 0x7f12780693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f127c002250 tx=0x7f128c15b610 comp rx=0 tx=0).stop 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c0c71d0 msgr2=0x7f128c0b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c0c71d0 0x7f128c0b4ae0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f1280011960 tx=0x7f1280008040 comp rx=0 tx=0).stop 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 shutdown_connections 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1278066f30 0x7f12780693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f128c0b5020 0x7f128c0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f128c0cd440 0x7f128c0c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 --2- 172.21.15.81:0/1011201666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c0c71d0 0x7f128c0b4ae0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 >> 172.21.15.81:0/1011201666 conn(0x7f128c06bb90 msgr2=0x7f128c1558a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 shutdown_connections 2023-10-06T02:52:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.326+0000 7f1291d33700 1 -- 172.21.15.81:0/1011201666 wait complete. 2023-10-06T02:52:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:52:31.340 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2023-10-06T02:52:29.583639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7206,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555293,"statfs":{"total":1600000000,"available":1592621032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.055424"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539241+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538356+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540065+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538781+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539863+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539659+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:52.861165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541510+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:01.855585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539739+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:24.087056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538422+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539461+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:28.881920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538906+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541170+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:16.893240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538006+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:28.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538906+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539501+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539319+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:46.119876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540686+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539438+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540910+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540044+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:33.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539044+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541689+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541381+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.544340+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.542721+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539567+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.070249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539411+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.543794+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:28.700897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538818+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:49.401503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538453+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.543118+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.543527+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541485+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544754+0000","last_change":"2023-10-06T02:52:25.544754+0000","last_active":"2023-10-06T02:52:25.544754+0000","last_peered":"2023-10-06T02:52:25.544754+0000","last_clean":"2023-10-06T02:52:25.544754+0000","last_became_active":"2023-10-06T02:52:25.544522+0000","last_became_peered":"2023-10-06T02:52:25.544522+0000","last_unstale":"2023-10-06T02:52:25.544754+0000","last_undegraded":"2023-10-06T02:52:25.544754+0000","last_fullsized":"2023-10-06T02:52:25.544754+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:27.128855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541374+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:44.465768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.542191+0000","last_change":"2023-10-06T02:52:25.542191+0000","last_active":"2023-10-06T02:52:25.542191+0000","last_peered":"2023-10-06T02:52:25.542191+0000","last_clean":"2023-10-06T02:52:25.542191+0000","last_became_active":"2023-10-06T02:52:25.541967+0000","last_became_peered":"2023-10-06T02:52:25.541967+0000","last_unstale":"2023-10-06T02:52:25.542191+0000","last_undegraded":"2023-10-06T02:52:25.542191+0000","last_fullsized":"2023-10-06T02:52:25.542191+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537999+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545738+0000","last_change":"2023-10-06T02:52:25.545738+0000","last_active":"2023-10-06T02:52:25.545738+0000","last_peered":"2023-10-06T02:52:25.545738+0000","last_clean":"2023-10-06T02:52:25.545738+0000","last_became_active":"2023-10-06T02:52:25.545482+0000","last_became_peered":"2023-10-06T02:52:25.545482+0000","last_unstale":"2023-10-06T02:52:25.545738+0000","last_undegraded":"2023-10-06T02:52:25.545738+0000","last_fullsized":"2023-10-06T02:52:25.545738+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541022+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543504+0000","last_change":"2023-10-06T02:52:25.543504+0000","last_active":"2023-10-06T02:52:25.543504+0000","last_peered":"2023-10-06T02:52:25.543504+0000","last_clean":"2023-10-06T02:52:25.543504+0000","last_became_active":"2023-10-06T02:52:25.543294+0000","last_became_peered":"2023-10-06T02:52:25.543294+0000","last_unstale":"2023-10-06T02:52:25.543504+0000","last_undegraded":"2023-10-06T02:52:25.543504+0000","last_fullsized":"2023-10-06T02:52:25.543504+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.015668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537876+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:37.035449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547100+0000","last_change":"2023-10-06T02:52:25.547100+0000","last_active":"2023-10-06T02:52:25.547100+0000","last_peered":"2023-10-06T02:52:25.547100+0000","last_clean":"2023-10-06T02:52:25.547100+0000","last_became_active":"2023-10-06T02:52:25.546711+0000","last_became_peered":"2023-10-06T02:52:25.546711+0000","last_unstale":"2023-10-06T02:52:25.547100+0000","last_undegraded":"2023-10-06T02:52:25.547100+0000","last_fullsized":"2023-10-06T02:52:25.547100+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:55.222375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539450+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545503+0000","last_change":"2023-10-06T02:52:25.545503+0000","last_active":"2023-10-06T02:52:25.545503+0000","last_peered":"2023-10-06T02:52:25.545503+0000","last_clean":"2023-10-06T02:52:25.545503+0000","last_became_active":"2023-10-06T02:52:25.543328+0000","last_became_peered":"2023-10-06T02:52:25.543328+0000","last_unstale":"2023-10-06T02:52:25.545503+0000","last_undegraded":"2023-10-06T02:52:25.545503+0000","last_fullsized":"2023-10-06T02:52:25.545503+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:21.145420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539095+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544790+0000","last_change":"2023-10-06T02:52:25.544790+0000","last_active":"2023-10-06T02:52:25.544790+0000","last_peered":"2023-10-06T02:52:25.544790+0000","last_clean":"2023-10-06T02:52:25.544790+0000","last_became_active":"2023-10-06T02:52:25.544567+0000","last_became_peered":"2023-10-06T02:52:25.544567+0000","last_unstale":"2023-10-06T02:52:25.544790+0000","last_undegraded":"2023-10-06T02:52:25.544790+0000","last_fullsized":"2023-10-06T02:52:25.544790+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540356+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545963+0000","last_change":"2023-10-06T02:52:25.545963+0000","last_active":"2023-10-06T02:52:25.545963+0000","last_peered":"2023-10-06T02:52:25.545963+0000","last_clean":"2023-10-06T02:52:25.545963+0000","last_became_active":"2023-10-06T02:52:25.544613+0000","last_became_peered":"2023-10-06T02:52:25.544613+0000","last_unstale":"2023-10-06T02:52:25.545963+0000","last_undegraded":"2023-10-06T02:52:25.545963+0000","last_fullsized":"2023-10-06T02:52:25.545963+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:28.221311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537964+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544827+0000","last_change":"2023-10-06T02:52:25.544827+0000","last_active":"2023-10-06T02:52:25.544827+0000","last_peered":"2023-10-06T02:52:25.544827+0000","last_clean":"2023-10-06T02:52:25.544827+0000","last_became_active":"2023-10-06T02:52:25.544602+0000","last_became_peered":"2023-10-06T02:52:25.544602+0000","last_unstale":"2023-10-06T02:52:25.544827+0000","last_undegraded":"2023-10-06T02:52:25.544827+0000","last_fullsized":"2023-10-06T02:52:25.544827+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538561+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.542765+0000","last_change":"2023-10-06T02:52:25.542765+0000","last_active":"2023-10-06T02:52:25.542765+0000","last_peered":"2023-10-06T02:52:25.542765+0000","last_clean":"2023-10-06T02:52:25.542765+0000","last_became_active":"2023-10-06T02:52:25.542333+0000","last_became_peered":"2023-10-06T02:52:25.542333+0000","last_unstale":"2023-10-06T02:52:25.542765+0000","last_undegraded":"2023-10-06T02:52:25.542765+0000","last_fullsized":"2023-10-06T02:52:25.542765+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:48.265643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.541050+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:18.233825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547169+0000","last_change":"2023-10-06T02:52:25.547169+0000","last_active":"2023-10-06T02:52:25.547169+0000","last_peered":"2023-10-06T02:52:25.547169+0000","last_clean":"2023-10-06T02:52:25.547169+0000","last_became_active":"2023-10-06T02:52:25.546959+0000","last_became_peered":"2023-10-06T02:52:25.546959+0000","last_unstale":"2023-10-06T02:52:25.547169+0000","last_undegraded":"2023-10-06T02:52:25.547169+0000","last_fullsized":"2023-10-06T02:52:25.547169+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537532+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:28.881920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.548463+0000","last_change":"2023-10-06T02:52:25.548463+0000","last_active":"2023-10-06T02:52:25.548463+0000","last_peered":"2023-10-06T02:52:25.548463+0000","last_clean":"2023-10-06T02:52:25.548463+0000","last_became_active":"2023-10-06T02:52:25.548237+0000","last_became_peered":"2023-10-06T02:52:25.548237+0000","last_unstale":"2023-10-06T02:52:25.548463+0000","last_undegraded":"2023-10-06T02:52:25.548463+0000","last_fullsized":"2023-10-06T02:52:25.548463+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538960+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:42.506920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545831+0000","last_change":"2023-10-06T02:52:25.545831+0000","last_active":"2023-10-06T02:52:25.545831+0000","last_peered":"2023-10-06T02:52:25.545831+0000","last_clean":"2023-10-06T02:52:25.545831+0000","last_became_active":"2023-10-06T02:52:25.544736+0000","last_became_peered":"2023-10-06T02:52:25.544736+0000","last_unstale":"2023-10-06T02:52:25.545831+0000","last_undegraded":"2023-10-06T02:52:25.545831+0000","last_fullsized":"2023-10-06T02:52:25.545831+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:04.384554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538103+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543505+0000","last_change":"2023-10-06T02:52:25.543505+0000","last_active":"2023-10-06T02:52:25.543505+0000","last_peered":"2023-10-06T02:52:25.543505+0000","last_clean":"2023-10-06T02:52:25.543505+0000","last_became_active":"2023-10-06T02:52:25.543320+0000","last_became_peered":"2023-10-06T02:52:25.543320+0000","last_unstale":"2023-10-06T02:52:25.543505+0000","last_undegraded":"2023-10-06T02:52:25.543505+0000","last_fullsized":"2023-10-06T02:52:25.543505+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538561+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.538954+0000","last_change":"2023-10-06T02:52:25.538954+0000","last_active":"2023-10-06T02:52:25.538954+0000","last_peered":"2023-10-06T02:52:25.538954+0000","last_clean":"2023-10-06T02:52:25.538954+0000","last_became_active":"2023-10-06T02:52:25.538719+0000","last_became_peered":"2023-10-06T02:52:25.538719+0000","last_unstale":"2023-10-06T02:52:25.538954+0000","last_undegraded":"2023-10-06T02:52:25.538954+0000","last_fullsized":"2023-10-06T02:52:25.538954+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537494+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:02.719347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545718+0000","last_change":"2023-10-06T02:52:25.545718+0000","last_active":"2023-10-06T02:52:25.545718+0000","last_peered":"2023-10-06T02:52:25.545718+0000","last_clean":"2023-10-06T02:52:25.545718+0000","last_became_active":"2023-10-06T02:52:25.545491+0000","last_became_peered":"2023-10-06T02:52:25.545491+0000","last_unstale":"2023-10-06T02:52:25.545718+0000","last_undegraded":"2023-10-06T02:52:25.545718+0000","last_fullsized":"2023-10-06T02:52:25.545718+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540677+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:37.422386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546086+0000","last_change":"2023-10-06T02:52:25.546086+0000","last_active":"2023-10-06T02:52:25.546086+0000","last_peered":"2023-10-06T02:52:25.546086+0000","last_clean":"2023-10-06T02:52:25.546086+0000","last_became_active":"2023-10-06T02:52:25.545594+0000","last_became_peered":"2023-10-06T02:52:25.545594+0000","last_unstale":"2023-10-06T02:52:25.546086+0000","last_undegraded":"2023-10-06T02:52:25.546086+0000","last_fullsized":"2023-10-06T02:52:25.546086+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:18.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539508+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547920+0000","last_change":"2023-10-06T02:52:25.547920+0000","last_active":"2023-10-06T02:52:25.547920+0000","last_peered":"2023-10-06T02:52:25.547920+0000","last_clean":"2023-10-06T02:52:25.547920+0000","last_became_active":"2023-10-06T02:52:25.547743+0000","last_became_peered":"2023-10-06T02:52:25.547743+0000","last_unstale":"2023-10-06T02:52:25.547920+0000","last_undegraded":"2023-10-06T02:52:25.547920+0000","last_fullsized":"2023-10-06T02:52:25.547920+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540664+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.547752+0000","last_change":"2023-10-06T02:52:25.547752+0000","last_active":"2023-10-06T02:52:25.547752+0000","last_peered":"2023-10-06T02:52:25.547752+0000","last_clean":"2023-10-06T02:52:25.547752+0000","last_became_active":"2023-10-06T02:52:25.547526+0000","last_became_peered":"2023-10-06T02:52:25.547526+0000","last_unstale":"2023-10-06T02:52:25.547752+0000","last_undegraded":"2023-10-06T02:52:25.547752+0000","last_fullsized":"2023-10-06T02:52:25.547752+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:36.026761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540012+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:10.124283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545836+0000","last_change":"2023-10-06T02:52:25.545836+0000","last_active":"2023-10-06T02:52:25.545836+0000","last_peered":"2023-10-06T02:52:25.545836+0000","last_clean":"2023-10-06T02:52:25.545836+0000","last_became_active":"2023-10-06T02:52:25.544311+0000","last_became_peered":"2023-10-06T02:52:25.544311+0000","last_unstale":"2023-10-06T02:52:25.545836+0000","last_undegraded":"2023-10-06T02:52:25.545836+0000","last_fullsized":"2023-10-06T02:52:25.545836+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:51.912933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.542668+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:43.535260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545621+0000","last_change":"2023-10-06T02:52:25.545621+0000","last_active":"2023-10-06T02:52:25.545621+0000","last_peered":"2023-10-06T02:52:25.545621+0000","last_clean":"2023-10-06T02:52:25.545621+0000","last_became_active":"2023-10-06T02:52:25.545184+0000","last_became_peered":"2023-10-06T02:52:25.545184+0000","last_unstale":"2023-10-06T02:52:25.545621+0000","last_undegraded":"2023-10-06T02:52:25.545621+0000","last_fullsized":"2023-10-06T02:52:25.545621+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:08.888993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538770+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546929+0000","last_change":"2023-10-06T02:52:25.546929+0000","last_active":"2023-10-06T02:52:25.546929+0000","last_peered":"2023-10-06T02:52:25.546929+0000","last_clean":"2023-10-06T02:52:25.546929+0000","last_became_active":"2023-10-06T02:52:25.546386+0000","last_became_peered":"2023-10-06T02:52:25.546386+0000","last_unstale":"2023-10-06T02:52:25.546929+0000","last_undegraded":"2023-10-06T02:52:25.546929+0000","last_fullsized":"2023-10-06T02:52:25.546929+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:36.519223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539543+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.545690+0000","last_change":"2023-10-06T02:52:25.545690+0000","last_active":"2023-10-06T02:52:25.545690+0000","last_peered":"2023-10-06T02:52:25.545690+0000","last_clean":"2023-10-06T02:52:25.545690+0000","last_became_active":"2023-10-06T02:52:25.544448+0000","last_became_peered":"2023-10-06T02:52:25.544448+0000","last_unstale":"2023-10-06T02:52:25.545690+0000","last_undegraded":"2023-10-06T02:52:25.545690+0000","last_fullsized":"2023-10-06T02:52:25.545690+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:52.270415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538048+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:02.719347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544210+0000","last_change":"2023-10-06T02:52:25.544210+0000","last_active":"2023-10-06T02:52:25.544210+0000","last_peered":"2023-10-06T02:52:25.544210+0000","last_clean":"2023-10-06T02:52:25.544210+0000","last_became_active":"2023-10-06T02:52:25.543966+0000","last_became_peered":"2023-10-06T02:52:25.543966+0000","last_unstale":"2023-10-06T02:52:25.544210+0000","last_undegraded":"2023-10-06T02:52:25.544210+0000","last_fullsized":"2023-10-06T02:52:25.544210+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540551+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543969+0000","last_change":"2023-10-06T02:52:25.543969+0000","last_active":"2023-10-06T02:52:25.543969+0000","last_peered":"2023-10-06T02:52:25.543969+0000","last_clean":"2023-10-06T02:52:25.543969+0000","last_became_active":"2023-10-06T02:52:25.543754+0000","last_became_peered":"2023-10-06T02:52:25.543754+0000","last_unstale":"2023-10-06T02:52:25.543969+0000","last_undegraded":"2023-10-06T02:52:25.543969+0000","last_fullsized":"2023-10-06T02:52:25.543969+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530277+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:52:24.530277+0000","last_peered":"2023-10-06T02:52:24.530277+0000","last_clean":"2023-10-06T02:52:24.530277+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:52:24.530277+0000","last_undegraded":"2023-10-06T02:52:24.530277+0000","last_fullsized":"2023-10-06T02:52:24.530277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539229+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:39:12.681495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.544064+0000","last_change":"2023-10-06T02:52:25.544064+0000","last_active":"2023-10-06T02:52:25.544064+0000","last_peered":"2023-10-06T02:52:25.544064+0000","last_clean":"2023-10-06T02:52:25.544064+0000","last_became_active":"2023-10-06T02:52:25.543804+0000","last_became_peered":"2023-10-06T02:52:25.543804+0000","last_unstale":"2023-10-06T02:52:25.544064+0000","last_undegraded":"2023-10-06T02:52:25.544064+0000","last_fullsized":"2023-10-06T02:52:25.544064+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":122,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.529651+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:52:24.529651+0000","last_peered":"2023-10-06T02:52:24.529651+0000","last_clean":"2023-10-06T02:52:24.529651+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:52:24.529651+0000","last_undegraded":"2023-10-06T02:52:24.529651+0000","last_fullsized":"2023-10-06T02:52:24.529651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.540031+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.538066+0000","last_change":"2023-10-06T02:52:25.538066+0000","last_active":"2023-10-06T02:52:25.538066+0000","last_peered":"2023-10-06T02:52:25.538066+0000","last_clean":"2023-10-06T02:52:25.538066+0000","last_became_active":"2023-10-06T02:52:25.537825+0000","last_became_peered":"2023-10-06T02:52:25.537825+0000","last_unstale":"2023-10-06T02:52:25.538066+0000","last_undegraded":"2023-10-06T02:52:25.538066+0000","last_fullsized":"2023-10-06T02:52:25.538066+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530954+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:52:24.530954+0000","last_peered":"2023-10-06T02:52:24.530954+0000","last_clean":"2023-10-06T02:52:24.530954+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:52:24.530954+0000","last_undegraded":"2023-10-06T02:52:24.530954+0000","last_fullsized":"2023-10-06T02:52:24.530954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.539108+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543751+0000","last_change":"2023-10-06T02:52:25.543751+0000","last_active":"2023-10-06T02:52:25.543751+0000","last_peered":"2023-10-06T02:52:25.543751+0000","last_clean":"2023-10-06T02:52:25.543751+0000","last_became_active":"2023-10-06T02:52:25.543563+0000","last_became_peered":"2023-10-06T02:52:25.543563+0000","last_unstale":"2023-10-06T02:52:25.543751+0000","last_undegraded":"2023-10-06T02:52:25.543751+0000","last_fullsized":"2023-10-06T02:52:25.543751+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530727+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:52:24.530727+0000","last_peered":"2023-10-06T02:52:24.530727+0000","last_clean":"2023-10-06T02:52:24.530727+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:52:24.530727+0000","last_undegraded":"2023-10-06T02:52:24.530727+0000","last_fullsized":"2023-10-06T02:52:24.530727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":260,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531541+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:52:24.531541+0000","last_peered":"2023-10-06T02:52:24.531541+0000","last_clean":"2023-10-06T02:52:24.531541+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:52:24.531541+0000","last_undegraded":"2023-10-06T02:52:24.531541+0000","last_fullsized":"2023-10-06T02:52:24.531541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.538931+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.541005+0000","last_change":"2023-10-06T02:52:25.541005+0000","last_active":"2023-10-06T02:52:25.541005+0000","last_peered":"2023-10-06T02:52:25.541005+0000","last_clean":"2023-10-06T02:52:25.541005+0000","last_became_active":"2023-10-06T02:52:25.540862+0000","last_became_peered":"2023-10-06T02:52:25.540862+0000","last_unstale":"2023-10-06T02:52:25.541005+0000","last_undegraded":"2023-10-06T02:52:25.541005+0000","last_fullsized":"2023-10-06T02:52:25.541005+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531456+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:52:24.531456+0000","last_peered":"2023-10-06T02:52:24.531456+0000","last_clean":"2023-10-06T02:52:24.531456+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:52:24.531456+0000","last_undegraded":"2023-10-06T02:52:24.531456+0000","last_fullsized":"2023-10-06T02:52:24.531456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537917+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546234+0000","last_change":"2023-10-06T02:52:25.546234+0000","last_active":"2023-10-06T02:52:25.546234+0000","last_peered":"2023-10-06T02:52:25.546234+0000","last_clean":"2023-10-06T02:52:25.546234+0000","last_became_active":"2023-10-06T02:52:25.545953+0000","last_became_peered":"2023-10-06T02:52:25.545953+0000","last_unstale":"2023-10-06T02:52:25.546234+0000","last_undegraded":"2023-10-06T02:52:25.546234+0000","last_fullsized":"2023-10-06T02:52:25.546234+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:42.320760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531644+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:52:24.531644+0000","last_peered":"2023-10-06T02:52:24.531644+0000","last_clean":"2023-10-06T02:52:24.531644+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:52:24.531644+0000","last_undegraded":"2023-10-06T02:52:24.531644+0000","last_fullsized":"2023-10-06T02:52:24.531644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537931+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.546603+0000","last_change":"2023-10-06T02:52:25.546603+0000","last_active":"2023-10-06T02:52:25.546603+0000","last_peered":"2023-10-06T02:52:25.546603+0000","last_clean":"2023-10-06T02:52:25.546603+0000","last_became_active":"2023-10-06T02:52:25.546366+0000","last_became_peered":"2023-10-06T02:52:25.546366+0000","last_unstale":"2023-10-06T02:52:25.546603+0000","last_undegraded":"2023-10-06T02:52:25.546603+0000","last_fullsized":"2023-10-06T02:52:25.546603+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.530278+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:52:24.530278+0000","last_peered":"2023-10-06T02:52:24.530278+0000","last_clean":"2023-10-06T02:52:24.530278+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:52:24.530278+0000","last_undegraded":"2023-10-06T02:52:24.530278+0000","last_fullsized":"2023-10-06T02:52:24.530278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:52:25.527619+0000","last_change":"2023-10-06T02:52:25.537921+0000","last_active":"2023-10-06T02:52:25.527619+0000","last_peered":"2023-10-06T02:52:25.527619+0000","last_clean":"2023-10-06T02:52:25.527619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:52:25.527619+0000","last_undegraded":"2023-10-06T02:52:25.527619+0000","last_fullsized":"2023-10-06T02:52:25.527619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T02:52:25.543355+0000","last_change":"2023-10-06T02:52:25.543355+0000","last_active":"2023-10-06T02:52:25.543355+0000","last_peered":"2023-10-06T02:52:25.543355+0000","last_clean":"2023-10-06T02:52:25.543355+0000","last_became_active":"2023-10-06T02:52:25.543138+0000","last_became_peered":"2023-10-06T02:52:25.543138+0000","last_unstale":"2023-10-06T02:52:25.543355+0000","last_undegraded":"2023-10-06T02:52:25.543355+0000","last_fullsized":"2023-10-06T02:52:25.543355+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-10-06T02:52:24.531363+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:52:24.531363+0000","last_peered":"2023-10-06T02:52:24.531363+0000","last_clean":"2023-10-06T02:52:24.531363+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:52:24.531363+0000","last_undegraded":"2023-10-06T02:52:24.531363+0000","last_fullsized":"2023-10-06T02:52:24.531363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193979,"statfs":{"total":200000000,"available":198634853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70799999999999996,"5min":0.80600000000000005,"15min":1.393},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.33800000000000002,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":1.5569999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.627,"5min":0.76400000000000001,"15min":1.081},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":1.4710000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.48699999999999999},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58899999999999997,"15min":0.63500000000000001},"min":{"1min":0.35899999999999999,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.65900000000000003,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.61199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.65700000000000003,"5min":3.0649999999999999,"15min":3.4870000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.58499999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.69999999999999996,"5min":0.97899999999999998,"15min":2.2349999999999999},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.498},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72599999999999998},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.879},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.751}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.44,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76300000000000001},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.60999999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64800000000000002,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.64100000000000001,"5min":0.75700000000000001,"15min":1.879},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53000000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67800000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53700000000000003,"15min":0.94599999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65700000000000003,"5min":0.80000000000000004,"15min":11.957000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.51000000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66900000000000004,"5min":1.042,"15min":1.0580000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.39400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69899999999999995,"5min":0.83399999999999996,"15min":0.95799999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.80100000000000005,"15min":1.163},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":1.05,"15min":1.05},"last":0.755},{"interface":"front","average":{"1min":0.501,"5min":0.498,"15min":0.56100000000000005},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48199999999999998,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.60199999999999998},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.61199999999999999},"min":{"1min":0.33600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.314,"15min":0.313},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.40799999999999997,"5min":0.501,"15min":0.501},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35199999999999998,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46300000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33300000000000002,"15min":0.32200000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.30399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.36299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.23400000000000001},"max":{"1min":0.42299999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.996,"15min":0.996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.43099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.53900000000000003},"min":{"1min":0.49399999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.434},{"interface":"front","average":{"1min":0.62,"5min":0.58699999999999997,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39000000000000001},"max":{"1min":0.71699999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60599999999999998,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.006},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.57399999999999995},"min":{"1min":0.54900000000000004,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":0.88200000000000001},"last":0.498}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193979,"statfs":{"total":200000000,"available":198634853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33100000000000002,"15min":0.34699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.45600000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.375,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":1.0389999999999999},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.188},"max":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":22.038},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":1.3779999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.36099999999999999},"min":{"1min":0.22,"5min":0.183,"15min":0.183},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":1.071},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.253},"max":{"1min":0.498,"5min":0.63300000000000001,"15min":21.942},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70499999999999996,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.75},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":1.1419999999999999},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.86499999999999999,"15min":11.122999999999999},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":1.2290000000000001},"min":{"1min":0.38400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71999999999999997,"5min":0.80200000000000005,"15min":22.010999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.69799999999999995,"5min":0.83899999999999997,"15min":1.401},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":1.171},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73499999999999999,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":1.254},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.84799999999999998,"15min":21.98},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.70899999999999996,"5min":0.91000000000000003,"15min":1.425},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.90300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.71999999999999997,"5min":0.81899999999999995,"15min":11.154},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"min":{"1min":0.215,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.41799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.316,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.24099999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.40200000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.39800000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.41699999999999998,"15min":0.38900000000000001},"min":{"1min":0.315,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.47499999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39400000000000002,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.499,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.314},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51300000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.056,"15min":1.056},"last":0.754},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81599999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.628,"15min":0.59199999999999997},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83399999999999996,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.56000000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68700000000000006,"5min":1.002,"15min":1.002},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60799999999999998,"15min":0.58699999999999997},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.86499999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.318,"15min":0.307},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.439,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.37,"15min":0.33300000000000002},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.56999999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.24399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.35299999999999998,"15min":0.33000000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.45100000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.378,"15min":0.34799999999999998},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.58499999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41199999999999998,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.65900000000000003,"5min":3.044,"15min":3.044},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.249},"max":{"1min":0.45100000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.26400000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.446,"5min":1.446,"15min":2.2120000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.327,"5min":1.327,"15min":2.25},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58599999999999997,"15min":0.68799999999999994},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.5}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.44500000000000001,"15min":0.38600000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.94099999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.442,"5min":0.372,"15min":0.372},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.5,"15min":0.78100000000000003},"min":{"1min":0.39600000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.62},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.221},"max":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52100000000000002,"15min":0.81299999999999994},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65900000000000003,"5min":0.70599999999999996,"15min":5.9329999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52000000000000002,"15min":0.76700000000000002},"min":{"1min":0.373,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.67800000000000005,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.75900000000000001,"15min":5.4390000000000001},"last":0.623},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.67100000000000004},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.61199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.77000000000000002,"15min":3.456},"last":0.499}]},{"osd":5,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.245},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.59699999999999998,"15min":1.0069999999999999},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":13.173999999999999},"last":0.64700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194555,"statfs":{"total":200000000,"available":199225221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.69399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.27400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.41599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.6269999999999998,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.32700000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.63800000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68000000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71999999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73499999999999999,"5min":0.879,"15min":0.879},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.47599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.74299999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.81799999999999995}]}]}],"pool_statfs":[]}} 2023-10-06T02:52:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3f is not active+clean 2023-10-06T02:52:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539241+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:52:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2023-10-06T02:52:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538356+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2023-10-06T02:52:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540065+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3c is not active+clean 2023-10-06T02:52:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538781+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:52:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3b is not active+clean 2023-10-06T02:52:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539863+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:52:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2023-10-06T02:52:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539659+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:31:52.861165+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2023-10-06T02:52:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.541510+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:35:01.855585+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2023-10-06T02:52:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539739+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:10:24.087056+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2023-10-06T02:52:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538422+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:52:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2023-10-06T02:52:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539461+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:38:28.881920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:52:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.35 is not active+clean 2023-10-06T02:52:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538906+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:52:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2023-10-06T02:52:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.541170+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:22:16.893240+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2023-10-06T02:52:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538006+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:09:28.137544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:52:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2023-10-06T02:52:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538906+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.31 is not active+clean 2023-10-06T02:52:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539501+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:52:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2023-10-06T02:52:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539319+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:28:46.119876+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2023-10-06T02:52:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540686+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:52:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2023-10-06T02:52:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539438+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2d is not active+clean 2023-10-06T02:52:31.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540910+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:52:31.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2023-10-06T02:52:31.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540044+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:49:33.203942+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:52:31.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2b is not active+clean 2023-10-06T02:52:31.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539044+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:52:31.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2a is not active+clean 2023-10-06T02:52:31.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.541689+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:52:31.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.29 is not active+clean 2023-10-06T02:52:31.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.541381+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:52:31.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.28 is not active+clean 2023-10-06T02:52:31.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.544340+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.27 is not active+clean 2023-10-06T02:52:31.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.542721+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2023-10-06T02:52:31.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539567+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:23:12.070249+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:52:31.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.25 is not active+clean 2023-10-06T02:52:31.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539411+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:52:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2023-10-06T02:52:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.543794+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:00:28.700897+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2023-10-06T02:52:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538818+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:57:49.401503+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:52:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2023-10-06T02:52:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538453+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.21 is not active+clean 2023-10-06T02:52:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.543118+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.20 is not active+clean 2023-10-06T02:52:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.543527+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-10-06T02:52:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.541485+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:52:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2023-10-06T02:52:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.541374+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:19:44.465768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-10-06T02:52:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.537999+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-10-06T02:52:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.541022+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:52:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-10-06T02:52:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.537876+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:15:37.035449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:52:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-10-06T02:52:31.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539450+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:52:31.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-10-06T02:52:31.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539095+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-10-06T02:52:31.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540356+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:52:46.023818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:52:31.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-10-06T02:52:31.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.537964+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-10-06T02:52:31.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538561+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:52:31.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2023-10-06T02:52:31.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.541050+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:20:18.233825+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-10-06T02:52:31.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.537532+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:38:28.881920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2023-10-06T02:52:31.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538960+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:56:42.506920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-10-06T02:52:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538103+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-10-06T02:52:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538561+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-10-06T02:52:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.537494+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:29:02.719347+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2023-10-06T02:52:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540677+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:15:37.422386+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-10-06T02:52:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539508+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:52:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-10-06T02:52:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540664+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:52:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2023-10-06T02:52:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540012+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:51:10.124283+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:52:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2023-10-06T02:52:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.542668+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:29:43.535260+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:52:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-10-06T02:52:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538770+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-10-06T02:52:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539543+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:52:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-10-06T02:52:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538048+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:29:02.719347+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:52:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-10-06T02:52:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540551+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:52:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2023-10-06T02:52:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539229+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:39:12.681495+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:52:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-10-06T02:52:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.540031+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:52:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-10-06T02:52:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.539108+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:52:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-10-06T02:52:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.538931+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:32:24.114095+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:52:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-10-06T02:52:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.537917+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:49:13.781219+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-10-06T02:52:31.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.537931+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:52:31.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-10-06T02:52:31.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:52:25.527619+0000', 'last_change': '2023-10-06T02:52:25.537921+0000', 'last_active': '2023-10-06T02:52:25.527619+0000', 'last_peered': '2023-10-06T02:52:25.527619+0000', 'last_clean': '2023-10-06T02:52:25.527619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:52:25.527619+0000', 'last_undegraded': '2023-10-06T02:52:25.527619+0000', 'last_fullsized': '2023-10-06T02:52:25.527619+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'last_clean_scrub_stamp': '2023-10-06T02:52:25.527619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:12:48.934529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:52:31.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:52:31.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.492+0000 7fdd8df3d700 1 Processor -- start 2023-10-06T02:52:31.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.492+0000 7fdd8df3d700 1 -- start start 2023-10-06T02:52:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd8df3d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd88157bb0 0x7fdd8815b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd8df3d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdd8806d240 0x7fdd8806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd8df3d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd880cfdd0 con 0x7fdd881577e0 2023-10-06T02:52:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd8df3d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8806dc00 con 0x7fdd8806d240 2023-10-06T02:52:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd8df3d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880d00b0 con 0x7fdd88157bb0 2023-10-06T02:52:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd87fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdd8806d240 0x7fdd8806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd7effd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd88157bb0 0x7fdd8815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd877fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fdd881577e0 0x7fdd880cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:40368/0 (socket says 172.21.15.81:40368) 2023-10-06T02:52:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd877fe700 1 -- 172.21.15.81:0/2955923733 learned_addr learned my addr 172.21.15.81:0/2955923733 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd7effd700 1 -- 172.21.15.81:0/2955923733 >> v2:172.21.15.83:3300/0 conn(0x7fdd8806d240 msgr2=0x7fdd8806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd7effd700 1 --2- 172.21.15.81:0/2955923733 >> v2:172.21.15.83:3300/0 conn(0x7fdd8806d240 0x7fdd8806d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd7effd700 1 -- 172.21.15.81:0/2955923733 >> v1:172.21.15.83:6789/0 conn(0x7fdd881577e0 legacy=0x7fdd880cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd7effd700 1 -- 172.21.15.81:0/2955923733 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd880d0390 con 0x7fdd88157bb0 2023-10-06T02:52:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd86ffd700 1 -- 172.21.15.81:0/2955923733 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611863116 0 0) 0x7fdd880cfdd0 con 0x7fdd881577e0 2023-10-06T02:52:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.493+0000 7fdd87fff700 1 --2- 172.21.15.81:0/2955923733 >> v2:172.21.15.83:3300/0 conn(0x7fdd8806d240 0x7fdd8806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd7effd700 1 --2- 172.21.15.81:0/2955923733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd88157bb0 0x7fdd8815b070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdd700098e0 tx=0x7fdd700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2390e7996e66e501 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd86ffd700 1 -- 172.21.15.81:0/2955923733 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000b640 con 0x7fdd88157bb0 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd86ffd700 1 -- 172.21.15.81:0/2955923733 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7000b7a0 con 0x7fdd88157bb0 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd86ffd700 1 -- 172.21.15.81:0/2955923733 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000bb40 con 0x7fdd88157bb0 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd8df3d700 1 -- 172.21.15.81:0/2955923733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd88157bb0 msgr2=0x7fdd8815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd8df3d700 1 --2- 172.21.15.81:0/2955923733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd88157bb0 0x7fdd8815b070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdd700098e0 tx=0x7fdd700091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd8df3d700 1 -- 172.21.15.81:0/2955923733 shutdown_connections 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd8df3d700 1 --2- 172.21.15.81:0/2955923733 >> v2:172.21.15.83:3300/0 conn(0x7fdd8806d240 0x7fdd8806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd8df3d700 1 --2- 172.21.15.81:0/2955923733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd88157bb0 0x7fdd8815b070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd8df3d700 1 -- 172.21.15.81:0/2955923733 >> 172.21.15.81:0/2955923733 conn(0x7fdd8806bb90 msgr2=0x7fdd8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd8df3d700 1 -- 172.21.15.81:0/2955923733 shutdown_connections 2023-10-06T02:52:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.494+0000 7fdd8df3d700 1 -- 172.21.15.81:0/2955923733 wait complete. 2023-10-06T02:52:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.495+0000 7fdd8df3d700 1 Processor -- start 2023-10-06T02:52:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.496+0000 7fdd8df3d700 1 -- start start 2023-10-06T02:52:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.496+0000 7fdd8df3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8806d240 0x7fdd881530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.496+0000 7fdd8df3d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd881577e0 0x7fdd881428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.496+0000 7fdd8df3d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd88157bb0 0x7fdd88155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.496+0000 7fdd8df3d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd881555c0 con 0x7fdd8806d240 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.496+0000 7fdd8df3d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880b40b0 con 0x7fdd88157bb0 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.496+0000 7fdd8df3d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd88155000 con 0x7fdd881577e0 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8806d240 0x7fdd881530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8806d240 0x7fdd881530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55828/0 (socket says 172.21.15.81:55828) 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd877fe700 1 -- 172.21.15.81:0/938755972 learned_addr learned my addr 172.21.15.81:0/938755972 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd87fff700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd88157bb0 0x7fdd88155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd7effd700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd881577e0 0x7fdd881428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd877fe700 1 -- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd881577e0 msgr2=0x7fdd881428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd877fe700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd881577e0 0x7fdd881428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd877fe700 1 -- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd88157bb0 msgr2=0x7fdd88155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd877fe700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd88157bb0 0x7fdd88155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd877fe700 1 -- 172.21.15.81:0/938755972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80009a20 con 0x7fdd8806d240 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd877fe700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8806d240 0x7fdd881530b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c7e0 tx=0x7fdd78007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd7ffff700 1 -- 172.21.15.81:0/938755972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78005b30 con 0x7fdd8806d240 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd7ffff700 1 -- 172.21.15.81:0/938755972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78005c90 con 0x7fdd8806d240 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd7ffff700 1 -- 172.21.15.81:0/938755972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78007320 con 0x7fdd8806d240 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd70009420 con 0x7fdd8806d240 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.497+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd880b3d40 con 0x7fdd8806d240 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.498+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd880b3ba0 con 0x7fdd8806d240 2023-10-06T02:52:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.499+0000 7fdd7ffff700 1 -- 172.21.15.81:0/938755972 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd7801b3b0 con 0x7fdd8806d240 2023-10-06T02:52:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.499+0000 7fdd7ffff700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd68066f30 0x7fdd680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.499+0000 7fdd7ffff700 1 -- 172.21.15.81:0/938755972 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdd78083aa0 con 0x7fdd8806d240 2023-10-06T02:52:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.499+0000 7fdd7effd700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd68066f30 0x7fdd680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.500+0000 7fdd7effd700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd68066f30 0x7fdd680693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdd700091e0 tx=0x7fdd70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.503+0000 7fdd7ffff700 1 -- 172.21.15.81:0/938755972 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd880b3ba0 con 0x7fdd8806d240 2023-10-06T02:52:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.763+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdd880b3ba0 con 0x7fdd8806d240 2023-10-06T02:52:31.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.763+0000 7fdd7ffff700 1 -- 172.21.15.81:0/938755972 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1450 (secure 0 0 0) 0x7fdd780175c0 con 0x7fdd8806d240 2023-10-06T02:52:31.765 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:31.765 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":402,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":135,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560354,"num_in_osds":8,"osd_in_since":1696560351,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":7378968,"bytes_avail":1592621032,"bytes_total":1600000000,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":67,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":7275}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-10-06T02:51:41.573380+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:52:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.765+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd68066f30 msgr2=0x7fdd680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.765+0000 7fdd8df3d700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd68066f30 0x7fdd680693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdd700091e0 tx=0x7fdd70017000 comp rx=0 tx=0).stop 2023-10-06T02:52:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.765+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8806d240 msgr2=0x7fdd881530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.766+0000 7fdd8df3d700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8806d240 0x7fdd881530b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c7e0 tx=0x7fdd78007df0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.766+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 shutdown_connections 2023-10-06T02:52:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.766+0000 7fdd8df3d700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdd68066f30 0x7fdd680693e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.766+0000 7fdd8df3d700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd88157bb0 0x7fdd88155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.766+0000 7fdd8df3d700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8806d240 0x7fdd881530b0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.766+0000 7fdd8df3d700 1 --2- 172.21.15.81:0/938755972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd881577e0 0x7fdd881428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.766+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 >> 172.21.15.81:0/938755972 conn(0x7fdd8806bb90 msgr2=0x7fdd88068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.766+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 shutdown_connections 2023-10-06T02:52:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.766+0000 7fdd8df3d700 1 -- 172.21.15.81:0/938755972 wait complete. 2023-10-06T02:52:31.779 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:52:31.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:52:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.892+0000 7f5f9db0e700 1 Processor -- start 2023-10-06T02:52:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.892+0000 7f5f9db0e700 1 -- start start 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9db0e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f98157860 0x7f5f9806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9db0e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f9806a020 0x7f5f9815a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9db0e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f980cbec0 con 0x7f5f980cdb60 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9db0e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f980cb9d0 con 0x7f5f98157860 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9db0e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9815b2d0 con 0x7f5f9806a020 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9cb0c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f98157860 0x7f5f9806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9cb0c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f98157860 0x7f5f9806dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55834/0 (socket says 172.21.15.81:55834) 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9cb0c700 1 -- 172.21.15.81:0/2403096335 learned_addr learned my addr 172.21.15.81:0/2403096335 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f97fff700 1 --2- 172.21.15.81:0/2403096335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f9806a020 0x7f5f9815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9cb0c700 1 -- 172.21.15.81:0/2403096335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f9806a020 msgr2=0x7f5f9815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9cb0c700 1 --2- 172.21.15.81:0/2403096335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f9806a020 0x7f5f9815a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9cb0c700 1 -- 172.21.15.81:0/2403096335 >> v1:172.21.15.83:6789/0 conn(0x7f5f980cdb60 legacy=0x7f5f980cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9cb0c700 1 -- 172.21.15.81:0/2403096335 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f980cc180 con 0x7f5f98157860 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.893+0000 7f5f9cb0c700 1 --2- 172.21.15.81:0/2403096335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98157860 0x7f5f9806dfe0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009f20 tx=0x7f5f90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820011f89d39ac39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f977fe700 1 -- 172.21.15.81:0/2403096335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000e070 con 0x7f5f98157860 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f977fe700 1 -- 172.21.15.81:0/2403096335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9000b9d0 con 0x7f5f98157860 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f977fe700 1 -- 172.21.15.81:0/2403096335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f900092e0 con 0x7f5f98157860 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f9db0e700 1 -- 172.21.15.81:0/2403096335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98157860 msgr2=0x7f5f9806dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f9db0e700 1 --2- 172.21.15.81:0/2403096335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98157860 0x7f5f9806dfe0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009f20 tx=0x7f5f90009840 comp rx=0 tx=0).stop 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f9db0e700 1 -- 172.21.15.81:0/2403096335 shutdown_connections 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f9db0e700 1 --2- 172.21.15.81:0/2403096335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98157860 0x7f5f9806dfe0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f9db0e700 1 --2- 172.21.15.81:0/2403096335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f9806a020 0x7f5f9815a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f9db0e700 1 -- 172.21.15.81:0/2403096335 >> 172.21.15.81:0/2403096335 conn(0x7f5f98063230 msgr2=0x7f5f98063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:31.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f9db0e700 1 -- 172.21.15.81:0/2403096335 shutdown_connections 2023-10-06T02:52:31.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.894+0000 7f5f9db0e700 1 -- 172.21.15.81:0/2403096335 wait complete. 2023-10-06T02:52:31.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.895+0000 7f5f9db0e700 1 Processor -- start 2023-10-06T02:52:31.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9db0e700 1 -- start start 2023-10-06T02:52:31.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9db0e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9806a020 0x7f5f98150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9db0e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f980cdb60 0x7f5f98153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9db0e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f98157860 0x7f5f98156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9db0e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980b0e40 con 0x7f5f9806a020 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9db0e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98150f30 con 0x7f5f980cdb60 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9db0e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f981505d0 con 0x7f5f98157860 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9cb0c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9806a020 0x7f5f98150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9cb0c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9806a020 0x7f5f98150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55846/0 (socket says 172.21.15.81:55846) 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9cb0c700 1 -- 172.21.15.81:0/443589679 learned_addr learned my addr 172.21.15.81:0/443589679 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f97fff700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f980cdb60 0x7f5f98153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.896+0000 7f5f9d30d700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f98157860 0x7f5f98156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f9cb0c700 1 -- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f98157860 msgr2=0x7f5f98156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f9cb0c700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f98157860 0x7f5f98156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f9cb0c700 1 -- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f980cdb60 msgr2=0x7f5f98153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f9cb0c700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f980cdb60 0x7f5f98153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:31.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f9cb0c700 1 -- 172.21.15.81:0/443589679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f90009ae0 con 0x7f5f9806a020 2023-10-06T02:52:31.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f9cb0c700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9806a020 0x7f5f98150090 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000b610 tx=0x7f5f90018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:31.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f94ff9700 1 -- 172.21.15.81:0/443589679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f900088f0 con 0x7f5f9806a020 2023-10-06T02:52:31.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f94ff9700 1 -- 172.21.15.81:0/443589679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f90008a50 con 0x7f5f9806a020 2023-10-06T02:52:31.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f98154940 con 0x7f5f9806a020 2023-10-06T02:52:31.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f94ff9700 1 -- 172.21.15.81:0/443589679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90008df0 con 0x7f5f9806a020 2023-10-06T02:52:31.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.897+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f98154cd0 con 0x7f5f9806a020 2023-10-06T02:52:31.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.898+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f980690d0 con 0x7f5f9806a020 2023-10-06T02:52:31.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.898+0000 7f5f94ff9700 1 -- 172.21.15.81:0/443589679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f90003040 con 0x7f5f9806a020 2023-10-06T02:52:31.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.899+0000 7f5f94ff9700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f78066f30 0x7f5f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:31.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.899+0000 7f5f94ff9700 1 -- 172.21.15.81:0/443589679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f90086040 con 0x7f5f9806a020 2023-10-06T02:52:31.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.899+0000 7f5f97fff700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f78066f30 0x7f5f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:31.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.899+0000 7f5f97fff700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f78066f30 0x7f5f780693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ca140 tx=0x7f5f880091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:31.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:31.903+0000 7f5f94ff9700 1 -- 172.21.15.81:0/443589679 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f90053150 con 0x7f5f9806a020 2023-10-06T02:52:32.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.079+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f98151070 con 0x7f5f78066f30 2023-10-06T02:52:32.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.088+0000 7f5f94ff9700 1 -- 172.21.15.81:0/443589679 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305781 (secure 0 0 0) 0x7f5f88011a20 con 0x7f5f78066f30 2023-10-06T02:52:32.093 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:32.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.091+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f78066f30 msgr2=0x7f5f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:32.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.091+0000 7f5f9db0e700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f78066f30 0x7f5f780693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ca140 tx=0x7f5f880091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:32.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.091+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9806a020 msgr2=0x7f5f98150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.091+0000 7f5f9db0e700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9806a020 0x7f5f98150090 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000b610 tx=0x7f5f90018000 comp rx=0 tx=0).stop 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.092+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 shutdown_connections 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.092+0000 7f5f9db0e700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5f98157860 0x7f5f98156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.092+0000 7f5f9db0e700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9806a020 0x7f5f98150090 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.092+0000 7f5f9db0e700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5f78066f30 0x7f5f780693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.092+0000 7f5f9db0e700 1 --2- 172.21.15.81:0/443589679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f980cdb60 0x7f5f98153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.092+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 >> 172.21.15.81:0/443589679 conn(0x7f5f98063230 msgr2=0x7f5f98153000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.092+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 shutdown_connections 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:32.092+0000 7f5f9db0e700 1 -- 172.21.15.81:0/443589679 wait complete. 2023-10-06T02:52:32.096 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:52:32.104 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2023-10-06T02:52:31.584027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555181,"statfs":{"total":1600000000,"available":1592506364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.048307"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547250+0000","last_change":"2023-10-06T02:52:26.547165+0000","last_active":"2023-10-06T02:52:26.547250+0000","last_peered":"2023-10-06T02:52:26.547250+0000","last_clean":"2023-10-06T02:52:26.547250+0000","last_became_active":"2023-10-06T02:52:26.546893+0000","last_became_peered":"2023-10-06T02:52:26.546893+0000","last_unstale":"2023-10-06T02:52:26.547250+0000","last_undegraded":"2023-10-06T02:52:26.547250+0000","last_fullsized":"2023-10-06T02:52:26.547250+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:58.350339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547784+0000","last_change":"2023-10-06T02:52:26.547716+0000","last_active":"2023-10-06T02:52:26.547784+0000","last_peered":"2023-10-06T02:52:26.547784+0000","last_clean":"2023-10-06T02:52:26.547784+0000","last_became_active":"2023-10-06T02:52:26.547500+0000","last_became_peered":"2023-10-06T02:52:26.547500+0000","last_unstale":"2023-10-06T02:52:26.547784+0000","last_undegraded":"2023-10-06T02:52:26.547784+0000","last_fullsized":"2023-10-06T02:52:26.547784+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549770+0000","last_change":"2023-10-06T02:52:26.549726+0000","last_active":"2023-10-06T02:52:26.549770+0000","last_peered":"2023-10-06T02:52:26.549770+0000","last_clean":"2023-10-06T02:52:26.549770+0000","last_became_active":"2023-10-06T02:52:26.548998+0000","last_became_peered":"2023-10-06T02:52:26.548998+0000","last_unstale":"2023-10-06T02:52:26.549770+0000","last_undegraded":"2023-10-06T02:52:26.549770+0000","last_fullsized":"2023-10-06T02:52:26.549770+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:49.493406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546039+0000","last_change":"2023-10-06T02:52:26.545760+0000","last_active":"2023-10-06T02:52:26.546039+0000","last_peered":"2023-10-06T02:52:26.546039+0000","last_clean":"2023-10-06T02:52:26.546039+0000","last_became_active":"2023-10-06T02:52:26.545411+0000","last_became_peered":"2023-10-06T02:52:26.545411+0000","last_unstale":"2023-10-06T02:52:26.546039+0000","last_undegraded":"2023-10-06T02:52:26.546039+0000","last_fullsized":"2023-10-06T02:52:26.546039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545385+0000","last_change":"2023-10-06T02:52:26.545025+0000","last_active":"2023-10-06T02:52:26.545385+0000","last_peered":"2023-10-06T02:52:26.545385+0000","last_clean":"2023-10-06T02:52:26.545385+0000","last_became_active":"2023-10-06T02:52:26.544291+0000","last_became_peered":"2023-10-06T02:52:26.544291+0000","last_unstale":"2023-10-06T02:52:26.545385+0000","last_undegraded":"2023-10-06T02:52:26.545385+0000","last_fullsized":"2023-10-06T02:52:26.545385+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:24.087056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545790+0000","last_change":"2023-10-06T02:52:26.545248+0000","last_active":"2023-10-06T02:52:26.545790+0000","last_peered":"2023-10-06T02:52:26.545790+0000","last_clean":"2023-10-06T02:52:26.545790+0000","last_became_active":"2023-10-06T02:52:26.544185+0000","last_became_peered":"2023-10-06T02:52:26.544185+0000","last_unstale":"2023-10-06T02:52:26.545790+0000","last_undegraded":"2023-10-06T02:52:26.545790+0000","last_fullsized":"2023-10-06T02:52:26.545790+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:54.488413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547413+0000","last_change":"2023-10-06T02:52:26.547347+0000","last_active":"2023-10-06T02:52:26.547413+0000","last_peered":"2023-10-06T02:52:26.547413+0000","last_clean":"2023-10-06T02:52:26.547413+0000","last_became_active":"2023-10-06T02:52:26.546938+0000","last_became_peered":"2023-10-06T02:52:26.546938+0000","last_unstale":"2023-10-06T02:52:26.547413+0000","last_undegraded":"2023-10-06T02:52:26.547413+0000","last_fullsized":"2023-10-06T02:52:26.547413+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:48.831646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549642+0000","last_change":"2023-10-06T02:52:26.549598+0000","last_active":"2023-10-06T02:52:26.549642+0000","last_peered":"2023-10-06T02:52:26.549642+0000","last_clean":"2023-10-06T02:52:26.549642+0000","last_became_active":"2023-10-06T02:52:26.548789+0000","last_became_peered":"2023-10-06T02:52:26.548789+0000","last_unstale":"2023-10-06T02:52:26.549642+0000","last_undegraded":"2023-10-06T02:52:26.549642+0000","last_fullsized":"2023-10-06T02:52:26.549642+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:02.641276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546023+0000","last_change":"2023-10-06T02:52:26.545629+0000","last_active":"2023-10-06T02:52:26.546023+0000","last_peered":"2023-10-06T02:52:26.546023+0000","last_clean":"2023-10-06T02:52:26.546023+0000","last_became_active":"2023-10-06T02:52:26.544655+0000","last_became_peered":"2023-10-06T02:52:26.544655+0000","last_unstale":"2023-10-06T02:52:26.546023+0000","last_undegraded":"2023-10-06T02:52:26.546023+0000","last_fullsized":"2023-10-06T02:52:26.546023+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:24.087056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544170+0000","last_change":"2023-10-06T02:52:26.543648+0000","last_active":"2023-10-06T02:52:26.544170+0000","last_peered":"2023-10-06T02:52:26.544170+0000","last_clean":"2023-10-06T02:52:26.544170+0000","last_became_active":"2023-10-06T02:52:26.543432+0000","last_became_peered":"2023-10-06T02:52:26.543432+0000","last_unstale":"2023-10-06T02:52:26.544170+0000","last_undegraded":"2023-10-06T02:52:26.544170+0000","last_fullsized":"2023-10-06T02:52:26.544170+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.551931+0000","last_change":"2023-10-06T02:52:26.551848+0000","last_active":"2023-10-06T02:52:26.551931+0000","last_peered":"2023-10-06T02:52:26.551931+0000","last_clean":"2023-10-06T02:52:26.551931+0000","last_became_active":"2023-10-06T02:52:26.551516+0000","last_became_peered":"2023-10-06T02:52:26.551516+0000","last_unstale":"2023-10-06T02:52:26.551931+0000","last_undegraded":"2023-10-06T02:52:26.551931+0000","last_fullsized":"2023-10-06T02:52:26.551931+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:02.641276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544730+0000","last_change":"2023-10-06T02:52:26.544662+0000","last_active":"2023-10-06T02:52:26.544730+0000","last_peered":"2023-10-06T02:52:26.544730+0000","last_clean":"2023-10-06T02:52:26.544730+0000","last_became_active":"2023-10-06T02:52:26.544458+0000","last_became_peered":"2023-10-06T02:52:26.544458+0000","last_unstale":"2023-10-06T02:52:26.544730+0000","last_undegraded":"2023-10-06T02:52:26.544730+0000","last_fullsized":"2023-10-06T02:52:26.544730+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:01.189585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548150+0000","last_change":"2023-10-06T02:52:26.548096+0000","last_active":"2023-10-06T02:52:26.548150+0000","last_peered":"2023-10-06T02:52:26.548150+0000","last_clean":"2023-10-06T02:52:26.548150+0000","last_became_active":"2023-10-06T02:52:26.547869+0000","last_became_peered":"2023-10-06T02:52:26.547869+0000","last_unstale":"2023-10-06T02:52:26.548150+0000","last_undegraded":"2023-10-06T02:52:26.548150+0000","last_fullsized":"2023-10-06T02:52:26.548150+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547096+0000","last_change":"2023-10-06T02:52:26.546946+0000","last_active":"2023-10-06T02:52:26.547096+0000","last_peered":"2023-10-06T02:52:26.547096+0000","last_clean":"2023-10-06T02:52:26.547096+0000","last_became_active":"2023-10-06T02:52:26.546695+0000","last_became_peered":"2023-10-06T02:52:26.546695+0000","last_unstale":"2023-10-06T02:52:26.547096+0000","last_undegraded":"2023-10-06T02:52:26.547096+0000","last_fullsized":"2023-10-06T02:52:26.547096+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:57.641548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545366+0000","last_change":"2023-10-06T02:52:26.544887+0000","last_active":"2023-10-06T02:52:26.545366+0000","last_peered":"2023-10-06T02:52:26.545366+0000","last_clean":"2023-10-06T02:52:26.545366+0000","last_became_active":"2023-10-06T02:52:26.543983+0000","last_became_peered":"2023-10-06T02:52:26.543983+0000","last_unstale":"2023-10-06T02:52:26.545366+0000","last_undegraded":"2023-10-06T02:52:26.545366+0000","last_fullsized":"2023-10-06T02:52:26.545366+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:19.070290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.542402+0000","last_change":"2023-10-06T02:52:26.542343+0000","last_active":"2023-10-06T02:52:26.542402+0000","last_peered":"2023-10-06T02:52:26.542402+0000","last_clean":"2023-10-06T02:52:26.542402+0000","last_became_active":"2023-10-06T02:52:26.542119+0000","last_became_peered":"2023-10-06T02:52:26.542119+0000","last_unstale":"2023-10-06T02:52:26.542402+0000","last_undegraded":"2023-10-06T02:52:26.542402+0000","last_fullsized":"2023-10-06T02:52:26.542402+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:24.583171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548520+0000","last_change":"2023-10-06T02:52:26.548469+0000","last_active":"2023-10-06T02:52:26.548520+0000","last_peered":"2023-10-06T02:52:26.548520+0000","last_clean":"2023-10-06T02:52:26.548520+0000","last_became_active":"2023-10-06T02:52:26.547659+0000","last_became_peered":"2023-10-06T02:52:26.547659+0000","last_unstale":"2023-10-06T02:52:26.548520+0000","last_undegraded":"2023-10-06T02:52:26.548520+0000","last_fullsized":"2023-10-06T02:52:26.548520+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.550642+0000","last_change":"2023-10-06T02:52:26.550585+0000","last_active":"2023-10-06T02:52:26.550642+0000","last_peered":"2023-10-06T02:52:26.550642+0000","last_clean":"2023-10-06T02:52:26.550642+0000","last_became_active":"2023-10-06T02:52:26.550404+0000","last_became_peered":"2023-10-06T02:52:26.550404+0000","last_unstale":"2023-10-06T02:52:26.550642+0000","last_undegraded":"2023-10-06T02:52:26.550642+0000","last_fullsized":"2023-10-06T02:52:26.550642+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:31.567028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548826+0000","last_change":"2023-10-06T02:52:26.548721+0000","last_active":"2023-10-06T02:52:26.548826+0000","last_peered":"2023-10-06T02:52:26.548826+0000","last_clean":"2023-10-06T02:52:26.548826+0000","last_became_active":"2023-10-06T02:52:26.547803+0000","last_became_peered":"2023-10-06T02:52:26.547803+0000","last_unstale":"2023-10-06T02:52:26.548826+0000","last_undegraded":"2023-10-06T02:52:26.548826+0000","last_fullsized":"2023-10-06T02:52:26.548826+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546788+0000","last_change":"2023-10-06T02:52:26.546725+0000","last_active":"2023-10-06T02:52:26.546788+0000","last_peered":"2023-10-06T02:52:26.546788+0000","last_clean":"2023-10-06T02:52:26.546788+0000","last_became_active":"2023-10-06T02:52:26.546455+0000","last_became_peered":"2023-10-06T02:52:26.546455+0000","last_unstale":"2023-10-06T02:52:26.546788+0000","last_undegraded":"2023-10-06T02:52:26.546788+0000","last_fullsized":"2023-10-06T02:52:26.546788+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:47.345805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545997+0000","last_change":"2023-10-06T02:52:26.545281+0000","last_active":"2023-10-06T02:52:26.545997+0000","last_peered":"2023-10-06T02:52:26.545997+0000","last_clean":"2023-10-06T02:52:26.545997+0000","last_became_active":"2023-10-06T02:52:26.545043+0000","last_became_peered":"2023-10-06T02:52:26.545043+0000","last_unstale":"2023-10-06T02:52:26.545997+0000","last_undegraded":"2023-10-06T02:52:26.545997+0000","last_fullsized":"2023-10-06T02:52:26.545997+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549699+0000","last_change":"2023-10-06T02:52:26.548917+0000","last_active":"2023-10-06T02:52:26.549699+0000","last_peered":"2023-10-06T02:52:26.549699+0000","last_clean":"2023-10-06T02:52:26.549699+0000","last_became_active":"2023-10-06T02:52:26.548671+0000","last_became_peered":"2023-10-06T02:52:26.548671+0000","last_unstale":"2023-10-06T02:52:26.549699+0000","last_undegraded":"2023-10-06T02:52:26.549699+0000","last_fullsized":"2023-10-06T02:52:26.549699+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:49.493406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.550363+0000","last_change":"2023-10-06T02:52:26.549838+0000","last_active":"2023-10-06T02:52:26.550363+0000","last_peered":"2023-10-06T02:52:26.550363+0000","last_clean":"2023-10-06T02:52:26.550363+0000","last_became_active":"2023-10-06T02:52:26.549607+0000","last_became_peered":"2023-10-06T02:52:26.549607+0000","last_unstale":"2023-10-06T02:52:26.550363+0000","last_undegraded":"2023-10-06T02:52:26.550363+0000","last_fullsized":"2023-10-06T02:52:26.550363+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:02.641276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545612+0000","last_change":"2023-10-06T02:52:26.545133+0000","last_active":"2023-10-06T02:52:26.545612+0000","last_peered":"2023-10-06T02:52:26.545612+0000","last_clean":"2023-10-06T02:52:26.545612+0000","last_became_active":"2023-10-06T02:52:26.544897+0000","last_became_peered":"2023-10-06T02:52:26.544897+0000","last_unstale":"2023-10-06T02:52:26.545612+0000","last_undegraded":"2023-10-06T02:52:26.545612+0000","last_fullsized":"2023-10-06T02:52:26.545612+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544537+0000","last_change":"2023-10-06T02:52:26.544420+0000","last_active":"2023-10-06T02:52:26.544537+0000","last_peered":"2023-10-06T02:52:26.544537+0000","last_clean":"2023-10-06T02:52:26.544537+0000","last_became_active":"2023-10-06T02:52:26.544171+0000","last_became_peered":"2023-10-06T02:52:26.544171+0000","last_unstale":"2023-10-06T02:52:26.544537+0000","last_undegraded":"2023-10-06T02:52:26.544537+0000","last_fullsized":"2023-10-06T02:52:26.544537+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545182+0000","last_change":"2023-10-06T02:52:26.545102+0000","last_active":"2023-10-06T02:52:26.545182+0000","last_peered":"2023-10-06T02:52:26.545182+0000","last_clean":"2023-10-06T02:52:26.545182+0000","last_became_active":"2023-10-06T02:52:26.544698+0000","last_became_peered":"2023-10-06T02:52:26.544698+0000","last_unstale":"2023-10-06T02:52:26.545182+0000","last_undegraded":"2023-10-06T02:52:26.545182+0000","last_fullsized":"2023-10-06T02:52:26.545182+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:08.940922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545651+0000","last_change":"2023-10-06T02:52:26.545587+0000","last_active":"2023-10-06T02:52:26.545651+0000","last_peered":"2023-10-06T02:52:26.545651+0000","last_clean":"2023-10-06T02:52:26.545651+0000","last_became_active":"2023-10-06T02:52:26.545436+0000","last_became_peered":"2023-10-06T02:52:26.545436+0000","last_unstale":"2023-10-06T02:52:26.545651+0000","last_undegraded":"2023-10-06T02:52:26.545651+0000","last_fullsized":"2023-10-06T02:52:26.545651+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544199+0000","last_change":"2023-10-06T02:52:26.543618+0000","last_active":"2023-10-06T02:52:26.544199+0000","last_peered":"2023-10-06T02:52:26.544199+0000","last_clean":"2023-10-06T02:52:26.544199+0000","last_became_active":"2023-10-06T02:52:26.541763+0000","last_became_peered":"2023-10-06T02:52:26.541763+0000","last_unstale":"2023-10-06T02:52:26.544199+0000","last_undegraded":"2023-10-06T02:52:26.544199+0000","last_fullsized":"2023-10-06T02:52:26.544199+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:28.857260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544402+0000","last_change":"2023-10-06T02:52:26.544105+0000","last_active":"2023-10-06T02:52:26.544402+0000","last_peered":"2023-10-06T02:52:26.544402+0000","last_clean":"2023-10-06T02:52:26.544402+0000","last_became_active":"2023-10-06T02:52:26.543894+0000","last_became_peered":"2023-10-06T02:52:26.543894+0000","last_unstale":"2023-10-06T02:52:26.544402+0000","last_undegraded":"2023-10-06T02:52:26.544402+0000","last_fullsized":"2023-10-06T02:52:26.544402+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:02.294005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548793+0000","last_change":"2023-10-06T02:52:26.548719+0000","last_active":"2023-10-06T02:52:26.548793+0000","last_peered":"2023-10-06T02:52:26.548793+0000","last_clean":"2023-10-06T02:52:26.548793+0000","last_became_active":"2023-10-06T02:52:26.547949+0000","last_became_peered":"2023-10-06T02:52:26.547949+0000","last_unstale":"2023-10-06T02:52:26.548793+0000","last_undegraded":"2023-10-06T02:52:26.548793+0000","last_fullsized":"2023-10-06T02:52:26.548793+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:20.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548939+0000","last_change":"2023-10-06T02:52:26.548710+0000","last_active":"2023-10-06T02:52:26.548939+0000","last_peered":"2023-10-06T02:52:26.548939+0000","last_clean":"2023-10-06T02:52:26.548939+0000","last_became_active":"2023-10-06T02:52:26.548132+0000","last_became_peered":"2023-10-06T02:52:26.548132+0000","last_unstale":"2023-10-06T02:52:26.548939+0000","last_undegraded":"2023-10-06T02:52:26.548939+0000","last_fullsized":"2023-10-06T02:52:26.548939+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545631+0000","last_change":"2023-10-06T02:52:26.545540+0000","last_active":"2023-10-06T02:52:26.545631+0000","last_peered":"2023-10-06T02:52:26.545631+0000","last_clean":"2023-10-06T02:52:26.545631+0000","last_became_active":"2023-10-06T02:52:26.545268+0000","last_became_peered":"2023-10-06T02:52:26.545268+0000","last_unstale":"2023-10-06T02:52:26.545631+0000","last_undegraded":"2023-10-06T02:52:26.545631+0000","last_fullsized":"2023-10-06T02:52:26.545631+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.542922+0000","last_change":"2023-10-06T02:52:26.542857+0000","last_active":"2023-10-06T02:52:26.542922+0000","last_peered":"2023-10-06T02:52:26.542922+0000","last_clean":"2023-10-06T02:52:26.542922+0000","last_became_active":"2023-10-06T02:52:26.542584+0000","last_became_peered":"2023-10-06T02:52:26.542584+0000","last_unstale":"2023-10-06T02:52:26.542922+0000","last_undegraded":"2023-10-06T02:52:26.542922+0000","last_fullsized":"2023-10-06T02:52:26.542922+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"134'4","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.559672+0000","last_change":"2023-10-06T02:52:25.544754+0000","last_active":"2023-10-06T02:52:26.559672+0000","last_peered":"2023-10-06T02:52:26.559672+0000","last_clean":"2023-10-06T02:52:26.559672+0000","last_became_active":"2023-10-06T02:52:25.544522+0000","last_became_peered":"2023-10-06T02:52:25.544522+0000","last_unstale":"2023-10-06T02:52:26.559672+0000","last_undegraded":"2023-10-06T02:52:26.559672+0000","last_fullsized":"2023-10-06T02:52:26.559672+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:27.128855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546200+0000","last_change":"2023-10-06T02:52:26.546083+0000","last_active":"2023-10-06T02:52:26.546200+0000","last_peered":"2023-10-06T02:52:26.546200+0000","last_clean":"2023-10-06T02:52:26.546200+0000","last_became_active":"2023-10-06T02:52:26.545642+0000","last_became_peered":"2023-10-06T02:52:26.545642+0000","last_unstale":"2023-10-06T02:52:26.546200+0000","last_undegraded":"2023-10-06T02:52:26.546200+0000","last_fullsized":"2023-10-06T02:52:26.546200+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:40.301033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.557600+0000","last_change":"2023-10-06T02:52:25.542191+0000","last_active":"2023-10-06T02:52:26.557600+0000","last_peered":"2023-10-06T02:52:26.557600+0000","last_clean":"2023-10-06T02:52:26.557600+0000","last_became_active":"2023-10-06T02:52:25.541967+0000","last_became_peered":"2023-10-06T02:52:25.541967+0000","last_unstale":"2023-10-06T02:52:26.557600+0000","last_undegraded":"2023-10-06T02:52:26.557600+0000","last_fullsized":"2023-10-06T02:52:26.557600+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549727+0000","last_change":"2023-10-06T02:52:26.549484+0000","last_active":"2023-10-06T02:52:26.549727+0000","last_peered":"2023-10-06T02:52:26.549727+0000","last_clean":"2023-10-06T02:52:26.549727+0000","last_became_active":"2023-10-06T02:52:26.548970+0000","last_became_peered":"2023-10-06T02:52:26.548970+0000","last_unstale":"2023-10-06T02:52:26.549727+0000","last_undegraded":"2023-10-06T02:52:26.549727+0000","last_fullsized":"2023-10-06T02:52:26.549727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:58.350339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.560906+0000","last_change":"2023-10-06T02:52:25.545738+0000","last_active":"2023-10-06T02:52:26.560906+0000","last_peered":"2023-10-06T02:52:26.560906+0000","last_clean":"2023-10-06T02:52:26.560906+0000","last_became_active":"2023-10-06T02:52:25.545482+0000","last_became_peered":"2023-10-06T02:52:25.545482+0000","last_unstale":"2023-10-06T02:52:26.560906+0000","last_undegraded":"2023-10-06T02:52:26.560906+0000","last_fullsized":"2023-10-06T02:52:26.560906+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549675+0000","last_change":"2023-10-06T02:52:26.548505+0000","last_active":"2023-10-06T02:52:26.549675+0000","last_peered":"2023-10-06T02:52:26.549675+0000","last_clean":"2023-10-06T02:52:26.549675+0000","last_became_active":"2023-10-06T02:52:26.548108+0000","last_became_peered":"2023-10-06T02:52:26.548108+0000","last_unstale":"2023-10-06T02:52:26.549675+0000","last_undegraded":"2023-10-06T02:52:26.549675+0000","last_fullsized":"2023-10-06T02:52:26.549675+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:19.070290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.558387+0000","last_change":"2023-10-06T02:52:25.543504+0000","last_active":"2023-10-06T02:52:26.558387+0000","last_peered":"2023-10-06T02:52:26.558387+0000","last_clean":"2023-10-06T02:52:26.558387+0000","last_became_active":"2023-10-06T02:52:25.543294+0000","last_became_peered":"2023-10-06T02:52:25.543294+0000","last_unstale":"2023-10-06T02:52:26.558387+0000","last_undegraded":"2023-10-06T02:52:26.558387+0000","last_fullsized":"2023-10-06T02:52:26.558387+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.015668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548204+0000","last_change":"2023-10-06T02:52:26.548165+0000","last_active":"2023-10-06T02:52:26.548204+0000","last_peered":"2023-10-06T02:52:26.548204+0000","last_clean":"2023-10-06T02:52:26.548204+0000","last_became_active":"2023-10-06T02:52:26.547956+0000","last_became_peered":"2023-10-06T02:52:26.547956+0000","last_unstale":"2023-10-06T02:52:26.548204+0000","last_undegraded":"2023-10-06T02:52:26.548204+0000","last_fullsized":"2023-10-06T02:52:26.548204+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.558764+0000","last_change":"2023-10-06T02:52:25.547100+0000","last_active":"2023-10-06T02:52:26.558764+0000","last_peered":"2023-10-06T02:52:26.558764+0000","last_clean":"2023-10-06T02:52:26.558764+0000","last_became_active":"2023-10-06T02:52:25.546711+0000","last_became_peered":"2023-10-06T02:52:25.546711+0000","last_unstale":"2023-10-06T02:52:26.558764+0000","last_undegraded":"2023-10-06T02:52:26.558764+0000","last_fullsized":"2023-10-06T02:52:26.558764+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:55.222375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.550850+0000","last_change":"2023-10-06T02:52:26.550778+0000","last_active":"2023-10-06T02:52:26.550850+0000","last_peered":"2023-10-06T02:52:26.550850+0000","last_clean":"2023-10-06T02:52:26.550850+0000","last_became_active":"2023-10-06T02:52:26.550546+0000","last_became_peered":"2023-10-06T02:52:26.550546+0000","last_unstale":"2023-10-06T02:52:26.550850+0000","last_undegraded":"2023-10-06T02:52:26.550850+0000","last_fullsized":"2023-10-06T02:52:26.550850+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.561321+0000","last_change":"2023-10-06T02:52:25.545503+0000","last_active":"2023-10-06T02:52:26.561321+0000","last_peered":"2023-10-06T02:52:26.561321+0000","last_clean":"2023-10-06T02:52:26.561321+0000","last_became_active":"2023-10-06T02:52:25.543328+0000","last_became_peered":"2023-10-06T02:52:25.543328+0000","last_unstale":"2023-10-06T02:52:26.561321+0000","last_undegraded":"2023-10-06T02:52:26.561321+0000","last_fullsized":"2023-10-06T02:52:26.561321+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:21.145420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.550633+0000","last_change":"2023-10-06T02:52:26.550010+0000","last_active":"2023-10-06T02:52:26.550633+0000","last_peered":"2023-10-06T02:52:26.550633+0000","last_clean":"2023-10-06T02:52:26.550633+0000","last_became_active":"2023-10-06T02:52:26.549443+0000","last_became_peered":"2023-10-06T02:52:26.549443+0000","last_unstale":"2023-10-06T02:52:26.550633+0000","last_undegraded":"2023-10-06T02:52:26.550633+0000","last_fullsized":"2023-10-06T02:52:26.550633+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:32.571020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.538886+0000","last_change":"2023-10-06T02:52:25.544790+0000","last_active":"2023-10-06T02:52:26.538886+0000","last_peered":"2023-10-06T02:52:26.538886+0000","last_clean":"2023-10-06T02:52:26.538886+0000","last_became_active":"2023-10-06T02:52:25.544567+0000","last_became_peered":"2023-10-06T02:52:25.544567+0000","last_unstale":"2023-10-06T02:52:26.538886+0000","last_undegraded":"2023-10-06T02:52:26.538886+0000","last_fullsized":"2023-10-06T02:52:26.538886+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547951+0000","last_change":"2023-10-06T02:52:26.547132+0000","last_active":"2023-10-06T02:52:26.547951+0000","last_peered":"2023-10-06T02:52:26.547951+0000","last_clean":"2023-10-06T02:52:26.547951+0000","last_became_active":"2023-10-06T02:52:26.546889+0000","last_became_peered":"2023-10-06T02:52:26.546889+0000","last_unstale":"2023-10-06T02:52:26.547951+0000","last_undegraded":"2023-10-06T02:52:26.547951+0000","last_fullsized":"2023-10-06T02:52:26.547951+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.537546+0000","last_change":"2023-10-06T02:52:25.545963+0000","last_active":"2023-10-06T02:52:26.537546+0000","last_peered":"2023-10-06T02:52:26.537546+0000","last_clean":"2023-10-06T02:52:26.537546+0000","last_became_active":"2023-10-06T02:52:25.544613+0000","last_became_peered":"2023-10-06T02:52:25.544613+0000","last_unstale":"2023-10-06T02:52:26.537546+0000","last_undegraded":"2023-10-06T02:52:26.537546+0000","last_fullsized":"2023-10-06T02:52:26.537546+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:28.221311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547471+0000","last_change":"2023-10-06T02:52:26.546848+0000","last_active":"2023-10-06T02:52:26.547471+0000","last_peered":"2023-10-06T02:52:26.547471+0000","last_clean":"2023-10-06T02:52:26.547471+0000","last_became_active":"2023-10-06T02:52:26.546595+0000","last_became_peered":"2023-10-06T02:52:26.546595+0000","last_unstale":"2023-10-06T02:52:26.547471+0000","last_undegraded":"2023-10-06T02:52:26.547471+0000","last_fullsized":"2023-10-06T02:52:26.547471+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:03.131444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.557508+0000","last_change":"2023-10-06T02:52:25.544827+0000","last_active":"2023-10-06T02:52:26.557508+0000","last_peered":"2023-10-06T02:52:26.557508+0000","last_clean":"2023-10-06T02:52:26.557508+0000","last_became_active":"2023-10-06T02:52:25.544602+0000","last_became_peered":"2023-10-06T02:52:25.544602+0000","last_unstale":"2023-10-06T02:52:26.557508+0000","last_undegraded":"2023-10-06T02:52:26.557508+0000","last_fullsized":"2023-10-06T02:52:26.557508+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.551802+0000","last_change":"2023-10-06T02:52:26.551731+0000","last_active":"2023-10-06T02:52:26.551802+0000","last_peered":"2023-10-06T02:52:26.551802+0000","last_clean":"2023-10-06T02:52:26.551802+0000","last_became_active":"2023-10-06T02:52:26.551191+0000","last_became_peered":"2023-10-06T02:52:26.551191+0000","last_unstale":"2023-10-06T02:52:26.551802+0000","last_undegraded":"2023-10-06T02:52:26.551802+0000","last_fullsized":"2023-10-06T02:52:26.551802+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:03.131444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.561752+0000","last_change":"2023-10-06T02:52:25.542765+0000","last_active":"2023-10-06T02:52:26.561752+0000","last_peered":"2023-10-06T02:52:26.561752+0000","last_clean":"2023-10-06T02:52:26.561752+0000","last_became_active":"2023-10-06T02:52:25.542333+0000","last_became_peered":"2023-10-06T02:52:25.542333+0000","last_unstale":"2023-10-06T02:52:26.561752+0000","last_undegraded":"2023-10-06T02:52:26.561752+0000","last_fullsized":"2023-10-06T02:52:26.561752+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:48.265643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546025+0000","last_change":"2023-10-06T02:52:26.545943+0000","last_active":"2023-10-06T02:52:26.546025+0000","last_peered":"2023-10-06T02:52:26.546025+0000","last_clean":"2023-10-06T02:52:26.546025+0000","last_became_active":"2023-10-06T02:52:26.545227+0000","last_became_peered":"2023-10-06T02:52:26.545227+0000","last_unstale":"2023-10-06T02:52:26.546025+0000","last_undegraded":"2023-10-06T02:52:26.546025+0000","last_fullsized":"2023-10-06T02:52:26.546025+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:45.678587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.559151+0000","last_change":"2023-10-06T02:52:25.547169+0000","last_active":"2023-10-06T02:52:26.559151+0000","last_peered":"2023-10-06T02:52:26.559151+0000","last_clean":"2023-10-06T02:52:26.559151+0000","last_became_active":"2023-10-06T02:52:25.546959+0000","last_became_peered":"2023-10-06T02:52:25.546959+0000","last_unstale":"2023-10-06T02:52:26.559151+0000","last_undegraded":"2023-10-06T02:52:26.559151+0000","last_fullsized":"2023-10-06T02:52:26.559151+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549744+0000","last_change":"2023-10-06T02:52:26.549628+0000","last_active":"2023-10-06T02:52:26.549744+0000","last_peered":"2023-10-06T02:52:26.549744+0000","last_clean":"2023-10-06T02:52:26.549744+0000","last_became_active":"2023-10-06T02:52:26.549258+0000","last_became_peered":"2023-10-06T02:52:26.549258+0000","last_unstale":"2023-10-06T02:52:26.549744+0000","last_undegraded":"2023-10-06T02:52:26.549744+0000","last_fullsized":"2023-10-06T02:52:26.549744+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.538801+0000","last_change":"2023-10-06T02:52:25.548463+0000","last_active":"2023-10-06T02:52:26.538801+0000","last_peered":"2023-10-06T02:52:26.538801+0000","last_clean":"2023-10-06T02:52:26.538801+0000","last_became_active":"2023-10-06T02:52:25.548237+0000","last_became_peered":"2023-10-06T02:52:25.548237+0000","last_unstale":"2023-10-06T02:52:26.538801+0000","last_undegraded":"2023-10-06T02:52:26.538801+0000","last_fullsized":"2023-10-06T02:52:26.538801+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544217+0000","last_change":"2023-10-06T02:52:26.543773+0000","last_active":"2023-10-06T02:52:26.544217+0000","last_peered":"2023-10-06T02:52:26.544217+0000","last_clean":"2023-10-06T02:52:26.544217+0000","last_became_active":"2023-10-06T02:52:26.543360+0000","last_became_peered":"2023-10-06T02:52:26.543360+0000","last_unstale":"2023-10-06T02:52:26.544217+0000","last_undegraded":"2023-10-06T02:52:26.544217+0000","last_fullsized":"2023-10-06T02:52:26.544217+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:59.214618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.558212+0000","last_change":"2023-10-06T02:52:25.545831+0000","last_active":"2023-10-06T02:52:26.558212+0000","last_peered":"2023-10-06T02:52:26.558212+0000","last_clean":"2023-10-06T02:52:26.558212+0000","last_became_active":"2023-10-06T02:52:25.544736+0000","last_became_peered":"2023-10-06T02:52:25.544736+0000","last_unstale":"2023-10-06T02:52:26.558212+0000","last_undegraded":"2023-10-06T02:52:26.558212+0000","last_fullsized":"2023-10-06T02:52:26.558212+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:04.384554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548927+0000","last_change":"2023-10-06T02:52:26.548883+0000","last_active":"2023-10-06T02:52:26.548927+0000","last_peered":"2023-10-06T02:52:26.548927+0000","last_clean":"2023-10-06T02:52:26.548927+0000","last_became_active":"2023-10-06T02:52:26.548353+0000","last_became_peered":"2023-10-06T02:52:26.548353+0000","last_unstale":"2023-10-06T02:52:26.548927+0000","last_undegraded":"2023-10-06T02:52:26.548927+0000","last_fullsized":"2023-10-06T02:52:26.548927+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:49.559714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539370+0000","last_change":"2023-10-06T02:52:25.543505+0000","last_active":"2023-10-06T02:52:26.539370+0000","last_peered":"2023-10-06T02:52:26.539370+0000","last_clean":"2023-10-06T02:52:26.539370+0000","last_became_active":"2023-10-06T02:52:25.543320+0000","last_became_peered":"2023-10-06T02:52:25.543320+0000","last_unstale":"2023-10-06T02:52:26.539370+0000","last_undegraded":"2023-10-06T02:52:26.539370+0000","last_fullsized":"2023-10-06T02:52:26.539370+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545846+0000","last_change":"2023-10-06T02:52:26.545724+0000","last_active":"2023-10-06T02:52:26.545846+0000","last_peered":"2023-10-06T02:52:26.545846+0000","last_clean":"2023-10-06T02:52:26.545846+0000","last_became_active":"2023-10-06T02:52:26.545493+0000","last_became_peered":"2023-10-06T02:52:26.545493+0000","last_unstale":"2023-10-06T02:52:26.545846+0000","last_undegraded":"2023-10-06T02:52:26.545846+0000","last_fullsized":"2023-10-06T02:52:26.545846+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:58.350339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.543117+0000","last_change":"2023-10-06T02:52:25.538954+0000","last_active":"2023-10-06T02:52:26.543117+0000","last_peered":"2023-10-06T02:52:26.543117+0000","last_clean":"2023-10-06T02:52:26.543117+0000","last_became_active":"2023-10-06T02:52:25.538719+0000","last_became_peered":"2023-10-06T02:52:25.538719+0000","last_unstale":"2023-10-06T02:52:26.543117+0000","last_undegraded":"2023-10-06T02:52:26.543117+0000","last_fullsized":"2023-10-06T02:52:26.543117+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548277+0000","last_change":"2023-10-06T02:52:26.548207+0000","last_active":"2023-10-06T02:52:26.548277+0000","last_peered":"2023-10-06T02:52:26.548277+0000","last_clean":"2023-10-06T02:52:26.548277+0000","last_became_active":"2023-10-06T02:52:26.547623+0000","last_became_peered":"2023-10-06T02:52:26.547623+0000","last_unstale":"2023-10-06T02:52:26.548277+0000","last_undegraded":"2023-10-06T02:52:26.548277+0000","last_fullsized":"2023-10-06T02:52:26.548277+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.538416+0000","last_change":"2023-10-06T02:52:25.545718+0000","last_active":"2023-10-06T02:52:26.538416+0000","last_peered":"2023-10-06T02:52:26.538416+0000","last_clean":"2023-10-06T02:52:26.538416+0000","last_became_active":"2023-10-06T02:52:25.545491+0000","last_became_peered":"2023-10-06T02:52:25.545491+0000","last_unstale":"2023-10-06T02:52:26.538416+0000","last_undegraded":"2023-10-06T02:52:26.538416+0000","last_fullsized":"2023-10-06T02:52:26.538416+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.541383+0000","last_change":"2023-10-06T02:52:26.540826+0000","last_active":"2023-10-06T02:52:26.541383+0000","last_peered":"2023-10-06T02:52:26.541383+0000","last_clean":"2023-10-06T02:52:26.541383+0000","last_became_active":"2023-10-06T02:52:26.540612+0000","last_became_peered":"2023-10-06T02:52:26.540612+0000","last_unstale":"2023-10-06T02:52:26.541383+0000","last_undegraded":"2023-10-06T02:52:26.541383+0000","last_fullsized":"2023-10-06T02:52:26.541383+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:08.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.560197+0000","last_change":"2023-10-06T02:52:25.546086+0000","last_active":"2023-10-06T02:52:26.560197+0000","last_peered":"2023-10-06T02:52:26.560197+0000","last_clean":"2023-10-06T02:52:26.560197+0000","last_became_active":"2023-10-06T02:52:25.545594+0000","last_became_peered":"2023-10-06T02:52:25.545594+0000","last_unstale":"2023-10-06T02:52:26.560197+0000","last_undegraded":"2023-10-06T02:52:26.560197+0000","last_fullsized":"2023-10-06T02:52:26.560197+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:18.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548343+0000","last_change":"2023-10-06T02:52:26.548284+0000","last_active":"2023-10-06T02:52:26.548343+0000","last_peered":"2023-10-06T02:52:26.548343+0000","last_clean":"2023-10-06T02:52:26.548343+0000","last_became_active":"2023-10-06T02:52:26.548082+0000","last_became_peered":"2023-10-06T02:52:26.548082+0000","last_unstale":"2023-10-06T02:52:26.548343+0000","last_undegraded":"2023-10-06T02:52:26.548343+0000","last_fullsized":"2023-10-06T02:52:26.548343+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-06T02:52:27.861195+0000","last_change":"2023-10-06T02:52:25.547920+0000","last_active":"2023-10-06T02:52:27.861195+0000","last_peered":"2023-10-06T02:52:27.861195+0000","last_clean":"2023-10-06T02:52:27.861195+0000","last_became_active":"2023-10-06T02:52:25.547743+0000","last_became_peered":"2023-10-06T02:52:25.547743+0000","last_unstale":"2023-10-06T02:52:27.861195+0000","last_undegraded":"2023-10-06T02:52:27.861195+0000","last_fullsized":"2023-10-06T02:52:27.861195+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549655+0000","last_change":"2023-10-06T02:52:26.548362+0000","last_active":"2023-10-06T02:52:26.549655+0000","last_peered":"2023-10-06T02:52:26.549655+0000","last_clean":"2023-10-06T02:52:26.549655+0000","last_became_active":"2023-10-06T02:52:26.547811+0000","last_became_peered":"2023-10-06T02:52:26.547811+0000","last_unstale":"2023-10-06T02:52:26.549655+0000","last_undegraded":"2023-10-06T02:52:26.549655+0000","last_fullsized":"2023-10-06T02:52:26.549655+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.543228+0000","last_change":"2023-10-06T02:52:25.547752+0000","last_active":"2023-10-06T02:52:26.543228+0000","last_peered":"2023-10-06T02:52:26.543228+0000","last_clean":"2023-10-06T02:52:26.543228+0000","last_became_active":"2023-10-06T02:52:25.547526+0000","last_became_peered":"2023-10-06T02:52:25.547526+0000","last_unstale":"2023-10-06T02:52:26.543228+0000","last_undegraded":"2023-10-06T02:52:26.543228+0000","last_fullsized":"2023-10-06T02:52:26.543228+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:36.026761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545199+0000","last_change":"2023-10-06T02:52:26.545107+0000","last_active":"2023-10-06T02:52:26.545199+0000","last_peered":"2023-10-06T02:52:26.545199+0000","last_clean":"2023-10-06T02:52:26.545199+0000","last_became_active":"2023-10-06T02:52:26.544855+0000","last_became_peered":"2023-10-06T02:52:26.544855+0000","last_unstale":"2023-10-06T02:52:26.545199+0000","last_undegraded":"2023-10-06T02:52:26.545199+0000","last_fullsized":"2023-10-06T02:52:26.545199+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:02.862198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.537631+0000","last_change":"2023-10-06T02:52:25.545836+0000","last_active":"2023-10-06T02:52:26.537631+0000","last_peered":"2023-10-06T02:52:26.537631+0000","last_clean":"2023-10-06T02:52:26.537631+0000","last_became_active":"2023-10-06T02:52:25.544311+0000","last_became_peered":"2023-10-06T02:52:25.544311+0000","last_unstale":"2023-10-06T02:52:26.537631+0000","last_undegraded":"2023-10-06T02:52:26.537631+0000","last_fullsized":"2023-10-06T02:52:26.537631+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:51.912933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544714+0000","last_change":"2023-10-06T02:52:26.544548+0000","last_active":"2023-10-06T02:52:26.544714+0000","last_peered":"2023-10-06T02:52:26.544714+0000","last_clean":"2023-10-06T02:52:26.544714+0000","last_became_active":"2023-10-06T02:52:26.544329+0000","last_became_peered":"2023-10-06T02:52:26.544329+0000","last_unstale":"2023-10-06T02:52:26.544714+0000","last_undegraded":"2023-10-06T02:52:26.544714+0000","last_fullsized":"2023-10-06T02:52:26.544714+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:29.321757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.542984+0000","last_change":"2023-10-06T02:52:25.545621+0000","last_active":"2023-10-06T02:52:26.542984+0000","last_peered":"2023-10-06T02:52:26.542984+0000","last_clean":"2023-10-06T02:52:26.542984+0000","last_became_active":"2023-10-06T02:52:25.545184+0000","last_became_peered":"2023-10-06T02:52:25.545184+0000","last_unstale":"2023-10-06T02:52:26.542984+0000","last_undegraded":"2023-10-06T02:52:26.542984+0000","last_fullsized":"2023-10-06T02:52:26.542984+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:08.888993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549351+0000","last_change":"2023-10-06T02:52:26.549303+0000","last_active":"2023-10-06T02:52:26.549351+0000","last_peered":"2023-10-06T02:52:26.549351+0000","last_clean":"2023-10-06T02:52:26.549351+0000","last_became_active":"2023-10-06T02:52:26.548427+0000","last_became_peered":"2023-10-06T02:52:26.548427+0000","last_unstale":"2023-10-06T02:52:26.549351+0000","last_undegraded":"2023-10-06T02:52:26.549351+0000","last_fullsized":"2023-10-06T02:52:26.549351+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:19.070290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.543867+0000","last_change":"2023-10-06T02:52:25.546929+0000","last_active":"2023-10-06T02:52:26.543867+0000","last_peered":"2023-10-06T02:52:26.543867+0000","last_clean":"2023-10-06T02:52:26.543867+0000","last_became_active":"2023-10-06T02:52:25.546386+0000","last_became_peered":"2023-10-06T02:52:25.546386+0000","last_unstale":"2023-10-06T02:52:26.543867+0000","last_undegraded":"2023-10-06T02:52:26.543867+0000","last_fullsized":"2023-10-06T02:52:26.543867+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:36.519223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546053+0000","last_change":"2023-10-06T02:52:26.545890+0000","last_active":"2023-10-06T02:52:26.546053+0000","last_peered":"2023-10-06T02:52:26.546053+0000","last_clean":"2023-10-06T02:52:26.546053+0000","last_became_active":"2023-10-06T02:52:26.545637+0000","last_became_peered":"2023-10-06T02:52:26.545637+0000","last_unstale":"2023-10-06T02:52:26.546053+0000","last_undegraded":"2023-10-06T02:52:26.546053+0000","last_fullsized":"2023-10-06T02:52:26.546053+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:03.131444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.537087+0000","last_change":"2023-10-06T02:52:25.545690+0000","last_active":"2023-10-06T02:52:26.537087+0000","last_peered":"2023-10-06T02:52:26.537087+0000","last_clean":"2023-10-06T02:52:26.537087+0000","last_became_active":"2023-10-06T02:52:25.544448+0000","last_became_peered":"2023-10-06T02:52:25.544448+0000","last_unstale":"2023-10-06T02:52:26.537087+0000","last_undegraded":"2023-10-06T02:52:26.537087+0000","last_fullsized":"2023-10-06T02:52:26.537087+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:52.270415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547968+0000","last_change":"2023-10-06T02:52:26.547620+0000","last_active":"2023-10-06T02:52:26.547968+0000","last_peered":"2023-10-06T02:52:26.547968+0000","last_clean":"2023-10-06T02:52:26.547968+0000","last_became_active":"2023-10-06T02:52:26.547273+0000","last_became_peered":"2023-10-06T02:52:26.547273+0000","last_unstale":"2023-10-06T02:52:26.547968+0000","last_undegraded":"2023-10-06T02:52:26.547968+0000","last_fullsized":"2023-10-06T02:52:26.547968+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539461+0000","last_change":"2023-10-06T02:52:25.544210+0000","last_active":"2023-10-06T02:52:26.539461+0000","last_peered":"2023-10-06T02:52:26.539461+0000","last_clean":"2023-10-06T02:52:26.539461+0000","last_became_active":"2023-10-06T02:52:25.543966+0000","last_became_peered":"2023-10-06T02:52:25.543966+0000","last_unstale":"2023-10-06T02:52:26.539461+0000","last_undegraded":"2023-10-06T02:52:26.539461+0000","last_fullsized":"2023-10-06T02:52:26.539461+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548801+0000","last_change":"2023-10-06T02:52:26.548585+0000","last_active":"2023-10-06T02:52:26.548801+0000","last_peered":"2023-10-06T02:52:26.548801+0000","last_clean":"2023-10-06T02:52:26.548801+0000","last_became_active":"2023-10-06T02:52:26.547531+0000","last_became_peered":"2023-10-06T02:52:26.547531+0000","last_unstale":"2023-10-06T02:52:26.548801+0000","last_undegraded":"2023-10-06T02:52:26.548801+0000","last_fullsized":"2023-10-06T02:52:26.548801+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.541000+0000","last_change":"2023-10-06T02:52:25.543969+0000","last_active":"2023-10-06T02:52:26.541000+0000","last_peered":"2023-10-06T02:52:26.541000+0000","last_clean":"2023-10-06T02:52:26.541000+0000","last_became_active":"2023-10-06T02:52:25.543754+0000","last_became_peered":"2023-10-06T02:52:25.543754+0000","last_unstale":"2023-10-06T02:52:26.541000+0000","last_undegraded":"2023-10-06T02:52:26.541000+0000","last_fullsized":"2023-10-06T02:52:26.541000+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":111,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539800+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:52:26.539800+0000","last_peered":"2023-10-06T02:52:26.539800+0000","last_clean":"2023-10-06T02:52:26.539800+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:52:26.539800+0000","last_undegraded":"2023-10-06T02:52:26.539800+0000","last_fullsized":"2023-10-06T02:52:26.539800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546390+0000","last_change":"2023-10-06T02:52:26.546297+0000","last_active":"2023-10-06T02:52:26.546390+0000","last_peered":"2023-10-06T02:52:26.546390+0000","last_clean":"2023-10-06T02:52:26.546390+0000","last_became_active":"2023-10-06T02:52:26.546081+0000","last_became_peered":"2023-10-06T02:52:26.546081+0000","last_unstale":"2023-10-06T02:52:26.546390+0000","last_undegraded":"2023-10-06T02:52:26.546390+0000","last_fullsized":"2023-10-06T02:52:26.546390+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:30.734656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544150+0000","last_change":"2023-10-06T02:52:25.544064+0000","last_active":"2023-10-06T02:52:26.544150+0000","last_peered":"2023-10-06T02:52:26.544150+0000","last_clean":"2023-10-06T02:52:26.544150+0000","last_became_active":"2023-10-06T02:52:25.543804+0000","last_became_peered":"2023-10-06T02:52:25.543804+0000","last_unstale":"2023-10-06T02:52:26.544150+0000","last_undegraded":"2023-10-06T02:52:26.544150+0000","last_fullsized":"2023-10-06T02:52:26.544150+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539853+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:52:26.539853+0000","last_peered":"2023-10-06T02:52:26.539853+0000","last_clean":"2023-10-06T02:52:26.539853+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:52:26.539853+0000","last_undegraded":"2023-10-06T02:52:26.539853+0000","last_fullsized":"2023-10-06T02:52:26.539853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548376+0000","last_change":"2023-10-06T02:52:26.547920+0000","last_active":"2023-10-06T02:52:26.548376+0000","last_peered":"2023-10-06T02:52:26.548376+0000","last_clean":"2023-10-06T02:52:26.548376+0000","last_became_active":"2023-10-06T02:52:26.547366+0000","last_became_peered":"2023-10-06T02:52:26.547366+0000","last_unstale":"2023-10-06T02:52:26.548376+0000","last_undegraded":"2023-10-06T02:52:26.548376+0000","last_fullsized":"2023-10-06T02:52:26.548376+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.542351+0000","last_change":"2023-10-06T02:52:25.538066+0000","last_active":"2023-10-06T02:52:26.542351+0000","last_peered":"2023-10-06T02:52:26.542351+0000","last_clean":"2023-10-06T02:52:26.542351+0000","last_became_active":"2023-10-06T02:52:25.537825+0000","last_became_peered":"2023-10-06T02:52:25.537825+0000","last_unstale":"2023-10-06T02:52:26.542351+0000","last_undegraded":"2023-10-06T02:52:26.542351+0000","last_fullsized":"2023-10-06T02:52:26.542351+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539745+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:52:26.539745+0000","last_peered":"2023-10-06T02:52:26.539745+0000","last_clean":"2023-10-06T02:52:26.539745+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:52:26.539745+0000","last_undegraded":"2023-10-06T02:52:26.539745+0000","last_fullsized":"2023-10-06T02:52:26.539745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547821+0000","last_change":"2023-10-06T02:52:26.547003+0000","last_active":"2023-10-06T02:52:26.547821+0000","last_peered":"2023-10-06T02:52:26.547821+0000","last_clean":"2023-10-06T02:52:26.547821+0000","last_became_active":"2023-10-06T02:52:26.546311+0000","last_became_peered":"2023-10-06T02:52:26.546311+0000","last_unstale":"2023-10-06T02:52:26.547821+0000","last_undegraded":"2023-10-06T02:52:26.547821+0000","last_fullsized":"2023-10-06T02:52:26.547821+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:58.350339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"134'8","reported_seq":18,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.561206+0000","last_change":"2023-10-06T02:52:25.543751+0000","last_active":"2023-10-06T02:52:26.561206+0000","last_peered":"2023-10-06T02:52:26.561206+0000","last_clean":"2023-10-06T02:52:26.561206+0000","last_became_active":"2023-10-06T02:52:25.543563+0000","last_became_peered":"2023-10-06T02:52:25.543563+0000","last_unstale":"2023-10-06T02:52:26.561206+0000","last_undegraded":"2023-10-06T02:52:26.561206+0000","last_fullsized":"2023-10-06T02:52:26.561206+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539912+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:52:26.539912+0000","last_peered":"2023-10-06T02:52:26.539912+0000","last_clean":"2023-10-06T02:52:26.539912+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:52:26.539912+0000","last_undegraded":"2023-10-06T02:52:26.539912+0000","last_fullsized":"2023-10-06T02:52:26.539912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":262,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539630+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:52:26.539630+0000","last_peered":"2023-10-06T02:52:26.539630+0000","last_clean":"2023-10-06T02:52:26.539630+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:52:26.539630+0000","last_undegraded":"2023-10-06T02:52:26.539630+0000","last_fullsized":"2023-10-06T02:52:26.539630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548791+0000","last_change":"2023-10-06T02:52:26.547622+0000","last_active":"2023-10-06T02:52:26.548791+0000","last_peered":"2023-10-06T02:52:26.548791+0000","last_clean":"2023-10-06T02:52:26.548791+0000","last_became_active":"2023-10-06T02:52:26.547367+0000","last_became_peered":"2023-10-06T02:52:26.547367+0000","last_unstale":"2023-10-06T02:52:26.548791+0000","last_undegraded":"2023-10-06T02:52:26.548791+0000","last_fullsized":"2023-10-06T02:52:26.548791+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.560983+0000","last_change":"2023-10-06T02:52:25.541005+0000","last_active":"2023-10-06T02:52:26.560983+0000","last_peered":"2023-10-06T02:52:26.560983+0000","last_clean":"2023-10-06T02:52:26.560983+0000","last_became_active":"2023-10-06T02:52:25.540862+0000","last_became_peered":"2023-10-06T02:52:25.540862+0000","last_unstale":"2023-10-06T02:52:26.560983+0000","last_undegraded":"2023-10-06T02:52:26.560983+0000","last_fullsized":"2023-10-06T02:52:26.560983+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539540+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:52:26.539540+0000","last_peered":"2023-10-06T02:52:26.539540+0000","last_clean":"2023-10-06T02:52:26.539540+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:52:26.539540+0000","last_undegraded":"2023-10-06T02:52:26.539540+0000","last_fullsized":"2023-10-06T02:52:26.539540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548442+0000","last_change":"2023-10-06T02:52:26.548352+0000","last_active":"2023-10-06T02:52:26.548442+0000","last_peered":"2023-10-06T02:52:26.548442+0000","last_clean":"2023-10-06T02:52:26.548442+0000","last_became_active":"2023-10-06T02:52:26.547974+0000","last_became_peered":"2023-10-06T02:52:26.547974+0000","last_unstale":"2023-10-06T02:52:26.548442+0000","last_undegraded":"2023-10-06T02:52:26.548442+0000","last_fullsized":"2023-10-06T02:52:26.548442+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539773+0000","last_change":"2023-10-06T02:52:25.546234+0000","last_active":"2023-10-06T02:52:26.539773+0000","last_peered":"2023-10-06T02:52:26.539773+0000","last_clean":"2023-10-06T02:52:26.539773+0000","last_became_active":"2023-10-06T02:52:25.545953+0000","last_became_peered":"2023-10-06T02:52:25.545953+0000","last_unstale":"2023-10-06T02:52:26.539773+0000","last_undegraded":"2023-10-06T02:52:26.539773+0000","last_fullsized":"2023-10-06T02:52:26.539773+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:42.320760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539708+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:52:26.539708+0000","last_peered":"2023-10-06T02:52:26.539708+0000","last_clean":"2023-10-06T02:52:26.539708+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:52:26.539708+0000","last_undegraded":"2023-10-06T02:52:26.539708+0000","last_fullsized":"2023-10-06T02:52:26.539708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547078+0000","last_change":"2023-10-06T02:52:26.546893+0000","last_active":"2023-10-06T02:52:26.547078+0000","last_peered":"2023-10-06T02:52:26.547078+0000","last_clean":"2023-10-06T02:52:26.547078+0000","last_became_active":"2023-10-06T02:52:26.546660+0000","last_became_peered":"2023-10-06T02:52:26.546660+0000","last_unstale":"2023-10-06T02:52:26.547078+0000","last_undegraded":"2023-10-06T02:52:26.547078+0000","last_fullsized":"2023-10-06T02:52:26.547078+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:03.131444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"134'3","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.558824+0000","last_change":"2023-10-06T02:52:25.546603+0000","last_active":"2023-10-06T02:52:26.558824+0000","last_peered":"2023-10-06T02:52:26.558824+0000","last_clean":"2023-10-06T02:52:26.558824+0000","last_became_active":"2023-10-06T02:52:25.546366+0000","last_became_peered":"2023-10-06T02:52:25.546366+0000","last_unstale":"2023-10-06T02:52:26.558824+0000","last_undegraded":"2023-10-06T02:52:26.558824+0000","last_fullsized":"2023-10-06T02:52:26.558824+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":111,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539029+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:52:26.539029+0000","last_peered":"2023-10-06T02:52:26.539029+0000","last_clean":"2023-10-06T02:52:26.539029+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:52:26.539029+0000","last_undegraded":"2023-10-06T02:52:26.539029+0000","last_fullsized":"2023-10-06T02:52:26.539029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548958+0000","last_change":"2023-10-06T02:52:26.548874+0000","last_active":"2023-10-06T02:52:26.548958+0000","last_peered":"2023-10-06T02:52:26.548958+0000","last_clean":"2023-10-06T02:52:26.548958+0000","last_became_active":"2023-10-06T02:52:26.548472+0000","last_became_peered":"2023-10-06T02:52:26.548472+0000","last_unstale":"2023-10-06T02:52:26.548958+0000","last_undegraded":"2023-10-06T02:52:26.548958+0000","last_fullsized":"2023-10-06T02:52:26.548958+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"134'6","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.561844+0000","last_change":"2023-10-06T02:52:25.543355+0000","last_active":"2023-10-06T02:52:26.561844+0000","last_peered":"2023-10-06T02:52:26.561844+0000","last_clean":"2023-10-06T02:52:26.561844+0000","last_became_active":"2023-10-06T02:52:25.543138+0000","last_became_peered":"2023-10-06T02:52:25.543138+0000","last_unstale":"2023-10-06T02:52:26.561844+0000","last_undegraded":"2023-10-06T02:52:26.561844+0000","last_fullsized":"2023-10-06T02:52:26.561844+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.541734+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:52:26.541734+0000","last_peered":"2023-10-06T02:52:26.541734+0000","last_clean":"2023-10-06T02:52:26.541734+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:52:26.541734+0000","last_undegraded":"2023-10-06T02:52:26.541734+0000","last_fullsized":"2023-10-06T02:52:26.541734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193965,"statfs":{"total":200000000,"available":198620348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70799999999999996,"5min":0.80600000000000005,"15min":1.393},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.33800000000000002,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":1.5569999999999999},"last":0.248}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.627,"5min":0.76400000000000001,"15min":1.081},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":1.4710000000000001},"last":0.311}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.48699999999999999},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58899999999999997,"15min":0.63500000000000001},"min":{"1min":0.35899999999999999,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.65900000000000003,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.29399999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.61199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.65700000000000003,"5min":3.0649999999999999,"15min":3.4870000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.58499999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.69999999999999996,"5min":0.97899999999999998,"15min":2.2349999999999999},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.44},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72599999999999998},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.879},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.33600000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.44,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76300000000000001},"last":0.48799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194541,"statfs":{"total":200000000,"available":199210910,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.60999999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64800000000000002,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.434},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.64100000000000001,"5min":0.75700000000000001,"15min":1.879},"last":0.501}]},{"osd":1,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53000000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67800000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53700000000000003,"15min":0.94599999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65700000000000003,"5min":0.80000000000000004,"15min":11.957000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.51000000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66900000000000004,"5min":1.042,"15min":1.0580000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.39400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69899999999999995,"5min":0.83399999999999996,"15min":0.95799999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.80100000000000005,"15min":1.163},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":1.05,"15min":1.05},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.498,"15min":0.56100000000000005},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48199999999999998,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.60199999999999998},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.54800000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.61199999999999999},"min":{"1min":0.33600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.73699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211442,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.314,"15min":0.313},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.40799999999999997,"5min":0.501,"15min":0.501},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35199999999999998,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46300000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33300000000000002,"15min":0.32200000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.36299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.23400000000000001},"max":{"1min":0.42299999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.996,"15min":0.996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.43099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.53900000000000003},"min":{"1min":0.49399999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.58699999999999997,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39000000000000001},"max":{"1min":0.71699999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56799999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60599999999999998,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.006},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.57399999999999995},"min":{"1min":0.54900000000000004,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":0.88200000000000001},"last":0.51700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1346,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193965,"statfs":{"total":200000000,"available":198621074,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33100000000000002,"15min":0.34699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.45600000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.312},{"interface":"front","average":{"1min":0.373,"5min":0.375,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":1.0389999999999999},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.188},"max":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":22.038},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":1.3779999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.36099999999999999},"min":{"1min":0.22,"5min":0.183,"15min":0.183},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":1.071},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.253},"max":{"1min":0.498,"5min":0.63300000000000001,"15min":21.942},"last":0.32600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70499999999999996,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":1.1419999999999999},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.86499999999999999,"15min":11.122999999999999},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":1.2290000000000001},"min":{"1min":0.38400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71999999999999997,"5min":0.80200000000000005,"15min":22.010999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.69799999999999995,"5min":0.83899999999999997,"15min":1.401},"last":0.436}]},{"osd":6,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":1.171},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73499999999999999,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":1.254},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.84799999999999998,"15min":21.98},"last":0.45500000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.70899999999999996,"5min":0.91000000000000003,"15min":1.425},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.90300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.71999999999999997,"5min":0.81899999999999995,"15min":11.154},"last":0.46600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"min":{"1min":0.215,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.41799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.311},{"interface":"front","average":{"1min":0.316,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.24099999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.40200000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.28199999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.39800000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.248},{"interface":"front","average":{"1min":0.38,"5min":0.41699999999999998,"15min":0.38900000000000001},"min":{"1min":0.315,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.47499999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39400000000000002,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.499,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.38},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51300000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.056,"15min":1.056},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81599999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.628,"15min":0.59199999999999997},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83399999999999996,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.56000000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.505},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68700000000000006,"5min":1.002,"15min":1.002},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60799999999999998,"15min":0.58699999999999997},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.86499999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.52600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":771,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209894,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.318,"15min":0.307},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.439,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.37,"15min":0.33300000000000002},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.56999999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.25800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.35299999999999998,"15min":0.33000000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.45100000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.316},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.378,"15min":0.34799999999999998},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.58499999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41199999999999998,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.65900000000000003,"5min":3.044,"15min":3.044},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.249},"max":{"1min":0.45100000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.375}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.446,"5min":1.446,"15min":2.2120000000000002},"last":0.627},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.327,"5min":1.327,"15min":2.25},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58599999999999997,"15min":0.68799999999999994},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.44500000000000001,"15min":0.38600000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.94099999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.442,"5min":0.372,"15min":0.372},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":771,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209928,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.5,"15min":0.78100000000000003},"min":{"1min":0.39600000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.62},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.221},"max":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52100000000000002,"15min":0.81299999999999994},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65900000000000003,"5min":0.70599999999999996,"15min":5.9329999999999998},"last":0.503},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52000000000000002,"15min":0.76700000000000002},"min":{"1min":0.373,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.67800000000000005,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.75900000000000001,"15min":5.4390000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.67100000000000004},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.61199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.77000000000000002,"15min":3.456},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.245},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.443},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.59699999999999998,"15min":1.0069999999999999},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":13.173999999999999},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211304,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.69399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.27400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.5},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.41599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.6269999999999998,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44}]},{"osd":4,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.32700000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.63800000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68000000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71999999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73499999999999999,"5min":0.879,"15min":0.879},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.47599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.74299999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51500000000000001}]}]}],"pool_statfs":[]}} 2023-10-06T02:52:35.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:52:35.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.235+0000 7fbad4023700 1 Processor -- start 2023-10-06T02:52:35.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.235+0000 7fbad4023700 1 -- start start 2023-10-06T02:52:35.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad4023700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbacc15e170 0x7fbacc0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad4023700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbacc15e540 0x7fbacc06d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad4023700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc0cfdd0 0x7fbacc06d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad4023700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc0cf940 con 0x7fbacc15e540 2023-10-06T02:52:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad4023700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc0cf010 con 0x7fbacc15e170 2023-10-06T02:52:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad4023700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0cf2f0 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad15be700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbacc15e540 0x7fbacc06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad15be700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbacc15e540 0x7fbacc06d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55852/0 (socket says 172.21.15.81:55852) 2023-10-06T02:52:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad15be700 1 -- 172.21.15.81:0/1707453451 learned_addr learned my addr 172.21.15.81:0/1707453451 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad25c0700 1 --2- 172.21.15.81:0/1707453451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc0cfdd0 0x7fbacc06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad1dbf700 1 --2- 172.21.15.81:0/1707453451 >> v2:172.21.15.83:3300/0 conn(0x7fbacc15e170 0x7fbacc0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad15be700 1 -- 172.21.15.81:0/1707453451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc0cfdd0 msgr2=0x7fbacc06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad15be700 1 --2- 172.21.15.81:0/1707453451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc0cfdd0 0x7fbacc06d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad15be700 1 -- 172.21.15.81:0/1707453451 >> v2:172.21.15.83:3300/0 conn(0x7fbacc15e170 msgr2=0x7fbacc0b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad15be700 1 --2- 172.21.15.81:0/1707453451 >> v2:172.21.15.83:3300/0 conn(0x7fbacc15e170 0x7fbacc0b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad15be700 1 -- 172.21.15.81:0/1707453451 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0cf5d0 con 0x7fbacc15e540 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad25c0700 1 --2- 172.21.15.81:0/1707453451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc0cfdd0 0x7fbacc06d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad15be700 1 --2- 172.21.15.81:0/1707453451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc15e540 0x7fbacc06d120 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0646e0 tx=0x7fbabc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32642d92d4481c7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad0dbd700 1 -- 172.21.15.81:0/1707453451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00b860 con 0x7fbacc15e540 2023-10-06T02:52:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad0dbd700 1 -- 172.21.15.81:0/1707453451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc00b9c0 con 0x7fbacc15e540 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.236+0000 7fbad0dbd700 1 -- 172.21.15.81:0/1707453451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00bd60 con 0x7fbacc15e540 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.237+0000 7fbad4023700 1 -- 172.21.15.81:0/1707453451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc15e540 msgr2=0x7fbacc06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.237+0000 7fbad4023700 1 --2- 172.21.15.81:0/1707453451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc15e540 0x7fbacc06d120 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0646e0 tx=0x7fbabc009250 comp rx=0 tx=0).stop 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.237+0000 7fbad4023700 1 -- 172.21.15.81:0/1707453451 shutdown_connections 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.237+0000 7fbad4023700 1 --2- 172.21.15.81:0/1707453451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc0cfdd0 0x7fbacc06d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.237+0000 7fbad4023700 1 --2- 172.21.15.81:0/1707453451 >> v2:172.21.15.83:3300/0 conn(0x7fbacc15e170 0x7fbacc0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.237+0000 7fbad4023700 1 --2- 172.21.15.81:0/1707453451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc15e540 0x7fbacc06d120 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.237+0000 7fbad4023700 1 -- 172.21.15.81:0/1707453451 >> 172.21.15.81:0/1707453451 conn(0x7fbacc06bb90 msgr2=0x7fbacc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.237+0000 7fbad4023700 1 -- 172.21.15.81:0/1707453451 shutdown_connections 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.237+0000 7fbad4023700 1 -- 172.21.15.81:0/1707453451 wait complete. 2023-10-06T02:52:35.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.238+0000 7fbad4023700 1 Processor -- start 2023-10-06T02:52:35.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.238+0000 7fbad4023700 1 -- start start 2023-10-06T02:52:35.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad4023700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc0cfdd0 0x7fbacc08be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad4023700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc15e170 0x7fbacc0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad4023700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbacc15e540 0x7fbacc0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad4023700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc15c060 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad4023700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc15c1f0 con 0x7fbacc15e540 2023-10-06T02:52:35.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad4023700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc08c460 con 0x7fbacc15e170 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad1dbf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc0cfdd0 0x7fbacc08be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad1dbf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc0cfdd0 0x7fbacc08be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55864/0 (socket says 172.21.15.81:55864) 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad1dbf700 1 -- 172.21.15.81:0/473028494 learned_addr learned my addr 172.21.15.81:0/473028494 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad15be700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc15e170 0x7fbacc0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad1dbf700 1 -- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc15e170 msgr2=0x7fbacc0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad1dbf700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc15e170 0x7fbacc0d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad1dbf700 1 -- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbacc15e540 msgr2=0x7fbacc0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad25c0700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbacc15e540 0x7fbacc0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad1dbf700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbacc15e540 0x7fbacc0d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad1dbf700 1 -- 172.21.15.81:0/473028494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc0094f0 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.239+0000 7fbad25c0700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbacc15e540 0x7fbacc0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.240+0000 7fbad1dbf700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc0cfdd0 0x7fbacc08be80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbac800e190 tx=0x7fbac8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.240+0000 7fbac1ffb700 1 -- 172.21.15.81:0/473028494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac800ee30 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.240+0000 7fbac1ffb700 1 -- 172.21.15.81:0/473028494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8014420 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.240+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbacc08c740 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.240+0000 7fbac1ffb700 1 -- 172.21.15.81:0/473028494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80147c0 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.240+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbacc08cd00 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.241+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbacc067ac0 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.241+0000 7fbac1ffb700 1 -- 172.21.15.81:0/473028494 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbac8014b70 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.242+0000 7fbac1ffb700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbab0066f30 0x7fbab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.242+0000 7fbac1ffb700 1 -- 172.21.15.81:0/473028494 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbac8084e10 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.242+0000 7fbad15be700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbab0066f30 0x7fbab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.242+0000 7fbad15be700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbab0066f30 0x7fbab00693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0646e0 tx=0x7fbabc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:35.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.246+0000 7fbac1ffb700 1 -- 172.21.15.81:0/473028494 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbac8051f20 con 0x7fbacc0cfdd0 2023-10-06T02:52:35.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.423+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbacc15c330 con 0x7fbab0066f30 2023-10-06T02:52:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.432+0000 7fbac1ffb700 1 -- 172.21.15.81:0/473028494 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305781 (secure 0 0 0) 0x7fbabc00bb30 con 0x7fbab0066f30 2023-10-06T02:52:35.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbab0066f30 msgr2=0x7fbab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbab0066f30 0x7fbab00693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0646e0 tx=0x7fbabc017000 comp rx=0 tx=0).stop 2023-10-06T02:52:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc0cfdd0 msgr2=0x7fbacc08be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc0cfdd0 0x7fbacc08be80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbac800e190 tx=0x7fbac8009920 comp rx=0 tx=0).stop 2023-10-06T02:52:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 shutdown_connections 2023-10-06T02:52:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbab0066f30 0x7fbab00693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbacc15e540 0x7fbacc0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc0cfdd0 0x7fbacc08be80 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 --2- 172.21.15.81:0/473028494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbacc15e170 0x7fbacc0d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 >> 172.21.15.81:0/473028494 conn(0x7fbacc06bb90 msgr2=0x7fbacc068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:35.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 shutdown_connections 2023-10-06T02:52:35.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.435+0000 7fbad4023700 1 -- 172.21.15.81:0/473028494 wait complete. 2023-10-06T02:52:35.441 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:52:35.448 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2023-10-06T02:52:33.584700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555181,"statfs":{"total":1600000000,"available":1592506364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002067"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547250+0000","last_change":"2023-10-06T02:52:26.547165+0000","last_active":"2023-10-06T02:52:26.547250+0000","last_peered":"2023-10-06T02:52:26.547250+0000","last_clean":"2023-10-06T02:52:26.547250+0000","last_became_active":"2023-10-06T02:52:26.546893+0000","last_became_peered":"2023-10-06T02:52:26.546893+0000","last_unstale":"2023-10-06T02:52:26.547250+0000","last_undegraded":"2023-10-06T02:52:26.547250+0000","last_fullsized":"2023-10-06T02:52:26.547250+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:58.350339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547784+0000","last_change":"2023-10-06T02:52:26.547716+0000","last_active":"2023-10-06T02:52:26.547784+0000","last_peered":"2023-10-06T02:52:26.547784+0000","last_clean":"2023-10-06T02:52:26.547784+0000","last_became_active":"2023-10-06T02:52:26.547500+0000","last_became_peered":"2023-10-06T02:52:26.547500+0000","last_unstale":"2023-10-06T02:52:26.547784+0000","last_undegraded":"2023-10-06T02:52:26.547784+0000","last_fullsized":"2023-10-06T02:52:26.547784+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549770+0000","last_change":"2023-10-06T02:52:26.549726+0000","last_active":"2023-10-06T02:52:26.549770+0000","last_peered":"2023-10-06T02:52:26.549770+0000","last_clean":"2023-10-06T02:52:26.549770+0000","last_became_active":"2023-10-06T02:52:26.548998+0000","last_became_peered":"2023-10-06T02:52:26.548998+0000","last_unstale":"2023-10-06T02:52:26.549770+0000","last_undegraded":"2023-10-06T02:52:26.549770+0000","last_fullsized":"2023-10-06T02:52:26.549770+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:49.493406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546039+0000","last_change":"2023-10-06T02:52:26.545760+0000","last_active":"2023-10-06T02:52:26.546039+0000","last_peered":"2023-10-06T02:52:26.546039+0000","last_clean":"2023-10-06T02:52:26.546039+0000","last_became_active":"2023-10-06T02:52:26.545411+0000","last_became_peered":"2023-10-06T02:52:26.545411+0000","last_unstale":"2023-10-06T02:52:26.546039+0000","last_undegraded":"2023-10-06T02:52:26.546039+0000","last_fullsized":"2023-10-06T02:52:26.546039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545385+0000","last_change":"2023-10-06T02:52:26.545025+0000","last_active":"2023-10-06T02:52:26.545385+0000","last_peered":"2023-10-06T02:52:26.545385+0000","last_clean":"2023-10-06T02:52:26.545385+0000","last_became_active":"2023-10-06T02:52:26.544291+0000","last_became_peered":"2023-10-06T02:52:26.544291+0000","last_unstale":"2023-10-06T02:52:26.545385+0000","last_undegraded":"2023-10-06T02:52:26.545385+0000","last_fullsized":"2023-10-06T02:52:26.545385+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:24.087056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545790+0000","last_change":"2023-10-06T02:52:26.545248+0000","last_active":"2023-10-06T02:52:26.545790+0000","last_peered":"2023-10-06T02:52:26.545790+0000","last_clean":"2023-10-06T02:52:26.545790+0000","last_became_active":"2023-10-06T02:52:26.544185+0000","last_became_peered":"2023-10-06T02:52:26.544185+0000","last_unstale":"2023-10-06T02:52:26.545790+0000","last_undegraded":"2023-10-06T02:52:26.545790+0000","last_fullsized":"2023-10-06T02:52:26.545790+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:54.488413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547413+0000","last_change":"2023-10-06T02:52:26.547347+0000","last_active":"2023-10-06T02:52:26.547413+0000","last_peered":"2023-10-06T02:52:26.547413+0000","last_clean":"2023-10-06T02:52:26.547413+0000","last_became_active":"2023-10-06T02:52:26.546938+0000","last_became_peered":"2023-10-06T02:52:26.546938+0000","last_unstale":"2023-10-06T02:52:26.547413+0000","last_undegraded":"2023-10-06T02:52:26.547413+0000","last_fullsized":"2023-10-06T02:52:26.547413+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:48.831646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549642+0000","last_change":"2023-10-06T02:52:26.549598+0000","last_active":"2023-10-06T02:52:26.549642+0000","last_peered":"2023-10-06T02:52:26.549642+0000","last_clean":"2023-10-06T02:52:26.549642+0000","last_became_active":"2023-10-06T02:52:26.548789+0000","last_became_peered":"2023-10-06T02:52:26.548789+0000","last_unstale":"2023-10-06T02:52:26.549642+0000","last_undegraded":"2023-10-06T02:52:26.549642+0000","last_fullsized":"2023-10-06T02:52:26.549642+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:02.641276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546023+0000","last_change":"2023-10-06T02:52:26.545629+0000","last_active":"2023-10-06T02:52:26.546023+0000","last_peered":"2023-10-06T02:52:26.546023+0000","last_clean":"2023-10-06T02:52:26.546023+0000","last_became_active":"2023-10-06T02:52:26.544655+0000","last_became_peered":"2023-10-06T02:52:26.544655+0000","last_unstale":"2023-10-06T02:52:26.546023+0000","last_undegraded":"2023-10-06T02:52:26.546023+0000","last_fullsized":"2023-10-06T02:52:26.546023+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:24.087056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544170+0000","last_change":"2023-10-06T02:52:26.543648+0000","last_active":"2023-10-06T02:52:26.544170+0000","last_peered":"2023-10-06T02:52:26.544170+0000","last_clean":"2023-10-06T02:52:26.544170+0000","last_became_active":"2023-10-06T02:52:26.543432+0000","last_became_peered":"2023-10-06T02:52:26.543432+0000","last_unstale":"2023-10-06T02:52:26.544170+0000","last_undegraded":"2023-10-06T02:52:26.544170+0000","last_fullsized":"2023-10-06T02:52:26.544170+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.551931+0000","last_change":"2023-10-06T02:52:26.551848+0000","last_active":"2023-10-06T02:52:26.551931+0000","last_peered":"2023-10-06T02:52:26.551931+0000","last_clean":"2023-10-06T02:52:26.551931+0000","last_became_active":"2023-10-06T02:52:26.551516+0000","last_became_peered":"2023-10-06T02:52:26.551516+0000","last_unstale":"2023-10-06T02:52:26.551931+0000","last_undegraded":"2023-10-06T02:52:26.551931+0000","last_fullsized":"2023-10-06T02:52:26.551931+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:02.641276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544730+0000","last_change":"2023-10-06T02:52:26.544662+0000","last_active":"2023-10-06T02:52:26.544730+0000","last_peered":"2023-10-06T02:52:26.544730+0000","last_clean":"2023-10-06T02:52:26.544730+0000","last_became_active":"2023-10-06T02:52:26.544458+0000","last_became_peered":"2023-10-06T02:52:26.544458+0000","last_unstale":"2023-10-06T02:52:26.544730+0000","last_undegraded":"2023-10-06T02:52:26.544730+0000","last_fullsized":"2023-10-06T02:52:26.544730+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:01.189585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548150+0000","last_change":"2023-10-06T02:52:26.548096+0000","last_active":"2023-10-06T02:52:26.548150+0000","last_peered":"2023-10-06T02:52:26.548150+0000","last_clean":"2023-10-06T02:52:26.548150+0000","last_became_active":"2023-10-06T02:52:26.547869+0000","last_became_peered":"2023-10-06T02:52:26.547869+0000","last_unstale":"2023-10-06T02:52:26.548150+0000","last_undegraded":"2023-10-06T02:52:26.548150+0000","last_fullsized":"2023-10-06T02:52:26.548150+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547096+0000","last_change":"2023-10-06T02:52:26.546946+0000","last_active":"2023-10-06T02:52:26.547096+0000","last_peered":"2023-10-06T02:52:26.547096+0000","last_clean":"2023-10-06T02:52:26.547096+0000","last_became_active":"2023-10-06T02:52:26.546695+0000","last_became_peered":"2023-10-06T02:52:26.546695+0000","last_unstale":"2023-10-06T02:52:26.547096+0000","last_undegraded":"2023-10-06T02:52:26.547096+0000","last_fullsized":"2023-10-06T02:52:26.547096+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:57.641548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545366+0000","last_change":"2023-10-06T02:52:26.544887+0000","last_active":"2023-10-06T02:52:26.545366+0000","last_peered":"2023-10-06T02:52:26.545366+0000","last_clean":"2023-10-06T02:52:26.545366+0000","last_became_active":"2023-10-06T02:52:26.543983+0000","last_became_peered":"2023-10-06T02:52:26.543983+0000","last_unstale":"2023-10-06T02:52:26.545366+0000","last_undegraded":"2023-10-06T02:52:26.545366+0000","last_fullsized":"2023-10-06T02:52:26.545366+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:19.070290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.542402+0000","last_change":"2023-10-06T02:52:26.542343+0000","last_active":"2023-10-06T02:52:26.542402+0000","last_peered":"2023-10-06T02:52:26.542402+0000","last_clean":"2023-10-06T02:52:26.542402+0000","last_became_active":"2023-10-06T02:52:26.542119+0000","last_became_peered":"2023-10-06T02:52:26.542119+0000","last_unstale":"2023-10-06T02:52:26.542402+0000","last_undegraded":"2023-10-06T02:52:26.542402+0000","last_fullsized":"2023-10-06T02:52:26.542402+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:24.583171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548520+0000","last_change":"2023-10-06T02:52:26.548469+0000","last_active":"2023-10-06T02:52:26.548520+0000","last_peered":"2023-10-06T02:52:26.548520+0000","last_clean":"2023-10-06T02:52:26.548520+0000","last_became_active":"2023-10-06T02:52:26.547659+0000","last_became_peered":"2023-10-06T02:52:26.547659+0000","last_unstale":"2023-10-06T02:52:26.548520+0000","last_undegraded":"2023-10-06T02:52:26.548520+0000","last_fullsized":"2023-10-06T02:52:26.548520+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.550642+0000","last_change":"2023-10-06T02:52:26.550585+0000","last_active":"2023-10-06T02:52:26.550642+0000","last_peered":"2023-10-06T02:52:26.550642+0000","last_clean":"2023-10-06T02:52:26.550642+0000","last_became_active":"2023-10-06T02:52:26.550404+0000","last_became_peered":"2023-10-06T02:52:26.550404+0000","last_unstale":"2023-10-06T02:52:26.550642+0000","last_undegraded":"2023-10-06T02:52:26.550642+0000","last_fullsized":"2023-10-06T02:52:26.550642+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:31.567028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548826+0000","last_change":"2023-10-06T02:52:26.548721+0000","last_active":"2023-10-06T02:52:26.548826+0000","last_peered":"2023-10-06T02:52:26.548826+0000","last_clean":"2023-10-06T02:52:26.548826+0000","last_became_active":"2023-10-06T02:52:26.547803+0000","last_became_peered":"2023-10-06T02:52:26.547803+0000","last_unstale":"2023-10-06T02:52:26.548826+0000","last_undegraded":"2023-10-06T02:52:26.548826+0000","last_fullsized":"2023-10-06T02:52:26.548826+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546788+0000","last_change":"2023-10-06T02:52:26.546725+0000","last_active":"2023-10-06T02:52:26.546788+0000","last_peered":"2023-10-06T02:52:26.546788+0000","last_clean":"2023-10-06T02:52:26.546788+0000","last_became_active":"2023-10-06T02:52:26.546455+0000","last_became_peered":"2023-10-06T02:52:26.546455+0000","last_unstale":"2023-10-06T02:52:26.546788+0000","last_undegraded":"2023-10-06T02:52:26.546788+0000","last_fullsized":"2023-10-06T02:52:26.546788+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:47.345805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545997+0000","last_change":"2023-10-06T02:52:26.545281+0000","last_active":"2023-10-06T02:52:26.545997+0000","last_peered":"2023-10-06T02:52:26.545997+0000","last_clean":"2023-10-06T02:52:26.545997+0000","last_became_active":"2023-10-06T02:52:26.545043+0000","last_became_peered":"2023-10-06T02:52:26.545043+0000","last_unstale":"2023-10-06T02:52:26.545997+0000","last_undegraded":"2023-10-06T02:52:26.545997+0000","last_fullsized":"2023-10-06T02:52:26.545997+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549699+0000","last_change":"2023-10-06T02:52:26.548917+0000","last_active":"2023-10-06T02:52:26.549699+0000","last_peered":"2023-10-06T02:52:26.549699+0000","last_clean":"2023-10-06T02:52:26.549699+0000","last_became_active":"2023-10-06T02:52:26.548671+0000","last_became_peered":"2023-10-06T02:52:26.548671+0000","last_unstale":"2023-10-06T02:52:26.549699+0000","last_undegraded":"2023-10-06T02:52:26.549699+0000","last_fullsized":"2023-10-06T02:52:26.549699+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:49.493406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.550363+0000","last_change":"2023-10-06T02:52:26.549838+0000","last_active":"2023-10-06T02:52:26.550363+0000","last_peered":"2023-10-06T02:52:26.550363+0000","last_clean":"2023-10-06T02:52:26.550363+0000","last_became_active":"2023-10-06T02:52:26.549607+0000","last_became_peered":"2023-10-06T02:52:26.549607+0000","last_unstale":"2023-10-06T02:52:26.550363+0000","last_undegraded":"2023-10-06T02:52:26.550363+0000","last_fullsized":"2023-10-06T02:52:26.550363+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:02.641276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545612+0000","last_change":"2023-10-06T02:52:26.545133+0000","last_active":"2023-10-06T02:52:26.545612+0000","last_peered":"2023-10-06T02:52:26.545612+0000","last_clean":"2023-10-06T02:52:26.545612+0000","last_became_active":"2023-10-06T02:52:26.544897+0000","last_became_peered":"2023-10-06T02:52:26.544897+0000","last_unstale":"2023-10-06T02:52:26.545612+0000","last_undegraded":"2023-10-06T02:52:26.545612+0000","last_fullsized":"2023-10-06T02:52:26.545612+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544537+0000","last_change":"2023-10-06T02:52:26.544420+0000","last_active":"2023-10-06T02:52:26.544537+0000","last_peered":"2023-10-06T02:52:26.544537+0000","last_clean":"2023-10-06T02:52:26.544537+0000","last_became_active":"2023-10-06T02:52:26.544171+0000","last_became_peered":"2023-10-06T02:52:26.544171+0000","last_unstale":"2023-10-06T02:52:26.544537+0000","last_undegraded":"2023-10-06T02:52:26.544537+0000","last_fullsized":"2023-10-06T02:52:26.544537+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:09.278471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545182+0000","last_change":"2023-10-06T02:52:26.545102+0000","last_active":"2023-10-06T02:52:26.545182+0000","last_peered":"2023-10-06T02:52:26.545182+0000","last_clean":"2023-10-06T02:52:26.545182+0000","last_became_active":"2023-10-06T02:52:26.544698+0000","last_became_peered":"2023-10-06T02:52:26.544698+0000","last_unstale":"2023-10-06T02:52:26.545182+0000","last_undegraded":"2023-10-06T02:52:26.545182+0000","last_fullsized":"2023-10-06T02:52:26.545182+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:08.940922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545651+0000","last_change":"2023-10-06T02:52:26.545587+0000","last_active":"2023-10-06T02:52:26.545651+0000","last_peered":"2023-10-06T02:52:26.545651+0000","last_clean":"2023-10-06T02:52:26.545651+0000","last_became_active":"2023-10-06T02:52:26.545436+0000","last_became_peered":"2023-10-06T02:52:26.545436+0000","last_unstale":"2023-10-06T02:52:26.545651+0000","last_undegraded":"2023-10-06T02:52:26.545651+0000","last_fullsized":"2023-10-06T02:52:26.545651+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544199+0000","last_change":"2023-10-06T02:52:26.543618+0000","last_active":"2023-10-06T02:52:26.544199+0000","last_peered":"2023-10-06T02:52:26.544199+0000","last_clean":"2023-10-06T02:52:26.544199+0000","last_became_active":"2023-10-06T02:52:26.541763+0000","last_became_peered":"2023-10-06T02:52:26.541763+0000","last_unstale":"2023-10-06T02:52:26.544199+0000","last_undegraded":"2023-10-06T02:52:26.544199+0000","last_fullsized":"2023-10-06T02:52:26.544199+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:28.857260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544402+0000","last_change":"2023-10-06T02:52:26.544105+0000","last_active":"2023-10-06T02:52:26.544402+0000","last_peered":"2023-10-06T02:52:26.544402+0000","last_clean":"2023-10-06T02:52:26.544402+0000","last_became_active":"2023-10-06T02:52:26.543894+0000","last_became_peered":"2023-10-06T02:52:26.543894+0000","last_unstale":"2023-10-06T02:52:26.544402+0000","last_undegraded":"2023-10-06T02:52:26.544402+0000","last_fullsized":"2023-10-06T02:52:26.544402+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:02.294005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548793+0000","last_change":"2023-10-06T02:52:26.548719+0000","last_active":"2023-10-06T02:52:26.548793+0000","last_peered":"2023-10-06T02:52:26.548793+0000","last_clean":"2023-10-06T02:52:26.548793+0000","last_became_active":"2023-10-06T02:52:26.547949+0000","last_became_peered":"2023-10-06T02:52:26.547949+0000","last_unstale":"2023-10-06T02:52:26.548793+0000","last_undegraded":"2023-10-06T02:52:26.548793+0000","last_fullsized":"2023-10-06T02:52:26.548793+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:20.443085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548939+0000","last_change":"2023-10-06T02:52:26.548710+0000","last_active":"2023-10-06T02:52:26.548939+0000","last_peered":"2023-10-06T02:52:26.548939+0000","last_clean":"2023-10-06T02:52:26.548939+0000","last_became_active":"2023-10-06T02:52:26.548132+0000","last_became_peered":"2023-10-06T02:52:26.548132+0000","last_unstale":"2023-10-06T02:52:26.548939+0000","last_undegraded":"2023-10-06T02:52:26.548939+0000","last_fullsized":"2023-10-06T02:52:26.548939+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:18.258498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545631+0000","last_change":"2023-10-06T02:52:26.545540+0000","last_active":"2023-10-06T02:52:26.545631+0000","last_peered":"2023-10-06T02:52:26.545631+0000","last_clean":"2023-10-06T02:52:26.545631+0000","last_became_active":"2023-10-06T02:52:26.545268+0000","last_became_peered":"2023-10-06T02:52:26.545268+0000","last_unstale":"2023-10-06T02:52:26.545631+0000","last_undegraded":"2023-10-06T02:52:26.545631+0000","last_fullsized":"2023-10-06T02:52:26.545631+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.542922+0000","last_change":"2023-10-06T02:52:26.542857+0000","last_active":"2023-10-06T02:52:26.542922+0000","last_peered":"2023-10-06T02:52:26.542922+0000","last_clean":"2023-10-06T02:52:26.542922+0000","last_became_active":"2023-10-06T02:52:26.542584+0000","last_became_peered":"2023-10-06T02:52:26.542584+0000","last_unstale":"2023-10-06T02:52:26.542922+0000","last_undegraded":"2023-10-06T02:52:26.542922+0000","last_fullsized":"2023-10-06T02:52:26.542922+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"134'4","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.559672+0000","last_change":"2023-10-06T02:52:25.544754+0000","last_active":"2023-10-06T02:52:26.559672+0000","last_peered":"2023-10-06T02:52:26.559672+0000","last_clean":"2023-10-06T02:52:26.559672+0000","last_became_active":"2023-10-06T02:52:25.544522+0000","last_became_peered":"2023-10-06T02:52:25.544522+0000","last_unstale":"2023-10-06T02:52:26.559672+0000","last_undegraded":"2023-10-06T02:52:26.559672+0000","last_fullsized":"2023-10-06T02:52:26.559672+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:27.128855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546200+0000","last_change":"2023-10-06T02:52:26.546083+0000","last_active":"2023-10-06T02:52:26.546200+0000","last_peered":"2023-10-06T02:52:26.546200+0000","last_clean":"2023-10-06T02:52:26.546200+0000","last_became_active":"2023-10-06T02:52:26.545642+0000","last_became_peered":"2023-10-06T02:52:26.545642+0000","last_unstale":"2023-10-06T02:52:26.546200+0000","last_undegraded":"2023-10-06T02:52:26.546200+0000","last_fullsized":"2023-10-06T02:52:26.546200+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:40.301033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.557600+0000","last_change":"2023-10-06T02:52:25.542191+0000","last_active":"2023-10-06T02:52:26.557600+0000","last_peered":"2023-10-06T02:52:26.557600+0000","last_clean":"2023-10-06T02:52:26.557600+0000","last_became_active":"2023-10-06T02:52:25.541967+0000","last_became_peered":"2023-10-06T02:52:25.541967+0000","last_unstale":"2023-10-06T02:52:26.557600+0000","last_undegraded":"2023-10-06T02:52:26.557600+0000","last_fullsized":"2023-10-06T02:52:26.557600+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549727+0000","last_change":"2023-10-06T02:52:26.549484+0000","last_active":"2023-10-06T02:52:26.549727+0000","last_peered":"2023-10-06T02:52:26.549727+0000","last_clean":"2023-10-06T02:52:26.549727+0000","last_became_active":"2023-10-06T02:52:26.548970+0000","last_became_peered":"2023-10-06T02:52:26.548970+0000","last_unstale":"2023-10-06T02:52:26.549727+0000","last_undegraded":"2023-10-06T02:52:26.549727+0000","last_fullsized":"2023-10-06T02:52:26.549727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:58.350339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.560906+0000","last_change":"2023-10-06T02:52:25.545738+0000","last_active":"2023-10-06T02:52:26.560906+0000","last_peered":"2023-10-06T02:52:26.560906+0000","last_clean":"2023-10-06T02:52:26.560906+0000","last_became_active":"2023-10-06T02:52:25.545482+0000","last_became_peered":"2023-10-06T02:52:25.545482+0000","last_unstale":"2023-10-06T02:52:26.560906+0000","last_undegraded":"2023-10-06T02:52:26.560906+0000","last_fullsized":"2023-10-06T02:52:26.560906+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549675+0000","last_change":"2023-10-06T02:52:26.548505+0000","last_active":"2023-10-06T02:52:26.549675+0000","last_peered":"2023-10-06T02:52:26.549675+0000","last_clean":"2023-10-06T02:52:26.549675+0000","last_became_active":"2023-10-06T02:52:26.548108+0000","last_became_peered":"2023-10-06T02:52:26.548108+0000","last_unstale":"2023-10-06T02:52:26.549675+0000","last_undegraded":"2023-10-06T02:52:26.549675+0000","last_fullsized":"2023-10-06T02:52:26.549675+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:19.070290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.558387+0000","last_change":"2023-10-06T02:52:25.543504+0000","last_active":"2023-10-06T02:52:26.558387+0000","last_peered":"2023-10-06T02:52:26.558387+0000","last_clean":"2023-10-06T02:52:26.558387+0000","last_became_active":"2023-10-06T02:52:25.543294+0000","last_became_peered":"2023-10-06T02:52:25.543294+0000","last_unstale":"2023-10-06T02:52:26.558387+0000","last_undegraded":"2023-10-06T02:52:26.558387+0000","last_fullsized":"2023-10-06T02:52:26.558387+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.015668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548204+0000","last_change":"2023-10-06T02:52:26.548165+0000","last_active":"2023-10-06T02:52:26.548204+0000","last_peered":"2023-10-06T02:52:26.548204+0000","last_clean":"2023-10-06T02:52:26.548204+0000","last_became_active":"2023-10-06T02:52:26.547956+0000","last_became_peered":"2023-10-06T02:52:26.547956+0000","last_unstale":"2023-10-06T02:52:26.548204+0000","last_undegraded":"2023-10-06T02:52:26.548204+0000","last_fullsized":"2023-10-06T02:52:26.548204+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:56.231063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.558764+0000","last_change":"2023-10-06T02:52:25.547100+0000","last_active":"2023-10-06T02:52:26.558764+0000","last_peered":"2023-10-06T02:52:26.558764+0000","last_clean":"2023-10-06T02:52:26.558764+0000","last_became_active":"2023-10-06T02:52:25.546711+0000","last_became_peered":"2023-10-06T02:52:25.546711+0000","last_unstale":"2023-10-06T02:52:26.558764+0000","last_undegraded":"2023-10-06T02:52:26.558764+0000","last_fullsized":"2023-10-06T02:52:26.558764+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:55.222375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.550850+0000","last_change":"2023-10-06T02:52:26.550778+0000","last_active":"2023-10-06T02:52:26.550850+0000","last_peered":"2023-10-06T02:52:26.550850+0000","last_clean":"2023-10-06T02:52:26.550850+0000","last_became_active":"2023-10-06T02:52:26.550546+0000","last_became_peered":"2023-10-06T02:52:26.550546+0000","last_unstale":"2023-10-06T02:52:26.550850+0000","last_undegraded":"2023-10-06T02:52:26.550850+0000","last_fullsized":"2023-10-06T02:52:26.550850+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.561321+0000","last_change":"2023-10-06T02:52:25.545503+0000","last_active":"2023-10-06T02:52:26.561321+0000","last_peered":"2023-10-06T02:52:26.561321+0000","last_clean":"2023-10-06T02:52:26.561321+0000","last_became_active":"2023-10-06T02:52:25.543328+0000","last_became_peered":"2023-10-06T02:52:25.543328+0000","last_unstale":"2023-10-06T02:52:26.561321+0000","last_undegraded":"2023-10-06T02:52:26.561321+0000","last_fullsized":"2023-10-06T02:52:26.561321+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:21.145420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.550633+0000","last_change":"2023-10-06T02:52:26.550010+0000","last_active":"2023-10-06T02:52:26.550633+0000","last_peered":"2023-10-06T02:52:26.550633+0000","last_clean":"2023-10-06T02:52:26.550633+0000","last_became_active":"2023-10-06T02:52:26.549443+0000","last_became_peered":"2023-10-06T02:52:26.549443+0000","last_unstale":"2023-10-06T02:52:26.550633+0000","last_undegraded":"2023-10-06T02:52:26.550633+0000","last_fullsized":"2023-10-06T02:52:26.550633+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:32.571020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.538886+0000","last_change":"2023-10-06T02:52:25.544790+0000","last_active":"2023-10-06T02:52:26.538886+0000","last_peered":"2023-10-06T02:52:26.538886+0000","last_clean":"2023-10-06T02:52:26.538886+0000","last_became_active":"2023-10-06T02:52:25.544567+0000","last_became_peered":"2023-10-06T02:52:25.544567+0000","last_unstale":"2023-10-06T02:52:26.538886+0000","last_undegraded":"2023-10-06T02:52:26.538886+0000","last_fullsized":"2023-10-06T02:52:26.538886+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547951+0000","last_change":"2023-10-06T02:52:26.547132+0000","last_active":"2023-10-06T02:52:26.547951+0000","last_peered":"2023-10-06T02:52:26.547951+0000","last_clean":"2023-10-06T02:52:26.547951+0000","last_became_active":"2023-10-06T02:52:26.546889+0000","last_became_peered":"2023-10-06T02:52:26.546889+0000","last_unstale":"2023-10-06T02:52:26.547951+0000","last_undegraded":"2023-10-06T02:52:26.547951+0000","last_fullsized":"2023-10-06T02:52:26.547951+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.537546+0000","last_change":"2023-10-06T02:52:25.545963+0000","last_active":"2023-10-06T02:52:26.537546+0000","last_peered":"2023-10-06T02:52:26.537546+0000","last_clean":"2023-10-06T02:52:26.537546+0000","last_became_active":"2023-10-06T02:52:25.544613+0000","last_became_peered":"2023-10-06T02:52:25.544613+0000","last_unstale":"2023-10-06T02:52:26.537546+0000","last_undegraded":"2023-10-06T02:52:26.537546+0000","last_fullsized":"2023-10-06T02:52:26.537546+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:28.221311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547471+0000","last_change":"2023-10-06T02:52:26.546848+0000","last_active":"2023-10-06T02:52:26.547471+0000","last_peered":"2023-10-06T02:52:26.547471+0000","last_clean":"2023-10-06T02:52:26.547471+0000","last_became_active":"2023-10-06T02:52:26.546595+0000","last_became_peered":"2023-10-06T02:52:26.546595+0000","last_unstale":"2023-10-06T02:52:26.547471+0000","last_undegraded":"2023-10-06T02:52:26.547471+0000","last_fullsized":"2023-10-06T02:52:26.547471+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:03.131444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.557508+0000","last_change":"2023-10-06T02:52:25.544827+0000","last_active":"2023-10-06T02:52:26.557508+0000","last_peered":"2023-10-06T02:52:26.557508+0000","last_clean":"2023-10-06T02:52:26.557508+0000","last_became_active":"2023-10-06T02:52:25.544602+0000","last_became_peered":"2023-10-06T02:52:25.544602+0000","last_unstale":"2023-10-06T02:52:26.557508+0000","last_undegraded":"2023-10-06T02:52:26.557508+0000","last_fullsized":"2023-10-06T02:52:26.557508+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:32.667092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.551802+0000","last_change":"2023-10-06T02:52:26.551731+0000","last_active":"2023-10-06T02:52:26.551802+0000","last_peered":"2023-10-06T02:52:26.551802+0000","last_clean":"2023-10-06T02:52:26.551802+0000","last_became_active":"2023-10-06T02:52:26.551191+0000","last_became_peered":"2023-10-06T02:52:26.551191+0000","last_unstale":"2023-10-06T02:52:26.551802+0000","last_undegraded":"2023-10-06T02:52:26.551802+0000","last_fullsized":"2023-10-06T02:52:26.551802+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:03.131444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.561752+0000","last_change":"2023-10-06T02:52:25.542765+0000","last_active":"2023-10-06T02:52:26.561752+0000","last_peered":"2023-10-06T02:52:26.561752+0000","last_clean":"2023-10-06T02:52:26.561752+0000","last_became_active":"2023-10-06T02:52:25.542333+0000","last_became_peered":"2023-10-06T02:52:25.542333+0000","last_unstale":"2023-10-06T02:52:26.561752+0000","last_undegraded":"2023-10-06T02:52:26.561752+0000","last_fullsized":"2023-10-06T02:52:26.561752+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:48.265643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546025+0000","last_change":"2023-10-06T02:52:26.545943+0000","last_active":"2023-10-06T02:52:26.546025+0000","last_peered":"2023-10-06T02:52:26.546025+0000","last_clean":"2023-10-06T02:52:26.546025+0000","last_became_active":"2023-10-06T02:52:26.545227+0000","last_became_peered":"2023-10-06T02:52:26.545227+0000","last_unstale":"2023-10-06T02:52:26.546025+0000","last_undegraded":"2023-10-06T02:52:26.546025+0000","last_fullsized":"2023-10-06T02:52:26.546025+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:45.678587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"134'1","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.559151+0000","last_change":"2023-10-06T02:52:25.547169+0000","last_active":"2023-10-06T02:52:26.559151+0000","last_peered":"2023-10-06T02:52:26.559151+0000","last_clean":"2023-10-06T02:52:26.559151+0000","last_became_active":"2023-10-06T02:52:25.546959+0000","last_became_peered":"2023-10-06T02:52:25.546959+0000","last_unstale":"2023-10-06T02:52:26.559151+0000","last_undegraded":"2023-10-06T02:52:26.559151+0000","last_fullsized":"2023-10-06T02:52:26.559151+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549744+0000","last_change":"2023-10-06T02:52:26.549628+0000","last_active":"2023-10-06T02:52:26.549744+0000","last_peered":"2023-10-06T02:52:26.549744+0000","last_clean":"2023-10-06T02:52:26.549744+0000","last_became_active":"2023-10-06T02:52:26.549258+0000","last_became_peered":"2023-10-06T02:52:26.549258+0000","last_unstale":"2023-10-06T02:52:26.549744+0000","last_undegraded":"2023-10-06T02:52:26.549744+0000","last_fullsized":"2023-10-06T02:52:26.549744+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:55.593097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.538801+0000","last_change":"2023-10-06T02:52:25.548463+0000","last_active":"2023-10-06T02:52:26.538801+0000","last_peered":"2023-10-06T02:52:26.538801+0000","last_clean":"2023-10-06T02:52:26.538801+0000","last_became_active":"2023-10-06T02:52:25.548237+0000","last_became_peered":"2023-10-06T02:52:25.548237+0000","last_unstale":"2023-10-06T02:52:26.538801+0000","last_undegraded":"2023-10-06T02:52:26.538801+0000","last_fullsized":"2023-10-06T02:52:26.538801+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544217+0000","last_change":"2023-10-06T02:52:26.543773+0000","last_active":"2023-10-06T02:52:26.544217+0000","last_peered":"2023-10-06T02:52:26.544217+0000","last_clean":"2023-10-06T02:52:26.544217+0000","last_became_active":"2023-10-06T02:52:26.543360+0000","last_became_peered":"2023-10-06T02:52:26.543360+0000","last_unstale":"2023-10-06T02:52:26.544217+0000","last_undegraded":"2023-10-06T02:52:26.544217+0000","last_fullsized":"2023-10-06T02:52:26.544217+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:59.214618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.558212+0000","last_change":"2023-10-06T02:52:25.545831+0000","last_active":"2023-10-06T02:52:26.558212+0000","last_peered":"2023-10-06T02:52:26.558212+0000","last_clean":"2023-10-06T02:52:26.558212+0000","last_became_active":"2023-10-06T02:52:25.544736+0000","last_became_peered":"2023-10-06T02:52:25.544736+0000","last_unstale":"2023-10-06T02:52:26.558212+0000","last_undegraded":"2023-10-06T02:52:26.558212+0000","last_fullsized":"2023-10-06T02:52:26.558212+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:04.384554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548927+0000","last_change":"2023-10-06T02:52:26.548883+0000","last_active":"2023-10-06T02:52:26.548927+0000","last_peered":"2023-10-06T02:52:26.548927+0000","last_clean":"2023-10-06T02:52:26.548927+0000","last_became_active":"2023-10-06T02:52:26.548353+0000","last_became_peered":"2023-10-06T02:52:26.548353+0000","last_unstale":"2023-10-06T02:52:26.548927+0000","last_undegraded":"2023-10-06T02:52:26.548927+0000","last_fullsized":"2023-10-06T02:52:26.548927+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:49.559714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539370+0000","last_change":"2023-10-06T02:52:25.543505+0000","last_active":"2023-10-06T02:52:26.539370+0000","last_peered":"2023-10-06T02:52:26.539370+0000","last_clean":"2023-10-06T02:52:26.539370+0000","last_became_active":"2023-10-06T02:52:25.543320+0000","last_became_peered":"2023-10-06T02:52:25.543320+0000","last_unstale":"2023-10-06T02:52:26.539370+0000","last_undegraded":"2023-10-06T02:52:26.539370+0000","last_fullsized":"2023-10-06T02:52:26.539370+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545846+0000","last_change":"2023-10-06T02:52:26.545724+0000","last_active":"2023-10-06T02:52:26.545846+0000","last_peered":"2023-10-06T02:52:26.545846+0000","last_clean":"2023-10-06T02:52:26.545846+0000","last_became_active":"2023-10-06T02:52:26.545493+0000","last_became_peered":"2023-10-06T02:52:26.545493+0000","last_unstale":"2023-10-06T02:52:26.545846+0000","last_undegraded":"2023-10-06T02:52:26.545846+0000","last_fullsized":"2023-10-06T02:52:26.545846+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:58.350339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.543117+0000","last_change":"2023-10-06T02:52:25.538954+0000","last_active":"2023-10-06T02:52:26.543117+0000","last_peered":"2023-10-06T02:52:26.543117+0000","last_clean":"2023-10-06T02:52:26.543117+0000","last_became_active":"2023-10-06T02:52:25.538719+0000","last_became_peered":"2023-10-06T02:52:25.538719+0000","last_unstale":"2023-10-06T02:52:26.543117+0000","last_undegraded":"2023-10-06T02:52:26.543117+0000","last_fullsized":"2023-10-06T02:52:26.543117+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548277+0000","last_change":"2023-10-06T02:52:26.548207+0000","last_active":"2023-10-06T02:52:26.548277+0000","last_peered":"2023-10-06T02:52:26.548277+0000","last_clean":"2023-10-06T02:52:26.548277+0000","last_became_active":"2023-10-06T02:52:26.547623+0000","last_became_peered":"2023-10-06T02:52:26.547623+0000","last_unstale":"2023-10-06T02:52:26.548277+0000","last_undegraded":"2023-10-06T02:52:26.548277+0000","last_fullsized":"2023-10-06T02:52:26.548277+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.485488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.538416+0000","last_change":"2023-10-06T02:52:25.545718+0000","last_active":"2023-10-06T02:52:26.538416+0000","last_peered":"2023-10-06T02:52:26.538416+0000","last_clean":"2023-10-06T02:52:26.538416+0000","last_became_active":"2023-10-06T02:52:25.545491+0000","last_became_peered":"2023-10-06T02:52:25.545491+0000","last_unstale":"2023-10-06T02:52:26.538416+0000","last_undegraded":"2023-10-06T02:52:26.538416+0000","last_fullsized":"2023-10-06T02:52:26.538416+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.541383+0000","last_change":"2023-10-06T02:52:26.540826+0000","last_active":"2023-10-06T02:52:26.541383+0000","last_peered":"2023-10-06T02:52:26.541383+0000","last_clean":"2023-10-06T02:52:26.541383+0000","last_became_active":"2023-10-06T02:52:26.540612+0000","last_became_peered":"2023-10-06T02:52:26.540612+0000","last_unstale":"2023-10-06T02:52:26.541383+0000","last_undegraded":"2023-10-06T02:52:26.541383+0000","last_fullsized":"2023-10-06T02:52:26.541383+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:08.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.560197+0000","last_change":"2023-10-06T02:52:25.546086+0000","last_active":"2023-10-06T02:52:26.560197+0000","last_peered":"2023-10-06T02:52:26.560197+0000","last_clean":"2023-10-06T02:52:26.560197+0000","last_became_active":"2023-10-06T02:52:25.545594+0000","last_became_peered":"2023-10-06T02:52:25.545594+0000","last_unstale":"2023-10-06T02:52:26.560197+0000","last_undegraded":"2023-10-06T02:52:26.560197+0000","last_fullsized":"2023-10-06T02:52:26.560197+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:18.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548343+0000","last_change":"2023-10-06T02:52:26.548284+0000","last_active":"2023-10-06T02:52:26.548343+0000","last_peered":"2023-10-06T02:52:26.548343+0000","last_clean":"2023-10-06T02:52:26.548343+0000","last_became_active":"2023-10-06T02:52:26.548082+0000","last_became_peered":"2023-10-06T02:52:26.548082+0000","last_unstale":"2023-10-06T02:52:26.548343+0000","last_undegraded":"2023-10-06T02:52:26.548343+0000","last_fullsized":"2023-10-06T02:52:26.548343+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:32.997449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-06T02:52:27.861195+0000","last_change":"2023-10-06T02:52:25.547920+0000","last_active":"2023-10-06T02:52:27.861195+0000","last_peered":"2023-10-06T02:52:27.861195+0000","last_clean":"2023-10-06T02:52:27.861195+0000","last_became_active":"2023-10-06T02:52:25.547743+0000","last_became_peered":"2023-10-06T02:52:25.547743+0000","last_unstale":"2023-10-06T02:52:27.861195+0000","last_undegraded":"2023-10-06T02:52:27.861195+0000","last_fullsized":"2023-10-06T02:52:27.861195+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:01.710658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549655+0000","last_change":"2023-10-06T02:52:26.548362+0000","last_active":"2023-10-06T02:52:26.549655+0000","last_peered":"2023-10-06T02:52:26.549655+0000","last_clean":"2023-10-06T02:52:26.549655+0000","last_became_active":"2023-10-06T02:52:26.547811+0000","last_became_peered":"2023-10-06T02:52:26.547811+0000","last_unstale":"2023-10-06T02:52:26.549655+0000","last_undegraded":"2023-10-06T02:52:26.549655+0000","last_fullsized":"2023-10-06T02:52:26.549655+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:36.927212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.543228+0000","last_change":"2023-10-06T02:52:25.547752+0000","last_active":"2023-10-06T02:52:26.543228+0000","last_peered":"2023-10-06T02:52:26.543228+0000","last_clean":"2023-10-06T02:52:26.543228+0000","last_became_active":"2023-10-06T02:52:25.547526+0000","last_became_peered":"2023-10-06T02:52:25.547526+0000","last_unstale":"2023-10-06T02:52:26.543228+0000","last_undegraded":"2023-10-06T02:52:26.543228+0000","last_fullsized":"2023-10-06T02:52:26.543228+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:36.026761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.545199+0000","last_change":"2023-10-06T02:52:26.545107+0000","last_active":"2023-10-06T02:52:26.545199+0000","last_peered":"2023-10-06T02:52:26.545199+0000","last_clean":"2023-10-06T02:52:26.545199+0000","last_became_active":"2023-10-06T02:52:26.544855+0000","last_became_peered":"2023-10-06T02:52:26.544855+0000","last_unstale":"2023-10-06T02:52:26.545199+0000","last_undegraded":"2023-10-06T02:52:26.545199+0000","last_fullsized":"2023-10-06T02:52:26.545199+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:02.862198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.537631+0000","last_change":"2023-10-06T02:52:25.545836+0000","last_active":"2023-10-06T02:52:26.537631+0000","last_peered":"2023-10-06T02:52:26.537631+0000","last_clean":"2023-10-06T02:52:26.537631+0000","last_became_active":"2023-10-06T02:52:25.544311+0000","last_became_peered":"2023-10-06T02:52:25.544311+0000","last_unstale":"2023-10-06T02:52:26.537631+0000","last_undegraded":"2023-10-06T02:52:26.537631+0000","last_fullsized":"2023-10-06T02:52:26.537631+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:51.912933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544714+0000","last_change":"2023-10-06T02:52:26.544548+0000","last_active":"2023-10-06T02:52:26.544714+0000","last_peered":"2023-10-06T02:52:26.544714+0000","last_clean":"2023-10-06T02:52:26.544714+0000","last_became_active":"2023-10-06T02:52:26.544329+0000","last_became_peered":"2023-10-06T02:52:26.544329+0000","last_unstale":"2023-10-06T02:52:26.544714+0000","last_undegraded":"2023-10-06T02:52:26.544714+0000","last_fullsized":"2023-10-06T02:52:26.544714+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:29.321757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.542984+0000","last_change":"2023-10-06T02:52:25.545621+0000","last_active":"2023-10-06T02:52:26.542984+0000","last_peered":"2023-10-06T02:52:26.542984+0000","last_clean":"2023-10-06T02:52:26.542984+0000","last_became_active":"2023-10-06T02:52:25.545184+0000","last_became_peered":"2023-10-06T02:52:25.545184+0000","last_unstale":"2023-10-06T02:52:26.542984+0000","last_undegraded":"2023-10-06T02:52:26.542984+0000","last_fullsized":"2023-10-06T02:52:26.542984+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:08.888993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.549351+0000","last_change":"2023-10-06T02:52:26.549303+0000","last_active":"2023-10-06T02:52:26.549351+0000","last_peered":"2023-10-06T02:52:26.549351+0000","last_clean":"2023-10-06T02:52:26.549351+0000","last_became_active":"2023-10-06T02:52:26.548427+0000","last_became_peered":"2023-10-06T02:52:26.548427+0000","last_unstale":"2023-10-06T02:52:26.549351+0000","last_undegraded":"2023-10-06T02:52:26.549351+0000","last_fullsized":"2023-10-06T02:52:26.549351+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:19.070290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.543867+0000","last_change":"2023-10-06T02:52:25.546929+0000","last_active":"2023-10-06T02:52:26.543867+0000","last_peered":"2023-10-06T02:52:26.543867+0000","last_clean":"2023-10-06T02:52:26.543867+0000","last_became_active":"2023-10-06T02:52:25.546386+0000","last_became_peered":"2023-10-06T02:52:25.546386+0000","last_unstale":"2023-10-06T02:52:26.543867+0000","last_undegraded":"2023-10-06T02:52:26.543867+0000","last_fullsized":"2023-10-06T02:52:26.543867+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:36.519223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546053+0000","last_change":"2023-10-06T02:52:26.545890+0000","last_active":"2023-10-06T02:52:26.546053+0000","last_peered":"2023-10-06T02:52:26.546053+0000","last_clean":"2023-10-06T02:52:26.546053+0000","last_became_active":"2023-10-06T02:52:26.545637+0000","last_became_peered":"2023-10-06T02:52:26.545637+0000","last_unstale":"2023-10-06T02:52:26.546053+0000","last_undegraded":"2023-10-06T02:52:26.546053+0000","last_fullsized":"2023-10-06T02:52:26.546053+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:03.131444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.537087+0000","last_change":"2023-10-06T02:52:25.545690+0000","last_active":"2023-10-06T02:52:26.537087+0000","last_peered":"2023-10-06T02:52:26.537087+0000","last_clean":"2023-10-06T02:52:26.537087+0000","last_became_active":"2023-10-06T02:52:25.544448+0000","last_became_peered":"2023-10-06T02:52:25.544448+0000","last_unstale":"2023-10-06T02:52:26.537087+0000","last_undegraded":"2023-10-06T02:52:26.537087+0000","last_fullsized":"2023-10-06T02:52:26.537087+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:52.270415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547968+0000","last_change":"2023-10-06T02:52:26.547620+0000","last_active":"2023-10-06T02:52:26.547968+0000","last_peered":"2023-10-06T02:52:26.547968+0000","last_clean":"2023-10-06T02:52:26.547968+0000","last_became_active":"2023-10-06T02:52:26.547273+0000","last_became_peered":"2023-10-06T02:52:26.547273+0000","last_unstale":"2023-10-06T02:52:26.547968+0000","last_undegraded":"2023-10-06T02:52:26.547968+0000","last_fullsized":"2023-10-06T02:52:26.547968+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539461+0000","last_change":"2023-10-06T02:52:25.544210+0000","last_active":"2023-10-06T02:52:26.539461+0000","last_peered":"2023-10-06T02:52:26.539461+0000","last_clean":"2023-10-06T02:52:26.539461+0000","last_became_active":"2023-10-06T02:52:25.543966+0000","last_became_peered":"2023-10-06T02:52:25.543966+0000","last_unstale":"2023-10-06T02:52:26.539461+0000","last_undegraded":"2023-10-06T02:52:26.539461+0000","last_fullsized":"2023-10-06T02:52:26.539461+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548801+0000","last_change":"2023-10-06T02:52:26.548585+0000","last_active":"2023-10-06T02:52:26.548801+0000","last_peered":"2023-10-06T02:52:26.548801+0000","last_clean":"2023-10-06T02:52:26.548801+0000","last_became_active":"2023-10-06T02:52:26.547531+0000","last_became_peered":"2023-10-06T02:52:26.547531+0000","last_unstale":"2023-10-06T02:52:26.548801+0000","last_undegraded":"2023-10-06T02:52:26.548801+0000","last_fullsized":"2023-10-06T02:52:26.548801+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:09.897682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.541000+0000","last_change":"2023-10-06T02:52:25.543969+0000","last_active":"2023-10-06T02:52:26.541000+0000","last_peered":"2023-10-06T02:52:26.541000+0000","last_clean":"2023-10-06T02:52:26.541000+0000","last_became_active":"2023-10-06T02:52:25.543754+0000","last_became_peered":"2023-10-06T02:52:25.543754+0000","last_unstale":"2023-10-06T02:52:26.541000+0000","last_undegraded":"2023-10-06T02:52:26.541000+0000","last_fullsized":"2023-10-06T02:52:26.541000+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":111,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539800+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:52:26.539800+0000","last_peered":"2023-10-06T02:52:26.539800+0000","last_clean":"2023-10-06T02:52:26.539800+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:52:26.539800+0000","last_undegraded":"2023-10-06T02:52:26.539800+0000","last_fullsized":"2023-10-06T02:52:26.539800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.546390+0000","last_change":"2023-10-06T02:52:26.546297+0000","last_active":"2023-10-06T02:52:26.546390+0000","last_peered":"2023-10-06T02:52:26.546390+0000","last_clean":"2023-10-06T02:52:26.546390+0000","last_became_active":"2023-10-06T02:52:26.546081+0000","last_became_peered":"2023-10-06T02:52:26.546081+0000","last_unstale":"2023-10-06T02:52:26.546390+0000","last_undegraded":"2023-10-06T02:52:26.546390+0000","last_fullsized":"2023-10-06T02:52:26.546390+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:30.734656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.544150+0000","last_change":"2023-10-06T02:52:25.544064+0000","last_active":"2023-10-06T02:52:26.544150+0000","last_peered":"2023-10-06T02:52:26.544150+0000","last_clean":"2023-10-06T02:52:26.544150+0000","last_became_active":"2023-10-06T02:52:25.543804+0000","last_became_peered":"2023-10-06T02:52:25.543804+0000","last_unstale":"2023-10-06T02:52:26.544150+0000","last_undegraded":"2023-10-06T02:52:26.544150+0000","last_fullsized":"2023-10-06T02:52:26.544150+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:12.772530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539853+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:52:26.539853+0000","last_peered":"2023-10-06T02:52:26.539853+0000","last_clean":"2023-10-06T02:52:26.539853+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:52:26.539853+0000","last_undegraded":"2023-10-06T02:52:26.539853+0000","last_fullsized":"2023-10-06T02:52:26.539853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548376+0000","last_change":"2023-10-06T02:52:26.547920+0000","last_active":"2023-10-06T02:52:26.548376+0000","last_peered":"2023-10-06T02:52:26.548376+0000","last_clean":"2023-10-06T02:52:26.548376+0000","last_became_active":"2023-10-06T02:52:26.547366+0000","last_became_peered":"2023-10-06T02:52:26.547366+0000","last_unstale":"2023-10-06T02:52:26.548376+0000","last_undegraded":"2023-10-06T02:52:26.548376+0000","last_fullsized":"2023-10-06T02:52:26.548376+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.542351+0000","last_change":"2023-10-06T02:52:25.538066+0000","last_active":"2023-10-06T02:52:26.542351+0000","last_peered":"2023-10-06T02:52:26.542351+0000","last_clean":"2023-10-06T02:52:26.542351+0000","last_became_active":"2023-10-06T02:52:25.537825+0000","last_became_peered":"2023-10-06T02:52:25.537825+0000","last_unstale":"2023-10-06T02:52:26.542351+0000","last_undegraded":"2023-10-06T02:52:26.542351+0000","last_fullsized":"2023-10-06T02:52:26.542351+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:27.873231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539745+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:52:26.539745+0000","last_peered":"2023-10-06T02:52:26.539745+0000","last_clean":"2023-10-06T02:52:26.539745+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:52:26.539745+0000","last_undegraded":"2023-10-06T02:52:26.539745+0000","last_fullsized":"2023-10-06T02:52:26.539745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547821+0000","last_change":"2023-10-06T02:52:26.547003+0000","last_active":"2023-10-06T02:52:26.547821+0000","last_peered":"2023-10-06T02:52:26.547821+0000","last_clean":"2023-10-06T02:52:26.547821+0000","last_became_active":"2023-10-06T02:52:26.546311+0000","last_became_peered":"2023-10-06T02:52:26.546311+0000","last_unstale":"2023-10-06T02:52:26.547821+0000","last_undegraded":"2023-10-06T02:52:26.547821+0000","last_fullsized":"2023-10-06T02:52:26.547821+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:58.350339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"134'8","reported_seq":18,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.561206+0000","last_change":"2023-10-06T02:52:25.543751+0000","last_active":"2023-10-06T02:52:26.561206+0000","last_peered":"2023-10-06T02:52:26.561206+0000","last_clean":"2023-10-06T02:52:26.561206+0000","last_became_active":"2023-10-06T02:52:25.543563+0000","last_became_peered":"2023-10-06T02:52:25.543563+0000","last_unstale":"2023-10-06T02:52:26.561206+0000","last_undegraded":"2023-10-06T02:52:26.561206+0000","last_fullsized":"2023-10-06T02:52:26.561206+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:47.925840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539912+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:52:26.539912+0000","last_peered":"2023-10-06T02:52:26.539912+0000","last_clean":"2023-10-06T02:52:26.539912+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:52:26.539912+0000","last_undegraded":"2023-10-06T02:52:26.539912+0000","last_fullsized":"2023-10-06T02:52:26.539912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":262,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539630+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:52:26.539630+0000","last_peered":"2023-10-06T02:52:26.539630+0000","last_clean":"2023-10-06T02:52:26.539630+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:52:26.539630+0000","last_undegraded":"2023-10-06T02:52:26.539630+0000","last_fullsized":"2023-10-06T02:52:26.539630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548791+0000","last_change":"2023-10-06T02:52:26.547622+0000","last_active":"2023-10-06T02:52:26.548791+0000","last_peered":"2023-10-06T02:52:26.548791+0000","last_clean":"2023-10-06T02:52:26.548791+0000","last_became_active":"2023-10-06T02:52:26.547367+0000","last_became_peered":"2023-10-06T02:52:26.547367+0000","last_unstale":"2023-10-06T02:52:26.548791+0000","last_undegraded":"2023-10-06T02:52:26.548791+0000","last_fullsized":"2023-10-06T02:52:26.548791+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:37.527911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"134'2","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.560983+0000","last_change":"2023-10-06T02:52:25.541005+0000","last_active":"2023-10-06T02:52:26.560983+0000","last_peered":"2023-10-06T02:52:26.560983+0000","last_clean":"2023-10-06T02:52:26.560983+0000","last_became_active":"2023-10-06T02:52:25.540862+0000","last_became_peered":"2023-10-06T02:52:25.540862+0000","last_unstale":"2023-10-06T02:52:26.560983+0000","last_undegraded":"2023-10-06T02:52:26.560983+0000","last_fullsized":"2023-10-06T02:52:26.560983+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.015129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539540+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:52:26.539540+0000","last_peered":"2023-10-06T02:52:26.539540+0000","last_clean":"2023-10-06T02:52:26.539540+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:52:26.539540+0000","last_undegraded":"2023-10-06T02:52:26.539540+0000","last_fullsized":"2023-10-06T02:52:26.539540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548442+0000","last_change":"2023-10-06T02:52:26.548352+0000","last_active":"2023-10-06T02:52:26.548442+0000","last_peered":"2023-10-06T02:52:26.548442+0000","last_clean":"2023-10-06T02:52:26.548442+0000","last_became_active":"2023-10-06T02:52:26.547974+0000","last_became_peered":"2023-10-06T02:52:26.547974+0000","last_unstale":"2023-10-06T02:52:26.548442+0000","last_undegraded":"2023-10-06T02:52:26.548442+0000","last_fullsized":"2023-10-06T02:52:26.548442+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:24.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539773+0000","last_change":"2023-10-06T02:52:25.546234+0000","last_active":"2023-10-06T02:52:26.539773+0000","last_peered":"2023-10-06T02:52:26.539773+0000","last_clean":"2023-10-06T02:52:26.539773+0000","last_became_active":"2023-10-06T02:52:25.545953+0000","last_became_peered":"2023-10-06T02:52:25.545953+0000","last_unstale":"2023-10-06T02:52:26.539773+0000","last_undegraded":"2023-10-06T02:52:26.539773+0000","last_fullsized":"2023-10-06T02:52:26.539773+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:42.320760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539708+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:52:26.539708+0000","last_peered":"2023-10-06T02:52:26.539708+0000","last_clean":"2023-10-06T02:52:26.539708+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:52:26.539708+0000","last_undegraded":"2023-10-06T02:52:26.539708+0000","last_fullsized":"2023-10-06T02:52:26.539708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.547078+0000","last_change":"2023-10-06T02:52:26.546893+0000","last_active":"2023-10-06T02:52:26.547078+0000","last_peered":"2023-10-06T02:52:26.547078+0000","last_clean":"2023-10-06T02:52:26.547078+0000","last_became_active":"2023-10-06T02:52:26.546660+0000","last_became_peered":"2023-10-06T02:52:26.546660+0000","last_unstale":"2023-10-06T02:52:26.547078+0000","last_undegraded":"2023-10-06T02:52:26.547078+0000","last_fullsized":"2023-10-06T02:52:26.547078+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:03.131444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"134'3","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.558824+0000","last_change":"2023-10-06T02:52:25.546603+0000","last_active":"2023-10-06T02:52:26.558824+0000","last_peered":"2023-10-06T02:52:26.558824+0000","last_clean":"2023-10-06T02:52:26.558824+0000","last_became_active":"2023-10-06T02:52:25.546366+0000","last_became_peered":"2023-10-06T02:52:25.546366+0000","last_unstale":"2023-10-06T02:52:26.558824+0000","last_undegraded":"2023-10-06T02:52:26.558824+0000","last_fullsized":"2023-10-06T02:52:26.558824+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:42.511616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":111,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.539029+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:52:26.539029+0000","last_peered":"2023-10-06T02:52:26.539029+0000","last_clean":"2023-10-06T02:52:26.539029+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:52:26.539029+0000","last_undegraded":"2023-10-06T02:52:26.539029+0000","last_fullsized":"2023-10-06T02:52:26.539029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.548958+0000","last_change":"2023-10-06T02:52:26.548874+0000","last_active":"2023-10-06T02:52:26.548958+0000","last_peered":"2023-10-06T02:52:26.548958+0000","last_clean":"2023-10-06T02:52:26.548958+0000","last_became_active":"2023-10-06T02:52:26.548472+0000","last_became_peered":"2023-10-06T02:52:26.548472+0000","last_unstale":"2023-10-06T02:52:26.548958+0000","last_undegraded":"2023-10-06T02:52:26.548958+0000","last_fullsized":"2023-10-06T02:52:26.548958+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:25.527619+0000","last_clean_scrub_stamp":"2023-10-06T02:52:25.527619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:40.673773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"134'6","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.561844+0000","last_change":"2023-10-06T02:52:25.543355+0000","last_active":"2023-10-06T02:52:26.561844+0000","last_peered":"2023-10-06T02:52:26.561844+0000","last_clean":"2023-10-06T02:52:26.561844+0000","last_became_active":"2023-10-06T02:52:25.543138+0000","last_became_peered":"2023-10-06T02:52:25.543138+0000","last_unstale":"2023-10-06T02:52:26.561844+0000","last_undegraded":"2023-10-06T02:52:26.561844+0000","last_fullsized":"2023-10-06T02:52:26.561844+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:52:24.518930+0000","last_clean_scrub_stamp":"2023-10-06T02:52:24.518930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:23.105407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-06T02:52:26.541734+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:52:26.541734+0000","last_peered":"2023-10-06T02:52:26.541734+0000","last_clean":"2023-10-06T02:52:26.541734+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:52:26.541734+0000","last_undegraded":"2023-10-06T02:52:26.541734+0000","last_fullsized":"2023-10-06T02:52:26.541734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193965,"statfs":{"total":200000000,"available":198620348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70799999999999996,"5min":0.80600000000000005,"15min":1.393},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.33800000000000002,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":1.5569999999999999},"last":0.248}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.627,"5min":0.76400000000000001,"15min":1.081},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":1.4710000000000001},"last":0.311}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.48699999999999999},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58899999999999997,"15min":0.63500000000000001},"min":{"1min":0.35899999999999999,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.65900000000000003,"5min":4.8129999999999997,"15min":4.8129999999999997},"last":0.29399999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.61199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.65700000000000003,"5min":3.0649999999999999,"15min":3.4870000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.58499999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.69999999999999996,"5min":0.97899999999999998,"15min":2.2349999999999999},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.44},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72599999999999998},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.879},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.33600000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.44,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76300000000000001},"last":0.48799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194541,"statfs":{"total":200000000,"available":199210910,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.60999999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64800000000000002,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.434},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52600000000000002,"15min":0.56599999999999995},"min":{"1min":0.32800000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.64100000000000001,"5min":0.75700000000000001,"15min":1.879},"last":0.501}]},{"osd":1,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53000000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67800000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53700000000000003,"15min":0.94599999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65700000000000003,"5min":0.80000000000000004,"15min":11.957000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.51000000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66900000000000004,"5min":1.042,"15min":1.0580000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.39400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69899999999999995,"5min":0.83399999999999996,"15min":0.95799999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.80100000000000005,"15min":1.163},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":1.05,"15min":1.05},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.498,"15min":0.56100000000000005},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48199999999999998,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.60199999999999998},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72199999999999998,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.54800000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.61199999999999999},"min":{"1min":0.33600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.73699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211442,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.314,"15min":0.313},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.40799999999999997,"5min":0.501,"15min":0.501},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35199999999999998,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46300000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33300000000000002,"15min":0.32200000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45000000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39800000000000002,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.36299999999999999},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.23400000000000001},"max":{"1min":0.42299999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.996,"15min":0.996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.43099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.53900000000000003},"min":{"1min":0.49399999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.58699999999999997,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.39000000000000001},"max":{"1min":0.71699999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56799999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60599999999999998,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.006},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.57399999999999995},"min":{"1min":0.54900000000000004,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":0.88200000000000001},"last":0.51700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1346,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193965,"statfs":{"total":200000000,"available":198621074,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33100000000000002,"15min":0.34699999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.45600000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.312},{"interface":"front","average":{"1min":0.373,"5min":0.375,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":1.0389999999999999},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.188},"max":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":22.038},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":1.3779999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.36099999999999999},"min":{"1min":0.22,"5min":0.183,"15min":0.183},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.375,"15min":1.071},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.253},"max":{"1min":0.498,"5min":0.63300000000000001,"15min":21.942},"last":0.32600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70499999999999996,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":1.1419999999999999},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.86499999999999999,"15min":11.122999999999999},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":1.2290000000000001},"min":{"1min":0.38400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71999999999999997,"5min":0.80200000000000005,"15min":22.010999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.69799999999999995,"5min":0.83899999999999997,"15min":1.401},"last":0.436}]},{"osd":6,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":1.171},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73499999999999999,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":1.254},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.84799999999999998,"15min":21.98},"last":0.45500000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.70899999999999996,"5min":0.91000000000000003,"15min":1.425},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.90300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.71999999999999997,"5min":0.81899999999999995,"15min":11.154},"last":0.46600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33900000000000002,"15min":0.33300000000000002},"min":{"1min":0.215,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.41799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.311},{"interface":"front","average":{"1min":0.316,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.24099999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.40200000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.28199999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.36499999999999999,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.39800000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.248},{"interface":"front","average":{"1min":0.38,"5min":0.41699999999999998,"15min":0.38900000000000001},"min":{"1min":0.315,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.47499999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39400000000000002,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.499,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.38},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51300000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.056,"15min":1.056},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81599999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.628,"15min":0.59199999999999997},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83399999999999996,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.56000000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.505},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.68700000000000006,"5min":1.002,"15min":1.002},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Oct 6 02:52:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60799999999999998,"15min":0.58699999999999997},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.86499999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.52600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":771,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209894,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.318,"15min":0.307},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.439,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.37,"15min":0.33300000000000002},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.56999999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.25800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.35299999999999998,"15min":0.33000000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.45100000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.316},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.378,"15min":0.34799999999999998},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.58499999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41199999999999998,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.65900000000000003,"5min":3.044,"15min":3.044},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.249},"max":{"1min":0.45100000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.375}]},{"osd":4,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.446,"5min":1.446,"15min":2.2120000000000002},"last":0.627},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.327,"5min":1.327,"15min":2.25},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58599999999999997,"15min":0.68799999999999994},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.44500000000000001,"15min":0.38600000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.94099999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.442,"5min":0.372,"15min":0.372},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":771,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194540,"statfs":{"total":200000000,"available":199209928,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.5,"15min":0.78100000000000003},"min":{"1min":0.39600000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.62},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.221},"max":{"1min":0.65200000000000002,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52100000000000002,"15min":0.81299999999999994},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65900000000000003,"5min":0.70599999999999996,"15min":5.9329999999999998},"last":0.503},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52000000000000002,"15min":0.76700000000000002},"min":{"1min":0.373,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.67800000000000005,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.75900000000000001,"15min":5.4390000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.67100000000000004},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.61199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.77000000000000002,"15min":3.456},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.245},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.443},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.59699999999999998,"15min":1.0069999999999999},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.78200000000000003,"5min":0.78400000000000003,"15min":13.173999999999999},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211304,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.69399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.27400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.5},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.41599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.6269999999999998,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44}]},{"osd":4,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.32700000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.63800000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68000000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71999999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73499999999999999,"5min":0.879,"15min":0.879},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:52:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.47599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.74299999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51500000000000001}]}]}],"pool_statfs":[]}} 2023-10-06T02:52:35.456 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:52:35.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.609+0000 7f45aa55e700 1 Processor -- start 2023-10-06T02:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.609+0000 7f45aa55e700 1 -- start start 2023-10-06T02:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45aa55e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45a41577c0 0x7f45a4068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45aa55e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45aa55e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f45a40cb790 0x7f45a40cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45aa55e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a40cca80 con 0x7f45a41577c0 2023-10-06T02:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45aa55e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a40cedd0 con 0x7f45a40cb790 2023-10-06T02:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45aa55e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40cc4c0 con 0x7f45a4157b90 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45a41577c0 0x7f45a4068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45a41577c0 0x7f45a4068810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55866/0 (socket says 172.21.15.81:55866) 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a3fff700 1 -- 172.21.15.81:0/922241957 learned_addr learned my addr 172.21.15.81:0/922241957 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a8afb700 1 --2- 172.21.15.81:0/922241957 >> v2:172.21.15.83:3300/0 conn(0x7f45a40cb790 0x7f45a40cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a37fe700 1 --2- 172.21.15.81:0/922241957 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a3fff700 1 -- 172.21.15.81:0/922241957 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 msgr2=0x7f45a4068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a3fff700 1 --2- 172.21.15.81:0/922241957 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a4068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a3fff700 1 -- 172.21.15.81:0/922241957 >> v2:172.21.15.83:3300/0 conn(0x7f45a40cb790 msgr2=0x7f45a40cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a3fff700 1 --2- 172.21.15.81:0/922241957 >> v2:172.21.15.83:3300/0 conn(0x7f45a40cb790 0x7f45a40cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a3fff700 1 -- 172.21.15.81:0/922241957 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a40cc7a0 con 0x7f45a41577c0 2023-10-06T02:52:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a37fe700 1 --2- 172.21.15.81:0/922241957 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a4068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a8afb700 1 --2- 172.21.15.81:0/922241957 >> v2:172.21.15.83:3300/0 conn(0x7f45a40cb790 0x7f45a40cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a3fff700 1 --2- 172.21.15.81:0/922241957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a41577c0 0x7f45a4068810 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f45a415d9e0 tx=0x7f4598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dc0cc414266605 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a2ffd700 1 -- 172.21.15.81:0/922241957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800b860 con 0x7f45a41577c0 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a2ffd700 1 -- 172.21.15.81:0/922241957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459800b9c0 con 0x7f45a41577c0 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.610+0000 7f45a2ffd700 1 -- 172.21.15.81:0/922241957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800bd60 con 0x7f45a41577c0 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.611+0000 7f45aa55e700 1 -- 172.21.15.81:0/922241957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a41577c0 msgr2=0x7f45a4068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.611+0000 7f45aa55e700 1 --2- 172.21.15.81:0/922241957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a41577c0 0x7f45a4068810 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f45a415d9e0 tx=0x7f4598009250 comp rx=0 tx=0).stop 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.611+0000 7f45aa55e700 1 -- 172.21.15.81:0/922241957 shutdown_connections 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.611+0000 7f45aa55e700 1 --2- 172.21.15.81:0/922241957 >> v2:172.21.15.83:3300/0 conn(0x7f45a40cb790 0x7f45a40cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.611+0000 7f45aa55e700 1 --2- 172.21.15.81:0/922241957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a41577c0 0x7f45a4068810 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.611+0000 7f45aa55e700 1 --2- 172.21.15.81:0/922241957 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a4068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.611+0000 7f45aa55e700 1 -- 172.21.15.81:0/922241957 >> 172.21.15.81:0/922241957 conn(0x7f45a40d0df0 msgr2=0x7f45a40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.611+0000 7f45aa55e700 1 -- 172.21.15.81:0/922241957 shutdown_connections 2023-10-06T02:52:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.611+0000 7f45aa55e700 1 -- 172.21.15.81:0/922241957 wait complete. 2023-10-06T02:52:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.612+0000 7f45aa55e700 1 Processor -- start 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.612+0000 7f45aa55e700 1 -- start start 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45aa55e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a40cb790 0x7f45a414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45aa55e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a41577c0 0x7f45a4158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45aa55e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a40c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45aa55e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a415dac0 con 0x7f45a40cb790 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45aa55e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a41598f0 con 0x7f45a41577c0 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45aa55e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4159bd0 con 0x7f45a4157b90 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a40cb790 0x7f45a414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a40cb790 0x7f45a414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55878/0 (socket says 172.21.15.81:55878) 2023-10-06T02:52:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a3fff700 1 -- 172.21.15.81:0/607171742 learned_addr learned my addr 172.21.15.81:0/607171742 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a37fe700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a41577c0 0x7f45a4158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a8afb700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a40c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a3fff700 1 -- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 msgr2=0x7f45a40c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a3fff700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a40c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a3fff700 1 -- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a41577c0 msgr2=0x7f45a4158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a3fff700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a41577c0 0x7f45a4158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a3fff700 1 -- 172.21.15.81:0/607171742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45980094f0 con 0x7f45a40cb790 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a37fe700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a41577c0 0x7f45a4158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a8afb700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a40c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.613+0000 7f45a3fff700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a40cb790 0x7f45a414d950 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f45a406fd60 tx=0x7f4598017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.614+0000 7f458bfff700 1 -- 172.21.15.81:0/607171742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598024440 con 0x7f45a40cb790 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.614+0000 7f458bfff700 1 -- 172.21.15.81:0/607171742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45980245a0 con 0x7f45a40cb790 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.614+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a4159eb0 con 0x7f45a40cb790 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.614+0000 7f458bfff700 1 -- 172.21.15.81:0/607171742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598024960 con 0x7f45a40cb790 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.614+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a41539b0 con 0x7f45a40cb790 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.615+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a4153ba0 con 0x7f45a40cb790 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.615+0000 7f458bfff700 1 -- 172.21.15.81:0/607171742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f459801a420 con 0x7f45a40cb790 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.615+0000 7f458bfff700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4590066f30 0x7f45900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.616+0000 7f458bfff700 1 -- 172.21.15.81:0/607171742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f45980864b0 con 0x7f45a40cb790 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.616+0000 7f45a37fe700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4590066f30 0x7f45900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.616+0000 7f45a37fe700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4590066f30 0x7f45900693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4594006fd0 tx=0x7f4594008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.620+0000 7f458bfff700 1 -- 172.21.15.81:0/607171742 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45980535c0 con 0x7f45a40cb790 2023-10-06T02:52:35.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.878+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f45a40cea60 con 0x7f45a40cb790 2023-10-06T02:52:35.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.881+0000 7f458bfff700 1 -- 172.21.15.81:0/607171742 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4598056be0 con 0x7f45a40cb790 2023-10-06T02:52:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4590066f30 msgr2=0x7f45900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4590066f30 0x7f45900693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4594006fd0 tx=0x7f4594008040 comp rx=0 tx=0).stop 2023-10-06T02:52:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a40cb790 msgr2=0x7f45a414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a40cb790 0x7f45a414d950 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f45a406fd60 tx=0x7f4598017000 comp rx=0 tx=0).stop 2023-10-06T02:52:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 shutdown_connections 2023-10-06T02:52:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a4157b90 0x7f45a40c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a40cb790 0x7f45a414d950 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4590066f30 0x7f45900693e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 --2- 172.21.15.81:0/607171742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a41577c0 0x7f45a4158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 >> 172.21.15.81:0/607171742 conn(0x7f45a40d0df0 msgr2=0x7f45a40cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 shutdown_connections 2023-10-06T02:52:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:35.883+0000 7f45aa55e700 1 -- 172.21.15.81:0/607171742 wait complete. 2023-10-06T02:52:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:52:35.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.009+0000 7fce29e70700 1 Processor -- start 2023-10-06T02:52:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.009+0000 7fce29e70700 1 -- start start 2023-10-06T02:52:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce29e70700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159bc0 0x7fce240b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce29e70700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce24067640 con 0x7fce24159f90 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce29e70700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce240b1e50 con 0x7fce240cf060 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce29e70700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce24067890 con 0x7fce24159bc0 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce23fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fce24159f90 0x7fce240ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54226/0 (socket says 172.21.15.81:54226) 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce23fff700 1 -- 172.21.15.81:0/79570230 learned_addr learned my addr 172.21.15.81:0/79570230 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce28e6e700 1 --2- 172.21.15.81:0/79570230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159bc0 0x7fce240b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce237fe700 1 -- 172.21.15.81:0/79570230 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876493645 0 0) 0x7fce24067640 con 0x7fce24159f90 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce237fe700 1 -- 172.21.15.81:0/79570230 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce14003570 con 0x7fce24159f90 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce237fe700 1 -- 172.21.15.81:0/79570230 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801643430 0 0) 0x7fce240b1e50 con 0x7fce240cf060 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce237fe700 1 -- 172.21.15.81:0/79570230 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce24067640 con 0x7fce240cf060 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce28e6e700 1 -- 172.21.15.81:0/79570230 >> v1:172.21.15.83:6789/0 conn(0x7fce240cf060 legacy=0x7fce24163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce28e6e700 1 -- 172.21.15.81:0/79570230 >> v1:172.21.15.81:6789/0 conn(0x7fce24159f90 legacy=0x7fce240ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce237fe700 1 -- 172.21.15.81:0/79570230 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2454483520 0 0) 0x7fce14003570 con 0x7fce24159f90 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.010+0000 7fce28e6e700 1 -- 172.21.15.81:0/79570230 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce24067b70 con 0x7fce24159bc0 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce28e6e700 1 --2- 172.21.15.81:0/79570230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159bc0 0x7fce240b17c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce18009910 tx=0x7fce180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a88b1635e494c7af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce237fe700 1 -- 172.21.15.81:0/79570230 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18011630 con 0x7fce24159bc0 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce237fe700 1 -- 172.21.15.81:0/79570230 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18011790 con 0x7fce24159bc0 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce237fe700 1 -- 172.21.15.81:0/79570230 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18011b10 con 0x7fce24159bc0 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce29e70700 1 -- 172.21.15.81:0/79570230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159bc0 msgr2=0x7fce240b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce29e70700 1 --2- 172.21.15.81:0/79570230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159bc0 0x7fce240b17c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce18009910 tx=0x7fce180091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce29e70700 1 -- 172.21.15.81:0/79570230 shutdown_connections 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce29e70700 1 --2- 172.21.15.81:0/79570230 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159bc0 0x7fce240b17c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce29e70700 1 -- 172.21.15.81:0/79570230 >> 172.21.15.81:0/79570230 conn(0x7fce2406c620 msgr2=0x7fce2406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:36.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce29e70700 1 -- 172.21.15.81:0/79570230 shutdown_connections 2023-10-06T02:52:36.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.011+0000 7fce29e70700 1 -- 172.21.15.81:0/79570230 wait complete. 2023-10-06T02:52:36.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.012+0000 7fce29e70700 1 Processor -- start 2023-10-06T02:52:36.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.013+0000 7fce29e70700 1 -- start start 2023-10-06T02:52:36.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.013+0000 7fce29e70700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce240cf060 0x7fce24152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.013+0000 7fce29e70700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce24159bc0 0x7fce240cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.013+0000 7fce29e70700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159f90 0x7fce240c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.013+0000 7fce29e70700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce24152c40 con 0x7fce240cf060 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.013+0000 7fce29e70700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce240ade20 con 0x7fce24159bc0 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.013+0000 7fce29e70700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce240ae9a0 con 0x7fce24159f90 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce28e6e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce240cf060 0x7fce24152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce28e6e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce240cf060 0x7fce24152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55890/0 (socket says 172.21.15.81:55890) 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce28e6e700 1 -- 172.21.15.81:0/3694165104 learned_addr learned my addr 172.21.15.81:0/3694165104 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce23fff700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce24159bc0 0x7fce240cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce2966f700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159f90 0x7fce240c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce28e6e700 1 -- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159f90 msgr2=0x7fce240c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce28e6e700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159f90 0x7fce240c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce28e6e700 1 -- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce24159bc0 msgr2=0x7fce240cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce28e6e700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce24159bc0 0x7fce240cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce28e6e700 1 -- 172.21.15.81:0/3694165104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18009420 con 0x7fce240cf060 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce2966f700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159f90 0x7fce240c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce28e6e700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce240cf060 0x7fce24152700 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fce18009860 tx=0x7fce18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce20ff9700 1 -- 172.21.15.81:0/3694165104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18011b10 con 0x7fce240cf060 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce20ff9700 1 -- 172.21.15.81:0/3694165104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18025400 con 0x7fce240cf060 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce240ae070 con 0x7fce240cf060 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce20ff9700 1 -- 172.21.15.81:0/3694165104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180257c0 con 0x7fce240cf060 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.014+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce240ae630 con 0x7fce240cf060 2023-10-06T02:52:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.015+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce24069920 con 0x7fce240cf060 2023-10-06T02:52:36.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.015+0000 7fce20ff9700 1 -- 172.21.15.81:0/3694165104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce1802e430 con 0x7fce240cf060 2023-10-06T02:52:36.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.016+0000 7fce20ff9700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce08066f30 0x7fce080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.016+0000 7fce20ff9700 1 -- 172.21.15.81:0/3694165104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce18086040 con 0x7fce240cf060 2023-10-06T02:52:36.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.016+0000 7fce23fff700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce08066f30 0x7fce080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.016+0000 7fce23fff700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce08066f30 0x7fce080693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fce10000fb0 tx=0x7fce10007bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.020+0000 7fce20ff9700 1 -- 172.21.15.81:0/3694165104 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce18053150 con 0x7fce240cf060 2023-10-06T02:52:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.246+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce240ce2b0 con 0x7fce240cf060 2023-10-06T02:52:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.247+0000 7fce20ff9700 1 -- 172.21.15.81:0/3694165104 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fce18056770 con 0x7fce240cf060 2023-10-06T02:52:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:36.248 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:52:25.912348+0000","modified":"2023-10-06T02:52:29.566702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7275":{"gid":7275,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/4039558742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":4039558742},{"type":"v1","addr":"172.21.15.83:6836","nonce":4039558742}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T02:52:36.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce08066f30 msgr2=0x7fce080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce08066f30 0x7fce080693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fce10000fb0 tx=0x7fce10007bb0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce240cf060 msgr2=0x7fce24152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce240cf060 0x7fce24152700 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fce18009860 tx=0x7fce18017000 comp rx=0 tx=0).stop 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 shutdown_connections 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce24159f90 0x7fce240c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce240cf060 0x7fce24152700 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce08066f30 0x7fce080693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 --2- 172.21.15.81:0/3694165104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce24159bc0 0x7fce240cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 >> 172.21.15.81:0/3694165104 conn(0x7fce2406c620 msgr2=0x7fce2415a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 shutdown_connections 2023-10-06T02:52:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.249+0000 7fce29e70700 1 -- 172.21.15.81:0/3694165104 wait complete. 2023-10-06T02:52:36.252 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 67 2023-10-06T02:52:36.664 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:52:25.912348+0000', 'modified': '2023-10-06T02:52:29.566702+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7275': {'gid': 7275, 'name': 'd', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6836/4039558742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 4039558742}, {'type': 'v1', 'addr': '172.21.15.83:6836', 'nonce': 4039558742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:52:36.664 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:52:36.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T02:52:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.779+0000 7fe629263700 1 Processor -- start 2023-10-06T02:52:36.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.779+0000 7fe629263700 1 -- start start 2023-10-06T02:52:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.780+0000 7fe629263700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6240ce1f0 0x7fe6240aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.780+0000 7fe629263700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe6240ac570 0x7fe62406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.780+0000 7fe629263700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62415dfb0 con 0x7fe6240ce5c0 2023-10-06T02:52:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.780+0000 7fe629263700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6240acec0 con 0x7fe6240ce1f0 2023-10-06T02:52:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.780+0000 7fe629263700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6240ad1a0 con 0x7fe6240ac570 2023-10-06T02:52:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.780+0000 7fe622ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6240ce1f0 0x7fe6240aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.780+0000 7fe622ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6240ce1f0 0x7fe6240aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55904/0 (socket says 172.21.15.81:55904) 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.780+0000 7fe622ffd700 1 -- 172.21.15.81:0/2782921665 learned_addr learned my addr 172.21.15.81:0/2782921665 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.781+0000 7fe6237fe700 1 --2- 172.21.15.81:0/2782921665 >> v2:172.21.15.83:3300/0 conn(0x7fe6240ac570 0x7fe62406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.781+0000 7fe622ffd700 1 -- 172.21.15.81:0/2782921665 >> v2:172.21.15.83:3300/0 conn(0x7fe6240ac570 msgr2=0x7fe62406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.781+0000 7fe622ffd700 1 --2- 172.21.15.81:0/2782921665 >> v2:172.21.15.83:3300/0 conn(0x7fe6240ac570 0x7fe62406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.781+0000 7fe622ffd700 1 -- 172.21.15.81:0/2782921665 >> v1:172.21.15.83:6789/0 conn(0x7fe6240ce5c0 legacy=0x7fe62415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.781+0000 7fe622ffd700 1 -- 172.21.15.81:0/2782921665 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62415dc40 con 0x7fe6240ce1f0 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.781+0000 7fe622ffd700 1 --2- 172.21.15.81:0/2782921665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ce1f0 0x7fe6240aacf0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe6240b3760 tx=0x7fe614009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fc8825feb0daf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.781+0000 7fe6227fc700 1 -- 172.21.15.81:0/2782921665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400b860 con 0x7fe6240ce1f0 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.781+0000 7fe6227fc700 1 -- 172.21.15.81:0/2782921665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61400b9c0 con 0x7fe6240ce1f0 2023-10-06T02:52:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.781+0000 7fe6227fc700 1 -- 172.21.15.81:0/2782921665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400bd60 con 0x7fe6240ce1f0 2023-10-06T02:52:36.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.782+0000 7fe629263700 1 -- 172.21.15.81:0/2782921665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ce1f0 msgr2=0x7fe6240aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.782+0000 7fe629263700 1 --2- 172.21.15.81:0/2782921665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ce1f0 0x7fe6240aacf0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe6240b3760 tx=0x7fe614009250 comp rx=0 tx=0).stop 2023-10-06T02:52:36.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.782+0000 7fe629263700 1 -- 172.21.15.81:0/2782921665 shutdown_connections 2023-10-06T02:52:36.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.782+0000 7fe629263700 1 --2- 172.21.15.81:0/2782921665 >> v2:172.21.15.83:3300/0 conn(0x7fe6240ac570 0x7fe62406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.782+0000 7fe629263700 1 --2- 172.21.15.81:0/2782921665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ce1f0 0x7fe6240aacf0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.782+0000 7fe629263700 1 -- 172.21.15.81:0/2782921665 >> 172.21.15.81:0/2782921665 conn(0x7fe62406cca0 msgr2=0x7fe62406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:36.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.782+0000 7fe629263700 1 -- 172.21.15.81:0/2782921665 shutdown_connections 2023-10-06T02:52:36.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.782+0000 7fe629263700 1 -- 172.21.15.81:0/2782921665 wait complete. 2023-10-06T02:52:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.783+0000 7fe629263700 1 Processor -- start 2023-10-06T02:52:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.783+0000 7fe629263700 1 -- start start 2023-10-06T02:52:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe629263700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ac570 0x7fe62415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe629263700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6240ce1f0 0x7fe624147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe629263700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6240ce5c0 0x7fe6241592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe629263700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62415c2f0 con 0x7fe6240ac570 2023-10-06T02:52:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe629263700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62415cb50 con 0x7fe6240ce5c0 2023-10-06T02:52:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe629263700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62416e7f0 con 0x7fe6240ce1f0 2023-10-06T02:52:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe622ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ac570 0x7fe62415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe622ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ac570 0x7fe62415cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55910/0 (socket says 172.21.15.81:55910) 2023-10-06T02:52:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe622ffd700 1 -- 172.21.15.81:0/2226137535 learned_addr learned my addr 172.21.15.81:0/2226137535 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6240ce1f0 0x7fe624147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe6237fe700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6240ce5c0 0x7fe6241592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe622ffd700 1 -- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6240ce1f0 msgr2=0x7fe624147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe622ffd700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6240ce1f0 0x7fe624147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe622ffd700 1 -- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6240ce5c0 msgr2=0x7fe6241592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe622ffd700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6240ce5c0 0x7fe6241592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe622ffd700 1 -- 172.21.15.81:0/2226137535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140094f0 con 0x7fe6240ac570 2023-10-06T02:52:36.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe622ffd700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ac570 0x7fe62415cfe0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe62406cc70 tx=0x7fe614017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe61b7fe700 1 -- 172.21.15.81:0/2226137535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614011e60 con 0x7fe6240ac570 2023-10-06T02:52:36.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe61b7fe700 1 -- 172.21.15.81:0/2226137535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61401a630 con 0x7fe6240ac570 2023-10-06T02:52:36.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe629263700 1 -- 172.21.15.81:0/2226137535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62415c500 con 0x7fe6240ac570 2023-10-06T02:52:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe61b7fe700 1 -- 172.21.15.81:0/2226137535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61401a9f0 con 0x7fe6240ac570 2023-10-06T02:52:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.784+0000 7fe629263700 1 -- 172.21.15.81:0/2226137535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62415d520 con 0x7fe6240ac570 2023-10-06T02:52:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.786+0000 7fe61b7fe700 1 -- 172.21.15.81:0/2226137535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe61402d440 con 0x7fe6240ac570 2023-10-06T02:52:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.786+0000 7fe61b7fe700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe604066f60 0x7fe604069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.786+0000 7fe61b7fe700 1 -- 172.21.15.81:0/2226137535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe614086260 con 0x7fe6240ac570 2023-10-06T02:52:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.787+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe604066f60 0x7fe604069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.787+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe604066f60 0x7fe604069410 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe6240cd0b0 tx=0x7fe60c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.788+0000 7fe63255bb80 1 Processor -- start 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.788+0000 7fe63255bb80 1 -- start start 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad4ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4fcc0 0x55a9cad9e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad9ec00 0x55a9cad9f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe63255bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9caca5a70 con 0x55a9cad4e840 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe63255bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9caca3270 con 0x55a9cad9ec00 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe63255bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9cac9f060 con 0x55a9cad4fcc0 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe622ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad4ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe622ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad4ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55918/0 (socket says 172.21.15.81:55918) 2023-10-06T02:52:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe622ffd700 1 -- 172.21.15.81:0/424972121 learned_addr learned my addr 172.21.15.81:0/424972121 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe6237fe700 1 --2- 172.21.15.81:0/424972121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad9ec00 0x55a9cad9f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/424972121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4fcc0 0x55a9cad9e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe622ffd700 1 -- 172.21.15.81:0/424972121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4fcc0 msgr2=0x55a9cad9e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe622ffd700 1 --2- 172.21.15.81:0/424972121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4fcc0 0x55a9cad9e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe622ffd700 1 -- 172.21.15.81:0/424972121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad9ec00 msgr2=0x55a9cad9f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe622ffd700 1 --2- 172.21.15.81:0/424972121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad9ec00 0x55a9cad9f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.789+0000 7fe622ffd700 1 -- 172.21.15.81:0/424972121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9cab39270 con 0x55a9cad4e840 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe622ffd700 1 --2- 172.21.15.81:0/424972121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad4ec10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe6140846d0 tx=0x7fe614084580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d0eef87ab1f820 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe603fff700 1 -- 172.21.15.81:0/424972121 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614057730 con 0x55a9cad4e840 2023-10-06T02:52:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe603fff700 1 -- 172.21.15.81:0/424972121 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe614057030 con 0x55a9cad4e840 2023-10-06T02:52:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe603fff700 1 -- 172.21.15.81:0/424972121 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61405a280 con 0x55a9cad4e840 2023-10-06T02:52:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe63255bb80 1 -- 172.21.15.81:0/424972121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 msgr2=0x55a9cad4ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe63255bb80 1 --2- 172.21.15.81:0/424972121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad4ec10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe6140846d0 tx=0x7fe614084580 comp rx=0 tx=0).stop 2023-10-06T02:52:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe63255bb80 1 -- 172.21.15.81:0/424972121 shutdown_connections 2023-10-06T02:52:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe63255bb80 1 --2- 172.21.15.81:0/424972121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad9ec00 0x55a9cad9f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe63255bb80 1 --2- 172.21.15.81:0/424972121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad4ec10 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe63255bb80 1 --2- 172.21.15.81:0/424972121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4fcc0 0x55a9cad9e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe63255bb80 1 -- 172.21.15.81:0/424972121 >> 172.21.15.81:0/424972121 conn(0x55a9cad50160 msgr2=0x55a9cad50530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe63255bb80 1 -- 172.21.15.81:0/424972121 shutdown_connections 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.790+0000 7fe63255bb80 1 -- 172.21.15.81:0/424972121 wait complete. 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.791+0000 7fe63255bb80 1 -- start start 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.791+0000 7fe63255bb80 1 Processor -- start 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad926b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cad96a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad9ec00 0x55a9cad96fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe63255bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cac4a890 con 0x55a9cad4e840 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe63255bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cac65ea0 con 0x55a9cad4fcc0 2023-10-06T02:52:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe63255bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9cab21e30 con 0x55a9cad9ec00 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe63255bb80 10 client.0 _ll_register_callbacks cb 0x55a9cad11e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe622ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad926b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe622ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad926b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55932/0 (socket says 172.21.15.81:55932) 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe622ffd700 1 -- 172.21.15.81:0/1313537906 learned_addr learned my addr 172.21.15.81:0/1313537906 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cad96a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe6237fe700 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad9ec00 0x55a9cad96fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe622ffd700 1 -- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad9ec00 msgr2=0x55a9cad96fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe622ffd700 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad9ec00 0x55a9cad96fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe622ffd700 1 -- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 msgr2=0x55a9cad96a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe622ffd700 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cad96a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe622ffd700 1 -- 172.21.15.81:0/1313537906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62415d520 con 0x55a9cad4e840 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cad96a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe6237fe700 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad9ec00 0x55a9cad96fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe6017fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.792+0000 7fe622ffd700 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad926b0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe61400b3c0 tx=0x7fe614059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae44a1117e7ce94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe6017fa700 1 -- 172.21.15.81:0/1313537906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61405e050 con 0x55a9cad4e840 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe6017fa700 1 -- 172.21.15.81:0/1313537906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe61402b550 con 0x55a9cad4e840 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe63255bb80 1 -- 172.21.15.81:0/1313537906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9cad43940 con 0x55a9cad4e840 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe6017fa700 1 -- 172.21.15.81:0/1313537906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe61405a280 con 0x55a9cad4e840 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe63255bb80 10 client.7428 fetch_fsmap learned FSMap version 67 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe63255bb80 1 -- 172.21.15.81:0/1313537906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55a9caadbfe0 con 0x55a9cad4e840 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe6017fa700 1 -- 172.21.15.81:0/1313537906 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9cad43940 con 0x55a9cad4e840 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe6017fa700 1 -- 172.21.15.81:0/1313537906 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe614057290 con 0x55a9cad4e840 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe63255bb80 10 client.7428 fetch_fsmap finished waiting for FSMap version 67 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe63255bb80 10 client.7428 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe63255bb80 20 client.7428 populate_metadata read hostname 'smithi081' 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe63255bb80 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] conn(0x55a9cad8d9e0 0x55a9cad8ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe63255bb80 4 client.7428 mds_command: new command op to 7275 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe63255bb80 1 -- 172.21.15.81:0/1313537906 --> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9cad20870 con 0x55a9cad8d9e0 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.793+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] conn(0x55a9cad8d9e0 0x55a9cad8ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.794+0000 7fe6017fa700 10 client.7428 ms_handle_connect on v2:172.21.15.83:6834/4039558742 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.794+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] conn(0x55a9cad8d9e0 0x55a9cad8ddb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b398e04c24fa7f61 server_cookie=b5991fc05985769c in_seq=0 out_seq=0 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.794+0000 7fe6017fa700 1 -- 172.21.15.81:0/1313537906 <== mds.0 v2:172.21.15.83:6834/4039558742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a9cad20870 con 0x55a9cad8d9e0 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.794+0000 7fe6017fa700 10 client.7428 handle_command_reply: tid=0 2023-10-06T02:52:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.794+0000 7fe63255bb80 1 client.7428 shutdown 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.794+0000 7fe63255bb80 1 -- 172.21.15.81:0/1313537906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 msgr2=0x55a9cad926b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.794+0000 7fe63255bb80 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad926b0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe61400b3c0 tx=0x7fe614059000 comp rx=0 tx=0).stop 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe63255bb80 1 -- 172.21.15.81:0/1313537906 shutdown_connections 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe63255bb80 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] conn(0x55a9cad8d9e0 0x55a9cad8ddb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe63255bb80 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad9ec00 0x55a9cad96fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe63255bb80 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad4e840 0x55a9cad926b0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe63255bb80 1 --2- 172.21.15.81:0/1313537906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cad96a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe6017fa700 0 client.7428 ms_handle_reset on v2:172.21.15.83:6834/4039558742 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe63255bb80 1 -- 172.21.15.81:0/1313537906 >> 172.21.15.81:0/1313537906 conn(0x55a9cad50160 msgr2=0x55a9cad4f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe63255bb80 1 -- 172.21.15.81:0/1313537906 shutdown_connections 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe63255bb80 1 -- 172.21.15.81:0/1313537906 wait complete. 2023-10-06T02:52:36.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.795+0000 7fe63255bb80 20 client.7428 trim_cache size 0 max 16384 2023-10-06T02:52:36.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.811+0000 7fe63255bb80 1 Processor -- start 2023-10-06T02:52:36.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.811+0000 7fe63255bb80 1 -- start start 2023-10-06T02:52:36.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 0x55a9cad4f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cad8ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cad8e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe63255bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cad99530 con 0x55a9cad9ec00 2023-10-06T02:52:36.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe63255bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cad95d20 con 0x55a9cad4fcc0 2023-10-06T02:52:36.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe63255bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9cad4c340 con 0x55a9cad4e840 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe6237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cad8e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe6237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cad8e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55942/0 (socket says 172.21.15.81:55942) 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe6237fe700 1 -- 172.21.15.81:0/3984978217 learned_addr learned my addr 172.21.15.81:0/3984978217 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe622ffd700 1 --2- 172.21.15.81:0/3984978217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 0x55a9cad4f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/3984978217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cad8ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe6237fe700 1 -- 172.21.15.81:0/3984978217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 msgr2=0x55a9cad4f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe6237fe700 1 --2- 172.21.15.81:0/3984978217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 0x55a9cad4f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe6237fe700 1 -- 172.21.15.81:0/3984978217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 msgr2=0x55a9cad8ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe6237fe700 1 --2- 172.21.15.81:0/3984978217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cad8ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe6237fe700 1 -- 172.21.15.81:0/3984978217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9cad7eae0 con 0x55a9cad9ec00 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.812+0000 7fe6237fe700 1 --2- 172.21.15.81:0/3984978217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cad8e2f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0074b0 tx=0x7fe61c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8b6311e0003974 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe618ff9700 1 -- 172.21.15.81:0/3984978217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c009ca0 con 0x55a9cad9ec00 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe618ff9700 1 -- 172.21.15.81:0/3984978217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c00f040 con 0x55a9cad9ec00 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe618ff9700 1 -- 172.21.15.81:0/3984978217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c017880 con 0x55a9cad9ec00 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe63255bb80 1 -- 172.21.15.81:0/3984978217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 msgr2=0x55a9cad8e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe63255bb80 1 --2- 172.21.15.81:0/3984978217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cad8e2f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0074b0 tx=0x7fe61c00b040 comp rx=0 tx=0).stop 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe63255bb80 1 -- 172.21.15.81:0/3984978217 shutdown_connections 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe63255bb80 1 --2- 172.21.15.81:0/3984978217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cad8e2f0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe63255bb80 1 --2- 172.21.15.81:0/3984978217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 0x55a9cad4f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe63255bb80 1 --2- 172.21.15.81:0/3984978217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cad8ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe63255bb80 1 -- 172.21.15.81:0/3984978217 >> 172.21.15.81:0/3984978217 conn(0x55a9cad50160 msgr2=0x55a9cad4c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe63255bb80 1 -- 172.21.15.81:0/3984978217 shutdown_connections 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.813+0000 7fe63255bb80 1 -- 172.21.15.81:0/3984978217 wait complete. 2023-10-06T02:52:36.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.814+0000 7fe63255bb80 1 -- start start 2023-10-06T02:52:36.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.814+0000 7fe63255bb80 1 Processor -- start 2023-10-06T02:52:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 0x55a9cada1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cadf9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cadf9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cad989a0 con 0x55a9cad9ec00 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cad98470 con 0x55a9cad4fcc0 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9cad8e5a0 con 0x55a9cad4e840 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 10 client.0 _ll_register_callbacks cb 0x55a9cad11e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cadf9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cadf9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55958/0 (socket says 172.21.15.81:55958) 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6237fe700 1 -- 172.21.15.81:0/563487262 learned_addr learned my addr 172.21.15.81:0/563487262 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe622ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 0x55a9cada1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe61a7fc700 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cadf9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6237fe700 1 -- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 msgr2=0x55a9cada1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6237fe700 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 0x55a9cada1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6237fe700 1 -- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 msgr2=0x55a9cadf9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6237fe700 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cadf9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6237fe700 1 -- 172.21.15.81:0/563487262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c009e10 con 0x55a9cad9ec00 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6237fe700 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cadf9850 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe61c01b000 tx=0x7fe61c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c286496af266104e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6017fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6017fa700 1 -- 172.21.15.81:0/563487262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c0070a0 con 0x55a9cad9ec00 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6017fa700 1 -- 172.21.15.81:0/563487262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe61c009670 con 0x55a9cad9ec00 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 1 -- 172.21.15.81:0/563487262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe614057030 con 0x55a9cad9ec00 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe6017fa700 1 -- 172.21.15.81:0/563487262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe61c017860 con 0x55a9cad9ec00 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 10 client.7434 fetch_fsmap learned FSMap version 67 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.815+0000 7fe63255bb80 1 -- 172.21.15.81:0/563487262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55a9cac6d780 con 0x55a9cad9ec00 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe6017fa700 1 -- 172.21.15.81:0/563487262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe614057030 con 0x55a9cad9ec00 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe6017fa700 1 -- 172.21.15.81:0/563487262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe61c014050 con 0x55a9cad9ec00 2023-10-06T02:52:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe63255bb80 10 client.7434 fetch_fsmap finished waiting for FSMap version 67 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe63255bb80 10 client.7434 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe63255bb80 20 client.7434 populate_metadata read hostname 'smithi081' 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe63255bb80 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] conn(0x55a9cad8ece0 0x55a9cad8f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe63255bb80 4 client.7434 mds_command: new command op to 7275 tid=0[{"prefix": "status"}] 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe63255bb80 1 -- 172.21.15.81:0/563487262 --> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9cac41e00 con 0x55a9cad8ece0 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe622ffd700 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] conn(0x55a9cad8ece0 0x55a9cad8f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe6017fa700 10 client.7434 ms_handle_connect on v2:172.21.15.83:6834/4039558742 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe622ffd700 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] conn(0x55a9cad8ece0 0x55a9cad8f0b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0555b79867f55de server_cookie=7ed2e186125eceb7 in_seq=0 out_seq=0 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe6017fa700 1 -- 172.21.15.81:0/563487262 <== mds.0 v2:172.21.15.83:6834/4039558742 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55a9cac41e00 con 0x55a9cad8ece0 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe6017fa700 10 client.7434 handle_command_reply: tid=0 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.816+0000 7fe63255bb80 1 client.7434 shutdown 2023-10-06T02:52:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 -- 172.21.15.81:0/563487262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 msgr2=0x55a9cadf9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cadf9850 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe61c01b000 tx=0x7fe61c021000 comp rx=0 tx=0).stop 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 -- 172.21.15.81:0/563487262 shutdown_connections 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:6834/4039558742,v1:172.21.15.83:6836/4039558742] conn(0x55a9cad8ece0 0x55a9cad8f0b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9cad9ec00 0x55a9cadf9850 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe6017fa700 0 client.7434 ms_handle_reset on v2:172.21.15.83:6834/4039558742 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a9cad4e840 0x55a9cada1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 --2- 172.21.15.81:0/563487262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a9cad4fcc0 0x55a9cadf9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 -- 172.21.15.81:0/563487262 >> 172.21.15.81:0/563487262 conn(0x55a9cad50160 msgr2=0x55a9cad4f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 -- 172.21.15.81:0/563487262 shutdown_connections 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 1 -- 172.21.15.81:0/563487262 wait complete. 2023-10-06T02:52:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe63255bb80 20 client.7434 trim_cache size 0 max 16384 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7275, 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 10.265653289999999, 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 67, 2023-10-06T02:52:36.826 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 135, 2023-10-06T02:52:36.827 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 135, 2023-10-06T02:52:36.827 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 16.386691041999999 2023-10-06T02:52:36.827 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 -- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe604066f60 msgr2=0x7fe604069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe604066f60 0x7fe604069410 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe6240cd0b0 tx=0x7fe60c009040 comp rx=0 tx=0).stop 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 -- 172.21.15.81:0/2226137535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ac570 msgr2=0x7fe62415cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ac570 0x7fe62415cfe0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe62406cc70 tx=0x7fe614017000 comp rx=0 tx=0).stop 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 -- 172.21.15.81:0/2226137535 shutdown_connections 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe604066f60 0x7fe604069410 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6240ce5c0 0x7fe6241592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240ac570 0x7fe62415cfe0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 --2- 172.21.15.81:0/2226137535 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6240ce1f0 0x7fe624147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 -- 172.21.15.81:0/2226137535 >> 172.21.15.81:0/2226137535 conn(0x7fe62406cca0 msgr2=0x7fe6241569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 -- 172.21.15.81:0/2226137535 shutdown_connections 2023-10-06T02:52:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.817+0000 7fe629263700 1 -- 172.21.15.81:0/2226137535 wait complete. 2023-10-06T02:52:36.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:52:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.943+0000 7fcaa9299700 1 Processor -- start 2023-10-06T02:52:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.943+0000 7fcaa9299700 1 -- start start 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa9299700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcaa41578d0 0x7fcaa40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa9299700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa406d120 0x7fcaa406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa9299700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa40d07c0 con 0x7fcaa4157ca0 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa9299700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa406daa0 con 0x7fcaa41578d0 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa9299700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40cfbb0 con 0x7fcaa406d120 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcaa4157ca0 0x7fcaa415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54236/0 (socket says 172.21.15.81:54236) 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa27fc700 1 -- 172.21.15.81:0/2442642527 learned_addr learned my addr 172.21.15.81:0/2442642527 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa2ffd700 1 --2- 172.21.15.81:0/2442642527 >> v2:172.21.15.83:3300/0 conn(0x7fcaa41578d0 0x7fcaa40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa37fe700 1 --2- 172.21.15.81:0/2442642527 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa406d120 0x7fcaa406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa1ffb700 1 -- 172.21.15.81:0/2442642527 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503049007 0 0) 0x7fcaa40d07c0 con 0x7fcaa4157ca0 2023-10-06T02:52:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa1ffb700 1 -- 172.21.15.81:0/2442642527 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca8c003570 con 0x7fcaa4157ca0 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa37fe700 1 -- 172.21.15.81:0/2442642527 >> v2:172.21.15.83:3300/0 conn(0x7fcaa41578d0 msgr2=0x7fcaa40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa37fe700 1 --2- 172.21.15.81:0/2442642527 >> v2:172.21.15.83:3300/0 conn(0x7fcaa41578d0 0x7fcaa40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa37fe700 1 -- 172.21.15.81:0/2442642527 >> v1:172.21.15.81:6789/0 conn(0x7fcaa4157ca0 legacy=0x7fcaa415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa37fe700 1 -- 172.21.15.81:0/2442642527 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40cfe90 con 0x7fcaa406d120 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa2ffd700 1 --2- 172.21.15.81:0/2442642527 >> v2:172.21.15.83:3300/0 conn(0x7fcaa41578d0 0x7fcaa40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.944+0000 7fcaa37fe700 1 --2- 172.21.15.81:0/2442642527 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa406d120 0x7fcaa406d560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca940098e0 tx=0x7fca940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d5772fabb47986 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa1ffb700 1 -- 172.21.15.81:0/2442642527 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94011630 con 0x7fcaa406d120 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa1ffb700 1 -- 172.21.15.81:0/2442642527 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94011790 con 0x7fcaa406d120 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa1ffb700 1 -- 172.21.15.81:0/2442642527 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94011b10 con 0x7fcaa406d120 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa9299700 1 -- 172.21.15.81:0/2442642527 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa406d120 msgr2=0x7fcaa406d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa9299700 1 --2- 172.21.15.81:0/2442642527 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa406d120 0x7fcaa406d560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca940098e0 tx=0x7fca940091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa9299700 1 -- 172.21.15.81:0/2442642527 shutdown_connections 2023-10-06T02:52:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa9299700 1 --2- 172.21.15.81:0/2442642527 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa406d120 0x7fcaa406d560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa9299700 1 --2- 172.21.15.81:0/2442642527 >> v2:172.21.15.83:3300/0 conn(0x7fcaa41578d0 0x7fcaa40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa9299700 1 -- 172.21.15.81:0/2442642527 >> 172.21.15.81:0/2442642527 conn(0x7fcaa406bb90 msgr2=0x7fcaa406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa9299700 1 -- 172.21.15.81:0/2442642527 shutdown_connections 2023-10-06T02:52:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.945+0000 7fcaa9299700 1 -- 172.21.15.81:0/2442642527 wait complete. 2023-10-06T02:52:36.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.946+0000 7fcaa9299700 1 Processor -- start 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.946+0000 7fcaa9299700 1 -- start start 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa9299700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa406d120 0x7fcaa4154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa9299700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa41578d0 0x7fcaa40c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa9299700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4157ca0 0x7fcaa40c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa9299700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40c5b20 con 0x7fcaa4157ca0 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa9299700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40c6680 con 0x7fcaa406d120 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa9299700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40c5d50 con 0x7fcaa41578d0 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4157ca0 0x7fcaa40c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4157ca0 0x7fcaa40c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55968/0 (socket says 172.21.15.81:55968) 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa37fe700 1 -- 172.21.15.81:0/712723826 learned_addr learned my addr 172.21.15.81:0/712723826 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa27fc700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa41578d0 0x7fcaa40c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.947+0000 7fcaa2ffd700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa406d120 0x7fcaa4154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fcaa37fe700 1 -- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa41578d0 msgr2=0x7fcaa40c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fcaa37fe700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa41578d0 0x7fcaa40c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fcaa37fe700 1 -- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa406d120 msgr2=0x7fcaa4154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fcaa37fe700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa406d120 0x7fcaa4154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fcaa37fe700 1 -- 172.21.15.81:0/712723826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c009a20 con 0x7fcaa4157ca0 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fcaa37fe700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4157ca0 0x7fcaa40c7bc0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4068330 tx=0x7fca94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fca8affd700 1 -- 172.21.15.81:0/712723826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9401a430 con 0x7fcaa4157ca0 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fca8affd700 1 -- 172.21.15.81:0/712723826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9401a590 con 0x7fcaa4157ca0 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fca8affd700 1 -- 172.21.15.81:0/712723826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9401a950 con 0x7fcaa4157ca0 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca94009420 con 0x7fcaa4157ca0 2023-10-06T02:52:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.948+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa40c6310 con 0x7fcaa4157ca0 2023-10-06T02:52:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.949+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa40b2fc0 con 0x7fcaa4157ca0 2023-10-06T02:52:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.949+0000 7fca8affd700 1 -- 172.21.15.81:0/712723826 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca9401ad00 con 0x7fcaa4157ca0 2023-10-06T02:52:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.949+0000 7fca8affd700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca90066f30 0x7fca900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.950+0000 7fca8affd700 1 -- 172.21.15.81:0/712723826 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca94086520 con 0x7fcaa4157ca0 2023-10-06T02:52:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.950+0000 7fcaa2ffd700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca90066f30 0x7fca900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.950+0000 7fcaa2ffd700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca90066f30 0x7fca900693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0099f0 tx=0x7fca9c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:36.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:36.954+0000 7fca8affd700 1 -- 172.21.15.81:0/712723826 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca94053630 con 0x7fcaa4157ca0 2023-10-06T02:52:37.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:52:37.165 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:52:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.180+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcaa40c67c0 con 0x7fcaa4157ca0 2023-10-06T02:52:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.181+0000 7fca8affd700 1 -- 172.21.15.81:0/712723826 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca94056c50 con 0x7fcaa4157ca0 2023-10-06T02:52:37.182 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:52:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca90066f30 msgr2=0x7fca900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca90066f30 0x7fca900693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0099f0 tx=0x7fca9c00b040 comp rx=0 tx=0).stop 2023-10-06T02:52:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4157ca0 msgr2=0x7fcaa40c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4157ca0 0x7fcaa40c7bc0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4068330 tx=0x7fca94017000 comp rx=0 tx=0).stop 2023-10-06T02:52:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 shutdown_connections 2023-10-06T02:52:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4157ca0 0x7fcaa40c7bc0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fca90066f30 0x7fca900693e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa406d120 0x7fcaa4154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 --2- 172.21.15.81:0/712723826 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa41578d0 0x7fcaa40c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 >> 172.21.15.81:0/712723826 conn(0x7fcaa406bb90 msgr2=0x7fcaa41569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 shutdown_connections 2023-10-06T02:52:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:37.183+0000 7fcaa9299700 1 -- 172.21.15.81:0/712723826 wait complete. 2023-10-06T02:52:37.196 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:52:37.197 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:52:37.197 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:52:37.197 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:52:37.197 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:52:37.197 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:52:37.197 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:52:37.197 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:52:37.197 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:52:37.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:37.198 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:52:37.278 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:52:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:52:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:52:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42159sec preferred_lft 42159sec 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:52:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:52:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:52:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:37.281 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:52:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:52:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:52:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:37.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:37.281 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:52:37.342 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:52:37.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:37.343 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:52:37.399 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:52:37.399 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:52:37.399 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:52:37.399 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:52:37.399 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:52:37.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:37.400 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:52:37.400 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:52:37.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:52:37.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:52:37.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:52:37.400 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:52:37.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:37.499 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:52:37.514 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:52:37.514 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:52:37.514 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:52:37.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:37.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:52:37.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:52:37.578 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:52:37.633 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:52:37.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:52:37.633 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:52:37.687 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:52:37.687 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:52:37.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:37.766 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:37.767 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:37.785 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:37.785 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:37.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:52:37.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:52:37.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:52:37.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:52:37.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:52:37.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:52:37.807 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:37.813 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:37.813 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:52:37.813 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:52:37.813 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:52:37.813 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:52:37.813 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:52:37.813 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:52:37.813 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:52:37.814 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:52:37.814 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:52:37.815 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:52:37.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:37.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:52:37.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:52:38.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.032+0000 7f46b166d700 1 Processor -- start 2023-10-06T02:52:38.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.032+0000 7f46b166d700 1 -- start start 2023-10-06T02:52:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.033+0000 7f46b166d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac0ce1f0 0x7f46ac0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.033+0000 7f46b166d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f46ac0ce5c0 0x7f46ac15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.033+0000 7f46b166d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac15dfb0 con 0x7f46ac0ac570 2023-10-06T02:52:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.033+0000 7f46b166d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac0acec0 con 0x7f46ac0ce5c0 2023-10-06T02:52:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.033+0000 7f46b166d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0ad1a0 con 0x7f46ac0ce1f0 2023-10-06T02:52:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.033+0000 7f46ab7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f46ac0ac570 0x7f46ac06e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54240/0 (socket says 172.21.15.81:54240) 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.033+0000 7f46ab7fe700 1 -- 172.21.15.81:0/3548852349 learned_addr learned my addr 172.21.15.81:0/3548852349 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504969063 0 0) 0x7f46ac15dfb0 con 0x7f46ac0ac570 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aaffd700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac0ce1f0 0x7f46ac0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4698003570 con 0x7f46ac0ac570 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46a27fc700 1 --2- 172.21.15.81:0/3548852349 >> v2:172.21.15.83:3300/0 conn(0x7f46ac0ce5c0 0x7f46ac15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 899706630 0 0) 0x7f4698003570 con 0x7f46ac0ac570 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac0ce1f0 msgr2=0x7f46ac0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac0ce1f0 0x7f46ac0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 >> v2:172.21.15.83:3300/0 conn(0x7f46ac0ce5c0 msgr2=0x7f46ac15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 --2- 172.21.15.81:0/3548852349 >> v2:172.21.15.83:3300/0 conn(0x7f46ac0ce5c0 0x7f46ac15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac15dc40 con 0x7f46ac0ac570 2023-10-06T02:52:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f46a40017f0 con 0x7f46ac0ac570 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 >> v1:172.21.15.81:6789/0 conn(0x7f46ac0ac570 legacy=0x7f46ac06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac0ce1f0 0x7f4698003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f4698004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4698004d50 0x7f46980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0acec0 con 0x7f4698003fe0 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0ad1a0 con 0x7f4698004d50 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469800ba90 con 0x7f46ac0ce1f0 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46a27fc700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f4698004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46ab7fe700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4698004d50 0x7f46980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46aaffd700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac0ce1f0 0x7f4698003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46a27fc700 1 -- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac0ce1f0 msgr2=0x7f4698003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46a27fc700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac0ce1f0 0x7f4698003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46a27fc700 1 -- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4698004d50 msgr2=0x7f46980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46a27fc700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4698004d50 0x7f46980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.034+0000 7f46a27fc700 1 -- 172.21.15.81:0/3548852349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698003570 con 0x7f4698003fe0 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46a27fc700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f4698004810 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f4694009c00 tx=0x7f46940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964d938c24efb02f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400e6b0 con 0x7f4698003fe0 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469400e810 con 0x7f4698003fe0 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46aa7fc700 1 -- 172.21.15.81:0/3548852349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400ebd0 con 0x7f4698003fe0 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46b166d700 1 -- 172.21.15.81:0/3548852349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 msgr2=0x7f4698004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46b166d700 1 --2- 172.21.15.81:0/3548852349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f4698004810 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f4694009c00 tx=0x7f46940091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46ab7fe700 1 -- 172.21.15.81:0/3548852349 reap_dead start 2023-10-06T02:52:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46b166d700 1 -- 172.21.15.81:0/3548852349 shutdown_connections 2023-10-06T02:52:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46b166d700 1 -- 172.21.15.81:0/3548852349 >> 172.21.15.81:0/3548852349 conn(0x7f46ac06cca0 msgr2=0x7f46ac06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46b166d700 1 -- 172.21.15.81:0/3548852349 shutdown_connections 2023-10-06T02:52:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.035+0000 7f46b166d700 1 -- 172.21.15.81:0/3548852349 wait complete. 2023-10-06T02:52:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.036+0000 7f46b166d700 1 Processor -- start 2023-10-06T02:52:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.036+0000 7f46b166d700 1 -- start start 2023-10-06T02:52:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46b166d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f46ac14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46b166d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac15ad10 0x7f46ac14fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46b166d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ac15d020 0x7f46ac0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46b166d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1502c0 con 0x7f4698003fe0 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46b166d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac15b2e0 con 0x7f46ac15d020 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46b166d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac15b5c0 con 0x7f46ac15ad10 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46aaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f46ac14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46aaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f46ac14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55988/0 (socket says 172.21.15.81:55988) 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46aaffd700 1 -- 172.21.15.81:0/2838822080 learned_addr learned my addr 172.21.15.81:0/2838822080 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46a27fc700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac15ad10 0x7f46ac14fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.037+0000 7f46ab7fe700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ac15d020 0x7f46ac0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46aaffd700 1 -- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac15ad10 msgr2=0x7f46ac14fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46aaffd700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac15ad10 0x7f46ac14fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46aaffd700 1 -- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ac15d020 msgr2=0x7f46ac0b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46aaffd700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ac15d020 0x7f46ac0b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46aaffd700 1 -- 172.21.15.81:0/2838822080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0af0b0 con 0x7f4698003fe0 2023-10-06T02:52:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46ab7fe700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ac15d020 0x7f46ac0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46aaffd700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f46ac14ebc0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f469c011990 tx=0x7f469c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46a37fe700 1 -- 172.21.15.81:0/2838822080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00f760 con 0x7f4698003fe0 2023-10-06T02:52:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46a37fe700 1 -- 172.21.15.81:0/2838822080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00f8c0 con 0x7f4698003fe0 2023-10-06T02:52:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac0af390 con 0x7f4698003fe0 2023-10-06T02:52:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46a37fe700 1 -- 172.21.15.81:0/2838822080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00fc80 con 0x7f4698003fe0 2023-10-06T02:52:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.038+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac0b20f0 con 0x7f4698003fe0 2023-10-06T02:52:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.039+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac0af5d0 con 0x7f4698003fe0 2023-10-06T02:52:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.039+0000 7f46a37fe700 1 -- 172.21.15.81:0/2838822080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f469c015670 con 0x7f4698003fe0 2023-10-06T02:52:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.039+0000 7f46a37fe700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f468c066f60 0x7f468c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.040+0000 7f46a37fe700 1 -- 172.21.15.81:0/2838822080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f469c084e00 con 0x7f4698003fe0 2023-10-06T02:52:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.040+0000 7f46a27fc700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f468c066f60 0x7f468c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.040+0000 7f46a27fc700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f468c066f60 0x7f468c069410 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46940091e0 tx=0x7f469401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.044+0000 7f46a37fe700 1 -- 172.21.15.81:0/2838822080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46ac0af5d0 con 0x7f4698003fe0 2023-10-06T02:52:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.272+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f46ac0af5d0 con 0x7f4698003fe0 2023-10-06T02:52:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.272+0000 7f46a37fe700 1 -- 172.21.15.81:0/2838822080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7f46ac0af5d0 con 0x7f4698003fe0 2023-10-06T02:52:38.273 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:52:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f468c066f60 msgr2=0x7f468c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f468c066f60 0x7f468c069410 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46940091e0 tx=0x7f469401a000 comp rx=0 tx=0).stop 2023-10-06T02:52:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 msgr2=0x7f46ac14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f46ac14ebc0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f469c011990 tx=0x7f469c008040 comp rx=0 tx=0).stop 2023-10-06T02:52:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 shutdown_connections 2023-10-06T02:52:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f468c066f60 0x7f468c069410 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ac15d020 0x7f46ac0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698003fe0 0x7f46ac14ebc0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 --2- 172.21.15.81:0/2838822080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ac15ad10 0x7f46ac14fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 >> 172.21.15.81:0/2838822080 conn(0x7f46ac06cca0 msgr2=0x7f46ac159760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 shutdown_connections 2023-10-06T02:52:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:38.274+0000 7f46b166d700 1 -- 172.21.15.81:0/2838822080 wait complete. 2023-10-06T02:52:38.287 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:52:38.287 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:52:38.287 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:52:38.287 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:52:38.287 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:52:38.287 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:52:38.287 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:52:38.287 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:52:38.287 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:52:38.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:38.288 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:38.307 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42158sec preferred_lft 42158sec 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:52:38.308 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:52:38.309 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:52:38.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:38.310 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:52:38.378 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:52:38.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:38.379 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:52:38.436 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:52:38.436 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:52:38.436 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:52:38.436 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:52:38.437 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:52:38.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:38.437 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:52:38.437 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:52:38.437 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:52:38.437 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:52:38.437 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:52:38.437 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:52:38.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:38.543 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:52:38.558 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:52:38.558 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:52:38.558 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:52:38.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:38.558 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:52:38.622 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:52:38.623 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:52:38.678 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:52:38.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:52:38.678 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:52:38.732 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:52:38.732 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:52:38.732 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:38.811 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:38.811 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:38.830 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:38.830 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:38.830 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:52:38.830 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:52:38.831 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:52:38.831 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:52:38.831 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:52:38.831 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:52:38.851 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:52:38.851 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:52:38.851 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:52:38.851 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:52:38.852 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:52:38.852 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:52:38.852 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:52:38.852 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:52:38.852 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:52:38.852 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:52:38.852 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:52:38.853 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:52:38.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:52:38.854 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:52:38.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:39.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.033+0000 7f30bcef4700 1 Processor -- start 2023-10-06T02:52:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.033+0000 7f30bcef4700 1 -- start start 2023-10-06T02:52:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.034+0000 7f30bcef4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f30b815a2a0 0x7f30b80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.034+0000 7f30bcef4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f30b80ceb30 0x7f30b80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.034+0000 7f30bcef4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b80b0ca0 con 0x7f30b806d650 2023-10-06T02:52:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.034+0000 7f30bcef4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b806e160 con 0x7f30b80ceb30 2023-10-06T02:52:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.034+0000 7f30bcef4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b806ea90 con 0x7f30b815a2a0 2023-10-06T02:52:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.034+0000 7f30add9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f30b80ceb30 0x7f30b80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.034+0000 7f30b6d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f30b806d650 0x7f30b806da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54248/0 (socket says 172.21.15.81:54248) 2023-10-06T02:52:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.034+0000 7f30b6d9d700 1 -- 172.21.15.81:0/3383130439 learned_addr learned my addr 172.21.15.81:0/3383130439 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.034+0000 7f30b659c700 1 --2- 172.21.15.81:0/3383130439 >> v2:172.21.15.83:3300/0 conn(0x7f30b815a2a0 0x7f30b80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30add9b700 1 -- 172.21.15.81:0/3383130439 >> v2:172.21.15.83:3300/0 conn(0x7f30b815a2a0 msgr2=0x7f30b80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30add9b700 1 --2- 172.21.15.81:0/3383130439 >> v2:172.21.15.83:3300/0 conn(0x7f30b815a2a0 0x7f30b80b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30add9b700 1 -- 172.21.15.81:0/3383130439 >> v1:172.21.15.81:6789/0 conn(0x7f30b806d650 legacy=0x7f30b806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30add9b700 1 -- 172.21.15.81:0/3383130439 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b80b00d0 con 0x7f30b80ceb30 2023-10-06T02:52:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30b5d9b700 1 -- 172.21.15.81:0/3383130439 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877376881 0 0) 0x7f30b80b0ca0 con 0x7f30b806d650 2023-10-06T02:52:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30add9b700 1 --2- 172.21.15.81:0/3383130439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b80ceb30 0x7f30b80cefb0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f30b80637a0 tx=0x7f30a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284236b505231bea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30b5d9b700 1 -- 172.21.15.81:0/3383130439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a000b6b0 con 0x7f30b80ceb30 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30b5d9b700 1 -- 172.21.15.81:0/3383130439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a000b810 con 0x7f30b80ceb30 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30b5d9b700 1 -- 172.21.15.81:0/3383130439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a000bbb0 con 0x7f30b80ceb30 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30bcef4700 1 -- 172.21.15.81:0/3383130439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b80ceb30 msgr2=0x7f30b80cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30bcef4700 1 --2- 172.21.15.81:0/3383130439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b80ceb30 0x7f30b80cefb0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f30b80637a0 tx=0x7f30a00091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30bcef4700 1 -- 172.21.15.81:0/3383130439 shutdown_connections 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30bcef4700 1 --2- 172.21.15.81:0/3383130439 >> v2:172.21.15.83:3300/0 conn(0x7f30b815a2a0 0x7f30b80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30bcef4700 1 --2- 172.21.15.81:0/3383130439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b80ceb30 0x7f30b80cefb0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30bcef4700 1 -- 172.21.15.81:0/3383130439 >> 172.21.15.81:0/3383130439 conn(0x7f30b8067640 msgr2=0x7f30b8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30bcef4700 1 -- 172.21.15.81:0/3383130439 shutdown_connections 2023-10-06T02:52:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.035+0000 7f30bcef4700 1 -- 172.21.15.81:0/3383130439 wait complete. 2023-10-06T02:52:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30bcef4700 1 Processor -- start 2023-10-06T02:52:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30bcef4700 1 -- start start 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30bcef4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b806d650 0x7f30b8143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30bcef4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30b80ceb30 0x7f30b815def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30bcef4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b815a2a0 0x7f30b80c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30bcef4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b815f410 con 0x7f30b806d650 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30bcef4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b815e800 con 0x7f30b815a2a0 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30bcef4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b815eae0 con 0x7f30b80ceb30 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30b659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b806d650 0x7f30b8143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30b659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b806d650 0x7f30b8143190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56008/0 (socket says 172.21.15.81:56008) 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.037+0000 7f30b659c700 1 -- 172.21.15.81:0/212991622 learned_addr learned my addr 172.21.15.81:0/212991622 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30b6d9d700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b815a2a0 0x7f30b80c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30add9b700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30b80ceb30 0x7f30b815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30b659c700 1 -- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30b80ceb30 msgr2=0x7f30b815def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30b659c700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30b80ceb30 0x7f30b815def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30b659c700 1 -- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b815a2a0 msgr2=0x7f30b80c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30b659c700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b815a2a0 0x7f30b80c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30b659c700 1 -- 172.21.15.81:0/212991622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0009420 con 0x7f30b806d650 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30b659c700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b806d650 0x7f30b8143190 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f30a800d860 tx=0x7f30a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30aeffd700 1 -- 172.21.15.81:0/212991622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a80125f0 con 0x7f30b806d650 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30aeffd700 1 -- 172.21.15.81:0/212991622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a8012750 con 0x7f30b806d650 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30aeffd700 1 -- 172.21.15.81:0/212991622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a8012b10 con 0x7f30b806d650 2023-10-06T02:52:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b815edc0 con 0x7f30b806d650 2023-10-06T02:52:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.038+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b81436d0 con 0x7f30b806d650 2023-10-06T02:52:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.039+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b815f6f0 con 0x7f30b806d650 2023-10-06T02:52:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.039+0000 7f30aeffd700 1 -- 172.21.15.81:0/212991622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30a801e460 con 0x7f30b806d650 2023-10-06T02:52:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.040+0000 7f30aeffd700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3098066f30 0x7f30980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.040+0000 7f30aeffd700 1 -- 172.21.15.81:0/212991622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f30a8084bc0 con 0x7f30b806d650 2023-10-06T02:52:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.040+0000 7f30add9b700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3098066f30 0x7f30980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.040+0000 7f30add9b700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3098066f30 0x7f30980693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f30a00093f0 tx=0x7f30a0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.044+0000 7f30aeffd700 1 -- 172.21.15.81:0/212991622 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30a8051cd0 con 0x7f30b806d650 2023-10-06T02:52:39.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.268+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30b8159970 con 0x7f30b806d650 2023-10-06T02:52:39.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.269+0000 7f30aeffd700 1 -- 172.21.15.81:0/212991622 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f30a80552f0 con 0x7f30b806d650 2023-10-06T02:52:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:39.270 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:52:25.912348+0000","modified":"2023-10-06T02:52:29.566702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7275":{"gid":7275,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/4039558742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":4039558742},{"type":"v1","addr":"172.21.15.83:6836","nonce":4039558742}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T02:52:39.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3098066f30 msgr2=0x7f30980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3098066f30 0x7f30980693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f30a00093f0 tx=0x7f30a0017000 comp rx=0 tx=0).stop 2023-10-06T02:52:39.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b806d650 msgr2=0x7f30b8143190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b806d650 0x7f30b8143190 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f30a800d860 tx=0x7f30a8008040 comp rx=0 tx=0).stop 2023-10-06T02:52:39.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 shutdown_connections 2023-10-06T02:52:39.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3098066f30 0x7f30980693e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30b815a2a0 0x7f30b80c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b806d650 0x7f30b8143190 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 --2- 172.21.15.81:0/212991622 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30b80ceb30 0x7f30b815def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 >> 172.21.15.81:0/212991622 conn(0x7f30b8067640 msgr2=0x7f30b8158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:39.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 shutdown_connections 2023-10-06T02:52:39.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.270+0000 7f30bcef4700 1 -- 172.21.15.81:0/212991622 wait complete. 2023-10-06T02:52:39.273 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 67 2023-10-06T02:52:39.284 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-06T02:52:39.419 INFO:teuthology.orchestra.run.smithi083.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":7275,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.856959270999999,"mdsmap_epoch":67,"osdmap_epoch":135,"osdmap_epoch_barrier":135,"uptime":18.977997684000002} 2023-10-06T02:52:39.419 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 7275, "mdsmap_epoch": 67, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "rank_uptime": 12.856959271, "state": "up:active", "uptime": 18.977997684, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:52:39.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-06T02:52:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.535+0000 7f3f6c6db700 1 Processor -- start 2023-10-06T02:52:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.535+0000 7f3f6c6db700 1 -- start start 2023-10-06T02:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.536+0000 7f3f6c6db700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 0x7f3f640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.536+0000 7f3f6c6db700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f6406d120 0x7f3f6406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.536+0000 7f3f6c6db700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6406dac0 con 0x7f3f64157ca0 2023-10-06T02:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.536+0000 7f3f6c6db700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f640d07c0 con 0x7f3f6406d120 2023-10-06T02:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.536+0000 7f3f6c6db700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640cfbb0 con 0x7f3f641578d0 2023-10-06T02:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.536+0000 7f3f6ac78700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f6406d120 0x7f3f6406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.536+0000 7f3f6ac78700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f6406d120 0x7f3f6406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56016/0 (socket says 172.21.15.81:56016) 2023-10-06T02:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.536+0000 7f3f6ac78700 1 -- 172.21.15.81:0/2106935872 learned_addr learned my addr 172.21.15.81:0/2106935872 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.536+0000 7f3f6a477700 1 --2- 172.21.15.81:0/2106935872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 0x7f3f640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6ac78700 1 -- 172.21.15.81:0/2106935872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 msgr2=0x7f3f640cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6ac78700 1 --2- 172.21.15.81:0/2106935872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 0x7f3f640cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6ac78700 1 -- 172.21.15.81:0/2106935872 >> v1:172.21.15.83:6789/0 conn(0x7f3f64157ca0 legacy=0x7f3f6415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6ac78700 1 -- 172.21.15.81:0/2106935872 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f640cfe90 con 0x7f3f6406d120 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6a477700 1 --2- 172.21.15.81:0/2106935872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 0x7f3f640cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6ac78700 1 --2- 172.21.15.81:0/2106935872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6406d120 0x7f3f6406d580 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009f20 tx=0x7f3f5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf8e78808713b23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f69475700 1 -- 172.21.15.81:0/2106935872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00e070 con 0x7f3f6406d120 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f69475700 1 -- 172.21.15.81:0/2106935872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c00ba80 con 0x7f3f6406d120 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f69475700 1 -- 172.21.15.81:0/2106935872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0092e0 con 0x7f3f6406d120 2023-10-06T02:52:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6c6db700 1 -- 172.21.15.81:0/2106935872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6406d120 msgr2=0x7f3f6406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6c6db700 1 --2- 172.21.15.81:0/2106935872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6406d120 0x7f3f6406d580 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009f20 tx=0x7f3f5c009840 comp rx=0 tx=0).stop 2023-10-06T02:52:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6c6db700 1 -- 172.21.15.81:0/2106935872 shutdown_connections 2023-10-06T02:52:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.537+0000 7f3f6c6db700 1 --2- 172.21.15.81:0/2106935872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6406d120 0x7f3f6406d580 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.538+0000 7f3f6c6db700 1 --2- 172.21.15.81:0/2106935872 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 0x7f3f640cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.538+0000 7f3f6c6db700 1 -- 172.21.15.81:0/2106935872 >> 172.21.15.81:0/2106935872 conn(0x7f3f6406bb90 msgr2=0x7f3f6406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.538+0000 7f3f6c6db700 1 -- 172.21.15.81:0/2106935872 shutdown_connections 2023-10-06T02:52:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.538+0000 7f3f6c6db700 1 -- 172.21.15.81:0/2106935872 wait complete. 2023-10-06T02:52:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.539+0000 7f3f6c6db700 1 Processor -- start 2023-10-06T02:52:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.539+0000 7f3f6c6db700 1 -- start start 2023-10-06T02:52:39.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.539+0000 7f3f6c6db700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6406d120 0x7f3f640c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.539+0000 7f3f6c6db700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 0x7f3f64159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.539+0000 7f3f6c6db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f64157ca0 0x7f3f64148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.539+0000 7f3f6c6db700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640c7970 con 0x7f3f64157ca0 2023-10-06T02:52:39.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.539+0000 7f3f6c6db700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640c6d60 con 0x7f3f6406d120 2023-10-06T02:52:39.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.539+0000 7f3f6c6db700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640c7040 con 0x7f3f641578d0 2023-10-06T02:52:39.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6ac78700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f64157ca0 0x7f3f64148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6a477700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6406d120 0x7f3f640c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6ac78700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f64157ca0 0x7f3f64148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56024/0 (socket says 172.21.15.81:56024) 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6a477700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6406d120 0x7f3f640c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:57620/0 (socket says 172.21.15.81:57620) 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6ac78700 1 -- 172.21.15.81:0/3974519926 learned_addr learned my addr 172.21.15.81:0/3974519926 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f69c76700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 0x7f3f64159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6ac78700 1 -- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 msgr2=0x7f3f64159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6ac78700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 0x7f3f64159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6ac78700 1 -- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6406d120 msgr2=0x7f3f640c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6ac78700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6406d120 0x7f3f640c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:39.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6ac78700 1 -- 172.21.15.81:0/3974519926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c009ae0 con 0x7f3f64157ca0 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6ac78700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f64157ca0 0x7f3f64148540 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3f6406fe20 tx=0x7f3f5c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/3974519926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0032f0 con 0x7f3f64157ca0 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/3974519926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c008d20 con 0x7f3f64157ca0 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f640c7320 con 0x7f3f64157ca0 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/3974519926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0266b0 con 0x7f3f64157ca0 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.540+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f640c6af0 con 0x7f3f64157ca0 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.541+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f640c7b20 con 0x7f3f64157ca0 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.541+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/3974519926 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f5c003040 con 0x7f3f64157ca0 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.542+0000 7f3f5a7fc700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f48066f30 0x7f3f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.542+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/3974519926 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f5c086580 con 0x7f3f64157ca0 2023-10-06T02:52:39.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.542+0000 7f3f6a477700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f48066f30 0x7f3f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:39.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.542+0000 7f3f6a477700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f48066f30 0x7f3f480693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3f60006f00 tx=0x7f3f60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:39.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.546+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/3974519926 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f5c053690 con 0x7f3f64157ca0 2023-10-06T02:52:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:39.731+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f3f640d0170 con 0x7f3f64157ca0 2023-10-06T02:52:40.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.602+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/3974519926 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v136) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3f5c056cb0 con 0x7f3f64157ca0 2023-10-06T02:52:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f48066f30 msgr2=0x7f3f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f48066f30 0x7f3f480693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3f60006f00 tx=0x7f3f60008040 comp rx=0 tx=0).stop 2023-10-06T02:52:40.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f64157ca0 msgr2=0x7f3f64148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f64157ca0 0x7f3f64148540 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3f6406fe20 tx=0x7f3f5c018000 comp rx=0 tx=0).stop 2023-10-06T02:52:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 shutdown_connections 2023-10-06T02:52:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f64157ca0 0x7f3f64148540 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3f48066f30 0x7f3f480693e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6406d120 0x7f3f640c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 --2- 172.21.15.81:0/3974519926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f641578d0 0x7f3f64159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 >> 172.21.15.81:0/3974519926 conn(0x7f3f6406bb90 msgr2=0x7f3f64070750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 shutdown_connections 2023-10-06T02:52:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:40.604+0000 7f3f6c6db700 1 -- 172.21.15.81:0/3974519926 wait complete. 2023-10-06T02:52:40.607 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-06T02:52:40.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-06T02:52:40.748 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-06T02:52:40.748 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-06T02:52:40.748 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-06T02:52:40.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:40.749 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-06T02:52:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:16+0 records in 2023-10-06T02:52:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:16+0 records out 2023-10-06T02:52:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.102104 s, 164 MB/s 2023-10-06T02:52:40.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:40.871 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-06T02:52:40.983 INFO:teuthology.orchestra.run.smithi081.stderr:17+0 records in 2023-10-06T02:52:40.983 INFO:teuthology.orchestra.run.smithi081.stderr:17+0 records out 2023-10-06T02:52:40.983 INFO:teuthology.orchestra.run.smithi081.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0945757 s, 188 MB/s 2023-10-06T02:52:40.983 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-06T02:52:40.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:52:41.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.095+0000 7f463e0ec700 1 Processor -- start 2023-10-06T02:52:41.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.095+0000 7f463e0ec700 1 -- start start 2023-10-06T02:52:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.096+0000 7f463e0ec700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4638157fe0 0x7f46380b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.096+0000 7f463e0ec700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f46381583b0 0x7f46380b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.096+0000 7f463e0ec700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46380b2890 con 0x7f46380ceb30 2023-10-06T02:52:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.096+0000 7f463e0ec700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46380b4070 con 0x7f4638157fe0 2023-10-06T02:52:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.096+0000 7f463e0ec700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46380b4350 con 0x7f46381583b0 2023-10-06T02:52:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.096+0000 7f46377fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4638157fe0 0x7f46380b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.096+0000 7f4637fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f46380ceb30 0x7f46380cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43868/0 (socket says 172.21.15.81:43868) 2023-10-06T02:52:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.096+0000 7f4637fff700 1 -- 172.21.15.81:0/2453755187 learned_addr learned my addr 172.21.15.81:0/2453755187 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f4636ffd700 1 --2- 172.21.15.81:0/2453755187 >> v2:172.21.15.83:3300/0 conn(0x7f46381583b0 0x7f46380b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f46377fe700 1 -- 172.21.15.81:0/2453755187 >> v2:172.21.15.83:3300/0 conn(0x7f46381583b0 msgr2=0x7f46380b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f46377fe700 1 --2- 172.21.15.81:0/2453755187 >> v2:172.21.15.83:3300/0 conn(0x7f46381583b0 0x7f46380b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f46377fe700 1 -- 172.21.15.81:0/2453755187 >> v1:172.21.15.81:6789/0 conn(0x7f46380ceb30 legacy=0x7f46380cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f46377fe700 1 -- 172.21.15.81:0/2453755187 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380b4630 con 0x7f4638157fe0 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f46367fc700 1 -- 172.21.15.81:0/2453755187 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223780222 0 0) 0x7f46380b2890 con 0x7f46380ceb30 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f46377fe700 1 --2- 172.21.15.81:0/2453755187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 0x7f46380b34c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f463804c150 tx=0x7f4628009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6b655349e6cf95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f46367fc700 1 -- 172.21.15.81:0/2453755187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462800e070 con 0x7f4638157fe0 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f46367fc700 1 -- 172.21.15.81:0/2453755187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462800bc30 con 0x7f4638157fe0 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f46367fc700 1 -- 172.21.15.81:0/2453755187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628012430 con 0x7f4638157fe0 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.097+0000 7f463e0ec700 1 -- 172.21.15.81:0/2453755187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 msgr2=0x7f46380b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.098+0000 7f463e0ec700 1 --2- 172.21.15.81:0/2453755187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 0x7f46380b34c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f463804c150 tx=0x7f4628009780 comp rx=0 tx=0).stop 2023-10-06T02:52:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.098+0000 7f463e0ec700 1 -- 172.21.15.81:0/2453755187 shutdown_connections 2023-10-06T02:52:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.098+0000 7f463e0ec700 1 --2- 172.21.15.81:0/2453755187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 0x7f46380b34c0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.098+0000 7f463e0ec700 1 --2- 172.21.15.81:0/2453755187 >> v2:172.21.15.83:3300/0 conn(0x7f46381583b0 0x7f46380b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.098+0000 7f463e0ec700 1 -- 172.21.15.81:0/2453755187 >> 172.21.15.81:0/2453755187 conn(0x7f4638067640 msgr2=0x7f4638067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.098+0000 7f463e0ec700 1 -- 172.21.15.81:0/2453755187 shutdown_connections 2023-10-06T02:52:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.098+0000 7f463e0ec700 1 -- 172.21.15.81:0/2453755187 wait complete. 2023-10-06T02:52:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.099+0000 7f463e0ec700 1 Processor -- start 2023-10-06T02:52:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.099+0000 7f463e0ec700 1 -- start start 2023-10-06T02:52:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f463e0ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46380ceb30 0x7f4638146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f463e0ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 0x7f463815b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f463e0ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46381583b0 0x7f463815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f463e0ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463815a7c0 con 0x7f4638157fe0 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f463e0ec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4638159c40 con 0x7f46380ceb30 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f463e0ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4638159f20 con 0x7f46381583b0 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4636ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 0x7f463815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4636ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 0x7f463815b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51830/0 (socket says 172.21.15.81:51830) 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4636ffd700 1 -- 172.21.15.81:0/798073123 learned_addr learned my addr 172.21.15.81:0/798073123 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f46377fe700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46380ceb30 0x7f4638146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4637fff700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46381583b0 0x7f463815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4636ffd700 1 -- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46381583b0 msgr2=0x7f463815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4636ffd700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46381583b0 0x7f463815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4636ffd700 1 -- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46380ceb30 msgr2=0x7f4638146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4636ffd700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46380ceb30 0x7f4638146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4636ffd700 1 -- 172.21.15.81:0/798073123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628009a20 con 0x7f4638157fe0 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f4636ffd700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 0x7f463815b160 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f462c00d890 tx=0x7f462c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f461f7fe700 1 -- 172.21.15.81:0/798073123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c0125f0 con 0x7f4638157fe0 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f461f7fe700 1 -- 172.21.15.81:0/798073123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c012750 con 0x7f4638157fe0 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463815a200 con 0x7f4638157fe0 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f461f7fe700 1 -- 172.21.15.81:0/798073123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c012ad0 con 0x7f4638157fe0 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.100+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4638146c70 con 0x7f4638157fe0 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.101+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46380c97d0 con 0x7f4638157fe0 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.102+0000 7f461f7fe700 1 -- 172.21.15.81:0/798073123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f462c01e460 con 0x7f4638157fe0 2023-10-06T02:52:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.102+0000 7f461f7fe700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4624066f30 0x7f46240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.102+0000 7f461f7fe700 1 -- 172.21.15.81:0/798073123 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f462c084cd0 con 0x7f4638157fe0 2023-10-06T02:52:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.102+0000 7f46377fe700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4624066f30 0x7f46240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.103+0000 7f46377fe700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4624066f30 0x7f46240693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f463804c150 tx=0x7f4628019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.106+0000 7f461f7fe700 1 -- 172.21.15.81:0/798073123 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f462c055870 con 0x7f4638157fe0 2023-10-06T02:52:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.290+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f46380c95f0 con 0x7f4638157fe0 2023-10-06T02:52:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.292+0000 7f461f7fe700 1 -- 172.21.15.81:0/798073123 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) v1 ==== 81+0+34792 (secure 0 0 0) 0x7f462c055400 con 0x7f4638157fe0 2023-10-06T02:52:41.293 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:41.293 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:41.293 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 136, 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:52:40.596986+0000", 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:52:41.294 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 18, 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:52:41.295 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:41.296 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:41.297 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:41.298 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:41.299 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:41.300 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:52:41.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:41.302 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:52:41.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:41.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:41.305 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:41.307 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-06T02:52:41.308 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:23.555508+0000", 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:41.309 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:41.310 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "134", 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:41.311 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:41.312 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:41.313 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:41.314 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 18, 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:24.879976+0000", 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:52:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "136", 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:41.317 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:41.318 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:41.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:52:41.320 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:41.321 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:41.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:41.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:41.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:41.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.333 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:41.334 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:41.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.337 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:52:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:52:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:52:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:52:41.344 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:41.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:52:41.347 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:41.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:52:41.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:52:41.353 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:41.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.357 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.358 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:52:41.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:41.361 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:41.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:41.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:52:41.366 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:41.367 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:52:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:52:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:52:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:52:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:52:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:52:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:52:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:52:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:52:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:41.382 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4624066f30 msgr2=0x7f46240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4624066f30 0x7f46240693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f463804c150 tx=0x7f4628019000 comp rx=0 tx=0).stop 2023-10-06T02:52:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 msgr2=0x7f463815b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 0x7f463815b160 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f462c00d890 tx=0x7f462c008040 comp rx=0 tx=0).stop 2023-10-06T02:52:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 shutdown_connections 2023-10-06T02:52:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46381583b0 0x7f463815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4624066f30 0x7f46240693e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46380ceb30 0x7f4638146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 --2- 172.21.15.81:0/798073123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4638157fe0 0x7f463815b160 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 >> 172.21.15.81:0/798073123 conn(0x7f4638067640 msgr2=0x7f46380cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 shutdown_connections 2023-10-06T02:52:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:41.294+0000 7f463e0ec700 1 -- 172.21.15.81:0/798073123 wait complete. 2023-10-06T02:52:41.385 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:52:46.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:52:46.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.512+0000 7f6d0f79c700 1 Processor -- start 2023-10-06T02:52:46.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.512+0000 7f6d0f79c700 1 -- start start 2023-10-06T02:52:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0f79c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0f79c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d08068980 0x7f6d080c7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0f79c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d080c8e20 con 0x7f6d080c78d0 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0f79c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d080c9100 con 0x7f6d08068980 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0f79c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c1810 con 0x7f6d080c6fc0 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0d538700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0cd37700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d08068980 0x7f6d080c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0cd37700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d08068980 0x7f6d080c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50036/0 (socket says 172.21.15.81:50036) 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0dd39700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6d080c78d0 0x7f6d080c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:48044/0 (socket says 172.21.15.81:48044) 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0d538700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:49056/0 (socket says 172.21.15.81:49056) 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0cd37700 1 -- 172.21.15.81:0/3285497354 learned_addr learned my addr 172.21.15.81:0/3285497354 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0d538700 1 -- 172.21.15.81:0/3285497354 >> v2:172.21.15.83:3300/0 conn(0x7f6d08068980 msgr2=0x7f6d080c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0d538700 1 --2- 172.21.15.81:0/3285497354 >> v2:172.21.15.83:3300/0 conn(0x7f6d08068980 0x7f6d080c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0d538700 1 -- 172.21.15.81:0/3285497354 >> v1:172.21.15.83:6789/0 conn(0x7f6d080c78d0 legacy=0x7f6d080c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0d538700 1 -- 172.21.15.81:0/3285497354 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080c1af0 con 0x7f6d080c6fc0 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0cd37700 1 --2- 172.21.15.81:0/3285497354 >> v2:172.21.15.83:3300/0 conn(0x7f6d08068980 0x7f6d080c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.513+0000 7f6d0d538700 1 --2- 172.21.15.81:0/3285497354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080ab6e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009e60 tx=0x7f6d04009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf3398ebec54e4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6cfffff700 1 -- 172.21.15.81:0/3285497354 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400e070 con 0x7f6d080c6fc0 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6cfffff700 1 -- 172.21.15.81:0/3285497354 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0400bb60 con 0x7f6d080c6fc0 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6cfffff700 1 -- 172.21.15.81:0/3285497354 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04012430 con 0x7f6d080c6fc0 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6d0f79c700 1 -- 172.21.15.81:0/3285497354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 msgr2=0x7f6d080ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6d0f79c700 1 --2- 172.21.15.81:0/3285497354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080ab6e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009e60 tx=0x7f6d04009780 comp rx=0 tx=0).stop 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6d0f79c700 1 -- 172.21.15.81:0/3285497354 shutdown_connections 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6d0f79c700 1 --2- 172.21.15.81:0/3285497354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080ab6e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6d0f79c700 1 --2- 172.21.15.81:0/3285497354 >> v2:172.21.15.83:3300/0 conn(0x7f6d08068980 0x7f6d080c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6d0f79c700 1 -- 172.21.15.81:0/3285497354 >> 172.21.15.81:0/3285497354 conn(0x7f6d0806c660 msgr2=0x7f6d080cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:46.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6d0f79c700 1 -- 172.21.15.81:0/3285497354 shutdown_connections 2023-10-06T02:52:46.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.514+0000 7f6d0f79c700 1 -- 172.21.15.81:0/3285497354 wait complete. 2023-10-06T02:52:46.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.515+0000 7f6d0f79c700 1 Processor -- start 2023-10-06T02:52:46.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.515+0000 7f6d0f79c700 1 -- start start 2023-10-06T02:52:46.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0f79c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d08068980 0x7f6d0816ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:46.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0f79c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:46.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0f79c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d080c78d0 0x7f6d0816d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:46.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0f79c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0816bfd0 con 0x7f6d08068980 2023-10-06T02:52:46.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0f79c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080cb3c0 con 0x7f6d080c78d0 2023-10-06T02:52:46.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0f79c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c5a30 con 0x7f6d080c6fc0 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0d538700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d08068980 0x7f6d0816ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0d538700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d08068980 0x7f6d0816ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51834/0 (socket says 172.21.15.81:51834) 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0d538700 1 -- 172.21.15.81:0/2542719252 learned_addr learned my addr 172.21.15.81:0/2542719252 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0dd39700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d080c78d0 0x7f6d0816d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.516+0000 7f6d0cd37700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6d0d538700 1 -- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 msgr2=0x7f6d080cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6d0d538700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6d0d538700 1 -- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d080c78d0 msgr2=0x7f6d0816d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6d0d538700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d080c78d0 0x7f6d0816d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6d0d538700 1 -- 172.21.15.81:0/2542719252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf80094f0 con 0x7f6d08068980 2023-10-06T02:52:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6d0d538700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d08068980 0x7f6d0816ba90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6d040097c0 tx=0x7f6d04019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6cfd7fa700 1 -- 172.21.15.81:0/2542719252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04012c40 con 0x7f6d08068980 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6cfd7fa700 1 -- 172.21.15.81:0/2542719252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d04012dc0 con 0x7f6d08068980 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d04009a20 con 0x7f6d08068980 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6cfd7fa700 1 -- 172.21.15.81:0/2542719252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040276c0 con 0x7f6d08068980 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.517+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d080c5ff0 con 0x7f6d08068980 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.518+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d08067bc0 con 0x7f6d08068980 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.518+0000 7f6cfd7fa700 1 -- 172.21.15.81:0/2542719252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d04024070 con 0x7f6d08068980 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.519+0000 7f6cfd7fa700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cec066f30 0x7f6cec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.519+0000 7f6cfd7fa700 1 -- 172.21.15.81:0/2542719252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6d04086ba0 con 0x7f6d08068980 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.519+0000 7f6d0cd37700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cec066f30 0x7f6cec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.519+0000 7f6cfd7fa700 1 -- 172.21.15.81:0/2542719252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7f6cec06f070 con 0x7f6d08068980 2023-10-06T02:52:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.519+0000 7f6d0cd37700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cec066f30 0x7f6cec0693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6d080cc730 tx=0x7f6cf8009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:46.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.523+0000 7f6cfd7fa700 1 -- 172.21.15.81:0/2542719252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d0402c020 con 0x7f6d08068980 2023-10-06T02:52:46.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.706+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6d0816a8c0 con 0x7f6d08068980 2023-10-06T02:52:46.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.707+0000 7f6cfd7fa700 1 -- 172.21.15.81:0/2542719252 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) v1 ==== 81+0+34811 (secure 0 0 0) 0x7f6d04053cb0 con 0x7f6d08068980 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 137, 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:52:44.416602+0000", 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:52:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:52:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 18, 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:52:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:52:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:23.555508+0000", 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "134", 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:52:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 18, 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:52:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:24.879976+0000", 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:46.736 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:46.737 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:52:46.738 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:52:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:52:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:52:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:52:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:52:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:52:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:52:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:52:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:52:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:52:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:52:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:52:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:52:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:52:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:46.798 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cec066f30 msgr2=0x7f6cec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cec066f30 0x7f6cec0693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6d080cc730 tx=0x7f6cf8009250 comp rx=0 tx=0).stop 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d08068980 msgr2=0x7f6d0816ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d08068980 0x7f6d0816ba90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6d040097c0 tx=0x7f6d04019000 comp rx=0 tx=0).stop 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 shutdown_connections 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6cec066f30 0x7f6cec0693e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d080c78d0 0x7f6d0816d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d08068980 0x7f6d0816ba90 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 --2- 172.21.15.81:0/2542719252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d080c6fc0 0x7f6d080cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 >> 172.21.15.81:0/2542719252 conn(0x7f6d0806c660 msgr2=0x7f6d0806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 shutdown_connections 2023-10-06T02:52:46.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:46.709+0000 7f6d0f79c700 1 -- 172.21.15.81:0/2542719252 wait complete. 2023-10-06T02:52:46.801 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:52:46.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:46.801 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-06T02:52:47.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:52:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-06T02:52:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-06T02:52:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-06T02:52:47.048 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.226585 s, 231 MB/s 2023-10-06T02:52:47.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:52:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.160+0000 7fd88ee78700 1 Processor -- start 2023-10-06T02:52:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.161+0000 7fd88ee78700 1 -- start start 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.161+0000 7fd88ee78700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd8880aacf0 0x7fd88806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.161+0000 7fd88ee78700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880acc80 con 0x7fd8880ce5c0 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.161+0000 7fd88ee78700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880ab150 con 0x7fd8880ce1f0 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.161+0000 7fd88ee78700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88815dfb0 con 0x7fd8880aacf0 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.161+0000 7fd887fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd8880ce5c0 0x7fd8880ac570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43870/0 (socket says 172.21.15.81:43870) 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd887fff700 1 -- 172.21.15.81:0/518395938 learned_addr learned my addr 172.21.15.81:0/518395938 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd88d415700 1 --2- 172.21.15.81:0/518395938 >> v2:172.21.15.83:3300/0 conn(0x7fd8880aacf0 0x7fd88806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820105786 0 0) 0x7fd87c001110 con 0x7fd8880ce5c0 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd870003570 con 0x7fd8880ce5c0 2023-10-06T02:52:47.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620809286 0 0) 0x7fd878001490 con 0x7fd8880ce1f0 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd87c001110 con 0x7fd8880ce1f0 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3478810966 0 0) 0x7fd870003570 con 0x7fd8880ce5c0 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 >> v2:172.21.15.83:3300/0 conn(0x7fd8880aacf0 msgr2=0x7fd88806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 --2- 172.21.15.81:0/518395938 >> v2:172.21.15.83:3300/0 conn(0x7fd8880aacf0 0x7fd88806e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 >> v1:172.21.15.83:6789/0 conn(0x7fd8880ce1f0 legacy=0x7fd88815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880acec0 con 0x7fd8880ce5c0 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fd87c001600 con 0x7fd8880ce5c0 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 >> v1:172.21.15.81:6789/0 conn(0x7fd8880ce5c0 legacy=0x7fd8880ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd870003c40 0x7fd870004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd870004810 0x7fd870004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd870005210 0x7fd87000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88815dfb0 con 0x7fd870003c40 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87000c130 con 0x7fd870005210 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87000c2c0 con 0x7fd870004810 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd88d415700 1 --2- 172.21.15.81:0/518395938 >> v2:172.21.15.83:3300/0 conn(0x7fd8880aacf0 0x7fd88806e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd88cc14700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd870003c40 0x7fd870004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd887fff700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd870004810 0x7fd870004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd88cc14700 1 -- 172.21.15.81:0/518395938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd870004810 msgr2=0x7fd870004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd88d415700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd870005210 0x7fd87000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.162+0000 7fd88cc14700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd870004810 0x7fd870004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88cc14700 1 -- 172.21.15.81:0/518395938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd870005210 msgr2=0x7fd87000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88cc14700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd870005210 0x7fd87000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88cc14700 1 -- 172.21.15.81:0/518395938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870003570 con 0x7fd870003c40 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88d415700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd870005210 0x7fd87000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88d415700 1 -- 172.21.15.81:0/518395938 reap_dead start 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88cc14700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd870003c40 0x7fd870004030 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c1c0 tx=0x7fd878001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7332a62737abfc54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878001c40 con 0x7fd870003c40 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87800ca50 con 0x7fd870003c40 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd8877fe700 1 -- 172.21.15.81:0/518395938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87800ce10 con 0x7fd870003c40 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88ee78700 1 -- 172.21.15.81:0/518395938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd870003c40 msgr2=0x7fd870004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88ee78700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd870003c40 0x7fd870004030 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c1c0 tx=0x7fd878001950 comp rx=0 tx=0).stop 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88ee78700 1 -- 172.21.15.81:0/518395938 shutdown_connections 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88ee78700 1 --2- 172.21.15.81:0/518395938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd870003c40 0x7fd870004030 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88ee78700 1 -- 172.21.15.81:0/518395938 >> 172.21.15.81:0/518395938 conn(0x7fd88806cca0 msgr2=0x7fd88806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88ee78700 1 -- 172.21.15.81:0/518395938 shutdown_connections 2023-10-06T02:52:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.163+0000 7fd88ee78700 1 -- 172.21.15.81:0/518395938 wait complete. 2023-10-06T02:52:47.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.164+0000 7fd88ee78700 1 Processor -- start 2023-10-06T02:52:47.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd88ee78700 1 -- start start 2023-10-06T02:52:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd88ee78700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd870003c40 0x7fd8880aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd88ee78700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8880ae410 0x7fd8880cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd88ee78700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8880ccc30 0x7fd88816d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd88ee78700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88816b480 con 0x7fd8880ae410 2023-10-06T02:52:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd88ee78700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88816b180 con 0x7fd8880ccc30 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd88ee78700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880ae890 con 0x7fd870003c40 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd887fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8880ae410 0x7fd8880cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd887fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8880ae410 0x7fd8880cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51858/0 (socket says 172.21.15.81:51858) 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.165+0000 7fd887fff700 1 -- 172.21.15.81:0/4249966818 learned_addr learned my addr 172.21.15.81:0/4249966818 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd88cc14700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd870003c40 0x7fd8880aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd88d415700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8880ccc30 0x7fd88816d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd887fff700 1 -- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd870003c40 msgr2=0x7fd8880aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd887fff700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd870003c40 0x7fd8880aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd887fff700 1 -- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8880ccc30 msgr2=0x7fd88816d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd887fff700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8880ccc30 0x7fd88816d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd887fff700 1 -- 172.21.15.81:0/4249966818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880aeb70 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd887fff700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8880ae410 0x7fd8880cc6f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0010e0 tx=0x7fd87c001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd884ff9700 1 -- 172.21.15.81:0/4249966818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00ee70 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd884ff9700 1 -- 172.21.15.81:0/4249966818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c00c7e0 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8880aee50 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd884ff9700 1 -- 172.21.15.81:0/4249966818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00cba0 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.166+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88816dbb0 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.167+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd888068900 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.167+0000 7fd884ff9700 1 -- 172.21.15.81:0/4249966818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd87c01d460 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.168+0000 7fd884ff9700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd874066f30 0x7fd8740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.168+0000 7fd884ff9700 1 -- 172.21.15.81:0/4249966818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd87c084430 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.168+0000 7fd884ff9700 1 -- 172.21.15.81:0/4249966818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7fd87406f0f0 con 0x7fd8880ae410 2023-10-06T02:52:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.168+0000 7fd88cc14700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd874066f30 0x7fd8740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.168+0000 7fd88cc14700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd874066f30 0x7fd8740693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c1c0 tx=0x7fd878016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:47.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.172+0000 7fd884ff9700 1 -- 172.21.15.81:0/4249966818 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd87c051540 con 0x7fd8880ae410 2023-10-06T02:52:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.356+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd8880acc80 con 0x7fd8880ae410 2023-10-06T02:52:47.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.357+0000 7fd884ff9700 1 -- 172.21.15.81:0/4249966818 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) v1 ==== 81+0+34811 (secure 0 0 0) 0x7fd8880acc80 con 0x7fd8880ae410 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 137, 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:52:44.416602+0000", 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:52:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 18, 2023-10-06T02:52:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:52:47.362 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:47.363 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:47.364 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:47.366 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:47.368 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:47.369 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:47.370 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:47.371 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:47.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:47.373 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:23.555508+0000", 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:47.374 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:47.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "134", 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:47.377 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:47.378 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:47.379 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:47.380 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 18, 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:24.879976+0000", 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:47.382 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:47.382 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:47.382 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:47.382 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:47.382 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:47.382 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:47.382 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:47.382 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:52:47.382 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.383 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:47.384 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:47.385 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:47.386 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:47.386 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:47.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:47.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.387 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:47.387 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:47.387 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:47.387 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:47.387 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:47.387 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:47.387 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:47.387 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:47.389 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:52:47.391 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:52:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:52:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:52:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:52:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:52:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:52:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:52:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:52:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:52:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:52:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:52:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:52:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:52:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:47.452 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd874066f30 msgr2=0x7fd8740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd874066f30 0x7fd8740693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c1c0 tx=0x7fd878016000 comp rx=0 tx=0).stop 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8880ae410 msgr2=0x7fd8880cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8880ae410 0x7fd8880cc6f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0010e0 tx=0x7fd87c001d90 comp rx=0 tx=0).stop 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 shutdown_connections 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd874066f30 0x7fd8740693e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8880ccc30 0x7fd88816d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd870003c40 0x7fd8880aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 --2- 172.21.15.81:0/4249966818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8880ae410 0x7fd8880cc6f0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 >> 172.21.15.81:0/4249966818 conn(0x7fd88806cca0 msgr2=0x7fd8880b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 shutdown_connections 2023-10-06T02:52:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.359+0000 7fd88ee78700 1 -- 172.21.15.81:0/4249966818 wait complete. 2023-10-06T02:52:47.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:47.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.568+0000 7f301cd54700 1 Processor -- start 2023-10-06T02:52:47.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.568+0000 7f301cd54700 1 -- start start 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f301cd54700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3018159f10 0x7f3018068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f301cd54700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 0x7f30180cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f301cd54700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30180cee10 con 0x7f3018159b40 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f301cd54700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3018069140 con 0x7f3018159f10 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f301cd54700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30180cd040 con 0x7f3018068cc0 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f30177fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3018159b40 0x7f30180cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43878/0 (socket says 172.21.15.81:43878) 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f30177fe700 1 -- 172.21.15.81:0/1508777440 learned_addr learned my addr 172.21.15.81:0/1508777440 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f3016ffd700 1 --2- 172.21.15.81:0/1508777440 >> v2:172.21.15.83:3300/0 conn(0x7f3018159f10 0x7f3018068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f3017fff700 1 --2- 172.21.15.81:0/1508777440 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 0x7f30180cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f30167fc700 1 -- 172.21.15.81:0/1508777440 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967083194 0 0) 0x7f30180cee10 con 0x7f3018159b40 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f30167fc700 1 -- 172.21.15.81:0/1508777440 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3000003570 con 0x7f3018159b40 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f3016ffd700 1 -- 172.21.15.81:0/1508777440 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 msgr2=0x7f30180cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f3016ffd700 1 --2- 172.21.15.81:0/1508777440 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 0x7f30180cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f3016ffd700 1 -- 172.21.15.81:0/1508777440 >> v1:172.21.15.81:6789/0 conn(0x7f3018159b40 legacy=0x7f30180cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.569+0000 7f3016ffd700 1 -- 172.21.15.81:0/1508777440 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30180cd320 con 0x7f3018159f10 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f3016ffd700 1 --2- 172.21.15.81:0/1508777440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 0x7f3018068780 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f300c0098e0 tx=0x7f300c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e52b042b41ab421 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f30167fc700 1 -- 172.21.15.81:0/1508777440 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c011630 con 0x7f3018159f10 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f30167fc700 1 -- 172.21.15.81:0/1508777440 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c011790 con 0x7f3018159f10 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f30167fc700 1 -- 172.21.15.81:0/1508777440 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c011b10 con 0x7f3018159f10 2023-10-06T02:52:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f301cd54700 1 -- 172.21.15.81:0/1508777440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 msgr2=0x7f3018068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f301cd54700 1 --2- 172.21.15.81:0/1508777440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 0x7f3018068780 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f300c0098e0 tx=0x7f300c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f301cd54700 1 -- 172.21.15.81:0/1508777440 shutdown_connections 2023-10-06T02:52:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f301cd54700 1 --2- 172.21.15.81:0/1508777440 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 0x7f30180cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f301cd54700 1 --2- 172.21.15.81:0/1508777440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 0x7f3018068780 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f301cd54700 1 -- 172.21.15.81:0/1508777440 >> 172.21.15.81:0/1508777440 conn(0x7f30180cd660 msgr2=0x7f30180cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f301cd54700 1 -- 172.21.15.81:0/1508777440 shutdown_connections 2023-10-06T02:52:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.570+0000 7f301cd54700 1 -- 172.21.15.81:0/1508777440 wait complete. 2023-10-06T02:52:47.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.572+0000 7f301cd54700 1 Processor -- start 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.572+0000 7f301cd54700 1 -- start start 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.572+0000 7f301cd54700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 0x7f301816bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.572+0000 7f301cd54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3018159b40 0x7f3018145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.572+0000 7f301cd54700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 0x7f30180c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.572+0000 7f301cd54700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301816c050 con 0x7f3018159b40 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.572+0000 7f301cd54700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301816c2a0 con 0x7f3018159f10 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.572+0000 7f301cd54700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301816c580 con 0x7f3018068cc0 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3016ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3018159b40 0x7f3018145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3016ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3018159b40 0x7f3018145470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51874/0 (socket says 172.21.15.81:51874) 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f30177fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 0x7f301816bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3016ffd700 1 -- 172.21.15.81:0/773392333 learned_addr learned my addr 172.21.15.81:0/773392333 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3017fff700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 0x7f30180c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3016ffd700 1 -- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 msgr2=0x7f301816bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3016ffd700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 0x7f301816bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3016ffd700 1 -- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 msgr2=0x7f30180c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3016ffd700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 0x7f30180c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3016ffd700 1 -- 172.21.15.81:0/773392333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c009420 con 0x7f3018159b40 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3017fff700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 0x7f30180c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f3016ffd700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3018159b40 0x7f3018145470 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f301806fe10 tx=0x7f300c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f2fff7fe700 1 -- 172.21.15.81:0/773392333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c011900 con 0x7f3018159b40 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f2fff7fe700 1 -- 172.21.15.81:0/773392333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c011a60 con 0x7f3018159b40 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301816c860 con 0x7f3018159b40 2023-10-06T02:52:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f2fff7fe700 1 -- 172.21.15.81:0/773392333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c01a680 con 0x7f3018159b40 2023-10-06T02:52:47.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.573+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301816ce20 con 0x7f3018159b40 2023-10-06T02:52:47.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.574+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301816cfe0 con 0x7f3018159b40 2023-10-06T02:52:47.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.575+0000 7f2fff7fe700 1 -- 172.21.15.81:0/773392333 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f300c01aa30 con 0x7f3018159b40 2023-10-06T02:52:47.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.575+0000 7f2fff7fe700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3004066f30 0x7f30040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:47.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.575+0000 7f2fff7fe700 1 -- 172.21.15.81:0/773392333 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f300c086260 con 0x7f3018159b40 2023-10-06T02:52:47.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.575+0000 7f2fff7fe700 1 -- 172.21.15.81:0/773392333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7f300406f0f0 con 0x7f3018159b40 2023-10-06T02:52:47.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.575+0000 7f30177fe700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3004066f30 0x7f30040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:47.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.576+0000 7f30177fe700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3004066f30 0x7f30040693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3008005c50 tx=0x7f3008009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:47.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.579+0000 7f2fff7fe700 1 -- 172.21.15.81:0/773392333 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f300c053370 con 0x7f3018159b40 2023-10-06T02:52:47.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.803+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30180cb8f0 con 0x7f3018159b40 2023-10-06T02:52:47.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.803+0000 7f2fff7fe700 1 -- 172.21.15.81:0/773392333 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f300c015020 con 0x7f3018159b40 2023-10-06T02:52:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:47.805 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:52:25.912348+0000","modified":"2023-10-06T02:52:29.566702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7275":{"gid":7275,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/4039558742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":4039558742},{"type":"v1","addr":"172.21.15.83:6836","nonce":4039558742}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3004066f30 msgr2=0x7f30040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3004066f30 0x7f30040693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3008005c50 tx=0x7f3008009040 comp rx=0 tx=0).stop 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3018159b40 msgr2=0x7f3018145470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3018159b40 0x7f3018145470 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f301806fe10 tx=0x7f300c017000 comp rx=0 tx=0).stop 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 shutdown_connections 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3004066f30 0x7f30040693e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3018159f10 0x7f30180c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3018068cc0 0x7f301816bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 --2- 172.21.15.81:0/773392333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3018159b40 0x7f3018145470 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:47.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 >> 172.21.15.81:0/773392333 conn(0x7f30180cd660 msgr2=0x7f301806dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:47.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 shutdown_connections 2023-10-06T02:52:47.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:47.805+0000 7f301cd54700 1 -- 172.21.15.81:0/773392333 wait complete. 2023-10-06T02:52:47.808 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 67 2023-10-06T02:52:47.819 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-06T02:52:47.964 INFO:teuthology.orchestra.run.smithi083.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":7275,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.402080012999999,"mdsmap_epoch":67,"osdmap_epoch":137,"osdmap_epoch_barrier":137,"uptime":27.523118357000001} 2023-10-06T02:52:47.965 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 7275, "mdsmap_epoch": 67, "osdmap_epoch": 137, "osdmap_epoch_barrier": 137, "rank_uptime": 21.402080013, "state": "up:active", "uptime": 27.523118357, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:52:47.965 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:52:47.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:47.965 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-06T02:52:47.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:52:47.981 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-06T02:52:48.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:52:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.193+0000 7f569759e700 1 Processor -- start 2023-10-06T02:52:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.193+0000 7f569759e700 1 -- start start 2023-10-06T02:52:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5698159b40 0x7f56980cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5698068e90 0x7f56980cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56980cee10 con 0x7f5698159f10 2023-10-06T02:52:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56980cd040 con 0x7f5698068e90 2023-10-06T02:52:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56980cd320 con 0x7f5698159b40 2023-10-06T02:52:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f5695d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5698159f10 0x7f5698068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43880/0 (socket says 172.21.15.81:43880) 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f5695d9b700 1 -- 172.21.15.81:0/802250107 learned_addr learned my addr 172.21.15.81:0/802250107 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498053837 0 0) 0x7f56980cee10 con 0x7f5698159f10 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f5696d9d700 1 --2- 172.21.15.81:0/802250107 >> v2:172.21.15.83:3300/0 conn(0x7f5698068e90 0x7f56980cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569659c700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5698159b40 0x7f56980cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5680003570 con 0x7f5698159f10 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3389552522 0 0) 0x7f5680003570 con 0x7f5698159f10 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5698159b40 msgr2=0x7f56980cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569559a700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5698159b40 0x7f56980cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 >> v2:172.21.15.83:3300/0 conn(0x7f5698068e90 msgr2=0x7f56980cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569559a700 1 --2- 172.21.15.81:0/802250107 >> v2:172.21.15.83:3300/0 conn(0x7f5698068e90 0x7f56980cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56980ce7c0 con 0x7f5698159f10 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.194+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f568c001470 con 0x7f5698159f10 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 >> v1:172.21.15.81:6789/0 conn(0x7f5698159f10 legacy=0x7f5698068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5680003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5698159b40 0x7f5680004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5680004d50 0x7f56800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980cd040 con 0x7f5680003a60 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980cd320 con 0x7f5680004d50 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568000ba60 con 0x7f5698159b40 2023-10-06T02:52:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569659c700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5680003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f5696d9d700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5680004d50 0x7f56800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f5695d9b700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5698159b40 0x7f5680004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569659c700 1 -- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5698159b40 msgr2=0x7f5680004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569659c700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5698159b40 0x7f5680004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569659c700 1 -- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5680004d50 msgr2=0x7f56800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569659c700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5680004d50 0x7f56800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569659c700 1 -- 172.21.15.81:0/802250107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680003570 con 0x7f5680003a60 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569659c700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5680003e70 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f5688009c00 tx=0x7f56880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f46a00a0e53cca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800e6b0 con 0x7f5680003a60 2023-10-06T02:52:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800e810 con 0x7f5680003a60 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.195+0000 7f569559a700 1 -- 172.21.15.81:0/802250107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800ebd0 con 0x7f5680003a60 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.196+0000 7f569759e700 1 -- 172.21.15.81:0/802250107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 msgr2=0x7f5680003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.196+0000 7f569759e700 1 --2- 172.21.15.81:0/802250107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5680003e70 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f5688009c00 tx=0x7f56880091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.196+0000 7f5696d9d700 1 -- 172.21.15.81:0/802250107 reap_dead start 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.196+0000 7f569759e700 1 -- 172.21.15.81:0/802250107 shutdown_connections 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.196+0000 7f569759e700 1 -- 172.21.15.81:0/802250107 >> 172.21.15.81:0/802250107 conn(0x7f56980cd660 msgr2=0x7f56980cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.196+0000 7f569759e700 1 -- 172.21.15.81:0/802250107 shutdown_connections 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.196+0000 7f569759e700 1 -- 172.21.15.81:0/802250107 wait complete. 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.197+0000 7f569759e700 1 Processor -- start 2023-10-06T02:52:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.197+0000 7f569759e700 1 -- start start 2023-10-06T02:52:48.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5698158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:48.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f569816e5e0 0x7f5698157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:48.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56981580c0 0x7f569816ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569816a620 con 0x7f5680003a60 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980cacd0 con 0x7f569816e5e0 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569816eb30 con 0x7f56981580c0 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5698158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5698158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51886/0 (socket says 172.21.15.81:51886) 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569659c700 1 -- 172.21.15.81:0/53003466 learned_addr learned my addr 172.21.15.81:0/53003466 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f5696d9d700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56981580c0 0x7f569816ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f5695d9b700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f569816e5e0 0x7f5698157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569659c700 1 -- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56981580c0 msgr2=0x7f569816ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569659c700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56981580c0 0x7f569816ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569659c700 1 -- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f569816e5e0 msgr2=0x7f5698157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569659c700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f569816e5e0 0x7f5698157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569659c700 1 -- 172.21.15.81:0/53003466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569816a8c0 con 0x7f5680003a60 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f5695d9b700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f569816e5e0 0x7f5698157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569659c700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5698158bc0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f5680004730 tx=0x7f568801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f56867fc700 1 -- 172.21.15.81:0/53003466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688022070 con 0x7f5680003a60 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f56867fc700 1 -- 172.21.15.81:0/53003466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800e980 con 0x7f5680003a60 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5698159100 con 0x7f5680003a60 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f56867fc700 1 -- 172.21.15.81:0/53003466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688027470 con 0x7f5680003a60 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.198+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56980ca9f0 con 0x7f5680003a60 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.199+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56980cb890 con 0x7f5680003a60 2023-10-06T02:52:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.200+0000 7f56867fc700 1 -- 172.21.15.81:0/53003466 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f568801c450 con 0x7f5680003a60 2023-10-06T02:52:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.200+0000 7f56867fc700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5678066f30 0x7f56780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.200+0000 7f56867fc700 1 -- 172.21.15.81:0/53003466 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f56880860b0 con 0x7f5680003a60 2023-10-06T02:52:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.200+0000 7f5695d9b700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5678066f30 0x7f56780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.200+0000 7f56867fc700 1 -- 172.21.15.81:0/53003466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7f567806f0f0 con 0x7f5680003a60 2023-10-06T02:52:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.201+0000 7f5695d9b700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5678066f30 0x7f56780693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f568c001d20 tx=0x7f568c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.204+0000 7f56867fc700 1 -- 172.21.15.81:0/53003466 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f568802c060 con 0x7f5680003a60 2023-10-06T02:52:48.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.384+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f56980ceaa0 con 0x7f5680003a60 2023-10-06T02:52:48.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.385+0000 7f56867fc700 1 -- 172.21.15.81:0/53003466 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) v1 ==== 81+0+34811 (secure 0 0 0) 0x7f5688017020 con 0x7f5680003a60 2023-10-06T02:52:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:48.387 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 137, 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:52:44.416602+0000", 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:52:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 18, 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:52:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:52:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:52:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:52:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:52:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:23.555508+0000", 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "134", 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 18, 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:24.879976+0000", 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:52:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:52:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:52:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:52:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:52:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:52:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:52:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:48.441 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:48.442 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:52:48.443 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:48.445 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.448 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:48.449 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:52:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:52:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:48.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.464 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:52:48.466 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:48.468 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:48.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:48.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:52:48.473 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:52:48.475 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.477 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:48.478 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:48.479 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:52:48.480 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:52:48.481 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:52:48.482 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:52:48.483 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:52:48.483 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:52:48.483 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:52:48.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:48.483 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5678066f30 msgr2=0x7f56780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5678066f30 0x7f56780693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f568c001d20 tx=0x7f568c009040 comp rx=0 tx=0).stop 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 msgr2=0x7f5698158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5698158bc0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f5680004730 tx=0x7f568801a000 comp rx=0 tx=0).stop 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 shutdown_connections 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56981580c0 0x7f569816ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5680003a60 0x7f5698158bc0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5678066f30 0x7f56780693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 --2- 172.21.15.81:0/53003466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f569816e5e0 0x7f5698157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 >> 172.21.15.81:0/53003466 conn(0x7f56980cd660 msgr2=0x7f569806e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 shutdown_connections 2023-10-06T02:52:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:48.388+0000 7f569759e700 1 -- 172.21.15.81:0/53003466 wait complete. 2023-10-06T02:52:48.486 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:52:53.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:52:53.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.610+0000 7f75abce8700 1 Processor -- start 2023-10-06T02:52:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.611+0000 7f75abce8700 1 -- start start 2023-10-06T02:52:53.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.611+0000 7f75abce8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f75a41578d0 0x7f75a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:53.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.611+0000 7f75abce8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75a4157ca0 0x7f75a415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:53.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.611+0000 7f75abce8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a40d07c0 con 0x7f75a406d120 2023-10-06T02:52:53.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.611+0000 7f75abce8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a40cfbb0 con 0x7f75a4157ca0 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.611+0000 7f75abce8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a40cfe90 con 0x7f75a41578d0 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9283700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75a4157ca0 0x7f75a415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9283700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75a4157ca0 0x7f75a415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36254/0 (socket says 172.21.15.81:36254) 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9283700 1 -- 172.21.15.81:0/2959957004 learned_addr learned my addr 172.21.15.81:0/2959957004 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9a84700 1 --2- 172.21.15.81:0/2959957004 >> v2:172.21.15.83:3300/0 conn(0x7f75a41578d0 0x7f75a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9283700 1 -- 172.21.15.81:0/2959957004 >> v2:172.21.15.83:3300/0 conn(0x7f75a41578d0 msgr2=0x7f75a40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9283700 1 --2- 172.21.15.81:0/2959957004 >> v2:172.21.15.83:3300/0 conn(0x7f75a41578d0 0x7f75a40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9283700 1 -- 172.21.15.81:0/2959957004 >> v1:172.21.15.83:6789/0 conn(0x7f75a406d120 legacy=0x7f75a406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9283700 1 -- 172.21.15.81:0/2959957004 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40d0170 con 0x7f75a4157ca0 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9a84700 1 --2- 172.21.15.81:0/2959957004 >> v2:172.21.15.83:3300/0 conn(0x7f75a41578d0 0x7f75a40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a9283700 1 --2- 172.21.15.81:0/2959957004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 0x7f75a415af00 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f75a40646b0 tx=0x7f7594009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0a1d621df860f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a8a82700 1 -- 172.21.15.81:0/2959957004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400b820 con 0x7f75a4157ca0 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a8a82700 1 -- 172.21.15.81:0/2959957004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759400b980 con 0x7f75a4157ca0 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.612+0000 7f75a8a82700 1 -- 172.21.15.81:0/2959957004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400bd20 con 0x7f75a4157ca0 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.613+0000 7f75abce8700 1 -- 172.21.15.81:0/2959957004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 msgr2=0x7f75a415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.613+0000 7f75abce8700 1 --2- 172.21.15.81:0/2959957004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 0x7f75a415af00 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f75a40646b0 tx=0x7f7594009250 comp rx=0 tx=0).stop 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.613+0000 7f75abce8700 1 -- 172.21.15.81:0/2959957004 shutdown_connections 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.613+0000 7f75abce8700 1 --2- 172.21.15.81:0/2959957004 >> v2:172.21.15.83:3300/0 conn(0x7f75a41578d0 0x7f75a40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.613+0000 7f75abce8700 1 --2- 172.21.15.81:0/2959957004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 0x7f75a415af00 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.613+0000 7f75abce8700 1 -- 172.21.15.81:0/2959957004 >> 172.21.15.81:0/2959957004 conn(0x7f75a406bb90 msgr2=0x7f75a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.613+0000 7f75abce8700 1 -- 172.21.15.81:0/2959957004 shutdown_connections 2023-10-06T02:52:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.613+0000 7f75abce8700 1 -- 172.21.15.81:0/2959957004 wait complete. 2023-10-06T02:52:53.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.614+0000 7f75abce8700 1 Processor -- start 2023-10-06T02:52:53.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.614+0000 7f75abce8700 1 -- start start 2023-10-06T02:52:53.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75abce8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75a406d120 0x7f75a40b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:53.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75abce8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75a41578d0 0x7f75a40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:53.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75abce8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 0x7f75a41539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:53.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75abce8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40aa890 con 0x7f75a4157ca0 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75abce8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40aab30 con 0x7f75a406d120 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75abce8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40acdf0 con 0x7f75a41578d0 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75aa285700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 0x7f75a41539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75aa285700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 0x7f75a41539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36262/0 (socket says 172.21.15.81:36262) 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75aa285700 1 -- 172.21.15.81:0/2470702403 learned_addr learned my addr 172.21.15.81:0/2470702403 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75a9a84700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75a406d120 0x7f75a40b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75a9283700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75a41578d0 0x7f75a40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75aa285700 1 -- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75a41578d0 msgr2=0x7f75a40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75aa285700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75a41578d0 0x7f75a40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:53.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75aa285700 1 -- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75a406d120 msgr2=0x7f75a40b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75aa285700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75a406d120 0x7f75a40b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75aa285700 1 -- 172.21.15.81:0/2470702403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940094f0 con 0x7f75a4157ca0 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75aa285700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 0x7f75a41539d0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c5b0 tx=0x7f759c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f7599ffb700 1 -- 172.21.15.81:0/2470702403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c011590 con 0x7f75a4157ca0 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f7599ffb700 1 -- 172.21.15.81:0/2470702403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c011710 con 0x7f75a4157ca0 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a40b6530 con 0x7f75a4157ca0 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.615+0000 7f7599ffb700 1 -- 172.21.15.81:0/2470702403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c011ad0 con 0x7f75a4157ca0 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.616+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a40b6af0 con 0x7f75a4157ca0 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.617+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a40aacc0 con 0x7f75a4157ca0 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.617+0000 7f7599ffb700 1 -- 172.21.15.81:0/2470702403 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f759c01c460 con 0x7f75a4157ca0 2023-10-06T02:52:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.617+0000 7f7599ffb700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7588066f30 0x7f75880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:53.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.617+0000 7f7599ffb700 1 -- 172.21.15.81:0/2470702403 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f759c084360 con 0x7f75a4157ca0 2023-10-06T02:52:53.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.617+0000 7f7599ffb700 1 -- 172.21.15.81:0/2470702403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7f758806f0f0 con 0x7f75a4157ca0 2023-10-06T02:52:53.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.617+0000 7f75a9a84700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7588066f30 0x7f75880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:53.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.618+0000 7f75a9a84700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7588066f30 0x7f75880693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f75a000d6e0 tx=0x7f75a0007850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:53.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.621+0000 7f7599ffb700 1 -- 172.21.15.81:0/2470702403 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f759c051470 con 0x7f75a4157ca0 2023-10-06T02:52:53.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.805+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f75a40b6ce0 con 0x7f75a4157ca0 2023-10-06T02:52:53.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.806+0000 7f7599ffb700 1 -- 172.21.15.81:0/2470702403 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) v1 ==== 81+0+34811 (secure 0 0 0) 0x7f759c054a90 con 0x7f75a4157ca0 2023-10-06T02:52:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:53.808 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 137, 2023-10-06T02:52:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:52:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:52:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:52:44.416602+0000", 2023-10-06T02:52:53.808 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:52:53.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 18, 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:52:53.810 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:53.811 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:53.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:53.813 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:53.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:53.815 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:52:53.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:53.817 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:53.818 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:53.819 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:53.820 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:53.821 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-06T02:52:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:23.555508+0000", 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:53.823 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:52:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:52:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:52:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:52:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:52:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "134", 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:53.825 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:53.826 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:53.827 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:52:53.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 18, 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:24.879976+0000", 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-06T02:52:53.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:52:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-06T02:52:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:52:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:52:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:52:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:52:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:52:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:52:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:52:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:52:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:52:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:52:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:52:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:52:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:53.895 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:53.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7588066f30 msgr2=0x7f75880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:53.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7588066f30 0x7f75880693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f75a000d6e0 tx=0x7f75a0007850 comp rx=0 tx=0).stop 2023-10-06T02:52:53.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 msgr2=0x7f75a41539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:53.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 0x7f75a41539d0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c5b0 tx=0x7f759c007f60 comp rx=0 tx=0).stop 2023-10-06T02:52:53.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 shutdown_connections 2023-10-06T02:52:53.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4157ca0 0x7f75a41539d0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:53.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7588066f30 0x7f75880693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:53.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75a406d120 0x7f75a40b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:53.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 --2- 172.21.15.81:0/2470702403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75a41578d0 0x7f75a40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:53.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.808+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 >> 172.21.15.81:0/2470702403 conn(0x7f75a406bb90 msgr2=0x7f75a4154960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:53.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.809+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 shutdown_connections 2023-10-06T02:52:53.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:53.809+0000 7f75abce8700 1 -- 172.21.15.81:0/2470702403 wait complete. 2023-10-06T02:52:53.898 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:52:58.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:52:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.023+0000 7f2cf6a94700 1 Processor -- start 2023-10-06T02:52:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.023+0000 7f2cf6a94700 1 -- start start 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.024+0000 7f2cf6a94700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cf015a2a0 0x7f2cf00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.024+0000 7f2cf6a94700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2cf006dd60 0x7f2cf00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.024+0000 7f2cf6a94700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00cf4e0 con 0x7f2cf00ceb30 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.024+0000 7f2cf6a94700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf006ea90 con 0x7f2cf006dd60 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.024+0000 7f2cf6a94700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00b0ca0 con 0x7f2cf015a2a0 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.024+0000 7f2cf5031700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2cf006dd60 0x7f2cf00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.024+0000 7f2cf5031700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2cf006dd60 0x7f2cf00cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36266/0 (socket says 172.21.15.81:36266) 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.024+0000 7f2cf5031700 1 -- 172.21.15.81:0/1548883732 learned_addr learned my addr 172.21.15.81:0/1548883732 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2cf4830700 1 --2- 172.21.15.81:0/1548883732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cf015a2a0 0x7f2cf00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2cf5031700 1 -- 172.21.15.81:0/1548883732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cf015a2a0 msgr2=0x7f2cf00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2cf5031700 1 --2- 172.21.15.81:0/1548883732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cf015a2a0 0x7f2cf00b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2cf5031700 1 -- 172.21.15.81:0/1548883732 >> v1:172.21.15.83:6789/0 conn(0x7f2cf00ceb30 legacy=0x7f2cf006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2cf5031700 1 -- 172.21.15.81:0/1548883732 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00b00d0 con 0x7f2cf006dd60 2023-10-06T02:52:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2cf5031700 1 --2- 172.21.15.81:0/1548883732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf006dd60 0x7f2cf00cefa0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80099b0 tx=0x7f2ce8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a5b2cac46497f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2ce77fe700 1 -- 172.21.15.81:0/1548883732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800b820 con 0x7f2cf006dd60 2023-10-06T02:52:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2ce77fe700 1 -- 172.21.15.81:0/1548883732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce800b980 con 0x7f2cf006dd60 2023-10-06T02:52:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2ce77fe700 1 -- 172.21.15.81:0/1548883732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800bd20 con 0x7f2cf006dd60 2023-10-06T02:52:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2cf6a94700 1 -- 172.21.15.81:0/1548883732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf006dd60 msgr2=0x7f2cf00cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.025+0000 7f2cf6a94700 1 --2- 172.21.15.81:0/1548883732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf006dd60 0x7f2cf00cefa0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80099b0 tx=0x7f2ce8009250 comp rx=0 tx=0).stop 2023-10-06T02:52:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.026+0000 7f2cf6a94700 1 -- 172.21.15.81:0/1548883732 shutdown_connections 2023-10-06T02:52:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.026+0000 7f2cf6a94700 1 --2- 172.21.15.81:0/1548883732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf006dd60 0x7f2cf00cefa0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.026+0000 7f2cf6a94700 1 --2- 172.21.15.81:0/1548883732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cf015a2a0 0x7f2cf00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.026+0000 7f2cf6a94700 1 -- 172.21.15.81:0/1548883732 >> 172.21.15.81:0/1548883732 conn(0x7f2cf0067640 msgr2=0x7f2cf0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.026+0000 7f2cf6a94700 1 -- 172.21.15.81:0/1548883732 shutdown_connections 2023-10-06T02:52:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.026+0000 7f2cf6a94700 1 -- 172.21.15.81:0/1548883732 wait complete. 2023-10-06T02:52:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.027+0000 7f2cf6a94700 1 Processor -- start 2023-10-06T02:52:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.027+0000 7f2cf6a94700 1 -- start start 2023-10-06T02:52:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf6a94700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cf006dd60 0x7f2cf015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf6a94700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf00ceb30 0x7f2cf0150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf6a94700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cf015a2a0 0x7f2cf015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf6a94700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf015cc80 con 0x7f2cf00ceb30 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf6a94700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf01507a0 con 0x7f2cf015a2a0 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf6a94700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0154cf0 con 0x7f2cf006dd60 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf00ceb30 0x7f2cf0150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf00ceb30 0x7f2cf0150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36280/0 (socket says 172.21.15.81:36280) 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce7fff700 1 -- 172.21.15.81:0/235903384 learned_addr learned my addr 172.21.15.81:0/235903384 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf5031700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cf015a2a0 0x7f2cf015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce7fff700 1 -- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cf006dd60 msgr2=0x7f2cf015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce7fff700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cf006dd60 0x7f2cf015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce7fff700 1 -- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cf015a2a0 msgr2=0x7f2cf015d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce7fff700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cf015a2a0 0x7f2cf015d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce7fff700 1 -- 172.21.15.81:0/235903384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce80094f0 con 0x7f2cf00ceb30 2023-10-06T02:52:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf5031700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cf015a2a0 0x7f2cf015d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce7fff700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf00ceb30 0x7f2cf0150260 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000c5d0 tx=0x7f2ce0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce4ff9700 1 -- 172.21.15.81:0/235903384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0011590 con 0x7f2cf00ceb30 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce4ff9700 1 -- 172.21.15.81:0/235903384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce0011710 con 0x7f2cf00ceb30 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf0154fd0 con 0x7f2cf00ceb30 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2ce4ff9700 1 -- 172.21.15.81:0/235903384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0011ad0 con 0x7f2cf00ceb30 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.028+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf015c910 con 0x7f2cf00ceb30 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.029+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0064650 con 0x7f2cf00ceb30 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.030+0000 7f2ce4ff9700 1 -- 172.21.15.81:0/235903384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ce001c460 con 0x7f2cf00ceb30 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.030+0000 7f2ce4ff9700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2cdc066f30 0x7f2cdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.030+0000 7f2ce4ff9700 1 -- 172.21.15.81:0/235903384 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ce0084490 con 0x7f2cf00ceb30 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.030+0000 7f2cf4830700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2cdc066f30 0x7f2cdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.031+0000 7f2cf4830700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2cdc066f30 0x7f2cdc0693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2cec007eb0 tx=0x7f2cec0073a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.034+0000 7f2ce4ff9700 1 -- 172.21.15.81:0/235903384 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ce00515a0 con 0x7f2cf00ceb30 2023-10-06T02:52:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.218+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2cf015cdc0 con 0x7f2cf00ceb30 2023-10-06T02:52:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.220+0000 7f2ce4ff9700 1 -- 172.21.15.81:0/235903384 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+34792 (secure 0 0 0) 0x7f2ce0054bc0 con 0x7f2cf00ceb30 2023-10-06T02:52:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:59.221 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 138, 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:52:54.418546+0000", 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:52:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:52:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:52:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:52:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:52:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:52:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:52:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 18, 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:52:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:52:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:52:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:52:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:52:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:52:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:23.555508+0000", 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:52:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "134", 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 18, 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:24.879976+0000", 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:52:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "138", 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:52:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:52:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:52:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:52:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:52:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:52:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:52:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:52:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:52:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:52:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:52:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:52:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:52:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:52:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:52:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:52:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:52:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:52:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:52:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:52:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:52:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:52:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:52:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:52:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:52:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:52:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:52:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:52:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:52:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:52:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:52:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:52:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.326 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.326 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.326 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.326 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:52:59.326 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.327 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:59.327 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.327 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.327 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.328 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.328 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.328 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:52:59.328 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.329 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:59.329 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.329 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.329 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.329 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.329 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.330 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:52:59.330 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.330 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:59.330 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.331 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.331 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.331 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.331 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.331 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:52:59.331 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.332 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:59.332 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:52:59.332 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:52:59.332 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:52:59.332 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:52:59.332 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:52:59.333 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:52:59.333 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:52:59.333 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:52:59.333 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:52:59.333 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:52:59.333 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:52:59.334 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:52:59.334 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:52:59.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.334 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:52:59.334 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:52:59.334 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:52:59.335 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:52:59.335 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:52:59.335 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:52:59.335 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:52:59.335 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:52:59.335 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:52:59.335 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:52:59.336 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:52:59.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.336 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2cdc066f30 msgr2=0x7f2cdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2cdc066f30 0x7f2cdc0693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2cec007eb0 tx=0x7f2cec0073a0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf00ceb30 msgr2=0x7f2cf0150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf00ceb30 0x7f2cf0150260 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000c5d0 tx=0x7f2ce0007f60 comp rx=0 tx=0).stop 2023-10-06T02:52:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 shutdown_connections 2023-10-06T02:52:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2cdc066f30 0x7f2cdc0693e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cf015a2a0 0x7f2cf015d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2cf006dd60 0x7f2cf015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 --2- 172.21.15.81:0/235903384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cf00ceb30 0x7f2cf0150260 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 >> 172.21.15.81:0/235903384 conn(0x7f2cf0067640 msgr2=0x7f2cf00ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:59.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 shutdown_connections 2023-10-06T02:52:59.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.222+0000 7f2cf6a94700 1 -- 172.21.15.81:0/235903384 wait complete. 2023-10-06T02:52:59.342 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-06T02:52:59.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:52:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.455+0000 7fcea759e700 1 Processor -- start 2023-10-06T02:52:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.455+0000 7fcea759e700 1 -- start start 2023-10-06T02:52:59.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.456+0000 7fcea759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcea80add30 0x7fcea80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.456+0000 7fcea759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea80b17c0 con 0x7fcea80cefa0 2023-10-06T02:52:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.456+0000 7fcea759e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea80b1d80 con 0x7fcea8067640 2023-10-06T02:52:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.456+0000 7fcea759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea80b37b0 con 0x7fcea80add30 2023-10-06T02:52:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea6d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcea80cefa0 0x7fcea80cc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60572/0 (socket says 172.21.15.81:60572) 2023-10-06T02:52:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea6d9d700 1 -- 172.21.15.81:0/3531808890 learned_addr learned my addr 172.21.15.81:0/3531808890 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea659c700 1 --2- 172.21.15.81:0/3531808890 >> v2:172.21.15.83:3300/0 conn(0x7fcea80add30 0x7fcea80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827403720 0 0) 0x7fcea80b17c0 con 0x7fcea80cefa0 2023-10-06T02:52:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce90003570 con 0x7fcea80cefa0 2023-10-06T02:52:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244503714 0 0) 0x7fcea80b1d80 con 0x7fcea8067640 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea80b17c0 con 0x7fcea8067640 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2294091564 0 0) 0x7fce90003570 con 0x7fcea80cefa0 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 >> v2:172.21.15.83:3300/0 conn(0x7fcea80add30 msgr2=0x7fcea80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 --2- 172.21.15.81:0/3531808890 >> v2:172.21.15.83:3300/0 conn(0x7fcea80add30 0x7fcea80b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 >> v1:172.21.15.83:6789/0 conn(0x7fcea8067640 legacy=0x7fcea80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea8068220 con 0x7fcea80cefa0 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fcea00017f0 con 0x7fcea80cefa0 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea659c700 1 --2- 172.21.15.81:0/3531808890 >> v2:172.21.15.83:3300/0 conn(0x7fcea80add30 0x7fcea80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 >> v1:172.21.15.81:6789/0 conn(0x7fcea80cefa0 legacy=0x7fcea80cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce90003bf0 0x7fce90003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce90004810 0x7fce90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900051c0 0x7fce9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9000c080 con 0x7fce900051c0 2023-10-06T02:52:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9000c1f0 con 0x7fce90004810 2023-10-06T02:52:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9000c3b0 con 0x7fce90003bf0 2023-10-06T02:52:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea6d9d700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900051c0 0x7fce9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea659c700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce90003bf0 0x7fce90003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.457+0000 7fcea5d9b700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce90004810 0x7fce90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea6d9d700 1 -- 172.21.15.81:0/3531808890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce90003bf0 msgr2=0x7fce90003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea6d9d700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce90003bf0 0x7fce90003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea6d9d700 1 -- 172.21.15.81:0/3531808890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce90004810 msgr2=0x7fce90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:52:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea6d9d700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce90004810 0x7fce90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea6d9d700 1 -- 172.21.15.81:0/3531808890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90003570 con 0x7fce900051c0 2023-10-06T02:52:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea6d9d700 1 -- 172.21.15.81:0/3531808890 reap_dead start 2023-10-06T02:52:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea6d9d700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900051c0 0x7fce9000ba60 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fcea000a8c0 tx=0x7fcea0002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395b5fc3d66bb8ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00070d0 con 0x7fce900051c0 2023-10-06T02:52:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea0007250 con 0x7fce900051c0 2023-10-06T02:52:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea559a700 1 -- 172.21.15.81:0/3531808890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0007610 con 0x7fce900051c0 2023-10-06T02:52:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea759e700 1 -- 172.21.15.81:0/3531808890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900051c0 msgr2=0x7fce9000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea759e700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900051c0 0x7fce9000ba60 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fcea000a8c0 tx=0x7fcea0002190 comp rx=0 tx=0).stop 2023-10-06T02:52:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea759e700 1 -- 172.21.15.81:0/3531808890 shutdown_connections 2023-10-06T02:52:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea759e700 1 --2- 172.21.15.81:0/3531808890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900051c0 0x7fce9000ba60 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea759e700 1 -- 172.21.15.81:0/3531808890 >> 172.21.15.81:0/3531808890 conn(0x7fcea806c620 msgr2=0x7fcea806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea759e700 1 -- 172.21.15.81:0/3531808890 shutdown_connections 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.458+0000 7fcea759e700 1 -- 172.21.15.81:0/3531808890 wait complete. 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.459+0000 7fcea759e700 1 Processor -- start 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.459+0000 7fcea759e700 1 -- start start 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce900051c0 0x7fcea815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea814c5b0 0x7fcea815ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcea8152730 0x7fcea8152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea816c420 con 0x7fcea814c5b0 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8151c50 con 0x7fce900051c0 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8151f30 con 0x7fcea8152730 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea814c5b0 0x7fcea815ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea814c5b0 0x7fcea815ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36306/0 (socket says 172.21.15.81:36306) 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea5d9b700 1 -- 172.21.15.81:0/245533886 learned_addr learned my addr 172.21.15.81:0/245533886 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea659c700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce900051c0 0x7fcea815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.460+0000 7fcea6d9d700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcea8152730 0x7fcea8152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fcea5d9b700 1 -- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcea8152730 msgr2=0x7fcea8152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fcea5d9b700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcea8152730 0x7fcea8152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fcea5d9b700 1 -- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce900051c0 msgr2=0x7fcea815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fcea5d9b700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce900051c0 0x7fcea815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fcea5d9b700 1 -- 172.21.15.81:0/245533886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea8152210 con 0x7fcea814c5b0 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fcea5d9b700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea814c5b0 0x7fcea815ceb0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fce9c002b30 tx=0x7fce9c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fce967fc700 1 -- 172.21.15.81:0/245533886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00f870 con 0x7fcea814c5b0 2023-10-06T02:52:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fce967fc700 1 -- 172.21.15.81:0/245533886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c00f9d0 con 0x7fcea814c5b0 2023-10-06T02:52:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea8151900 con 0x7fcea814c5b0 2023-10-06T02:52:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fce967fc700 1 -- 172.21.15.81:0/245533886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00fd90 con 0x7fcea814c5b0 2023-10-06T02:52:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.461+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea815aba0 con 0x7fcea814c5b0 2023-10-06T02:52:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.462+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea8152450 con 0x7fcea814c5b0 2023-10-06T02:52:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.462+0000 7fce967fc700 1 -- 172.21.15.81:0/245533886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce9c006a30 con 0x7fcea814c5b0 2023-10-06T02:52:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.463+0000 7fce967fc700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce88066f30 0x7fce880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.463+0000 7fce967fc700 1 -- 172.21.15.81:0/245533886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce9c084900 con 0x7fcea814c5b0 2023-10-06T02:52:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.463+0000 7fcea659c700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce88066f30 0x7fce880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.463+0000 7fcea659c700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce88066f30 0x7fce880693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fce98006f00 tx=0x7fce980091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.467+0000 7fce967fc700 1 -- 172.21.15.81:0/245533886 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcea8152450 con 0x7fcea814c5b0 2023-10-06T02:52:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.649+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcea8152450 con 0x7fcea814c5b0 2023-10-06T02:52:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.650+0000 7fce967fc700 1 -- 172.21.15.81:0/245533886 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+34792 (secure 0 0 0) 0x7fcea8152450 con 0x7fcea814c5b0 2023-10-06T02:52:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:52:59.651 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:52:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 138, 2023-10-06T02:52:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:52:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:52:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:52:54.418546+0000", 2023-10-06T02:52:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:52:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:52:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:52:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:52:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:52:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 18, 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:52:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:52:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:52:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:52:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:52:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:52:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:59.662 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:59.664 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:59.664 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:59.664 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:59.664 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:59.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.664 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:52:59.664 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:59.664 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:59.664 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:59.665 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:59.666 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:59.666 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:59.666 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:59.666 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:59.666 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:59.667 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:59.668 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:23.555508+0000", 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:59.670 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:59.671 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "134", 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:59.672 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:59.673 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.674 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:59.675 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 18, 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:52:24.879976+0000", 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:52:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:52:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:52:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:52:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:52:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:52:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:52:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:52:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "138", 2023-10-06T02:52:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:52:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:52:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:52:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:52:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:52:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:52:59.684 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:52:59.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.684 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:59.684 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:52:59.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.684 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:59.684 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.685 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.691 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.692 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:52:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.697 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:52:59.698 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:52:59.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.698 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:52:59.698 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:52:59.698 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:52:59.698 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:52:59.698 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.699 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:52:59.703 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:52:59.705 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:52:59.706 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.706 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.706 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.706 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.706 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:59.706 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.706 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.707 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.707 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.707 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.707 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.707 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.707 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.707 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.707 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.709 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:52:59.709 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.709 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:52:59.712 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.712 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.712 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:52:59.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.714 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.714 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:52:59.714 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:52:59.714 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:52:59.714 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:52:59.714 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.714 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.715 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:52:59.716 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.717 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:52:59.721 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.722 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:52:59.723 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.725 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.728 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.729 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.731 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.733 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:52:59.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 133, 2023-10-06T02:52:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:52:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:52:59.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:52:59.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:52:59.743 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.744 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:52:59.748 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:52:59.749 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:52:59.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:52:59.751 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:52:59.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:52:59.752 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce88066f30 msgr2=0x7fce880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce88066f30 0x7fce880693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fce98006f00 tx=0x7fce980091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea814c5b0 msgr2=0x7fcea815ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea814c5b0 0x7fcea815ceb0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fce9c002b30 tx=0x7fce9c007d30 comp rx=0 tx=0).stop 2023-10-06T02:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 shutdown_connections 2023-10-06T02:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcea8152730 0x7fcea8152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce88066f30 0x7fce880693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce900051c0 0x7fcea815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 --2- 172.21.15.81:0/245533886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea814c5b0 0x7fcea815ceb0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 >> 172.21.15.81:0/245533886 conn(0x7fcea806c620 msgr2=0x7fcea81572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 shutdown_connections 2023-10-06T02:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.652+0000 7fcea759e700 1 -- 172.21.15.81:0/245533886 wait complete. 2023-10-06T02:52:59.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:52:59.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.867+0000 7f8578fe7700 1 Processor -- start 2023-10-06T02:52:59.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.867+0000 7f8578fe7700 1 -- start start 2023-10-06T02:52:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.868+0000 7f8578fe7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8574159f10 0x7f8574068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.868+0000 7f8578fe7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8574069120 con 0x7f8574159b40 2023-10-06T02:52:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.868+0000 7f8578fe7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85740cee10 con 0x7f8574068cc0 2023-10-06T02:52:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.868+0000 7f8578fe7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85740cd040 con 0x7f8574159f10 2023-10-06T02:52:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.868+0000 7f85737fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8574159b40 0x7f85740cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60576/0 (socket says 172.21.15.81:60576) 2023-10-06T02:52:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.868+0000 7f85737fe700 1 -- 172.21.15.81:0/1896992253 learned_addr learned my addr 172.21.15.81:0/1896992253 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:52:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.868+0000 7f8572ffd700 1 --2- 172.21.15.81:0/1896992253 >> v2:172.21.15.83:3300/0 conn(0x7f8574159f10 0x7f8574068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.868+0000 7f85727fc700 1 -- 172.21.15.81:0/1896992253 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331291708 0 0) 0x7f8564001110 con 0x7f8574159b40 2023-10-06T02:52:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.868+0000 7f85727fc700 1 -- 172.21.15.81:0/1896992253 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f855c003570 con 0x7f8574159b40 2023-10-06T02:52:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8572ffd700 1 -- 172.21.15.81:0/1896992253 >> v1:172.21.15.83:6789/0 conn(0x7f8574068cc0 legacy=0x7f85740cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8572ffd700 1 -- 172.21.15.81:0/1896992253 >> v1:172.21.15.81:6789/0 conn(0x7f8574159b40 legacy=0x7f85740cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f85727fc700 1 -- 172.21.15.81:0/1896992253 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 743778829 0 0) 0x7f855c003570 con 0x7f8574159b40 2023-10-06T02:52:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8572ffd700 1 -- 172.21.15.81:0/1896992253 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85740cd320 con 0x7f8574159f10 2023-10-06T02:52:59.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8572ffd700 1 --2- 172.21.15.81:0/1896992253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 0x7f8574068780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f85680098e0 tx=0x7f85680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcee09e46be156f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:59.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f85727fc700 1 -- 172.21.15.81:0/1896992253 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800b640 con 0x7f8574159f10 2023-10-06T02:52:59.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f85727fc700 1 -- 172.21.15.81:0/1896992253 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856800b7a0 con 0x7f8574159f10 2023-10-06T02:52:59.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f85727fc700 1 -- 172.21.15.81:0/1896992253 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800bb40 con 0x7f8574159f10 2023-10-06T02:52:59.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8578fe7700 1 -- 172.21.15.81:0/1896992253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 msgr2=0x7f8574068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8578fe7700 1 --2- 172.21.15.81:0/1896992253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 0x7f8574068780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f85680098e0 tx=0x7f85680091a0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8578fe7700 1 -- 172.21.15.81:0/1896992253 shutdown_connections 2023-10-06T02:52:59.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8578fe7700 1 --2- 172.21.15.81:0/1896992253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 0x7f8574068780 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8578fe7700 1 -- 172.21.15.81:0/1896992253 >> 172.21.15.81:0/1896992253 conn(0x7f85740cd660 msgr2=0x7f85740cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:52:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.869+0000 7f8578fe7700 1 -- 172.21.15.81:0/1896992253 shutdown_connections 2023-10-06T02:52:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.870+0000 7f8578fe7700 1 -- 172.21.15.81:0/1896992253 wait complete. 2023-10-06T02:52:59.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.871+0000 7f8578fe7700 1 Processor -- start 2023-10-06T02:52:59.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.871+0000 7f8578fe7700 1 -- start start 2023-10-06T02:52:59.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.871+0000 7f8578fe7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8574068cc0 0x7f857416e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.871+0000 7f8578fe7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8574159b40 0x7f8574158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f8578fe7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 0x7f857415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f8578fe7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740ca610 con 0x7f8574068cc0 2023-10-06T02:52:59.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f8578fe7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857416e990 con 0x7f8574159f10 2023-10-06T02:52:59.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f8578fe7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8574158dd0 con 0x7f8574159b40 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f85737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8574068cc0 0x7f857416e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f85737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8574068cc0 0x7f857416e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36312/0 (socket says 172.21.15.81:36312) 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f85737fe700 1 -- 172.21.15.81:0/2090561955 learned_addr learned my addr 172.21.15.81:0/2090561955 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f8573fff700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 0x7f857415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f8572ffd700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8574159b40 0x7f8574158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f85737fe700 1 -- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8574159b40 msgr2=0x7f8574158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f85737fe700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8574159b40 0x7f8574158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f85737fe700 1 -- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 msgr2=0x7f857415c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f85737fe700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 0x7f857415c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f85737fe700 1 -- 172.21.15.81:0/2090561955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568009420 con 0x7f8574068cc0 2023-10-06T02:52:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f8573fff700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 0x7f857415c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f85737fe700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8574068cc0 0x7f857416e450 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f856400c840 tx=0x7f85640079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f855b7fe700 1 -- 172.21.15.81:0/2090561955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564007360 con 0x7f8574068cc0 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f855b7fe700 1 -- 172.21.15.81:0/2090561955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85640074e0 con 0x7f8574068cc0 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85741612e0 con 0x7f8574068cc0 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f855b7fe700 1 -- 172.21.15.81:0/2090561955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564004830 con 0x7f8574068cc0 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.872+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85741618a0 con 0x7f8574068cc0 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.873+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85740cb890 con 0x7f8574068cc0 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.874+0000 7f855b7fe700 1 -- 172.21.15.81:0/2090561955 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8564004bc0 con 0x7f8574068cc0 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.874+0000 7f855b7fe700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8560066f30 0x7f85600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.874+0000 7f855b7fe700 1 -- 172.21.15.81:0/2090561955 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8564084330 con 0x7f8574068cc0 2023-10-06T02:52:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.874+0000 7f8572ffd700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8560066f30 0x7f85600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:52:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.875+0000 7f8572ffd700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8560066f30 0x7f85600693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f85680093f0 tx=0x7f8568017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:52:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:52:59.878+0000 7f855b7fe700 1 -- 172.21.15.81:0/2090561955 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85640514c0 con 0x7f8574068cc0 2023-10-06T02:53:00.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.104+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8574069120 con 0x7f8574068cc0 2023-10-06T02:53:00.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.104+0000 7f855b7fe700 1 -- 172.21.15.81:0/2090561955 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f8574069120 con 0x7f8574068cc0 2023-10-06T02:53:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:00.106 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:52:25.912348+0000","modified":"2023-10-06T02:52:29.566702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7275":{"gid":7275,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/4039558742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":4039558742},{"type":"v1","addr":"172.21.15.83:6836","nonce":4039558742}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8560066f30 msgr2=0x7f85600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8560066f30 0x7f85600693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f85680093f0 tx=0x7f8568017000 comp rx=0 tx=0).stop 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8574068cc0 msgr2=0x7f857416e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8574068cc0 0x7f857416e450 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f856400c840 tx=0x7f85640079d0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 shutdown_connections 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8560066f30 0x7f85600693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8574159f10 0x7f857415c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8574068cc0 0x7f857416e450 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 --2- 172.21.15.81:0/2090561955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8574159b40 0x7f8574158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 >> 172.21.15.81:0/2090561955 conn(0x7f85740cd660 msgr2=0x7f85740c6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:00.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 shutdown_connections 2023-10-06T02:53:00.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.106+0000 7f8578fe7700 1 -- 172.21.15.81:0/2090561955 wait complete. 2023-10-06T02:53:00.111 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 67 2023-10-06T02:53:00.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-06T02:53:00.263 INFO:teuthology.orchestra.run.smithi083.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":7275,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":33.701434075999998,"mdsmap_epoch":67,"osdmap_epoch":138,"osdmap_epoch_barrier":137,"uptime":39.822470578000001} 2023-10-06T02:53:00.264 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 7275, "mdsmap_epoch": 67, "osdmap_epoch": 138, "osdmap_epoch_barrier": 137, "rank_uptime": 33.701434076, "state": "up:active", "uptime": 39.822470578, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:53:00.264 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:53:00.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:53:00.264 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-06T02:53:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-06T02:53:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-06T02:53:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.259176 s, 202 MB/s 2023-10-06T02:53:00.541 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:53:00.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:53:00.581 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:53:00.617 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:53:00.617 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:53:00.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:53:00.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:53:00.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:53:00.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:00.689 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:53:00.705 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:53:00.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:53:00.706 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:53:00.748 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:53:00.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:00.749 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:53:00.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:53:00.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.916+0000 7efec1839700 1 Processor -- start 2023-10-06T02:53:00.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.916+0000 7efec1839700 1 -- start start 2023-10-06T02:53:00.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.917+0000 7efec1839700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc06dd60 0x7efebc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:00.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.917+0000 7efec1839700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc0b0ca0 con 0x7efebc0cf240 2023-10-06T02:53:00.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.917+0000 7efec1839700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc0b00d0 con 0x7efebc15a2a0 2023-10-06T02:53:00.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.917+0000 7efec1839700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc06ea90 con 0x7efebc06dd60 2023-10-06T02:53:00.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.917+0000 7efeb27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efebc0cf240 0x7efebc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48146/0 (socket says 172.21.15.81:48146) 2023-10-06T02:53:00.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.917+0000 7efeb27fc700 1 -- 172.21.15.81:0/2028983892 learned_addr learned my addr 172.21.15.81:0/2028983892 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:00.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.917+0000 7efebb7fe700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc06dd60 0x7efebc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779192564 0 0) 0x7efebc0b0ca0 con 0x7efebc0cf240 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea8003570 con 0x7efebc0cf240 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470780183 0 0) 0x7efebc0b00d0 con 0x7efebc15a2a0 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efebc0b0ca0 con 0x7efebc15a2a0 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3753506316 0 0) 0x7efea8003570 con 0x7efebc0cf240 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc06dd60 msgr2=0x7efebc0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc06dd60 0x7efebc0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 >> v1:172.21.15.83:6789/0 conn(0x7efebc15a2a0 legacy=0x7efebc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0b0370 con 0x7efebc0cf240 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7efea4001470 con 0x7efebc0cf240 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 >> v1:172.21.15.81:6789/0 conn(0x7efebc0cf240 legacy=0x7efebc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:00.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efea8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea8004810 0x7efea8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea80051c0 0x7efea800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc06ea90 con 0x7efea8003c20 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea800c020 con 0x7efea8004810 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea800c1e0 con 0x7efea80051c0 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efebb7fe700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc06dd60 0x7efebc0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efebaffd700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efea8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efeb27fc700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea8004810 0x7efea8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efebb7fe700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea80051c0 0x7efea800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efebaffd700 1 -- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea80051c0 msgr2=0x7efea800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efebaffd700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea80051c0 0x7efea800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efebaffd700 1 -- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea8004810 msgr2=0x7efea8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efebaffd700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea8004810 0x7efea8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.918+0000 7efebaffd700 1 -- 172.21.15.81:0/2028983892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea8003570 con 0x7efea8003c20 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efebaffd700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efea8004010 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7efeac001a10 tx=0x7efeac007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bb4a7a8941e888 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00c5d0 con 0x7efea8003c20 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac00c730 con 0x7efea8003c20 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efeba7fc700 1 -- 172.21.15.81:0/2028983892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00caf0 con 0x7efea8003c20 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efec1839700 1 -- 172.21.15.81:0/2028983892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 msgr2=0x7efea8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efec1839700 1 --2- 172.21.15.81:0/2028983892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efea8004010 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7efeac001a10 tx=0x7efeac007d10 comp rx=0 tx=0).stop 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efebb7fe700 1 -- 172.21.15.81:0/2028983892 reap_dead start 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efec1839700 1 -- 172.21.15.81:0/2028983892 shutdown_connections 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efec1839700 1 -- 172.21.15.81:0/2028983892 >> 172.21.15.81:0/2028983892 conn(0x7efebc067640 msgr2=0x7efebc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:00.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efec1839700 1 -- 172.21.15.81:0/2028983892 shutdown_connections 2023-10-06T02:53:00.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.919+0000 7efec1839700 1 -- 172.21.15.81:0/2028983892 wait complete. 2023-10-06T02:53:00.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.920+0000 7efec1839700 1 Processor -- start 2023-10-06T02:53:00.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efec1839700 1 -- start start 2023-10-06T02:53:00.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efec1839700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efebc0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:00.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efec1839700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efebc0cc410 0x7efebc15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:00.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efec1839700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc1554f0 0x7efebc155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:00.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efec1839700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc155ed0 con 0x7efea8003c20 2023-10-06T02:53:00.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efec1839700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0b2950 con 0x7efebc0cc410 2023-10-06T02:53:00.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efec1839700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc154380 con 0x7efebc1554f0 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efebaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efebc0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efebaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efebc0cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36794/0 (socket says 172.21.15.81:36794) 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efebaffd700 1 -- 172.21.15.81:0/2001415802 learned_addr learned my addr 172.21.15.81:0/2001415802 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efeb27fc700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efebc0cc410 0x7efebc15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.921+0000 7efebb7fe700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc1554f0 0x7efebc155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efebaffd700 1 -- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc1554f0 msgr2=0x7efebc155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efebaffd700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc1554f0 0x7efebc155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efebaffd700 1 -- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efebc0cc410 msgr2=0x7efebc15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efebaffd700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efebc0cc410 0x7efebc15c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efebaffd700 1 -- 172.21.15.81:0/2001415802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0cba90 con 0x7efea8003c20 2023-10-06T02:53:00.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efebaffd700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efebc0cb550 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7efeac012ea0 tx=0x7efeac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:00.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efeb37fe700 1 -- 172.21.15.81:0/2001415802 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00c5d0 con 0x7efea8003c20 2023-10-06T02:53:00.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efeb37fe700 1 -- 172.21.15.81:0/2001415802 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac0013b0 con 0x7efea8003c20 2023-10-06T02:53:00.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc0b1940 con 0x7efea8003c20 2023-10-06T02:53:00.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efeb37fe700 1 -- 172.21.15.81:0/2001415802 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac026630 con 0x7efea8003c20 2023-10-06T02:53:00.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.922+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc0b24c0 con 0x7efea8003c20 2023-10-06T02:53:00.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.923+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc069e40 con 0x7efea8003c20 2023-10-06T02:53:00.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.923+0000 7efeb37fe700 1 -- 172.21.15.81:0/2001415802 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efeac019030 con 0x7efea8003c20 2023-10-06T02:53:00.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.924+0000 7efeb37fe700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe9c066f30 0x7efe9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:00.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.924+0000 7efeb37fe700 1 -- 172.21.15.81:0/2001415802 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efeac0859d0 con 0x7efea8003c20 2023-10-06T02:53:00.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.924+0000 7efeb27fc700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe9c066f30 0x7efe9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:00.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.924+0000 7efeb27fc700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe9c066f30 0x7efe9c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efebc0cc7e0 tx=0x7efea4001df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:00.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:00.928+0000 7efeb37fe700 1 -- 172.21.15.81:0/2001415802 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efeac052ba0 con 0x7efea8003c20 2023-10-06T02:53:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.151+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efebc0cba90 con 0x7efea8003c20 2023-10-06T02:53:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.152+0000 7efeb37fe700 1 -- 172.21.15.81:0/2001415802 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7efebc0cba90 con 0x7efea8003c20 2023-10-06T02:53:01.153 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:01.153 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:52:25.912348+0000","modified":"2023-10-06T02:52:29.566702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7275":{"gid":7275,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/4039558742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":4039558742},{"type":"v1","addr":"172.21.15.83:6836","nonce":4039558742}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T02:53:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe9c066f30 msgr2=0x7efe9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe9c066f30 0x7efe9c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efebc0cc7e0 tx=0x7efea4001df0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 msgr2=0x7efebc0cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efebc0cb550 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7efeac012ea0 tx=0x7efeac015000 comp rx=0 tx=0).stop 2023-10-06T02:53:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 shutdown_connections 2023-10-06T02:53:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efebc1554f0 0x7efebc155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea8003c20 0x7efebc0cb550 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efe9c066f30 0x7efe9c0693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 --2- 172.21.15.81:0/2001415802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efebc0cc410 0x7efebc15c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 >> 172.21.15.81:0/2001415802 conn(0x7efebc067640 msgr2=0x7efebc156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 shutdown_connections 2023-10-06T02:53:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.154+0000 7efec1839700 1 -- 172.21.15.81:0/2001415802 wait complete. 2023-10-06T02:53:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 67 2023-10-06T02:53:01.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:53:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.279+0000 7fcd1761d700 1 Processor -- start 2023-10-06T02:53:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.279+0000 7fcd1761d700 1 -- start start 2023-10-06T02:53:01.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd1761d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd101578d0 0x7fcd100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd1761d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcd1006d120 0x7fcd1006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd1761d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd100d07c0 con 0x7fcd10157ca0 2023-10-06T02:53:01.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd1761d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1006da50 con 0x7fcd101578d0 2023-10-06T02:53:01.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd1761d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd100cfbb0 con 0x7fcd1006d120 2023-10-06T02:53:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd153b9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd101578d0 0x7fcd100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd14bb8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcd10157ca0 0x7fcd1015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48150/0 (socket says 172.21.15.81:48150) 2023-10-06T02:53:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd14bb8700 1 -- 172.21.15.81:0/748273114 learned_addr learned my addr 172.21.15.81:0/748273114 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd15bba700 1 --2- 172.21.15.81:0/748273114 >> v2:172.21.15.83:3300/0 conn(0x7fcd1006d120 0x7fcd1006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd153b9700 1 -- 172.21.15.81:0/748273114 >> v2:172.21.15.83:3300/0 conn(0x7fcd1006d120 msgr2=0x7fcd1006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd153b9700 1 --2- 172.21.15.81:0/748273114 >> v2:172.21.15.83:3300/0 conn(0x7fcd1006d120 0x7fcd1006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd153b9700 1 -- 172.21.15.81:0/748273114 >> v1:172.21.15.81:6789/0 conn(0x7fcd10157ca0 legacy=0x7fcd1015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd153b9700 1 -- 172.21.15.81:0/748273114 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd100cfe90 con 0x7fcd101578d0 2023-10-06T02:53:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd07fff700 1 -- 172.21.15.81:0/748273114 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755672098 0 0) 0x7fcd100d07c0 con 0x7fcd10157ca0 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd15bba700 1 --2- 172.21.15.81:0/748273114 >> v2:172.21.15.83:3300/0 conn(0x7fcd1006d120 0x7fcd1006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd153b9700 1 --2- 172.21.15.81:0/748273114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101578d0 0x7fcd100cf4f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fcd10068300 tx=0x7fcd0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9e8115bfe201a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd07fff700 1 -- 172.21.15.81:0/748273114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00b6b0 con 0x7fcd101578d0 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd07fff700 1 -- 172.21.15.81:0/748273114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c00b810 con 0x7fcd101578d0 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.280+0000 7fcd07fff700 1 -- 172.21.15.81:0/748273114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00bbb0 con 0x7fcd101578d0 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.281+0000 7fcd1761d700 1 -- 172.21.15.81:0/748273114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101578d0 msgr2=0x7fcd100cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.281+0000 7fcd1761d700 1 --2- 172.21.15.81:0/748273114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101578d0 0x7fcd100cf4f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fcd10068300 tx=0x7fcd0c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.281+0000 7fcd1761d700 1 -- 172.21.15.81:0/748273114 shutdown_connections 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.281+0000 7fcd1761d700 1 --2- 172.21.15.81:0/748273114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101578d0 0x7fcd100cf4f0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.281+0000 7fcd1761d700 1 --2- 172.21.15.81:0/748273114 >> v2:172.21.15.83:3300/0 conn(0x7fcd1006d120 0x7fcd1006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.281+0000 7fcd1761d700 1 -- 172.21.15.81:0/748273114 >> 172.21.15.81:0/748273114 conn(0x7fcd1006bb90 msgr2=0x7fcd1006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.281+0000 7fcd1761d700 1 -- 172.21.15.81:0/748273114 shutdown_connections 2023-10-06T02:53:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.281+0000 7fcd1761d700 1 -- 172.21.15.81:0/748273114 wait complete. 2023-10-06T02:53:01.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.282+0000 7fcd1761d700 1 Processor -- start 2023-10-06T02:53:01.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.282+0000 7fcd1761d700 1 -- start start 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd1761d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1006d120 0x7fcd10068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd1761d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd101578d0 0x7fcd1016d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd1761d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd10157ca0 0x7fcd1016dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd1761d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100ab270 con 0x7fcd1006d120 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd1761d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1016e2c0 con 0x7fcd10157ca0 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd1761d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1016e570 con 0x7fcd101578d0 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd153b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1006d120 0x7fcd10068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd153b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1006d120 0x7fcd10068eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36810/0 (socket says 172.21.15.81:36810) 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd153b9700 1 -- 172.21.15.81:0/1799156670 learned_addr learned my addr 172.21.15.81:0/1799156670 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd15bba700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd10157ca0 0x7fcd1016dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd153b9700 1 -- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd101578d0 msgr2=0x7fcd1016d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd14bb8700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd101578d0 0x7fcd1016d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd153b9700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd101578d0 0x7fcd1016d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd153b9700 1 -- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd10157ca0 msgr2=0x7fcd1016dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd153b9700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd10157ca0 0x7fcd1016dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd153b9700 1 -- 172.21.15.81:0/1799156670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c009420 con 0x7fcd1006d120 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd15bba700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd10157ca0 0x7fcd1016dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.283+0000 7fcd14bb8700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd101578d0 0x7fcd1016d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.284+0000 7fcd153b9700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1006d120 0x7fcd10068eb0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fcd1006fe20 tx=0x7fcd0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.284+0000 7fcd057fa700 1 -- 172.21.15.81:0/1799156670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00bb90 con 0x7fcd1006d120 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.284+0000 7fcd057fa700 1 -- 172.21.15.81:0/1799156670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c011420 con 0x7fcd1006d120 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.284+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd100aac20 con 0x7fcd1006d120 2023-10-06T02:53:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.284+0000 7fcd057fa700 1 -- 172.21.15.81:0/1799156670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0117a0 con 0x7fcd1006d120 2023-10-06T02:53:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.284+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd100693f0 con 0x7fcd1006d120 2023-10-06T02:53:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.285+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd100aaa80 con 0x7fcd1006d120 2023-10-06T02:53:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.285+0000 7fcd057fa700 1 -- 172.21.15.81:0/1799156670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd0c011b90 con 0x7fcd1006d120 2023-10-06T02:53:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.286+0000 7fcd057fa700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fccf4066f30 0x7fccf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.286+0000 7fcd057fa700 1 -- 172.21.15.81:0/1799156670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcd0c086060 con 0x7fcd1006d120 2023-10-06T02:53:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.286+0000 7fcd14bb8700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fccf4066f30 0x7fccf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.286+0000 7fcd14bb8700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fccf4066f30 0x7fccf40693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcd1016d7a0 tx=0x7fcd00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.290+0000 7fcd057fa700 1 -- 172.21.15.81:0/1799156670 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd100aaa80 con 0x7fcd1006d120 2023-10-06T02:53:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.473+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd100aaa80 con 0x7fcd1006d120 2023-10-06T02:53:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.474+0000 7fcd057fa700 1 -- 172.21.15.81:0/1799156670 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16841 (secure 0 0 0) 0x7fcd100aaa80 con 0x7fcd1006d120 2023-10-06T02:53:01.475 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:01.475 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":138,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:54.418546+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:52:23.555508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T02:52:24.879976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:53:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fccf4066f30 msgr2=0x7fccf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fccf4066f30 0x7fccf40693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcd1016d7a0 tx=0x7fcd00009040 comp rx=0 tx=0).stop 2023-10-06T02:53:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1006d120 msgr2=0x7fcd10068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1006d120 0x7fcd10068eb0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fcd1006fe20 tx=0x7fcd0c017000 comp rx=0 tx=0).stop 2023-10-06T02:53:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 shutdown_connections 2023-10-06T02:53:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fccf4066f30 0x7fccf40693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd10157ca0 0x7fcd1016dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1006d120 0x7fcd10068eb0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 --2- 172.21.15.81:0/1799156670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd101578d0 0x7fcd1016d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 >> 172.21.15.81:0/1799156670 conn(0x7fcd1006bb90 msgr2=0x7fcd1006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 shutdown_connections 2023-10-06T02:53:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.476+0000 7fcd1761d700 1 -- 172.21.15.81:0/1799156670 wait complete. 2023-10-06T02:53:01.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:52:23.555508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:52:24.879976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:53:01.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:53:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.606+0000 7f6085940700 1 Processor -- start 2023-10-06T02:53:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.606+0000 7f6085940700 1 -- start start 2023-10-06T02:53:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f6085940700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60801578d0 0x7f60800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f6085940700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6080157ca0 0x7f608015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f6085940700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f608006d120 0x7f608006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f6085940700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608006dac0 con 0x7f60801578d0 2023-10-06T02:53:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f6085940700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60800d07c0 con 0x7f608006d120 2023-10-06T02:53:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f6085940700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60800cfbb0 con 0x7f6080157ca0 2023-10-06T02:53:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60801578d0 0x7f60800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60801578d0 0x7f60800cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36826/0 (socket says 172.21.15.81:36826) 2023-10-06T02:53:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607effd700 1 -- 172.21.15.81:0/320141621 learned_addr learned my addr 172.21.15.81:0/320141621 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607f7fe700 1 --2- 172.21.15.81:0/320141621 >> v2:172.21.15.83:3300/0 conn(0x7f608006d120 0x7f608006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607e7fc700 1 --2- 172.21.15.81:0/320141621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6080157ca0 0x7f608015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607effd700 1 -- 172.21.15.81:0/320141621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6080157ca0 msgr2=0x7f608015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607effd700 1 --2- 172.21.15.81:0/320141621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6080157ca0 0x7f608015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607effd700 1 -- 172.21.15.81:0/320141621 >> v2:172.21.15.83:3300/0 conn(0x7f608006d120 msgr2=0x7f608006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607effd700 1 --2- 172.21.15.81:0/320141621 >> v2:172.21.15.83:3300/0 conn(0x7f608006d120 0x7f608006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607effd700 1 -- 172.21.15.81:0/320141621 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60800cfe90 con 0x7f60801578d0 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607f7fe700 1 --2- 172.21.15.81:0/320141621 >> v2:172.21.15.83:3300/0 conn(0x7f608006d120 0x7f608006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.607+0000 7f607e7fc700 1 --2- 172.21.15.81:0/320141621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6080157ca0 0x7f608015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f607effd700 1 --2- 172.21.15.81:0/320141621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60801578d0 0x7f60800cf4f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f60800b3940 tx=0x7f6078009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fa5e6156ab87f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f607dffb700 1 -- 172.21.15.81:0/320141621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607800e070 con 0x7f60801578d0 2023-10-06T02:53:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f607dffb700 1 -- 172.21.15.81:0/320141621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607800ba50 con 0x7f60801578d0 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f607dffb700 1 -- 172.21.15.81:0/320141621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780092e0 con 0x7f60801578d0 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f6085940700 1 -- 172.21.15.81:0/320141621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60801578d0 msgr2=0x7f60800cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f6085940700 1 --2- 172.21.15.81:0/320141621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60801578d0 0x7f60800cf4f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f60800b3940 tx=0x7f6078009840 comp rx=0 tx=0).stop 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f6085940700 1 -- 172.21.15.81:0/320141621 shutdown_connections 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f6085940700 1 --2- 172.21.15.81:0/320141621 >> v2:172.21.15.83:3300/0 conn(0x7f608006d120 0x7f608006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f6085940700 1 --2- 172.21.15.81:0/320141621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60801578d0 0x7f60800cf4f0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f6085940700 1 --2- 172.21.15.81:0/320141621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6080157ca0 0x7f608015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f6085940700 1 -- 172.21.15.81:0/320141621 >> 172.21.15.81:0/320141621 conn(0x7f608006bb90 msgr2=0x7f608006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f6085940700 1 -- 172.21.15.81:0/320141621 shutdown_connections 2023-10-06T02:53:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.608+0000 7f6085940700 1 -- 172.21.15.81:0/320141621 wait complete. 2023-10-06T02:53:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.609+0000 7f6085940700 1 Processor -- start 2023-10-06T02:53:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f6085940700 1 -- start start 2023-10-06T02:53:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f6085940700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f608006d120 0x7f60801538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f6085940700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60801578d0 0x7f60800c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f6085940700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6080157ca0 0x7f6080155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f6085940700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60800b4b70 con 0x7f608006d120 2023-10-06T02:53:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f6085940700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60800b5410 con 0x7f6080157ca0 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f6085940700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6080153e10 con 0x7f60801578d0 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f607effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f608006d120 0x7f60801538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f607effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f608006d120 0x7f60801538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36832/0 (socket says 172.21.15.81:36832) 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f607effd700 1 -- 172.21.15.81:0/1993165248 learned_addr learned my addr 172.21.15.81:0/1993165248 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f607f7fe700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6080157ca0 0x7f6080155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.610+0000 7f607e7fc700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60801578d0 0x7f60800c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f607effd700 1 -- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60801578d0 msgr2=0x7f60800c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f607effd700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60801578d0 0x7f60800c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f607effd700 1 -- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6080157ca0 msgr2=0x7f6080155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f607effd700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6080157ca0 0x7f6080155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f607effd700 1 -- 172.21.15.81:0/1993165248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6078009ae0 con 0x7f608006d120 2023-10-06T02:53:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f607effd700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f608006d120 0x7f60801538d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f608006fe20 tx=0x7f6078018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f6076ffd700 1 -- 172.21.15.81:0/1993165248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780088b0 con 0x7f608006d120 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f6076ffd700 1 -- 172.21.15.81:0/1993165248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6078008a30 con 0x7f608006d120 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60800c7fd0 con 0x7f608006d120 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f6076ffd700 1 -- 172.21.15.81:0/1993165248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6078008df0 con 0x7f608006d120 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.611+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60800b50a0 con 0x7f608006d120 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.612+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6080067ac0 con 0x7f608006d120 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.612+0000 7f6076ffd700 1 -- 172.21.15.81:0/1993165248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6078003040 con 0x7f608006d120 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.613+0000 7f6076ffd700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6060066fb0 0x7f6060069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.613+0000 7f6076ffd700 1 -- 172.21.15.81:0/1993165248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f60780865a0 con 0x7f608006d120 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.613+0000 7f607e7fc700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6060066fb0 0x7f6060069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.613+0000 7f607e7fc700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6060066fb0 0x7f6060069460 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f60800c7000 tx=0x7f6068008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:01.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.617+0000 7f6076ffd700 1 -- 172.21.15.81:0/1993165248 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60780536c0 con 0x7f608006d120 2023-10-06T02:53:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.798+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60800d0170 con 0x7f608006d120 2023-10-06T02:53:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.799+0000 7f6076ffd700 1 -- 172.21.15.81:0/1993165248 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v138) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6078056ce0 con 0x7f608006d120 2023-10-06T02:53:01.800 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:53:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6060066fb0 msgr2=0x7f6060069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6060066fb0 0x7f6060069460 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f60800c7000 tx=0x7f6068008040 comp rx=0 tx=0).stop 2023-10-06T02:53:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f608006d120 msgr2=0x7f60801538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f608006d120 0x7f60801538d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f608006fe20 tx=0x7f6078018000 comp rx=0 tx=0).stop 2023-10-06T02:53:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 shutdown_connections 2023-10-06T02:53:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6060066fb0 0x7f6060069460 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6080157ca0 0x7f6080155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f608006d120 0x7f60801538d0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 --2- 172.21.15.81:0/1993165248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60801578d0 0x7f60800c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.800+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 >> 172.21.15.81:0/1993165248 conn(0x7f608006bb90 msgr2=0x7f6080068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.801+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 shutdown_connections 2023-10-06T02:53:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.801+0000 7f6085940700 1 -- 172.21.15.81:0/1993165248 wait complete. 2023-10-06T02:53:01.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:53:01.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.929+0000 7feab235b700 1 Processor -- start 2023-10-06T02:53:01.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.929+0000 7feab235b700 1 -- start start 2023-10-06T02:53:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.930+0000 7feab235b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feaac1578d0 0x7feaac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.930+0000 7feab235b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7feaac157ca0 0x7feaac15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.930+0000 7feab235b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0d07c0 con 0x7feaac06d120 2023-10-06T02:53:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.930+0000 7feab235b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac0cfbb0 con 0x7feaac1578d0 2023-10-06T02:53:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.930+0000 7feab235b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac0cfe90 con 0x7feaac157ca0 2023-10-06T02:53:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.930+0000 7feaabfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feaac1578d0 0x7feaac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.930+0000 7feaabfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feaac1578d0 0x7feaac0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36834/0 (socket says 172.21.15.81:36834) 2023-10-06T02:53:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.930+0000 7feab08f8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feaac06d120 0x7feaac06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48156/0 (socket says 172.21.15.81:48156) 2023-10-06T02:53:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.930+0000 7feaabfff700 1 -- 172.21.15.81:0/2926172042 learned_addr learned my addr 172.21.15.81:0/2926172042 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feaab7fe700 1 --2- 172.21.15.81:0/2926172042 >> v2:172.21.15.83:3300/0 conn(0x7feaac157ca0 0x7feaac15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feaabfff700 1 -- 172.21.15.81:0/2926172042 >> v2:172.21.15.83:3300/0 conn(0x7feaac157ca0 msgr2=0x7feaac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feaabfff700 1 --2- 172.21.15.81:0/2926172042 >> v2:172.21.15.83:3300/0 conn(0x7feaac157ca0 0x7feaac15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feaabfff700 1 -- 172.21.15.81:0/2926172042 >> v1:172.21.15.81:6789/0 conn(0x7feaac06d120 legacy=0x7feaac06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feaabfff700 1 -- 172.21.15.81:0/2926172042 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0d0170 con 0x7feaac1578d0 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feaabfff700 1 --2- 172.21.15.81:0/2926172042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac1578d0 0x7feaac0cf4f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7feaac068510 tx=0x7fea9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609e2d245ed423c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feaaaffd700 1 -- 172.21.15.81:0/2926172042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00b860 con 0x7feaac1578d0 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feaaaffd700 1 -- 172.21.15.81:0/2926172042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00b9c0 con 0x7feaac1578d0 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feaaaffd700 1 -- 172.21.15.81:0/2926172042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00bd60 con 0x7feaac1578d0 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feab235b700 1 -- 172.21.15.81:0/2926172042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac1578d0 msgr2=0x7feaac0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feab235b700 1 --2- 172.21.15.81:0/2926172042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac1578d0 0x7feaac0cf4f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7feaac068510 tx=0x7fea9c009250 comp rx=0 tx=0).stop 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feab235b700 1 -- 172.21.15.81:0/2926172042 shutdown_connections 2023-10-06T02:53:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feab235b700 1 --2- 172.21.15.81:0/2926172042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac1578d0 0x7feaac0cf4f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feab235b700 1 --2- 172.21.15.81:0/2926172042 >> v2:172.21.15.83:3300/0 conn(0x7feaac157ca0 0x7feaac15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feab235b700 1 -- 172.21.15.81:0/2926172042 >> 172.21.15.81:0/2926172042 conn(0x7feaac06bb90 msgr2=0x7feaac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.931+0000 7feab235b700 1 -- 172.21.15.81:0/2926172042 shutdown_connections 2023-10-06T02:53:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.932+0000 7feab235b700 1 -- 172.21.15.81:0/2926172042 wait complete. 2023-10-06T02:53:01.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.933+0000 7feab235b700 1 Processor -- start 2023-10-06T02:53:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.933+0000 7feab235b700 1 -- start start 2023-10-06T02:53:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.933+0000 7feab235b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d120 0x7feaac0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.933+0000 7feab235b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac1578d0 0x7feaac147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.933+0000 7feab235b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac157ca0 0x7feaac0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.933+0000 7feab235b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0ccfd0 con 0x7feaac06d120 2023-10-06T02:53:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.933+0000 7feab235b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0cc3c0 con 0x7feaac1578d0 2023-10-06T02:53:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.933+0000 7feab235b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0cc6a0 con 0x7feaac157ca0 2023-10-06T02:53:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d120 0x7feaac0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d120 0x7feaac0cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36846/0 (socket says 172.21.15.81:36846) 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaabfff700 1 -- 172.21.15.81:0/37704327 learned_addr learned my addr 172.21.15.81:0/37704327 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feab08f8700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac157ca0 0x7feaac0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaab7fe700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac1578d0 0x7feaac147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaabfff700 1 -- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac157ca0 msgr2=0x7feaac0cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaabfff700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac157ca0 0x7feaac0cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaabfff700 1 -- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac1578d0 msgr2=0x7feaac147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaabfff700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac1578d0 0x7feaac147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaabfff700 1 -- 172.21.15.81:0/37704327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0094f0 con 0x7feaac06d120 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feaabfff700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d120 0x7feaac0cd460 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7feaac06fe20 tx=0x7fea9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7fea93fff700 1 -- 172.21.15.81:0/37704327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c024440 con 0x7feaac06d120 2023-10-06T02:53:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7fea93fff700 1 -- 172.21.15.81:0/37704327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c0245a0 con 0x7feaac06d120 2023-10-06T02:53:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0cc980 con 0x7feaac06d120 2023-10-06T02:53:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7fea93fff700 1 -- 172.21.15.81:0/37704327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c024960 con 0x7feaac06d120 2023-10-06T02:53:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.934+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac147f70 con 0x7feaac06d120 2023-10-06T02:53:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.935+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac0cd2b0 con 0x7feaac06d120 2023-10-06T02:53:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.936+0000 7fea93fff700 1 -- 172.21.15.81:0/37704327 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea9c01a420 con 0x7feaac06d120 2023-10-06T02:53:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.936+0000 7fea93fff700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea98066f30 0x7fea980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.936+0000 7fea93fff700 1 -- 172.21.15.81:0/37704327 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea9c086490 con 0x7feaac06d120 2023-10-06T02:53:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.936+0000 7feaab7fe700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea98066f30 0x7fea980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.936+0000 7feaab7fe700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea98066f30 0x7fea980693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feaac16d6d0 tx=0x7feaa0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:01.940+0000 7fea93fff700 1 -- 172.21.15.81:0/37704327 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea9c0535a0 con 0x7feaac06d120 2023-10-06T02:53:02.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.122+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feaac0d0450 con 0x7feaac06d120 2023-10-06T02:53:02.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.122+0000 7fea93fff700 1 -- 172.21.15.81:0/37704327 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v138) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea9c056bc0 con 0x7feaac06d120 2023-10-06T02:53:02.124 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:53:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea98066f30 msgr2=0x7fea980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea98066f30 0x7fea980693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feaac16d6d0 tx=0x7feaa0008040 comp rx=0 tx=0).stop 2023-10-06T02:53:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d120 msgr2=0x7feaac0cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d120 0x7feaac0cd460 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7feaac06fe20 tx=0x7fea9c017000 comp rx=0 tx=0).stop 2023-10-06T02:53:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 shutdown_connections 2023-10-06T02:53:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac157ca0 0x7feaac0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d120 0x7feaac0cd460 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea98066f30 0x7fea980693e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 --2- 172.21.15.81:0/37704327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac1578d0 0x7feaac147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 >> 172.21.15.81:0/37704327 conn(0x7feaac06bb90 msgr2=0x7feaac06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:02.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 shutdown_connections 2023-10-06T02:53:02.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.124+0000 7feab235b700 1 -- 172.21.15.81:0/37704327 wait complete. 2023-10-06T02:53:02.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:53:02.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.253+0000 7f9d7b59e700 1 Processor -- start 2023-10-06T02:53:02.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.253+0000 7f9d7b59e700 1 -- start start 2023-10-06T02:53:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d7b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9d7c0d0f50 0x7f9d7c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d7b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c06d530 0x7f9d7c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d7b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c06d990 con 0x7f9d7c0d0b80 2023-10-06T02:53:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d7b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c15a690 con 0x7f9d7c0d0f50 2023-10-06T02:53:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d7b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0cf2d0 con 0x7f9d7c06d530 2023-10-06T02:53:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d71d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9d7c0d0f50 0x7f9d7c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d7a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9d7c0d0b80 0x7f9d7c0cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48160/0 (socket says 172.21.15.81:48160) 2023-10-06T02:53:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d7a59c700 1 -- 172.21.15.81:0/403116226 learned_addr learned my addr 172.21.15.81:0/403116226 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d71d9b700 1 -- 172.21.15.81:0/403116226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c06d530 msgr2=0x7f9d7c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d7ad9d700 1 --2- 172.21.15.81:0/403116226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c06d530 0x7f9d7c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d79d9b700 1 -- 172.21.15.81:0/403116226 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370670082 0 0) 0x7f9d7c06d990 con 0x7f9d7c0d0b80 2023-10-06T02:53:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d71d9b700 1 --2- 172.21.15.81:0/403116226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c06d530 0x7f9d7c15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d71d9b700 1 -- 172.21.15.81:0/403116226 >> v1:172.21.15.81:6789/0 conn(0x7f9d7c0d0b80 legacy=0x7f9d7c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d71d9b700 1 -- 172.21.15.81:0/403116226 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0d0480 con 0x7f9d7c0d0f50 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.254+0000 7f9d7ad9d700 1 --2- 172.21.15.81:0/403116226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c06d530 0x7f9d7c15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d71d9b700 1 --2- 172.21.15.81:0/403116226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c0d0f50 0x7f9d7c06cff0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f9d640098e0 tx=0x7f9d640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dab464b9894659 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d79d9b700 1 -- 172.21.15.81:0/403116226 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64009e80 con 0x7f9d7c0d0f50 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d79d9b700 1 -- 172.21.15.81:0/403116226 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6400b860 con 0x7f9d7c0d0f50 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d79d9b700 1 -- 172.21.15.81:0/403116226 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400bbe0 con 0x7f9d7c0d0f50 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d7b59e700 1 -- 172.21.15.81:0/403116226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c0d0f50 msgr2=0x7f9d7c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d7b59e700 1 --2- 172.21.15.81:0/403116226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c0d0f50 0x7f9d7c06cff0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f9d640098e0 tx=0x7f9d640091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d7b59e700 1 -- 172.21.15.81:0/403116226 shutdown_connections 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d7b59e700 1 --2- 172.21.15.81:0/403116226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c06d530 0x7f9d7c15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d7b59e700 1 --2- 172.21.15.81:0/403116226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c0d0f50 0x7f9d7c06cff0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d7b59e700 1 -- 172.21.15.81:0/403116226 >> 172.21.15.81:0/403116226 conn(0x7f9d7c063230 msgr2=0x7f9d7c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d7b59e700 1 -- 172.21.15.81:0/403116226 shutdown_connections 2023-10-06T02:53:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.255+0000 7f9d7b59e700 1 -- 172.21.15.81:0/403116226 wait complete. 2023-10-06T02:53:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7b59e700 1 Processor -- start 2023-10-06T02:53:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7b59e700 1 -- start start 2023-10-06T02:53:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c06d530 0x7f9d7c16cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c0d0b80 0x7f9d7c16d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d7c0d0f50 0x7f9d7c16db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0c8af0 con 0x7f9d7c06d530 2023-10-06T02:53:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0c8dd0 con 0x7f9d7c0d0f50 2023-10-06T02:53:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0c90b0 con 0x7f9d7c0d0b80 2023-10-06T02:53:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c06d530 0x7f9d7c16cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c06d530 0x7f9d7c16cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36870/0 (socket says 172.21.15.81:36870) 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d71d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c0d0b80 0x7f9d7c16d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.257+0000 7f9d7a59c700 1 -- 172.21.15.81:0/2208317430 learned_addr learned my addr 172.21.15.81:0/2208317430 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d7ad9d700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d7c0d0f50 0x7f9d7c16db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d7a59c700 1 -- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c0d0b80 msgr2=0x7f9d7c16d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d7a59c700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c0d0b80 0x7f9d7c16d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d7a59c700 1 -- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d7c0d0f50 msgr2=0x7f9d7c16db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d7a59c700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d7c0d0f50 0x7f9d7c16db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d7a59c700 1 -- 172.21.15.81:0/2208317430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d64009420 con 0x7f9d7c06d530 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d7a59c700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c06d530 0x7f9d7c16cf10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c7e0 tx=0x7f9d6c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d72ffd700 1 -- 172.21.15.81:0/2208317430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c005b30 con 0x7f9d7c06d530 2023-10-06T02:53:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d72ffd700 1 -- 172.21.15.81:0/2208317430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c005c90 con 0x7f9d7c06d530 2023-10-06T02:53:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c0c9390 con 0x7f9d7c06d530 2023-10-06T02:53:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d72ffd700 1 -- 172.21.15.81:0/2208317430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c007300 con 0x7f9d7c06d530 2023-10-06T02:53:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.258+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c0c7f80 con 0x7f9d7c06d530 2023-10-06T02:53:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.259+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c0676e0 con 0x7f9d7c06d530 2023-10-06T02:53:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.260+0000 7f9d72ffd700 1 -- 172.21.15.81:0/2208317430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d6c01b3b0 con 0x7f9d7c06d530 2023-10-06T02:53:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.260+0000 7f9d72ffd700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d5c066f30 0x7f9d5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.260+0000 7f9d72ffd700 1 -- 172.21.15.81:0/2208317430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9d6c083bb0 con 0x7f9d7c06d530 2023-10-06T02:53:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.260+0000 7f9d71d9b700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d5c066f30 0x7f9d5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.261+0000 7f9d71d9b700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d5c066f30 0x7f9d5c0693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9d640091e0 tx=0x7f9d64017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:02.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.264+0000 7f9d72ffd700 1 -- 172.21.15.81:0/2208317430 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d6c050cc0 con 0x7f9d7c06d530 2023-10-06T02:53:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.446+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d7c06dc00 con 0x7f9d7c06d530 2023-10-06T02:53:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.447+0000 7f9d72ffd700 1 -- 172.21.15.81:0/2208317430 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v138) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d6c0170a0 con 0x7f9d7c06d530 2023-10-06T02:53:02.448 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:53:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d5c066f30 msgr2=0x7f9d5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d5c066f30 0x7f9d5c0693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9d640091e0 tx=0x7f9d64017000 comp rx=0 tx=0).stop 2023-10-06T02:53:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c06d530 msgr2=0x7f9d7c16cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c06d530 0x7f9d7c16cf10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c7e0 tx=0x7f9d6c007df0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 shutdown_connections 2023-10-06T02:53:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9d5c066f30 0x7f9d5c0693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d7c0d0f50 0x7f9d7c16db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d7c06d530 0x7f9d7c16cf10 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 --2- 172.21.15.81:0/2208317430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d7c0d0b80 0x7f9d7c16d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 >> 172.21.15.81:0/2208317430 conn(0x7f9d7c063230 msgr2=0x7f9d7c0b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 shutdown_connections 2023-10-06T02:53:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.449+0000 7f9d7b59e700 1 -- 172.21.15.81:0/2208317430 wait complete. 2023-10-06T02:53:02.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:53:02.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.578+0000 7f2ec3fff700 1 Processor -- start 2023-10-06T02:53:02.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.578+0000 7f2ec3fff700 1 -- start start 2023-10-06T02:53:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec3fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2ec406d700 0x7f2ec415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec3fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec40cf2d0 con 0x7f2ec40d0f50 2023-10-06T02:53:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec3fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec40d0480 con 0x7f2ec40d0b80 2023-10-06T02:53:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec3fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec415a690 con 0x7f2ec406d700 2023-10-06T02:53:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2ec40d0f50 0x7f2ec406cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48174/0 (socket says 172.21.15.81:48174) 2023-10-06T02:53:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec27fc700 1 -- 172.21.15.81:0/2520660004 learned_addr learned my addr 172.21.15.81:0/2520660004 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec37fe700 1 --2- 172.21.15.81:0/2520660004 >> v2:172.21.15.83:3300/0 conn(0x7f2ec406d700 0x7f2ec415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec1ffb700 1 -- 172.21.15.81:0/2520660004 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292122012 0 0) 0x7f2ec40cf2d0 con 0x7f2ec40d0f50 2023-10-06T02:53:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec1ffb700 1 -- 172.21.15.81:0/2520660004 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eac003570 con 0x7f2ec40d0f50 2023-10-06T02:53:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec37fe700 1 -- 172.21.15.81:0/2520660004 >> v1:172.21.15.83:6789/0 conn(0x7f2ec40d0b80 legacy=0x7f2ec40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec1ffb700 1 -- 172.21.15.81:0/2520660004 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264094054 0 0) 0x7f2ec40d0480 con 0x7f2ec40d0b80 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec37fe700 1 -- 172.21.15.81:0/2520660004 >> v1:172.21.15.81:6789/0 conn(0x7f2ec40d0f50 legacy=0x7f2ec406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec37fe700 1 -- 172.21.15.81:0/2520660004 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec406dc00 con 0x7f2ec406d700 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.579+0000 7f2ec37fe700 1 --2- 172.21.15.81:0/2520660004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec406d700 0x7f2ec415b320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0098e0 tx=0x7f2ebc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bc1d7e9b78792f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec1ffb700 1 -- 172.21.15.81:0/2520660004 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00b640 con 0x7f2ec406d700 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec1ffb700 1 -- 172.21.15.81:0/2520660004 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc00b7a0 con 0x7f2ec406d700 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec1ffb700 1 -- 172.21.15.81:0/2520660004 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00bb40 con 0x7f2ec406d700 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2520660004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec406d700 msgr2=0x7f2ec415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec3fff700 1 --2- 172.21.15.81:0/2520660004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec406d700 0x7f2ec415b320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0098e0 tx=0x7f2ebc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2520660004 shutdown_connections 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec3fff700 1 --2- 172.21.15.81:0/2520660004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec406d700 0x7f2ec415b320 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2520660004 >> 172.21.15.81:0/2520660004 conn(0x7f2ec4063230 msgr2=0x7f2ec4063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2520660004 shutdown_connections 2023-10-06T02:53:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.580+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2520660004 wait complete. 2023-10-06T02:53:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.581+0000 7f2ec3fff700 1 Processor -- start 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.581+0000 7f2ec3fff700 1 -- start start 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec406d700 0x7f2ec416ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec40d0b80 0x7f2ec41554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec40d0f50 0x7f2ec40c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec40c6f80 con 0x7f2ec40d0f50 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec3fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec40c6370 con 0x7f2ec406d700 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec3fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec40c6650 con 0x7f2ec40d0b80 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec40d0f50 0x7f2ec40c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec40d0f50 0x7f2ec40c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36884/0 (socket says 172.21.15.81:36884) 2023-10-06T02:53:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec37fe700 1 -- 172.21.15.81:0/2528267907 learned_addr learned my addr 172.21.15.81:0/2528267907 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec27fc700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec40d0b80 0x7f2ec41554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec2ffd700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec406d700 0x7f2ec416ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec37fe700 1 -- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec40d0b80 msgr2=0x7f2ec41554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.582+0000 7f2ec37fe700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec40d0b80 0x7f2ec41554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.583+0000 7f2ec37fe700 1 -- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec406d700 msgr2=0x7f2ec416ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.583+0000 7f2ec37fe700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec406d700 0x7f2ec416ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.583+0000 7f2ec37fe700 1 -- 172.21.15.81:0/2528267907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc009420 con 0x7f2ec40d0f50 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.583+0000 7f2ec37fe700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec40d0f50 0x7f2ec40c5b20 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f2ec406fcc0 tx=0x7f2ebc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.583+0000 7f2eaaffd700 1 -- 172.21.15.81:0/2528267907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc01f070 con 0x7f2ec40d0f50 2023-10-06T02:53:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.583+0000 7f2eaaffd700 1 -- 172.21.15.81:0/2528267907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc002f70 con 0x7f2ec40d0f50 2023-10-06T02:53:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.583+0000 7f2eaaffd700 1 -- 172.21.15.81:0/2528267907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00bb40 con 0x7f2ec40d0f50 2023-10-06T02:53:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.583+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec40c6930 con 0x7f2ec40d0f50 2023-10-06T02:53:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.583+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec40c6060 con 0x7f2ec40d0f50 2023-10-06T02:53:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.584+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec40c70c0 con 0x7f2ec40d0f50 2023-10-06T02:53:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.584+0000 7f2eaaffd700 1 -- 172.21.15.81:0/2528267907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ebc023070 con 0x7f2ec40d0f50 2023-10-06T02:53:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.584+0000 7f2eaaffd700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2eb0066f30 0x7f2eb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.585+0000 7f2eaaffd700 1 -- 172.21.15.81:0/2528267907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ebc085b50 con 0x7f2ec40d0f50 2023-10-06T02:53:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.585+0000 7f2ec2ffd700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2eb0066f30 0x7f2eb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.585+0000 7f2ec2ffd700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2eb0066f30 0x7f2eb00693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40c9e30 tx=0x7f2eb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.589+0000 7f2eaaffd700 1 -- 172.21.15.81:0/2528267907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ec40c70c0 con 0x7f2ec40d0f50 2023-10-06T02:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.774+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ec40c70c0 con 0x7f2ec40d0f50 2023-10-06T02:53:02.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.774+0000 7f2eaaffd700 1 -- 172.21.15.81:0/2528267907 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v138) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ec40c70c0 con 0x7f2ec40d0f50 2023-10-06T02:53:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:53:02.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2eb0066f30 msgr2=0x7f2eb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2eb0066f30 0x7f2eb00693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40c9e30 tx=0x7f2eb4009040 comp rx=0 tx=0).stop 2023-10-06T02:53:02.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec40d0f50 msgr2=0x7f2ec40c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec40d0f50 0x7f2ec40c5b20 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f2ec406fcc0 tx=0x7f2ebc017000 comp rx=0 tx=0).stop 2023-10-06T02:53:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 shutdown_connections 2023-10-06T02:53:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec40d0f50 0x7f2ec40c5b20 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2eb0066f30 0x7f2eb00693e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec406d700 0x7f2ec416ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 --2- 172.21.15.81:0/2528267907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec40d0b80 0x7f2ec41554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 >> 172.21.15.81:0/2528267907 conn(0x7f2ec4063230 msgr2=0x7f2ec415b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 shutdown_connections 2023-10-06T02:53:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.777+0000 7f2ec3fff700 1 -- 172.21.15.81:0/2528267907 wait complete. 2023-10-06T02:53:02.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:53:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.902+0000 7f777cca0700 1 Processor -- start 2023-10-06T02:53:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.902+0000 7f777cca0700 1 -- start start 2023-10-06T02:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f777cca0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7778159f10 0x7f7778068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f777cca0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7778068cc0 0x7f77780cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f777cca0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7778069120 con 0x7f7778159b40 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f777cca0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77780cee10 con 0x7f7778159f10 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f777cca0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77780cd040 con 0x7f7778068cc0 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f7776ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7778159f10 0x7f7778068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f77777fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7778159b40 0x7f77780cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48184/0 (socket says 172.21.15.81:48184) 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f7776ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7778159f10 0x7f7778068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36898/0 (socket says 172.21.15.81:36898) 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f77777fe700 1 -- 172.21.15.81:0/2595214364 learned_addr learned my addr 172.21.15.81:0/2595214364 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f7777fff700 1 --2- 172.21.15.81:0/2595214364 >> v2:172.21.15.83:3300/0 conn(0x7f7778068cc0 0x7f77780cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f7776ffd700 1 -- 172.21.15.81:0/2595214364 >> v2:172.21.15.83:3300/0 conn(0x7f7778068cc0 msgr2=0x7f77780cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f7776ffd700 1 --2- 172.21.15.81:0/2595214364 >> v2:172.21.15.83:3300/0 conn(0x7f7778068cc0 0x7f77780cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f7776ffd700 1 -- 172.21.15.81:0/2595214364 >> v1:172.21.15.81:6789/0 conn(0x7f7778159b40 legacy=0x7f77780cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f7776ffd700 1 -- 172.21.15.81:0/2595214364 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77780cd320 con 0x7f7778159f10 2023-10-06T02:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.903+0000 7f77767fc700 1 -- 172.21.15.81:0/2595214364 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282177873 0 0) 0x7f7768001490 con 0x7f7778159b40 2023-10-06T02:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f7776ffd700 1 --2- 172.21.15.81:0/2595214364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159f10 0x7f7778068780 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f77780cae10 tx=0x7f776c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dddb989d80a02a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f77767fc700 1 -- 172.21.15.81:0/2595214364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c00b6b0 con 0x7f7778159f10 2023-10-06T02:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f77767fc700 1 -- 172.21.15.81:0/2595214364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c00b810 con 0x7f7778159f10 2023-10-06T02:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f77767fc700 1 -- 172.21.15.81:0/2595214364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c00bbb0 con 0x7f7778159f10 2023-10-06T02:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f777cca0700 1 -- 172.21.15.81:0/2595214364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159f10 msgr2=0x7f7778068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f777cca0700 1 --2- 172.21.15.81:0/2595214364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159f10 0x7f7778068780 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f77780cae10 tx=0x7f776c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f777cca0700 1 -- 172.21.15.81:0/2595214364 shutdown_connections 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f777cca0700 1 --2- 172.21.15.81:0/2595214364 >> v2:172.21.15.83:3300/0 conn(0x7f7778068cc0 0x7f77780cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f777cca0700 1 --2- 172.21.15.81:0/2595214364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159f10 0x7f7778068780 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f777cca0700 1 -- 172.21.15.81:0/2595214364 >> 172.21.15.81:0/2595214364 conn(0x7f77780cd660 msgr2=0x7f77780cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f777cca0700 1 -- 172.21.15.81:0/2595214364 shutdown_connections 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.904+0000 7f777cca0700 1 -- 172.21.15.81:0/2595214364 wait complete. 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f777cca0700 1 Processor -- start 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f777cca0700 1 -- start start 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f777cca0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7778068cc0 0x7f7778167650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f777cca0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159b40 0x7f777815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f777cca0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7778159f10 0x7f777815e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f777cca0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77780cabe0 con 0x7f7778159b40 2023-10-06T02:53:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f777cca0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77780ca060 con 0x7f7778159f10 2023-10-06T02:53:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f777cca0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77780ca340 con 0x7f7778068cc0 2023-10-06T02:53:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f7776ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159b40 0x7f777815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f7776ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159b40 0x7f777815dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36904/0 (socket says 172.21.15.81:36904) 2023-10-06T02:53:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.906+0000 7f7776ffd700 1 -- 172.21.15.81:0/2976758058 learned_addr learned my addr 172.21.15.81:0/2976758058 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f7777fff700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7778159f10 0x7f777815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f77777fe700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7778068cc0 0x7f7778167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f7776ffd700 1 -- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7778068cc0 msgr2=0x7f7778167650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f7776ffd700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7778068cc0 0x7f7778167650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f7776ffd700 1 -- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7778159f10 msgr2=0x7f777815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f7776ffd700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7778159f10 0x7f777815e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f7776ffd700 1 -- 172.21.15.81:0/2976758058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c009420 con 0x7f7778159b40 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f7776ffd700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159b40 0x7f777815dde0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f777806fe10 tx=0x7f776c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f775f7fe700 1 -- 172.21.15.81:0/2976758058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c00bb90 con 0x7f7778159b40 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f775f7fe700 1 -- 172.21.15.81:0/2976758058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c011420 con 0x7f7778159b40 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f775f7fe700 1 -- 172.21.15.81:0/2976758058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0117c0 con 0x7f7778159b40 2023-10-06T02:53:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77780ca620 con 0x7f7778159b40 2023-10-06T02:53:02.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.907+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7778167b90 con 0x7f7778159b40 2023-10-06T02:53:02.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.908+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77780cb890 con 0x7f7778159b40 2023-10-06T02:53:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.908+0000 7f775f7fe700 1 -- 172.21.15.81:0/2976758058 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f776c011bb0 con 0x7f7778159b40 2023-10-06T02:53:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.909+0000 7f775f7fe700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7764066f30 0x7f77640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.909+0000 7f775f7fe700 1 -- 172.21.15.81:0/2976758058 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f776c085e90 con 0x7f7778159b40 2023-10-06T02:53:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.909+0000 7f77777fe700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7764066f30 0x7f77640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.909+0000 7f77777fe700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7764066f30 0x7f77640693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f77680072e0 tx=0x7f7768001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:02.913+0000 7f775f7fe700 1 -- 172.21.15.81:0/2976758058 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f776c052fa0 con 0x7f7778159b40 2023-10-06T02:53:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.135+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77780ce7c0 con 0x7f7778159b40 2023-10-06T02:53:03.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.136+0000 7f775f7fe700 1 -- 172.21.15.81:0/2976758058 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f776c011e60 con 0x7f7778159b40 2023-10-06T02:53:03.137 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:03.137 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:52:25.912348+0000","modified":"2023-10-06T02:52:29.566702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7275":{"gid":7275,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/4039558742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":4039558742},{"type":"v1","addr":"172.21.15.83:6836","nonce":4039558742}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T02:53:03.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7764066f30 msgr2=0x7f77640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7764066f30 0x7f77640693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f77680072e0 tx=0x7f7768001a10 comp rx=0 tx=0).stop 2023-10-06T02:53:03.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159b40 msgr2=0x7f777815dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159b40 0x7f777815dde0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f777806fe10 tx=0x7f776c017000 comp rx=0 tx=0).stop 2023-10-06T02:53:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 shutdown_connections 2023-10-06T02:53:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7764066f30 0x7f77640693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7778159f10 0x7f777815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7778068cc0 0x7f7778167650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 --2- 172.21.15.81:0/2976758058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778159b40 0x7f777815dde0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 >> 172.21.15.81:0/2976758058 conn(0x7f77780cd660 msgr2=0x7f77780b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 shutdown_connections 2023-10-06T02:53:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.138+0000 7f777cca0700 1 -- 172.21.15.81:0/2976758058 wait complete. 2023-10-06T02:53:03.141 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 67 2023-10-06T02:53:03.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:53:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.264+0000 7f9941648700 1 Processor -- start 2023-10-06T02:53:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.264+0000 7f9941648700 1 -- start start 2023-10-06T02:53:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f9941648700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c0cf240 0x7f993c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f9941648700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c0b0ca0 con 0x7f993c15a2a0 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f9941648700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c0b00d0 con 0x7f993c06d650 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f9941648700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c06ea90 con 0x7f993c0cf240 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f993affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f993c15a2a0 0x7f993c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48194/0 (socket says 172.21.15.81:48194) 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f993affd700 1 -- 172.21.15.81:0/1638038095 learned_addr learned my addr 172.21.15.81:0/1638038095 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f993a7fc700 1 --2- 172.21.15.81:0/1638038095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c0cf240 0x7f993c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f9939ffb700 1 -- 172.21.15.81:0/1638038095 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407159733 0 0) 0x7f993c0b0ca0 con 0x7f993c15a2a0 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f9939ffb700 1 -- 172.21.15.81:0/1638038095 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9928003570 con 0x7f993c15a2a0 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f9939ffb700 1 -- 172.21.15.81:0/1638038095 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524478858 0 0) 0x7f993c0b00d0 con 0x7f993c06d650 2023-10-06T02:53:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f9939ffb700 1 -- 172.21.15.81:0/1638038095 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f993c0b0ca0 con 0x7f993c06d650 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f9939ffb700 1 -- 172.21.15.81:0/1638038095 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785365394 0 0) 0x7f9928003570 con 0x7f993c15a2a0 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f993a7fc700 1 -- 172.21.15.81:0/1638038095 >> v1:172.21.15.83:6789/0 conn(0x7f993c06d650 legacy=0x7f993c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f993a7fc700 1 -- 172.21.15.81:0/1638038095 >> v1:172.21.15.81:6789/0 conn(0x7f993c15a2a0 legacy=0x7f993c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.265+0000 7f993a7fc700 1 -- 172.21.15.81:0/1638038095 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c0b0370 con 0x7f993c0cf240 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f993a7fc700 1 --2- 172.21.15.81:0/1638038095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c0cf240 0x7f993c0b1130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9924009910 tx=0x7f99240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=329fad4ed7d83d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9939ffb700 1 -- 172.21.15.81:0/1638038095 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340017f0 con 0x7f993c0cf240 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9939ffb700 1 -- 172.21.15.81:0/1638038095 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9924011420 con 0x7f993c0cf240 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9939ffb700 1 -- 172.21.15.81:0/1638038095 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99240117c0 con 0x7f993c0cf240 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9941648700 1 -- 172.21.15.81:0/1638038095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c0cf240 msgr2=0x7f993c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9941648700 1 --2- 172.21.15.81:0/1638038095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c0cf240 0x7f993c0b1130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9924009910 tx=0x7f99240091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9941648700 1 -- 172.21.15.81:0/1638038095 shutdown_connections 2023-10-06T02:53:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9941648700 1 --2- 172.21.15.81:0/1638038095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c0cf240 0x7f993c0b1130 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9941648700 1 -- 172.21.15.81:0/1638038095 >> 172.21.15.81:0/1638038095 conn(0x7f993c067640 msgr2=0x7f993c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9941648700 1 -- 172.21.15.81:0/1638038095 shutdown_connections 2023-10-06T02:53:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.266+0000 7f9941648700 1 -- 172.21.15.81:0/1638038095 wait complete. 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f9941648700 1 Processor -- start 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f9941648700 1 -- start start 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f9941648700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f993c06d650 0x7f993c153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f9941648700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f993c0cf240 0x7f993c0b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f9941648700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c15a2a0 0x7f993c14f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f9941648700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c154650 con 0x7f993c0cf240 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f9941648700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c154930 con 0x7f993c06d650 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f9941648700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c154c10 con 0x7f993c15a2a0 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f993a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f993c0cf240 0x7f993c0b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f993a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f993c0cf240 0x7f993c0b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36906/0 (socket says 172.21.15.81:36906) 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f993a7fc700 1 -- 172.21.15.81:0/2638301576 learned_addr learned my addr 172.21.15.81:0/2638301576 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f993affd700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f993c06d650 0x7f993c153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.268+0000 7f993b7fe700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c15a2a0 0x7f993c14f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f993a7fc700 1 -- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c15a2a0 msgr2=0x7f993c14f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f993a7fc700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c15a2a0 0x7f993c14f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f993a7fc700 1 -- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f993c06d650 msgr2=0x7f993c153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f993a7fc700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f993c06d650 0x7f993c153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f993a7fc700 1 -- 172.21.15.81:0/2638301576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924009420 con 0x7f993c0cf240 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f993a7fc700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f993c0cf240 0x7f993c0b2660 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f993c06f990 tx=0x7f9924016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f9932ffd700 1 -- 172.21.15.81:0/2638301576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992401caf0 con 0x7f993c0cf240 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f9932ffd700 1 -- 172.21.15.81:0/2638301576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992401cc50 con 0x7f993c0cf240 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c154ef0 con 0x7f993c0cf240 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f9932ffd700 1 -- 172.21.15.81:0/2638301576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992401a450 con 0x7f993c0cf240 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.269+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c154290 con 0x7f993c0cf240 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.270+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c069e40 con 0x7f993c0cf240 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.270+0000 7f9932ffd700 1 -- 172.21.15.81:0/2638301576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f992401a860 con 0x7f993c0cf240 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.271+0000 7f9932ffd700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.271+0000 7f9932ffd700 1 -- 172.21.15.81:0/2638301576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9924085fd0 con 0x7f993c0cf240 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.271+0000 7f993affd700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.271+0000 7f993affd700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f991c066f30 0x7f991c0693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9934007fd0 tx=0x7f9934000f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.275+0000 7f9932ffd700 1 -- 172.21.15.81:0/2638301576 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9924053040 con 0x7f993c0cf240 2023-10-06T02:53:03.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.457+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f993c04bb80 con 0x7f993c0cf240 2023-10-06T02:53:03.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.457+0000 7f9932ffd700 1 -- 172.21.15.81:0/2638301576 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16841 (secure 0 0 0) 0x7f9924056660 con 0x7f993c0cf240 2023-10-06T02:53:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:03.459 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":138,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:52:54.418546+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:52:23.555508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T02:52:24.879976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:53:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f991c066f30 msgr2=0x7f991c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f991c066f30 0x7f991c0693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9934007fd0 tx=0x7f9934000f40 comp rx=0 tx=0).stop 2023-10-06T02:53:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f993c0cf240 msgr2=0x7f993c0b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f993c0cf240 0x7f993c0b2660 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f993c06f990 tx=0x7f9924016000 comp rx=0 tx=0).stop 2023-10-06T02:53:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 shutdown_connections 2023-10-06T02:53:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f993c15a2a0 0x7f993c14f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f993c06d650 0x7f993c153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 --2- 172.21.15.81:0/2638301576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f993c0cf240 0x7f993c0b2660 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 >> 172.21.15.81:0/2638301576 conn(0x7f993c067640 msgr2=0x7f993c158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:03.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 shutdown_connections 2023-10-06T02:53:03.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.459+0000 7f9941648700 1 -- 172.21.15.81:0/2638301576 wait complete. 2023-10-06T02:53:03.473 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:53:03.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:53:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.586+0000 7f6835613700 1 Processor -- start 2023-10-06T02:53:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.586+0000 7f6835613700 1 -- start start 2023-10-06T02:53:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f6835613700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68301578d0 0x7f68300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f6835613700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6830157ca0 0x7f683015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f6835613700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68300d07c0 con 0x7f683006d120 2023-10-06T02:53:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f6835613700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68300cfbb0 con 0x7f6830157ca0 2023-10-06T02:53:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f6835613700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68300cfe90 con 0x7f68301578d0 2023-10-06T02:53:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682e7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6830157ca0 0x7f683015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682effd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68301578d0 0x7f68300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682f7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f683006d120 0x7f683015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:36076/0 (socket says 172.21.15.81:36076) 2023-10-06T02:53:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682effd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68301578d0 0x7f68300cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:42352/0 (socket says 172.21.15.81:42352) 2023-10-06T02:53:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682f7fe700 1 -- 172.21.15.81:0/3239088494 learned_addr learned my addr 172.21.15.81:0/3239088494 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682e7fc700 1 -- 172.21.15.81:0/3239088494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68301578d0 msgr2=0x7f68300cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682e7fc700 1 --2- 172.21.15.81:0/3239088494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68301578d0 0x7f68300cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682e7fc700 1 -- 172.21.15.81:0/3239088494 >> v1:172.21.15.83:6789/0 conn(0x7f683006d120 legacy=0x7f683015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682dffb700 1 -- 172.21.15.81:0/3239088494 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629518463 0 0) 0x7f68300d07c0 con 0x7f683006d120 2023-10-06T02:53:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682e7fc700 1 -- 172.21.15.81:0/3239088494 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68300d0170 con 0x7f6830157ca0 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.587+0000 7f682e7fc700 1 --2- 172.21.15.81:0/3239088494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6830157ca0 0x7f683015af00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f68240098e0 tx=0x7f68240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69b92b8a50cfe894 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f682dffb700 1 -- 172.21.15.81:0/3239088494 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682400b640 con 0x7f6830157ca0 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f682dffb700 1 -- 172.21.15.81:0/3239088494 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682400b7a0 con 0x7f6830157ca0 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f682dffb700 1 -- 172.21.15.81:0/3239088494 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682400bb40 con 0x7f6830157ca0 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f6835613700 1 -- 172.21.15.81:0/3239088494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6830157ca0 msgr2=0x7f683015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f6835613700 1 --2- 172.21.15.81:0/3239088494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6830157ca0 0x7f683015af00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f68240098e0 tx=0x7f68240091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f6835613700 1 -- 172.21.15.81:0/3239088494 shutdown_connections 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f6835613700 1 --2- 172.21.15.81:0/3239088494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68301578d0 0x7f68300cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f6835613700 1 --2- 172.21.15.81:0/3239088494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6830157ca0 0x7f683015af00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f6835613700 1 -- 172.21.15.81:0/3239088494 >> 172.21.15.81:0/3239088494 conn(0x7f683006bb90 msgr2=0x7f683006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f6835613700 1 -- 172.21.15.81:0/3239088494 shutdown_connections 2023-10-06T02:53:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.588+0000 7f6835613700 1 -- 172.21.15.81:0/3239088494 wait complete. 2023-10-06T02:53:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f6835613700 1 Processor -- start 2023-10-06T02:53:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f6835613700 1 -- start start 2023-10-06T02:53:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f6835613700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f683006d120 0x7f68301556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f6835613700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68301578d0 0x7f68300ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f6835613700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6830157ca0 0x7f68300b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f6835613700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6830155c10 con 0x7f68301578d0 2023-10-06T02:53:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f6835613700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68300aaf10 con 0x7f6830157ca0 2023-10-06T02:53:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f6835613700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68300aa930 con 0x7f683006d120 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f682e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68301578d0 0x7f68300ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f682effd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f683006d120 0x7f68301556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f682e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68301578d0 0x7f68300ab3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36918/0 (socket says 172.21.15.81:36918) 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f682e7fc700 1 -- 172.21.15.81:0/3850470646 learned_addr learned my addr 172.21.15.81:0/3850470646 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.590+0000 7f682f7fe700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6830157ca0 0x7f68300b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f682e7fc700 1 -- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f683006d120 msgr2=0x7f68301556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f682e7fc700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f683006d120 0x7f68301556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f682e7fc700 1 -- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6830157ca0 msgr2=0x7f68300b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f682e7fc700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6830157ca0 0x7f68300b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f682e7fc700 1 -- 172.21.15.81:0/3850470646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824009420 con 0x7f68301578d0 2023-10-06T02:53:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f682e7fc700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68301578d0 0x7f68300ab3a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f682400b6c0 tx=0x7f6824017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f6816ffd700 1 -- 172.21.15.81:0/3850470646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682400bb20 con 0x7f68301578d0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f6816ffd700 1 -- 172.21.15.81:0/3850470646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6824000c90 con 0x7f68301578d0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68300acaf0 con 0x7f68301578d0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f6816ffd700 1 -- 172.21.15.81:0/3850470646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824011650 con 0x7f68301578d0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.591+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68300acdd0 con 0x7f68301578d0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.592+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683006c960 con 0x7f68301578d0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.592+0000 7f6816ffd700 1 -- 172.21.15.81:0/3850470646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6824011a40 con 0x7f68301578d0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.593+0000 7f6816ffd700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f681c066f30 0x7f681c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.593+0000 7f6816ffd700 1 -- 172.21.15.81:0/3850470646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6824085f90 con 0x7f68301578d0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.593+0000 7f682effd700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f681c066f30 0x7f681c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.594+0000 7f682effd700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f681c066f30 0x7f681c0693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6820009db0 tx=0x7f68200091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:03.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.597+0000 7f6816ffd700 1 -- 172.21.15.81:0/3850470646 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68240530a0 con 0x7f68301578d0 2023-10-06T02:53:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.824+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68300d0450 con 0x7f68301578d0 2023-10-06T02:53:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.825+0000 7f6816ffd700 1 -- 172.21.15.81:0/3850470646 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f68240566c0 con 0x7f68301578d0 2023-10-06T02:53:03.826 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:03.826 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:52:25.912348+0000","modified":"2023-10-06T02:52:29.566702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7275":{"gid":7275,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/4039558742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":4039558742},{"type":"v1","addr":"172.21.15.83:6836","nonce":4039558742}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T02:53:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f681c066f30 msgr2=0x7f681c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f681c066f30 0x7f681c0693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6820009db0 tx=0x7f68200091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68301578d0 msgr2=0x7f68300ab3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68301578d0 0x7f68300ab3a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f682400b6c0 tx=0x7f6824017000 comp rx=0 tx=0).stop 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 shutdown_connections 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f681c066f30 0x7f681c0693e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6830157ca0 0x7f68300b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f683006d120 0x7f68301556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 --2- 172.21.15.81:0/3850470646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68301578d0 0x7f68300ab3a0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 >> 172.21.15.81:0/3850470646 conn(0x7f683006bb90 msgr2=0x7f683015b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 shutdown_connections 2023-10-06T02:53:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.827+0000 7f6835613700 1 -- 172.21.15.81:0/3850470646 wait complete. 2023-10-06T02:53:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 67 2023-10-06T02:53:03.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:53:03.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.953+0000 7f14bf6cd700 1 Processor -- start 2023-10-06T02:53:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.953+0000 7f14bf6cd700 1 -- start start 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.954+0000 7f14bf6cd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b8157ca0 0x7f14b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.954+0000 7f14bf6cd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b80d07c0 con 0x7f14b81578d0 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.954+0000 7f14bf6cd700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b80cfbb0 con 0x7f14b806d120 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.954+0000 7f14bf6cd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80cfe90 con 0x7f14b8157ca0 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.954+0000 7f14bd469700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f14b81578d0 0x7f14b815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48198/0 (socket says 172.21.15.81:48198) 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.954+0000 7f14bd469700 1 -- 172.21.15.81:0/1879939084 learned_addr learned my addr 172.21.15.81:0/1879939084 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.954+0000 7f14bcc68700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b8157ca0 0x7f14b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.954+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905425752 0 0) 0x7f14b80d07c0 con 0x7f14b81578d0 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a4003570 con 0x7f14b81578d0 2023-10-06T02:53:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665563931 0 0) 0x7f14b80cfbb0 con 0x7f14b806d120 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b80d07c0 con 0x7f14b806d120 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3599494468 0 0) 0x7f14a4003570 con 0x7f14b81578d0 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b8157ca0 msgr2=0x7f14b80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b8157ca0 0x7f14b80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 >> v1:172.21.15.83:6789/0 conn(0x7f14b806d120 legacy=0x7f14b815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b80d0170 con 0x7f14b81578d0 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f14b40017f0 con 0x7f14b81578d0 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 >> v1:172.21.15.81:6789/0 conn(0x7f14b81578d0 legacy=0x7f14b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a4003c20 0x7f14a4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b8157ca0 0x7f14a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a4004d50 0x7f14a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80cfe90 con 0x7f14a4004d50 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a400bb40 con 0x7f14a4003c20 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a400bd00 con 0x7f14b8157ca0 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14bdc6a700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a4004d50 0x7f14a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14bd469700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a4003c20 0x7f14a4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14bcc68700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b8157ca0 0x7f14a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14bdc6a700 1 -- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b8157ca0 msgr2=0x7f14a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14bdc6a700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b8157ca0 0x7f14a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14bdc6a700 1 -- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a4003c20 msgr2=0x7f14a4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14bdc6a700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a4003c20 0x7f14a4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14bdc6a700 1 -- 172.21.15.81:0/1879939084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4003570 con 0x7f14a4004d50 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.955+0000 7f14bdc6a700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a4004d50 0x7f14a40051c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f14b0001a10 tx=0x7f14b0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62d1c7efea2a5e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000c5d0 con 0x7f14a4004d50 2023-10-06T02:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b000c730 con 0x7f14a4004d50 2023-10-06T02:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14affff700 1 -- 172.21.15.81:0/1879939084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000cad0 con 0x7f14a4004d50 2023-10-06T02:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14bf6cd700 1 -- 172.21.15.81:0/1879939084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a4004d50 msgr2=0x7f14a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14bf6cd700 1 --2- 172.21.15.81:0/1879939084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14a4004d50 0x7f14a40051c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f14b0001a10 tx=0x7f14b0007d30 comp rx=0 tx=0).stop 2023-10-06T02:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14bdc6a700 1 -- 172.21.15.81:0/1879939084 reap_dead start 2023-10-06T02:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14bf6cd700 1 -- 172.21.15.81:0/1879939084 shutdown_connections 2023-10-06T02:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14bf6cd700 1 -- 172.21.15.81:0/1879939084 >> 172.21.15.81:0/1879939084 conn(0x7f14b806bb90 msgr2=0x7f14b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14bf6cd700 1 -- 172.21.15.81:0/1879939084 shutdown_connections 2023-10-06T02:53:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.956+0000 7f14bf6cd700 1 -- 172.21.15.81:0/1879939084 wait complete. 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.957+0000 7f14bf6cd700 1 Processor -- start 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.957+0000 7f14bf6cd700 1 -- start start 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bf6cd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a4004d50 0x7f14b816d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bf6cd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b80c9e20 0x7f14b80ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bf6cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b80cbe40 0x7f14b80cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bf6cd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80cd840 con 0x7f14b80cbe40 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bf6cd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80ca7d0 con 0x7f14a4004d50 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bf6cd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80ccc30 con 0x7f14b80c9e20 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bdc6a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b80cbe40 0x7f14b80cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bdc6a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b80cbe40 0x7f14b80cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36940/0 (socket says 172.21.15.81:36940) 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bdc6a700 1 -- 172.21.15.81:0/2770234698 learned_addr learned my addr 172.21.15.81:0/2770234698 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bcc68700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b80c9e20 0x7f14b80ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bd469700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a4004d50 0x7f14b816d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bdc6a700 1 -- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b80c9e20 msgr2=0x7f14b80ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bdc6a700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b80c9e20 0x7f14b80ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bdc6a700 1 -- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a4004d50 msgr2=0x7f14b816d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bdc6a700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a4004d50 0x7f14b816d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.958+0000 7f14bdc6a700 1 -- 172.21.15.81:0/2770234698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b80ccf10 con 0x7f14b80cbe40 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.959+0000 7f14bdc6a700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b80cbe40 0x7f14b80cc2e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f14a4004790 tx=0x7f14b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.959+0000 7f14ad7fa700 1 -- 172.21.15.81:0/2770234698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b0023070 con 0x7f14b80cbe40 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.959+0000 7f14ad7fa700 1 -- 172.21.15.81:0/2770234698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b0001360 con 0x7f14b80cbe40 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.959+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b80cd1f0 con 0x7f14b80cbe40 2023-10-06T02:53:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.959+0000 7f14ad7fa700 1 -- 172.21.15.81:0/2770234698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000c5d0 con 0x7f14b80cbe40 2023-10-06T02:53:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.959+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b816d620 con 0x7f14b80cbe40 2023-10-06T02:53:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.960+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b8067ac0 con 0x7f14b80cbe40 2023-10-06T02:53:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.960+0000 7f14ad7fa700 1 -- 172.21.15.81:0/2770234698 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14b0019070 con 0x7f14b80cbe40 2023-10-06T02:53:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.960+0000 7f14ad7fa700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.961+0000 7f14ad7fa700 1 -- 172.21.15.81:0/2770234698 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f14b0085270 con 0x7f14b80cbe40 2023-10-06T02:53:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.961+0000 7f14bd469700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.961+0000 7f14bd469700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f149c066f30 0x7f149c0693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f14b80b6c80 tx=0x7f14b4006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:03.965+0000 7f14ad7fa700 1 -- 172.21.15.81:0/2770234698 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14b00522e0 con 0x7f14b80cbe40 2023-10-06T02:53:04.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.189+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14b80cd980 con 0x7f14b80cbe40 2023-10-06T02:53:04.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.190+0000 7f14ad7fa700 1 -- 172.21.15.81:0/2770234698 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f14b80cd980 con 0x7f14b80cbe40 2023-10-06T02:53:04.191 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:04.191 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:52:25.912348+0000","modified":"2023-10-06T02:52:29.566702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7275":{"gid":7275,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6836/4039558742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":4039558742},{"type":"v1","addr":"172.21.15.83:6836","nonce":4039558742}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T02:53:04.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f149c066f30 msgr2=0x7f149c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f149c066f30 0x7f149c0693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f14b80b6c80 tx=0x7f14b4006040 comp rx=0 tx=0).stop 2023-10-06T02:53:04.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b80cbe40 msgr2=0x7f14b80cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b80cbe40 0x7f14b80cc2e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f14a4004790 tx=0x7f14b0015000 comp rx=0 tx=0).stop 2023-10-06T02:53:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 shutdown_connections 2023-10-06T02:53:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14b80cbe40 0x7f14b80cc2e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14a4004d50 0x7f14b816d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 --2- 172.21.15.81:0/2770234698 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14b80c9e20 0x7f14b80ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 >> 172.21.15.81:0/2770234698 conn(0x7f14b806bb90 msgr2=0x7f14b81568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 shutdown_connections 2023-10-06T02:53:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.192+0000 7f14bf6cd700 1 -- 172.21.15.81:0/2770234698 wait complete. 2023-10-06T02:53:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 67 2023-10-06T02:53:04.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:53:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.318+0000 7fc9aed5b700 1 Processor -- start 2023-10-06T02:53:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.318+0000 7fc9aed5b700 1 -- start start 2023-10-06T02:53:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9aed5b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc9a81578d0 0x7fc9a80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9aed5b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a8157ca0 0x7fc9a815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9aed5b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9a806d120 0x7fc9a806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9aed5b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a806dac0 con 0x7fc9a806d120 2023-10-06T02:53:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9aed5b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80d07c0 con 0x7fc9a81578d0 2023-10-06T02:53:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9aed5b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80cfbb0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9ad2f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9a806d120 0x7fc9a806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9ad2f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9a806d120 0x7fc9a806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36950/0 (socket says 172.21.15.81:36950) 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9ad2f8700 1 -- 172.21.15.81:0/1201118164 learned_addr learned my addr 172.21.15.81:0/1201118164 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9a7fff700 1 --2- 172.21.15.81:0/1201118164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a8157ca0 0x7fc9a815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9acaf7700 1 --2- 172.21.15.81:0/1201118164 >> v2:172.21.15.83:3300/0 conn(0x7fc9a81578d0 0x7fc9a80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9ad2f8700 1 -- 172.21.15.81:0/1201118164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a8157ca0 msgr2=0x7fc9a815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9ad2f8700 1 --2- 172.21.15.81:0/1201118164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a8157ca0 0x7fc9a815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9ad2f8700 1 -- 172.21.15.81:0/1201118164 >> v2:172.21.15.83:3300/0 conn(0x7fc9a81578d0 msgr2=0x7fc9a80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9ad2f8700 1 --2- 172.21.15.81:0/1201118164 >> v2:172.21.15.83:3300/0 conn(0x7fc9a81578d0 0x7fc9a80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9ad2f8700 1 -- 172.21.15.81:0/1201118164 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80cfe90 con 0x7fc9a806d120 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9a7fff700 1 --2- 172.21.15.81:0/1201118164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a8157ca0 0x7fc9a815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9acaf7700 1 --2- 172.21.15.81:0/1201118164 >> v2:172.21.15.83:3300/0 conn(0x7fc9a81578d0 0x7fc9a80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9ad2f8700 1 --2- 172.21.15.81:0/1201118164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a806d120 0x7fc9a806d580 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80646b0 tx=0x7fc9a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c7dead0abc9ebd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9a77fe700 1 -- 172.21.15.81:0/1201118164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000e070 con 0x7fc9a806d120 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9a77fe700 1 -- 172.21.15.81:0/1201118164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a000ba50 con 0x7fc9a806d120 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.319+0000 7fc9a77fe700 1 -- 172.21.15.81:0/1201118164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00092e0 con 0x7fc9a806d120 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.320+0000 7fc9aed5b700 1 -- 172.21.15.81:0/1201118164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a806d120 msgr2=0x7fc9a806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.320+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/1201118164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a806d120 0x7fc9a806d580 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80646b0 tx=0x7fc9a0009840 comp rx=0 tx=0).stop 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.320+0000 7fc9aed5b700 1 -- 172.21.15.81:0/1201118164 shutdown_connections 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.320+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/1201118164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a806d120 0x7fc9a806d580 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.320+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/1201118164 >> v2:172.21.15.83:3300/0 conn(0x7fc9a81578d0 0x7fc9a80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.320+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/1201118164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a8157ca0 0x7fc9a815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.320+0000 7fc9aed5b700 1 -- 172.21.15.81:0/1201118164 >> 172.21.15.81:0/1201118164 conn(0x7fc9a806bb90 msgr2=0x7fc9a806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.320+0000 7fc9aed5b700 1 -- 172.21.15.81:0/1201118164 shutdown_connections 2023-10-06T02:53:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.320+0000 7fc9aed5b700 1 -- 172.21.15.81:0/1201118164 wait complete. 2023-10-06T02:53:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.321+0000 7fc9aed5b700 1 Processor -- start 2023-10-06T02:53:04.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.321+0000 7fc9aed5b700 1 -- start start 2023-10-06T02:53:04.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9aed5b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a806d120 0x7fc9a814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9aed5b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a81578d0 0x7fc9a80b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9aed5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a8157ca0 0x7fc9a80b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9aed5b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80b40e0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9aed5b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80b4f20 con 0x7fc9a81578d0 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9aed5b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80b4310 con 0x7fc9a806d120 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9ad2f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a8157ca0 0x7fc9a80b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9ad2f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a8157ca0 0x7fc9a80b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36952/0 (socket says 172.21.15.81:36952) 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9ad2f8700 1 -- 172.21.15.81:0/3704521502 learned_addr learned my addr 172.21.15.81:0/3704521502 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9acaf7700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a806d120 0x7fc9a814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9a7fff700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a81578d0 0x7fc9a80b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9ad2f8700 1 -- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a806d120 msgr2=0x7fc9a814bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9ad2f8700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a806d120 0x7fc9a814bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9ad2f8700 1 -- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a81578d0 msgr2=0x7fc9a80b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9ad2f8700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a81578d0 0x7fc9a80b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9ad2f8700 1 -- 172.21.15.81:0/3704521502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a0009ae0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9acaf7700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a806d120 0x7fc9a814bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.322+0000 7fc9ad2f8700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a8157ca0 0x7fc9a80b3ba0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fc9a806fe20 tx=0x7fc9a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.323+0000 7fc9a4ff9700 1 -- 172.21.15.81:0/3704521502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00094e0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.323+0000 7fc9a4ff9700 1 -- 172.21.15.81:0/3704521502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a00032f0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.323+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a80b45f0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.323+0000 7fc9a4ff9700 1 -- 172.21.15.81:0/3704521502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00266b0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.323+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a80b4bb0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.324+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a8067ac0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.324+0000 7fc9a4ff9700 1 -- 172.21.15.81:0/3704521502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9a0003040 con 0x7fc9a8157ca0 2023-10-06T02:53:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.324+0000 7fc9a4ff9700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc98c066f30 0x7fc98c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.324+0000 7fc9a4ff9700 1 -- 172.21.15.81:0/3704521502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc9a00866e0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.325+0000 7fc9acaf7700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc98c066f30 0x7fc98c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.325+0000 7fc9acaf7700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc98c066f30 0x7fc98c0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc99c008a80 tx=0x7fc99c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.328+0000 7fc9a4ff9700 1 -- 172.21.15.81:0/3704521502 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9a00537f0 con 0x7fc9a8157ca0 2023-10-06T02:53:04.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.515+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a80d0170 con 0x7fc9a8157ca0 2023-10-06T02:53:04.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.515+0000 7fc9a4ff9700 1 -- 172.21.15.81:0/3704521502 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16860 (secure 0 0 0) 0x7fc9a0056e10 con 0x7fc9a8157ca0 2023-10-06T02:53:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:04.517 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":139,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:53:04.420305+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:52:23.555508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T02:52:24.879976+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:53:04.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc98c066f30 msgr2=0x7fc98c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc98c066f30 0x7fc98c0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc99c008a80 tx=0x7fc99c008040 comp rx=0 tx=0).stop 2023-10-06T02:53:04.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a8157ca0 msgr2=0x7fc9a80b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a8157ca0 0x7fc9a80b3ba0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fc9a806fe20 tx=0x7fc9a0018000 comp rx=0 tx=0).stop 2023-10-06T02:53:04.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 shutdown_connections 2023-10-06T02:53:04.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a8157ca0 0x7fc9a80b3ba0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a806d120 0x7fc9a814bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc98c066f30 0x7fc98c0693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 --2- 172.21.15.81:0/3704521502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a81578d0 0x7fc9a80b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 >> 172.21.15.81:0/3704521502 conn(0x7fc9a806bb90 msgr2=0x7fc9a806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:04.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 shutdown_connections 2023-10-06T02:53:04.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.518+0000 7fc9aed5b700 1 -- 172.21.15.81:0/3704521502 wait complete. 2023-10-06T02:53:04.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:53:04.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.645+0000 7fc824699700 1 Processor -- start 2023-10-06T02:53:04.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.645+0000 7fc824699700 1 -- start start 2023-10-06T02:53:04.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc824699700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c157ca0 0x7fc81c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc824699700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc81c06d120 0x7fc81c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc824699700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c06dac0 con 0x7fc81c1578d0 2023-10-06T02:53:04.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc824699700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c0d07c0 con 0x7fc81c06d120 2023-10-06T02:53:04.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc824699700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0cfbb0 con 0x7fc81c157ca0 2023-10-06T02:53:04.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc822435700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc81c1578d0 0x7fc81c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48204/0 (socket says 172.21.15.81:48204) 2023-10-06T02:53:04.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc822435700 1 -- 172.21.15.81:0/4213619384 learned_addr learned my addr 172.21.15.81:0/4213619384 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977115521 0 0) 0x7fc818001110 con 0x7fc81c1578d0 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc808003570 con 0x7fc81c1578d0 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821c34700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c157ca0 0x7fc81c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc822c36700 1 --2- 172.21.15.81:0/4213619384 >> v2:172.21.15.83:3300/0 conn(0x7fc81c06d120 0x7fc81c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978070073 0 0) 0x7fc808003570 con 0x7fc81c1578d0 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c157ca0 msgr2=0x7fc81c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c157ca0 0x7fc81c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 >> v2:172.21.15.83:3300/0 conn(0x7fc81c06d120 msgr2=0x7fc81c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 --2- 172.21.15.81:0/4213619384 >> v2:172.21.15.83:3300/0 conn(0x7fc81c06d120 0x7fc81c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0cfe90 con 0x7fc81c1578d0 2023-10-06T02:53:04.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fc818001600 con 0x7fc81c1578d0 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 >> v1:172.21.15.81:6789/0 conn(0x7fc81c1578d0 legacy=0x7fc81c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc808003a60 0x7fc808003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc808004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.646+0000 7fc821433700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c157ca0 0x7fc8080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0d07c0 con 0x7fc808004810 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0cfbb0 con 0x7fc808003a60 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80800ba60 con 0x7fc81c157ca0 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821c34700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc808004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc822435700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc808003a60 0x7fc808003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc822c36700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c157ca0 0x7fc8080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821c34700 1 -- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c157ca0 msgr2=0x7fc8080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821c34700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c157ca0 0x7fc8080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821c34700 1 -- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc808003a60 msgr2=0x7fc808003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821c34700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc808003a60 0x7fc808003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821c34700 1 -- 172.21.15.81:0/4213619384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808003570 con 0x7fc808004810 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821c34700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc808004c80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009c30 tx=0x7fc80c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c261422bf5130a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00e710 con 0x7fc808004810 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c00e870 con 0x7fc808004810 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.647+0000 7fc821433700 1 -- 172.21.15.81:0/4213619384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00ec30 con 0x7fc808004810 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.648+0000 7fc824699700 1 -- 172.21.15.81:0/4213619384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 msgr2=0x7fc808004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.648+0000 7fc824699700 1 --2- 172.21.15.81:0/4213619384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc808004c80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009c30 tx=0x7fc80c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.648+0000 7fc822c36700 1 -- 172.21.15.81:0/4213619384 reap_dead start 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.648+0000 7fc824699700 1 -- 172.21.15.81:0/4213619384 shutdown_connections 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.648+0000 7fc824699700 1 -- 172.21.15.81:0/4213619384 >> 172.21.15.81:0/4213619384 conn(0x7fc81c06bb90 msgr2=0x7fc81c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.648+0000 7fc824699700 1 -- 172.21.15.81:0/4213619384 shutdown_connections 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.648+0000 7fc824699700 1 -- 172.21.15.81:0/4213619384 wait complete. 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.649+0000 7fc824699700 1 Processor -- start 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.649+0000 7fc824699700 1 -- start start 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc824699700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc81c16a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc824699700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc81c0cab20 0x7fc81c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc824699700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c0c5e30 0x7fc81c0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc824699700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0cb4d0 con 0x7fc808004810 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc824699700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c6b60 con 0x7fc81c0cab20 2023-10-06T02:53:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc824699700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c6e40 con 0x7fc81c0c5e30 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc822435700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc81c16a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc822435700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc81c16a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36984/0 (socket says 172.21.15.81:36984) 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc822435700 1 -- 172.21.15.81:0/2597842887 learned_addr learned my addr 172.21.15.81:0/2597842887 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc822435700 1 -- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c0c5e30 msgr2=0x7fc81c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc822435700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c0c5e30 0x7fc81c0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc822435700 1 -- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc81c0cab20 msgr2=0x7fc81c0caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc822435700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc81c0cab20 0x7fc81c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc822435700 1 -- 172.21.15.81:0/2597842887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0c7120 con 0x7fc808004810 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc822435700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc81c16a120 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc8180073c0 tx=0x7fc81c0d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818018030 con 0x7fc808004810 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81800f870 con 0x7fc808004810 2023-10-06T02:53:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c0c7400 con 0x7fc808004810 2023-10-06T02:53:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81800fc10 con 0x7fc808004810 2023-10-06T02:53:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.650+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c16a660 con 0x7fc808004810 2023-10-06T02:53:04.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.651+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c0c7620 con 0x7fc808004810 2023-10-06T02:53:04.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.652+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc81801b070 con 0x7fc808004810 2023-10-06T02:53:04.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.652+0000 7fc8127fc700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc800066f30 0x7fc8000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:04.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.652+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc818019070 con 0x7fc808004810 2023-10-06T02:53:04.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.652+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7fc80006f0f0 con 0x7fc808004810 2023-10-06T02:53:04.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.652+0000 7fc821c34700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc800066f30 0x7fc8000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:04.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.653+0000 7fc821c34700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc800066f30 0x7fc8000693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc81c15d3f0 tx=0x7fc80c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:04.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.656+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8180515c0 con 0x7fc808004810 2023-10-06T02:53:04.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.880+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc81c06dac0 con 0x7fc808004810 2023-10-06T02:53:04.882 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:53:04.881+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:53:04.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.883+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(140..140 src has 1..140) v4 ==== 366+0+0 (secure 0 0 0) 0x7fc818055280 con 0x7fc808004810 2023-10-06T02:53:04.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.883+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7fc80006fa40 con 0x7fc808004810 2023-10-06T02:53:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.885+0000 7fc8127fc700 1 -- 172.21.15.81:0/2597842887 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc81c06dac0 con 0x7fc808004810 2023-10-06T02:53:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.887+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc800066f30 msgr2=0x7fc8000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.887+0000 7fc824699700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc800066f30 0x7fc8000693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc81c15d3f0 tx=0x7fc80c01a000 comp rx=0 tx=0).stop 2023-10-06T02:53:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.887+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 msgr2=0x7fc81c16a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.887+0000 7fc824699700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc81c16a120 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc8180073c0 tx=0x7fc81c0d0730 comp rx=0 tx=0).stop 2023-10-06T02:53:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.887+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 shutdown_connections 2023-10-06T02:53:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.887+0000 7fc824699700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc81c0c5e30 0x7fc81c0c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.888+0000 7fc824699700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc808004810 0x7fc81c16a120 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.888+0000 7fc824699700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc800066f30 0x7fc8000693e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.888+0000 7fc824699700 1 --2- 172.21.15.81:0/2597842887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc81c0cab20 0x7fc81c0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:04.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.888+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 >> 172.21.15.81:0/2597842887 conn(0x7fc81c06bb90 msgr2=0x7fc81c15a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:04.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.888+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 shutdown_connections 2023-10-06T02:53:04.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:04.888+0000 7fc824699700 1 -- 172.21.15.81:0/2597842887 wait complete. 2023-10-06T02:53:04.890 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:53:04.891 INFO:tasks.ceph.mds.d.smithi083.stderr: -7557> 2023-10-06T02:52:30.836+0000 7fd1e344e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:53:04.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:53:04.919 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:53:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.016+0000 7f0e9a4ec700 1 Processor -- start 2023-10-06T02:53:05.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.016+0000 7f0e9a4ec700 1 -- start start 2023-10-06T02:53:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.017+0000 7f0e9a4ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940ce5c0 0x7f0e940aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.017+0000 7f0e9a4ec700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9415dfb0 con 0x7f0e940ce1f0 2023-10-06T02:53:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.017+0000 7f0e9a4ec700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e940acec0 con 0x7f0e940ac570 2023-10-06T02:53:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.017+0000 7f0e9a4ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940ad1a0 con 0x7f0e940ce5c0 2023-10-06T02:53:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.017+0000 7f0e93fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0e940ce1f0 0x7f0e9415e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48212/0 (socket says 172.21.15.81:48212) 2023-10-06T02:53:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.017+0000 7f0e93fff700 1 -- 172.21.15.81:0/879472869 learned_addr learned my addr 172.21.15.81:0/879472869 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.017+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162453071 0 0) 0x7f0e9415dfb0 con 0x7f0e940ce1f0 2023-10-06T02:53:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.017+0000 7f0e937fe700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940ce5c0 0x7f0e940aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.017+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e7c003570 con 0x7f0e940ce1f0 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 552351795 0 0) 0x7f0e7c003570 con 0x7f0e940ce1f0 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940ce5c0 msgr2=0x7f0e940aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940ce5c0 0x7f0e940aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 >> v1:172.21.15.83:6789/0 conn(0x7f0e940ac570 legacy=0x7f0e9406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9415dc40 con 0x7f0e940ce1f0 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f0e84001470 con 0x7f0e940ce1f0 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 >> v1:172.21.15.81:6789/0 conn(0x7f0e940ce1f0 legacy=0x7f0e9415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e7c003a90 0x7f0e7c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940ce5c0 0x7f0e7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e7c004d50 0x7f0e7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940ad1a0 con 0x7f0e7c004d50 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c00bbf0 con 0x7f0e7c003a90 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c00bd80 con 0x7f0e940ce5c0 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e93fff700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e7c003a90 0x7f0e7c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e98a89700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e7c004d50 0x7f0e7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e937fe700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940ce5c0 0x7f0e7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e98a89700 1 -- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940ce5c0 msgr2=0x7f0e7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e98a89700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940ce5c0 0x7f0e7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e98a89700 1 -- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e7c003a90 msgr2=0x7f0e7c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e98a89700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e7c003a90 0x7f0e7c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e98a89700 1 -- 172.21.15.81:0/879472869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c003570 con 0x7f0e7c004d50 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e98a89700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e7c004d50 0x7f0e7c0051c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c001fc0 tx=0x7f0e8c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5795d178fc433a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c001950 con 0x7f0e7c004d50 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c00c8b0 con 0x7f0e7c004d50 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.018+0000 7f0e92ffd700 1 -- 172.21.15.81:0/879472869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00cc50 con 0x7f0e7c004d50 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.019+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/879472869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e7c004d50 msgr2=0x7f0e7c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.019+0000 7f0e9a4ec700 1 --2- 172.21.15.81:0/879472869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e7c004d50 0x7f0e7c0051c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c001fc0 tx=0x7f0e8c001640 comp rx=0 tx=0).stop 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.019+0000 7f0e98a89700 1 -- 172.21.15.81:0/879472869 reap_dead start 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.019+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/879472869 shutdown_connections 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.019+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/879472869 >> 172.21.15.81:0/879472869 conn(0x7f0e9406cca0 msgr2=0x7f0e9406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.019+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/879472869 shutdown_connections 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.019+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/879472869 wait complete. 2023-10-06T02:53:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.020+0000 7f0e9a4ec700 1 Processor -- start 2023-10-06T02:53:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.020+0000 7f0e9a4ec700 1 -- start start 2023-10-06T02:53:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e9a4ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94155b00 0x7f0e9415d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e9a4ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940c29f0 0x7f0e94158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e9a4ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940c2e60 0x7f0e94159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e9a4ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9415d630 con 0x7f0e94155b00 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e9a4ec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9415cc60 con 0x7f0e940c29f0 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e9a4ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940cc690 con 0x7f0e940c2e60 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94155b00 0x7f0e9415d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94155b00 0x7f0e9415d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37000/0 (socket says 172.21.15.81:37000) 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e93fff700 1 -- 172.21.15.81:0/2214752729 learned_addr learned my addr 172.21.15.81:0/2214752729 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e98a89700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940c2e60 0x7f0e94159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e937fe700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940c29f0 0x7f0e94158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e93fff700 1 -- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940c2e60 msgr2=0x7f0e94159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e93fff700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940c2e60 0x7f0e94159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e93fff700 1 -- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940c29f0 msgr2=0x7f0e94158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:05.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e93fff700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940c29f0 0x7f0e94158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.021+0000 7f0e93fff700 1 -- 172.21.15.81:0/2214752729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9415bdb0 con 0x7f0e94155b00 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.022+0000 7f0e93fff700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94155b00 0x7f0e9415d0f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f0e840073c0 tx=0x7f0e84001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.022+0000 7f0e7bfff700 1 -- 172.21.15.81:0/2214752729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400f6c0 con 0x7f0e94155b00 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.022+0000 7f0e7bfff700 1 -- 172.21.15.81:0/2214752729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8400f820 con 0x7f0e94155b00 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.022+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9415c050 con 0x7f0e94155b00 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.022+0000 7f0e7bfff700 1 -- 172.21.15.81:0/2214752729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400fbe0 con 0x7f0e94155b00 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.022+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9415c610 con 0x7f0e94155b00 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.023+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e94157c10 con 0x7f0e94155b00 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.023+0000 7f0e7bfff700 1 -- 172.21.15.81:0/2214752729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e8401e3b0 con 0x7f0e94155b00 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.023+0000 7f0e7bfff700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.024+0000 7f0e7bfff700 1 -- 172.21.15.81:0/2214752729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f0e84084300 con 0x7f0e94155b00 2023-10-06T02:53:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.024+0000 7f0e937fe700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:05.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.024+0000 7f0e7bfff700 1 -- 172.21.15.81:0/2214752729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f0e8006f190 con 0x7f0e94155b00 2023-10-06T02:53:05.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.024+0000 7f0e937fe700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0e94159e50 tx=0x7f0e880091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:05.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.028+0000 7f0e7bfff700 1 -- 172.21.15.81:0/2214752729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e8401a060 con 0x7f0e94155b00 2023-10-06T02:53:05.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.252+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0e940aca10 con 0x7f0e94155b00 2023-10-06T02:53:05.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.889+0000 7f0e7bfff700 1 -- 172.21.15.81:0/2214752729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0e840513c0 con 0x7f0e94155b00 2023-10-06T02:53:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e80066f30 msgr2=0x7f0e800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0e94159e50 tx=0x7f0e880091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94155b00 msgr2=0x7f0e9415d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94155b00 0x7f0e9415d0f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f0e840073c0 tx=0x7f0e84001d80 comp rx=0 tx=0).stop 2023-10-06T02:53:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 shutdown_connections 2023-10-06T02:53:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e940c2e60 0x7f0e94159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94155b00 0x7f0e9415d0f0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 --2- 172.21.15.81:0/2214752729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e940c29f0 0x7f0e94158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 >> 172.21.15.81:0/2214752729 conn(0x7f0e9406cca0 msgr2=0x7f0e9406aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 shutdown_connections 2023-10-06T02:53:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:05.891+0000 7f0e9a4ec700 1 -- 172.21.15.81:0/2214752729 wait complete. 2023-10-06T02:53:05.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:53:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.022+0000 7f6f306bf700 1 Processor -- start 2023-10-06T02:53:06.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.022+0000 7f6f306bf700 1 -- start start 2023-10-06T02:53:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.023+0000 7f6f306bf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f28157ca0 0x7f6f280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.023+0000 7f6f306bf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f2806d120 0x7f6f2806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.023+0000 7f6f306bf700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f280d07c0 con 0x7f6f281578d0 2023-10-06T02:53:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.023+0000 7f6f306bf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2806daa0 con 0x7f6f28157ca0 2023-10-06T02:53:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.023+0000 7f6f306bf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280cfbb0 con 0x7f6f2806d120 2023-10-06T02:53:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.023+0000 7f6f2dc5a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f28157ca0 0x7f6f280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.023+0000 7f6f2dc5a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f28157ca0 0x7f6f280cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37006/0 (socket says 172.21.15.81:37006) 2023-10-06T02:53:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.023+0000 7f6f2dc5a700 1 -- 172.21.15.81:0/1865116037 learned_addr learned my addr 172.21.15.81:0/1865116037 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.023+0000 7f6f2ec5c700 1 --2- 172.21.15.81:0/1865116037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f2806d120 0x7f6f2806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f2dc5a700 1 -- 172.21.15.81:0/1865116037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f2806d120 msgr2=0x7f6f2806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f2dc5a700 1 --2- 172.21.15.81:0/1865116037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f2806d120 0x7f6f2806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f2dc5a700 1 -- 172.21.15.81:0/1865116037 >> v1:172.21.15.83:6789/0 conn(0x7f6f281578d0 legacy=0x7f6f2815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f2dc5a700 1 -- 172.21.15.81:0/1865116037 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280cfe90 con 0x7f6f28157ca0 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f2ec5c700 1 --2- 172.21.15.81:0/1865116037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f2806d120 0x7f6f2806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f2dc5a700 1 --2- 172.21.15.81:0/1865116037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f28157ca0 0x7f6f280cf4f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f6f180099b0 tx=0x7f6f18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfe2ad4f163bff6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f2d459700 1 -- 172.21.15.81:0/1865116037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800b860 con 0x7f6f28157ca0 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f2d459700 1 -- 172.21.15.81:0/1865116037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800b9c0 con 0x7f6f28157ca0 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f2d459700 1 -- 172.21.15.81:0/1865116037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800bd60 con 0x7f6f28157ca0 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f306bf700 1 -- 172.21.15.81:0/1865116037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f28157ca0 msgr2=0x7f6f280cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f306bf700 1 --2- 172.21.15.81:0/1865116037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f28157ca0 0x7f6f280cf4f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f6f180099b0 tx=0x7f6f18009250 comp rx=0 tx=0).stop 2023-10-06T02:53:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f306bf700 1 -- 172.21.15.81:0/1865116037 shutdown_connections 2023-10-06T02:53:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f306bf700 1 --2- 172.21.15.81:0/1865116037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f2806d120 0x7f6f2806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f306bf700 1 --2- 172.21.15.81:0/1865116037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f28157ca0 0x7f6f280cf4f0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f306bf700 1 -- 172.21.15.81:0/1865116037 >> 172.21.15.81:0/1865116037 conn(0x7f6f2806bb90 msgr2=0x7f6f2806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f306bf700 1 -- 172.21.15.81:0/1865116037 shutdown_connections 2023-10-06T02:53:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.024+0000 7f6f306bf700 1 -- 172.21.15.81:0/1865116037 wait complete. 2023-10-06T02:53:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.025+0000 7f6f306bf700 1 Processor -- start 2023-10-06T02:53:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f306bf700 1 -- start start 2023-10-06T02:53:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f306bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2806d120 0x7f6f280b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f306bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f281578d0 0x7f6f28153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f306bf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f28157ca0 0x7f6f280b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f306bf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f28154120 con 0x7f6f2806d120 2023-10-06T02:53:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f306bf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280b2950 con 0x7f6f281578d0 2023-10-06T02:53:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f306bf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280b2670 con 0x7f6f28157ca0 2023-10-06T02:53:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f2e45b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2806d120 0x7f6f280b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f2e45b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2806d120 0x7f6f280b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37016/0 (socket says 172.21.15.81:37016) 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f2e45b700 1 -- 172.21.15.81:0/57728383 learned_addr learned my addr 172.21.15.81:0/57728383 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f2ec5c700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f28157ca0 0x7f6f280b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.026+0000 7f6f2dc5a700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f281578d0 0x7f6f28153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f2e45b700 1 -- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f28157ca0 msgr2=0x7f6f280b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f2e45b700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f28157ca0 0x7f6f280b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f2e45b700 1 -- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f281578d0 msgr2=0x7f6f28153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f2e45b700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f281578d0 0x7f6f28153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f2e45b700 1 -- 172.21.15.81:0/57728383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180094f0 con 0x7f6f2806d120 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f2e45b700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2806d120 0x7f6f280b5780 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c590 tx=0x7f6f2400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24011590 con 0x7f6f2806d120 2023-10-06T02:53:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24011710 con 0x7f6f2806d120 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f280b4ca0 con 0x7f6f2806d120 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24011ad0 con 0x7f6f2806d120 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.027+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f280b5260 con 0x7f6f2806d120 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.028+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f280b5450 con 0x7f6f2806d120 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.028+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f2401b3b0 con 0x7f6f2806d120 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.029+0000 7f6f1e7fc700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f0c066f30 0x7f6f0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.029+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f6f24083b50 con 0x7f6f2806d120 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.029+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f6f0c06f190 con 0x7f6f2806d120 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.029+0000 7f6f2dc5a700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f0c066f30 0x7f6f0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.029+0000 7f6f2dc5a700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f0c066f30 0x7f6f0c0693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6f180099b0 tx=0x7f6f18017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.033+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f24017070 con 0x7f6f2806d120 2023-10-06T02:53:06.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.218+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6f280d0170 con 0x7f6f2806d120 2023-10-06T02:53:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.890+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(141..141 src has 1..141) v4 ==== 288+0+0 (secure 0 0 0) 0x7f6f24054fd0 con 0x7f6f2806d120 2023-10-06T02:53:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.890+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7f6f0c06d5c0 con 0x7f6f2806d120 2023-10-06T02:53:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.893+0000 7f6f1e7fc700 1 -- 172.21.15.81:0/57728383 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v141) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6f24050c10 con 0x7f6f2806d120 2023-10-06T02:53:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f0c066f30 msgr2=0x7f6f0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f0c066f30 0x7f6f0c0693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6f180099b0 tx=0x7f6f18017000 comp rx=0 tx=0).stop 2023-10-06T02:53:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2806d120 msgr2=0x7f6f280b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2806d120 0x7f6f280b5780 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c590 tx=0x7f6f2400c8a0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 shutdown_connections 2023-10-06T02:53:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6f28157ca0 0x7f6f280b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2806d120 0x7f6f280b5780 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6f0c066f30 0x7f6f0c0693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 --2- 172.21.15.81:0/57728383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f281578d0 0x7f6f28153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 >> 172.21.15.81:0/57728383 conn(0x7f6f2806bb90 msgr2=0x7f6f28068aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 shutdown_connections 2023-10-06T02:53:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:06.899+0000 7f6f306bf700 1 -- 172.21.15.81:0/57728383 wait complete. 2023-10-06T02:53:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:53:06.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:53:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.031+0000 7f5de96dd700 1 Processor -- start 2023-10-06T02:53:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.031+0000 7f5de96dd700 1 -- start start 2023-10-06T02:53:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.032+0000 7f5de96dd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5de415a2a0 0x7f5de40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.032+0000 7f5de96dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40ceb30 0x7f5de40cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.032+0000 7f5de96dd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de40b0ca0 con 0x7f5de406d650 2023-10-06T02:53:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.032+0000 7f5de96dd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de406ea90 con 0x7f5de415a2a0 2023-10-06T02:53:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.032+0000 7f5de96dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40cf4c0 con 0x7f5de40ceb30 2023-10-06T02:53:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.032+0000 7f5de2ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5de415a2a0 0x7f5de40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.032+0000 7f5de37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5de406d650 0x7f5de406da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48216/0 (socket says 172.21.15.81:48216) 2023-10-06T02:53:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.032+0000 7f5de37fe700 1 -- 172.21.15.81:0/411202381 learned_addr learned my addr 172.21.15.81:0/411202381 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de2ffd700 1 -- 172.21.15.81:0/411202381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40ceb30 msgr2=0x7f5de40cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5dda7fc700 1 --2- 172.21.15.81:0/411202381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40ceb30 0x7f5de40cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de27fc700 1 -- 172.21.15.81:0/411202381 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383346376 0 0) 0x7f5de40b0ca0 con 0x7f5de406d650 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de2ffd700 1 --2- 172.21.15.81:0/411202381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40ceb30 0x7f5de40cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de2ffd700 1 -- 172.21.15.81:0/411202381 >> v1:172.21.15.81:6789/0 conn(0x7f5de406d650 legacy=0x7f5de406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de2ffd700 1 -- 172.21.15.81:0/411202381 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40b00d0 con 0x7f5de415a2a0 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de2ffd700 1 --2- 172.21.15.81:0/411202381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de415a2a0 0x7f5de40b1130 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40098e0 tx=0x7f5dd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d4472865c80b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de27fc700 1 -- 172.21.15.81:0/411202381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4009e80 con 0x7f5de415a2a0 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de27fc700 1 -- 172.21.15.81:0/411202381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd400b860 con 0x7f5de415a2a0 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de27fc700 1 -- 172.21.15.81:0/411202381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd400bbe0 con 0x7f5de415a2a0 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de96dd700 1 -- 172.21.15.81:0/411202381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de415a2a0 msgr2=0x7f5de40b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de96dd700 1 --2- 172.21.15.81:0/411202381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de415a2a0 0x7f5de40b1130 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40098e0 tx=0x7f5dd40091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:07.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de96dd700 1 -- 172.21.15.81:0/411202381 shutdown_connections 2023-10-06T02:53:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de96dd700 1 --2- 172.21.15.81:0/411202381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de415a2a0 0x7f5de40b1130 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de96dd700 1 --2- 172.21.15.81:0/411202381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40ceb30 0x7f5de40cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.033+0000 7f5de96dd700 1 -- 172.21.15.81:0/411202381 >> 172.21.15.81:0/411202381 conn(0x7f5de4067640 msgr2=0x7f5de4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.034+0000 7f5de96dd700 1 -- 172.21.15.81:0/411202381 shutdown_connections 2023-10-06T02:53:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.034+0000 7f5de96dd700 1 -- 172.21.15.81:0/411202381 wait complete. 2023-10-06T02:53:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.035+0000 7f5de96dd700 1 Processor -- start 2023-10-06T02:53:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.035+0000 7f5de96dd700 1 -- start start 2023-10-06T02:53:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.035+0000 7f5de96dd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de406d650 0x7f5de4154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.035+0000 7f5de96dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de40ceb30 0x7f5de40b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.035+0000 7f5de96dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de415a2a0 0x7f5de40b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.035+0000 7f5de96dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40c9620 con 0x7f5de40ceb30 2023-10-06T02:53:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.035+0000 7f5de96dd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de415e1c0 con 0x7f5de406d650 2023-10-06T02:53:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.035+0000 7f5de96dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de415d920 con 0x7f5de415a2a0 2023-10-06T02:53:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5dda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de40ceb30 0x7f5de40b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5dda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de40ceb30 0x7f5de40b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37032/0 (socket says 172.21.15.81:37032) 2023-10-06T02:53:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5dda7fc700 1 -- 172.21.15.81:0/2253221184 learned_addr learned my addr 172.21.15.81:0/2253221184 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5de37fe700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de415a2a0 0x7f5de40b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5dda7fc700 1 -- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de415a2a0 msgr2=0x7f5de40b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5de2ffd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de406d650 0x7f5de4154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5dda7fc700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de415a2a0 0x7f5de40b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5dda7fc700 1 -- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de406d650 msgr2=0x7f5de4154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5dda7fc700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de406d650 0x7f5de4154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5dda7fc700 1 -- 172.21.15.81:0/2253221184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4009420 con 0x7f5de40ceb30 2023-10-06T02:53:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5de37fe700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de415a2a0 0x7f5de40b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5de2ffd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de406d650 0x7f5de4154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5dda7fc700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de40ceb30 0x7f5de40b3a20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c7d0 tx=0x7f5dcc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc011600 con 0x7f5de40ceb30 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc011760 con 0x7f5de40ceb30 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc011b20 con 0x7f5de40ceb30 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de415dc00 con 0x7f5de40ceb30 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.036+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de41553d0 con 0x7f5de40ceb30 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.037+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de4069e40 con 0x7f5de40ceb30 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.037+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5dcc0193f0 con 0x7f5de40ceb30 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.038+0000 7f5ddb7fe700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5dc4066f30 0x7f5dc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.038+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f5dcc0849d0 con 0x7f5de40ceb30 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.038+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7f5dc406e310 con 0x7f5de40ceb30 2023-10-06T02:53:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.038+0000 7f5de2ffd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5dc4066f30 0x7f5dc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.038+0000 7f5de2ffd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5dc4066f30 0x7f5dc40693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4003080 tx=0x7f5dd4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.042+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5dcc051c40 con 0x7f5de40ceb30 2023-10-06T02:53:07.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.225+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5de40c93f0 con 0x7f5de40ceb30 2023-10-06T02:53:07.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:53:07.228 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:53:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.896+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(142..142 src has 1..142) v4 ==== 288+0+0 (secure 0 0 0) 0x7f5dcc00f2d0 con 0x7f5de40ceb30 2023-10-06T02:53:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.896+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f5dc406d0a0 con 0x7f5de40ceb30 2023-10-06T02:53:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.904+0000 7f5ddb7fe700 1 -- 172.21.15.81:0/2253221184 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v142) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5dcc055260 con 0x7f5de40ceb30 2023-10-06T02:53:07.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.908+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5dc4066f30 msgr2=0x7f5dc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.908+0000 7f5de96dd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5dc4066f30 0x7f5dc40693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4003080 tx=0x7f5dd4017000 comp rx=0 tx=0).stop 2023-10-06T02:53:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.908+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de40ceb30 msgr2=0x7f5de40b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.908+0000 7f5de96dd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de40ceb30 0x7f5de40b3a20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c7d0 tx=0x7f5dcc008040 comp rx=0 tx=0).stop 2023-10-06T02:53:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.908+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 shutdown_connections 2023-10-06T02:53:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.908+0000 7f5de96dd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de415a2a0 0x7f5de40b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.908+0000 7f5de96dd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5dc4066f30 0x7f5dc40693e0 secure :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4003080 tx=0x7f5dd4017000 comp rx=0 tx=0).stop 2023-10-06T02:53:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.908+0000 7f5de96dd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de406d650 0x7f5de4154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.908+0000 7f5de96dd700 1 --2- 172.21.15.81:0/2253221184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de40ceb30 0x7f5de40b3a20 secure :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c7d0 tx=0x7f5dcc008040 comp rx=0 tx=0).stop 2023-10-06T02:53:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.909+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 >> 172.21.15.81:0/2253221184 conn(0x7f5de4067640 msgr2=0x7f5de40ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:07.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.909+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 shutdown_connections 2023-10-06T02:53:07.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:07.909+0000 7f5de96dd700 1 -- 172.21.15.81:0/2253221184 wait complete. 2023-10-06T02:53:07.913 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:53:07.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:53:08.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.042+0000 7fb27e4b5700 1 Processor -- start 2023-10-06T02:53:08.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.042+0000 7fb27e4b5700 1 -- start start 2023-10-06T02:53:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.042+0000 7fb27e4b5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb278157ca0 0x7fb2780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.042+0000 7fb27e4b5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb27806d120 0x7fb27806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.042+0000 7fb27e4b5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2780d07c0 con 0x7fb2781578d0 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.042+0000 7fb27e4b5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27806da50 con 0x7fb278157ca0 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.042+0000 7fb27e4b5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2780cfbb0 con 0x7fb27806d120 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb2777fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb278157ca0 0x7fb2780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb2777fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb278157ca0 0x7fb2780cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37034/0 (socket says 172.21.15.81:37034) 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb2777fe700 1 -- 172.21.15.81:0/2506422548 learned_addr learned my addr 172.21.15.81:0/2506422548 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb277fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb2781578d0 0x7fb27815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48220/0 (socket says 172.21.15.81:48220) 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb27ca52700 1 --2- 172.21.15.81:0/2506422548 >> v2:172.21.15.83:3300/0 conn(0x7fb27806d120 0x7fb27806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb2777fe700 1 -- 172.21.15.81:0/2506422548 >> v2:172.21.15.83:3300/0 conn(0x7fb27806d120 msgr2=0x7fb27806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb2777fe700 1 --2- 172.21.15.81:0/2506422548 >> v2:172.21.15.83:3300/0 conn(0x7fb27806d120 0x7fb27806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb2777fe700 1 -- 172.21.15.81:0/2506422548 >> v1:172.21.15.81:6789/0 conn(0x7fb2781578d0 legacy=0x7fb27815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb2777fe700 1 -- 172.21.15.81:0/2506422548 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2780cfe90 con 0x7fb278157ca0 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb276ffd700 1 -- 172.21.15.81:0/2506422548 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733153202 0 0) 0x7fb2780d07c0 con 0x7fb2781578d0 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb2777fe700 1 --2- 172.21.15.81:0/2506422548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb278157ca0 0x7fb2780cf4f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fb278068300 tx=0x7fb268009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4f8a8ae0e3e102 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb276ffd700 1 -- 172.21.15.81:0/2506422548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800b860 con 0x7fb278157ca0 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb276ffd700 1 -- 172.21.15.81:0/2506422548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26800b9c0 con 0x7fb278157ca0 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.043+0000 7fb276ffd700 1 -- 172.21.15.81:0/2506422548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800bd60 con 0x7fb278157ca0 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.044+0000 7fb27e4b5700 1 -- 172.21.15.81:0/2506422548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb278157ca0 msgr2=0x7fb2780cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.044+0000 7fb27e4b5700 1 --2- 172.21.15.81:0/2506422548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb278157ca0 0x7fb2780cf4f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fb278068300 tx=0x7fb268009250 comp rx=0 tx=0).stop 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.044+0000 7fb27e4b5700 1 -- 172.21.15.81:0/2506422548 shutdown_connections 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.044+0000 7fb27e4b5700 1 --2- 172.21.15.81:0/2506422548 >> v2:172.21.15.83:3300/0 conn(0x7fb27806d120 0x7fb27806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.044+0000 7fb27e4b5700 1 --2- 172.21.15.81:0/2506422548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb278157ca0 0x7fb2780cf4f0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.044+0000 7fb27e4b5700 1 -- 172.21.15.81:0/2506422548 >> 172.21.15.81:0/2506422548 conn(0x7fb27806bb90 msgr2=0x7fb27806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:08.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.044+0000 7fb27e4b5700 1 -- 172.21.15.81:0/2506422548 shutdown_connections 2023-10-06T02:53:08.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.044+0000 7fb27e4b5700 1 -- 172.21.15.81:0/2506422548 wait complete. 2023-10-06T02:53:08.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.045+0000 7fb27e4b5700 1 Processor -- start 2023-10-06T02:53:08.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.045+0000 7fb27e4b5700 1 -- start start 2023-10-06T02:53:08.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb27e4b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27806d120 0x7fb278153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb27e4b5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2781578d0 0x7fb278158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb27e4b5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb278157ca0 0x7fb278159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb27e4b5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780ac750 con 0x7fb27806d120 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb27e4b5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27816dd40 con 0x7fb2781578d0 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb27e4b5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27816e020 con 0x7fb278157ca0 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb277fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27806d120 0x7fb278153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb277fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27806d120 0x7fb278153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37042/0 (socket says 172.21.15.81:37042) 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb277fff700 1 -- 172.21.15.81:0/3478914125 learned_addr learned my addr 172.21.15.81:0/3478914125 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb27ca52700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb278157ca0 0x7fb278159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb277fff700 1 -- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb278157ca0 msgr2=0x7fb278159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb277fff700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb278157ca0 0x7fb278159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb2777fe700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2781578d0 0x7fb278158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb277fff700 1 -- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2781578d0 msgr2=0x7fb278158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb277fff700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2781578d0 0x7fb278158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb277fff700 1 -- 172.21.15.81:0/3478914125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680094f0 con 0x7fb27806d120 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb277fff700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27806d120 0x7fb278153240 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0011e0 tx=0x7fb26c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb25ffff700 1 -- 172.21.15.81:0/3478914125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c007300 con 0x7fb27806d120 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb25ffff700 1 -- 172.21.15.81:0/3478914125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c007460 con 0x7fb27806d120 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb25ffff700 1 -- 172.21.15.81:0/3478914125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c004830 con 0x7fb27806d120 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.046+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27816e300 con 0x7fb27806d120 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.047+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27816e940 con 0x7fb27806d120 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.047+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb278067ac0 con 0x7fb27806d120 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.048+0000 7fb25ffff700 1 -- 172.21.15.81:0/3478914125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb26c004be0 con 0x7fb27806d120 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.048+0000 7fb25ffff700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb264066f30 0x7fb2640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.048+0000 7fb25ffff700 1 -- 172.21.15.81:0/3478914125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb26c0838d0 con 0x7fb27806d120 2023-10-06T02:53:08.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.048+0000 7fb2777fe700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb264066f30 0x7fb2640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.049+0000 7fb2777fe700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb264066f30 0x7fb2640693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb278068300 tx=0x7fb268017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:08.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.052+0000 7fb25ffff700 1 -- 172.21.15.81:0/3478914125 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb26c050d60 con 0x7fb27806d120 2023-10-06T02:53:08.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.233+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb2780d0170 con 0x7fb27806d120 2023-10-06T02:53:08.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.237+0000 7fb25ffff700 1 -- 172.21.15.81:0/3478914125 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb26c0180a0 con 0x7fb27806d120 2023-10-06T02:53:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb264066f30 msgr2=0x7fb2640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb264066f30 0x7fb2640693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb278068300 tx=0x7fb268017000 comp rx=0 tx=0).stop 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27806d120 msgr2=0x7fb278153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27806d120 0x7fb278153240 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0011e0 tx=0x7fb26c007e10 comp rx=0 tx=0).stop 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 shutdown_connections 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb278157ca0 0x7fb278159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27806d120 0x7fb278153240 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb264066f30 0x7fb2640693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 --2- 172.21.15.81:0/3478914125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2781578d0 0x7fb278158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 >> 172.21.15.81:0/3478914125 conn(0x7fb27806bb90 msgr2=0x7fb27806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 shutdown_connections 2023-10-06T02:53:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.239+0000 7fb27e4b5700 1 -- 172.21.15.81:0/3478914125 wait complete. 2023-10-06T02:53:08.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-06T02:53:08.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.365+0000 7f8fba248700 1 Processor -- start 2023-10-06T02:53:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.365+0000 7f8fba248700 1 -- start start 2023-10-06T02:53:08.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.366+0000 7f8fba248700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fb4159f10 0x7f8fb4068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.366+0000 7f8fba248700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb40cee10 con 0x7f8fb4068cc0 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.366+0000 7f8fba248700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb40cd040 con 0x7f8fb4159b40 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.366+0000 7f8fba248700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4069140 con 0x7f8fb4159f10 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.366+0000 7f8fb9a47700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8fb4068cc0 0x7f8fb40cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48222/0 (socket says 172.21.15.81:48222) 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fb9a47700 1 -- 172.21.15.81:0/965363484 learned_addr learned my addr 172.21.15.81:0/965363484 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fb8a45700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fb4159f10 0x7f8fb4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770523187 0 0) 0x7f8fb40cee10 con 0x7f8fb4068cc0 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fa0003570 con 0x7f8fb4068cc0 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224488179 0 0) 0x7f8fb40cd040 con 0x7f8fb4159b40 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb40cee10 con 0x7f8fb4159b40 2023-10-06T02:53:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3064246219 0 0) 0x7f8fa0003570 con 0x7f8fb4068cc0 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fb4159f10 msgr2=0x7f8fb4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fb4159f10 0x7f8fb4068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 >> v1:172.21.15.83:6789/0 conn(0x7f8fb4159b40 legacy=0x7f8fb40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40cd320 con 0x7f8fb4068cc0 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f8fac0017f0 con 0x7f8fb4068cc0 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 >> v1:172.21.15.81:6789/0 conn(0x7f8fb4068cc0 legacy=0x7f8fb40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fa0003c20 0x7f8fa0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fa0004810 0x7f8fa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa00051c0 0x7f8fa000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4069140 con 0x7f8fa00051c0 2023-10-06T02:53:08.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa000c020 con 0x7f8fa0004810 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa000c1e0 con 0x7f8fa0003c20 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fb8a45700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fb4159f10 0x7f8fb4068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fb9a47700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa00051c0 0x7f8fa000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fb9246700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fa0003c20 0x7f8fa0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fb8a45700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fa0004810 0x7f8fa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.367+0000 7f8fb9a47700 1 -- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fa0003c20 msgr2=0x7f8fa0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fb9a47700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fa0003c20 0x7f8fa0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fb9a47700 1 -- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fa0004810 msgr2=0x7f8fa0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fb9a47700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fa0004810 0x7f8fa0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fb9a47700 1 -- 172.21.15.81:0/965363484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0003570 con 0x7f8fa00051c0 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fb8a45700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fa0004810 0x7f8fa0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fb9a47700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa00051c0 0x7f8fa000ba60 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00a8f0 tx=0x7f8fac002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7f62de226acdad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0070d0 con 0x7f8fa00051c0 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac007230 con 0x7f8fa00051c0 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fabfff700 1 -- 172.21.15.81:0/965363484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0075f0 con 0x7f8fa00051c0 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fba248700 1 -- 172.21.15.81:0/965363484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa00051c0 msgr2=0x7f8fa000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fba248700 1 --2- 172.21.15.81:0/965363484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa00051c0 0x7f8fa000ba60 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00a8f0 tx=0x7f8fac002190 comp rx=0 tx=0).stop 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fb9a47700 1 -- 172.21.15.81:0/965363484 reap_dead start 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fba248700 1 -- 172.21.15.81:0/965363484 shutdown_connections 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fba248700 1 -- 172.21.15.81:0/965363484 >> 172.21.15.81:0/965363484 conn(0x7f8fb40cd660 msgr2=0x7f8fb40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fba248700 1 -- 172.21.15.81:0/965363484 shutdown_connections 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.368+0000 7f8fba248700 1 -- 172.21.15.81:0/965363484 wait complete. 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.369+0000 7f8fba248700 1 Processor -- start 2023-10-06T02:53:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.370+0000 7f8fba248700 1 -- start start 2023-10-06T02:53:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.370+0000 7f8fba248700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fa00051c0 0x7f8fb4158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.370+0000 7f8fba248700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb415b0d0 0x7f8fb415e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.370+0000 7f8fba248700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fb416a3a0 0x7f8fb40c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.370+0000 7f8fba248700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415c310 con 0x7f8fb415b0d0 2023-10-06T02:53:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.370+0000 7f8fba248700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4159000 con 0x7f8fb416a3a0 2023-10-06T02:53:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.370+0000 7f8fba248700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415b740 con 0x7f8fa00051c0 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.370+0000 7f8fb8a45700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb415b0d0 0x7f8fb415e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.370+0000 7f8fb8a45700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb415b0d0 0x7f8fb415e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37060/0 (socket says 172.21.15.81:37060) 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fb8a45700 1 -- 172.21.15.81:0/3355855312 learned_addr learned my addr 172.21.15.81:0/3355855312 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fb9246700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fa00051c0 0x7f8fb4158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fb9a47700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fb416a3a0 0x7f8fb40c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fb8a45700 1 -- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fa00051c0 msgr2=0x7f8fb4158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fb8a45700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fa00051c0 0x7f8fb4158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fb8a45700 1 -- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fb416a3a0 msgr2=0x7f8fb40c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fb8a45700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fb416a3a0 0x7f8fb40c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fb8a45700 1 -- 172.21.15.81:0/3355855312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb415b9e0 con 0x7f8fb415b0d0 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fb8a45700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb415b0d0 0x7f8fb415e400 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4011910 tx=0x7f8fa4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fa97fa700 1 -- 172.21.15.81:0/3355855312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400f700 con 0x7f8fb415b0d0 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fa97fa700 1 -- 172.21.15.81:0/3355855312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400f860 con 0x7f8fb415b0d0 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb415bcc0 con 0x7f8fb415b0d0 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fa97fa700 1 -- 172.21.15.81:0/3355855312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400fc20 con 0x7f8fb415b0d0 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.371+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb415e940 con 0x7f8fb415b0d0 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.372+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb415c4c0 con 0x7f8fb415b0d0 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.373+0000 7f8fa97fa700 1 -- 172.21.15.81:0/3355855312 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fa400fd80 con 0x7f8fb415b0d0 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.373+0000 7f8fa97fa700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8f98066f30 0x7f8f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.373+0000 7f8fa97fa700 1 -- 172.21.15.81:0/3355855312 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8fa4084bb0 con 0x7f8fb415b0d0 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.373+0000 7f8fb9246700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8f98066f30 0x7f8f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.374+0000 7f8fb9246700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8f98066f30 0x7f8f980693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0007e20 tx=0x7f8fb0007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:08.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.377+0000 7f8fa97fa700 1 -- 172.21.15.81:0/3355855312 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fb415c4c0 con 0x7f8fb415b0d0 2023-10-06T02:53:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.635+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f8fb4063e90 con 0x7f8fb415b0d0 2023-10-06T02:53:08.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.900+0000 7f8fa97fa700 1 -- 172.21.15.81:0/3355855312 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v368) v1 ==== 140+0+0 (secure 0 0 0) 0x7f8fa4051fe0 con 0x7f8fb415b0d0 2023-10-06T02:53:08.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8f98066f30 msgr2=0x7f8f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8f98066f30 0x7f8f980693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0007e20 tx=0x7f8fb0007d10 comp rx=0 tx=0).stop 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb415b0d0 msgr2=0x7f8fb415e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb415b0d0 0x7f8fb415e400 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4011910 tx=0x7f8fa4008040 comp rx=0 tx=0).stop 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 shutdown_connections 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8f98066f30 0x7f8f980693e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fb416a3a0 0x7f8fb40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8fa00051c0 0x7f8fb4158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 --2- 172.21.15.81:0/3355855312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb415b0d0 0x7f8fb415e400 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 >> 172.21.15.81:0/3355855312 conn(0x7f8fb40cd660 msgr2=0x7f8fb406e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 shutdown_connections 2023-10-06T02:53:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:08.902+0000 7f8fba248700 1 -- 172.21.15.81:0/3355855312 wait complete. 2023-10-06T02:53:08.915 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-06T02:53:08.916 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-10-06T02:53:08.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-06T02:53:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.029+0000 7f9729e52700 1 Processor -- start 2023-10-06T02:53:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.029+0000 7f9729e52700 1 -- start start 2023-10-06T02:53:09.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.030+0000 7f9729e52700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f972406d830 0x7f97240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:09.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.030+0000 7f9729e52700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97240d07c0 con 0x7f97241578d0 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.030+0000 7f9729e52700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97240cfbb0 con 0x7f9724157ca0 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.030+0000 7f9729e52700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97240cfe90 con 0x7f972406d830 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.030+0000 7f97237fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f97241578d0 0x7f972415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48232/0 (socket says 172.21.15.81:48232) 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.030+0000 7f97237fe700 1 -- 172.21.15.81:0/3221359819 learned_addr learned my addr 172.21.15.81:0/3221359819 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f9723fff700 1 --2- 172.21.15.81:0/3221359819 >> v2:172.21.15.83:3300/0 conn(0x7f972406d830 0x7f97240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591273398 0 0) 0x7f97240d07c0 con 0x7f97241578d0 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9710003570 con 0x7f97241578d0 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758144513 0 0) 0x7f97240cfbb0 con 0x7f9724157ca0 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97240d07c0 con 0x7f9724157ca0 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2577297959 0 0) 0x7f9710003570 con 0x7f97241578d0 2023-10-06T02:53:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 >> v2:172.21.15.83:3300/0 conn(0x7f972406d830 msgr2=0x7f97240cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 --2- 172.21.15.81:0/3221359819 >> v2:172.21.15.83:3300/0 conn(0x7f972406d830 0x7f97240cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 >> v1:172.21.15.83:6789/0 conn(0x7f9724157ca0 legacy=0x7f972406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240d0170 con 0x7f97241578d0 2023-10-06T02:53:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f97140017f0 con 0x7f97241578d0 2023-10-06T02:53:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 >> v1:172.21.15.81:6789/0 conn(0x7f97241578d0 legacy=0x7f972415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9710004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9710004810 0x7f9710004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9710005210 0x7f971000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97240cfe90 con 0x7f9710003c40 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971000c130 con 0x7f9710005210 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971000c2c0 con 0x7f9710004810 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97237fe700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9710004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f9723fff700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9710005210 0x7f971000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f9722ffd700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9710004810 0x7f9710004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97237fe700 1 -- 172.21.15.81:0/3221359819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9710004810 msgr2=0x7f9710004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97237fe700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9710004810 0x7f9710004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97237fe700 1 -- 172.21.15.81:0/3221359819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9710005210 msgr2=0x7f971000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97237fe700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9710005210 0x7f971000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f97237fe700 1 -- 172.21.15.81:0/3221359819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710003570 con 0x7f9710003c40 2023-10-06T02:53:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f9723fff700 1 -- 172.21.15.81:0/3221359819 reap_dead start 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.031+0000 7f9722ffd700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9710004810 0x7f9710004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f97237fe700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9710004030 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f971400a850 tx=0x7f97140020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b67eb4739a6a68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140070f0 con 0x7f9710003c40 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9714007270 con 0x7f9710003c40 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f97227fc700 1 -- 172.21.15.81:0/3221359819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714007630 con 0x7f9710003c40 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f9729e52700 1 -- 172.21.15.81:0/3221359819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 msgr2=0x7f9710004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f9729e52700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9710004030 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f971400a850 tx=0x7f97140020c0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f9729e52700 1 -- 172.21.15.81:0/3221359819 shutdown_connections 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f9729e52700 1 --2- 172.21.15.81:0/3221359819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9710004030 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f9729e52700 1 -- 172.21.15.81:0/3221359819 >> 172.21.15.81:0/3221359819 conn(0x7f972406bb90 msgr2=0x7f972406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f9729e52700 1 -- 172.21.15.81:0/3221359819 shutdown_connections 2023-10-06T02:53:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.032+0000 7f9729e52700 1 -- 172.21.15.81:0/3221359819 wait complete. 2023-10-06T02:53:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.033+0000 7f9729e52700 1 Processor -- start 2023-10-06T02:53:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f9729e52700 1 -- start start 2023-10-06T02:53:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f9729e52700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9724151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f9729e52700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f972415da40 0x7f972415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f9729e52700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97240aa900 0x7f97240aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f9729e52700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972415e3f0 con 0x7f9710003c40 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f9729e52700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972416ba10 con 0x7f97240aa900 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f9729e52700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972416ae40 con 0x7f972415da40 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f97237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9724151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f97237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9724151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37086/0 (socket says 172.21.15.81:37086) 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f97237fe700 1 -- 172.21.15.81:0/325393382 learned_addr learned my addr 172.21.15.81:0/325393382 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f9722ffd700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f972415da40 0x7f972415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.034+0000 7f9723fff700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97240aa900 0x7f97240aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f97237fe700 1 -- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f972415da40 msgr2=0x7f972415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f97237fe700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f972415da40 0x7f972415deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f97237fe700 1 -- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97240aa900 msgr2=0x7f97240aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f97237fe700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97240aa900 0x7f97240aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f97237fe700 1 -- 172.21.15.81:0/325393382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972416b0e0 con 0x7f9710003c40 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f97237fe700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9724151820 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f9714012000 tx=0x7f9714016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f971b7fe700 1 -- 172.21.15.81:0/325393382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140016f0 con 0x7f9710003c40 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f971b7fe700 1 -- 172.21.15.81:0/325393382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9714000f40 con 0x7f9710003c40 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972416b3c0 con 0x7f9710003c40 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f971b7fe700 1 -- 172.21.15.81:0/325393382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140073e0 con 0x7f9710003c40 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.035+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9724151d60 con 0x7f9710003c40 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.036+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9724067ac0 con 0x7f9710003c40 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.036+0000 7f971b7fe700 1 -- 172.21.15.81:0/325393382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f971401e430 con 0x7f9710003c40 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.037+0000 7f971b7fe700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9704066f60 0x7f9704069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:09.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.037+0000 7f971b7fe700 1 -- 172.21.15.81:0/325393382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9714086bf0 con 0x7f9710003c40 2023-10-06T02:53:09.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.037+0000 7f9722ffd700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9704066f60 0x7f9704069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:09.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.037+0000 7f9722ffd700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9704066f60 0x7f9704069410 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f970c007bc0 tx=0x7f970c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:09.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.041+0000 7f971b7fe700 1 -- 172.21.15.81:0/325393382 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9714054000 con 0x7f9710003c40 2023-10-06T02:53:09.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.295+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f972415e3f0 con 0x7f9710003c40 2023-10-06T02:53:09.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.905+0000 7f971b7fe700 1 -- 172.21.15.81:0/325393382 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v369) v1 ==== 135+0+0 (secure 0 0 0) 0x7f9714057620 con 0x7f9710003c40 2023-10-06T02:53:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.907+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9704066f60 msgr2=0x7f9704069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.907+0000 7f9729e52700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9704066f60 0x7f9704069410 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f970c007bc0 tx=0x7f970c009040 comp rx=0 tx=0).stop 2023-10-06T02:53:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.907+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 msgr2=0x7f9724151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.907+0000 7f9729e52700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9724151820 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f9714012000 tx=0x7f9714016000 comp rx=0 tx=0).stop 2023-10-06T02:53:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.907+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 shutdown_connections 2023-10-06T02:53:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.907+0000 7f9729e52700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9704066f60 0x7f9704069410 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.908+0000 7f9729e52700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97240aa900 0x7f97240aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.908+0000 7f9729e52700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9710003c40 0x7f9724151820 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.908+0000 7f9729e52700 1 --2- 172.21.15.81:0/325393382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f972415da40 0x7f972415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.908+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 >> 172.21.15.81:0/325393382 conn(0x7f972406bb90 msgr2=0x7f9724068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.908+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 shutdown_connections 2023-10-06T02:53:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:09.908+0000 7f9729e52700 1 -- 172.21.15.81:0/325393382 wait complete. 2023-10-06T02:53:09.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:53:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.038+0000 7fc755417700 1 Processor -- start 2023-10-06T02:53:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.038+0000 7fc755417700 1 -- start start 2023-10-06T02:53:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc755417700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc7500d0f50 0x7fc75006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc755417700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc75006d530 0x7fc75015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc755417700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75006d990 con 0x7fc7500d0b80 2023-10-06T02:53:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc755417700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75015a690 con 0x7fc75006d530 2023-10-06T02:53:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc755417700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7500cf2d0 con 0x7fc7500d0f50 2023-10-06T02:53:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc754c16700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc75006d530 0x7fc75015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc74ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc7500d0b80 0x7fc7500cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48248/0 (socket says 172.21.15.81:48248) 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc74ffff700 1 -- 172.21.15.81:0/3534597057 learned_addr learned my addr 172.21.15.81:0/3534597057 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc754c16700 1 -- 172.21.15.81:0/3534597057 >> v2:172.21.15.83:3300/0 conn(0x7fc7500d0f50 msgr2=0x7fc75006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc74f7fe700 1 --2- 172.21.15.81:0/3534597057 >> v2:172.21.15.83:3300/0 conn(0x7fc7500d0f50 0x7fc75006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc754c16700 1 --2- 172.21.15.81:0/3534597057 >> v2:172.21.15.83:3300/0 conn(0x7fc7500d0f50 0x7fc75006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc74effd700 1 -- 172.21.15.81:0/3534597057 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182592429 0 0) 0x7fc75006d990 con 0x7fc7500d0b80 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc754c16700 1 -- 172.21.15.81:0/3534597057 >> v1:172.21.15.81:6789/0 conn(0x7fc7500d0b80 legacy=0x7fc7500cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc754c16700 1 -- 172.21.15.81:0/3534597057 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500d0480 con 0x7fc75006d530 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.039+0000 7fc754c16700 1 --2- 172.21.15.81:0/3534597057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc75006d530 0x7fc75015b320 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fc7500cecc0 tx=0x7fc748009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afc73037bd56d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc74effd700 1 -- 172.21.15.81:0/3534597057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74800e070 con 0x7fc75006d530 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc74effd700 1 -- 172.21.15.81:0/3534597057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74800bc30 con 0x7fc75006d530 2023-10-06T02:53:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc74effd700 1 -- 172.21.15.81:0/3534597057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748012430 con 0x7fc75006d530 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc755417700 1 -- 172.21.15.81:0/3534597057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc75006d530 msgr2=0x7fc75015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc755417700 1 --2- 172.21.15.81:0/3534597057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc75006d530 0x7fc75015b320 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fc7500cecc0 tx=0x7fc748009780 comp rx=0 tx=0).stop 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc755417700 1 -- 172.21.15.81:0/3534597057 shutdown_connections 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc755417700 1 --2- 172.21.15.81:0/3534597057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc75006d530 0x7fc75015b320 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc755417700 1 --2- 172.21.15.81:0/3534597057 >> v2:172.21.15.83:3300/0 conn(0x7fc7500d0f50 0x7fc75006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc755417700 1 -- 172.21.15.81:0/3534597057 >> 172.21.15.81:0/3534597057 conn(0x7fc750063230 msgr2=0x7fc750063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc755417700 1 -- 172.21.15.81:0/3534597057 shutdown_connections 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.040+0000 7fc755417700 1 -- 172.21.15.81:0/3534597057 wait complete. 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.041+0000 7fc755417700 1 Processor -- start 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.041+0000 7fc755417700 1 -- start start 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc755417700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc75006d530 0x7fc7500c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc755417700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc7500c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc755417700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7500d0f50 0x7fc750146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc755417700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc750147930 con 0x7fc7500d0b80 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc755417700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75014a8b0 con 0x7fc7500d0f50 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc755417700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500ca390 con 0x7fc75006d530 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc74f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc7500c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc74f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc7500c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37100/0 (socket says 172.21.15.81:37100) 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc74f7fe700 1 -- 172.21.15.81:0/2915293137 learned_addr learned my addr 172.21.15.81:0/2915293137 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc754c16700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7500d0f50 0x7fc750146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc74ffff700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc75006d530 0x7fc7500c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc74f7fe700 1 -- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc75006d530 msgr2=0x7fc7500c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc74f7fe700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc75006d530 0x7fc7500c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc74f7fe700 1 -- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7500d0f50 msgr2=0x7fc750146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc74f7fe700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7500d0f50 0x7fc750146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.042+0000 7fc74f7fe700 1 -- 172.21.15.81:0/2915293137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc748009a20 con 0x7fc7500d0b80 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.043+0000 7fc74f7fe700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc7500c9180 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc74400c880 tx=0x7fc744008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.043+0000 7fc737fff700 1 -- 172.21.15.81:0/2915293137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744011600 con 0x7fc7500d0b80 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.043+0000 7fc737fff700 1 -- 172.21.15.81:0/2915293137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc744011780 con 0x7fc7500d0b80 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.043+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7500ca670 con 0x7fc7500d0b80 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.043+0000 7fc737fff700 1 -- 172.21.15.81:0/2915293137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744011b40 con 0x7fc7500d0b80 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.043+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7500caa00 con 0x7fc7500d0b80 2023-10-06T02:53:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.044+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7500ca800 con 0x7fc7500d0b80 2023-10-06T02:53:10.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.044+0000 7fc737fff700 1 -- 172.21.15.81:0/2915293137 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc744018360 con 0x7fc7500d0b80 2023-10-06T02:53:10.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.044+0000 7fc737fff700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc73c066f30 0x7fc73c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.044+0000 7fc737fff700 1 -- 172.21.15.81:0/2915293137 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc744084110 con 0x7fc7500d0b80 2023-10-06T02:53:10.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.045+0000 7fc74ffff700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc73c066f30 0x7fc73c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.045+0000 7fc74ffff700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc73c066f30 0x7fc73c0693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc7400011e0 tx=0x7fc740009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:10.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.049+0000 7fc737fff700 1 -- 172.21.15.81:0/2915293137 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc744054fb0 con 0x7fc7500d0b80 2023-10-06T02:53:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.229+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc75006dc00 con 0x7fc7500d0b80 2023-10-06T02:53:10.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.235+0000 7fc737fff700 1 -- 172.21.15.81:0/2915293137 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc74405a0c0 con 0x7fc7500d0b80 2023-10-06T02:53:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc73c066f30 msgr2=0x7fc73c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc73c066f30 0x7fc73c0693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc7400011e0 tx=0x7fc740009040 comp rx=0 tx=0).stop 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 msgr2=0x7fc7500c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc7500c9180 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc74400c880 tx=0x7fc744008040 comp rx=0 tx=0).stop 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 shutdown_connections 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc73c066f30 0x7fc73c0693e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7500d0f50 0x7fc750146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc75006d530 0x7fc7500c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 --2- 172.21.15.81:0/2915293137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc7500c9180 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 >> 172.21.15.81:0/2915293137 conn(0x7fc750063230 msgr2=0x7fc7500b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 shutdown_connections 2023-10-06T02:53:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.237+0000 7fc755417700 1 -- 172.21.15.81:0/2915293137 wait complete. 2023-10-06T02:53:10.250 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:53:10.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:53:10.291 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:53:10.343 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:53:10.344 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:53:10.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:53:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.458+0000 7f4ff4b63700 1 Processor -- start 2023-10-06T02:53:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.458+0000 7f4ff4b63700 1 -- start start 2023-10-06T02:53:10.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4ff4b63700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ff01578d0 0x7f4ff00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4ff4b63700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4ff0157ca0 0x7f4ff015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4ff4b63700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00d07c0 con 0x7f4ff006d120 2023-10-06T02:53:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4ff4b63700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff00cfbb0 con 0x7f4ff0157ca0 2023-10-06T02:53:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4ff4b63700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00cfe90 con 0x7f4ff01578d0 2023-10-06T02:53:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4feed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ff006d120 0x7f4ff015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52346/0 (socket says 172.21.15.81:52346) 2023-10-06T02:53:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4feed9d700 1 -- 172.21.15.81:0/3388538543 learned_addr learned my addr 172.21.15.81:0/3388538543 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576801379 0 0) 0x7f4ff00d07c0 con 0x7f4ff006d120 2023-10-06T02:53:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fdc003570 con 0x7f4ff006d120 2023-10-06T02:53:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fe7fff700 1 --2- 172.21.15.81:0/3388538543 >> v2:172.21.15.83:3300/0 conn(0x7f4ff0157ca0 0x7f4ff015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fee59c700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ff01578d0 0x7f4ff00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1704197367 0 0) 0x7f4fdc003570 con 0x7f4ff006d120 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ff01578d0 msgr2=0x7f4ff00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ff01578d0 0x7f4ff00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 >> v2:172.21.15.83:3300/0 conn(0x7f4ff0157ca0 msgr2=0x7f4ff015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 --2- 172.21.15.81:0/3388538543 >> v2:172.21.15.83:3300/0 conn(0x7f4ff0157ca0 0x7f4ff015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00d0170 con 0x7f4ff006d120 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f4fe80017f0 con 0x7f4ff006d120 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 >> v1:172.21.15.81:6789/0 conn(0x7f4ff006d120 legacy=0x7f4ff015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4fdc003a60 0x7f4fdc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ff01578d0 0x7f4fdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc004d50 0x7f4fdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00cfbb0 con 0x7f4fdc004d50 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00cfe90 con 0x7f4fdc003a60 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc00bb90 con 0x7f4ff01578d0 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4feed9d700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc004d50 0x7f4fdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.459+0000 7f4fee59c700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4fdc003a60 0x7f4fdc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4fe7fff700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ff01578d0 0x7f4fdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4feed9d700 1 -- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ff01578d0 msgr2=0x7f4fdc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4feed9d700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ff01578d0 0x7f4fdc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4feed9d700 1 -- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4fdc003a60 msgr2=0x7f4fdc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4feed9d700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4fdc003a60 0x7f4fdc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4feed9d700 1 -- 172.21.15.81:0/3388538543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc003570 con 0x7f4fdc004d50 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4feed9d700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc004d50 0x7f4fdc0051c0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800a970 tx=0x7f4ff00d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f045e9313a8d43c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80070d0 con 0x7f4fdc004d50 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe8007230 con 0x7f4fdc004d50 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4fedd9b700 1 -- 172.21.15.81:0/3388538543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80075f0 con 0x7f4fdc004d50 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4ff4b63700 1 -- 172.21.15.81:0/3388538543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc004d50 msgr2=0x7f4fdc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4ff4b63700 1 --2- 172.21.15.81:0/3388538543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc004d50 0x7f4fdc0051c0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800a970 tx=0x7f4ff00d0730 comp rx=0 tx=0).stop 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.460+0000 7f4feed9d700 1 -- 172.21.15.81:0/3388538543 reap_dead start 2023-10-06T02:53:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.461+0000 7f4ff4b63700 1 -- 172.21.15.81:0/3388538543 shutdown_connections 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.461+0000 7f4ff4b63700 1 -- 172.21.15.81:0/3388538543 >> 172.21.15.81:0/3388538543 conn(0x7f4ff006bb90 msgr2=0x7f4ff006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.461+0000 7f4ff4b63700 1 -- 172.21.15.81:0/3388538543 shutdown_connections 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.461+0000 7f4ff4b63700 1 -- 172.21.15.81:0/3388538543 wait complete. 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4ff4b63700 1 Processor -- start 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4ff4b63700 1 -- start start 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4ff4b63700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4fdc004d50 0x7f4ff0154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4ff4b63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0158760 0x7f4ff01456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4ff4b63700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ff015c610 0x7f4ff015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4ff4b63700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff015cf80 con 0x7f4ff0158760 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4ff4b63700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff0158bd0 con 0x7f4ff015c610 2023-10-06T02:53:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4ff4b63700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff0155560 con 0x7f4fdc004d50 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4fe7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0158760 0x7f4ff01456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.462+0000 7f4fe7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0158760 0x7f4ff01456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47976/0 (socket says 172.21.15.81:47976) 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe7fff700 1 -- 172.21.15.81:0/617826824 learned_addr learned my addr 172.21.15.81:0/617826824 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fee59c700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4fdc004d50 0x7f4ff0154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4feed9d700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ff015c610 0x7f4ff015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe7fff700 1 -- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4fdc004d50 msgr2=0x7f4ff0154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe7fff700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4fdc004d50 0x7f4ff0154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe7fff700 1 -- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ff015c610 msgr2=0x7f4ff015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe7fff700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ff015c610 0x7f4ff015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe7fff700 1 -- 172.21.15.81:0/617826824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff0155840 con 0x7f4ff0158760 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe7fff700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0158760 0x7f4ff01456c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8010a20 tx=0x7f4fd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe67fc700 1 -- 172.21.15.81:0/617826824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8010e60 con 0x7f4ff0158760 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe67fc700 1 -- 172.21.15.81:0/617826824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd800e8d0 con 0x7f4ff0158760 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff0155b20 con 0x7f4ff0158760 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4fe67fc700 1 -- 172.21.15.81:0/617826824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800ecd0 con 0x7f4ff0158760 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.463+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff01560e0 con 0x7f4ff0158760 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.464+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff0067ac0 con 0x7f4ff0158760 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.464+0000 7f4fe67fc700 1 -- 172.21.15.81:0/617826824 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fd8014640 con 0x7f4ff0158760 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.465+0000 7f4fe67fc700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4fd0066f30 0x7f4fd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.465+0000 7f4fe67fc700 1 -- 172.21.15.81:0/617826824 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4fd80848f0 con 0x7f4ff0158760 2023-10-06T02:53:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.465+0000 7f4fee59c700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4fd0066f30 0x7f4fd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.465+0000 7f4fee59c700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4fd0066f30 0x7f4fd00693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0006fd0 tx=0x7f4fe0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.469+0000 7f4fe67fc700 1 -- 172.21.15.81:0/617826824 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fd8051d00 con 0x7f4ff0158760 2023-10-06T02:53:10.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.692+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ff0158d10 con 0x7f4ff0158760 2023-10-06T02:53:10.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.693+0000 7f4fe67fc700 1 -- 172.21.15.81:0/617826824 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f4fd8022de0 con 0x7f4ff0158760 2023-10-06T02:53:10.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2478339548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2478339548},{"type":"v1","addr":"172.21.15.83:6837","nonce":2478339548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3555083751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3555083751},{"type":"v1","addr":"172.21.15.83:6836","nonce":3555083751}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3323159920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3323159920},{"type":"v1","addr":"172.21.15.81:6834","nonce":3323159920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1350613629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1350613629},{"type":"v1","addr":"172.21.15.81:6835","nonce":1350613629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-10-06T02:53:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4fd0066f30 msgr2=0x7f4fd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4fd0066f30 0x7f4fd00693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0006fd0 tx=0x7f4fe0008040 comp rx=0 tx=0).stop 2023-10-06T02:53:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0158760 msgr2=0x7f4ff01456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0158760 0x7f4ff01456c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8010a20 tx=0x7f4fd800b040 comp rx=0 tx=0).stop 2023-10-06T02:53:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 shutdown_connections 2023-10-06T02:53:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4fd0066f30 0x7f4fd00693e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ff015c610 0x7f4ff015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4fdc004d50 0x7f4ff0154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 --2- 172.21.15.81:0/617826824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0158760 0x7f4ff01456c0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 >> 172.21.15.81:0/617826824 conn(0x7f4ff006bb90 msgr2=0x7f4ff0068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 shutdown_connections 2023-10-06T02:53:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.695+0000 7f4ff4b63700 1 -- 172.21.15.81:0/617826824 wait complete. 2023-10-06T02:53:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 69 2023-10-06T02:53:10.708 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:53:10.708 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:53:10.708 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:53:10.709 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:53:10.709 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:53:10.709 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:53:10.709 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:53:10.709 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:53:10.709 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:53:10.709 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:53:10.710 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:53:10.710 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:53:10.710 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:53:10.710 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:53:10.710 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:53:10.710 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:53:10.716 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:53:10.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:53:10.717 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:53:10.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:53:10.720 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:53:10.721 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:53:10.721 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:53:10.721 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:53:10.759 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:53:10.759 DEBUG:teuthology.parallel:result is None 2023-10-06T02:53:10.760 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:53:10.760 DEBUG:teuthology.parallel:result is None 2023-10-06T02:53:10.763 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:53:10.763 DEBUG:teuthology.parallel:result is None 2023-10-06T02:53:10.763 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:53:10.764 DEBUG:teuthology.parallel:result is None 2023-10-06T02:53:10.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:53:10.832 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:53:10.833 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:53:10.844 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:53:10.845 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:53:10.845 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-10-06T02:53:10.843+0000 7fa901090700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T02:53:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.884+0000 7faedf59e700 1 Processor -- start 2023-10-06T02:53:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.884+0000 7faedf59e700 1 -- start start 2023-10-06T02:53:10.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedf59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faee0159f10 0x7faee0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedf59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faee0068cc0 0x7faee00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedf59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00cee10 con 0x7faee0159b40 2023-10-06T02:53:10.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedf59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee0069140 con 0x7faee0159f10 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedf59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee00cd040 con 0x7faee0068cc0 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faede59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faee0159b40 0x7faee00cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52354/0 (socket says 172.21.15.81:52354) 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faede59c700 1 -- 172.21.15.81:0/3845590655 learned_addr learned my addr 172.21.15.81:0/3845590655 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670193335 0 0) 0x7faee00cee10 con 0x7faee0159b40 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec8003570 con 0x7faee0159b40 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faeddd9b700 1 --2- 172.21.15.81:0/3845590655 >> v2:172.21.15.83:3300/0 conn(0x7faee0159f10 0x7faee0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faeded9d700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faee0068cc0 0x7faee00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4179072818 0 0) 0x7faec8003570 con 0x7faee0159b40 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faee0068cc0 msgr2=0x7faee00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:10.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedd59a700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faee0068cc0 0x7faee00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 >> v2:172.21.15.83:3300/0 conn(0x7faee0159f10 msgr2=0x7faee0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.885+0000 7faedd59a700 1 --2- 172.21.15.81:0/3845590655 >> v2:172.21.15.83:3300/0 conn(0x7faee0159f10 0x7faee0068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00cd320 con 0x7faee0159b40 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7faed0001470 con 0x7faee0159b40 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 >> v1:172.21.15.81:6789/0 conn(0x7faee0159b40 legacy=0x7faee00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faee0068cc0 0x7faec8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec8003fe0 0x7faec8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8004d50 0x7faec80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0069140 con 0x7faec8003fe0 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00cd040 con 0x7faec8004d50 2023-10-06T02:53:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec800ba90 con 0x7faee0068cc0 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faeddd9b700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec8003fe0 0x7faec8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faede59c700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faee0068cc0 0x7faec8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faeded9d700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8004d50 0x7faec80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faeddd9b700 1 -- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faee0068cc0 msgr2=0x7faec8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faeddd9b700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faee0068cc0 0x7faec8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faeddd9b700 1 -- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8004d50 msgr2=0x7faec80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faeddd9b700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec8004d50 0x7faec80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faeddd9b700 1 -- 172.21.15.81:0/3845590655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8003570 con 0x7faec8003fe0 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faeddd9b700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec8003fe0 0x7faec8004810 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7faed4009c00 tx=0x7faed40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a490dec5b5b940 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed400e6b0 con 0x7faec8003fe0 2023-10-06T02:53:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed400e810 con 0x7faec8003fe0 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.886+0000 7faedd59a700 1 -- 172.21.15.81:0/3845590655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed400ebd0 con 0x7faec8003fe0 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.887+0000 7faedf59e700 1 -- 172.21.15.81:0/3845590655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec8003fe0 msgr2=0x7faec8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.887+0000 7faedf59e700 1 --2- 172.21.15.81:0/3845590655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec8003fe0 0x7faec8004810 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7faed4009c00 tx=0x7faed40091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.887+0000 7faeded9d700 1 -- 172.21.15.81:0/3845590655 reap_dead start 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.887+0000 7faedf59e700 1 -- 172.21.15.81:0/3845590655 shutdown_connections 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.887+0000 7faedf59e700 1 -- 172.21.15.81:0/3845590655 >> 172.21.15.81:0/3845590655 conn(0x7faee00cd660 msgr2=0x7faee00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.887+0000 7faedf59e700 1 -- 172.21.15.81:0/3845590655 shutdown_connections 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.887+0000 7faedf59e700 1 -- 172.21.15.81:0/3845590655 wait complete. 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.888+0000 7faedf59e700 1 Processor -- start 2023-10-06T02:53:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.888+0000 7faedf59e700 1 -- start start 2023-10-06T02:53:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faedf59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8003fe0 0x7faee015e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faedf59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faee015bd30 0x7faee015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faedf59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0147610 0x7faee00b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faedf59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee015c4a0 con 0x7faee0147610 2023-10-06T02:53:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faedf59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee015c780 con 0x7faee015bd30 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faedf59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee015ca60 con 0x7faec8003fe0 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeded9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0147610 0x7faee00b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeded9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0147610 0x7faee00b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48032/0 (socket says 172.21.15.81:48032) 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeded9d700 1 -- 172.21.15.81:0/3414123886 learned_addr learned my addr 172.21.15.81:0/3414123886 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faede59c700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8003fe0 0x7faee015e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeddd9b700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faee015bd30 0x7faee015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeded9d700 1 -- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8003fe0 msgr2=0x7faee015e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeded9d700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8003fe0 0x7faee015e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeded9d700 1 -- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faee015bd30 msgr2=0x7faee015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeded9d700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faee015bd30 0x7faee015d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeded9d700 1 -- 172.21.15.81:0/3414123886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee015cd40 con 0x7faee0147610 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faede59c700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8003fe0 0x7faee015e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeddd9b700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faee015bd30 0x7faee015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faeded9d700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0147610 0x7faee00b5c40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7faee0067a80 tx=0x7faed800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faece7fc700 1 -- 172.21.15.81:0/3414123886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800e040 con 0x7faee0147610 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faece7fc700 1 -- 172.21.15.81:0/3414123886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed800f040 con 0x7faee0147610 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee015d020 con 0x7faee0147610 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faece7fc700 1 -- 172.21.15.81:0/3414123886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800fe20 con 0x7faee0147610 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.889+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee015da80 con 0x7faee0147610 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.890+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee00ceaa0 con 0x7faee0147610 2023-10-06T02:53:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.891+0000 7faece7fc700 1 -- 172.21.15.81:0/3414123886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faed8015640 con 0x7faee0147610 2023-10-06T02:53:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.891+0000 7faece7fc700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.891+0000 7faece7fc700 1 -- 172.21.15.81:0/3414123886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7faed8084b80 con 0x7faee0147610 2023-10-06T02:53:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.892+0000 7faede59c700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.892+0000 7faede59c700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7faed0000e10 tx=0x7faed0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:10.896+0000 7faece7fc700 1 -- 172.21.15.81:0/3414123886 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faed8051f90 con 0x7faee0147610 2023-10-06T02:53:11.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.095+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7faee00ce7c0 con 0x7faee0147610 2023-10-06T02:53:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.924+0000 7faece7fc700 1 -- 172.21.15.81:0/3414123886 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v147) v1 ==== 97+0+0 (secure 0 0 0) 0x7faed80555b0 con 0x7faee0147610 2023-10-06T02:53:11.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faec0066f30 msgr2=0x7faec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:11.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7faed0000e10 tx=0x7faed0009040 comp rx=0 tx=0).stop 2023-10-06T02:53:11.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0147610 msgr2=0x7faee00b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0147610 0x7faee00b5c40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7faee0067a80 tx=0x7faed800b040 comp rx=0 tx=0).stop 2023-10-06T02:53:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 shutdown_connections 2023-10-06T02:53:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0147610 0x7faee00b5c40 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8003fe0 0x7faee015e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 --2- 172.21.15.81:0/3414123886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faee015bd30 0x7faee015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 >> 172.21.15.81:0/3414123886 conn(0x7faee00cd660 msgr2=0x7faee006d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 shutdown_connections 2023-10-06T02:53:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:11.927+0000 7faedf59e700 1 -- 172.21.15.81:0/3414123886 wait complete. 2023-10-06T02:53:11.931 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:53:11.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:53:12.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.056+0000 7f2d745b0700 1 Processor -- start 2023-10-06T02:53:12.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.056+0000 7f2d745b0700 1 -- start start 2023-10-06T02:53:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.057+0000 7f2d745b0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.057+0000 7f2d745b0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d6c0ceb30 0x7f2d6c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.057+0000 7f2d745b0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c0cf4e0 con 0x7f2d6c06d650 2023-10-06T02:53:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.057+0000 7f2d745b0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6c06ea90 con 0x7f2d6c0ceb30 2023-10-06T02:53:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.057+0000 7f2d745b0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0b0ca0 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.057+0000 7f2d71b4b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d6c0ceb30 0x7f2d6c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.057+0000 7f2d71b4b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d6c0ceb30 0x7f2d6c0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48042/0 (socket says 172.21.15.81:48042) 2023-10-06T02:53:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.057+0000 7f2d71b4b700 1 -- 172.21.15.81:0/339096168 learned_addr learned my addr 172.21.15.81:0/339096168 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d7234c700 1 --2- 172.21.15.81:0/339096168 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d71b4b700 1 -- 172.21.15.81:0/339096168 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c15a2a0 msgr2=0x7f2d6c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d71b4b700 1 --2- 172.21.15.81:0/339096168 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d71b4b700 1 -- 172.21.15.81:0/339096168 >> v1:172.21.15.83:6789/0 conn(0x7f2d6c06d650 legacy=0x7f2d6c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d71b4b700 1 -- 172.21.15.81:0/339096168 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c0b00d0 con 0x7f2d6c0ceb30 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d71b4b700 1 --2- 172.21.15.81:0/339096168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c0ceb30 0x7f2d6c0cefa0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0099b0 tx=0x7f2d5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53455c79106001fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d7134a700 1 -- 172.21.15.81:0/339096168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00b860 con 0x7f2d6c0ceb30 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d7134a700 1 -- 172.21.15.81:0/339096168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c00b9c0 con 0x7f2d6c0ceb30 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d7134a700 1 -- 172.21.15.81:0/339096168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00bd60 con 0x7f2d6c0ceb30 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d745b0700 1 -- 172.21.15.81:0/339096168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c0ceb30 msgr2=0x7f2d6c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.058+0000 7f2d745b0700 1 --2- 172.21.15.81:0/339096168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c0ceb30 0x7f2d6c0cefa0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0099b0 tx=0x7f2d5c009250 comp rx=0 tx=0).stop 2023-10-06T02:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.059+0000 7f2d745b0700 1 -- 172.21.15.81:0/339096168 shutdown_connections 2023-10-06T02:53:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.059+0000 7f2d745b0700 1 --2- 172.21.15.81:0/339096168 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.059+0000 7f2d745b0700 1 --2- 172.21.15.81:0/339096168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c0ceb30 0x7f2d6c0cefa0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.059+0000 7f2d745b0700 1 -- 172.21.15.81:0/339096168 >> 172.21.15.81:0/339096168 conn(0x7f2d6c067640 msgr2=0x7f2d6c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.059+0000 7f2d745b0700 1 -- 172.21.15.81:0/339096168 shutdown_connections 2023-10-06T02:53:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.059+0000 7f2d745b0700 1 -- 172.21.15.81:0/339096168 wait complete. 2023-10-06T02:53:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d745b0700 1 Processor -- start 2023-10-06T02:53:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d745b0700 1 -- start start 2023-10-06T02:53:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d745b0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c06d650 0x7f2d6c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d745b0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c0ceb30 0x7f2d6c15f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d745b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d745b0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c15fd10 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d745b0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0b19d0 con 0x7f2d6c0ceb30 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d745b0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0b4ad0 con 0x7f2d6c06d650 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d72b4d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d72b4d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48048/0 (socket says 172.21.15.81:48048) 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d72b4d700 1 -- 172.21.15.81:0/974682552 learned_addr learned my addr 172.21.15.81:0/974682552 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d7234c700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c06d650 0x7f2d6c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.060+0000 7f2d71b4b700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c0ceb30 0x7f2d6c15f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d72b4d700 1 -- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c06d650 msgr2=0x7f2d6c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d72b4d700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c06d650 0x7f2d6c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d72b4d700 1 -- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c0ceb30 msgr2=0x7f2d6c15f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d72b4d700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c0ceb30 0x7f2d6c15f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d72b4d700 1 -- 172.21.15.81:0/974682552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c0094f0 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d72b4d700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b2db0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c560 tx=0x7f2d64007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d627fc700 1 -- 172.21.15.81:0/974682552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64011590 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d627fc700 1 -- 172.21.15.81:0/974682552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d640116f0 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c0cc0a0 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d627fc700 1 -- 172.21.15.81:0/974682552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64011ab0 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.061+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c0cc620 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.062+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6c069e40 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.062+0000 7f2d627fc700 1 -- 172.21.15.81:0/974682552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d6401b3b0 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.063+0000 7f2d627fc700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d50066f30 0x7f2d500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.063+0000 7f2d627fc700 1 -- 172.21.15.81:0/974682552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2d64083700 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.063+0000 7f2d7234c700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d50066f30 0x7f2d500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.063+0000 7f2d7234c700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d50066f30 0x7f2d500693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2d680075a0 tx=0x7f2d680097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.067+0000 7f2d627fc700 1 -- 172.21.15.81:0/974682552 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d64050b60 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.324+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2d6c0b1b10 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.324+0000 7f2d627fc700 1 -- 172.21.15.81:0/974682552 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2d64017020 con 0x7f2d6c15a2a0 2023-10-06T02:53:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:12.327 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:53:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:53:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:53:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:53:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:53:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:53:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:53:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:53:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:53:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:53:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:53:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:53:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:53:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:53:12.342 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d50066f30 msgr2=0x7f2d500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d50066f30 0x7f2d500693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2d680075a0 tx=0x7f2d680097e0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15a2a0 msgr2=0x7f2d6c0b2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b2db0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c560 tx=0x7f2d64007ef0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 shutdown_connections 2023-10-06T02:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15a2a0 0x7f2d6c0b2db0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d6c06d650 0x7f2d6c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2d50066f30 0x7f2d500693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 --2- 172.21.15.81:0/974682552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c0ceb30 0x7f2d6c15f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 >> 172.21.15.81:0/974682552 conn(0x7f2d6c067640 msgr2=0x7f2d6c0ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 shutdown_connections 2023-10-06T02:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.326+0000 7f2d745b0700 1 -- 172.21.15.81:0/974682552 wait complete. 2023-10-06T02:53:12.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:53:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.458+0000 7fdcb7fb9700 1 Processor -- start 2023-10-06T02:53:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.458+0000 7fdcb7fb9700 1 -- start start 2023-10-06T02:53:12.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb7fb9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcb01578d0 0x7fdcb00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb7fb9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb00d07c0 con 0x7fdcb006d120 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb7fb9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb00cfbb0 con 0x7fdcb0157ca0 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb7fb9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00cfe90 con 0x7fdcb01578d0 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb5d55700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcb01578d0 0x7fdcb00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb5d55700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcb01578d0 0x7fdcb00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48054/0 (socket says 172.21.15.81:48054) 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb6556700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdcb006d120 0x7fdcb006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52370/0 (socket says 172.21.15.81:52370) 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb5d55700 1 -- 172.21.15.81:0/1400688628 learned_addr learned my addr 172.21.15.81:0/1400688628 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb5d55700 1 -- 172.21.15.81:0/1400688628 >> v1:172.21.15.83:6789/0 conn(0x7fdcb0157ca0 legacy=0x7fdcb015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb5d55700 1 -- 172.21.15.81:0/1400688628 >> v1:172.21.15.81:6789/0 conn(0x7fdcb006d120 legacy=0x7fdcb006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb4d53700 1 -- 172.21.15.81:0/1400688628 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421055346 0 0) 0x7fdcb00d07c0 con 0x7fdcb006d120 2023-10-06T02:53:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb5d55700 1 -- 172.21.15.81:0/1400688628 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00d0170 con 0x7fdcb01578d0 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.459+0000 7fdcb5d55700 1 --2- 172.21.15.81:0/1400688628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb01578d0 0x7fdcb00cf4f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009f20 tx=0x7fdcac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6ebbbb8214ee2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb4d53700 1 -- 172.21.15.81:0/1400688628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac00e070 con 0x7fdcb01578d0 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb4d53700 1 -- 172.21.15.81:0/1400688628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac00ba40 con 0x7fdcb01578d0 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb4d53700 1 -- 172.21.15.81:0/1400688628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0092e0 con 0x7fdcb01578d0 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/1400688628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb01578d0 msgr2=0x7fdcb00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb7fb9700 1 --2- 172.21.15.81:0/1400688628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb01578d0 0x7fdcb00cf4f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009f20 tx=0x7fdcac009840 comp rx=0 tx=0).stop 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/1400688628 shutdown_connections 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb7fb9700 1 --2- 172.21.15.81:0/1400688628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb01578d0 0x7fdcb00cf4f0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/1400688628 >> 172.21.15.81:0/1400688628 conn(0x7fdcb006bb90 msgr2=0x7fdcb006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/1400688628 shutdown_connections 2023-10-06T02:53:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.460+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/1400688628 wait complete. 2023-10-06T02:53:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.461+0000 7fdcb7fb9700 1 Processor -- start 2023-10-06T02:53:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.461+0000 7fdcb7fb9700 1 -- start start 2023-10-06T02:53:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb7fb9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb006d120 0x7fdcb00b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb7fb9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb01578d0 0x7fdcb00c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb7fb9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdcb0157ca0 0x7fdcb016a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb7fb9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00b5b40 con 0x7fdcb006d120 2023-10-06T02:53:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb7fb9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00b4f30 con 0x7fdcb01578d0 2023-10-06T02:53:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb7fb9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00b5210 con 0x7fdcb0157ca0 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb5d55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb006d120 0x7fdcb00b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb5d55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb006d120 0x7fdcb00b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48070/0 (socket says 172.21.15.81:48070) 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb5d55700 1 -- 172.21.15.81:0/3791643916 learned_addr learned my addr 172.21.15.81:0/3791643916 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb5d55700 1 -- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdcb0157ca0 msgr2=0x7fdcb016a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb5d55700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdcb0157ca0 0x7fdcb016a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb5d55700 1 -- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb01578d0 msgr2=0x7fdcb00c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb5d55700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb01578d0 0x7fdcb00c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb5d55700 1 -- 172.21.15.81:0/3791643916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac009ae0 con 0x7fdcb006d120 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.462+0000 7fdcb5d55700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb006d120 0x7fdcb00b5fd0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009880 tx=0x7fdcac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.463+0000 7fdca5ffb700 1 -- 172.21.15.81:0/3791643916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac012ae0 con 0x7fdcb006d120 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.463+0000 7fdca5ffb700 1 -- 172.21.15.81:0/3791643916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac012c60 con 0x7fdcb006d120 2023-10-06T02:53:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.463+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb00b54f0 con 0x7fdcb006d120 2023-10-06T02:53:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.463+0000 7fdca5ffb700 1 -- 172.21.15.81:0/3791643916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac01e430 con 0x7fdcb006d120 2023-10-06T02:53:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.463+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb00b6510 con 0x7fdcb006d120 2023-10-06T02:53:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.464+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb0067ac0 con 0x7fdcb006d120 2023-10-06T02:53:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.464+0000 7fdca5ffb700 1 -- 172.21.15.81:0/3791643916 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdcac01e820 con 0x7fdcb006d120 2023-10-06T02:53:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.465+0000 7fdca5ffb700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc94066fb0 0x7fdc94069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.465+0000 7fdca5ffb700 1 -- 172.21.15.81:0/3791643916 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdcac085f50 con 0x7fdcb006d120 2023-10-06T02:53:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.465+0000 7fdcb5554700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc94066fb0 0x7fdc94069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.465+0000 7fdcb5554700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc94066fb0 0x7fdc94069460 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdcb015a820 tx=0x7fdca0006c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:12.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.469+0000 7fdca5ffb700 1 -- 172.21.15.81:0/3791643916 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcac053310 con 0x7fdcb006d120 2023-10-06T02:53:12.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.649+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcb00d0450 con 0x7fdcb006d120 2023-10-06T02:53:12.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.650+0000 7fdca5ffb700 1 -- 172.21.15.81:0/3791643916 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+13614 (secure 0 0 0) 0x7fdcac056930 con 0x7fdcb006d120 2023-10-06T02:53:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:12.652 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":147,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:53:11.923133+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:53:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc94066fb0 msgr2=0x7fdc94069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc94066fb0 0x7fdc94069460 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdcb015a820 tx=0x7fdca0006c60 comp rx=0 tx=0).stop 2023-10-06T02:53:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb006d120 msgr2=0x7fdcb00b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb006d120 0x7fdcb00b5fd0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009880 tx=0x7fdcac017000 comp rx=0 tx=0).stop 2023-10-06T02:53:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 shutdown_connections 2023-10-06T02:53:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdcb0157ca0 0x7fdcb016a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb006d120 0x7fdcb00b5fd0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdc94066fb0 0x7fdc94069460 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 --2- 172.21.15.81:0/3791643916 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb01578d0 0x7fdcb00c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 >> 172.21.15.81:0/3791643916 conn(0x7fdcb006bb90 msgr2=0x7fdcb0154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:12.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 shutdown_connections 2023-10-06T02:53:12.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.652+0000 7fdcb7fb9700 1 -- 172.21.15.81:0/3791643916 wait complete. 2023-10-06T02:53:12.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:53:12.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:53:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.781+0000 7f8b9b993700 1 Processor -- start 2023-10-06T02:53:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.781+0000 7f8b9b993700 1 -- start start 2023-10-06T02:53:12.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b9b993700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8b94157ca0 0x7f8b940cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b9b993700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8b9406d120 0x7f8b9406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b9b993700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b940d07c0 con 0x7f8b941578d0 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b9b993700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9406da50 con 0x7f8b9406d120 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b9b993700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b940cfbb0 con 0x7f8b94157ca0 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b99f30700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8b9406d120 0x7f8b9406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b9972f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8b941578d0 0x7f8b9415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52374/0 (socket says 172.21.15.81:52374) 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b9972f700 1 -- 172.21.15.81:0/3653681348 learned_addr learned my addr 172.21.15.81:0/3653681348 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b98f2e700 1 --2- 172.21.15.81:0/3653681348 >> v2:172.21.15.83:3300/0 conn(0x7f8b94157ca0 0x7f8b940cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b99f30700 1 -- 172.21.15.81:0/3653681348 >> v2:172.21.15.83:3300/0 conn(0x7f8b94157ca0 msgr2=0x7f8b940cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b99f30700 1 --2- 172.21.15.81:0/3653681348 >> v2:172.21.15.83:3300/0 conn(0x7f8b94157ca0 0x7f8b940cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b99f30700 1 -- 172.21.15.81:0/3653681348 >> v1:172.21.15.81:6789/0 conn(0x7f8b941578d0 legacy=0x7f8b9415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b8bfff700 1 -- 172.21.15.81:0/3653681348 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456570464 0 0) 0x7f8b940d07c0 con 0x7f8b941578d0 2023-10-06T02:53:12.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b99f30700 1 -- 172.21.15.81:0/3653681348 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940cfe90 con 0x7f8b9406d120 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b99f30700 1 --2- 172.21.15.81:0/3653681348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 0x7f8b9406d510 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8b94068510 tx=0x7f8b8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37464512efa96c7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b8bfff700 1 -- 172.21.15.81:0/3653681348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00b6b0 con 0x7f8b9406d120 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b8bfff700 1 -- 172.21.15.81:0/3653681348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c00b810 con 0x7f8b9406d120 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.782+0000 7f8b8bfff700 1 -- 172.21.15.81:0/3653681348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00bbb0 con 0x7f8b9406d120 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.783+0000 7f8b9b993700 1 -- 172.21.15.81:0/3653681348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 msgr2=0x7f8b9406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.783+0000 7f8b9b993700 1 --2- 172.21.15.81:0/3653681348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 0x7f8b9406d510 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8b94068510 tx=0x7f8b8c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.783+0000 7f8b9b993700 1 -- 172.21.15.81:0/3653681348 shutdown_connections 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.783+0000 7f8b9b993700 1 --2- 172.21.15.81:0/3653681348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 0x7f8b9406d510 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.783+0000 7f8b9b993700 1 --2- 172.21.15.81:0/3653681348 >> v2:172.21.15.83:3300/0 conn(0x7f8b94157ca0 0x7f8b940cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.783+0000 7f8b9b993700 1 -- 172.21.15.81:0/3653681348 >> 172.21.15.81:0/3653681348 conn(0x7f8b9406bb90 msgr2=0x7f8b9406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.783+0000 7f8b9b993700 1 -- 172.21.15.81:0/3653681348 shutdown_connections 2023-10-06T02:53:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.783+0000 7f8b9b993700 1 -- 172.21.15.81:0/3653681348 wait complete. 2023-10-06T02:53:12.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.784+0000 7f8b9b993700 1 Processor -- start 2023-10-06T02:53:12.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.784+0000 7f8b9b993700 1 -- start start 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9b993700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 0x7f8b940c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9b993700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b941578d0 0x7f8b940c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9b993700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b94157ca0 0x7f8b9416d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9b993700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940c6490 con 0x7f8b9406d120 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9b993700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940c6770 con 0x7f8b941578d0 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9b993700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940c6a50 con 0x7f8b94157ca0 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9972f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 0x7f8b940c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9972f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 0x7f8b940c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48094/0 (socket says 172.21.15.81:48094) 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9972f700 1 -- 172.21.15.81:0/4003523841 learned_addr learned my addr 172.21.15.81:0/4003523841 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b99f30700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b94157ca0 0x7f8b9416d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b98f2e700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b941578d0 0x7f8b940c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9972f700 1 -- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b94157ca0 msgr2=0x7f8b9416d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9972f700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b94157ca0 0x7f8b9416d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9972f700 1 -- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b941578d0 msgr2=0x7f8b940c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9972f700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b941578d0 0x7f8b940c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9972f700 1 -- 172.21.15.81:0/4003523841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c009420 con 0x7f8b9406d120 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b98f2e700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b941578d0 0x7f8b940c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.785+0000 7f8b9972f700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 0x7f8b940c7530 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000cd80 tx=0x7f8b90001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.786+0000 7f8b897fa700 1 -- 172.21.15.81:0/4003523841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000ab10 con 0x7f8b9406d120 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.786+0000 7f8b897fa700 1 -- 172.21.15.81:0/4003523841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000ac70 con 0x7f8b9406d120 2023-10-06T02:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.786+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b940c6d30 con 0x7f8b9406d120 2023-10-06T02:53:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.786+0000 7f8b897fa700 1 -- 172.21.15.81:0/4003523841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900070f0 con 0x7f8b9406d120 2023-10-06T02:53:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.786+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b940c70c0 con 0x7f8b9406d120 2023-10-06T02:53:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.787+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b94067ac0 con 0x7f8b9406d120 2023-10-06T02:53:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.787+0000 7f8b897fa700 1 -- 172.21.15.81:0/4003523841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b900074e0 con 0x7f8b9406d120 2023-10-06T02:53:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.787+0000 7f8b897fa700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b78066f30 0x7f8b780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.787+0000 7f8b897fa700 1 -- 172.21.15.81:0/4003523841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8b90084870 con 0x7f8b9406d120 2023-10-06T02:53:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.788+0000 7f8b98f2e700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b78066f30 0x7f8b780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.788+0000 7f8b98f2e700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b78066f30 0x7f8b780693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8b84006fd0 tx=0x7f8b84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.791+0000 7f8b897fa700 1 -- 172.21.15.81:0/4003523841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b90051d50 con 0x7f8b9406d120 2023-10-06T02:53:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.977+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b940d0170 con 0x7f8b9406d120 2023-10-06T02:53:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.977+0000 7f8b897fa700 1 -- 172.21.15.81:0/4003523841 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b90055370 con 0x7f8b9406d120 2023-10-06T02:53:12.980 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:53:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.979+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b78066f30 msgr2=0x7f8b780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.979+0000 7f8b9b993700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b78066f30 0x7f8b780693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8b84006fd0 tx=0x7f8b84008040 comp rx=0 tx=0).stop 2023-10-06T02:53:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 msgr2=0x7f8b940c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 0x7f8b940c7530 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000cd80 tx=0x7f8b90001ae0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 shutdown_connections 2023-10-06T02:53:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b94157ca0 0x7f8b9416d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9406d120 0x7f8b940c7530 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b78066f30 0x7f8b780693e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 --2- 172.21.15.81:0/4003523841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b941578d0 0x7f8b940c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 >> 172.21.15.81:0/4003523841 conn(0x7f8b9406bb90 msgr2=0x7f8b94156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 shutdown_connections 2023-10-06T02:53:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:12.980+0000 7f8b9b993700 1 -- 172.21.15.81:0/4003523841 wait complete. 2023-10-06T02:53:12.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:53:13.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.108+0000 7f0caffff700 1 Processor -- start 2023-10-06T02:53:13.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.108+0000 7f0caffff700 1 -- start start 2023-10-06T02:53:13.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0cb00d0f50 0x7f0cb006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cb006d530 0x7f0cb015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caffff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb006d990 con 0x7f0cb00d0b80 2023-10-06T02:53:13.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb015a690 con 0x7f0cb006d530 2023-10-06T02:53:13.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caffff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb00cf2d0 con 0x7f0cb00d0f50 2023-10-06T02:53:13.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cb006d530 0x7f0cb015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cb006d530 0x7f0cb015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48100/0 (socket says 172.21.15.81:48100) 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caf7fe700 1 -- 172.21.15.81:0/3742797060 learned_addr learned my addr 172.21.15.81:0/3742797060 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0ca67fc700 1 --2- 172.21.15.81:0/3742797060 >> v2:172.21.15.83:3300/0 conn(0x7f0cb00d0f50 0x7f0cb006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caf7fe700 1 -- 172.21.15.81:0/3742797060 >> v2:172.21.15.83:3300/0 conn(0x7f0cb00d0f50 msgr2=0x7f0cb006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caf7fe700 1 --2- 172.21.15.81:0/3742797060 >> v2:172.21.15.83:3300/0 conn(0x7f0cb00d0f50 0x7f0cb006cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caf7fe700 1 -- 172.21.15.81:0/3742797060 >> v1:172.21.15.83:6789/0 conn(0x7f0cb00d0b80 legacy=0x7f0cb00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caf7fe700 1 -- 172.21.15.81:0/3742797060 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00d0480 con 0x7f0cb006d530 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0caf7fe700 1 --2- 172.21.15.81:0/3742797060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb006d530 0x7f0cb015b320 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00cecc0 tx=0x7f0ca8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e77778fd0b99d4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0cae7fc700 1 -- 172.21.15.81:0/3742797060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800e070 con 0x7f0cb006d530 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0cae7fc700 1 -- 172.21.15.81:0/3742797060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca800ba10 con 0x7f0cb006d530 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.109+0000 7f0cae7fc700 1 -- 172.21.15.81:0/3742797060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80092e0 con 0x7f0cb006d530 2023-10-06T02:53:13.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.110+0000 7f0caffff700 1 -- 172.21.15.81:0/3742797060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb006d530 msgr2=0x7f0cb015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.110+0000 7f0caffff700 1 --2- 172.21.15.81:0/3742797060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb006d530 0x7f0cb015b320 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00cecc0 tx=0x7f0ca8009840 comp rx=0 tx=0).stop 2023-10-06T02:53:13.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.110+0000 7f0caffff700 1 -- 172.21.15.81:0/3742797060 shutdown_connections 2023-10-06T02:53:13.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.110+0000 7f0caffff700 1 --2- 172.21.15.81:0/3742797060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb006d530 0x7f0cb015b320 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.110+0000 7f0caffff700 1 --2- 172.21.15.81:0/3742797060 >> v2:172.21.15.83:3300/0 conn(0x7f0cb00d0f50 0x7f0cb006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.110+0000 7f0caffff700 1 -- 172.21.15.81:0/3742797060 >> 172.21.15.81:0/3742797060 conn(0x7f0cb0063230 msgr2=0x7f0cb0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:13.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.110+0000 7f0caffff700 1 -- 172.21.15.81:0/3742797060 shutdown_connections 2023-10-06T02:53:13.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.110+0000 7f0caffff700 1 -- 172.21.15.81:0/3742797060 wait complete. 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.111+0000 7f0caffff700 1 Processor -- start 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.111+0000 7f0caffff700 1 -- start start 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0caffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0cb006d530 0x7f0cb0152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0caffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb00d0b80 0x7f0cb0150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0caffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cb00d0f50 0x7f0cb013c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0caffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb0151830 con 0x7f0cb00d0b80 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0caffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb014fba0 con 0x7f0cb00d0f50 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0caffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb0150c20 con 0x7f0cb006d530 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0ca67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb00d0b80 0x7f0cb0150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0ca67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb00d0b80 0x7f0cb0150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48116/0 (socket says 172.21.15.81:48116) 2023-10-06T02:53:13.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0ca67fc700 1 -- 172.21.15.81:0/2930583411 learned_addr learned my addr 172.21.15.81:0/2930583411 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0caeffd700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0cb006d530 0x7f0cb0152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0caf7fe700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cb00d0f50 0x7f0cb013c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0ca67fc700 1 -- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0cb006d530 msgr2=0x7f0cb0152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0ca67fc700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0cb006d530 0x7f0cb0152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0ca67fc700 1 -- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cb00d0f50 msgr2=0x7f0cb013c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0ca67fc700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cb00d0f50 0x7f0cb013c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0ca67fc700 1 -- 172.21.15.81:0/2930583411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009ae0 con 0x7f0cb00d0b80 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.112+0000 7f0ca67fc700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb00d0b80 0x7f0cb0150160 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800d860 tx=0x7f0c98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.113+0000 7f0ca77fe700 1 -- 172.21.15.81:0/2930583411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980125f0 con 0x7f0cb00d0b80 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.113+0000 7f0ca77fe700 1 -- 172.21.15.81:0/2930583411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98012750 con 0x7f0cb00d0b80 2023-10-06T02:53:13.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.113+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb0150f00 con 0x7f0cb00d0b80 2023-10-06T02:53:13.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.113+0000 7f0ca77fe700 1 -- 172.21.15.81:0/2930583411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98012b10 con 0x7f0cb00d0b80 2023-10-06T02:53:13.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.113+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb01514c0 con 0x7f0cb00d0b80 2023-10-06T02:53:13.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.114+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb01519a0 con 0x7f0cb00d0b80 2023-10-06T02:53:13.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.114+0000 7f0ca77fe700 1 -- 172.21.15.81:0/2930583411 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c9801e460 con 0x7f0cb00d0b80 2023-10-06T02:53:13.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.114+0000 7f0ca77fe700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c90066f30 0x7f0c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.115+0000 7f0ca77fe700 1 -- 172.21.15.81:0/2930583411 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0c98084a00 con 0x7f0cb00d0b80 2023-10-06T02:53:13.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.115+0000 7f0caeffd700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c90066f30 0x7f0c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.115+0000 7f0caeffd700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c90066f30 0x7f0c900693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0003870 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:13.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.119+0000 7f0ca77fe700 1 -- 172.21.15.81:0/2930583411 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c980558f0 con 0x7f0cb00d0b80 2023-10-06T02:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.297+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0cb0151680 con 0x7f0cb00d0b80 2023-10-06T02:53:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.298+0000 7f0ca77fe700 1 -- 172.21.15.81:0/2930583411 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c98055480 con 0x7f0cb00d0b80 2023-10-06T02:53:13.300 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:53:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c90066f30 msgr2=0x7f0c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c90066f30 0x7f0c900693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0003870 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb00d0b80 msgr2=0x7f0cb0150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb00d0b80 0x7f0cb0150160 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800d860 tx=0x7f0c98008040 comp rx=0 tx=0).stop 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 shutdown_connections 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c90066f30 0x7f0c900693e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cb00d0f50 0x7f0cb013c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0cb006d530 0x7f0cb0152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 --2- 172.21.15.81:0/2930583411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb00d0b80 0x7f0cb0150160 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 >> 172.21.15.81:0/2930583411 conn(0x7f0cb0063230 msgr2=0x7f0cb00b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 shutdown_connections 2023-10-06T02:53:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.300+0000 7f0caffff700 1 -- 172.21.15.81:0/2930583411 wait complete. 2023-10-06T02:53:13.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:53:13.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.426+0000 7fb2499a0700 1 Processor -- start 2023-10-06T02:53:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.426+0000 7fb2499a0700 1 -- start start 2023-10-06T02:53:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.427+0000 7fb2499a0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb244067640 0x7fb244067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.427+0000 7fb2499a0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2440ce890 0x7fb2440cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.427+0000 7fb2499a0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb244067ff0 con 0x7fb2440add30 2023-10-06T02:53:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.427+0000 7fb2499a0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2440b37b0 con 0x7fb2440ce890 2023-10-06T02:53:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.427+0000 7fb2499a0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2440cf230 con 0x7fb244067640 2023-10-06T02:53:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.427+0000 7fb24919f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2440ce890 0x7fb2440cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.427+0000 7fb24899e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb2440add30 0x7fb2440b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52388/0 (socket says 172.21.15.81:52388) 2023-10-06T02:53:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.427+0000 7fb24899e700 1 -- 172.21.15.81:0/2320585357 learned_addr learned my addr 172.21.15.81:0/2320585357 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb23bfff700 1 --2- 172.21.15.81:0/2320585357 >> v2:172.21.15.83:3300/0 conn(0x7fb244067640 0x7fb244067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb23b7fe700 1 -- 172.21.15.81:0/2320585357 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426564415 0 0) 0x7fb244067ff0 con 0x7fb2440add30 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb23b7fe700 1 -- 172.21.15.81:0/2320585357 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb22c003570 con 0x7fb2440add30 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb24919f700 1 -- 172.21.15.81:0/2320585357 >> v2:172.21.15.83:3300/0 conn(0x7fb244067640 msgr2=0x7fb244067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb24919f700 1 --2- 172.21.15.81:0/2320585357 >> v2:172.21.15.83:3300/0 conn(0x7fb244067640 0x7fb244067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb24919f700 1 -- 172.21.15.81:0/2320585357 >> v1:172.21.15.81:6789/0 conn(0x7fb2440add30 legacy=0x7fb2440b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb24919f700 1 -- 172.21.15.81:0/2320585357 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440b17c0 con 0x7fb2440ce890 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb24919f700 1 --2- 172.21.15.81:0/2320585357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440ce890 0x7fb2440cecf0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fb2440ce650 tx=0x7fb23c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54284a0571879303 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb23b7fe700 1 -- 172.21.15.81:0/2320585357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c011630 con 0x7fb2440ce890 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb23b7fe700 1 -- 172.21.15.81:0/2320585357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c011790 con 0x7fb2440ce890 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.428+0000 7fb23b7fe700 1 -- 172.21.15.81:0/2320585357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c011b30 con 0x7fb2440ce890 2023-10-06T02:53:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.429+0000 7fb2499a0700 1 -- 172.21.15.81:0/2320585357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440ce890 msgr2=0x7fb2440cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.429+0000 7fb2499a0700 1 --2- 172.21.15.81:0/2320585357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440ce890 0x7fb2440cecf0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fb2440ce650 tx=0x7fb23c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.429+0000 7fb2499a0700 1 -- 172.21.15.81:0/2320585357 shutdown_connections 2023-10-06T02:53:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.429+0000 7fb2499a0700 1 --2- 172.21.15.81:0/2320585357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440ce890 0x7fb2440cecf0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.429+0000 7fb2499a0700 1 --2- 172.21.15.81:0/2320585357 >> v2:172.21.15.83:3300/0 conn(0x7fb244067640 0x7fb244067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.429+0000 7fb2499a0700 1 -- 172.21.15.81:0/2320585357 >> 172.21.15.81:0/2320585357 conn(0x7fb24406c620 msgr2=0x7fb24406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.429+0000 7fb2499a0700 1 -- 172.21.15.81:0/2320585357 shutdown_connections 2023-10-06T02:53:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.429+0000 7fb2499a0700 1 -- 172.21.15.81:0/2320585357 wait complete. 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.430+0000 7fb2499a0700 1 Processor -- start 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.430+0000 7fb2499a0700 1 -- start start 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb2499a0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb244067640 0x7fb2440a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb2499a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440add30 0x7fb24406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb2499a0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2440ce890 0x7fb2440a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb2499a0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24406e510 con 0x7fb2440add30 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb2499a0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440a6b10 con 0x7fb2440ce890 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb2499a0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440a6df0 con 0x7fb244067640 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb23bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440add30 0x7fb24406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb23bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440add30 0x7fb24406dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48124/0 (socket says 172.21.15.81:48124) 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb23bfff700 1 -- 172.21.15.81:0/1816450253 learned_addr learned my addr 172.21.15.81:0/1816450253 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb24899e700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb244067640 0x7fb2440a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb24919f700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2440ce890 0x7fb2440a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb23bfff700 1 -- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb244067640 msgr2=0x7fb2440a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb23bfff700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb244067640 0x7fb2440a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb23bfff700 1 -- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2440ce890 msgr2=0x7fb2440a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb23bfff700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2440ce890 0x7fb2440a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb23bfff700 1 -- 172.21.15.81:0/1816450253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009420 con 0x7fb2440add30 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb24899e700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb244067640 0x7fb2440a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb23bfff700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440add30 0x7fb24406dfd0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fb23400d860 tx=0x7fb234008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb238ff9700 1 -- 172.21.15.81:0/1816450253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2340125f0 con 0x7fb2440add30 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb238ff9700 1 -- 172.21.15.81:0/1816450253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb234012750 con 0x7fb2440add30 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2440a70d0 con 0x7fb2440add30 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb238ff9700 1 -- 172.21.15.81:0/1816450253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234012b10 con 0x7fb2440add30 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.431+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2440a7690 con 0x7fb2440add30 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.432+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2440a7a00 con 0x7fb2440add30 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.433+0000 7fb238ff9700 1 -- 172.21.15.81:0/1816450253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb23401e460 con 0x7fb2440add30 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.433+0000 7fb238ff9700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb230066f30 0x7fb2300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.433+0000 7fb238ff9700 1 -- 172.21.15.81:0/1816450253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb2340848b0 con 0x7fb2440add30 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.433+0000 7fb24899e700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb230066f30 0x7fb2300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.434+0000 7fb24899e700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb230066f30 0x7fb2300693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb240005c50 tx=0x7fb240009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.437+0000 7fb238ff9700 1 -- 172.21.15.81:0/1816450253 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb234051d10 con 0x7fb2440add30 2023-10-06T02:53:13.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.622+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb244071b10 con 0x7fb2440add30 2023-10-06T02:53:13.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.623+0000 7fb238ff9700 1 -- 172.21.15.81:0/1816450253 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v147) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb234055330 con 0x7fb2440add30 2023-10-06T02:53:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:13.625 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:53:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:53:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:53:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:53:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:53:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:53:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:53:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:53:13.626 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:53:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb230066f30 msgr2=0x7fb2300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb230066f30 0x7fb2300693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb240005c50 tx=0x7fb240009040 comp rx=0 tx=0).stop 2023-10-06T02:53:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440add30 msgr2=0x7fb24406dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440add30 0x7fb24406dfd0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fb23400d860 tx=0x7fb234008040 comp rx=0 tx=0).stop 2023-10-06T02:53:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 shutdown_connections 2023-10-06T02:53:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb230066f30 0x7fb2300693e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2440ce890 0x7fb2440a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb244067640 0x7fb2440a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 --2- 172.21.15.81:0/1816450253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2440add30 0x7fb24406dfd0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 >> 172.21.15.81:0/1816450253 conn(0x7fb24406c620 msgr2=0x7fb2441572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:13.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 shutdown_connections 2023-10-06T02:53:13.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.625+0000 7fb2499a0700 1 -- 172.21.15.81:0/1816450253 wait complete. 2023-10-06T02:53:13.639 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:53:13.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:53:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.755+0000 7f9ff08b9700 1 Processor -- start 2023-10-06T02:53:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.755+0000 7f9ff08b9700 1 -- start start 2023-10-06T02:53:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9ff08b9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec1578d0 0x7f9fec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9ff08b9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fec157ca0 0x7f9fec15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9ff08b9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec0d07c0 con 0x7f9fec06d120 2023-10-06T02:53:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9ff08b9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec0cfbb0 con 0x7f9fec157ca0 2023-10-06T02:53:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9ff08b9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0cfe90 con 0x7f9fec1578d0 2023-10-06T02:53:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fe1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fec157ca0 0x7f9fec15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fe1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fec157ca0 0x7f9fec15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48140/0 (socket says 172.21.15.81:48140) 2023-10-06T02:53:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fe1d9b700 1 -- 172.21.15.81:0/2089889394 learned_addr learned my addr 172.21.15.81:0/2089889394 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fead9d700 1 --1- 172.21.15.81:0/2089889394 >> v1:172.21.15.81:6789/0 conn(0x7f9fec06d120 0x7f9fec15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52402/0 (socket says 172.21.15.81:52402) 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fea59c700 1 --2- 172.21.15.81:0/2089889394 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec1578d0 0x7f9fec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fe1d9b700 1 -- 172.21.15.81:0/2089889394 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec1578d0 msgr2=0x7f9fec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fe1d9b700 1 --2- 172.21.15.81:0/2089889394 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec1578d0 0x7f9fec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fe1d9b700 1 -- 172.21.15.81:0/2089889394 >> v1:172.21.15.81:6789/0 conn(0x7f9fec06d120 legacy=0x7f9fec15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fe9d9b700 1 -- 172.21.15.81:0/2089889394 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885118691 0 0) 0x7f9fec0d07c0 con 0x7f9fec06d120 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fe1d9b700 1 -- 172.21.15.81:0/2089889394 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0d0170 con 0x7f9fec157ca0 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.756+0000 7f9fe1d9b700 1 --2- 172.21.15.81:0/2089889394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec157ca0 0x7f9fec15af00 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40099b0 tx=0x7f9fd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4854846c2832dc02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9fe9d9b700 1 -- 172.21.15.81:0/2089889394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400b860 con 0x7f9fec157ca0 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9fe9d9b700 1 -- 172.21.15.81:0/2089889394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd400b9c0 con 0x7f9fec157ca0 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9fe9d9b700 1 -- 172.21.15.81:0/2089889394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400bd60 con 0x7f9fec157ca0 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9ff08b9700 1 -- 172.21.15.81:0/2089889394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec157ca0 msgr2=0x7f9fec15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9ff08b9700 1 --2- 172.21.15.81:0/2089889394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec157ca0 0x7f9fec15af00 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40099b0 tx=0x7f9fd4009250 comp rx=0 tx=0).stop 2023-10-06T02:53:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9ff08b9700 1 -- 172.21.15.81:0/2089889394 shutdown_connections 2023-10-06T02:53:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9ff08b9700 1 --2- 172.21.15.81:0/2089889394 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec1578d0 0x7f9fec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9ff08b9700 1 --2- 172.21.15.81:0/2089889394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec157ca0 0x7f9fec15af00 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9ff08b9700 1 -- 172.21.15.81:0/2089889394 >> 172.21.15.81:0/2089889394 conn(0x7f9fec06bb90 msgr2=0x7f9fec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9ff08b9700 1 -- 172.21.15.81:0/2089889394 shutdown_connections 2023-10-06T02:53:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.757+0000 7f9ff08b9700 1 -- 172.21.15.81:0/2089889394 wait complete. 2023-10-06T02:53:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.758+0000 7f9ff08b9700 1 Processor -- start 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.758+0000 7f9ff08b9700 1 -- start start 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9ff08b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec06d120 0x7f9fec154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9ff08b9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1578d0 0x7f9fec0c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9ff08b9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec157ca0 0x7f9fec15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9ff08b9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0cb180 con 0x7f9fec06d120 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9ff08b9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec155250 con 0x7f9fec1578d0 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9ff08b9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0c90c0 con 0x7f9fec157ca0 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fea59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec06d120 0x7f9fec154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fea59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec06d120 0x7f9fec154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48152/0 (socket says 172.21.15.81:48152) 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fea59c700 1 -- 172.21.15.81:0/3470581592 learned_addr learned my addr 172.21.15.81:0/3470581592 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fead9d700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec157ca0 0x7f9fec15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fe1d9b700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1578d0 0x7f9fec0c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fea59c700 1 -- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec157ca0 msgr2=0x7f9fec15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fea59c700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec157ca0 0x7f9fec15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fea59c700 1 -- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1578d0 msgr2=0x7f9fec0c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fea59c700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1578d0 0x7f9fec0c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fea59c700 1 -- 172.21.15.81:0/3470581592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40094f0 con 0x7f9fec06d120 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.759+0000 7f9fead9d700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec157ca0 0x7f9fec15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.760+0000 7f9fea59c700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec06d120 0x7f9fec154d10 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00d890 tx=0x7f9fdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.760+0000 7f9fe2ffd700 1 -- 172.21.15.81:0/3470581592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00b600 con 0x7f9fec06d120 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.760+0000 7f9fe2ffd700 1 -- 172.21.15.81:0/3470581592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc00b760 con 0x7f9fec06d120 2023-10-06T02:53:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.760+0000 7f9fe2ffd700 1 -- 172.21.15.81:0/3470581592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00bae0 con 0x7f9fec06d120 2023-10-06T02:53:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.760+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec0ca850 con 0x7f9fec06d120 2023-10-06T02:53:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.760+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec0cae10 con 0x7f9fec06d120 2023-10-06T02:53:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.761+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec067ac0 con 0x7f9fec06d120 2023-10-06T02:53:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.761+0000 7f9fe2ffd700 1 -- 172.21.15.81:0/3470581592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fdc01e460 con 0x7f9fec06d120 2023-10-06T02:53:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.761+0000 7f9fe2ffd700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.761+0000 7f9fe2ffd700 1 -- 172.21.15.81:0/3470581592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9fdc0849f0 con 0x7f9fec06d120 2023-10-06T02:53:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.761+0000 7f9fe1d9b700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.762+0000 7f9fe1d9b700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40099b0 tx=0x7f9fd4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.766+0000 7f9fe2ffd700 1 -- 172.21.15.81:0/3470581592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fdc051e50 con 0x7f9fec06d120 2023-10-06T02:53:13.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:13.950+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9fec0cb460 con 0x7f9fec06d120 2023-10-06T02:53:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.937+0000 7f9fe2ffd700 1 -- 172.21.15.81:0/3470581592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v148) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9fdc055470 con 0x7f9fec06d120 2023-10-06T02:53:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fcc066f30 msgr2=0x7f9fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40099b0 tx=0x7f9fd4017000 comp rx=0 tx=0).stop 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec06d120 msgr2=0x7f9fec154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec06d120 0x7f9fec154d10 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00d890 tx=0x7f9fdc008040 comp rx=0 tx=0).stop 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 shutdown_connections 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec157ca0 0x7f9fec15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec06d120 0x7f9fec154d10 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 --2- 172.21.15.81:0/3470581592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1578d0 0x7f9fec0c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 >> 172.21.15.81:0/3470581592 conn(0x7f9fec06bb90 msgr2=0x7f9fec155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 shutdown_connections 2023-10-06T02:53:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:14.941+0000 7f9ff08b9700 1 -- 172.21.15.81:0/3470581592 wait complete. 2023-10-06T02:53:14.945 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:53:14.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:53:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.078+0000 7fb07406c700 1 Processor -- start 2023-10-06T02:53:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.078+0000 7fb07406c700 1 -- start start 2023-10-06T02:53:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb07406c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c1577c0 0x7fb06c068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb07406c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0cca80 con 0x7fb06c0cbea0 2023-10-06T02:53:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb07406c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0cedd0 con 0x7fb06c157b90 2023-10-06T02:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb07406c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0cc4c0 con 0x7fb06c1577c0 2023-10-06T02:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb072609700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb06c0cbea0 0x7fb06c0cf260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52412/0 (socket says 172.21.15.81:52412) 2023-10-06T02:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb072609700 1 -- 172.21.15.81:0/3626887155 learned_addr learned my addr 172.21.15.81:0/3626887155 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb071e08700 1 --2- 172.21.15.81:0/3626887155 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c1577c0 0x7fb06c068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb070e06700 1 -- 172.21.15.81:0/3626887155 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385977243 0 0) 0x7fb06c0cca80 con 0x7fb06c0cbea0 2023-10-06T02:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb070e06700 1 -- 172.21.15.81:0/3626887155 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb058003570 con 0x7fb06c0cbea0 2023-10-06T02:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb070e06700 1 -- 172.21.15.81:0/3626887155 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627477261 0 0) 0x7fb06c0cedd0 con 0x7fb06c157b90 2023-10-06T02:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb070e06700 1 -- 172.21.15.81:0/3626887155 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb06c0cca80 con 0x7fb06c157b90 2023-10-06T02:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb071e08700 1 -- 172.21.15.81:0/3626887155 >> v1:172.21.15.83:6789/0 conn(0x7fb06c157b90 legacy=0x7fb06c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb071e08700 1 -- 172.21.15.81:0/3626887155 >> v1:172.21.15.81:6789/0 conn(0x7fb06c0cbea0 legacy=0x7fb06c0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb071e08700 1 -- 172.21.15.81:0/3626887155 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0cc7a0 con 0x7fb06c1577c0 2023-10-06T02:53:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.079+0000 7fb071e08700 1 --2- 172.21.15.81:0/3626887155 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c1577c0 0x7fb06c068810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb068009e90 tx=0x7fb068009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31dc8628c266794c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb070e06700 1 -- 172.21.15.81:0/3626887155 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800e070 con 0x7fb06c1577c0 2023-10-06T02:53:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb070e06700 1 -- 172.21.15.81:0/3626887155 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06800bb80 con 0x7fb06c1577c0 2023-10-06T02:53:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb070e06700 1 -- 172.21.15.81:0/3626887155 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068012430 con 0x7fb06c1577c0 2023-10-06T02:53:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb07406c700 1 -- 172.21.15.81:0/3626887155 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c1577c0 msgr2=0x7fb06c068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb07406c700 1 --2- 172.21.15.81:0/3626887155 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c1577c0 0x7fb06c068810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb068009e90 tx=0x7fb068009780 comp rx=0 tx=0).stop 2023-10-06T02:53:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb07406c700 1 -- 172.21.15.81:0/3626887155 shutdown_connections 2023-10-06T02:53:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb07406c700 1 --2- 172.21.15.81:0/3626887155 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c1577c0 0x7fb06c068810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb07406c700 1 -- 172.21.15.81:0/3626887155 >> 172.21.15.81:0/3626887155 conn(0x7fb06c0d0df0 msgr2=0x7fb06c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb07406c700 1 -- 172.21.15.81:0/3626887155 shutdown_connections 2023-10-06T02:53:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.080+0000 7fb07406c700 1 -- 172.21.15.81:0/3626887155 wait complete. 2023-10-06T02:53:15.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.081+0000 7fb07406c700 1 Processor -- start 2023-10-06T02:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.081+0000 7fb07406c700 1 -- start start 2023-10-06T02:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb07406c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c0cbea0 0x7fb06c1413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb07406c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c1577c0 0x7fb06c0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb07406c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06c157b90 0x7fb06c15fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb07406c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c06dcb0 con 0x7fb06c157b90 2023-10-06T02:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb07406c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c141900 con 0x7fb06c1577c0 2023-10-06T02:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb07406c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c06d0a0 con 0x7fb06c0cbea0 2023-10-06T02:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb072609700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06c157b90 0x7fb06c15fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb072609700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06c157b90 0x7fb06c15fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48154/0 (socket says 172.21.15.81:48154) 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb072609700 1 -- 172.21.15.81:0/3785475071 learned_addr learned my addr 172.21.15.81:0/3785475071 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb071e08700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c0cbea0 0x7fb06c1413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb072609700 1 -- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c0cbea0 msgr2=0x7fb06c1413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb072609700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c0cbea0 0x7fb06c1413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb071607700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c1577c0 0x7fb06c0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb072609700 1 -- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c1577c0 msgr2=0x7fb06c0b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb072609700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c1577c0 0x7fb06c0b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb072609700 1 -- 172.21.15.81:0/3785475071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068009a20 con 0x7fb06c157b90 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.082+0000 7fb071607700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c1577c0 0x7fb06c0b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.083+0000 7fb072609700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06c157b90 0x7fb06c15fbc0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c790 tx=0x7fb064007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.083+0000 7fb061ffb700 1 -- 172.21.15.81:0/3785475071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064005c00 con 0x7fb06c157b90 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.083+0000 7fb061ffb700 1 -- 172.21.15.81:0/3785475071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb064005d60 con 0x7fb06c157b90 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.083+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c06d380 con 0x7fb06c157b90 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.083+0000 7fb061ffb700 1 -- 172.21.15.81:0/3785475071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064007300 con 0x7fb06c157b90 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.083+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c06d940 con 0x7fb06c157b90 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.084+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c06de60 con 0x7fb06c157b90 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.084+0000 7fb061ffb700 1 -- 172.21.15.81:0/3785475071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb064007670 con 0x7fb06c157b90 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.085+0000 7fb061ffb700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb050066f30 0x7fb0500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.085+0000 7fb061ffb700 1 -- 172.21.15.81:0/3785475071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fb064083b20 con 0x7fb06c157b90 2023-10-06T02:53:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.085+0000 7fb071e08700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb050066f30 0x7fb0500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:15.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.085+0000 7fb071e08700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb050066f30 0x7fb0500693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb0680097c0 tx=0x7fb068019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:15.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.089+0000 7fb061ffb700 1 -- 172.21.15.81:0/3785475071 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb06c06de60 con 0x7fb06c157b90 2023-10-06T02:53:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.272+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb06c06de60 con 0x7fb06c157b90 2023-10-06T02:53:15.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.941+0000 7fb061ffb700 1 -- 172.21.15.81:0/3785475071 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v149) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb06c06de60 con 0x7fb06c157b90 2023-10-06T02:53:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.946+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb050066f30 msgr2=0x7fb0500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.946+0000 7fb07406c700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb050066f30 0x7fb0500693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb0680097c0 tx=0x7fb068019000 comp rx=0 tx=0).stop 2023-10-06T02:53:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.946+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06c157b90 msgr2=0x7fb06c15fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.946+0000 7fb07406c700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06c157b90 0x7fb06c15fbc0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c790 tx=0x7fb064007dd0 comp rx=0 tx=0).stop 2023-10-06T02:53:15.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.950+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 shutdown_connections 2023-10-06T02:53:15.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.950+0000 7fb07406c700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06c157b90 0x7fb06c15fbc0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:15.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.950+0000 7fb07406c700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb06c0cbea0 0x7fb06c1413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.950+0000 7fb07406c700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb050066f30 0x7fb0500693e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.950+0000 7fb07406c700 1 --2- 172.21.15.81:0/3785475071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c1577c0 0x7fb06c0b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.950+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 >> 172.21.15.81:0/3785475071 conn(0x7fb06c0d0df0 msgr2=0x7fb06c155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.951+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 shutdown_connections 2023-10-06T02:53:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:15.951+0000 7fb07406c700 1 -- 172.21.15.81:0/3785475071 wait complete. 2023-10-06T02:53:15.954 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:53:15.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:53:16.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.080+0000 7fcefef96700 1 Processor -- start 2023-10-06T02:53:16.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.080+0000 7fcefef96700 1 -- start start 2023-10-06T02:53:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.081+0000 7fcefef96700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8156420 0x7fcef80cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.081+0000 7fcefef96700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80cb880 con 0x7fcef80c71d0 2023-10-06T02:53:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.081+0000 7fcefef96700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80cac70 con 0x7fcef80cc250 2023-10-06T02:53:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.081+0000 7fcefef96700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef806aa10 con 0x7fcef8156420 2023-10-06T02:53:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.081+0000 7fcefd533700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcef80c71d0 0x7fcef80c1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52416/0 (socket says 172.21.15.81:52416) 2023-10-06T02:53:16.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.081+0000 7fcefd533700 1 -- 172.21.15.81:0/298882595 learned_addr learned my addr 172.21.15.81:0/298882595 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:16.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fcefcd32700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8156420 0x7fcef80cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:16.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548587296 0 0) 0x7fcef80cb880 con 0x7fcef80c71d0 2023-10-06T02:53:16.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee0003570 con 0x7fcef80c71d0 2023-10-06T02:53:16.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449112311 0 0) 0x7fcee0003570 con 0x7fcef80c71d0 2023-10-06T02:53:16.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8156420 msgr2=0x7fcef80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:16.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8156420 0x7fcef80cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:16.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 >> v1:172.21.15.83:6789/0 conn(0x7fcef80cc250 legacy=0x7fcef8069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80caf50 con 0x7fcef80c71d0 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fcef0001470 con 0x7fcef80c71d0 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 >> v1:172.21.15.81:6789/0 conn(0x7fcef80c71d0 legacy=0x7fcef80c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8156420 0x7fcee0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004010 0x7fcee0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcee0004d50 0x7fcee00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef806aa10 con 0x7fcee0004010 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee000bbf0 con 0x7fcee0004d50 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee000bdb0 con 0x7fcef8156420 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceeffff700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004010 0x7fcee0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fcefcd32700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8156420 0x7fcee0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fcefd533700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcee0004d50 0x7fcee00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceeffff700 1 -- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8156420 msgr2=0x7fcee0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceeffff700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8156420 0x7fcee0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceeffff700 1 -- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcee0004d50 msgr2=0x7fcee00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceeffff700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcee0004d50 0x7fcee00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.082+0000 7fceeffff700 1 -- 172.21.15.81:0/298882595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee0003570 con 0x7fcee0004010 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fceeffff700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004010 0x7fcee0004810 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fcee80018b0 tx=0x7fcee8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d75b06e1d54028 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8012420 con 0x7fcee0004010 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee8012580 con 0x7fcee0004010 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fceef7fe700 1 -- 172.21.15.81:0/298882595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8012920 con 0x7fcee0004010 2023-10-06T02:53:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fcefef96700 1 -- 172.21.15.81:0/298882595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004010 msgr2=0x7fcee0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fcefef96700 1 --2- 172.21.15.81:0/298882595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004010 0x7fcee0004810 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fcee80018b0 tx=0x7fcee8007d30 comp rx=0 tx=0).stop 2023-10-06T02:53:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fcefd533700 1 -- 172.21.15.81:0/298882595 reap_dead start 2023-10-06T02:53:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fcefef96700 1 -- 172.21.15.81:0/298882595 shutdown_connections 2023-10-06T02:53:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fcefef96700 1 -- 172.21.15.81:0/298882595 >> 172.21.15.81:0/298882595 conn(0x7fcef806c660 msgr2=0x7fcef80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fcefef96700 1 -- 172.21.15.81:0/298882595 shutdown_connections 2023-10-06T02:53:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.083+0000 7fcefef96700 1 -- 172.21.15.81:0/298882595 wait complete. 2023-10-06T02:53:16.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.084+0000 7fcefef96700 1 Processor -- start 2023-10-06T02:53:16.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefef96700 1 -- start start 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefef96700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcee0004010 0x7fcef8146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefef96700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8148240 0x7fcef8148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefef96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef81491e0 0x7fcef81567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefef96700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8157ee0 con 0x7fcef81491e0 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefef96700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8149650 con 0x7fcee0004010 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefef96700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8158d00 con 0x7fcef8148240 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefd533700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef81491e0 0x7fcef81567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefd533700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef81491e0 0x7fcef81567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48178/0 (socket says 172.21.15.81:48178) 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefd533700 1 -- 172.21.15.81:0/4256853732 learned_addr learned my addr 172.21.15.81:0/4256853732 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fceeffff700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8148240 0x7fcef8148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.085+0000 7fcefcd32700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcee0004010 0x7fcef8146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fcefd533700 1 -- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8148240 msgr2=0x7fcef8148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fcefd533700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8148240 0x7fcef8148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fcefd533700 1 -- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcee0004010 msgr2=0x7fcef8146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fcefd533700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcee0004010 0x7fcef8146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fcefd533700 1 -- 172.21.15.81:0/4256853732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef81580f0 con 0x7fcef81491e0 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fcefd533700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef81491e0 0x7fcef81567f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fcef0000c00 tx=0x7fcef0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fceecff9700 1 -- 172.21.15.81:0/4256853732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0018030 con 0x7fcef81491e0 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fceecff9700 1 -- 172.21.15.81:0/4256853732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef0007740 con 0x7fcef81491e0 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef81583d0 con 0x7fcef81491e0 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fceecff9700 1 -- 172.21.15.81:0/4256853732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef000faf0 con 0x7fcef81491e0 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.086+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef8158990 con 0x7fcef81491e0 2023-10-06T02:53:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.087+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef8158e70 con 0x7fcef81491e0 2023-10-06T02:53:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.087+0000 7fceecff9700 1 -- 172.21.15.81:0/4256853732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcef001b070 con 0x7fcef81491e0 2023-10-06T02:53:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.088+0000 7fceecff9700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcee4066f30 0x7fcee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.088+0000 7fceecff9700 1 -- 172.21.15.81:0/4256853732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fcef0019070 con 0x7fcef81491e0 2023-10-06T02:53:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.088+0000 7fcefcd32700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcee4066f30 0x7fcee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.088+0000 7fcefcd32700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcee4066f30 0x7fcee40693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcef40094d0 tx=0x7fcef400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.092+0000 7fceecff9700 1 -- 172.21.15.81:0/4256853732 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcef0051490 con 0x7fcef81491e0 2023-10-06T02:53:16.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.318+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcef80cb230 con 0x7fcef81491e0 2023-10-06T02:53:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.954+0000 7fceecff9700 1 -- 172.21.15.81:0/4256853732 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v71) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcef0054ab0 con 0x7fcef81491e0 2023-10-06T02:53:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcee4066f30 msgr2=0x7fcee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcee4066f30 0x7fcee40693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcef40094d0 tx=0x7fcef400b040 comp rx=0 tx=0).stop 2023-10-06T02:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef81491e0 msgr2=0x7fcef81567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef81491e0 0x7fcef81567f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fcef0000c00 tx=0x7fcef0001e50 comp rx=0 tx=0).stop 2023-10-06T02:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 shutdown_connections 2023-10-06T02:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef81491e0 0x7fcef81567f0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcee4066f30 0x7fcee40693e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcee0004010 0x7fcef8146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 --2- 172.21.15.81:0/4256853732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef8148240 0x7fcef8148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 >> 172.21.15.81:0/4256853732 conn(0x7fcef806c660 msgr2=0x7fcef80b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.965+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 shutdown_connections 2023-10-06T02:53:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:16.966+0000 7fcefef96700 1 -- 172.21.15.81:0/4256853732 wait complete. 2023-10-06T02:53:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 19 and data pool 20 2023-10-06T02:53:16.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:53:17.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.095+0000 7f57fdcff700 1 Processor -- start 2023-10-06T02:53:17.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.095+0000 7f57fdcff700 1 -- start start 2023-10-06T02:53:17.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57fdcff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 0x7f57f80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57fdcff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57f8159f10 0x7f57f8068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57fdcff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f57f80ccb40 0x7f57f8068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57fdcff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f80cee10 con 0x7f57f8159f10 2023-10-06T02:53:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57fdcff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f80cd040 con 0x7f57f80ccb40 2023-10-06T02:53:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57fdcff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f80cd320 con 0x7f57f8159b40 2023-10-06T02:53:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57f8159f10 0x7f57f8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57f8159f10 0x7f57f8068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48194/0 (socket says 172.21.15.81:48194) 2023-10-06T02:53:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f7fff700 1 -- 172.21.15.81:0/234634437 learned_addr learned my addr 172.21.15.81:0/234634437 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57fd4fe700 1 --2- 172.21.15.81:0/234634437 >> v2:172.21.15.83:3300/0 conn(0x7f57f80ccb40 0x7f57f8068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57fccfd700 1 --2- 172.21.15.81:0/234634437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 0x7f57f80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f7fff700 1 -- 172.21.15.81:0/234634437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 msgr2=0x7f57f80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f7fff700 1 --2- 172.21.15.81:0/234634437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 0x7f57f80cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f7fff700 1 -- 172.21.15.81:0/234634437 >> v2:172.21.15.83:3300/0 conn(0x7f57f80ccb40 msgr2=0x7f57f8068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f7fff700 1 --2- 172.21.15.81:0/234634437 >> v2:172.21.15.83:3300/0 conn(0x7f57f80ccb40 0x7f57f8068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f7fff700 1 -- 172.21.15.81:0/234634437 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f80ce7c0 con 0x7f57f8159f10 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f7fff700 1 --2- 172.21.15.81:0/234634437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f8159f10 0x7f57f8068780 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f57f80b6bf0 tx=0x7f57e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33874f45a2ae32be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.096+0000 7f57f77fe700 1 -- 172.21.15.81:0/234634437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e400b860 con 0x7f57f8159f10 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57f77fe700 1 -- 172.21.15.81:0/234634437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e400b9c0 con 0x7f57f8159f10 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57f77fe700 1 -- 172.21.15.81:0/234634437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e400bd60 con 0x7f57f8159f10 2023-10-06T02:53:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57fdcff700 1 -- 172.21.15.81:0/234634437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f8159f10 msgr2=0x7f57f8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57fdcff700 1 --2- 172.21.15.81:0/234634437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f8159f10 0x7f57f8068780 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f57f80b6bf0 tx=0x7f57e4009250 comp rx=0 tx=0).stop 2023-10-06T02:53:17.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57fdcff700 1 -- 172.21.15.81:0/234634437 shutdown_connections 2023-10-06T02:53:17.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57fdcff700 1 --2- 172.21.15.81:0/234634437 >> v2:172.21.15.83:3300/0 conn(0x7f57f80ccb40 0x7f57f8068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57fdcff700 1 --2- 172.21.15.81:0/234634437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 0x7f57f80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57fdcff700 1 --2- 172.21.15.81:0/234634437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f8159f10 0x7f57f8068780 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57fdcff700 1 -- 172.21.15.81:0/234634437 >> 172.21.15.81:0/234634437 conn(0x7f57f80cd660 msgr2=0x7f57f80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:17.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57fdcff700 1 -- 172.21.15.81:0/234634437 shutdown_connections 2023-10-06T02:53:17.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.097+0000 7f57fdcff700 1 -- 172.21.15.81:0/234634437 wait complete. 2023-10-06T02:53:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.098+0000 7f57fdcff700 1 Processor -- start 2023-10-06T02:53:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.098+0000 7f57fdcff700 1 -- start start 2023-10-06T02:53:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fdcff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f80ccb40 0x7f57f816a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fdcff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 0x7f57f81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fdcff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57f8159f10 0x7f57f8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fdcff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f816dcb0 con 0x7f57f80ccb40 2023-10-06T02:53:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fdcff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f81581c0 con 0x7f57f8159f10 2023-10-06T02:53:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fdcff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8157340 con 0x7f57f8159b40 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fccfd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f80ccb40 0x7f57f816a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fccfd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f80ccb40 0x7f57f816a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48210/0 (socket says 172.21.15.81:48210) 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fccfd700 1 -- 172.21.15.81:0/3986211939 learned_addr learned my addr 172.21.15.81:0/3986211939 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fd4fe700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57f8159f10 0x7f57f8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57f7fff700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 0x7f57f81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fccfd700 1 -- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 msgr2=0x7f57f81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fccfd700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 0x7f57f81568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fccfd700 1 -- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57f8159f10 msgr2=0x7f57f8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fccfd700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57f8159f10 0x7f57f8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.099+0000 7f57fccfd700 1 -- 172.21.15.81:0/3986211939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40094f0 con 0x7f57f80ccb40 2023-10-06T02:53:17.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.100+0000 7f57fccfd700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f80ccb40 0x7f57f816a850 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00d8c0 tx=0x7f57ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.100+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3986211939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0125f0 con 0x7f57f80ccb40 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.100+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3986211939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec012750 con 0x7f57f80ccb40 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.100+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f816ad90 con 0x7f57f80ccb40 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.100+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3986211939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec012af0 con 0x7f57f80ccb40 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.100+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f8157890 con 0x7f57f80ccb40 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.101+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f80cb890 con 0x7f57f80ccb40 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.101+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3986211939 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57ec01e460 con 0x7f57f80ccb40 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.102+0000 7f57f4ff9700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f57dc066f30 0x7f57dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.102+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3986211939 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f57ec084d00 con 0x7f57f80ccb40 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.102+0000 7f57f7fff700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f57dc066f30 0x7f57dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.103+0000 7f57f7fff700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f57dc066f30 0x7f57dc0693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f57f80b6bf0 tx=0x7f57e4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:17.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.106+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3986211939 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57ec051d70 con 0x7f57f80ccb40 2023-10-06T02:53:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.291+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57f80ceaa0 con 0x7f57f80ccb40 2023-10-06T02:53:17.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.292+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3986211939 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16847 (secure 0 0 0) 0x7f57ec055390 con 0x7f57f80ccb40 2023-10-06T02:53:17.294 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:17.294 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":150,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:53:16.320134+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:53:13.969056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T02:53:15.291652+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:53:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f57dc066f30 msgr2=0x7f57dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f57dc066f30 0x7f57dc0693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f57f80b6bf0 tx=0x7f57e4017000 comp rx=0 tx=0).stop 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f80ccb40 msgr2=0x7f57f816a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f80ccb40 0x7f57f816a850 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00d8c0 tx=0x7f57ec008040 comp rx=0 tx=0).stop 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 shutdown_connections 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f57dc066f30 0x7f57dc0693e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57f8159f10 0x7f57f8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f80ccb40 0x7f57f816a850 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 --2- 172.21.15.81:0/3986211939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57f8159b40 0x7f57f81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 >> 172.21.15.81:0/3986211939 conn(0x7f57f80cd660 msgr2=0x7f57f80c6610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 shutdown_connections 2023-10-06T02:53:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.294+0000 7f57fdcff700 1 -- 172.21.15.81:0/3986211939 wait complete. 2023-10-06T02:53:17.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:53:17.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.422+0000 7fd529c34700 1 Processor -- start 2023-10-06T02:53:17.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.422+0000 7fd529c34700 1 -- start start 2023-10-06T02:53:17.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd529c34700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd524157ca0 0x7fd5240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd529c34700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd52406d120 0x7fd52406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd529c34700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52406dac0 con 0x7fd5241578d0 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd529c34700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5240d07c0 con 0x7fd52406d120 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd529c34700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240cfbb0 con 0x7fd524157ca0 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd5237fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd5241578d0 0x7fd52415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52422/0 (socket says 172.21.15.81:52422) 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd5237fe700 1 -- 172.21.15.81:0/1385558246 learned_addr learned my addr 172.21.15.81:0/1385558246 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd522ffd700 1 --2- 172.21.15.81:0/1385558246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd524157ca0 0x7fd5240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd523fff700 1 --2- 172.21.15.81:0/1385558246 >> v2:172.21.15.83:3300/0 conn(0x7fd52406d120 0x7fd52406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd5227fc700 1 -- 172.21.15.81:0/1385558246 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123511370 0 0) 0x7fd514001490 con 0x7fd5241578d0 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd5227fc700 1 -- 172.21.15.81:0/1385558246 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd50c003570 con 0x7fd5241578d0 2023-10-06T02:53:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd5227fc700 1 -- 172.21.15.81:0/1385558246 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2359200117 0 0) 0x7fd50c003570 con 0x7fd5241578d0 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd522ffd700 1 -- 172.21.15.81:0/1385558246 >> v2:172.21.15.83:3300/0 conn(0x7fd52406d120 msgr2=0x7fd52406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd522ffd700 1 --2- 172.21.15.81:0/1385558246 >> v2:172.21.15.83:3300/0 conn(0x7fd52406d120 0x7fd52406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd522ffd700 1 -- 172.21.15.81:0/1385558246 >> v1:172.21.15.81:6789/0 conn(0x7fd5241578d0 legacy=0x7fd52415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.423+0000 7fd522ffd700 1 -- 172.21.15.81:0/1385558246 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240cfe90 con 0x7fd524157ca0 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd522ffd700 1 --2- 172.21.15.81:0/1385558246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd524157ca0 0x7fd5240cf4f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd5180098e0 tx=0x7fd5180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d921ec651fcd8dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd5227fc700 1 -- 172.21.15.81:0/1385558246 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514001980 con 0x7fd524157ca0 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd5227fc700 1 -- 172.21.15.81:0/1385558246 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518011420 con 0x7fd524157ca0 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd5227fc700 1 -- 172.21.15.81:0/1385558246 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180117c0 con 0x7fd524157ca0 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd529c34700 1 -- 172.21.15.81:0/1385558246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd524157ca0 msgr2=0x7fd5240cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd529c34700 1 --2- 172.21.15.81:0/1385558246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd524157ca0 0x7fd5240cf4f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd5180098e0 tx=0x7fd5180091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd529c34700 1 -- 172.21.15.81:0/1385558246 shutdown_connections 2023-10-06T02:53:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd529c34700 1 --2- 172.21.15.81:0/1385558246 >> v2:172.21.15.83:3300/0 conn(0x7fd52406d120 0x7fd52406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd529c34700 1 --2- 172.21.15.81:0/1385558246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd524157ca0 0x7fd5240cf4f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd529c34700 1 -- 172.21.15.81:0/1385558246 >> 172.21.15.81:0/1385558246 conn(0x7fd52406bb90 msgr2=0x7fd52406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:17.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd529c34700 1 -- 172.21.15.81:0/1385558246 shutdown_connections 2023-10-06T02:53:17.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.424+0000 7fd529c34700 1 -- 172.21.15.81:0/1385558246 wait complete. 2023-10-06T02:53:17.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.426+0000 7fd529c34700 1 Processor -- start 2023-10-06T02:53:17.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.426+0000 7fd529c34700 1 -- start start 2023-10-06T02:53:17.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.426+0000 7fd529c34700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd52406d120 0x7fd5240b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.426+0000 7fd529c34700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd5241578d0 0x7fd52416b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.426+0000 7fd529c34700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd524157ca0 0x7fd5240b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.426+0000 7fd529c34700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240b3500 con 0x7fd524157ca0 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.426+0000 7fd529c34700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240b51e0 con 0x7fd52406d120 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.426+0000 7fd529c34700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240b54c0 con 0x7fd5241578d0 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd523fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd524157ca0 0x7fd5240b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd5237fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd52406d120 0x7fd5240b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd523fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd524157ca0 0x7fd5240b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48212/0 (socket says 172.21.15.81:48212) 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd523fff700 1 -- 172.21.15.81:0/714600722 learned_addr learned my addr 172.21.15.81:0/714600722 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd522ffd700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd5241578d0 0x7fd52416b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd523fff700 1 -- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd5241578d0 msgr2=0x7fd52416b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd523fff700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd5241578d0 0x7fd52416b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd523fff700 1 -- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd52406d120 msgr2=0x7fd5240b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd523fff700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd52406d120 0x7fd5240b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd523fff700 1 -- 172.21.15.81:0/714600722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518009420 con 0x7fd524157ca0 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd523fff700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd524157ca0 0x7fd5240b2fc0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00ea50 tx=0x7fd51c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd50b7fe700 1 -- 172.21.15.81:0/714600722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00ee90 con 0x7fd524157ca0 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd50b7fe700 1 -- 172.21.15.81:0/714600722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c00c850 con 0x7fd524157ca0 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5240b57a0 con 0x7fd524157ca0 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd50b7fe700 1 -- 172.21.15.81:0/714600722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00cc10 con 0x7fd524157ca0 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.427+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5240b5d60 con 0x7fd524157ca0 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.428+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5240b5f50 con 0x7fd524157ca0 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.428+0000 7fd50b7fe700 1 -- 172.21.15.81:0/714600722 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd51c013470 con 0x7fd524157ca0 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.429+0000 7fd50b7fe700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd510066f30 0x7fd5100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.429+0000 7fd50b7fe700 1 -- 172.21.15.81:0/714600722 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd51c0848e0 con 0x7fd524157ca0 2023-10-06T02:53:17.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.429+0000 7fd5237fe700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd510066f30 0x7fd5100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.430+0000 7fd5237fe700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd510066f30 0x7fd5100693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd514001900 tx=0x7fd514001690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:17.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.433+0000 7fd50b7fe700 1 -- 172.21.15.81:0/714600722 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd51c0519f0 con 0x7fd524157ca0 2023-10-06T02:53:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.616+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5240d0170 con 0x7fd524157ca0 2023-10-06T02:53:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.617+0000 7fd50b7fe700 1 -- 172.21.15.81:0/714600722 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16847 (secure 0 0 0) 0x7fd51c055010 con 0x7fd524157ca0 2023-10-06T02:53:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:17.619 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":150,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:53:16.320134+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:53:13.969056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T02:53:15.291652+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:53:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd510066f30 msgr2=0x7fd5100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd510066f30 0x7fd5100693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd514001900 tx=0x7fd514001690 comp rx=0 tx=0).stop 2023-10-06T02:53:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd524157ca0 msgr2=0x7fd5240b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd524157ca0 0x7fd5240b2fc0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00ea50 tx=0x7fd51c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 shutdown_connections 2023-10-06T02:53:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd524157ca0 0x7fd5240b2fc0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd510066f30 0x7fd5100693e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd52406d120 0x7fd5240b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 --2- 172.21.15.81:0/714600722 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd5241578d0 0x7fd52416b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 >> 172.21.15.81:0/714600722 conn(0x7fd52406bb90 msgr2=0x7fd524069600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 shutdown_connections 2023-10-06T02:53:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.619+0000 7fd529c34700 1 -- 172.21.15.81:0/714600722 wait complete. 2023-10-06T02:53:17.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:53:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.748+0000 7fdf872dd700 1 Processor -- start 2023-10-06T02:53:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.748+0000 7fdf872dd700 1 -- start start 2023-10-06T02:53:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf872dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8015b2f0 0x7fdf800c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf872dd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf8006f2a0 0x7fdf800ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf872dd700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8006ee10 con 0x7fdf800c8b60 2023-10-06T02:53:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf872dd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8006e200 con 0x7fdf8006f2a0 2023-10-06T02:53:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf872dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8006e4e0 con 0x7fdf8015b2f0 2023-10-06T02:53:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf86adc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf8006f2a0 0x7fdf800ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf86adc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf8006f2a0 0x7fdf800ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48218/0 (socket says 172.21.15.81:48218) 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf86adc700 1 -- 172.21.15.81:0/1815148427 learned_addr learned my addr 172.21.15.81:0/1815148427 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf85ada700 1 --2- 172.21.15.81:0/1815148427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8015b2f0 0x7fdf800c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf86adc700 1 -- 172.21.15.81:0/1815148427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8015b2f0 msgr2=0x7fdf800c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf86adc700 1 --2- 172.21.15.81:0/1815148427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8015b2f0 0x7fdf800c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf86adc700 1 -- 172.21.15.81:0/1815148427 >> v1:172.21.15.83:6789/0 conn(0x7fdf800c8b60 legacy=0x7fdf800ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.749+0000 7fdf86adc700 1 -- 172.21.15.81:0/1815148427 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8006e7c0 con 0x7fdf8006f2a0 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf86adc700 1 --2- 172.21.15.81:0/1815148427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8006f2a0 0x7fdf800ac8a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800bc50 tx=0x7fdf7800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91b042f74f6e301 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf852d9700 1 -- 172.21.15.81:0/1815148427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7800dbf0 con 0x7fdf8006f2a0 2023-10-06T02:53:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf852d9700 1 -- 172.21.15.81:0/1815148427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7800dd50 con 0x7fdf8006f2a0 2023-10-06T02:53:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf852d9700 1 -- 172.21.15.81:0/1815148427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf780196b0 con 0x7fdf8006f2a0 2023-10-06T02:53:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf872dd700 1 -- 172.21.15.81:0/1815148427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8006f2a0 msgr2=0x7fdf800ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf872dd700 1 --2- 172.21.15.81:0/1815148427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8006f2a0 0x7fdf800ac8a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800bc50 tx=0x7fdf7800b4f0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf872dd700 1 -- 172.21.15.81:0/1815148427 shutdown_connections 2023-10-06T02:53:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf872dd700 1 --2- 172.21.15.81:0/1815148427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8006f2a0 0x7fdf800ac8a0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf872dd700 1 --2- 172.21.15.81:0/1815148427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8015b2f0 0x7fdf800c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf872dd700 1 -- 172.21.15.81:0/1815148427 >> 172.21.15.81:0/1815148427 conn(0x7fdf8006cca0 msgr2=0x7fdf8006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf872dd700 1 -- 172.21.15.81:0/1815148427 shutdown_connections 2023-10-06T02:53:17.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.750+0000 7fdf872dd700 1 -- 172.21.15.81:0/1815148427 wait complete. 2023-10-06T02:53:17.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.751+0000 7fdf872dd700 1 Processor -- start 2023-10-06T02:53:17.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.751+0000 7fdf872dd700 1 -- start start 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf872dd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8006f2a0 0x7fdf8016de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf872dd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf800c8b60 0x7fdf800c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf872dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8015b2f0 0x7fdf80147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf872dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8016e350 con 0x7fdf8015b2f0 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf872dd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf80153a90 con 0x7fdf800c8b60 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf872dd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800cb830 con 0x7fdf8006f2a0 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf86adc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8015b2f0 0x7fdf80147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf86adc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8015b2f0 0x7fdf80147df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48228/0 (socket says 172.21.15.81:48228) 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf86adc700 1 -- 172.21.15.81:0/3085221560 learned_addr learned my addr 172.21.15.81:0/3085221560 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf862db700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8006f2a0 0x7fdf8016de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.752+0000 7fdf85ada700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf800c8b60 0x7fdf800c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf86adc700 1 -- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8006f2a0 msgr2=0x7fdf8016de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf86adc700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8006f2a0 0x7fdf8016de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf86adc700 1 -- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf800c8b60 msgr2=0x7fdf800c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf86adc700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf800c8b60 0x7fdf800c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf86adc700 1 -- 172.21.15.81:0/3085221560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7800b790 con 0x7fdf8015b2f0 2023-10-06T02:53:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf86adc700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8015b2f0 0x7fdf80147df0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fdf80063d30 tx=0x7fdf7801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf767fc700 1 -- 172.21.15.81:0/3085221560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7800dbf0 con 0x7fdf8015b2f0 2023-10-06T02:53:17.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf767fc700 1 -- 172.21.15.81:0/3085221560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7800dec0 con 0x7fdf8015b2f0 2023-10-06T02:53:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf800cbb10 con 0x7fdf8015b2f0 2023-10-06T02:53:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf767fc700 1 -- 172.21.15.81:0/3085221560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78010da0 con 0x7fdf8015b2f0 2023-10-06T02:53:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.753+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf800cc0d0 con 0x7fdf8015b2f0 2023-10-06T02:53:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.754+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf800684e0 con 0x7fdf8015b2f0 2023-10-06T02:53:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.754+0000 7fdf767fc700 1 -- 172.21.15.81:0/3085221560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf7802c430 con 0x7fdf8015b2f0 2023-10-06T02:53:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.755+0000 7fdf767fc700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf64066f30 0x7fdf640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.755+0000 7fdf767fc700 1 -- 172.21.15.81:0/3085221560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf78014070 con 0x7fdf8015b2f0 2023-10-06T02:53:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.755+0000 7fdf862db700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf64066f30 0x7fdf640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.755+0000 7fdf862db700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf64066f30 0x7fdf640693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c007fd0 tx=0x7fdf7c0016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:17.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.759+0000 7fdf767fc700 1 -- 172.21.15.81:0/3085221560 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf780535f0 con 0x7fdf8015b2f0 2023-10-06T02:53:17.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:17.987+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf80071b10 con 0x7fdf8015b2f0 2023-10-06T02:53:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.983+0000 7fdf767fc700 1 -- 172.21.15.81:0/3085221560 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v74) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf78056c10 con 0x7fdf8015b2f0 2023-10-06T02:53:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf64066f30 msgr2=0x7fdf640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf64066f30 0x7fdf640693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c007fd0 tx=0x7fdf7c0016f0 comp rx=0 tx=0).stop 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8015b2f0 msgr2=0x7fdf80147df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8015b2f0 0x7fdf80147df0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fdf80063d30 tx=0x7fdf7801b000 comp rx=0 tx=0).stop 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 shutdown_connections 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8015b2f0 0x7fdf80147df0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8006f2a0 0x7fdf8016de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fdf64066f30 0x7fdf640693e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 --2- 172.21.15.81:0/3085221560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf800c8b60 0x7fdf800c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 >> 172.21.15.81:0/3085221560 conn(0x7fdf8006cca0 msgr2=0x7fdf80070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 shutdown_connections 2023-10-06T02:53:18.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:18.986+0000 7fdf872dd700 1 -- 172.21.15.81:0/3085221560 wait complete. 2023-10-06T02:53:19.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:53:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.117+0000 7ff5dc2e5700 1 Processor -- start 2023-10-06T02:53:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.117+0000 7ff5dc2e5700 1 -- start start 2023-10-06T02:53:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.118+0000 7ff5dc2e5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d41578d0 0x7ff5d40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.118+0000 7ff5dc2e5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40d07c0 con 0x7ff5d406d120 2023-10-06T02:53:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.118+0000 7ff5dc2e5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40cfbb0 con 0x7ff5d4157ca0 2023-10-06T02:53:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.118+0000 7ff5dc2e5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40cfe90 con 0x7ff5d41578d0 2023-10-06T02:53:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.118+0000 7ff5da882700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff5d406d120 0x7ff5d415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52430/0 (socket says 172.21.15.81:52430) 2023-10-06T02:53:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.118+0000 7ff5da882700 1 -- 172.21.15.81:0/1992787213 learned_addr learned my addr 172.21.15.81:0/1992787213 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.118+0000 7ff5da081700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d41578d0 0x7ff5d40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.118+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442340848 0 0) 0x7ff5d40d07c0 con 0x7ff5d406d120 2023-10-06T02:53:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c0003570 con 0x7ff5d406d120 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2566580344 0 0) 0x7ff5c0003570 con 0x7ff5d406d120 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d41578d0 msgr2=0x7ff5d40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d41578d0 0x7ff5d40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 >> v1:172.21.15.83:6789/0 conn(0x7ff5d4157ca0 legacy=0x7ff5d415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40d0170 con 0x7ff5d406d120 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7ff5cc001470 con 0x7ff5d406d120 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 >> v1:172.21.15.81:6789/0 conn(0x7ff5d406d120 legacy=0x7ff5d415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d41578d0 0x7ff5c0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5c0004010 0x7ff5c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40cfe90 con 0x7ff5c0004d50 2023-10-06T02:53:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c000bbf0 con 0x7ff5c0004010 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c000bdb0 con 0x7ff5d41578d0 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5da882700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5d9880700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5c0004010 0x7ff5c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5da081700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d41578d0 0x7ff5c0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5da882700 1 -- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d41578d0 msgr2=0x7ff5c0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5da882700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d41578d0 0x7ff5c0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5da882700 1 -- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5c0004010 msgr2=0x7ff5c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5da882700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5c0004010 0x7ff5c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5da882700 1 -- 172.21.15.81:0/1992787213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c0003570 con 0x7ff5c0004d50 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.119+0000 7ff5da882700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5c00051c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc001ed0 tx=0x7ff5d415b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43f7a3f95ea9aef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00cc30 con 0x7ff5c0004d50 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc00cd90 con 0x7ff5c0004d50 2023-10-06T02:53:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5d907f700 1 -- 172.21.15.81:0/1992787213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc005b70 con 0x7ff5c0004d50 2023-10-06T02:53:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1992787213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 msgr2=0x7ff5c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5dc2e5700 1 --2- 172.21.15.81:0/1992787213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5c00051c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc001ed0 tx=0x7ff5d415b610 comp rx=0 tx=0).stop 2023-10-06T02:53:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5da882700 1 -- 172.21.15.81:0/1992787213 reap_dead start 2023-10-06T02:53:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1992787213 shutdown_connections 2023-10-06T02:53:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1992787213 >> 172.21.15.81:0/1992787213 conn(0x7ff5d406bb90 msgr2=0x7ff5d406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1992787213 shutdown_connections 2023-10-06T02:53:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.120+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1992787213 wait complete. 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.121+0000 7ff5dc2e5700 1 Processor -- start 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.121+0000 7ff5dc2e5700 1 -- start start 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5dc2e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5d40c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5dc2e5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5d416e7e0 0x7ff5d415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5dc2e5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d40ccde0 0x7ff5d40cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5dc2e5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40c8580 con 0x7ff5c0004d50 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5dc2e5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40c7a00 con 0x7ff5d416e7e0 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5dc2e5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40c7ce0 con 0x7ff5d40ccde0 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da081700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5d40c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da081700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5d40c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48250/0 (socket says 172.21.15.81:48250) 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da081700 1 -- 172.21.15.81:0/1789602852 learned_addr learned my addr 172.21.15.81:0/1789602852 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da882700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d40ccde0 0x7ff5d40cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5d9880700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5d416e7e0 0x7ff5d415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da081700 1 -- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d40ccde0 msgr2=0x7ff5d40cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da081700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d40ccde0 0x7ff5d40cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da081700 1 -- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5d416e7e0 msgr2=0x7ff5d415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da081700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5d416e7e0 0x7ff5d415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da081700 1 -- 172.21.15.81:0/1789602852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40c7fc0 con 0x7ff5c0004d50 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da882700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d40ccde0 0x7ff5d40cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.122+0000 7ff5da081700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5d40c7420 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0011f00 tx=0x7ff5d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.123+0000 7ff5ca7fc700 1 -- 172.21.15.81:0/1789602852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000e040 con 0x7ff5c0004d50 2023-10-06T02:53:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.123+0000 7ff5ca7fc700 1 -- 172.21.15.81:0/1789602852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d000f040 con 0x7ff5c0004d50 2023-10-06T02:53:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.123+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d40c82a0 con 0x7ff5c0004d50 2023-10-06T02:53:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.123+0000 7ff5ca7fc700 1 -- 172.21.15.81:0/1789602852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0015430 con 0x7ff5c0004d50 2023-10-06T02:53:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.123+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40cd7a0 con 0x7ff5c0004d50 2023-10-06T02:53:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.124+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d4067ac0 con 0x7ff5c0004d50 2023-10-06T02:53:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.124+0000 7ff5ca7fc700 1 -- 172.21.15.81:0/1789602852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5d0015860 con 0x7ff5c0004d50 2023-10-06T02:53:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.124+0000 7ff5ca7fc700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff5b8066f30 0x7ff5b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.124+0000 7ff5ca7fc700 1 -- 172.21.15.81:0/1789602852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff5d0085390 con 0x7ff5c0004d50 2023-10-06T02:53:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.124+0000 7ff5d9880700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff5b8066f30 0x7ff5b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.125+0000 7ff5d9880700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff5b8066f30 0x7ff5b80693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4003b00 tx=0x7ff5c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.129+0000 7ff5ca7fc700 1 -- 172.21.15.81:0/1789602852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5d00524a0 con 0x7ff5c0004d50 2023-10-06T02:53:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.353+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff5d416a810 con 0x7ff5c0004d50 2023-10-06T02:53:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.985+0000 7ff5ca7fc700 1 -- 172.21.15.81:0/1789602852 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v75) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff5d0055ac0 con 0x7ff5c0004d50 2023-10-06T02:53:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.987+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff5b8066f30 msgr2=0x7ff5b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.987+0000 7ff5dc2e5700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff5b8066f30 0x7ff5b80693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4003b00 tx=0x7ff5c4009040 comp rx=0 tx=0).stop 2023-10-06T02:53:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.987+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 msgr2=0x7ff5d40c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.987+0000 7ff5dc2e5700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5d40c7420 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0011f00 tx=0x7ff5d000b040 comp rx=0 tx=0).stop 2023-10-06T02:53:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.987+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 shutdown_connections 2023-10-06T02:53:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.988+0000 7ff5dc2e5700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5d40ccde0 0x7ff5d40cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.988+0000 7ff5dc2e5700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0004d50 0x7ff5d40c7420 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.988+0000 7ff5dc2e5700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff5b8066f30 0x7ff5b80693e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.988+0000 7ff5dc2e5700 1 --2- 172.21.15.81:0/1789602852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5d416e7e0 0x7ff5d415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.988+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 >> 172.21.15.81:0/1789602852 conn(0x7ff5d406bb90 msgr2=0x7ff5d4156ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.988+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 shutdown_connections 2023-10-06T02:53:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:19.988+0000 7ff5dc2e5700 1 -- 172.21.15.81:0/1789602852 wait complete. 2023-10-06T02:53:20.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:53:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.114+0000 7efc032ff700 1 Processor -- start 2023-10-06T02:53:20.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.114+0000 7efc032ff700 1 -- start start 2023-10-06T02:53:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.115+0000 7efc032ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc15a2a0 0x7efbfc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.115+0000 7efc032ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc0b0ca0 con 0x7efbfc0ceb30 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.115+0000 7efc032ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc0b00d0 con 0x7efbfc06dd60 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.115+0000 7efc032ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc06ea90 con 0x7efbfc15a2a0 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.115+0000 7efc0089a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efbfc0ceb30 0x7efbfc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52438/0 (socket says 172.21.15.81:52438) 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.115+0000 7efc0089a700 1 -- 172.21.15.81:0/776352880 learned_addr learned my addr 172.21.15.81:0/776352880 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253588112 0 0) 0x7efbfc0b0ca0 con 0x7efbfc0ceb30 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbec003570 con 0x7efbfc0ceb30 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efc0109b700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc15a2a0 0x7efbfc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956215121 0 0) 0x7efbec003570 con 0x7efbfc0ceb30 2023-10-06T02:53:20.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc15a2a0 msgr2=0x7efbfc0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc15a2a0 0x7efbfc0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 >> v1:172.21.15.83:6789/0 conn(0x7efbfc06dd60 legacy=0x7efbfc0b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0b0370 con 0x7efbfc0ceb30 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7efbe8001470 con 0x7efbfc0ceb30 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 >> v1:172.21.15.81:6789/0 conn(0x7efbfc0ceb30 legacy=0x7efbfc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbec003a90 0x7efbec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc15a2a0 0x7efbec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbec004d50 0x7efbec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc06ea90 con 0x7efbec003a90 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec00bb70 con 0x7efbec004d50 2023-10-06T02:53:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbec00bd30 con 0x7efbfc15a2a0 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efc0109b700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbec003a90 0x7efbec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efc0089a700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc15a2a0 0x7efbec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efc0109b700 1 -- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc15a2a0 msgr2=0x7efbec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efc0109b700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc15a2a0 0x7efbec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efc0109b700 1 -- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbec004d50 msgr2=0x7efbec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efc0109b700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbec004d50 0x7efbec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efc0109b700 1 -- 172.21.15.81:0/776352880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec003570 con 0x7efbec003a90 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.116+0000 7efc0089a700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc15a2a0 0x7efbec004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efc0109b700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbec003a90 0x7efbec003ea0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7efbf000e210 tx=0x7efbf000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cbb145b29a2466 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000eac0 con 0x7efbec003a90 2023-10-06T02:53:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf000f040 con 0x7efbec003a90 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efbfbfff700 1 -- 172.21.15.81:0/776352880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000ee70 con 0x7efbec003a90 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efc032ff700 1 -- 172.21.15.81:0/776352880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbec003a90 msgr2=0x7efbec003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efc032ff700 1 --2- 172.21.15.81:0/776352880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbec003a90 0x7efbec003ea0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7efbf000e210 tx=0x7efbf000b040 comp rx=0 tx=0).stop 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efc0189c700 1 -- 172.21.15.81:0/776352880 reap_dead start 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efc032ff700 1 -- 172.21.15.81:0/776352880 shutdown_connections 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efc032ff700 1 -- 172.21.15.81:0/776352880 >> 172.21.15.81:0/776352880 conn(0x7efbfc067640 msgr2=0x7efbfc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efc032ff700 1 -- 172.21.15.81:0/776352880 shutdown_connections 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.117+0000 7efc032ff700 1 -- 172.21.15.81:0/776352880 wait complete. 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.118+0000 7efc032ff700 1 Processor -- start 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.118+0000 7efc032ff700 1 -- start start 2023-10-06T02:53:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.119+0000 7efc032ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbec003a90 0x7efbfc142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.119+0000 7efc032ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc16d570 0x7efbfc155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.119+0000 7efc032ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbfc1563d0 0x7efbfc16b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.119+0000 7efc032ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc156850 con 0x7efbfc1563d0 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.119+0000 7efc032ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc16c4d0 con 0x7efbec003a90 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.119+0000 7efc032ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc16c7b0 con 0x7efbfc16d570 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.119+0000 7efc0189c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbfc1563d0 0x7efbfc16b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.119+0000 7efc0189c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbfc1563d0 0x7efbfc16b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48270/0 (socket says 172.21.15.81:48270) 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.119+0000 7efc0189c700 1 -- 172.21.15.81:0/491761031 learned_addr learned my addr 172.21.15.81:0/491761031 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc0109b700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbec003a90 0x7efbfc142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc0089a700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc16d570 0x7efbfc155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc0189c700 1 -- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc16d570 msgr2=0x7efbfc155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc0189c700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc16d570 0x7efbfc155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc0189c700 1 -- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbec003a90 msgr2=0x7efbfc142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc0189c700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbec003a90 0x7efbfc142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc0189c700 1 -- 172.21.15.81:0/491761031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc16ca90 con 0x7efbfc1563d0 2023-10-06T02:53:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc0109b700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbec003a90 0x7efbfc142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc0189c700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbfc1563d0 0x7efbfc16b7a0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7efbfc06f940 tx=0x7efbf4007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efbf97fa700 1 -- 172.21.15.81:0/491761031 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4001ea0 con 0x7efbfc1563d0 2023-10-06T02:53:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efbf97fa700 1 -- 172.21.15.81:0/491761031 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf40070d0 con 0x7efbfc1563d0 2023-10-06T02:53:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efbf97fa700 1 -- 172.21.15.81:0/491761031 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf40074f0 con 0x7efbfc1563d0 2023-10-06T02:53:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc16cd70 con 0x7efbfc1563d0 2023-10-06T02:53:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.120+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc143480 con 0x7efbfc1563d0 2023-10-06T02:53:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.121+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc069e40 con 0x7efbfc1563d0 2023-10-06T02:53:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.121+0000 7efbf97fa700 1 -- 172.21.15.81:0/491761031 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efbf4005a20 con 0x7efbfc1563d0 2023-10-06T02:53:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.122+0000 7efbf97fa700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efbe0066f30 0x7efbe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.122+0000 7efbf97fa700 1 -- 172.21.15.81:0/491761031 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efbf4083600 con 0x7efbfc1563d0 2023-10-06T02:53:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.122+0000 7efc0109b700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efbe0066f30 0x7efbe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.122+0000 7efc0109b700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efbe0066f30 0x7efbe00693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efbf000afd0 tx=0x7efbf001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.126+0000 7efbf97fa700 1 -- 172.21.15.81:0/491761031 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efbf404a5a0 con 0x7efbfc1563d0 2023-10-06T02:53:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.352+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efbfc04bb80 con 0x7efbfc1563d0 2023-10-06T02:53:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.353+0000 7efbf97fa700 1 -- 172.21.15.81:0/491761031 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4590 (secure 0 0 0) 0x7efbf4050710 con 0x7efbfc1563d0 2023-10-06T02:53:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:20.355 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7668,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/97994403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":97994403},{"type":"v1","addr":"172.21.15.81:6834","nonce":97994403}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/871547713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":871547713},{"type":"v1","addr":"172.21.15.81:6835","nonce":871547713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3300657165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3300657165},{"type":"v1","addr":"172.21.15.83:6836","nonce":3300657165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:53:16.320455+0000","modified":"2023-10-06T02:53:19.984430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7686":{"gid":7686,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1726464211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1726464211},{"type":"v1","addr":"172.21.15.83:6837","nonce":1726464211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T02:53:20.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efbe0066f30 msgr2=0x7efbe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efbe0066f30 0x7efbe00693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efbf000afd0 tx=0x7efbf001a000 comp rx=0 tx=0).stop 2023-10-06T02:53:20.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbfc1563d0 msgr2=0x7efbfc16b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbfc1563d0 0x7efbfc16b7a0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7efbfc06f940 tx=0x7efbf4007c90 comp rx=0 tx=0).stop 2023-10-06T02:53:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 shutdown_connections 2023-10-06T02:53:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efbfc1563d0 0x7efbfc16b7a0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efbe0066f30 0x7efbe00693e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efbec003a90 0x7efbfc142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 --2- 172.21.15.81:0/491761031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efbfc16d570 0x7efbfc155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 >> 172.21.15.81:0/491761031 conn(0x7efbfc067640 msgr2=0x7efbfc0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 shutdown_connections 2023-10-06T02:53:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.355+0000 7efc032ff700 1 -- 172.21.15.81:0/491761031 wait complete. 2023-10-06T02:53:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-10-06T02:53:20.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:53:20.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.481+0000 7ff7951ef700 1 Processor -- start 2023-10-06T02:53:20.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.481+0000 7ff7951ef700 1 -- start start 2023-10-06T02:53:20.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff7951ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff790157ca0 0x7ff7900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff7951ef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff79006d120 0x7ff79006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff7951ef700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79006dac0 con 0x7ff7901578d0 2023-10-06T02:53:20.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff7951ef700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7900d07c0 con 0x7ff79006d120 2023-10-06T02:53:20.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff7951ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900cfbb0 con 0x7ff790157ca0 2023-10-06T02:53:20.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff78f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff79006d120 0x7ff79006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff78f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff79006d120 0x7ff79006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49120/0 (socket says 172.21.15.81:49120) 2023-10-06T02:53:20.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff78f59e700 1 -- 172.21.15.81:0/3523864928 learned_addr learned my addr 172.21.15.81:0/3523864928 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:20.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff78659c700 1 --2- 172.21.15.81:0/3523864928 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff790157ca0 0x7ff7900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff78f59e700 1 -- 172.21.15.81:0/3523864928 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff790157ca0 msgr2=0x7ff7900cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:20.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff78f59e700 1 --2- 172.21.15.81:0/3523864928 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff790157ca0 0x7ff7900cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff78f59e700 1 -- 172.21.15.81:0/3523864928 >> v1:172.21.15.83:6789/0 conn(0x7ff7901578d0 legacy=0x7ff79015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.482+0000 7ff78f59e700 1 -- 172.21.15.81:0/3523864928 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7900cfe90 con 0x7ff79006d120 2023-10-06T02:53:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff78f59e700 1 --2- 172.21.15.81:0/3523864928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 0x7ff79006d580 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff788009f20 tx=0x7ff788009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378cd2f29ea7cde0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff78e59c700 1 -- 172.21.15.81:0/3523864928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78800e070 con 0x7ff79006d120 2023-10-06T02:53:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff78e59c700 1 -- 172.21.15.81:0/3523864928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78800ba80 con 0x7ff79006d120 2023-10-06T02:53:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff78e59c700 1 -- 172.21.15.81:0/3523864928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880092e0 con 0x7ff79006d120 2023-10-06T02:53:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff7951ef700 1 -- 172.21.15.81:0/3523864928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 msgr2=0x7ff79006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff7951ef700 1 --2- 172.21.15.81:0/3523864928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 0x7ff79006d580 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff788009f20 tx=0x7ff788009840 comp rx=0 tx=0).stop 2023-10-06T02:53:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff7951ef700 1 -- 172.21.15.81:0/3523864928 shutdown_connections 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff7951ef700 1 --2- 172.21.15.81:0/3523864928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 0x7ff79006d580 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff7951ef700 1 --2- 172.21.15.81:0/3523864928 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff790157ca0 0x7ff7900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff7951ef700 1 -- 172.21.15.81:0/3523864928 >> 172.21.15.81:0/3523864928 conn(0x7ff79006bb90 msgr2=0x7ff79006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff7951ef700 1 -- 172.21.15.81:0/3523864928 shutdown_connections 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.483+0000 7ff7951ef700 1 -- 172.21.15.81:0/3523864928 wait complete. 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.484+0000 7ff7951ef700 1 Processor -- start 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff7951ef700 1 -- start start 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff7951ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 0x7ff79016d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff7951ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7901578d0 0x7ff79016b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff7951ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff790157ca0 0x7ff7900c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff7951ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79016d950 con 0x7ff79006d120 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff7951ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900c8aa0 con 0x7ff790157ca0 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff7951ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79016bc10 con 0x7ff7901578d0 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff78ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 0x7ff79016d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff78ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 0x7ff79016d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49122/0 (socket says 172.21.15.81:49122) 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff78ed9d700 1 -- 172.21.15.81:0/2204180662 learned_addr learned my addr 172.21.15.81:0/2204180662 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff78659c700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7901578d0 0x7ff79016b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.485+0000 7ff78f59e700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff790157ca0 0x7ff7900c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff78ed9d700 1 -- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7901578d0 msgr2=0x7ff79016b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff78ed9d700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7901578d0 0x7ff79016b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff78ed9d700 1 -- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff790157ca0 msgr2=0x7ff7900c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff78ed9d700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff790157ca0 0x7ff7900c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff78ed9d700 1 -- 172.21.15.81:0/2204180662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff788009ae0 con 0x7ff79006d120 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff78ed9d700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 0x7ff79016d410 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c5c0 tx=0x7ff78000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff7877fe700 1 -- 172.21.15.81:0/2204180662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011590 con 0x7ff79006d120 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff7877fe700 1 -- 172.21.15.81:0/2204180662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff780011710 con 0x7ff79006d120 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7900c6500 con 0x7ff79006d120 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff7877fe700 1 -- 172.21.15.81:0/2204180662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011ad0 con 0x7ff79006d120 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.486+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7900c6ac0 con 0x7ff79006d120 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.487+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff790067ac0 con 0x7ff79006d120 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.487+0000 7ff7877fe700 1 -- 172.21.15.81:0/2204180662 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff78001b3b0 con 0x7ff79006d120 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.487+0000 7ff7877fe700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff770066f30 0x7ff7700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.488+0000 7ff7877fe700 1 -- 172.21.15.81:0/2204180662 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff780083950 con 0x7ff79006d120 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.488+0000 7ff78659c700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff770066f30 0x7ff7700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.488+0000 7ff78659c700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff770066f30 0x7ff7700693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff79015d1d0 tx=0x7ff778008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.492+0000 7ff7877fe700 1 -- 172.21.15.81:0/2204180662 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff780050a60 con 0x7ff79006d120 2023-10-06T02:53:20.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.672+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff79006dac0 con 0x7ff79006d120 2023-10-06T02:53:20.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.673+0000 7ff7877fe700 1 -- 172.21.15.81:0/2204180662 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16834 (secure 0 0 0) 0x7ff79006dac0 con 0x7ff79006d120 2023-10-06T02:53:20.675 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:20.675 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":151,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:53:17.953157+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:53:13.969056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T02:53:15.291652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:53:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff770066f30 msgr2=0x7ff7700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff770066f30 0x7ff7700693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff79015d1d0 tx=0x7ff778008040 comp rx=0 tx=0).stop 2023-10-06T02:53:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 msgr2=0x7ff79016d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 0x7ff79016d410 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c5c0 tx=0x7ff78000c8d0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 shutdown_connections 2023-10-06T02:53:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff770066f30 0x7ff7700693e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff790157ca0 0x7ff7900c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff79006d120 0x7ff79016d410 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 --2- 172.21.15.81:0/2204180662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7901578d0 0x7ff79016b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 >> 172.21.15.81:0/2204180662 conn(0x7ff79006bb90 msgr2=0x7ff790155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 shutdown_connections 2023-10-06T02:53:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.675+0000 7ff7951ef700 1 -- 172.21.15.81:0/2204180662 wait complete. 2023-10-06T02:53:20.689 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:53:20.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:53:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.801+0000 7fe639ec5700 1 Processor -- start 2023-10-06T02:53:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.801+0000 7fe639ec5700 1 -- start start 2023-10-06T02:53:20.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.802+0000 7fe639ec5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe634157ca0 0x7fe6340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.802+0000 7fe639ec5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe63406d120 0x7fe63406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.802+0000 7fe639ec5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63406dac0 con 0x7fe6341578d0 2023-10-06T02:53:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.802+0000 7fe639ec5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6340d07c0 con 0x7fe63406d120 2023-10-06T02:53:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.802+0000 7fe639ec5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340cfbb0 con 0x7fe634157ca0 2023-10-06T02:53:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.802+0000 7fe633fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe63406d120 0x7fe63406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.802+0000 7fe6337fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe6341578d0 0x7fe63415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35834/0 (socket says 172.21.15.81:35834) 2023-10-06T02:53:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.802+0000 7fe6337fe700 1 -- 172.21.15.81:0/1078230841 learned_addr learned my addr 172.21.15.81:0/1078230841 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe633fff700 1 -- 172.21.15.81:0/1078230841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe634157ca0 msgr2=0x7fe6340cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe632ffd700 1 --2- 172.21.15.81:0/1078230841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe634157ca0 0x7fe6340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe633fff700 1 --2- 172.21.15.81:0/1078230841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe634157ca0 0x7fe6340cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe633fff700 1 -- 172.21.15.81:0/1078230841 >> v1:172.21.15.81:6789/0 conn(0x7fe6341578d0 legacy=0x7fe63415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe6327fc700 1 -- 172.21.15.81:0/1078230841 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96582963 0 0) 0x7fe624001490 con 0x7fe6341578d0 2023-10-06T02:53:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe633fff700 1 -- 172.21.15.81:0/1078230841 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340cfe90 con 0x7fe63406d120 2023-10-06T02:53:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe633fff700 1 --2- 172.21.15.81:0/1078230841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63406d120 0x7fe63406d580 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0098e0 tx=0x7fe62c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56057a682b3a3a8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe6327fc700 1 -- 172.21.15.81:0/1078230841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c009e80 con 0x7fe63406d120 2023-10-06T02:53:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe6327fc700 1 -- 172.21.15.81:0/1078230841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c00b860 con 0x7fe63406d120 2023-10-06T02:53:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe6327fc700 1 -- 172.21.15.81:0/1078230841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c00bbe0 con 0x7fe63406d120 2023-10-06T02:53:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe639ec5700 1 -- 172.21.15.81:0/1078230841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63406d120 msgr2=0x7fe63406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe639ec5700 1 --2- 172.21.15.81:0/1078230841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63406d120 0x7fe63406d580 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0098e0 tx=0x7fe62c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe639ec5700 1 -- 172.21.15.81:0/1078230841 shutdown_connections 2023-10-06T02:53:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe639ec5700 1 --2- 172.21.15.81:0/1078230841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63406d120 0x7fe63406d580 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe639ec5700 1 --2- 172.21.15.81:0/1078230841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe634157ca0 0x7fe6340cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.803+0000 7fe639ec5700 1 -- 172.21.15.81:0/1078230841 >> 172.21.15.81:0/1078230841 conn(0x7fe63406bb90 msgr2=0x7fe63406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.804+0000 7fe639ec5700 1 -- 172.21.15.81:0/1078230841 shutdown_connections 2023-10-06T02:53:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.804+0000 7fe639ec5700 1 -- 172.21.15.81:0/1078230841 wait complete. 2023-10-06T02:53:20.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.805+0000 7fe639ec5700 1 Processor -- start 2023-10-06T02:53:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.805+0000 7fe639ec5700 1 -- start start 2023-10-06T02:53:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.805+0000 7fe639ec5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63406d120 0x7fe6340ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.805+0000 7fe639ec5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6341578d0 0x7fe6340adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.805+0000 7fe639ec5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe634157ca0 0x7fe63416dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.805+0000 7fe639ec5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340abe80 con 0x7fe634157ca0 2023-10-06T02:53:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.805+0000 7fe639ec5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340ab270 con 0x7fe63406d120 2023-10-06T02:53:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.805+0000 7fe639ec5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340ab550 con 0x7fe6341578d0 2023-10-06T02:53:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe633fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe634157ca0 0x7fe63416dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe633fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe634157ca0 0x7fe63416dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49148/0 (socket says 172.21.15.81:49148) 2023-10-06T02:53:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe633fff700 1 -- 172.21.15.81:0/1640766772 learned_addr learned my addr 172.21.15.81:0/1640766772 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe6337fe700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63406d120 0x7fe6340ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe632ffd700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6341578d0 0x7fe6340adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe633fff700 1 -- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6341578d0 msgr2=0x7fe6340adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe633fff700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6341578d0 0x7fe6340adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe633fff700 1 -- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63406d120 msgr2=0x7fe6340ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe633fff700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63406d120 0x7fe6340ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe633fff700 1 -- 172.21.15.81:0/1640766772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c009420 con 0x7fe634157ca0 2023-10-06T02:53:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe632ffd700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6341578d0 0x7fe6340adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe633fff700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe634157ca0 0x7fe63416dc90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00b3c0 tx=0x7fe62c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe62b7fe700 1 -- 172.21.15.81:0/1640766772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c011630 con 0x7fe634157ca0 2023-10-06T02:53:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe62b7fe700 1 -- 172.21.15.81:0/1640766772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c011790 con 0x7fe634157ca0 2023-10-06T02:53:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6340ab830 con 0x7fe634157ca0 2023-10-06T02:53:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe62b7fe700 1 -- 172.21.15.81:0/1640766772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c011b50 con 0x7fe634157ca0 2023-10-06T02:53:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.806+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63416e1d0 con 0x7fe634157ca0 2023-10-06T02:53:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.807+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6340ac030 con 0x7fe634157ca0 2023-10-06T02:53:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.807+0000 7fe62b7fe700 1 -- 172.21.15.81:0/1640766772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe62c0253f0 con 0x7fe634157ca0 2023-10-06T02:53:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.808+0000 7fe62b7fe700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe614066f30 0x7fe6140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.808+0000 7fe62b7fe700 1 -- 172.21.15.81:0/1640766772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe62c0862f0 con 0x7fe634157ca0 2023-10-06T02:53:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.808+0000 7fe6337fe700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe614066f30 0x7fe6140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.809+0000 7fe6337fe700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe614066f30 0x7fe6140693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe6240072e0 tx=0x7fe624001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.812+0000 7fe62b7fe700 1 -- 172.21.15.81:0/1640766772 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe62c053400 con 0x7fe634157ca0 2023-10-06T02:53:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:20.990+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6340d0170 con 0x7fe614066f30 2023-10-06T02:53:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.000+0000 7fe62b7fe700 1 -- 172.21.15.81:0/1640766772 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302851 (secure 0 0 0) 0x7fe6340d0170 con 0x7fe614066f30 2023-10-06T02:53:21.008 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe614066f30 msgr2=0x7fe6140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe614066f30 0x7fe6140693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe6240072e0 tx=0x7fe624001a10 comp rx=0 tx=0).stop 2023-10-06T02:53:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe634157ca0 msgr2=0x7fe63416dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe634157ca0 0x7fe63416dc90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00b3c0 tx=0x7fe62c017000 comp rx=0 tx=0).stop 2023-10-06T02:53:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 shutdown_connections 2023-10-06T02:53:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe634157ca0 0x7fe63416dc90 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe614066f30 0x7fe6140693e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63406d120 0x7fe6340ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 --2- 172.21.15.81:0/1640766772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6341578d0 0x7fe6340adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 >> 172.21.15.81:0/1640766772 conn(0x7fe63406bb90 msgr2=0x7fe634155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 shutdown_connections 2023-10-06T02:53:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.003+0000 7fe639ec5700 1 -- 172.21.15.81:0/1640766772 wait complete. 2023-10-06T02:53:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:53:21.017 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2023-10-06T02:53:19.595375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7961,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554538,"statfs":{"total":1600000000,"available":1591847552,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.656548"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944885+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:33.945195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943021+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:16.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945132+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:31.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944072+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:40.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942306+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945633+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.948358+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:41.007295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946796+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945189+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.947086+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:39.701229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.947701+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:51.895407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.948865+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:44.898347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944764+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:51.895407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.949085+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:36.088521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945321+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:19.110831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945320+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946081+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942084+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:40.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945824+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941988+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:29.709175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943144+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:41.426949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945795+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:59.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943587+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:31.560000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944817+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:31.560000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944262+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:56.082472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943541+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:52.909214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.948022+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946346+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:06.729423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943861+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:29.230017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943801+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:19.795559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945266+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946919+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.256285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944764+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:31.560000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.952620+0000","last_change":"2023-10-06T02:53:15.952620+0000","last_active":"2023-10-06T02:53:15.952620+0000","last_peered":"2023-10-06T02:53:15.952620+0000","last_clean":"2023-10-06T02:53:15.952620+0000","last_became_active":"2023-10-06T02:53:15.952241+0000","last_became_peered":"2023-10-06T02:53:15.952241+0000","last_unstale":"2023-10-06T02:53:15.952620+0000","last_undegraded":"2023-10-06T02:53:15.952620+0000","last_fullsized":"2023-10-06T02:53:15.952620+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:21.071442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946773+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:51.599520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950606+0000","last_change":"2023-10-06T02:53:15.950606+0000","last_active":"2023-10-06T02:53:15.950606+0000","last_peered":"2023-10-06T02:53:15.950606+0000","last_clean":"2023-10-06T02:53:15.950606+0000","last_became_active":"2023-10-06T02:53:15.950220+0000","last_became_peered":"2023-10-06T02:53:15.950220+0000","last_unstale":"2023-10-06T02:53:15.950606+0000","last_undegraded":"2023-10-06T02:53:15.950606+0000","last_fullsized":"2023-10-06T02:53:15.950606+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942394+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:12.466135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.955289+0000","last_change":"2023-10-06T02:53:15.955289+0000","last_active":"2023-10-06T02:53:15.955289+0000","last_peered":"2023-10-06T02:53:15.955289+0000","last_clean":"2023-10-06T02:53:15.955289+0000","last_became_active":"2023-10-06T02:53:15.954958+0000","last_became_peered":"2023-10-06T02:53:15.954958+0000","last_unstale":"2023-10-06T02:53:15.955289+0000","last_undegraded":"2023-10-06T02:53:15.955289+0000","last_fullsized":"2023-10-06T02:53:15.955289+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945432+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:39.241581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953447+0000","last_change":"2023-10-06T02:53:15.953447+0000","last_active":"2023-10-06T02:53:15.953447+0000","last_peered":"2023-10-06T02:53:15.953447+0000","last_clean":"2023-10-06T02:53:15.953447+0000","last_became_active":"2023-10-06T02:53:15.952891+0000","last_became_peered":"2023-10-06T02:53:15.952891+0000","last_unstale":"2023-10-06T02:53:15.953447+0000","last_undegraded":"2023-10-06T02:53:15.953447+0000","last_fullsized":"2023-10-06T02:53:15.953447+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944893+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:40.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950593+0000","last_change":"2023-10-06T02:53:15.950593+0000","last_active":"2023-10-06T02:53:15.950593+0000","last_peered":"2023-10-06T02:53:15.950593+0000","last_clean":"2023-10-06T02:53:15.950593+0000","last_became_active":"2023-10-06T02:53:15.950349+0000","last_became_peered":"2023-10-06T02:53:15.950349+0000","last_unstale":"2023-10-06T02:53:15.950593+0000","last_undegraded":"2023-10-06T02:53:15.950593+0000","last_fullsized":"2023-10-06T02:53:15.950593+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945170+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950422+0000","last_change":"2023-10-06T02:53:15.950422+0000","last_active":"2023-10-06T02:53:15.950422+0000","last_peered":"2023-10-06T02:53:15.950422+0000","last_clean":"2023-10-06T02:53:15.950422+0000","last_became_active":"2023-10-06T02:53:15.950180+0000","last_became_peered":"2023-10-06T02:53:15.950180+0000","last_unstale":"2023-10-06T02:53:15.950422+0000","last_undegraded":"2023-10-06T02:53:15.950422+0000","last_fullsized":"2023-10-06T02:53:15.950422+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942167+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:06.183443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.949331+0000","last_change":"2023-10-06T02:53:15.949331+0000","last_active":"2023-10-06T02:53:15.949331+0000","last_peered":"2023-10-06T02:53:15.949331+0000","last_clean":"2023-10-06T02:53:15.949331+0000","last_became_active":"2023-10-06T02:53:15.949073+0000","last_became_peered":"2023-10-06T02:53:15.949073+0000","last_unstale":"2023-10-06T02:53:15.949331+0000","last_undegraded":"2023-10-06T02:53:15.949331+0000","last_fullsized":"2023-10-06T02:53:15.949331+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:10.217520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946553+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:29.709175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.948938+0000","last_change":"2023-10-06T02:53:15.948938+0000","last_active":"2023-10-06T02:53:15.948938+0000","last_peered":"2023-10-06T02:53:15.948938+0000","last_clean":"2023-10-06T02:53:15.948938+0000","last_became_active":"2023-10-06T02:53:15.947646+0000","last_became_peered":"2023-10-06T02:53:15.947646+0000","last_unstale":"2023-10-06T02:53:15.948938+0000","last_undegraded":"2023-10-06T02:53:15.948938+0000","last_fullsized":"2023-10-06T02:53:15.948938+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:51.518352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942667+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:33.971045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950371+0000","last_change":"2023-10-06T02:53:15.950371+0000","last_active":"2023-10-06T02:53:15.950371+0000","last_peered":"2023-10-06T02:53:15.950371+0000","last_clean":"2023-10-06T02:53:15.950371+0000","last_became_active":"2023-10-06T02:53:15.950141+0000","last_became_peered":"2023-10-06T02:53:15.950141+0000","last_unstale":"2023-10-06T02:53:15.950371+0000","last_undegraded":"2023-10-06T02:53:15.950371+0000","last_fullsized":"2023-10-06T02:53:15.950371+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946693+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:40.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.949084+0000","last_change":"2023-10-06T02:53:15.949084+0000","last_active":"2023-10-06T02:53:15.949084+0000","last_peered":"2023-10-06T02:53:15.949084+0000","last_clean":"2023-10-06T02:53:15.949084+0000","last_became_active":"2023-10-06T02:53:15.947986+0000","last_became_peered":"2023-10-06T02:53:15.947986+0000","last_unstale":"2023-10-06T02:53:15.949084+0000","last_undegraded":"2023-10-06T02:53:15.949084+0000","last_fullsized":"2023-10-06T02:53:15.949084+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:49.756550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945393+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.947587+0000","last_change":"2023-10-06T02:53:15.947587+0000","last_active":"2023-10-06T02:53:15.947587+0000","last_peered":"2023-10-06T02:53:15.947587+0000","last_clean":"2023-10-06T02:53:15.947587+0000","last_became_active":"2023-10-06T02:53:15.947298+0000","last_became_peered":"2023-10-06T02:53:15.947298+0000","last_unstale":"2023-10-06T02:53:15.947587+0000","last_undegraded":"2023-10-06T02:53:15.947587+0000","last_fullsized":"2023-10-06T02:53:15.947587+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945998+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:14.631507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.942574+0000","last_change":"2023-10-06T02:53:15.942574+0000","last_active":"2023-10-06T02:53:15.942574+0000","last_peered":"2023-10-06T02:53:15.942574+0000","last_clean":"2023-10-06T02:53:15.942574+0000","last_became_active":"2023-10-06T02:53:15.942392+0000","last_became_peered":"2023-10-06T02:53:15.942392+0000","last_unstale":"2023-10-06T02:53:15.942574+0000","last_undegraded":"2023-10-06T02:53:15.942574+0000","last_fullsized":"2023-10-06T02:53:15.942574+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941557+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950485+0000","last_change":"2023-10-06T02:53:15.950485+0000","last_active":"2023-10-06T02:53:15.950485+0000","last_peered":"2023-10-06T02:53:15.950485+0000","last_clean":"2023-10-06T02:53:15.950485+0000","last_became_active":"2023-10-06T02:53:15.949974+0000","last_became_peered":"2023-10-06T02:53:15.949974+0000","last_unstale":"2023-10-06T02:53:15.950485+0000","last_undegraded":"2023-10-06T02:53:15.950485+0000","last_fullsized":"2023-10-06T02:53:15.950485+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:30.739583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944526+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:52.265520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951410+0000","last_change":"2023-10-06T02:53:15.951410+0000","last_active":"2023-10-06T02:53:15.951410+0000","last_peered":"2023-10-06T02:53:15.951410+0000","last_clean":"2023-10-06T02:53:15.951410+0000","last_became_active":"2023-10-06T02:53:15.950897+0000","last_became_peered":"2023-10-06T02:53:15.950897+0000","last_unstale":"2023-10-06T02:53:15.951410+0000","last_undegraded":"2023-10-06T02:53:15.951410+0000","last_fullsized":"2023-10-06T02:53:15.951410+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:35.524955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941647+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953249+0000","last_change":"2023-10-06T02:53:15.953249+0000","last_active":"2023-10-06T02:53:15.953249+0000","last_peered":"2023-10-06T02:53:15.953249+0000","last_clean":"2023-10-06T02:53:15.953249+0000","last_became_active":"2023-10-06T02:53:15.953058+0000","last_became_peered":"2023-10-06T02:53:15.953058+0000","last_unstale":"2023-10-06T02:53:15.953249+0000","last_undegraded":"2023-10-06T02:53:15.953249+0000","last_fullsized":"2023-10-06T02:53:15.953249+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942527+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:31.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.949459+0000","last_change":"2023-10-06T02:53:15.949459+0000","last_active":"2023-10-06T02:53:15.949459+0000","last_peered":"2023-10-06T02:53:15.949459+0000","last_clean":"2023-10-06T02:53:15.949459+0000","last_became_active":"2023-10-06T02:53:15.949233+0000","last_became_peered":"2023-10-06T02:53:15.949233+0000","last_unstale":"2023-10-06T02:53:15.949459+0000","last_undegraded":"2023-10-06T02:53:15.949459+0000","last_fullsized":"2023-10-06T02:53:15.949459+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:32.966190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941829+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:51.951868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953568+0000","last_change":"2023-10-06T02:53:15.953568+0000","last_active":"2023-10-06T02:53:15.953568+0000","last_peered":"2023-10-06T02:53:15.953568+0000","last_clean":"2023-10-06T02:53:15.953568+0000","last_became_active":"2023-10-06T02:53:15.952663+0000","last_became_peered":"2023-10-06T02:53:15.952663+0000","last_unstale":"2023-10-06T02:53:15.953568+0000","last_undegraded":"2023-10-06T02:53:15.953568+0000","last_fullsized":"2023-10-06T02:53:15.953568+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:42.266244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944349+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:43.099586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951083+0000","last_change":"2023-10-06T02:53:15.951083+0000","last_active":"2023-10-06T02:53:15.951083+0000","last_peered":"2023-10-06T02:53:15.951083+0000","last_clean":"2023-10-06T02:53:15.951083+0000","last_became_active":"2023-10-06T02:53:15.950728+0000","last_became_peered":"2023-10-06T02:53:15.950728+0000","last_unstale":"2023-10-06T02:53:15.951083+0000","last_undegraded":"2023-10-06T02:53:15.951083+0000","last_fullsized":"2023-10-06T02:53:15.951083+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945728+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951578+0000","last_change":"2023-10-06T02:53:15.951578+0000","last_active":"2023-10-06T02:53:15.951578+0000","last_peered":"2023-10-06T02:53:15.951578+0000","last_clean":"2023-10-06T02:53:15.951578+0000","last_became_active":"2023-10-06T02:53:15.951350+0000","last_became_peered":"2023-10-06T02:53:15.951350+0000","last_unstale":"2023-10-06T02:53:15.951578+0000","last_undegraded":"2023-10-06T02:53:15.951578+0000","last_fullsized":"2023-10-06T02:53:15.951578+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:15.781730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945653+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:40.680189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951271+0000","last_change":"2023-10-06T02:53:15.951271+0000","last_active":"2023-10-06T02:53:15.951271+0000","last_peered":"2023-10-06T02:53:15.951271+0000","last_clean":"2023-10-06T02:53:15.951271+0000","last_became_active":"2023-10-06T02:53:15.951044+0000","last_became_peered":"2023-10-06T02:53:15.951044+0000","last_unstale":"2023-10-06T02:53:15.951271+0000","last_undegraded":"2023-10-06T02:53:15.951271+0000","last_fullsized":"2023-10-06T02:53:15.951271+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944752+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:41.426949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.954250+0000","last_change":"2023-10-06T02:53:15.954250+0000","last_active":"2023-10-06T02:53:15.954250+0000","last_peered":"2023-10-06T02:53:15.954250+0000","last_clean":"2023-10-06T02:53:15.954250+0000","last_became_active":"2023-10-06T02:53:15.951275+0000","last_became_peered":"2023-10-06T02:53:15.951275+0000","last_unstale":"2023-10-06T02:53:15.954250+0000","last_undegraded":"2023-10-06T02:53:15.954250+0000","last_fullsized":"2023-10-06T02:53:15.954250+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944314+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:16.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.955738+0000","last_change":"2023-10-06T02:53:15.955738+0000","last_active":"2023-10-06T02:53:15.955738+0000","last_peered":"2023-10-06T02:53:15.955738+0000","last_clean":"2023-10-06T02:53:15.955738+0000","last_became_active":"2023-10-06T02:53:15.955524+0000","last_became_peered":"2023-10-06T02:53:15.955524+0000","last_unstale":"2023-10-06T02:53:15.955738+0000","last_undegraded":"2023-10-06T02:53:15.955738+0000","last_fullsized":"2023-10-06T02:53:15.955738+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:30.555145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944220+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:31.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951067+0000","last_change":"2023-10-06T02:53:15.951067+0000","last_active":"2023-10-06T02:53:15.951067+0000","last_peered":"2023-10-06T02:53:15.951067+0000","last_clean":"2023-10-06T02:53:15.951067+0000","last_became_active":"2023-10-06T02:53:15.950869+0000","last_became_peered":"2023-10-06T02:53:15.950869+0000","last_unstale":"2023-10-06T02:53:15.951067+0000","last_undegraded":"2023-10-06T02:53:15.951067+0000","last_fullsized":"2023-10-06T02:53:15.951067+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946136+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:51.951868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.948960+0000","last_change":"2023-10-06T02:53:15.948960+0000","last_active":"2023-10-06T02:53:15.948960+0000","last_peered":"2023-10-06T02:53:15.948960+0000","last_clean":"2023-10-06T02:53:15.948960+0000","last_became_active":"2023-10-06T02:53:15.947980+0000","last_became_peered":"2023-10-06T02:53:15.947980+0000","last_unstale":"2023-10-06T02:53:15.948960+0000","last_undegraded":"2023-10-06T02:53:15.948960+0000","last_fullsized":"2023-10-06T02:53:15.948960+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943142+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:43.467592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.954832+0000","last_change":"2023-10-06T02:53:15.954832+0000","last_active":"2023-10-06T02:53:15.954832+0000","last_peered":"2023-10-06T02:53:15.954832+0000","last_clean":"2023-10-06T02:53:15.954832+0000","last_became_active":"2023-10-06T02:53:15.954616+0000","last_became_peered":"2023-10-06T02:53:15.954616+0000","last_unstale":"2023-10-06T02:53:15.954832+0000","last_undegraded":"2023-10-06T02:53:15.954832+0000","last_fullsized":"2023-10-06T02:53:15.954832+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":123,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.938315+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:53:14.938315+0000","last_peered":"2023-10-06T02:53:14.938315+0000","last_clean":"2023-10-06T02:53:14.938315+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:53:14.938315+0000","last_undegraded":"2023-10-06T02:53:14.938315+0000","last_fullsized":"2023-10-06T02:53:14.938315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.947270+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:01.005879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951215+0000","last_change":"2023-10-06T02:53:15.951215+0000","last_active":"2023-10-06T02:53:15.951215+0000","last_peered":"2023-10-06T02:53:15.951215+0000","last_clean":"2023-10-06T02:53:15.951215+0000","last_became_active":"2023-10-06T02:53:15.951002+0000","last_became_peered":"2023-10-06T02:53:15.951002+0000","last_unstale":"2023-10-06T02:53:15.951215+0000","last_undegraded":"2023-10-06T02:53:15.951215+0000","last_fullsized":"2023-10-06T02:53:15.951215+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:36.226855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.942035+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:53:14.942035+0000","last_peered":"2023-10-06T02:53:14.942035+0000","last_clean":"2023-10-06T02:53:14.942035+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:53:14.942035+0000","last_undegraded":"2023-10-06T02:53:14.942035+0000","last_fullsized":"2023-10-06T02:53:14.942035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941674+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.949900+0000","last_change":"2023-10-06T02:53:15.949900+0000","last_active":"2023-10-06T02:53:15.949900+0000","last_peered":"2023-10-06T02:53:15.949900+0000","last_clean":"2023-10-06T02:53:15.949900+0000","last_became_active":"2023-10-06T02:53:15.949704+0000","last_became_peered":"2023-10-06T02:53:15.949704+0000","last_unstale":"2023-10-06T02:53:15.949900+0000","last_undegraded":"2023-10-06T02:53:15.949900+0000","last_fullsized":"2023-10-06T02:53:15.949900+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:51.904359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":125,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.941521+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:53:14.941521+0000","last_peered":"2023-10-06T02:53:14.941521+0000","last_clean":"2023-10-06T02:53:14.941521+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:53:14.941521+0000","last_undegraded":"2023-10-06T02:53:14.941521+0000","last_fullsized":"2023-10-06T02:53:14.941521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944755+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:12.466135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953624+0000","last_change":"2023-10-06T02:53:15.953624+0000","last_active":"2023-10-06T02:53:15.953624+0000","last_peered":"2023-10-06T02:53:15.953624+0000","last_clean":"2023-10-06T02:53:15.953624+0000","last_became_active":"2023-10-06T02:53:15.953206+0000","last_became_peered":"2023-10-06T02:53:15.953206+0000","last_unstale":"2023-10-06T02:53:15.953624+0000","last_undegraded":"2023-10-06T02:53:15.953624+0000","last_fullsized":"2023-10-06T02:53:15.953624+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:50.890551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.942061+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:53:14.942061+0000","last_peered":"2023-10-06T02:53:14.942061+0000","last_clean":"2023-10-06T02:53:14.942061+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:53:14.942061+0000","last_undegraded":"2023-10-06T02:53:14.942061+0000","last_fullsized":"2023-10-06T02:53:14.942061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.944019+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:53:14.944019+0000","last_peered":"2023-10-06T02:53:14.944019+0000","last_clean":"2023-10-06T02:53:14.944019+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:53:14.944019+0000","last_undegraded":"2023-10-06T02:53:14.944019+0000","last_fullsized":"2023-10-06T02:53:14.944019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946823+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:06.183443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950535+0000","last_change":"2023-10-06T02:53:15.950535+0000","last_active":"2023-10-06T02:53:15.950535+0000","last_peered":"2023-10-06T02:53:15.950535+0000","last_clean":"2023-10-06T02:53:15.950535+0000","last_became_active":"2023-10-06T02:53:15.950353+0000","last_became_peered":"2023-10-06T02:53:15.950353+0000","last_unstale":"2023-10-06T02:53:15.950535+0000","last_undegraded":"2023-10-06T02:53:15.950535+0000","last_fullsized":"2023-10-06T02:53:15.950535+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:04.092161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.943871+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:53:14.943871+0000","last_peered":"2023-10-06T02:53:14.943871+0000","last_clean":"2023-10-06T02:53:14.943871+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:53:14.943871+0000","last_undegraded":"2023-10-06T02:53:14.943871+0000","last_fullsized":"2023-10-06T02:53:14.943871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943347+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:11.222375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951054+0000","last_change":"2023-10-06T02:53:15.951054+0000","last_active":"2023-10-06T02:53:15.951054+0000","last_peered":"2023-10-06T02:53:15.951054+0000","last_clean":"2023-10-06T02:53:15.951054+0000","last_became_active":"2023-10-06T02:53:15.950811+0000","last_became_peered":"2023-10-06T02:53:15.950811+0000","last_unstale":"2023-10-06T02:53:15.951054+0000","last_undegraded":"2023-10-06T02:53:15.951054+0000","last_fullsized":"2023-10-06T02:53:15.951054+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.944129+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:53:14.944129+0000","last_peered":"2023-10-06T02:53:14.944129+0000","last_clean":"2023-10-06T02:53:14.944129+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:53:14.944129+0000","last_undegraded":"2023-10-06T02:53:14.944129+0000","last_fullsized":"2023-10-06T02:53:14.944129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943977+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:34.875702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.954105+0000","last_change":"2023-10-06T02:53:15.954105+0000","last_active":"2023-10-06T02:53:15.954105+0000","last_peered":"2023-10-06T02:53:15.954105+0000","last_clean":"2023-10-06T02:53:15.954105+0000","last_became_active":"2023-10-06T02:53:15.950962+0000","last_became_peered":"2023-10-06T02:53:15.950962+0000","last_unstale":"2023-10-06T02:53:15.954105+0000","last_undegraded":"2023-10-06T02:53:15.954105+0000","last_fullsized":"2023-10-06T02:53:15.954105+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":123,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.938333+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:53:14.938333+0000","last_peered":"2023-10-06T02:53:14.938333+0000","last_clean":"2023-10-06T02:53:14.938333+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:53:14.938333+0000","last_undegraded":"2023-10-06T02:53:14.938333+0000","last_fullsized":"2023-10-06T02:53:14.938333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944955+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:40.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953695+0000","last_change":"2023-10-06T02:53:15.953695+0000","last_active":"2023-10-06T02:53:15.953695+0000","last_peered":"2023-10-06T02:53:15.953695+0000","last_clean":"2023-10-06T02:53:15.953695+0000","last_became_active":"2023-10-06T02:53:15.953150+0000","last_became_peered":"2023-10-06T02:53:15.953150+0000","last_unstale":"2023-10-06T02:53:15.953695+0000","last_undegraded":"2023-10-06T02:53:15.953695+0000","last_fullsized":"2023-10-06T02:53:15.953695+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:26.827466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.941546+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:53:14.941546+0000","last_peered":"2023-10-06T02:53:14.941546+0000","last_clean":"2023-10-06T02:53:14.941546+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:53:14.941546+0000","last_undegraded":"2023-10-06T02:53:14.941546+0000","last_fullsized":"2023-10-06T02:53:14.941546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193882,"statfs":{"total":200000000,"available":198535690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.393},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.53000000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":1.081},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.52900000000000003},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.72399999999999998,"5min":0.79900000000000004,"15min":1.4710000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.626},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":4.8129999999999997},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.60299999999999998},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.69599999999999995,"5min":0.78600000000000003,"15min":3.4870000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":2.2349999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46600000000000003,"15min":0.45900000000000002},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63200000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.497,"15min":0.49099999999999999},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51200000000000001,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":0.879},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.31900000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":853,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194459,"statfs":{"total":200000000,"available":199126058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.60299999999999998},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.56100000000000005},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.879},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.90500000000000003},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.81599999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.64700000000000002,"5min":1.042,"15min":1.0580000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54500000000000004,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.29499999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.80100000000000005,"15min":1.163},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47499999999999998,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":1.05},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.501,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.86799999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.53700000000000003,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.754,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54100000000000004,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":1.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76400000000000001,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.39400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":847,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199132666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32000000000000001,"15min":0.313},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.44400000000000001,"5min":0.501,"15min":0.501},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.35499999999999998,"15min":0.33300000000000002},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.51000000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.32300000000000001},"min":{"1min":0.23799999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.48399999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40400000000000003,"15min":0.38400000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.36399999999999999},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.441}]},{"osd":4,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.53800000000000003},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76800000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.91400000000000003,"5min":1.006,"15min":1.006},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.61899999999999999,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.88200000000000001},"last":0.68300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193888,"statfs":{"total":200000000,"available":198542298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.34499999999999997},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46500000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33200000000000002,"15min":0.96699999999999997},"min":{"1min":0.217,"5min":0.216,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.56899999999999995,"15min":22.038},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":1.3779999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.50900000000000001,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":1.0009999999999999},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.253},"max":{"1min":0.60399999999999998,"5min":0.63300000000000001,"15min":21.942},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":1.083},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.32900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":11.122999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":1.1599999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":22.010999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":1.401},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":1.113},"min":{"1min":0.374,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.83599999999999997,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":1.1850000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":21.98},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.425},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.872},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":11.154},"last":0.51800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":853,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194459,"statfs":{"total":200000000,"available":199126058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.183,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.46000000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.186},"max":{"1min":0.501,"5min":0.60199999999999998,"15min":0.60699999999999998},"last":0.26700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36699999999999999,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48899999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.41299999999999998,"15min":0.38900000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.59299999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.318}]},{"osd":3,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.374},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.40400000000000003,"15min":0.39700000000000002},"min":{"1min":0.245,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.28199999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83599999999999997,"5min":1.056,"15min":1.056},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.312,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.433}]},{"osd":5,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.61699999999999999,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.72099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.59399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86399999999999999,"5min":1.018,"15min":1.2569999999999999},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":1.002,"15min":1.002},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.624,"15min":0.59499999999999997},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76100000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.52500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":847,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199132666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32000000000000001,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.223},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.372,"15min":0.33400000000000002},"min":{"1min":0.23100000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.25800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35599999999999998,"15min":0.33200000000000002},"min":{"1min":0.249,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.48899999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38100000000000001,"15min":0.34999999999999998},"min":{"1min":0.28100000000000003,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.496,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.41499999999999998,"15min":0.374},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":0.44,"5min":3.044,"15min":3.044},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39100000000000001,"15min":0.35099999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.312}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73699999999999999,"5min":1.446,"15min":2.2120000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":1.327,"15min":2.25},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.67800000000000005},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80500000000000005,"5min":1.268,"15min":1.268},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76400000000000001,"5min":1.218,"15min":1.218},"last":0.753},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38600000000000001},"max":{"1min":0.83699999999999997,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.62}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61099999999999999,"15min":0.90600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":0.79800000000000004,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":853,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194459,"statfs":{"total":200000000,"available":199126058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.495,"15min":0.752},"min":{"1min":0.27200000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.67700000000000005,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.60599999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.221},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.28999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52300000000000002,"15min":0.78200000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":5.9329999999999998},"last":0.433},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.74099999999999999},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.65900000000000003,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":5.4390000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.65700000000000003},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66700000000000004,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69899999999999995,"5min":0.77000000000000002,"15min":3.456},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.27500000000000002,"15min":0.245},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72199999999999998,"5min":0.76400000000000001,"15min":0.78400000000000003},"last":0.497},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.96599999999999997},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":13.173999999999999},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":853,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194459,"statfs":{"total":200000000,"available":199126058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.64700000000000002,"5min":0.747,"15min":0.79100000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.28799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67600000000000005,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.30399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68899999999999995,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.60599999999999998,"5min":0.747,"15min":0.83799999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.252},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69799999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.504}]},{"osd":6,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.498,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.879,"15min":0.879},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72599999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81799999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.621}]}]}],"pool_statfs":[]}} 2023-10-06T02:53:21.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:53:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.169+0000 7f6d561be700 1 Processor -- start 2023-10-06T02:53:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.169+0000 7f6d561be700 1 -- start start 2023-10-06T02:53:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d561be700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d500add30 0x7f6d500b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d561be700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d500cefa0 0x7f6d50067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d561be700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d50067ff0 con 0x7f6d50067640 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d561be700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d500b37b0 con 0x7f6d500add30 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d561be700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500b17c0 con 0x7f6d500cefa0 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d549bb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6d50067640 0x7f6d500ce890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35842/0 (socket says 172.21.15.81:35842) 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d549bb700 1 -- 172.21.15.81:0/1892107761 learned_addr learned my addr 172.21.15.81:0/1892107761 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d559bd700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d500cefa0 0x7f6d50067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d551bc700 1 --2- 172.21.15.81:0/1892107761 >> v2:172.21.15.83:3300/0 conn(0x7f6d500add30 0x7f6d500b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185848086 0 0) 0x7f6d50067ff0 con 0x7f6d50067640 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d3c003570 con 0x7f6d50067640 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2055171920 0 0) 0x7f6d3c003570 con 0x7f6d50067640 2023-10-06T02:53:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d500cefa0 msgr2=0x7f6d50067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d47fff700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d500cefa0 0x7f6d50067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 >> v2:172.21.15.83:3300/0 conn(0x7f6d500add30 msgr2=0x7f6d500b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d47fff700 1 --2- 172.21.15.81:0/1892107761 >> v2:172.21.15.83:3300/0 conn(0x7f6d500add30 0x7f6d500b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.170+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500b1d80 con 0x7f6d50067640 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f6d40001470 con 0x7f6d50067640 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 >> v1:172.21.15.81:6789/0 conn(0x7f6d50067640 legacy=0x7f6d500ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d500cefa0 0x7f6d3c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d3c003fe0 0x7f6d3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c004d50 0x7f6d3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500b17c0 con 0x7f6d3c004d50 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c00ba60 con 0x7f6d3c003fe0 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c00bbd0 con 0x7f6d500cefa0 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d559bd700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c004d50 0x7f6d3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d549bb700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d3c003fe0 0x7f6d3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d551bc700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d500cefa0 0x7f6d3c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d559bd700 1 -- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d500cefa0 msgr2=0x7f6d3c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d559bd700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d500cefa0 0x7f6d3c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d559bd700 1 -- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d3c003fe0 msgr2=0x7f6d3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d559bd700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d3c003fe0 0x7f6d3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d559bd700 1 -- 172.21.15.81:0/1892107761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c003570 con 0x7f6d3c004d50 2023-10-06T02:53:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d559bd700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c004d50 0x7f6d3c0051c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f6d500cf3a0 tx=0x7f6d480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374fd819d8aa818d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800e680 con 0x7f6d3c004d50 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800e7e0 con 0x7f6d3c004d50 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.171+0000 7f6d47fff700 1 -- 172.21.15.81:0/1892107761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800eba0 con 0x7f6d3c004d50 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.172+0000 7f6d561be700 1 -- 172.21.15.81:0/1892107761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c004d50 msgr2=0x7f6d3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.172+0000 7f6d561be700 1 --2- 172.21.15.81:0/1892107761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c004d50 0x7f6d3c0051c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f6d500cf3a0 tx=0x7f6d480091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.172+0000 7f6d559bd700 1 -- 172.21.15.81:0/1892107761 reap_dead start 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.172+0000 7f6d561be700 1 -- 172.21.15.81:0/1892107761 shutdown_connections 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.172+0000 7f6d561be700 1 -- 172.21.15.81:0/1892107761 >> 172.21.15.81:0/1892107761 conn(0x7f6d5006c620 msgr2=0x7f6d5006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.172+0000 7f6d561be700 1 -- 172.21.15.81:0/1892107761 shutdown_connections 2023-10-06T02:53:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.172+0000 7f6d561be700 1 -- 172.21.15.81:0/1892107761 wait complete. 2023-10-06T02:53:21.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.173+0000 7f6d561be700 1 Processor -- start 2023-10-06T02:53:21.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.173+0000 7f6d561be700 1 -- start start 2023-10-06T02:53:21.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d561be700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d3c004d50 0x7f6d500ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d561be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d500a9f20 0x7f6d500a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d561be700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d5015d7e0 0x7f6d5015dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d561be700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5015e1a0 con 0x7f6d500a9f20 2023-10-06T02:53:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d561be700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500a7060 con 0x7f6d5015d7e0 2023-10-06T02:53:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d561be700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500aa390 con 0x7f6d3c004d50 2023-10-06T02:53:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d549bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d500a9f20 0x7f6d500a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d549bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d500a9f20 0x7f6d500a90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49178/0 (socket says 172.21.15.81:49178) 2023-10-06T02:53:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d549bb700 1 -- 172.21.15.81:0/2290225566 learned_addr learned my addr 172.21.15.81:0/2290225566 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d559bd700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d5015d7e0 0x7f6d5015dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d551bc700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d3c004d50 0x7f6d500ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d549bb700 1 -- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d3c004d50 msgr2=0x7f6d500ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d549bb700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d3c004d50 0x7f6d500ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d549bb700 1 -- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d5015d7e0 msgr2=0x7f6d5015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d549bb700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d5015d7e0 0x7f6d5015dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d549bb700 1 -- 172.21.15.81:0/2290225566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500acb30 con 0x7f6d500a9f20 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.174+0000 7f6d549bb700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d500a9f20 0x7f6d500a90e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f6d40007370 tx=0x7f6d500b1cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.175+0000 7f6d457fa700 1 -- 172.21.15.81:0/2290225566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40018030 con 0x7f6d500a9f20 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.175+0000 7f6d457fa700 1 -- 172.21.15.81:0/2290225566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4000f9a0 con 0x7f6d500a9f20 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.175+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d500ace10 con 0x7f6d500a9f20 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.175+0000 7f6d457fa700 1 -- 172.21.15.81:0/2290225566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000fd40 con 0x7f6d500a9f20 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.175+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d500ad3d0 con 0x7f6d500a9f20 2023-10-06T02:53:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.176+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d500a7210 con 0x7f6d500a9f20 2023-10-06T02:53:21.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.176+0000 7f6d457fa700 1 -- 172.21.15.81:0/2290225566 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d4001b070 con 0x7f6d500a9f20 2023-10-06T02:53:21.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.176+0000 7f6d457fa700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d34066fb0 0x7f6d34069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.176+0000 7f6d457fa700 1 -- 172.21.15.81:0/2290225566 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6d40019070 con 0x7f6d500a9f20 2023-10-06T02:53:21.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.177+0000 7f6d551bc700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d34066fb0 0x7f6d34069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.177+0000 7f6d551bc700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d34066fb0 0x7f6d34069460 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009750 tx=0x7f6d4c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:21.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.180+0000 7f6d457fa700 1 -- 172.21.15.81:0/2290225566 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d500a7210 con 0x7f6d500a9f20 2023-10-06T02:53:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.358+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d500a71d0 con 0x7f6d34066fb0 2023-10-06T02:53:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.368+0000 7f6d457fa700 1 -- 172.21.15.81:0/2290225566 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302851 (secure 0 0 0) 0x7f6d500a71d0 con 0x7f6d34066fb0 2023-10-06T02:53:21.373 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d34066fb0 msgr2=0x7f6d34069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d34066fb0 0x7f6d34069460 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009750 tx=0x7f6d4c00b040 comp rx=0 tx=0).stop 2023-10-06T02:53:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d500a9f20 msgr2=0x7f6d500a90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d500a9f20 0x7f6d500a90e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f6d40007370 tx=0x7f6d500b1cf0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 shutdown_connections 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6d34066fb0 0x7f6d34069460 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d5015d7e0 0x7f6d5015dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d3c004d50 0x7f6d500ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 --2- 172.21.15.81:0/2290225566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d500a9f20 0x7f6d500a90e0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.370+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 >> 172.21.15.81:0/2290225566 conn(0x7f6d5006c620 msgr2=0x7f6d500aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.371+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 shutdown_connections 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.371+0000 7f6d561be700 1 -- 172.21.15.81:0/2290225566 wait complete. 2023-10-06T02:53:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:53:21.384 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2023-10-06T02:53:19.595375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7961,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554538,"statfs":{"total":1600000000,"available":1591847552,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.656548"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944885+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:33.945195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943021+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:16.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945132+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:31.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944072+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:40.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942306+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945633+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.948358+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:41.007295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946796+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945189+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.947086+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:39.701229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.947701+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:51.895407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.948865+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:44.898347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944764+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:51.895407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.949085+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:36.088521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945321+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:19.110831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945320+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946081+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942084+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:40.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945824+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941988+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:29.709175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943144+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:41.426949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945795+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:59.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943587+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:31.560000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944817+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:31.560000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944262+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:56.082472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943541+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:52.909214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.948022+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946346+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:06.729423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943861+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:29.230017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943801+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:19.795559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945266+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946919+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.256285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944764+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:31.560000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.952620+0000","last_change":"2023-10-06T02:53:15.952620+0000","last_active":"2023-10-06T02:53:15.952620+0000","last_peered":"2023-10-06T02:53:15.952620+0000","last_clean":"2023-10-06T02:53:15.952620+0000","last_became_active":"2023-10-06T02:53:15.952241+0000","last_became_peered":"2023-10-06T02:53:15.952241+0000","last_unstale":"2023-10-06T02:53:15.952620+0000","last_undegraded":"2023-10-06T02:53:15.952620+0000","last_fullsized":"2023-10-06T02:53:15.952620+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:21.071442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946773+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:51.599520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950606+0000","last_change":"2023-10-06T02:53:15.950606+0000","last_active":"2023-10-06T02:53:15.950606+0000","last_peered":"2023-10-06T02:53:15.950606+0000","last_clean":"2023-10-06T02:53:15.950606+0000","last_became_active":"2023-10-06T02:53:15.950220+0000","last_became_peered":"2023-10-06T02:53:15.950220+0000","last_unstale":"2023-10-06T02:53:15.950606+0000","last_undegraded":"2023-10-06T02:53:15.950606+0000","last_fullsized":"2023-10-06T02:53:15.950606+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942394+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:12.466135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.955289+0000","last_change":"2023-10-06T02:53:15.955289+0000","last_active":"2023-10-06T02:53:15.955289+0000","last_peered":"2023-10-06T02:53:15.955289+0000","last_clean":"2023-10-06T02:53:15.955289+0000","last_became_active":"2023-10-06T02:53:15.954958+0000","last_became_peered":"2023-10-06T02:53:15.954958+0000","last_unstale":"2023-10-06T02:53:15.955289+0000","last_undegraded":"2023-10-06T02:53:15.955289+0000","last_fullsized":"2023-10-06T02:53:15.955289+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945432+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:39.241581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953447+0000","last_change":"2023-10-06T02:53:15.953447+0000","last_active":"2023-10-06T02:53:15.953447+0000","last_peered":"2023-10-06T02:53:15.953447+0000","last_clean":"2023-10-06T02:53:15.953447+0000","last_became_active":"2023-10-06T02:53:15.952891+0000","last_became_peered":"2023-10-06T02:53:15.952891+0000","last_unstale":"2023-10-06T02:53:15.953447+0000","last_undegraded":"2023-10-06T02:53:15.953447+0000","last_fullsized":"2023-10-06T02:53:15.953447+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944893+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:40.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950593+0000","last_change":"2023-10-06T02:53:15.950593+0000","last_active":"2023-10-06T02:53:15.950593+0000","last_peered":"2023-10-06T02:53:15.950593+0000","last_clean":"2023-10-06T02:53:15.950593+0000","last_became_active":"2023-10-06T02:53:15.950349+0000","last_became_peered":"2023-10-06T02:53:15.950349+0000","last_unstale":"2023-10-06T02:53:15.950593+0000","last_undegraded":"2023-10-06T02:53:15.950593+0000","last_fullsized":"2023-10-06T02:53:15.950593+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945170+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950422+0000","last_change":"2023-10-06T02:53:15.950422+0000","last_active":"2023-10-06T02:53:15.950422+0000","last_peered":"2023-10-06T02:53:15.950422+0000","last_clean":"2023-10-06T02:53:15.950422+0000","last_became_active":"2023-10-06T02:53:15.950180+0000","last_became_peered":"2023-10-06T02:53:15.950180+0000","last_unstale":"2023-10-06T02:53:15.950422+0000","last_undegraded":"2023-10-06T02:53:15.950422+0000","last_fullsized":"2023-10-06T02:53:15.950422+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942167+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:06.183443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.949331+0000","last_change":"2023-10-06T02:53:15.949331+0000","last_active":"2023-10-06T02:53:15.949331+0000","last_peered":"2023-10-06T02:53:15.949331+0000","last_clean":"2023-10-06T02:53:15.949331+0000","last_became_active":"2023-10-06T02:53:15.949073+0000","last_became_peered":"2023-10-06T02:53:15.949073+0000","last_unstale":"2023-10-06T02:53:15.949331+0000","last_undegraded":"2023-10-06T02:53:15.949331+0000","last_fullsized":"2023-10-06T02:53:15.949331+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:10.217520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946553+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:29.709175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.948938+0000","last_change":"2023-10-06T02:53:15.948938+0000","last_active":"2023-10-06T02:53:15.948938+0000","last_peered":"2023-10-06T02:53:15.948938+0000","last_clean":"2023-10-06T02:53:15.948938+0000","last_became_active":"2023-10-06T02:53:15.947646+0000","last_became_peered":"2023-10-06T02:53:15.947646+0000","last_unstale":"2023-10-06T02:53:15.948938+0000","last_undegraded":"2023-10-06T02:53:15.948938+0000","last_fullsized":"2023-10-06T02:53:15.948938+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:51.518352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942667+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:33.971045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950371+0000","last_change":"2023-10-06T02:53:15.950371+0000","last_active":"2023-10-06T02:53:15.950371+0000","last_peered":"2023-10-06T02:53:15.950371+0000","last_clean":"2023-10-06T02:53:15.950371+0000","last_became_active":"2023-10-06T02:53:15.950141+0000","last_became_peered":"2023-10-06T02:53:15.950141+0000","last_unstale":"2023-10-06T02:53:15.950371+0000","last_undegraded":"2023-10-06T02:53:15.950371+0000","last_fullsized":"2023-10-06T02:53:15.950371+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946693+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:40.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.949084+0000","last_change":"2023-10-06T02:53:15.949084+0000","last_active":"2023-10-06T02:53:15.949084+0000","last_peered":"2023-10-06T02:53:15.949084+0000","last_clean":"2023-10-06T02:53:15.949084+0000","last_became_active":"2023-10-06T02:53:15.947986+0000","last_became_peered":"2023-10-06T02:53:15.947986+0000","last_unstale":"2023-10-06T02:53:15.949084+0000","last_undegraded":"2023-10-06T02:53:15.949084+0000","last_fullsized":"2023-10-06T02:53:15.949084+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:49.756550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945393+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.947587+0000","last_change":"2023-10-06T02:53:15.947587+0000","last_active":"2023-10-06T02:53:15.947587+0000","last_peered":"2023-10-06T02:53:15.947587+0000","last_clean":"2023-10-06T02:53:15.947587+0000","last_became_active":"2023-10-06T02:53:15.947298+0000","last_became_peered":"2023-10-06T02:53:15.947298+0000","last_unstale":"2023-10-06T02:53:15.947587+0000","last_undegraded":"2023-10-06T02:53:15.947587+0000","last_fullsized":"2023-10-06T02:53:15.947587+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945998+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:14.631507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.942574+0000","last_change":"2023-10-06T02:53:15.942574+0000","last_active":"2023-10-06T02:53:15.942574+0000","last_peered":"2023-10-06T02:53:15.942574+0000","last_clean":"2023-10-06T02:53:15.942574+0000","last_became_active":"2023-10-06T02:53:15.942392+0000","last_became_peered":"2023-10-06T02:53:15.942392+0000","last_unstale":"2023-10-06T02:53:15.942574+0000","last_undegraded":"2023-10-06T02:53:15.942574+0000","last_fullsized":"2023-10-06T02:53:15.942574+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941557+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950485+0000","last_change":"2023-10-06T02:53:15.950485+0000","last_active":"2023-10-06T02:53:15.950485+0000","last_peered":"2023-10-06T02:53:15.950485+0000","last_clean":"2023-10-06T02:53:15.950485+0000","last_became_active":"2023-10-06T02:53:15.949974+0000","last_became_peered":"2023-10-06T02:53:15.949974+0000","last_unstale":"2023-10-06T02:53:15.950485+0000","last_undegraded":"2023-10-06T02:53:15.950485+0000","last_fullsized":"2023-10-06T02:53:15.950485+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:30.739583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944526+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:52.265520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951410+0000","last_change":"2023-10-06T02:53:15.951410+0000","last_active":"2023-10-06T02:53:15.951410+0000","last_peered":"2023-10-06T02:53:15.951410+0000","last_clean":"2023-10-06T02:53:15.951410+0000","last_became_active":"2023-10-06T02:53:15.950897+0000","last_became_peered":"2023-10-06T02:53:15.950897+0000","last_unstale":"2023-10-06T02:53:15.951410+0000","last_undegraded":"2023-10-06T02:53:15.951410+0000","last_fullsized":"2023-10-06T02:53:15.951410+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:35.524955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941647+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953249+0000","last_change":"2023-10-06T02:53:15.953249+0000","last_active":"2023-10-06T02:53:15.953249+0000","last_peered":"2023-10-06T02:53:15.953249+0000","last_clean":"2023-10-06T02:53:15.953249+0000","last_became_active":"2023-10-06T02:53:15.953058+0000","last_became_peered":"2023-10-06T02:53:15.953058+0000","last_unstale":"2023-10-06T02:53:15.953249+0000","last_undegraded":"2023-10-06T02:53:15.953249+0000","last_fullsized":"2023-10-06T02:53:15.953249+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.942527+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:31.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.949459+0000","last_change":"2023-10-06T02:53:15.949459+0000","last_active":"2023-10-06T02:53:15.949459+0000","last_peered":"2023-10-06T02:53:15.949459+0000","last_clean":"2023-10-06T02:53:15.949459+0000","last_became_active":"2023-10-06T02:53:15.949233+0000","last_became_peered":"2023-10-06T02:53:15.949233+0000","last_unstale":"2023-10-06T02:53:15.949459+0000","last_undegraded":"2023-10-06T02:53:15.949459+0000","last_fullsized":"2023-10-06T02:53:15.949459+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:32.966190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941829+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:51.951868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953568+0000","last_change":"2023-10-06T02:53:15.953568+0000","last_active":"2023-10-06T02:53:15.953568+0000","last_peered":"2023-10-06T02:53:15.953568+0000","last_clean":"2023-10-06T02:53:15.953568+0000","last_became_active":"2023-10-06T02:53:15.952663+0000","last_became_peered":"2023-10-06T02:53:15.952663+0000","last_unstale":"2023-10-06T02:53:15.953568+0000","last_undegraded":"2023-10-06T02:53:15.953568+0000","last_fullsized":"2023-10-06T02:53:15.953568+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:42.266244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944349+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:43.099586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951083+0000","last_change":"2023-10-06T02:53:15.951083+0000","last_active":"2023-10-06T02:53:15.951083+0000","last_peered":"2023-10-06T02:53:15.951083+0000","last_clean":"2023-10-06T02:53:15.951083+0000","last_became_active":"2023-10-06T02:53:15.950728+0000","last_became_peered":"2023-10-06T02:53:15.950728+0000","last_unstale":"2023-10-06T02:53:15.951083+0000","last_undegraded":"2023-10-06T02:53:15.951083+0000","last_fullsized":"2023-10-06T02:53:15.951083+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945728+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951578+0000","last_change":"2023-10-06T02:53:15.951578+0000","last_active":"2023-10-06T02:53:15.951578+0000","last_peered":"2023-10-06T02:53:15.951578+0000","last_clean":"2023-10-06T02:53:15.951578+0000","last_became_active":"2023-10-06T02:53:15.951350+0000","last_became_peered":"2023-10-06T02:53:15.951350+0000","last_unstale":"2023-10-06T02:53:15.951578+0000","last_undegraded":"2023-10-06T02:53:15.951578+0000","last_fullsized":"2023-10-06T02:53:15.951578+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:15.781730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.945653+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:40.680189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951271+0000","last_change":"2023-10-06T02:53:15.951271+0000","last_active":"2023-10-06T02:53:15.951271+0000","last_peered":"2023-10-06T02:53:15.951271+0000","last_clean":"2023-10-06T02:53:15.951271+0000","last_became_active":"2023-10-06T02:53:15.951044+0000","last_became_peered":"2023-10-06T02:53:15.951044+0000","last_unstale":"2023-10-06T02:53:15.951271+0000","last_undegraded":"2023-10-06T02:53:15.951271+0000","last_fullsized":"2023-10-06T02:53:15.951271+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944752+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:41.426949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.954250+0000","last_change":"2023-10-06T02:53:15.954250+0000","last_active":"2023-10-06T02:53:15.954250+0000","last_peered":"2023-10-06T02:53:15.954250+0000","last_clean":"2023-10-06T02:53:15.954250+0000","last_became_active":"2023-10-06T02:53:15.951275+0000","last_became_peered":"2023-10-06T02:53:15.951275+0000","last_unstale":"2023-10-06T02:53:15.954250+0000","last_undegraded":"2023-10-06T02:53:15.954250+0000","last_fullsized":"2023-10-06T02:53:15.954250+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944314+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:16.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.955738+0000","last_change":"2023-10-06T02:53:15.955738+0000","last_active":"2023-10-06T02:53:15.955738+0000","last_peered":"2023-10-06T02:53:15.955738+0000","last_clean":"2023-10-06T02:53:15.955738+0000","last_became_active":"2023-10-06T02:53:15.955524+0000","last_became_peered":"2023-10-06T02:53:15.955524+0000","last_unstale":"2023-10-06T02:53:15.955738+0000","last_undegraded":"2023-10-06T02:53:15.955738+0000","last_fullsized":"2023-10-06T02:53:15.955738+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:30.555145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944220+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:31.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951067+0000","last_change":"2023-10-06T02:53:15.951067+0000","last_active":"2023-10-06T02:53:15.951067+0000","last_peered":"2023-10-06T02:53:15.951067+0000","last_clean":"2023-10-06T02:53:15.951067+0000","last_became_active":"2023-10-06T02:53:15.950869+0000","last_became_peered":"2023-10-06T02:53:15.950869+0000","last_unstale":"2023-10-06T02:53:15.951067+0000","last_undegraded":"2023-10-06T02:53:15.951067+0000","last_fullsized":"2023-10-06T02:53:15.951067+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946136+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:51.951868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.948960+0000","last_change":"2023-10-06T02:53:15.948960+0000","last_active":"2023-10-06T02:53:15.948960+0000","last_peered":"2023-10-06T02:53:15.948960+0000","last_clean":"2023-10-06T02:53:15.948960+0000","last_became_active":"2023-10-06T02:53:15.947980+0000","last_became_peered":"2023-10-06T02:53:15.947980+0000","last_unstale":"2023-10-06T02:53:15.948960+0000","last_undegraded":"2023-10-06T02:53:15.948960+0000","last_fullsized":"2023-10-06T02:53:15.948960+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943142+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:43.467592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.954832+0000","last_change":"2023-10-06T02:53:15.954832+0000","last_active":"2023-10-06T02:53:15.954832+0000","last_peered":"2023-10-06T02:53:15.954832+0000","last_clean":"2023-10-06T02:53:15.954832+0000","last_became_active":"2023-10-06T02:53:15.954616+0000","last_became_peered":"2023-10-06T02:53:15.954616+0000","last_unstale":"2023-10-06T02:53:15.954832+0000","last_undegraded":"2023-10-06T02:53:15.954832+0000","last_fullsized":"2023-10-06T02:53:15.954832+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":123,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.938315+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:53:14.938315+0000","last_peered":"2023-10-06T02:53:14.938315+0000","last_clean":"2023-10-06T02:53:14.938315+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:53:14.938315+0000","last_undegraded":"2023-10-06T02:53:14.938315+0000","last_fullsized":"2023-10-06T02:53:14.938315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.947270+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:01.005879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951215+0000","last_change":"2023-10-06T02:53:15.951215+0000","last_active":"2023-10-06T02:53:15.951215+0000","last_peered":"2023-10-06T02:53:15.951215+0000","last_clean":"2023-10-06T02:53:15.951215+0000","last_became_active":"2023-10-06T02:53:15.951002+0000","last_became_peered":"2023-10-06T02:53:15.951002+0000","last_unstale":"2023-10-06T02:53:15.951215+0000","last_undegraded":"2023-10-06T02:53:15.951215+0000","last_fullsized":"2023-10-06T02:53:15.951215+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:36.226855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.942035+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:53:14.942035+0000","last_peered":"2023-10-06T02:53:14.942035+0000","last_clean":"2023-10-06T02:53:14.942035+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:53:14.942035+0000","last_undegraded":"2023-10-06T02:53:14.942035+0000","last_fullsized":"2023-10-06T02:53:14.942035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.941674+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.949900+0000","last_change":"2023-10-06T02:53:15.949900+0000","last_active":"2023-10-06T02:53:15.949900+0000","last_peered":"2023-10-06T02:53:15.949900+0000","last_clean":"2023-10-06T02:53:15.949900+0000","last_became_active":"2023-10-06T02:53:15.949704+0000","last_became_peered":"2023-10-06T02:53:15.949704+0000","last_unstale":"2023-10-06T02:53:15.949900+0000","last_undegraded":"2023-10-06T02:53:15.949900+0000","last_fullsized":"2023-10-06T02:53:15.949900+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:51.904359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":125,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.941521+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:53:14.941521+0000","last_peered":"2023-10-06T02:53:14.941521+0000","last_clean":"2023-10-06T02:53:14.941521+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:53:14.941521+0000","last_undegraded":"2023-10-06T02:53:14.941521+0000","last_fullsized":"2023-10-06T02:53:14.941521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944755+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:12.466135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953624+0000","last_change":"2023-10-06T02:53:15.953624+0000","last_active":"2023-10-06T02:53:15.953624+0000","last_peered":"2023-10-06T02:53:15.953624+0000","last_clean":"2023-10-06T02:53:15.953624+0000","last_became_active":"2023-10-06T02:53:15.953206+0000","last_became_peered":"2023-10-06T02:53:15.953206+0000","last_unstale":"2023-10-06T02:53:15.953624+0000","last_undegraded":"2023-10-06T02:53:15.953624+0000","last_fullsized":"2023-10-06T02:53:15.953624+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:50.890551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.942061+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:53:14.942061+0000","last_peered":"2023-10-06T02:53:14.942061+0000","last_clean":"2023-10-06T02:53:14.942061+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:53:14.942061+0000","last_undegraded":"2023-10-06T02:53:14.942061+0000","last_fullsized":"2023-10-06T02:53:14.942061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.944019+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:53:14.944019+0000","last_peered":"2023-10-06T02:53:14.944019+0000","last_clean":"2023-10-06T02:53:14.944019+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:53:14.944019+0000","last_undegraded":"2023-10-06T02:53:14.944019+0000","last_fullsized":"2023-10-06T02:53:14.944019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.946823+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:06.183443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.950535+0000","last_change":"2023-10-06T02:53:15.950535+0000","last_active":"2023-10-06T02:53:15.950535+0000","last_peered":"2023-10-06T02:53:15.950535+0000","last_clean":"2023-10-06T02:53:15.950535+0000","last_became_active":"2023-10-06T02:53:15.950353+0000","last_became_peered":"2023-10-06T02:53:15.950353+0000","last_unstale":"2023-10-06T02:53:15.950535+0000","last_undegraded":"2023-10-06T02:53:15.950535+0000","last_fullsized":"2023-10-06T02:53:15.950535+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:04.092161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.943871+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:53:14.943871+0000","last_peered":"2023-10-06T02:53:14.943871+0000","last_clean":"2023-10-06T02:53:14.943871+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:53:14.943871+0000","last_undegraded":"2023-10-06T02:53:14.943871+0000","last_fullsized":"2023-10-06T02:53:14.943871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943347+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:11.222375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.951054+0000","last_change":"2023-10-06T02:53:15.951054+0000","last_active":"2023-10-06T02:53:15.951054+0000","last_peered":"2023-10-06T02:53:15.951054+0000","last_clean":"2023-10-06T02:53:15.951054+0000","last_became_active":"2023-10-06T02:53:15.950811+0000","last_became_peered":"2023-10-06T02:53:15.950811+0000","last_unstale":"2023-10-06T02:53:15.951054+0000","last_undegraded":"2023-10-06T02:53:15.951054+0000","last_fullsized":"2023-10-06T02:53:15.951054+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.944129+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:53:14.944129+0000","last_peered":"2023-10-06T02:53:14.944129+0000","last_clean":"2023-10-06T02:53:14.944129+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:53:14.944129+0000","last_undegraded":"2023-10-06T02:53:14.944129+0000","last_fullsized":"2023-10-06T02:53:14.944129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.943977+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:34.875702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.954105+0000","last_change":"2023-10-06T02:53:15.954105+0000","last_active":"2023-10-06T02:53:15.954105+0000","last_peered":"2023-10-06T02:53:15.954105+0000","last_clean":"2023-10-06T02:53:15.954105+0000","last_became_active":"2023-10-06T02:53:15.950962+0000","last_became_peered":"2023-10-06T02:53:15.950962+0000","last_unstale":"2023-10-06T02:53:15.954105+0000","last_undegraded":"2023-10-06T02:53:15.954105+0000","last_fullsized":"2023-10-06T02:53:15.954105+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":123,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.938333+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:53:14.938333+0000","last_peered":"2023-10-06T02:53:14.938333+0000","last_clean":"2023-10-06T02:53:14.938333+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:53:14.938333+0000","last_undegraded":"2023-10-06T02:53:14.938333+0000","last_fullsized":"2023-10-06T02:53:14.938333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:53:15.937553+0000","last_change":"2023-10-06T02:53:15.944955+0000","last_active":"2023-10-06T02:53:15.937553+0000","last_peered":"2023-10-06T02:53:15.937553+0000","last_clean":"2023-10-06T02:53:15.937553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:53:15.937553+0000","last_undegraded":"2023-10-06T02:53:15.937553+0000","last_fullsized":"2023-10-06T02:53:15.937553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:40.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:53:15.953695+0000","last_change":"2023-10-06T02:53:15.953695+0000","last_active":"2023-10-06T02:53:15.953695+0000","last_peered":"2023-10-06T02:53:15.953695+0000","last_clean":"2023-10-06T02:53:15.953695+0000","last_became_active":"2023-10-06T02:53:15.953150+0000","last_became_peered":"2023-10-06T02:53:15.953150+0000","last_unstale":"2023-10-06T02:53:15.953695+0000","last_undegraded":"2023-10-06T02:53:15.953695+0000","last_fullsized":"2023-10-06T02:53:15.953695+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:26.827466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-06T02:53:14.941546+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:53:14.941546+0000","last_peered":"2023-10-06T02:53:14.941546+0000","last_clean":"2023-10-06T02:53:14.941546+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:53:14.941546+0000","last_undegraded":"2023-10-06T02:53:14.941546+0000","last_fullsized":"2023-10-06T02:53:14.941546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193882,"statfs":{"total":200000000,"available":198535690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.393},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.53000000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":1.081},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.52900000000000003},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.72399999999999998,"5min":0.79900000000000004,"15min":1.4710000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.626},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":4.8129999999999997},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.60299999999999998},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.69599999999999995,"5min":0.78600000000000003,"15min":3.4870000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":2.2349999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46600000000000003,"15min":0.45900000000000002},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63200000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.497,"15min":0.49099999999999999},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51200000000000001,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":0.879},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.31900000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":853,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194459,"statfs":{"total":200000000,"available":199126058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.60299999999999998},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.56100000000000005},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.879},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.90500000000000003},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.81599999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.64700000000000002,"5min":1.042,"15min":1.0580000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54500000000000004,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.29499999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.80100000000000005,"15min":1.163},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47499999999999998,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":1.05},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.501,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.86799999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.53700000000000003,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.754,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54100000000000004,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":1.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76400000000000001,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.39400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":847,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199132666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32000000000000001,"15min":0.313},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.44400000000000001,"5min":0.501,"15min":0.501},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.35499999999999998,"15min":0.33300000000000002},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.51000000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.32300000000000001},"min":{"1min":0.23799999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.48399999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40400000000000003,"15min":0.38400000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.36399999999999999},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.441}]},{"osd":4,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.53800000000000003},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76800000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.91400000000000003,"5min":1.006,"15min":1.006},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.61899999999999999,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.88200000000000001},"last":0.68300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193888,"statfs":{"total":200000000,"available":198542298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.34499999999999997},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46500000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33200000000000002,"15min":0.96699999999999997},"min":{"1min":0.217,"5min":0.216,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.56899999999999995,"15min":22.038},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":1.3779999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.50900000000000001,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":1.0009999999999999},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.253},"max":{"1min":0.60399999999999998,"5min":0.63300000000000001,"15min":21.942},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":1.083},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.32900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":11.122999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":1.1599999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":22.010999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":1.401},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":1.113},"min":{"1min":0.374,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.83599999999999997,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":1.1850000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":21.98},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.425},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.872},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":11.154},"last":0.51800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":853,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194459,"statfs":{"total":200000000,"available":199126058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.183,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.46000000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.186},"max":{"1min":0.501,"5min":0.60199999999999998,"15min":0.60699999999999998},"last":0.26700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36699999999999999,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48899999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.41299999999999998,"15min":0.38900000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.59299999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.318}]},{"osd":3,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.374},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.40400000000000003,"15min":0.39700000000000002},"min":{"1min":0.245,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.28199999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83599999999999997,"5min":1.056,"15min":1.056},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.312,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.433}]},{"osd":5,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.61699999999999999,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.72099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.59399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86399999999999999,"5min":1.018,"15min":1.2569999999999999},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":1.002,"15min":1.002},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.624,"15min":0.59499999999999997},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76100000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.52500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":847,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199132666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32000000000000001,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.223},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.372,"15min":0.33400000000000002},"min":{"1min":0.23100000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.25800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35599999999999998,"15min":0.33200000000000002},"min":{"1min":0.249,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.48899999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38100000000000001,"15min":0.34999999999999998},"min":{"1min":0.28100000000000003,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.496,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.41499999999999998,"15min":0.374},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":0.44,"5min":3.044,"15min":3.044},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39100000000000001,"15min":0.35099999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.312}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73699999999999999,"5min":1.446,"15min":2.2120000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":1.327,"15min":2.25},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.67800000000000005},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80500000000000005,"5min":1.268,"15min":1.268},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76400000000000001,"5min":1.218,"15min":1.218},"last":0.753},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38600000000000001},"max":{"1min":0.83699999999999997,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.62}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61099999999999999,"15min":0.90600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":0.79800000000000004,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":853,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194459,"statfs":{"total":200000000,"available":199126058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.495,"15min":0.752},"min":{"1min":0.27200000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.67700000000000005,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.60599999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.221},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.28999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52300000000000002,"15min":0.78200000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":5.9329999999999998},"last":0.433},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.74099999999999999},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.65900000000000003,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":5.4390000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.65700000000000003},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66700000000000004,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69899999999999995,"5min":0.77000000000000002,"15min":3.456},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.27500000000000002,"15min":0.245},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72199999999999998,"5min":0.76400000000000001,"15min":0.78400000000000003},"last":0.497},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.96599999999999997},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":13.173999999999999},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":853,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194459,"statfs":{"total":200000000,"available":199126058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.64700000000000002,"5min":0.747,"15min":0.79100000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.28799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67600000000000005,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.30399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68899999999999995,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.60599999999999998,"5min":0.747,"15min":0.83799999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.252},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69799999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.504}]},{"osd":6,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.498,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.879,"15min":0.879},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72599999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81799999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.621}]}]}],"pool_statfs":[]}} 2023-10-06T02:53:21.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:53:21.434 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-10-06T02:53:21.432+0000 7fa8fb084700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:53:21.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.536+0000 7f82a0fac700 1 Processor -- start 2023-10-06T02:53:21.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.536+0000 7f82a0fac700 1 -- start start 2023-10-06T02:53:21.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.537+0000 7f82a0fac700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f829c157ca0 0x7f829c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.537+0000 7f82a0fac700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c0d07c0 con 0x7f829c1578d0 2023-10-06T02:53:21.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.537+0000 7f82a0fac700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c0cfbb0 con 0x7f829c06d120 2023-10-06T02:53:21.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.537+0000 7f82a0fac700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c0cfe90 con 0x7f829c157ca0 2023-10-06T02:53:21.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.537+0000 7f8291d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f829c157ca0 0x7f829c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.537+0000 7f829a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f829c1578d0 0x7f829c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35854/0 (socket says 172.21.15.81:35854) 2023-10-06T02:53:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.537+0000 7f8291d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f829c157ca0 0x7f829c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49186/0 (socket says 172.21.15.81:49186) 2023-10-06T02:53:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.537+0000 7f829a59c700 1 -- 172.21.15.81:0/1962552963 learned_addr learned my addr 172.21.15.81:0/1962552963 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f8291d9b700 1 -- 172.21.15.81:0/1962552963 >> v1:172.21.15.83:6789/0 conn(0x7f829c06d120 legacy=0x7f829c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f8291d9b700 1 -- 172.21.15.81:0/1962552963 >> v1:172.21.15.81:6789/0 conn(0x7f829c1578d0 legacy=0x7f829c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f8299d9b700 1 -- 172.21.15.81:0/1962552963 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504000318 0 0) 0x7f829c0d07c0 con 0x7f829c1578d0 2023-10-06T02:53:21.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f8291d9b700 1 -- 172.21.15.81:0/1962552963 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c0d0170 con 0x7f829c157ca0 2023-10-06T02:53:21.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f8291d9b700 1 --2- 172.21.15.81:0/1962552963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c157ca0 0x7f829c0cf4f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f82840098e0 tx=0x7f82840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1a137dc1868fb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:21.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f8299d9b700 1 -- 172.21.15.81:0/1962552963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284009e80 con 0x7f829c157ca0 2023-10-06T02:53:21.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f8299d9b700 1 -- 172.21.15.81:0/1962552963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400b860 con 0x7f829c157ca0 2023-10-06T02:53:21.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f8299d9b700 1 -- 172.21.15.81:0/1962552963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400bbe0 con 0x7f829c157ca0 2023-10-06T02:53:21.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f82a0fac700 1 -- 172.21.15.81:0/1962552963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c157ca0 msgr2=0x7f829c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f82a0fac700 1 --2- 172.21.15.81:0/1962552963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c157ca0 0x7f829c0cf4f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f82840098e0 tx=0x7f82840091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f82a0fac700 1 -- 172.21.15.81:0/1962552963 shutdown_connections 2023-10-06T02:53:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f82a0fac700 1 --2- 172.21.15.81:0/1962552963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c157ca0 0x7f829c0cf4f0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f82a0fac700 1 -- 172.21.15.81:0/1962552963 >> 172.21.15.81:0/1962552963 conn(0x7f829c06bb90 msgr2=0x7f829c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f82a0fac700 1 -- 172.21.15.81:0/1962552963 shutdown_connections 2023-10-06T02:53:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.538+0000 7f82a0fac700 1 -- 172.21.15.81:0/1962552963 wait complete. 2023-10-06T02:53:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f82a0fac700 1 Processor -- start 2023-10-06T02:53:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f82a0fac700 1 -- start start 2023-10-06T02:53:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f82a0fac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c06d120 0x7f829c14b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f82a0fac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f829c1578d0 0x7f829c0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f82a0fac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f829c157ca0 0x7f829c0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f82a0fac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0b2570 con 0x7f829c06d120 2023-10-06T02:53:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f82a0fac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c14be00 con 0x7f829c157ca0 2023-10-06T02:53:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f82a0fac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0b18f0 con 0x7f829c1578d0 2023-10-06T02:53:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f829a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c06d120 0x7f829c14b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f829a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c06d120 0x7f829c14b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49202/0 (socket says 172.21.15.81:49202) 2023-10-06T02:53:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.540+0000 7f829a59c700 1 -- 172.21.15.81:0/1099807017 learned_addr learned my addr 172.21.15.81:0/1099807017 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f829a59c700 1 -- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f829c1578d0 msgr2=0x7f829c0b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f829a59c700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f829c1578d0 0x7f829c0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f829a59c700 1 -- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f829c157ca0 msgr2=0x7f829c0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f829ad9d700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f829c157ca0 0x7f829c0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f829a59c700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f829c157ca0 0x7f829c0b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f829a59c700 1 -- 172.21.15.81:0/1099807017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8284009420 con 0x7f829c06d120 2023-10-06T02:53:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f829a59c700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c06d120 0x7f829c14b8c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c840 tx=0x7f828c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f8292ffd700 1 -- 172.21.15.81:0/1099807017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c005c00 con 0x7f829c06d120 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f8292ffd700 1 -- 172.21.15.81:0/1099807017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c005d80 con 0x7f829c06d120 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c0b1bd0 con 0x7f829c06d120 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f8292ffd700 1 -- 172.21.15.81:0/1099807017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c007320 con 0x7f829c06d120 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.541+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c0b2190 con 0x7f829c06d120 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.542+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c0b6c60 con 0x7f829c06d120 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.542+0000 7f8292ffd700 1 -- 172.21.15.81:0/1099807017 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f828c01b3b0 con 0x7f829c06d120 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.543+0000 7f8292ffd700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f827c066f30 0x7f827c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.543+0000 7f8292ffd700 1 -- 172.21.15.81:0/1099807017 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f828c083c80 con 0x7f829c06d120 2023-10-06T02:53:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.543+0000 7f8291d9b700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f827c066f30 0x7f827c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.543+0000 7f8291d9b700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f827c066f30 0x7f827c0693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f829c1580c0 tx=0x7f8284017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.547+0000 7f8292ffd700 1 -- 172.21.15.81:0/1099807017 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f828c050d90 con 0x7f829c06d120 2023-10-06T02:53:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.726+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f829c0d0450 con 0x7f827c066f30 2023-10-06T02:53:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.736+0000 7f8292ffd700 1 -- 172.21.15.81:0/1099807017 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305862 (secure 0 0 0) 0x7f829c0d0450 con 0x7f827c066f30 2023-10-06T02:53:21.741 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f827c066f30 msgr2=0x7f827c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f827c066f30 0x7f827c0693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f829c1580c0 tx=0x7f8284017000 comp rx=0 tx=0).stop 2023-10-06T02:53:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c06d120 msgr2=0x7f829c14b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c06d120 0x7f829c14b8c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c840 tx=0x7f828c007d90 comp rx=0 tx=0).stop 2023-10-06T02:53:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 shutdown_connections 2023-10-06T02:53:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f827c066f30 0x7f827c0693e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f829c157ca0 0x7f829c0b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f829c06d120 0x7f829c14b8c0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 --2- 172.21.15.81:0/1099807017 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f829c1578d0 0x7f829c0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 >> 172.21.15.81:0/1099807017 conn(0x7f829c06bb90 msgr2=0x7f829c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 shutdown_connections 2023-10-06T02:53:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.738+0000 7f82a0fac700 1 -- 172.21.15.81:0/1099807017 wait complete. 2023-10-06T02:53:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:53:21.753 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2023-10-06T02:53:21.595759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8092,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554407,"statfs":{"total":1600000000,"available":1591713060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001313"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964474+0000","last_change":"2023-10-06T02:53:16.964366+0000","last_active":"2023-10-06T02:53:16.964474+0000","last_peered":"2023-10-06T02:53:16.964474+0000","last_clean":"2023-10-06T02:53:16.964474+0000","last_became_active":"2023-10-06T02:53:16.964152+0000","last_became_peered":"2023-10-06T02:53:16.964152+0000","last_unstale":"2023-10-06T02:53:16.964474+0000","last_undegraded":"2023-10-06T02:53:16.964474+0000","last_fullsized":"2023-10-06T02:53:16.964474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:19.267194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963477+0000","last_change":"2023-10-06T02:53:16.963411+0000","last_active":"2023-10-06T02:53:16.963477+0000","last_peered":"2023-10-06T02:53:16.963477+0000","last_clean":"2023-10-06T02:53:16.963477+0000","last_became_active":"2023-10-06T02:53:16.963241+0000","last_became_peered":"2023-10-06T02:53:16.963241+0000","last_unstale":"2023-10-06T02:53:16.963477+0000","last_undegraded":"2023-10-06T02:53:16.963477+0000","last_fullsized":"2023-10-06T02:53:16.963477+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976745+0000","last_change":"2023-10-06T02:53:16.971956+0000","last_active":"2023-10-06T02:53:16.976745+0000","last_peered":"2023-10-06T02:53:16.976745+0000","last_clean":"2023-10-06T02:53:16.976745+0000","last_became_active":"2023-10-06T02:53:16.971529+0000","last_became_peered":"2023-10-06T02:53:16.971529+0000","last_unstale":"2023-10-06T02:53:16.976745+0000","last_undegraded":"2023-10-06T02:53:16.976745+0000","last_fullsized":"2023-10-06T02:53:16.976745+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:40.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964106+0000","last_change":"2023-10-06T02:53:16.964041+0000","last_active":"2023-10-06T02:53:16.964106+0000","last_peered":"2023-10-06T02:53:16.964106+0000","last_clean":"2023-10-06T02:53:16.964106+0000","last_became_active":"2023-10-06T02:53:16.963789+0000","last_became_peered":"2023-10-06T02:53:16.963789+0000","last_unstale":"2023-10-06T02:53:16.964106+0000","last_undegraded":"2023-10-06T02:53:16.964106+0000","last_fullsized":"2023-10-06T02:53:16.964106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965475+0000","last_change":"2023-10-06T02:53:16.965419+0000","last_active":"2023-10-06T02:53:16.965475+0000","last_peered":"2023-10-06T02:53:16.965475+0000","last_clean":"2023-10-06T02:53:16.965475+0000","last_became_active":"2023-10-06T02:53:16.965214+0000","last_became_peered":"2023-10-06T02:53:16.965214+0000","last_unstale":"2023-10-06T02:53:16.965475+0000","last_undegraded":"2023-10-06T02:53:16.965475+0000","last_fullsized":"2023-10-06T02:53:16.965475+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:08.537334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963420+0000","last_change":"2023-10-06T02:53:16.963193+0000","last_active":"2023-10-06T02:53:16.963420+0000","last_peered":"2023-10-06T02:53:16.963420+0000","last_clean":"2023-10-06T02:53:16.963420+0000","last_became_active":"2023-10-06T02:53:16.962989+0000","last_became_peered":"2023-10-06T02:53:16.962989+0000","last_unstale":"2023-10-06T02:53:16.963420+0000","last_undegraded":"2023-10-06T02:53:16.963420+0000","last_fullsized":"2023-10-06T02:53:16.963420+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.974532+0000","last_change":"2023-10-06T02:53:16.974470+0000","last_active":"2023-10-06T02:53:16.974532+0000","last_peered":"2023-10-06T02:53:16.974532+0000","last_clean":"2023-10-06T02:53:16.974532+0000","last_became_active":"2023-10-06T02:53:16.973433+0000","last_became_peered":"2023-10-06T02:53:16.973433+0000","last_unstale":"2023-10-06T02:53:16.974532+0000","last_undegraded":"2023-10-06T02:53:16.974532+0000","last_fullsized":"2023-10-06T02:53:16.974532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:18.791274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969503+0000","last_change":"2023-10-06T02:53:16.968369+0000","last_active":"2023-10-06T02:53:16.969503+0000","last_peered":"2023-10-06T02:53:16.969503+0000","last_clean":"2023-10-06T02:53:16.969503+0000","last_became_active":"2023-10-06T02:53:16.967979+0000","last_became_peered":"2023-10-06T02:53:16.967979+0000","last_unstale":"2023-10-06T02:53:16.969503+0000","last_undegraded":"2023-10-06T02:53:16.969503+0000","last_fullsized":"2023-10-06T02:53:16.969503+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966452+0000","last_change":"2023-10-06T02:53:16.966268+0000","last_active":"2023-10-06T02:53:16.966452+0000","last_peered":"2023-10-06T02:53:16.966452+0000","last_clean":"2023-10-06T02:53:16.966452+0000","last_became_active":"2023-10-06T02:53:16.965789+0000","last_became_peered":"2023-10-06T02:53:16.965789+0000","last_unstale":"2023-10-06T02:53:16.966452+0000","last_undegraded":"2023-10-06T02:53:16.966452+0000","last_fullsized":"2023-10-06T02:53:16.966452+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:46.513629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966548+0000","last_change":"2023-10-06T02:53:16.966490+0000","last_active":"2023-10-06T02:53:16.966548+0000","last_peered":"2023-10-06T02:53:16.966548+0000","last_clean":"2023-10-06T02:53:16.966548+0000","last_became_active":"2023-10-06T02:53:16.966238+0000","last_became_peered":"2023-10-06T02:53:16.966238+0000","last_unstale":"2023-10-06T02:53:16.966548+0000","last_undegraded":"2023-10-06T02:53:16.966548+0000","last_fullsized":"2023-10-06T02:53:16.966548+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:50.567117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968913+0000","last_change":"2023-10-06T02:53:16.968803+0000","last_active":"2023-10-06T02:53:16.968913+0000","last_peered":"2023-10-06T02:53:16.968913+0000","last_clean":"2023-10-06T02:53:16.968913+0000","last_became_active":"2023-10-06T02:53:16.968493+0000","last_became_peered":"2023-10-06T02:53:16.968493+0000","last_unstale":"2023-10-06T02:53:16.968913+0000","last_undegraded":"2023-10-06T02:53:16.968913+0000","last_fullsized":"2023-10-06T02:53:16.968913+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960447+0000","last_change":"2023-10-06T02:53:16.960354+0000","last_active":"2023-10-06T02:53:16.960447+0000","last_peered":"2023-10-06T02:53:16.960447+0000","last_clean":"2023-10-06T02:53:16.960447+0000","last_became_active":"2023-10-06T02:53:16.960134+0000","last_became_peered":"2023-10-06T02:53:16.960134+0000","last_unstale":"2023-10-06T02:53:16.960447+0000","last_undegraded":"2023-10-06T02:53:16.960447+0000","last_fullsized":"2023-10-06T02:53:16.960447+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:47.125694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965409+0000","last_change":"2023-10-06T02:53:16.965340+0000","last_active":"2023-10-06T02:53:16.965409+0000","last_peered":"2023-10-06T02:53:16.965409+0000","last_clean":"2023-10-06T02:53:16.965409+0000","last_became_active":"2023-10-06T02:53:16.965113+0000","last_became_peered":"2023-10-06T02:53:16.965113+0000","last_unstale":"2023-10-06T02:53:16.965409+0000","last_undegraded":"2023-10-06T02:53:16.965409+0000","last_fullsized":"2023-10-06T02:53:16.965409+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:29.709175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962633+0000","last_change":"2023-10-06T02:53:16.962192+0000","last_active":"2023-10-06T02:53:16.962633+0000","last_peered":"2023-10-06T02:53:16.962633+0000","last_clean":"2023-10-06T02:53:16.962633+0000","last_became_active":"2023-10-06T02:53:16.961955+0000","last_became_peered":"2023-10-06T02:53:16.961955+0000","last_unstale":"2023-10-06T02:53:16.962633+0000","last_undegraded":"2023-10-06T02:53:16.962633+0000","last_fullsized":"2023-10-06T02:53:16.962633+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:16.000558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962615+0000","last_change":"2023-10-06T02:53:16.962069+0000","last_active":"2023-10-06T02:53:16.962615+0000","last_peered":"2023-10-06T02:53:16.962615+0000","last_clean":"2023-10-06T02:53:16.962615+0000","last_became_active":"2023-10-06T02:53:16.961852+0000","last_became_peered":"2023-10-06T02:53:16.961852+0000","last_unstale":"2023-10-06T02:53:16.962615+0000","last_undegraded":"2023-10-06T02:53:16.962615+0000","last_fullsized":"2023-10-06T02:53:16.962615+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:30.710968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964962+0000","last_change":"2023-10-06T02:53:16.964622+0000","last_active":"2023-10-06T02:53:16.964962+0000","last_peered":"2023-10-06T02:53:16.964962+0000","last_clean":"2023-10-06T02:53:16.964962+0000","last_became_active":"2023-10-06T02:53:16.964357+0000","last_became_peered":"2023-10-06T02:53:16.964357+0000","last_unstale":"2023-10-06T02:53:16.964962+0000","last_undegraded":"2023-10-06T02:53:16.964962+0000","last_fullsized":"2023-10-06T02:53:16.964962+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964301+0000","last_change":"2023-10-06T02:53:16.964241+0000","last_active":"2023-10-06T02:53:16.964301+0000","last_peered":"2023-10-06T02:53:16.964301+0000","last_clean":"2023-10-06T02:53:16.964301+0000","last_became_active":"2023-10-06T02:53:16.963989+0000","last_became_peered":"2023-10-06T02:53:16.963989+0000","last_unstale":"2023-10-06T02:53:16.964301+0000","last_undegraded":"2023-10-06T02:53:16.964301+0000","last_fullsized":"2023-10-06T02:53:16.964301+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.961844+0000","last_change":"2023-10-06T02:53:16.961787+0000","last_active":"2023-10-06T02:53:16.961844+0000","last_peered":"2023-10-06T02:53:16.961844+0000","last_clean":"2023-10-06T02:53:16.961844+0000","last_became_active":"2023-10-06T02:53:16.961549+0000","last_became_peered":"2023-10-06T02:53:16.961549+0000","last_unstale":"2023-10-06T02:53:16.961844+0000","last_undegraded":"2023-10-06T02:53:16.961844+0000","last_fullsized":"2023-10-06T02:53:16.961844+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:04.547121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969905+0000","last_change":"2023-10-06T02:53:16.967603+0000","last_active":"2023-10-06T02:53:16.969905+0000","last_peered":"2023-10-06T02:53:16.969905+0000","last_clean":"2023-10-06T02:53:16.969905+0000","last_became_active":"2023-10-06T02:53:16.967257+0000","last_became_peered":"2023-10-06T02:53:16.967257+0000","last_unstale":"2023-10-06T02:53:16.969905+0000","last_undegraded":"2023-10-06T02:53:16.969905+0000","last_fullsized":"2023-10-06T02:53:16.969905+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:46.513629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963308+0000","last_change":"2023-10-06T02:53:16.963262+0000","last_active":"2023-10-06T02:53:16.963308+0000","last_peered":"2023-10-06T02:53:16.963308+0000","last_clean":"2023-10-06T02:53:16.963308+0000","last_became_active":"2023-10-06T02:53:16.963045+0000","last_became_peered":"2023-10-06T02:53:16.963045+0000","last_unstale":"2023-10-06T02:53:16.963308+0000","last_undegraded":"2023-10-06T02:53:16.963308+0000","last_fullsized":"2023-10-06T02:53:16.963308+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:41.518762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963023+0000","last_change":"2023-10-06T02:53:16.961784+0000","last_active":"2023-10-06T02:53:16.963023+0000","last_peered":"2023-10-06T02:53:16.963023+0000","last_clean":"2023-10-06T02:53:16.963023+0000","last_became_active":"2023-10-06T02:53:16.961539+0000","last_became_peered":"2023-10-06T02:53:16.961539+0000","last_unstale":"2023-10-06T02:53:16.963023+0000","last_undegraded":"2023-10-06T02:53:16.963023+0000","last_fullsized":"2023-10-06T02:53:16.963023+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.959136+0000","last_change":"2023-10-06T02:53:16.959071+0000","last_active":"2023-10-06T02:53:16.959136+0000","last_peered":"2023-10-06T02:53:16.959136+0000","last_clean":"2023-10-06T02:53:16.959136+0000","last_became_active":"2023-10-06T02:53:16.958842+0000","last_became_peered":"2023-10-06T02:53:16.958842+0000","last_unstale":"2023-10-06T02:53:16.959136+0000","last_undegraded":"2023-10-06T02:53:16.959136+0000","last_fullsized":"2023-10-06T02:53:16.959136+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:22.969575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967859+0000","last_change":"2023-10-06T02:53:16.967393+0000","last_active":"2023-10-06T02:53:16.967859+0000","last_peered":"2023-10-06T02:53:16.967859+0000","last_clean":"2023-10-06T02:53:16.967859+0000","last_became_active":"2023-10-06T02:53:16.966986+0000","last_became_peered":"2023-10-06T02:53:16.966986+0000","last_unstale":"2023-10-06T02:53:16.967859+0000","last_undegraded":"2023-10-06T02:53:16.967859+0000","last_fullsized":"2023-10-06T02:53:16.967859+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966469+0000","last_change":"2023-10-06T02:53:16.966402+0000","last_active":"2023-10-06T02:53:16.966469+0000","last_peered":"2023-10-06T02:53:16.966469+0000","last_clean":"2023-10-06T02:53:16.966469+0000","last_became_active":"2023-10-06T02:53:16.966058+0000","last_became_peered":"2023-10-06T02:53:16.966058+0000","last_unstale":"2023-10-06T02:53:16.966469+0000","last_undegraded":"2023-10-06T02:53:16.966469+0000","last_fullsized":"2023-10-06T02:53:16.966469+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966953+0000","last_change":"2023-10-06T02:53:16.966866+0000","last_active":"2023-10-06T02:53:16.966953+0000","last_peered":"2023-10-06T02:53:16.966953+0000","last_clean":"2023-10-06T02:53:16.966953+0000","last_became_active":"2023-10-06T02:53:16.966496+0000","last_became_peered":"2023-10-06T02:53:16.966496+0000","last_unstale":"2023-10-06T02:53:16.966953+0000","last_undegraded":"2023-10-06T02:53:16.966953+0000","last_fullsized":"2023-10-06T02:53:16.966953+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976990+0000","last_change":"2023-10-06T02:53:16.975642+0000","last_active":"2023-10-06T02:53:16.976990+0000","last_peered":"2023-10-06T02:53:16.976990+0000","last_clean":"2023-10-06T02:53:16.976990+0000","last_became_active":"2023-10-06T02:53:16.973199+0000","last_became_peered":"2023-10-06T02:53:16.973199+0000","last_unstale":"2023-10-06T02:53:16.976990+0000","last_undegraded":"2023-10-06T02:53:16.976990+0000","last_fullsized":"2023-10-06T02:53:16.976990+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969966+0000","last_change":"2023-10-06T02:53:16.969752+0000","last_active":"2023-10-06T02:53:16.969966+0000","last_peered":"2023-10-06T02:53:16.969966+0000","last_clean":"2023-10-06T02:53:16.969966+0000","last_became_active":"2023-10-06T02:53:16.969379+0000","last_became_peered":"2023-10-06T02:53:16.969379+0000","last_unstale":"2023-10-06T02:53:16.969966+0000","last_undegraded":"2023-10-06T02:53:16.969966+0000","last_fullsized":"2023-10-06T02:53:16.969966+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:05.498811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964799+0000","last_change":"2023-10-06T02:53:16.964735+0000","last_active":"2023-10-06T02:53:16.964799+0000","last_peered":"2023-10-06T02:53:16.964799+0000","last_clean":"2023-10-06T02:53:16.964799+0000","last_became_active":"2023-10-06T02:53:16.963476+0000","last_became_peered":"2023-10-06T02:53:16.963476+0000","last_unstale":"2023-10-06T02:53:16.964799+0000","last_undegraded":"2023-10-06T02:53:16.964799+0000","last_fullsized":"2023-10-06T02:53:16.964799+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:53.420838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963196+0000","last_change":"2023-10-06T02:53:16.962948+0000","last_active":"2023-10-06T02:53:16.963196+0000","last_peered":"2023-10-06T02:53:16.963196+0000","last_clean":"2023-10-06T02:53:16.963196+0000","last_became_active":"2023-10-06T02:53:16.962663+0000","last_became_peered":"2023-10-06T02:53:16.962663+0000","last_unstale":"2023-10-06T02:53:16.963196+0000","last_undegraded":"2023-10-06T02:53:16.963196+0000","last_fullsized":"2023-10-06T02:53:16.963196+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:41.426949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966782+0000","last_change":"2023-10-06T02:53:16.966720+0000","last_active":"2023-10-06T02:53:16.966782+0000","last_peered":"2023-10-06T02:53:16.966782+0000","last_clean":"2023-10-06T02:53:16.966782+0000","last_became_active":"2023-10-06T02:53:16.966199+0000","last_became_peered":"2023-10-06T02:53:16.966199+0000","last_unstale":"2023-10-06T02:53:16.966782+0000","last_undegraded":"2023-10-06T02:53:16.966782+0000","last_fullsized":"2023-10-06T02:53:16.966782+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965787+0000","last_change":"2023-10-06T02:53:16.965661+0000","last_active":"2023-10-06T02:53:16.965787+0000","last_peered":"2023-10-06T02:53:16.965787+0000","last_clean":"2023-10-06T02:53:16.965787+0000","last_became_active":"2023-10-06T02:53:16.965228+0000","last_became_peered":"2023-10-06T02:53:16.965228+0000","last_unstale":"2023-10-06T02:53:16.965787+0000","last_undegraded":"2023-10-06T02:53:16.965787+0000","last_fullsized":"2023-10-06T02:53:16.965787+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963965+0000","last_change":"2023-10-06T02:53:16.963678+0000","last_active":"2023-10-06T02:53:16.963965+0000","last_peered":"2023-10-06T02:53:16.963965+0000","last_clean":"2023-10-06T02:53:16.963965+0000","last_became_active":"2023-10-06T02:53:16.963392+0000","last_became_peered":"2023-10-06T02:53:16.963392+0000","last_unstale":"2023-10-06T02:53:16.963965+0000","last_undegraded":"2023-10-06T02:53:16.963965+0000","last_fullsized":"2023-10-06T02:53:16.963965+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:32.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972994+0000","last_change":"2023-10-06T02:53:16.972929+0000","last_active":"2023-10-06T02:53:16.972994+0000","last_peered":"2023-10-06T02:53:16.972994+0000","last_clean":"2023-10-06T02:53:16.972994+0000","last_became_active":"2023-10-06T02:53:16.972683+0000","last_became_peered":"2023-10-06T02:53:16.972683+0000","last_unstale":"2023-10-06T02:53:16.972994+0000","last_undegraded":"2023-10-06T02:53:16.972994+0000","last_fullsized":"2023-10-06T02:53:16.972994+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"150'4","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.977836+0000","last_change":"2023-10-06T02:53:15.952620+0000","last_active":"2023-10-06T02:53:16.977836+0000","last_peered":"2023-10-06T02:53:16.977836+0000","last_clean":"2023-10-06T02:53:16.977836+0000","last_became_active":"2023-10-06T02:53:15.952241+0000","last_became_peered":"2023-10-06T02:53:15.952241+0000","last_unstale":"2023-10-06T02:53:16.977836+0000","last_undegraded":"2023-10-06T02:53:16.977836+0000","last_fullsized":"2023-10-06T02:53:16.977836+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:21.071442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958609+0000","last_change":"2023-10-06T02:53:16.958551+0000","last_active":"2023-10-06T02:53:16.958609+0000","last_peered":"2023-10-06T02:53:16.958609+0000","last_clean":"2023-10-06T02:53:16.958609+0000","last_became_active":"2023-10-06T02:53:16.958327+0000","last_became_peered":"2023-10-06T02:53:16.958327+0000","last_unstale":"2023-10-06T02:53:16.958609+0000","last_undegraded":"2023-10-06T02:53:16.958609+0000","last_fullsized":"2023-10-06T02:53:16.958609+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:14.993106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.970305+0000","last_change":"2023-10-06T02:53:15.950606+0000","last_active":"2023-10-06T02:53:16.970305+0000","last_peered":"2023-10-06T02:53:16.970305+0000","last_clean":"2023-10-06T02:53:16.970305+0000","last_became_active":"2023-10-06T02:53:15.950220+0000","last_became_peered":"2023-10-06T02:53:15.950220+0000","last_unstale":"2023-10-06T02:53:16.970305+0000","last_undegraded":"2023-10-06T02:53:16.970305+0000","last_fullsized":"2023-10-06T02:53:16.970305+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967841+0000","last_change":"2023-10-06T02:53:16.967246+0000","last_active":"2023-10-06T02:53:16.967841+0000","last_peered":"2023-10-06T02:53:16.967841+0000","last_clean":"2023-10-06T02:53:16.967841+0000","last_became_active":"2023-10-06T02:53:16.966700+0000","last_became_peered":"2023-10-06T02:53:16.966700+0000","last_unstale":"2023-10-06T02:53:16.967841+0000","last_undegraded":"2023-10-06T02:53:16.967841+0000","last_fullsized":"2023-10-06T02:53:16.967841+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972919+0000","last_change":"2023-10-06T02:53:15.955289+0000","last_active":"2023-10-06T02:53:16.972919+0000","last_peered":"2023-10-06T02:53:16.972919+0000","last_clean":"2023-10-06T02:53:16.972919+0000","last_became_active":"2023-10-06T02:53:15.954958+0000","last_became_peered":"2023-10-06T02:53:15.954958+0000","last_unstale":"2023-10-06T02:53:16.972919+0000","last_undegraded":"2023-10-06T02:53:16.972919+0000","last_fullsized":"2023-10-06T02:53:16.972919+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969429+0000","last_change":"2023-10-06T02:53:16.969370+0000","last_active":"2023-10-06T02:53:16.969429+0000","last_peered":"2023-10-06T02:53:16.969429+0000","last_clean":"2023-10-06T02:53:16.969429+0000","last_became_active":"2023-10-06T02:53:16.969142+0000","last_became_peered":"2023-10-06T02:53:16.969142+0000","last_unstale":"2023-10-06T02:53:16.969429+0000","last_undegraded":"2023-10-06T02:53:16.969429+0000","last_fullsized":"2023-10-06T02:53:16.969429+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:09.738869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.973929+0000","last_change":"2023-10-06T02:53:15.953447+0000","last_active":"2023-10-06T02:53:16.973929+0000","last_peered":"2023-10-06T02:53:16.973929+0000","last_clean":"2023-10-06T02:53:16.973929+0000","last_became_active":"2023-10-06T02:53:15.952891+0000","last_became_peered":"2023-10-06T02:53:15.952891+0000","last_unstale":"2023-10-06T02:53:16.973929+0000","last_undegraded":"2023-10-06T02:53:16.973929+0000","last_fullsized":"2023-10-06T02:53:16.973929+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965769+0000","last_change":"2023-10-06T02:53:16.965476+0000","last_active":"2023-10-06T02:53:16.965769+0000","last_peered":"2023-10-06T02:53:16.965769+0000","last_clean":"2023-10-06T02:53:16.965769+0000","last_became_active":"2023-10-06T02:53:16.964920+0000","last_became_peered":"2023-10-06T02:53:16.964920+0000","last_unstale":"2023-10-06T02:53:16.965769+0000","last_undegraded":"2023-10-06T02:53:16.965769+0000","last_fullsized":"2023-10-06T02:53:16.965769+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.973144+0000","last_change":"2023-10-06T02:53:15.950593+0000","last_active":"2023-10-06T02:53:16.973144+0000","last_peered":"2023-10-06T02:53:16.973144+0000","last_clean":"2023-10-06T02:53:16.973144+0000","last_became_active":"2023-10-06T02:53:15.950349+0000","last_became_peered":"2023-10-06T02:53:15.950349+0000","last_unstale":"2023-10-06T02:53:16.973144+0000","last_undegraded":"2023-10-06T02:53:16.973144+0000","last_fullsized":"2023-10-06T02:53:16.973144+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967229+0000","last_change":"2023-10-06T02:53:16.967101+0000","last_active":"2023-10-06T02:53:16.967229+0000","last_peered":"2023-10-06T02:53:16.967229+0000","last_clean":"2023-10-06T02:53:16.967229+0000","last_became_active":"2023-10-06T02:53:16.966822+0000","last_became_peered":"2023-10-06T02:53:16.966822+0000","last_unstale":"2023-10-06T02:53:16.967229+0000","last_undegraded":"2023-10-06T02:53:16.967229+0000","last_fullsized":"2023-10-06T02:53:16.967229+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972256+0000","last_change":"2023-10-06T02:53:15.950422+0000","last_active":"2023-10-06T02:53:16.972256+0000","last_peered":"2023-10-06T02:53:16.972256+0000","last_clean":"2023-10-06T02:53:16.972256+0000","last_became_active":"2023-10-06T02:53:15.950180+0000","last_became_peered":"2023-10-06T02:53:15.950180+0000","last_unstale":"2023-10-06T02:53:16.972256+0000","last_undegraded":"2023-10-06T02:53:16.972256+0000","last_fullsized":"2023-10-06T02:53:16.972256+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964854+0000","last_change":"2023-10-06T02:53:16.964266+0000","last_active":"2023-10-06T02:53:16.964854+0000","last_peered":"2023-10-06T02:53:16.964854+0000","last_clean":"2023-10-06T02:53:16.964854+0000","last_became_active":"2023-10-06T02:53:16.963911+0000","last_became_peered":"2023-10-06T02:53:16.963911+0000","last_unstale":"2023-10-06T02:53:16.964854+0000","last_undegraded":"2023-10-06T02:53:16.964854+0000","last_fullsized":"2023-10-06T02:53:16.964854+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:12.395339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958446+0000","last_change":"2023-10-06T02:53:15.949331+0000","last_active":"2023-10-06T02:53:16.958446+0000","last_peered":"2023-10-06T02:53:16.958446+0000","last_clean":"2023-10-06T02:53:16.958446+0000","last_became_active":"2023-10-06T02:53:15.949073+0000","last_became_peered":"2023-10-06T02:53:15.949073+0000","last_unstale":"2023-10-06T02:53:16.958446+0000","last_undegraded":"2023-10-06T02:53:16.958446+0000","last_fullsized":"2023-10-06T02:53:16.958446+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:10.217520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969925+0000","last_change":"2023-10-06T02:53:16.969024+0000","last_active":"2023-10-06T02:53:16.969925+0000","last_peered":"2023-10-06T02:53:16.969925+0000","last_clean":"2023-10-06T02:53:16.969925+0000","last_became_active":"2023-10-06T02:53:16.968755+0000","last_became_peered":"2023-10-06T02:53:16.968755+0000","last_unstale":"2023-10-06T02:53:16.969925+0000","last_undegraded":"2023-10-06T02:53:16.969925+0000","last_fullsized":"2023-10-06T02:53:16.969925+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:04.547121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960775+0000","last_change":"2023-10-06T02:53:15.948938+0000","last_active":"2023-10-06T02:53:16.960775+0000","last_peered":"2023-10-06T02:53:16.960775+0000","last_clean":"2023-10-06T02:53:16.960775+0000","last_became_active":"2023-10-06T02:53:15.947646+0000","last_became_peered":"2023-10-06T02:53:15.947646+0000","last_unstale":"2023-10-06T02:53:16.960775+0000","last_undegraded":"2023-10-06T02:53:16.960775+0000","last_fullsized":"2023-10-06T02:53:16.960775+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:51.518352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962242+0000","last_change":"2023-10-06T02:53:16.962119+0000","last_active":"2023-10-06T02:53:16.962242+0000","last_peered":"2023-10-06T02:53:16.962242+0000","last_clean":"2023-10-06T02:53:16.962242+0000","last_became_active":"2023-10-06T02:53:16.961857+0000","last_became_peered":"2023-10-06T02:53:16.961857+0000","last_unstale":"2023-10-06T02:53:16.962242+0000","last_undegraded":"2023-10-06T02:53:16.962242+0000","last_fullsized":"2023-10-06T02:53:16.962242+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:16.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969878+0000","last_change":"2023-10-06T02:53:15.950371+0000","last_active":"2023-10-06T02:53:16.969878+0000","last_peered":"2023-10-06T02:53:16.969878+0000","last_clean":"2023-10-06T02:53:16.969878+0000","last_became_active":"2023-10-06T02:53:15.950141+0000","last_became_peered":"2023-10-06T02:53:15.950141+0000","last_unstale":"2023-10-06T02:53:16.969878+0000","last_undegraded":"2023-10-06T02:53:16.969878+0000","last_fullsized":"2023-10-06T02:53:16.969878+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.970604+0000","last_change":"2023-10-06T02:53:16.970531+0000","last_active":"2023-10-06T02:53:16.970604+0000","last_peered":"2023-10-06T02:53:16.970604+0000","last_clean":"2023-10-06T02:53:16.970604+0000","last_became_active":"2023-10-06T02:53:16.970120+0000","last_became_peered":"2023-10-06T02:53:16.970120+0000","last_unstale":"2023-10-06T02:53:16.970604+0000","last_undegraded":"2023-10-06T02:53:16.970604+0000","last_fullsized":"2023-10-06T02:53:16.970604+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:10.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976947+0000","last_change":"2023-10-06T02:53:15.949084+0000","last_active":"2023-10-06T02:53:16.976947+0000","last_peered":"2023-10-06T02:53:16.976947+0000","last_clean":"2023-10-06T02:53:16.976947+0000","last_became_active":"2023-10-06T02:53:15.947986+0000","last_became_peered":"2023-10-06T02:53:15.947986+0000","last_unstale":"2023-10-06T02:53:16.976947+0000","last_undegraded":"2023-10-06T02:53:16.976947+0000","last_fullsized":"2023-10-06T02:53:16.976947+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:49.756550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969869+0000","last_change":"2023-10-06T02:53:16.967480+0000","last_active":"2023-10-06T02:53:16.969869+0000","last_peered":"2023-10-06T02:53:16.969869+0000","last_clean":"2023-10-06T02:53:16.969869+0000","last_became_active":"2023-10-06T02:53:16.966567+0000","last_became_peered":"2023-10-06T02:53:16.966567+0000","last_unstale":"2023-10-06T02:53:16.969869+0000","last_undegraded":"2023-10-06T02:53:16.969869+0000","last_fullsized":"2023-10-06T02:53:16.969869+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:08.537334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.971093+0000","last_change":"2023-10-06T02:53:15.947587+0000","last_active":"2023-10-06T02:53:16.971093+0000","last_peered":"2023-10-06T02:53:16.971093+0000","last_clean":"2023-10-06T02:53:16.971093+0000","last_became_active":"2023-10-06T02:53:15.947298+0000","last_became_peered":"2023-10-06T02:53:15.947298+0000","last_unstale":"2023-10-06T02:53:16.971093+0000","last_undegraded":"2023-10-06T02:53:16.971093+0000","last_fullsized":"2023-10-06T02:53:16.971093+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968149+0000","last_change":"2023-10-06T02:53:16.968021+0000","last_active":"2023-10-06T02:53:16.968149+0000","last_peered":"2023-10-06T02:53:16.968149+0000","last_clean":"2023-10-06T02:53:16.968149+0000","last_became_active":"2023-10-06T02:53:16.967741+0000","last_became_peered":"2023-10-06T02:53:16.967741+0000","last_unstale":"2023-10-06T02:53:16.968149+0000","last_undegraded":"2023-10-06T02:53:16.968149+0000","last_fullsized":"2023-10-06T02:53:16.968149+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:59.865832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.957202+0000","last_change":"2023-10-06T02:53:15.942574+0000","last_active":"2023-10-06T02:53:16.957202+0000","last_peered":"2023-10-06T02:53:16.957202+0000","last_clean":"2023-10-06T02:53:16.957202+0000","last_became_active":"2023-10-06T02:53:15.942392+0000","last_became_peered":"2023-10-06T02:53:15.942392+0000","last_unstale":"2023-10-06T02:53:16.957202+0000","last_undegraded":"2023-10-06T02:53:16.957202+0000","last_fullsized":"2023-10-06T02:53:16.957202+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962601+0000","last_change":"2023-10-06T02:53:16.962545+0000","last_active":"2023-10-06T02:53:16.962601+0000","last_peered":"2023-10-06T02:53:16.962601+0000","last_clean":"2023-10-06T02:53:16.962601+0000","last_became_active":"2023-10-06T02:53:16.961760+0000","last_became_peered":"2023-10-06T02:53:16.961760+0000","last_unstale":"2023-10-06T02:53:16.962601+0000","last_undegraded":"2023-10-06T02:53:16.962601+0000","last_fullsized":"2023-10-06T02:53:16.962601+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:46.513629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.977129+0000","last_change":"2023-10-06T02:53:15.950485+0000","last_active":"2023-10-06T02:53:16.977129+0000","last_peered":"2023-10-06T02:53:16.977129+0000","last_clean":"2023-10-06T02:53:16.977129+0000","last_became_active":"2023-10-06T02:53:15.949974+0000","last_became_peered":"2023-10-06T02:53:15.949974+0000","last_unstale":"2023-10-06T02:53:16.977129+0000","last_undegraded":"2023-10-06T02:53:16.977129+0000","last_fullsized":"2023-10-06T02:53:16.977129+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:30.739583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972565+0000","last_change":"2023-10-06T02:53:16.972515+0000","last_active":"2023-10-06T02:53:16.972565+0000","last_peered":"2023-10-06T02:53:16.972565+0000","last_clean":"2023-10-06T02:53:16.972565+0000","last_became_active":"2023-10-06T02:53:16.972336+0000","last_became_peered":"2023-10-06T02:53:16.972336+0000","last_unstale":"2023-10-06T02:53:16.972565+0000","last_undegraded":"2023-10-06T02:53:16.972565+0000","last_fullsized":"2023-10-06T02:53:16.972565+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:19.731691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.954937+0000","last_change":"2023-10-06T02:53:15.951410+0000","last_active":"2023-10-06T02:53:16.954937+0000","last_peered":"2023-10-06T02:53:16.954937+0000","last_clean":"2023-10-06T02:53:16.954937+0000","last_became_active":"2023-10-06T02:53:15.950897+0000","last_became_peered":"2023-10-06T02:53:15.950897+0000","last_unstale":"2023-10-06T02:53:16.954937+0000","last_undegraded":"2023-10-06T02:53:16.954937+0000","last_fullsized":"2023-10-06T02:53:16.954937+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:35.524955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969475+0000","last_change":"2023-10-06T02:53:16.969425+0000","last_active":"2023-10-06T02:53:16.969475+0000","last_peered":"2023-10-06T02:53:16.969475+0000","last_clean":"2023-10-06T02:53:16.969475+0000","last_became_active":"2023-10-06T02:53:16.969225+0000","last_became_peered":"2023-10-06T02:53:16.969225+0000","last_unstale":"2023-10-06T02:53:16.969475+0000","last_undegraded":"2023-10-06T02:53:16.969475+0000","last_fullsized":"2023-10-06T02:53:16.969475+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:41.007295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960075+0000","last_change":"2023-10-06T02:53:15.953249+0000","last_active":"2023-10-06T02:53:16.960075+0000","last_peered":"2023-10-06T02:53:16.960075+0000","last_clean":"2023-10-06T02:53:16.960075+0000","last_became_active":"2023-10-06T02:53:15.953058+0000","last_became_peered":"2023-10-06T02:53:15.953058+0000","last_unstale":"2023-10-06T02:53:16.960075+0000","last_undegraded":"2023-10-06T02:53:16.960075+0000","last_fullsized":"2023-10-06T02:53:16.960075+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.970099+0000","last_change":"2023-10-06T02:53:16.970013+0000","last_active":"2023-10-06T02:53:16.970099+0000","last_peered":"2023-10-06T02:53:16.970099+0000","last_clean":"2023-10-06T02:53:16.970099+0000","last_became_active":"2023-10-06T02:53:16.969600+0000","last_became_peered":"2023-10-06T02:53:16.969600+0000","last_unstale":"2023-10-06T02:53:16.970099+0000","last_undegraded":"2023-10-06T02:53:16.970099+0000","last_fullsized":"2023-10-06T02:53:16.970099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960727+0000","last_change":"2023-10-06T02:53:15.949459+0000","last_active":"2023-10-06T02:53:16.960727+0000","last_peered":"2023-10-06T02:53:16.960727+0000","last_clean":"2023-10-06T02:53:16.960727+0000","last_became_active":"2023-10-06T02:53:15.949233+0000","last_became_peered":"2023-10-06T02:53:15.949233+0000","last_unstale":"2023-10-06T02:53:16.960727+0000","last_undegraded":"2023-10-06T02:53:16.960727+0000","last_fullsized":"2023-10-06T02:53:16.960727+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:32.966190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964209+0000","last_change":"2023-10-06T02:53:16.964131+0000","last_active":"2023-10-06T02:53:16.964209+0000","last_peered":"2023-10-06T02:53:16.964209+0000","last_clean":"2023-10-06T02:53:16.964209+0000","last_became_active":"2023-10-06T02:53:16.962427+0000","last_became_peered":"2023-10-06T02:53:16.962427+0000","last_unstale":"2023-10-06T02:53:16.964209+0000","last_undegraded":"2023-10-06T02:53:16.964209+0000","last_fullsized":"2023-10-06T02:53:16.964209+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:05.498811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.971456+0000","last_change":"2023-10-06T02:53:15.953568+0000","last_active":"2023-10-06T02:53:16.971456+0000","last_peered":"2023-10-06T02:53:16.971456+0000","last_clean":"2023-10-06T02:53:16.971456+0000","last_became_active":"2023-10-06T02:53:15.952663+0000","last_became_peered":"2023-10-06T02:53:15.952663+0000","last_unstale":"2023-10-06T02:53:16.971456+0000","last_undegraded":"2023-10-06T02:53:16.971456+0000","last_fullsized":"2023-10-06T02:53:16.971456+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:42.266244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968464+0000","last_change":"2023-10-06T02:53:16.967928+0000","last_active":"2023-10-06T02:53:16.968464+0000","last_peered":"2023-10-06T02:53:16.968464+0000","last_clean":"2023-10-06T02:53:16.968464+0000","last_became_active":"2023-10-06T02:53:16.967705+0000","last_became_peered":"2023-10-06T02:53:16.967705+0000","last_unstale":"2023-10-06T02:53:16.968464+0000","last_undegraded":"2023-10-06T02:53:16.968464+0000","last_fullsized":"2023-10-06T02:53:16.968464+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:51.895407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:53:18.049378+0000","last_change":"2023-10-06T02:53:15.951083+0000","last_active":"2023-10-06T02:53:18.049378+0000","last_peered":"2023-10-06T02:53:18.049378+0000","last_clean":"2023-10-06T02:53:18.049378+0000","last_became_active":"2023-10-06T02:53:15.950728+0000","last_became_peered":"2023-10-06T02:53:15.950728+0000","last_unstale":"2023-10-06T02:53:18.049378+0000","last_undegraded":"2023-10-06T02:53:18.049378+0000","last_fullsized":"2023-10-06T02:53:18.049378+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.974842+0000","last_change":"2023-10-06T02:53:16.974765+0000","last_active":"2023-10-06T02:53:16.974842+0000","last_peered":"2023-10-06T02:53:16.974842+0000","last_clean":"2023-10-06T02:53:16.974842+0000","last_became_active":"2023-10-06T02:53:16.974120+0000","last_became_peered":"2023-10-06T02:53:16.974120+0000","last_unstale":"2023-10-06T02:53:16.974842+0000","last_undegraded":"2023-10-06T02:53:16.974842+0000","last_fullsized":"2023-10-06T02:53:16.974842+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:41.518762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960569+0000","last_change":"2023-10-06T02:53:15.951578+0000","last_active":"2023-10-06T02:53:16.960569+0000","last_peered":"2023-10-06T02:53:16.960569+0000","last_clean":"2023-10-06T02:53:16.960569+0000","last_became_active":"2023-10-06T02:53:15.951350+0000","last_became_peered":"2023-10-06T02:53:15.951350+0000","last_unstale":"2023-10-06T02:53:16.960569+0000","last_undegraded":"2023-10-06T02:53:16.960569+0000","last_fullsized":"2023-10-06T02:53:16.960569+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:15.781730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966124+0000","last_change":"2023-10-06T02:53:16.966089+0000","last_active":"2023-10-06T02:53:16.966124+0000","last_peered":"2023-10-06T02:53:16.966124+0000","last_clean":"2023-10-06T02:53:16.966124+0000","last_became_active":"2023-10-06T02:53:16.965908+0000","last_became_peered":"2023-10-06T02:53:16.965908+0000","last_unstale":"2023-10-06T02:53:16.966124+0000","last_undegraded":"2023-10-06T02:53:16.966124+0000","last_fullsized":"2023-10-06T02:53:16.966124+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:25.447041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960533+0000","last_change":"2023-10-06T02:53:15.951271+0000","last_active":"2023-10-06T02:53:16.960533+0000","last_peered":"2023-10-06T02:53:16.960533+0000","last_clean":"2023-10-06T02:53:16.960533+0000","last_became_active":"2023-10-06T02:53:15.951044+0000","last_became_peered":"2023-10-06T02:53:15.951044+0000","last_unstale":"2023-10-06T02:53:16.960533+0000","last_undegraded":"2023-10-06T02:53:16.960533+0000","last_fullsized":"2023-10-06T02:53:16.960533+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965604+0000","last_change":"2023-10-06T02:53:16.965535+0000","last_active":"2023-10-06T02:53:16.965604+0000","last_peered":"2023-10-06T02:53:16.965604+0000","last_clean":"2023-10-06T02:53:16.965604+0000","last_became_active":"2023-10-06T02:53:16.965277+0000","last_became_peered":"2023-10-06T02:53:16.965277+0000","last_unstale":"2023-10-06T02:53:16.965604+0000","last_undegraded":"2023-10-06T02:53:16.965604+0000","last_fullsized":"2023-10-06T02:53:16.965604+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:40.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956540+0000","last_change":"2023-10-06T02:53:15.954250+0000","last_active":"2023-10-06T02:53:16.956540+0000","last_peered":"2023-10-06T02:53:16.956540+0000","last_clean":"2023-10-06T02:53:16.956540+0000","last_became_active":"2023-10-06T02:53:15.951275+0000","last_became_peered":"2023-10-06T02:53:15.951275+0000","last_unstale":"2023-10-06T02:53:16.956540+0000","last_undegraded":"2023-10-06T02:53:16.956540+0000","last_fullsized":"2023-10-06T02:53:16.956540+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.961320+0000","last_change":"2023-10-06T02:53:16.961253+0000","last_active":"2023-10-06T02:53:16.961320+0000","last_peered":"2023-10-06T02:53:16.961320+0000","last_clean":"2023-10-06T02:53:16.961320+0000","last_became_active":"2023-10-06T02:53:16.960689+0000","last_became_peered":"2023-10-06T02:53:16.960689+0000","last_unstale":"2023-10-06T02:53:16.961320+0000","last_undegraded":"2023-10-06T02:53:16.961320+0000","last_fullsized":"2023-10-06T02:53:16.961320+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:06.183443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962407+0000","last_change":"2023-10-06T02:53:15.955738+0000","last_active":"2023-10-06T02:53:16.962407+0000","last_peered":"2023-10-06T02:53:16.962407+0000","last_clean":"2023-10-06T02:53:16.962407+0000","last_became_active":"2023-10-06T02:53:15.955524+0000","last_became_peered":"2023-10-06T02:53:15.955524+0000","last_unstale":"2023-10-06T02:53:16.962407+0000","last_undegraded":"2023-10-06T02:53:16.962407+0000","last_fullsized":"2023-10-06T02:53:16.962407+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:30.555145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.971213+0000","last_change":"2023-10-06T02:53:16.971168+0000","last_active":"2023-10-06T02:53:16.971213+0000","last_peered":"2023-10-06T02:53:16.971213+0000","last_clean":"2023-10-06T02:53:16.971213+0000","last_became_active":"2023-10-06T02:53:16.970855+0000","last_became_peered":"2023-10-06T02:53:16.970855+0000","last_unstale":"2023-10-06T02:53:16.971213+0000","last_undegraded":"2023-10-06T02:53:16.971213+0000","last_fullsized":"2023-10-06T02:53:16.971213+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:51.951868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960018+0000","last_change":"2023-10-06T02:53:15.951067+0000","last_active":"2023-10-06T02:53:16.960018+0000","last_peered":"2023-10-06T02:53:16.960018+0000","last_clean":"2023-10-06T02:53:16.960018+0000","last_became_active":"2023-10-06T02:53:15.950869+0000","last_became_peered":"2023-10-06T02:53:15.950869+0000","last_unstale":"2023-10-06T02:53:16.960018+0000","last_undegraded":"2023-10-06T02:53:16.960018+0000","last_fullsized":"2023-10-06T02:53:16.960018+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.974823+0000","last_change":"2023-10-06T02:53:16.974624+0000","last_active":"2023-10-06T02:53:16.974823+0000","last_peered":"2023-10-06T02:53:16.974823+0000","last_clean":"2023-10-06T02:53:16.974823+0000","last_became_active":"2023-10-06T02:53:16.973753+0000","last_became_peered":"2023-10-06T02:53:16.973753+0000","last_unstale":"2023-10-06T02:53:16.974823+0000","last_undegraded":"2023-10-06T02:53:16.974823+0000","last_fullsized":"2023-10-06T02:53:16.974823+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:12.395339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956720+0000","last_change":"2023-10-06T02:53:15.948960+0000","last_active":"2023-10-06T02:53:16.956720+0000","last_peered":"2023-10-06T02:53:16.956720+0000","last_clean":"2023-10-06T02:53:16.956720+0000","last_became_active":"2023-10-06T02:53:15.947980+0000","last_became_peered":"2023-10-06T02:53:15.947980+0000","last_unstale":"2023-10-06T02:53:16.956720+0000","last_undegraded":"2023-10-06T02:53:16.956720+0000","last_fullsized":"2023-10-06T02:53:16.956720+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968548+0000","last_change":"2023-10-06T02:53:16.968480+0000","last_active":"2023-10-06T02:53:16.968548+0000","last_peered":"2023-10-06T02:53:16.968548+0000","last_clean":"2023-10-06T02:53:16.968548+0000","last_became_active":"2023-10-06T02:53:16.968166+0000","last_became_peered":"2023-10-06T02:53:16.968166+0000","last_unstale":"2023-10-06T02:53:16.968548+0000","last_undegraded":"2023-10-06T02:53:16.968548+0000","last_fullsized":"2023-10-06T02:53:16.968548+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"150'3","reported_seq":13,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.977388+0000","last_change":"2023-10-06T02:53:15.954832+0000","last_active":"2023-10-06T02:53:16.977388+0000","last_peered":"2023-10-06T02:53:16.977388+0000","last_clean":"2023-10-06T02:53:16.977388+0000","last_became_active":"2023-10-06T02:53:15.954616+0000","last_became_peered":"2023-10-06T02:53:15.954616+0000","last_unstale":"2023-10-06T02:53:16.977388+0000","last_undegraded":"2023-10-06T02:53:16.977388+0000","last_fullsized":"2023-10-06T02:53:16.977388+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960595+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:53:16.960595+0000","last_peered":"2023-10-06T02:53:16.960595+0000","last_clean":"2023-10-06T02:53:16.960595+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:53:16.960595+0000","last_undegraded":"2023-10-06T02:53:16.960595+0000","last_fullsized":"2023-10-06T02:53:16.960595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.959080+0000","last_change":"2023-10-06T02:53:16.959024+0000","last_active":"2023-10-06T02:53:16.959080+0000","last_peered":"2023-10-06T02:53:16.959080+0000","last_clean":"2023-10-06T02:53:16.959080+0000","last_became_active":"2023-10-06T02:53:16.958803+0000","last_became_peered":"2023-10-06T02:53:16.958803+0000","last_unstale":"2023-10-06T02:53:16.959080+0000","last_undegraded":"2023-10-06T02:53:16.959080+0000","last_fullsized":"2023-10-06T02:53:16.959080+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.758775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968509+0000","last_change":"2023-10-06T02:53:15.951215+0000","last_active":"2023-10-06T02:53:16.968509+0000","last_peered":"2023-10-06T02:53:16.968509+0000","last_clean":"2023-10-06T02:53:16.968509+0000","last_became_active":"2023-10-06T02:53:15.951002+0000","last_became_peered":"2023-10-06T02:53:15.951002+0000","last_unstale":"2023-10-06T02:53:16.968509+0000","last_undegraded":"2023-10-06T02:53:16.968509+0000","last_fullsized":"2023-10-06T02:53:16.968509+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:36.226855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956730+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:53:16.956730+0000","last_peered":"2023-10-06T02:53:16.956730+0000","last_clean":"2023-10-06T02:53:16.956730+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:53:16.956730+0000","last_undegraded":"2023-10-06T02:53:16.956730+0000","last_fullsized":"2023-10-06T02:53:16.956730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962731+0000","last_change":"2023-10-06T02:53:16.962591+0000","last_active":"2023-10-06T02:53:16.962731+0000","last_peered":"2023-10-06T02:53:16.962731+0000","last_clean":"2023-10-06T02:53:16.962731+0000","last_became_active":"2023-10-06T02:53:16.962298+0000","last_became_peered":"2023-10-06T02:53:16.962298+0000","last_unstale":"2023-10-06T02:53:16.962731+0000","last_undegraded":"2023-10-06T02:53:16.962731+0000","last_fullsized":"2023-10-06T02:53:16.962731+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:10.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"150'8","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976120+0000","last_change":"2023-10-06T02:53:15.949900+0000","last_active":"2023-10-06T02:53:16.976120+0000","last_peered":"2023-10-06T02:53:16.976120+0000","last_clean":"2023-10-06T02:53:16.976120+0000","last_became_active":"2023-10-06T02:53:15.949704+0000","last_became_peered":"2023-10-06T02:53:15.949704+0000","last_unstale":"2023-10-06T02:53:16.976120+0000","last_undegraded":"2023-10-06T02:53:16.976120+0000","last_fullsized":"2023-10-06T02:53:16.976120+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:51.904359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":127,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.954647+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:53:16.954647+0000","last_peered":"2023-10-06T02:53:16.954647+0000","last_clean":"2023-10-06T02:53:16.954647+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:53:16.954647+0000","last_undegraded":"2023-10-06T02:53:16.954647+0000","last_fullsized":"2023-10-06T02:53:16.954647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968487+0000","last_change":"2023-10-06T02:53:16.968431+0000","last_active":"2023-10-06T02:53:16.968487+0000","last_peered":"2023-10-06T02:53:16.968487+0000","last_clean":"2023-10-06T02:53:16.968487+0000","last_became_active":"2023-10-06T02:53:16.968164+0000","last_became_peered":"2023-10-06T02:53:16.968164+0000","last_unstale":"2023-10-06T02:53:16.968487+0000","last_undegraded":"2023-10-06T02:53:16.968487+0000","last_fullsized":"2023-10-06T02:53:16.968487+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:31.560000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967738+0000","last_change":"2023-10-06T02:53:15.953624+0000","last_active":"2023-10-06T02:53:16.967738+0000","last_peered":"2023-10-06T02:53:16.967738+0000","last_clean":"2023-10-06T02:53:16.967738+0000","last_became_active":"2023-10-06T02:53:15.953206+0000","last_became_peered":"2023-10-06T02:53:15.953206+0000","last_unstale":"2023-10-06T02:53:16.967738+0000","last_undegraded":"2023-10-06T02:53:16.967738+0000","last_fullsized":"2023-10-06T02:53:16.967738+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:50.890551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956630+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:53:16.956630+0000","last_peered":"2023-10-06T02:53:16.956630+0000","last_clean":"2023-10-06T02:53:16.956630+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:53:16.956630+0000","last_undegraded":"2023-10-06T02:53:16.956630+0000","last_fullsized":"2023-10-06T02:53:16.956630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960897+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:53:16.960897+0000","last_peered":"2023-10-06T02:53:16.960897+0000","last_clean":"2023-10-06T02:53:16.960897+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:53:16.960897+0000","last_undegraded":"2023-10-06T02:53:16.960897+0000","last_fullsized":"2023-10-06T02:53:16.960897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969949+0000","last_change":"2023-10-06T02:53:16.969608+0000","last_active":"2023-10-06T02:53:16.969949+0000","last_peered":"2023-10-06T02:53:16.969949+0000","last_clean":"2023-10-06T02:53:16.969949+0000","last_became_active":"2023-10-06T02:53:16.969064+0000","last_became_peered":"2023-10-06T02:53:16.969064+0000","last_unstale":"2023-10-06T02:53:16.969949+0000","last_undegraded":"2023-10-06T02:53:16.969949+0000","last_fullsized":"2023-10-06T02:53:16.969949+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:21.663680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958365+0000","last_change":"2023-10-06T02:53:15.950535+0000","last_active":"2023-10-06T02:53:16.958365+0000","last_peered":"2023-10-06T02:53:16.958365+0000","last_clean":"2023-10-06T02:53:16.958365+0000","last_became_active":"2023-10-06T02:53:15.950353+0000","last_became_peered":"2023-10-06T02:53:15.950353+0000","last_unstale":"2023-10-06T02:53:16.958365+0000","last_undegraded":"2023-10-06T02:53:16.958365+0000","last_fullsized":"2023-10-06T02:53:16.958365+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:04.092161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960809+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:53:16.960809+0000","last_peered":"2023-10-06T02:53:16.960809+0000","last_clean":"2023-10-06T02:53:16.960809+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:53:16.960809+0000","last_undegraded":"2023-10-06T02:53:16.960809+0000","last_fullsized":"2023-10-06T02:53:16.960809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964804+0000","last_change":"2023-10-06T02:53:16.963707+0000","last_active":"2023-10-06T02:53:16.964804+0000","last_peered":"2023-10-06T02:53:16.964804+0000","last_clean":"2023-10-06T02:53:16.964804+0000","last_became_active":"2023-10-06T02:53:16.963473+0000","last_became_peered":"2023-10-06T02:53:16.963473+0000","last_unstale":"2023-10-06T02:53:16.964804+0000","last_undegraded":"2023-10-06T02:53:16.964804+0000","last_fullsized":"2023-10-06T02:53:16.964804+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976269+0000","last_change":"2023-10-06T02:53:15.951054+0000","last_active":"2023-10-06T02:53:16.976269+0000","last_peered":"2023-10-06T02:53:16.976269+0000","last_clean":"2023-10-06T02:53:16.976269+0000","last_became_active":"2023-10-06T02:53:15.950811+0000","last_became_peered":"2023-10-06T02:53:15.950811+0000","last_unstale":"2023-10-06T02:53:16.976269+0000","last_undegraded":"2023-10-06T02:53:16.976269+0000","last_fullsized":"2023-10-06T02:53:16.976269+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.961074+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:53:16.961074+0000","last_peered":"2023-10-06T02:53:16.961074+0000","last_clean":"2023-10-06T02:53:16.961074+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:53:16.961074+0000","last_undegraded":"2023-10-06T02:53:16.961074+0000","last_fullsized":"2023-10-06T02:53:16.961074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964822+0000","last_change":"2023-10-06T02:53:16.964708+0000","last_active":"2023-10-06T02:53:16.964822+0000","last_peered":"2023-10-06T02:53:16.964822+0000","last_clean":"2023-10-06T02:53:16.964822+0000","last_became_active":"2023-10-06T02:53:16.964451+0000","last_became_peered":"2023-10-06T02:53:16.964451+0000","last_unstale":"2023-10-06T02:53:16.964822+0000","last_undegraded":"2023-10-06T02:53:16.964822+0000","last_fullsized":"2023-10-06T02:53:16.964822+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.624552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956430+0000","last_change":"2023-10-06T02:53:15.954105+0000","last_active":"2023-10-06T02:53:16.956430+0000","last_peered":"2023-10-06T02:53:16.956430+0000","last_clean":"2023-10-06T02:53:16.956430+0000","last_became_active":"2023-10-06T02:53:15.950962+0000","last_became_peered":"2023-10-06T02:53:15.950962+0000","last_unstale":"2023-10-06T02:53:16.956430+0000","last_undegraded":"2023-10-06T02:53:16.956430+0000","last_fullsized":"2023-10-06T02:53:16.956430+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960090+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:53:16.960090+0000","last_peered":"2023-10-06T02:53:16.960090+0000","last_clean":"2023-10-06T02:53:16.960090+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:53:16.960090+0000","last_undegraded":"2023-10-06T02:53:16.960090+0000","last_fullsized":"2023-10-06T02:53:16.960090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964975+0000","last_change":"2023-10-06T02:53:16.964920+0000","last_active":"2023-10-06T02:53:16.964975+0000","last_peered":"2023-10-06T02:53:16.964975+0000","last_clean":"2023-10-06T02:53:16.964975+0000","last_became_active":"2023-10-06T02:53:16.964701+0000","last_became_peered":"2023-10-06T02:53:16.964701+0000","last_unstale":"2023-10-06T02:53:16.964975+0000","last_undegraded":"2023-10-06T02:53:16.964975+0000","last_fullsized":"2023-10-06T02:53:16.964975+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.955165+0000","last_change":"2023-10-06T02:53:15.953695+0000","last_active":"2023-10-06T02:53:16.955165+0000","last_peered":"2023-10-06T02:53:16.955165+0000","last_clean":"2023-10-06T02:53:16.955165+0000","last_became_active":"2023-10-06T02:53:15.953150+0000","last_became_peered":"2023-10-06T02:53:15.953150+0000","last_unstale":"2023-10-06T02:53:16.955165+0000","last_undegraded":"2023-10-06T02:53:16.955165+0000","last_fullsized":"2023-10-06T02:53:16.955165+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:26.827466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958451+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:53:16.958451+0000","last_peered":"2023-10-06T02:53:16.958451+0000","last_clean":"2023-10-06T02:53:16.958451+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:53:16.958451+0000","last_undegraded":"2023-10-06T02:53:16.958451+0000","last_fullsized":"2023-10-06T02:53:16.958451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1445,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193867,"statfs":{"total":200000000,"available":198520307,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.393},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.53000000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":1.081},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.52900000000000003},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.72399999999999998,"5min":0.79900000000000004,"15min":1.4710000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.622},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.626},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":4.8129999999999997},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.60299999999999998},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.69599999999999995,"5min":0.78600000000000003,"15min":3.4870000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":2.2349999999999999},"last":0.505}]},{"osd":4,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46600000000000003,"15min":0.45900000000000002},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63200000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.497,"15min":0.49099999999999999},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51200000000000001,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":0.879},"last":0.378},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.39300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.432},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.31900000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199111657,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.60299999999999998},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.56100000000000005},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.879},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.90500000000000003},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.81599999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.64700000000000002,"5min":1.042,"15min":1.0580000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54500000000000004,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.29499999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.80100000000000005,"15min":1.163},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47499999999999998,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":1.05},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.501,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.86799999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.53700000000000003,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.754,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54100000000000004,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":1.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76400000000000001,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.39400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112231,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32000000000000001,"15min":0.313},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.44400000000000001,"5min":0.501,"15min":0.501},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.35499999999999998,"15min":0.33300000000000002},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.51000000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.28799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.32300000000000001},"min":{"1min":0.23799999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.48399999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.25},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40400000000000003,"15min":0.38400000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.36399999999999999},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.53800000000000003},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76800000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.91400000000000003,"5min":1.006,"15min":1.006},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.61899999999999999,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.88200000000000001},"last":0.62}]}]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1443,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193869,"statfs":{"total":200000000,"available":198521877,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.34499999999999997},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46500000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.442}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33200000000000002,"15min":0.96699999999999997},"min":{"1min":0.217,"5min":0.216,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.56899999999999995,"15min":22.038},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":1.3779999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.50900000000000001,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":1.0009999999999999},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.253},"max":{"1min":0.60399999999999998,"5min":0.63300000000000001,"15min":21.942},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":1.083},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.32900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":11.122999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":1.1599999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":22.010999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":1.401},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":1.113},"min":{"1min":0.374,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.83599999999999997,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":1.1850000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":21.98},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.425},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.872},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":11.154},"last":0.76900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574939,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199111713,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.183,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.46000000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.186},"max":{"1min":0.501,"5min":0.60199999999999998,"15min":0.60699999999999998},"last":0.27000000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36699999999999999,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48899999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.41299999999999998,"15min":0.38900000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.59299999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.374},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.40400000000000003,"15min":0.39700000000000002},"min":{"1min":0.245,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83599999999999997,"5min":1.056,"15min":1.056},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.312,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55700000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.61699999999999999,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.72099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.59399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86399999999999999,"5min":1.018,"15min":1.2569999999999999},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":1.002,"15min":1.002},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.624,"15min":0.59499999999999997},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76100000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199110695,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32000000000000001,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.372,"15min":0.33400000000000002},"min":{"1min":0.23100000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35599999999999998,"15min":0.33200000000000002},"min":{"1min":0.249,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.48899999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38100000000000001,"15min":0.34999999999999998},"min":{"1min":0.28100000000000003,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.496,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.41499999999999998,"15min":0.374},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":0.44,"5min":3.044,"15min":3.044},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39100000000000001,"15min":0.35099999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73699999999999999,"5min":1.446,"15min":2.2120000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":1.327,"15min":2.25},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.67800000000000005},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80500000000000005,"5min":1.268,"15min":1.268},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76400000000000001,"5min":1.218,"15min":1.218},"last":0.748},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38600000000000001},"max":{"1min":0.83699999999999997,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61099999999999999,"15min":0.90600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":0.79800000000000004,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.495,"15min":0.752},"min":{"1min":0.27200000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.67700000000000005,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.60599999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.221},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52300000000000002,"15min":0.78200000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":5.9329999999999998},"last":0.496},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.74099999999999999},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.65900000000000003,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":5.4390000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.65700000000000003},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66700000000000004,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.622},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69899999999999995,"5min":0.77000000000000002,"15min":3.456},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.27500000000000002,"15min":0.245},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72199999999999998,"5min":0.76400000000000001,"15min":0.78400000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.96599999999999997},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":13.173999999999999},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.64700000000000002,"5min":0.747,"15min":0.79100000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.28799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67600000000000005,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.30399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68899999999999995,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.60599999999999998,"5min":0.747,"15min":0.83799999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.629}]},{"osd":4,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.252},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69799999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.879,"15min":0.879},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72599999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81799999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70499999999999996}]}]}],"pool_statfs":[]}} 2023-10-06T02:53:21.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:53:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.913+0000 7fcf371bc700 1 Processor -- start 2023-10-06T02:53:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.913+0000 7fcf371bc700 1 -- start start 2023-10-06T02:53:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.914+0000 7fcf371bc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcf300cac20 0x7fcf3006e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.914+0000 7fcf371bc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3015a0a0 con 0x7fcf300cb3b0 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.914+0000 7fcf371bc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf300cb950 con 0x7fcf300ca850 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.914+0000 7fcf371bc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf300cbc30 con 0x7fcf300cac20 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.914+0000 7fcf369bb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcf300cb3b0 0x7fcf300ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35858/0 (socket says 172.21.15.81:35858) 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.914+0000 7fcf369bb700 1 -- 172.21.15.81:0/2910777577 learned_addr learned my addr 172.21.15.81:0/2910777577 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.914+0000 7fcf359b9700 1 --2- 172.21.15.81:0/2910777577 >> v2:172.21.15.83:3300/0 conn(0x7fcf300cac20 0x7fcf3006e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf351b8700 1 -- 172.21.15.81:0/2910777577 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436776055 0 0) 0x7fcf3015a0a0 con 0x7fcf300cb3b0 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf351b8700 1 -- 172.21.15.81:0/2910777577 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf1c003570 con 0x7fcf300cb3b0 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf359b9700 1 -- 172.21.15.81:0/2910777577 >> v1:172.21.15.83:6789/0 conn(0x7fcf300ca850 legacy=0x7fcf3015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf359b9700 1 -- 172.21.15.81:0/2910777577 >> v1:172.21.15.81:6789/0 conn(0x7fcf300cb3b0 legacy=0x7fcf300ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf351b8700 1 -- 172.21.15.81:0/2910777577 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1587461952 0 0) 0x7fcf1c003570 con 0x7fcf300cb3b0 2023-10-06T02:53:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf359b9700 1 -- 172.21.15.81:0/2910777577 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf300cbf10 con 0x7fcf300cac20 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf359b9700 1 --2- 172.21.15.81:0/2910777577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf300cac20 0x7fcf3006e300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098e0 tx=0x7fcf200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7d6181eb23d9fb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf351b8700 1 -- 172.21.15.81:0/2910777577 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0017f0 con 0x7fcf300cac20 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf351b8700 1 -- 172.21.15.81:0/2910777577 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20011420 con 0x7fcf300cac20 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.915+0000 7fcf351b8700 1 -- 172.21.15.81:0/2910777577 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf200117a0 con 0x7fcf300cac20 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.916+0000 7fcf371bc700 1 -- 172.21.15.81:0/2910777577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf300cac20 msgr2=0x7fcf3006e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.916+0000 7fcf371bc700 1 --2- 172.21.15.81:0/2910777577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf300cac20 0x7fcf3006e300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098e0 tx=0x7fcf200091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.916+0000 7fcf371bc700 1 -- 172.21.15.81:0/2910777577 shutdown_connections 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.916+0000 7fcf371bc700 1 --2- 172.21.15.81:0/2910777577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf300cac20 0x7fcf3006e300 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.916+0000 7fcf371bc700 1 -- 172.21.15.81:0/2910777577 >> 172.21.15.81:0/2910777577 conn(0x7fcf3006b570 msgr2=0x7fcf30067640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.916+0000 7fcf371bc700 1 -- 172.21.15.81:0/2910777577 shutdown_connections 2023-10-06T02:53:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.916+0000 7fcf371bc700 1 -- 172.21.15.81:0/2910777577 wait complete. 2023-10-06T02:53:21.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.917+0000 7fcf371bc700 1 Processor -- start 2023-10-06T02:53:21.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.917+0000 7fcf371bc700 1 -- start start 2023-10-06T02:53:21.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf371bc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf300ca850 0x7fcf300c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf371bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf300cac20 0x7fcf3014b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf371bc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf300cb3b0 0x7fcf3015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf371bc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300c5b20 con 0x7fcf300cac20 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf371bc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3015ddc0 con 0x7fcf300cb3b0 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf371bc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300c5dc0 con 0x7fcf300ca850 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf359b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf300cac20 0x7fcf3014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf359b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf300cac20 0x7fcf3014b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49214/0 (socket says 172.21.15.81:49214) 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf359b9700 1 -- 172.21.15.81:0/1899968665 learned_addr learned my addr 172.21.15.81:0/1899968665 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf369bb700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf300cb3b0 0x7fcf3015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf359b9700 1 -- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf300ca850 msgr2=0x7fcf300c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf361ba700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf300ca850 0x7fcf300c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf359b9700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf300ca850 0x7fcf300c65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf359b9700 1 -- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf300cb3b0 msgr2=0x7fcf3015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf359b9700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf300cb3b0 0x7fcf3015d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf359b9700 1 -- 172.21.15.81:0/1899968665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20009420 con 0x7fcf300cac20 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf359b9700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf300cac20 0x7fcf3014b390 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fcf30063860 tx=0x7fcf20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf267fc700 1 -- 172.21.15.81:0/1899968665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2001cce0 con 0x7fcf300cac20 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf267fc700 1 -- 172.21.15.81:0/1899968665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2001ce40 con 0x7fcf300cac20 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf267fc700 1 -- 172.21.15.81:0/1899968665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2001a6a0 con 0x7fcf300cac20 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.918+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf300c60a0 con 0x7fcf300cac20 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.919+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3014b8d0 con 0x7fcf300cac20 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.919+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf300c62b0 con 0x7fcf300cac20 2023-10-06T02:53:21.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.920+0000 7fcf267fc700 1 -- 172.21.15.81:0/1899968665 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf2001aa90 con 0x7fcf300cac20 2023-10-06T02:53:21.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.920+0000 7fcf267fc700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf14066f30 0x7fcf140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:21.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.920+0000 7fcf267fc700 1 -- 172.21.15.81:0/1899968665 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcf20086010 con 0x7fcf300cac20 2023-10-06T02:53:21.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.920+0000 7fcf361ba700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf14066f30 0x7fcf140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:21.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.921+0000 7fcf361ba700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf14066f30 0x7fcf140693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcf28001800 tx=0x7fcf28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:21.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:21.924+0000 7fcf267fc700 1 -- 172.21.15.81:0/1899968665 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf20053120 con 0x7fcf300cac20 2023-10-06T02:53:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.181+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcf30069a00 con 0x7fcf300cac20 2023-10-06T02:53:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.182+0000 7fcf267fc700 1 -- 172.21.15.81:0/1899968665 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1430 (secure 0 0 0) 0x7fcf20056740 con 0x7fcf300cac20 2023-10-06T02:53:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:22.184 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":452,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":151,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560354,"num_in_osds":8,"osd_in_since":1696560351,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592674,"bytes_used":8286940,"bytes_avail":1591713060,"bytes_total":1600000000,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":75,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":7686}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-10-06T02:53:05.592478+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:53:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.183+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf14066f30 msgr2=0x7fcf140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.183+0000 7fcf371bc700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf14066f30 0x7fcf140693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcf28001800 tx=0x7fcf28009040 comp rx=0 tx=0).stop 2023-10-06T02:53:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf300cac20 msgr2=0x7fcf3014b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf300cac20 0x7fcf3014b390 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fcf30063860 tx=0x7fcf20016000 comp rx=0 tx=0).stop 2023-10-06T02:53:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 shutdown_connections 2023-10-06T02:53:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf14066f30 0x7fcf140693e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf300cb3b0 0x7fcf3015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf300ca850 0x7fcf300c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 --2- 172.21.15.81:0/1899968665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf300cac20 0x7fcf3014b390 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 >> 172.21.15.81:0/1899968665 conn(0x7fcf3006b570 msgr2=0x7fcf30157d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 shutdown_connections 2023-10-06T02:53:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.184+0000 7fcf371bc700 1 -- 172.21.15.81:0/1899968665 wait complete. 2023-10-06T02:53:22.198 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:53:22.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:53:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.310+0000 7f5d4faf3700 1 Processor -- start 2023-10-06T02:53:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.310+0000 7f5d4faf3700 1 -- start start 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.311+0000 7f5d4faf3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d481578d0 0x7f5d480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.311+0000 7f5d4faf3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 0x7f5d4815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.311+0000 7f5d4faf3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d480d07c0 con 0x7f5d4806d120 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.311+0000 7f5d4faf3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d480cfbb0 con 0x7f5d481578d0 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.311+0000 7f5d4faf3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480cfe90 con 0x7f5d48157ca0 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.311+0000 7f5d4d88f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d481578d0 0x7f5d480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.311+0000 7f5d4e090700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5d4806d120 0x7f5d4815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35868/0 (socket says 172.21.15.81:35868) 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.311+0000 7f5d4e090700 1 -- 172.21.15.81:0/3988286560 learned_addr learned my addr 172.21.15.81:0/3988286560 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.311+0000 7f5d4d08e700 1 --2- 172.21.15.81:0/3988286560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 0x7f5d4815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4d88f700 1 -- 172.21.15.81:0/3988286560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 msgr2=0x7f5d4815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4d88f700 1 --2- 172.21.15.81:0/3988286560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 0x7f5d4815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4d88f700 1 -- 172.21.15.81:0/3988286560 >> v1:172.21.15.81:6789/0 conn(0x7f5d4806d120 legacy=0x7f5d4815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4d88f700 1 -- 172.21.15.81:0/3988286560 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d480d0170 con 0x7f5d481578d0 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4c88d700 1 -- 172.21.15.81:0/3988286560 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631281858 0 0) 0x7f5d480d07c0 con 0x7f5d4806d120 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4d88f700 1 --2- 172.21.15.81:0/3988286560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d481578d0 0x7f5d480cf4f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009e60 tx=0x7f5d44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08cc05eef23af48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4c88d700 1 -- 172.21.15.81:0/3988286560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400e070 con 0x7f5d481578d0 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4c88d700 1 -- 172.21.15.81:0/3988286560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400bb60 con 0x7f5d481578d0 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4c88d700 1 -- 172.21.15.81:0/3988286560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44012430 con 0x7f5d481578d0 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4faf3700 1 -- 172.21.15.81:0/3988286560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d481578d0 msgr2=0x7f5d480cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4faf3700 1 --2- 172.21.15.81:0/3988286560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d481578d0 0x7f5d480cf4f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009e60 tx=0x7f5d44009780 comp rx=0 tx=0).stop 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4faf3700 1 -- 172.21.15.81:0/3988286560 shutdown_connections 2023-10-06T02:53:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4faf3700 1 --2- 172.21.15.81:0/3988286560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d481578d0 0x7f5d480cf4f0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4faf3700 1 --2- 172.21.15.81:0/3988286560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d48157ca0 0x7f5d4815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.312+0000 7f5d4faf3700 1 -- 172.21.15.81:0/3988286560 >> 172.21.15.81:0/3988286560 conn(0x7f5d4806bb90 msgr2=0x7f5d4806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.313+0000 7f5d4faf3700 1 -- 172.21.15.81:0/3988286560 shutdown_connections 2023-10-06T02:53:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.313+0000 7f5d4faf3700 1 -- 172.21.15.81:0/3988286560 wait complete. 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4faf3700 1 Processor -- start 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4faf3700 1 -- start start 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4faf3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4806d120 0x7f5d480ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4faf3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d481578d0 0x7f5d480b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4faf3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d480af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4faf3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480b64b0 con 0x7f5d48157ca0 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4faf3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480ab340 con 0x7f5d4806d120 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4faf3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480ab620 con 0x7f5d481578d0 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4e090700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d480af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4e090700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d480af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49226/0 (socket says 172.21.15.81:49226) 2023-10-06T02:53:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4e090700 1 -- 172.21.15.81:0/4097623755 learned_addr learned my addr 172.21.15.81:0/4097623755 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.314+0000 7f5d4d08e700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d481578d0 0x7f5d480b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d4d88f700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4806d120 0x7f5d480ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d4e090700 1 -- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d481578d0 msgr2=0x7f5d480b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d4e090700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d481578d0 0x7f5d480b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d4e090700 1 -- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4806d120 msgr2=0x7f5d480ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d4e090700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4806d120 0x7f5d480ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d4e090700 1 -- 172.21.15.81:0/4097623755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009a20 con 0x7f5d48157ca0 2023-10-06T02:53:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d4e090700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d480af720 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000c7e0 tx=0x7f5d40007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d3dffb700 1 -- 172.21.15.81:0/4097623755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40005c00 con 0x7f5d48157ca0 2023-10-06T02:53:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d3dffb700 1 -- 172.21.15.81:0/4097623755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d40005d80 con 0x7f5d48157ca0 2023-10-06T02:53:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d480ab900 con 0x7f5d48157ca0 2023-10-06T02:53:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d3dffb700 1 -- 172.21.15.81:0/4097623755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40007320 con 0x7f5d48157ca0 2023-10-06T02:53:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.315+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d480abec0 con 0x7f5d48157ca0 2023-10-06T02:53:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.316+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d48067ac0 con 0x7f5d48157ca0 2023-10-06T02:53:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.317+0000 7f5d3dffb700 1 -- 172.21.15.81:0/4097623755 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d4001b3b0 con 0x7f5d48157ca0 2023-10-06T02:53:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.317+0000 7f5d3dffb700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.317+0000 7f5d3dffb700 1 -- 172.21.15.81:0/4097623755 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d40083af0 con 0x7f5d48157ca0 2023-10-06T02:53:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.317+0000 7f5d4d88f700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.318+0000 7f5d4d88f700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5d440097c0 tx=0x7f5d44019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.321+0000 7f5d3dffb700 1 -- 172.21.15.81:0/4097623755 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d40050c00 con 0x7f5d48157ca0 2023-10-06T02:53:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.498+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d480d0450 con 0x7f5d2c066f30 2023-10-06T02:53:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.507+0000 7f5d3dffb700 1 -- 172.21.15.81:0/4097623755 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305862 (secure 0 0 0) 0x7f5d480d0450 con 0x7f5d2c066f30 2023-10-06T02:53:22.513 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 msgr2=0x7f5d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5d440097c0 tx=0x7f5d44019000 comp rx=0 tx=0).stop 2023-10-06T02:53:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 msgr2=0x7f5d480af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d480af720 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000c7e0 tx=0x7f5d40007d90 comp rx=0 tx=0).stop 2023-10-06T02:53:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 shutdown_connections 2023-10-06T02:53:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48157ca0 0x7f5d480af720 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4806d120 0x7f5d480ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 --2- 172.21.15.81:0/4097623755 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d481578d0 0x7f5d480b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 >> 172.21.15.81:0/4097623755 conn(0x7f5d4806bb90 msgr2=0x7f5d4806d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 shutdown_connections 2023-10-06T02:53:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:22.510+0000 7f5d4faf3700 1 -- 172.21.15.81:0/4097623755 wait complete. 2023-10-06T02:53:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:53:22.524 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2023-10-06T02:53:21.595759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8092,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554407,"statfs":{"total":1600000000,"available":1591713060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001313"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964474+0000","last_change":"2023-10-06T02:53:16.964366+0000","last_active":"2023-10-06T02:53:16.964474+0000","last_peered":"2023-10-06T02:53:16.964474+0000","last_clean":"2023-10-06T02:53:16.964474+0000","last_became_active":"2023-10-06T02:53:16.964152+0000","last_became_peered":"2023-10-06T02:53:16.964152+0000","last_unstale":"2023-10-06T02:53:16.964474+0000","last_undegraded":"2023-10-06T02:53:16.964474+0000","last_fullsized":"2023-10-06T02:53:16.964474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:19.267194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963477+0000","last_change":"2023-10-06T02:53:16.963411+0000","last_active":"2023-10-06T02:53:16.963477+0000","last_peered":"2023-10-06T02:53:16.963477+0000","last_clean":"2023-10-06T02:53:16.963477+0000","last_became_active":"2023-10-06T02:53:16.963241+0000","last_became_peered":"2023-10-06T02:53:16.963241+0000","last_unstale":"2023-10-06T02:53:16.963477+0000","last_undegraded":"2023-10-06T02:53:16.963477+0000","last_fullsized":"2023-10-06T02:53:16.963477+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976745+0000","last_change":"2023-10-06T02:53:16.971956+0000","last_active":"2023-10-06T02:53:16.976745+0000","last_peered":"2023-10-06T02:53:16.976745+0000","last_clean":"2023-10-06T02:53:16.976745+0000","last_became_active":"2023-10-06T02:53:16.971529+0000","last_became_peered":"2023-10-06T02:53:16.971529+0000","last_unstale":"2023-10-06T02:53:16.976745+0000","last_undegraded":"2023-10-06T02:53:16.976745+0000","last_fullsized":"2023-10-06T02:53:16.976745+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:40.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964106+0000","last_change":"2023-10-06T02:53:16.964041+0000","last_active":"2023-10-06T02:53:16.964106+0000","last_peered":"2023-10-06T02:53:16.964106+0000","last_clean":"2023-10-06T02:53:16.964106+0000","last_became_active":"2023-10-06T02:53:16.963789+0000","last_became_peered":"2023-10-06T02:53:16.963789+0000","last_unstale":"2023-10-06T02:53:16.964106+0000","last_undegraded":"2023-10-06T02:53:16.964106+0000","last_fullsized":"2023-10-06T02:53:16.964106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965475+0000","last_change":"2023-10-06T02:53:16.965419+0000","last_active":"2023-10-06T02:53:16.965475+0000","last_peered":"2023-10-06T02:53:16.965475+0000","last_clean":"2023-10-06T02:53:16.965475+0000","last_became_active":"2023-10-06T02:53:16.965214+0000","last_became_peered":"2023-10-06T02:53:16.965214+0000","last_unstale":"2023-10-06T02:53:16.965475+0000","last_undegraded":"2023-10-06T02:53:16.965475+0000","last_fullsized":"2023-10-06T02:53:16.965475+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:08.537334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963420+0000","last_change":"2023-10-06T02:53:16.963193+0000","last_active":"2023-10-06T02:53:16.963420+0000","last_peered":"2023-10-06T02:53:16.963420+0000","last_clean":"2023-10-06T02:53:16.963420+0000","last_became_active":"2023-10-06T02:53:16.962989+0000","last_became_peered":"2023-10-06T02:53:16.962989+0000","last_unstale":"2023-10-06T02:53:16.963420+0000","last_undegraded":"2023-10-06T02:53:16.963420+0000","last_fullsized":"2023-10-06T02:53:16.963420+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.974532+0000","last_change":"2023-10-06T02:53:16.974470+0000","last_active":"2023-10-06T02:53:16.974532+0000","last_peered":"2023-10-06T02:53:16.974532+0000","last_clean":"2023-10-06T02:53:16.974532+0000","last_became_active":"2023-10-06T02:53:16.973433+0000","last_became_peered":"2023-10-06T02:53:16.973433+0000","last_unstale":"2023-10-06T02:53:16.974532+0000","last_undegraded":"2023-10-06T02:53:16.974532+0000","last_fullsized":"2023-10-06T02:53:16.974532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:18.791274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969503+0000","last_change":"2023-10-06T02:53:16.968369+0000","last_active":"2023-10-06T02:53:16.969503+0000","last_peered":"2023-10-06T02:53:16.969503+0000","last_clean":"2023-10-06T02:53:16.969503+0000","last_became_active":"2023-10-06T02:53:16.967979+0000","last_became_peered":"2023-10-06T02:53:16.967979+0000","last_unstale":"2023-10-06T02:53:16.969503+0000","last_undegraded":"2023-10-06T02:53:16.969503+0000","last_fullsized":"2023-10-06T02:53:16.969503+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966452+0000","last_change":"2023-10-06T02:53:16.966268+0000","last_active":"2023-10-06T02:53:16.966452+0000","last_peered":"2023-10-06T02:53:16.966452+0000","last_clean":"2023-10-06T02:53:16.966452+0000","last_became_active":"2023-10-06T02:53:16.965789+0000","last_became_peered":"2023-10-06T02:53:16.965789+0000","last_unstale":"2023-10-06T02:53:16.966452+0000","last_undegraded":"2023-10-06T02:53:16.966452+0000","last_fullsized":"2023-10-06T02:53:16.966452+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:46.513629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966548+0000","last_change":"2023-10-06T02:53:16.966490+0000","last_active":"2023-10-06T02:53:16.966548+0000","last_peered":"2023-10-06T02:53:16.966548+0000","last_clean":"2023-10-06T02:53:16.966548+0000","last_became_active":"2023-10-06T02:53:16.966238+0000","last_became_peered":"2023-10-06T02:53:16.966238+0000","last_unstale":"2023-10-06T02:53:16.966548+0000","last_undegraded":"2023-10-06T02:53:16.966548+0000","last_fullsized":"2023-10-06T02:53:16.966548+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:50.567117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968913+0000","last_change":"2023-10-06T02:53:16.968803+0000","last_active":"2023-10-06T02:53:16.968913+0000","last_peered":"2023-10-06T02:53:16.968913+0000","last_clean":"2023-10-06T02:53:16.968913+0000","last_became_active":"2023-10-06T02:53:16.968493+0000","last_became_peered":"2023-10-06T02:53:16.968493+0000","last_unstale":"2023-10-06T02:53:16.968913+0000","last_undegraded":"2023-10-06T02:53:16.968913+0000","last_fullsized":"2023-10-06T02:53:16.968913+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960447+0000","last_change":"2023-10-06T02:53:16.960354+0000","last_active":"2023-10-06T02:53:16.960447+0000","last_peered":"2023-10-06T02:53:16.960447+0000","last_clean":"2023-10-06T02:53:16.960447+0000","last_became_active":"2023-10-06T02:53:16.960134+0000","last_became_peered":"2023-10-06T02:53:16.960134+0000","last_unstale":"2023-10-06T02:53:16.960447+0000","last_undegraded":"2023-10-06T02:53:16.960447+0000","last_fullsized":"2023-10-06T02:53:16.960447+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:47.125694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965409+0000","last_change":"2023-10-06T02:53:16.965340+0000","last_active":"2023-10-06T02:53:16.965409+0000","last_peered":"2023-10-06T02:53:16.965409+0000","last_clean":"2023-10-06T02:53:16.965409+0000","last_became_active":"2023-10-06T02:53:16.965113+0000","last_became_peered":"2023-10-06T02:53:16.965113+0000","last_unstale":"2023-10-06T02:53:16.965409+0000","last_undegraded":"2023-10-06T02:53:16.965409+0000","last_fullsized":"2023-10-06T02:53:16.965409+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:29.709175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962633+0000","last_change":"2023-10-06T02:53:16.962192+0000","last_active":"2023-10-06T02:53:16.962633+0000","last_peered":"2023-10-06T02:53:16.962633+0000","last_clean":"2023-10-06T02:53:16.962633+0000","last_became_active":"2023-10-06T02:53:16.961955+0000","last_became_peered":"2023-10-06T02:53:16.961955+0000","last_unstale":"2023-10-06T02:53:16.962633+0000","last_undegraded":"2023-10-06T02:53:16.962633+0000","last_fullsized":"2023-10-06T02:53:16.962633+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:16.000558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962615+0000","last_change":"2023-10-06T02:53:16.962069+0000","last_active":"2023-10-06T02:53:16.962615+0000","last_peered":"2023-10-06T02:53:16.962615+0000","last_clean":"2023-10-06T02:53:16.962615+0000","last_became_active":"2023-10-06T02:53:16.961852+0000","last_became_peered":"2023-10-06T02:53:16.961852+0000","last_unstale":"2023-10-06T02:53:16.962615+0000","last_undegraded":"2023-10-06T02:53:16.962615+0000","last_fullsized":"2023-10-06T02:53:16.962615+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:30.710968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964962+0000","last_change":"2023-10-06T02:53:16.964622+0000","last_active":"2023-10-06T02:53:16.964962+0000","last_peered":"2023-10-06T02:53:16.964962+0000","last_clean":"2023-10-06T02:53:16.964962+0000","last_became_active":"2023-10-06T02:53:16.964357+0000","last_became_peered":"2023-10-06T02:53:16.964357+0000","last_unstale":"2023-10-06T02:53:16.964962+0000","last_undegraded":"2023-10-06T02:53:16.964962+0000","last_fullsized":"2023-10-06T02:53:16.964962+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964301+0000","last_change":"2023-10-06T02:53:16.964241+0000","last_active":"2023-10-06T02:53:16.964301+0000","last_peered":"2023-10-06T02:53:16.964301+0000","last_clean":"2023-10-06T02:53:16.964301+0000","last_became_active":"2023-10-06T02:53:16.963989+0000","last_became_peered":"2023-10-06T02:53:16.963989+0000","last_unstale":"2023-10-06T02:53:16.964301+0000","last_undegraded":"2023-10-06T02:53:16.964301+0000","last_fullsized":"2023-10-06T02:53:16.964301+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.961844+0000","last_change":"2023-10-06T02:53:16.961787+0000","last_active":"2023-10-06T02:53:16.961844+0000","last_peered":"2023-10-06T02:53:16.961844+0000","last_clean":"2023-10-06T02:53:16.961844+0000","last_became_active":"2023-10-06T02:53:16.961549+0000","last_became_peered":"2023-10-06T02:53:16.961549+0000","last_unstale":"2023-10-06T02:53:16.961844+0000","last_undegraded":"2023-10-06T02:53:16.961844+0000","last_fullsized":"2023-10-06T02:53:16.961844+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:04.547121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969905+0000","last_change":"2023-10-06T02:53:16.967603+0000","last_active":"2023-10-06T02:53:16.969905+0000","last_peered":"2023-10-06T02:53:16.969905+0000","last_clean":"2023-10-06T02:53:16.969905+0000","last_became_active":"2023-10-06T02:53:16.967257+0000","last_became_peered":"2023-10-06T02:53:16.967257+0000","last_unstale":"2023-10-06T02:53:16.969905+0000","last_undegraded":"2023-10-06T02:53:16.969905+0000","last_fullsized":"2023-10-06T02:53:16.969905+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:46.513629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963308+0000","last_change":"2023-10-06T02:53:16.963262+0000","last_active":"2023-10-06T02:53:16.963308+0000","last_peered":"2023-10-06T02:53:16.963308+0000","last_clean":"2023-10-06T02:53:16.963308+0000","last_became_active":"2023-10-06T02:53:16.963045+0000","last_became_peered":"2023-10-06T02:53:16.963045+0000","last_unstale":"2023-10-06T02:53:16.963308+0000","last_undegraded":"2023-10-06T02:53:16.963308+0000","last_fullsized":"2023-10-06T02:53:16.963308+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:41.518762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963023+0000","last_change":"2023-10-06T02:53:16.961784+0000","last_active":"2023-10-06T02:53:16.963023+0000","last_peered":"2023-10-06T02:53:16.963023+0000","last_clean":"2023-10-06T02:53:16.963023+0000","last_became_active":"2023-10-06T02:53:16.961539+0000","last_became_peered":"2023-10-06T02:53:16.961539+0000","last_unstale":"2023-10-06T02:53:16.963023+0000","last_undegraded":"2023-10-06T02:53:16.963023+0000","last_fullsized":"2023-10-06T02:53:16.963023+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.959136+0000","last_change":"2023-10-06T02:53:16.959071+0000","last_active":"2023-10-06T02:53:16.959136+0000","last_peered":"2023-10-06T02:53:16.959136+0000","last_clean":"2023-10-06T02:53:16.959136+0000","last_became_active":"2023-10-06T02:53:16.958842+0000","last_became_peered":"2023-10-06T02:53:16.958842+0000","last_unstale":"2023-10-06T02:53:16.959136+0000","last_undegraded":"2023-10-06T02:53:16.959136+0000","last_fullsized":"2023-10-06T02:53:16.959136+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:22.969575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967859+0000","last_change":"2023-10-06T02:53:16.967393+0000","last_active":"2023-10-06T02:53:16.967859+0000","last_peered":"2023-10-06T02:53:16.967859+0000","last_clean":"2023-10-06T02:53:16.967859+0000","last_became_active":"2023-10-06T02:53:16.966986+0000","last_became_peered":"2023-10-06T02:53:16.966986+0000","last_unstale":"2023-10-06T02:53:16.967859+0000","last_undegraded":"2023-10-06T02:53:16.967859+0000","last_fullsized":"2023-10-06T02:53:16.967859+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966469+0000","last_change":"2023-10-06T02:53:16.966402+0000","last_active":"2023-10-06T02:53:16.966469+0000","last_peered":"2023-10-06T02:53:16.966469+0000","last_clean":"2023-10-06T02:53:16.966469+0000","last_became_active":"2023-10-06T02:53:16.966058+0000","last_became_peered":"2023-10-06T02:53:16.966058+0000","last_unstale":"2023-10-06T02:53:16.966469+0000","last_undegraded":"2023-10-06T02:53:16.966469+0000","last_fullsized":"2023-10-06T02:53:16.966469+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966953+0000","last_change":"2023-10-06T02:53:16.966866+0000","last_active":"2023-10-06T02:53:16.966953+0000","last_peered":"2023-10-06T02:53:16.966953+0000","last_clean":"2023-10-06T02:53:16.966953+0000","last_became_active":"2023-10-06T02:53:16.966496+0000","last_became_peered":"2023-10-06T02:53:16.966496+0000","last_unstale":"2023-10-06T02:53:16.966953+0000","last_undegraded":"2023-10-06T02:53:16.966953+0000","last_fullsized":"2023-10-06T02:53:16.966953+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976990+0000","last_change":"2023-10-06T02:53:16.975642+0000","last_active":"2023-10-06T02:53:16.976990+0000","last_peered":"2023-10-06T02:53:16.976990+0000","last_clean":"2023-10-06T02:53:16.976990+0000","last_became_active":"2023-10-06T02:53:16.973199+0000","last_became_peered":"2023-10-06T02:53:16.973199+0000","last_unstale":"2023-10-06T02:53:16.976990+0000","last_undegraded":"2023-10-06T02:53:16.976990+0000","last_fullsized":"2023-10-06T02:53:16.976990+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969966+0000","last_change":"2023-10-06T02:53:16.969752+0000","last_active":"2023-10-06T02:53:16.969966+0000","last_peered":"2023-10-06T02:53:16.969966+0000","last_clean":"2023-10-06T02:53:16.969966+0000","last_became_active":"2023-10-06T02:53:16.969379+0000","last_became_peered":"2023-10-06T02:53:16.969379+0000","last_unstale":"2023-10-06T02:53:16.969966+0000","last_undegraded":"2023-10-06T02:53:16.969966+0000","last_fullsized":"2023-10-06T02:53:16.969966+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:05.498811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964799+0000","last_change":"2023-10-06T02:53:16.964735+0000","last_active":"2023-10-06T02:53:16.964799+0000","last_peered":"2023-10-06T02:53:16.964799+0000","last_clean":"2023-10-06T02:53:16.964799+0000","last_became_active":"2023-10-06T02:53:16.963476+0000","last_became_peered":"2023-10-06T02:53:16.963476+0000","last_unstale":"2023-10-06T02:53:16.964799+0000","last_undegraded":"2023-10-06T02:53:16.964799+0000","last_fullsized":"2023-10-06T02:53:16.964799+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:53.420838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963196+0000","last_change":"2023-10-06T02:53:16.962948+0000","last_active":"2023-10-06T02:53:16.963196+0000","last_peered":"2023-10-06T02:53:16.963196+0000","last_clean":"2023-10-06T02:53:16.963196+0000","last_became_active":"2023-10-06T02:53:16.962663+0000","last_became_peered":"2023-10-06T02:53:16.962663+0000","last_unstale":"2023-10-06T02:53:16.963196+0000","last_undegraded":"2023-10-06T02:53:16.963196+0000","last_fullsized":"2023-10-06T02:53:16.963196+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:41.426949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966782+0000","last_change":"2023-10-06T02:53:16.966720+0000","last_active":"2023-10-06T02:53:16.966782+0000","last_peered":"2023-10-06T02:53:16.966782+0000","last_clean":"2023-10-06T02:53:16.966782+0000","last_became_active":"2023-10-06T02:53:16.966199+0000","last_became_peered":"2023-10-06T02:53:16.966199+0000","last_unstale":"2023-10-06T02:53:16.966782+0000","last_undegraded":"2023-10-06T02:53:16.966782+0000","last_fullsized":"2023-10-06T02:53:16.966782+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965787+0000","last_change":"2023-10-06T02:53:16.965661+0000","last_active":"2023-10-06T02:53:16.965787+0000","last_peered":"2023-10-06T02:53:16.965787+0000","last_clean":"2023-10-06T02:53:16.965787+0000","last_became_active":"2023-10-06T02:53:16.965228+0000","last_became_peered":"2023-10-06T02:53:16.965228+0000","last_unstale":"2023-10-06T02:53:16.965787+0000","last_undegraded":"2023-10-06T02:53:16.965787+0000","last_fullsized":"2023-10-06T02:53:16.965787+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963965+0000","last_change":"2023-10-06T02:53:16.963678+0000","last_active":"2023-10-06T02:53:16.963965+0000","last_peered":"2023-10-06T02:53:16.963965+0000","last_clean":"2023-10-06T02:53:16.963965+0000","last_became_active":"2023-10-06T02:53:16.963392+0000","last_became_peered":"2023-10-06T02:53:16.963392+0000","last_unstale":"2023-10-06T02:53:16.963965+0000","last_undegraded":"2023-10-06T02:53:16.963965+0000","last_fullsized":"2023-10-06T02:53:16.963965+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:32.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972994+0000","last_change":"2023-10-06T02:53:16.972929+0000","last_active":"2023-10-06T02:53:16.972994+0000","last_peered":"2023-10-06T02:53:16.972994+0000","last_clean":"2023-10-06T02:53:16.972994+0000","last_became_active":"2023-10-06T02:53:16.972683+0000","last_became_peered":"2023-10-06T02:53:16.972683+0000","last_unstale":"2023-10-06T02:53:16.972994+0000","last_undegraded":"2023-10-06T02:53:16.972994+0000","last_fullsized":"2023-10-06T02:53:16.972994+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"150'4","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.977836+0000","last_change":"2023-10-06T02:53:15.952620+0000","last_active":"2023-10-06T02:53:16.977836+0000","last_peered":"2023-10-06T02:53:16.977836+0000","last_clean":"2023-10-06T02:53:16.977836+0000","last_became_active":"2023-10-06T02:53:15.952241+0000","last_became_peered":"2023-10-06T02:53:15.952241+0000","last_unstale":"2023-10-06T02:53:16.977836+0000","last_undegraded":"2023-10-06T02:53:16.977836+0000","last_fullsized":"2023-10-06T02:53:16.977836+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:21.071442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958609+0000","last_change":"2023-10-06T02:53:16.958551+0000","last_active":"2023-10-06T02:53:16.958609+0000","last_peered":"2023-10-06T02:53:16.958609+0000","last_clean":"2023-10-06T02:53:16.958609+0000","last_became_active":"2023-10-06T02:53:16.958327+0000","last_became_peered":"2023-10-06T02:53:16.958327+0000","last_unstale":"2023-10-06T02:53:16.958609+0000","last_undegraded":"2023-10-06T02:53:16.958609+0000","last_fullsized":"2023-10-06T02:53:16.958609+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:14.993106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.970305+0000","last_change":"2023-10-06T02:53:15.950606+0000","last_active":"2023-10-06T02:53:16.970305+0000","last_peered":"2023-10-06T02:53:16.970305+0000","last_clean":"2023-10-06T02:53:16.970305+0000","last_became_active":"2023-10-06T02:53:15.950220+0000","last_became_peered":"2023-10-06T02:53:15.950220+0000","last_unstale":"2023-10-06T02:53:16.970305+0000","last_undegraded":"2023-10-06T02:53:16.970305+0000","last_fullsized":"2023-10-06T02:53:16.970305+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967841+0000","last_change":"2023-10-06T02:53:16.967246+0000","last_active":"2023-10-06T02:53:16.967841+0000","last_peered":"2023-10-06T02:53:16.967841+0000","last_clean":"2023-10-06T02:53:16.967841+0000","last_became_active":"2023-10-06T02:53:16.966700+0000","last_became_peered":"2023-10-06T02:53:16.966700+0000","last_unstale":"2023-10-06T02:53:16.967841+0000","last_undegraded":"2023-10-06T02:53:16.967841+0000","last_fullsized":"2023-10-06T02:53:16.967841+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972919+0000","last_change":"2023-10-06T02:53:15.955289+0000","last_active":"2023-10-06T02:53:16.972919+0000","last_peered":"2023-10-06T02:53:16.972919+0000","last_clean":"2023-10-06T02:53:16.972919+0000","last_became_active":"2023-10-06T02:53:15.954958+0000","last_became_peered":"2023-10-06T02:53:15.954958+0000","last_unstale":"2023-10-06T02:53:16.972919+0000","last_undegraded":"2023-10-06T02:53:16.972919+0000","last_fullsized":"2023-10-06T02:53:16.972919+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969429+0000","last_change":"2023-10-06T02:53:16.969370+0000","last_active":"2023-10-06T02:53:16.969429+0000","last_peered":"2023-10-06T02:53:16.969429+0000","last_clean":"2023-10-06T02:53:16.969429+0000","last_became_active":"2023-10-06T02:53:16.969142+0000","last_became_peered":"2023-10-06T02:53:16.969142+0000","last_unstale":"2023-10-06T02:53:16.969429+0000","last_undegraded":"2023-10-06T02:53:16.969429+0000","last_fullsized":"2023-10-06T02:53:16.969429+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:09.738869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.973929+0000","last_change":"2023-10-06T02:53:15.953447+0000","last_active":"2023-10-06T02:53:16.973929+0000","last_peered":"2023-10-06T02:53:16.973929+0000","last_clean":"2023-10-06T02:53:16.973929+0000","last_became_active":"2023-10-06T02:53:15.952891+0000","last_became_peered":"2023-10-06T02:53:15.952891+0000","last_unstale":"2023-10-06T02:53:16.973929+0000","last_undegraded":"2023-10-06T02:53:16.973929+0000","last_fullsized":"2023-10-06T02:53:16.973929+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965769+0000","last_change":"2023-10-06T02:53:16.965476+0000","last_active":"2023-10-06T02:53:16.965769+0000","last_peered":"2023-10-06T02:53:16.965769+0000","last_clean":"2023-10-06T02:53:16.965769+0000","last_became_active":"2023-10-06T02:53:16.964920+0000","last_became_peered":"2023-10-06T02:53:16.964920+0000","last_unstale":"2023-10-06T02:53:16.965769+0000","last_undegraded":"2023-10-06T02:53:16.965769+0000","last_fullsized":"2023-10-06T02:53:16.965769+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.973144+0000","last_change":"2023-10-06T02:53:15.950593+0000","last_active":"2023-10-06T02:53:16.973144+0000","last_peered":"2023-10-06T02:53:16.973144+0000","last_clean":"2023-10-06T02:53:16.973144+0000","last_became_active":"2023-10-06T02:53:15.950349+0000","last_became_peered":"2023-10-06T02:53:15.950349+0000","last_unstale":"2023-10-06T02:53:16.973144+0000","last_undegraded":"2023-10-06T02:53:16.973144+0000","last_fullsized":"2023-10-06T02:53:16.973144+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967229+0000","last_change":"2023-10-06T02:53:16.967101+0000","last_active":"2023-10-06T02:53:16.967229+0000","last_peered":"2023-10-06T02:53:16.967229+0000","last_clean":"2023-10-06T02:53:16.967229+0000","last_became_active":"2023-10-06T02:53:16.966822+0000","last_became_peered":"2023-10-06T02:53:16.966822+0000","last_unstale":"2023-10-06T02:53:16.967229+0000","last_undegraded":"2023-10-06T02:53:16.967229+0000","last_fullsized":"2023-10-06T02:53:16.967229+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972256+0000","last_change":"2023-10-06T02:53:15.950422+0000","last_active":"2023-10-06T02:53:16.972256+0000","last_peered":"2023-10-06T02:53:16.972256+0000","last_clean":"2023-10-06T02:53:16.972256+0000","last_became_active":"2023-10-06T02:53:15.950180+0000","last_became_peered":"2023-10-06T02:53:15.950180+0000","last_unstale":"2023-10-06T02:53:16.972256+0000","last_undegraded":"2023-10-06T02:53:16.972256+0000","last_fullsized":"2023-10-06T02:53:16.972256+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964854+0000","last_change":"2023-10-06T02:53:16.964266+0000","last_active":"2023-10-06T02:53:16.964854+0000","last_peered":"2023-10-06T02:53:16.964854+0000","last_clean":"2023-10-06T02:53:16.964854+0000","last_became_active":"2023-10-06T02:53:16.963911+0000","last_became_peered":"2023-10-06T02:53:16.963911+0000","last_unstale":"2023-10-06T02:53:16.964854+0000","last_undegraded":"2023-10-06T02:53:16.964854+0000","last_fullsized":"2023-10-06T02:53:16.964854+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:12.395339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958446+0000","last_change":"2023-10-06T02:53:15.949331+0000","last_active":"2023-10-06T02:53:16.958446+0000","last_peered":"2023-10-06T02:53:16.958446+0000","last_clean":"2023-10-06T02:53:16.958446+0000","last_became_active":"2023-10-06T02:53:15.949073+0000","last_became_peered":"2023-10-06T02:53:15.949073+0000","last_unstale":"2023-10-06T02:53:16.958446+0000","last_undegraded":"2023-10-06T02:53:16.958446+0000","last_fullsized":"2023-10-06T02:53:16.958446+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:10.217520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969925+0000","last_change":"2023-10-06T02:53:16.969024+0000","last_active":"2023-10-06T02:53:16.969925+0000","last_peered":"2023-10-06T02:53:16.969925+0000","last_clean":"2023-10-06T02:53:16.969925+0000","last_became_active":"2023-10-06T02:53:16.968755+0000","last_became_peered":"2023-10-06T02:53:16.968755+0000","last_unstale":"2023-10-06T02:53:16.969925+0000","last_undegraded":"2023-10-06T02:53:16.969925+0000","last_fullsized":"2023-10-06T02:53:16.969925+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:04.547121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960775+0000","last_change":"2023-10-06T02:53:15.948938+0000","last_active":"2023-10-06T02:53:16.960775+0000","last_peered":"2023-10-06T02:53:16.960775+0000","last_clean":"2023-10-06T02:53:16.960775+0000","last_became_active":"2023-10-06T02:53:15.947646+0000","last_became_peered":"2023-10-06T02:53:15.947646+0000","last_unstale":"2023-10-06T02:53:16.960775+0000","last_undegraded":"2023-10-06T02:53:16.960775+0000","last_fullsized":"2023-10-06T02:53:16.960775+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:51.518352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962242+0000","last_change":"2023-10-06T02:53:16.962119+0000","last_active":"2023-10-06T02:53:16.962242+0000","last_peered":"2023-10-06T02:53:16.962242+0000","last_clean":"2023-10-06T02:53:16.962242+0000","last_became_active":"2023-10-06T02:53:16.961857+0000","last_became_peered":"2023-10-06T02:53:16.961857+0000","last_unstale":"2023-10-06T02:53:16.962242+0000","last_undegraded":"2023-10-06T02:53:16.962242+0000","last_fullsized":"2023-10-06T02:53:16.962242+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:16.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969878+0000","last_change":"2023-10-06T02:53:15.950371+0000","last_active":"2023-10-06T02:53:16.969878+0000","last_peered":"2023-10-06T02:53:16.969878+0000","last_clean":"2023-10-06T02:53:16.969878+0000","last_became_active":"2023-10-06T02:53:15.950141+0000","last_became_peered":"2023-10-06T02:53:15.950141+0000","last_unstale":"2023-10-06T02:53:16.969878+0000","last_undegraded":"2023-10-06T02:53:16.969878+0000","last_fullsized":"2023-10-06T02:53:16.969878+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.970604+0000","last_change":"2023-10-06T02:53:16.970531+0000","last_active":"2023-10-06T02:53:16.970604+0000","last_peered":"2023-10-06T02:53:16.970604+0000","last_clean":"2023-10-06T02:53:16.970604+0000","last_became_active":"2023-10-06T02:53:16.970120+0000","last_became_peered":"2023-10-06T02:53:16.970120+0000","last_unstale":"2023-10-06T02:53:16.970604+0000","last_undegraded":"2023-10-06T02:53:16.970604+0000","last_fullsized":"2023-10-06T02:53:16.970604+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:10.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976947+0000","last_change":"2023-10-06T02:53:15.949084+0000","last_active":"2023-10-06T02:53:16.976947+0000","last_peered":"2023-10-06T02:53:16.976947+0000","last_clean":"2023-10-06T02:53:16.976947+0000","last_became_active":"2023-10-06T02:53:15.947986+0000","last_became_peered":"2023-10-06T02:53:15.947986+0000","last_unstale":"2023-10-06T02:53:16.976947+0000","last_undegraded":"2023-10-06T02:53:16.976947+0000","last_fullsized":"2023-10-06T02:53:16.976947+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:49.756550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969869+0000","last_change":"2023-10-06T02:53:16.967480+0000","last_active":"2023-10-06T02:53:16.969869+0000","last_peered":"2023-10-06T02:53:16.969869+0000","last_clean":"2023-10-06T02:53:16.969869+0000","last_became_active":"2023-10-06T02:53:16.966567+0000","last_became_peered":"2023-10-06T02:53:16.966567+0000","last_unstale":"2023-10-06T02:53:16.969869+0000","last_undegraded":"2023-10-06T02:53:16.969869+0000","last_fullsized":"2023-10-06T02:53:16.969869+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:08.537334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.971093+0000","last_change":"2023-10-06T02:53:15.947587+0000","last_active":"2023-10-06T02:53:16.971093+0000","last_peered":"2023-10-06T02:53:16.971093+0000","last_clean":"2023-10-06T02:53:16.971093+0000","last_became_active":"2023-10-06T02:53:15.947298+0000","last_became_peered":"2023-10-06T02:53:15.947298+0000","last_unstale":"2023-10-06T02:53:16.971093+0000","last_undegraded":"2023-10-06T02:53:16.971093+0000","last_fullsized":"2023-10-06T02:53:16.971093+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968149+0000","last_change":"2023-10-06T02:53:16.968021+0000","last_active":"2023-10-06T02:53:16.968149+0000","last_peered":"2023-10-06T02:53:16.968149+0000","last_clean":"2023-10-06T02:53:16.968149+0000","last_became_active":"2023-10-06T02:53:16.967741+0000","last_became_peered":"2023-10-06T02:53:16.967741+0000","last_unstale":"2023-10-06T02:53:16.968149+0000","last_undegraded":"2023-10-06T02:53:16.968149+0000","last_fullsized":"2023-10-06T02:53:16.968149+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:59.865832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.957202+0000","last_change":"2023-10-06T02:53:15.942574+0000","last_active":"2023-10-06T02:53:16.957202+0000","last_peered":"2023-10-06T02:53:16.957202+0000","last_clean":"2023-10-06T02:53:16.957202+0000","last_became_active":"2023-10-06T02:53:15.942392+0000","last_became_peered":"2023-10-06T02:53:15.942392+0000","last_unstale":"2023-10-06T02:53:16.957202+0000","last_undegraded":"2023-10-06T02:53:16.957202+0000","last_fullsized":"2023-10-06T02:53:16.957202+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962601+0000","last_change":"2023-10-06T02:53:16.962545+0000","last_active":"2023-10-06T02:53:16.962601+0000","last_peered":"2023-10-06T02:53:16.962601+0000","last_clean":"2023-10-06T02:53:16.962601+0000","last_became_active":"2023-10-06T02:53:16.961760+0000","last_became_peered":"2023-10-06T02:53:16.961760+0000","last_unstale":"2023-10-06T02:53:16.962601+0000","last_undegraded":"2023-10-06T02:53:16.962601+0000","last_fullsized":"2023-10-06T02:53:16.962601+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:46.513629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.977129+0000","last_change":"2023-10-06T02:53:15.950485+0000","last_active":"2023-10-06T02:53:16.977129+0000","last_peered":"2023-10-06T02:53:16.977129+0000","last_clean":"2023-10-06T02:53:16.977129+0000","last_became_active":"2023-10-06T02:53:15.949974+0000","last_became_peered":"2023-10-06T02:53:15.949974+0000","last_unstale":"2023-10-06T02:53:16.977129+0000","last_undegraded":"2023-10-06T02:53:16.977129+0000","last_fullsized":"2023-10-06T02:53:16.977129+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:30.739583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972565+0000","last_change":"2023-10-06T02:53:16.972515+0000","last_active":"2023-10-06T02:53:16.972565+0000","last_peered":"2023-10-06T02:53:16.972565+0000","last_clean":"2023-10-06T02:53:16.972565+0000","last_became_active":"2023-10-06T02:53:16.972336+0000","last_became_peered":"2023-10-06T02:53:16.972336+0000","last_unstale":"2023-10-06T02:53:16.972565+0000","last_undegraded":"2023-10-06T02:53:16.972565+0000","last_fullsized":"2023-10-06T02:53:16.972565+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:19.731691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.954937+0000","last_change":"2023-10-06T02:53:15.951410+0000","last_active":"2023-10-06T02:53:16.954937+0000","last_peered":"2023-10-06T02:53:16.954937+0000","last_clean":"2023-10-06T02:53:16.954937+0000","last_became_active":"2023-10-06T02:53:15.950897+0000","last_became_peered":"2023-10-06T02:53:15.950897+0000","last_unstale":"2023-10-06T02:53:16.954937+0000","last_undegraded":"2023-10-06T02:53:16.954937+0000","last_fullsized":"2023-10-06T02:53:16.954937+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:35.524955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969475+0000","last_change":"2023-10-06T02:53:16.969425+0000","last_active":"2023-10-06T02:53:16.969475+0000","last_peered":"2023-10-06T02:53:16.969475+0000","last_clean":"2023-10-06T02:53:16.969475+0000","last_became_active":"2023-10-06T02:53:16.969225+0000","last_became_peered":"2023-10-06T02:53:16.969225+0000","last_unstale":"2023-10-06T02:53:16.969475+0000","last_undegraded":"2023-10-06T02:53:16.969475+0000","last_fullsized":"2023-10-06T02:53:16.969475+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:41.007295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960075+0000","last_change":"2023-10-06T02:53:15.953249+0000","last_active":"2023-10-06T02:53:16.960075+0000","last_peered":"2023-10-06T02:53:16.960075+0000","last_clean":"2023-10-06T02:53:16.960075+0000","last_became_active":"2023-10-06T02:53:15.953058+0000","last_became_peered":"2023-10-06T02:53:15.953058+0000","last_unstale":"2023-10-06T02:53:16.960075+0000","last_undegraded":"2023-10-06T02:53:16.960075+0000","last_fullsized":"2023-10-06T02:53:16.960075+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.970099+0000","last_change":"2023-10-06T02:53:16.970013+0000","last_active":"2023-10-06T02:53:16.970099+0000","last_peered":"2023-10-06T02:53:16.970099+0000","last_clean":"2023-10-06T02:53:16.970099+0000","last_became_active":"2023-10-06T02:53:16.969600+0000","last_became_peered":"2023-10-06T02:53:16.969600+0000","last_unstale":"2023-10-06T02:53:16.970099+0000","last_undegraded":"2023-10-06T02:53:16.970099+0000","last_fullsized":"2023-10-06T02:53:16.970099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960727+0000","last_change":"2023-10-06T02:53:15.949459+0000","last_active":"2023-10-06T02:53:16.960727+0000","last_peered":"2023-10-06T02:53:16.960727+0000","last_clean":"2023-10-06T02:53:16.960727+0000","last_became_active":"2023-10-06T02:53:15.949233+0000","last_became_peered":"2023-10-06T02:53:15.949233+0000","last_unstale":"2023-10-06T02:53:16.960727+0000","last_undegraded":"2023-10-06T02:53:16.960727+0000","last_fullsized":"2023-10-06T02:53:16.960727+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:32.966190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964209+0000","last_change":"2023-10-06T02:53:16.964131+0000","last_active":"2023-10-06T02:53:16.964209+0000","last_peered":"2023-10-06T02:53:16.964209+0000","last_clean":"2023-10-06T02:53:16.964209+0000","last_became_active":"2023-10-06T02:53:16.962427+0000","last_became_peered":"2023-10-06T02:53:16.962427+0000","last_unstale":"2023-10-06T02:53:16.964209+0000","last_undegraded":"2023-10-06T02:53:16.964209+0000","last_fullsized":"2023-10-06T02:53:16.964209+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:05.498811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.971456+0000","last_change":"2023-10-06T02:53:15.953568+0000","last_active":"2023-10-06T02:53:16.971456+0000","last_peered":"2023-10-06T02:53:16.971456+0000","last_clean":"2023-10-06T02:53:16.971456+0000","last_became_active":"2023-10-06T02:53:15.952663+0000","last_became_peered":"2023-10-06T02:53:15.952663+0000","last_unstale":"2023-10-06T02:53:16.971456+0000","last_undegraded":"2023-10-06T02:53:16.971456+0000","last_fullsized":"2023-10-06T02:53:16.971456+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:42.266244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968464+0000","last_change":"2023-10-06T02:53:16.967928+0000","last_active":"2023-10-06T02:53:16.968464+0000","last_peered":"2023-10-06T02:53:16.968464+0000","last_clean":"2023-10-06T02:53:16.968464+0000","last_became_active":"2023-10-06T02:53:16.967705+0000","last_became_peered":"2023-10-06T02:53:16.967705+0000","last_unstale":"2023-10-06T02:53:16.968464+0000","last_undegraded":"2023-10-06T02:53:16.968464+0000","last_fullsized":"2023-10-06T02:53:16.968464+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:51.895407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:53:18.049378+0000","last_change":"2023-10-06T02:53:15.951083+0000","last_active":"2023-10-06T02:53:18.049378+0000","last_peered":"2023-10-06T02:53:18.049378+0000","last_clean":"2023-10-06T02:53:18.049378+0000","last_became_active":"2023-10-06T02:53:15.950728+0000","last_became_peered":"2023-10-06T02:53:15.950728+0000","last_unstale":"2023-10-06T02:53:18.049378+0000","last_undegraded":"2023-10-06T02:53:18.049378+0000","last_fullsized":"2023-10-06T02:53:18.049378+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.974842+0000","last_change":"2023-10-06T02:53:16.974765+0000","last_active":"2023-10-06T02:53:16.974842+0000","last_peered":"2023-10-06T02:53:16.974842+0000","last_clean":"2023-10-06T02:53:16.974842+0000","last_became_active":"2023-10-06T02:53:16.974120+0000","last_became_peered":"2023-10-06T02:53:16.974120+0000","last_unstale":"2023-10-06T02:53:16.974842+0000","last_undegraded":"2023-10-06T02:53:16.974842+0000","last_fullsized":"2023-10-06T02:53:16.974842+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:41.518762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960569+0000","last_change":"2023-10-06T02:53:15.951578+0000","last_active":"2023-10-06T02:53:16.960569+0000","last_peered":"2023-10-06T02:53:16.960569+0000","last_clean":"2023-10-06T02:53:16.960569+0000","last_became_active":"2023-10-06T02:53:15.951350+0000","last_became_peered":"2023-10-06T02:53:15.951350+0000","last_unstale":"2023-10-06T02:53:16.960569+0000","last_undegraded":"2023-10-06T02:53:16.960569+0000","last_fullsized":"2023-10-06T02:53:16.960569+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:15.781730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966124+0000","last_change":"2023-10-06T02:53:16.966089+0000","last_active":"2023-10-06T02:53:16.966124+0000","last_peered":"2023-10-06T02:53:16.966124+0000","last_clean":"2023-10-06T02:53:16.966124+0000","last_became_active":"2023-10-06T02:53:16.965908+0000","last_became_peered":"2023-10-06T02:53:16.965908+0000","last_unstale":"2023-10-06T02:53:16.966124+0000","last_undegraded":"2023-10-06T02:53:16.966124+0000","last_fullsized":"2023-10-06T02:53:16.966124+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:25.447041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960533+0000","last_change":"2023-10-06T02:53:15.951271+0000","last_active":"2023-10-06T02:53:16.960533+0000","last_peered":"2023-10-06T02:53:16.960533+0000","last_clean":"2023-10-06T02:53:16.960533+0000","last_became_active":"2023-10-06T02:53:15.951044+0000","last_became_peered":"2023-10-06T02:53:15.951044+0000","last_unstale":"2023-10-06T02:53:16.960533+0000","last_undegraded":"2023-10-06T02:53:16.960533+0000","last_fullsized":"2023-10-06T02:53:16.960533+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965604+0000","last_change":"2023-10-06T02:53:16.965535+0000","last_active":"2023-10-06T02:53:16.965604+0000","last_peered":"2023-10-06T02:53:16.965604+0000","last_clean":"2023-10-06T02:53:16.965604+0000","last_became_active":"2023-10-06T02:53:16.965277+0000","last_became_peered":"2023-10-06T02:53:16.965277+0000","last_unstale":"2023-10-06T02:53:16.965604+0000","last_undegraded":"2023-10-06T02:53:16.965604+0000","last_fullsized":"2023-10-06T02:53:16.965604+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:40.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956540+0000","last_change":"2023-10-06T02:53:15.954250+0000","last_active":"2023-10-06T02:53:16.956540+0000","last_peered":"2023-10-06T02:53:16.956540+0000","last_clean":"2023-10-06T02:53:16.956540+0000","last_became_active":"2023-10-06T02:53:15.951275+0000","last_became_peered":"2023-10-06T02:53:15.951275+0000","last_unstale":"2023-10-06T02:53:16.956540+0000","last_undegraded":"2023-10-06T02:53:16.956540+0000","last_fullsized":"2023-10-06T02:53:16.956540+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.961320+0000","last_change":"2023-10-06T02:53:16.961253+0000","last_active":"2023-10-06T02:53:16.961320+0000","last_peered":"2023-10-06T02:53:16.961320+0000","last_clean":"2023-10-06T02:53:16.961320+0000","last_became_active":"2023-10-06T02:53:16.960689+0000","last_became_peered":"2023-10-06T02:53:16.960689+0000","last_unstale":"2023-10-06T02:53:16.961320+0000","last_undegraded":"2023-10-06T02:53:16.961320+0000","last_fullsized":"2023-10-06T02:53:16.961320+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:06.183443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962407+0000","last_change":"2023-10-06T02:53:15.955738+0000","last_active":"2023-10-06T02:53:16.962407+0000","last_peered":"2023-10-06T02:53:16.962407+0000","last_clean":"2023-10-06T02:53:16.962407+0000","last_became_active":"2023-10-06T02:53:15.955524+0000","last_became_peered":"2023-10-06T02:53:15.955524+0000","last_unstale":"2023-10-06T02:53:16.962407+0000","last_undegraded":"2023-10-06T02:53:16.962407+0000","last_fullsized":"2023-10-06T02:53:16.962407+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:30.555145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.971213+0000","last_change":"2023-10-06T02:53:16.971168+0000","last_active":"2023-10-06T02:53:16.971213+0000","last_peered":"2023-10-06T02:53:16.971213+0000","last_clean":"2023-10-06T02:53:16.971213+0000","last_became_active":"2023-10-06T02:53:16.970855+0000","last_became_peered":"2023-10-06T02:53:16.970855+0000","last_unstale":"2023-10-06T02:53:16.971213+0000","last_undegraded":"2023-10-06T02:53:16.971213+0000","last_fullsized":"2023-10-06T02:53:16.971213+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:51.951868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960018+0000","last_change":"2023-10-06T02:53:15.951067+0000","last_active":"2023-10-06T02:53:16.960018+0000","last_peered":"2023-10-06T02:53:16.960018+0000","last_clean":"2023-10-06T02:53:16.960018+0000","last_became_active":"2023-10-06T02:53:15.950869+0000","last_became_peered":"2023-10-06T02:53:15.950869+0000","last_unstale":"2023-10-06T02:53:16.960018+0000","last_undegraded":"2023-10-06T02:53:16.960018+0000","last_fullsized":"2023-10-06T02:53:16.960018+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.974823+0000","last_change":"2023-10-06T02:53:16.974624+0000","last_active":"2023-10-06T02:53:16.974823+0000","last_peered":"2023-10-06T02:53:16.974823+0000","last_clean":"2023-10-06T02:53:16.974823+0000","last_became_active":"2023-10-06T02:53:16.973753+0000","last_became_peered":"2023-10-06T02:53:16.973753+0000","last_unstale":"2023-10-06T02:53:16.974823+0000","last_undegraded":"2023-10-06T02:53:16.974823+0000","last_fullsized":"2023-10-06T02:53:16.974823+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:12.395339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956720+0000","last_change":"2023-10-06T02:53:15.948960+0000","last_active":"2023-10-06T02:53:16.956720+0000","last_peered":"2023-10-06T02:53:16.956720+0000","last_clean":"2023-10-06T02:53:16.956720+0000","last_became_active":"2023-10-06T02:53:15.947980+0000","last_became_peered":"2023-10-06T02:53:15.947980+0000","last_unstale":"2023-10-06T02:53:16.956720+0000","last_undegraded":"2023-10-06T02:53:16.956720+0000","last_fullsized":"2023-10-06T02:53:16.956720+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968548+0000","last_change":"2023-10-06T02:53:16.968480+0000","last_active":"2023-10-06T02:53:16.968548+0000","last_peered":"2023-10-06T02:53:16.968548+0000","last_clean":"2023-10-06T02:53:16.968548+0000","last_became_active":"2023-10-06T02:53:16.968166+0000","last_became_peered":"2023-10-06T02:53:16.968166+0000","last_unstale":"2023-10-06T02:53:16.968548+0000","last_undegraded":"2023-10-06T02:53:16.968548+0000","last_fullsized":"2023-10-06T02:53:16.968548+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"150'3","reported_seq":13,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.977388+0000","last_change":"2023-10-06T02:53:15.954832+0000","last_active":"2023-10-06T02:53:16.977388+0000","last_peered":"2023-10-06T02:53:16.977388+0000","last_clean":"2023-10-06T02:53:16.977388+0000","last_became_active":"2023-10-06T02:53:15.954616+0000","last_became_peered":"2023-10-06T02:53:15.954616+0000","last_unstale":"2023-10-06T02:53:16.977388+0000","last_undegraded":"2023-10-06T02:53:16.977388+0000","last_fullsized":"2023-10-06T02:53:16.977388+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960595+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:53:16.960595+0000","last_peered":"2023-10-06T02:53:16.960595+0000","last_clean":"2023-10-06T02:53:16.960595+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:53:16.960595+0000","last_undegraded":"2023-10-06T02:53:16.960595+0000","last_fullsized":"2023-10-06T02:53:16.960595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.959080+0000","last_change":"2023-10-06T02:53:16.959024+0000","last_active":"2023-10-06T02:53:16.959080+0000","last_peered":"2023-10-06T02:53:16.959080+0000","last_clean":"2023-10-06T02:53:16.959080+0000","last_became_active":"2023-10-06T02:53:16.958803+0000","last_became_peered":"2023-10-06T02:53:16.958803+0000","last_unstale":"2023-10-06T02:53:16.959080+0000","last_undegraded":"2023-10-06T02:53:16.959080+0000","last_fullsized":"2023-10-06T02:53:16.959080+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.758775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968509+0000","last_change":"2023-10-06T02:53:15.951215+0000","last_active":"2023-10-06T02:53:16.968509+0000","last_peered":"2023-10-06T02:53:16.968509+0000","last_clean":"2023-10-06T02:53:16.968509+0000","last_became_active":"2023-10-06T02:53:15.951002+0000","last_became_peered":"2023-10-06T02:53:15.951002+0000","last_unstale":"2023-10-06T02:53:16.968509+0000","last_undegraded":"2023-10-06T02:53:16.968509+0000","last_fullsized":"2023-10-06T02:53:16.968509+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:36.226855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956730+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:53:16.956730+0000","last_peered":"2023-10-06T02:53:16.956730+0000","last_clean":"2023-10-06T02:53:16.956730+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:53:16.956730+0000","last_undegraded":"2023-10-06T02:53:16.956730+0000","last_fullsized":"2023-10-06T02:53:16.956730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962731+0000","last_change":"2023-10-06T02:53:16.962591+0000","last_active":"2023-10-06T02:53:16.962731+0000","last_peered":"2023-10-06T02:53:16.962731+0000","last_clean":"2023-10-06T02:53:16.962731+0000","last_became_active":"2023-10-06T02:53:16.962298+0000","last_became_peered":"2023-10-06T02:53:16.962298+0000","last_unstale":"2023-10-06T02:53:16.962731+0000","last_undegraded":"2023-10-06T02:53:16.962731+0000","last_fullsized":"2023-10-06T02:53:16.962731+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:10.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"150'8","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976120+0000","last_change":"2023-10-06T02:53:15.949900+0000","last_active":"2023-10-06T02:53:16.976120+0000","last_peered":"2023-10-06T02:53:16.976120+0000","last_clean":"2023-10-06T02:53:16.976120+0000","last_became_active":"2023-10-06T02:53:15.949704+0000","last_became_peered":"2023-10-06T02:53:15.949704+0000","last_unstale":"2023-10-06T02:53:16.976120+0000","last_undegraded":"2023-10-06T02:53:16.976120+0000","last_fullsized":"2023-10-06T02:53:16.976120+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:51.904359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":127,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.954647+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:53:16.954647+0000","last_peered":"2023-10-06T02:53:16.954647+0000","last_clean":"2023-10-06T02:53:16.954647+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:53:16.954647+0000","last_undegraded":"2023-10-06T02:53:16.954647+0000","last_fullsized":"2023-10-06T02:53:16.954647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968487+0000","last_change":"2023-10-06T02:53:16.968431+0000","last_active":"2023-10-06T02:53:16.968487+0000","last_peered":"2023-10-06T02:53:16.968487+0000","last_clean":"2023-10-06T02:53:16.968487+0000","last_became_active":"2023-10-06T02:53:16.968164+0000","last_became_peered":"2023-10-06T02:53:16.968164+0000","last_unstale":"2023-10-06T02:53:16.968487+0000","last_undegraded":"2023-10-06T02:53:16.968487+0000","last_fullsized":"2023-10-06T02:53:16.968487+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:31.560000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967738+0000","last_change":"2023-10-06T02:53:15.953624+0000","last_active":"2023-10-06T02:53:16.967738+0000","last_peered":"2023-10-06T02:53:16.967738+0000","last_clean":"2023-10-06T02:53:16.967738+0000","last_became_active":"2023-10-06T02:53:15.953206+0000","last_became_peered":"2023-10-06T02:53:15.953206+0000","last_unstale":"2023-10-06T02:53:16.967738+0000","last_undegraded":"2023-10-06T02:53:16.967738+0000","last_fullsized":"2023-10-06T02:53:16.967738+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:50.890551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956630+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:53:16.956630+0000","last_peered":"2023-10-06T02:53:16.956630+0000","last_clean":"2023-10-06T02:53:16.956630+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:53:16.956630+0000","last_undegraded":"2023-10-06T02:53:16.956630+0000","last_fullsized":"2023-10-06T02:53:16.956630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960897+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:53:16.960897+0000","last_peered":"2023-10-06T02:53:16.960897+0000","last_clean":"2023-10-06T02:53:16.960897+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:53:16.960897+0000","last_undegraded":"2023-10-06T02:53:16.960897+0000","last_fullsized":"2023-10-06T02:53:16.960897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969949+0000","last_change":"2023-10-06T02:53:16.969608+0000","last_active":"2023-10-06T02:53:16.969949+0000","last_peered":"2023-10-06T02:53:16.969949+0000","last_clean":"2023-10-06T02:53:16.969949+0000","last_became_active":"2023-10-06T02:53:16.969064+0000","last_became_peered":"2023-10-06T02:53:16.969064+0000","last_unstale":"2023-10-06T02:53:16.969949+0000","last_undegraded":"2023-10-06T02:53:16.969949+0000","last_fullsized":"2023-10-06T02:53:16.969949+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:21.663680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958365+0000","last_change":"2023-10-06T02:53:15.950535+0000","last_active":"2023-10-06T02:53:16.958365+0000","last_peered":"2023-10-06T02:53:16.958365+0000","last_clean":"2023-10-06T02:53:16.958365+0000","last_became_active":"2023-10-06T02:53:15.950353+0000","last_became_peered":"2023-10-06T02:53:15.950353+0000","last_unstale":"2023-10-06T02:53:16.958365+0000","last_undegraded":"2023-10-06T02:53:16.958365+0000","last_fullsized":"2023-10-06T02:53:16.958365+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:04.092161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960809+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:53:16.960809+0000","last_peered":"2023-10-06T02:53:16.960809+0000","last_clean":"2023-10-06T02:53:16.960809+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:53:16.960809+0000","last_undegraded":"2023-10-06T02:53:16.960809+0000","last_fullsized":"2023-10-06T02:53:16.960809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964804+0000","last_change":"2023-10-06T02:53:16.963707+0000","last_active":"2023-10-06T02:53:16.964804+0000","last_peered":"2023-10-06T02:53:16.964804+0000","last_clean":"2023-10-06T02:53:16.964804+0000","last_became_active":"2023-10-06T02:53:16.963473+0000","last_became_peered":"2023-10-06T02:53:16.963473+0000","last_unstale":"2023-10-06T02:53:16.964804+0000","last_undegraded":"2023-10-06T02:53:16.964804+0000","last_fullsized":"2023-10-06T02:53:16.964804+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976269+0000","last_change":"2023-10-06T02:53:15.951054+0000","last_active":"2023-10-06T02:53:16.976269+0000","last_peered":"2023-10-06T02:53:16.976269+0000","last_clean":"2023-10-06T02:53:16.976269+0000","last_became_active":"2023-10-06T02:53:15.950811+0000","last_became_peered":"2023-10-06T02:53:15.950811+0000","last_unstale":"2023-10-06T02:53:16.976269+0000","last_undegraded":"2023-10-06T02:53:16.976269+0000","last_fullsized":"2023-10-06T02:53:16.976269+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.961074+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:53:16.961074+0000","last_peered":"2023-10-06T02:53:16.961074+0000","last_clean":"2023-10-06T02:53:16.961074+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:53:16.961074+0000","last_undegraded":"2023-10-06T02:53:16.961074+0000","last_fullsized":"2023-10-06T02:53:16.961074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964822+0000","last_change":"2023-10-06T02:53:16.964708+0000","last_active":"2023-10-06T02:53:16.964822+0000","last_peered":"2023-10-06T02:53:16.964822+0000","last_clean":"2023-10-06T02:53:16.964822+0000","last_became_active":"2023-10-06T02:53:16.964451+0000","last_became_peered":"2023-10-06T02:53:16.964451+0000","last_unstale":"2023-10-06T02:53:16.964822+0000","last_undegraded":"2023-10-06T02:53:16.964822+0000","last_fullsized":"2023-10-06T02:53:16.964822+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.624552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956430+0000","last_change":"2023-10-06T02:53:15.954105+0000","last_active":"2023-10-06T02:53:16.956430+0000","last_peered":"2023-10-06T02:53:16.956430+0000","last_clean":"2023-10-06T02:53:16.956430+0000","last_became_active":"2023-10-06T02:53:15.950962+0000","last_became_peered":"2023-10-06T02:53:15.950962+0000","last_unstale":"2023-10-06T02:53:16.956430+0000","last_undegraded":"2023-10-06T02:53:16.956430+0000","last_fullsized":"2023-10-06T02:53:16.956430+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960090+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:53:16.960090+0000","last_peered":"2023-10-06T02:53:16.960090+0000","last_clean":"2023-10-06T02:53:16.960090+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:53:16.960090+0000","last_undegraded":"2023-10-06T02:53:16.960090+0000","last_fullsized":"2023-10-06T02:53:16.960090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964975+0000","last_change":"2023-10-06T02:53:16.964920+0000","last_active":"2023-10-06T02:53:16.964975+0000","last_peered":"2023-10-06T02:53:16.964975+0000","last_clean":"2023-10-06T02:53:16.964975+0000","last_became_active":"2023-10-06T02:53:16.964701+0000","last_became_peered":"2023-10-06T02:53:16.964701+0000","last_unstale":"2023-10-06T02:53:16.964975+0000","last_undegraded":"2023-10-06T02:53:16.964975+0000","last_fullsized":"2023-10-06T02:53:16.964975+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.955165+0000","last_change":"2023-10-06T02:53:15.953695+0000","last_active":"2023-10-06T02:53:16.955165+0000","last_peered":"2023-10-06T02:53:16.955165+0000","last_clean":"2023-10-06T02:53:16.955165+0000","last_became_active":"2023-10-06T02:53:15.953150+0000","last_became_peered":"2023-10-06T02:53:15.953150+0000","last_unstale":"2023-10-06T02:53:16.955165+0000","last_undegraded":"2023-10-06T02:53:16.955165+0000","last_fullsized":"2023-10-06T02:53:16.955165+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:26.827466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958451+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:53:16.958451+0000","last_peered":"2023-10-06T02:53:16.958451+0000","last_clean":"2023-10-06T02:53:16.958451+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:53:16.958451+0000","last_undegraded":"2023-10-06T02:53:16.958451+0000","last_fullsized":"2023-10-06T02:53:16.958451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1445,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193867,"statfs":{"total":200000000,"available":198520307,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.393},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.53000000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":1.081},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.52900000000000003},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.72399999999999998,"5min":0.79900000000000004,"15min":1.4710000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.622},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.626},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":4.8129999999999997},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.60299999999999998},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.69599999999999995,"5min":0.78600000000000003,"15min":3.4870000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":2.2349999999999999},"last":0.505}]},{"osd":4,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46600000000000003,"15min":0.45900000000000002},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63200000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.497,"15min":0.49099999999999999},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51200000000000001,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":0.879},"last":0.378},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.39300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.432},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.31900000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199111657,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.60299999999999998},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.56100000000000005},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.879},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.90500000000000003},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.81599999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.64700000000000002,"5min":1.042,"15min":1.0580000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54500000000000004,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.29499999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.80100000000000005,"15min":1.163},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47499999999999998,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":1.05},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.501,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.86799999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.53700000000000003,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.754,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54100000000000004,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":1.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76400000000000001,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.39400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112231,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32000000000000001,"15min":0.313},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.44400000000000001,"5min":0.501,"15min":0.501},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.35499999999999998,"15min":0.33300000000000002},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.51000000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.28799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.32300000000000001},"min":{"1min":0.23799999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.48399999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.25},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40400000000000003,"15min":0.38400000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.36399999999999999},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.53800000000000003},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76800000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.91400000000000003,"5min":1.006,"15min":1.006},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.61899999999999999,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.88200000000000001},"last":0.62}]}]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1443,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193869,"statfs":{"total":200000000,"available":198521877,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.34499999999999997},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46500000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.442}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33200000000000002,"15min":0.96699999999999997},"min":{"1min":0.217,"5min":0.216,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.56899999999999995,"15min":22.038},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":1.3779999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.50900000000000001,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":1.0009999999999999},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.253},"max":{"1min":0.60399999999999998,"5min":0.63300000000000001,"15min":21.942},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":1.083},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.32900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":11.122999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":1.1599999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":22.010999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":1.401},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":1.113},"min":{"1min":0.374,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.83599999999999997,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":1.1850000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":21.98},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.425},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.872},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":11.154},"last":0.76900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574939,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199111713,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.183,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.46000000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.186},"max":{"1min":0.501,"5min":0.60199999999999998,"15min":0.60699999999999998},"last":0.27000000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36699999999999999,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48899999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.41299999999999998,"15min":0.38900000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.59299999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.374},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.40400000000000003,"15min":0.39700000000000002},"min":{"1min":0.245,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83599999999999997,"5min":1.056,"15min":1.056},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.312,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55700000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.61699999999999999,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.72099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.59399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86399999999999999,"5min":1.018,"15min":1.2569999999999999},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":1.002,"15min":1.002},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.624,"15min":0.59499999999999997},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76100000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199110695,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32000000000000001,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.372,"15min":0.33400000000000002},"min":{"1min":0.23100000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35599999999999998,"15min":0.33200000000000002},"min":{"1min":0.249,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.48899999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38100000000000001,"15min":0.34999999999999998},"min":{"1min":0.28100000000000003,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.496,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.41499999999999998,"15min":0.374},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":0.44,"5min":3.044,"15min":3.044},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39100000000000001,"15min":0.35099999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73699999999999999,"5min":1.446,"15min":2.2120000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":1.327,"15min":2.25},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.67800000000000005},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80500000000000005,"5min":1.268,"15min":1.268},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76400000000000001,"5min":1.218,"15min":1.218},"last":0.748},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38600000000000001},"max":{"1min":0.83699999999999997,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61099999999999999,"15min":0.90600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":0.79800000000000004,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.495,"15min":0.752},"min":{"1min":0.27200000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.67700000000000005,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.60599999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.221},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52300000000000002,"15min":0.78200000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":5.9329999999999998},"last":0.496},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.74099999999999999},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.65900000000000003,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":5.4390000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.65700000000000003},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66700000000000004,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.622},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69899999999999995,"5min":0.77000000000000002,"15min":3.456},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.27500000000000002,"15min":0.245},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72199999999999998,"5min":0.76400000000000001,"15min":0.78400000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.96599999999999997},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":13.173999999999999},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.64700000000000002,"5min":0.747,"15min":0.79100000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.28799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67600000000000005,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.30399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68899999999999995,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.60599999999999998,"5min":0.747,"15min":0.83799999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.629}]},{"osd":4,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.252},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69799999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.879,"15min":0.879},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72599999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81799999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70499999999999996}]}]}],"pool_statfs":[]}} 2023-10-06T02:53:25.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:53:25.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.655+0000 7f431c1bf700 1 Processor -- start 2023-10-06T02:53:25.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.655+0000 7f431c1bf700 1 -- start start 2023-10-06T02:53:25.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431c1bf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43141578d0 0x7f43140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:25.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431c1bf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f431406d120 0x7f431406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:25.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431c1bf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431406dac0 con 0x7f4314157ca0 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431c1bf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43140d07c0 con 0x7f431406d120 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431c1bf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43140cfbb0 con 0x7f43141578d0 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431a75c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f431406d120 0x7f431406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431975a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4314157ca0 0x7f431415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35882/0 (socket says 172.21.15.81:35882) 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431975a700 1 -- 172.21.15.81:0/3276721757 learned_addr learned my addr 172.21.15.81:0/3276721757 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f4319f5b700 1 --2- 172.21.15.81:0/3276721757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43141578d0 0x7f43140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431a75c700 1 -- 172.21.15.81:0/3276721757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43141578d0 msgr2=0x7f43140cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431a75c700 1 --2- 172.21.15.81:0/3276721757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43141578d0 0x7f43140cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431a75c700 1 -- 172.21.15.81:0/3276721757 >> v1:172.21.15.81:6789/0 conn(0x7f4314157ca0 legacy=0x7f431415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431a75c700 1 -- 172.21.15.81:0/3276721757 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43140cfe90 con 0x7f431406d120 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f4318f59700 1 -- 172.21.15.81:0/3276721757 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536597656 0 0) 0x7f4304001110 con 0x7f4314157ca0 2023-10-06T02:53:25.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f431a75c700 1 --2- 172.21.15.81:0/3276721757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 0x7f431406d580 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f430c0098e0 tx=0x7f430c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1631d0546801ce58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f4318f59700 1 -- 172.21.15.81:0/3276721757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c009e80 con 0x7f431406d120 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f4318f59700 1 -- 172.21.15.81:0/3276721757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430c00b860 con 0x7f431406d120 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.656+0000 7f4318f59700 1 -- 172.21.15.81:0/3276721757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c00bbe0 con 0x7f431406d120 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.657+0000 7f431c1bf700 1 -- 172.21.15.81:0/3276721757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 msgr2=0x7f431406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.657+0000 7f431c1bf700 1 --2- 172.21.15.81:0/3276721757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 0x7f431406d580 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f430c0098e0 tx=0x7f430c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.657+0000 7f431c1bf700 1 -- 172.21.15.81:0/3276721757 shutdown_connections 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.657+0000 7f431c1bf700 1 --2- 172.21.15.81:0/3276721757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 0x7f431406d580 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.657+0000 7f431c1bf700 1 --2- 172.21.15.81:0/3276721757 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43141578d0 0x7f43140cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.657+0000 7f431c1bf700 1 -- 172.21.15.81:0/3276721757 >> 172.21.15.81:0/3276721757 conn(0x7f431406bb90 msgr2=0x7f431406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.657+0000 7f431c1bf700 1 -- 172.21.15.81:0/3276721757 shutdown_connections 2023-10-06T02:53:25.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.657+0000 7f431c1bf700 1 -- 172.21.15.81:0/3276721757 wait complete. 2023-10-06T02:53:25.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.658+0000 7f431c1bf700 1 Processor -- start 2023-10-06T02:53:25.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.658+0000 7f431c1bf700 1 -- start start 2023-10-06T02:53:25.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431c1bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 0x7f4314068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:25.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431c1bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43141578d0 0x7f4314169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:25.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431c1bf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4314157ca0 0x7f431416a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:25.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431c1bf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431416ae40 con 0x7f431406d120 2023-10-06T02:53:25.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431c1bf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4314159c10 con 0x7f43141578d0 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431c1bf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431416a7a0 con 0x7f4314157ca0 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4319f5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 0x7f4314068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4319f5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 0x7f4314068a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49242/0 (socket says 172.21.15.81:49242) 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4319f5b700 1 -- 172.21.15.81:0/1304339786 learned_addr learned my addr 172.21.15.81:0/1304339786 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431a75c700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4314157ca0 0x7f431416a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431975a700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43141578d0 0x7f4314169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4319f5b700 1 -- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4314157ca0 msgr2=0x7f431416a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4319f5b700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4314157ca0 0x7f431416a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4319f5b700 1 -- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43141578d0 msgr2=0x7f4314169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4319f5b700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43141578d0 0x7f4314169c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4319f5b700 1 -- 172.21.15.81:0/1304339786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c009420 con 0x7f431406d120 2023-10-06T02:53:25.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431975a700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43141578d0 0x7f4314169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4319f5b700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 0x7f4314068a40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f431000e190 tx=0x7f4310009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4309ffb700 1 -- 172.21.15.81:0/1304339786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000ee30 con 0x7f431406d120 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4309ffb700 1 -- 172.21.15.81:0/1304339786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310014420 con 0x7f431406d120 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431416aa80 con 0x7f431406d120 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.659+0000 7f4309ffb700 1 -- 172.21.15.81:0/1304339786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43100147e0 con 0x7f431406d120 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.660+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431416b370 con 0x7f431406d120 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.661+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f431416b6e0 con 0x7f431406d120 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.661+0000 7f4309ffb700 1 -- 172.21.15.81:0/1304339786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4310014b90 con 0x7f431406d120 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.661+0000 7f4309ffb700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f42f8066f30 0x7f42f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.661+0000 7f4309ffb700 1 -- 172.21.15.81:0/1304339786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4310084ee0 con 0x7f431406d120 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.662+0000 7f431975a700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f42f8066f30 0x7f42f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.662+0000 7f431975a700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f42f8066f30 0x7f42f80693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f431415a310 tx=0x7f4304009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:25.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.665+0000 7f4309ffb700 1 -- 172.21.15.81:0/1304339786 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4310051ff0 con 0x7f431406d120 2023-10-06T02:53:25.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.843+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43140d0170 con 0x7f42f8066f30 2023-10-06T02:53:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.852+0000 7f4309ffb700 1 -- 172.21.15.81:0/1304339786 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305862 (secure 0 0 0) 0x7f43140d0170 con 0x7f42f8066f30 2023-10-06T02:53:25.857 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f42f8066f30 msgr2=0x7f42f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f42f8066f30 0x7f42f80693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f431415a310 tx=0x7f4304009040 comp rx=0 tx=0).stop 2023-10-06T02:53:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 msgr2=0x7f4314068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 0x7f4314068a40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f431000e190 tx=0x7f4310009920 comp rx=0 tx=0).stop 2023-10-06T02:53:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 shutdown_connections 2023-10-06T02:53:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4314157ca0 0x7f431416a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f431406d120 0x7f4314068a40 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f42f8066f30 0x7f42f80693e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 --2- 172.21.15.81:0/1304339786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43141578d0 0x7f4314169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 >> 172.21.15.81:0/1304339786 conn(0x7f431406bb90 msgr2=0x7f431415c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 shutdown_connections 2023-10-06T02:53:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:25.855+0000 7f431c1bf700 1 -- 172.21.15.81:0/1304339786 wait complete. 2023-10-06T02:53:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:53:25.868 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2023-10-06T02:53:25.596685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8092,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554407,"statfs":{"total":1600000000,"available":1591713060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.638429"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964474+0000","last_change":"2023-10-06T02:53:16.964366+0000","last_active":"2023-10-06T02:53:16.964474+0000","last_peered":"2023-10-06T02:53:16.964474+0000","last_clean":"2023-10-06T02:53:16.964474+0000","last_became_active":"2023-10-06T02:53:16.964152+0000","last_became_peered":"2023-10-06T02:53:16.964152+0000","last_unstale":"2023-10-06T02:53:16.964474+0000","last_undegraded":"2023-10-06T02:53:16.964474+0000","last_fullsized":"2023-10-06T02:53:16.964474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:19.267194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963477+0000","last_change":"2023-10-06T02:53:16.963411+0000","last_active":"2023-10-06T02:53:16.963477+0000","last_peered":"2023-10-06T02:53:16.963477+0000","last_clean":"2023-10-06T02:53:16.963477+0000","last_became_active":"2023-10-06T02:53:16.963241+0000","last_became_peered":"2023-10-06T02:53:16.963241+0000","last_unstale":"2023-10-06T02:53:16.963477+0000","last_undegraded":"2023-10-06T02:53:16.963477+0000","last_fullsized":"2023-10-06T02:53:16.963477+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976745+0000","last_change":"2023-10-06T02:53:16.971956+0000","last_active":"2023-10-06T02:53:16.976745+0000","last_peered":"2023-10-06T02:53:16.976745+0000","last_clean":"2023-10-06T02:53:16.976745+0000","last_became_active":"2023-10-06T02:53:16.971529+0000","last_became_peered":"2023-10-06T02:53:16.971529+0000","last_unstale":"2023-10-06T02:53:16.976745+0000","last_undegraded":"2023-10-06T02:53:16.976745+0000","last_fullsized":"2023-10-06T02:53:16.976745+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:40.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964106+0000","last_change":"2023-10-06T02:53:16.964041+0000","last_active":"2023-10-06T02:53:16.964106+0000","last_peered":"2023-10-06T02:53:16.964106+0000","last_clean":"2023-10-06T02:53:16.964106+0000","last_became_active":"2023-10-06T02:53:16.963789+0000","last_became_peered":"2023-10-06T02:53:16.963789+0000","last_unstale":"2023-10-06T02:53:16.964106+0000","last_undegraded":"2023-10-06T02:53:16.964106+0000","last_fullsized":"2023-10-06T02:53:16.964106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965475+0000","last_change":"2023-10-06T02:53:16.965419+0000","last_active":"2023-10-06T02:53:16.965475+0000","last_peered":"2023-10-06T02:53:16.965475+0000","last_clean":"2023-10-06T02:53:16.965475+0000","last_became_active":"2023-10-06T02:53:16.965214+0000","last_became_peered":"2023-10-06T02:53:16.965214+0000","last_unstale":"2023-10-06T02:53:16.965475+0000","last_undegraded":"2023-10-06T02:53:16.965475+0000","last_fullsized":"2023-10-06T02:53:16.965475+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:08.537334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963420+0000","last_change":"2023-10-06T02:53:16.963193+0000","last_active":"2023-10-06T02:53:16.963420+0000","last_peered":"2023-10-06T02:53:16.963420+0000","last_clean":"2023-10-06T02:53:16.963420+0000","last_became_active":"2023-10-06T02:53:16.962989+0000","last_became_peered":"2023-10-06T02:53:16.962989+0000","last_unstale":"2023-10-06T02:53:16.963420+0000","last_undegraded":"2023-10-06T02:53:16.963420+0000","last_fullsized":"2023-10-06T02:53:16.963420+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.974532+0000","last_change":"2023-10-06T02:53:16.974470+0000","last_active":"2023-10-06T02:53:16.974532+0000","last_peered":"2023-10-06T02:53:16.974532+0000","last_clean":"2023-10-06T02:53:16.974532+0000","last_became_active":"2023-10-06T02:53:16.973433+0000","last_became_peered":"2023-10-06T02:53:16.973433+0000","last_unstale":"2023-10-06T02:53:16.974532+0000","last_undegraded":"2023-10-06T02:53:16.974532+0000","last_fullsized":"2023-10-06T02:53:16.974532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:18.791274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969503+0000","last_change":"2023-10-06T02:53:16.968369+0000","last_active":"2023-10-06T02:53:16.969503+0000","last_peered":"2023-10-06T02:53:16.969503+0000","last_clean":"2023-10-06T02:53:16.969503+0000","last_became_active":"2023-10-06T02:53:16.967979+0000","last_became_peered":"2023-10-06T02:53:16.967979+0000","last_unstale":"2023-10-06T02:53:16.969503+0000","last_undegraded":"2023-10-06T02:53:16.969503+0000","last_fullsized":"2023-10-06T02:53:16.969503+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966452+0000","last_change":"2023-10-06T02:53:16.966268+0000","last_active":"2023-10-06T02:53:16.966452+0000","last_peered":"2023-10-06T02:53:16.966452+0000","last_clean":"2023-10-06T02:53:16.966452+0000","last_became_active":"2023-10-06T02:53:16.965789+0000","last_became_peered":"2023-10-06T02:53:16.965789+0000","last_unstale":"2023-10-06T02:53:16.966452+0000","last_undegraded":"2023-10-06T02:53:16.966452+0000","last_fullsized":"2023-10-06T02:53:16.966452+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:46.513629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966548+0000","last_change":"2023-10-06T02:53:16.966490+0000","last_active":"2023-10-06T02:53:16.966548+0000","last_peered":"2023-10-06T02:53:16.966548+0000","last_clean":"2023-10-06T02:53:16.966548+0000","last_became_active":"2023-10-06T02:53:16.966238+0000","last_became_peered":"2023-10-06T02:53:16.966238+0000","last_unstale":"2023-10-06T02:53:16.966548+0000","last_undegraded":"2023-10-06T02:53:16.966548+0000","last_fullsized":"2023-10-06T02:53:16.966548+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:50.567117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968913+0000","last_change":"2023-10-06T02:53:16.968803+0000","last_active":"2023-10-06T02:53:16.968913+0000","last_peered":"2023-10-06T02:53:16.968913+0000","last_clean":"2023-10-06T02:53:16.968913+0000","last_became_active":"2023-10-06T02:53:16.968493+0000","last_became_peered":"2023-10-06T02:53:16.968493+0000","last_unstale":"2023-10-06T02:53:16.968913+0000","last_undegraded":"2023-10-06T02:53:16.968913+0000","last_fullsized":"2023-10-06T02:53:16.968913+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960447+0000","last_change":"2023-10-06T02:53:16.960354+0000","last_active":"2023-10-06T02:53:16.960447+0000","last_peered":"2023-10-06T02:53:16.960447+0000","last_clean":"2023-10-06T02:53:16.960447+0000","last_became_active":"2023-10-06T02:53:16.960134+0000","last_became_peered":"2023-10-06T02:53:16.960134+0000","last_unstale":"2023-10-06T02:53:16.960447+0000","last_undegraded":"2023-10-06T02:53:16.960447+0000","last_fullsized":"2023-10-06T02:53:16.960447+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:47.125694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965409+0000","last_change":"2023-10-06T02:53:16.965340+0000","last_active":"2023-10-06T02:53:16.965409+0000","last_peered":"2023-10-06T02:53:16.965409+0000","last_clean":"2023-10-06T02:53:16.965409+0000","last_became_active":"2023-10-06T02:53:16.965113+0000","last_became_peered":"2023-10-06T02:53:16.965113+0000","last_unstale":"2023-10-06T02:53:16.965409+0000","last_undegraded":"2023-10-06T02:53:16.965409+0000","last_fullsized":"2023-10-06T02:53:16.965409+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:29.709175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962633+0000","last_change":"2023-10-06T02:53:16.962192+0000","last_active":"2023-10-06T02:53:16.962633+0000","last_peered":"2023-10-06T02:53:16.962633+0000","last_clean":"2023-10-06T02:53:16.962633+0000","last_became_active":"2023-10-06T02:53:16.961955+0000","last_became_peered":"2023-10-06T02:53:16.961955+0000","last_unstale":"2023-10-06T02:53:16.962633+0000","last_undegraded":"2023-10-06T02:53:16.962633+0000","last_fullsized":"2023-10-06T02:53:16.962633+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:16.000558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962615+0000","last_change":"2023-10-06T02:53:16.962069+0000","last_active":"2023-10-06T02:53:16.962615+0000","last_peered":"2023-10-06T02:53:16.962615+0000","last_clean":"2023-10-06T02:53:16.962615+0000","last_became_active":"2023-10-06T02:53:16.961852+0000","last_became_peered":"2023-10-06T02:53:16.961852+0000","last_unstale":"2023-10-06T02:53:16.962615+0000","last_undegraded":"2023-10-06T02:53:16.962615+0000","last_fullsized":"2023-10-06T02:53:16.962615+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:30.710968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964962+0000","last_change":"2023-10-06T02:53:16.964622+0000","last_active":"2023-10-06T02:53:16.964962+0000","last_peered":"2023-10-06T02:53:16.964962+0000","last_clean":"2023-10-06T02:53:16.964962+0000","last_became_active":"2023-10-06T02:53:16.964357+0000","last_became_peered":"2023-10-06T02:53:16.964357+0000","last_unstale":"2023-10-06T02:53:16.964962+0000","last_undegraded":"2023-10-06T02:53:16.964962+0000","last_fullsized":"2023-10-06T02:53:16.964962+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964301+0000","last_change":"2023-10-06T02:53:16.964241+0000","last_active":"2023-10-06T02:53:16.964301+0000","last_peered":"2023-10-06T02:53:16.964301+0000","last_clean":"2023-10-06T02:53:16.964301+0000","last_became_active":"2023-10-06T02:53:16.963989+0000","last_became_peered":"2023-10-06T02:53:16.963989+0000","last_unstale":"2023-10-06T02:53:16.964301+0000","last_undegraded":"2023-10-06T02:53:16.964301+0000","last_fullsized":"2023-10-06T02:53:16.964301+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.961844+0000","last_change":"2023-10-06T02:53:16.961787+0000","last_active":"2023-10-06T02:53:16.961844+0000","last_peered":"2023-10-06T02:53:16.961844+0000","last_clean":"2023-10-06T02:53:16.961844+0000","last_became_active":"2023-10-06T02:53:16.961549+0000","last_became_peered":"2023-10-06T02:53:16.961549+0000","last_unstale":"2023-10-06T02:53:16.961844+0000","last_undegraded":"2023-10-06T02:53:16.961844+0000","last_fullsized":"2023-10-06T02:53:16.961844+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:04.547121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969905+0000","last_change":"2023-10-06T02:53:16.967603+0000","last_active":"2023-10-06T02:53:16.969905+0000","last_peered":"2023-10-06T02:53:16.969905+0000","last_clean":"2023-10-06T02:53:16.969905+0000","last_became_active":"2023-10-06T02:53:16.967257+0000","last_became_peered":"2023-10-06T02:53:16.967257+0000","last_unstale":"2023-10-06T02:53:16.969905+0000","last_undegraded":"2023-10-06T02:53:16.969905+0000","last_fullsized":"2023-10-06T02:53:16.969905+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:46.513629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963308+0000","last_change":"2023-10-06T02:53:16.963262+0000","last_active":"2023-10-06T02:53:16.963308+0000","last_peered":"2023-10-06T02:53:16.963308+0000","last_clean":"2023-10-06T02:53:16.963308+0000","last_became_active":"2023-10-06T02:53:16.963045+0000","last_became_peered":"2023-10-06T02:53:16.963045+0000","last_unstale":"2023-10-06T02:53:16.963308+0000","last_undegraded":"2023-10-06T02:53:16.963308+0000","last_fullsized":"2023-10-06T02:53:16.963308+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:41.518762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963023+0000","last_change":"2023-10-06T02:53:16.961784+0000","last_active":"2023-10-06T02:53:16.963023+0000","last_peered":"2023-10-06T02:53:16.963023+0000","last_clean":"2023-10-06T02:53:16.963023+0000","last_became_active":"2023-10-06T02:53:16.961539+0000","last_became_peered":"2023-10-06T02:53:16.961539+0000","last_unstale":"2023-10-06T02:53:16.963023+0000","last_undegraded":"2023-10-06T02:53:16.963023+0000","last_fullsized":"2023-10-06T02:53:16.963023+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.959136+0000","last_change":"2023-10-06T02:53:16.959071+0000","last_active":"2023-10-06T02:53:16.959136+0000","last_peered":"2023-10-06T02:53:16.959136+0000","last_clean":"2023-10-06T02:53:16.959136+0000","last_became_active":"2023-10-06T02:53:16.958842+0000","last_became_peered":"2023-10-06T02:53:16.958842+0000","last_unstale":"2023-10-06T02:53:16.959136+0000","last_undegraded":"2023-10-06T02:53:16.959136+0000","last_fullsized":"2023-10-06T02:53:16.959136+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:22.969575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967859+0000","last_change":"2023-10-06T02:53:16.967393+0000","last_active":"2023-10-06T02:53:16.967859+0000","last_peered":"2023-10-06T02:53:16.967859+0000","last_clean":"2023-10-06T02:53:16.967859+0000","last_became_active":"2023-10-06T02:53:16.966986+0000","last_became_peered":"2023-10-06T02:53:16.966986+0000","last_unstale":"2023-10-06T02:53:16.967859+0000","last_undegraded":"2023-10-06T02:53:16.967859+0000","last_fullsized":"2023-10-06T02:53:16.967859+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966469+0000","last_change":"2023-10-06T02:53:16.966402+0000","last_active":"2023-10-06T02:53:16.966469+0000","last_peered":"2023-10-06T02:53:16.966469+0000","last_clean":"2023-10-06T02:53:16.966469+0000","last_became_active":"2023-10-06T02:53:16.966058+0000","last_became_peered":"2023-10-06T02:53:16.966058+0000","last_unstale":"2023-10-06T02:53:16.966469+0000","last_undegraded":"2023-10-06T02:53:16.966469+0000","last_fullsized":"2023-10-06T02:53:16.966469+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966953+0000","last_change":"2023-10-06T02:53:16.966866+0000","last_active":"2023-10-06T02:53:16.966953+0000","last_peered":"2023-10-06T02:53:16.966953+0000","last_clean":"2023-10-06T02:53:16.966953+0000","last_became_active":"2023-10-06T02:53:16.966496+0000","last_became_peered":"2023-10-06T02:53:16.966496+0000","last_unstale":"2023-10-06T02:53:16.966953+0000","last_undegraded":"2023-10-06T02:53:16.966953+0000","last_fullsized":"2023-10-06T02:53:16.966953+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976990+0000","last_change":"2023-10-06T02:53:16.975642+0000","last_active":"2023-10-06T02:53:16.976990+0000","last_peered":"2023-10-06T02:53:16.976990+0000","last_clean":"2023-10-06T02:53:16.976990+0000","last_became_active":"2023-10-06T02:53:16.973199+0000","last_became_peered":"2023-10-06T02:53:16.973199+0000","last_unstale":"2023-10-06T02:53:16.976990+0000","last_undegraded":"2023-10-06T02:53:16.976990+0000","last_fullsized":"2023-10-06T02:53:16.976990+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969966+0000","last_change":"2023-10-06T02:53:16.969752+0000","last_active":"2023-10-06T02:53:16.969966+0000","last_peered":"2023-10-06T02:53:16.969966+0000","last_clean":"2023-10-06T02:53:16.969966+0000","last_became_active":"2023-10-06T02:53:16.969379+0000","last_became_peered":"2023-10-06T02:53:16.969379+0000","last_unstale":"2023-10-06T02:53:16.969966+0000","last_undegraded":"2023-10-06T02:53:16.969966+0000","last_fullsized":"2023-10-06T02:53:16.969966+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:05.498811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964799+0000","last_change":"2023-10-06T02:53:16.964735+0000","last_active":"2023-10-06T02:53:16.964799+0000","last_peered":"2023-10-06T02:53:16.964799+0000","last_clean":"2023-10-06T02:53:16.964799+0000","last_became_active":"2023-10-06T02:53:16.963476+0000","last_became_peered":"2023-10-06T02:53:16.963476+0000","last_unstale":"2023-10-06T02:53:16.964799+0000","last_undegraded":"2023-10-06T02:53:16.964799+0000","last_fullsized":"2023-10-06T02:53:16.964799+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:53.420838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963196+0000","last_change":"2023-10-06T02:53:16.962948+0000","last_active":"2023-10-06T02:53:16.963196+0000","last_peered":"2023-10-06T02:53:16.963196+0000","last_clean":"2023-10-06T02:53:16.963196+0000","last_became_active":"2023-10-06T02:53:16.962663+0000","last_became_peered":"2023-10-06T02:53:16.962663+0000","last_unstale":"2023-10-06T02:53:16.963196+0000","last_undegraded":"2023-10-06T02:53:16.963196+0000","last_fullsized":"2023-10-06T02:53:16.963196+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:41.426949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966782+0000","last_change":"2023-10-06T02:53:16.966720+0000","last_active":"2023-10-06T02:53:16.966782+0000","last_peered":"2023-10-06T02:53:16.966782+0000","last_clean":"2023-10-06T02:53:16.966782+0000","last_became_active":"2023-10-06T02:53:16.966199+0000","last_became_peered":"2023-10-06T02:53:16.966199+0000","last_unstale":"2023-10-06T02:53:16.966782+0000","last_undegraded":"2023-10-06T02:53:16.966782+0000","last_fullsized":"2023-10-06T02:53:16.966782+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:55.689525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965787+0000","last_change":"2023-10-06T02:53:16.965661+0000","last_active":"2023-10-06T02:53:16.965787+0000","last_peered":"2023-10-06T02:53:16.965787+0000","last_clean":"2023-10-06T02:53:16.965787+0000","last_became_active":"2023-10-06T02:53:16.965228+0000","last_became_peered":"2023-10-06T02:53:16.965228+0000","last_unstale":"2023-10-06T02:53:16.965787+0000","last_undegraded":"2023-10-06T02:53:16.965787+0000","last_fullsized":"2023-10-06T02:53:16.965787+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:34.346782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.963965+0000","last_change":"2023-10-06T02:53:16.963678+0000","last_active":"2023-10-06T02:53:16.963965+0000","last_peered":"2023-10-06T02:53:16.963965+0000","last_clean":"2023-10-06T02:53:16.963965+0000","last_became_active":"2023-10-06T02:53:16.963392+0000","last_became_peered":"2023-10-06T02:53:16.963392+0000","last_unstale":"2023-10-06T02:53:16.963965+0000","last_undegraded":"2023-10-06T02:53:16.963965+0000","last_fullsized":"2023-10-06T02:53:16.963965+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:32.301009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972994+0000","last_change":"2023-10-06T02:53:16.972929+0000","last_active":"2023-10-06T02:53:16.972994+0000","last_peered":"2023-10-06T02:53:16.972994+0000","last_clean":"2023-10-06T02:53:16.972994+0000","last_became_active":"2023-10-06T02:53:16.972683+0000","last_became_peered":"2023-10-06T02:53:16.972683+0000","last_unstale":"2023-10-06T02:53:16.972994+0000","last_undegraded":"2023-10-06T02:53:16.972994+0000","last_fullsized":"2023-10-06T02:53:16.972994+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"150'4","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.977836+0000","last_change":"2023-10-06T02:53:15.952620+0000","last_active":"2023-10-06T02:53:16.977836+0000","last_peered":"2023-10-06T02:53:16.977836+0000","last_clean":"2023-10-06T02:53:16.977836+0000","last_became_active":"2023-10-06T02:53:15.952241+0000","last_became_peered":"2023-10-06T02:53:15.952241+0000","last_unstale":"2023-10-06T02:53:16.977836+0000","last_undegraded":"2023-10-06T02:53:16.977836+0000","last_fullsized":"2023-10-06T02:53:16.977836+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:21.071442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958609+0000","last_change":"2023-10-06T02:53:16.958551+0000","last_active":"2023-10-06T02:53:16.958609+0000","last_peered":"2023-10-06T02:53:16.958609+0000","last_clean":"2023-10-06T02:53:16.958609+0000","last_became_active":"2023-10-06T02:53:16.958327+0000","last_became_peered":"2023-10-06T02:53:16.958327+0000","last_unstale":"2023-10-06T02:53:16.958609+0000","last_undegraded":"2023-10-06T02:53:16.958609+0000","last_fullsized":"2023-10-06T02:53:16.958609+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:14.993106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.970305+0000","last_change":"2023-10-06T02:53:15.950606+0000","last_active":"2023-10-06T02:53:16.970305+0000","last_peered":"2023-10-06T02:53:16.970305+0000","last_clean":"2023-10-06T02:53:16.970305+0000","last_became_active":"2023-10-06T02:53:15.950220+0000","last_became_peered":"2023-10-06T02:53:15.950220+0000","last_unstale":"2023-10-06T02:53:16.970305+0000","last_undegraded":"2023-10-06T02:53:16.970305+0000","last_fullsized":"2023-10-06T02:53:16.970305+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967841+0000","last_change":"2023-10-06T02:53:16.967246+0000","last_active":"2023-10-06T02:53:16.967841+0000","last_peered":"2023-10-06T02:53:16.967841+0000","last_clean":"2023-10-06T02:53:16.967841+0000","last_became_active":"2023-10-06T02:53:16.966700+0000","last_became_peered":"2023-10-06T02:53:16.966700+0000","last_unstale":"2023-10-06T02:53:16.967841+0000","last_undegraded":"2023-10-06T02:53:16.967841+0000","last_fullsized":"2023-10-06T02:53:16.967841+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:26.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972919+0000","last_change":"2023-10-06T02:53:15.955289+0000","last_active":"2023-10-06T02:53:16.972919+0000","last_peered":"2023-10-06T02:53:16.972919+0000","last_clean":"2023-10-06T02:53:16.972919+0000","last_became_active":"2023-10-06T02:53:15.954958+0000","last_became_peered":"2023-10-06T02:53:15.954958+0000","last_unstale":"2023-10-06T02:53:16.972919+0000","last_undegraded":"2023-10-06T02:53:16.972919+0000","last_fullsized":"2023-10-06T02:53:16.972919+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969429+0000","last_change":"2023-10-06T02:53:16.969370+0000","last_active":"2023-10-06T02:53:16.969429+0000","last_peered":"2023-10-06T02:53:16.969429+0000","last_clean":"2023-10-06T02:53:16.969429+0000","last_became_active":"2023-10-06T02:53:16.969142+0000","last_became_peered":"2023-10-06T02:53:16.969142+0000","last_unstale":"2023-10-06T02:53:16.969429+0000","last_undegraded":"2023-10-06T02:53:16.969429+0000","last_fullsized":"2023-10-06T02:53:16.969429+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:09.738869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.973929+0000","last_change":"2023-10-06T02:53:15.953447+0000","last_active":"2023-10-06T02:53:16.973929+0000","last_peered":"2023-10-06T02:53:16.973929+0000","last_clean":"2023-10-06T02:53:16.973929+0000","last_became_active":"2023-10-06T02:53:15.952891+0000","last_became_peered":"2023-10-06T02:53:15.952891+0000","last_unstale":"2023-10-06T02:53:16.973929+0000","last_undegraded":"2023-10-06T02:53:16.973929+0000","last_fullsized":"2023-10-06T02:53:16.973929+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:54.684669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965769+0000","last_change":"2023-10-06T02:53:16.965476+0000","last_active":"2023-10-06T02:53:16.965769+0000","last_peered":"2023-10-06T02:53:16.965769+0000","last_clean":"2023-10-06T02:53:16.965769+0000","last_became_active":"2023-10-06T02:53:16.964920+0000","last_became_peered":"2023-10-06T02:53:16.964920+0000","last_unstale":"2023-10-06T02:53:16.965769+0000","last_undegraded":"2023-10-06T02:53:16.965769+0000","last_fullsized":"2023-10-06T02:53:16.965769+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.973144+0000","last_change":"2023-10-06T02:53:15.950593+0000","last_active":"2023-10-06T02:53:16.973144+0000","last_peered":"2023-10-06T02:53:16.973144+0000","last_clean":"2023-10-06T02:53:16.973144+0000","last_became_active":"2023-10-06T02:53:15.950349+0000","last_became_peered":"2023-10-06T02:53:15.950349+0000","last_unstale":"2023-10-06T02:53:16.973144+0000","last_undegraded":"2023-10-06T02:53:16.973144+0000","last_fullsized":"2023-10-06T02:53:16.973144+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967229+0000","last_change":"2023-10-06T02:53:16.967101+0000","last_active":"2023-10-06T02:53:16.967229+0000","last_peered":"2023-10-06T02:53:16.967229+0000","last_clean":"2023-10-06T02:53:16.967229+0000","last_became_active":"2023-10-06T02:53:16.966822+0000","last_became_peered":"2023-10-06T02:53:16.966822+0000","last_unstale":"2023-10-06T02:53:16.967229+0000","last_undegraded":"2023-10-06T02:53:16.967229+0000","last_fullsized":"2023-10-06T02:53:16.967229+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:51.215442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972256+0000","last_change":"2023-10-06T02:53:15.950422+0000","last_active":"2023-10-06T02:53:16.972256+0000","last_peered":"2023-10-06T02:53:16.972256+0000","last_clean":"2023-10-06T02:53:16.972256+0000","last_became_active":"2023-10-06T02:53:15.950180+0000","last_became_peered":"2023-10-06T02:53:15.950180+0000","last_unstale":"2023-10-06T02:53:16.972256+0000","last_undegraded":"2023-10-06T02:53:16.972256+0000","last_fullsized":"2023-10-06T02:53:16.972256+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:33.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964854+0000","last_change":"2023-10-06T02:53:16.964266+0000","last_active":"2023-10-06T02:53:16.964854+0000","last_peered":"2023-10-06T02:53:16.964854+0000","last_clean":"2023-10-06T02:53:16.964854+0000","last_became_active":"2023-10-06T02:53:16.963911+0000","last_became_peered":"2023-10-06T02:53:16.963911+0000","last_unstale":"2023-10-06T02:53:16.964854+0000","last_undegraded":"2023-10-06T02:53:16.964854+0000","last_fullsized":"2023-10-06T02:53:16.964854+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:12.395339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958446+0000","last_change":"2023-10-06T02:53:15.949331+0000","last_active":"2023-10-06T02:53:16.958446+0000","last_peered":"2023-10-06T02:53:16.958446+0000","last_clean":"2023-10-06T02:53:16.958446+0000","last_became_active":"2023-10-06T02:53:15.949073+0000","last_became_peered":"2023-10-06T02:53:15.949073+0000","last_unstale":"2023-10-06T02:53:16.958446+0000","last_undegraded":"2023-10-06T02:53:16.958446+0000","last_fullsized":"2023-10-06T02:53:16.958446+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:10.217520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969925+0000","last_change":"2023-10-06T02:53:16.969024+0000","last_active":"2023-10-06T02:53:16.969925+0000","last_peered":"2023-10-06T02:53:16.969925+0000","last_clean":"2023-10-06T02:53:16.969925+0000","last_became_active":"2023-10-06T02:53:16.968755+0000","last_became_peered":"2023-10-06T02:53:16.968755+0000","last_unstale":"2023-10-06T02:53:16.969925+0000","last_undegraded":"2023-10-06T02:53:16.969925+0000","last_fullsized":"2023-10-06T02:53:16.969925+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:04.547121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960775+0000","last_change":"2023-10-06T02:53:15.948938+0000","last_active":"2023-10-06T02:53:16.960775+0000","last_peered":"2023-10-06T02:53:16.960775+0000","last_clean":"2023-10-06T02:53:16.960775+0000","last_became_active":"2023-10-06T02:53:15.947646+0000","last_became_peered":"2023-10-06T02:53:15.947646+0000","last_unstale":"2023-10-06T02:53:16.960775+0000","last_undegraded":"2023-10-06T02:53:16.960775+0000","last_fullsized":"2023-10-06T02:53:16.960775+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:51.518352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962242+0000","last_change":"2023-10-06T02:53:16.962119+0000","last_active":"2023-10-06T02:53:16.962242+0000","last_peered":"2023-10-06T02:53:16.962242+0000","last_clean":"2023-10-06T02:53:16.962242+0000","last_became_active":"2023-10-06T02:53:16.961857+0000","last_became_peered":"2023-10-06T02:53:16.961857+0000","last_unstale":"2023-10-06T02:53:16.962242+0000","last_undegraded":"2023-10-06T02:53:16.962242+0000","last_fullsized":"2023-10-06T02:53:16.962242+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:16.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969878+0000","last_change":"2023-10-06T02:53:15.950371+0000","last_active":"2023-10-06T02:53:16.969878+0000","last_peered":"2023-10-06T02:53:16.969878+0000","last_clean":"2023-10-06T02:53:16.969878+0000","last_became_active":"2023-10-06T02:53:15.950141+0000","last_became_peered":"2023-10-06T02:53:15.950141+0000","last_unstale":"2023-10-06T02:53:16.969878+0000","last_undegraded":"2023-10-06T02:53:16.969878+0000","last_fullsized":"2023-10-06T02:53:16.969878+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.970604+0000","last_change":"2023-10-06T02:53:16.970531+0000","last_active":"2023-10-06T02:53:16.970604+0000","last_peered":"2023-10-06T02:53:16.970604+0000","last_clean":"2023-10-06T02:53:16.970604+0000","last_became_active":"2023-10-06T02:53:16.970120+0000","last_became_peered":"2023-10-06T02:53:16.970120+0000","last_unstale":"2023-10-06T02:53:16.970604+0000","last_undegraded":"2023-10-06T02:53:16.970604+0000","last_fullsized":"2023-10-06T02:53:16.970604+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:10.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976947+0000","last_change":"2023-10-06T02:53:15.949084+0000","last_active":"2023-10-06T02:53:16.976947+0000","last_peered":"2023-10-06T02:53:16.976947+0000","last_clean":"2023-10-06T02:53:16.976947+0000","last_became_active":"2023-10-06T02:53:15.947986+0000","last_became_peered":"2023-10-06T02:53:15.947986+0000","last_unstale":"2023-10-06T02:53:16.976947+0000","last_undegraded":"2023-10-06T02:53:16.976947+0000","last_fullsized":"2023-10-06T02:53:16.976947+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:49.756550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969869+0000","last_change":"2023-10-06T02:53:16.967480+0000","last_active":"2023-10-06T02:53:16.969869+0000","last_peered":"2023-10-06T02:53:16.969869+0000","last_clean":"2023-10-06T02:53:16.969869+0000","last_became_active":"2023-10-06T02:53:16.966567+0000","last_became_peered":"2023-10-06T02:53:16.966567+0000","last_unstale":"2023-10-06T02:53:16.969869+0000","last_undegraded":"2023-10-06T02:53:16.969869+0000","last_fullsized":"2023-10-06T02:53:16.969869+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:08.537334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.971093+0000","last_change":"2023-10-06T02:53:15.947587+0000","last_active":"2023-10-06T02:53:16.971093+0000","last_peered":"2023-10-06T02:53:16.971093+0000","last_clean":"2023-10-06T02:53:16.971093+0000","last_became_active":"2023-10-06T02:53:15.947298+0000","last_became_peered":"2023-10-06T02:53:15.947298+0000","last_unstale":"2023-10-06T02:53:16.971093+0000","last_undegraded":"2023-10-06T02:53:16.971093+0000","last_fullsized":"2023-10-06T02:53:16.971093+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968149+0000","last_change":"2023-10-06T02:53:16.968021+0000","last_active":"2023-10-06T02:53:16.968149+0000","last_peered":"2023-10-06T02:53:16.968149+0000","last_clean":"2023-10-06T02:53:16.968149+0000","last_became_active":"2023-10-06T02:53:16.967741+0000","last_became_peered":"2023-10-06T02:53:16.967741+0000","last_unstale":"2023-10-06T02:53:16.968149+0000","last_undegraded":"2023-10-06T02:53:16.968149+0000","last_fullsized":"2023-10-06T02:53:16.968149+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:59.865832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.957202+0000","last_change":"2023-10-06T02:53:15.942574+0000","last_active":"2023-10-06T02:53:16.957202+0000","last_peered":"2023-10-06T02:53:16.957202+0000","last_clean":"2023-10-06T02:53:16.957202+0000","last_became_active":"2023-10-06T02:53:15.942392+0000","last_became_peered":"2023-10-06T02:53:15.942392+0000","last_unstale":"2023-10-06T02:53:16.957202+0000","last_undegraded":"2023-10-06T02:53:16.957202+0000","last_fullsized":"2023-10-06T02:53:16.957202+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962601+0000","last_change":"2023-10-06T02:53:16.962545+0000","last_active":"2023-10-06T02:53:16.962601+0000","last_peered":"2023-10-06T02:53:16.962601+0000","last_clean":"2023-10-06T02:53:16.962601+0000","last_became_active":"2023-10-06T02:53:16.961760+0000","last_became_peered":"2023-10-06T02:53:16.961760+0000","last_unstale":"2023-10-06T02:53:16.962601+0000","last_undegraded":"2023-10-06T02:53:16.962601+0000","last_fullsized":"2023-10-06T02:53:16.962601+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:46.513629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.977129+0000","last_change":"2023-10-06T02:53:15.950485+0000","last_active":"2023-10-06T02:53:16.977129+0000","last_peered":"2023-10-06T02:53:16.977129+0000","last_clean":"2023-10-06T02:53:16.977129+0000","last_became_active":"2023-10-06T02:53:15.949974+0000","last_became_peered":"2023-10-06T02:53:15.949974+0000","last_unstale":"2023-10-06T02:53:16.977129+0000","last_undegraded":"2023-10-06T02:53:16.977129+0000","last_fullsized":"2023-10-06T02:53:16.977129+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:30.739583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.972565+0000","last_change":"2023-10-06T02:53:16.972515+0000","last_active":"2023-10-06T02:53:16.972565+0000","last_peered":"2023-10-06T02:53:16.972565+0000","last_clean":"2023-10-06T02:53:16.972565+0000","last_became_active":"2023-10-06T02:53:16.972336+0000","last_became_peered":"2023-10-06T02:53:16.972336+0000","last_unstale":"2023-10-06T02:53:16.972565+0000","last_undegraded":"2023-10-06T02:53:16.972565+0000","last_fullsized":"2023-10-06T02:53:16.972565+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:19.731691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.954937+0000","last_change":"2023-10-06T02:53:15.951410+0000","last_active":"2023-10-06T02:53:16.954937+0000","last_peered":"2023-10-06T02:53:16.954937+0000","last_clean":"2023-10-06T02:53:16.954937+0000","last_became_active":"2023-10-06T02:53:15.950897+0000","last_became_peered":"2023-10-06T02:53:15.950897+0000","last_unstale":"2023-10-06T02:53:16.954937+0000","last_undegraded":"2023-10-06T02:53:16.954937+0000","last_fullsized":"2023-10-06T02:53:16.954937+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:35.524955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969475+0000","last_change":"2023-10-06T02:53:16.969425+0000","last_active":"2023-10-06T02:53:16.969475+0000","last_peered":"2023-10-06T02:53:16.969475+0000","last_clean":"2023-10-06T02:53:16.969475+0000","last_became_active":"2023-10-06T02:53:16.969225+0000","last_became_peered":"2023-10-06T02:53:16.969225+0000","last_unstale":"2023-10-06T02:53:16.969475+0000","last_undegraded":"2023-10-06T02:53:16.969475+0000","last_fullsized":"2023-10-06T02:53:16.969475+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:41.007295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960075+0000","last_change":"2023-10-06T02:53:15.953249+0000","last_active":"2023-10-06T02:53:16.960075+0000","last_peered":"2023-10-06T02:53:16.960075+0000","last_clean":"2023-10-06T02:53:16.960075+0000","last_became_active":"2023-10-06T02:53:15.953058+0000","last_became_peered":"2023-10-06T02:53:15.953058+0000","last_unstale":"2023-10-06T02:53:16.960075+0000","last_undegraded":"2023-10-06T02:53:16.960075+0000","last_fullsized":"2023-10-06T02:53:16.960075+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:39.540611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.970099+0000","last_change":"2023-10-06T02:53:16.970013+0000","last_active":"2023-10-06T02:53:16.970099+0000","last_peered":"2023-10-06T02:53:16.970099+0000","last_clean":"2023-10-06T02:53:16.970099+0000","last_became_active":"2023-10-06T02:53:16.969600+0000","last_became_peered":"2023-10-06T02:53:16.969600+0000","last_unstale":"2023-10-06T02:53:16.970099+0000","last_undegraded":"2023-10-06T02:53:16.970099+0000","last_fullsized":"2023-10-06T02:53:16.970099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960727+0000","last_change":"2023-10-06T02:53:15.949459+0000","last_active":"2023-10-06T02:53:16.960727+0000","last_peered":"2023-10-06T02:53:16.960727+0000","last_clean":"2023-10-06T02:53:16.960727+0000","last_became_active":"2023-10-06T02:53:15.949233+0000","last_became_peered":"2023-10-06T02:53:15.949233+0000","last_unstale":"2023-10-06T02:53:16.960727+0000","last_undegraded":"2023-10-06T02:53:16.960727+0000","last_fullsized":"2023-10-06T02:53:16.960727+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:32.966190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964209+0000","last_change":"2023-10-06T02:53:16.964131+0000","last_active":"2023-10-06T02:53:16.964209+0000","last_peered":"2023-10-06T02:53:16.964209+0000","last_clean":"2023-10-06T02:53:16.964209+0000","last_became_active":"2023-10-06T02:53:16.962427+0000","last_became_peered":"2023-10-06T02:53:16.962427+0000","last_unstale":"2023-10-06T02:53:16.964209+0000","last_undegraded":"2023-10-06T02:53:16.964209+0000","last_fullsized":"2023-10-06T02:53:16.964209+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:05.498811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.971456+0000","last_change":"2023-10-06T02:53:15.953568+0000","last_active":"2023-10-06T02:53:16.971456+0000","last_peered":"2023-10-06T02:53:16.971456+0000","last_clean":"2023-10-06T02:53:16.971456+0000","last_became_active":"2023-10-06T02:53:15.952663+0000","last_became_peered":"2023-10-06T02:53:15.952663+0000","last_unstale":"2023-10-06T02:53:16.971456+0000","last_undegraded":"2023-10-06T02:53:16.971456+0000","last_fullsized":"2023-10-06T02:53:16.971456+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:42.266244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968464+0000","last_change":"2023-10-06T02:53:16.967928+0000","last_active":"2023-10-06T02:53:16.968464+0000","last_peered":"2023-10-06T02:53:16.968464+0000","last_clean":"2023-10-06T02:53:16.968464+0000","last_became_active":"2023-10-06T02:53:16.967705+0000","last_became_peered":"2023-10-06T02:53:16.967705+0000","last_unstale":"2023-10-06T02:53:16.968464+0000","last_undegraded":"2023-10-06T02:53:16.968464+0000","last_fullsized":"2023-10-06T02:53:16.968464+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:51.895407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:53:18.049378+0000","last_change":"2023-10-06T02:53:15.951083+0000","last_active":"2023-10-06T02:53:18.049378+0000","last_peered":"2023-10-06T02:53:18.049378+0000","last_clean":"2023-10-06T02:53:18.049378+0000","last_became_active":"2023-10-06T02:53:15.950728+0000","last_became_peered":"2023-10-06T02:53:15.950728+0000","last_unstale":"2023-10-06T02:53:18.049378+0000","last_undegraded":"2023-10-06T02:53:18.049378+0000","last_fullsized":"2023-10-06T02:53:18.049378+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.974842+0000","last_change":"2023-10-06T02:53:16.974765+0000","last_active":"2023-10-06T02:53:16.974842+0000","last_peered":"2023-10-06T02:53:16.974842+0000","last_clean":"2023-10-06T02:53:16.974842+0000","last_became_active":"2023-10-06T02:53:16.974120+0000","last_became_peered":"2023-10-06T02:53:16.974120+0000","last_unstale":"2023-10-06T02:53:16.974842+0000","last_undegraded":"2023-10-06T02:53:16.974842+0000","last_fullsized":"2023-10-06T02:53:16.974842+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:41.518762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960569+0000","last_change":"2023-10-06T02:53:15.951578+0000","last_active":"2023-10-06T02:53:16.960569+0000","last_peered":"2023-10-06T02:53:16.960569+0000","last_clean":"2023-10-06T02:53:16.960569+0000","last_became_active":"2023-10-06T02:53:15.951350+0000","last_became_peered":"2023-10-06T02:53:15.951350+0000","last_unstale":"2023-10-06T02:53:16.960569+0000","last_undegraded":"2023-10-06T02:53:16.960569+0000","last_fullsized":"2023-10-06T02:53:16.960569+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:15.781730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.966124+0000","last_change":"2023-10-06T02:53:16.966089+0000","last_active":"2023-10-06T02:53:16.966124+0000","last_peered":"2023-10-06T02:53:16.966124+0000","last_clean":"2023-10-06T02:53:16.966124+0000","last_became_active":"2023-10-06T02:53:16.965908+0000","last_became_peered":"2023-10-06T02:53:16.965908+0000","last_unstale":"2023-10-06T02:53:16.966124+0000","last_undegraded":"2023-10-06T02:53:16.966124+0000","last_fullsized":"2023-10-06T02:53:16.966124+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:25.447041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960533+0000","last_change":"2023-10-06T02:53:15.951271+0000","last_active":"2023-10-06T02:53:16.960533+0000","last_peered":"2023-10-06T02:53:16.960533+0000","last_clean":"2023-10-06T02:53:16.960533+0000","last_became_active":"2023-10-06T02:53:15.951044+0000","last_became_peered":"2023-10-06T02:53:15.951044+0000","last_unstale":"2023-10-06T02:53:16.960533+0000","last_undegraded":"2023-10-06T02:53:16.960533+0000","last_fullsized":"2023-10-06T02:53:16.960533+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.965604+0000","last_change":"2023-10-06T02:53:16.965535+0000","last_active":"2023-10-06T02:53:16.965604+0000","last_peered":"2023-10-06T02:53:16.965604+0000","last_clean":"2023-10-06T02:53:16.965604+0000","last_became_active":"2023-10-06T02:53:16.965277+0000","last_became_peered":"2023-10-06T02:53:16.965277+0000","last_unstale":"2023-10-06T02:53:16.965604+0000","last_undegraded":"2023-10-06T02:53:16.965604+0000","last_fullsized":"2023-10-06T02:53:16.965604+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:40.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956540+0000","last_change":"2023-10-06T02:53:15.954250+0000","last_active":"2023-10-06T02:53:16.956540+0000","last_peered":"2023-10-06T02:53:16.956540+0000","last_clean":"2023-10-06T02:53:16.956540+0000","last_became_active":"2023-10-06T02:53:15.951275+0000","last_became_peered":"2023-10-06T02:53:15.951275+0000","last_unstale":"2023-10-06T02:53:16.956540+0000","last_undegraded":"2023-10-06T02:53:16.956540+0000","last_fullsized":"2023-10-06T02:53:16.956540+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:18.790703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.961320+0000","last_change":"2023-10-06T02:53:16.961253+0000","last_active":"2023-10-06T02:53:16.961320+0000","last_peered":"2023-10-06T02:53:16.961320+0000","last_clean":"2023-10-06T02:53:16.961320+0000","last_became_active":"2023-10-06T02:53:16.960689+0000","last_became_peered":"2023-10-06T02:53:16.960689+0000","last_unstale":"2023-10-06T02:53:16.961320+0000","last_undegraded":"2023-10-06T02:53:16.961320+0000","last_fullsized":"2023-10-06T02:53:16.961320+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:06.183443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962407+0000","last_change":"2023-10-06T02:53:15.955738+0000","last_active":"2023-10-06T02:53:16.962407+0000","last_peered":"2023-10-06T02:53:16.962407+0000","last_clean":"2023-10-06T02:53:16.962407+0000","last_became_active":"2023-10-06T02:53:15.955524+0000","last_became_peered":"2023-10-06T02:53:15.955524+0000","last_unstale":"2023-10-06T02:53:16.962407+0000","last_undegraded":"2023-10-06T02:53:16.962407+0000","last_fullsized":"2023-10-06T02:53:16.962407+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:30.555145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.971213+0000","last_change":"2023-10-06T02:53:16.971168+0000","last_active":"2023-10-06T02:53:16.971213+0000","last_peered":"2023-10-06T02:53:16.971213+0000","last_clean":"2023-10-06T02:53:16.971213+0000","last_became_active":"2023-10-06T02:53:16.970855+0000","last_became_peered":"2023-10-06T02:53:16.970855+0000","last_unstale":"2023-10-06T02:53:16.971213+0000","last_undegraded":"2023-10-06T02:53:16.971213+0000","last_fullsized":"2023-10-06T02:53:16.971213+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:51.951868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960018+0000","last_change":"2023-10-06T02:53:15.951067+0000","last_active":"2023-10-06T02:53:16.960018+0000","last_peered":"2023-10-06T02:53:16.960018+0000","last_clean":"2023-10-06T02:53:16.960018+0000","last_became_active":"2023-10-06T02:53:15.950869+0000","last_became_peered":"2023-10-06T02:53:15.950869+0000","last_unstale":"2023-10-06T02:53:16.960018+0000","last_undegraded":"2023-10-06T02:53:16.960018+0000","last_fullsized":"2023-10-06T02:53:16.960018+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:28.225161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.974823+0000","last_change":"2023-10-06T02:53:16.974624+0000","last_active":"2023-10-06T02:53:16.974823+0000","last_peered":"2023-10-06T02:53:16.974823+0000","last_clean":"2023-10-06T02:53:16.974823+0000","last_became_active":"2023-10-06T02:53:16.973753+0000","last_became_peered":"2023-10-06T02:53:16.973753+0000","last_unstale":"2023-10-06T02:53:16.974823+0000","last_undegraded":"2023-10-06T02:53:16.974823+0000","last_fullsized":"2023-10-06T02:53:16.974823+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:12.395339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956720+0000","last_change":"2023-10-06T02:53:15.948960+0000","last_active":"2023-10-06T02:53:16.956720+0000","last_peered":"2023-10-06T02:53:16.956720+0000","last_clean":"2023-10-06T02:53:16.956720+0000","last_became_active":"2023-10-06T02:53:15.947980+0000","last_became_peered":"2023-10-06T02:53:15.947980+0000","last_unstale":"2023-10-06T02:53:16.956720+0000","last_undegraded":"2023-10-06T02:53:16.956720+0000","last_fullsized":"2023-10-06T02:53:16.956720+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968548+0000","last_change":"2023-10-06T02:53:16.968480+0000","last_active":"2023-10-06T02:53:16.968548+0000","last_peered":"2023-10-06T02:53:16.968548+0000","last_clean":"2023-10-06T02:53:16.968548+0000","last_became_active":"2023-10-06T02:53:16.968166+0000","last_became_peered":"2023-10-06T02:53:16.968166+0000","last_unstale":"2023-10-06T02:53:16.968548+0000","last_undegraded":"2023-10-06T02:53:16.968548+0000","last_fullsized":"2023-10-06T02:53:16.968548+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:41.921643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"150'3","reported_seq":13,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.977388+0000","last_change":"2023-10-06T02:53:15.954832+0000","last_active":"2023-10-06T02:53:16.977388+0000","last_peered":"2023-10-06T02:53:16.977388+0000","last_clean":"2023-10-06T02:53:16.977388+0000","last_became_active":"2023-10-06T02:53:15.954616+0000","last_became_peered":"2023-10-06T02:53:15.954616+0000","last_unstale":"2023-10-06T02:53:16.977388+0000","last_undegraded":"2023-10-06T02:53:16.977388+0000","last_fullsized":"2023-10-06T02:53:16.977388+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:40.422094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960595+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:53:16.960595+0000","last_peered":"2023-10-06T02:53:16.960595+0000","last_clean":"2023-10-06T02:53:16.960595+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:53:16.960595+0000","last_undegraded":"2023-10-06T02:53:16.960595+0000","last_fullsized":"2023-10-06T02:53:16.960595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.959080+0000","last_change":"2023-10-06T02:53:16.959024+0000","last_active":"2023-10-06T02:53:16.959080+0000","last_peered":"2023-10-06T02:53:16.959080+0000","last_clean":"2023-10-06T02:53:16.959080+0000","last_became_active":"2023-10-06T02:53:16.958803+0000","last_became_peered":"2023-10-06T02:53:16.958803+0000","last_unstale":"2023-10-06T02:53:16.959080+0000","last_undegraded":"2023-10-06T02:53:16.959080+0000","last_fullsized":"2023-10-06T02:53:16.959080+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.758775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968509+0000","last_change":"2023-10-06T02:53:15.951215+0000","last_active":"2023-10-06T02:53:16.968509+0000","last_peered":"2023-10-06T02:53:16.968509+0000","last_clean":"2023-10-06T02:53:16.968509+0000","last_became_active":"2023-10-06T02:53:15.951002+0000","last_became_peered":"2023-10-06T02:53:15.951002+0000","last_unstale":"2023-10-06T02:53:16.968509+0000","last_undegraded":"2023-10-06T02:53:16.968509+0000","last_fullsized":"2023-10-06T02:53:16.968509+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:36.226855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956730+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:53:16.956730+0000","last_peered":"2023-10-06T02:53:16.956730+0000","last_clean":"2023-10-06T02:53:16.956730+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:53:16.956730+0000","last_undegraded":"2023-10-06T02:53:16.956730+0000","last_fullsized":"2023-10-06T02:53:16.956730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.962731+0000","last_change":"2023-10-06T02:53:16.962591+0000","last_active":"2023-10-06T02:53:16.962731+0000","last_peered":"2023-10-06T02:53:16.962731+0000","last_clean":"2023-10-06T02:53:16.962731+0000","last_became_active":"2023-10-06T02:53:16.962298+0000","last_became_peered":"2023-10-06T02:53:16.962298+0000","last_unstale":"2023-10-06T02:53:16.962731+0000","last_undegraded":"2023-10-06T02:53:16.962731+0000","last_fullsized":"2023-10-06T02:53:16.962731+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:10.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"150'8","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976120+0000","last_change":"2023-10-06T02:53:15.949900+0000","last_active":"2023-10-06T02:53:16.976120+0000","last_peered":"2023-10-06T02:53:16.976120+0000","last_clean":"2023-10-06T02:53:16.976120+0000","last_became_active":"2023-10-06T02:53:15.949704+0000","last_became_peered":"2023-10-06T02:53:15.949704+0000","last_unstale":"2023-10-06T02:53:16.976120+0000","last_undegraded":"2023-10-06T02:53:16.976120+0000","last_fullsized":"2023-10-06T02:53:16.976120+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:56:51.904359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":127,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.954647+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:53:16.954647+0000","last_peered":"2023-10-06T02:53:16.954647+0000","last_clean":"2023-10-06T02:53:16.954647+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:53:16.954647+0000","last_undegraded":"2023-10-06T02:53:16.954647+0000","last_fullsized":"2023-10-06T02:53:16.954647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.968487+0000","last_change":"2023-10-06T02:53:16.968431+0000","last_active":"2023-10-06T02:53:16.968487+0000","last_peered":"2023-10-06T02:53:16.968487+0000","last_clean":"2023-10-06T02:53:16.968487+0000","last_became_active":"2023-10-06T02:53:16.968164+0000","last_became_peered":"2023-10-06T02:53:16.968164+0000","last_unstale":"2023-10-06T02:53:16.968487+0000","last_undegraded":"2023-10-06T02:53:16.968487+0000","last_fullsized":"2023-10-06T02:53:16.968487+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:31.560000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.967738+0000","last_change":"2023-10-06T02:53:15.953624+0000","last_active":"2023-10-06T02:53:16.967738+0000","last_peered":"2023-10-06T02:53:16.967738+0000","last_clean":"2023-10-06T02:53:16.967738+0000","last_became_active":"2023-10-06T02:53:15.953206+0000","last_became_peered":"2023-10-06T02:53:15.953206+0000","last_unstale":"2023-10-06T02:53:16.967738+0000","last_undegraded":"2023-10-06T02:53:16.967738+0000","last_fullsized":"2023-10-06T02:53:16.967738+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:50.890551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956630+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:53:16.956630+0000","last_peered":"2023-10-06T02:53:16.956630+0000","last_clean":"2023-10-06T02:53:16.956630+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:53:16.956630+0000","last_undegraded":"2023-10-06T02:53:16.956630+0000","last_fullsized":"2023-10-06T02:53:16.956630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960897+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:53:16.960897+0000","last_peered":"2023-10-06T02:53:16.960897+0000","last_clean":"2023-10-06T02:53:16.960897+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:53:16.960897+0000","last_undegraded":"2023-10-06T02:53:16.960897+0000","last_fullsized":"2023-10-06T02:53:16.960897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.969949+0000","last_change":"2023-10-06T02:53:16.969608+0000","last_active":"2023-10-06T02:53:16.969949+0000","last_peered":"2023-10-06T02:53:16.969949+0000","last_clean":"2023-10-06T02:53:16.969949+0000","last_became_active":"2023-10-06T02:53:16.969064+0000","last_became_peered":"2023-10-06T02:53:16.969064+0000","last_unstale":"2023-10-06T02:53:16.969949+0000","last_undegraded":"2023-10-06T02:53:16.969949+0000","last_fullsized":"2023-10-06T02:53:16.969949+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:21.663680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958365+0000","last_change":"2023-10-06T02:53:15.950535+0000","last_active":"2023-10-06T02:53:16.958365+0000","last_peered":"2023-10-06T02:53:16.958365+0000","last_clean":"2023-10-06T02:53:16.958365+0000","last_became_active":"2023-10-06T02:53:15.950353+0000","last_became_peered":"2023-10-06T02:53:15.950353+0000","last_unstale":"2023-10-06T02:53:16.958365+0000","last_undegraded":"2023-10-06T02:53:16.958365+0000","last_fullsized":"2023-10-06T02:53:16.958365+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:04.092161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960809+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:53:16.960809+0000","last_peered":"2023-10-06T02:53:16.960809+0000","last_clean":"2023-10-06T02:53:16.960809+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:53:16.960809+0000","last_undegraded":"2023-10-06T02:53:16.960809+0000","last_fullsized":"2023-10-06T02:53:16.960809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964804+0000","last_change":"2023-10-06T02:53:16.963707+0000","last_active":"2023-10-06T02:53:16.964804+0000","last_peered":"2023-10-06T02:53:16.964804+0000","last_clean":"2023-10-06T02:53:16.964804+0000","last_became_active":"2023-10-06T02:53:16.963473+0000","last_became_peered":"2023-10-06T02:53:16.963473+0000","last_unstale":"2023-10-06T02:53:16.964804+0000","last_undegraded":"2023-10-06T02:53:16.964804+0000","last_fullsized":"2023-10-06T02:53:16.964804+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:40.545467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.976269+0000","last_change":"2023-10-06T02:53:15.951054+0000","last_active":"2023-10-06T02:53:16.976269+0000","last_peered":"2023-10-06T02:53:16.976269+0000","last_clean":"2023-10-06T02:53:16.976269+0000","last_became_active":"2023-10-06T02:53:15.950811+0000","last_became_peered":"2023-10-06T02:53:15.950811+0000","last_unstale":"2023-10-06T02:53:16.976269+0000","last_undegraded":"2023-10-06T02:53:16.976269+0000","last_fullsized":"2023-10-06T02:53:16.976269+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:39.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.961074+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:53:16.961074+0000","last_peered":"2023-10-06T02:53:16.961074+0000","last_clean":"2023-10-06T02:53:16.961074+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:53:16.961074+0000","last_undegraded":"2023-10-06T02:53:16.961074+0000","last_fullsized":"2023-10-06T02:53:16.961074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964822+0000","last_change":"2023-10-06T02:53:16.964708+0000","last_active":"2023-10-06T02:53:16.964822+0000","last_peered":"2023-10-06T02:53:16.964822+0000","last_clean":"2023-10-06T02:53:16.964822+0000","last_became_active":"2023-10-06T02:53:16.964451+0000","last_became_peered":"2023-10-06T02:53:16.964451+0000","last_unstale":"2023-10-06T02:53:16.964822+0000","last_undegraded":"2023-10-06T02:53:16.964822+0000","last_fullsized":"2023-10-06T02:53:16.964822+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:49.624552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.956430+0000","last_change":"2023-10-06T02:53:15.954105+0000","last_active":"2023-10-06T02:53:16.956430+0000","last_peered":"2023-10-06T02:53:16.956430+0000","last_clean":"2023-10-06T02:53:16.956430+0000","last_became_active":"2023-10-06T02:53:15.950962+0000","last_became_peered":"2023-10-06T02:53:15.950962+0000","last_unstale":"2023-10-06T02:53:16.956430+0000","last_undegraded":"2023-10-06T02:53:16.956430+0000","last_fullsized":"2023-10-06T02:53:16.956430+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:55.077617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.960090+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:53:16.960090+0000","last_peered":"2023-10-06T02:53:16.960090+0000","last_clean":"2023-10-06T02:53:16.960090+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:53:16.960090+0000","last_undegraded":"2023-10-06T02:53:16.960090+0000","last_fullsized":"2023-10-06T02:53:16.960090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.964975+0000","last_change":"2023-10-06T02:53:16.964920+0000","last_active":"2023-10-06T02:53:16.964975+0000","last_peered":"2023-10-06T02:53:16.964975+0000","last_clean":"2023-10-06T02:53:16.964975+0000","last_became_active":"2023-10-06T02:53:16.964701+0000","last_became_peered":"2023-10-06T02:53:16.964701+0000","last_unstale":"2023-10-06T02:53:16.964975+0000","last_undegraded":"2023-10-06T02:53:16.964975+0000","last_fullsized":"2023-10-06T02:53:16.964975+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:15.937553+0000","last_clean_scrub_stamp":"2023-10-06T02:53:15.937553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:14.417677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.955165+0000","last_change":"2023-10-06T02:53:15.953695+0000","last_active":"2023-10-06T02:53:16.955165+0000","last_peered":"2023-10-06T02:53:16.955165+0000","last_clean":"2023-10-06T02:53:16.955165+0000","last_became_active":"2023-10-06T02:53:15.953150+0000","last_became_peered":"2023-10-06T02:53:15.953150+0000","last_unstale":"2023-10-06T02:53:16.955165+0000","last_undegraded":"2023-10-06T02:53:16.955165+0000","last_fullsized":"2023-10-06T02:53:16.955165+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:53:14.932698+0000","last_clean_scrub_stamp":"2023-10-06T02:53:14.932698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:26.827466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T02:53:16.958451+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:53:16.958451+0000","last_peered":"2023-10-06T02:53:16.958451+0000","last_clean":"2023-10-06T02:53:16.958451+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:53:16.958451+0000","last_undegraded":"2023-10-06T02:53:16.958451+0000","last_fullsized":"2023-10-06T02:53:16.958451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1445,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193867,"statfs":{"total":200000000,"available":198520307,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":1.393},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.53000000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":1.081},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.52900000000000003},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.72399999999999998,"5min":0.79900000000000004,"15min":1.4710000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.622},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53400000000000003,"15min":0.626},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":4.8129999999999997},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.60299999999999998},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.69599999999999995,"5min":0.78600000000000003,"15min":3.4870000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":2.2349999999999999},"last":0.505}]},{"osd":4,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46600000000000003,"15min":0.45900000000000002},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63200000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.497,"15min":0.49099999999999999},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51200000000000001,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":0.879,"15min":0.879},"last":0.378},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.751,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.39300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.432},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.31900000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199111657,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.60299999999999998},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":2.8650000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.56100000000000005},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.879},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.90500000000000003},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.81599999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.64700000000000002,"5min":1.042,"15min":1.0580000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54500000000000004,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.29499999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.80100000000000005,"15min":1.163},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47499999999999998,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":1.05},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.501,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.86799999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.53700000000000003,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.754,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 02:53:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54100000000000004,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":1.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76400000000000001,"5min":0.78200000000000003,"15min":0.89500000000000002},"last":0.39400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112231,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32000000000000001,"15min":0.313},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.44400000000000001,"5min":0.501,"15min":0.501},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.35499999999999998,"15min":0.33300000000000002},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.51000000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.28799999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33900000000000002,"15min":0.32300000000000001},"min":{"1min":0.23799999999999999,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.48399999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.25},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40400000000000003,"15min":0.38400000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.36399999999999999},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.53800000000000003},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76800000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79800000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:53:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.91400000000000003,"5min":1.006,"15min":1.006},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.61899999999999999,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.88200000000000001},"last":0.62}]}]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1443,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193869,"statfs":{"total":200000000,"available":198521877,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.34499999999999997},"min":{"1min":0.23000000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46500000000000002,"5min":0.58199999999999996,"15min":1.177},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.65400000000000003,"15min":1.3400000000000001},"last":0.442}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33200000000000002,"15min":0.96699999999999997},"min":{"1min":0.217,"5min":0.216,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.56899999999999995,"15min":22.038},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":1.3779999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35299999999999998,"15min":0.35999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.50900000000000001,"5min":0.60399999999999998,"15min":1.1439999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":1.0009999999999999},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.253},"max":{"1min":0.60399999999999998,"5min":0.63300000000000001,"15min":21.942},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75,"5min":0.85499999999999998,"15min":1.9390000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":1.083},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.32900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":11.122999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":1.1599999999999999},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":22.010999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":1.401},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":1.113},"min":{"1min":0.374,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.83599999999999997,"5min":0.91300000000000003,"15min":11.090999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":1.1850000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":21.98},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.425},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.872},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":11.154},"last":0.76900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574939,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199111713,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.183,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.46000000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.186},"max":{"1min":0.501,"5min":0.60199999999999998,"15min":0.60699999999999998},"last":0.27000000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36699999999999999,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48899999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.41299999999999998,"15min":0.38900000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.59299999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.374},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.40400000000000003,"15min":0.39700000000000002},"min":{"1min":0.245,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83599999999999997,"5min":1.056,"15min":1.056},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.312,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55700000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.61699999999999999,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.72099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.59399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86399999999999999,"5min":1.018,"15min":1.2569999999999999},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":1.002,"15min":1.002},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77200000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.624,"15min":0.59499999999999997},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76100000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199110695,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32000000000000001,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.372,"15min":0.33400000000000002},"min":{"1min":0.23100000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35599999999999998,"15min":0.33200000000000002},"min":{"1min":0.249,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.48899999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38100000000000001,"15min":0.34999999999999998},"min":{"1min":0.28100000000000003,"5min":0.23100000000000001,"15min":0.22600000000000001},"max":{"1min":0.496,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.41499999999999998,"15min":0.374},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":0.44,"5min":3.044,"15min":3.044},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39100000000000001,"15min":0.35099999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73699999999999999,"5min":1.446,"15min":2.2120000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":1.327,"15min":2.25},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.67800000000000005},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80500000000000005,"5min":1.268,"15min":1.268},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76400000000000001,"5min":1.218,"15min":1.218},"last":0.748},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38600000000000001},"max":{"1min":0.83699999999999997,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61099999999999999,"15min":0.90600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.36399999999999999},"max":{"1min":0.79800000000000004,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.495,"15min":0.752},"min":{"1min":0.27200000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.67700000000000005,"5min":0.71699999999999997,"15min":5.8949999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.60599999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.221},"max":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":5.3579999999999997},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52300000000000002,"15min":0.78200000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":5.9329999999999998},"last":0.496},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.74099999999999999},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.65900000000000003,"5min":0.80000000000000004,"15min":5.9820000000000002},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":5.4390000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.65700000000000003},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66700000000000004,"5min":0.70499999999999996,"15min":5.3470000000000004},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":3.4100000000000001},"last":0.622},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.60499999999999998},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69899999999999995,"5min":0.77000000000000002,"15min":3.456},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.27500000000000002,"15min":0.245},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.0920000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":1.0489999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72199999999999998,"5min":0.76400000000000001,"15min":0.78400000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.96599999999999997},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":13.173999999999999},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.64700000000000002,"5min":0.747,"15min":0.79100000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.28799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67600000000000005,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65100000000000002,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.30399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68899999999999995,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.72599999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.60599999999999998,"5min":0.747,"15min":0.83799999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76100000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.629}]},{"osd":4,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.252},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69799999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.879,"15min":0.879},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72599999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81799999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70499999999999996}]}]}],"pool_statfs":[]}} 2023-10-06T02:53:25.874 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:53:25.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:53:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.027+0000 7fbd6ae81700 1 Processor -- start 2023-10-06T02:53:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.028+0000 7fbd6ae81700 1 -- start start 2023-10-06T02:53:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.028+0000 7fbd6ae81700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd640b1ef0 0x7fbd6406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.028+0000 7fbd6ae81700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 0x7fbd64163bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.028+0000 7fbd6ae81700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd64068d40 con 0x7fbd6406f4f0 2023-10-06T02:53:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.028+0000 7fbd6ae81700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6415a520 con 0x7fbd640b1ef0 2023-10-06T02:53:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.028+0000 7fbd6ae81700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6406a1e0 con 0x7fbd640b29d0 2023-10-06T02:53:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd69e7f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd640b1ef0 0x7fbd6406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd69e7f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd640b1ef0 0x7fbd6406da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49246/0 (socket says 172.21.15.81:49246) 2023-10-06T02:53:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd6967e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbd6406f4f0 0x7fbd640b22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35890/0 (socket says 172.21.15.81:35890) 2023-10-06T02:53:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd69e7f700 1 -- 172.21.15.81:0/2491334290 learned_addr learned my addr 172.21.15.81:0/2491334290 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd6a680700 1 --2- 172.21.15.81:0/2491334290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 0x7fbd64163bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd69e7f700 1 -- 172.21.15.81:0/2491334290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 msgr2=0x7fbd64163bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd69e7f700 1 --2- 172.21.15.81:0/2491334290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 0x7fbd64163bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd69e7f700 1 -- 172.21.15.81:0/2491334290 >> v1:172.21.15.81:6789/0 conn(0x7fbd6406f4f0 legacy=0x7fbd640b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd69e7f700 1 -- 172.21.15.81:0/2491334290 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6406e2d0 con 0x7fbd640b1ef0 2023-10-06T02:53:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd68e7d700 1 -- 172.21.15.81:0/2491334290 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445379556 0 0) 0x7fbd64068d40 con 0x7fbd6406f4f0 2023-10-06T02:53:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd69e7f700 1 --2- 172.21.15.81:0/2491334290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 0x7fbd6406da20 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fbd600099b0 tx=0x7fbd60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93094befc28e25be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd68e7d700 1 -- 172.21.15.81:0/2491334290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6000b860 con 0x7fbd640b1ef0 2023-10-06T02:53:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd68e7d700 1 -- 172.21.15.81:0/2491334290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6000b9c0 con 0x7fbd640b1ef0 2023-10-06T02:53:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.029+0000 7fbd68e7d700 1 -- 172.21.15.81:0/2491334290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6000bd60 con 0x7fbd640b1ef0 2023-10-06T02:53:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.030+0000 7fbd6ae81700 1 -- 172.21.15.81:0/2491334290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 msgr2=0x7fbd6406da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.030+0000 7fbd6ae81700 1 --2- 172.21.15.81:0/2491334290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 0x7fbd6406da20 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fbd600099b0 tx=0x7fbd60009250 comp rx=0 tx=0).stop 2023-10-06T02:53:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.030+0000 7fbd6ae81700 1 -- 172.21.15.81:0/2491334290 shutdown_connections 2023-10-06T02:53:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.030+0000 7fbd6ae81700 1 --2- 172.21.15.81:0/2491334290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 0x7fbd64163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.030+0000 7fbd6ae81700 1 --2- 172.21.15.81:0/2491334290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 0x7fbd6406da20 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.030+0000 7fbd6ae81700 1 -- 172.21.15.81:0/2491334290 >> 172.21.15.81:0/2491334290 conn(0x7fbd640d0bb0 msgr2=0x7fbd640d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.030+0000 7fbd6ae81700 1 -- 172.21.15.81:0/2491334290 shutdown_connections 2023-10-06T02:53:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.030+0000 7fbd6ae81700 1 -- 172.21.15.81:0/2491334290 wait complete. 2023-10-06T02:53:26.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.031+0000 7fbd6ae81700 1 Processor -- start 2023-10-06T02:53:26.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.031+0000 7fbd6ae81700 1 -- start start 2023-10-06T02:53:26.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6ae81700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6406f4f0 0x7fbd6415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6ae81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 0x7fbd6415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6ae81700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 0x7fbd6415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6ae81700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6415f960 con 0x7fbd640b1ef0 2023-10-06T02:53:26.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6ae81700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6415ea40 con 0x7fbd6406f4f0 2023-10-06T02:53:26.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6ae81700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6415db50 con 0x7fbd640b29d0 2023-10-06T02:53:26.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6967e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 0x7fbd6415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6967e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 0x7fbd6415c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49250/0 (socket says 172.21.15.81:49250) 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6967e700 1 -- 172.21.15.81:0/767408478 learned_addr learned my addr 172.21.15.81:0/767408478 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6a680700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 0x7fbd6415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd69e7f700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6406f4f0 0x7fbd6415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6967e700 1 -- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 msgr2=0x7fbd6415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6967e700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 0x7fbd6415ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6967e700 1 -- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6406f4f0 msgr2=0x7fbd6415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6967e700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6406f4f0 0x7fbd6415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6967e700 1 -- 172.21.15.81:0/767408478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600094f0 con 0x7fbd640b1ef0 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6967e700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 0x7fbd6415c8b0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400c5b0 tx=0x7fbd54001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:26.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd59ffb700 1 -- 172.21.15.81:0/767408478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54005a70 con 0x7fbd640b1ef0 2023-10-06T02:53:26.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd59ffb700 1 -- 172.21.15.81:0/767408478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd54005bd0 con 0x7fbd640b1ef0 2023-10-06T02:53:26.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd59ffb700 1 -- 172.21.15.81:0/767408478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd540070d0 con 0x7fbd640b1ef0 2023-10-06T02:53:26.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6415de30 con 0x7fbd640b1ef0 2023-10-06T02:53:26.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.032+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6415e3f0 con 0x7fbd640b1ef0 2023-10-06T02:53:26.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.033+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd64067b70 con 0x7fbd640b1ef0 2023-10-06T02:53:26.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.034+0000 7fbd59ffb700 1 -- 172.21.15.81:0/767408478 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd54007480 con 0x7fbd640b1ef0 2023-10-06T02:53:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.034+0000 7fbd59ffb700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbd48066f30 0x7fbd480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.034+0000 7fbd59ffb700 1 -- 172.21.15.81:0/767408478 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbd54083b90 con 0x7fbd640b1ef0 2023-10-06T02:53:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.034+0000 7fbd69e7f700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbd48066f30 0x7fbd480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.034+0000 7fbd69e7f700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbd48066f30 0x7fbd480693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbd600099b0 tx=0x7fbd60017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.038+0000 7fbd59ffb700 1 -- 172.21.15.81:0/767408478 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd54050ca0 con 0x7fbd640b1ef0 2023-10-06T02:53:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.295+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbd64071b10 con 0x7fbd640b1ef0 2023-10-06T02:53:26.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.299+0000 7fbd59ffb700 1 -- 172.21.15.81:0/767408478 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbd54017020 con 0x7fbd640b1ef0 2023-10-06T02:53:26.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbd48066f30 msgr2=0x7fbd480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbd48066f30 0x7fbd480693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbd600099b0 tx=0x7fbd60017000 comp rx=0 tx=0).stop 2023-10-06T02:53:26.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 msgr2=0x7fbd6415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 0x7fbd6415c8b0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400c5b0 tx=0x7fbd54001040 comp rx=0 tx=0).stop 2023-10-06T02:53:26.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 shutdown_connections 2023-10-06T02:53:26.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd640b29d0 0x7fbd6415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbd48066f30 0x7fbd480693e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd6406f4f0 0x7fbd6415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 --2- 172.21.15.81:0/767408478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd640b1ef0 0x7fbd6415c8b0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 >> 172.21.15.81:0/767408478 conn(0x7fbd640d0bb0 msgr2=0x7fbd640b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:26.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 shutdown_connections 2023-10-06T02:53:26.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.301+0000 7fbd6ae81700 1 -- 172.21.15.81:0/767408478 wait complete. 2023-10-06T02:53:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:53:26.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:53:26.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.427+0000 7fba530c4700 1 Processor -- start 2023-10-06T02:53:26.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.427+0000 7fba530c4700 1 -- start start 2023-10-06T02:53:26.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.428+0000 7fba530c4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba4c157fe0 0x7fba4c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.428+0000 7fba530c4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c1583b0 0x7fba4c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.428+0000 7fba530c4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0b2890 con 0x7fba4c0ceb30 2023-10-06T02:53:26.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.428+0000 7fba530c4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4c0b4070 con 0x7fba4c157fe0 2023-10-06T02:53:26.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.428+0000 7fba530c4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c0b4350 con 0x7fba4c1583b0 2023-10-06T02:53:26.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.428+0000 7fba50e60700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba4c157fe0 0x7fba4c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.428+0000 7fba51661700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fba4c0ceb30 0x7fba4c0cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35902/0 (socket says 172.21.15.81:35902) 2023-10-06T02:53:26.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.428+0000 7fba50e60700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba4c157fe0 0x7fba4c0b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49266/0 (socket says 172.21.15.81:49266) 2023-10-06T02:53:26.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.428+0000 7fba51661700 1 -- 172.21.15.81:0/2458179075 learned_addr learned my addr 172.21.15.81:0/2458179075 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:26.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba43fff700 1 --2- 172.21.15.81:0/2458179075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c1583b0 0x7fba4c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba50e60700 1 -- 172.21.15.81:0/2458179075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c1583b0 msgr2=0x7fba4c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:26.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba50e60700 1 --2- 172.21.15.81:0/2458179075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c1583b0 0x7fba4c0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba50e60700 1 -- 172.21.15.81:0/2458179075 >> v1:172.21.15.81:6789/0 conn(0x7fba4c0ceb30 legacy=0x7fba4c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba50e60700 1 -- 172.21.15.81:0/2458179075 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c0b4630 con 0x7fba4c157fe0 2023-10-06T02:53:26.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba437fe700 1 -- 172.21.15.81:0/2458179075 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154083523 0 0) 0x7fba4c0b2890 con 0x7fba4c0ceb30 2023-10-06T02:53:26.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba43fff700 1 --2- 172.21.15.81:0/2458179075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c1583b0 0x7fba4c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:26.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba50e60700 1 --2- 172.21.15.81:0/2458179075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c157fe0 0x7fba4c0b34c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fba48009e60 tx=0x7fba48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ba6320409c05cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:26.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba437fe700 1 -- 172.21.15.81:0/2458179075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4800e070 con 0x7fba4c157fe0 2023-10-06T02:53:26.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba437fe700 1 -- 172.21.15.81:0/2458179075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4800bc30 con 0x7fba4c157fe0 2023-10-06T02:53:26.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.429+0000 7fba437fe700 1 -- 172.21.15.81:0/2458179075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48012430 con 0x7fba4c157fe0 2023-10-06T02:53:26.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.430+0000 7fba530c4700 1 -- 172.21.15.81:0/2458179075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c157fe0 msgr2=0x7fba4c0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.430+0000 7fba530c4700 1 --2- 172.21.15.81:0/2458179075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c157fe0 0x7fba4c0b34c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fba48009e60 tx=0x7fba48009780 comp rx=0 tx=0).stop 2023-10-06T02:53:26.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.430+0000 7fba530c4700 1 -- 172.21.15.81:0/2458179075 shutdown_connections 2023-10-06T02:53:26.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.430+0000 7fba530c4700 1 --2- 172.21.15.81:0/2458179075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c157fe0 0x7fba4c0b34c0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.430+0000 7fba530c4700 1 --2- 172.21.15.81:0/2458179075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c1583b0 0x7fba4c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.430+0000 7fba530c4700 1 -- 172.21.15.81:0/2458179075 >> 172.21.15.81:0/2458179075 conn(0x7fba4c067640 msgr2=0x7fba4c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:26.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.430+0000 7fba530c4700 1 -- 172.21.15.81:0/2458179075 shutdown_connections 2023-10-06T02:53:26.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.430+0000 7fba530c4700 1 -- 172.21.15.81:0/2458179075 wait complete. 2023-10-06T02:53:26.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.431+0000 7fba530c4700 1 Processor -- start 2023-10-06T02:53:26.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.431+0000 7fba530c4700 1 -- start start 2023-10-06T02:53:26.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba530c4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c0ceb30 0x7fba4c14a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba530c4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157fe0 0x7fba4c159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba530c4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1583b0 0x7fba4c15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba530c4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c14c470 con 0x7fba4c1583b0 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba530c4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c14c140 con 0x7fba4c0ceb30 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba530c4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c15a830 con 0x7fba4c157fe0 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba51661700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1583b0 0x7fba4c15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba51661700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1583b0 0x7fba4c15a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49282/0 (socket says 172.21.15.81:49282) 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba51661700 1 -- 172.21.15.81:0/4104270507 learned_addr learned my addr 172.21.15.81:0/4104270507 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba51661700 1 -- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157fe0 msgr2=0x7fba4c159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba50e60700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c0ceb30 0x7fba4c14a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba43fff700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157fe0 0x7fba4c159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba51661700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157fe0 0x7fba4c159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba51661700 1 -- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c0ceb30 msgr2=0x7fba4c14a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba51661700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c0ceb30 0x7fba4c14a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba51661700 1 -- 172.21.15.81:0/4104270507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48009a20 con 0x7fba4c1583b0 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba43fff700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157fe0 0x7fba4c159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba50e60700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c0ceb30 0x7fba4c14a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba51661700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1583b0 0x7fba4c15a240 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fba4400c530 tx=0x7fba44007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba40ff9700 1 -- 172.21.15.81:0/4104270507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44005b30 con 0x7fba4c1583b0 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba40ff9700 1 -- 172.21.15.81:0/4104270507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba44005c90 con 0x7fba4c1583b0 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c15ab10 con 0x7fba4c1583b0 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba40ff9700 1 -- 172.21.15.81:0/4104270507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44007320 con 0x7fba4c1583b0 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.432+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c14ac20 con 0x7fba4c1583b0 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.433+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c14c5e0 con 0x7fba4c1583b0 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.434+0000 7fba40ff9700 1 -- 172.21.15.81:0/4104270507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba4401b3b0 con 0x7fba4c1583b0 2023-10-06T02:53:26.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.434+0000 7fba40ff9700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba38066f30 0x7fba380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:26.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.434+0000 7fba40ff9700 1 -- 172.21.15.81:0/4104270507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fba44083bb0 con 0x7fba4c1583b0 2023-10-06T02:53:26.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.434+0000 7fba50e60700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba38066f30 0x7fba380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:26.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.435+0000 7fba50e60700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba38066f30 0x7fba380693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fba48009e60 tx=0x7fba48019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:26.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.438+0000 7fba40ff9700 1 -- 172.21.15.81:0/4104270507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba44050cc0 con 0x7fba4c1583b0 2023-10-06T02:53:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.667+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba4c0b3d20 con 0x7fba4c1583b0 2023-10-06T02:53:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.667+0000 7fba40ff9700 1 -- 172.21.15.81:0/4104270507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4590 (secure 0 0 0) 0x7fba44017090 con 0x7fba4c1583b0 2023-10-06T02:53:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:26.669 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7668,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/97994403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":97994403},{"type":"v1","addr":"172.21.15.81:6834","nonce":97994403}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/871547713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":871547713},{"type":"v1","addr":"172.21.15.81:6835","nonce":871547713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3300657165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3300657165},{"type":"v1","addr":"172.21.15.83:6836","nonce":3300657165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:53:16.320455+0000","modified":"2023-10-06T02:53:19.984430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7686":{"gid":7686,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1726464211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1726464211},{"type":"v1","addr":"172.21.15.83:6837","nonce":1726464211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T02:53:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba38066f30 msgr2=0x7fba380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba38066f30 0x7fba380693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fba48009e60 tx=0x7fba48019000 comp rx=0 tx=0).stop 2023-10-06T02:53:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1583b0 msgr2=0x7fba4c15a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1583b0 0x7fba4c15a240 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fba4400c530 tx=0x7fba44007f90 comp rx=0 tx=0).stop 2023-10-06T02:53:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 shutdown_connections 2023-10-06T02:53:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c1583b0 0x7fba4c15a240 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba38066f30 0x7fba380693e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba4c0ceb30 0x7fba4c14a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 --2- 172.21.15.81:0/4104270507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fba4c157fe0 0x7fba4c159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 >> 172.21.15.81:0/4104270507 conn(0x7fba4c067640 msgr2=0x7fba4c0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 shutdown_connections 2023-10-06T02:53:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:26.670+0000 7fba530c4700 1 -- 172.21.15.81:0/4104270507 wait complete. 2023-10-06T02:53:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-10-06T02:53:27.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:53:16.320455+0000', 'modified': '2023-10-06T02:53:19.984430+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7686}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7686': {'gid': 7686, 'name': 'b', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6837/1726464211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6835', 'nonce': 1726464211}, {'type': 'v1', 'addr': '172.21.15.83:6837', 'nonce': 1726464211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:53:27.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:53:27.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T02:53:27.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.199+0000 7ff344d8e700 1 Processor -- start 2023-10-06T02:53:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.199+0000 7ff344d8e700 1 -- start start 2023-10-06T02:53:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.200+0000 7ff344d8e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff340157ca0 0x7ff3400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.200+0000 7ff344d8e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3400d07c0 con 0x7ff3401578d0 2023-10-06T02:53:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.200+0000 7ff344d8e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3400cfbb0 con 0x7ff34006d120 2023-10-06T02:53:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.200+0000 7ff344d8e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3400cfe90 con 0x7ff340157ca0 2023-10-06T02:53:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.200+0000 7ff33e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff3401578d0 0x7ff34015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35916/0 (socket says 172.21.15.81:35916) 2023-10-06T02:53:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.200+0000 7ff33e59c700 1 -- 172.21.15.81:0/2153164785 learned_addr learned my addr 172.21.15.81:0/2153164785 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.200+0000 7ff335d9b700 1 --2- 172.21.15.81:0/2153164785 >> v2:172.21.15.83:3300/0 conn(0x7ff340157ca0 0x7ff3400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.200+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274753219 0 0) 0x7ff3400d07c0 con 0x7ff3401578d0 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.200+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff32c003570 con 0x7ff3401578d0 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3485379553 0 0) 0x7ff32c003570 con 0x7ff3401578d0 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 >> v2:172.21.15.83:3300/0 conn(0x7ff340157ca0 msgr2=0x7ff3400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 --2- 172.21.15.81:0/2153164785 >> v2:172.21.15.83:3300/0 conn(0x7ff340157ca0 0x7ff3400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 >> v1:172.21.15.83:6789/0 conn(0x7ff34006d120 legacy=0x7ff34006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3400d0170 con 0x7ff3401578d0 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7ff330001470 con 0x7ff3401578d0 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 >> v1:172.21.15.81:6789/0 conn(0x7ff3401578d0 legacy=0x7ff34015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff32c003a60 0x7ff32c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff32c004810 0x7ff32c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff32c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3400cfe90 con 0x7ff32c0051c0 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c00c0d0 con 0x7ff32c004810 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c00c290 con 0x7ff32c003a60 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff32c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff335d9b700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff32c004810 0x7ff32c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33e59c700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff32c003a60 0x7ff32c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33ed9d700 1 -- 172.21.15.81:0/2153164785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff32c003a60 msgr2=0x7ff32c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff32c003a60 0x7ff32c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33ed9d700 1 -- 172.21.15.81:0/2153164785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff32c004810 msgr2=0x7ff32c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff32c004810 0x7ff32c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33ed9d700 1 -- 172.21.15.81:0/2153164785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c003570 con 0x7ff32c0051c0 2023-10-06T02:53:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33ed9d700 1 -- 172.21.15.81:0/2153164785 reap_dead start 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff32c00ba60 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff338001fc0 tx=0x7ff338001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d9d65969a86c7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338001950 con 0x7ff32c0051c0 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33800c8b0 con 0x7ff32c0051c0 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.201+0000 7ff33dd9b700 1 -- 172.21.15.81:0/2153164785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800cc90 con 0x7ff32c0051c0 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.202+0000 7ff344d8e700 1 -- 172.21.15.81:0/2153164785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 msgr2=0x7ff32c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.202+0000 7ff344d8e700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff32c00ba60 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff338001fc0 tx=0x7ff338001640 comp rx=0 tx=0).stop 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.202+0000 7ff344d8e700 1 -- 172.21.15.81:0/2153164785 shutdown_connections 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.202+0000 7ff344d8e700 1 --2- 172.21.15.81:0/2153164785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff32c00ba60 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.202+0000 7ff344d8e700 1 -- 172.21.15.81:0/2153164785 >> 172.21.15.81:0/2153164785 conn(0x7ff34006bb90 msgr2=0x7ff34006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.202+0000 7ff344d8e700 1 -- 172.21.15.81:0/2153164785 shutdown_connections 2023-10-06T02:53:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.202+0000 7ff344d8e700 1 -- 172.21.15.81:0/2153164785 wait complete. 2023-10-06T02:53:27.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.203+0000 7ff344d8e700 1 Processor -- start 2023-10-06T02:53:27.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.203+0000 7ff344d8e700 1 -- start start 2023-10-06T02:53:27.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff344d8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff340153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff344d8e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff34015cd70 0x7ff340158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff344d8e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff34014d410 0x7ff340159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff344d8e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340150940 con 0x7ff32c0051c0 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff344d8e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340154130 con 0x7ff34014d410 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff344d8e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff340150010 con 0x7ff34015cd70 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff340153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff340153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49292/0 (socket says 172.21.15.81:49292) 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33e59c700 1 -- 172.21.15.81:0/3286616225 learned_addr learned my addr 172.21.15.81:0/3286616225 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff335d9b700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff34015cd70 0x7ff340158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff34014d410 0x7ff340159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33e59c700 1 -- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff34015cd70 msgr2=0x7ff340158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33e59c700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff34015cd70 0x7ff340158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33e59c700 1 -- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff34014d410 msgr2=0x7ff340159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33e59c700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff34014d410 0x7ff340159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33e59c700 1 -- 172.21.15.81:0/3286616225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3401502f0 con 0x7ff32c0051c0 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.204+0000 7ff33e59c700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff340153bf0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff330007390 tx=0x7ff330001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.205+0000 7ff336ffd700 1 -- 172.21.15.81:0/3286616225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000f6e0 con 0x7ff32c0051c0 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.205+0000 7ff336ffd700 1 -- 172.21.15.81:0/3286616225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33000f880 con 0x7ff32c0051c0 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.205+0000 7ff344d8e700 1 -- 172.21.15.81:0/3286616225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3401505d0 con 0x7ff32c0051c0 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.205+0000 7ff336ffd700 1 -- 172.21.15.81:0/3286616225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000fc40 con 0x7ff32c0051c0 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.205+0000 7ff344d8e700 1 -- 172.21.15.81:0/3286616225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff340150ee0 con 0x7ff32c0051c0 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.206+0000 7ff336ffd700 1 -- 172.21.15.81:0/3286616225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff33001d460 con 0x7ff32c0051c0 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.207+0000 7ff336ffd700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.207+0000 7ff336ffd700 1 -- 172.21.15.81:0/3286616225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff330084770 con 0x7ff32c0051c0 2023-10-06T02:53:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.207+0000 7ff335d9b700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.207+0000 7ff335d9b700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff340159c90 tx=0x7ff3280091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.208+0000 7ff34e086b80 1 Processor -- start 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff34e086b80 1 -- start start 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x5631004e2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e3cc0 0x5631005326c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 0x563100533050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff34e086b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563100439a70 con 0x5631004e2840 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff34e086b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x563100437270 con 0x563100532c00 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff34e086b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x563100433060 con 0x5631004e3cc0 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff33e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x5631004e2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff33e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x5631004e2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49302/0 (socket says 172.21.15.81:49302) 2023-10-06T02:53:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff33e59c700 1 -- 172.21.15.81:0/411725774 learned_addr learned my addr 172.21.15.81:0/411725774 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.209+0000 7ff335d9b700 1 --2- 172.21.15.81:0/411725774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e3cc0 0x5631005326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/411725774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 0x563100533050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff33e59c700 1 -- 172.21.15.81:0/411725774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e3cc0 msgr2=0x5631005326c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff33e59c700 1 --2- 172.21.15.81:0/411725774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e3cc0 0x5631005326c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff33e59c700 1 -- 172.21.15.81:0/411725774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 msgr2=0x563100533050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff33e59c700 1 --2- 172.21.15.81:0/411725774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 0x563100533050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff33e59c700 1 -- 172.21.15.81:0/411725774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631002cd270 con 0x5631004e2840 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff33e59c700 1 --2- 172.21.15.81:0/411725774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x5631004e2c10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff330082be0 tx=0x7ff330006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb718f75cb75402 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff31f7fe700 1 -- 172.21.15.81:0/411725774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330055540 con 0x5631004e2840 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff31f7fe700 1 -- 172.21.15.81:0/411725774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330058790 con 0x5631004e2840 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.210+0000 7ff31f7fe700 1 -- 172.21.15.81:0/411725774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33005c4e0 con 0x5631004e2840 2023-10-06T02:53:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 -- 172.21.15.81:0/411725774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 msgr2=0x5631004e2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 --2- 172.21.15.81:0/411725774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x5631004e2c10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff330082be0 tx=0x7ff330006040 comp rx=0 tx=0).stop 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 -- 172.21.15.81:0/411725774 shutdown_connections 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 --2- 172.21.15.81:0/411725774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 0x563100533050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 --2- 172.21.15.81:0/411725774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x5631004e2c10 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 --2- 172.21.15.81:0/411725774 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e3cc0 0x5631005326c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 -- 172.21.15.81:0/411725774 >> 172.21.15.81:0/411725774 conn(0x5631004e4160 msgr2=0x5631004e4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 -- 172.21.15.81:0/411725774 shutdown_connections 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 -- 172.21.15.81:0/411725774 wait complete. 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 -- start start 2023-10-06T02:53:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.211+0000 7ff34e086b80 1 Processor -- start 2023-10-06T02:53:27.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 0x5631004df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 0x56310052a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563100532c00 0x563100523450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff34e086b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631003de890 con 0x563100532c00 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff34e086b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631003f9ea0 con 0x5631004e3cc0 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff34e086b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631002b5e30 con 0x5631004e2840 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff34e086b80 10 client.0 _ll_register_callbacks cb 0x5631004a5e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff33ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563100532c00 0x563100523450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff33ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563100532c00 0x563100523450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49318/0 (socket says 172.21.15.81:49318) 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff33ed9d700 1 -- 172.21.15.81:0/1161348268 learned_addr learned my addr 172.21.15.81:0/1161348268 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff335d9b700 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 0x56310052a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.212+0000 7ff33e59c700 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 0x5631004df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff33ed9d700 1 -- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 msgr2=0x5631004df2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 0x5631004df2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff33ed9d700 1 -- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 msgr2=0x56310052a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 0x56310052a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff33ed9d700 1 -- 172.21.15.81:0/1161348268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff340150ee0 con 0x563100532c00 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563100532c00 0x563100523450 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff33800c6a0 tx=0x7ff338015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367d1a05447b1148 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff31cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff31cff9700 1 -- 172.21.15.81:0/1161348268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800c6d0 con 0x563100532c00 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff31cff9700 1 -- 172.21.15.81:0/1161348268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff338012860 con 0x563100532c00 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff34e086b80 1 -- 172.21.15.81:0/1161348268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631004d7940 con 0x563100532c00 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff31cff9700 1 -- 172.21.15.81:0/1161348268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff338012c30 con 0x563100532c00 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff34e086b80 10 client.7866 fetch_fsmap learned FSMap version 75 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff34e086b80 1 -- 172.21.15.81:0/1161348268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x56310026ffe0 con 0x563100532c00 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff31cff9700 1 -- 172.21.15.81:0/1161348268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631004d7940 con 0x563100532c00 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff31cff9700 1 -- 172.21.15.81:0/1161348268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 75) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff33800c0e0 con 0x563100532c00 2023-10-06T02:53:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff34e086b80 10 client.7866 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff34e086b80 10 client.7866 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff34e086b80 20 client.7866 populate_metadata read hostname 'smithi081' 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff34e086b80 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] conn(0x56310052a860 0x563100520fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff34e086b80 4 client.7866 mds_command: new command op to 7686 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.213+0000 7ff34e086b80 1 -- 172.21.15.81:0/1161348268 --> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631004b4870 con 0x56310052a860 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.214+0000 7ff33e59c700 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] conn(0x56310052a860 0x563100520fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.214+0000 7ff31cff9700 10 client.7866 ms_handle_connect on v2:172.21.15.83:6835/1726464211 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.214+0000 7ff33e59c700 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] conn(0x56310052a860 0x563100520fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=573992af2cb5954d server_cookie=e9cd7dda3cd0b0f9 in_seq=0 out_seq=0 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff31cff9700 1 -- 172.21.15.81:0/1161348268 <== mds.0 v2:172.21.15.83:6835/1726464211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5631004b4870 con 0x56310052a860 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff31cff9700 10 client.7866 handle_command_reply: tid=0 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 client.7866 shutdown 2023-10-06T02:53:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 -- 172.21.15.81:0/1161348268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563100532c00 msgr2=0x563100523450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563100532c00 0x563100523450 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff33800c6a0 tx=0x7ff338015000 comp rx=0 tx=0).stop 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 -- 172.21.15.81:0/1161348268 shutdown_connections 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] conn(0x56310052a860 0x563100520fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563100532c00 0x563100523450 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 0x5631004df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff31cff9700 0 client.7866 ms_handle_reset on v2:172.21.15.83:6835/1726464211 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 --2- 172.21.15.81:0/1161348268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 0x56310052a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 -- 172.21.15.81:0/1161348268 >> 172.21.15.81:0/1161348268 conn(0x5631004e4160 msgr2=0x5631004dda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 -- 172.21.15.81:0/1161348268 shutdown_connections 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 1 -- 172.21.15.81:0/1161348268 wait complete. 2023-10-06T02:53:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.215+0000 7ff34e086b80 20 client.7866 trim_cache size 0 max 16384 2023-10-06T02:53:27.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.232+0000 7ff34e086b80 1 Processor -- start 2023-10-06T02:53:27.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.232+0000 7ff34e086b80 1 -- start start 2023-10-06T02:53:27.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.232+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 0x56310051f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.232+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e3cc0 0x5631004dda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.232+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 0x5631004ddf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.232+0000 7ff34e086b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563100527cc0 con 0x5631004e3cc0 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.232+0000 7ff34e086b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310054be90 con 0x563100532c00 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.232+0000 7ff34e086b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x56310052a700 con 0x5631004e2840 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff335d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e3cc0 0x5631004dda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff335d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e3cc0 0x5631004dda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49326/0 (socket says 172.21.15.81:49326) 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff335d9b700 1 -- 172.21.15.81:0/858810094 learned_addr learned my addr 172.21.15.81:0/858810094 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff33e59c700 1 --2- 172.21.15.81:0/858810094 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 0x56310051f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/858810094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 0x5631004ddf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff335d9b700 1 -- 172.21.15.81:0/858810094 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 msgr2=0x56310051f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff335d9b700 1 --2- 172.21.15.81:0/858810094 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 0x56310051f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff335d9b700 1 -- 172.21.15.81:0/858810094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 msgr2=0x5631004ddf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff335d9b700 1 --2- 172.21.15.81:0/858810094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 0x5631004ddf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff335d9b700 1 -- 172.21.15.81:0/858810094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563100401780 con 0x5631004e3cc0 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff335d9b700 1 --2- 172.21.15.81:0/858810094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e3cc0 0x5631004dda10 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7ff328014cb0 tx=0x7ff32801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb888b9514fc664 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff31ffff700 1 -- 172.21.15.81:0/858810094 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328028070 con 0x5631004e3cc0 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff31ffff700 1 -- 172.21.15.81:0/858810094 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff328019070 con 0x5631004e3cc0 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.233+0000 7ff31ffff700 1 -- 172.21.15.81:0/858810094 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328023d10 con 0x5631004e3cc0 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 -- 172.21.15.81:0/858810094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e3cc0 msgr2=0x5631004dda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 --2- 172.21.15.81:0/858810094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e3cc0 0x5631004dda10 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7ff328014cb0 tx=0x7ff32801c000 comp rx=0 tx=0).stop 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 -- 172.21.15.81:0/858810094 shutdown_connections 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 --2- 172.21.15.81:0/858810094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563100532c00 0x5631004ddf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 --2- 172.21.15.81:0/858810094 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x5631004e2840 0x56310051f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 --2- 172.21.15.81:0/858810094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e3cc0 0x5631004dda10 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 -- 172.21.15.81:0/858810094 >> 172.21.15.81:0/858810094 conn(0x5631004e4160 msgr2=0x563100507950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 -- 172.21.15.81:0/858810094 shutdown_connections 2023-10-06T02:53:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 -- 172.21.15.81:0/858810094 wait complete. 2023-10-06T02:53:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 -- start start 2023-10-06T02:53:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.234+0000 7ff34e086b80 1 Processor -- start 2023-10-06T02:53:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x563100525750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 0x563100525c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff34e086b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563100532c00 0x563100523f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff34e086b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310058fd90 con 0x5631004e2840 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff34e086b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631005219b0 con 0x5631004e3cc0 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff34e086b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x56310052cfb0 con 0x563100532c00 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff34e086b80 10 client.0 _ll_register_callbacks cb 0x5631004a5e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff33e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x563100525750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff33e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x563100525750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49342/0 (socket says 172.21.15.81:49342) 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff33e59c700 1 -- 172.21.15.81:0/2058035767 learned_addr learned my addr 172.21.15.81:0/2058035767 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff335d9b700 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 0x563100525c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.235+0000 7ff33ed9d700 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563100532c00 0x563100523f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff33e59c700 1 -- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563100532c00 msgr2=0x563100523f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff33e59c700 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563100532c00 0x563100523f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff33e59c700 1 -- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 msgr2=0x563100525c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff33e59c700 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 0x563100525c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff33e59c700 1 -- 172.21.15.81:0/2058035767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3280149e0 con 0x5631004e2840 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff33e59c700 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x563100525750 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7ff330004fd0 tx=0x7ff330006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bce1015dbedce2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff31cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff31cff9700 1 -- 172.21.15.81:0/2058035767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330082080 con 0x5631004e2840 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff31cff9700 1 -- 172.21.15.81:0/2058035767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff330055c40 con 0x5631004e2840 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff34e086b80 1 -- 172.21.15.81:0/2058035767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff330058790 con 0x5631004e2840 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff31cff9700 1 -- 172.21.15.81:0/2058035767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff33005c4e0 con 0x5631004e2840 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff34e086b80 10 client.7872 fetch_fsmap learned FSMap version 75 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff34e086b80 1 -- 172.21.15.81:0/2058035767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x5631003e8470 con 0x5631004e2840 2023-10-06T02:53:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff31cff9700 1 -- 172.21.15.81:0/2058035767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330058790 con 0x5631004e2840 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff31cff9700 1 -- 172.21.15.81:0/2058035767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 75) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff3300557a0 con 0x5631004e2840 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff34e086b80 10 client.7872 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff34e086b80 10 client.7872 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff34e086b80 20 client.7872 populate_metadata read hostname 'smithi081' 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff34e086b80 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] conn(0x5631005246d0 0x56310058e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff34e086b80 4 client.7872 mds_command: new command op to 7686 tid=0[{"prefix": "status"}] 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff34e086b80 1 -- 172.21.15.81:0/2058035767 --> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5631003d5e00 con 0x5631005246d0 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.236+0000 7ff335d9b700 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] conn(0x5631005246d0 0x56310058e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff31cff9700 10 client.7872 ms_handle_connect on v2:172.21.15.83:6835/1726464211 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff335d9b700 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] conn(0x5631005246d0 0x56310058e380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e073b7261842da5 server_cookie=11ac2ab9b5a199e6 in_seq=0 out_seq=0 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff31cff9700 1 -- 172.21.15.81:0/2058035767 <== mds.0 v2:172.21.15.83:6835/1726464211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5631003d5e00 con 0x5631005246d0 2023-10-06T02:53:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff31cff9700 10 client.7872 handle_command_reply: tid=0 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 client.7872 shutdown 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 -- 172.21.15.81:0/2058035767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 msgr2=0x563100525750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x563100525750 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7ff330004fd0 tx=0x7ff330006040 comp rx=0 tx=0).stop 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 -- 172.21.15.81:0/2058035767 shutdown_connections 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:6835/1726464211,v1:172.21.15.83:6837/1726464211] conn(0x5631005246d0 0x56310058e380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x563100532c00 0x563100523f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff31cff9700 0 client.7872 ms_handle_reset on v2:172.21.15.83:6835/1726464211 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5631004e2840 0x563100525750 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 --2- 172.21.15.81:0/2058035767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5631004e3cc0 0x563100525c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 -- 172.21.15.81:0/2058035767 >> 172.21.15.81:0/2058035767 conn(0x5631004e4160 msgr2=0x5631004e3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 -- 172.21.15.81:0/2058035767 shutdown_connections 2023-10-06T02:53:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 1 -- 172.21.15.81:0/2058035767 wait complete. 2023-10-06T02:53:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.237+0000 7ff34e086b80 20 client.7872 trim_cache size 0 max 16384 2023-10-06T02:53:27.246 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:53:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:53:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:53:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7686, 2023-10-06T02:53:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:53:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:53:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:53:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 10.284472773999999, 2023-10-06T02:53:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 75, 2023-10-06T02:53:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 151, 2023-10-06T02:53:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 151, 2023-10-06T02:53:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 16.391845536999998 2023-10-06T02:53:27.247 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:53:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 -- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 msgr2=0x7ff3200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff340159c90 tx=0x7ff3280091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 -- 172.21.15.81:0/3286616225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 msgr2=0x7ff340153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff340153bf0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff330007390 tx=0x7ff330001e50 comp rx=0 tx=0).stop 2023-10-06T02:53:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 -- 172.21.15.81:0/3286616225 shutdown_connections 2023-10-06T02:53:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff320066f30 0x7ff3200693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff34014d410 0x7ff340159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c0051c0 0x7ff340153bf0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 --2- 172.21.15.81:0/3286616225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff34015cd70 0x7ff340158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 -- 172.21.15.81:0/3286616225 >> 172.21.15.81:0/3286616225 conn(0x7ff34006bb90 msgr2=0x7ff340156970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 -- 172.21.15.81:0/3286616225 shutdown_connections 2023-10-06T02:53:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.238+0000 7ff344d8e700 1 -- 172.21.15.81:0/3286616225 wait complete. 2023-10-06T02:53:27.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:53:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.362+0000 7faad0717700 1 Processor -- start 2023-10-06T02:53:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.362+0000 7faad0717700 1 -- start start 2023-10-06T02:53:27.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faad0717700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac80aeea0 0x7faac80c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faad0717700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faac80af270 0x7faac80c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faad0717700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac806aae0 con 0x7faac80c7d00 2023-10-06T02:53:27.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faad0717700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac8069ed0 con 0x7faac80af270 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faad0717700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac806a1b0 con 0x7faac80aeea0 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faacecb4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faac80c7d00 0x7faac80c8140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35920/0 (socket says 172.21.15.81:35920) 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faacecb4700 1 -- 172.21.15.81:0/4019109580 learned_addr learned my addr 172.21.15.81:0/4019109580 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841875952 0 0) 0x7faac806aae0 con 0x7faac80c7d00 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faace4b3700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac80aeea0 0x7faac80c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab4003570 con 0x7faac80c7d00 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.363+0000 7faacdcb2700 1 --2- 172.21.15.81:0/4019109580 >> v2:172.21.15.83:3300/0 conn(0x7faac80af270 0x7faac80c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 902499383 0 0) 0x7faab4003570 con 0x7faac80c7d00 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac80aeea0 msgr2=0x7faac80c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac80aeea0 0x7faac80c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 >> v2:172.21.15.83:3300/0 conn(0x7faac80af270 msgr2=0x7faac80c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 --2- 172.21.15.81:0/4019109580 >> v2:172.21.15.83:3300/0 conn(0x7faac80af270 0x7faac80c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac806a490 con 0x7faac80c7d00 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7faac0001470 con 0x7faac80c7d00 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 >> v1:172.21.15.81:6789/0 conn(0x7faac80c7d00 legacy=0x7faac80c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faab4003a60 0x7faab4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac80aeea0 0x7faab4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4004d50 0x7faab40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac8069ed0 con 0x7faab4003a60 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac806a1b0 con 0x7faab4004d50 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab400ba60 con 0x7faac80aeea0 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faace4b3700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faab4003a60 0x7faab4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacdcb2700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac80aeea0 0x7faab4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacecb4700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4004d50 0x7faab40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faace4b3700 1 -- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac80aeea0 msgr2=0x7faab4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faace4b3700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac80aeea0 0x7faab4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faace4b3700 1 -- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4004d50 msgr2=0x7faab40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faace4b3700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4004d50 0x7faab40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faace4b3700 1 -- 172.21.15.81:0/4019109580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4003570 con 0x7faab4003a60 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacecb4700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4004d50 0x7faab40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faace4b3700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faab4003a60 0x7faab4003e70 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7faac400e210 tx=0x7faac400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae1eabbc06f2d4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.364+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac400ea60 con 0x7faab4003a60 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.365+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac400f040 con 0x7faab4003a60 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.365+0000 7faacd4b1700 1 -- 172.21.15.81:0/4019109580 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac400ee10 con 0x7faab4003a60 2023-10-06T02:53:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.365+0000 7faad0717700 1 -- 172.21.15.81:0/4019109580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faab4003a60 msgr2=0x7faab4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.365+0000 7faad0717700 1 --2- 172.21.15.81:0/4019109580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faab4003a60 0x7faab4003e70 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7faac400e210 tx=0x7faac400b040 comp rx=0 tx=0).stop 2023-10-06T02:53:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.365+0000 7faacecb4700 1 -- 172.21.15.81:0/4019109580 reap_dead start 2023-10-06T02:53:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.365+0000 7faad0717700 1 -- 172.21.15.81:0/4019109580 shutdown_connections 2023-10-06T02:53:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.365+0000 7faad0717700 1 -- 172.21.15.81:0/4019109580 >> 172.21.15.81:0/4019109580 conn(0x7faac806c660 msgr2=0x7faac80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.365+0000 7faad0717700 1 -- 172.21.15.81:0/4019109580 shutdown_connections 2023-10-06T02:53:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.365+0000 7faad0717700 1 -- 172.21.15.81:0/4019109580 wait complete. 2023-10-06T02:53:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.366+0000 7faad0717700 1 Processor -- start 2023-10-06T02:53:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.366+0000 7faad0717700 1 -- start start 2023-10-06T02:53:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faad0717700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4003a60 0x7faac8143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faad0717700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac8159ea0 0x7faac8157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faad0717700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac815a310 0x7faac8157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faad0717700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac8157f70 con 0x7faac8159ea0 2023-10-06T02:53:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faad0717700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac8158250 con 0x7faab4003a60 2023-10-06T02:53:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faad0717700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac8158530 con 0x7faac815a310 2023-10-06T02:53:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacdcb2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac8159ea0 0x7faac8157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacdcb2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac8159ea0 0x7faac8157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49358/0 (socket says 172.21.15.81:49358) 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacdcb2700 1 -- 172.21.15.81:0/3911396939 learned_addr learned my addr 172.21.15.81:0/3911396939 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faace4b3700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4003a60 0x7faac8143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacecb4700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac815a310 0x7faac8157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacdcb2700 1 -- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac815a310 msgr2=0x7faac8157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacdcb2700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac815a310 0x7faac8157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacdcb2700 1 -- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4003a60 msgr2=0x7faac8143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacdcb2700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4003a60 0x7faac8143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacdcb2700 1 -- 172.21.15.81:0/3911396939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8158810 con 0x7faac8159ea0 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faacdcb2700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac8159ea0 0x7faac8157320 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7faab8011d40 tx=0x7faab80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.367+0000 7faabe7fc700 1 -- 172.21.15.81:0/3911396939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800fac0 con 0x7faac8159ea0 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.368+0000 7faabe7fc700 1 -- 172.21.15.81:0/3911396939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab800fc20 con 0x7faac8159ea0 2023-10-06T02:53:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.368+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac8158af0 con 0x7faac8159ea0 2023-10-06T02:53:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.368+0000 7faabe7fc700 1 -- 172.21.15.81:0/3911396939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8014440 con 0x7faac8159ea0 2023-10-06T02:53:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.368+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac8143740 con 0x7faac8159ea0 2023-10-06T02:53:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.368+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac8067bc0 con 0x7faac8159ea0 2023-10-06T02:53:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.369+0000 7faabe7fc700 1 -- 172.21.15.81:0/3911396939 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faab8014a80 con 0x7faac8159ea0 2023-10-06T02:53:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.369+0000 7faabe7fc700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faaac066f30 0x7faaac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.369+0000 7faabe7fc700 1 -- 172.21.15.81:0/3911396939 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faab8018030 con 0x7faac8159ea0 2023-10-06T02:53:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.369+0000 7faace4b3700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faaac066f30 0x7faaac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.370+0000 7faace4b3700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faaac066f30 0x7faaac0693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7faac400afd0 tx=0x7faac401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.373+0000 7faabe7fc700 1 -- 172.21.15.81:0/3911396939 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faab8052460 con 0x7faac8159ea0 2023-10-06T02:53:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.598+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faac804bb80 con 0x7faac8159ea0 2023-10-06T02:53:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.598+0000 7faabe7fc700 1 -- 172.21.15.81:0/3911396939 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) v1 ==== 53+0+73 (secure 0 0 0) 0x7faab8055a80 con 0x7faac8159ea0 2023-10-06T02:53:27.599 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:53:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faaac066f30 msgr2=0x7faaac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faaac066f30 0x7faaac0693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7faac400afd0 tx=0x7faac401a000 comp rx=0 tx=0).stop 2023-10-06T02:53:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac8159ea0 msgr2=0x7faac8157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac8159ea0 0x7faac8157320 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7faab8011d40 tx=0x7faab80091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 shutdown_connections 2023-10-06T02:53:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac815a310 0x7faac8157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faaac066f30 0x7faaac0693e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faab4003a60 0x7faac8143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 --2- 172.21.15.81:0/3911396939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac8159ea0 0x7faac8157320 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 >> 172.21.15.81:0/3911396939 conn(0x7faac806c660 msgr2=0x7faac80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 shutdown_connections 2023-10-06T02:53:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:27.600+0000 7faad0717700 1 -- 172.21.15.81:0/3911396939 wait complete. 2023-10-06T02:53:27.613 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:53:27.613 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:53:27.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:53:27.613 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:53:27.613 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:53:27.615 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:53:27.616 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:53:27.616 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:53:27.616 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:53:27.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:27.616 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:53:27.631 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:53:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:53:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:53:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:53:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:27.632 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:53:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:53:27.632 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:53:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:53:27.632 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:53:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:27.633 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:53:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:53:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42109sec preferred_lft 42109sec 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:53:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:27.635 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:53:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:53:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:53:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:27.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:27.635 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:53:27.694 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:53:27.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:27.696 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:53:27.751 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:53:27.752 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:53:27.752 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:53:27.752 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:53:27.753 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:53:27.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:27.753 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:53:27.753 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:53:27.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:53:27.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:53:27.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:53:27.754 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:53:27.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:27.851 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:53:27.865 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:53:27.866 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:53:27.866 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:53:27.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:27.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:53:27.930 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:53:27.930 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:53:27.986 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:53:27.986 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:53:27.987 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:53:28.040 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:53:28.040 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:53:28.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:53:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:53:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:53:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:53:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:53:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:53:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:53:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:53:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:53:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:53:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:53:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:53:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:53:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:53:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:53:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:53:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:53:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:53:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:53:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:53:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:53:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:53:28.162 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:53:28.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:28.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:53:28.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:53:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.381+0000 7fe26ad38700 1 Processor -- start 2023-10-06T02:53:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.381+0000 7fe26ad38700 1 -- start start 2023-10-06T02:53:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.382+0000 7fe26ad38700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2641578d0 0x7fe2640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.382+0000 7fe26ad38700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2640d07c0 con 0x7fe264157ca0 2023-10-06T02:53:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.382+0000 7fe26ad38700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2640cfbb0 con 0x7fe26406d120 2023-10-06T02:53:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.382+0000 7fe26ad38700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640cfe90 con 0x7fe2641578d0 2023-10-06T02:53:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.382+0000 7fe25bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe264157ca0 0x7fe26415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35928/0 (socket says 172.21.15.81:35928) 2023-10-06T02:53:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.382+0000 7fe25bfff700 1 -- 172.21.15.81:0/3671519288 learned_addr learned my addr 172.21.15.81:0/3671519288 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe268ad4700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2641578d0 0x7fe2640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605501650 0 0) 0x7fe2640d07c0 con 0x7fe264157ca0 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe24c003570 con 0x7fe264157ca0 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320714454 0 0) 0x7fe24c003570 con 0x7fe264157ca0 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2641578d0 msgr2=0x7fe2640cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2641578d0 0x7fe2640cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 >> v1:172.21.15.83:6789/0 conn(0x7fe26406d120 legacy=0x7fe26415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640d0170 con 0x7fe264157ca0 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fe254001470 con 0x7fe264157ca0 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 >> v1:172.21.15.81:6789/0 conn(0x7fe264157ca0 legacy=0x7fe26415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2641578d0 0x7fe24c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c003fd0 0x7fe24c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe24c004d50 0x7fe24c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640cfe90 con 0x7fe24c003fd0 2023-10-06T02:53:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c00bb40 con 0x7fe24c004d50 2023-10-06T02:53:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c00bd00 con 0x7fe2641578d0 2023-10-06T02:53:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25bfff700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c003fd0 0x7fe24c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe268ad4700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2641578d0 0x7fe24c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe2692d5700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe24c004d50 0x7fe24c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25bfff700 1 -- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2641578d0 msgr2=0x7fe24c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25bfff700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe2641578d0 0x7fe24c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25bfff700 1 -- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe24c004d50 msgr2=0x7fe24c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25bfff700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe24c004d50 0x7fe24c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25bfff700 1 -- 172.21.15.81:0/3671519288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c003570 con 0x7fe24c003fd0 2023-10-06T02:53:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe2692d5700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe24c004d50 0x7fe24c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.383+0000 7fe25bfff700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c003fd0 0x7fe24c004810 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fe25400c390 tx=0x7fe26415b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1665fe6a2aac62ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400cc60 con 0x7fe24c003fd0 2023-10-06T02:53:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25400ce00 con 0x7fe24c003fd0 2023-10-06T02:53:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe25b7fe700 1 -- 172.21.15.81:0/3671519288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254005b70 con 0x7fe24c003fd0 2023-10-06T02:53:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe26ad38700 1 -- 172.21.15.81:0/3671519288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c003fd0 msgr2=0x7fe24c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe26ad38700 1 --2- 172.21.15.81:0/3671519288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c003fd0 0x7fe24c004810 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fe25400c390 tx=0x7fe26415b610 comp rx=0 tx=0).stop 2023-10-06T02:53:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe2692d5700 1 -- 172.21.15.81:0/3671519288 reap_dead start 2023-10-06T02:53:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe26ad38700 1 -- 172.21.15.81:0/3671519288 shutdown_connections 2023-10-06T02:53:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe26ad38700 1 -- 172.21.15.81:0/3671519288 >> 172.21.15.81:0/3671519288 conn(0x7fe26406bb90 msgr2=0x7fe26406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe26ad38700 1 -- 172.21.15.81:0/3671519288 shutdown_connections 2023-10-06T02:53:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.384+0000 7fe26ad38700 1 -- 172.21.15.81:0/3671519288 wait complete. 2023-10-06T02:53:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.385+0000 7fe26ad38700 1 Processor -- start 2023-10-06T02:53:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.385+0000 7fe26ad38700 1 -- start start 2023-10-06T02:53:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe26ad38700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24c003fd0 0x7fe2640b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe26ad38700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2641547b0 0x7fe264153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe26ad38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26414ded0 0x7fe264154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe26ad38700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640b4150 con 0x7fe26414ded0 2023-10-06T02:53:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe26ad38700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264153380 con 0x7fe2641547b0 2023-10-06T02:53:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe26ad38700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640b48f0 con 0x7fe24c003fd0 2023-10-06T02:53:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe2692d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26414ded0 0x7fe264154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe2692d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26414ded0 0x7fe264154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49388/0 (socket says 172.21.15.81:49388) 2023-10-06T02:53:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe2692d5700 1 -- 172.21.15.81:0/1046372414 learned_addr learned my addr 172.21.15.81:0/1046372414 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe25bfff700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2641547b0 0x7fe264153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe268ad4700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24c003fd0 0x7fe2640b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe2692d5700 1 -- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24c003fd0 msgr2=0x7fe2640b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe2692d5700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24c003fd0 0x7fe2640b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe2692d5700 1 -- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2641547b0 msgr2=0x7fe264153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe2692d5700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2641547b0 0x7fe264153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.386+0000 7fe2692d5700 1 -- 172.21.15.81:0/1046372414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640b4330 con 0x7fe26414ded0 2023-10-06T02:53:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.387+0000 7fe2692d5700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26414ded0 0x7fe264154df0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fe264063f70 tx=0x7fe25c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.387+0000 7fe258ff9700 1 -- 172.21.15.81:0/1046372414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c013630 con 0x7fe26414ded0 2023-10-06T02:53:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.387+0000 7fe258ff9700 1 -- 172.21.15.81:0/1046372414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c0137b0 con 0x7fe26414ded0 2023-10-06T02:53:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.387+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2640b4610 con 0x7fe26414ded0 2023-10-06T02:53:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.387+0000 7fe258ff9700 1 -- 172.21.15.81:0/1046372414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c013b70 con 0x7fe26414ded0 2023-10-06T02:53:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.387+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26406a730 con 0x7fe26414ded0 2023-10-06T02:53:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.388+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe264152e70 con 0x7fe26414ded0 2023-10-06T02:53:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.388+0000 7fe258ff9700 1 -- 172.21.15.81:0/1046372414 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe25c003030 con 0x7fe26414ded0 2023-10-06T02:53:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.388+0000 7fe258ff9700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe250066f30 0x7fe2500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.389+0000 7fe258ff9700 1 -- 172.21.15.81:0/1046372414 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe25c0844e0 con 0x7fe26414ded0 2023-10-06T02:53:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.389+0000 7fe268ad4700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe250066f30 0x7fe2500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.389+0000 7fe268ad4700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe250066f30 0x7fe2500693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe2640695d0 tx=0x7fe2600091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.393+0000 7fe258ff9700 1 -- 172.21.15.81:0/1046372414 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe264152e70 con 0x7fe26414ded0 2023-10-06T02:53:28.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.618+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe264153530 con 0x7fe26414ded0 2023-10-06T02:53:28.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.619+0000 7fe258ff9700 1 -- 172.21.15.81:0/1046372414 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe264153530 con 0x7fe26414ded0 2023-10-06T02:53:28.620 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:53:28.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.620+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe250066f30 msgr2=0x7fe2500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:28.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.620+0000 7fe26ad38700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe250066f30 0x7fe2500693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe2640695d0 tx=0x7fe2600091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.620+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26414ded0 msgr2=0x7fe264154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:28.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.620+0000 7fe26ad38700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26414ded0 0x7fe264154df0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fe264063f70 tx=0x7fe25c009040 comp rx=0 tx=0).stop 2023-10-06T02:53:28.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.621+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 shutdown_connections 2023-10-06T02:53:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.621+0000 7fe26ad38700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26414ded0 0x7fe264154df0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.621+0000 7fe26ad38700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe24c003fd0 0x7fe2640b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.621+0000 7fe26ad38700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe250066f30 0x7fe2500693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.621+0000 7fe26ad38700 1 --2- 172.21.15.81:0/1046372414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2641547b0 0x7fe264153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.621+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 >> 172.21.15.81:0/1046372414 conn(0x7fe26406bb90 msgr2=0x7fe26415f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.621+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 shutdown_connections 2023-10-06T02:53:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:28.621+0000 7fe26ad38700 1 -- 172.21.15.81:0/1046372414 wait complete. 2023-10-06T02:53:28.633 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:53:28.634 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:53:28.634 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:53:28.634 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:53:28.634 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:53:28.634 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:53:28.634 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:53:28.634 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:53:28.634 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:53:28.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:28.635 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:53:28.653 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:53:28.653 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:53:28.653 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:53:28.653 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:28.653 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:28.654 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42108sec preferred_lft 42108sec 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:53:28.655 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:28.656 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:53:28.656 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:53:28.656 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:53:28.656 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:28.656 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:53:28.656 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:53:28.656 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:53:28.656 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:53:28.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:28.657 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:53:28.722 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:53:28.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:28.724 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:53:28.781 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:53:28.782 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:53:28.782 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:53:28.782 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:53:28.782 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:53:28.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:28.782 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:53:28.782 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:53:28.783 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:53:28.783 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:53:28.783 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:53:28.783 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:53:28.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:28.887 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:53:28.902 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:53:28.902 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:53:28.902 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:53:28.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:28.902 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:53:28.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:53:28.968 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:53:29.023 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:53:29.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:53:29.023 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:53:29.077 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:53:29.077 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:53:29.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:53:29.157 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:53:29.157 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:53:29.175 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:53:29.176 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:53:29.176 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:53:29.176 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:53:29.176 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:53:29.176 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:53:29.176 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:53:29.176 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:53:29.196 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:53:29.196 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:53:29.197 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:53:29.197 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:53:29.197 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:53:29.197 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:53:29.197 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:53:29.197 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:53:29.197 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:53:29.197 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:53:29.197 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:53:29.198 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:53:29.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:53:29.199 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:53:29.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:53:29.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.378+0000 7f9a33fa1700 1 Processor -- start 2023-10-06T02:53:29.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.378+0000 7f9a33fa1700 1 -- start start 2023-10-06T02:53:29.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.379+0000 7f9a33fa1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 0x7f9a2c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.379+0000 7f9a33fa1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0d07c0 con 0x7f9a2c06d120 2023-10-06T02:53:29.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.379+0000 7f9a33fa1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0cfbb0 con 0x7f9a2c1578d0 2023-10-06T02:53:29.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.379+0000 7f9a33fa1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0cfe90 con 0x7f9a2c157ca0 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.379+0000 7f9a3253e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9a2c06d120 0x7f9a2c15b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35934/0 (socket says 172.21.15.81:35934) 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.379+0000 7f9a3253e700 1 -- 172.21.15.81:0/602633375 learned_addr learned my addr 172.21.15.81:0/602633375 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a3153c700 1 --2- 172.21.15.81:0/602633375 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 0x7f9a2c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a30d3b700 1 -- 172.21.15.81:0/602633375 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18796281 0 0) 0x7f9a2c0d07c0 con 0x7f9a2c06d120 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a30d3b700 1 -- 172.21.15.81:0/602633375 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a18003570 con 0x7f9a2c06d120 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a30d3b700 1 -- 172.21.15.81:0/602633375 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626781265 0 0) 0x7f9a2c0cfbb0 con 0x7f9a2c1578d0 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a30d3b700 1 -- 172.21.15.81:0/602633375 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a2c0d07c0 con 0x7f9a2c1578d0 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a3153c700 1 -- 172.21.15.81:0/602633375 >> v1:172.21.15.83:6789/0 conn(0x7f9a2c1578d0 legacy=0x7f9a2c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a3153c700 1 -- 172.21.15.81:0/602633375 >> v1:172.21.15.81:6789/0 conn(0x7f9a2c06d120 legacy=0x7f9a2c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a3153c700 1 -- 172.21.15.81:0/602633375 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0d0170 con 0x7f9a2c157ca0 2023-10-06T02:53:29.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a3153c700 1 --2- 172.21.15.81:0/602633375 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 0x7f9a2c0cf4f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009910 tx=0x7f9a1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1525b684e94d28ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a30d3b700 1 -- 172.21.15.81:0/602633375 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c011630 con 0x7f9a2c157ca0 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a30d3b700 1 -- 172.21.15.81:0/602633375 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c011790 con 0x7f9a2c157ca0 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.380+0000 7f9a30d3b700 1 -- 172.21.15.81:0/602633375 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c011b30 con 0x7f9a2c157ca0 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.381+0000 7f9a33fa1700 1 -- 172.21.15.81:0/602633375 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 msgr2=0x7f9a2c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.381+0000 7f9a33fa1700 1 --2- 172.21.15.81:0/602633375 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 0x7f9a2c0cf4f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009910 tx=0x7f9a1c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.381+0000 7f9a33fa1700 1 -- 172.21.15.81:0/602633375 shutdown_connections 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.381+0000 7f9a33fa1700 1 --2- 172.21.15.81:0/602633375 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 0x7f9a2c0cf4f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.381+0000 7f9a33fa1700 1 -- 172.21.15.81:0/602633375 >> 172.21.15.81:0/602633375 conn(0x7f9a2c06bb90 msgr2=0x7f9a2c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.381+0000 7f9a33fa1700 1 -- 172.21.15.81:0/602633375 shutdown_connections 2023-10-06T02:53:29.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.381+0000 7f9a33fa1700 1 -- 172.21.15.81:0/602633375 wait complete. 2023-10-06T02:53:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.382+0000 7f9a33fa1700 1 Processor -- start 2023-10-06T02:53:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.382+0000 7f9a33fa1700 1 -- start start 2023-10-06T02:53:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a33fa1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a2c06d120 0x7f9a2c153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a33fa1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a2c1578d0 0x7f9a2c151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a33fa1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 0x7f9a2c16dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a33fa1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c152ce0 con 0x7f9a2c1578d0 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a33fa1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0b5a50 con 0x7f9a2c06d120 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a33fa1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c16e7f0 con 0x7f9a2c157ca0 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3153c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a2c1578d0 0x7f9a2c151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3153c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a2c1578d0 0x7f9a2c151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49402/0 (socket says 172.21.15.81:49402) 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3153c700 1 -- 172.21.15.81:0/656243800 learned_addr learned my addr 172.21.15.81:0/656243800 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a31d3d700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a2c06d120 0x7f9a2c153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3253e700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 0x7f9a2c16dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3153c700 1 -- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 msgr2=0x7f9a2c16dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3153c700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 0x7f9a2c16dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3153c700 1 -- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a2c06d120 msgr2=0x7f9a2c153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3153c700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a2c06d120 0x7f9a2c153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3153c700 1 -- 172.21.15.81:0/656243800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c009420 con 0x7f9a2c1578d0 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a3153c700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a2c1578d0 0x7f9a2c151fe0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009f00 tx=0x7f9a1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a21ffb700 1 -- 172.21.15.81:0/656243800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c01f070 con 0x7f9a2c1578d0 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a21ffb700 1 -- 172.21.15.81:0/656243800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c002f70 con 0x7f9a2c1578d0 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c153380 con 0x7f9a2c1578d0 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.383+0000 7f9a21ffb700 1 -- 172.21.15.81:0/656243800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c011900 con 0x7f9a2c1578d0 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.384+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c153940 con 0x7f9a2c1578d0 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.385+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c15cc80 con 0x7f9a2c1578d0 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.385+0000 7f9a21ffb700 1 -- 172.21.15.81:0/656243800 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a1c023070 con 0x7f9a2c1578d0 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.385+0000 7f9a21ffb700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a10066f30 0x7f9a100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.385+0000 7f9a21ffb700 1 -- 172.21.15.81:0/656243800 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a1c0858b0 con 0x7f9a2c1578d0 2023-10-06T02:53:29.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.386+0000 7f9a31d3d700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a10066f30 0x7f9a100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.386+0000 7f9a31d3d700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a10066f30 0x7f9a100693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9a28004140 tx=0x7f9a28007f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:29.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.389+0000 7f9a21ffb700 1 -- 172.21.15.81:0/656243800 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a1c0529c0 con 0x7f9a2c1578d0 2023-10-06T02:53:29.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.615+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a2c071b10 con 0x7f9a2c1578d0 2023-10-06T02:53:29.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.615+0000 7f9a21ffb700 1 -- 172.21.15.81:0/656243800 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f9a1c02a090 con 0x7f9a2c1578d0 2023-10-06T02:53:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:53:29.617 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7668,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/97994403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":97994403},{"type":"v1","addr":"172.21.15.81:6834","nonce":97994403}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/871547713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":871547713},{"type":"v1","addr":"172.21.15.81:6835","nonce":871547713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3300657165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3300657165},{"type":"v1","addr":"172.21.15.83:6836","nonce":3300657165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:53:16.320455+0000","modified":"2023-10-06T02:53:19.984430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7686":{"gid":7686,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1726464211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1726464211},{"type":"v1","addr":"172.21.15.83:6837","nonce":1726464211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T02:53:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a10066f30 msgr2=0x7f9a100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a10066f30 0x7f9a100693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9a28004140 tx=0x7f9a28007f90 comp rx=0 tx=0).stop 2023-10-06T02:53:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a2c1578d0 msgr2=0x7f9a2c151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a2c1578d0 0x7f9a2c151fe0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009f00 tx=0x7f9a1c017000 comp rx=0 tx=0).stop 2023-10-06T02:53:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 shutdown_connections 2023-10-06T02:53:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a2c157ca0 0x7f9a2c16dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f9a10066f30 0x7f9a100693e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a2c06d120 0x7f9a2c153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 --2- 172.21.15.81:0/656243800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a2c1578d0 0x7f9a2c151fe0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 >> 172.21.15.81:0/656243800 conn(0x7f9a2c06bb90 msgr2=0x7f9a2c069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 shutdown_connections 2023-10-06T02:53:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.618+0000 7f9a33fa1700 1 -- 172.21.15.81:0/656243800 wait complete. 2023-10-06T02:53:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-10-06T02:53:29.631 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-06T02:53:29.764 INFO:teuthology.orchestra.run.smithi083.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":7686,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.800767572,"mdsmap_epoch":75,"osdmap_epoch":151,"osdmap_epoch_barrier":151,"uptime":18.908139878} 2023-10-06T02:53:29.765 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 7686, "mdsmap_epoch": 75, "osdmap_epoch": 151, "osdmap_epoch_barrier": 151, "rank_uptime": 12.800767572, "state": "up:active", "uptime": 18.908139878, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:53:29.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-06T02:53:29.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.881+0000 7f7cc7d25700 1 Processor -- start 2023-10-06T02:53:29.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.881+0000 7f7cc7d25700 1 -- start start 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.882+0000 7f7cc7d25700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7cc01578d0 0x7f7cc00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.882+0000 7f7cc7d25700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7cc0157ca0 0x7f7cc015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.882+0000 7f7cc7d25700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc00d07c0 con 0x7f7cc006d120 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.882+0000 7f7cc7d25700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00cfbb0 con 0x7f7cc01578d0 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.882+0000 7f7cc7d25700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00cfe90 con 0x7f7cc0157ca0 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.882+0000 7f7cc5ac1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7cc01578d0 0x7f7cc00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.882+0000 7f7cc62c2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7cc006d120 0x7f7cc006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35936/0 (socket says 172.21.15.81:35936) 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.882+0000 7f7cc62c2700 1 -- 172.21.15.81:0/1385717931 learned_addr learned my addr 172.21.15.81:0/1385717931 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.882+0000 7f7cc52c0700 1 --2- 172.21.15.81:0/1385717931 >> v2:172.21.15.83:3300/0 conn(0x7f7cc0157ca0 0x7f7cc015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc5ac1700 1 -- 172.21.15.81:0/1385717931 >> v2:172.21.15.83:3300/0 conn(0x7f7cc0157ca0 msgr2=0x7f7cc015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc5ac1700 1 --2- 172.21.15.81:0/1385717931 >> v2:172.21.15.83:3300/0 conn(0x7f7cc0157ca0 0x7f7cc015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc5ac1700 1 -- 172.21.15.81:0/1385717931 >> v1:172.21.15.81:6789/0 conn(0x7f7cc006d120 legacy=0x7f7cc006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc5ac1700 1 -- 172.21.15.81:0/1385717931 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00d0170 con 0x7f7cc01578d0 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc4abf700 1 -- 172.21.15.81:0/1385717931 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389722295 0 0) 0x7f7cc00d07c0 con 0x7f7cc006d120 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc5ac1700 1 --2- 172.21.15.81:0/1385717931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc01578d0 0x7f7cc00cf4f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0068510 tx=0x7f7cbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41981283c76fee64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc4abf700 1 -- 172.21.15.81:0/1385717931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc00b6b0 con 0x7f7cc01578d0 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc4abf700 1 -- 172.21.15.81:0/1385717931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc00b810 con 0x7f7cc01578d0 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc4abf700 1 -- 172.21.15.81:0/1385717931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc00bbb0 con 0x7f7cc01578d0 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc7d25700 1 -- 172.21.15.81:0/1385717931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc01578d0 msgr2=0x7f7cc00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc7d25700 1 --2- 172.21.15.81:0/1385717931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc01578d0 0x7f7cc00cf4f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0068510 tx=0x7f7cbc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc7d25700 1 -- 172.21.15.81:0/1385717931 shutdown_connections 2023-10-06T02:53:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc7d25700 1 --2- 172.21.15.81:0/1385717931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc01578d0 0x7f7cc00cf4f0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc7d25700 1 --2- 172.21.15.81:0/1385717931 >> v2:172.21.15.83:3300/0 conn(0x7f7cc0157ca0 0x7f7cc015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc7d25700 1 -- 172.21.15.81:0/1385717931 >> 172.21.15.81:0/1385717931 conn(0x7f7cc006bb90 msgr2=0x7f7cc006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc7d25700 1 -- 172.21.15.81:0/1385717931 shutdown_connections 2023-10-06T02:53:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.883+0000 7f7cc7d25700 1 -- 172.21.15.81:0/1385717931 wait complete. 2023-10-06T02:53:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc7d25700 1 Processor -- start 2023-10-06T02:53:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc7d25700 1 -- start start 2023-10-06T02:53:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc7d25700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc006d120 0x7f7cc0153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc7d25700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cc01578d0 0x7f7cc00b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc7d25700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cc0157ca0 0x7f7cc0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc7d25700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0154140 con 0x7f7cc006d120 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc7d25700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00b4c10 con 0x7f7cc0157ca0 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc7d25700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00b4ef0 con 0x7f7cc01578d0 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc5ac1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc006d120 0x7f7cc0153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc5ac1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc006d120 0x7f7cc0153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49416/0 (socket says 172.21.15.81:49416) 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc5ac1700 1 -- 172.21.15.81:0/458443045 learned_addr learned my addr 172.21.15.81:0/458443045 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc62c2700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cc0157ca0 0x7f7cc0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.885+0000 7f7cc52c0700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cc01578d0 0x7f7cc00b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cc5ac1700 1 -- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cc01578d0 msgr2=0x7f7cc00b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cc5ac1700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cc01578d0 0x7f7cc00b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cc5ac1700 1 -- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cc0157ca0 msgr2=0x7f7cc0068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cc5ac1700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cc0157ca0 0x7f7cc0068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cc5ac1700 1 -- 172.21.15.81:0/458443045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc009420 con 0x7f7cc006d120 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cc52c0700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cc01578d0 0x7f7cc00b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cc5ac1700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc006d120 0x7f7cc0153c00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f7cc006fe20 tx=0x7f7cbc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cb5ffb700 1 -- 172.21.15.81:0/458443045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc00bb90 con 0x7f7cc006d120 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cb5ffb700 1 -- 172.21.15.81:0/458443045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc011420 con 0x7f7cc006d120 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cb5ffb700 1 -- 172.21.15.81:0/458443045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0117c0 con 0x7f7cc006d120 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc00b51d0 con 0x7f7cc006d120 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.886+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc00b59d0 con 0x7f7cc006d120 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.887+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc00ceb10 con 0x7f7cc006d120 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.887+0000 7f7cb5ffb700 1 -- 172.21.15.81:0/458443045 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cbc011bf0 con 0x7f7cc006d120 2023-10-06T02:53:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.888+0000 7f7cb5ffb700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:53:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.888+0000 7f7cb5ffb700 1 -- 172.21.15.81:0/458443045 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7cbc085fc0 con 0x7f7cc006d120 2023-10-06T02:53:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.888+0000 7f7cc52c0700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:53:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.888+0000 7f7cc52c0700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ca4066f30 0x7f7ca40693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00b3340 tx=0x7f7cb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:53:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:29.892+0000 7f7cb5ffb700 1 -- 172.21.15.81:0/458443045 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cbc0b75a0 con 0x7f7cc006d120 2023-10-06T02:53:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.073+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f7cc00d0450 con 0x7f7cc006d120 2023-10-06T02:53:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.432+0000 7f7cb5ffb700 1 -- 172.21.15.81:0/458443045 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v152) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7cbc0530d0 con 0x7f7cc006d120 2023-10-06T02:53:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ca4066f30 msgr2=0x7f7ca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ca4066f30 0x7f7ca40693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00b3340 tx=0x7f7cb0008040 comp rx=0 tx=0).stop 2023-10-06T02:53:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc006d120 msgr2=0x7f7cc0153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:53:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc006d120 0x7f7cc0153c00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f7cc006fe20 tx=0x7f7cbc017000 comp rx=0 tx=0).stop 2023-10-06T02:53:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 shutdown_connections 2023-10-06T02:53:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cc0157ca0 0x7f7cc0068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc006d120 0x7f7cc0153c00 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 --2- 172.21.15.81:0/458443045 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cc01578d0 0x7f7cc00b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:53:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 >> 172.21.15.81:0/458443045 conn(0x7f7cc006bb90 msgr2=0x7f7cc006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:53:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 shutdown_connections 2023-10-06T02:53:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:53:30.435+0000 7f7cc7d25700 1 -- 172.21.15.81:0/458443045 wait complete. 2023-10-06T02:53:30.438 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-06T02:53:30.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-06T02:53:30.577 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-06T02:53:30.577 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-06T02:53:30.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-06T02:53:30.702 INFO:teuthology.orchestra.run.smithi081.stdout:{"mon_tick_interval":"5"} 2023-10-06T02:53:30.702 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-06T02:53:30.702 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-06T02:53:30.702 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:53:30.702 DEBUG:teuthology.orchestra.run.smithi081:> import time 2023-10-06T02:53:30.702 DEBUG:teuthology.orchestra.run.smithi081:> import datetime 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> # Write some buffered data through before going full, all should be well 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> print("writing some data through which we expect to succeed") 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> bytes = 0 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-06T02:53:30.703 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> # buffered IO, the error should always only appear from fsync and not 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> # from write 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> full = False 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(32 * 0.9)): 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> print("done writing {0} bytes".format(bytes)) 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> # OK, now we should sneak in under the full condition 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> # due to the time it takes the OSDs to report to the 2023-10-06T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi081:> # mons, and get a successful fsync on our full-making data 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> # buffered write, add more dirty data to the buffer 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> print("starting buffered write") 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(32 * 0.2)): 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(15.0) 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> except OSError: 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> pass; 2023-10-06T02:53:30.705 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> # Wait long enough for a background flush that should fail 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(30) 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> # ...and check that the failed background flush is reflected in fclose 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> except OSError: 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> print("close() returned an error as expected") 2023-10-06T02:53:30.706 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-06T02:53:30.707 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("close() failed to raise error") 2023-10-06T02:53:30.707 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-06T02:53:30.707 DEBUG:teuthology.orchestra.run.smithi081:> # The kernel cephfs client does not raise errors on fclose 2023-10-06T02:53:30.707 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-06T02:53:30.707 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:53:30.707 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-06T02:53:30.707 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:53:37.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:53:37.295 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:07.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:07.357 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:37.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:37.444 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:55:07.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:55:07.518 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:55:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:writing some data through which we expect to succeed 2023-10-06T02:55:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-06T02:55:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-06T02:55:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-06T02:55:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-06T02:55:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-06T02:55:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-06T02:55:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-06T02:55:31.020 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-06T02:55:31.021 INFO:teuthology.orchestra.run.smithi081.stdout:done writing 29884416 bytes 2023-10-06T02:55:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:successfully fsync'ed prior to getting full state reported 2023-10-06T02:55:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:starting buffered write 2023-10-06T02:55:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:55:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:55:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:55:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:55:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:55:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:55:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-06T02:55:31.123 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:55:31.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:55:31.167 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:55:31.222 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:55:31.223 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:55:31.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:31.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:55:31.267 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:55:31.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.267 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:55:31.323 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:55:31.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:31.324 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:55:31.372 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:55:31.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.373 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:55:31.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:31.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.507+0000 7f2068544700 1 Processor -- start 2023-10-06T02:55:31.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.507+0000 7f2068544700 1 -- start start 2023-10-06T02:55:31.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f2068544700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f20601578d0 0x7f20600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f2068544700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 0x7f206015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f2068544700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f206006d120 0x7f206006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f2068544700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206006dac0 con 0x7f20601578d0 2023-10-06T02:55:31.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f2068544700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20600d07c0 con 0x7f206006d120 2023-10-06T02:55:31.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f2068544700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20600cfbb0 con 0x7f2060157ca0 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f20662e0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f20601578d0 0x7f20600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f20662e0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f20601578d0 0x7f20600cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43622/0 (socket says 172.21.15.81:43622) 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f20662e0700 1 -- 172.21.15.81:0/3314273781 learned_addr learned my addr 172.21.15.81:0/3314273781 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f2066ae1700 1 --2- 172.21.15.81:0/3314273781 >> v2:172.21.15.83:3300/0 conn(0x7f206006d120 0x7f206006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f2065adf700 1 --2- 172.21.15.81:0/3314273781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 0x7f206015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f20662e0700 1 -- 172.21.15.81:0/3314273781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 msgr2=0x7f206015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f20662e0700 1 --2- 172.21.15.81:0/3314273781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 0x7f206015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f20662e0700 1 -- 172.21.15.81:0/3314273781 >> v2:172.21.15.83:3300/0 conn(0x7f206006d120 msgr2=0x7f206006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f20662e0700 1 --2- 172.21.15.81:0/3314273781 >> v2:172.21.15.83:3300/0 conn(0x7f206006d120 0x7f206006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f20662e0700 1 -- 172.21.15.81:0/3314273781 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600cfe90 con 0x7f20601578d0 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.508+0000 7f2066ae1700 1 --2- 172.21.15.81:0/3314273781 >> v2:172.21.15.83:3300/0 conn(0x7f206006d120 0x7f206006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f20662e0700 1 --2- 172.21.15.81:0/3314273781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 0x7f20600cf4f0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f20600b3940 tx=0x7f205c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1842d3c939a201 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f20652de700 1 -- 172.21.15.81:0/3314273781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c00e070 con 0x7f20601578d0 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f20652de700 1 -- 172.21.15.81:0/3314273781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c00ba50 con 0x7f20601578d0 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f20652de700 1 -- 172.21.15.81:0/3314273781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c0092e0 con 0x7f20601578d0 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f2068544700 1 -- 172.21.15.81:0/3314273781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 msgr2=0x7f20600cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f2068544700 1 --2- 172.21.15.81:0/3314273781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 0x7f20600cf4f0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f20600b3940 tx=0x7f205c009840 comp rx=0 tx=0).stop 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f2068544700 1 -- 172.21.15.81:0/3314273781 shutdown_connections 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f2068544700 1 --2- 172.21.15.81:0/3314273781 >> v2:172.21.15.83:3300/0 conn(0x7f206006d120 0x7f206006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f2068544700 1 --2- 172.21.15.81:0/3314273781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 0x7f20600cf4f0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f2068544700 1 --2- 172.21.15.81:0/3314273781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 0x7f206015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f2068544700 1 -- 172.21.15.81:0/3314273781 >> 172.21.15.81:0/3314273781 conn(0x7f206006bb90 msgr2=0x7f206006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:31.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f2068544700 1 -- 172.21.15.81:0/3314273781 shutdown_connections 2023-10-06T02:55:31.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.509+0000 7f2068544700 1 -- 172.21.15.81:0/3314273781 wait complete. 2023-10-06T02:55:31.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.510+0000 7f2068544700 1 Processor -- start 2023-10-06T02:55:31.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.510+0000 7f2068544700 1 -- start start 2023-10-06T02:55:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2068544700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206006d120 0x7f20601489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2068544700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 0x7f2060069c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2068544700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 0x7f206006a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2068544700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20600c65f0 con 0x7f20601578d0 2023-10-06T02:55:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2068544700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20600c5cc0 con 0x7f206006d120 2023-10-06T02:55:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2068544700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20600c5fa0 con 0x7f2060157ca0 2023-10-06T02:55:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2065adf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 0x7f2060069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2065adf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 0x7f2060069c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43636/0 (socket says 172.21.15.81:43636) 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2065adf700 1 -- 172.21.15.81:0/1339697699 learned_addr learned my addr 172.21.15.81:0/1339697699 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f20662e0700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206006d120 0x7f20601489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.511+0000 7f2066ae1700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 0x7f206006a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f2065adf700 1 -- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 msgr2=0x7f206006a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f2065adf700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 0x7f206006a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f2065adf700 1 -- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206006d120 msgr2=0x7f20601489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f2065adf700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206006d120 0x7f20601489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f2065adf700 1 -- 172.21.15.81:0/1339697699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c009ae0 con 0x7f20601578d0 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f2066ae1700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 0x7f206006a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f2065adf700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 0x7f2060069c00 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f205000d860 tx=0x7f2050008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f20567fc700 1 -- 172.21.15.81:0/1339697699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20500125f0 con 0x7f20601578d0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f20567fc700 1 -- 172.21.15.81:0/1339697699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2050012750 con 0x7f20601578d0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20600c6280 con 0x7f20601578d0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f20567fc700 1 -- 172.21.15.81:0/1339697699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050012b10 con 0x7f20601578d0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.512+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20600c6a80 con 0x7f20601578d0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.513+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2060067ac0 con 0x7f20601578d0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.513+0000 7f20567fc700 1 -- 172.21.15.81:0/1339697699 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f205001e460 con 0x7f20601578d0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.514+0000 7f20567fc700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2044066f30 0x7f20440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.514+0000 7f20567fc700 1 -- 172.21.15.81:0/1339697699 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2050084c30 con 0x7f20601578d0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.514+0000 7f20567fc700 1 -- 172.21.15.81:0/1339697699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f204406f0f0 con 0x7f20601578d0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.514+0000 7f20662e0700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2044066f30 0x7f20440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.514+0000 7f20662e0700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2044066f30 0x7f20440693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f205c009880 tx=0x7f205c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.518+0000 7f20567fc700 1 -- 172.21.15.81:0/1339697699 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2050051d40 con 0x7f20601578d0 2023-10-06T02:55:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.743+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20600c6730 con 0x7f20601578d0 2023-10-06T02:55:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.744+0000 7f20567fc700 1 -- 172.21.15.81:0/1339697699 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f2050055360 con 0x7f20601578d0 2023-10-06T02:55:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:31.745 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7668,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/97994403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":97994403},{"type":"v1","addr":"172.21.15.81:6834","nonce":97994403}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/871547713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":871547713},{"type":"v1","addr":"172.21.15.81:6835","nonce":871547713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3300657165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3300657165},{"type":"v1","addr":"172.21.15.83:6836","nonce":3300657165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:53:16.320455+0000","modified":"2023-10-06T02:53:19.984430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7686":{"gid":7686,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1726464211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1726464211},{"type":"v1","addr":"172.21.15.83:6837","nonce":1726464211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T02:55:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2044066f30 msgr2=0x7f20440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2044066f30 0x7f20440693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f205c009880 tx=0x7f205c018000 comp rx=0 tx=0).stop 2023-10-06T02:55:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 msgr2=0x7f2060069c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 0x7f2060069c00 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f205000d860 tx=0x7f2050008040 comp rx=0 tx=0).stop 2023-10-06T02:55:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 shutdown_connections 2023-10-06T02:55:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2060157ca0 0x7f206006a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2044066f30 0x7f20440693e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f206006d120 0x7f20601489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 --2- 172.21.15.81:0/1339697699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20601578d0 0x7f2060069c00 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 >> 172.21.15.81:0/1339697699 conn(0x7f206006bb90 msgr2=0x7f20601547a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 shutdown_connections 2023-10-06T02:55:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.746+0000 7f2068544700 1 -- 172.21.15.81:0/1339697699 wait complete. 2023-10-06T02:55:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-10-06T02:55:31.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.872+0000 7f8b4d701700 1 Processor -- start 2023-10-06T02:55:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.872+0000 7f8b4d701700 1 -- start start 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b4d701700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8b48159b40 0x7f8b480cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b4d701700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b480cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b4d701700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480cee10 con 0x7f8b48159f10 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b4d701700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480cd040 con 0x7f8b48159b40 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b4d701700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480cd320 con 0x7f8b48068e90 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b477fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8b48159f10 0x7f8b48068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50784/0 (socket says 172.21.15.81:50784) 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b477fe700 1 -- 172.21.15.81:0/3086824621 learned_addr learned my addr 172.21.15.81:0/3086824621 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b47fff700 1 --2- 172.21.15.81:0/3086824621 >> v2:172.21.15.83:3300/0 conn(0x7f8b48159b40 0x7f8b480cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b4cf00700 1 --2- 172.21.15.81:0/3086824621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b480cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b46ffd700 1 -- 172.21.15.81:0/3086824621 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566019389 0 0) 0x7f8b480cee10 con 0x7f8b48159f10 2023-10-06T02:55:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.873+0000 7f8b46ffd700 1 -- 172.21.15.81:0/3086824621 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b30003570 con 0x7f8b48159f10 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b46ffd700 1 -- 172.21.15.81:0/3086824621 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509421254 0 0) 0x7f8b30003570 con 0x7f8b48159f10 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b47fff700 1 -- 172.21.15.81:0/3086824621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 msgr2=0x7f8b480cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b47fff700 1 --2- 172.21.15.81:0/3086824621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b480cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b47fff700 1 -- 172.21.15.81:0/3086824621 >> v1:172.21.15.81:6789/0 conn(0x7f8b48159f10 legacy=0x7f8b48068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b47fff700 1 -- 172.21.15.81:0/3086824621 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480ce7c0 con 0x7f8b48159b40 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b4cf00700 1 --2- 172.21.15.81:0/3086824621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b480cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b47fff700 1 --2- 172.21.15.81:0/3086824621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159b40 0x7f8b480cc600 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b380098e0 tx=0x7f8b380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94b53f6b3bdabba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b46ffd700 1 -- 172.21.15.81:0/3086824621 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c001470 con 0x7f8b48159b40 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b46ffd700 1 -- 172.21.15.81:0/3086824621 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b38011420 con 0x7f8b48159b40 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b46ffd700 1 -- 172.21.15.81:0/3086824621 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380117c0 con 0x7f8b48159b40 2023-10-06T02:55:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b4d701700 1 -- 172.21.15.81:0/3086824621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159b40 msgr2=0x7f8b480cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b4d701700 1 --2- 172.21.15.81:0/3086824621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159b40 0x7f8b480cc600 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b380098e0 tx=0x7f8b380091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b4d701700 1 -- 172.21.15.81:0/3086824621 shutdown_connections 2023-10-06T02:55:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b4d701700 1 --2- 172.21.15.81:0/3086824621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b480cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b4d701700 1 --2- 172.21.15.81:0/3086824621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159b40 0x7f8b480cc600 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.874+0000 7f8b4d701700 1 -- 172.21.15.81:0/3086824621 >> 172.21.15.81:0/3086824621 conn(0x7f8b480cd660 msgr2=0x7f8b480cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.875+0000 7f8b4d701700 1 -- 172.21.15.81:0/3086824621 shutdown_connections 2023-10-06T02:55:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.875+0000 7f8b4d701700 1 -- 172.21.15.81:0/3086824621 wait complete. 2023-10-06T02:55:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.876+0000 7f8b4d701700 1 Processor -- start 2023-10-06T02:55:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.876+0000 7f8b4d701700 1 -- start start 2023-10-06T02:55:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.876+0000 7f8b4d701700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b4815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.876+0000 7f8b4d701700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b48159b40 0x7f8b4815c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.876+0000 7f8b4d701700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159f10 0x7f8b481547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.876+0000 7f8b4d701700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48158500 con 0x7f8b48159b40 2023-10-06T02:55:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.876+0000 7f8b4d701700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4815c540 con 0x7f8b48159f10 2023-10-06T02:55:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.876+0000 7f8b4d701700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4815c7c0 con 0x7f8b48068e90 2023-10-06T02:55:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b48159b40 0x7f8b4815c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b48159b40 0x7f8b4815c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43650/0 (socket says 172.21.15.81:43650) 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b477fe700 1 -- 172.21.15.81:0/2378841874 learned_addr learned my addr 172.21.15.81:0/2378841874 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b4cf00700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159f10 0x7f8b481547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b47fff700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b4815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b477fe700 1 -- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 msgr2=0x7f8b4815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b477fe700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b4815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b477fe700 1 -- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159f10 msgr2=0x7f8b481547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b477fe700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159f10 0x7f8b481547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b477fe700 1 -- 172.21.15.81:0/2378841874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40009a20 con 0x7f8b48159b40 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b47fff700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b4815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b4cf00700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159f10 0x7f8b481547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b477fe700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b48159b40 0x7f8b4815c000 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00cb90 tx=0x7f8b3c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b2ffff700 1 -- 172.21.15.81:0/2378841874 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c001d40 con 0x7f8b48159b40 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b2ffff700 1 -- 172.21.15.81:0/2378841874 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c007360 con 0x7f8b48159b40 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b38009420 con 0x7f8b48159b40 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b2ffff700 1 -- 172.21.15.81:0/2378841874 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c004830 con 0x7f8b48159b40 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.877+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b48158190 con 0x7f8b48159b40 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.878+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b480cae60 con 0x7f8b48159b40 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.879+0000 7f8b2ffff700 1 -- 172.21.15.81:0/2378841874 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b3c004ba0 con 0x7f8b48159b40 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.879+0000 7f8b2ffff700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b34066f30 0x7f8b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.879+0000 7f8b2ffff700 1 -- 172.21.15.81:0/2378841874 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8b3c083f00 con 0x7f8b48159b40 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.879+0000 7f8b2ffff700 1 -- 172.21.15.81:0/2378841874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f8b3406f0f0 con 0x7f8b48159b40 2023-10-06T02:55:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.879+0000 7f8b47fff700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b34066f30 0x7f8b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.880+0000 7f8b47fff700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b34066f30 0x7f8b340693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8b380030c0 tx=0x7f8b38016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:31.883+0000 7f8b2ffff700 1 -- 172.21.15.81:0/2378841874 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b3c018020 con 0x7f8b48159b40 2023-10-06T02:55:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.074+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b480cb910 con 0x7f8b48159b40 2023-10-06T02:55:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.074+0000 7f8b2ffff700 1 -- 172.21.15.81:0/2378841874 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+16860 (secure 0 0 0) 0x7f8b3c051090 con 0x7f8b48159b40 2023-10-06T02:55:32.076 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:32.076 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":153,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:54:54.442401+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:53:13.969056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T02:53:15.291652+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.076+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b34066f30 msgr2=0x7f8b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.076+0000 7f8b4d701700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b34066f30 0x7f8b340693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8b380030c0 tx=0x7f8b38016000 comp rx=0 tx=0).stop 2023-10-06T02:55:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.076+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b48159b40 msgr2=0x7f8b4815c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.076+0000 7f8b4d701700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b48159b40 0x7f8b4815c000 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00cb90 tx=0x7f8b3c001ab0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.077+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 shutdown_connections 2023-10-06T02:55:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.077+0000 7f8b4d701700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8b34066f30 0x7f8b340693e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.077+0000 7f8b4d701700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b48159f10 0x7f8b481547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.077+0000 7f8b4d701700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b48068e90 0x7f8b4815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.077+0000 7f8b4d701700 1 --2- 172.21.15.81:0/2378841874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b48159b40 0x7f8b4815c000 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.077+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 >> 172.21.15.81:0/2378841874 conn(0x7f8b480cd660 msgr2=0x7f8b480c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.077+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 shutdown_connections 2023-10-06T02:55:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.077+0000 7f8b4d701700 1 -- 172.21.15.81:0/2378841874 wait complete. 2023-10-06T02:55:32.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:53:13.969056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:53:15.291652+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:55:32.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.208+0000 7fb49ba5f700 1 Processor -- start 2023-10-06T02:55:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.208+0000 7fb49ba5f700 1 -- start start 2023-10-06T02:55:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb49ba5f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 0x7fb4940cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb49ba5f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb494157ca0 0x7fb49415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb49ba5f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4940d07c0 con 0x7fb49406d120 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb49ba5f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4940cfbb0 con 0x7fb494157ca0 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb49ba5f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940cfe90 con 0x7fb4941578d0 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb498ffa700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb494157ca0 0x7fb49415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb4997fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 0x7fb4940cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb498ffa700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb494157ca0 0x7fb49415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50206/0 (socket says 172.21.15.81:50206) 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb498ffa700 1 -- 172.21.15.81:0/535924078 learned_addr learned my addr 172.21.15.81:0/535924078 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb499ffc700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fb49406d120 0x7fb49415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:48688/0 (socket says 172.21.15.81:48688) 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb4997fb700 1 -- 172.21.15.81:0/535924078 >> v2:172.21.15.83:3300/0 conn(0x7fb494157ca0 msgr2=0x7fb49415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb4997fb700 1 --2- 172.21.15.81:0/535924078 >> v2:172.21.15.83:3300/0 conn(0x7fb494157ca0 0x7fb49415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb4997fb700 1 -- 172.21.15.81:0/535924078 >> v1:172.21.15.83:6789/0 conn(0x7fb49406d120 legacy=0x7fb49415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb4997fb700 1 -- 172.21.15.81:0/535924078 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4940d0170 con 0x7fb4941578d0 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb48bfff700 1 -- 172.21.15.81:0/535924078 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897681628 0 0) 0x7fb4940d07c0 con 0x7fb49406d120 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.209+0000 7fb498ffa700 1 --2- 172.21.15.81:0/535924078 >> v2:172.21.15.83:3300/0 conn(0x7fb494157ca0 0x7fb49415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb4997fb700 1 --2- 172.21.15.81:0/535924078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 0x7fb4940cf4f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4900098e0 tx=0x7fb4900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41c3b8b52a194d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb48bfff700 1 -- 172.21.15.81:0/535924078 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000b640 con 0x7fb4941578d0 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb48bfff700 1 -- 172.21.15.81:0/535924078 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49000b7a0 con 0x7fb4941578d0 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb48bfff700 1 -- 172.21.15.81:0/535924078 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000bb40 con 0x7fb4941578d0 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb49ba5f700 1 -- 172.21.15.81:0/535924078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 msgr2=0x7fb4940cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb49ba5f700 1 --2- 172.21.15.81:0/535924078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 0x7fb4940cf4f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4900098e0 tx=0x7fb4900091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb49ba5f700 1 -- 172.21.15.81:0/535924078 shutdown_connections 2023-10-06T02:55:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb49ba5f700 1 --2- 172.21.15.81:0/535924078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 0x7fb4940cf4f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb49ba5f700 1 --2- 172.21.15.81:0/535924078 >> v2:172.21.15.83:3300/0 conn(0x7fb494157ca0 0x7fb49415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb49ba5f700 1 -- 172.21.15.81:0/535924078 >> 172.21.15.81:0/535924078 conn(0x7fb49406bb90 msgr2=0x7fb49406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb49ba5f700 1 -- 172.21.15.81:0/535924078 shutdown_connections 2023-10-06T02:55:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.210+0000 7fb49ba5f700 1 -- 172.21.15.81:0/535924078 wait complete. 2023-10-06T02:55:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.211+0000 7fb49ba5f700 1 Processor -- start 2023-10-06T02:55:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.212+0000 7fb49ba5f700 1 -- start start 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.212+0000 7fb49ba5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb49406d120 0x7fb494154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.212+0000 7fb49ba5f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 0x7fb4940b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.212+0000 7fb49ba5f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb494157ca0 0x7fb4940b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.212+0000 7fb49ba5f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940b4f40 con 0x7fb49406d120 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.212+0000 7fb49ba5f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940ca810 con 0x7fb494157ca0 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.212+0000 7fb49ba5f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940c6740 con 0x7fb4941578d0 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.212+0000 7fb4997fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb49406d120 0x7fb494154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4997fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb49406d120 0x7fb494154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43652/0 (socket says 172.21.15.81:43652) 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4997fb700 1 -- 172.21.15.81:0/205372863 learned_addr learned my addr 172.21.15.81:0/205372863 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb498ffa700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 0x7fb4940b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb499ffc700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb494157ca0 0x7fb4940b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4997fb700 1 -- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 msgr2=0x7fb4940b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4997fb700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 0x7fb4940b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4997fb700 1 -- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb494157ca0 msgr2=0x7fb4940b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4997fb700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb494157ca0 0x7fb4940b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4997fb700 1 -- 172.21.15.81:0/205372863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840094f0 con 0x7fb49406d120 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4997fb700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb49406d120 0x7fb494154fc0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb494068330 tx=0x7fb490017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4897fa700 1 -- 172.21.15.81:0/205372863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000bb20 con 0x7fb49406d120 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4897fa700 1 -- 172.21.15.81:0/205372863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490000c90 con 0x7fb49406d120 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb490009420 con 0x7fb49406d120 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb4897fa700 1 -- 172.21.15.81:0/205372863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490011630 con 0x7fb49406d120 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.213+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49416c270 con 0x7fb49406d120 2023-10-06T02:55:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.214+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494067ac0 con 0x7fb49406d120 2023-10-06T02:55:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.214+0000 7fb4897fa700 1 -- 172.21.15.81:0/205372863 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4900119a0 con 0x7fb49406d120 2023-10-06T02:55:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.215+0000 7fb4897fa700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb478066f30 0x7fb4780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.215+0000 7fb4897fa700 1 -- 172.21.15.81:0/205372863 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb4900859b0 con 0x7fb49406d120 2023-10-06T02:55:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.215+0000 7fb4897fa700 1 -- 172.21.15.81:0/205372863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7fb47806f0f0 con 0x7fb49406d120 2023-10-06T02:55:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.215+0000 7fb498ffa700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb478066f30 0x7fb4780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.215+0000 7fb498ffa700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb478066f30 0x7fb4780693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb4940b6c70 tx=0x7fb484009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.219+0000 7fb4897fa700 1 -- 172.21.15.81:0/205372863 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb490052ac0 con 0x7fb49406d120 2023-10-06T02:55:32.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.399+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4940d0450 con 0x7fb49406d120 2023-10-06T02:55:32.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.400+0000 7fb4897fa700 1 -- 172.21.15.81:0/205372863 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v153) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb490015030 con 0x7fb49406d120 2023-10-06T02:55:32.402 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:55:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb478066f30 msgr2=0x7fb4780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb478066f30 0x7fb4780693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb4940b6c70 tx=0x7fb484009250 comp rx=0 tx=0).stop 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb49406d120 msgr2=0x7fb494154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb49406d120 0x7fb494154fc0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb494068330 tx=0x7fb490017000 comp rx=0 tx=0).stop 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 shutdown_connections 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb478066f30 0x7fb4780693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb494157ca0 0x7fb4940b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb49406d120 0x7fb494154fc0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 --2- 172.21.15.81:0/205372863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4941578d0 0x7fb4940b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 >> 172.21.15.81:0/205372863 conn(0x7fb49406bb90 msgr2=0x7fb49406d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 shutdown_connections 2023-10-06T02:55:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.402+0000 7fb49ba5f700 1 -- 172.21.15.81:0/205372863 wait complete. 2023-10-06T02:55:32.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.532+0000 7f0c58ce8700 1 Processor -- start 2023-10-06T02:55:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.532+0000 7f0c58ce8700 1 -- start start 2023-10-06T02:55:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c58ce8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c540d0b80 0x7f0c540cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c58ce8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540cf2d0 con 0x7f0c540d02b0 2023-10-06T02:55:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c58ce8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5406dc00 con 0x7f0c5406d700 2023-10-06T02:55:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c58ce8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415a690 con 0x7f0c540d0b80 2023-10-06T02:55:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c4bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0c540d02b0 0x7f0c5406cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50800/0 (socket says 172.21.15.81:50800) 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c4bfff700 1 -- 172.21.15.81:0/2755922832 learned_addr learned my addr 172.21.15.81:0/2755922832 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c537fe700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c540d0b80 0x7f0c540cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659846698 0 0) 0x7f0c540cf2d0 con 0x7f0c540d02b0 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c40003570 con 0x7f0c540d02b0 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792100019 0 0) 0x7f0c5406dc00 con 0x7f0c5406d700 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c540cf2d0 con 0x7f0c5406d700 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1093106409 0 0) 0x7f0c40003570 con 0x7f0c540d02b0 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c540d0b80 msgr2=0x7f0c540cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c540d0b80 0x7f0c540cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 >> v1:172.21.15.83:6789/0 conn(0x7f0c5406d700 legacy=0x7f0c5415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540cf570 con 0x7f0c540d02b0 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.533+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f0c3c001470 con 0x7f0c540d02b0 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 >> v1:172.21.15.81:6789/0 conn(0x7f0c540d02b0 legacy=0x7f0c5406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c40003c20 0x7f0c40004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c540d0b80 0x7f0c40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c40004d50 0x7f0c400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415a690 con 0x7f0c40003c20 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4000bb40 con 0x7f0c40004d50 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4000bd00 con 0x7f0c540d0b80 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c537fe700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c40003c20 0x7f0c40004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c4bfff700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c540d0b80 0x7f0c40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c53fff700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c40004d50 0x7f0c400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c537fe700 1 -- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c540d0b80 msgr2=0x7f0c40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c537fe700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c540d0b80 0x7f0c40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c537fe700 1 -- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c40004d50 msgr2=0x7f0c400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c537fe700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c40004d50 0x7f0c400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c537fe700 1 -- 172.21.15.81:0/2755922832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40003570 con 0x7f0c40003c20 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c4bfff700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c540d0b80 0x7f0c40004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c537fe700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c40003c20 0x7f0c40004010 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009c00 tx=0x7f0c440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0ec5b02971fc39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400e710 con 0x7f0c40003c20 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4400e870 con 0x7f0c40003c20 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.534+0000 7f0c52ffd700 1 -- 172.21.15.81:0/2755922832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400ec30 con 0x7f0c40003c20 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.535+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2755922832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c40003c20 msgr2=0x7f0c40004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.535+0000 7f0c58ce8700 1 --2- 172.21.15.81:0/2755922832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c40003c20 0x7f0c40004010 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009c00 tx=0x7f0c440091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.535+0000 7f0c53fff700 1 -- 172.21.15.81:0/2755922832 reap_dead start 2023-10-06T02:55:32.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.535+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2755922832 shutdown_connections 2023-10-06T02:55:32.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.535+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2755922832 >> 172.21.15.81:0/2755922832 conn(0x7f0c54063230 msgr2=0x7f0c54063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:32.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.535+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2755922832 shutdown_connections 2023-10-06T02:55:32.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.535+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2755922832 wait complete. 2023-10-06T02:55:32.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.536+0000 7f0c58ce8700 1 Processor -- start 2023-10-06T02:55:32.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.536+0000 7f0c58ce8700 1 -- start start 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c58ce8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c40003c20 0x7f0c540b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c58ce8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c540ae4a0 0x7f0c540ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c58ce8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c5416a510 0x7f0c5406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c58ce8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5416ae40 con 0x7f0c540ae4a0 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c58ce8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5416b120 con 0x7f0c40003c20 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c58ce8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5416b400 con 0x7f0c5416a510 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c540ae4a0 0x7f0c540ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c540ae4a0 0x7f0c540ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43660/0 (socket says 172.21.15.81:43660) 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4bfff700 1 -- 172.21.15.81:0/2327718946 learned_addr learned my addr 172.21.15.81:0/2327718946 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c537fe700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c40003c20 0x7f0c540b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c53fff700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c5416a510 0x7f0c5406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4bfff700 1 -- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c5416a510 msgr2=0x7f0c5406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4bfff700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c5416a510 0x7f0c5406bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4bfff700 1 -- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c40003c20 msgr2=0x7f0c540b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4bfff700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c40003c20 0x7f0c540b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4bfff700 1 -- 172.21.15.81:0/2327718946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540aca80 con 0x7f0c540ae4a0 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4bfff700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c540ae4a0 0x7f0c540ad280 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00eb90 tx=0x7f0c3c001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4b7fe700 1 -- 172.21.15.81:0/2327718946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c005e90 con 0x7f0c540ae4a0 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4b7fe700 1 -- 172.21.15.81:0/2327718946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c00c7e0 con 0x7f0c540ae4a0 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c540acd60 con 0x7f0c540ae4a0 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c4b7fe700 1 -- 172.21.15.81:0/2327718946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00cb80 con 0x7f0c540ae4a0 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.537+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c540ad7c0 con 0x7f0c540ae4a0 2023-10-06T02:55:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.538+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c540676e0 con 0x7f0c540ae4a0 2023-10-06T02:55:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.539+0000 7f0c4b7fe700 1 -- 172.21.15.81:0/2327718946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c3c01d460 con 0x7f0c540ae4a0 2023-10-06T02:55:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.539+0000 7f0c4b7fe700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c34066f30 0x7f0c340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.539+0000 7f0c4b7fe700 1 -- 172.21.15.81:0/2327718946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0c3c0845a0 con 0x7f0c540ae4a0 2023-10-06T02:55:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.539+0000 7f0c4b7fe700 1 -- 172.21.15.81:0/2327718946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f0c3406f0f0 con 0x7f0c540ae4a0 2023-10-06T02:55:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.539+0000 7f0c537fe700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c34066f30 0x7f0c340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.540+0000 7f0c537fe700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c34066f30 0x7f0c340693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0c440091e0 tx=0x7f0c4401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.543+0000 7f0c4b7fe700 1 -- 172.21.15.81:0/2327718946 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c3c0516b0 con 0x7f0c540ae4a0 2023-10-06T02:55:32.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.723+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c540cf850 con 0x7f0c540ae4a0 2023-10-06T02:55:32.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.724+0000 7f0c4b7fe700 1 -- 172.21.15.81:0/2327718946 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v153) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c3c054cd0 con 0x7f0c540ae4a0 2023-10-06T02:55:32.725 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:55:32.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c34066f30 msgr2=0x7f0c340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c34066f30 0x7f0c340693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0c440091e0 tx=0x7f0c4401a000 comp rx=0 tx=0).stop 2023-10-06T02:55:32.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c540ae4a0 msgr2=0x7f0c540ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c540ae4a0 0x7f0c540ad280 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00eb90 tx=0x7f0c3c001de0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 shutdown_connections 2023-10-06T02:55:32.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c5416a510 0x7f0c5406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c34066f30 0x7f0c340693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c40003c20 0x7f0c540b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 --2- 172.21.15.81:0/2327718946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c540ae4a0 0x7f0c540ad280 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 >> 172.21.15.81:0/2327718946 conn(0x7f0c54063230 msgr2=0x7f0c5406cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:32.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 shutdown_connections 2023-10-06T02:55:32.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.726+0000 7f0c58ce8700 1 -- 172.21.15.81:0/2327718946 wait complete. 2023-10-06T02:55:32.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:55:32.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.854+0000 7f1f0dfa0700 1 Processor -- start 2023-10-06T02:55:32.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.854+0000 7f1f0dfa0700 1 -- start start 2023-10-06T02:55:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f0dfa0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f080b43c0 0x7f1f080cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f0dfa0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cddd0 0x7f1f080ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f0dfa0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f080cadb0 con 0x7f1f080cd030 2023-10-06T02:55:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f0dfa0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080cc250 con 0x7f1f080b43c0 2023-10-06T02:55:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f0dfa0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080cf000 con 0x7f1f080cddd0 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f0cf9e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f080b43c0 0x7f1f080cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f07fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cddd0 0x7f1f080ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f07fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cddd0 0x7f1f080ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:41622/0 (socket says 172.21.15.81:41622) 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f0cf9e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1f080b43c0 0x7f1f080cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50242/0 (socket says 172.21.15.81:50242) 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f07fff700 1 -- 172.21.15.81:0/1092553874 learned_addr learned my addr 172.21.15.81:0/1092553874 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.855+0000 7f1f0d79f700 1 --1- 172.21.15.81:0/1092553874 >> v1:172.21.15.83:6789/0 conn(0x7f1f080cd030 0x7f1f0815b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:48710/0 (socket says 172.21.15.81:48710) 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.856+0000 7f1f07fff700 1 -- 172.21.15.81:0/1092553874 >> v2:172.21.15.83:3300/0 conn(0x7f1f080b43c0 msgr2=0x7f1f080cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.856+0000 7f1f07fff700 1 --2- 172.21.15.81:0/1092553874 >> v2:172.21.15.83:3300/0 conn(0x7f1f080b43c0 0x7f1f080cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.856+0000 7f1f07fff700 1 -- 172.21.15.81:0/1092553874 >> v1:172.21.15.83:6789/0 conn(0x7f1f080cd030 legacy=0x7f1f0815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.856+0000 7f1f07fff700 1 -- 172.21.15.81:0/1092553874 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080cf2e0 con 0x7f1f080cddd0 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.856+0000 7f1f07fff700 1 --2- 172.21.15.81:0/1092553874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cddd0 0x7f1f080ccaf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00099b0 tx=0x7f1ef0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ff67f6d60af2e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.856+0000 7f1f077fe700 1 -- 172.21.15.81:0/1092553874 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0009ea0 con 0x7f1f080cddd0 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.856+0000 7f1f077fe700 1 -- 172.21.15.81:0/1092553874 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef000b860 con 0x7f1f080cddd0 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.856+0000 7f1f077fe700 1 -- 172.21.15.81:0/1092553874 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000bc00 con 0x7f1f080cddd0 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.857+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/1092553874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cddd0 msgr2=0x7f1f080ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.857+0000 7f1f0dfa0700 1 --2- 172.21.15.81:0/1092553874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cddd0 0x7f1f080ccaf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00099b0 tx=0x7f1ef0009250 comp rx=0 tx=0).stop 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.857+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/1092553874 shutdown_connections 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.857+0000 7f1f0dfa0700 1 --2- 172.21.15.81:0/1092553874 >> v2:172.21.15.83:3300/0 conn(0x7f1f080b43c0 0x7f1f080cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.857+0000 7f1f0dfa0700 1 --2- 172.21.15.81:0/1092553874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cddd0 0x7f1f080ccaf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.857+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/1092553874 >> 172.21.15.81:0/1092553874 conn(0x7f1f08068110 msgr2=0x7f1f0806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.857+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/1092553874 shutdown_connections 2023-10-06T02:55:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.857+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/1092553874 wait complete. 2023-10-06T02:55:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.858+0000 7f1f0dfa0700 1 Processor -- start 2023-10-06T02:55:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.858+0000 7f1f0dfa0700 1 -- start start 2023-10-06T02:55:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0dfa0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f080b43c0 0x7f1f0806e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0dfa0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cd030 0x7f1f080b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0dfa0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f080cddd0 0x7f1f0815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0dfa0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0806e7b0 con 0x7f1f080b43c0 2023-10-06T02:55:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0dfa0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080b1090 con 0x7f1f080cddd0 2023-10-06T02:55:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0dfa0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080c8850 con 0x7f1f080cd030 2023-10-06T02:55:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0cf9e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f080b43c0 0x7f1f0806e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0cf9e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f080b43c0 0x7f1f0806e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43672/0 (socket says 172.21.15.81:43672) 2023-10-06T02:55:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0cf9e700 1 -- 172.21.15.81:0/956853875 learned_addr learned my addr 172.21.15.81:0/956853875 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0d79f700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f080cddd0 0x7f1f0815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f07fff700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cd030 0x7f1f080b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0cf9e700 1 -- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cd030 msgr2=0x7f1f080b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0cf9e700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cd030 0x7f1f080b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0cf9e700 1 -- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f080cddd0 msgr2=0x7f1f0815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0cf9e700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f080cddd0 0x7f1f0815a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f0cf9e700 1 -- 172.21.15.81:0/956853875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef00094f0 con 0x7f1f080b43c0 2023-10-06T02:55:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.859+0000 7f1f07fff700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cd030 0x7f1f080b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.860+0000 7f1f0cf9e700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f080b43c0 0x7f1f0806e270 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009ef0 tx=0x7f1ef800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.860+0000 7f1f04ff9700 1 -- 172.21.15.81:0/956853875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800cc50 con 0x7f1f080b43c0 2023-10-06T02:55:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.860+0000 7f1f04ff9700 1 -- 172.21.15.81:0/956853875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef800f040 con 0x7f1f080b43c0 2023-10-06T02:55:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.860+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f080c8b30 con 0x7f1f080b43c0 2023-10-06T02:55:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.860+0000 7f1f04ff9700 1 -- 172.21.15.81:0/956853875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8014480 con 0x7f1f080b43c0 2023-10-06T02:55:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.860+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f080c8540 con 0x7f1f080b43c0 2023-10-06T02:55:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.861+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0815a200 con 0x7f1f080b43c0 2023-10-06T02:55:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.861+0000 7f1f04ff9700 1 -- 172.21.15.81:0/956853875 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ef80147f0 con 0x7f1f080b43c0 2023-10-06T02:55:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.862+0000 7f1f04ff9700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ee8066f30 0x7f1ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.862+0000 7f1f04ff9700 1 -- 172.21.15.81:0/956853875 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ef8085170 con 0x7f1f080b43c0 2023-10-06T02:55:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.862+0000 7f1f07fff700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ee8066f30 0x7f1ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.862+0000 7f1f04ff9700 1 -- 172.21.15.81:0/956853875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f1ee806f0f0 con 0x7f1f080b43c0 2023-10-06T02:55:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.862+0000 7f1f07fff700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ee8066f30 0x7f1ee80693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00099b0 tx=0x7f1ef0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:32.866+0000 7f1f04ff9700 1 -- 172.21.15.81:0/956853875 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ef8052280 con 0x7f1f080b43c0 2023-10-06T02:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.049+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f080c8f70 con 0x7f1f080b43c0 2023-10-06T02:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.050+0000 7f1f04ff9700 1 -- 172.21.15.81:0/956853875 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v153) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ef80558a0 con 0x7f1f080b43c0 2023-10-06T02:55:33.051 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:55:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ee8066f30 msgr2=0x7f1ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ee8066f30 0x7f1ee80693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00099b0 tx=0x7f1ef0017000 comp rx=0 tx=0).stop 2023-10-06T02:55:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f080b43c0 msgr2=0x7f1f0806e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f080b43c0 0x7f1f0806e270 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009ef0 tx=0x7f1ef800b040 comp rx=0 tx=0).stop 2023-10-06T02:55:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 shutdown_connections 2023-10-06T02:55:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1ee8066f30 0x7f1ee80693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f080cddd0 0x7f1f0815a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f080b43c0 0x7f1f0806e270 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 --2- 172.21.15.81:0/956853875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1f080cd030 0x7f1f080b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 >> 172.21.15.81:0/956853875 conn(0x7f1f08068110 msgr2=0x7f1f080cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 shutdown_connections 2023-10-06T02:55:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.052+0000 7f1f0dfa0700 1 -- 172.21.15.81:0/956853875 wait complete. 2023-10-06T02:55:33.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:55:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.180+0000 7f6653994700 1 Processor -- start 2023-10-06T02:55:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.180+0000 7f6653994700 1 -- start start 2023-10-06T02:55:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.181+0000 7f6653994700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c1578d0 0x7f664c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.181+0000 7f6653994700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c0d07c0 con 0x7f664c157ca0 2023-10-06T02:55:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.181+0000 7f6653994700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c0cfbb0 con 0x7f664c06d120 2023-10-06T02:55:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.181+0000 7f6653994700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664c0cfe90 con 0x7f664c1578d0 2023-10-06T02:55:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.181+0000 7f6650f2f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f664c157ca0 0x7f664c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50808/0 (socket says 172.21.15.81:50808) 2023-10-06T02:55:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.181+0000 7f6650f2f700 1 -- 172.21.15.81:0/593829449 learned_addr learned my addr 172.21.15.81:0/593829449 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.181+0000 7f6651730700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c1578d0 0x7f664c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286424954 0 0) 0x7f664c0d07c0 con 0x7f664c157ca0 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6638003570 con 0x7f664c157ca0 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4136147283 0 0) 0x7f6638003570 con 0x7f664c157ca0 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c1578d0 msgr2=0x7f664c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c1578d0 0x7f664c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 >> v1:172.21.15.83:6789/0 conn(0x7f664c06d120 legacy=0x7f664c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c0d0170 con 0x7f664c157ca0 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f663c001470 con 0x7f664c157ca0 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 >> v1:172.21.15.81:6789/0 conn(0x7f664c157ca0 legacy=0x7f664c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6638003a90 0x7f6638003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c1578d0 0x7f6638004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638004d50 0x7f66380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c0cfe90 con 0x7f6638003a90 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663800bb10 con 0x7f6638004d50 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663800bcd0 con 0x7f664c1578d0 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6651730700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6638003a90 0x7f6638003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6650f2f700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c1578d0 0x7f6638004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6651f31700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638004d50 0x7f66380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6651730700 1 -- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c1578d0 msgr2=0x7f6638004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6651730700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c1578d0 0x7f6638004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6651730700 1 -- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638004d50 msgr2=0x7f66380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6651730700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638004d50 0x7f66380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6651730700 1 -- 172.21.15.81:0/593829449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638003570 con 0x7f6638003a90 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6651f31700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638004d50 0x7f66380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.182+0000 7f6651730700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6638003a90 0x7f6638003e60 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f6648009c00 tx=0x7f66480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30960b92d34c46a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800e710 con 0x7f6638003a90 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664800e870 con 0x7f6638003a90 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6643fff700 1 -- 172.21.15.81:0/593829449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800ec30 con 0x7f6638003a90 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6653994700 1 -- 172.21.15.81:0/593829449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6638003a90 msgr2=0x7f6638003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6653994700 1 --2- 172.21.15.81:0/593829449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6638003a90 0x7f6638003e60 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f6648009c00 tx=0x7f66480091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6651f31700 1 -- 172.21.15.81:0/593829449 reap_dead start 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6653994700 1 -- 172.21.15.81:0/593829449 shutdown_connections 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6653994700 1 -- 172.21.15.81:0/593829449 >> 172.21.15.81:0/593829449 conn(0x7f664c06bb90 msgr2=0x7f664c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6653994700 1 -- 172.21.15.81:0/593829449 shutdown_connections 2023-10-06T02:55:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.183+0000 7f6653994700 1 -- 172.21.15.81:0/593829449 wait complete. 2023-10-06T02:55:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.184+0000 7f6653994700 1 Processor -- start 2023-10-06T02:55:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.184+0000 7f6653994700 1 -- start start 2023-10-06T02:55:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6653994700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638003a90 0x7f664c153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6653994700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f664c0c7a80 0x7f664c0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6653994700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c154ef0 0x7f664c155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6653994700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c158f10 con 0x7f664c0c7a80 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6653994700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c1558a0 con 0x7f6638003a90 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6653994700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664c16dce0 con 0x7f664c154ef0 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6650f2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f664c0c7a80 0x7f664c0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6650f2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f664c0c7a80 0x7f664c0c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43686/0 (socket says 172.21.15.81:43686) 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6650f2f700 1 -- 172.21.15.81:0/1243348606 learned_addr learned my addr 172.21.15.81:0/1243348606 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6651730700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638003a90 0x7f664c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6651f31700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c154ef0 0x7f664c155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6650f2f700 1 -- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c154ef0 msgr2=0x7f664c155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6650f2f700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c154ef0 0x7f664c155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6650f2f700 1 -- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638003a90 msgr2=0x7f664c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6650f2f700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638003a90 0x7f664c153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6650f2f700 1 -- 172.21.15.81:0/1243348606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c158150 con 0x7f664c0c7a80 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.185+0000 7f6651730700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638003a90 0x7f664c153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.186+0000 7f6650f2f700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f664c0c7a80 0x7f664c0c7ef0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f663c0073c0 tx=0x7f664c15b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.186+0000 7f66417fa700 1 -- 172.21.15.81:0/1243348606 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00f8d0 con 0x7f664c0c7a80 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.186+0000 7f66417fa700 1 -- 172.21.15.81:0/1243348606 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c00fa50 con 0x7f664c0c7a80 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.186+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c158430 con 0x7f664c0c7a80 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.186+0000 7f66417fa700 1 -- 172.21.15.81:0/1243348606 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00fe10 con 0x7f664c0c7a80 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.186+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664c1589f0 con 0x7f664c0c7a80 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.187+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664c067ac0 con 0x7f664c0c7a80 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.187+0000 7f66417fa700 1 -- 172.21.15.81:0/1243348606 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f663c0135c0 con 0x7f664c0c7a80 2023-10-06T02:55:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.187+0000 7f66417fa700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6630066f30 0x7f66300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.187+0000 7f66417fa700 1 -- 172.21.15.81:0/1243348606 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f663c0842b0 con 0x7f664c0c7a80 2023-10-06T02:55:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.188+0000 7f66417fa700 1 -- 172.21.15.81:0/1243348606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f663006f0f0 con 0x7f664c0c7a80 2023-10-06T02:55:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.188+0000 7f6651730700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6630066f30 0x7f66300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.188+0000 7f6651730700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6630066f30 0x7f66300693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f66480091e0 tx=0x7f664801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.192+0000 7f66417fa700 1 -- 172.21.15.81:0/1243348606 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f663c01a060 con 0x7f664c0c7a80 2023-10-06T02:55:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.372+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f664c0d0450 con 0x7f664c0c7a80 2023-10-06T02:55:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.373+0000 7f66417fa700 1 -- 172.21.15.81:0/1243348606 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v153) v1 ==== 100+0+11 (secure 0 0 0) 0x7f663c051480 con 0x7f664c0c7a80 2023-10-06T02:55:33.374 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:55:33.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6630066f30 msgr2=0x7f66300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6630066f30 0x7f66300693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f66480091e0 tx=0x7f664801a000 comp rx=0 tx=0).stop 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f664c0c7a80 msgr2=0x7f664c0c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f664c0c7a80 0x7f664c0c7ef0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f663c0073c0 tx=0x7f664c15b610 comp rx=0 tx=0).stop 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 shutdown_connections 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f664c154ef0 0x7f664c155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6630066f30 0x7f66300693e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6638003a90 0x7f664c153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 --2- 172.21.15.81:0/1243348606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f664c0c7a80 0x7f664c0c7ef0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 >> 172.21.15.81:0/1243348606 conn(0x7f664c06bb90 msgr2=0x7f664c15def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 shutdown_connections 2023-10-06T02:55:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.375+0000 7f6653994700 1 -- 172.21.15.81:0/1243348606 wait complete. 2023-10-06T02:55:33.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:33.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.501+0000 7f2241591700 1 Processor -- start 2023-10-06T02:55:33.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.501+0000 7f2241591700 1 -- start start 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2241591700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f223c0cf060 0x7f223c0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2241591700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159f90 0x7f223c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2241591700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c067640 con 0x7f223c159bc0 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2241591700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c0b1e50 con 0x7f223c0cf060 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2241591700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c067890 con 0x7f223c159f90 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f223b7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f223c0cf060 0x7f223c0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2240d90700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159f90 0x7f223c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f223b7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f223c0cf060 0x7f223c0b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50284/0 (socket says 172.21.15.81:50284) 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2240d90700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159f90 0x7f223c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:41658/0 (socket says 172.21.15.81:41658) 2023-10-06T02:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f223b7fe700 1 -- 172.21.15.81:0/3000999778 learned_addr learned my addr 172.21.15.81:0/3000999778 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f223bfff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f223c159bc0 0x7f223c0ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:48738/0 (socket says 172.21.15.81:48738) 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2240d90700 1 -- 172.21.15.81:0/3000999778 >> v2:172.21.15.83:3300/0 conn(0x7f223c0cf060 msgr2=0x7f223c0b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2240d90700 1 --2- 172.21.15.81:0/3000999778 >> v2:172.21.15.83:3300/0 conn(0x7f223c0cf060 0x7f223c0b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2240d90700 1 -- 172.21.15.81:0/3000999778 >> v1:172.21.15.83:6789/0 conn(0x7f223c159bc0 legacy=0x7f223c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f2240d90700 1 -- 172.21.15.81:0/3000999778 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c067b70 con 0x7f223c159f90 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.502+0000 7f223b7fe700 1 --2- 172.21.15.81:0/3000999778 >> v2:172.21.15.83:3300/0 conn(0x7f223c0cf060 0x7f223c0b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f2240d90700 1 --2- 172.21.15.81:0/3000999778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159f90 0x7f223c06b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2234009e60 tx=0x7f2234009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe0f38fb3aa2e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f223affd700 1 -- 172.21.15.81:0/3000999778 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400e070 con 0x7f223c159f90 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f223affd700 1 -- 172.21.15.81:0/3000999778 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400bb60 con 0x7f223c159f90 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f223affd700 1 -- 172.21.15.81:0/3000999778 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234012430 con 0x7f223c159f90 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f2241591700 1 -- 172.21.15.81:0/3000999778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159f90 msgr2=0x7f223c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f2241591700 1 --2- 172.21.15.81:0/3000999778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159f90 0x7f223c06b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2234009e60 tx=0x7f2234009780 comp rx=0 tx=0).stop 2023-10-06T02:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f2241591700 1 -- 172.21.15.81:0/3000999778 shutdown_connections 2023-10-06T02:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f2241591700 1 --2- 172.21.15.81:0/3000999778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159f90 0x7f223c06b0d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f2241591700 1 --2- 172.21.15.81:0/3000999778 >> v2:172.21.15.83:3300/0 conn(0x7f223c0cf060 0x7f223c0b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f2241591700 1 -- 172.21.15.81:0/3000999778 >> 172.21.15.81:0/3000999778 conn(0x7f223c06c620 msgr2=0x7f223c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f2241591700 1 -- 172.21.15.81:0/3000999778 shutdown_connections 2023-10-06T02:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.503+0000 7f2241591700 1 -- 172.21.15.81:0/3000999778 wait complete. 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.504+0000 7f2241591700 1 Processor -- start 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f2241591700 1 -- start start 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f2241591700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f223c0cf060 0x7f223c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f2241591700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159bc0 0x7f223c15d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f2241591700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c159f90 0x7f223c0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f2241591700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15ef30 con 0x7f223c159f90 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f2241591700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15ddd0 con 0x7f223c0cf060 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f2241591700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15e070 con 0x7f223c159bc0 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f223bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f223c0cf060 0x7f223c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f2240d90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c159f90 0x7f223c0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.505+0000 7f223b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159bc0 0x7f223c15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f223c0cf060 0x7f223c1559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50286/0 (socket says 172.21.15.81:50286) 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159bc0 0x7f223c15d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:41668/0 (socket says 172.21.15.81:41668) 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f2240d90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c159f90 0x7f223c0af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43694/0 (socket says 172.21.15.81:43694) 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223bfff700 1 -- 172.21.15.81:0/3738450788 learned_addr learned my addr 172.21.15.81:0/3738450788 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223bfff700 1 -- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159bc0 msgr2=0x7f223c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223bfff700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159bc0 0x7f223c15d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223bfff700 1 -- 172.21.15.81:0/3738450788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c159f90 msgr2=0x7f223c0af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223bfff700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c159f90 0x7f223c0af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223bfff700 1 -- 172.21.15.81:0/3738450788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300094f0 con 0x7f223c0cf060 2023-10-06T02:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223b7fe700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159bc0 0x7f223c15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f223bfff700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f223c0cf060 0x7f223c1559c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c7c0 tx=0x7f222c007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f2223fff700 1 -- 172.21.15.81:0/3738450788 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c005a70 con 0x7f223c0cf060 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f2223fff700 1 -- 172.21.15.81:0/3738450788 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c005bd0 con 0x7f223c0cf060 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2234009a20 con 0x7f223c0cf060 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f2223fff700 1 -- 172.21.15.81:0/3738450788 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c0070d0 con 0x7f223c0cf060 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.506+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c15e630 con 0x7f223c0cf060 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.507+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c15e850 con 0x7f223c0cf060 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.508+0000 7f2223fff700 1 -- 172.21.15.81:0/3738450788 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f222c007480 con 0x7f223c0cf060 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.508+0000 7f2223fff700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2228066f30 0x7f22280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.508+0000 7f2223fff700 1 -- 172.21.15.81:0/3738450788 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f222c083b40 con 0x7f223c0cf060 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.508+0000 7f2223fff700 1 -- 172.21.15.81:0/3738450788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f222806f0f0 con 0x7f223c0cf060 2023-10-06T02:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.508+0000 7f223b7fe700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2228066f30 0x7f22280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.509+0000 7f223b7fe700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2228066f30 0x7f22280693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2230006d20 tx=0x7f2230009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.513+0000 7f2223fff700 1 -- 172.21.15.81:0/3738450788 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f222c017020 con 0x7f223c0cf060 2023-10-06T02:55:33.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.739+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f223c0c83a0 con 0x7f223c0cf060 2023-10-06T02:55:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.740+0000 7f2223fff700 1 -- 172.21.15.81:0/3738450788 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f222c050bb0 con 0x7f223c0cf060 2023-10-06T02:55:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:33.742 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7668,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/97994403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":97994403},{"type":"v1","addr":"172.21.15.81:6834","nonce":97994403}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/871547713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":871547713},{"type":"v1","addr":"172.21.15.81:6835","nonce":871547713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3300657165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3300657165},{"type":"v1","addr":"172.21.15.83:6836","nonce":3300657165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:53:16.320455+0000","modified":"2023-10-06T02:53:19.984430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7686":{"gid":7686,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1726464211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1726464211},{"type":"v1","addr":"172.21.15.83:6837","nonce":1726464211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T02:55:33.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2228066f30 msgr2=0x7f22280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2228066f30 0x7f22280693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2230006d20 tx=0x7f2230009250 comp rx=0 tx=0).stop 2023-10-06T02:55:33.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f223c0cf060 msgr2=0x7f223c1559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f223c0cf060 0x7f223c1559c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c7c0 tx=0x7f222c007f70 comp rx=0 tx=0).stop 2023-10-06T02:55:33.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 shutdown_connections 2023-10-06T02:55:33.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c159f90 0x7f223c0af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2228066f30 0x7f22280693e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f223c0cf060 0x7f223c1559c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 --2- 172.21.15.81:0/3738450788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f223c159bc0 0x7f223c15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 >> 172.21.15.81:0/3738450788 conn(0x7f223c06c620 msgr2=0x7f223c15c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 shutdown_connections 2023-10-06T02:55:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.742+0000 7f2241591700 1 -- 172.21.15.81:0/3738450788 wait complete. 2023-10-06T02:55:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-10-06T02:55:33.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:33.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.867+0000 7feab135c700 1 Processor -- start 2023-10-06T02:55:33.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.867+0000 7feab135c700 1 -- start start 2023-10-06T02:55:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.868+0000 7feab135c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feaac15a2a0 0x7feaac0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.868+0000 7feab135c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7feaac0ceb30 0x7feaac0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.868+0000 7feab135c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0b0ca0 con 0x7feaac06d650 2023-10-06T02:55:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.868+0000 7feab135c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac06e160 con 0x7feaac15a2a0 2023-10-06T02:55:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.868+0000 7feab135c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac06ea90 con 0x7feaac0ceb30 2023-10-06T02:55:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.868+0000 7feaaaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feaac15a2a0 0x7feaac0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feaac15a2a0 0x7feaac0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43702/0 (socket says 172.21.15.81:43702) 2023-10-06T02:55:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaaffd700 1 -- 172.21.15.81:0/3529094518 learned_addr learned my addr 172.21.15.81:0/3529094518 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaa27fc700 1 --2- 172.21.15.81:0/3529094518 >> v2:172.21.15.83:3300/0 conn(0x7feaac0ceb30 0x7feaac0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaaffd700 1 -- 172.21.15.81:0/3529094518 >> v2:172.21.15.83:3300/0 conn(0x7feaac0ceb30 msgr2=0x7feaac0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaaffd700 1 --2- 172.21.15.81:0/3529094518 >> v2:172.21.15.83:3300/0 conn(0x7feaac0ceb30 0x7feaac0cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaaffd700 1 -- 172.21.15.81:0/3529094518 >> v1:172.21.15.83:6789/0 conn(0x7feaac06d650 legacy=0x7feaac06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaaffd700 1 -- 172.21.15.81:0/3529094518 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0b00d0 con 0x7feaac15a2a0 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaaffd700 1 --2- 172.21.15.81:0/3529094518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac15a2a0 0x7feaac0b1130 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7feaac06ab90 tx=0x7fea9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9535dbfab1256c27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaa7fc700 1 -- 172.21.15.81:0/3529094518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c009e70 con 0x7feaac15a2a0 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaa7fc700 1 -- 172.21.15.81:0/3529094518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00b860 con 0x7feaac15a2a0 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.869+0000 7feaaa7fc700 1 -- 172.21.15.81:0/3529094518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00bc00 con 0x7feaac15a2a0 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.870+0000 7feab135c700 1 -- 172.21.15.81:0/3529094518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac15a2a0 msgr2=0x7feaac0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.870+0000 7feab135c700 1 --2- 172.21.15.81:0/3529094518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac15a2a0 0x7feaac0b1130 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7feaac06ab90 tx=0x7fea9c009250 comp rx=0 tx=0).stop 2023-10-06T02:55:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.870+0000 7feab135c700 1 -- 172.21.15.81:0/3529094518 shutdown_connections 2023-10-06T02:55:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.870+0000 7feab135c700 1 --2- 172.21.15.81:0/3529094518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac15a2a0 0x7feaac0b1130 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.870+0000 7feab135c700 1 --2- 172.21.15.81:0/3529094518 >> v2:172.21.15.83:3300/0 conn(0x7feaac0ceb30 0x7feaac0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.870+0000 7feab135c700 1 -- 172.21.15.81:0/3529094518 >> 172.21.15.81:0/3529094518 conn(0x7feaac067640 msgr2=0x7feaac067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.870+0000 7feab135c700 1 -- 172.21.15.81:0/3529094518 shutdown_connections 2023-10-06T02:55:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.870+0000 7feab135c700 1 -- 172.21.15.81:0/3529094518 wait complete. 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.871+0000 7feab135c700 1 Processor -- start 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.871+0000 7feab135c700 1 -- start start 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feab135c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d650 0x7feaac154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feab135c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac0ceb30 0x7feaac15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feab135c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac15a2a0 0x7feaac15d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feab135c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac155110 con 0x7feaac06d650 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feab135c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0b38c0 con 0x7feaac0ceb30 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feab135c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac15c870 con 0x7feaac15a2a0 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaaaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d650 0x7feaac154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaaaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d650 0x7feaac154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43718/0 (socket says 172.21.15.81:43718) 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaaaffd700 1 -- 172.21.15.81:0/660768268 learned_addr learned my addr 172.21.15.81:0/660768268 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaa27fc700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac0ceb30 0x7feaac15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaab7fe700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac15a2a0 0x7feaac15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaaaffd700 1 -- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac15a2a0 msgr2=0x7feaac15d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaaaffd700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac15a2a0 0x7feaac15d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaaaffd700 1 -- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac0ceb30 msgr2=0x7feaac15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaaaffd700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac0ceb30 0x7feaac15d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaaaffd700 1 -- 172.21.15.81:0/660768268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0094f0 con 0x7feaac06d650 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaaaffd700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d650 0x7feaac154bd0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7feaac06f990 tx=0x7fea9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaa37fe700 1 -- 172.21.15.81:0/660768268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00b9d0 con 0x7feaac06d650 2023-10-06T02:55:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaa37fe700 1 -- 172.21.15.81:0/660768268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00bb30 con 0x7feaac06d650 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0b2550 con 0x7feaac06d650 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feaa37fe700 1 -- 172.21.15.81:0/660768268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c025670 con 0x7feaac06d650 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.872+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac15cac0 con 0x7feaac06d650 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.873+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac069e40 con 0x7feaac06d650 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.874+0000 7feaa37fe700 1 -- 172.21.15.81:0/660768268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea9c023070 con 0x7feaac06d650 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.874+0000 7feaa37fe700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea8c066f30 0x7fea8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.874+0000 7feaa37fe700 1 -- 172.21.15.81:0/660768268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea9c085a20 con 0x7feaac06d650 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.874+0000 7feaa37fe700 1 -- 172.21.15.81:0/660768268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7fea8c06f0f0 con 0x7feaac06d650 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.874+0000 7feaa27fc700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea8c066f30 0x7fea8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.875+0000 7feaa27fc700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea8c066f30 0x7fea8c0693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7feaac158a30 tx=0x7fea940091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:33.878+0000 7feaa37fe700 1 -- 172.21.15.81:0/660768268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea9c052b30 con 0x7feaac06d650 2023-10-06T02:55:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.059+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaac04bb80 con 0x7feaac06d650 2023-10-06T02:55:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.060+0000 7feaa37fe700 1 -- 172.21.15.81:0/660768268 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+16860 (secure 0 0 0) 0x7fea9c015030 con 0x7feaac06d650 2023-10-06T02:55:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:34.062 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":153,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:54:54.442401+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:53:13.969056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T02:53:15.291652+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea8c066f30 msgr2=0x7fea8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea8c066f30 0x7fea8c0693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7feaac158a30 tx=0x7fea940091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d650 msgr2=0x7feaac154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d650 0x7feaac154bd0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7feaac06f990 tx=0x7fea9c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 shutdown_connections 2023-10-06T02:55:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feaac15a2a0 0x7feaac15d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaac06d650 0x7feaac154bd0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fea8c066f30 0x7fea8c0693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 --2- 172.21.15.81:0/660768268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaac0ceb30 0x7feaac15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 >> 172.21.15.81:0/660768268 conn(0x7feaac067640 msgr2=0x7feaac0ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:34.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 shutdown_connections 2023-10-06T02:55:34.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.062+0000 7feab135c700 1 -- 172.21.15.81:0/660768268 wait complete. 2023-10-06T02:55:34.076 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:55:34.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.189+0000 7f095759e700 1 Processor -- start 2023-10-06T02:55:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.189+0000 7f095759e700 1 -- start start 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f095759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0958159f10 0x7f0958068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f095759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0958069120 con 0x7f0958159b40 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f095759e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580cee10 con 0x7f0958068cc0 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f095759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580cd040 con 0x7f0958159f10 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f095659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0958159b40 0x7f09580cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50824/0 (socket says 172.21.15.81:50824) 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f095659c700 1 -- 172.21.15.81:0/2330807846 learned_addr learned my addr 172.21.15.81:0/2330807846 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f0955d9b700 1 --2- 172.21.15.81:0/2330807846 >> v2:172.21.15.83:3300/0 conn(0x7f0958159f10 0x7f0958068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f095559a700 1 -- 172.21.15.81:0/2330807846 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069955554 0 0) 0x7f0948001110 con 0x7f0958159b40 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f095559a700 1 -- 172.21.15.81:0/2330807846 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0940003570 con 0x7f0958159b40 2023-10-06T02:55:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f095559a700 1 -- 172.21.15.81:0/2330807846 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782353505 0 0) 0x7f0940003570 con 0x7f0958159b40 2023-10-06T02:55:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.190+0000 7f0955d9b700 1 -- 172.21.15.81:0/2330807846 >> v1:172.21.15.83:6789/0 conn(0x7f0958068cc0 legacy=0x7f09580cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f0955d9b700 1 -- 172.21.15.81:0/2330807846 >> v1:172.21.15.81:6789/0 conn(0x7f0958159b40 legacy=0x7f09580cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f0955d9b700 1 -- 172.21.15.81:0/2330807846 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580cd320 con 0x7f0958159f10 2023-10-06T02:55:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f0955d9b700 1 --2- 172.21.15.81:0/2330807846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0958159f10 0x7f0958068780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f094c0098e0 tx=0x7f094c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=726d90f6a4dbc85f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095559a700 1 -- 172.21.15.81:0/2330807846 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948001600 con 0x7f0958159f10 2023-10-06T02:55:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095559a700 1 -- 172.21.15.81:0/2330807846 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c011420 con 0x7f0958159f10 2023-10-06T02:55:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095559a700 1 -- 172.21.15.81:0/2330807846 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c0117c0 con 0x7f0958159f10 2023-10-06T02:55:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095759e700 1 -- 172.21.15.81:0/2330807846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0958159f10 msgr2=0x7f0958068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095759e700 1 --2- 172.21.15.81:0/2330807846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0958159f10 0x7f0958068780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f094c0098e0 tx=0x7f094c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095759e700 1 -- 172.21.15.81:0/2330807846 shutdown_connections 2023-10-06T02:55:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095759e700 1 --2- 172.21.15.81:0/2330807846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0958159f10 0x7f0958068780 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095759e700 1 -- 172.21.15.81:0/2330807846 >> 172.21.15.81:0/2330807846 conn(0x7f09580cd660 msgr2=0x7f09580cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095759e700 1 -- 172.21.15.81:0/2330807846 shutdown_connections 2023-10-06T02:55:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.191+0000 7f095759e700 1 -- 172.21.15.81:0/2330807846 wait complete. 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.192+0000 7f095759e700 1 Processor -- start 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f095759e700 1 -- start start 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f095759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0958068cc0 0x7f095815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f095759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958159b40 0x7f095816ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f095759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0958159f10 0x7f095815c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f095759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095816f170 con 0x7f0958159b40 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f095759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095815b610 con 0x7f0958068cc0 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f095759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095815aa00 con 0x7f0958159f10 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f0955d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958159b40 0x7f095816ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f0955d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958159b40 0x7f095816ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43730/0 (socket says 172.21.15.81:43730) 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f0955d9b700 1 -- 172.21.15.81:0/300396126 learned_addr learned my addr 172.21.15.81:0/300396126 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f095659c700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0958068cc0 0x7f095815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.193+0000 7f0956d9d700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0958159f10 0x7f095815c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f0955d9b700 1 -- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0958159f10 msgr2=0x7f095815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f0955d9b700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0958159f10 0x7f095815c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f0955d9b700 1 -- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0958068cc0 msgr2=0x7f095815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f0955d9b700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0958068cc0 0x7f095815a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f0955d9b700 1 -- 172.21.15.81:0/300396126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c009420 con 0x7f0958159b40 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f0955d9b700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958159b40 0x7f095816ec30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f094c0030c0 tx=0x7f094c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f09467fc700 1 -- 172.21.15.81:0/300396126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c010ac0 con 0x7f0958159b40 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f09467fc700 1 -- 172.21.15.81:0/300396126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c010c40 con 0x7f0958159b40 2023-10-06T02:55:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095815ace0 con 0x7f0958159b40 2023-10-06T02:55:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f09467fc700 1 -- 172.21.15.81:0/300396126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c01d430 con 0x7f0958159b40 2023-10-06T02:55:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.194+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095815b2a0 con 0x7f0958159b40 2023-10-06T02:55:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.195+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09580cc060 con 0x7f0958159b40 2023-10-06T02:55:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.195+0000 7f09467fc700 1 -- 172.21.15.81:0/300396126 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f094c01d7a0 con 0x7f0958159b40 2023-10-06T02:55:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.196+0000 7f09467fc700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0938066f30 0x7f09380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.196+0000 7f09467fc700 1 -- 172.21.15.81:0/300396126 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f094c0863d0 con 0x7f0958159b40 2023-10-06T02:55:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.196+0000 7f095659c700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0938066f30 0x7f09380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.196+0000 7f09467fc700 1 -- 172.21.15.81:0/300396126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f093806f0f0 con 0x7f0958159b40 2023-10-06T02:55:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.196+0000 7f095659c700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0938066f30 0x7f09380693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f09580b6360 tx=0x7f0948000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.200+0000 7f09467fc700 1 -- 172.21.15.81:0/300396126 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f094c053440 con 0x7f0958159b40 2023-10-06T02:55:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.422+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09580ce7c0 con 0x7f0958159b40 2023-10-06T02:55:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.422+0000 7f09467fc700 1 -- 172.21.15.81:0/300396126 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f094c056a60 con 0x7f0958159b40 2023-10-06T02:55:34.423 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:34.424 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7668,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/97994403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":97994403},{"type":"v1","addr":"172.21.15.81:6834","nonce":97994403}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/871547713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":871547713},{"type":"v1","addr":"172.21.15.81:6835","nonce":871547713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3300657165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3300657165},{"type":"v1","addr":"172.21.15.83:6836","nonce":3300657165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:53:16.320455+0000","modified":"2023-10-06T02:53:19.984430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7686":{"gid":7686,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1726464211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1726464211},{"type":"v1","addr":"172.21.15.83:6837","nonce":1726464211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T02:55:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0938066f30 msgr2=0x7f09380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0938066f30 0x7f09380693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f09580b6360 tx=0x7f0948000bc0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958159b40 msgr2=0x7f095816ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958159b40 0x7f095816ec30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f094c0030c0 tx=0x7f094c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 shutdown_connections 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0958159f10 0x7f095815c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0938066f30 0x7f09380693e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0958068cc0 0x7f095815a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 --2- 172.21.15.81:0/300396126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958159b40 0x7f095816ec30 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 >> 172.21.15.81:0/300396126 conn(0x7f09580cd660 msgr2=0x7f095806f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 shutdown_connections 2023-10-06T02:55:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.424+0000 7f095759e700 1 -- 172.21.15.81:0/300396126 wait complete. 2023-10-06T02:55:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-10-06T02:55:34.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:34.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.550+0000 7f2855b63700 1 Processor -- start 2023-10-06T02:55:34.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.550+0000 7f2855b63700 1 -- start start 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f2855b63700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28501578d0 0x7f28500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f2855b63700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2850157ca0 0x7f285015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f2855b63700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 0x7f285006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f2855b63700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28500d07c0 con 0x7f28501578d0 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f2855b63700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285006daa0 con 0x7f2850157ca0 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f2855b63700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28500cfbb0 con 0x7f285006d120 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28501578d0 0x7f28500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28501578d0 0x7f28500cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43742/0 (socket says 172.21.15.81:43742) 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284f7fe700 1 -- 172.21.15.81:0/2358189700 learned_addr learned my addr 172.21.15.81:0/2358189700 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284effd700 1 --2- 172.21.15.81:0/2358189700 >> v2:172.21.15.83:3300/0 conn(0x7f2850157ca0 0x7f285015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284ffff700 1 --2- 172.21.15.81:0/2358189700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 0x7f285006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284f7fe700 1 -- 172.21.15.81:0/2358189700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 msgr2=0x7f285006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284f7fe700 1 --2- 172.21.15.81:0/2358189700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 0x7f285006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284f7fe700 1 -- 172.21.15.81:0/2358189700 >> v2:172.21.15.83:3300/0 conn(0x7f2850157ca0 msgr2=0x7f285015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284f7fe700 1 --2- 172.21.15.81:0/2358189700 >> v2:172.21.15.83:3300/0 conn(0x7f2850157ca0 0x7f285015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284f7fe700 1 -- 172.21.15.81:0/2358189700 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500cfe90 con 0x7f28501578d0 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284f7fe700 1 --2- 172.21.15.81:0/2358189700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28501578d0 0x7f28500cf4f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2850068510 tx=0x7f2840009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd50f84bc89229 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284e7fc700 1 -- 172.21.15.81:0/2358189700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000e070 con 0x7f28501578d0 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.551+0000 7f284e7fc700 1 -- 172.21.15.81:0/2358189700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284000b970 con 0x7f28501578d0 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f284e7fc700 1 -- 172.21.15.81:0/2358189700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400092e0 con 0x7f28501578d0 2023-10-06T02:55:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f2855b63700 1 -- 172.21.15.81:0/2358189700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28501578d0 msgr2=0x7f28500cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f2855b63700 1 --2- 172.21.15.81:0/2358189700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28501578d0 0x7f28500cf4f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2850068510 tx=0x7f2840009840 comp rx=0 tx=0).stop 2023-10-06T02:55:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f2855b63700 1 -- 172.21.15.81:0/2358189700 shutdown_connections 2023-10-06T02:55:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f2855b63700 1 --2- 172.21.15.81:0/2358189700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 0x7f285006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f2855b63700 1 --2- 172.21.15.81:0/2358189700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28501578d0 0x7f28500cf4f0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f2855b63700 1 --2- 172.21.15.81:0/2358189700 >> v2:172.21.15.83:3300/0 conn(0x7f2850157ca0 0x7f285015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f2855b63700 1 -- 172.21.15.81:0/2358189700 >> 172.21.15.81:0/2358189700 conn(0x7f285006bb90 msgr2=0x7f285006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f2855b63700 1 -- 172.21.15.81:0/2358189700 shutdown_connections 2023-10-06T02:55:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.552+0000 7f2855b63700 1 -- 172.21.15.81:0/2358189700 wait complete. 2023-10-06T02:55:34.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.553+0000 7f2855b63700 1 Processor -- start 2023-10-06T02:55:34.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.553+0000 7f2855b63700 1 -- start start 2023-10-06T02:55:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f2855b63700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 0x7f285016b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f2855b63700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28501578d0 0x7f285013fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f2855b63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2850157ca0 0x7f2850140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f2855b63700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285016b720 con 0x7f2850157ca0 2023-10-06T02:55:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f2855b63700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285016e300 con 0x7f28501578d0 2023-10-06T02:55:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f2855b63700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285016e5e0 con 0x7f285006d120 2023-10-06T02:55:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2850157ca0 0x7f2850140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2850157ca0 0x7f2850140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43750/0 (socket says 172.21.15.81:43750) 2023-10-06T02:55:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284ffff700 1 -- 172.21.15.81:0/4085356794 learned_addr learned my addr 172.21.15.81:0/4085356794 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284effd700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28501578d0 0x7f285013fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284f7fe700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 0x7f285016b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284ffff700 1 -- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 msgr2=0x7f285016b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284ffff700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 0x7f285016b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284ffff700 1 -- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28501578d0 msgr2=0x7f285013fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284ffff700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28501578d0 0x7f285013fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.554+0000 7f284ffff700 1 -- 172.21.15.81:0/4085356794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840009ae0 con 0x7f2850157ca0 2023-10-06T02:55:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.555+0000 7f284ffff700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2850157ca0 0x7f2850140400 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f284800ea50 tx=0x7f28480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.555+0000 7f28377fe700 1 -- 172.21.15.81:0/4085356794 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480096b0 con 0x7f2850157ca0 2023-10-06T02:55:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.555+0000 7f28377fe700 1 -- 172.21.15.81:0/4085356794 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284800c850 con 0x7f2850157ca0 2023-10-06T02:55:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.555+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285016e8c0 con 0x7f2850157ca0 2023-10-06T02:55:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.555+0000 7f28377fe700 1 -- 172.21.15.81:0/4085356794 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800cc10 con 0x7f2850157ca0 2023-10-06T02:55:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.555+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285016b910 con 0x7f2850157ca0 2023-10-06T02:55:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.556+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2850067ac0 con 0x7f2850157ca0 2023-10-06T02:55:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.556+0000 7f28377fe700 1 -- 172.21.15.81:0/4085356794 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2848013470 con 0x7f2850157ca0 2023-10-06T02:55:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.557+0000 7f28377fe700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f283c066f30 0x7f283c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.557+0000 7f28377fe700 1 -- 172.21.15.81:0/4085356794 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2848084750 con 0x7f2850157ca0 2023-10-06T02:55:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.557+0000 7f284f7fe700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f283c066f30 0x7f283c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.557+0000 7f28377fe700 1 -- 172.21.15.81:0/4085356794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f283c06f0f0 con 0x7f2850157ca0 2023-10-06T02:55:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.557+0000 7f284f7fe700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f283c066f30 0x7f283c0693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2840009880 tx=0x7f2840018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.561+0000 7f28377fe700 1 -- 172.21.15.81:0/4085356794 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2848051860 con 0x7f2850157ca0 2023-10-06T02:55:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.787+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28500d0170 con 0x7f2850157ca0 2023-10-06T02:55:34.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.788+0000 7f28377fe700 1 -- 172.21.15.81:0/4085356794 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f2848054e80 con 0x7f2850157ca0 2023-10-06T02:55:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:34.789 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7668,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/97994403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":97994403},{"type":"v1","addr":"172.21.15.81:6834","nonce":97994403}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/871547713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":871547713},{"type":"v1","addr":"172.21.15.81:6835","nonce":871547713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3300657165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3300657165},{"type":"v1","addr":"172.21.15.83:6836","nonce":3300657165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:53:16.320455+0000","modified":"2023-10-06T02:53:19.984430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7686":{"gid":7686,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/1726464211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1726464211},{"type":"v1","addr":"172.21.15.83:6837","nonce":1726464211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f283c066f30 msgr2=0x7f283c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f283c066f30 0x7f283c0693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2840009880 tx=0x7f2840018000 comp rx=0 tx=0).stop 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2850157ca0 msgr2=0x7f2850140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2850157ca0 0x7f2850140400 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f284800ea50 tx=0x7f28480091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 shutdown_connections 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2850157ca0 0x7f2850140400 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f285006d120 0x7f285016b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f283c066f30 0x7f283c0693e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 --2- 172.21.15.81:0/4085356794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28501578d0 0x7f285013fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 >> 172.21.15.81:0/4085356794 conn(0x7f285006bb90 msgr2=0x7f285006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:34.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 shutdown_connections 2023-10-06T02:55:34.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.790+0000 7f2855b63700 1 -- 172.21.15.81:0/4085356794 wait complete. 2023-10-06T02:55:34.793 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-10-06T02:55:34.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:34.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.916+0000 7fb81b271700 1 Processor -- start 2023-10-06T02:55:34.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.916+0000 7fb81b271700 1 -- start start 2023-10-06T02:55:34.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81b271700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb814157ca0 0x7fb8140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81b271700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb81406d120 0x7fb81406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81b271700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8140d07c0 con 0x7fb8141578d0 2023-10-06T02:55:34.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81b271700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81406daa0 con 0x7fb814157ca0 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81b271700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140cfbb0 con 0x7fb81406d120 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81880c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb814157ca0 0x7fb8140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81900d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8141578d0 0x7fb81415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50828/0 (socket says 172.21.15.81:50828) 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81900d700 1 -- 172.21.15.81:0/2303277305 learned_addr learned my addr 172.21.15.81:0/2303277305 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81980e700 1 --2- 172.21.15.81:0/2303277305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb81406d120 0x7fb81406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81880c700 1 -- 172.21.15.81:0/2303277305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb81406d120 msgr2=0x7fb81406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81880c700 1 --2- 172.21.15.81:0/2303277305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb81406d120 0x7fb81406d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81880c700 1 -- 172.21.15.81:0/2303277305 >> v1:172.21.15.81:6789/0 conn(0x7fb8141578d0 legacy=0x7fb81415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81880c700 1 -- 172.21.15.81:0/2303277305 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140cfe90 con 0x7fb814157ca0 2023-10-06T02:55:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb80bfff700 1 -- 172.21.15.81:0/2303277305 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289387522 0 0) 0x7fb8140d07c0 con 0x7fb8141578d0 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb81880c700 1 --2- 172.21.15.81:0/2303277305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 0x7fb8140cf4f0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fb8040098e0 tx=0x7fb8040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ea927ad6c5ba2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb80bfff700 1 -- 172.21.15.81:0/2303277305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804009e80 con 0x7fb814157ca0 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb80bfff700 1 -- 172.21.15.81:0/2303277305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80400b860 con 0x7fb814157ca0 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.917+0000 7fb80bfff700 1 -- 172.21.15.81:0/2303277305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80400bbe0 con 0x7fb814157ca0 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.918+0000 7fb81b271700 1 -- 172.21.15.81:0/2303277305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 msgr2=0x7fb8140cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.918+0000 7fb81b271700 1 --2- 172.21.15.81:0/2303277305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 0x7fb8140cf4f0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fb8040098e0 tx=0x7fb8040091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.918+0000 7fb81b271700 1 -- 172.21.15.81:0/2303277305 shutdown_connections 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.918+0000 7fb81b271700 1 --2- 172.21.15.81:0/2303277305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb81406d120 0x7fb81406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.918+0000 7fb81b271700 1 --2- 172.21.15.81:0/2303277305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 0x7fb8140cf4f0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.918+0000 7fb81b271700 1 -- 172.21.15.81:0/2303277305 >> 172.21.15.81:0/2303277305 conn(0x7fb81406bb90 msgr2=0x7fb81406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:34.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.918+0000 7fb81b271700 1 -- 172.21.15.81:0/2303277305 shutdown_connections 2023-10-06T02:55:34.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.918+0000 7fb81b271700 1 -- 172.21.15.81:0/2303277305 wait complete. 2023-10-06T02:55:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.919+0000 7fb81b271700 1 Processor -- start 2023-10-06T02:55:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.919+0000 7fb81b271700 1 -- start start 2023-10-06T02:55:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81b271700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb81406d120 0x7fb814146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81b271700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8141578d0 0x7fb8140ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81b271700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 0x7fb8140adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81b271700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140aba10 con 0x7fb814157ca0 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81b271700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb814146d40 con 0x7fb8141578d0 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81b271700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140aae00 con 0x7fb81406d120 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81980e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 0x7fb8140adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81980e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 0x7fb8140adc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43770/0 (socket says 172.21.15.81:43770) 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81980e700 1 -- 172.21.15.81:0/1369712694 learned_addr learned my addr 172.21.15.81:0/1369712694 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81980e700 1 -- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb81406d120 msgr2=0x7fb814146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81980e700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb81406d120 0x7fb814146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81980e700 1 -- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8141578d0 msgr2=0x7fb8140ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81880c700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8141578d0 0x7fb8140ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81980e700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8141578d0 0x7fb8140ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81980e700 1 -- 172.21.15.81:0/1369712694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804009420 con 0x7fb814157ca0 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb81980e700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 0x7fb8140adc30 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00ceb0 tx=0x7fb80c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.920+0000 7fb8097fa700 1 -- 172.21.15.81:0/1369712694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c00ae40 con 0x7fb814157ca0 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.921+0000 7fb8097fa700 1 -- 172.21.15.81:0/1369712694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c016430 con 0x7fb814157ca0 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.921+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8140ab0e0 con 0x7fb814157ca0 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.921+0000 7fb8097fa700 1 -- 172.21.15.81:0/1369712694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0167d0 con 0x7fb814157ca0 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.921+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8140ab6a0 con 0x7fb814157ca0 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.921+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb814067ac0 con 0x7fb814157ca0 2023-10-06T02:55:34.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.922+0000 7fb8097fa700 1 -- 172.21.15.81:0/1369712694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb80c003020 con 0x7fb814157ca0 2023-10-06T02:55:34.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.922+0000 7fb8097fa700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7f8066f30 0x7fb7f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:34.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.922+0000 7fb8097fa700 1 -- 172.21.15.81:0/1369712694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb80c012070 con 0x7fb814157ca0 2023-10-06T02:55:34.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.922+0000 7fb8097fa700 1 -- 172.21.15.81:0/1369712694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7fb7f806f0f0 con 0x7fb814157ca0 2023-10-06T02:55:34.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.922+0000 7fb81900d700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7f8066f30 0x7fb7f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:34.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.923+0000 7fb81900d700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7f8066f30 0x7fb7f80693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb8100011e0 tx=0x7fb8100079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:34.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:34.926+0000 7fb8097fa700 1 -- 172.21.15.81:0/1369712694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb80c0526d0 con 0x7fb814157ca0 2023-10-06T02:55:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.108+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8140d0170 con 0x7fb814157ca0 2023-10-06T02:55:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.108+0000 7fb8097fa700 1 -- 172.21.15.81:0/1369712694 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+16860 (secure 0 0 0) 0x7fb80c055cf0 con 0x7fb814157ca0 2023-10-06T02:55:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:35.110 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":153,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:54:54.442401+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:53:13.969056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T02:53:15.291652+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7f8066f30 msgr2=0x7fb7f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7f8066f30 0x7fb7f80693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb8100011e0 tx=0x7fb8100079d0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 msgr2=0x7fb8140adc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 0x7fb8140adc30 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00ceb0 tx=0x7fb80c007870 comp rx=0 tx=0).stop 2023-10-06T02:55:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 shutdown_connections 2023-10-06T02:55:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814157ca0 0x7fb8140adc30 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb81406d120 0x7fb814146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb7f8066f30 0x7fb7f80693e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 --2- 172.21.15.81:0/1369712694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8141578d0 0x7fb8140ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 >> 172.21.15.81:0/1369712694 conn(0x7fb81406bb90 msgr2=0x7fb814155c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 shutdown_connections 2023-10-06T02:55:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.111+0000 7fb81b271700 1 -- 172.21.15.81:0/1369712694 wait complete. 2023-10-06T02:55:35.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:55:35.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.238+0000 7fb3f0022700 1 Processor -- start 2023-10-06T02:55:35.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.238+0000 7fb3f0022700 1 -- start start 2023-10-06T02:55:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.239+0000 7fb3f0022700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb3e81578d0 0x7fb3e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.239+0000 7fb3f0022700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e806d120 0x7fb3e806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.239+0000 7fb3f0022700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e80d07c0 con 0x7fb3e8157ca0 2023-10-06T02:55:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.239+0000 7fb3f0022700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e806daa0 con 0x7fb3e81578d0 2023-10-06T02:55:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.239+0000 7fb3f0022700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80cfbb0 con 0x7fb3e806d120 2023-10-06T02:55:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.239+0000 7fb3ed5bd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb3e8157ca0 0x7fb3e815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50836/0 (socket says 172.21.15.81:50836) 2023-10-06T02:55:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.239+0000 7fb3ed5bd700 1 -- 172.21.15.81:0/4200191304 learned_addr learned my addr 172.21.15.81:0/4200191304 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3eddbe700 1 --2- 172.21.15.81:0/4200191304 >> v2:172.21.15.83:3300/0 conn(0x7fb3e81578d0 0x7fb3e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ee5bf700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e806d120 0x7fb3e806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070724720 0 0) 0x7fb3e80d07c0 con 0x7fb3e8157ca0 2023-10-06T02:55:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d4003570 con 0x7fb3e8157ca0 2023-10-06T02:55:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1529371724 0 0) 0x7fb3d4003570 con 0x7fb3e8157ca0 2023-10-06T02:55:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e806d120 msgr2=0x7fb3e806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e806d120 0x7fb3e806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 >> v2:172.21.15.83:3300/0 conn(0x7fb3e81578d0 msgr2=0x7fb3e80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 --2- 172.21.15.81:0/4200191304 >> v2:172.21.15.83:3300/0 conn(0x7fb3e81578d0 0x7fb3e80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80cfe90 con 0x7fb3e8157ca0 2023-10-06T02:55:35.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fb3d8001470 con 0x7fb3e8157ca0 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 >> v1:172.21.15.81:6789/0 conn(0x7fb3e8157ca0 legacy=0x7fb3e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3d4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3d4004810 0x7fb3d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e806d120 0x7fb3d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e806daa0 con 0x7fb3d4003ae0 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80cfbb0 con 0x7fb3d4004810 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d400bb10 con 0x7fb3e806d120 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3eddbe700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3d4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ed5bd700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3d4004810 0x7fb3d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ee5bf700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e806d120 0x7fb3d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3eddbe700 1 -- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e806d120 msgr2=0x7fb3d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:35.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3eddbe700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e806d120 0x7fb3d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3eddbe700 1 -- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3d4004810 msgr2=0x7fb3d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:35.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3eddbe700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3d4004810 0x7fb3d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3eddbe700 1 -- 172.21.15.81:0/4200191304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4003570 con 0x7fb3d4003ae0 2023-10-06T02:55:35.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3ee5bf700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e806d120 0x7fb3d40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:35.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.240+0000 7fb3eddbe700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3d4003ef0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400e210 tx=0x7fb3e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8978a8c8fb41fda8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:35.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400eac0 con 0x7fb3d4003ae0 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e400f040 con 0x7fb3d4003ae0 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3ecdbc700 1 -- 172.21.15.81:0/4200191304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400ee70 con 0x7fb3d4003ae0 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3f0022700 1 -- 172.21.15.81:0/4200191304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 msgr2=0x7fb3d4003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3f0022700 1 --2- 172.21.15.81:0/4200191304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3d4003ef0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400e210 tx=0x7fb3e400b040 comp rx=0 tx=0).stop 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3ee5bf700 1 -- 172.21.15.81:0/4200191304 reap_dead start 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3f0022700 1 -- 172.21.15.81:0/4200191304 shutdown_connections 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3f0022700 1 -- 172.21.15.81:0/4200191304 >> 172.21.15.81:0/4200191304 conn(0x7fb3e806bb90 msgr2=0x7fb3e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3f0022700 1 -- 172.21.15.81:0/4200191304 shutdown_connections 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.241+0000 7fb3f0022700 1 -- 172.21.15.81:0/4200191304 wait complete. 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.242+0000 7fb3f0022700 1 Processor -- start 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.242+0000 7fb3f0022700 1 -- start start 2023-10-06T02:55:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3f0022700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3e8158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3f0022700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e80b4f10 0x7fb3e80b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3f0022700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e8144360 0x7fb3e81447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3f0022700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8144d20 con 0x7fb3d4003ae0 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3f0022700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80b6a50 con 0x7fb3e80b4f10 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3f0022700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80b59b0 con 0x7fb3e8144360 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3eddbe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3e8158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3eddbe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3e8158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43782/0 (socket says 172.21.15.81:43782) 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3eddbe700 1 -- 172.21.15.81:0/2637191974 learned_addr learned my addr 172.21.15.81:0/2637191974 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3ed5bd700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e80b4f10 0x7fb3e80b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3ee5bf700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e8144360 0x7fb3e81447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3eddbe700 1 -- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e8144360 msgr2=0x7fb3e81447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3eddbe700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e8144360 0x7fb3e81447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3eddbe700 1 -- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e80b4f10 msgr2=0x7fb3e80b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3eddbe700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e80b4f10 0x7fb3e80b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3eddbe700 1 -- 172.21.15.81:0/2637191974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80b5c90 con 0x7fb3d4003ae0 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.243+0000 7fb3ee5bf700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e8144360 0x7fb3e81447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.244+0000 7fb3eddbe700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3e8158720 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400afd0 tx=0x7fb3e401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.244+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4029450 con 0x7fb3d4003ae0 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.244+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e40295b0 con 0x7fb3d4003ae0 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.244+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e80b5f70 con 0x7fb3d4003ae0 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.244+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40299b0 con 0x7fb3d4003ae0 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.244+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e80b6530 con 0x7fb3d4003ae0 2023-10-06T02:55:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.245+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e8067ac0 con 0x7fb3d4003ae0 2023-10-06T02:55:35.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.245+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3e4003040 con 0x7fb3d4003ae0 2023-10-06T02:55:35.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.246+0000 7fb3ddffb700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb3cc066f30 0x7fb3cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.246+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb3e4086940 con 0x7fb3d4003ae0 2023-10-06T02:55:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.246+0000 7fb3ed5bd700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb3cc066f30 0x7fb3cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.246+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7fb3cc06f0f0 con 0x7fb3d4003ae0 2023-10-06T02:55:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.246+0000 7fb3ed5bd700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb3cc066f30 0x7fb3cc0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8000fd0 tx=0x7fb3e80d0730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.250+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3e4018020 con 0x7fb3d4003ae0 2023-10-06T02:55:35.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.475+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb3e80d0170 con 0x7fb3d4003ae0 2023-10-06T02:55:35.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:55:35.475+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:55:35.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.477+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(154..154 src has 1..154) v4 ==== 366+0+0 (secure 0 0 0) 0x7fb3e4057e10 con 0x7fb3d4003ae0 2023-10-06T02:55:35.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.477+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=155}) v3 -- 0x7fb3cc06fa40 con 0x7fb3d4003ae0 2023-10-06T02:55:35.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.480+0000 7fb3ddffb700 1 -- 172.21.15.81:0/2637191974 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb3e4053a50 con 0x7fb3d4003ae0 2023-10-06T02:55:35.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb3cc066f30 msgr2=0x7fb3cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb3cc066f30 0x7fb3cc0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8000fd0 tx=0x7fb3e80d0730 comp rx=0 tx=0).stop 2023-10-06T02:55:35.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 msgr2=0x7fb3e8158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3e8158720 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400afd0 tx=0x7fb3e401a000 comp rx=0 tx=0).stop 2023-10-06T02:55:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 shutdown_connections 2023-10-06T02:55:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3e8144360 0x7fb3e81447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4003ae0 0x7fb3e8158720 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb3cc066f30 0x7fb3cc0693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 --2- 172.21.15.81:0/2637191974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3e80b4f10 0x7fb3e80b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 >> 172.21.15.81:0/2637191974 conn(0x7fb3e806bb90 msgr2=0x7fb3e8155120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 shutdown_connections 2023-10-06T02:55:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.482+0000 7fb3f0022700 1 -- 172.21.15.81:0/2637191974 wait complete. 2023-10-06T02:55:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:55:35.486 INFO:tasks.ceph.mds.b.smithi083.stderr: -9013> 2023-10-06T02:53:21.432+0000 7fa8fb084700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:55:35.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:55:35.515 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:55:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.610+0000 7f3663fff700 1 Processor -- start 2023-10-06T02:55:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.610+0000 7f3663fff700 1 -- start start 2023-10-06T02:55:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f3663fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 0x7f36640cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f3663fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f366406d700 0x7f366415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f3663fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36640cf2d0 con 0x7f36640d02b0 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f3663fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366415a690 con 0x7f366406d700 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f3663fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366406dc00 con 0x7f36640d0b80 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f36637fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f366406d700 0x7f366415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f36637fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f366406d700 0x7f366415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43798/0 (socket says 172.21.15.81:43798) 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f36637fe700 1 -- 172.21.15.81:0/2515599897 learned_addr learned my addr 172.21.15.81:0/2515599897 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f3662ffd700 1 --2- 172.21.15.81:0/2515599897 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 0x7f36640cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f36637fe700 1 -- 172.21.15.81:0/2515599897 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 msgr2=0x7f36640cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f36637fe700 1 --2- 172.21.15.81:0/2515599897 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 0x7f36640cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f36637fe700 1 -- 172.21.15.81:0/2515599897 >> v1:172.21.15.83:6789/0 conn(0x7f36640d02b0 legacy=0x7f366406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f36637fe700 1 -- 172.21.15.81:0/2515599897 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640cf570 con 0x7f366406d700 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.611+0000 7f36637fe700 1 --2- 172.21.15.81:0/2515599897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366406d700 0x7f366415b320 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f365c009f20 tx=0x7f365c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2651a397da507ae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f36627fc700 1 -- 172.21.15.81:0/2515599897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00e070 con 0x7f366406d700 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f36627fc700 1 -- 172.21.15.81:0/2515599897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c00b9d0 con 0x7f366406d700 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f36627fc700 1 -- 172.21.15.81:0/2515599897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0092e0 con 0x7f366406d700 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f3663fff700 1 -- 172.21.15.81:0/2515599897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366406d700 msgr2=0x7f366415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f3663fff700 1 --2- 172.21.15.81:0/2515599897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366406d700 0x7f366415b320 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f365c009f20 tx=0x7f365c009840 comp rx=0 tx=0).stop 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f3663fff700 1 -- 172.21.15.81:0/2515599897 shutdown_connections 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f3663fff700 1 --2- 172.21.15.81:0/2515599897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366406d700 0x7f366415b320 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f3663fff700 1 --2- 172.21.15.81:0/2515599897 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 0x7f36640cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f3663fff700 1 -- 172.21.15.81:0/2515599897 >> 172.21.15.81:0/2515599897 conn(0x7f3664063230 msgr2=0x7f3664063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f3663fff700 1 -- 172.21.15.81:0/2515599897 shutdown_connections 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.612+0000 7f3663fff700 1 -- 172.21.15.81:0/2515599897 wait complete. 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.613+0000 7f3663fff700 1 Processor -- start 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.613+0000 7f3663fff700 1 -- start start 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f3663fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f366406d700 0x7f36640b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f3663fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36640d02b0 0x7f3664154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f3663fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 0x7f366414dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f3663fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366414f1f0 con 0x7f36640d02b0 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f3663fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36640b2600 con 0x7f366406d700 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f3663fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36641550f0 con 0x7f36640d0b80 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f365a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36640d02b0 0x7f3664154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f365a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36640d02b0 0x7f3664154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43808/0 (socket says 172.21.15.81:43808) 2023-10-06T02:55:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f365a7fc700 1 -- 172.21.15.81:0/328233150 learned_addr learned my addr 172.21.15.81:0/328233150 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f3662ffd700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f366406d700 0x7f36640b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.614+0000 7f36637fe700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 0x7f366414dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f365a7fc700 1 -- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 msgr2=0x7f366414dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f365a7fc700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 0x7f366414dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f365a7fc700 1 -- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f366406d700 msgr2=0x7f36640b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f365a7fc700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f366406d700 0x7f36640b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f365a7fc700 1 -- 172.21.15.81:0/328233150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c009ae0 con 0x7f36640d02b0 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f365a7fc700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36640d02b0 0x7f3664154a10 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c590 tx=0x7f364c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f365b7fe700 1 -- 172.21.15.81:0/328233150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c011590 con 0x7f36640d02b0 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f365b7fe700 1 -- 172.21.15.81:0/328233150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c011710 con 0x7f36640d02b0 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36641553d0 con 0x7f36640d02b0 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f365b7fe700 1 -- 172.21.15.81:0/328233150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c011ad0 con 0x7f36640d02b0 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.615+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3664155990 con 0x7f36640d02b0 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.616+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366414f3a0 con 0x7f36640d02b0 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.616+0000 7f365b7fe700 1 -- 172.21.15.81:0/328233150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f364c01b3b0 con 0x7f36640d02b0 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.617+0000 7f365b7fe700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3644067000 0x7f36440694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.617+0000 7f365b7fe700 1 -- 172.21.15.81:0/328233150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f364c083b40 con 0x7f36640d02b0 2023-10-06T02:55:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.617+0000 7f3662ffd700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3644067000 0x7f36440694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.617+0000 7f365b7fe700 1 -- 172.21.15.81:0/328233150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=155}) v3 -- 0x7f364406f260 con 0x7f36640d02b0 2023-10-06T02:55:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.617+0000 7f3662ffd700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3644067000 0x7f36440694b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3654009d10 tx=0x7f36540091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.621+0000 7f365b7fe700 1 -- 172.21.15.81:0/328233150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f364c017070 con 0x7f36640d02b0 2023-10-06T02:55:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:35.847+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f36640676e0 con 0x7f36640d02b0 2023-10-06T02:55:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.485+0000 7f365b7fe700 1 -- 172.21.15.81:0/328233150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) v1 ==== 104+0+0 (secure 0 0 0) 0x7f366414f3a0 con 0x7f36640d02b0 2023-10-06T02:55:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.487+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3644067000 msgr2=0x7f36440694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3644067000 0x7f36440694b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3654009d10 tx=0x7f36540091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36640d02b0 msgr2=0x7f3664154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36640d02b0 0x7f3664154a10 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c590 tx=0x7f364c00c8a0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 shutdown_connections 2023-10-06T02:55:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36640d0b80 0x7f366414dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3644067000 0x7f36440694b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f366406d700 0x7f36640b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 --2- 172.21.15.81:0/328233150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36640d02b0 0x7f3664154a10 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 >> 172.21.15.81:0/328233150 conn(0x7f3664063230 msgr2=0x7f366406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 shutdown_connections 2023-10-06T02:55:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.488+0000 7f3663fff700 1 -- 172.21.15.81:0/328233150 wait complete. 2023-10-06T02:55:36.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:55:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.619+0000 7fa654829700 1 Processor -- start 2023-10-06T02:55:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.619+0000 7fa654829700 1 -- start start 2023-10-06T02:55:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa654829700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa6500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa654829700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa65006d120 0x7fa65006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa654829700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65006dac0 con 0x7fa6501578d0 2023-10-06T02:55:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa654829700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6500d07c0 con 0x7fa65006d120 2023-10-06T02:55:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa654829700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500cfbb0 con 0x7fa650157ca0 2023-10-06T02:55:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa64e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa6501578d0 0x7fa65015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50852/0 (socket says 172.21.15.81:50852) 2023-10-06T02:55:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa64e59c700 1 -- 172.21.15.81:0/797608248 learned_addr learned my addr 172.21.15.81:0/797608248 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920742701 0 0) 0x7fa640001110 con 0x7fa6501578d0 2023-10-06T02:55:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa63c003570 con 0x7fa6501578d0 2023-10-06T02:55:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa645d9b700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa6500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.620+0000 7fa64ed9d700 1 --2- 172.21.15.81:0/797608248 >> v2:172.21.15.83:3300/0 conn(0x7fa65006d120 0x7fa65006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 166939237 0 0) 0x7fa63c003570 con 0x7fa6501578d0 2023-10-06T02:55:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 msgr2=0x7fa6500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa6500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 >> v2:172.21.15.83:3300/0 conn(0x7fa65006d120 msgr2=0x7fa65006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 --2- 172.21.15.81:0/797608248 >> v2:172.21.15.83:3300/0 conn(0x7fa65006d120 0x7fa65006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6500cfe90 con 0x7fa6501578d0 2023-10-06T02:55:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fa640001600 con 0x7fa6501578d0 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 >> v1:172.21.15.81:6789/0 conn(0x7fa6501578d0 legacy=0x7fa65015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa63c003a60 0x7fa63c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa63c004810 0x7fa63c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa63c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500d07c0 con 0x7fa63c003a60 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500cfbb0 con 0x7fa63c004810 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c00ba60 con 0x7fa650157ca0 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64e59c700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa63c003a60 0x7fa63c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa645d9b700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa63c004810 0x7fa63c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64ed9d700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa63c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64e59c700 1 -- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 msgr2=0x7fa63c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64e59c700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa650157ca0 0x7fa63c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64e59c700 1 -- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa63c004810 msgr2=0x7fa63c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64e59c700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa63c004810 0x7fa63c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64e59c700 1 -- 172.21.15.81:0/797608248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c003570 con 0x7fa63c003a60 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64e59c700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa63c003a60 0x7fa63c003e70 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c620 tx=0x7fa6500d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f156c9d52c85c57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64000cde0 con 0x7fa63c003a60 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640005920 con 0x7fa63c003a60 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.621+0000 7fa64dd9b700 1 -- 172.21.15.81:0/797608248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640005ce0 con 0x7fa63c003a60 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.622+0000 7fa654829700 1 -- 172.21.15.81:0/797608248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa63c003a60 msgr2=0x7fa63c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.622+0000 7fa654829700 1 --2- 172.21.15.81:0/797608248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa63c003a60 0x7fa63c003e70 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c620 tx=0x7fa6500d0730 comp rx=0 tx=0).stop 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.622+0000 7fa64ed9d700 1 -- 172.21.15.81:0/797608248 reap_dead start 2023-10-06T02:55:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.622+0000 7fa654829700 1 -- 172.21.15.81:0/797608248 shutdown_connections 2023-10-06T02:55:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.622+0000 7fa654829700 1 -- 172.21.15.81:0/797608248 >> 172.21.15.81:0/797608248 conn(0x7fa65006bb90 msgr2=0x7fa65006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.622+0000 7fa654829700 1 -- 172.21.15.81:0/797608248 shutdown_connections 2023-10-06T02:55:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.622+0000 7fa654829700 1 -- 172.21.15.81:0/797608248 wait complete. 2023-10-06T02:55:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.623+0000 7fa654829700 1 Processor -- start 2023-10-06T02:55:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.623+0000 7fa654829700 1 -- start start 2023-10-06T02:55:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa654829700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63c003a60 0x7fa650154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa654829700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6500aaa40 0x7fa6500ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa654829700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650068be0 0x7fa650069050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa654829700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500b6810 con 0x7fa6500aaa40 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa654829700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500ad390 con 0x7fa650068be0 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa654829700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa650069590 con 0x7fa63c003a60 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa645d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6500aaa40 0x7fa6500ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa645d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6500aaa40 0x7fa6500ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43826/0 (socket says 172.21.15.81:43826) 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa645d9b700 1 -- 172.21.15.81:0/891223039 learned_addr learned my addr 172.21.15.81:0/891223039 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa64ed9d700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650068be0 0x7fa650069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa64e59c700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63c003a60 0x7fa650154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa645d9b700 1 -- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63c003a60 msgr2=0x7fa650154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa645d9b700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63c003a60 0x7fa650154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa645d9b700 1 -- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650068be0 msgr2=0x7fa650069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa645d9b700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650068be0 0x7fa650069050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.624+0000 7fa645d9b700 1 -- 172.21.15.81:0/891223039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65016d980 con 0x7fa6500aaa40 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.625+0000 7fa645d9b700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6500aaa40 0x7fa6500ace50 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa638011d70 tx=0x7fa6380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.625+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63800f990 con 0x7fa6500aaa40 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.625+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63800faf0 con 0x7fa6500aaa40 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.625+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63800fe70 con 0x7fa6500aaa40 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.625+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6500aafb0 con 0x7fa6500aaa40 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.625+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6500ab570 con 0x7fa6500aaa40 2023-10-06T02:55:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.626+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65016a5e0 con 0x7fa6500aaa40 2023-10-06T02:55:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.626+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa638014650 con 0x7fa6500aaa40 2023-10-06T02:55:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.626+0000 7fa646ffd700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.626+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa638018030 con 0x7fa6500aaa40 2023-10-06T02:55:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.627+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=155}) v3 -- 0x7fa63006f190 con 0x7fa6500aaa40 2023-10-06T02:55:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.627+0000 7fa64e59c700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.627+0000 7fa64e59c700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa640007e50 tx=0x7fa640015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.631+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa638022060 con 0x7fa6500aaa40 2023-10-06T02:55:36.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:36.814+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa65016d980 con 0x7fa6500aaa40 2023-10-06T02:55:37.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:55:37.589 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:55:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.704+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(155..155 src has 1..155) v4 ==== 288+0+0 (secure 0 0 0) 0x7fa638056320 con 0x7fa6500aaa40 2023-10-06T02:55:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.704+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7fa63006d5c0 con 0x7fa6500aaa40 2023-10-06T02:55:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.706+0000 7fa646ffd700 1 -- 172.21.15.81:0/891223039 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v155) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa65016d980 con 0x7fa6500aaa40 2023-10-06T02:55:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.711+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 msgr2=0x7fa6300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.711+0000 7fa654829700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa640007e50 tx=0x7fa640015000 comp rx=0 tx=0).stop 2023-10-06T02:55:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.711+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6500aaa40 msgr2=0x7fa6500ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.711+0000 7fa654829700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6500aaa40 0x7fa6500ace50 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa638011d70 tx=0x7fa6380091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.712+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 shutdown_connections 2023-10-06T02:55:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.712+0000 7fa654829700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa630066f30 0x7fa6300693e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.712+0000 7fa654829700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa650068be0 0x7fa650069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.712+0000 7fa654829700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa63c003a60 0x7fa650154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.712+0000 7fa654829700 1 --2- 172.21.15.81:0/891223039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6500aaa40 0x7fa6500ace50 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.712+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 >> 172.21.15.81:0/891223039 conn(0x7fa65006bb90 msgr2=0x7fa650156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.712+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 shutdown_connections 2023-10-06T02:55:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.712+0000 7fa654829700 1 -- 172.21.15.81:0/891223039 wait complete. 2023-10-06T02:55:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:55:37.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:55:37.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.843+0000 7f776c800700 1 Processor -- start 2023-10-06T02:55:37.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.843+0000 7f776c800700 1 -- start start 2023-10-06T02:55:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.844+0000 7f776c800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7768157a70 0x7f77680b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.844+0000 7f776c800700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77680b1720 0x7f77680b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.844+0000 7f776c800700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7768158830 con 0x7f77680b37d0 2023-10-06T02:55:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.844+0000 7f776c800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77680b2b80 con 0x7f7768157a70 2023-10-06T02:55:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.844+0000 7f776c800700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77680b3c50 con 0x7f77680b1720 2023-10-06T02:55:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.844+0000 7f77677fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7768157a70 0x7f77680b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.844+0000 7f77677fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7768157a70 0x7f77680b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43842/0 (socket says 172.21.15.81:43842) 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.844+0000 7f77677fe700 1 -- 172.21.15.81:0/1454384987 learned_addr learned my addr 172.21.15.81:0/1454384987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f7766ffd700 1 --2- 172.21.15.81:0/1454384987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77680b1720 0x7f77680b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f77677fe700 1 -- 172.21.15.81:0/1454384987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77680b1720 msgr2=0x7f77680b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f77677fe700 1 --2- 172.21.15.81:0/1454384987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77680b1720 0x7f77680b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f77677fe700 1 -- 172.21.15.81:0/1454384987 >> v1:172.21.15.83:6789/0 conn(0x7f77680b37d0 legacy=0x7f776806a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f77677fe700 1 -- 172.21.15.81:0/1454384987 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77680cb230 con 0x7f7768157a70 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f77677fe700 1 --2- 172.21.15.81:0/1454384987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7768157a70 0x7f77680b2640 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7758009f20 tx=0x7f7758009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750e865ec4f734c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f77667fc700 1 -- 172.21.15.81:0/1454384987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775800e070 con 0x7f7768157a70 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f77667fc700 1 -- 172.21.15.81:0/1454384987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775800ba80 con 0x7f7768157a70 2023-10-06T02:55:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f77667fc700 1 -- 172.21.15.81:0/1454384987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580092e0 con 0x7f7768157a70 2023-10-06T02:55:37.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f776c800700 1 -- 172.21.15.81:0/1454384987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7768157a70 msgr2=0x7f77680b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:37.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.845+0000 7f776c800700 1 --2- 172.21.15.81:0/1454384987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7768157a70 0x7f77680b2640 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7758009f20 tx=0x7f7758009840 comp rx=0 tx=0).stop 2023-10-06T02:55:37.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.846+0000 7f776c800700 1 -- 172.21.15.81:0/1454384987 shutdown_connections 2023-10-06T02:55:37.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.846+0000 7f776c800700 1 --2- 172.21.15.81:0/1454384987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7768157a70 0x7f77680b2640 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.846+0000 7f776c800700 1 --2- 172.21.15.81:0/1454384987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77680b1720 0x7f77680b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.846+0000 7f776c800700 1 -- 172.21.15.81:0/1454384987 >> 172.21.15.81:0/1454384987 conn(0x7f77680680d0 msgr2=0x7f776806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:37.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.846+0000 7f776c800700 1 -- 172.21.15.81:0/1454384987 shutdown_connections 2023-10-06T02:55:37.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.846+0000 7f776c800700 1 -- 172.21.15.81:0/1454384987 wait complete. 2023-10-06T02:55:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.847+0000 7f776c800700 1 Processor -- start 2023-10-06T02:55:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.847+0000 7f776c800700 1 -- start start 2023-10-06T02:55:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f776c800700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77680b1720 0x7f776814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f776c800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77680b37d0 0x7f77680ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f776c800700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7768157a70 0x7f77680ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f776c800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776814ca10 con 0x7f77680b37d0 2023-10-06T02:55:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f776c800700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77680ce4e0 con 0x7f77680b1720 2023-10-06T02:55:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f776c800700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77680cd8d0 con 0x7f7768157a70 2023-10-06T02:55:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7766ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77680b37d0 0x7f77680ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7766ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77680b37d0 0x7f77680ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43850/0 (socket says 172.21.15.81:43850) 2023-10-06T02:55:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7766ffd700 1 -- 172.21.15.81:0/2928468443 learned_addr learned my addr 172.21.15.81:0/2928468443 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f77677fe700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77680b1720 0x7f776814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7767fff700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7768157a70 0x7f77680ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7766ffd700 1 -- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7768157a70 msgr2=0x7f77680ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7766ffd700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7768157a70 0x7f77680ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7766ffd700 1 -- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77680b1720 msgr2=0x7f776814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7766ffd700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77680b1720 0x7f776814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7766ffd700 1 -- 172.21.15.81:0/2928468443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7758009ae0 con 0x7f77680b37d0 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7767fff700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7768157a70 0x7f77680ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f7766ffd700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77680b37d0 0x7f77680ce970 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f775c00d860 tx=0x7f775c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c009610 con 0x7f77680b37d0 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c009770 con 0x7f77680b37d0 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77680cdbb0 con 0x7f77680b37d0 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c009b30 con 0x7f77680b37d0 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.848+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77680ce170 con 0x7f77680b37d0 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.849+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77680ce670 con 0x7f77680b37d0 2023-10-06T02:55:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.850+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f775c01e460 con 0x7f77680b37d0 2023-10-06T02:55:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.850+0000 7f774f7fe700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7754066f30 0x7f77540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.850+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f775c084b90 con 0x7f77680b37d0 2023-10-06T02:55:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.850+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f775406e310 con 0x7f77680b37d0 2023-10-06T02:55:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.850+0000 7f77677fe700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7754066f30 0x7f77540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.851+0000 7f77677fe700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7754066f30 0x7f77540693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7758009880 tx=0x7f7758018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:37.854+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f775c051e00 con 0x7f77680b37d0 2023-10-06T02:55:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.040+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77680cf8a0 con 0x7f77680b37d0 2023-10-06T02:55:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.714+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(156..156 src has 1..156) v4 ==== 288+0+0 (secure 0 0 0) 0x7f775c0561c0 con 0x7f77680b37d0 2023-10-06T02:55:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.714+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f775406d0a0 con 0x7f77680b37d0 2023-10-06T02:55:38.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.717+0000 7f774f7fe700 1 -- 172.21.15.81:0/2928468443 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v156) v1 ==== 169+0+0 (secure 0 0 0) 0x7f775c055420 con 0x7f77680b37d0 2023-10-06T02:55:38.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7754066f30 msgr2=0x7f77540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7754066f30 0x7f77540693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7758009880 tx=0x7f7758018000 comp rx=0 tx=0).stop 2023-10-06T02:55:38.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77680b37d0 msgr2=0x7f77680ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77680b37d0 0x7f77680ce970 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f775c00d860 tx=0x7f775c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 shutdown_connections 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7768157a70 0x7f77680ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7754066f30 0x7f77540693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77680b1720 0x7f776814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 --2- 172.21.15.81:0/2928468443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77680b37d0 0x7f77680ce970 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 >> 172.21.15.81:0/2928468443 conn(0x7f77680680d0 msgr2=0x7f7768156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.721+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 shutdown_connections 2023-10-06T02:55:38.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.722+0000 7f776c800700 1 -- 172.21.15.81:0/2928468443 wait complete. 2023-10-06T02:55:38.724 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:55:38.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:55:38.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.892+0000 7f8478bb4700 1 Processor -- start 2023-10-06T02:55:38.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.892+0000 7f8478bb4700 1 -- start start 2023-10-06T02:55:38.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f8478bb4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84741578d0 0x7f84740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f8478bb4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f847406d120 0x7f847406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f8478bb4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84740d07c0 con 0x7f8474157ca0 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f8478bb4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847406da50 con 0x7f84741578d0 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f8478bb4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84740cfbb0 con 0x7f847406d120 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84741578d0 0x7f84740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84741578d0 0x7f84740cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43854/0 (socket says 172.21.15.81:43854) 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847259c700 1 -- 172.21.15.81:0/768219338 learned_addr learned my addr 172.21.15.81:0/768219338 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f8472d9d700 1 --2- 172.21.15.81:0/768219338 >> v2:172.21.15.83:3300/0 conn(0x7f847406d120 0x7f847406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847259c700 1 -- 172.21.15.81:0/768219338 >> v2:172.21.15.83:3300/0 conn(0x7f847406d120 msgr2=0x7f847406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847259c700 1 --2- 172.21.15.81:0/768219338 >> v2:172.21.15.83:3300/0 conn(0x7f847406d120 0x7f847406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847259c700 1 -- 172.21.15.81:0/768219338 >> v1:172.21.15.83:6789/0 conn(0x7f8474157ca0 legacy=0x7f847415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847259c700 1 -- 172.21.15.81:0/768219338 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84740cfe90 con 0x7f84741578d0 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847259c700 1 --2- 172.21.15.81:0/768219338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 0x7f84740cf4f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f8474068300 tx=0x7f846c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c964d0e54e0cf043 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847159a700 1 -- 172.21.15.81:0/768219338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00e070 con 0x7f84741578d0 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847159a700 1 -- 172.21.15.81:0/768219338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c00ba10 con 0x7f84741578d0 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.893+0000 7f847159a700 1 -- 172.21.15.81:0/768219338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c0092e0 con 0x7f84741578d0 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.894+0000 7f8478bb4700 1 -- 172.21.15.81:0/768219338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 msgr2=0x7f84740cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.894+0000 7f8478bb4700 1 --2- 172.21.15.81:0/768219338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 0x7f84740cf4f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f8474068300 tx=0x7f846c009840 comp rx=0 tx=0).stop 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.894+0000 7f8478bb4700 1 -- 172.21.15.81:0/768219338 shutdown_connections 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.894+0000 7f8478bb4700 1 --2- 172.21.15.81:0/768219338 >> v2:172.21.15.83:3300/0 conn(0x7f847406d120 0x7f847406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.894+0000 7f8478bb4700 1 --2- 172.21.15.81:0/768219338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 0x7f84740cf4f0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.894+0000 7f8478bb4700 1 -- 172.21.15.81:0/768219338 >> 172.21.15.81:0/768219338 conn(0x7f847406bb90 msgr2=0x7f847406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.894+0000 7f8478bb4700 1 -- 172.21.15.81:0/768219338 shutdown_connections 2023-10-06T02:55:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.894+0000 7f8478bb4700 1 -- 172.21.15.81:0/768219338 wait complete. 2023-10-06T02:55:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.895+0000 7f8478bb4700 1 Processor -- start 2023-10-06T02:55:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.895+0000 7f8478bb4700 1 -- start start 2023-10-06T02:55:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8478bb4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f847406d120 0x7f8474153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8478bb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 0x7f84740c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8478bb4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8474157ca0 0x7f8474069d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8478bb4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84740c81a0 con 0x7f84741578d0 2023-10-06T02:55:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8478bb4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847416d9e0 con 0x7f8474157ca0 2023-10-06T02:55:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8478bb4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847416dcc0 con 0x7f847406d120 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8471d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 0x7f84740c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8471d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 0x7f84740c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43866/0 (socket says 172.21.15.81:43866) 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8471d9b700 1 -- 172.21.15.81:0/788837322 learned_addr learned my addr 172.21.15.81:0/788837322 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8471d9b700 1 -- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f847406d120 msgr2=0x7f8474153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8472d9d700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8474157ca0 0x7f8474069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8471d9b700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f847406d120 0x7f8474153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8471d9b700 1 -- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8474157ca0 msgr2=0x7f8474069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8471d9b700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8474157ca0 0x7f8474069d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8471d9b700 1 -- 172.21.15.81:0/788837322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c009ae0 con 0x7f84741578d0 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.896+0000 7f8471d9b700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 0x7f84740c77c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f845c00b5e0 tx=0x7f845c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.897+0000 7f846a7fc700 1 -- 172.21.15.81:0/788837322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00f510 con 0x7f84741578d0 2023-10-06T02:55:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.897+0000 7f846a7fc700 1 -- 172.21.15.81:0/788837322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00f6b0 con 0x7f84741578d0 2023-10-06T02:55:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.897+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847416dfa0 con 0x7f84741578d0 2023-10-06T02:55:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.897+0000 7f846a7fc700 1 -- 172.21.15.81:0/788837322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00fa70 con 0x7f84741578d0 2023-10-06T02:55:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.897+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847416e7a0 con 0x7f84741578d0 2023-10-06T02:55:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.897+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8474067ac0 con 0x7f84741578d0 2023-10-06T02:55:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.898+0000 7f846a7fc700 1 -- 172.21.15.81:0/788837322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f845c01a400 con 0x7f84741578d0 2023-10-06T02:55:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.898+0000 7f846a7fc700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8454066f30 0x7f84540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.898+0000 7f846a7fc700 1 -- 172.21.15.81:0/788837322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f845c083ec0 con 0x7f84741578d0 2023-10-06T02:55:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.898+0000 7f847259c700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8454066f30 0x7f84540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.899+0000 7f847259c700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8454066f30 0x7f84540693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8474069700 tx=0x7f846c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:38.902+0000 7f846a7fc700 1 -- 172.21.15.81:0/788837322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f845c051350 con 0x7f84741578d0 2023-10-06T02:55:39.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.084+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f84740d0170 con 0x7f84741578d0 2023-10-06T02:55:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.090+0000 7f846a7fc700 1 -- 172.21.15.81:0/788837322 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f845c054970 con 0x7f84741578d0 2023-10-06T02:55:39.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8454066f30 msgr2=0x7f84540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8454066f30 0x7f84540693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8474069700 tx=0x7f846c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:39.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 msgr2=0x7f84740c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 0x7f84740c77c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f845c00b5e0 tx=0x7f845c0090f0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 shutdown_connections 2023-10-06T02:55:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8454066f30 0x7f84540693e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8474157ca0 0x7f8474069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f847406d120 0x7f8474153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 --2- 172.21.15.81:0/788837322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84741578d0 0x7f84740c77c0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 >> 172.21.15.81:0/788837322 conn(0x7f847406bb90 msgr2=0x7f8474155bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 shutdown_connections 2023-10-06T02:55:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.092+0000 7f8478bb4700 1 -- 172.21.15.81:0/788837322 wait complete. 2023-10-06T02:55:39.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-06T02:55:39.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.218+0000 7f265887a700 1 Processor -- start 2023-10-06T02:55:39.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.218+0000 7f265887a700 1 -- start start 2023-10-06T02:55:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f265887a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce5c0 0x7f26540aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f265887a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26540ac570 0x7f265406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f265887a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265415dfb0 con 0x7f26540ce1f0 2023-10-06T02:55:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f265887a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26540acec0 con 0x7f26540ac570 2023-10-06T02:55:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f265887a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26540ad1a0 con 0x7f26540ce5c0 2023-10-06T02:55:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f2652d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26540ac570 0x7f265406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f2652d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26540ac570 0x7f265406e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43870/0 (socket says 172.21.15.81:43870) 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f2652d9d700 1 -- 172.21.15.81:0/720295236 learned_addr learned my addr 172.21.15.81:0/720295236 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f2652d9d700 1 -- 172.21.15.81:0/720295236 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce5c0 msgr2=0x7f26540aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f2649d9b700 1 --2- 172.21.15.81:0/720295236 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce5c0 0x7f26540aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f2652d9d700 1 --2- 172.21.15.81:0/720295236 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce5c0 0x7f26540aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f2652d9d700 1 -- 172.21.15.81:0/720295236 >> v1:172.21.15.83:6789/0 conn(0x7f26540ce1f0 legacy=0x7f265415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.219+0000 7f2652d9d700 1 -- 172.21.15.81:0/720295236 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265415dc40 con 0x7f26540ac570 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f2652d9d700 1 --2- 172.21.15.81:0/720295236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 0x7f265406e230 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f264c009f20 tx=0x7f264c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb3d902340b1c72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f2651d9b700 1 -- 172.21.15.81:0/720295236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00e070 con 0x7f26540ac570 2023-10-06T02:55:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f2651d9b700 1 -- 172.21.15.81:0/720295236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c00ba40 con 0x7f26540ac570 2023-10-06T02:55:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f2651d9b700 1 -- 172.21.15.81:0/720295236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c0092e0 con 0x7f26540ac570 2023-10-06T02:55:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f265887a700 1 -- 172.21.15.81:0/720295236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 msgr2=0x7f265406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f265887a700 1 --2- 172.21.15.81:0/720295236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 0x7f265406e230 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f264c009f20 tx=0x7f264c009840 comp rx=0 tx=0).stop 2023-10-06T02:55:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f265887a700 1 -- 172.21.15.81:0/720295236 shutdown_connections 2023-10-06T02:55:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f265887a700 1 --2- 172.21.15.81:0/720295236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 0x7f265406e230 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f265887a700 1 --2- 172.21.15.81:0/720295236 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce5c0 0x7f26540aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f265887a700 1 -- 172.21.15.81:0/720295236 >> 172.21.15.81:0/720295236 conn(0x7f265406cca0 msgr2=0x7f265406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f265887a700 1 -- 172.21.15.81:0/720295236 shutdown_connections 2023-10-06T02:55:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.220+0000 7f265887a700 1 -- 172.21.15.81:0/720295236 wait complete. 2023-10-06T02:55:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.221+0000 7f265887a700 1 Processor -- start 2023-10-06T02:55:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.221+0000 7f265887a700 1 -- start start 2023-10-06T02:55:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f265887a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 0x7f2654151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f265887a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce1f0 0x7f2654152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f265887a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26540ce5c0 0x7f2654152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f265887a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26541537a0 con 0x7f26540ac570 2023-10-06T02:55:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f265887a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26540b1ac0 con 0x7f26540ce5c0 2023-10-06T02:55:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f265887a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2654152b90 con 0x7f26540ce1f0 2023-10-06T02:55:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f265259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 0x7f2654151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f265259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 0x7f2654151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43880/0 (socket says 172.21.15.81:43880) 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f265259c700 1 -- 172.21.15.81:0/2876974317 learned_addr learned my addr 172.21.15.81:0/2876974317 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f2652d9d700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26540ce5c0 0x7f2654152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.222+0000 7f2649d9b700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce1f0 0x7f2654152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f265259c700 1 -- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce1f0 msgr2=0x7f2654152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f265259c700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce1f0 0x7f2654152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f265259c700 1 -- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26540ce5c0 msgr2=0x7f2654152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f265259c700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26540ce5c0 0x7f2654152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f265259c700 1 -- 172.21.15.81:0/2876974317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c009ae0 con 0x7f26540ac570 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f265259c700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 0x7f2654151770 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f264400c5d0 tx=0x7f2644007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f264affd700 1 -- 172.21.15.81:0/2876974317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644011590 con 0x7f26540ac570 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f264affd700 1 -- 172.21.15.81:0/2876974317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2644011710 con 0x7f26540ac570 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f264affd700 1 -- 172.21.15.81:0/2876974317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644011ad0 con 0x7f26540ac570 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2654152e70 con 0x7f26540ac570 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.223+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2654153430 con 0x7f26540ac570 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.224+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2654153a80 con 0x7f26540ac570 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.224+0000 7f264affd700 1 -- 172.21.15.81:0/2876974317 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f264401c460 con 0x7f26540ac570 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.225+0000 7f264affd700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.225+0000 7f264affd700 1 -- 172.21.15.81:0/2876974317 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2644084050 con 0x7f26540ac570 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.225+0000 7f2649d9b700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.225+0000 7f2649d9b700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2634066f30 0x7f26340693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2654154430 tx=0x7f263c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.229+0000 7f264affd700 1 -- 172.21.15.81:0/2876974317 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2644051460 con 0x7f26540ac570 2023-10-06T02:55:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.483+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f26540aca10 con 0x7f26540ac570 2023-10-06T02:55:39.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.709+0000 7f264affd700 1 -- 172.21.15.81:0/2876974317 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v456) v1 ==== 132+0+0 (secure 0 0 0) 0x7f2644054a80 con 0x7f26540ac570 2023-10-06T02:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.711+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2634066f30 msgr2=0x7f26340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.711+0000 7f265887a700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2634066f30 0x7f26340693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2654154430 tx=0x7f263c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.711+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 msgr2=0x7f2654151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.711+0000 7f265887a700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 0x7f2654151770 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f264400c5d0 tx=0x7f2644007f60 comp rx=0 tx=0).stop 2023-10-06T02:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.711+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 shutdown_connections 2023-10-06T02:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.711+0000 7f265887a700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.712+0000 7f265887a700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26540ce5c0 0x7f2654152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.712+0000 7f265887a700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26540ac570 0x7f2654151770 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.712+0000 7f265887a700 1 --2- 172.21.15.81:0/2876974317 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26540ce1f0 0x7f2654152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.712+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 >> 172.21.15.81:0/2876974317 conn(0x7f265406cca0 msgr2=0x7f2654159600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.712+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 shutdown_connections 2023-10-06T02:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.712+0000 7f265887a700 1 -- 172.21.15.81:0/2876974317 wait complete. 2023-10-06T02:55:39.725 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-06T02:55:39.725 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-10-06T02:55:39.725 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-10-06T02:55:39.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-06T02:55:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.838+0000 7f6886784700 1 Processor -- start 2023-10-06T02:55:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.839+0000 7f6886784700 1 -- start start 2023-10-06T02:55:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.839+0000 7f6886784700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6880157ca0 0x7f68800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.839+0000 7f6886784700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f688006d120 0x7f688006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.839+0000 7f6886784700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68800d07c0 con 0x7f68801578d0 2023-10-06T02:55:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.839+0000 7f6886784700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688006daa0 con 0x7f6880157ca0 2023-10-06T02:55:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.839+0000 7f6886784700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68800cfbb0 con 0x7f688006d120 2023-10-06T02:55:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.839+0000 7f687f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6880157ca0 0x7f68800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.839+0000 7f687ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f68801578d0 0x7f688015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50864/0 (socket says 172.21.15.81:50864) 2023-10-06T02:55:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.839+0000 7f687ffff700 1 -- 172.21.15.81:0/4098199639 learned_addr learned my addr 172.21.15.81:0/4098199639 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f6884d21700 1 --2- 172.21.15.81:0/4098199639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f688006d120 0x7f688006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f687f7fe700 1 -- 172.21.15.81:0/4098199639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f688006d120 msgr2=0x7f688006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f687f7fe700 1 --2- 172.21.15.81:0/4098199639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f688006d120 0x7f688006d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f687f7fe700 1 -- 172.21.15.81:0/4098199639 >> v1:172.21.15.81:6789/0 conn(0x7f68801578d0 legacy=0x7f688015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f687effd700 1 -- 172.21.15.81:0/4098199639 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098293094 0 0) 0x7f68800d07c0 con 0x7f68801578d0 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f687f7fe700 1 -- 172.21.15.81:0/4098199639 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68800cfe90 con 0x7f6880157ca0 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f687f7fe700 1 --2- 172.21.15.81:0/4098199639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6880157ca0 0x7f68800cf4f0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f68740098e0 tx=0x7f68740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96999eafa49e1340 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f687effd700 1 -- 172.21.15.81:0/4098199639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874009e80 con 0x7f6880157ca0 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f687effd700 1 -- 172.21.15.81:0/4098199639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687400b860 con 0x7f6880157ca0 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.840+0000 7f687effd700 1 -- 172.21.15.81:0/4098199639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687400bbe0 con 0x7f6880157ca0 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.841+0000 7f6886784700 1 -- 172.21.15.81:0/4098199639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6880157ca0 msgr2=0x7f68800cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.841+0000 7f6886784700 1 --2- 172.21.15.81:0/4098199639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6880157ca0 0x7f68800cf4f0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f68740098e0 tx=0x7f68740091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.841+0000 7f6886784700 1 -- 172.21.15.81:0/4098199639 shutdown_connections 2023-10-06T02:55:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.841+0000 7f6886784700 1 --2- 172.21.15.81:0/4098199639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f688006d120 0x7f688006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.841+0000 7f6886784700 1 --2- 172.21.15.81:0/4098199639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6880157ca0 0x7f68800cf4f0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.841+0000 7f6886784700 1 -- 172.21.15.81:0/4098199639 >> 172.21.15.81:0/4098199639 conn(0x7f688006bb90 msgr2=0x7f688006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.841+0000 7f6886784700 1 -- 172.21.15.81:0/4098199639 shutdown_connections 2023-10-06T02:55:39.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.841+0000 7f6886784700 1 -- 172.21.15.81:0/4098199639 wait complete. 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.842+0000 7f6886784700 1 Processor -- start 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.842+0000 7f6886784700 1 -- start start 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6886784700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688006d120 0x7f68800b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6886784700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68801578d0 0x7f6880154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6886784700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6880157ca0 0x7f68800aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6886784700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801550e0 con 0x7f688006d120 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6886784700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68800aae60 con 0x7f6880157ca0 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6886784700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68800ab100 con 0x7f68801578d0 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688006d120 0x7f68800b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688006d120 0x7f68800b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43900/0 (socket says 172.21.15.81:43900) 2023-10-06T02:55:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687ffff700 1 -- 172.21.15.81:0/2519298081 learned_addr learned my addr 172.21.15.81:0/2519298081 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6884d21700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6880157ca0 0x7f68800aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687f7fe700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68801578d0 0x7f6880154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687ffff700 1 -- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68801578d0 msgr2=0x7f6880154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687ffff700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68801578d0 0x7f6880154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687ffff700 1 -- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6880157ca0 msgr2=0x7f68800aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687ffff700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6880157ca0 0x7f68800aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687ffff700 1 -- 172.21.15.81:0/2519298081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6874009420 con 0x7f688006d120 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f687ffff700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688006d120 0x7f68800b66b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f687000c7e0 tx=0x7f6870007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6867fff700 1 -- 172.21.15.81:0/2519298081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6870005b30 con 0x7f688006d120 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6867fff700 1 -- 172.21.15.81:0/2519298081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6870005c90 con 0x7f688006d120 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68800ab3e0 con 0x7f688006d120 2023-10-06T02:55:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6867fff700 1 -- 172.21.15.81:0/2519298081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6870007300 con 0x7f688006d120 2023-10-06T02:55:39.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.843+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68800ab9a0 con 0x7f688006d120 2023-10-06T02:55:39.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.844+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68800abcd0 con 0x7f688006d120 2023-10-06T02:55:39.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.845+0000 7f6867fff700 1 -- 172.21.15.81:0/2519298081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f687001b3b0 con 0x7f688006d120 2023-10-06T02:55:39.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.845+0000 7f6867fff700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f686c066f30 0x7f686c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.845+0000 7f6867fff700 1 -- 172.21.15.81:0/2519298081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f68700838b0 con 0x7f688006d120 2023-10-06T02:55:39.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.845+0000 7f687f7fe700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f686c066f30 0x7f686c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.846+0000 7f687f7fe700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f686c066f30 0x7f686c0693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f68801580c0 tx=0x7f6874017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:39.849+0000 7f6867fff700 1 -- 172.21.15.81:0/2519298081 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6870050cc0 con 0x7f688006d120 2023-10-06T02:55:40.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.104+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f68800d0170 con 0x7f688006d120 2023-10-06T02:55:40.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.713+0000 7f6867fff700 1 -- 172.21.15.81:0/2519298081 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v457) v1 ==== 134+0+0 (secure 0 0 0) 0x7f6870017020 con 0x7f688006d120 2023-10-06T02:55:40.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f686c066f30 msgr2=0x7f686c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f686c066f30 0x7f686c0693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f68801580c0 tx=0x7f6874017000 comp rx=0 tx=0).stop 2023-10-06T02:55:40.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688006d120 msgr2=0x7f68800b66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688006d120 0x7f68800b66b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f687000c7e0 tx=0x7f6870007df0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 shutdown_connections 2023-10-06T02:55:40.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f686c066f30 0x7f686c0693e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6880157ca0 0x7f68800aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688006d120 0x7f68800b66b0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 --2- 172.21.15.81:0/2519298081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68801578d0 0x7f6880154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 >> 172.21.15.81:0/2519298081 conn(0x7f688006bb90 msgr2=0x7f68801569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:40.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 shutdown_connections 2023-10-06T02:55:40.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.715+0000 7f6886784700 1 -- 172.21.15.81:0/2519298081 wait complete. 2023-10-06T02:55:40.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:55:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.846+0000 7fd9875f5700 1 Processor -- start 2023-10-06T02:55:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.846+0000 7fd9875f5700 1 -- start start 2023-10-06T02:55:40.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd9875f5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd9800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd9875f5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd98006d120 0x7fd98006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd9875f5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98006dac0 con 0x7fd980157ca0 2023-10-06T02:55:40.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd9875f5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9800d07c0 con 0x7fd98006d120 2023-10-06T02:55:40.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd9875f5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800cfbb0 con 0x7fd9801578d0 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd985391700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd9800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd985b92700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd98006d120 0x7fd98006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd985391700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd9800cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:40812/0 (socket says 172.21.15.81:40812) 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd985b92700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd98006d120 0x7fd98006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:58374/0 (socket says 172.21.15.81:58374) 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.847+0000 7fd985391700 1 -- 172.21.15.81:0/4042339059 learned_addr learned my addr 172.21.15.81:0/4042339059 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.848+0000 7fd985b92700 1 -- 172.21.15.81:0/4042339059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 msgr2=0x7fd9800cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.848+0000 7fd985b92700 1 --2- 172.21.15.81:0/4042339059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd9800cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.848+0000 7fd985b92700 1 -- 172.21.15.81:0/4042339059 >> v1:172.21.15.83:6789/0 conn(0x7fd980157ca0 legacy=0x7fd98015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.848+0000 7fd985b92700 1 -- 172.21.15.81:0/4042339059 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800cfe90 con 0x7fd98006d120 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.848+0000 7fd985391700 1 --2- 172.21.15.81:0/4042339059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd9800cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.848+0000 7fd985b92700 1 --2- 172.21.15.81:0/4042339059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98006d120 0x7fd98006d580 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd978009e60 tx=0x7fd978009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f68386848fde7ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.848+0000 7fd977fff700 1 -- 172.21.15.81:0/4042339059 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97800e070 con 0x7fd98006d120 2023-10-06T02:55:40.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.848+0000 7fd977fff700 1 -- 172.21.15.81:0/4042339059 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97800bb60 con 0x7fd98006d120 2023-10-06T02:55:40.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.848+0000 7fd977fff700 1 -- 172.21.15.81:0/4042339059 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978012430 con 0x7fd98006d120 2023-10-06T02:55:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.849+0000 7fd9875f5700 1 -- 172.21.15.81:0/4042339059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98006d120 msgr2=0x7fd98006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.849+0000 7fd9875f5700 1 --2- 172.21.15.81:0/4042339059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98006d120 0x7fd98006d580 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd978009e60 tx=0x7fd978009780 comp rx=0 tx=0).stop 2023-10-06T02:55:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.849+0000 7fd9875f5700 1 -- 172.21.15.81:0/4042339059 shutdown_connections 2023-10-06T02:55:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.849+0000 7fd9875f5700 1 --2- 172.21.15.81:0/4042339059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98006d120 0x7fd98006d580 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.849+0000 7fd9875f5700 1 --2- 172.21.15.81:0/4042339059 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd9800cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.849+0000 7fd9875f5700 1 -- 172.21.15.81:0/4042339059 >> 172.21.15.81:0/4042339059 conn(0x7fd98006bb90 msgr2=0x7fd98006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.849+0000 7fd9875f5700 1 -- 172.21.15.81:0/4042339059 shutdown_connections 2023-10-06T02:55:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.849+0000 7fd9875f5700 1 -- 172.21.15.81:0/4042339059 wait complete. 2023-10-06T02:55:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.850+0000 7fd9875f5700 1 Processor -- start 2023-10-06T02:55:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.850+0000 7fd9875f5700 1 -- start start 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9875f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98006d120 0x7fd9800ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9875f5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd980154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9875f5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd980157ca0 0x7fd98015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9875f5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800aa890 con 0x7fd98006d120 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9875f5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800ad6e0 con 0x7fd980157ca0 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9875f5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800ab670 con 0x7fd9801578d0 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985391700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98006d120 0x7fd9800ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985391700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98006d120 0x7fd9800ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36680/0 (socket says 172.21.15.81:36680) 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985391700 1 -- 172.21.15.81:0/3930853851 learned_addr learned my addr 172.21.15.81:0/3930853851 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985b92700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd980157ca0 0x7fd98015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd984b90700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd980154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985391700 1 -- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 msgr2=0x7fd980154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985391700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd980154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985391700 1 -- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd980157ca0 msgr2=0x7fd98015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985391700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd980157ca0 0x7fd98015c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985391700 1 -- 172.21.15.81:0/3930853851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c0094f0 con 0x7fd98006d120 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd985391700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98006d120 0x7fd9800ad1a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00ec50 tx=0x7fd97c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9757fa700 1 -- 172.21.15.81:0/3930853851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00c9d0 con 0x7fd98006d120 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9757fa700 1 -- 172.21.15.81:0/3930853851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c00cb30 con 0x7fd98006d120 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd978009a20 con 0x7fd98006d120 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9757fa700 1 -- 172.21.15.81:0/3930853851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c013470 con 0x7fd98006d120 2023-10-06T02:55:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.851+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9800aad40 con 0x7fd98006d120 2023-10-06T02:55:40.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.852+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9800ab950 con 0x7fd98006d120 2023-10-06T02:55:40.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.853+0000 7fd9757fa700 1 -- 172.21.15.81:0/3930853851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd97c013860 con 0x7fd98006d120 2023-10-06T02:55:40.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.853+0000 7fd9757fa700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd964066f30 0x7fd9640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.853+0000 7fd9757fa700 1 -- 172.21.15.81:0/3930853851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd97c084bd0 con 0x7fd98006d120 2023-10-06T02:55:40.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.853+0000 7fd984b90700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd964066f30 0x7fd9640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.854+0000 7fd984b90700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd964066f30 0x7fd9640693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd9800ce0e0 tx=0x7fd970009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:40.858+0000 7fd9757fa700 1 -- 172.21.15.81:0/3930853851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd97c051fe0 con 0x7fd98006d120 2023-10-06T02:55:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.040+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd9800d0170 con 0x7fd98006d120 2023-10-06T02:55:41.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.046+0000 7fd9757fa700 1 -- 172.21.15.81:0/3930853851 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd97c055600 con 0x7fd98006d120 2023-10-06T02:55:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd964066f30 msgr2=0x7fd9640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd964066f30 0x7fd9640693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd9800ce0e0 tx=0x7fd970009040 comp rx=0 tx=0).stop 2023-10-06T02:55:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98006d120 msgr2=0x7fd9800ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98006d120 0x7fd9800ad1a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00ec50 tx=0x7fd97c009250 comp rx=0 tx=0).stop 2023-10-06T02:55:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 shutdown_connections 2023-10-06T02:55:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd964066f30 0x7fd9640693e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd980157ca0 0x7fd98015c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98006d120 0x7fd9800ad1a0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 --2- 172.21.15.81:0/3930853851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9801578d0 0x7fd980154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 >> 172.21.15.81:0/3930853851 conn(0x7fd98006bb90 msgr2=0x7fd9801568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 shutdown_connections 2023-10-06T02:55:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.048+0000 7fd9875f5700 1 -- 172.21.15.81:0/3930853851 wait complete. 2023-10-06T02:55:41.061 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:55:41.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:55:41.099 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:55:41.148 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:55:41.148 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:55:41.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.261+0000 7f4aea80e700 1 Processor -- start 2023-10-06T02:55:41.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.261+0000 7f4aea80e700 1 -- start start 2023-10-06T02:55:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4aea80e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ae4159b40 0x7f4ae40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4aea80e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4068e90 0x7f4ae40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4aea80e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40cee10 con 0x7f4ae4159f10 2023-10-06T02:55:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4aea80e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae40cd040 con 0x7f4ae4159b40 2023-10-06T02:55:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4aea80e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40cd320 con 0x7f4ae4068e90 2023-10-06T02:55:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4ae980c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ae4159b40 0x7f4ae40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4ae980c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ae4159b40 0x7f4ae40cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36686/0 (socket says 172.21.15.81:36686) 2023-10-06T02:55:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4ae980c700 1 -- 172.21.15.81:0/332582235 learned_addr learned my addr 172.21.15.81:0/332582235 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4aea00d700 1 --2- 172.21.15.81:0/332582235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4068e90 0x7f4ae40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4ae980c700 1 -- 172.21.15.81:0/332582235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4068e90 msgr2=0x7f4ae40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4ae980c700 1 --2- 172.21.15.81:0/332582235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4068e90 0x7f4ae40cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4ae980c700 1 -- 172.21.15.81:0/332582235 >> v1:172.21.15.83:6789/0 conn(0x7f4ae4159f10 legacy=0x7f4ae4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4ae980c700 1 -- 172.21.15.81:0/332582235 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40ce7c0 con 0x7f4ae4159b40 2023-10-06T02:55:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4aea00d700 1 --2- 172.21.15.81:0/332582235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4068e90 0x7f4ae40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.262+0000 7f4ae980c700 1 --2- 172.21.15.81:0/332582235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159b40 0x7f4ae40cc600 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00099b0 tx=0x7f4ae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf58f7cad6875325 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4ae880a700 1 -- 172.21.15.81:0/332582235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae000b820 con 0x7f4ae4159b40 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4ae880a700 1 -- 172.21.15.81:0/332582235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae000b980 con 0x7f4ae4159b40 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4ae880a700 1 -- 172.21.15.81:0/332582235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae000bd20 con 0x7f4ae4159b40 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4aea80e700 1 -- 172.21.15.81:0/332582235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159b40 msgr2=0x7f4ae40cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4aea80e700 1 --2- 172.21.15.81:0/332582235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159b40 0x7f4ae40cc600 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00099b0 tx=0x7f4ae0009250 comp rx=0 tx=0).stop 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4aea80e700 1 -- 172.21.15.81:0/332582235 shutdown_connections 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4aea80e700 1 --2- 172.21.15.81:0/332582235 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4068e90 0x7f4ae40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4aea80e700 1 --2- 172.21.15.81:0/332582235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159b40 0x7f4ae40cc600 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4aea80e700 1 -- 172.21.15.81:0/332582235 >> 172.21.15.81:0/332582235 conn(0x7f4ae40cd660 msgr2=0x7f4ae40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4aea80e700 1 -- 172.21.15.81:0/332582235 shutdown_connections 2023-10-06T02:55:41.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.263+0000 7f4aea80e700 1 -- 172.21.15.81:0/332582235 wait complete. 2023-10-06T02:55:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.264+0000 7f4aea80e700 1 Processor -- start 2023-10-06T02:55:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.264+0000 7f4aea80e700 1 -- start start 2023-10-06T02:55:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea80e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ae4068e90 0x7f4ae40c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea80e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4159b40 0x7f4ae4156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea80e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159f10 0x7f4ae41461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea80e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40b3aa0 con 0x7f4ae4159f10 2023-10-06T02:55:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea80e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40b3d80 con 0x7f4ae4068e90 2023-10-06T02:55:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea80e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40b4060 con 0x7f4ae4159b40 2023-10-06T02:55:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea00d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159f10 0x7f4ae41461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea00d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159f10 0x7f4ae41461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36700/0 (socket says 172.21.15.81:36700) 2023-10-06T02:55:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea00d700 1 -- 172.21.15.81:0/595853786 learned_addr learned my addr 172.21.15.81:0/595853786 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4ae900b700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4159b40 0x7f4ae4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4ae980c700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ae4068e90 0x7f4ae40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea00d700 1 -- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4159b40 msgr2=0x7f4ae4156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea00d700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4159b40 0x7f4ae4156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea00d700 1 -- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ae4068e90 msgr2=0x7f4ae40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea00d700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ae4068e90 0x7f4ae40c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea00d700 1 -- 172.21.15.81:0/595853786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00094f0 con 0x7f4ae4159f10 2023-10-06T02:55:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.265+0000 7f4aea00d700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159f10 0x7f4ae41461f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00cfb0 tx=0x7f4adc0078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.266+0000 7f4ad9ffb700 1 -- 172.21.15.81:0/595853786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00aea0 con 0x7f4ae4159f10 2023-10-06T02:55:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.266+0000 7f4ad9ffb700 1 -- 172.21.15.81:0/595853786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc015440 con 0x7f4ae4159f10 2023-10-06T02:55:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.266+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae40b4340 con 0x7f4ae4159f10 2023-10-06T02:55:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.266+0000 7f4ad9ffb700 1 -- 172.21.15.81:0/595853786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc015800 con 0x7f4ae4159f10 2023-10-06T02:55:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.266+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae40ca220 con 0x7f4ae4159f10 2023-10-06T02:55:41.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.267+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae40ca440 con 0x7f4ae4159f10 2023-10-06T02:55:41.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.267+0000 7f4ad9ffb700 1 -- 172.21.15.81:0/595853786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4adc003020 con 0x7f4ae4159f10 2023-10-06T02:55:41.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.267+0000 7f4ad9ffb700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ac8066f30 0x7f4ac80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.268+0000 7f4ad9ffb700 1 -- 172.21.15.81:0/595853786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4adc0849f0 con 0x7f4ae4159f10 2023-10-06T02:55:41.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.268+0000 7f4ae980c700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ac8066f30 0x7f4ac80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.268+0000 7f4ae980c700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ac8066f30 0x7f4ac80693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00099b0 tx=0x7f4ae0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.272+0000 7f4ad9ffb700 1 -- 172.21.15.81:0/595853786 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4adc04d5a0 con 0x7f4ae4159f10 2023-10-06T02:55:41.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.492+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ae40b4860 con 0x7f4ae4159f10 2023-10-06T02:55:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.493+0000 7f4ad9ffb700 1 -- 172.21.15.81:0/595853786 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f4ae40b4860 con 0x7f4ae4159f10 2023-10-06T02:55:41.494 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:41.494 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/3102238192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":3102238192},{"type":"v1","addr":"172.21.15.83:6837","nonce":3102238192}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7668,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/97994403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":97994403},{"type":"v1","addr":"172.21.15.81:6834","nonce":97994403}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/871547713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":871547713},{"type":"v1","addr":"172.21.15.81:6835","nonce":871547713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3300657165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3300657165},{"type":"v1","addr":"172.21.15.83:6836","nonce":3300657165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[]} 2023-10-06T02:55:41.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ac8066f30 msgr2=0x7f4ac80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ac8066f30 0x7f4ac80693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00099b0 tx=0x7f4ae0016000 comp rx=0 tx=0).stop 2023-10-06T02:55:41.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159f10 msgr2=0x7f4ae41461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159f10 0x7f4ae41461f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00cfb0 tx=0x7f4adc0078c0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 shutdown_connections 2023-10-06T02:55:41.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae4159f10 0x7f4ae41461f0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4ac8066f30 0x7f4ac80693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ae4068e90 0x7f4ae40c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 --2- 172.21.15.81:0/595853786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ae4159b40 0x7f4ae4156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 >> 172.21.15.81:0/595853786 conn(0x7f4ae40cd660 msgr2=0x7f4ae406dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 shutdown_connections 2023-10-06T02:55:41.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.495+0000 7f4aea80e700 1 -- 172.21.15.81:0/595853786 wait complete. 2023-10-06T02:55:41.499 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2023-10-06T02:55:41.508 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:55:41.509 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:55:41.509 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:55:41.509 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:55:41.509 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:55:41.509 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:55:41.509 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:55:41.509 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:55:41.510 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:55:41.510 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:55:41.510 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:55:41.510 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:55:41.510 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:55:41.510 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:55:41.511 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:55:41.511 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:55:41.518 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:55:41.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:55:41.519 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:55:41.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:55:41.524 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:55:41.524 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:55:41.525 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:55:41.525 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:55:41.560 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:55:41.560 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:41.561 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:55:41.561 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:41.566 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:55:41.566 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:41.567 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:55:41.567 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:41.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:55:41.633 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:55:41.634 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:55:41.649 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:55:41.650 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:55:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.686+0000 7f581dadd700 1 Processor -- start 2023-10-06T02:55:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.686+0000 7f581dadd700 1 -- start start 2023-10-06T02:55:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.687+0000 7f581dadd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f58181578d0 0x7f58180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.687+0000 7f581dadd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5818157ca0 0x7f581815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.687+0000 7f581dadd700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58180d07c0 con 0x7f581806d120 2023-10-06T02:55:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.687+0000 7f581dadd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58180cfbb0 con 0x7f5818157ca0 2023-10-06T02:55:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.687+0000 7f581dadd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58180cfe90 con 0x7f58181578d0 2023-10-06T02:55:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.687+0000 7f5816ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5818157ca0 0x7f581815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.687+0000 7f5816ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5818157ca0 0x7f581815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36746/0 (socket says 172.21.15.81:36746) 2023-10-06T02:55:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.687+0000 7f5816ffd700 1 -- 172.21.15.81:0/3069116722 learned_addr learned my addr 172.21.15.81:0/3069116722 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.687+0000 7f58177fe700 1 --2- 172.21.15.81:0/3069116722 >> v2:172.21.15.83:3300/0 conn(0x7f58181578d0 0x7f58180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f5816ffd700 1 -- 172.21.15.81:0/3069116722 >> v2:172.21.15.83:3300/0 conn(0x7f58181578d0 msgr2=0x7f58180cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f5816ffd700 1 --2- 172.21.15.81:0/3069116722 >> v2:172.21.15.83:3300/0 conn(0x7f58181578d0 0x7f58180cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f5816ffd700 1 -- 172.21.15.81:0/3069116722 >> v1:172.21.15.83:6789/0 conn(0x7f581806d120 legacy=0x7f581806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f5816ffd700 1 -- 172.21.15.81:0/3069116722 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58180d0170 con 0x7f5818157ca0 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f5816ffd700 1 --2- 172.21.15.81:0/3069116722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 0x7f581815af00 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f58180646b0 tx=0x7f580c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f895ee029677d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f58167fc700 1 -- 172.21.15.81:0/3069116722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c009e70 con 0x7f5818157ca0 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f58167fc700 1 -- 172.21.15.81:0/3069116722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c00b860 con 0x7f5818157ca0 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f58167fc700 1 -- 172.21.15.81:0/3069116722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c00bc00 con 0x7f5818157ca0 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f581dadd700 1 -- 172.21.15.81:0/3069116722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 msgr2=0x7f581815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f581dadd700 1 --2- 172.21.15.81:0/3069116722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 0x7f581815af00 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f58180646b0 tx=0x7f580c009250 comp rx=0 tx=0).stop 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f581dadd700 1 -- 172.21.15.81:0/3069116722 shutdown_connections 2023-10-06T02:55:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f581dadd700 1 --2- 172.21.15.81:0/3069116722 >> v2:172.21.15.83:3300/0 conn(0x7f58181578d0 0x7f58180cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f581dadd700 1 --2- 172.21.15.81:0/3069116722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 0x7f581815af00 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f581dadd700 1 -- 172.21.15.81:0/3069116722 >> 172.21.15.81:0/3069116722 conn(0x7f581806bb90 msgr2=0x7f581806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.688+0000 7f581dadd700 1 -- 172.21.15.81:0/3069116722 shutdown_connections 2023-10-06T02:55:41.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.689+0000 7f581dadd700 1 -- 172.21.15.81:0/3069116722 wait complete. 2023-10-06T02:55:41.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.690+0000 7f581dadd700 1 Processor -- start 2023-10-06T02:55:41.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.690+0000 7f581dadd700 1 -- start start 2023-10-06T02:55:41.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.690+0000 7f581dadd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581806d120 0x7f5818144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.690+0000 7f581dadd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58181578d0 0x7f58180cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.690+0000 7f581dadd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 0x7f58181595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.690+0000 7f581dadd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58180ccf30 con 0x7f5818157ca0 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.690+0000 7f581dadd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58180cc080 con 0x7f58181578d0 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.690+0000 7f581dadd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58180cc320 con 0x7f581806d120 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.690+0000 7f5817fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 0x7f58181595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f5817fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 0x7f58181595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36758/0 (socket says 172.21.15.81:36758) 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f5817fff700 1 -- 172.21.15.81:0/1454127434 learned_addr learned my addr 172.21.15.81:0/1454127434 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f5816ffd700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58181578d0 0x7f58180cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f58177fe700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581806d120 0x7f5818144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f5817fff700 1 -- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581806d120 msgr2=0x7f5818144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f5817fff700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581806d120 0x7f5818144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f5817fff700 1 -- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58181578d0 msgr2=0x7f58180cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f5817fff700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58181578d0 0x7f58180cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f5817fff700 1 -- 172.21.15.81:0/1454127434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c0094f0 con 0x7f5818157ca0 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f5817fff700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 0x7f58181595b0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f581000c560 tx=0x7f5810007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f57ff7fe700 1 -- 172.21.15.81:0/1454127434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810011590 con 0x7f5818157ca0 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f57ff7fe700 1 -- 172.21.15.81:0/1454127434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58100116f0 con 0x7f5818157ca0 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58180cc600 con 0x7f5818157ca0 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f57ff7fe700 1 -- 172.21.15.81:0/1454127434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810011ab0 con 0x7f5818157ca0 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.691+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58180ccbc0 con 0x7f5818157ca0 2023-10-06T02:55:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.692+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58180cd0a0 con 0x7f5818157ca0 2023-10-06T02:55:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.693+0000 7f57ff7fe700 1 -- 172.21.15.81:0/1454127434 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f581001b3b0 con 0x7f5818157ca0 2023-10-06T02:55:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.693+0000 7f57ff7fe700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5804066f30 0x7f58040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.693+0000 7f57ff7fe700 1 -- 172.21.15.81:0/1454127434 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5810083750 con 0x7f5818157ca0 2023-10-06T02:55:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.693+0000 7f58177fe700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5804066f30 0x7f58040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.694+0000 7f58177fe700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5804066f30 0x7f58040693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f580800f570 tx=0x7f580800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.697+0000 7f57ff7fe700 1 -- 172.21.15.81:0/1454127434 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5810050b60 con 0x7f5818157ca0 2023-10-06T02:55:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:41.895+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f58180d0450 con 0x7f5818157ca0 2023-10-06T02:55:42.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.732+0000 7f57ff7fe700 1 -- 172.21.15.81:0/1454127434 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v161) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5810017020 con 0x7f5818157ca0 2023-10-06T02:55:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5804066f30 msgr2=0x7f58040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5804066f30 0x7f58040693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f580800f570 tx=0x7f580800b040 comp rx=0 tx=0).stop 2023-10-06T02:55:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 msgr2=0x7f58181595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 0x7f58181595b0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f581000c560 tx=0x7f5810007ef0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 shutdown_connections 2023-10-06T02:55:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5818157ca0 0x7f58181595b0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581806d120 0x7f5818144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5804066f30 0x7f58040693e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 --2- 172.21.15.81:0/1454127434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58181578d0 0x7f58180cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 >> 172.21.15.81:0/1454127434 conn(0x7f581806bb90 msgr2=0x7f581815a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 shutdown_connections 2023-10-06T02:55:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.734+0000 7f581dadd700 1 -- 172.21.15.81:0/1454127434 wait complete. 2023-10-06T02:55:42.738 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:55:42.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:55:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.862+0000 7f82e92f6700 1 Processor -- start 2023-10-06T02:55:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.862+0000 7f82e92f6700 1 -- start start 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.863+0000 7f82e92f6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82e4159bc0 0x7f82e40b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.863+0000 7f82e92f6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f82e40cf060 0x7f82e406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.863+0000 7f82e92f6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e4067640 con 0x7f82e4159f90 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.863+0000 7f82e92f6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e40b1e50 con 0x7f82e4159bc0 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.863+0000 7f82e92f6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e4067890 con 0x7f82e40cf060 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.863+0000 7f82e3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82e4159bc0 0x7f82e40b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.863+0000 7f82e3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82e4159bc0 0x7f82e40b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36772/0 (socket says 172.21.15.81:36772) 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.863+0000 7f82e3fff700 1 -- 172.21.15.81:0/956276958 learned_addr learned my addr 172.21.15.81:0/956276958 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.863+0000 7f82e8af5700 1 --2- 172.21.15.81:0/956276958 >> v2:172.21.15.83:3300/0 conn(0x7f82e40cf060 0x7f82e406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e3fff700 1 -- 172.21.15.81:0/956276958 >> v2:172.21.15.83:3300/0 conn(0x7f82e40cf060 msgr2=0x7f82e406b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e3fff700 1 --2- 172.21.15.81:0/956276958 >> v2:172.21.15.83:3300/0 conn(0x7f82e40cf060 0x7f82e406b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e3fff700 1 -- 172.21.15.81:0/956276958 >> v1:172.21.15.83:6789/0 conn(0x7f82e4159f90 legacy=0x7f82e40ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e3fff700 1 -- 172.21.15.81:0/956276958 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4067b70 con 0x7f82e4159bc0 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e3fff700 1 --2- 172.21.15.81:0/956276958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e4159bc0 0x7f82e40b17c0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f82e40b4a00 tx=0x7f82d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f723d57ac6e503 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e2ffd700 1 -- 172.21.15.81:0/956276958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d400b820 con 0x7f82e4159bc0 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e2ffd700 1 -- 172.21.15.81:0/956276958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d400b980 con 0x7f82e4159bc0 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e2ffd700 1 -- 172.21.15.81:0/956276958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d400bd20 con 0x7f82e4159bc0 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e92f6700 1 -- 172.21.15.81:0/956276958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e4159bc0 msgr2=0x7f82e40b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e92f6700 1 --2- 172.21.15.81:0/956276958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e4159bc0 0x7f82e40b17c0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f82e40b4a00 tx=0x7f82d4009250 comp rx=0 tx=0).stop 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e92f6700 1 -- 172.21.15.81:0/956276958 shutdown_connections 2023-10-06T02:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e92f6700 1 --2- 172.21.15.81:0/956276958 >> v2:172.21.15.83:3300/0 conn(0x7f82e40cf060 0x7f82e406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e92f6700 1 --2- 172.21.15.81:0/956276958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e4159bc0 0x7f82e40b17c0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e92f6700 1 -- 172.21.15.81:0/956276958 >> 172.21.15.81:0/956276958 conn(0x7f82e406c620 msgr2=0x7f82e406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e92f6700 1 -- 172.21.15.81:0/956276958 shutdown_connections 2023-10-06T02:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.864+0000 7f82e92f6700 1 -- 172.21.15.81:0/956276958 wait complete. 2023-10-06T02:55:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.865+0000 7f82e92f6700 1 Processor -- start 2023-10-06T02:55:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.866+0000 7f82e92f6700 1 -- start start 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.866+0000 7f82e92f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40cf060 0x7f82e40ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.866+0000 7f82e92f6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e4159bc0 0x7f82e41531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.866+0000 7f82e92f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82e4159f90 0x7f82e40c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.866+0000 7f82e92f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4153e00 con 0x7f82e40cf060 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.866+0000 7f82e92f6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40afae0 con 0x7f82e4159bc0 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.866+0000 7f82e92f6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40aeed0 con 0x7f82e4159f90 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40cf060 0x7f82e40ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40cf060 0x7f82e40ca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36782/0 (socket says 172.21.15.81:36782) 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e3fff700 1 -- 172.21.15.81:0/2436120636 learned_addr learned my addr 172.21.15.81:0/2436120636 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e37fe700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e4159bc0 0x7f82e41531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e8af5700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82e4159f90 0x7f82e40c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e3fff700 1 -- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82e4159f90 msgr2=0x7f82e40c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e3fff700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82e4159f90 0x7f82e40c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e3fff700 1 -- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e4159bc0 msgr2=0x7f82e41531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e3fff700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e4159bc0 0x7f82e41531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e3fff700 1 -- 172.21.15.81:0/2436120636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d40094f0 con 0x7f82e40cf060 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e3fff700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40cf060 0x7f82e40ca0e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f82d40030c0 tx=0x7f82d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82cbfff700 1 -- 172.21.15.81:0/2436120636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4011d00 con 0x7f82e40cf060 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82cbfff700 1 -- 172.21.15.81:0/2436120636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4020070 con 0x7f82e40cf060 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e40af1b0 con 0x7f82e40cf060 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82cbfff700 1 -- 172.21.15.81:0/2436120636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d401b6a0 con 0x7f82e40cf060 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.867+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e40af770 con 0x7f82e40cf060 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.868+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e4069920 con 0x7f82e40cf060 2023-10-06T02:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.869+0000 7f82cbfff700 1 -- 172.21.15.81:0/2436120636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82d4022030 con 0x7f82e40cf060 2023-10-06T02:55:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.869+0000 7f82cbfff700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82d0066f30 0x7f82d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.869+0000 7f82cbfff700 1 -- 172.21.15.81:0/2436120636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f82d40861c0 con 0x7f82e40cf060 2023-10-06T02:55:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.869+0000 7f82e37fe700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82d0066f30 0x7f82d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.870+0000 7f82e37fe700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82d0066f30 0x7f82d00693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f82e40c8270 tx=0x7f82d8007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:42.873+0000 7f82cbfff700 1 -- 172.21.15.81:0/2436120636 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82d40536d0 con 0x7f82e40cf060 2023-10-06T02:55:43.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.127+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f82e4069920 con 0x7f82e40cf060 2023-10-06T02:55:43.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.128+0000 7f82cbfff700 1 -- 172.21.15.81:0/2436120636 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f82d4011e60 con 0x7f82e40cf060 2023-10-06T02:55:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:55:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:55:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:55:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:55:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:55:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:55:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:55:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:55:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:55:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:55:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:55:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:55:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:55:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:55:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:55:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:55:43.149 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:55:43.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82d0066f30 msgr2=0x7f82d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82d0066f30 0x7f82d00693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f82e40c8270 tx=0x7f82d8007ea0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40cf060 msgr2=0x7f82e40ca0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40cf060 0x7f82e40ca0e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f82d40030c0 tx=0x7f82d4016000 comp rx=0 tx=0).stop 2023-10-06T02:55:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 shutdown_connections 2023-10-06T02:55:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82e4159f90 0x7f82e40c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e40cf060 0x7f82e40ca0e0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f82d0066f30 0x7f82d00693e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 --2- 172.21.15.81:0/2436120636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e4159bc0 0x7f82e41531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 >> 172.21.15.81:0/2436120636 conn(0x7f82e406c620 msgr2=0x7f82e415caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 shutdown_connections 2023-10-06T02:55:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.130+0000 7f82e92f6700 1 -- 172.21.15.81:0/2436120636 wait complete. 2023-10-06T02:55:43.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.266+0000 7f2f0b4c0700 1 Processor -- start 2023-10-06T02:55:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.266+0000 7f2f0b4c0700 1 -- start start 2023-10-06T02:55:43.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f0b4c0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2f0406d830 0x7f2f040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f0b4c0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f040d07c0 con 0x7f2f04157ca0 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f0b4c0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f040cfbb0 con 0x7f2f041578d0 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f0b4c0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f040cfe90 con 0x7f2f0406d830 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f08a5b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2f04157ca0 0x7f2f0406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43910/0 (socket says 172.21.15.81:43910) 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f08a5b700 1 -- 172.21.15.81:0/4155275152 learned_addr learned my addr 172.21.15.81:0/4155275152 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f09a5d700 1 --2- 172.21.15.81:0/4155275152 >> v2:172.21.15.83:3300/0 conn(0x7f2f0406d830 0x7f2f040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2efbfff700 1 -- 172.21.15.81:0/4155275152 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239644446 0 0) 0x7f2f040d07c0 con 0x7f2f04157ca0 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2efbfff700 1 -- 172.21.15.81:0/4155275152 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef0003570 con 0x7f2f04157ca0 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f09a5d700 1 -- 172.21.15.81:0/4155275152 >> v1:172.21.15.83:6789/0 conn(0x7f2f041578d0 legacy=0x7f2f0415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f09a5d700 1 -- 172.21.15.81:0/4155275152 >> v1:172.21.15.81:6789/0 conn(0x7f2f04157ca0 legacy=0x7f2f0406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f09a5d700 1 -- 172.21.15.81:0/4155275152 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040d0170 con 0x7f2f0406d830 2023-10-06T02:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2f09a5d700 1 --2- 172.21.15.81:0/4155275152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f0406d830 0x7f2f040cf4f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0098e0 tx=0x7f2efc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43aae9ed851d7329 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.267+0000 7f2efbfff700 1 -- 172.21.15.81:0/4155275152 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00b640 con 0x7f2f0406d830 2023-10-06T02:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.268+0000 7f2efbfff700 1 -- 172.21.15.81:0/4155275152 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00b7a0 con 0x7f2f0406d830 2023-10-06T02:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.268+0000 7f2efbfff700 1 -- 172.21.15.81:0/4155275152 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00bb40 con 0x7f2f0406d830 2023-10-06T02:55:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.268+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/4155275152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f0406d830 msgr2=0x7f2f040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.268+0000 7f2f0b4c0700 1 --2- 172.21.15.81:0/4155275152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f0406d830 0x7f2f040cf4f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0098e0 tx=0x7f2efc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.268+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/4155275152 shutdown_connections 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.268+0000 7f2f0b4c0700 1 --2- 172.21.15.81:0/4155275152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f0406d830 0x7f2f040cf4f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.268+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/4155275152 >> 172.21.15.81:0/4155275152 conn(0x7f2f0406bb90 msgr2=0x7f2f0406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.268+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/4155275152 shutdown_connections 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.268+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/4155275152 wait complete. 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.269+0000 7f2f0b4c0700 1 Processor -- start 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.269+0000 7f2f0b4c0700 1 -- start start 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f0b4c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0406d830 0x7f2f040b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f0b4c0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f041578d0 0x7f2f0415f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f0b4c0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f04157ca0 0x7f2f0416daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f0b4c0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0415ea10 con 0x7f2f0406d830 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f0b4c0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0416e560 con 0x7f2f04157ca0 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f0b4c0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0416e840 con 0x7f2f041578d0 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f0925c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0406d830 0x7f2f040b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f0925c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0406d830 0x7f2f040b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36790/0 (socket says 172.21.15.81:36790) 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f0925c700 1 -- 172.21.15.81:0/1603608538 learned_addr learned my addr 172.21.15.81:0/1603608538 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f09a5d700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f04157ca0 0x7f2f0416daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.270+0000 7f2f08a5b700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f041578d0 0x7f2f0415f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f0925c700 1 -- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f041578d0 msgr2=0x7f2f0415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f0925c700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f041578d0 0x7f2f0415f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f0925c700 1 -- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f04157ca0 msgr2=0x7f2f0416daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f0925c700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f04157ca0 0x7f2f0416daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f0925c700 1 -- 172.21.15.81:0/1603608538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc009420 con 0x7f2f0406d830 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f09a5d700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f04157ca0 0x7f2f0416daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f08a5b700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f041578d0 0x7f2f0415f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f0925c700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0406d830 0x7f2f040b59a0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000cb10 tx=0x7f2f000017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2ef97fa700 1 -- 172.21.15.81:0/1603608538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000a760 con 0x7f2f0406d830 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2ef97fa700 1 -- 172.21.15.81:0/1603608538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000a8e0 con 0x7f2f0406d830 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0415ecb0 con 0x7f2f0406d830 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2ef97fa700 1 -- 172.21.15.81:0/1603608538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000aca0 con 0x7f2f0406d830 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.271+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f040b5ee0 con 0x7f2f0406d830 2023-10-06T02:55:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.272+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0415f1b0 con 0x7f2f0406d830 2023-10-06T02:55:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.272+0000 7f2ef97fa700 1 -- 172.21.15.81:0/1603608538 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f00003030 con 0x7f2f0406d830 2023-10-06T02:55:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.273+0000 7f2ef97fa700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee8066f30 0x7f2ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.273+0000 7f2ef97fa700 1 -- 172.21.15.81:0/1603608538 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2f00084440 con 0x7f2f0406d830 2023-10-06T02:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.273+0000 7f2f08a5b700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee8066f30 0x7f2ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.273+0000 7f2f08a5b700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee8066f30 0x7f2ee80693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4007fd0 tx=0x7f2ef4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.277+0000 7f2ef97fa700 1 -- 172.21.15.81:0/1603608538 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f000518a0 con 0x7f2f0406d830 2023-10-06T02:55:43.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.461+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f040d0450 con 0x7f2f0406d830 2023-10-06T02:55:43.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.461+0000 7f2ef97fa700 1 -- 172.21.15.81:0/1603608538 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+13614 (secure 0 0 0) 0x7f2f00054ec0 con 0x7f2f0406d830 2023-10-06T02:55:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:43.463 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":161,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:55:42.729931+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:43.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee8066f30 msgr2=0x7f2ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee8066f30 0x7f2ee80693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4007fd0 tx=0x7f2ef4009040 comp rx=0 tx=0).stop 2023-10-06T02:55:43.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0406d830 msgr2=0x7f2f040b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0406d830 0x7f2f040b59a0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000cb10 tx=0x7f2f000017b0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 shutdown_connections 2023-10-06T02:55:43.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2ee8066f30 0x7f2ee80693e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f04157ca0 0x7f2f0416daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0406d830 0x7f2f040b59a0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 --2- 172.21.15.81:0/1603608538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f041578d0 0x7f2f0415f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.463+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 >> 172.21.15.81:0/1603608538 conn(0x7f2f0406bb90 msgr2=0x7f2f041556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.464+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 shutdown_connections 2023-10-06T02:55:43.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.464+0000 7f2f0b4c0700 1 -- 172.21.15.81:0/1603608538 wait complete. 2023-10-06T02:55:43.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:55:43.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:43.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.592+0000 7f5936895700 1 Processor -- start 2023-10-06T02:55:43.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.593+0000 7f5936895700 1 -- start start 2023-10-06T02:55:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.593+0000 7f5936895700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f593015a2a0 0x7f59300b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.593+0000 7f5936895700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300b0ca0 con 0x7f59300ceb30 2023-10-06T02:55:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.593+0000 7f5936895700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300b00d0 con 0x7f593006dd60 2023-10-06T02:55:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.593+0000 7f5936895700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593006e160 con 0x7f593015a2a0 2023-10-06T02:55:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.593+0000 7f592ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f593015a2a0 0x7f59300b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.593+0000 7f592f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f59300ceb30 0x7f593006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43924/0 (socket says 172.21.15.81:43924) 2023-10-06T02:55:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.593+0000 7f592f7fe700 1 -- 172.21.15.81:0/1786166263 learned_addr learned my addr 172.21.15.81:0/1786166263 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.594+0000 7f592ffff700 1 -- 172.21.15.81:0/1786166263 >> v1:172.21.15.83:6789/0 conn(0x7f593006dd60 legacy=0x7f59300b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.594+0000 7f592ffff700 1 -- 172.21.15.81:0/1786166263 >> v1:172.21.15.81:6789/0 conn(0x7f59300ceb30 legacy=0x7f593006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.594+0000 7f592ffff700 1 -- 172.21.15.81:0/1786166263 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300b0370 con 0x7f593015a2a0 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.594+0000 7f592effd700 1 -- 172.21.15.81:0/1786166263 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346389638 0 0) 0x7f59300b0ca0 con 0x7f59300ceb30 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.594+0000 7f592ffff700 1 --2- 172.21.15.81:0/1786166263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f593015a2a0 0x7f59300b1130 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f59200098e0 tx=0x7f59200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc822f1c5bc0a66a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.594+0000 7f592effd700 1 -- 172.21.15.81:0/1786166263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920009e80 con 0x7f593015a2a0 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.594+0000 7f592effd700 1 -- 172.21.15.81:0/1786166263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000b820 con 0x7f593015a2a0 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.594+0000 7f592effd700 1 -- 172.21.15.81:0/1786166263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000bba0 con 0x7f593015a2a0 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.595+0000 7f5936895700 1 -- 172.21.15.81:0/1786166263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f593015a2a0 msgr2=0x7f59300b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.595+0000 7f5936895700 1 --2- 172.21.15.81:0/1786166263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f593015a2a0 0x7f59300b1130 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f59200098e0 tx=0x7f59200091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.595+0000 7f5936895700 1 -- 172.21.15.81:0/1786166263 shutdown_connections 2023-10-06T02:55:43.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.595+0000 7f5936895700 1 --2- 172.21.15.81:0/1786166263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f593015a2a0 0x7f59300b1130 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.595+0000 7f5936895700 1 -- 172.21.15.81:0/1786166263 >> 172.21.15.81:0/1786166263 conn(0x7f5930067640 msgr2=0x7f5930067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.595+0000 7f5936895700 1 -- 172.21.15.81:0/1786166263 shutdown_connections 2023-10-06T02:55:43.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.595+0000 7f5936895700 1 -- 172.21.15.81:0/1786166263 wait complete. 2023-10-06T02:55:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.596+0000 7f5936895700 1 Processor -- start 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.596+0000 7f5936895700 1 -- start start 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5936895700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f593006dd60 0x7f59301498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5936895700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59300ceb30 0x7f593015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5936895700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f593015a2a0 0x7f593015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5936895700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300cc6c0 con 0x7f59300ceb30 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5936895700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593015cb40 con 0x7f593015a2a0 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5936895700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300cbe20 con 0x7f593006dd60 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59300ceb30 0x7f593015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59300ceb30 0x7f593015acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36814/0 (socket says 172.21.15.81:36814) 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592f7fe700 1 -- 172.21.15.81:0/2570460716 learned_addr learned my addr 172.21.15.81:0/2570460716 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592ffff700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f593006dd60 0x7f59301498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5934e32700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f593015a2a0 0x7f593015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592f7fe700 1 -- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f593006dd60 msgr2=0x7f59301498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592f7fe700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f593006dd60 0x7f59301498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592f7fe700 1 -- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f593015a2a0 msgr2=0x7f593015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592f7fe700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f593015a2a0 0x7f593015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592f7fe700 1 -- 172.21.15.81:0/2570460716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009420 con 0x7f59300ceb30 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f592f7fe700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59300ceb30 0x7f593015acc0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f592400c7e0 tx=0x7f5924007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5917fff700 1 -- 172.21.15.81:0/2570460716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924005b30 con 0x7f59300ceb30 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5917fff700 1 -- 172.21.15.81:0/2570460716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924005c90 con 0x7f59300ceb30 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59300cc100 con 0x7f59300ceb30 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5917fff700 1 -- 172.21.15.81:0/2570460716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924007300 con 0x7f59300ceb30 2023-10-06T02:55:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.597+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5930149e30 con 0x7f59300ceb30 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.598+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593015c910 con 0x7f59300ceb30 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.599+0000 7f5917fff700 1 -- 172.21.15.81:0/2570460716 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f592401b3b0 con 0x7f59300ceb30 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.599+0000 7f5917fff700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f591c066f30 0x7f591c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.599+0000 7f5917fff700 1 -- 172.21.15.81:0/2570460716 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5924083860 con 0x7f59300ceb30 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.599+0000 7f592ffff700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f591c066f30 0x7f591c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.600+0000 7f592ffff700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f591c066f30 0x7f591c0693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f59200030c0 tx=0x7f5920016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.603+0000 7f5917fff700 1 -- 172.21.15.81:0/2570460716 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5924050cc0 con 0x7f59300ceb30 2023-10-06T02:55:43.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.787+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f593015cc80 con 0x7f59300ceb30 2023-10-06T02:55:43.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.787+0000 7f5917fff700 1 -- 172.21.15.81:0/2570460716 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5924017020 con 0x7f59300ceb30 2023-10-06T02:55:43.789 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:55:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f591c066f30 msgr2=0x7f591c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f591c066f30 0x7f591c0693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f59200030c0 tx=0x7f5920016000 comp rx=0 tx=0).stop 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59300ceb30 msgr2=0x7f593015acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59300ceb30 0x7f593015acc0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f592400c7e0 tx=0x7f5924007df0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 shutdown_connections 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f591c066f30 0x7f591c0693e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f593015a2a0 0x7f593015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f593006dd60 0x7f59301498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 --2- 172.21.15.81:0/2570460716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59300ceb30 0x7f593015acc0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 >> 172.21.15.81:0/2570460716 conn(0x7f5930067640 msgr2=0x7f593006d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 shutdown_connections 2023-10-06T02:55:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.789+0000 7f5936895700 1 -- 172.21.15.81:0/2570460716 wait complete. 2023-10-06T02:55:43.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.919+0000 7eff12c36700 1 Processor -- start 2023-10-06T02:55:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.919+0000 7eff12c36700 1 -- start start 2023-10-06T02:55:43.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff12c36700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff0c1578d0 0x7eff0c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff12c36700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c0d07c0 con 0x7eff0c06d120 2023-10-06T02:55:43.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff12c36700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c0cfbb0 con 0x7eff0c157ca0 2023-10-06T02:55:43.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff12c36700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c0cfe90 con 0x7eff0c1578d0 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff109d2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff0c1578d0 0x7eff0c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff111d3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7eff0c06d120 0x7eff0c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43926/0 (socket says 172.21.15.81:43926) 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff111d3700 1 -- 172.21.15.81:0/1443224049 learned_addr learned my addr 172.21.15.81:0/1443224049 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff109d2700 1 -- 172.21.15.81:0/1443224049 >> v1:172.21.15.83:6789/0 conn(0x7eff0c157ca0 legacy=0x7eff0c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff109d2700 1 -- 172.21.15.81:0/1443224049 >> v1:172.21.15.81:6789/0 conn(0x7eff0c06d120 legacy=0x7eff0c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff109d2700 1 -- 172.21.15.81:0/1443224049 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0d0170 con 0x7eff0c1578d0 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff0b7fe700 1 -- 172.21.15.81:0/1443224049 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147025442 0 0) 0x7eff0c0d07c0 con 0x7eff0c06d120 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff109d2700 1 --2- 172.21.15.81:0/1443224049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c1578d0 0x7eff0c0cf4f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7eff04009e60 tx=0x7eff04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60edda1b3b5e8879 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff0b7fe700 1 -- 172.21.15.81:0/1443224049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0400e070 con 0x7eff0c1578d0 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.920+0000 7eff0b7fe700 1 -- 172.21.15.81:0/1443224049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0400bbf0 con 0x7eff0c1578d0 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.921+0000 7eff0b7fe700 1 -- 172.21.15.81:0/1443224049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04012430 con 0x7eff0c1578d0 2023-10-06T02:55:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.921+0000 7eff12c36700 1 -- 172.21.15.81:0/1443224049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c1578d0 msgr2=0x7eff0c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.921+0000 7eff12c36700 1 --2- 172.21.15.81:0/1443224049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c1578d0 0x7eff0c0cf4f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7eff04009e60 tx=0x7eff04009780 comp rx=0 tx=0).stop 2023-10-06T02:55:43.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.921+0000 7eff12c36700 1 -- 172.21.15.81:0/1443224049 shutdown_connections 2023-10-06T02:55:43.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.921+0000 7eff12c36700 1 --2- 172.21.15.81:0/1443224049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c1578d0 0x7eff0c0cf4f0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.921+0000 7eff12c36700 1 -- 172.21.15.81:0/1443224049 >> 172.21.15.81:0/1443224049 conn(0x7eff0c06bb90 msgr2=0x7eff0c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.921+0000 7eff12c36700 1 -- 172.21.15.81:0/1443224049 shutdown_connections 2023-10-06T02:55:43.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.921+0000 7eff12c36700 1 -- 172.21.15.81:0/1443224049 wait complete. 2023-10-06T02:55:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.922+0000 7eff12c36700 1 Processor -- start 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.922+0000 7eff12c36700 1 -- start start 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff12c36700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c06d120 0x7eff0c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff12c36700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff0c1578d0 0x7eff0c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff12c36700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff0c157ca0 0x7eff0c069b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff12c36700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c154c60 con 0x7eff0c06d120 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff12c36700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c1551d0 con 0x7eff0c157ca0 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff12c36700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0ad710 con 0x7eff0c1578d0 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff109d2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c06d120 0x7eff0c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff109d2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c06d120 0x7eff0c154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36836/0 (socket says 172.21.15.81:36836) 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff109d2700 1 -- 172.21.15.81:0/2695152479 learned_addr learned my addr 172.21.15.81:0/2695152479 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff111d3700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff0c157ca0 0x7eff0c069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff0bfff700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff0c1578d0 0x7eff0c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff109d2700 1 -- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff0c1578d0 msgr2=0x7eff0c0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff109d2700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff0c1578d0 0x7eff0c0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff109d2700 1 -- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff0c157ca0 msgr2=0x7eff0c069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff109d2700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff0c157ca0 0x7eff0c069b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff109d2700 1 -- 172.21.15.81:0/2695152479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009a20 con 0x7eff0c06d120 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.923+0000 7eff0bfff700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff0c1578d0 0x7eff0c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.924+0000 7eff109d2700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c06d120 0x7eff0c154720 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7eff0c06fe20 tx=0x7eff04018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.924+0000 7eff08ff9700 1 -- 172.21.15.81:0/2695152479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04012e80 con 0x7eff0c06d120 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.924+0000 7eff08ff9700 1 -- 172.21.15.81:0/2695152479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0401e640 con 0x7eff0c06d120 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.924+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c16b230 con 0x7eff0c06d120 2023-10-06T02:55:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.924+0000 7eff08ff9700 1 -- 172.21.15.81:0/2695152479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0401e9e0 con 0x7eff0c06d120 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.924+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c0ad0c0 con 0x7eff0c06d120 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.925+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c067ac0 con 0x7eff0c06d120 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.925+0000 7eff08ff9700 1 -- 172.21.15.81:0/2695152479 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff04024070 con 0x7eff0c06d120 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.925+0000 7eff08ff9700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efef8066fb0 0x7efef8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.926+0000 7eff08ff9700 1 -- 172.21.15.81:0/2695152479 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5206+0+0 (secure 0 0 0) 0x7eff04086d60 con 0x7eff0c06d120 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.926+0000 7eff0bfff700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efef8066fb0 0x7efef8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.926+0000 7eff0bfff700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efef8066fb0 0x7efef8069460 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7eff00006fd0 tx=0x7eff00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:43.930+0000 7eff08ff9700 1 -- 172.21.15.81:0/2695152479 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff040541d0 con 0x7eff0c06d120 2023-10-06T02:55:44.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.112+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7eff0c0d0450 con 0x7eff0c06d120 2023-10-06T02:55:44.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.113+0000 7eff08ff9700 1 -- 172.21.15.81:0/2695152479 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v161) v1 ==== 92+0+10 (secure 0 0 0) 0x7eff040577f0 con 0x7eff0c06d120 2023-10-06T02:55:44.114 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:55:44.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efef8066fb0 msgr2=0x7efef8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efef8066fb0 0x7efef8069460 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7eff00006fd0 tx=0x7eff00008040 comp rx=0 tx=0).stop 2023-10-06T02:55:44.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c06d120 msgr2=0x7eff0c154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c06d120 0x7eff0c154720 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7eff0c06fe20 tx=0x7eff04018000 comp rx=0 tx=0).stop 2023-10-06T02:55:44.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 shutdown_connections 2023-10-06T02:55:44.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7efef8066fb0 0x7efef8069460 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff0c157ca0 0x7eff0c069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c06d120 0x7eff0c154720 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 --2- 172.21.15.81:0/2695152479 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff0c1578d0 0x7eff0c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 >> 172.21.15.81:0/2695152479 conn(0x7eff0c06bb90 msgr2=0x7eff0c0689f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 shutdown_connections 2023-10-06T02:55:44.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.115+0000 7eff12c36700 1 -- 172.21.15.81:0/2695152479 wait complete. 2023-10-06T02:55:44.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:55:44.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.241+0000 7fd2bffff700 1 Processor -- start 2023-10-06T02:55:44.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.241+0000 7fd2bffff700 1 -- start start 2023-10-06T02:55:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2bffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2c0159b40 0x7fd2c00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2bffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2c0159f10 0x7fd2c0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2bffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c00ccb40 0x7fd2c0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2bffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c00cee10 con 0x7fd2c0159b40 2023-10-06T02:55:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2bffff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c00cd040 con 0x7fd2c0159f10 2023-10-06T02:55:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2bffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00cd320 con 0x7fd2c00ccb40 2023-10-06T02:55:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2beffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2c0159b40 0x7fd2c00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2beffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2c0159b40 0x7fd2c00cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36850/0 (socket says 172.21.15.81:36850) 2023-10-06T02:55:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2beffd700 1 -- 172.21.15.81:0/3395696100 learned_addr learned my addr 172.21.15.81:0/3395696100 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2b67fc700 1 --2- 172.21.15.81:0/3395696100 >> v2:172.21.15.83:3300/0 conn(0x7fd2c0159f10 0x7fd2c0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2bf7fe700 1 --2- 172.21.15.81:0/3395696100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c00ccb40 0x7fd2c0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2beffd700 1 -- 172.21.15.81:0/3395696100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c00ccb40 msgr2=0x7fd2c0068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2beffd700 1 --2- 172.21.15.81:0/3395696100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c00ccb40 0x7fd2c0068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2beffd700 1 -- 172.21.15.81:0/3395696100 >> v2:172.21.15.83:3300/0 conn(0x7fd2c0159f10 msgr2=0x7fd2c0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2beffd700 1 --2- 172.21.15.81:0/3395696100 >> v2:172.21.15.83:3300/0 conn(0x7fd2c0159f10 0x7fd2c0068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2beffd700 1 -- 172.21.15.81:0/3395696100 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c00ce7c0 con 0x7fd2c0159b40 2023-10-06T02:55:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.242+0000 7fd2b67fc700 1 --2- 172.21.15.81:0/3395696100 >> v2:172.21.15.83:3300/0 conn(0x7fd2c0159f10 0x7fd2c0068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2beffd700 1 --2- 172.21.15.81:0/3395696100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0159b40 0x7fd2c00cc600 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd2c006fd80 tx=0x7fd2b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321910d74edddb7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2be7fc700 1 -- 172.21.15.81:0/3395696100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b000b860 con 0x7fd2c0159b40 2023-10-06T02:55:44.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2be7fc700 1 -- 172.21.15.81:0/3395696100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b000b9c0 con 0x7fd2c0159b40 2023-10-06T02:55:44.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2be7fc700 1 -- 172.21.15.81:0/3395696100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b000bd60 con 0x7fd2c0159b40 2023-10-06T02:55:44.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2bffff700 1 -- 172.21.15.81:0/3395696100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0159b40 msgr2=0x7fd2c00cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3395696100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0159b40 0x7fd2c00cc600 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd2c006fd80 tx=0x7fd2b0009250 comp rx=0 tx=0).stop 2023-10-06T02:55:44.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2bffff700 1 -- 172.21.15.81:0/3395696100 shutdown_connections 2023-10-06T02:55:44.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3395696100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c00ccb40 0x7fd2c0068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3395696100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0159b40 0x7fd2c00cc600 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3395696100 >> v2:172.21.15.83:3300/0 conn(0x7fd2c0159f10 0x7fd2c0068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2bffff700 1 -- 172.21.15.81:0/3395696100 >> 172.21.15.81:0/3395696100 conn(0x7fd2c00cd660 msgr2=0x7fd2c00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2bffff700 1 -- 172.21.15.81:0/3395696100 shutdown_connections 2023-10-06T02:55:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.243+0000 7fd2bffff700 1 -- 172.21.15.81:0/3395696100 wait complete. 2023-10-06T02:55:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.244+0000 7fd2bffff700 1 Processor -- start 2023-10-06T02:55:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.244+0000 7fd2bffff700 1 -- start start 2023-10-06T02:55:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c00ccb40 0x7fd2c0154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2bffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c0159b40 0x7fd2c0155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2bffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2c0159f10 0x7fd2c0156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2bffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c015b620 con 0x7fd2c00ccb40 2023-10-06T02:55:44.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2bffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00ca770 con 0x7fd2c0159f10 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2bffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00c9bf0 con 0x7fd2c0159b40 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2beffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c00ccb40 0x7fd2c0154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2beffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c00ccb40 0x7fd2c0154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36866/0 (socket says 172.21.15.81:36866) 2023-10-06T02:55:44.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2beffd700 1 -- 172.21.15.81:0/3114069914 learned_addr learned my addr 172.21.15.81:0/3114069914 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:44.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2bf7fe700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2c0159f10 0x7fd2c0156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.245+0000 7fd2b67fc700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c0159b40 0x7fd2c0155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2beffd700 1 -- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c0159b40 msgr2=0x7fd2c0155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2beffd700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c0159b40 0x7fd2c0155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2beffd700 1 -- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2c0159f10 msgr2=0x7fd2c0156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2beffd700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2c0159f10 0x7fd2c0156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2beffd700 1 -- 172.21.15.81:0/3114069914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00094f0 con 0x7fd2c00ccb40 2023-10-06T02:55:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2beffd700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c00ccb40 0x7fd2c0154750 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009290 tx=0x7fd2b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2b77fe700 1 -- 172.21.15.81:0/3114069914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0011e40 con 0x7fd2c00ccb40 2023-10-06T02:55:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2b77fe700 1 -- 172.21.15.81:0/3114069914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b001f070 con 0x7fd2c00ccb40 2023-10-06T02:55:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c00c9ed0 con 0x7fd2c00ccb40 2023-10-06T02:55:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2b77fe700 1 -- 172.21.15.81:0/3114069914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00266d0 con 0x7fd2c00ccb40 2023-10-06T02:55:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.246+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c00ca490 con 0x7fd2c00ccb40 2023-10-06T02:55:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.247+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c015b760 con 0x7fd2c00ccb40 2023-10-06T02:55:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.247+0000 7fd2b77fe700 1 -- 172.21.15.81:0/3114069914 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2b0026a40 con 0x7fd2c00ccb40 2023-10-06T02:55:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.247+0000 7fd2b77fe700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd2a0066f30 0x7fd2a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.248+0000 7fd2b77fe700 1 -- 172.21.15.81:0/3114069914 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd2b0021070 con 0x7fd2c00ccb40 2023-10-06T02:55:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.248+0000 7fd2b67fc700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd2a0066f30 0x7fd2a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.248+0000 7fd2b67fc700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd2a0066f30 0x7fd2a00693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd2c006a920 tx=0x7fd2a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.252+0000 7fd2b77fe700 1 -- 172.21.15.81:0/3114069914 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2b00535a0 con 0x7fd2c00ccb40 2023-10-06T02:55:44.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.436+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd2c00cc060 con 0x7fd2c00ccb40 2023-10-06T02:55:44.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.436+0000 7fd2b77fe700 1 -- 172.21.15.81:0/3114069914 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v161) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd2b002b090 con 0x7fd2c00ccb40 2023-10-06T02:55:44.438 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:44.438 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:55:44.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:44.438 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:55:44.438 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:55:44.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:55:44.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:55:44.438 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:55:44.438 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:55:44.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:55:44.439 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:55:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd2a0066f30 msgr2=0x7fd2a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd2a0066f30 0x7fd2a00693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd2c006a920 tx=0x7fd2a8008040 comp rx=0 tx=0).stop 2023-10-06T02:55:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c00ccb40 msgr2=0x7fd2c0154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c00ccb40 0x7fd2c0154750 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009290 tx=0x7fd2b0017000 comp rx=0 tx=0).stop 2023-10-06T02:55:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 shutdown_connections 2023-10-06T02:55:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd2a0066f30 0x7fd2a00693e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2c0159f10 0x7fd2c0156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c00ccb40 0x7fd2c0154750 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 --2- 172.21.15.81:0/3114069914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2c0159b40 0x7fd2c0155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 >> 172.21.15.81:0/3114069914 conn(0x7fd2c00cd660 msgr2=0x7fd2c006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 shutdown_connections 2023-10-06T02:55:44.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.438+0000 7fd2bffff700 1 -- 172.21.15.81:0/3114069914 wait complete. 2023-10-06T02:55:44.451 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:55:44.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:55:44.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.568+0000 7f215c67a700 1 Processor -- start 2023-10-06T02:55:44.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.568+0000 7f215c67a700 1 -- start start 2023-10-06T02:55:44.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f215c67a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2154157ca0 0x7f21540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f215c67a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f215406d120 0x7f215406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f215c67a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21540d07c0 con 0x7f21541578d0 2023-10-06T02:55:44.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f215c67a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215406da50 con 0x7f2154157ca0 2023-10-06T02:55:44.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f215c67a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21540cfbb0 con 0x7f215406d120 2023-10-06T02:55:44.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f2159c15700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2154157ca0 0x7f21540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f2159c15700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2154157ca0 0x7f21540cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36868/0 (socket says 172.21.15.81:36868) 2023-10-06T02:55:44.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f2159c15700 1 -- 172.21.15.81:0/1556887394 learned_addr learned my addr 172.21.15.81:0/1556887394 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f215ac17700 1 --2- 172.21.15.81:0/1556887394 >> v2:172.21.15.83:3300/0 conn(0x7f215406d120 0x7f215406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f2159c15700 1 -- 172.21.15.81:0/1556887394 >> v2:172.21.15.83:3300/0 conn(0x7f215406d120 msgr2=0x7f215406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.569+0000 7f2159c15700 1 --2- 172.21.15.81:0/1556887394 >> v2:172.21.15.83:3300/0 conn(0x7f215406d120 0x7f215406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f2159c15700 1 -- 172.21.15.81:0/1556887394 >> v1:172.21.15.83:6789/0 conn(0x7f21541578d0 legacy=0x7f215415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f2159c15700 1 -- 172.21.15.81:0/1556887394 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540cfe90 con 0x7f2154157ca0 2023-10-06T02:55:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f2159c15700 1 --2- 172.21.15.81:0/1556887394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154157ca0 0x7f21540cf4f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f2154068300 tx=0x7f2144009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be215dd008a99ffd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f2159414700 1 -- 172.21.15.81:0/1556887394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400b860 con 0x7f2154157ca0 2023-10-06T02:55:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f2159414700 1 -- 172.21.15.81:0/1556887394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400b9c0 con 0x7f2154157ca0 2023-10-06T02:55:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f2159414700 1 -- 172.21.15.81:0/1556887394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400bd60 con 0x7f2154157ca0 2023-10-06T02:55:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f215c67a700 1 -- 172.21.15.81:0/1556887394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154157ca0 msgr2=0x7f21540cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f215c67a700 1 --2- 172.21.15.81:0/1556887394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154157ca0 0x7f21540cf4f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f2154068300 tx=0x7f2144009250 comp rx=0 tx=0).stop 2023-10-06T02:55:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f215c67a700 1 -- 172.21.15.81:0/1556887394 shutdown_connections 2023-10-06T02:55:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f215c67a700 1 --2- 172.21.15.81:0/1556887394 >> v2:172.21.15.83:3300/0 conn(0x7f215406d120 0x7f215406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f215c67a700 1 --2- 172.21.15.81:0/1556887394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154157ca0 0x7f21540cf4f0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f215c67a700 1 -- 172.21.15.81:0/1556887394 >> 172.21.15.81:0/1556887394 conn(0x7f215406bb90 msgr2=0x7f215406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f215c67a700 1 -- 172.21.15.81:0/1556887394 shutdown_connections 2023-10-06T02:55:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.570+0000 7f215c67a700 1 -- 172.21.15.81:0/1556887394 wait complete. 2023-10-06T02:55:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215c67a700 1 Processor -- start 2023-10-06T02:55:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215c67a700 1 -- start start 2023-10-06T02:55:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215c67a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215406d120 0x7f2154146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215c67a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21541578d0 0x7f2154154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215c67a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2154157ca0 0x7f2154154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215c67a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215416c500 con 0x7f215406d120 2023-10-06T02:55:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215c67a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215416b8f0 con 0x7f21541578d0 2023-10-06T02:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215c67a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215416bbd0 con 0x7f2154157ca0 2023-10-06T02:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215a416700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215406d120 0x7f2154146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215a416700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215406d120 0x7f2154146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36884/0 (socket says 172.21.15.81:36884) 2023-10-06T02:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.572+0000 7f215a416700 1 -- 172.21.15.81:0/877681775 learned_addr learned my addr 172.21.15.81:0/877681775 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f2159c15700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21541578d0 0x7f2154154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215ac17700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2154157ca0 0x7f2154154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215a416700 1 -- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2154157ca0 msgr2=0x7f2154154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215a416700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2154157ca0 0x7f2154154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215a416700 1 -- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21541578d0 msgr2=0x7f2154154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215a416700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21541578d0 0x7f2154154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215a416700 1 -- 172.21.15.81:0/877681775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440094f0 con 0x7f215406d120 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215ac17700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2154157ca0 0x7f2154154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215a416700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215406d120 0x7f2154146a30 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f215000c790 tx=0x7f2150007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f214a7fc700 1 -- 172.21.15.81:0/877681775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150011590 con 0x7f215406d120 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f214a7fc700 1 -- 172.21.15.81:0/877681775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2150011710 con 0x7f215406d120 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f214a7fc700 1 -- 172.21.15.81:0/877681775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150011ad0 con 0x7f215406d120 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215416beb0 con 0x7f215406d120 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.573+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2154168230 con 0x7f215406d120 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.574+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2154067ac0 con 0x7f215406d120 2023-10-06T02:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.575+0000 7f214a7fc700 1 -- 172.21.15.81:0/877681775 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f215001b3b0 con 0x7f215406d120 2023-10-06T02:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.576+0000 7f214a7fc700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2138066f30 0x7f21380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.576+0000 7f214a7fc700 1 -- 172.21.15.81:0/877681775 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2150083ab0 con 0x7f215406d120 2023-10-06T02:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.576+0000 7f2159c15700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2138066f30 0x7f21380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.576+0000 7f2159c15700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2138066f30 0x7f21380693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2154068300 tx=0x7f2144017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.579+0000 7f214a7fc700 1 -- 172.21.15.81:0/877681775 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2150050ef0 con 0x7f215406d120 2023-10-06T02:55:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:44.762+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f21540d0170 con 0x7f215406d120 2023-10-06T02:55:45.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.742+0000 7f214a7fc700 1 -- 172.21.15.81:0/877681775 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v162) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2150017070 con 0x7f215406d120 2023-10-06T02:55:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2138066f30 msgr2=0x7f21380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2138066f30 0x7f21380693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2154068300 tx=0x7f2144017000 comp rx=0 tx=0).stop 2023-10-06T02:55:45.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215406d120 msgr2=0x7f2154146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215406d120 0x7f2154146a30 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f215000c790 tx=0x7f2150007f40 comp rx=0 tx=0).stop 2023-10-06T02:55:45.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 shutdown_connections 2023-10-06T02:55:45.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2154157ca0 0x7f2154154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215406d120 0x7f2154146a30 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2138066f30 0x7f21380693e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 --2- 172.21.15.81:0/877681775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21541578d0 0x7f2154154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 >> 172.21.15.81:0/877681775 conn(0x7f215406bb90 msgr2=0x7f2154068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 shutdown_connections 2023-10-06T02:55:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.745+0000 7f215c67a700 1 -- 172.21.15.81:0/877681775 wait complete. 2023-10-06T02:55:45.750 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:55:45.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:55:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.878+0000 7f4bacf52700 1 Processor -- start 2023-10-06T02:55:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.878+0000 7f4bacf52700 1 -- start start 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4bacf52700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ba81577c0 0x7f4ba8068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4bacf52700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba80cca80 con 0x7f4ba80cbea0 2023-10-06T02:55:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4bacf52700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba80cedd0 con 0x7f4ba8157b90 2023-10-06T02:55:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4bacf52700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba80cc2e0 con 0x7f4ba81577c0 2023-10-06T02:55:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4ba659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ba81577c0 0x7f4ba8068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4ba6d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ba80cbea0 0x7f4ba80cf260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43936/0 (socket says 172.21.15.81:43936) 2023-10-06T02:55:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4ba6d9d700 1 -- 172.21.15.81:0/1828532120 learned_addr learned my addr 172.21.15.81:0/1828532120 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4ba659c700 1 -- 172.21.15.81:0/1828532120 >> v1:172.21.15.83:6789/0 conn(0x7f4ba8157b90 legacy=0x7f4ba80cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4ba659c700 1 -- 172.21.15.81:0/1828532120 >> v1:172.21.15.81:6789/0 conn(0x7f4ba80cbea0 legacy=0x7f4ba80cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4ba659c700 1 -- 172.21.15.81:0/1828532120 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba80cc4c0 con 0x7f4ba81577c0 2023-10-06T02:55:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.879+0000 7f4ba5d9b700 1 -- 172.21.15.81:0/1828532120 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113013504 0 0) 0x7f4ba80cca80 con 0x7f4ba80cbea0 2023-10-06T02:55:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4ba659c700 1 --2- 172.21.15.81:0/1828532120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81577c0 0x7f4ba8068810 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4b980098e0 tx=0x7f4b980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabe8666b9df0ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4ba5d9b700 1 -- 172.21.15.81:0/1828532120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98009e80 con 0x7f4ba81577c0 2023-10-06T02:55:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4ba5d9b700 1 -- 172.21.15.81:0/1828532120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9800b820 con 0x7f4ba81577c0 2023-10-06T02:55:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4ba5d9b700 1 -- 172.21.15.81:0/1828532120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800bba0 con 0x7f4ba81577c0 2023-10-06T02:55:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4bacf52700 1 -- 172.21.15.81:0/1828532120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81577c0 msgr2=0x7f4ba8068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4bacf52700 1 --2- 172.21.15.81:0/1828532120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81577c0 0x7f4ba8068810 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4b980098e0 tx=0x7f4b980091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4bacf52700 1 -- 172.21.15.81:0/1828532120 shutdown_connections 2023-10-06T02:55:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4bacf52700 1 --2- 172.21.15.81:0/1828532120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81577c0 0x7f4ba8068810 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4bacf52700 1 -- 172.21.15.81:0/1828532120 >> 172.21.15.81:0/1828532120 conn(0x7f4ba80d0df0 msgr2=0x7f4ba80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4bacf52700 1 -- 172.21.15.81:0/1828532120 shutdown_connections 2023-10-06T02:55:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.880+0000 7f4bacf52700 1 -- 172.21.15.81:0/1828532120 wait complete. 2023-10-06T02:55:45.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.881+0000 7f4bacf52700 1 Processor -- start 2023-10-06T02:55:45.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.881+0000 7f4bacf52700 1 -- start start 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4bacf52700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ba80cbea0 0x7f4ba816b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4bacf52700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ba81577c0 0x7f4ba8145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4bacf52700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8157b90 0x7f4ba806da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4bacf52700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba816b730 con 0x7f4ba8157b90 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4bacf52700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba8158c30 con 0x7f4ba80cbea0 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4bacf52700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80cae00 con 0x7f4ba81577c0 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4ba6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8157b90 0x7f4ba806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4ba6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8157b90 0x7f4ba806da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36890/0 (socket says 172.21.15.81:36890) 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4ba6d9d700 1 -- 172.21.15.81:0/3788471963 learned_addr learned my addr 172.21.15.81:0/3788471963 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4ba659c700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ba80cbea0 0x7f4ba816b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4b9dd9b700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ba81577c0 0x7f4ba8145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.882+0000 7f4ba6d9d700 1 -- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ba81577c0 msgr2=0x7f4ba8145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4ba6d9d700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ba81577c0 0x7f4ba8145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4ba6d9d700 1 -- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ba80cbea0 msgr2=0x7f4ba816b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4ba6d9d700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ba80cbea0 0x7f4ba816b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4ba6d9d700 1 -- 172.21.15.81:0/3788471963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98009420 con 0x7f4ba8157b90 2023-10-06T02:55:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4ba659c700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ba80cbea0 0x7f4ba816b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4ba6d9d700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8157b90 0x7f4ba806da70 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000ccc0 tx=0x7f4ba0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4b9effd700 1 -- 172.21.15.81:0/3788471963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000a8f0 con 0x7f4ba8157b90 2023-10-06T02:55:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4b9effd700 1 -- 172.21.15.81:0/3788471963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba000aa50 con 0x7f4ba8157b90 2023-10-06T02:55:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4b9effd700 1 -- 172.21.15.81:0/3788471963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000ae10 con 0x7f4ba8157b90 2023-10-06T02:55:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba8158020 con 0x7f4ba8157b90 2023-10-06T02:55:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.883+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba81585e0 con 0x7f4ba8157b90 2023-10-06T02:55:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.884+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba80683c0 con 0x7f4ba8157b90 2023-10-06T02:55:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.884+0000 7f4b9effd700 1 -- 172.21.15.81:0/3788471963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ba0007300 con 0x7f4ba8157b90 2023-10-06T02:55:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.884+0000 7f4b9effd700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b88066f30 0x7f4b880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.885+0000 7f4b9effd700 1 -- 172.21.15.81:0/3788471963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f4ba00847d0 con 0x7f4ba8157b90 2023-10-06T02:55:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.885+0000 7f4ba659c700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b88066f30 0x7f4b880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.885+0000 7f4ba659c700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b88066f30 0x7f4b880693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4b980030c0 tx=0x7f4b98016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:45.889+0000 7f4b9effd700 1 -- 172.21.15.81:0/3788471963 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ba0051b40 con 0x7f4ba8157b90 2023-10-06T02:55:46.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.070+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4ba80cc7a0 con 0x7f4ba8157b90 2023-10-06T02:55:46.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.747+0000 7f4b9effd700 1 -- 172.21.15.81:0/3788471963 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v163) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4ba0055160 con 0x7f4ba8157b90 2023-10-06T02:55:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b88066f30 msgr2=0x7f4b880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b88066f30 0x7f4b880693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4b980030c0 tx=0x7f4b98016000 comp rx=0 tx=0).stop 2023-10-06T02:55:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8157b90 msgr2=0x7f4ba806da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8157b90 0x7f4ba806da70 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000ccc0 tx=0x7f4ba0001a80 comp rx=0 tx=0).stop 2023-10-06T02:55:46.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 shutdown_connections 2023-10-06T02:55:46.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8157b90 0x7f4ba806da70 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4b88066f30 0x7f4b880693e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ba80cbea0 0x7f4ba816b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 --2- 172.21.15.81:0/3788471963 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4ba81577c0 0x7f4ba8145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 >> 172.21.15.81:0/3788471963 conn(0x7f4ba80d0df0 msgr2=0x7f4ba8156790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:46.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 shutdown_connections 2023-10-06T02:55:46.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.757+0000 7f4bacf52700 1 -- 172.21.15.81:0/3788471963 wait complete. 2023-10-06T02:55:46.760 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:55:46.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:55:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.890+0000 7f32ee0c9700 1 Processor -- start 2023-10-06T02:55:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.890+0000 7f32ee0c9700 1 -- start start 2023-10-06T02:55:46.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32ee0c9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32e81578d0 0x7f32e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32ee0c9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f32e8157ca0 0x7f32e815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32ee0c9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e80d07c0 con 0x7f32e806d120 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32ee0c9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e80cfbb0 con 0x7f32e8157ca0 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32ee0c9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80cfe90 con 0x7f32e81578d0 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32e7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f32e806d120 0x7f32e815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43952/0 (socket says 172.21.15.81:43952) 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32e7fff700 1 -- 172.21.15.81:0/3022860795 learned_addr learned my addr 172.21.15.81:0/3022860795 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32e6ffd700 1 --2- 172.21.15.81:0/3022860795 >> v2:172.21.15.83:3300/0 conn(0x7f32e8157ca0 0x7f32e815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32e77fe700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32e81578d0 0x7f32e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534336334 0 0) 0x7f32e80d07c0 con 0x7f32e806d120 2023-10-06T02:55:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.891+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d0003570 con 0x7f32e806d120 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 250543394 0 0) 0x7f32d0003570 con 0x7f32e806d120 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32e81578d0 msgr2=0x7f32e80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32e81578d0 0x7f32e80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 >> v2:172.21.15.83:3300/0 conn(0x7f32e8157ca0 msgr2=0x7f32e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 --2- 172.21.15.81:0/3022860795 >> v2:172.21.15.83:3300/0 conn(0x7f32e8157ca0 0x7f32e815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80d0170 con 0x7f32e806d120 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f32e0001470 con 0x7f32e806d120 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 >> v1:172.21.15.81:6789/0 conn(0x7f32e806d120 legacy=0x7f32e815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d0003a60 0x7f32d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32e81578d0 0x7f32d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32d0004d50 0x7f32d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80cfbb0 con 0x7f32d0003a60 2023-10-06T02:55:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80cfe90 con 0x7f32d0004d50 2023-10-06T02:55:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d000ba60 con 0x7f32e81578d0 2023-10-06T02:55:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e77fe700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d0003a60 0x7f32d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e6ffd700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32e81578d0 0x7f32d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e7fff700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32d0004d50 0x7f32d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e77fe700 1 -- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32e81578d0 msgr2=0x7f32d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e77fe700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32e81578d0 0x7f32d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e77fe700 1 -- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32d0004d50 msgr2=0x7f32d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e77fe700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32d0004d50 0x7f32d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e77fe700 1 -- 172.21.15.81:0/3022860795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d0003570 con 0x7f32d0003a60 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e6ffd700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32e81578d0 0x7f32d0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e77fe700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d0003a60 0x7f32d0003e70 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f32d800e210 tx=0x7f32d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e61d96fba8e3fba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.892+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d800ea60 con 0x7f32d0003a60 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.893+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d800f040 con 0x7f32d0003a60 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.893+0000 7f32e67fc700 1 -- 172.21.15.81:0/3022860795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d800ee10 con 0x7f32d0003a60 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.893+0000 7f32ee0c9700 1 -- 172.21.15.81:0/3022860795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d0003a60 msgr2=0x7f32d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.893+0000 7f32ee0c9700 1 --2- 172.21.15.81:0/3022860795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d0003a60 0x7f32d0003e70 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f32d800e210 tx=0x7f32d800b040 comp rx=0 tx=0).stop 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.893+0000 7f32e7fff700 1 -- 172.21.15.81:0/3022860795 reap_dead start 2023-10-06T02:55:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.893+0000 7f32ee0c9700 1 -- 172.21.15.81:0/3022860795 shutdown_connections 2023-10-06T02:55:46.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.893+0000 7f32ee0c9700 1 -- 172.21.15.81:0/3022860795 >> 172.21.15.81:0/3022860795 conn(0x7f32e806bb90 msgr2=0x7f32e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:46.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.893+0000 7f32ee0c9700 1 -- 172.21.15.81:0/3022860795 shutdown_connections 2023-10-06T02:55:46.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.893+0000 7f32ee0c9700 1 -- 172.21.15.81:0/3022860795 wait complete. 2023-10-06T02:55:46.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.894+0000 7f32ee0c9700 1 Processor -- start 2023-10-06T02:55:46.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.894+0000 7f32ee0c9700 1 -- start start 2023-10-06T02:55:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32ee0c9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32d0003a60 0x7f32e8148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32ee0c9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e80c7510 0x7f32e80c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32ee0c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e80c5b20 0x7f32e80c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32ee0c9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80c7ec0 con 0x7f32e80c5b20 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32ee0c9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80c6810 con 0x7f32e80c7510 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32ee0c9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80c6af0 con 0x7f32d0003a60 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e80c5b20 0x7f32e80c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e80c5b20 0x7f32e80c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36910/0 (socket says 172.21.15.81:36910) 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e7fff700 1 -- 172.21.15.81:0/1481534637 learned_addr learned my addr 172.21.15.81:0/1481534637 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e6ffd700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e80c7510 0x7f32e80c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e77fe700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32d0003a60 0x7f32e8148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e7fff700 1 -- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32d0003a60 msgr2=0x7f32e8148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e7fff700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32d0003a60 0x7f32e8148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e7fff700 1 -- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e80c7510 msgr2=0x7f32e80c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e7fff700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e80c7510 0x7f32e80c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.895+0000 7f32e7fff700 1 -- 172.21.15.81:0/1481534637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80b3d40 con 0x7f32e80c5b20 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.896+0000 7f32e7fff700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e80c5b20 0x7f32e80c5f90 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f32e0000c00 tx=0x7f32e80d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.896+0000 7f32cf7fe700 1 -- 172.21.15.81:0/1481534637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0012590 con 0x7f32e80c5b20 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.896+0000 7f32cf7fe700 1 -- 172.21.15.81:0/1481534637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e0012710 con 0x7f32e80c5b20 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.896+0000 7f32cf7fe700 1 -- 172.21.15.81:0/1481534637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0012ad0 con 0x7f32e80c5b20 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.896+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e80b4020 con 0x7f32e80c5b20 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.896+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e80c64d0 con 0x7f32e80c5b20 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.897+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e80b3ba0 con 0x7f32e80c5b20 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.897+0000 7f32cf7fe700 1 -- 172.21.15.81:0/1481534637 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32e001d460 con 0x7f32e80c5b20 2023-10-06T02:55:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.898+0000 7f32cf7fe700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32d4066f30 0x7f32d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.898+0000 7f32cf7fe700 1 -- 172.21.15.81:0/1481534637 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f32e0084260 con 0x7f32e80c5b20 2023-10-06T02:55:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.898+0000 7f32e77fe700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32d4066f30 0x7f32d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.898+0000 7f32e77fe700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32d4066f30 0x7f32d40693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f32d800afd0 tx=0x7f32d801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:46.902+0000 7f32cf7fe700 1 -- 172.21.15.81:0/1481534637 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32e80b3ba0 con 0x7f32e80c5b20 2023-10-06T02:55:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.126+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f32e80b3ba0 con 0x7f32e80c5b20 2023-10-06T02:55:47.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.765+0000 7f32cf7fe700 1 -- 172.21.15.81:0/1481534637 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v79) v1 ==== 174+0+0 (secure 0 0 0) 0x7f32e80b3ba0 con 0x7f32e80c5b20 2023-10-06T02:55:47.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32d4066f30 msgr2=0x7f32d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32d4066f30 0x7f32d40693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f32d800afd0 tx=0x7f32d801a000 comp rx=0 tx=0).stop 2023-10-06T02:55:47.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e80c5b20 msgr2=0x7f32e80c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e80c5b20 0x7f32e80c5f90 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f32e0000c00 tx=0x7f32e80d0730 comp rx=0 tx=0).stop 2023-10-06T02:55:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 shutdown_connections 2023-10-06T02:55:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e80c5b20 0x7f32e80c5f90 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32d0003a60 0x7f32e8148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f32d4066f30 0x7f32d40693e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 --2- 172.21.15.81:0/1481534637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32e80c7510 0x7f32e80c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 >> 172.21.15.81:0/1481534637 conn(0x7f32e806bb90 msgr2=0x7f32e8154610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 shutdown_connections 2023-10-06T02:55:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.772+0000 7f32ee0c9700 1 -- 172.21.15.81:0/1481534637 wait complete. 2023-10-06T02:55:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 21 and data pool 22 2023-10-06T02:55:47.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.900+0000 7f3791333700 1 Processor -- start 2023-10-06T02:55:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.900+0000 7f3791333700 1 -- start start 2023-10-06T02:55:47.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f3791333700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f378c0b3bd0 0x7f378c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f3791333700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c1583b0 0x7f378c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f3791333700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378c0b2890 con 0x7f378c157fe0 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f3791333700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378c0b4070 con 0x7f378c0b3bd0 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f3791333700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0b4350 con 0x7f378c1583b0 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f37827fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f378c0b3bd0 0x7f378c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f37827fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f378c0b3bd0 0x7f378c0ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36922/0 (socket says 172.21.15.81:36922) 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f37827fc700 1 -- 172.21.15.81:0/3967593411 learned_addr learned my addr 172.21.15.81:0/3967593411 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f378b7fe700 1 --2- 172.21.15.81:0/3967593411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c1583b0 0x7f378c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f37827fc700 1 -- 172.21.15.81:0/3967593411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c1583b0 msgr2=0x7f378c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f37827fc700 1 --2- 172.21.15.81:0/3967593411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c1583b0 0x7f378c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f37827fc700 1 -- 172.21.15.81:0/3967593411 >> v1:172.21.15.83:6789/0 conn(0x7f378c157fe0 legacy=0x7f378c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.901+0000 7f37827fc700 1 -- 172.21.15.81:0/3967593411 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0b4630 con 0x7f378c0b3bd0 2023-10-06T02:55:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f37827fc700 1 --2- 172.21.15.81:0/3967593411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c0b3bd0 0x7f378c0ceb30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f37740099b0 tx=0x7f3774009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f1e87903e3d588 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f378a7fc700 1 -- 172.21.15.81:0/3967593411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400b860 con 0x7f378c0b3bd0 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f378a7fc700 1 -- 172.21.15.81:0/3967593411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400b9c0 con 0x7f378c0b3bd0 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f378a7fc700 1 -- 172.21.15.81:0/3967593411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400bd60 con 0x7f378c0b3bd0 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f3791333700 1 -- 172.21.15.81:0/3967593411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c0b3bd0 msgr2=0x7f378c0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f3791333700 1 --2- 172.21.15.81:0/3967593411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c0b3bd0 0x7f378c0ceb30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f37740099b0 tx=0x7f3774009250 comp rx=0 tx=0).stop 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f3791333700 1 -- 172.21.15.81:0/3967593411 shutdown_connections 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f3791333700 1 --2- 172.21.15.81:0/3967593411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c1583b0 0x7f378c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f3791333700 1 --2- 172.21.15.81:0/3967593411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c0b3bd0 0x7f378c0ceb30 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f3791333700 1 -- 172.21.15.81:0/3967593411 >> 172.21.15.81:0/3967593411 conn(0x7f378c067640 msgr2=0x7f378c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f3791333700 1 -- 172.21.15.81:0/3967593411 shutdown_connections 2023-10-06T02:55:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.902+0000 7f3791333700 1 -- 172.21.15.81:0/3967593411 wait complete. 2023-10-06T02:55:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f3791333700 1 Processor -- start 2023-10-06T02:55:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f3791333700 1 -- start start 2023-10-06T02:55:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f3791333700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f378c0b3bd0 0x7f378c14a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f3791333700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c157fe0 0x7f378c14f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f3791333700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c1583b0 0x7f378c15c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f3791333700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c151160 con 0x7f378c1583b0 2023-10-06T02:55:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f3791333700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c150cd0 con 0x7f378c0b3bd0 2023-10-06T02:55:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f3791333700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c14ae20 con 0x7f378c157fe0 2023-10-06T02:55:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f378b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c1583b0 0x7f378c15c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f378b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c1583b0 0x7f378c15c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36928/0 (socket says 172.21.15.81:36928) 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f378b7fe700 1 -- 172.21.15.81:0/1315770352 learned_addr learned my addr 172.21.15.81:0/1315770352 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f378affd700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f378c0b3bd0 0x7f378c14a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.904+0000 7f37827fc700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c157fe0 0x7f378c14f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f378b7fe700 1 -- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c157fe0 msgr2=0x7f378c14f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f378b7fe700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c157fe0 0x7f378c14f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f378b7fe700 1 -- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f378c0b3bd0 msgr2=0x7f378c14a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f378b7fe700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f378c0b3bd0 0x7f378c14a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f378b7fe700 1 -- 172.21.15.81:0/1315770352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37740094f0 con 0x7f378c1583b0 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f378b7fe700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c1583b0 0x7f378c15c5b0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f3784009fa0 tx=0x7f3784009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f37837fe700 1 -- 172.21.15.81:0/1315770352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400ebc0 con 0x7f378c1583b0 2023-10-06T02:55:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f37837fe700 1 -- 172.21.15.81:0/1315770352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400ed20 con 0x7f378c1583b0 2023-10-06T02:55:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c1500c0 con 0x7f378c1583b0 2023-10-06T02:55:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f37837fe700 1 -- 172.21.15.81:0/1315770352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784014670 con 0x7f378c1583b0 2023-10-06T02:55:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.905+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c150680 con 0x7f378c1583b0 2023-10-06T02:55:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.906+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378c150e60 con 0x7f378c1583b0 2023-10-06T02:55:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.906+0000 7f37837fe700 1 -- 172.21.15.81:0/1315770352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37840149e0 con 0x7f378c1583b0 2023-10-06T02:55:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.907+0000 7f37837fe700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f376c066f30 0x7f376c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.907+0000 7f37837fe700 1 -- 172.21.15.81:0/1315770352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3784084d30 con 0x7f378c1583b0 2023-10-06T02:55:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.907+0000 7f378affd700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f376c066f30 0x7f376c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.907+0000 7f378affd700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f376c066f30 0x7f376c0693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f378c0b0bc0 tx=0x7f377c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:47.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:47.911+0000 7f37837fe700 1 -- 172.21.15.81:0/1315770352 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3784051e40 con 0x7f378c1583b0 2023-10-06T02:55:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.095+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f378c0cc6b0 con 0x7f378c1583b0 2023-10-06T02:55:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.096+0000 7f37837fe700 1 -- 172.21.15.81:0/1315770352 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16847 (secure 0 0 0) 0x7f3784055460 con 0x7f378c1583b0 2023-10-06T02:55:48.098 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:48.098 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":164,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:55:47.127557+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:44.780110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:46.089490+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f376c066f30 msgr2=0x7f376c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f376c066f30 0x7f376c0693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f378c0b0bc0 tx=0x7f377c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c1583b0 msgr2=0x7f378c15c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c1583b0 0x7f378c15c5b0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f3784009fa0 tx=0x7f3784009900 comp rx=0 tx=0).stop 2023-10-06T02:55:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 shutdown_connections 2023-10-06T02:55:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f378c1583b0 0x7f378c15c5b0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f376c066f30 0x7f376c0693e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f378c0b3bd0 0x7f378c14a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 --2- 172.21.15.81:0/1315770352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f378c157fe0 0x7f378c14f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 >> 172.21.15.81:0/1315770352 conn(0x7f378c067640 msgr2=0x7f378c067bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 shutdown_connections 2023-10-06T02:55:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.098+0000 7f3791333700 1 -- 172.21.15.81:0/1315770352 wait complete. 2023-10-06T02:55:48.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.225+0000 7fb21a89a700 1 Processor -- start 2023-10-06T02:55:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.225+0000 7fb21a89a700 1 -- start start 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a89a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb214159b40 0x7fb2140cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a89a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb214068e90 0x7fb2140cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a89a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2140cee10 con 0x7fb214159f10 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a89a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2140cd040 con 0x7fb214068e90 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a89a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2140cd320 con 0x7fb214159b40 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a099700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb214068e90 0x7fb2140cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb219097700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb214159f10 0x7fb214068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43958/0 (socket says 172.21.15.81:43958) 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb219097700 1 -- 172.21.15.81:0/85882616 learned_addr learned my addr 172.21.15.81:0/85882616 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb219898700 1 --2- 172.21.15.81:0/85882616 >> v2:172.21.15.83:3300/0 conn(0x7fb214159b40 0x7fb2140cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a099700 1 -- 172.21.15.81:0/85882616 >> v2:172.21.15.83:3300/0 conn(0x7fb214159b40 msgr2=0x7fb2140cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a099700 1 --2- 172.21.15.81:0/85882616 >> v2:172.21.15.83:3300/0 conn(0x7fb214159b40 0x7fb2140cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a099700 1 -- 172.21.15.81:0/85882616 >> v1:172.21.15.81:6789/0 conn(0x7fb214159f10 legacy=0x7fb214068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb21a099700 1 -- 172.21.15.81:0/85882616 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140ce7c0 con 0x7fb214068e90 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.226+0000 7fb218896700 1 -- 172.21.15.81:0/85882616 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368894863 0 0) 0x7fb2140cee10 con 0x7fb214159f10 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb21a099700 1 --2- 172.21.15.81:0/85882616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214068e90 0x7fb2140cf2a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb2140d0bc0 tx=0x7fb20c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b55c1104896a48e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb218896700 1 -- 172.21.15.81:0/85882616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00e070 con 0x7fb214068e90 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb218896700 1 -- 172.21.15.81:0/85882616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c00bb60 con 0x7fb214068e90 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb218896700 1 -- 172.21.15.81:0/85882616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c012430 con 0x7fb214068e90 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb21a89a700 1 -- 172.21.15.81:0/85882616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214068e90 msgr2=0x7fb2140cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb21a89a700 1 --2- 172.21.15.81:0/85882616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214068e90 0x7fb2140cf2a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb2140d0bc0 tx=0x7fb20c009780 comp rx=0 tx=0).stop 2023-10-06T02:55:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb21a89a700 1 -- 172.21.15.81:0/85882616 shutdown_connections 2023-10-06T02:55:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb21a89a700 1 --2- 172.21.15.81:0/85882616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214068e90 0x7fb2140cf2a0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb21a89a700 1 --2- 172.21.15.81:0/85882616 >> v2:172.21.15.83:3300/0 conn(0x7fb214159b40 0x7fb2140cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb21a89a700 1 -- 172.21.15.81:0/85882616 >> 172.21.15.81:0/85882616 conn(0x7fb2140cd660 msgr2=0x7fb2140cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb21a89a700 1 -- 172.21.15.81:0/85882616 shutdown_connections 2023-10-06T02:55:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.227+0000 7fb21a89a700 1 -- 172.21.15.81:0/85882616 wait complete. 2023-10-06T02:55:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.228+0000 7fb21a89a700 1 Processor -- start 2023-10-06T02:55:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.228+0000 7fb21a89a700 1 -- start start 2023-10-06T02:55:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb21a89a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb214068e90 0x7fb21416b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb21a89a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb214159b40 0x7fb214169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb21a89a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214159f10 0x7fb21415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb21a89a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140cab30 con 0x7fb214159f10 2023-10-06T02:55:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb21a89a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21416e9a0 con 0x7fb214159b40 2023-10-06T02:55:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb21a89a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21416ddd0 con 0x7fb214068e90 2023-10-06T02:55:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb21a099700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214159f10 0x7fb21415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb21a099700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214159f10 0x7fb21415c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36934/0 (socket says 172.21.15.81:36934) 2023-10-06T02:55:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb21a099700 1 -- 172.21.15.81:0/2100296990 learned_addr learned my addr 172.21.15.81:0/2100296990 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb219898700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb214068e90 0x7fb21416b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.229+0000 7fb219097700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb214159b40 0x7fb214169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb21a099700 1 -- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb214068e90 msgr2=0x7fb21416b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb21a099700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb214068e90 0x7fb21416b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb21a099700 1 -- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb214159b40 msgr2=0x7fb214169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb21a099700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb214159b40 0x7fb214169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb21a099700 1 -- 172.21.15.81:0/2100296990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c009a20 con 0x7fb214159f10 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb21a099700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214159f10 0x7fb21415c450 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb20c013000 tx=0x7fb20c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb209ffb700 1 -- 172.21.15.81:0/2100296990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c027470 con 0x7fb214159f10 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb209ffb700 1 -- 172.21.15.81:0/2100296990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c0275d0 con 0x7fb214159f10 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21416b6c0 con 0x7fb214159f10 2023-10-06T02:55:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb209ffb700 1 -- 172.21.15.81:0/2100296990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c027990 con 0x7fb214159f10 2023-10-06T02:55:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.230+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21416e3d0 con 0x7fb214159f10 2023-10-06T02:55:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.231+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21416eb10 con 0x7fb214159f10 2023-10-06T02:55:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.231+0000 7fb209ffb700 1 -- 172.21.15.81:0/2100296990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb20c024070 con 0x7fb214159f10 2023-10-06T02:55:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.232+0000 7fb209ffb700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1f8066fb0 0x7fb1f8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.232+0000 7fb209ffb700 1 -- 172.21.15.81:0/2100296990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb20c0870f0 con 0x7fb214159f10 2023-10-06T02:55:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.232+0000 7fb219898700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1f8066fb0 0x7fb1f8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.232+0000 7fb219898700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1f8066fb0 0x7fb1f8069460 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb210009db0 tx=0x7fb2100091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.236+0000 7fb209ffb700 1 -- 172.21.15.81:0/2100296990 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb20c054160 con 0x7fb214159f10 2023-10-06T02:55:48.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.419+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb214063e90 con 0x7fb214159f10 2023-10-06T02:55:48.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.420+0000 7fb209ffb700 1 -- 172.21.15.81:0/2100296990 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16847 (secure 0 0 0) 0x7fb20c009880 con 0x7fb214159f10 2023-10-06T02:55:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:48.422 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":164,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:55:47.127557+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:44.780110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:46.089490+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:48.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.422+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1f8066fb0 msgr2=0x7fb1f8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.422+0000 7fb21a89a700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1f8066fb0 0x7fb1f8069460 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb210009db0 tx=0x7fb2100091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.422+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214159f10 msgr2=0x7fb21415c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.422+0000 7fb21a89a700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214159f10 0x7fb21415c450 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb20c013000 tx=0x7fb20c019000 comp rx=0 tx=0).stop 2023-10-06T02:55:48.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.423+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 shutdown_connections 2023-10-06T02:55:48.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.423+0000 7fb21a89a700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb214159f10 0x7fb21415c450 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.423+0000 7fb21a89a700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb214068e90 0x7fb21416b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.423+0000 7fb21a89a700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb1f8066fb0 0x7fb1f8069460 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.423+0000 7fb21a89a700 1 --2- 172.21.15.81:0/2100296990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb214159b40 0x7fb214169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.423+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 >> 172.21.15.81:0/2100296990 conn(0x7fb2140cd660 msgr2=0x7fb2140c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.423+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 shutdown_connections 2023-10-06T02:55:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.423+0000 7fb21a89a700 1 -- 172.21.15.81:0/2100296990 wait complete. 2023-10-06T02:55:48.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:55:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.552+0000 7f63210cc700 1 Processor -- start 2023-10-06T02:55:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.552+0000 7f63210cc700 1 -- start start 2023-10-06T02:55:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f63210cc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f631c0d0b80 0x7f631c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f63210cc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 0x7f631c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f63210cc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c0cf2d0 con 0x7f631c0d02b0 2023-10-06T02:55:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f63210cc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c15a690 con 0x7f631c0d0b80 2023-10-06T02:55:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f63210cc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c06dc00 con 0x7f631c06d700 2023-10-06T02:55:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f631bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f631c0d0b80 0x7f631c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f631b7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f631c0d02b0 0x7f631c06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:58598/0 (socket says 172.21.15.81:58598) 2023-10-06T02:55:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f63208cb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 0x7f631c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f631b7fe700 1 -- 172.21.15.81:0/3132366857 learned_addr learned my addr 172.21.15.81:0/3132366857 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f631bfff700 1 -- 172.21.15.81:0/3132366857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 msgr2=0x7f631c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f631bfff700 1 --2- 172.21.15.81:0/3132366857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 0x7f631c15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f631bfff700 1 -- 172.21.15.81:0/3132366857 >> v1:172.21.15.83:6789/0 conn(0x7f631c0d02b0 legacy=0x7f631c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f631bfff700 1 -- 172.21.15.81:0/3132366857 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0cf570 con 0x7f631c0d0b80 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.553+0000 7f63208cb700 1 --2- 172.21.15.81:0/3132366857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 0x7f631c15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f631bfff700 1 --2- 172.21.15.81:0/3132366857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f631c0d0b80 0x7f631c0cfd70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f630c0098e0 tx=0x7f630c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2b9c90d1b9878dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f631affd700 1 -- 172.21.15.81:0/3132366857 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c00b640 con 0x7f631c0d0b80 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f631affd700 1 -- 172.21.15.81:0/3132366857 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c00b7a0 con 0x7f631c0d0b80 2023-10-06T02:55:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f631affd700 1 -- 172.21.15.81:0/3132366857 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c00bb40 con 0x7f631c0d0b80 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f63210cc700 1 -- 172.21.15.81:0/3132366857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f631c0d0b80 msgr2=0x7f631c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f63210cc700 1 --2- 172.21.15.81:0/3132366857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f631c0d0b80 0x7f631c0cfd70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f630c0098e0 tx=0x7f630c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f63210cc700 1 -- 172.21.15.81:0/3132366857 shutdown_connections 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f63210cc700 1 --2- 172.21.15.81:0/3132366857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 0x7f631c15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f63210cc700 1 --2- 172.21.15.81:0/3132366857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f631c0d0b80 0x7f631c0cfd70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f63210cc700 1 -- 172.21.15.81:0/3132366857 >> 172.21.15.81:0/3132366857 conn(0x7f631c063230 msgr2=0x7f631c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f63210cc700 1 -- 172.21.15.81:0/3132366857 shutdown_connections 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.554+0000 7f63210cc700 1 -- 172.21.15.81:0/3132366857 wait complete. 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.555+0000 7f63210cc700 1 Processor -- start 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.556+0000 7f63210cc700 1 -- start start 2023-10-06T02:55:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.556+0000 7f63210cc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 0x7f631c0ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.556+0000 7f63210cc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f631c0d02b0 0x7f631c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.556+0000 7f63210cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0d0b80 0x7f631c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.556+0000 7f63210cc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0ae760 con 0x7f631c0d0b80 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.556+0000 7f63210cc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0acf20 con 0x7f631c0d02b0 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.556+0000 7f63210cc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0ad180 con 0x7f631c06d700 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63208cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0d0b80 0x7f631c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f631bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 0x7f631c0ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63208cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0d0b80 0x7f631c15bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36936/0 (socket says 172.21.15.81:36936) 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f631b7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f631c0d02b0 0x7f631c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63208cb700 1 -- 172.21.15.81:0/2419877819 learned_addr learned my addr 172.21.15.81:0/2419877819 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63208cb700 1 -- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 msgr2=0x7f631c0ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63208cb700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 0x7f631c0ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63208cb700 1 -- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f631c0d02b0 msgr2=0x7f631c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63208cb700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f631c0d02b0 0x7f631c15b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63208cb700 1 -- 172.21.15.81:0/2419877819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6314009a20 con 0x7f631c0d0b80 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63208cb700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0d0b80 0x7f631c15bc40 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6314009f90 tx=0x7f631400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f6303fff700 1 -- 172.21.15.81:0/2419877819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400cbd0 con 0x7f631c0d0b80 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f6303fff700 1 -- 172.21.15.81:0/2419877819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631400f040 con 0x7f631c0d0b80 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c009420 con 0x7f631c0d0b80 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f6303fff700 1 -- 172.21.15.81:0/2419877819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314014480 con 0x7f631c0d0b80 2023-10-06T02:55:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.557+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c0ad740 con 0x7f631c0d0b80 2023-10-06T02:55:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.558+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c0ae910 con 0x7f631c0d0b80 2023-10-06T02:55:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.559+0000 7f6303fff700 1 -- 172.21.15.81:0/2419877819 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63140147f0 con 0x7f631c0d0b80 2023-10-06T02:55:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.559+0000 7f6303fff700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6308066f30 0x7f63080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.559+0000 7f6303fff700 1 -- 172.21.15.81:0/2419877819 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6314085380 con 0x7f631c0d0b80 2023-10-06T02:55:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.559+0000 7f631bfff700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6308066f30 0x7f63080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.560+0000 7f631bfff700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6308066f30 0x7f63080693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f630c0093f0 tx=0x7f630c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.563+0000 7f6303fff700 1 -- 172.21.15.81:0/2419877819 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f631c0ae910 con 0x7f631c0d0b80 2023-10-06T02:55:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:48.791+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f631c0ae910 con 0x7f631c0d0b80 2023-10-06T02:55:49.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.780+0000 7f6303fff700 1 -- 172.21.15.81:0/2419877819 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) v1 ==== 118+0+0 (secure 0 0 0) 0x7f631c0ae910 con 0x7f631c0d0b80 2023-10-06T02:55:49.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6308066f30 msgr2=0x7f63080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6308066f30 0x7f63080693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f630c0093f0 tx=0x7f630c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:49.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0d0b80 msgr2=0x7f631c15bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0d0b80 0x7f631c15bc40 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6314009f90 tx=0x7f631400b040 comp rx=0 tx=0).stop 2023-10-06T02:55:49.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 shutdown_connections 2023-10-06T02:55:49.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0d0b80 0x7f631c15bc40 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f631c06d700 0x7f631c0ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6308066f30 0x7f63080693e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 --2- 172.21.15.81:0/2419877819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f631c0d02b0 0x7f631c15b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 >> 172.21.15.81:0/2419877819 conn(0x7f631c063230 msgr2=0x7f631c0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:49.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 shutdown_connections 2023-10-06T02:55:49.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.783+0000 7f63210cc700 1 -- 172.21.15.81:0/2419877819 wait complete. 2023-10-06T02:55:49.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:55:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.921+0000 7f513e0ea700 1 Processor -- start 2023-10-06T02:55:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.921+0000 7f513e0ea700 1 -- start start 2023-10-06T02:55:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.922+0000 7f513e0ea700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51380d0b80 0x7f51380cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.922+0000 7f513e0ea700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f513806d700 0x7f513815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.922+0000 7f513e0ea700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51380cf2d0 con 0x7f51380d02b0 2023-10-06T02:55:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.922+0000 7f513e0ea700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513815a690 con 0x7f51380d0b80 2023-10-06T02:55:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.922+0000 7f513e0ea700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513806dc00 con 0x7f513806d700 2023-10-06T02:55:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.922+0000 7f513d0e8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51380d0b80 0x7f51380cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.922+0000 7f513c8e7700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f51380d02b0 0x7f513806cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:58606/0 (socket says 172.21.15.81:58606) 2023-10-06T02:55:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.922+0000 7f513c8e7700 1 -- 172.21.15.81:0/4196352226 learned_addr learned my addr 172.21.15.81:0/4196352226 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.922+0000 7f513d8e9700 1 --2- 172.21.15.81:0/4196352226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f513806d700 0x7f513815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513d0e8700 1 -- 172.21.15.81:0/4196352226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f513806d700 msgr2=0x7f513815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513d0e8700 1 --2- 172.21.15.81:0/4196352226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f513806d700 0x7f513815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513d0e8700 1 -- 172.21.15.81:0/4196352226 >> v1:172.21.15.83:6789/0 conn(0x7f51380d02b0 legacy=0x7f513806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f512ffff700 1 -- 172.21.15.81:0/4196352226 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992001302 0 0) 0x7f51380cf2d0 con 0x7f51380d02b0 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513d0e8700 1 -- 172.21.15.81:0/4196352226 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380cf570 con 0x7f51380d0b80 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513d8e9700 1 --2- 172.21.15.81:0/4196352226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f513806d700 0x7f513815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513d0e8700 1 --2- 172.21.15.81:0/4196352226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51380d0b80 0x7f51380cfd70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f51340098e0 tx=0x7f51340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cba76be18abe8d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f512ffff700 1 -- 172.21.15.81:0/4196352226 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400b640 con 0x7f51380d0b80 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f512ffff700 1 -- 172.21.15.81:0/4196352226 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513400b7a0 con 0x7f51380d0b80 2023-10-06T02:55:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f512ffff700 1 -- 172.21.15.81:0/4196352226 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400bb40 con 0x7f51380d0b80 2023-10-06T02:55:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513e0ea700 1 -- 172.21.15.81:0/4196352226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51380d0b80 msgr2=0x7f51380cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513e0ea700 1 --2- 172.21.15.81:0/4196352226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51380d0b80 0x7f51380cfd70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f51340098e0 tx=0x7f51340091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513e0ea700 1 -- 172.21.15.81:0/4196352226 shutdown_connections 2023-10-06T02:55:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513e0ea700 1 --2- 172.21.15.81:0/4196352226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f513806d700 0x7f513815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513e0ea700 1 --2- 172.21.15.81:0/4196352226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51380d0b80 0x7f51380cfd70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.923+0000 7f513e0ea700 1 -- 172.21.15.81:0/4196352226 >> 172.21.15.81:0/4196352226 conn(0x7f5138063230 msgr2=0x7f5138063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.924+0000 7f513e0ea700 1 -- 172.21.15.81:0/4196352226 shutdown_connections 2023-10-06T02:55:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.924+0000 7f513e0ea700 1 -- 172.21.15.81:0/4196352226 wait complete. 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.925+0000 7f513e0ea700 1 Processor -- start 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.925+0000 7f513e0ea700 1 -- start start 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.925+0000 7f513e0ea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f513806d700 0x7f5138146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.925+0000 7f513e0ea700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51380d02b0 0x7f51380b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.925+0000 7f513e0ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51380d0b80 0x7f51380b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.925+0000 7f513e0ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51380ae5e0 con 0x7f51380d0b80 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.925+0000 7f513e0ea700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51380adcb0 con 0x7f513806d700 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.925+0000 7f513e0ea700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51380adf90 con 0x7f51380d02b0 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d8e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51380d0b80 0x7f51380b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d8e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51380d0b80 0x7f51380b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36944/0 (socket says 172.21.15.81:36944) 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d8e9700 1 -- 172.21.15.81:0/3754131281 learned_addr learned my addr 172.21.15.81:0/3754131281 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:49.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d0e8700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f513806d700 0x7f5138146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513c8e7700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51380d02b0 0x7f51380b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d8e9700 1 -- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51380d02b0 msgr2=0x7f51380b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d8e9700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51380d02b0 0x7f51380b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d8e9700 1 -- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f513806d700 msgr2=0x7f5138146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d8e9700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f513806d700 0x7f5138146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d8e9700 1 -- 172.21.15.81:0/3754131281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5130009a20 con 0x7f51380d0b80 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513d8e9700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51380d0b80 0x7f51380b0a70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5130009f90 tx=0x7f513000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f512d7fa700 1 -- 172.21.15.81:0/3754131281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513000cbd0 con 0x7f51380d0b80 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f512d7fa700 1 -- 172.21.15.81:0/3754131281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513000f040 con 0x7f51380d0b80 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5134009420 con 0x7f51380d0b80 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f512d7fa700 1 -- 172.21.15.81:0/3754131281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130014480 con 0x7f51380d0b80 2023-10-06T02:55:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.926+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5138146b40 con 0x7f51380d0b80 2023-10-06T02:55:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.927+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51380ae790 con 0x7f51380d0b80 2023-10-06T02:55:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.927+0000 7f512d7fa700 1 -- 172.21.15.81:0/3754131281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51300147f0 con 0x7f51380d0b80 2023-10-06T02:55:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.928+0000 7f512d7fa700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f511c066f30 0x7f511c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.928+0000 7f512d7fa700 1 -- 172.21.15.81:0/3754131281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5130085350 con 0x7f51380d0b80 2023-10-06T02:55:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.928+0000 7f513d0e8700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f511c066f30 0x7f511c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.928+0000 7f513d0e8700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f511c066f30 0x7f511c0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f51340093f0 tx=0x7f5134017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:49.932+0000 7f512d7fa700 1 -- 172.21.15.81:0/3754131281 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51380ae790 con 0x7f51380d0b80 2023-10-06T02:55:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.156+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f51380676e0 con 0x7f51380d0b80 2023-10-06T02:55:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.783+0000 7f512d7fa700 1 -- 172.21.15.81:0/3754131281 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5130052460 con 0x7f51380d0b80 2023-10-06T02:55:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f511c066f30 msgr2=0x7f511c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f511c066f30 0x7f511c0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f51340093f0 tx=0x7f5134017000 comp rx=0 tx=0).stop 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51380d0b80 msgr2=0x7f51380b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51380d0b80 0x7f51380b0a70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5130009f90 tx=0x7f513000b040 comp rx=0 tx=0).stop 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 shutdown_connections 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51380d0b80 0x7f51380b0a70 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f511c066f30 0x7f511c0693e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f513806d700 0x7f5138146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 --2- 172.21.15.81:0/3754131281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51380d02b0 0x7f51380b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 >> 172.21.15.81:0/3754131281 conn(0x7f5138063230 msgr2=0x7f51380b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 shutdown_connections 2023-10-06T02:55:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.785+0000 7f513e0ea700 1 -- 172.21.15.81:0/3754131281 wait complete. 2023-10-06T02:55:50.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.913+0000 7f364756b700 1 Processor -- start 2023-10-06T02:55:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.913+0000 7f364756b700 1 -- start start 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.914+0000 7f364756b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f364006d830 0x7f36400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.914+0000 7f364756b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36400d07c0 con 0x7f36401578d0 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.914+0000 7f364756b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36400cfbb0 con 0x7f3640157ca0 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.914+0000 7f364756b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36400cfe90 con 0x7f364006d830 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.914+0000 7f3645307700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f36401578d0 0x7f364015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33084/0 (socket says 172.21.15.81:33084) 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.914+0000 7f3645307700 1 -- 172.21.15.81:0/2000103273 learned_addr learned my addr 172.21.15.81:0/2000103273 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022174638 0 0) 0x7f36400d07c0 con 0x7f36401578d0 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f362c003570 con 0x7f36401578d0 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3645b08700 1 --2- 172.21.15.81:0/2000103273 >> v2:172.21.15.83:3300/0 conn(0x7f364006d830 0x7f36400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 502012438 0 0) 0x7f362c003570 con 0x7f36401578d0 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 >> v2:172.21.15.83:3300/0 conn(0x7f364006d830 msgr2=0x7f36400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 --2- 172.21.15.81:0/2000103273 >> v2:172.21.15.83:3300/0 conn(0x7f364006d830 0x7f36400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 >> v1:172.21.15.83:6789/0 conn(0x7f3640157ca0 legacy=0x7f364006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400d0170 con 0x7f36401578d0 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f363c001470 con 0x7f36401578d0 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 >> v1:172.21.15.81:6789/0 conn(0x7f36401578d0 legacy=0x7f364015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c003a60 0x7f362c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362c004810 0x7f362c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c0051c0 0x7f362c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400cfe90 con 0x7f362c003a60 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c00c0d0 con 0x7f362c0051c0 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c00c290 con 0x7f362c004810 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3645307700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c003a60 0x7f362c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3645b08700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c0051c0 0x7f362c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3644b06700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362c004810 0x7f362c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3645307700 1 -- 172.21.15.81:0/2000103273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362c004810 msgr2=0x7f362c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3645307700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362c004810 0x7f362c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3645307700 1 -- 172.21.15.81:0/2000103273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c0051c0 msgr2=0x7f362c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3645307700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c0051c0 0x7f362c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3645b08700 1 -- 172.21.15.81:0/2000103273 reap_dead start 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.915+0000 7f3645307700 1 -- 172.21.15.81:0/2000103273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c003570 con 0x7f362c003a60 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f3645307700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c003a60 0x7f362c003e70 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c3c0 tx=0x7f363c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a221dbe631c0b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00cc90 con 0x7f362c003a60 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00cdf0 con 0x7f362c003a60 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f3637fff700 1 -- 172.21.15.81:0/2000103273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c005b50 con 0x7f362c003a60 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f364756b700 1 -- 172.21.15.81:0/2000103273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c003a60 msgr2=0x7f362c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f364756b700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c003a60 0x7f362c003e70 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c3c0 tx=0x7f363c001e50 comp rx=0 tx=0).stop 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f364756b700 1 -- 172.21.15.81:0/2000103273 shutdown_connections 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f364756b700 1 --2- 172.21.15.81:0/2000103273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c003a60 0x7f362c003e70 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f364756b700 1 -- 172.21.15.81:0/2000103273 >> 172.21.15.81:0/2000103273 conn(0x7f364006bb90 msgr2=0x7f364006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f364756b700 1 -- 172.21.15.81:0/2000103273 shutdown_connections 2023-10-06T02:55:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.916+0000 7f364756b700 1 -- 172.21.15.81:0/2000103273 wait complete. 2023-10-06T02:55:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.917+0000 7f364756b700 1 Processor -- start 2023-10-06T02:55:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.917+0000 7f364756b700 1 -- start start 2023-10-06T02:55:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f364756b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c003a60 0x7f36400b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f364756b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36400ace30 0x7f36400b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f364756b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3640153c70 0x7f36400aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f364756b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400b4e90 con 0x7f36400ace30 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f364756b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400b4280 con 0x7f362c003a60 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f364756b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36400b4560 con 0x7f3640153c70 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f3644b06700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36400ace30 0x7f36400b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f3644b06700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36400ace30 0x7f36400b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32942/0 (socket says 172.21.15.81:32942) 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f3644b06700 1 -- 172.21.15.81:0/652274865 learned_addr learned my addr 172.21.15.81:0/652274865 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f3645b08700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3640153c70 0x7f36400aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.918+0000 7f3645307700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c003a60 0x7f36400b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f3644b06700 1 -- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3640153c70 msgr2=0x7f36400aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f3644b06700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3640153c70 0x7f36400aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f3644b06700 1 -- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c003a60 msgr2=0x7f36400b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f3644b06700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c003a60 0x7f36400b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f3644b06700 1 -- 172.21.15.81:0/652274865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400b4840 con 0x7f36400ace30 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f3645b08700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3640153c70 0x7f36400aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f3645307700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c003a60 0x7f36400b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f3644b06700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36400ace30 0x7f36400b5320 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f363000e810 tx=0x7f3630009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f36357fa700 1 -- 172.21.15.81:0/652274865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630012590 con 0x7f36400ace30 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f36357fa700 1 -- 172.21.15.81:0/652274865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36300126f0 con 0x7f36400ace30 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36400b4b20 con 0x7f36400ace30 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f36357fa700 1 -- 172.21.15.81:0/652274865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630012a90 con 0x7f36400ace30 2023-10-06T02:55:50.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.919+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36400b5860 con 0x7f36400ace30 2023-10-06T02:55:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.920+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36400b5000 con 0x7f36400ace30 2023-10-06T02:55:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.920+0000 7f36357fa700 1 -- 172.21.15.81:0/652274865 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f363001d460 con 0x7f36400ace30 2023-10-06T02:55:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.921+0000 7f36357fa700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3624066f30 0x7f36240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.921+0000 7f36357fa700 1 -- 172.21.15.81:0/652274865 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3630084820 con 0x7f36400ace30 2023-10-06T02:55:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.921+0000 7f3645307700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3624066f30 0x7f36240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.922+0000 7f3645307700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3624066f30 0x7f36240693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f363c001ed0 tx=0x7f363c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:50.925+0000 7f36357fa700 1 -- 172.21.15.81:0/652274865 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3630051930 con 0x7f36400ace30 2023-10-06T02:55:51.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.149+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36400d0450 con 0x7f36400ace30 2023-10-06T02:55:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.149+0000 7f36357fa700 1 -- 172.21.15.81:0/652274865 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f3630054f50 con 0x7f36400ace30 2023-10-06T02:55:51.151 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:51.151 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4037385194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4037385194},{"type":"v1","addr":"172.21.15.83:6837","nonce":4037385194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2052186081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2052186081},{"type":"v1","addr":"172.21.15.83:6836","nonce":2052186081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2641977500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2641977500},{"type":"v1","addr":"172.21.15.81:6833","nonce":2641977500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:47.127871+0000","modified":"2023-10-06T02:55:50.779474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/70519905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":70519905},{"type":"v1","addr":"172.21.15.81:6835","nonce":70519905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T02:55:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3624066f30 msgr2=0x7f36240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3624066f30 0x7f36240693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f363c001ed0 tx=0x7f363c015000 comp rx=0 tx=0).stop 2023-10-06T02:55:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36400ace30 msgr2=0x7f36400b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36400ace30 0x7f36400b5320 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f363000e810 tx=0x7f3630009040 comp rx=0 tx=0).stop 2023-10-06T02:55:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 shutdown_connections 2023-10-06T02:55:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3640153c70 0x7f36400aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3624066f30 0x7f36240693e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f362c003a60 0x7f36400b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 --2- 172.21.15.81:0/652274865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36400ace30 0x7f36400b5320 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 >> 172.21.15.81:0/652274865 conn(0x7f364006bb90 msgr2=0x7f36401567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 shutdown_connections 2023-10-06T02:55:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.152+0000 7f364756b700 1 -- 172.21.15.81:0/652274865 wait complete. 2023-10-06T02:55:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2023-10-06T02:55:51.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.279+0000 7f8042641700 1 Processor -- start 2023-10-06T02:55:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.279+0000 7f8042641700 1 -- start start 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.280+0000 7f8042641700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f803c157ca0 0x7f803c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.280+0000 7f8042641700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c0d07c0 con 0x7f803c06d120 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.280+0000 7f8042641700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c0cfbb0 con 0x7f803c1578d0 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.280+0000 7f8042641700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c0cfe90 con 0x7f803c157ca0 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.280+0000 7f803b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f803c157ca0 0x7f803c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.280+0000 7f8040bde700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f803c06d120 0x7f803c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33088/0 (socket says 172.21.15.81:33088) 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.280+0000 7f8040bde700 1 -- 172.21.15.81:0/2729394192 learned_addr learned my addr 172.21.15.81:0/2729394192 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.280+0000 7f803b7fe700 1 -- 172.21.15.81:0/2729394192 >> v1:172.21.15.83:6789/0 conn(0x7f803c1578d0 legacy=0x7f803c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.280+0000 7f803b7fe700 1 -- 172.21.15.81:0/2729394192 >> v1:172.21.15.81:6789/0 conn(0x7f803c06d120 legacy=0x7f803c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f803b7fe700 1 -- 172.21.15.81:0/2729394192 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0d0170 con 0x7f803c157ca0 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f803b7fe700 1 --2- 172.21.15.81:0/2729394192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c157ca0 0x7f803c0cf4f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f80300098e0 tx=0x7f80300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220b0a367d6b7d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f803affd700 1 -- 172.21.15.81:0/2729394192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030009e80 con 0x7f803c157ca0 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f803affd700 1 -- 172.21.15.81:0/2729394192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803000b820 con 0x7f803c157ca0 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f803affd700 1 -- 172.21.15.81:0/2729394192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803000bba0 con 0x7f803c157ca0 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f8042641700 1 -- 172.21.15.81:0/2729394192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c157ca0 msgr2=0x7f803c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f8042641700 1 --2- 172.21.15.81:0/2729394192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c157ca0 0x7f803c0cf4f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f80300098e0 tx=0x7f80300091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f8042641700 1 -- 172.21.15.81:0/2729394192 shutdown_connections 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f8042641700 1 --2- 172.21.15.81:0/2729394192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c157ca0 0x7f803c0cf4f0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f8042641700 1 -- 172.21.15.81:0/2729394192 >> 172.21.15.81:0/2729394192 conn(0x7f803c06bb90 msgr2=0x7f803c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f8042641700 1 -- 172.21.15.81:0/2729394192 shutdown_connections 2023-10-06T02:55:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.281+0000 7f8042641700 1 -- 172.21.15.81:0/2729394192 wait complete. 2023-10-06T02:55:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.282+0000 7f8042641700 1 Processor -- start 2023-10-06T02:55:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.283+0000 7f8042641700 1 -- start start 2023-10-06T02:55:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.283+0000 7f8042641700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c06d120 0x7f803c0cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.283+0000 7f8042641700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c1578d0 0x7f803c16b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.283+0000 7f8042641700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f803c157ca0 0x7f803c145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.283+0000 7f8042641700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0ca890 con 0x7f803c06d120 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.283+0000 7f8042641700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0cd6c0 con 0x7f803c1578d0 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.283+0000 7f8042641700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c16ba00 con 0x7f803c157ca0 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.283+0000 7f803bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c06d120 0x7f803c0cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c06d120 0x7f803c0cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32946/0 (socket says 172.21.15.81:32946) 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803bfff700 1 -- 172.21.15.81:0/1093783325 learned_addr learned my addr 172.21.15.81:0/1093783325 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803b7fe700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c1578d0 0x7f803c16b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f8040bde700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f803c157ca0 0x7f803c145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803bfff700 1 -- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f803c157ca0 msgr2=0x7f803c145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803bfff700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f803c157ca0 0x7f803c145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803bfff700 1 -- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c1578d0 msgr2=0x7f803c16b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803bfff700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c1578d0 0x7f803c16b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803bfff700 1 -- 172.21.15.81:0/1093783325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8030009420 con 0x7f803c06d120 2023-10-06T02:55:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803b7fe700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c1578d0 0x7f803c16b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f8040bde700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f803c157ca0 0x7f803c145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f803bfff700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c06d120 0x7f803c0cc4d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f802c00c5d0 tx=0x7f802c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f8023fff700 1 -- 172.21.15.81:0/1093783325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c011590 con 0x7f803c06d120 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f8023fff700 1 -- 172.21.15.81:0/1093783325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c011710 con 0x7f803c06d120 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f8023fff700 1 -- 172.21.15.81:0/1093783325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c011ad0 con 0x7f803c06d120 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c0ccab0 con 0x7f803c06d120 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.284+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c0cd350 con 0x7f803c06d120 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.285+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c0cd9a0 con 0x7f803c06d120 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.285+0000 7f8023fff700 1 -- 172.21.15.81:0/1093783325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f802c01c460 con 0x7f803c06d120 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.286+0000 7f8023fff700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8028066f30 0x7f80280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.286+0000 7f8023fff700 1 -- 172.21.15.81:0/1093783325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f802c084430 con 0x7f803c06d120 2023-10-06T02:55:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.286+0000 7f803b7fe700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8028066f30 0x7f80280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.286+0000 7f803b7fe700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8028066f30 0x7f80280693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f803c1580c0 tx=0x7f8030016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.290+0000 7f8023fff700 1 -- 172.21.15.81:0/1093783325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f802c051540 con 0x7f803c06d120 2023-10-06T02:55:51.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.472+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f803c0b2b20 con 0x7f803c06d120 2023-10-06T02:55:51.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.473+0000 7f8023fff700 1 -- 172.21.15.81:0/1093783325 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16834 (secure 0 0 0) 0x7f802c054b60 con 0x7f803c06d120 2023-10-06T02:55:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:51.474 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":165,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:55:48.747732+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:44.780110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:46.089490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.474+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8028066f30 msgr2=0x7f80280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.474+0000 7f8042641700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8028066f30 0x7f80280693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f803c1580c0 tx=0x7f8030016000 comp rx=0 tx=0).stop 2023-10-06T02:55:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.474+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c06d120 msgr2=0x7f803c0cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.474+0000 7f8042641700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c06d120 0x7f803c0cc4d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f802c00c5d0 tx=0x7f802c007f60 comp rx=0 tx=0).stop 2023-10-06T02:55:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.474+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 shutdown_connections 2023-10-06T02:55:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.474+0000 7f8042641700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f803c157ca0 0x7f803c145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.474+0000 7f8042641700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f803c06d120 0x7f803c0cc4d0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.474+0000 7f8042641700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8028066f30 0x7f80280693e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.474+0000 7f8042641700 1 --2- 172.21.15.81:0/1093783325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c1578d0 0x7f803c16b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.475+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 >> 172.21.15.81:0/1093783325 conn(0x7f803c06bb90 msgr2=0x7f803c06a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.475+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 shutdown_connections 2023-10-06T02:55:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.475+0000 7f8042641700 1 -- 172.21.15.81:0/1093783325 wait complete. 2023-10-06T02:55:51.488 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:55:51.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:55:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.600+0000 7fa4db59e700 1 Processor -- start 2023-10-06T02:55:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.600+0000 7fa4db59e700 1 -- start start 2023-10-06T02:55:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.601+0000 7fa4db59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 0x7fa4dc0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.601+0000 7fa4db59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa4dc0cf060 0x7fa4dc06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.601+0000 7fa4db59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc067640 con 0x7fa4dc159f90 2023-10-06T02:55:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.601+0000 7fa4db59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc0b1e50 con 0x7fa4dc0cf060 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.601+0000 7fa4db59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc067890 con 0x7fa4dc159bc0 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.601+0000 7fa4dad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa4dc0cf060 0x7fa4dc06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.601+0000 7fa4dad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa4dc0cf060 0x7fa4dc06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32960/0 (socket says 172.21.15.81:32960) 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.601+0000 7fa4dad9d700 1 -- 172.21.15.81:0/2112122921 learned_addr learned my addr 172.21.15.81:0/2112122921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.601+0000 7fa4da59c700 1 --2- 172.21.15.81:0/2112122921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 0x7fa4dc0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4dad9d700 1 -- 172.21.15.81:0/2112122921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 msgr2=0x7fa4dc0b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4dad9d700 1 --2- 172.21.15.81:0/2112122921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 0x7fa4dc0b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4dad9d700 1 -- 172.21.15.81:0/2112122921 >> v1:172.21.15.83:6789/0 conn(0x7fa4dc159f90 legacy=0x7fa4dc0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4dad9d700 1 -- 172.21.15.81:0/2112122921 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc067b70 con 0x7fa4dc0cf060 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4da59c700 1 --2- 172.21.15.81:0/2112122921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 0x7fa4dc0b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4dad9d700 1 --2- 172.21.15.81:0/2112122921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc0cf060 0x7fa4dc06b0d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009f20 tx=0x7fa4d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daeab7cf63ebc186 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4d9d9b700 1 -- 172.21.15.81:0/2112122921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400e070 con 0x7fa4dc0cf060 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4d9d9b700 1 -- 172.21.15.81:0/2112122921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d400ba40 con 0x7fa4dc0cf060 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4d9d9b700 1 -- 172.21.15.81:0/2112122921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40092e0 con 0x7fa4dc0cf060 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4db59e700 1 -- 172.21.15.81:0/2112122921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc0cf060 msgr2=0x7fa4dc06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4db59e700 1 --2- 172.21.15.81:0/2112122921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc0cf060 0x7fa4dc06b0d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009f20 tx=0x7fa4d4009840 comp rx=0 tx=0).stop 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4db59e700 1 -- 172.21.15.81:0/2112122921 shutdown_connections 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4db59e700 1 --2- 172.21.15.81:0/2112122921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc0cf060 0x7fa4dc06b0d0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4db59e700 1 --2- 172.21.15.81:0/2112122921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 0x7fa4dc0b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4db59e700 1 -- 172.21.15.81:0/2112122921 >> 172.21.15.81:0/2112122921 conn(0x7fa4dc06c620 msgr2=0x7fa4dc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4db59e700 1 -- 172.21.15.81:0/2112122921 shutdown_connections 2023-10-06T02:55:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.602+0000 7fa4db59e700 1 -- 172.21.15.81:0/2112122921 wait complete. 2023-10-06T02:55:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.604+0000 7fa4db59e700 1 Processor -- start 2023-10-06T02:55:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.604+0000 7fa4db59e700 1 -- start start 2023-10-06T02:55:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.604+0000 7fa4db59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4dc0cf060 0x7fa4dc0ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.604+0000 7fa4db59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 0x7fa4dc16a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.604+0000 7fa4db59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc159f90 0x7fa4dc0afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.604+0000 7fa4db59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0af890 con 0x7fa4dc159f90 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.604+0000 7fa4db59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0aec80 con 0x7fa4dc0cf060 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.604+0000 7fa4db59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0aef60 con 0x7fa4dc159bc0 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4dad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc159f90 0x7fa4dc0afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4dad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc159f90 0x7fa4dc0afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32976/0 (socket says 172.21.15.81:32976) 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4dad9d700 1 -- 172.21.15.81:0/4184334222 learned_addr learned my addr 172.21.15.81:0/4184334222 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4da59c700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4dc0cf060 0x7fa4dc0ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4d1d9b700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 0x7fa4dc16a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4dad9d700 1 -- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 msgr2=0x7fa4dc16a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4dad9d700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 0x7fa4dc16a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4dad9d700 1 -- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4dc0cf060 msgr2=0x7fa4dc0ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4dad9d700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4dc0cf060 0x7fa4dc0ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4dad9d700 1 -- 172.21.15.81:0/4184334222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4009ae0 con 0x7fa4dc159f90 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4dad9d700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc159f90 0x7fa4dc0afd20 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4003000 tx=0x7fa4d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4d2ffd700 1 -- 172.21.15.81:0/4184334222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40092e0 con 0x7fa4dc159f90 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4d2ffd700 1 -- 172.21.15.81:0/4184334222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4012d00 con 0x7fa4dc159f90 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc0af240 con 0x7fa4dc159f90 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4d2ffd700 1 -- 172.21.15.81:0/4184334222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d401d650 con 0x7fa4dc159f90 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.605+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc0ae8c0 con 0x7fa4dc159f90 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.606+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc069920 con 0x7fa4dc159f90 2023-10-06T02:55:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.607+0000 7fa4d2ffd700 1 -- 172.21.15.81:0/4184334222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4d401da00 con 0x7fa4dc159f90 2023-10-06T02:55:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.607+0000 7fa4d2ffd700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa4bc066f30 0x7fa4bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.607+0000 7fa4d2ffd700 1 -- 172.21.15.81:0/4184334222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa4d4085e50 con 0x7fa4dc159f90 2023-10-06T02:55:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.607+0000 7fa4da59c700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa4bc066f30 0x7fa4bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.608+0000 7fa4da59c700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa4bc066f30 0x7fa4bc0693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00adc0 tx=0x7fa4cc006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.611+0000 7fa4d2ffd700 1 -- 172.21.15.81:0/4184334222 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4d4052f60 con 0x7fa4dc159f90 2023-10-06T02:55:51.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.791+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4dc0ad680 con 0x7fa4bc066f30 2023-10-06T02:55:51.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.802+0000 7fa4d2ffd700 1 -- 172.21.15.81:0/4184334222 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305853 (secure 0 0 0) 0x7fa4dc0ad680 con 0x7fa4bc066f30 2023-10-06T02:55:51.807 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa4bc066f30 msgr2=0x7fa4bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa4bc066f30 0x7fa4bc0693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00adc0 tx=0x7fa4cc006f90 comp rx=0 tx=0).stop 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc159f90 msgr2=0x7fa4dc0afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc159f90 0x7fa4dc0afd20 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4003000 tx=0x7fa4d4017000 comp rx=0 tx=0).stop 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 shutdown_connections 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc159f90 0x7fa4dc0afd20 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa4bc066f30 0x7fa4bc0693e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4dc0cf060 0x7fa4dc0ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 --2- 172.21.15.81:0/4184334222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4dc159bc0 0x7fa4dc16a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 >> 172.21.15.81:0/4184334222 conn(0x7fa4dc06c620 msgr2=0x7fa4dc0b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 shutdown_connections 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.806+0000 7fa4db59e700 1 -- 172.21.15.81:0/4184334222 wait complete. 2023-10-06T02:55:51.810 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:55:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":453,"stamp":"2023-10-06T02:55:51.633281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8763,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553736,"statfs":{"total":1600000000,"available":1591025948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891612"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756623+0000","last_change":"2023-10-06T02:55:47.754821+0000","last_active":"2023-10-06T02:55:47.756623+0000","last_peered":"2023-10-06T02:55:47.756623+0000","last_clean":"2023-10-06T02:55:47.756623+0000","last_became_active":"2023-10-06T02:55:47.754524+0000","last_became_peered":"2023-10-06T02:55:47.754524+0000","last_unstale":"2023-10-06T02:55:47.756623+0000","last_undegraded":"2023-10-06T02:55:47.756623+0000","last_fullsized":"2023-10-06T02:55:47.756623+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:07.094974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.766135+0000","last_change":"2023-10-06T02:55:47.766038+0000","last_active":"2023-10-06T02:55:47.766135+0000","last_peered":"2023-10-06T02:55:47.766135+0000","last_clean":"2023-10-06T02:55:47.766135+0000","last_became_active":"2023-10-06T02:55:47.765725+0000","last_became_peered":"2023-10-06T02:55:47.765725+0000","last_unstale":"2023-10-06T02:55:47.766135+0000","last_undegraded":"2023-10-06T02:55:47.766135+0000","last_fullsized":"2023-10-06T02:55:47.766135+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:59.630289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758448+0000","last_change":"2023-10-06T02:55:47.758366+0000","last_active":"2023-10-06T02:55:47.758448+0000","last_peered":"2023-10-06T02:55:47.758448+0000","last_clean":"2023-10-06T02:55:47.758448+0000","last_became_active":"2023-10-06T02:55:47.758095+0000","last_became_peered":"2023-10-06T02:55:47.758095+0000","last_unstale":"2023-10-06T02:55:47.758448+0000","last_undegraded":"2023-10-06T02:55:47.758448+0000","last_fullsized":"2023-10-06T02:55:47.758448+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:08.289793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767718+0000","last_change":"2023-10-06T02:55:47.767406+0000","last_active":"2023-10-06T02:55:47.767718+0000","last_peered":"2023-10-06T02:55:47.767718+0000","last_clean":"2023-10-06T02:55:47.767718+0000","last_became_active":"2023-10-06T02:55:47.766237+0000","last_became_peered":"2023-10-06T02:55:47.766237+0000","last_unstale":"2023-10-06T02:55:47.767718+0000","last_undegraded":"2023-10-06T02:55:47.767718+0000","last_fullsized":"2023-10-06T02:55:47.767718+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:18.000536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764863+0000","last_change":"2023-10-06T02:55:47.764712+0000","last_active":"2023-10-06T02:55:47.764863+0000","last_peered":"2023-10-06T02:55:47.764863+0000","last_clean":"2023-10-06T02:55:47.764863+0000","last_became_active":"2023-10-06T02:55:47.764381+0000","last_became_peered":"2023-10-06T02:55:47.764381+0000","last_unstale":"2023-10-06T02:55:47.764863+0000","last_undegraded":"2023-10-06T02:55:47.764863+0000","last_fullsized":"2023-10-06T02:55:47.764863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.460517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762120+0000","last_change":"2023-10-06T02:55:47.762061+0000","last_active":"2023-10-06T02:55:47.762120+0000","last_peered":"2023-10-06T02:55:47.762120+0000","last_clean":"2023-10-06T02:55:47.762120+0000","last_became_active":"2023-10-06T02:55:47.761818+0000","last_became_peered":"2023-10-06T02:55:47.761818+0000","last_unstale":"2023-10-06T02:55:47.762120+0000","last_undegraded":"2023-10-06T02:55:47.762120+0000","last_fullsized":"2023-10-06T02:55:47.762120+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:41.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760806+0000","last_change":"2023-10-06T02:55:47.760740+0000","last_active":"2023-10-06T02:55:47.760806+0000","last_peered":"2023-10-06T02:55:47.760806+0000","last_clean":"2023-10-06T02:55:47.760806+0000","last_became_active":"2023-10-06T02:55:47.760501+0000","last_became_peered":"2023-10-06T02:55:47.760501+0000","last_unstale":"2023-10-06T02:55:47.760806+0000","last_undegraded":"2023-10-06T02:55:47.760806+0000","last_fullsized":"2023-10-06T02:55:47.760806+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:37.622527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764002+0000","last_change":"2023-10-06T02:55:47.763908+0000","last_active":"2023-10-06T02:55:47.764002+0000","last_peered":"2023-10-06T02:55:47.764002+0000","last_clean":"2023-10-06T02:55:47.764002+0000","last_became_active":"2023-10-06T02:55:47.763381+0000","last_became_peered":"2023-10-06T02:55:47.763381+0000","last_unstale":"2023-10-06T02:55:47.764002+0000","last_undegraded":"2023-10-06T02:55:47.764002+0000","last_fullsized":"2023-10-06T02:55:47.764002+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:03.066779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762427+0000","last_change":"2023-10-06T02:55:47.762369+0000","last_active":"2023-10-06T02:55:47.762427+0000","last_peered":"2023-10-06T02:55:47.762427+0000","last_clean":"2023-10-06T02:55:47.762427+0000","last_became_active":"2023-10-06T02:55:47.762168+0000","last_became_peered":"2023-10-06T02:55:47.762168+0000","last_unstale":"2023-10-06T02:55:47.762427+0000","last_undegraded":"2023-10-06T02:55:47.762427+0000","last_fullsized":"2023-10-06T02:55:47.762427+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:40.272755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762452+0000","last_change":"2023-10-06T02:55:47.762403+0000","last_active":"2023-10-06T02:55:47.762452+0000","last_peered":"2023-10-06T02:55:47.762452+0000","last_clean":"2023-10-06T02:55:47.762452+0000","last_became_active":"2023-10-06T02:55:47.762028+0000","last_became_peered":"2023-10-06T02:55:47.762028+0000","last_unstale":"2023-10-06T02:55:47.762452+0000","last_undegraded":"2023-10-06T02:55:47.762452+0000","last_fullsized":"2023-10-06T02:55:47.762452+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:42.930827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761854+0000","last_change":"2023-10-06T02:55:47.761505+0000","last_active":"2023-10-06T02:55:47.761854+0000","last_peered":"2023-10-06T02:55:47.761854+0000","last_clean":"2023-10-06T02:55:47.761854+0000","last_became_active":"2023-10-06T02:55:47.761073+0000","last_became_peered":"2023-10-06T02:55:47.761073+0000","last_unstale":"2023-10-06T02:55:47.761854+0000","last_undegraded":"2023-10-06T02:55:47.761854+0000","last_fullsized":"2023-10-06T02:55:47.761854+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:52.326386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767699+0000","last_change":"2023-10-06T02:55:47.767261+0000","last_active":"2023-10-06T02:55:47.767699+0000","last_peered":"2023-10-06T02:55:47.767699+0000","last_clean":"2023-10-06T02:55:47.767699+0000","last_became_active":"2023-10-06T02:55:47.766435+0000","last_became_peered":"2023-10-06T02:55:47.766435+0000","last_unstale":"2023-10-06T02:55:47.767699+0000","last_undegraded":"2023-10-06T02:55:47.767699+0000","last_fullsized":"2023-10-06T02:55:47.767699+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:32.037263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757888+0000","last_change":"2023-10-06T02:55:47.757795+0000","last_active":"2023-10-06T02:55:47.757888+0000","last_peered":"2023-10-06T02:55:47.757888+0000","last_clean":"2023-10-06T02:55:47.757888+0000","last_became_active":"2023-10-06T02:55:47.757530+0000","last_became_peered":"2023-10-06T02:55:47.757530+0000","last_unstale":"2023-10-06T02:55:47.757888+0000","last_undegraded":"2023-10-06T02:55:47.757888+0000","last_fullsized":"2023-10-06T02:55:47.757888+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:03.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767818+0000","last_change":"2023-10-06T02:55:47.767761+0000","last_active":"2023-10-06T02:55:47.767818+0000","last_peered":"2023-10-06T02:55:47.767818+0000","last_clean":"2023-10-06T02:55:47.767818+0000","last_became_active":"2023-10-06T02:55:47.767122+0000","last_became_peered":"2023-10-06T02:55:47.767122+0000","last_unstale":"2023-10-06T02:55:47.767818+0000","last_undegraded":"2023-10-06T02:55:47.767818+0000","last_fullsized":"2023-10-06T02:55:47.767818+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:15.270812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765201+0000","last_change":"2023-10-06T02:55:47.764739+0000","last_active":"2023-10-06T02:55:47.765201+0000","last_peered":"2023-10-06T02:55:47.765201+0000","last_clean":"2023-10-06T02:55:47.765201+0000","last_became_active":"2023-10-06T02:55:47.764407+0000","last_became_peered":"2023-10-06T02:55:47.764407+0000","last_unstale":"2023-10-06T02:55:47.765201+0000","last_undegraded":"2023-10-06T02:55:47.765201+0000","last_fullsized":"2023-10-06T02:55:47.765201+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:03.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764548+0000","last_change":"2023-10-06T02:55:47.763824+0000","last_active":"2023-10-06T02:55:47.764548+0000","last_peered":"2023-10-06T02:55:47.764548+0000","last_clean":"2023-10-06T02:55:47.764548+0000","last_became_active":"2023-10-06T02:55:47.763478+0000","last_became_peered":"2023-10-06T02:55:47.763478+0000","last_unstale":"2023-10-06T02:55:47.764548+0000","last_undegraded":"2023-10-06T02:55:47.764548+0000","last_fullsized":"2023-10-06T02:55:47.764548+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:16.760503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767735+0000","last_change":"2023-10-06T02:55:47.767565+0000","last_active":"2023-10-06T02:55:47.767735+0000","last_peered":"2023-10-06T02:55:47.767735+0000","last_clean":"2023-10-06T02:55:47.767735+0000","last_became_active":"2023-10-06T02:55:47.766677+0000","last_became_peered":"2023-10-06T02:55:47.766677+0000","last_unstale":"2023-10-06T02:55:47.767735+0000","last_undegraded":"2023-10-06T02:55:47.767735+0000","last_fullsized":"2023-10-06T02:55:47.767735+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:16.085353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760761+0000","last_change":"2023-10-06T02:55:47.760645+0000","last_active":"2023-10-06T02:55:47.760761+0000","last_peered":"2023-10-06T02:55:47.760761+0000","last_clean":"2023-10-06T02:55:47.760761+0000","last_became_active":"2023-10-06T02:55:47.760278+0000","last_became_peered":"2023-10-06T02:55:47.760278+0000","last_unstale":"2023-10-06T02:55:47.760761+0000","last_undegraded":"2023-10-06T02:55:47.760761+0000","last_fullsized":"2023-10-06T02:55:47.760761+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:33.684667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765400+0000","last_change":"2023-10-06T02:55:47.765343+0000","last_active":"2023-10-06T02:55:47.765400+0000","last_peered":"2023-10-06T02:55:47.765400+0000","last_clean":"2023-10-06T02:55:47.765400+0000","last_became_active":"2023-10-06T02:55:47.765055+0000","last_became_peered":"2023-10-06T02:55:47.765055+0000","last_unstale":"2023-10-06T02:55:47.765400+0000","last_undegraded":"2023-10-06T02:55:47.765400+0000","last_fullsized":"2023-10-06T02:55:47.765400+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:41.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757185+0000","last_change":"2023-10-06T02:55:47.757120+0000","last_active":"2023-10-06T02:55:47.757185+0000","last_peered":"2023-10-06T02:55:47.757185+0000","last_clean":"2023-10-06T02:55:47.757185+0000","last_became_active":"2023-10-06T02:55:47.756699+0000","last_became_peered":"2023-10-06T02:55:47.756699+0000","last_unstale":"2023-10-06T02:55:47.757185+0000","last_undegraded":"2023-10-06T02:55:47.757185+0000","last_fullsized":"2023-10-06T02:55:47.757185+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:35.662949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760728+0000","last_change":"2023-10-06T02:55:47.760509+0000","last_active":"2023-10-06T02:55:47.760728+0000","last_peered":"2023-10-06T02:55:47.760728+0000","last_clean":"2023-10-06T02:55:47.760728+0000","last_became_active":"2023-10-06T02:55:47.759921+0000","last_became_peered":"2023-10-06T02:55:47.759921+0000","last_unstale":"2023-10-06T02:55:47.760728+0000","last_undegraded":"2023-10-06T02:55:47.760728+0000","last_fullsized":"2023-10-06T02:55:47.760728+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:06.299497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758282+0000","last_change":"2023-10-06T02:55:47.758215+0000","last_active":"2023-10-06T02:55:47.758282+0000","last_peered":"2023-10-06T02:55:47.758282+0000","last_clean":"2023-10-06T02:55:47.758282+0000","last_became_active":"2023-10-06T02:55:47.757957+0000","last_became_peered":"2023-10-06T02:55:47.757957+0000","last_unstale":"2023-10-06T02:55:47.758282+0000","last_undegraded":"2023-10-06T02:55:47.758282+0000","last_fullsized":"2023-10-06T02:55:47.758282+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:08.783212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758506+0000","last_change":"2023-10-06T02:55:47.758396+0000","last_active":"2023-10-06T02:55:47.758506+0000","last_peered":"2023-10-06T02:55:47.758506+0000","last_clean":"2023-10-06T02:55:47.758506+0000","last_became_active":"2023-10-06T02:55:47.758095+0000","last_became_peered":"2023-10-06T02:55:47.758095+0000","last_unstale":"2023-10-06T02:55:47.758506+0000","last_undegraded":"2023-10-06T02:55:47.758506+0000","last_fullsized":"2023-10-06T02:55:47.758506+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:50.943508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760722+0000","last_change":"2023-10-06T02:55:47.759915+0000","last_active":"2023-10-06T02:55:47.760722+0000","last_peered":"2023-10-06T02:55:47.760722+0000","last_clean":"2023-10-06T02:55:47.760722+0000","last_became_active":"2023-10-06T02:55:47.759684+0000","last_became_peered":"2023-10-06T02:55:47.759684+0000","last_unstale":"2023-10-06T02:55:47.760722+0000","last_undegraded":"2023-10-06T02:55:47.760722+0000","last_fullsized":"2023-10-06T02:55:47.760722+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:47.555683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756648+0000","last_change":"2023-10-06T02:55:47.755929+0000","last_active":"2023-10-06T02:55:47.756648+0000","last_peered":"2023-10-06T02:55:47.756648+0000","last_clean":"2023-10-06T02:55:47.756648+0000","last_became_active":"2023-10-06T02:55:47.755651+0000","last_became_peered":"2023-10-06T02:55:47.755651+0000","last_unstale":"2023-10-06T02:55:47.756648+0000","last_undegraded":"2023-10-06T02:55:47.756648+0000","last_fullsized":"2023-10-06T02:55:47.756648+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:10.616272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757037+0000","last_change":"2023-10-06T02:55:47.756974+0000","last_active":"2023-10-06T02:55:47.757037+0000","last_peered":"2023-10-06T02:55:47.757037+0000","last_clean":"2023-10-06T02:55:47.757037+0000","last_became_active":"2023-10-06T02:55:47.756757+0000","last_became_peered":"2023-10-06T02:55:47.756757+0000","last_unstale":"2023-10-06T02:55:47.757037+0000","last_undegraded":"2023-10-06T02:55:47.757037+0000","last_fullsized":"2023-10-06T02:55:47.757037+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:03.066779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761677+0000","last_change":"2023-10-06T02:55:47.761597+0000","last_active":"2023-10-06T02:55:47.761677+0000","last_peered":"2023-10-06T02:55:47.761677+0000","last_clean":"2023-10-06T02:55:47.761677+0000","last_became_active":"2023-10-06T02:55:47.761304+0000","last_became_peered":"2023-10-06T02:55:47.761304+0000","last_unstale":"2023-10-06T02:55:47.761677+0000","last_undegraded":"2023-10-06T02:55:47.761677+0000","last_fullsized":"2023-10-06T02:55:47.761677+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:03.970960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760740+0000","last_change":"2023-10-06T02:55:47.760508+0000","last_active":"2023-10-06T02:55:47.760740+0000","last_peered":"2023-10-06T02:55:47.760740+0000","last_clean":"2023-10-06T02:55:47.760740+0000","last_became_active":"2023-10-06T02:55:47.759980+0000","last_became_peered":"2023-10-06T02:55:47.759980+0000","last_unstale":"2023-10-06T02:55:47.760740+0000","last_undegraded":"2023-10-06T02:55:47.760740+0000","last_fullsized":"2023-10-06T02:55:47.760740+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:50.650843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.763985+0000","last_change":"2023-10-06T02:55:47.763793+0000","last_active":"2023-10-06T02:55:47.763985+0000","last_peered":"2023-10-06T02:55:47.763985+0000","last_clean":"2023-10-06T02:55:47.763985+0000","last_became_active":"2023-10-06T02:55:47.763072+0000","last_became_peered":"2023-10-06T02:55:47.763072+0000","last_unstale":"2023-10-06T02:55:47.763985+0000","last_undegraded":"2023-10-06T02:55:47.763985+0000","last_fullsized":"2023-10-06T02:55:47.763985+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:03.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.763965+0000","last_change":"2023-10-06T02:55:47.763909+0000","last_active":"2023-10-06T02:55:47.763965+0000","last_peered":"2023-10-06T02:55:47.763965+0000","last_clean":"2023-10-06T02:55:47.763965+0000","last_became_active":"2023-10-06T02:55:47.763688+0000","last_became_peered":"2023-10-06T02:55:47.763688+0000","last_unstale":"2023-10-06T02:55:47.763965+0000","last_undegraded":"2023-10-06T02:55:47.763965+0000","last_fullsized":"2023-10-06T02:55:47.763965+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:51.264200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764529+0000","last_change":"2023-10-06T02:55:47.763684+0000","last_active":"2023-10-06T02:55:47.764529+0000","last_peered":"2023-10-06T02:55:47.764529+0000","last_clean":"2023-10-06T02:55:47.764529+0000","last_became_active":"2023-10-06T02:55:47.763190+0000","last_became_peered":"2023-10-06T02:55:47.763190+0000","last_unstale":"2023-10-06T02:55:47.764529+0000","last_undegraded":"2023-10-06T02:55:47.764529+0000","last_fullsized":"2023-10-06T02:55:47.764529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:47.139074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755723+0000","last_change":"2023-10-06T02:55:47.755637+0000","last_active":"2023-10-06T02:55:47.755723+0000","last_peered":"2023-10-06T02:55:47.755723+0000","last_clean":"2023-10-06T02:55:47.755723+0000","last_became_active":"2023-10-06T02:55:47.755343+0000","last_became_peered":"2023-10-06T02:55:47.755343+0000","last_unstale":"2023-10-06T02:55:47.755723+0000","last_undegraded":"2023-10-06T02:55:47.755723+0000","last_fullsized":"2023-10-06T02:55:47.755723+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:59.630289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757788+0000","last_change":"2023-10-06T02:55:47.757720+0000","last_active":"2023-10-06T02:55:47.757788+0000","last_peered":"2023-10-06T02:55:47.757788+0000","last_clean":"2023-10-06T02:55:47.757788+0000","last_became_active":"2023-10-06T02:55:47.757442+0000","last_became_peered":"2023-10-06T02:55:47.757442+0000","last_unstale":"2023-10-06T02:55:47.757788+0000","last_undegraded":"2023-10-06T02:55:47.757788+0000","last_fullsized":"2023-10-06T02:55:47.757788+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:05.256642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"164'4","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.774018+0000","last_change":"2023-10-06T02:55:46.752934+0000","last_active":"2023-10-06T02:55:47.774018+0000","last_peered":"2023-10-06T02:55:47.774018+0000","last_clean":"2023-10-06T02:55:47.774018+0000","last_became_active":"2023-10-06T02:55:46.752711+0000","last_became_peered":"2023-10-06T02:55:46.752711+0000","last_unstale":"2023-10-06T02:55:47.774018+0000","last_undegraded":"2023-10-06T02:55:47.774018+0000","last_fullsized":"2023-10-06T02:55:47.774018+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:09.611757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765185+0000","last_change":"2023-10-06T02:55:47.764603+0000","last_active":"2023-10-06T02:55:47.765185+0000","last_peered":"2023-10-06T02:55:47.765185+0000","last_clean":"2023-10-06T02:55:47.765185+0000","last_became_active":"2023-10-06T02:55:47.764143+0000","last_became_peered":"2023-10-06T02:55:47.764143+0000","last_unstale":"2023-10-06T02:55:47.765185+0000","last_undegraded":"2023-10-06T02:55:47.765185+0000","last_fullsized":"2023-10-06T02:55:47.765185+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:15.410289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.772457+0000","last_change":"2023-10-06T02:55:46.761386+0000","last_active":"2023-10-06T02:55:47.772457+0000","last_peered":"2023-10-06T02:55:47.772457+0000","last_clean":"2023-10-06T02:55:47.772457+0000","last_became_active":"2023-10-06T02:55:46.761131+0000","last_became_peered":"2023-10-06T02:55:46.761131+0000","last_unstale":"2023-10-06T02:55:47.772457+0000","last_undegraded":"2023-10-06T02:55:47.772457+0000","last_fullsized":"2023-10-06T02:55:47.772457+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:14.405774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.768039+0000","last_change":"2023-10-06T02:55:47.767959+0000","last_active":"2023-10-06T02:55:47.768039+0000","last_peered":"2023-10-06T02:55:47.768039+0000","last_clean":"2023-10-06T02:55:47.768039+0000","last_became_active":"2023-10-06T02:55:47.767315+0000","last_became_peered":"2023-10-06T02:55:47.767315+0000","last_unstale":"2023-10-06T02:55:47.768039+0000","last_undegraded":"2023-10-06T02:55:47.768039+0000","last_fullsized":"2023-10-06T02:55:47.768039+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:08.783212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.772602+0000","last_change":"2023-10-06T02:55:46.761120+0000","last_active":"2023-10-06T02:55:47.772602+0000","last_peered":"2023-10-06T02:55:47.772602+0000","last_clean":"2023-10-06T02:55:47.772602+0000","last_became_active":"2023-10-06T02:55:46.760888+0000","last_became_peered":"2023-10-06T02:55:46.760888+0000","last_unstale":"2023-10-06T02:55:47.772602+0000","last_undegraded":"2023-10-06T02:55:47.772602+0000","last_fullsized":"2023-10-06T02:55:47.772602+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:49.938993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760173+0000","last_change":"2023-10-06T02:55:47.759978+0000","last_active":"2023-10-06T02:55:47.760173+0000","last_peered":"2023-10-06T02:55:47.760173+0000","last_clean":"2023-10-06T02:55:47.760173+0000","last_became_active":"2023-10-06T02:55:47.759754+0000","last_became_peered":"2023-10-06T02:55:47.759754+0000","last_unstale":"2023-10-06T02:55:47.760173+0000","last_undegraded":"2023-10-06T02:55:47.760173+0000","last_fullsized":"2023-10-06T02:55:47.760173+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:18.924235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.772000+0000","last_change":"2023-10-06T02:55:46.754866+0000","last_active":"2023-10-06T02:55:47.772000+0000","last_peered":"2023-10-06T02:55:47.772000+0000","last_clean":"2023-10-06T02:55:47.772000+0000","last_became_active":"2023-10-06T02:55:46.754602+0000","last_became_peered":"2023-10-06T02:55:46.754602+0000","last_unstale":"2023-10-06T02:55:47.772000+0000","last_undegraded":"2023-10-06T02:55:47.772000+0000","last_fullsized":"2023-10-06T02:55:47.772000+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:42.082817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756018+0000","last_change":"2023-10-06T02:55:47.755304+0000","last_active":"2023-10-06T02:55:47.756018+0000","last_peered":"2023-10-06T02:55:47.756018+0000","last_clean":"2023-10-06T02:55:47.756018+0000","last_became_active":"2023-10-06T02:55:47.755089+0000","last_became_peered":"2023-10-06T02:55:47.755089+0000","last_unstale":"2023-10-06T02:55:47.756018+0000","last_undegraded":"2023-10-06T02:55:47.756018+0000","last_fullsized":"2023-10-06T02:55:47.756018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:43.670452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771445+0000","last_change":"2023-10-06T02:55:46.763630+0000","last_active":"2023-10-06T02:55:47.771445+0000","last_peered":"2023-10-06T02:55:47.771445+0000","last_clean":"2023-10-06T02:55:47.771445+0000","last_became_active":"2023-10-06T02:55:46.762728+0000","last_became_peered":"2023-10-06T02:55:46.762728+0000","last_unstale":"2023-10-06T02:55:47.771445+0000","last_undegraded":"2023-10-06T02:55:47.771445+0000","last_fullsized":"2023-10-06T02:55:47.771445+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:24.388086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764962+0000","last_change":"2023-10-06T02:55:47.763955+0000","last_active":"2023-10-06T02:55:47.764962+0000","last_peered":"2023-10-06T02:55:47.764962+0000","last_clean":"2023-10-06T02:55:47.764962+0000","last_became_active":"2023-10-06T02:55:47.763558+0000","last_became_peered":"2023-10-06T02:55:47.763558+0000","last_unstale":"2023-10-06T02:55:47.764962+0000","last_undegraded":"2023-10-06T02:55:47.764962+0000","last_fullsized":"2023-10-06T02:55:47.764962+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:10.747734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.773208+0000","last_change":"2023-10-06T02:55:46.754232+0000","last_active":"2023-10-06T02:55:47.773208+0000","last_peered":"2023-10-06T02:55:47.773208+0000","last_clean":"2023-10-06T02:55:47.773208+0000","last_became_active":"2023-10-06T02:55:46.753938+0000","last_became_peered":"2023-10-06T02:55:46.753938+0000","last_unstale":"2023-10-06T02:55:47.773208+0000","last_undegraded":"2023-10-06T02:55:47.773208+0000","last_fullsized":"2023-10-06T02:55:47.773208+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:15.080838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755952+0000","last_change":"2023-10-06T02:55:47.755652+0000","last_active":"2023-10-06T02:55:47.755952+0000","last_peered":"2023-10-06T02:55:47.755952+0000","last_clean":"2023-10-06T02:55:47.755952+0000","last_became_active":"2023-10-06T02:55:47.755414+0000","last_became_peered":"2023-10-06T02:55:47.755414+0000","last_unstale":"2023-10-06T02:55:47.755952+0000","last_undegraded":"2023-10-06T02:55:47.755952+0000","last_fullsized":"2023-10-06T02:55:47.755952+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:07.094974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.752032+0000","last_change":"2023-10-06T02:55:46.758617+0000","last_active":"2023-10-06T02:55:47.752032+0000","last_peered":"2023-10-06T02:55:47.752032+0000","last_clean":"2023-10-06T02:55:47.752032+0000","last_became_active":"2023-10-06T02:55:46.758339+0000","last_became_peered":"2023-10-06T02:55:46.758339+0000","last_unstale":"2023-10-06T02:55:47.752032+0000","last_undegraded":"2023-10-06T02:55:47.752032+0000","last_fullsized":"2023-10-06T02:55:47.752032+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:19.641889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757017+0000","last_change":"2023-10-06T02:55:47.756935+0000","last_active":"2023-10-06T02:55:47.757017+0000","last_peered":"2023-10-06T02:55:47.757017+0000","last_clean":"2023-10-06T02:55:47.757017+0000","last_became_active":"2023-10-06T02:55:47.756638+0000","last_became_peered":"2023-10-06T02:55:47.756638+0000","last_unstale":"2023-10-06T02:55:47.757017+0000","last_undegraded":"2023-10-06T02:55:47.757017+0000","last_fullsized":"2023-10-06T02:55:47.757017+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:50.943508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760138+0000","last_change":"2023-10-06T02:55:46.760086+0000","last_active":"2023-10-06T02:55:47.760138+0000","last_peered":"2023-10-06T02:55:47.760138+0000","last_clean":"2023-10-06T02:55:47.760138+0000","last_became_active":"2023-10-06T02:55:46.759410+0000","last_became_peered":"2023-10-06T02:55:46.759410+0000","last_unstale":"2023-10-06T02:55:47.760138+0000","last_undegraded":"2023-10-06T02:55:47.760138+0000","last_fullsized":"2023-10-06T02:55:47.760138+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:07.778697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760562+0000","last_change":"2023-10-06T02:55:47.760379+0000","last_active":"2023-10-06T02:55:47.760562+0000","last_peered":"2023-10-06T02:55:47.760562+0000","last_clean":"2023-10-06T02:55:47.760562+0000","last_became_active":"2023-10-06T02:55:47.760075+0000","last_became_peered":"2023-10-06T02:55:47.760075+0000","last_unstale":"2023-10-06T02:55:47.760562+0000","last_undegraded":"2023-10-06T02:55:47.760562+0000","last_fullsized":"2023-10-06T02:55:47.760562+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:35.547639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.772875+0000","last_change":"2023-10-06T02:55:46.761959+0000","last_active":"2023-10-06T02:55:47.772875+0000","last_peered":"2023-10-06T02:55:47.772875+0000","last_clean":"2023-10-06T02:55:47.772875+0000","last_became_active":"2023-10-06T02:55:46.761642+0000","last_became_peered":"2023-10-06T02:55:46.761642+0000","last_unstale":"2023-10-06T02:55:47.772875+0000","last_undegraded":"2023-10-06T02:55:47.772875+0000","last_fullsized":"2023-10-06T02:55:47.772875+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:49.350846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764487+0000","last_change":"2023-10-06T02:55:47.764347+0000","last_active":"2023-10-06T02:55:47.764487+0000","last_peered":"2023-10-06T02:55:47.764487+0000","last_clean":"2023-10-06T02:55:47.764487+0000","last_became_active":"2023-10-06T02:55:47.763937+0000","last_became_peered":"2023-10-06T02:55:47.763937+0000","last_unstale":"2023-10-06T02:55:47.764487+0000","last_undegraded":"2023-10-06T02:55:47.764487+0000","last_fullsized":"2023-10-06T02:55:47.764487+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:42.930827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771886+0000","last_change":"2023-10-06T02:55:46.752669+0000","last_active":"2023-10-06T02:55:47.771886+0000","last_peered":"2023-10-06T02:55:47.771886+0000","last_clean":"2023-10-06T02:55:47.771886+0000","last_became_active":"2023-10-06T02:55:46.752430+0000","last_became_peered":"2023-10-06T02:55:46.752430+0000","last_unstale":"2023-10-06T02:55:47.771886+0000","last_undegraded":"2023-10-06T02:55:47.771886+0000","last_fullsized":"2023-10-06T02:55:47.771886+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:18.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.763155+0000","last_change":"2023-10-06T02:55:47.763038+0000","last_active":"2023-10-06T02:55:47.763155+0000","last_peered":"2023-10-06T02:55:47.763155+0000","last_clean":"2023-10-06T02:55:47.763155+0000","last_became_active":"2023-10-06T02:55:47.762514+0000","last_became_peered":"2023-10-06T02:55:47.762514+0000","last_unstale":"2023-10-06T02:55:47.763155+0000","last_undegraded":"2023-10-06T02:55:47.763155+0000","last_fullsized":"2023-10-06T02:55:47.763155+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:19.763007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.773227+0000","last_change":"2023-10-06T02:55:46.756267+0000","last_active":"2023-10-06T02:55:47.773227+0000","last_peered":"2023-10-06T02:55:47.773227+0000","last_clean":"2023-10-06T02:55:47.773227+0000","last_became_active":"2023-10-06T02:55:46.756047+0000","last_became_peered":"2023-10-06T02:55:46.756047+0000","last_unstale":"2023-10-06T02:55:47.773227+0000","last_undegraded":"2023-10-06T02:55:47.773227+0000","last_fullsized":"2023-10-06T02:55:47.773227+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:16.996021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765566+0000","last_change":"2023-10-06T02:55:47.765500+0000","last_active":"2023-10-06T02:55:47.765566+0000","last_peered":"2023-10-06T02:55:47.765566+0000","last_clean":"2023-10-06T02:55:47.765566+0000","last_became_active":"2023-10-06T02:55:47.765272+0000","last_became_peered":"2023-10-06T02:55:47.765272+0000","last_unstale":"2023-10-06T02:55:47.765566+0000","last_undegraded":"2023-10-06T02:55:47.765566+0000","last_fullsized":"2023-10-06T02:55:47.765566+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:46.642017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764702+0000","last_change":"2023-10-06T02:55:46.759855+0000","last_active":"2023-10-06T02:55:47.764702+0000","last_peered":"2023-10-06T02:55:47.764702+0000","last_clean":"2023-10-06T02:55:47.764702+0000","last_became_active":"2023-10-06T02:55:46.759256+0000","last_became_peered":"2023-10-06T02:55:46.759256+0000","last_unstale":"2023-10-06T02:55:47.764702+0000","last_undegraded":"2023-10-06T02:55:47.764702+0000","last_fullsized":"2023-10-06T02:55:47.764702+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:54.396091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764285+0000","last_change":"2023-10-06T02:55:47.764182+0000","last_active":"2023-10-06T02:55:47.764285+0000","last_peered":"2023-10-06T02:55:47.764285+0000","last_clean":"2023-10-06T02:55:47.764285+0000","last_became_active":"2023-10-06T02:55:47.763573+0000","last_became_peered":"2023-10-06T02:55:47.763573+0000","last_unstale":"2023-10-06T02:55:47.764285+0000","last_undegraded":"2023-10-06T02:55:47.764285+0000","last_fullsized":"2023-10-06T02:55:47.764285+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:06.807033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771805+0000","last_change":"2023-10-06T02:55:46.756165+0000","last_active":"2023-10-06T02:55:47.771805+0000","last_peered":"2023-10-06T02:55:47.771805+0000","last_clean":"2023-10-06T02:55:47.771805+0000","last_became_active":"2023-10-06T02:55:46.755944+0000","last_became_peered":"2023-10-06T02:55:46.755944+0000","last_unstale":"2023-10-06T02:55:47.771805+0000","last_undegraded":"2023-10-06T02:55:47.771805+0000","last_fullsized":"2023-10-06T02:55:47.771805+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:39.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758466+0000","last_change":"2023-10-06T02:55:47.758396+0000","last_active":"2023-10-06T02:55:47.758466+0000","last_peered":"2023-10-06T02:55:47.758466+0000","last_clean":"2023-10-06T02:55:47.758466+0000","last_became_active":"2023-10-06T02:55:47.758173+0000","last_became_peered":"2023-10-06T02:55:47.758173+0000","last_unstale":"2023-10-06T02:55:47.758466+0000","last_undegraded":"2023-10-06T02:55:47.758466+0000","last_fullsized":"2023-10-06T02:55:47.758466+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:50.943508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755103+0000","last_change":"2023-10-06T02:55:46.756712+0000","last_active":"2023-10-06T02:55:47.755103+0000","last_peered":"2023-10-06T02:55:47.755103+0000","last_clean":"2023-10-06T02:55:47.755103+0000","last_became_active":"2023-10-06T02:55:46.756094+0000","last_became_peered":"2023-10-06T02:55:46.756094+0000","last_unstale":"2023-10-06T02:55:47.755103+0000","last_undegraded":"2023-10-06T02:55:47.755103+0000","last_fullsized":"2023-10-06T02:55:47.755103+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:48.065144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761305+0000","last_change":"2023-10-06T02:55:47.761226+0000","last_active":"2023-10-06T02:55:47.761305+0000","last_peered":"2023-10-06T02:55:47.761305+0000","last_clean":"2023-10-06T02:55:47.761305+0000","last_became_active":"2023-10-06T02:55:47.760996+0000","last_became_peered":"2023-10-06T02:55:47.760996+0000","last_unstale":"2023-10-06T02:55:47.761305+0000","last_undegraded":"2023-10-06T02:55:47.761305+0000","last_fullsized":"2023-10-06T02:55:47.761305+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:02.645706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.751552+0000","last_change":"2023-10-06T02:55:46.754310+0000","last_active":"2023-10-06T02:55:47.751552+0000","last_peered":"2023-10-06T02:55:47.751552+0000","last_clean":"2023-10-06T02:55:47.751552+0000","last_became_active":"2023-10-06T02:55:46.753906+0000","last_became_peered":"2023-10-06T02:55:46.753906+0000","last_unstale":"2023-10-06T02:55:47.751552+0000","last_undegraded":"2023-10-06T02:55:47.751552+0000","last_fullsized":"2023-10-06T02:55:47.751552+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.631138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765630+0000","last_change":"2023-10-06T02:55:47.765572+0000","last_active":"2023-10-06T02:55:47.765630+0000","last_peered":"2023-10-06T02:55:47.765630+0000","last_clean":"2023-10-06T02:55:47.765630+0000","last_became_active":"2023-10-06T02:55:47.765351+0000","last_became_peered":"2023-10-06T02:55:47.765351+0000","last_unstale":"2023-10-06T02:55:47.765630+0000","last_undegraded":"2023-10-06T02:55:47.765630+0000","last_fullsized":"2023-10-06T02:55:47.765630+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:03.066779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.753335+0000","last_change":"2023-10-06T02:55:46.760374+0000","last_active":"2023-10-06T02:55:47.753335+0000","last_peered":"2023-10-06T02:55:47.753335+0000","last_clean":"2023-10-06T02:55:47.753335+0000","last_became_active":"2023-10-06T02:55:46.758512+0000","last_became_peered":"2023-10-06T02:55:46.758512+0000","last_unstale":"2023-10-06T02:55:47.753335+0000","last_undegraded":"2023-10-06T02:55:47.753335+0000","last_fullsized":"2023-10-06T02:55:47.753335+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:46.184921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761662+0000","last_change":"2023-10-06T02:55:47.761105+0000","last_active":"2023-10-06T02:55:47.761662+0000","last_peered":"2023-10-06T02:55:47.761662+0000","last_clean":"2023-10-06T02:55:47.761662+0000","last_became_active":"2023-10-06T02:55:47.760741+0000","last_became_peered":"2023-10-06T02:55:47.760741+0000","last_unstale":"2023-10-06T02:55:47.761662+0000","last_undegraded":"2023-10-06T02:55:47.761662+0000","last_fullsized":"2023-10-06T02:55:47.761662+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:41:39.828918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771131+0000","last_change":"2023-10-06T02:55:46.760001+0000","last_active":"2023-10-06T02:55:47.771131+0000","last_peered":"2023-10-06T02:55:47.771131+0000","last_clean":"2023-10-06T02:55:47.771131+0000","last_became_active":"2023-10-06T02:55:46.759615+0000","last_became_peered":"2023-10-06T02:55:46.759615+0000","last_unstale":"2023-10-06T02:55:47.771131+0000","last_undegraded":"2023-10-06T02:55:47.771131+0000","last_fullsized":"2023-10-06T02:55:47.771131+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:47.877544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767754+0000","last_change":"2023-10-06T02:55:47.767591+0000","last_active":"2023-10-06T02:55:47.767754+0000","last_peered":"2023-10-06T02:55:47.767754+0000","last_clean":"2023-10-06T02:55:47.767754+0000","last_became_active":"2023-10-06T02:55:47.766631+0000","last_became_peered":"2023-10-06T02:55:47.766631+0000","last_unstale":"2023-10-06T02:55:47.767754+0000","last_undegraded":"2023-10-06T02:55:47.767754+0000","last_fullsized":"2023-10-06T02:55:47.767754+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:19.763007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.751948+0000","last_change":"2023-10-06T02:55:46.760189+0000","last_active":"2023-10-06T02:55:47.751948+0000","last_peered":"2023-10-06T02:55:47.751948+0000","last_clean":"2023-10-06T02:55:47.751948+0000","last_became_active":"2023-10-06T02:55:46.759507+0000","last_became_peered":"2023-10-06T02:55:46.759507+0000","last_unstale":"2023-10-06T02:55:47.751948+0000","last_undegraded":"2023-10-06T02:55:47.751948+0000","last_fullsized":"2023-10-06T02:55:47.751948+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:48.065144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756604+0000","last_change":"2023-10-06T02:55:47.754755+0000","last_active":"2023-10-06T02:55:47.756604+0000","last_peered":"2023-10-06T02:55:47.756604+0000","last_clean":"2023-10-06T02:55:47.756604+0000","last_became_active":"2023-10-06T02:55:47.754445+0000","last_became_peered":"2023-10-06T02:55:47.754445+0000","last_unstale":"2023-10-06T02:55:47.756604+0000","last_undegraded":"2023-10-06T02:55:47.756604+0000","last_fullsized":"2023-10-06T02:55:47.756604+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:19.726327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754359+0000","last_change":"2023-10-06T02:55:46.754796+0000","last_active":"2023-10-06T02:55:47.754359+0000","last_peered":"2023-10-06T02:55:47.754359+0000","last_clean":"2023-10-06T02:55:47.754359+0000","last_became_active":"2023-10-06T02:55:46.754605+0000","last_became_peered":"2023-10-06T02:55:46.754605+0000","last_unstale":"2023-10-06T02:55:47.754359+0000","last_undegraded":"2023-10-06T02:55:47.754359+0000","last_fullsized":"2023-10-06T02:55:47.754359+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:24.388086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.766819+0000","last_change":"2023-10-06T02:55:47.766734+0000","last_active":"2023-10-06T02:55:47.766819+0000","last_peered":"2023-10-06T02:55:47.766819+0000","last_clean":"2023-10-06T02:55:47.766819+0000","last_became_active":"2023-10-06T02:55:47.766481+0000","last_became_peered":"2023-10-06T02:55:47.766481+0000","last_unstale":"2023-10-06T02:55:47.766819+0000","last_undegraded":"2023-10-06T02:55:47.766819+0000","last_fullsized":"2023-10-06T02:55:47.766819+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:08.289793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.759960+0000","last_change":"2023-10-06T02:55:46.762763+0000","last_active":"2023-10-06T02:55:47.759960+0000","last_peered":"2023-10-06T02:55:47.759960+0000","last_clean":"2023-10-06T02:55:47.759960+0000","last_became_active":"2023-10-06T02:55:46.762538+0000","last_became_peered":"2023-10-06T02:55:46.762538+0000","last_unstale":"2023-10-06T02:55:47.759960+0000","last_undegraded":"2023-10-06T02:55:47.759960+0000","last_fullsized":"2023-10-06T02:55:47.759960+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:45.637502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755741+0000","last_change":"2023-10-06T02:55:47.755642+0000","last_active":"2023-10-06T02:55:47.755741+0000","last_peered":"2023-10-06T02:55:47.755741+0000","last_clean":"2023-10-06T02:55:47.755741+0000","last_became_active":"2023-10-06T02:55:47.755400+0000","last_became_peered":"2023-10-06T02:55:47.755400+0000","last_unstale":"2023-10-06T02:55:47.755741+0000","last_undegraded":"2023-10-06T02:55:47.755741+0000","last_fullsized":"2023-10-06T02:55:47.755741+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:37.622527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.753441+0000","last_change":"2023-10-06T02:55:46.760918+0000","last_active":"2023-10-06T02:55:47.753441+0000","last_peered":"2023-10-06T02:55:47.753441+0000","last_clean":"2023-10-06T02:55:47.753441+0000","last_became_active":"2023-10-06T02:55:46.760675+0000","last_became_peered":"2023-10-06T02:55:46.760675+0000","last_unstale":"2023-10-06T02:55:47.753441+0000","last_undegraded":"2023-10-06T02:55:47.753441+0000","last_fullsized":"2023-10-06T02:55:47.753441+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:44.450925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765937+0000","last_change":"2023-10-06T02:55:47.765863+0000","last_active":"2023-10-06T02:55:47.765937+0000","last_peered":"2023-10-06T02:55:47.765937+0000","last_clean":"2023-10-06T02:55:47.765937+0000","last_became_active":"2023-10-06T02:55:47.765661+0000","last_became_peered":"2023-10-06T02:55:47.765661+0000","last_unstale":"2023-10-06T02:55:47.765937+0000","last_undegraded":"2023-10-06T02:55:47.765937+0000","last_fullsized":"2023-10-06T02:55:47.765937+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:25.924382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754006+0000","last_change":"2023-10-06T02:55:46.759852+0000","last_active":"2023-10-06T02:55:47.754006+0000","last_peered":"2023-10-06T02:55:47.754006+0000","last_clean":"2023-10-06T02:55:47.754006+0000","last_became_active":"2023-10-06T02:55:46.759638+0000","last_became_peered":"2023-10-06T02:55:46.759638+0000","last_unstale":"2023-10-06T02:55:47.754006+0000","last_undegraded":"2023-10-06T02:55:47.754006+0000","last_fullsized":"2023-10-06T02:55:47.754006+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:09.060084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.759333+0000","last_change":"2023-10-06T02:55:47.759274+0000","last_active":"2023-10-06T02:55:47.759333+0000","last_peered":"2023-10-06T02:55:47.759333+0000","last_clean":"2023-10-06T02:55:47.759333+0000","last_became_active":"2023-10-06T02:55:47.759060+0000","last_became_peered":"2023-10-06T02:55:47.759060+0000","last_unstale":"2023-10-06T02:55:47.759333+0000","last_undegraded":"2023-10-06T02:55:47.759333+0000","last_fullsized":"2023-10-06T02:55:47.759333+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:01.194042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.752034+0000","last_change":"2023-10-06T02:55:46.760014+0000","last_active":"2023-10-06T02:55:47.752034+0000","last_peered":"2023-10-06T02:55:47.752034+0000","last_clean":"2023-10-06T02:55:47.752034+0000","last_became_active":"2023-10-06T02:55:46.759220+0000","last_became_peered":"2023-10-06T02:55:46.759220+0000","last_unstale":"2023-10-06T02:55:47.752034+0000","last_undegraded":"2023-10-06T02:55:47.752034+0000","last_fullsized":"2023-10-06T02:55:47.752034+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:17.719569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.763524+0000","last_change":"2023-10-06T02:55:47.763081+0000","last_active":"2023-10-06T02:55:47.763524+0000","last_peered":"2023-10-06T02:55:47.763524+0000","last_clean":"2023-10-06T02:55:47.763524+0000","last_became_active":"2023-10-06T02:55:47.762774+0000","last_became_peered":"2023-10-06T02:55:47.762774+0000","last_unstale":"2023-10-06T02:55:47.763524+0000","last_undegraded":"2023-10-06T02:55:47.763524+0000","last_fullsized":"2023-10-06T02:55:47.763524+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:15.410289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756483+0000","last_change":"2023-10-06T02:55:46.759925+0000","last_active":"2023-10-06T02:55:47.756483+0000","last_peered":"2023-10-06T02:55:47.756483+0000","last_clean":"2023-10-06T02:55:47.756483+0000","last_became_active":"2023-10-06T02:55:46.759677+0000","last_became_peered":"2023-10-06T02:55:46.759677+0000","last_unstale":"2023-10-06T02:55:47.756483+0000","last_undegraded":"2023-10-06T02:55:47.756483+0000","last_fullsized":"2023-10-06T02:55:47.756483+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:01.884150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764094+0000","last_change":"2023-10-06T02:55:47.764038+0000","last_active":"2023-10-06T02:55:47.764094+0000","last_peered":"2023-10-06T02:55:47.764094+0000","last_clean":"2023-10-06T02:55:47.764094+0000","last_became_active":"2023-10-06T02:55:47.763687+0000","last_became_peered":"2023-10-06T02:55:47.763687+0000","last_unstale":"2023-10-06T02:55:47.764094+0000","last_undegraded":"2023-10-06T02:55:47.764094+0000","last_fullsized":"2023-10-06T02:55:47.764094+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:07.094974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771030+0000","last_change":"2023-10-06T02:55:46.753697+0000","last_active":"2023-10-06T02:55:47.771030+0000","last_peered":"2023-10-06T02:55:47.771030+0000","last_clean":"2023-10-06T02:55:47.771030+0000","last_became_active":"2023-10-06T02:55:46.753559+0000","last_became_peered":"2023-10-06T02:55:46.753559+0000","last_unstale":"2023-10-06T02:55:47.771030+0000","last_undegraded":"2023-10-06T02:55:47.771030+0000","last_fullsized":"2023-10-06T02:55:47.771030+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:36.618012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755787+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:55:47.755787+0000","last_peered":"2023-10-06T02:55:47.755787+0000","last_clean":"2023-10-06T02:55:47.755787+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:55:47.755787+0000","last_undegraded":"2023-10-06T02:55:47.755787+0000","last_fullsized":"2023-10-06T02:55:47.755787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.759446+0000","last_change":"2023-10-06T02:55:47.759346+0000","last_active":"2023-10-06T02:55:47.759446+0000","last_peered":"2023-10-06T02:55:47.759446+0000","last_clean":"2023-10-06T02:55:47.759446+0000","last_became_active":"2023-10-06T02:55:47.759130+0000","last_became_peered":"2023-10-06T02:55:47.759130+0000","last_unstale":"2023-10-06T02:55:47.759446+0000","last_undegraded":"2023-10-06T02:55:47.759446+0000","last_fullsized":"2023-10-06T02:55:47.759446+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:26.727135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"164'3","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771163+0000","last_change":"2023-10-06T02:55:46.752714+0000","last_active":"2023-10-06T02:55:47.771163+0000","last_peered":"2023-10-06T02:55:47.771163+0000","last_clean":"2023-10-06T02:55:47.771163+0000","last_became_active":"2023-10-06T02:55:46.752500+0000","last_became_peered":"2023-10-06T02:55:46.752500+0000","last_unstale":"2023-10-06T02:55:47.771163+0000","last_undegraded":"2023-10-06T02:55:47.771163+0000","last_fullsized":"2023-10-06T02:55:47.771163+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.336492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":154,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754233+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:55:47.754233+0000","last_peered":"2023-10-06T02:55:47.754233+0000","last_clean":"2023-10-06T02:55:47.754233+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:55:47.754233+0000","last_undegraded":"2023-10-06T02:55:47.754233+0000","last_fullsized":"2023-10-06T02:55:47.754233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762921+0000","last_change":"2023-10-06T02:55:47.762857+0000","last_active":"2023-10-06T02:55:47.762921+0000","last_peered":"2023-10-06T02:55:47.762921+0000","last_clean":"2023-10-06T02:55:47.762921+0000","last_became_active":"2023-10-06T02:55:47.762655+0000","last_became_peered":"2023-10-06T02:55:47.762655+0000","last_unstale":"2023-10-06T02:55:47.762921+0000","last_undegraded":"2023-10-06T02:55:47.762921+0000","last_fullsized":"2023-10-06T02:55:47.762921+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:17.297806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754146+0000","last_change":"2023-10-06T02:55:46.758349+0000","last_active":"2023-10-06T02:55:47.754146+0000","last_peered":"2023-10-06T02:55:47.754146+0000","last_clean":"2023-10-06T02:55:47.754146+0000","last_became_active":"2023-10-06T02:55:46.758139+0000","last_became_peered":"2023-10-06T02:55:46.758139+0000","last_unstale":"2023-10-06T02:55:47.754146+0000","last_undegraded":"2023-10-06T02:55:47.754146+0000","last_fullsized":"2023-10-06T02:55:47.754146+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:54.396091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":140,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758467+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:55:47.758467+0000","last_peered":"2023-10-06T02:55:47.758467+0000","last_clean":"2023-10-06T02:55:47.758467+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:55:47.758467+0000","last_undegraded":"2023-10-06T02:55:47.758467+0000","last_fullsized":"2023-10-06T02:55:47.758467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757541+0000","last_change":"2023-10-06T02:55:47.757473+0000","last_active":"2023-10-06T02:55:47.757541+0000","last_peered":"2023-10-06T02:55:47.757541+0000","last_clean":"2023-10-06T02:55:47.757541+0000","last_became_active":"2023-10-06T02:55:47.757237+0000","last_became_peered":"2023-10-06T02:55:47.757237+0000","last_unstale":"2023-10-06T02:55:47.757541+0000","last_undegraded":"2023-10-06T02:55:47.757541+0000","last_fullsized":"2023-10-06T02:55:47.757541+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:19.726327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"164'6","reported_seq":16,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.773758+0000","last_change":"2023-10-06T02:55:46.754166+0000","last_active":"2023-10-06T02:55:47.773758+0000","last_peered":"2023-10-06T02:55:47.773758+0000","last_clean":"2023-10-06T02:55:47.773758+0000","last_became_active":"2023-10-06T02:55:46.753945+0000","last_became_peered":"2023-10-06T02:55:46.753945+0000","last_unstale":"2023-10-06T02:55:47.773758+0000","last_undegraded":"2023-10-06T02:55:47.773758+0000","last_fullsized":"2023-10-06T02:55:47.773758+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:31.430700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":154,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.753534+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:55:47.753534+0000","last_peered":"2023-10-06T02:55:47.753534+0000","last_clean":"2023-10-06T02:55:47.753534+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:55:47.753534+0000","last_undegraded":"2023-10-06T02:55:47.753534+0000","last_fullsized":"2023-10-06T02:55:47.753534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":290,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756681+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:55:47.756681+0000","last_peered":"2023-10-06T02:55:47.756681+0000","last_clean":"2023-10-06T02:55:47.756681+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:55:47.756681+0000","last_undegraded":"2023-10-06T02:55:47.756681+0000","last_fullsized":"2023-10-06T02:55:47.756681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764018+0000","last_change":"2023-10-06T02:55:47.763935+0000","last_active":"2023-10-06T02:55:47.764018+0000","last_peered":"2023-10-06T02:55:47.764018+0000","last_clean":"2023-10-06T02:55:47.764018+0000","last_became_active":"2023-10-06T02:55:47.763377+0000","last_became_peered":"2023-10-06T02:55:47.763377+0000","last_unstale":"2023-10-06T02:55:47.764018+0000","last_undegraded":"2023-10-06T02:55:47.764018+0000","last_fullsized":"2023-10-06T02:55:47.764018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:02.888665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756855+0000","last_change":"2023-10-06T02:55:46.761705+0000","last_active":"2023-10-06T02:55:47.756855+0000","last_peered":"2023-10-06T02:55:47.756855+0000","last_clean":"2023-10-06T02:55:47.756855+0000","last_became_active":"2023-10-06T02:55:46.761481+0000","last_became_peered":"2023-10-06T02:55:46.761481+0000","last_unstale":"2023-10-06T02:55:47.756855+0000","last_undegraded":"2023-10-06T02:55:47.756855+0000","last_fullsized":"2023-10-06T02:55:47.756855+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:02.111189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756592+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:55:47.756592+0000","last_peered":"2023-10-06T02:55:47.756592+0000","last_clean":"2023-10-06T02:55:47.756592+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:55:47.756592+0000","last_undegraded":"2023-10-06T02:55:47.756592+0000","last_fullsized":"2023-10-06T02:55:47.756592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765988+0000","last_change":"2023-10-06T02:55:47.765916+0000","last_active":"2023-10-06T02:55:47.765988+0000","last_peered":"2023-10-06T02:55:47.765988+0000","last_clean":"2023-10-06T02:55:47.765988+0000","last_became_active":"2023-10-06T02:55:47.765520+0000","last_became_peered":"2023-10-06T02:55:47.765520+0000","last_unstale":"2023-10-06T02:55:47.765988+0000","last_undegraded":"2023-10-06T02:55:47.765988+0000","last_fullsized":"2023-10-06T02:55:47.765988+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:02.888665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762860+0000","last_change":"2023-10-06T02:55:46.763791+0000","last_active":"2023-10-06T02:55:47.762860+0000","last_peered":"2023-10-06T02:55:47.762860+0000","last_clean":"2023-10-06T02:55:47.762860+0000","last_became_active":"2023-10-06T02:55:46.763565+0000","last_became_peered":"2023-10-06T02:55:46.763565+0000","last_unstale":"2023-10-06T02:55:47.762860+0000","last_undegraded":"2023-10-06T02:55:47.762860+0000","last_fullsized":"2023-10-06T02:55:47.762860+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:44.041984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":136,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756765+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:55:47.756765+0000","last_peered":"2023-10-06T02:55:47.756765+0000","last_clean":"2023-10-06T02:55:47.756765+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:55:47.756765+0000","last_undegraded":"2023-10-06T02:55:47.756765+0000","last_fullsized":"2023-10-06T02:55:47.756765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760747+0000","last_change":"2023-10-06T02:55:47.760651+0000","last_active":"2023-10-06T02:55:47.760747+0000","last_peered":"2023-10-06T02:55:47.760747+0000","last_clean":"2023-10-06T02:55:47.760747+0000","last_became_active":"2023-10-06T02:55:47.760278+0000","last_became_peered":"2023-10-06T02:55:47.760278+0000","last_unstale":"2023-10-06T02:55:47.760747+0000","last_undegraded":"2023-10-06T02:55:47.760747+0000","last_fullsized":"2023-10-06T02:55:47.760747+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:35.547639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764619+0000","last_change":"2023-10-06T02:55:46.756259+0000","last_active":"2023-10-06T02:55:47.764619+0000","last_peered":"2023-10-06T02:55:47.764619+0000","last_clean":"2023-10-06T02:55:47.764619+0000","last_became_active":"2023-10-06T02:55:46.755515+0000","last_became_peered":"2023-10-06T02:55:46.755515+0000","last_unstale":"2023-10-06T02:55:47.764619+0000","last_undegraded":"2023-10-06T02:55:47.764619+0000","last_fullsized":"2023-10-06T02:55:47.764619+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:44.450925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754166+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:55:47.754166+0000","last_peered":"2023-10-06T02:55:47.754166+0000","last_clean":"2023-10-06T02:55:47.754166+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:55:47.754166+0000","last_undegraded":"2023-10-06T02:55:47.754166+0000","last_fullsized":"2023-10-06T02:55:47.754166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761984+0000","last_change":"2023-10-06T02:55:47.761925+0000","last_active":"2023-10-06T02:55:47.761984+0000","last_peered":"2023-10-06T02:55:47.761984+0000","last_clean":"2023-10-06T02:55:47.761984+0000","last_became_active":"2023-10-06T02:55:47.761688+0000","last_became_peered":"2023-10-06T02:55:47.761688+0000","last_unstale":"2023-10-06T02:55:47.761984+0000","last_undegraded":"2023-10-06T02:55:47.761984+0000","last_fullsized":"2023-10-06T02:55:47.761984+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:19.726327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"164'8","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.774153+0000","last_change":"2023-10-06T02:55:46.760322+0000","last_active":"2023-10-06T02:55:47.774153+0000","last_peered":"2023-10-06T02:55:47.774153+0000","last_clean":"2023-10-06T02:55:47.774153+0000","last_became_active":"2023-10-06T02:55:46.759799+0000","last_became_peered":"2023-10-06T02:55:46.759799+0000","last_unstale":"2023-10-06T02:55:47.774153+0000","last_undegraded":"2023-10-06T02:55:47.774153+0000","last_fullsized":"2023-10-06T02:55:47.774153+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:46.184921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764863+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:55:47.764863+0000","last_peered":"2023-10-06T02:55:47.764863+0000","last_clean":"2023-10-06T02:55:47.764863+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:55:47.764863+0000","last_undegraded":"2023-10-06T02:55:47.764863+0000","last_fullsized":"2023-10-06T02:55:47.764863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1527,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193785,"statfs":{"total":200000000,"available":198436022,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.82299999999999995,"5min":0.84299999999999997,"15min":1.393},"last":0.309},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.71299999999999997,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.504}]},{"osd":1,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.372,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70599999999999996,"5min":0.749,"15min":1.081},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.72399999999999998,"5min":0.83599999999999997,"15min":1.4710000000000001},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77900000000000003,"5min":0.873,"15min":0.873},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.60999999999999999},"min":{"1min":0.38800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.751,"5min":0.77600000000000002,"15min":4.8129999999999997},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.51800000000000002,"15min":0.58799999999999997},"min":{"1min":0.40000000000000002,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":3.4870000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":2.2349999999999999},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58799999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.495,"15min":0.48799999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.62,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76100000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":950,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199026342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.58999999999999997},"min":{"1min":0.379,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":2.8650000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":1.879},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.54300000000000004},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.92000000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54900000000000004,"15min":0.82699999999999996},"min":{"1min":0.41499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74099999999999999,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69999999999999996,"5min":0.76900000000000002,"15min":0.81599999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.56799999999999995},"min":{"1min":0.40500000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.0580000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.29499999999999998},"max":{"1min":0.72499999999999998,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.69899999999999995,"5min":0.73999999999999999,"15min":1.163},"last":0.505}]},{"osd":4,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.52500000000000002},"min":{"1min":0.26700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.79800000000000004,"15min":1.05},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.501,"15min":0.54600000000000004},"min":{"1min":0.30099999999999999,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":0.86799999999999999},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47999999999999998,"15min":0.51900000000000002},"min":{"1min":0.32600000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.58299999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.71599999999999997,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.59399999999999997},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":0.84899999999999998,"15min":1.0129999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.57799999999999996},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.79600000000000004,"15min":0.89500000000000002},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":950,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199026342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.317},"min":{"1min":0.23599999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.50600000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"min":{"1min":0.27900000000000003,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.53100000000000003,"5min":0.58299999999999996,"15min":0.61799999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.32900000000000001},"min":{"1min":0.25,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.47899999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.372},"min":{"1min":0.27500000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.311,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55800000000000005,"5min":0.61699999999999999,"15min":0.63100000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.30399999999999999,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.628,"15min":0.628},"last":0.29499999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.78900000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.55800000000000005},"min":{"1min":0.45500000000000002,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":0.70999999999999996,"5min":1.157,"15min":1.157},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.55500000000000005},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.35799999999999998},"max":{"1min":0.82299999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.40100000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.41899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.432}]},{"osd":7,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.006,"15min":1.006},"last":0.442},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61799999999999999,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":0.87,"15min":0.88200000000000001},"last":0.46899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193783,"statfs":{"total":200000000,"available":198433830,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.34599999999999997,"15min":0.34699999999999998},"min":{"1min":0.26800000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":1.177},"last":0.22},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39000000000000001,"15min":0.39400000000000002},"min":{"1min":0.35399999999999998,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":1.3400000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.83199999999999996},"min":{"1min":0.30199999999999999,"5min":0.217,"15min":0.188},"max":{"1min":0.51900000000000002,"5min":0.56899999999999995,"15min":22.038},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.29299999999999998,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":0.51100000000000001,"5min":0.59199999999999997,"15min":1.3779999999999999},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.28899999999999998,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":1.1439999999999999},"last":0.313},{"interface":"front","average":{"1min":0.435,"5min":0.39000000000000001,"15min":0.86799999999999999},"min":{"1min":0.36899999999999999,"5min":0.25600000000000001,"15min":0.253},"max":{"1min":0.56899999999999995,"5min":0.60399999999999998,"15min":21.942},"last":0.32900000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.39300000000000002,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.79700000000000004,"15min":1.9390000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55900000000000005,"15min":0.96999999999999997},"min":{"1min":0.44600000000000001,"5min":0.38900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":11.122999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":1.03},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":22.010999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":0.82999999999999996,"15min":1.401},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.997},"min":{"1min":0.44,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.82899999999999996,"5min":0.83599999999999997,"15min":11.090999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":1.0509999999999999},"min":{"1min":0.46800000000000003,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":0.85599999999999998,"15min":21.98},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.56799999999999995},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.375},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.425},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.81499999999999995},"min":{"1min":0.495,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":11.154},"last":0.55300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":950,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199026300,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.245,"5min":0.183,"15min":0.16900000000000001},"max":{"1min":0.41899999999999998,"5min":0.55200000000000005,"15min":0.58699999999999997},"last":0.311},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34699999999999998,"15min":0.34300000000000003},"min":{"1min":0.254,"5min":0.22,"15min":0.186},"max":{"1min":0.5,"5min":0.54400000000000004,"15min":0.60699999999999998},"last":0.23999999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36199999999999999},"min":{"1min":0.27800000000000002,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.5,"5min":0.67200000000000004,"15min":0.68200000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.503,"5min":0.63500000000000001,"15min":0.84499999999999997},"last":0.372}]},{"osd":3,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.379},"min":{"1min":0.35299999999999998,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.53600000000000003,"5min":0.60999999999999999,"15min":0.70999999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.33500000000000002,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69999999999999996,"5min":1.056,"15min":1.056},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.45500000000000002,"5min":0.312,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.434}]},{"osd":5,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.49299999999999999,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61799999999999999,"15min":0.59999999999999998},"min":{"1min":0.52300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76400000000000001,"5min":1.018,"15min":1.2569999999999999},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":1.0009999999999999,"15min":1.0660000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.5,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77400000000000002,"5min":0.93899999999999995,"15min":1.002},"last":0.5}]},{"osd":7,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.51500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78700000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61399999999999999,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199025824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33600000000000002,"15min":0.315},"min":{"1min":0.23499999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54900000000000004,"5min":0.55100000000000005,"15min":0.57499999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.22},"max":{"1min":0.748,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.371,"15min":0.34200000000000003},"min":{"1min":0.25600000000000001,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.69999999999999996},"last":0.317},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.36299999999999999},"min":{"1min":0.32600000000000001,"5min":0.27000000000000002,"15min":0.22600000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.71199999999999997},"last":0.372}]},{"osd":2,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.38200000000000001},"min":{"1min":0.307,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":3.044},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.41599999999999998,"15min":0.36699999999999999},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.249},"max":{"1min":0.70899999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.26000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.75800000000000001,"5min":1.446,"15min":2.2120000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":1.327,"15min":2.25},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60899999999999999,"15min":0.66000000000000003},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.34200000000000003},"max":{"1min":0.88100000000000001,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.56000000000000005},"min":{"1min":0.497,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":0.90500000000000003,"5min":1.268,"15min":1.268},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.57799999999999996},"min":{"1min":0.432,"5min":0.38800000000000001,"15min":0.34300000000000003},"max":{"1min":0.90700000000000003,"5min":1.218,"15min":1.218},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.623,"15min":0.84399999999999997},"min":{"1min":0.46200000000000002,"5min":0.39000000000000001,"15min":0.36399999999999999},"max":{"1min":0.877,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.58099999999999996},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.70299999999999996},"min":{"1min":0.42399999999999999,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":1.069,"15min":5.8949999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51400000000000001,"15min":0.58799999999999997},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.221},"max":{"1min":0.73399999999999999,"5min":1.1639999999999999,"15min":5.3579999999999997},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.72899999999999998},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73099999999999998,"5min":1.109,"15min":5.9329999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.69899999999999995},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":1.2310000000000001,"15min":5.9820000000000002},"last":0.625}]},{"osd":2,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.61099999999999999},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.77500000000000002,"5min":1.083,"15min":5.4390000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":1.252,"15min":5.3470000000000004},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.71799999999999997,"5min":1.093,"15min":3.4100000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":1.1839999999999999,"15min":3.456},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.245},"max":{"1min":0.73999999999999999,"5min":1.036,"15min":1.036},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.49199999999999999,"15min":0.503},"min":{"1min":0.28599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71299999999999997,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.5,"15min":0.51500000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68500000000000005,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.77700000000000002,"5min":0.94299999999999995,"15min":1.0489999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.88300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.86099999999999999,"5min":1.133,"15min":13.173999999999999},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":950,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199026412,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.26900000000000002,"15min":0.219},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.79100000000000004},"last":0.442},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.41599999999999998,"5min":0.27400000000000002,"15min":0.26900000000000002},"max":{"1min":0.77700000000000002,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.27900000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.752,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78800000000000003,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":0.72699999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.26700000000000002},"max":{"1min":0.71199999999999997,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75,"5min":0.75,"15min":0.83799999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82599999999999996},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.59299999999999997,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.495},{"interface":"front","average":{"1min":0.434,"5min":0.48099999999999998,"15min":0.50800000000000001},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.65200000000000002,"5min":0.73699999999999999,"15min":0.89300000000000002},"last":0.36699999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66600000000000004,"5min":0.76700000000000002,"15min":0.84999999999999998},"last":0.38},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.879},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.76900000000000002,"15min":0.82099999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.55900000000000005,"15min":0.57199999999999995},"min":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.46300000000000002}]}]}],"pool_statfs":[]}} 2023-10-06T02:55:51.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:55:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.972+0000 7f80f5bb2700 1 Processor -- start 2023-10-06T02:55:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.972+0000 7f80f5bb2700 1 -- start start 2023-10-06T02:55:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80f5bb2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80f01578d0 0x7f80f00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80f5bb2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80f5bb2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f00d07c0 con 0x7f80f006d120 2023-10-06T02:55:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80f5bb2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00cfbb0 con 0x7f80f01578d0 2023-10-06T02:55:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80f5bb2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00cfe90 con 0x7f80f0157ca0 2023-10-06T02:55:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80ef7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80f01578d0 0x7f80f00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80effff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f80f006d120 0x7f80f015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33102/0 (socket says 172.21.15.81:33102) 2023-10-06T02:55:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80effff700 1 -- 172.21.15.81:0/4287226617 learned_addr learned my addr 172.21.15.81:0/4287226617 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80eeffd700 1 --2- 172.21.15.81:0/4287226617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.973+0000 7f80ef7fe700 1 -- 172.21.15.81:0/4287226617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 msgr2=0x7f80f015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80ef7fe700 1 --2- 172.21.15.81:0/4287226617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80ef7fe700 1 -- 172.21.15.81:0/4287226617 >> v1:172.21.15.81:6789/0 conn(0x7f80f006d120 legacy=0x7f80f015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80ee7fc700 1 -- 172.21.15.81:0/4287226617 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35367597 0 0) 0x7f80f00d07c0 con 0x7f80f006d120 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80ef7fe700 1 -- 172.21.15.81:0/4287226617 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00d0170 con 0x7f80f01578d0 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80eeffd700 1 --2- 172.21.15.81:0/4287226617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80ef7fe700 1 --2- 172.21.15.81:0/4287226617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f01578d0 0x7f80f00cf4f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009e60 tx=0x7f80e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea799f00039a6a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80ee7fc700 1 -- 172.21.15.81:0/4287226617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000e070 con 0x7f80f01578d0 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80ee7fc700 1 -- 172.21.15.81:0/4287226617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000bc30 con 0x7f80f01578d0 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80ee7fc700 1 -- 172.21.15.81:0/4287226617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0012430 con 0x7f80f01578d0 2023-10-06T02:55:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80f5bb2700 1 -- 172.21.15.81:0/4287226617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f01578d0 msgr2=0x7f80f00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80f5bb2700 1 --2- 172.21.15.81:0/4287226617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f01578d0 0x7f80f00cf4f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009e60 tx=0x7f80e0009780 comp rx=0 tx=0).stop 2023-10-06T02:55:51.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80f5bb2700 1 -- 172.21.15.81:0/4287226617 shutdown_connections 2023-10-06T02:55:51.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80f5bb2700 1 --2- 172.21.15.81:0/4287226617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f01578d0 0x7f80f00cf4f0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80f5bb2700 1 --2- 172.21.15.81:0/4287226617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80f5bb2700 1 -- 172.21.15.81:0/4287226617 >> 172.21.15.81:0/4287226617 conn(0x7f80f006bb90 msgr2=0x7f80f006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80f5bb2700 1 -- 172.21.15.81:0/4287226617 shutdown_connections 2023-10-06T02:55:51.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.974+0000 7f80f5bb2700 1 -- 172.21.15.81:0/4287226617 wait complete. 2023-10-06T02:55:51.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80f5bb2700 1 Processor -- start 2023-10-06T02:55:51.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80f5bb2700 1 -- start start 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80f5bb2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f006d120 0x7f80f00c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80f5bb2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80f01578d0 0x7f80f0154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80f5bb2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80f5bb2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0154a00 con 0x7f80f006d120 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80f5bb2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00c6df0 con 0x7f80f01578d0 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80f5bb2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00b50c0 con 0x7f80f0157ca0 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f006d120 0x7f80f00c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f006d120 0x7f80f00c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32990/0 (socket says 172.21.15.81:32990) 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.976+0000 7f80ef7fe700 1 -- 172.21.15.81:0/3507090423 learned_addr learned my addr 172.21.15.81:0/3507090423 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80effff700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80eeffd700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80f01578d0 0x7f80f0154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80ef7fe700 1 -- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 msgr2=0x7f80f015eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80ef7fe700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80ef7fe700 1 -- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80f01578d0 msgr2=0x7f80f0154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80ef7fe700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80f01578d0 0x7f80f0154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80ef7fe700 1 -- 172.21.15.81:0/3507090423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e0009a20 con 0x7f80f006d120 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80effff700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80eeffd700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80f01578d0 0x7f80f0154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80ef7fe700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f006d120 0x7f80f00c6530 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f80f006fe20 tx=0x7f80e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80d77fe700 1 -- 172.21.15.81:0/3507090423 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0012e50 con 0x7f80f006d120 2023-10-06T02:55:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80d77fe700 1 -- 172.21.15.81:0/3507090423 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e001d630 con 0x7f80f006d120 2023-10-06T02:55:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80d77fe700 1 -- 172.21.15.81:0/3507090423 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e001d9f0 con 0x7f80f006d120 2023-10-06T02:55:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f00c6b10 con 0x7f80f006d120 2023-10-06T02:55:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.977+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f00b4d50 con 0x7f80f006d120 2023-10-06T02:55:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.978+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f0067ac0 con 0x7f80f006d120 2023-10-06T02:55:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.978+0000 7f80d77fe700 1 -- 172.21.15.81:0/3507090423 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80e0024070 con 0x7f80f006d120 2023-10-06T02:55:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.979+0000 7f80d77fe700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f80dc066f30 0x7f80dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.979+0000 7f80d77fe700 1 -- 172.21.15.81:0/3507090423 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f80e0086e30 con 0x7f80f006d120 2023-10-06T02:55:51.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.979+0000 7f80eeffd700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f80dc066f30 0x7f80dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.979+0000 7f80eeffd700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f80dc066f30 0x7f80dc0693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f80f00b2d70 tx=0x7f80e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:51.983+0000 7f80d77fe700 1 -- 172.21.15.81:0/3507090423 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80e0053f40 con 0x7f80f006d120 2023-10-06T02:55:52.053 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-06T02:55:52.052+0000 7fa244f17700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:55:52.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.160+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80f00b48f0 con 0x7f80dc066f30 2023-10-06T02:55:52.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.168+0000 7f80d77fe700 1 -- 172.21.15.81:0/3507090423 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305853 (secure 0 0 0) 0x7f80e400f6b0 con 0x7f80dc066f30 2023-10-06T02:55:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.171+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f80dc066f30 msgr2=0x7f80dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.171+0000 7f80f5bb2700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f80dc066f30 0x7f80dc0693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f80f00b2d70 tx=0x7f80e4008040 comp rx=0 tx=0).stop 2023-10-06T02:55:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.171+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f006d120 msgr2=0x7f80f00c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.171+0000 7f80f5bb2700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f006d120 0x7f80f00c6530 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f80f006fe20 tx=0x7f80e0019000 comp rx=0 tx=0).stop 2023-10-06T02:55:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.172+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 shutdown_connections 2023-10-06T02:55:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.172+0000 7f80f5bb2700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80f0157ca0 0x7f80f015eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.172+0000 7f80f5bb2700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f006d120 0x7f80f00c6530 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.172+0000 7f80f5bb2700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f80dc066f30 0x7f80dc0693e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.172+0000 7f80f5bb2700 1 --2- 172.21.15.81:0/3507090423 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80f01578d0 0x7f80f0154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.172+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 >> 172.21.15.81:0/3507090423 conn(0x7f80f006bb90 msgr2=0x7f80f006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.172+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 shutdown_connections 2023-10-06T02:55:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.172+0000 7f80f5bb2700 1 -- 172.21.15.81:0/3507090423 wait complete. 2023-10-06T02:55:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:55:52.184 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":453,"stamp":"2023-10-06T02:55:51.633281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8763,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553736,"statfs":{"total":1600000000,"available":1591025948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891612"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756623+0000","last_change":"2023-10-06T02:55:47.754821+0000","last_active":"2023-10-06T02:55:47.756623+0000","last_peered":"2023-10-06T02:55:47.756623+0000","last_clean":"2023-10-06T02:55:47.756623+0000","last_became_active":"2023-10-06T02:55:47.754524+0000","last_became_peered":"2023-10-06T02:55:47.754524+0000","last_unstale":"2023-10-06T02:55:47.756623+0000","last_undegraded":"2023-10-06T02:55:47.756623+0000","last_fullsized":"2023-10-06T02:55:47.756623+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:07.094974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.766135+0000","last_change":"2023-10-06T02:55:47.766038+0000","last_active":"2023-10-06T02:55:47.766135+0000","last_peered":"2023-10-06T02:55:47.766135+0000","last_clean":"2023-10-06T02:55:47.766135+0000","last_became_active":"2023-10-06T02:55:47.765725+0000","last_became_peered":"2023-10-06T02:55:47.765725+0000","last_unstale":"2023-10-06T02:55:47.766135+0000","last_undegraded":"2023-10-06T02:55:47.766135+0000","last_fullsized":"2023-10-06T02:55:47.766135+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:59.630289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758448+0000","last_change":"2023-10-06T02:55:47.758366+0000","last_active":"2023-10-06T02:55:47.758448+0000","last_peered":"2023-10-06T02:55:47.758448+0000","last_clean":"2023-10-06T02:55:47.758448+0000","last_became_active":"2023-10-06T02:55:47.758095+0000","last_became_peered":"2023-10-06T02:55:47.758095+0000","last_unstale":"2023-10-06T02:55:47.758448+0000","last_undegraded":"2023-10-06T02:55:47.758448+0000","last_fullsized":"2023-10-06T02:55:47.758448+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:08.289793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767718+0000","last_change":"2023-10-06T02:55:47.767406+0000","last_active":"2023-10-06T02:55:47.767718+0000","last_peered":"2023-10-06T02:55:47.767718+0000","last_clean":"2023-10-06T02:55:47.767718+0000","last_became_active":"2023-10-06T02:55:47.766237+0000","last_became_peered":"2023-10-06T02:55:47.766237+0000","last_unstale":"2023-10-06T02:55:47.767718+0000","last_undegraded":"2023-10-06T02:55:47.767718+0000","last_fullsized":"2023-10-06T02:55:47.767718+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:18.000536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764863+0000","last_change":"2023-10-06T02:55:47.764712+0000","last_active":"2023-10-06T02:55:47.764863+0000","last_peered":"2023-10-06T02:55:47.764863+0000","last_clean":"2023-10-06T02:55:47.764863+0000","last_became_active":"2023-10-06T02:55:47.764381+0000","last_became_peered":"2023-10-06T02:55:47.764381+0000","last_unstale":"2023-10-06T02:55:47.764863+0000","last_undegraded":"2023-10-06T02:55:47.764863+0000","last_fullsized":"2023-10-06T02:55:47.764863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.460517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762120+0000","last_change":"2023-10-06T02:55:47.762061+0000","last_active":"2023-10-06T02:55:47.762120+0000","last_peered":"2023-10-06T02:55:47.762120+0000","last_clean":"2023-10-06T02:55:47.762120+0000","last_became_active":"2023-10-06T02:55:47.761818+0000","last_became_peered":"2023-10-06T02:55:47.761818+0000","last_unstale":"2023-10-06T02:55:47.762120+0000","last_undegraded":"2023-10-06T02:55:47.762120+0000","last_fullsized":"2023-10-06T02:55:47.762120+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:41.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760806+0000","last_change":"2023-10-06T02:55:47.760740+0000","last_active":"2023-10-06T02:55:47.760806+0000","last_peered":"2023-10-06T02:55:47.760806+0000","last_clean":"2023-10-06T02:55:47.760806+0000","last_became_active":"2023-10-06T02:55:47.760501+0000","last_became_peered":"2023-10-06T02:55:47.760501+0000","last_unstale":"2023-10-06T02:55:47.760806+0000","last_undegraded":"2023-10-06T02:55:47.760806+0000","last_fullsized":"2023-10-06T02:55:47.760806+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:37.622527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764002+0000","last_change":"2023-10-06T02:55:47.763908+0000","last_active":"2023-10-06T02:55:47.764002+0000","last_peered":"2023-10-06T02:55:47.764002+0000","last_clean":"2023-10-06T02:55:47.764002+0000","last_became_active":"2023-10-06T02:55:47.763381+0000","last_became_peered":"2023-10-06T02:55:47.763381+0000","last_unstale":"2023-10-06T02:55:47.764002+0000","last_undegraded":"2023-10-06T02:55:47.764002+0000","last_fullsized":"2023-10-06T02:55:47.764002+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:03.066779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762427+0000","last_change":"2023-10-06T02:55:47.762369+0000","last_active":"2023-10-06T02:55:47.762427+0000","last_peered":"2023-10-06T02:55:47.762427+0000","last_clean":"2023-10-06T02:55:47.762427+0000","last_became_active":"2023-10-06T02:55:47.762168+0000","last_became_peered":"2023-10-06T02:55:47.762168+0000","last_unstale":"2023-10-06T02:55:47.762427+0000","last_undegraded":"2023-10-06T02:55:47.762427+0000","last_fullsized":"2023-10-06T02:55:47.762427+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:40.272755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762452+0000","last_change":"2023-10-06T02:55:47.762403+0000","last_active":"2023-10-06T02:55:47.762452+0000","last_peered":"2023-10-06T02:55:47.762452+0000","last_clean":"2023-10-06T02:55:47.762452+0000","last_became_active":"2023-10-06T02:55:47.762028+0000","last_became_peered":"2023-10-06T02:55:47.762028+0000","last_unstale":"2023-10-06T02:55:47.762452+0000","last_undegraded":"2023-10-06T02:55:47.762452+0000","last_fullsized":"2023-10-06T02:55:47.762452+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:42.930827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761854+0000","last_change":"2023-10-06T02:55:47.761505+0000","last_active":"2023-10-06T02:55:47.761854+0000","last_peered":"2023-10-06T02:55:47.761854+0000","last_clean":"2023-10-06T02:55:47.761854+0000","last_became_active":"2023-10-06T02:55:47.761073+0000","last_became_peered":"2023-10-06T02:55:47.761073+0000","last_unstale":"2023-10-06T02:55:47.761854+0000","last_undegraded":"2023-10-06T02:55:47.761854+0000","last_fullsized":"2023-10-06T02:55:47.761854+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:52.326386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767699+0000","last_change":"2023-10-06T02:55:47.767261+0000","last_active":"2023-10-06T02:55:47.767699+0000","last_peered":"2023-10-06T02:55:47.767699+0000","last_clean":"2023-10-06T02:55:47.767699+0000","last_became_active":"2023-10-06T02:55:47.766435+0000","last_became_peered":"2023-10-06T02:55:47.766435+0000","last_unstale":"2023-10-06T02:55:47.767699+0000","last_undegraded":"2023-10-06T02:55:47.767699+0000","last_fullsized":"2023-10-06T02:55:47.767699+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:32.037263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757888+0000","last_change":"2023-10-06T02:55:47.757795+0000","last_active":"2023-10-06T02:55:47.757888+0000","last_peered":"2023-10-06T02:55:47.757888+0000","last_clean":"2023-10-06T02:55:47.757888+0000","last_became_active":"2023-10-06T02:55:47.757530+0000","last_became_peered":"2023-10-06T02:55:47.757530+0000","last_unstale":"2023-10-06T02:55:47.757888+0000","last_undegraded":"2023-10-06T02:55:47.757888+0000","last_fullsized":"2023-10-06T02:55:47.757888+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:03.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767818+0000","last_change":"2023-10-06T02:55:47.767761+0000","last_active":"2023-10-06T02:55:47.767818+0000","last_peered":"2023-10-06T02:55:47.767818+0000","last_clean":"2023-10-06T02:55:47.767818+0000","last_became_active":"2023-10-06T02:55:47.767122+0000","last_became_peered":"2023-10-06T02:55:47.767122+0000","last_unstale":"2023-10-06T02:55:47.767818+0000","last_undegraded":"2023-10-06T02:55:47.767818+0000","last_fullsized":"2023-10-06T02:55:47.767818+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:15.270812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765201+0000","last_change":"2023-10-06T02:55:47.764739+0000","last_active":"2023-10-06T02:55:47.765201+0000","last_peered":"2023-10-06T02:55:47.765201+0000","last_clean":"2023-10-06T02:55:47.765201+0000","last_became_active":"2023-10-06T02:55:47.764407+0000","last_became_peered":"2023-10-06T02:55:47.764407+0000","last_unstale":"2023-10-06T02:55:47.765201+0000","last_undegraded":"2023-10-06T02:55:47.765201+0000","last_fullsized":"2023-10-06T02:55:47.765201+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:03.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764548+0000","last_change":"2023-10-06T02:55:47.763824+0000","last_active":"2023-10-06T02:55:47.764548+0000","last_peered":"2023-10-06T02:55:47.764548+0000","last_clean":"2023-10-06T02:55:47.764548+0000","last_became_active":"2023-10-06T02:55:47.763478+0000","last_became_peered":"2023-10-06T02:55:47.763478+0000","last_unstale":"2023-10-06T02:55:47.764548+0000","last_undegraded":"2023-10-06T02:55:47.764548+0000","last_fullsized":"2023-10-06T02:55:47.764548+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:16.760503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767735+0000","last_change":"2023-10-06T02:55:47.767565+0000","last_active":"2023-10-06T02:55:47.767735+0000","last_peered":"2023-10-06T02:55:47.767735+0000","last_clean":"2023-10-06T02:55:47.767735+0000","last_became_active":"2023-10-06T02:55:47.766677+0000","last_became_peered":"2023-10-06T02:55:47.766677+0000","last_unstale":"2023-10-06T02:55:47.767735+0000","last_undegraded":"2023-10-06T02:55:47.767735+0000","last_fullsized":"2023-10-06T02:55:47.767735+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:16.085353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760761+0000","last_change":"2023-10-06T02:55:47.760645+0000","last_active":"2023-10-06T02:55:47.760761+0000","last_peered":"2023-10-06T02:55:47.760761+0000","last_clean":"2023-10-06T02:55:47.760761+0000","last_became_active":"2023-10-06T02:55:47.760278+0000","last_became_peered":"2023-10-06T02:55:47.760278+0000","last_unstale":"2023-10-06T02:55:47.760761+0000","last_undegraded":"2023-10-06T02:55:47.760761+0000","last_fullsized":"2023-10-06T02:55:47.760761+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:33.684667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765400+0000","last_change":"2023-10-06T02:55:47.765343+0000","last_active":"2023-10-06T02:55:47.765400+0000","last_peered":"2023-10-06T02:55:47.765400+0000","last_clean":"2023-10-06T02:55:47.765400+0000","last_became_active":"2023-10-06T02:55:47.765055+0000","last_became_peered":"2023-10-06T02:55:47.765055+0000","last_unstale":"2023-10-06T02:55:47.765400+0000","last_undegraded":"2023-10-06T02:55:47.765400+0000","last_fullsized":"2023-10-06T02:55:47.765400+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:41.828967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757185+0000","last_change":"2023-10-06T02:55:47.757120+0000","last_active":"2023-10-06T02:55:47.757185+0000","last_peered":"2023-10-06T02:55:47.757185+0000","last_clean":"2023-10-06T02:55:47.757185+0000","last_became_active":"2023-10-06T02:55:47.756699+0000","last_became_peered":"2023-10-06T02:55:47.756699+0000","last_unstale":"2023-10-06T02:55:47.757185+0000","last_undegraded":"2023-10-06T02:55:47.757185+0000","last_fullsized":"2023-10-06T02:55:47.757185+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:35.662949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760728+0000","last_change":"2023-10-06T02:55:47.760509+0000","last_active":"2023-10-06T02:55:47.760728+0000","last_peered":"2023-10-06T02:55:47.760728+0000","last_clean":"2023-10-06T02:55:47.760728+0000","last_became_active":"2023-10-06T02:55:47.759921+0000","last_became_peered":"2023-10-06T02:55:47.759921+0000","last_unstale":"2023-10-06T02:55:47.760728+0000","last_undegraded":"2023-10-06T02:55:47.760728+0000","last_fullsized":"2023-10-06T02:55:47.760728+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:06.299497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758282+0000","last_change":"2023-10-06T02:55:47.758215+0000","last_active":"2023-10-06T02:55:47.758282+0000","last_peered":"2023-10-06T02:55:47.758282+0000","last_clean":"2023-10-06T02:55:47.758282+0000","last_became_active":"2023-10-06T02:55:47.757957+0000","last_became_peered":"2023-10-06T02:55:47.757957+0000","last_unstale":"2023-10-06T02:55:47.758282+0000","last_undegraded":"2023-10-06T02:55:47.758282+0000","last_fullsized":"2023-10-06T02:55:47.758282+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:08.783212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758506+0000","last_change":"2023-10-06T02:55:47.758396+0000","last_active":"2023-10-06T02:55:47.758506+0000","last_peered":"2023-10-06T02:55:47.758506+0000","last_clean":"2023-10-06T02:55:47.758506+0000","last_became_active":"2023-10-06T02:55:47.758095+0000","last_became_peered":"2023-10-06T02:55:47.758095+0000","last_unstale":"2023-10-06T02:55:47.758506+0000","last_undegraded":"2023-10-06T02:55:47.758506+0000","last_fullsized":"2023-10-06T02:55:47.758506+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:50.943508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760722+0000","last_change":"2023-10-06T02:55:47.759915+0000","last_active":"2023-10-06T02:55:47.760722+0000","last_peered":"2023-10-06T02:55:47.760722+0000","last_clean":"2023-10-06T02:55:47.760722+0000","last_became_active":"2023-10-06T02:55:47.759684+0000","last_became_peered":"2023-10-06T02:55:47.759684+0000","last_unstale":"2023-10-06T02:55:47.760722+0000","last_undegraded":"2023-10-06T02:55:47.760722+0000","last_fullsized":"2023-10-06T02:55:47.760722+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:47.555683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756648+0000","last_change":"2023-10-06T02:55:47.755929+0000","last_active":"2023-10-06T02:55:47.756648+0000","last_peered":"2023-10-06T02:55:47.756648+0000","last_clean":"2023-10-06T02:55:47.756648+0000","last_became_active":"2023-10-06T02:55:47.755651+0000","last_became_peered":"2023-10-06T02:55:47.755651+0000","last_unstale":"2023-10-06T02:55:47.756648+0000","last_undegraded":"2023-10-06T02:55:47.756648+0000","last_fullsized":"2023-10-06T02:55:47.756648+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:10.616272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757037+0000","last_change":"2023-10-06T02:55:47.756974+0000","last_active":"2023-10-06T02:55:47.757037+0000","last_peered":"2023-10-06T02:55:47.757037+0000","last_clean":"2023-10-06T02:55:47.757037+0000","last_became_active":"2023-10-06T02:55:47.756757+0000","last_became_peered":"2023-10-06T02:55:47.756757+0000","last_unstale":"2023-10-06T02:55:47.757037+0000","last_undegraded":"2023-10-06T02:55:47.757037+0000","last_fullsized":"2023-10-06T02:55:47.757037+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:03.066779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761677+0000","last_change":"2023-10-06T02:55:47.761597+0000","last_active":"2023-10-06T02:55:47.761677+0000","last_peered":"2023-10-06T02:55:47.761677+0000","last_clean":"2023-10-06T02:55:47.761677+0000","last_became_active":"2023-10-06T02:55:47.761304+0000","last_became_peered":"2023-10-06T02:55:47.761304+0000","last_unstale":"2023-10-06T02:55:47.761677+0000","last_undegraded":"2023-10-06T02:55:47.761677+0000","last_fullsized":"2023-10-06T02:55:47.761677+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:03.970960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760740+0000","last_change":"2023-10-06T02:55:47.760508+0000","last_active":"2023-10-06T02:55:47.760740+0000","last_peered":"2023-10-06T02:55:47.760740+0000","last_clean":"2023-10-06T02:55:47.760740+0000","last_became_active":"2023-10-06T02:55:47.759980+0000","last_became_peered":"2023-10-06T02:55:47.759980+0000","last_unstale":"2023-10-06T02:55:47.760740+0000","last_undegraded":"2023-10-06T02:55:47.760740+0000","last_fullsized":"2023-10-06T02:55:47.760740+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:50.650843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.763985+0000","last_change":"2023-10-06T02:55:47.763793+0000","last_active":"2023-10-06T02:55:47.763985+0000","last_peered":"2023-10-06T02:55:47.763985+0000","last_clean":"2023-10-06T02:55:47.763985+0000","last_became_active":"2023-10-06T02:55:47.763072+0000","last_became_peered":"2023-10-06T02:55:47.763072+0000","last_unstale":"2023-10-06T02:55:47.763985+0000","last_undegraded":"2023-10-06T02:55:47.763985+0000","last_fullsized":"2023-10-06T02:55:47.763985+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:03.115704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.763965+0000","last_change":"2023-10-06T02:55:47.763909+0000","last_active":"2023-10-06T02:55:47.763965+0000","last_peered":"2023-10-06T02:55:47.763965+0000","last_clean":"2023-10-06T02:55:47.763965+0000","last_became_active":"2023-10-06T02:55:47.763688+0000","last_became_peered":"2023-10-06T02:55:47.763688+0000","last_unstale":"2023-10-06T02:55:47.763965+0000","last_undegraded":"2023-10-06T02:55:47.763965+0000","last_fullsized":"2023-10-06T02:55:47.763965+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:51.264200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764529+0000","last_change":"2023-10-06T02:55:47.763684+0000","last_active":"2023-10-06T02:55:47.764529+0000","last_peered":"2023-10-06T02:55:47.764529+0000","last_clean":"2023-10-06T02:55:47.764529+0000","last_became_active":"2023-10-06T02:55:47.763190+0000","last_became_peered":"2023-10-06T02:55:47.763190+0000","last_unstale":"2023-10-06T02:55:47.764529+0000","last_undegraded":"2023-10-06T02:55:47.764529+0000","last_fullsized":"2023-10-06T02:55:47.764529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:47.139074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755723+0000","last_change":"2023-10-06T02:55:47.755637+0000","last_active":"2023-10-06T02:55:47.755723+0000","last_peered":"2023-10-06T02:55:47.755723+0000","last_clean":"2023-10-06T02:55:47.755723+0000","last_became_active":"2023-10-06T02:55:47.755343+0000","last_became_peered":"2023-10-06T02:55:47.755343+0000","last_unstale":"2023-10-06T02:55:47.755723+0000","last_undegraded":"2023-10-06T02:55:47.755723+0000","last_fullsized":"2023-10-06T02:55:47.755723+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:59.630289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757788+0000","last_change":"2023-10-06T02:55:47.757720+0000","last_active":"2023-10-06T02:55:47.757788+0000","last_peered":"2023-10-06T02:55:47.757788+0000","last_clean":"2023-10-06T02:55:47.757788+0000","last_became_active":"2023-10-06T02:55:47.757442+0000","last_became_peered":"2023-10-06T02:55:47.757442+0000","last_unstale":"2023-10-06T02:55:47.757788+0000","last_undegraded":"2023-10-06T02:55:47.757788+0000","last_fullsized":"2023-10-06T02:55:47.757788+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:05.256642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"164'4","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.774018+0000","last_change":"2023-10-06T02:55:46.752934+0000","last_active":"2023-10-06T02:55:47.774018+0000","last_peered":"2023-10-06T02:55:47.774018+0000","last_clean":"2023-10-06T02:55:47.774018+0000","last_became_active":"2023-10-06T02:55:46.752711+0000","last_became_peered":"2023-10-06T02:55:46.752711+0000","last_unstale":"2023-10-06T02:55:47.774018+0000","last_undegraded":"2023-10-06T02:55:47.774018+0000","last_fullsized":"2023-10-06T02:55:47.774018+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:09.611757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765185+0000","last_change":"2023-10-06T02:55:47.764603+0000","last_active":"2023-10-06T02:55:47.765185+0000","last_peered":"2023-10-06T02:55:47.765185+0000","last_clean":"2023-10-06T02:55:47.765185+0000","last_became_active":"2023-10-06T02:55:47.764143+0000","last_became_peered":"2023-10-06T02:55:47.764143+0000","last_unstale":"2023-10-06T02:55:47.765185+0000","last_undegraded":"2023-10-06T02:55:47.765185+0000","last_fullsized":"2023-10-06T02:55:47.765185+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:15.410289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.772457+0000","last_change":"2023-10-06T02:55:46.761386+0000","last_active":"2023-10-06T02:55:47.772457+0000","last_peered":"2023-10-06T02:55:47.772457+0000","last_clean":"2023-10-06T02:55:47.772457+0000","last_became_active":"2023-10-06T02:55:46.761131+0000","last_became_peered":"2023-10-06T02:55:46.761131+0000","last_unstale":"2023-10-06T02:55:47.772457+0000","last_undegraded":"2023-10-06T02:55:47.772457+0000","last_fullsized":"2023-10-06T02:55:47.772457+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:14.405774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.768039+0000","last_change":"2023-10-06T02:55:47.767959+0000","last_active":"2023-10-06T02:55:47.768039+0000","last_peered":"2023-10-06T02:55:47.768039+0000","last_clean":"2023-10-06T02:55:47.768039+0000","last_became_active":"2023-10-06T02:55:47.767315+0000","last_became_peered":"2023-10-06T02:55:47.767315+0000","last_unstale":"2023-10-06T02:55:47.768039+0000","last_undegraded":"2023-10-06T02:55:47.768039+0000","last_fullsized":"2023-10-06T02:55:47.768039+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:08.783212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.772602+0000","last_change":"2023-10-06T02:55:46.761120+0000","last_active":"2023-10-06T02:55:47.772602+0000","last_peered":"2023-10-06T02:55:47.772602+0000","last_clean":"2023-10-06T02:55:47.772602+0000","last_became_active":"2023-10-06T02:55:46.760888+0000","last_became_peered":"2023-10-06T02:55:46.760888+0000","last_unstale":"2023-10-06T02:55:47.772602+0000","last_undegraded":"2023-10-06T02:55:47.772602+0000","last_fullsized":"2023-10-06T02:55:47.772602+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:49.938993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760173+0000","last_change":"2023-10-06T02:55:47.759978+0000","last_active":"2023-10-06T02:55:47.760173+0000","last_peered":"2023-10-06T02:55:47.760173+0000","last_clean":"2023-10-06T02:55:47.760173+0000","last_became_active":"2023-10-06T02:55:47.759754+0000","last_became_peered":"2023-10-06T02:55:47.759754+0000","last_unstale":"2023-10-06T02:55:47.760173+0000","last_undegraded":"2023-10-06T02:55:47.760173+0000","last_fullsized":"2023-10-06T02:55:47.760173+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:18.924235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.772000+0000","last_change":"2023-10-06T02:55:46.754866+0000","last_active":"2023-10-06T02:55:47.772000+0000","last_peered":"2023-10-06T02:55:47.772000+0000","last_clean":"2023-10-06T02:55:47.772000+0000","last_became_active":"2023-10-06T02:55:46.754602+0000","last_became_peered":"2023-10-06T02:55:46.754602+0000","last_unstale":"2023-10-06T02:55:47.772000+0000","last_undegraded":"2023-10-06T02:55:47.772000+0000","last_fullsized":"2023-10-06T02:55:47.772000+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:42.082817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756018+0000","last_change":"2023-10-06T02:55:47.755304+0000","last_active":"2023-10-06T02:55:47.756018+0000","last_peered":"2023-10-06T02:55:47.756018+0000","last_clean":"2023-10-06T02:55:47.756018+0000","last_became_active":"2023-10-06T02:55:47.755089+0000","last_became_peered":"2023-10-06T02:55:47.755089+0000","last_unstale":"2023-10-06T02:55:47.756018+0000","last_undegraded":"2023-10-06T02:55:47.756018+0000","last_fullsized":"2023-10-06T02:55:47.756018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:43.670452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771445+0000","last_change":"2023-10-06T02:55:46.763630+0000","last_active":"2023-10-06T02:55:47.771445+0000","last_peered":"2023-10-06T02:55:47.771445+0000","last_clean":"2023-10-06T02:55:47.771445+0000","last_became_active":"2023-10-06T02:55:46.762728+0000","last_became_peered":"2023-10-06T02:55:46.762728+0000","last_unstale":"2023-10-06T02:55:47.771445+0000","last_undegraded":"2023-10-06T02:55:47.771445+0000","last_fullsized":"2023-10-06T02:55:47.771445+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:24.388086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764962+0000","last_change":"2023-10-06T02:55:47.763955+0000","last_active":"2023-10-06T02:55:47.764962+0000","last_peered":"2023-10-06T02:55:47.764962+0000","last_clean":"2023-10-06T02:55:47.764962+0000","last_became_active":"2023-10-06T02:55:47.763558+0000","last_became_peered":"2023-10-06T02:55:47.763558+0000","last_unstale":"2023-10-06T02:55:47.764962+0000","last_undegraded":"2023-10-06T02:55:47.764962+0000","last_fullsized":"2023-10-06T02:55:47.764962+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:10.747734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.773208+0000","last_change":"2023-10-06T02:55:46.754232+0000","last_active":"2023-10-06T02:55:47.773208+0000","last_peered":"2023-10-06T02:55:47.773208+0000","last_clean":"2023-10-06T02:55:47.773208+0000","last_became_active":"2023-10-06T02:55:46.753938+0000","last_became_peered":"2023-10-06T02:55:46.753938+0000","last_unstale":"2023-10-06T02:55:47.773208+0000","last_undegraded":"2023-10-06T02:55:47.773208+0000","last_fullsized":"2023-10-06T02:55:47.773208+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:15.080838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755952+0000","last_change":"2023-10-06T02:55:47.755652+0000","last_active":"2023-10-06T02:55:47.755952+0000","last_peered":"2023-10-06T02:55:47.755952+0000","last_clean":"2023-10-06T02:55:47.755952+0000","last_became_active":"2023-10-06T02:55:47.755414+0000","last_became_peered":"2023-10-06T02:55:47.755414+0000","last_unstale":"2023-10-06T02:55:47.755952+0000","last_undegraded":"2023-10-06T02:55:47.755952+0000","last_fullsized":"2023-10-06T02:55:47.755952+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:07.094974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.752032+0000","last_change":"2023-10-06T02:55:46.758617+0000","last_active":"2023-10-06T02:55:47.752032+0000","last_peered":"2023-10-06T02:55:47.752032+0000","last_clean":"2023-10-06T02:55:47.752032+0000","last_became_active":"2023-10-06T02:55:46.758339+0000","last_became_peered":"2023-10-06T02:55:46.758339+0000","last_unstale":"2023-10-06T02:55:47.752032+0000","last_undegraded":"2023-10-06T02:55:47.752032+0000","last_fullsized":"2023-10-06T02:55:47.752032+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:19.641889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757017+0000","last_change":"2023-10-06T02:55:47.756935+0000","last_active":"2023-10-06T02:55:47.757017+0000","last_peered":"2023-10-06T02:55:47.757017+0000","last_clean":"2023-10-06T02:55:47.757017+0000","last_became_active":"2023-10-06T02:55:47.756638+0000","last_became_peered":"2023-10-06T02:55:47.756638+0000","last_unstale":"2023-10-06T02:55:47.757017+0000","last_undegraded":"2023-10-06T02:55:47.757017+0000","last_fullsized":"2023-10-06T02:55:47.757017+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:50.943508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760138+0000","last_change":"2023-10-06T02:55:46.760086+0000","last_active":"2023-10-06T02:55:47.760138+0000","last_peered":"2023-10-06T02:55:47.760138+0000","last_clean":"2023-10-06T02:55:47.760138+0000","last_became_active":"2023-10-06T02:55:46.759410+0000","last_became_peered":"2023-10-06T02:55:46.759410+0000","last_unstale":"2023-10-06T02:55:47.760138+0000","last_undegraded":"2023-10-06T02:55:47.760138+0000","last_fullsized":"2023-10-06T02:55:47.760138+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:07.778697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760562+0000","last_change":"2023-10-06T02:55:47.760379+0000","last_active":"2023-10-06T02:55:47.760562+0000","last_peered":"2023-10-06T02:55:47.760562+0000","last_clean":"2023-10-06T02:55:47.760562+0000","last_became_active":"2023-10-06T02:55:47.760075+0000","last_became_peered":"2023-10-06T02:55:47.760075+0000","last_unstale":"2023-10-06T02:55:47.760562+0000","last_undegraded":"2023-10-06T02:55:47.760562+0000","last_fullsized":"2023-10-06T02:55:47.760562+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:35.547639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.772875+0000","last_change":"2023-10-06T02:55:46.761959+0000","last_active":"2023-10-06T02:55:47.772875+0000","last_peered":"2023-10-06T02:55:47.772875+0000","last_clean":"2023-10-06T02:55:47.772875+0000","last_became_active":"2023-10-06T02:55:46.761642+0000","last_became_peered":"2023-10-06T02:55:46.761642+0000","last_unstale":"2023-10-06T02:55:47.772875+0000","last_undegraded":"2023-10-06T02:55:47.772875+0000","last_fullsized":"2023-10-06T02:55:47.772875+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:49.350846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764487+0000","last_change":"2023-10-06T02:55:47.764347+0000","last_active":"2023-10-06T02:55:47.764487+0000","last_peered":"2023-10-06T02:55:47.764487+0000","last_clean":"2023-10-06T02:55:47.764487+0000","last_became_active":"2023-10-06T02:55:47.763937+0000","last_became_peered":"2023-10-06T02:55:47.763937+0000","last_unstale":"2023-10-06T02:55:47.764487+0000","last_undegraded":"2023-10-06T02:55:47.764487+0000","last_fullsized":"2023-10-06T02:55:47.764487+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:42.930827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771886+0000","last_change":"2023-10-06T02:55:46.752669+0000","last_active":"2023-10-06T02:55:47.771886+0000","last_peered":"2023-10-06T02:55:47.771886+0000","last_clean":"2023-10-06T02:55:47.771886+0000","last_became_active":"2023-10-06T02:55:46.752430+0000","last_became_peered":"2023-10-06T02:55:46.752430+0000","last_unstale":"2023-10-06T02:55:47.771886+0000","last_undegraded":"2023-10-06T02:55:47.771886+0000","last_fullsized":"2023-10-06T02:55:47.771886+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:18.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.763155+0000","last_change":"2023-10-06T02:55:47.763038+0000","last_active":"2023-10-06T02:55:47.763155+0000","last_peered":"2023-10-06T02:55:47.763155+0000","last_clean":"2023-10-06T02:55:47.763155+0000","last_became_active":"2023-10-06T02:55:47.762514+0000","last_became_peered":"2023-10-06T02:55:47.762514+0000","last_unstale":"2023-10-06T02:55:47.763155+0000","last_undegraded":"2023-10-06T02:55:47.763155+0000","last_fullsized":"2023-10-06T02:55:47.763155+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:19.763007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.773227+0000","last_change":"2023-10-06T02:55:46.756267+0000","last_active":"2023-10-06T02:55:47.773227+0000","last_peered":"2023-10-06T02:55:47.773227+0000","last_clean":"2023-10-06T02:55:47.773227+0000","last_became_active":"2023-10-06T02:55:46.756047+0000","last_became_peered":"2023-10-06T02:55:46.756047+0000","last_unstale":"2023-10-06T02:55:47.773227+0000","last_undegraded":"2023-10-06T02:55:47.773227+0000","last_fullsized":"2023-10-06T02:55:47.773227+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:16.996021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765566+0000","last_change":"2023-10-06T02:55:47.765500+0000","last_active":"2023-10-06T02:55:47.765566+0000","last_peered":"2023-10-06T02:55:47.765566+0000","last_clean":"2023-10-06T02:55:47.765566+0000","last_became_active":"2023-10-06T02:55:47.765272+0000","last_became_peered":"2023-10-06T02:55:47.765272+0000","last_unstale":"2023-10-06T02:55:47.765566+0000","last_undegraded":"2023-10-06T02:55:47.765566+0000","last_fullsized":"2023-10-06T02:55:47.765566+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:46.642017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764702+0000","last_change":"2023-10-06T02:55:46.759855+0000","last_active":"2023-10-06T02:55:47.764702+0000","last_peered":"2023-10-06T02:55:47.764702+0000","last_clean":"2023-10-06T02:55:47.764702+0000","last_became_active":"2023-10-06T02:55:46.759256+0000","last_became_peered":"2023-10-06T02:55:46.759256+0000","last_unstale":"2023-10-06T02:55:47.764702+0000","last_undegraded":"2023-10-06T02:55:47.764702+0000","last_fullsized":"2023-10-06T02:55:47.764702+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:54.396091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764285+0000","last_change":"2023-10-06T02:55:47.764182+0000","last_active":"2023-10-06T02:55:47.764285+0000","last_peered":"2023-10-06T02:55:47.764285+0000","last_clean":"2023-10-06T02:55:47.764285+0000","last_became_active":"2023-10-06T02:55:47.763573+0000","last_became_peered":"2023-10-06T02:55:47.763573+0000","last_unstale":"2023-10-06T02:55:47.764285+0000","last_undegraded":"2023-10-06T02:55:47.764285+0000","last_fullsized":"2023-10-06T02:55:47.764285+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:06.807033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771805+0000","last_change":"2023-10-06T02:55:46.756165+0000","last_active":"2023-10-06T02:55:47.771805+0000","last_peered":"2023-10-06T02:55:47.771805+0000","last_clean":"2023-10-06T02:55:47.771805+0000","last_became_active":"2023-10-06T02:55:46.755944+0000","last_became_peered":"2023-10-06T02:55:46.755944+0000","last_unstale":"2023-10-06T02:55:47.771805+0000","last_undegraded":"2023-10-06T02:55:47.771805+0000","last_fullsized":"2023-10-06T02:55:47.771805+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:39.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758466+0000","last_change":"2023-10-06T02:55:47.758396+0000","last_active":"2023-10-06T02:55:47.758466+0000","last_peered":"2023-10-06T02:55:47.758466+0000","last_clean":"2023-10-06T02:55:47.758466+0000","last_became_active":"2023-10-06T02:55:47.758173+0000","last_became_peered":"2023-10-06T02:55:47.758173+0000","last_unstale":"2023-10-06T02:55:47.758466+0000","last_undegraded":"2023-10-06T02:55:47.758466+0000","last_fullsized":"2023-10-06T02:55:47.758466+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:50.943508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755103+0000","last_change":"2023-10-06T02:55:46.756712+0000","last_active":"2023-10-06T02:55:47.755103+0000","last_peered":"2023-10-06T02:55:47.755103+0000","last_clean":"2023-10-06T02:55:47.755103+0000","last_became_active":"2023-10-06T02:55:46.756094+0000","last_became_peered":"2023-10-06T02:55:46.756094+0000","last_unstale":"2023-10-06T02:55:47.755103+0000","last_undegraded":"2023-10-06T02:55:47.755103+0000","last_fullsized":"2023-10-06T02:55:47.755103+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:48.065144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761305+0000","last_change":"2023-10-06T02:55:47.761226+0000","last_active":"2023-10-06T02:55:47.761305+0000","last_peered":"2023-10-06T02:55:47.761305+0000","last_clean":"2023-10-06T02:55:47.761305+0000","last_became_active":"2023-10-06T02:55:47.760996+0000","last_became_peered":"2023-10-06T02:55:47.760996+0000","last_unstale":"2023-10-06T02:55:47.761305+0000","last_undegraded":"2023-10-06T02:55:47.761305+0000","last_fullsized":"2023-10-06T02:55:47.761305+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:02.645706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.751552+0000","last_change":"2023-10-06T02:55:46.754310+0000","last_active":"2023-10-06T02:55:47.751552+0000","last_peered":"2023-10-06T02:55:47.751552+0000","last_clean":"2023-10-06T02:55:47.751552+0000","last_became_active":"2023-10-06T02:55:46.753906+0000","last_became_peered":"2023-10-06T02:55:46.753906+0000","last_unstale":"2023-10-06T02:55:47.751552+0000","last_undegraded":"2023-10-06T02:55:47.751552+0000","last_fullsized":"2023-10-06T02:55:47.751552+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.631138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765630+0000","last_change":"2023-10-06T02:55:47.765572+0000","last_active":"2023-10-06T02:55:47.765630+0000","last_peered":"2023-10-06T02:55:47.765630+0000","last_clean":"2023-10-06T02:55:47.765630+0000","last_became_active":"2023-10-06T02:55:47.765351+0000","last_became_peered":"2023-10-06T02:55:47.765351+0000","last_unstale":"2023-10-06T02:55:47.765630+0000","last_undegraded":"2023-10-06T02:55:47.765630+0000","last_fullsized":"2023-10-06T02:55:47.765630+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:03.066779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.753335+0000","last_change":"2023-10-06T02:55:46.760374+0000","last_active":"2023-10-06T02:55:47.753335+0000","last_peered":"2023-10-06T02:55:47.753335+0000","last_clean":"2023-10-06T02:55:47.753335+0000","last_became_active":"2023-10-06T02:55:46.758512+0000","last_became_peered":"2023-10-06T02:55:46.758512+0000","last_unstale":"2023-10-06T02:55:47.753335+0000","last_undegraded":"2023-10-06T02:55:47.753335+0000","last_fullsized":"2023-10-06T02:55:47.753335+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:46.184921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761662+0000","last_change":"2023-10-06T02:55:47.761105+0000","last_active":"2023-10-06T02:55:47.761662+0000","last_peered":"2023-10-06T02:55:47.761662+0000","last_clean":"2023-10-06T02:55:47.761662+0000","last_became_active":"2023-10-06T02:55:47.760741+0000","last_became_peered":"2023-10-06T02:55:47.760741+0000","last_unstale":"2023-10-06T02:55:47.761662+0000","last_undegraded":"2023-10-06T02:55:47.761662+0000","last_fullsized":"2023-10-06T02:55:47.761662+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:41:39.828918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771131+0000","last_change":"2023-10-06T02:55:46.760001+0000","last_active":"2023-10-06T02:55:47.771131+0000","last_peered":"2023-10-06T02:55:47.771131+0000","last_clean":"2023-10-06T02:55:47.771131+0000","last_became_active":"2023-10-06T02:55:46.759615+0000","last_became_peered":"2023-10-06T02:55:46.759615+0000","last_unstale":"2023-10-06T02:55:47.771131+0000","last_undegraded":"2023-10-06T02:55:47.771131+0000","last_fullsized":"2023-10-06T02:55:47.771131+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:47.877544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.767754+0000","last_change":"2023-10-06T02:55:47.767591+0000","last_active":"2023-10-06T02:55:47.767754+0000","last_peered":"2023-10-06T02:55:47.767754+0000","last_clean":"2023-10-06T02:55:47.767754+0000","last_became_active":"2023-10-06T02:55:47.766631+0000","last_became_peered":"2023-10-06T02:55:47.766631+0000","last_unstale":"2023-10-06T02:55:47.767754+0000","last_undegraded":"2023-10-06T02:55:47.767754+0000","last_fullsized":"2023-10-06T02:55:47.767754+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:19.763007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.751948+0000","last_change":"2023-10-06T02:55:46.760189+0000","last_active":"2023-10-06T02:55:47.751948+0000","last_peered":"2023-10-06T02:55:47.751948+0000","last_clean":"2023-10-06T02:55:47.751948+0000","last_became_active":"2023-10-06T02:55:46.759507+0000","last_became_peered":"2023-10-06T02:55:46.759507+0000","last_unstale":"2023-10-06T02:55:47.751948+0000","last_undegraded":"2023-10-06T02:55:47.751948+0000","last_fullsized":"2023-10-06T02:55:47.751948+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:48.065144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756604+0000","last_change":"2023-10-06T02:55:47.754755+0000","last_active":"2023-10-06T02:55:47.756604+0000","last_peered":"2023-10-06T02:55:47.756604+0000","last_clean":"2023-10-06T02:55:47.756604+0000","last_became_active":"2023-10-06T02:55:47.754445+0000","last_became_peered":"2023-10-06T02:55:47.754445+0000","last_unstale":"2023-10-06T02:55:47.756604+0000","last_undegraded":"2023-10-06T02:55:47.756604+0000","last_fullsized":"2023-10-06T02:55:47.756604+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:19.726327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754359+0000","last_change":"2023-10-06T02:55:46.754796+0000","last_active":"2023-10-06T02:55:47.754359+0000","last_peered":"2023-10-06T02:55:47.754359+0000","last_clean":"2023-10-06T02:55:47.754359+0000","last_became_active":"2023-10-06T02:55:46.754605+0000","last_became_peered":"2023-10-06T02:55:46.754605+0000","last_unstale":"2023-10-06T02:55:47.754359+0000","last_undegraded":"2023-10-06T02:55:47.754359+0000","last_fullsized":"2023-10-06T02:55:47.754359+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:24.388086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.766819+0000","last_change":"2023-10-06T02:55:47.766734+0000","last_active":"2023-10-06T02:55:47.766819+0000","last_peered":"2023-10-06T02:55:47.766819+0000","last_clean":"2023-10-06T02:55:47.766819+0000","last_became_active":"2023-10-06T02:55:47.766481+0000","last_became_peered":"2023-10-06T02:55:47.766481+0000","last_unstale":"2023-10-06T02:55:47.766819+0000","last_undegraded":"2023-10-06T02:55:47.766819+0000","last_fullsized":"2023-10-06T02:55:47.766819+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:08.289793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.759960+0000","last_change":"2023-10-06T02:55:46.762763+0000","last_active":"2023-10-06T02:55:47.759960+0000","last_peered":"2023-10-06T02:55:47.759960+0000","last_clean":"2023-10-06T02:55:47.759960+0000","last_became_active":"2023-10-06T02:55:46.762538+0000","last_became_peered":"2023-10-06T02:55:46.762538+0000","last_unstale":"2023-10-06T02:55:47.759960+0000","last_undegraded":"2023-10-06T02:55:47.759960+0000","last_fullsized":"2023-10-06T02:55:47.759960+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:15:45.637502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755741+0000","last_change":"2023-10-06T02:55:47.755642+0000","last_active":"2023-10-06T02:55:47.755741+0000","last_peered":"2023-10-06T02:55:47.755741+0000","last_clean":"2023-10-06T02:55:47.755741+0000","last_became_active":"2023-10-06T02:55:47.755400+0000","last_became_peered":"2023-10-06T02:55:47.755400+0000","last_unstale":"2023-10-06T02:55:47.755741+0000","last_undegraded":"2023-10-06T02:55:47.755741+0000","last_fullsized":"2023-10-06T02:55:47.755741+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:37.622527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.753441+0000","last_change":"2023-10-06T02:55:46.760918+0000","last_active":"2023-10-06T02:55:47.753441+0000","last_peered":"2023-10-06T02:55:47.753441+0000","last_clean":"2023-10-06T02:55:47.753441+0000","last_became_active":"2023-10-06T02:55:46.760675+0000","last_became_peered":"2023-10-06T02:55:46.760675+0000","last_unstale":"2023-10-06T02:55:47.753441+0000","last_undegraded":"2023-10-06T02:55:47.753441+0000","last_fullsized":"2023-10-06T02:55:47.753441+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:44.450925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765937+0000","last_change":"2023-10-06T02:55:47.765863+0000","last_active":"2023-10-06T02:55:47.765937+0000","last_peered":"2023-10-06T02:55:47.765937+0000","last_clean":"2023-10-06T02:55:47.765937+0000","last_became_active":"2023-10-06T02:55:47.765661+0000","last_became_peered":"2023-10-06T02:55:47.765661+0000","last_unstale":"2023-10-06T02:55:47.765937+0000","last_undegraded":"2023-10-06T02:55:47.765937+0000","last_fullsized":"2023-10-06T02:55:47.765937+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:25.924382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754006+0000","last_change":"2023-10-06T02:55:46.759852+0000","last_active":"2023-10-06T02:55:47.754006+0000","last_peered":"2023-10-06T02:55:47.754006+0000","last_clean":"2023-10-06T02:55:47.754006+0000","last_became_active":"2023-10-06T02:55:46.759638+0000","last_became_peered":"2023-10-06T02:55:46.759638+0000","last_unstale":"2023-10-06T02:55:47.754006+0000","last_undegraded":"2023-10-06T02:55:47.754006+0000","last_fullsized":"2023-10-06T02:55:47.754006+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:09.060084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.759333+0000","last_change":"2023-10-06T02:55:47.759274+0000","last_active":"2023-10-06T02:55:47.759333+0000","last_peered":"2023-10-06T02:55:47.759333+0000","last_clean":"2023-10-06T02:55:47.759333+0000","last_became_active":"2023-10-06T02:55:47.759060+0000","last_became_peered":"2023-10-06T02:55:47.759060+0000","last_unstale":"2023-10-06T02:55:47.759333+0000","last_undegraded":"2023-10-06T02:55:47.759333+0000","last_fullsized":"2023-10-06T02:55:47.759333+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:01.194042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.752034+0000","last_change":"2023-10-06T02:55:46.760014+0000","last_active":"2023-10-06T02:55:47.752034+0000","last_peered":"2023-10-06T02:55:47.752034+0000","last_clean":"2023-10-06T02:55:47.752034+0000","last_became_active":"2023-10-06T02:55:46.759220+0000","last_became_peered":"2023-10-06T02:55:46.759220+0000","last_unstale":"2023-10-06T02:55:47.752034+0000","last_undegraded":"2023-10-06T02:55:47.752034+0000","last_fullsized":"2023-10-06T02:55:47.752034+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:17.719569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.763524+0000","last_change":"2023-10-06T02:55:47.763081+0000","last_active":"2023-10-06T02:55:47.763524+0000","last_peered":"2023-10-06T02:55:47.763524+0000","last_clean":"2023-10-06T02:55:47.763524+0000","last_became_active":"2023-10-06T02:55:47.762774+0000","last_became_peered":"2023-10-06T02:55:47.762774+0000","last_unstale":"2023-10-06T02:55:47.763524+0000","last_undegraded":"2023-10-06T02:55:47.763524+0000","last_fullsized":"2023-10-06T02:55:47.763524+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:15.410289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756483+0000","last_change":"2023-10-06T02:55:46.759925+0000","last_active":"2023-10-06T02:55:47.756483+0000","last_peered":"2023-10-06T02:55:47.756483+0000","last_clean":"2023-10-06T02:55:47.756483+0000","last_became_active":"2023-10-06T02:55:46.759677+0000","last_became_peered":"2023-10-06T02:55:46.759677+0000","last_unstale":"2023-10-06T02:55:47.756483+0000","last_undegraded":"2023-10-06T02:55:47.756483+0000","last_fullsized":"2023-10-06T02:55:47.756483+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:01.884150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764094+0000","last_change":"2023-10-06T02:55:47.764038+0000","last_active":"2023-10-06T02:55:47.764094+0000","last_peered":"2023-10-06T02:55:47.764094+0000","last_clean":"2023-10-06T02:55:47.764094+0000","last_became_active":"2023-10-06T02:55:47.763687+0000","last_became_peered":"2023-10-06T02:55:47.763687+0000","last_unstale":"2023-10-06T02:55:47.764094+0000","last_undegraded":"2023-10-06T02:55:47.764094+0000","last_fullsized":"2023-10-06T02:55:47.764094+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:07.094974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771030+0000","last_change":"2023-10-06T02:55:46.753697+0000","last_active":"2023-10-06T02:55:47.771030+0000","last_peered":"2023-10-06T02:55:47.771030+0000","last_clean":"2023-10-06T02:55:47.771030+0000","last_became_active":"2023-10-06T02:55:46.753559+0000","last_became_peered":"2023-10-06T02:55:46.753559+0000","last_unstale":"2023-10-06T02:55:47.771030+0000","last_undegraded":"2023-10-06T02:55:47.771030+0000","last_fullsized":"2023-10-06T02:55:47.771030+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:36.618012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.755787+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:55:47.755787+0000","last_peered":"2023-10-06T02:55:47.755787+0000","last_clean":"2023-10-06T02:55:47.755787+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:55:47.755787+0000","last_undegraded":"2023-10-06T02:55:47.755787+0000","last_fullsized":"2023-10-06T02:55:47.755787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.759446+0000","last_change":"2023-10-06T02:55:47.759346+0000","last_active":"2023-10-06T02:55:47.759446+0000","last_peered":"2023-10-06T02:55:47.759446+0000","last_clean":"2023-10-06T02:55:47.759446+0000","last_became_active":"2023-10-06T02:55:47.759130+0000","last_became_peered":"2023-10-06T02:55:47.759130+0000","last_unstale":"2023-10-06T02:55:47.759446+0000","last_undegraded":"2023-10-06T02:55:47.759446+0000","last_fullsized":"2023-10-06T02:55:47.759446+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:26.727135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"164'3","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.771163+0000","last_change":"2023-10-06T02:55:46.752714+0000","last_active":"2023-10-06T02:55:47.771163+0000","last_peered":"2023-10-06T02:55:47.771163+0000","last_clean":"2023-10-06T02:55:47.771163+0000","last_became_active":"2023-10-06T02:55:46.752500+0000","last_became_peered":"2023-10-06T02:55:46.752500+0000","last_unstale":"2023-10-06T02:55:47.771163+0000","last_undegraded":"2023-10-06T02:55:47.771163+0000","last_fullsized":"2023-10-06T02:55:47.771163+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.336492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":154,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754233+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:55:47.754233+0000","last_peered":"2023-10-06T02:55:47.754233+0000","last_clean":"2023-10-06T02:55:47.754233+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:55:47.754233+0000","last_undegraded":"2023-10-06T02:55:47.754233+0000","last_fullsized":"2023-10-06T02:55:47.754233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762921+0000","last_change":"2023-10-06T02:55:47.762857+0000","last_active":"2023-10-06T02:55:47.762921+0000","last_peered":"2023-10-06T02:55:47.762921+0000","last_clean":"2023-10-06T02:55:47.762921+0000","last_became_active":"2023-10-06T02:55:47.762655+0000","last_became_peered":"2023-10-06T02:55:47.762655+0000","last_unstale":"2023-10-06T02:55:47.762921+0000","last_undegraded":"2023-10-06T02:55:47.762921+0000","last_fullsized":"2023-10-06T02:55:47.762921+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:17.297806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754146+0000","last_change":"2023-10-06T02:55:46.758349+0000","last_active":"2023-10-06T02:55:47.754146+0000","last_peered":"2023-10-06T02:55:47.754146+0000","last_clean":"2023-10-06T02:55:47.754146+0000","last_became_active":"2023-10-06T02:55:46.758139+0000","last_became_peered":"2023-10-06T02:55:46.758139+0000","last_unstale":"2023-10-06T02:55:47.754146+0000","last_undegraded":"2023-10-06T02:55:47.754146+0000","last_fullsized":"2023-10-06T02:55:47.754146+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:54.396091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":140,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.758467+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:55:47.758467+0000","last_peered":"2023-10-06T02:55:47.758467+0000","last_clean":"2023-10-06T02:55:47.758467+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:55:47.758467+0000","last_undegraded":"2023-10-06T02:55:47.758467+0000","last_fullsized":"2023-10-06T02:55:47.758467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.757541+0000","last_change":"2023-10-06T02:55:47.757473+0000","last_active":"2023-10-06T02:55:47.757541+0000","last_peered":"2023-10-06T02:55:47.757541+0000","last_clean":"2023-10-06T02:55:47.757541+0000","last_became_active":"2023-10-06T02:55:47.757237+0000","last_became_peered":"2023-10-06T02:55:47.757237+0000","last_unstale":"2023-10-06T02:55:47.757541+0000","last_undegraded":"2023-10-06T02:55:47.757541+0000","last_fullsized":"2023-10-06T02:55:47.757541+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:19.726327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"164'6","reported_seq":16,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.773758+0000","last_change":"2023-10-06T02:55:46.754166+0000","last_active":"2023-10-06T02:55:47.773758+0000","last_peered":"2023-10-06T02:55:47.773758+0000","last_clean":"2023-10-06T02:55:47.773758+0000","last_became_active":"2023-10-06T02:55:46.753945+0000","last_became_peered":"2023-10-06T02:55:46.753945+0000","last_unstale":"2023-10-06T02:55:47.773758+0000","last_undegraded":"2023-10-06T02:55:47.773758+0000","last_fullsized":"2023-10-06T02:55:47.773758+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:31.430700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":154,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.753534+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:55:47.753534+0000","last_peered":"2023-10-06T02:55:47.753534+0000","last_clean":"2023-10-06T02:55:47.753534+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:55:47.753534+0000","last_undegraded":"2023-10-06T02:55:47.753534+0000","last_fullsized":"2023-10-06T02:55:47.753534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":290,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756681+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:55:47.756681+0000","last_peered":"2023-10-06T02:55:47.756681+0000","last_clean":"2023-10-06T02:55:47.756681+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:55:47.756681+0000","last_undegraded":"2023-10-06T02:55:47.756681+0000","last_fullsized":"2023-10-06T02:55:47.756681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764018+0000","last_change":"2023-10-06T02:55:47.763935+0000","last_active":"2023-10-06T02:55:47.764018+0000","last_peered":"2023-10-06T02:55:47.764018+0000","last_clean":"2023-10-06T02:55:47.764018+0000","last_became_active":"2023-10-06T02:55:47.763377+0000","last_became_peered":"2023-10-06T02:55:47.763377+0000","last_unstale":"2023-10-06T02:55:47.764018+0000","last_undegraded":"2023-10-06T02:55:47.764018+0000","last_fullsized":"2023-10-06T02:55:47.764018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:02.888665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756855+0000","last_change":"2023-10-06T02:55:46.761705+0000","last_active":"2023-10-06T02:55:47.756855+0000","last_peered":"2023-10-06T02:55:47.756855+0000","last_clean":"2023-10-06T02:55:47.756855+0000","last_became_active":"2023-10-06T02:55:46.761481+0000","last_became_peered":"2023-10-06T02:55:46.761481+0000","last_unstale":"2023-10-06T02:55:47.756855+0000","last_undegraded":"2023-10-06T02:55:47.756855+0000","last_fullsized":"2023-10-06T02:55:47.756855+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:02.111189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756592+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:55:47.756592+0000","last_peered":"2023-10-06T02:55:47.756592+0000","last_clean":"2023-10-06T02:55:47.756592+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:55:47.756592+0000","last_undegraded":"2023-10-06T02:55:47.756592+0000","last_fullsized":"2023-10-06T02:55:47.756592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.765988+0000","last_change":"2023-10-06T02:55:47.765916+0000","last_active":"2023-10-06T02:55:47.765988+0000","last_peered":"2023-10-06T02:55:47.765988+0000","last_clean":"2023-10-06T02:55:47.765988+0000","last_became_active":"2023-10-06T02:55:47.765520+0000","last_became_peered":"2023-10-06T02:55:47.765520+0000","last_unstale":"2023-10-06T02:55:47.765988+0000","last_undegraded":"2023-10-06T02:55:47.765988+0000","last_fullsized":"2023-10-06T02:55:47.765988+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:02.888665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.762860+0000","last_change":"2023-10-06T02:55:46.763791+0000","last_active":"2023-10-06T02:55:47.762860+0000","last_peered":"2023-10-06T02:55:47.762860+0000","last_clean":"2023-10-06T02:55:47.762860+0000","last_became_active":"2023-10-06T02:55:46.763565+0000","last_became_peered":"2023-10-06T02:55:46.763565+0000","last_unstale":"2023-10-06T02:55:47.762860+0000","last_undegraded":"2023-10-06T02:55:47.762860+0000","last_fullsized":"2023-10-06T02:55:47.762860+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:44.041984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":136,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.756765+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:55:47.756765+0000","last_peered":"2023-10-06T02:55:47.756765+0000","last_clean":"2023-10-06T02:55:47.756765+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:55:47.756765+0000","last_undegraded":"2023-10-06T02:55:47.756765+0000","last_fullsized":"2023-10-06T02:55:47.756765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.760747+0000","last_change":"2023-10-06T02:55:47.760651+0000","last_active":"2023-10-06T02:55:47.760747+0000","last_peered":"2023-10-06T02:55:47.760747+0000","last_clean":"2023-10-06T02:55:47.760747+0000","last_became_active":"2023-10-06T02:55:47.760278+0000","last_became_peered":"2023-10-06T02:55:47.760278+0000","last_unstale":"2023-10-06T02:55:47.760747+0000","last_undegraded":"2023-10-06T02:55:47.760747+0000","last_fullsized":"2023-10-06T02:55:47.760747+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:35.547639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764619+0000","last_change":"2023-10-06T02:55:46.756259+0000","last_active":"2023-10-06T02:55:47.764619+0000","last_peered":"2023-10-06T02:55:47.764619+0000","last_clean":"2023-10-06T02:55:47.764619+0000","last_became_active":"2023-10-06T02:55:46.755515+0000","last_became_peered":"2023-10-06T02:55:46.755515+0000","last_unstale":"2023-10-06T02:55:47.764619+0000","last_undegraded":"2023-10-06T02:55:47.764619+0000","last_fullsized":"2023-10-06T02:55:47.764619+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:44.450925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.754166+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:55:47.754166+0000","last_peered":"2023-10-06T02:55:47.754166+0000","last_clean":"2023-10-06T02:55:47.754166+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:55:47.754166+0000","last_undegraded":"2023-10-06T02:55:47.754166+0000","last_fullsized":"2023-10-06T02:55:47.754166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.761984+0000","last_change":"2023-10-06T02:55:47.761925+0000","last_active":"2023-10-06T02:55:47.761984+0000","last_peered":"2023-10-06T02:55:47.761984+0000","last_clean":"2023-10-06T02:55:47.761984+0000","last_became_active":"2023-10-06T02:55:47.761688+0000","last_became_peered":"2023-10-06T02:55:47.761688+0000","last_unstale":"2023-10-06T02:55:47.761984+0000","last_undegraded":"2023-10-06T02:55:47.761984+0000","last_fullsized":"2023-10-06T02:55:47.761984+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:46.741122+0000","last_clean_scrub_stamp":"2023-10-06T02:55:46.741122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:19.726327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"164'8","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.774153+0000","last_change":"2023-10-06T02:55:46.760322+0000","last_active":"2023-10-06T02:55:47.774153+0000","last_peered":"2023-10-06T02:55:47.774153+0000","last_clean":"2023-10-06T02:55:47.774153+0000","last_became_active":"2023-10-06T02:55:46.759799+0000","last_became_peered":"2023-10-06T02:55:46.759799+0000","last_unstale":"2023-10-06T02:55:47.774153+0000","last_undegraded":"2023-10-06T02:55:47.774153+0000","last_fullsized":"2023-10-06T02:55:47.774153+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:45.736607+0000","last_clean_scrub_stamp":"2023-10-06T02:55:45.736607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:46.184921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-06T02:55:47.764863+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:55:47.764863+0000","last_peered":"2023-10-06T02:55:47.764863+0000","last_clean":"2023-10-06T02:55:47.764863+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:55:47.764863+0000","last_undegraded":"2023-10-06T02:55:47.764863+0000","last_fullsized":"2023-10-06T02:55:47.764863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1527,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193785,"statfs":{"total":200000000,"available":198436022,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.82299999999999995,"5min":0.84299999999999997,"15min":1.393},"last":0.309},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.71299999999999997,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.504}]},{"osd":1,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.372,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70599999999999996,"5min":0.749,"15min":1.081},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.72399999999999998,"5min":0.83599999999999997,"15min":1.4710000000000001},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.505},"min":{"1min":0.41199999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77900000000000003,"5min":0.873,"15min":0.873},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.60999999999999999},"min":{"1min":0.38800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.751,"5min":0.77600000000000002,"15min":4.8129999999999997},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.51800000000000002,"15min":0.58799999999999997},"min":{"1min":0.40000000000000002,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":3.4870000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":2.2349999999999999},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58799999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.495,"15min":0.48799999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.62,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76100000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":950,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199026342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.58999999999999997},"min":{"1min":0.379,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":2.8650000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":1.879},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.54300000000000004},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.92000000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54900000000000004,"15min":0.82699999999999996},"min":{"1min":0.41499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74099999999999999,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69999999999999996,"5min":0.76900000000000002,"15min":0.81599999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.56799999999999995},"min":{"1min":0.40500000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.0580000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.29499999999999998},"max":{"1min":0.72499999999999998,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.69899999999999995,"5min":0.73999999999999999,"15min":1.163},"last":0.505}]},{"osd":4,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.52500000000000002},"min":{"1min":0.26700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.79800000000000004,"15min":1.05},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.501,"15min":0.54600000000000004},"min":{"1min":0.30099999999999999,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":0.86799999999999999},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47999999999999998,"15min":0.51900000000000002},"min":{"1min":0.32600000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61299999999999999,"5min":0.76800000000000002,"15min":0.83999999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.58299999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.71599999999999997,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.59399999999999997},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":0.84899999999999998,"15min":1.0129999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.57799999999999996},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.79600000000000004,"15min":0.89500000000000002},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":950,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199026342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.317},"min":{"1min":0.23599999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.50600000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"min":{"1min":0.27900000000000003,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.53100000000000003,"5min":0.58299999999999996,"15min":0.61799999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.32900000000000001},"min":{"1min":0.25,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.47899999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.372},"min":{"1min":0.27500000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41399999999999998,"15min":0.39300000000000002},"min":{"1min":0.311,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55800000000000005,"5min":0.61699999999999999,"15min":0.63100000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.30399999999999999,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.628,"15min":0.628},"last":0.29499999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.78900000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.55800000000000005},"min":{"1min":0.45500000000000002,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":0.70999999999999996,"5min":1.157,"15min":1.157},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.89500000000000002,"15min":0.92000000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.55500000000000005},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.35799999999999998},"max":{"1min":0.82299999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.40100000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.41899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.432}]},{"osd":7,"last update":"Fri Oct 6 02:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.006,"15min":1.006},"last":0.442},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61799999999999999,"15min":0.58199999999999996},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":0.87,"15min":0.88200000000000001},"last":0.46899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193783,"statfs":{"total":200000000,"available":198433830,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.34599999999999997,"15min":0.34699999999999998},"min":{"1min":0.26800000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":1.177},"last":0.22},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39000000000000001,"15min":0.39400000000000002},"min":{"1min":0.35399999999999998,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":1.3400000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.83199999999999996},"min":{"1min":0.30199999999999999,"5min":0.217,"15min":0.188},"max":{"1min":0.51900000000000002,"5min":0.56899999999999995,"15min":22.038},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.29299999999999998,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":0.51100000000000001,"5min":0.59199999999999997,"15min":1.3779999999999999},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.28899999999999998,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":1.1439999999999999},"last":0.313},{"interface":"front","average":{"1min":0.435,"5min":0.39000000000000001,"15min":0.86799999999999999},"min":{"1min":0.36899999999999999,"5min":0.25600000000000001,"15min":0.253},"max":{"1min":0.56899999999999995,"5min":0.60399999999999998,"15min":21.942},"last":0.32900000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.39300000000000002,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.79700000000000004,"15min":1.9390000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55900000000000005,"15min":0.96999999999999997},"min":{"1min":0.44600000000000001,"5min":0.38900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":11.122999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":1.03},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":22.010999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":0.82999999999999996,"15min":1.401},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.997},"min":{"1min":0.44,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.82899999999999996,"5min":0.83599999999999997,"15min":11.090999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":1.0509999999999999},"min":{"1min":0.46800000000000003,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":0.85599999999999998,"15min":21.98},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.56799999999999995},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.375},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.425},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.81499999999999995},"min":{"1min":0.495,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":11.154},"last":0.55300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":950,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199026300,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.245,"5min":0.183,"15min":0.16900000000000001},"max":{"1min":0.41899999999999998,"5min":0.55200000000000005,"15min":0.58699999999999997},"last":0.311},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34699999999999998,"15min":0.34300000000000003},"min":{"1min":0.254,"5min":0.22,"15min":0.186},"max":{"1min":0.5,"5min":0.54400000000000004,"15min":0.60699999999999998},"last":0.23999999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36199999999999999},"min":{"1min":0.27800000000000002,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.5,"5min":0.67200000000000004,"15min":0.68200000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.503,"5min":0.63500000000000001,"15min":0.84499999999999997},"last":0.372}]},{"osd":3,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.379},"min":{"1min":0.35299999999999998,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.53600000000000003,"5min":0.60999999999999999,"15min":0.70999999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.33500000000000002,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69999999999999996,"5min":1.056,"15min":1.056},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.45500000000000002,"5min":0.312,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.434}]},{"osd":5,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.49299999999999999,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61799999999999999,"15min":0.59999999999999998},"min":{"1min":0.52300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76400000000000001,"5min":1.018,"15min":1.2569999999999999},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":1.0009999999999999,"15min":1.0660000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.5,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77400000000000002,"5min":0.93899999999999995,"15min":1.002},"last":0.5}]},{"osd":7,"last update":"Fri Oct 6 02:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.51500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78700000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61399999999999999,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199025824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33600000000000002,"15min":0.315},"min":{"1min":0.23499999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54900000000000004,"5min":0.55100000000000005,"15min":0.57499999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.22},"max":{"1min":0.748,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.371,"15min":0.34200000000000003},"min":{"1min":0.25600000000000001,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.69999999999999996},"last":0.317},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.36299999999999999},"min":{"1min":0.32600000000000001,"5min":0.27000000000000002,"15min":0.22600000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.71199999999999997},"last":0.372}]},{"osd":2,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.38200000000000001},"min":{"1min":0.307,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":3.044},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.41599999999999998,"15min":0.36699999999999999},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.249},"max":{"1min":0.70899999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.26000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.34599999999999997},"max":{"1min":0.75800000000000001,"5min":1.446,"15min":2.2120000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":1.327,"15min":2.25},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60899999999999999,"15min":0.66000000000000003},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.34200000000000003},"max":{"1min":0.88100000000000001,"5min":1.2929999999999999,"15min":6.4189999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.56000000000000005},"min":{"1min":0.497,"5min":0.36899999999999999,"15min":0.33500000000000002},"max":{"1min":0.90500000000000003,"5min":1.268,"15min":1.268},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.57799999999999996},"min":{"1min":0.432,"5min":0.38800000000000001,"15min":0.34300000000000003},"max":{"1min":0.90700000000000003,"5min":1.218,"15min":1.218},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":1.4179999999999999,"15min":1.8340000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.623,"15min":0.84399999999999997},"min":{"1min":0.46200000000000002,"5min":0.39000000000000001,"15min":0.36399999999999999},"max":{"1min":0.877,"5min":1.3720000000000001,"15min":14.912000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.58099999999999996},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.70299999999999996},"min":{"1min":0.42399999999999999,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":1.069,"15min":5.8949999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51400000000000001,"15min":0.58799999999999997},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.221},"max":{"1min":0.73399999999999999,"5min":1.1639999999999999,"15min":5.3579999999999997},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.72899999999999998},"min":{"1min":0.35999999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73099999999999998,"5min":1.109,"15min":5.9329999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.69899999999999995},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":1.2310000000000001,"15min":5.9820000000000002},"last":0.625}]},{"osd":2,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.61099999999999999},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":0.77500000000000002,"5min":1.083,"15min":5.4390000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":1.252,"15min":5.3470000000000004},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.71799999999999997,"5min":1.093,"15min":3.4100000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.59899999999999998},"min":{"1min":0.44900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":1.1839999999999999,"15min":3.456},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.245},"max":{"1min":0.73999999999999999,"5min":1.036,"15min":1.036},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.49199999999999999,"15min":0.503},"min":{"1min":0.28599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71299999999999997,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.5,"15min":0.51500000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68500000000000005,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.77700000000000002,"5min":0.94299999999999995,"15min":1.0489999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.88300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.86099999999999999,"5min":1.133,"15min":13.173999999999999},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":950,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194361,"statfs":{"total":200000000,"available":199026412,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.26900000000000002,"15min":0.219},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.79100000000000004},"last":0.442},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.41599999999999998,"5min":0.27400000000000002,"15min":0.26900000000000002},"max":{"1min":0.77700000000000002,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.27900000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.752,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78800000000000003,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":0.72699999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.26700000000000002},"max":{"1min":0.71199999999999997,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75,"5min":0.75,"15min":0.83799999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82599999999999996},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.59299999999999997,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.495},{"interface":"front","average":{"1min":0.434,"5min":0.48099999999999998,"15min":0.50800000000000001},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.65200000000000002,"5min":0.73699999999999999,"15min":0.89300000000000002},"last":0.36699999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66600000000000004,"5min":0.76700000000000002,"15min":0.84999999999999998},"last":0.38},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.879},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.76900000000000002,"15min":0.82099999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.55900000000000005,"15min":0.57199999999999995},"min":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.46300000000000002}]}]}],"pool_statfs":[]}} 2023-10-06T02:55:52.192 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:55:52.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:55:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.345+0000 7fd5a2406700 1 Processor -- start 2023-10-06T02:55:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.345+0000 7fd5a2406700 1 -- start start 2023-10-06T02:55:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.346+0000 7fd5a2406700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd59c0b1ef0 0x7fd59c06da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.346+0000 7fd5a2406700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b29d0 0x7fd59c163bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.346+0000 7fd5a2406700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59c068d40 con 0x7fd59c06f4f0 2023-10-06T02:55:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.346+0000 7fd5a2406700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c15a520 con 0x7fd59c0b1ef0 2023-10-06T02:55:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.346+0000 7fd5a2406700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c06a1e0 con 0x7fd59c0b29d0 2023-10-06T02:55:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.346+0000 7fd5a1404700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd59c0b1ef0 0x7fd59c06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.346+0000 7fd5a1c05700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b29d0 0x7fd59c163bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.346+0000 7fd5a0c03700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd59c06f4f0 0x7fd59c0b22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:35756/0 (socket says 172.21.15.81:35756) 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.346+0000 7fd5a0c03700 1 -- 172.21.15.81:0/411026808 learned_addr learned my addr 172.21.15.81:0/411026808 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd593fff700 1 -- 172.21.15.81:0/411026808 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274947695 0 0) 0x7fd59c068d40 con 0x7fd59c06f4f0 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd593fff700 1 -- 172.21.15.81:0/411026808 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd588003570 con 0x7fd59c06f4f0 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd5a1404700 1 -- 172.21.15.81:0/411026808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b29d0 msgr2=0x7fd59c163bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd5a1404700 1 --2- 172.21.15.81:0/411026808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b29d0 0x7fd59c163bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd5a1404700 1 -- 172.21.15.81:0/411026808 >> v1:172.21.15.83:6789/0 conn(0x7fd59c06f4f0 legacy=0x7fd59c0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd5a1404700 1 -- 172.21.15.81:0/411026808 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c06e2d0 con 0x7fd59c0b1ef0 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd5a1c05700 1 --2- 172.21.15.81:0/411026808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b29d0 0x7fd59c163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd5a1404700 1 --2- 172.21.15.81:0/411026808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd59c0b1ef0 0x7fd59c06da20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5980098e0 tx=0x7fd5980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=104122e387aed296 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd593fff700 1 -- 172.21.15.81:0/411026808 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598011630 con 0x7fd59c0b1ef0 2023-10-06T02:55:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd593fff700 1 -- 172.21.15.81:0/411026808 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd598011790 con 0x7fd59c0b1ef0 2023-10-06T02:55:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.347+0000 7fd593fff700 1 -- 172.21.15.81:0/411026808 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598011b30 con 0x7fd59c0b1ef0 2023-10-06T02:55:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.348+0000 7fd5a2406700 1 -- 172.21.15.81:0/411026808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd59c0b1ef0 msgr2=0x7fd59c06da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.348+0000 7fd5a2406700 1 --2- 172.21.15.81:0/411026808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd59c0b1ef0 0x7fd59c06da20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5980098e0 tx=0x7fd5980091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.348+0000 7fd5a2406700 1 -- 172.21.15.81:0/411026808 shutdown_connections 2023-10-06T02:55:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.348+0000 7fd5a2406700 1 --2- 172.21.15.81:0/411026808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b29d0 0x7fd59c163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.348+0000 7fd5a2406700 1 --2- 172.21.15.81:0/411026808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd59c0b1ef0 0x7fd59c06da20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.348+0000 7fd5a2406700 1 -- 172.21.15.81:0/411026808 >> 172.21.15.81:0/411026808 conn(0x7fd59c0d0bb0 msgr2=0x7fd59c0d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.348+0000 7fd5a2406700 1 -- 172.21.15.81:0/411026808 shutdown_connections 2023-10-06T02:55:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.348+0000 7fd5a2406700 1 -- 172.21.15.81:0/411026808 wait complete. 2023-10-06T02:55:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.349+0000 7fd5a2406700 1 Processor -- start 2023-10-06T02:55:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.349+0000 7fd5a2406700 1 -- start start 2023-10-06T02:55:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a2406700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c06f4f0 0x7fd59c14e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a2406700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b1ef0 0x7fd59c152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a2406700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd59c0b29d0 0x7fd59c0cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a2406700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c1532b0 con 0x7fd59c06f4f0 2023-10-06T02:55:52.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a2406700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c15b130 con 0x7fd59c0b29d0 2023-10-06T02:55:52.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a2406700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c14eb30 con 0x7fd59c0b1ef0 2023-10-06T02:55:52.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1404700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c06f4f0 0x7fd59c14e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1404700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c06f4f0 0x7fd59c14e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33006/0 (socket says 172.21.15.81:33006) 2023-10-06T02:55:52.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1404700 1 -- 172.21.15.81:0/335016315 learned_addr learned my addr 172.21.15.81:0/335016315 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:52.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a0c03700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b1ef0 0x7fd59c152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1c05700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd59c0b29d0 0x7fd59c0cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1404700 1 -- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b1ef0 msgr2=0x7fd59c152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1404700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b1ef0 0x7fd59c152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1404700 1 -- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd59c0b29d0 msgr2=0x7fd59c0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1404700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd59c0b29d0 0x7fd59c0cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1404700 1 -- 172.21.15.81:0/335016315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd594009a20 con 0x7fd59c06f4f0 2023-10-06T02:55:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5a1404700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c06f4f0 0x7fd59c14e5f0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0713d0 tx=0x7fd598017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.350+0000 7fd5917fa700 1 -- 172.21.15.81:0/335016315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598011b10 con 0x7fd59c06f4f0 2023-10-06T02:55:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.351+0000 7fd5917fa700 1 -- 172.21.15.81:0/335016315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5980253f0 con 0x7fd59c06f4f0 2023-10-06T02:55:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.351+0000 7fd5917fa700 1 -- 172.21.15.81:0/335016315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980257b0 con 0x7fd59c06f4f0 2023-10-06T02:55:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.351+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd598009420 con 0x7fd59c06f4f0 2023-10-06T02:55:52.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.351+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c15aae0 con 0x7fd59c06f4f0 2023-10-06T02:55:52.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.352+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c067b70 con 0x7fd59c06f4f0 2023-10-06T02:55:52.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.352+0000 7fd5917fa700 1 -- 172.21.15.81:0/335016315 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd598025b60 con 0x7fd59c06f4f0 2023-10-06T02:55:52.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.352+0000 7fd5917fa700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd580066f30 0x7fd5800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.352+0000 7fd5917fa700 1 -- 172.21.15.81:0/335016315 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd598085f70 con 0x7fd59c06f4f0 2023-10-06T02:55:52.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.352+0000 7fd5a0c03700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd580066f30 0x7fd5800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.353+0000 7fd5a0c03700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd580066f30 0x7fd5800693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0b0a30 tx=0x7fd58c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.356+0000 7fd5917fa700 1 -- 172.21.15.81:0/335016315 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5980b75a0 con 0x7fd59c06f4f0 2023-10-06T02:55:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.615+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd59c071b10 con 0x7fd59c06f4f0 2023-10-06T02:55:52.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.619+0000 7fd5917fa700 1 -- 172.21.15.81:0/335016315 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd598053080 con 0x7fd59c06f4f0 2023-10-06T02:55:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.621+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd580066f30 msgr2=0x7fd5800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.621+0000 7fd5a2406700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd580066f30 0x7fd5800693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0b0a30 tx=0x7fd58c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.621+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c06f4f0 msgr2=0x7fd59c14e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.621+0000 7fd5a2406700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c06f4f0 0x7fd59c14e5f0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0713d0 tx=0x7fd598017000 comp rx=0 tx=0).stop 2023-10-06T02:55:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.622+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 shutdown_connections 2023-10-06T02:55:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.622+0000 7fd5a2406700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd580066f30 0x7fd5800693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.622+0000 7fd5a2406700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd59c0b29d0 0x7fd59c0cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.622+0000 7fd5a2406700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c06f4f0 0x7fd59c14e5f0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.622+0000 7fd5a2406700 1 --2- 172.21.15.81:0/335016315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd59c0b1ef0 0x7fd59c152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.622+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 >> 172.21.15.81:0/335016315 conn(0x7fd59c0d0bb0 msgr2=0x7fd59c0b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.622+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 shutdown_connections 2023-10-06T02:55:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.622+0000 7fd5a2406700 1 -- 172.21.15.81:0/335016315 wait complete. 2023-10-06T02:55:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:55:52.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.748+0000 7f0ec7462700 1 Processor -- start 2023-10-06T02:55:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.748+0000 7f0ec7462700 1 -- start start 2023-10-06T02:55:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec7462700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ec00cf060 0x7f0ec00b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec7462700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec0067640 con 0x7f0ec0159f90 2023-10-06T02:55:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec7462700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec00b1e50 con 0x7f0ec0159bc0 2023-10-06T02:55:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec7462700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec0067890 con 0x7f0ec00cf060 2023-10-06T02:55:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec5c5f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ec00cf060 0x7f0ec00b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec6c61700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0ec0159f90 0x7f0ec0163930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33110/0 (socket says 172.21.15.81:33110) 2023-10-06T02:55:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec6c61700 1 -- 172.21.15.81:0/3872225056 learned_addr learned my addr 172.21.15.81:0/3872225056 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec5c5f700 1 -- 172.21.15.81:0/3872225056 >> v1:172.21.15.83:6789/0 conn(0x7f0ec0159bc0 legacy=0x7f0ec00ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec5c5f700 1 -- 172.21.15.81:0/3872225056 >> v1:172.21.15.81:6789/0 conn(0x7f0ec0159f90 legacy=0x7f0ec0163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec5c5f700 1 -- 172.21.15.81:0/3872225056 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0067b70 con 0x7f0ec00cf060 2023-10-06T02:55:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.749+0000 7f0ec545e700 1 -- 172.21.15.81:0/3872225056 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259747041 0 0) 0x7f0ec0067640 con 0x7f0ec0159f90 2023-10-06T02:55:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec5c5f700 1 --2- 172.21.15.81:0/3872225056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00cf060 0x7f0ec00b17c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00098e0 tx=0x7f0eb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc2510135a0f620 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec545e700 1 -- 172.21.15.81:0/3872225056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0009e80 con 0x7f0ec00cf060 2023-10-06T02:55:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec545e700 1 -- 172.21.15.81:0/3872225056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb000b860 con 0x7f0ec00cf060 2023-10-06T02:55:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec545e700 1 -- 172.21.15.81:0/3872225056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000bbe0 con 0x7f0ec00cf060 2023-10-06T02:55:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec7462700 1 -- 172.21.15.81:0/3872225056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00cf060 msgr2=0x7f0ec00b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec7462700 1 --2- 172.21.15.81:0/3872225056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00cf060 0x7f0ec00b17c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00098e0 tx=0x7f0eb00091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec7462700 1 -- 172.21.15.81:0/3872225056 shutdown_connections 2023-10-06T02:55:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec7462700 1 --2- 172.21.15.81:0/3872225056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec00cf060 0x7f0ec00b17c0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec7462700 1 -- 172.21.15.81:0/3872225056 >> 172.21.15.81:0/3872225056 conn(0x7f0ec006c620 msgr2=0x7f0ec006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec7462700 1 -- 172.21.15.81:0/3872225056 shutdown_connections 2023-10-06T02:55:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.750+0000 7f0ec7462700 1 -- 172.21.15.81:0/3872225056 wait complete. 2023-10-06T02:55:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.751+0000 7f0ec7462700 1 Processor -- start 2023-10-06T02:55:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.751+0000 7f0ec7462700 1 -- start start 2023-10-06T02:55:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec7462700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ec00cf060 0x7f0ec00af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec7462700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec0159bc0 0x7f0ec00c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec7462700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec0159f90 0x7f0ec00c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec7462700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00c93c0 con 0x7f0ec0159bc0 2023-10-06T02:55:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec7462700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00afb50 con 0x7f0ec00cf060 2023-10-06T02:55:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec7462700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00afe30 con 0x7f0ec0159f90 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec5c5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec0159bc0 0x7f0ec00c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec5c5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec0159bc0 0x7f0ec00c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33024/0 (socket says 172.21.15.81:33024) 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec5c5f700 1 -- 172.21.15.81:0/4086496435 learned_addr learned my addr 172.21.15.81:0/4086496435 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec5c5f700 1 -- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec0159f90 msgr2=0x7f0ec00c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec5c5f700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec0159f90 0x7f0ec00c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec5c5f700 1 -- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ec00cf060 msgr2=0x7f0ec00af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec5c5f700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ec00cf060 0x7f0ec00af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.752+0000 7f0ec5c5f700 1 -- 172.21.15.81:0/4086496435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0009420 con 0x7f0ec0159bc0 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.753+0000 7f0ec5c5f700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec0159bc0 0x7f0ec00c8e80 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0013000 tx=0x7f0eb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.753+0000 7f0eb67fc700 1 -- 172.21.15.81:0/4086496435 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0011420 con 0x7f0ec0159bc0 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.753+0000 7f0eb67fc700 1 -- 172.21.15.81:0/4086496435 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0011580 con 0x7f0ec0159bc0 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.753+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec00b0110 con 0x7f0ec0159bc0 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.753+0000 7f0eb67fc700 1 -- 172.21.15.81:0/4086496435 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0011920 con 0x7f0ec0159bc0 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.753+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec00b06d0 con 0x7f0ec0159bc0 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.754+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec0069920 con 0x7f0ec0159bc0 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.754+0000 7f0eb67fc700 1 -- 172.21.15.81:0/4086496435 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0eb0011c90 con 0x7f0ec0159bc0 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.754+0000 7f0eb67fc700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea4066f30 0x7f0ea40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.755+0000 7f0eb67fc700 1 -- 172.21.15.81:0/4086496435 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0eb00860e0 con 0x7f0ec0159bc0 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.755+0000 7f0ec6460700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea4066f30 0x7f0ea40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.755+0000 7f0ec6460700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea4066f30 0x7f0ea40693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc007fd0 tx=0x7f0ebc007b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.759+0000 7f0eb67fc700 1 -- 172.21.15.81:0/4086496435 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0eb0053270 con 0x7f0ec0159bc0 2023-10-06T02:55:52.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.983+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ec00b08c0 con 0x7f0ec0159bc0 2023-10-06T02:55:52.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.983+0000 7f0eb67fc700 1 -- 172.21.15.81:0/4086496435 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f0eb0056890 con 0x7f0ec0159bc0 2023-10-06T02:55:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:52.985 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4037385194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4037385194},{"type":"v1","addr":"172.21.15.83:6837","nonce":4037385194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2052186081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2052186081},{"type":"v1","addr":"172.21.15.83:6836","nonce":2052186081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2641977500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2641977500},{"type":"v1","addr":"172.21.15.81:6833","nonce":2641977500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:47.127871+0000","modified":"2023-10-06T02:55:50.779474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/70519905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":70519905},{"type":"v1","addr":"172.21.15.81:6835","nonce":70519905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T02:55:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea4066f30 msgr2=0x7f0ea40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea4066f30 0x7f0ea40693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc007fd0 tx=0x7f0ebc007b20 comp rx=0 tx=0).stop 2023-10-06T02:55:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec0159bc0 msgr2=0x7f0ec00c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec0159bc0 0x7f0ec00c8e80 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0013000 tx=0x7f0eb0017000 comp rx=0 tx=0).stop 2023-10-06T02:55:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 shutdown_connections 2023-10-06T02:55:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ec0159f90 0x7f0ec00c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0ea4066f30 0x7f0ea40693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ec00cf060 0x7f0ec00af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 --2- 172.21.15.81:0/4086496435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec0159bc0 0x7f0ec00c8e80 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 >> 172.21.15.81:0/4086496435 conn(0x7f0ec006c620 msgr2=0x7f0ec00b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:52.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 shutdown_connections 2023-10-06T02:55:52.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:52.985+0000 7f0ec7462700 1 -- 172.21.15.81:0/4086496435 wait complete. 2023-10-06T02:55:52.988 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2023-10-06T02:55:53.400 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:55:47.127871+0000', 'modified': '2023-10-06T02:55:50.779474+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8034}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8034': {'gid': 8034, 'name': 'c', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/70519905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 70519905}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 70519905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:55:53.401 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:55:53.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:55:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.516+0000 7fcfdfc66700 1 Processor -- start 2023-10-06T02:55:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.516+0000 7fcfdfc66700 1 -- start start 2023-10-06T02:55:53.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.517+0000 7fcfdfc66700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcfd8157ca0 0x7fcfd80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.517+0000 7fcfdfc66700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd80d07c0 con 0x7fcfd81578d0 2023-10-06T02:55:53.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.517+0000 7fcfdfc66700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd80cfbb0 con 0x7fcfd806d120 2023-10-06T02:55:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.517+0000 7fcfdfc66700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd80cfe90 con 0x7fcfd8157ca0 2023-10-06T02:55:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdda02700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcfd81578d0 0x7fcfd815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33124/0 (socket says 172.21.15.81:33124) 2023-10-06T02:55:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdda02700 1 -- 172.21.15.81:0/1328575519 learned_addr learned my addr 172.21.15.81:0/1328575519 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdd201700 1 --2- 172.21.15.81:0/1328575519 >> v2:172.21.15.83:3300/0 conn(0x7fcfd8157ca0 0x7fcfd80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559694015 0 0) 0x7fcfd80d07c0 con 0x7fcfd81578d0 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc4003570 con 0x7fcfd81578d0 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2751996187 0 0) 0x7fcfc4003570 con 0x7fcfd81578d0 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 >> v2:172.21.15.83:3300/0 conn(0x7fcfd8157ca0 msgr2=0x7fcfd80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 --2- 172.21.15.81:0/1328575519 >> v2:172.21.15.83:3300/0 conn(0x7fcfd8157ca0 0x7fcfd80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 >> v1:172.21.15.83:6789/0 conn(0x7fcfd806d120 legacy=0x7fcfd806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80d0170 con 0x7fcfd81578d0 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fcfd40017f0 con 0x7fcfd81578d0 2023-10-06T02:55:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 >> v1:172.21.15.81:6789/0 conn(0x7fcfd81578d0 legacy=0x7fcfd815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc4003a60 0x7fcfc4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4004810 0x7fcfc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfc40051c0 0x7fcfc400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80cfe90 con 0x7fcfc4003a60 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc400c0d0 con 0x7fcfc40051c0 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc400c290 con 0x7fcfc4004810 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc4003a60 0x7fcfc4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfde203700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfc40051c0 0x7fcfc400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.518+0000 7fcfdd201700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4004810 0x7fcfc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdda02700 1 -- 172.21.15.81:0/1328575519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4004810 msgr2=0x7fcfc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4004810 0x7fcfc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdda02700 1 -- 172.21.15.81:0/1328575519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfc40051c0 msgr2=0x7fcfc400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfc40051c0 0x7fcfc400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfde203700 1 -- 172.21.15.81:0/1328575519 reap_dead start 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdda02700 1 -- 172.21.15.81:0/1328575519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc4003570 con 0x7fcfc4003a60 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdd201700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4004810 0x7fcfc4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc4003a60 0x7fcfc4003e70 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400a930 tx=0x7fcfd40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72c7743f3e5b2dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40070d0 con 0x7fcfc4003a60 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd4007230 con 0x7fcfc4003a60 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdca00700 1 -- 172.21.15.81:0/1328575519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40075d0 con 0x7fcfc4003a60 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdfc66700 1 -- 172.21.15.81:0/1328575519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc4003a60 msgr2=0x7fcfc4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.519+0000 7fcfdfc66700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc4003a60 0x7fcfc4003e70 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400a930 tx=0x7fcfd40021d0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.520+0000 7fcfdfc66700 1 -- 172.21.15.81:0/1328575519 shutdown_connections 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.520+0000 7fcfdfc66700 1 --2- 172.21.15.81:0/1328575519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc4003a60 0x7fcfc4003e70 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.520+0000 7fcfdfc66700 1 -- 172.21.15.81:0/1328575519 >> 172.21.15.81:0/1328575519 conn(0x7fcfd806bb90 msgr2=0x7fcfd806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.520+0000 7fcfdfc66700 1 -- 172.21.15.81:0/1328575519 shutdown_connections 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.520+0000 7fcfdfc66700 1 -- 172.21.15.81:0/1328575519 wait complete. 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.521+0000 7fcfdfc66700 1 Processor -- start 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.521+0000 7fcfdfc66700 1 -- start start 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.521+0000 7fcfdfc66700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4003a60 0x7fcfd816a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.521+0000 7fcfdfc66700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd815dc90 0x7fcfd80c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.521+0000 7fcfdfc66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd80c7d90 0x7fcfd8153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.521+0000 7fcfdfc66700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c5e90 con 0x7fcfd80c7d90 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.521+0000 7fcfdfc66700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c82a0 con 0x7fcfd815dc90 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.521+0000 7fcfdfc66700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c8580 con 0x7fcfc4003a60 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfde203700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd80c7d90 0x7fcfd8153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfde203700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd80c7d90 0x7fcfd8153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33038/0 (socket says 172.21.15.81:33038) 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfde203700 1 -- 172.21.15.81:0/3351785083 learned_addr learned my addr 172.21.15.81:0/3351785083 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfdd201700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd815dc90 0x7fcfd80c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfdda02700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4003a60 0x7fcfd816a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfde203700 1 -- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4003a60 msgr2=0x7fcfd816a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfde203700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4003a60 0x7fcfd816a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfde203700 1 -- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd815dc90 msgr2=0x7fcfd80c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfde203700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd815dc90 0x7fcfd80c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfde203700 1 -- 172.21.15.81:0/3351785083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80c8860 con 0x7fcfd80c7d90 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfdda02700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4003a60 0x7fcfd816a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfdd201700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd815dc90 0x7fcfd80c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfde203700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd80c7d90 0x7fcfd8153820 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8063f70 tx=0x7fcfd0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfcdffb700 1 -- 172.21.15.81:0/3351785083 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0006b00 con 0x7fcfd80c7d90 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfcdffb700 1 -- 172.21.15.81:0/3351785083 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd0006c60 con 0x7fcfd80c7d90 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfdfc66700 1 -- 172.21.15.81:0/3351785083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd80c5b20 con 0x7fcfd80c7d90 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfcdffb700 1 -- 172.21.15.81:0/3351785083 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0007030 con 0x7fcfd80c7d90 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.522+0000 7fcfdfc66700 1 -- 172.21.15.81:0/3351785083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd816ad80 con 0x7fcfd80c7d90 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.524+0000 7fcfcdffb700 1 -- 172.21.15.81:0/3351785083 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfd00073e0 con 0x7fcfd80c7d90 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.524+0000 7fcfcdffb700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcfbc066f30 0x7fcfbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.524+0000 7fcfcdffb700 1 -- 172.21.15.81:0/3351785083 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcfd0083c70 con 0x7fcfd80c7d90 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.524+0000 7fcfdda02700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcfbc066f30 0x7fcfbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.525+0000 7fcfdda02700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcfbc066f30 0x7fcfbc0693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400afd0 tx=0x7fcfd4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.526+0000 7fcfe8f5eb80 1 Processor -- start 2023-10-06T02:55:53.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.526+0000 7fcfe8f5eb80 1 -- start start 2023-10-06T02:55:53.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 0x558f2a96bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 0x558f2a9bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a8c2a70 con 0x558f2a96ccc0 2023-10-06T02:55:53.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a8c0270 con 0x558f2a96b840 2023-10-06T02:55:53.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f2a8bc060 con 0x558f2a9bbc00 2023-10-06T02:55:53.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdd201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdd201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9bb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33046/0 (socket says 172.21.15.81:33046) 2023-10-06T02:55:53.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdd201700 1 -- 172.21.15.81:0/3451145050 learned_addr learned my addr 172.21.15.81:0/3451145050 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:53.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdda02700 1 --2- 172.21.15.81:0/3451145050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 0x558f2a96bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfde203700 1 --2- 172.21.15.81:0/3451145050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 0x558f2a9bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdd201700 1 -- 172.21.15.81:0/3451145050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 msgr2=0x558f2a9bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdd201700 1 --2- 172.21.15.81:0/3451145050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 0x558f2a9bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdd201700 1 -- 172.21.15.81:0/3451145050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 msgr2=0x558f2a96bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdd201700 1 --2- 172.21.15.81:0/3451145050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 0x558f2a96bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdd201700 1 -- 172.21.15.81:0/3451145050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f2a756270 con 0x558f2a96ccc0 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfdd201700 1 --2- 172.21.15.81:0/3451145050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9bb6c0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009aa0 tx=0x7fcfc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b425e0a174e85929 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfc2ffd700 1 -- 172.21.15.81:0/3451145050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8013770 con 0x558f2a96ccc0 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfc2ffd700 1 -- 172.21.15.81:0/3451145050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80138d0 con 0x558f2a96ccc0 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.527+0000 7fcfc2ffd700 1 -- 172.21.15.81:0/3451145050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8013c50 con 0x558f2a96ccc0 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.528+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/3451145050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 msgr2=0x558f2a9bb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.528+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/3451145050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9bb6c0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009aa0 tx=0x7fcfc8008040 comp rx=0 tx=0).stop 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.528+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/3451145050 shutdown_connections 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.528+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/3451145050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 0x558f2a9bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.528+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/3451145050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 0x558f2a96bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.528+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/3451145050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9bb6c0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.528+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/3451145050 >> 172.21.15.81:0/3451145050 conn(0x558f2a96d160 msgr2=0x558f2a96d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.528+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/3451145050 shutdown_connections 2023-10-06T02:55:53.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.528+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/3451145050 wait complete. 2023-10-06T02:55:53.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.529+0000 7fcfe8f5eb80 1 -- start start 2023-10-06T02:55:53.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.529+0000 7fcfe8f5eb80 1 Processor -- start 2023-10-06T02:55:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a96b840 0x558f2a9b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a9bbc00 0x558f2a9aa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a867890 con 0x558f2a96ccc0 2023-10-06T02:55:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a882ea0 con 0x558f2a9bbc00 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f2a73ee30 con 0x558f2a96b840 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 10 client.0 _ll_register_callbacks cb 0x558f2a92ee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdd201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdd201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33062/0 (socket says 172.21.15.81:33062) 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdd201700 1 -- 172.21.15.81:0/1913388257 learned_addr learned my addr 172.21.15.81:0/1913388257 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfde203700 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a9bbc00 0x558f2a9aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a96b840 0x558f2a9b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdd201700 1 -- 172.21.15.81:0/1913388257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a96b840 msgr2=0x558f2a9b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdd201700 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a96b840 0x558f2a9b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdd201700 1 -- 172.21.15.81:0/1913388257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a9bbc00 msgr2=0x558f2a9aa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdd201700 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a9bbc00 0x558f2a9aa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdd201700 1 -- 172.21.15.81:0/1913388257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc8009770 con 0x558f2a96ccc0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfdd201700 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9ae270 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcfc801a000 tx=0x7fcfc801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84375f1c8daf66e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfb7fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1913388257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8024070 con 0x558f2a96ccc0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1913388257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcfc8005a00 con 0x558f2a96ccc0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1913388257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f2a960940 con 0x558f2a96ccc0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1913388257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc8005e10 con 0x558f2a96ccc0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 10 client.8190 fetch_fsmap learned FSMap version 83 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.530+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1913388257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x558f2a6f8fe0 con 0x558f2a96ccc0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1913388257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f2a960940 con 0x558f2a96ccc0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1913388257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcfc8016460 con 0x558f2a96ccc0 2023-10-06T02:55:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfe8f5eb80 10 client.8190 fetch_fsmap finished waiting for FSMap version 83 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfe8f5eb80 10 client.8190 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfe8f5eb80 20 client.8190 populate_metadata read hostname 'smithi081' 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] conn(0x558f2a9c58f0 0x558f2a9c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfe8f5eb80 4 client.8190 mds_command: new command op to 8034 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1913388257 --> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f2a93d870 con 0x558f2a9c58f0 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] conn(0x558f2a9c58f0 0x558f2a9c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfb7fff700 10 client.8190 ms_handle_connect on v2:172.21.15.81:6834/70519905 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.531+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] conn(0x558f2a9c58f0 0x558f2a9c5cc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75052d27f99c45d7 server_cookie=de95cdc47f9c7d1b in_seq=0 out_seq=0 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1913388257 <== mds.0 v2:172.21.15.81:6834/70519905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558f2a93d870 con 0x558f2a9c58f0 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfb7fff700 10 client.8190 handle_command_reply: tid=0 2023-10-06T02:55:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 client.8190 shutdown 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1913388257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 msgr2=0x558f2a9ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9ae270 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcfc801a000 tx=0x7fcfc801e000 comp rx=0 tx=0).stop 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1913388257 shutdown_connections 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a9bbc00 0x558f2a9aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] conn(0x558f2a9c58f0 0x558f2a9c5cc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a96b840 0x558f2a9b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1913388257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a9ae270 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfb7fff700 0 client.8190 ms_handle_reset on v2:172.21.15.81:6834/70519905 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1913388257 >> 172.21.15.81:0/1913388257 conn(0x558f2a96d160 msgr2=0x558f2a96c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1913388257 shutdown_connections 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1913388257 wait complete. 2023-10-06T02:55:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.532+0000 7fcfe8f5eb80 20 client.8190 trim_cache size 0 max 16384 2023-10-06T02:55:53.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfe8f5eb80 1 Processor -- start 2023-10-06T02:55:53.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfe8f5eb80 1 -- start start 2023-10-06T02:55:53.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a96b840 0x558f2a968ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96ccc0 0x558f2a991d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a9bbc00 0x558f2a9922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a966620 con 0x558f2a9bbc00 2023-10-06T02:55:53.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a9b5c20 con 0x558f2a96ccc0 2023-10-06T02:55:53.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f2a99b350 con 0x558f2a96b840 2023-10-06T02:55:53.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfde203700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a9bbc00 0x558f2a9922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfde203700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a9bbc00 0x558f2a9922c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33072/0 (socket says 172.21.15.81:33072) 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.549+0000 7fcfde203700 1 -- 172.21.15.81:0/968736926 learned_addr learned my addr 172.21.15.81:0/968736926 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfde203700 1 -- 172.21.15.81:0/968736926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a96b840 msgr2=0x558f2a968ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfde203700 1 --2- 172.21.15.81:0/968736926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a96b840 0x558f2a968ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfde203700 1 -- 172.21.15.81:0/968736926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96ccc0 msgr2=0x558f2a991d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfde203700 1 --2- 172.21.15.81:0/968736926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96ccc0 0x558f2a991d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfde203700 1 -- 172.21.15.81:0/968736926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f2a88a780 con 0x558f2a9bbc00 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfde203700 1 --2- 172.21.15.81:0/968736926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a9bbc00 0x558f2a9922c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00549d0 tx=0x7fcfd0015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1363391fe0ea38ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfc37fe700 1 -- 172.21.15.81:0/968736926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd005b9e0 con 0x558f2a9bbc00 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfc37fe700 1 -- 172.21.15.81:0/968736926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd006e070 con 0x558f2a9bbc00 2023-10-06T02:55:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfc37fe700 1 -- 172.21.15.81:0/968736926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0052b80 con 0x558f2a9bbc00 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/968736926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a9bbc00 msgr2=0x558f2a9922c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/968736926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a9bbc00 0x558f2a9922c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00549d0 tx=0x7fcfd0015040 comp rx=0 tx=0).stop 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/968736926 shutdown_connections 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/968736926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a9bbc00 0x558f2a9922c0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/968736926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a96b840 0x558f2a968ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/968736926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96ccc0 0x558f2a991d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.550+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/968736926 >> 172.21.15.81:0/968736926 conn(0x558f2a96d160 msgr2=0x558f2a9b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.551+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/968736926 shutdown_connections 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.551+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/968736926 wait complete. 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.551+0000 7fcfe8f5eb80 1 -- start start 2023-10-06T02:55:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.551+0000 7fcfe8f5eb80 1 Processor -- start 2023-10-06T02:55:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 0x558f2a9cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a968ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfe8f5eb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 0x558f2a9b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a9ba030 con 0x558f2a96ccc0 2023-10-06T02:55:53.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a9695e0 con 0x558f2a96b840 2023-10-06T02:55:53.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfe8f5eb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f2a9cc0c0 con 0x558f2a9bbc00 2023-10-06T02:55:53.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfe8f5eb80 10 client.0 _ll_register_callbacks cb 0x558f2a92ee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:55:53.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdd201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a968ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdd201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a968ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33088/0 (socket says 172.21.15.81:33088) 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdd201700 1 -- 172.21.15.81:0/1200065682 learned_addr learned my addr 172.21.15.81:0/1200065682 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 0x558f2a9cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfde203700 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 0x558f2a9b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdd201700 1 -- 172.21.15.81:0/1200065682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 msgr2=0x558f2a9b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdd201700 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 0x558f2a9b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdd201700 1 -- 172.21.15.81:0/1200065682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 msgr2=0x558f2a9cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdd201700 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 0x558f2a9cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdd201700 1 -- 172.21.15.81:0/1200065682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd816ad80 con 0x558f2a96ccc0 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfde203700 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 0x558f2a9b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfdd201700 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a968ec0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x558f2a9b3fd0 tx=0x7fcfc8021050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2aa4b0609a12a50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.552+0000 7fcfb7fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1200065682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8024070 con 0x558f2a96ccc0 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1200065682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfc80138d0 con 0x558f2a96ccc0 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1200065682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcfc8006c90 con 0x558f2a96ccc0 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1200065682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc8000cf0 con 0x558f2a96ccc0 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfe8f5eb80 10 client.8196 fetch_fsmap learned FSMap version 83 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1200065682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x558f2a871470 con 0x558f2a96ccc0 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1200065682 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80138d0 con 0x558f2a96ccc0 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1200065682 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcfc801fd20 con 0x558f2a96ccc0 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfe8f5eb80 10 client.8196 fetch_fsmap finished waiting for FSMap version 83 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfe8f5eb80 10 client.8196 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfe8f5eb80 20 client.8196 populate_metadata read hostname 'smithi081' 2023-10-06T02:55:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] conn(0x558f2a9b1410 0x558f2a9b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfe8f5eb80 4 client.8196 mds_command: new command op to 8034 tid=0[{"prefix": "status"}] 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1200065682 --> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558f2a85ee00 con 0x558f2a9b1410 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] conn(0x558f2a9b1410 0x558f2a9b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfb7fff700 10 client.8196 ms_handle_connect on v2:172.21.15.81:6834/70519905 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.553+0000 7fcfdda02700 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] conn(0x558f2a9b1410 0x558f2a9b17e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631fe053f7038234 server_cookie=7e5514980e23c76a in_seq=0 out_seq=0 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfb7fff700 1 -- 172.21.15.81:0/1200065682 <== mds.0 v2:172.21.15.81:6834/70519905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x558f2a85ee00 con 0x558f2a9b1410 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfb7fff700 10 client.8196 handle_command_reply: tid=0 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 client.8196 shutdown 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1200065682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 msgr2=0x558f2a968ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a968ec0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x558f2a9b3fd0 tx=0x7fcfc8021050 comp rx=0 tx=0).stop 2023-10-06T02:55:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1200065682 shutdown_connections 2023-10-06T02:55:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.81:6834/70519905,v1:172.21.15.81:6835/70519905] conn(0x558f2a9b1410 0x558f2a9b17e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558f2a9bbc00 0x558f2a9b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfb7fff700 0 client.8196 ms_handle_reset on v2:172.21.15.81:6834/70519905 2023-10-06T02:55:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f2a96b840 0x558f2a9cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 --2- 172.21.15.81:0/1200065682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f2a96ccc0 0x558f2a968ec0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1200065682 >> 172.21.15.81:0/1200065682 conn(0x558f2a96d160 msgr2=0x558f2a9b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1200065682 shutdown_connections 2023-10-06T02:55:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 1 -- 172.21.15.81:0/1200065682 wait complete. 2023-10-06T02:55:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfe8f5eb80 20 client.8196 trim_cache size 0 max 16384 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8034, 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.7931632869999996, 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 83, 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 165, 2023-10-06T02:55:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 165, 2023-10-06T02:55:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.920139676 2023-10-06T02:55:53.567 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfdfc66700 1 -- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcfbc066f30 msgr2=0x7fcfbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfdfc66700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcfbc066f30 0x7fcfbc0693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400afd0 tx=0x7fcfd4016000 comp rx=0 tx=0).stop 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfdfc66700 1 -- 172.21.15.81:0/3351785083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd80c7d90 msgr2=0x7fcfd8153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.554+0000 7fcfdfc66700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd80c7d90 0x7fcfd8153820 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8063f70 tx=0x7fcfd0007d30 comp rx=0 tx=0).stop 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.555+0000 7fcfdfc66700 1 -- 172.21.15.81:0/3351785083 shutdown_connections 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.555+0000 7fcfdfc66700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd80c7d90 0x7fcfd8153820 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.555+0000 7fcfdfc66700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfc4003a60 0x7fcfd816a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.555+0000 7fcfdfc66700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcfbc066f30 0x7fcfbc0693e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.555+0000 7fcfdfc66700 1 --2- 172.21.15.81:0/3351785083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfd815dc90 0x7fcfd80c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.555+0000 7fcfdfc66700 1 -- 172.21.15.81:0/3351785083 >> 172.21.15.81:0/3351785083 conn(0x7fcfd806bb90 msgr2=0x7fcfd8154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.555+0000 7fcfdfc66700 1 -- 172.21.15.81:0/3351785083 shutdown_connections 2023-10-06T02:55:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.555+0000 7fcfdfc66700 1 -- 172.21.15.81:0/3351785083 wait complete. 2023-10-06T02:55:53.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:55:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.681+0000 7f31d794b700 1 Processor -- start 2023-10-06T02:55:53.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.681+0000 7f31d794b700 1 -- start start 2023-10-06T02:55:53.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.682+0000 7f31d794b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d006dd60 0x7f31d00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.682+0000 7f31d794b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d00b0ca0 con 0x7f31d015a2a0 2023-10-06T02:55:53.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.682+0000 7f31d794b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d00b00d0 con 0x7f31d00cf240 2023-10-06T02:55:53.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.682+0000 7f31d794b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d006ea90 con 0x7f31d006dd60 2023-10-06T02:55:53.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.682+0000 7f31d56e7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f31d015a2a0 0x7f31d00ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33126/0 (socket says 172.21.15.81:33126) 2023-10-06T02:55:53.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.682+0000 7f31d56e7700 1 -- 172.21.15.81:0/1261582353 learned_addr learned my addr 172.21.15.81:0/1261582353 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:53.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d5ee8700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d006dd60 0x7f31d00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015472756 0 0) 0x7f31d00b0ca0 con 0x7f31d015a2a0 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31bc003570 con 0x7f31d015a2a0 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190710249 0 0) 0x7f31d00b00d0 con 0x7f31d00cf240 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d00b0ca0 con 0x7f31d00cf240 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3884504380 0 0) 0x7f31bc003570 con 0x7f31d015a2a0 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d006dd60 msgr2=0x7f31d00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d006dd60 0x7f31d00b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 >> v1:172.21.15.83:6789/0 conn(0x7f31d00cf240 legacy=0x7f31d006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00b0370 con 0x7f31d015a2a0 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f31cc001470 con 0x7f31d015a2a0 2023-10-06T02:55:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 >> v1:172.21.15.81:6789/0 conn(0x7f31d015a2a0 legacy=0x7f31d00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31bc003c20 0x7f31bc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31bc004810 0x7f31bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31bc0051c0 0x7f31bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d006ea90 con 0x7f31bc0051c0 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc00c080 con 0x7f31bc003c20 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc00c240 con 0x7f31bc004810 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d5ee8700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d006dd60 0x7f31d00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d56e7700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31bc003c20 0x7f31bc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d5ee8700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31bc0051c0 0x7f31bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d4ee6700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31bc004810 0x7f31bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d5ee8700 1 -- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31bc004810 msgr2=0x7f31bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d5ee8700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31bc004810 0x7f31bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d5ee8700 1 -- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31bc003c20 msgr2=0x7f31bc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d5ee8700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31bc003c20 0x7f31bc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.683+0000 7f31d5ee8700 1 -- 172.21.15.81:0/1261582353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc003570 con 0x7f31bc0051c0 2023-10-06T02:55:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31d5ee8700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31bc0051c0 0x7f31bc00ba60 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f31d006e130 tx=0x7f31c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39fd4fdf634f4fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c800eaa0 con 0x7f31bc0051c0 2023-10-06T02:55:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c800f040 con 0x7f31bc0051c0 2023-10-06T02:55:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31c7fff700 1 -- 172.21.15.81:0/1261582353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c800ee30 con 0x7f31bc0051c0 2023-10-06T02:55:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31d794b700 1 -- 172.21.15.81:0/1261582353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31bc0051c0 msgr2=0x7f31bc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31d794b700 1 --2- 172.21.15.81:0/1261582353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31bc0051c0 0x7f31bc00ba60 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f31d006e130 tx=0x7f31c800b040 comp rx=0 tx=0).stop 2023-10-06T02:55:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31d5ee8700 1 -- 172.21.15.81:0/1261582353 reap_dead start 2023-10-06T02:55:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31d794b700 1 -- 172.21.15.81:0/1261582353 shutdown_connections 2023-10-06T02:55:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31d794b700 1 -- 172.21.15.81:0/1261582353 >> 172.21.15.81:0/1261582353 conn(0x7f31d0067640 msgr2=0x7f31d0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31d794b700 1 -- 172.21.15.81:0/1261582353 shutdown_connections 2023-10-06T02:55:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.684+0000 7f31d794b700 1 -- 172.21.15.81:0/1261582353 wait complete. 2023-10-06T02:55:53.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.685+0000 7f31d794b700 1 Processor -- start 2023-10-06T02:55:53.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.685+0000 7f31d794b700 1 -- start start 2023-10-06T02:55:53.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.686+0000 7f31d794b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31d014f3f0 0x7f31d014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.686+0000 7f31d794b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d016a960 0x7f31d00b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.686+0000 7f31d794b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31d0158be0 0x7f31d0159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.686+0000 7f31d794b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00b3040 con 0x7f31d0158be0 2023-10-06T02:55:53.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.686+0000 7f31d794b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0159590 con 0x7f31d014f3f0 2023-10-06T02:55:53.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.686+0000 7f31d794b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d016b980 con 0x7f31d016a960 2023-10-06T02:55:53.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.686+0000 7f31d5ee8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31d0158be0 0x7f31d0159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.686+0000 7f31d5ee8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31d0158be0 0x7f31d0159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33102/0 (socket says 172.21.15.81:33102) 2023-10-06T02:55:53.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.686+0000 7f31d5ee8700 1 -- 172.21.15.81:0/1724262947 learned_addr learned my addr 172.21.15.81:0/1724262947 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:53.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d4ee6700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d016a960 0x7f31d00b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d56e7700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31d014f3f0 0x7f31d014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d5ee8700 1 -- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d016a960 msgr2=0x7f31d00b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d5ee8700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d016a960 0x7f31d00b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d5ee8700 1 -- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31d014f3f0 msgr2=0x7f31d014fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d5ee8700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31d014f3f0 0x7f31d014fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d5ee8700 1 -- 172.21.15.81:0/1724262947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d015a830 con 0x7f31d0158be0 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d5ee8700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31d0158be0 0x7f31d0159050 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f31c80099f0 tx=0x7f31c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31c57fa700 1 -- 172.21.15.81:0/1724262947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8014d50 con 0x7f31d0158be0 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31c57fa700 1 -- 172.21.15.81:0/1724262947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c8028470 con 0x7f31d0158be0 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d015c540 con 0x7f31d0158be0 2023-10-06T02:55:53.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31c57fa700 1 -- 172.21.15.81:0/1724262947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8028830 con 0x7f31d0158be0 2023-10-06T02:55:53.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.687+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d016b3c0 con 0x7f31d0158be0 2023-10-06T02:55:53.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.688+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d015a9c0 con 0x7f31d0158be0 2023-10-06T02:55:53.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.688+0000 7f31c57fa700 1 -- 172.21.15.81:0/1724262947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31c8025070 con 0x7f31d0158be0 2023-10-06T02:55:53.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.689+0000 7f31c57fa700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31b4066f60 0x7f31b4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.689+0000 7f31c57fa700 1 -- 172.21.15.81:0/1724262947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f31c8086680 con 0x7f31d0158be0 2023-10-06T02:55:53.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.689+0000 7f31d56e7700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31b4066f60 0x7f31b4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.690+0000 7f31d56e7700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31b4066f60 0x7f31b4069410 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f31cc001bd0 tx=0x7f31cc001d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.693+0000 7f31c57fa700 1 -- 172.21.15.81:0/1724262947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31c8053790 con 0x7f31d0158be0 2023-10-06T02:55:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.925+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f31d00b38f0 con 0x7f31d0158be0 2023-10-06T02:55:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.926+0000 7f31c57fa700 1 -- 172.21.15.81:0/1724262947 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31c8084e60 con 0x7f31d0158be0 2023-10-06T02:55:53.928 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:55:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31b4066f60 msgr2=0x7f31b4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31b4066f60 0x7f31b4069410 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f31cc001bd0 tx=0x7f31cc001d40 comp rx=0 tx=0).stop 2023-10-06T02:55:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31d0158be0 msgr2=0x7f31d0159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31d0158be0 0x7f31d0159050 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f31c80099f0 tx=0x7f31c8016000 comp rx=0 tx=0).stop 2023-10-06T02:55:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 shutdown_connections 2023-10-06T02:55:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31d0158be0 0x7f31d0159050 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f31b4066f60 0x7f31b4069410 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31d014f3f0 0x7f31d014fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 --2- 172.21.15.81:0/1724262947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f31d016a960 0x7f31d00b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 >> 172.21.15.81:0/1724262947 conn(0x7f31d0067640 msgr2=0x7f31d0160910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 shutdown_connections 2023-10-06T02:55:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:53.928+0000 7f31d794b700 1 -- 172.21.15.81:0/1724262947 wait complete. 2023-10-06T02:55:53.942 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:55:53.942 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:55:53.942 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:55:53.942 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:55:53.942 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:55:53.942 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:55:53.943 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:55:53.943 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:55:53.943 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:55:53.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:53.943 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:55:53.958 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:53.959 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:55:53.959 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 41963sec preferred_lft 41963sec 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:53.960 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:55:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:55:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:53.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:53.962 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:55:54.022 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:55:54.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:54.023 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:55:54.080 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:55:54.080 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:55:54.081 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:55:54.081 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:55:54.081 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:55:54.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:54.081 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:55:54.081 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:55:54.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:55:54.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:55:54.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:55:54.082 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:55:54.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:54.180 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:55:54.194 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:55:54.195 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:55:54.195 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:55:54.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:54.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:55:54.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:54.259 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:55:54.313 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:55:54.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:54.314 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:55:54.368 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:55:54.368 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:55:54.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:55:54.447 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:55:54.448 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:55:54.467 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:55:54.468 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:55:54.468 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:55:54.468 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:55:54.468 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:55:54.469 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:55:54.469 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:55:54.469 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:54.489 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:55:54.489 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:55:54.489 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:55:54.489 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:55:54.489 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:55:54.490 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:55:54.490 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:55:54.490 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:54.491 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:55:54.491 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:55:54.491 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:55:54.492 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:55:54.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:54.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:55:54.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:55:54.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.709+0000 7f140f611700 1 Processor -- start 2023-10-06T02:55:54.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.709+0000 7f140f611700 1 -- start start 2023-10-06T02:55:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.710+0000 7f140f611700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f140806d830 0x7f14080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.710+0000 7f140f611700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14080d07c0 con 0x7f1408157ca0 2023-10-06T02:55:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.710+0000 7f140f611700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14080cfbb0 con 0x7f14081578d0 2023-10-06T02:55:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.710+0000 7f140f611700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14080cfe90 con 0x7f140806d830 2023-10-06T02:55:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.710+0000 7f140cbac700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1408157ca0 0x7f140806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33136/0 (socket says 172.21.15.81:33136) 2023-10-06T02:55:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.710+0000 7f140cbac700 1 -- 172.21.15.81:0/598141026 learned_addr learned my addr 172.21.15.81:0/598141026 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.710+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362596068 0 0) 0x7f14080d07c0 con 0x7f1408157ca0 2023-10-06T02:55:54.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.710+0000 7f140dbae700 1 --2- 172.21.15.81:0/598141026 >> v2:172.21.15.83:3300/0 conn(0x7f140806d830 0x7f14080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.710+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f4003570 con 0x7f1408157ca0 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2403562200 0 0) 0x7f13f4003570 con 0x7f1408157ca0 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 >> v2:172.21.15.83:3300/0 conn(0x7f140806d830 msgr2=0x7f14080cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 --2- 172.21.15.81:0/598141026 >> v2:172.21.15.83:3300/0 conn(0x7f140806d830 0x7f14080cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 >> v1:172.21.15.83:6789/0 conn(0x7f14081578d0 legacy=0x7f140815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080d0170 con 0x7f1408157ca0 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f13f8001470 con 0x7f1408157ca0 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 >> v1:172.21.15.81:6789/0 conn(0x7f1408157ca0 legacy=0x7f140806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f4003a60 0x7f13f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13f4004810 0x7f13f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13f40051c0 0x7f13f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080cfe90 con 0x7f13f4003a60 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f400c050 con 0x7f13f4004810 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f400c210 con 0x7f13f40051c0 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140d3ad700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f4003a60 0x7f13f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140cbac700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13f4004810 0x7f13f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140dbae700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13f40051c0 0x7f13f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140d3ad700 1 -- 172.21.15.81:0/598141026 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13f40051c0 msgr2=0x7f13f400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140d3ad700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13f40051c0 0x7f13f400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140d3ad700 1 -- 172.21.15.81:0/598141026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13f4004810 msgr2=0x7f13f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140d3ad700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13f4004810 0x7f13f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140d3ad700 1 -- 172.21.15.81:0/598141026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4003570 con 0x7f13f4003a60 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140dbae700 1 -- 172.21.15.81:0/598141026 reap_dead start 2023-10-06T02:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f140d3ad700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f4003a60 0x7f13f4003e30 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f14040019a0 tx=0x7f1404007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1446cc571707ec99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400c5d0 con 0x7f13f4003a60 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140400c750 con 0x7f13f4003a60 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.711+0000 7f13fffff700 1 -- 172.21.15.81:0/598141026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400cb10 con 0x7f13f4003a60 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.712+0000 7f140f611700 1 -- 172.21.15.81:0/598141026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f4003a60 msgr2=0x7f13f4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.712+0000 7f140f611700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f4003a60 0x7f13f4003e30 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f14040019a0 tx=0x7f1404007d10 comp rx=0 tx=0).stop 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.712+0000 7f140f611700 1 -- 172.21.15.81:0/598141026 shutdown_connections 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.712+0000 7f140f611700 1 --2- 172.21.15.81:0/598141026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f4003a60 0x7f13f4003e30 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.712+0000 7f140f611700 1 -- 172.21.15.81:0/598141026 >> 172.21.15.81:0/598141026 conn(0x7f140806bb90 msgr2=0x7f140806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.712+0000 7f140f611700 1 -- 172.21.15.81:0/598141026 shutdown_connections 2023-10-06T02:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.712+0000 7f140f611700 1 -- 172.21.15.81:0/598141026 wait complete. 2023-10-06T02:55:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.713+0000 7f140f611700 1 Processor -- start 2023-10-06T02:55:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.713+0000 7f140f611700 1 -- start start 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140f611700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13f4003a60 0x7f14080cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140f611700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14080b5eb0 0x7f14080c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140f611700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14080b6300 0x7f14080c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140f611700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080c92d0 con 0x7f14080b5eb0 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140f611700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080c94d0 con 0x7f14080b6300 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140f611700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14080cc500 con 0x7f13f4003a60 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140cbac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14080b5eb0 0x7f14080c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140cbac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14080b5eb0 0x7f14080c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33112/0 (socket says 172.21.15.81:33112) 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140cbac700 1 -- 172.21.15.81:0/2962583601 learned_addr learned my addr 172.21.15.81:0/2962583601 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140d3ad700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13f4003a60 0x7f14080cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140dbae700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14080b6300 0x7f14080c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140cbac700 1 -- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13f4003a60 msgr2=0x7f14080cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140cbac700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13f4003a60 0x7f14080cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140cbac700 1 -- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14080b6300 msgr2=0x7f14080c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140cbac700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14080b6300 0x7f14080c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.714+0000 7f140cbac700 1 -- 172.21.15.81:0/2962583601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080cbbd0 con 0x7f14080b5eb0 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.715+0000 7f140cbac700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14080b5eb0 0x7f14080c8850 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f13f80073f0 tx=0x7f13f8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.715+0000 7f13fd7fa700 1 -- 172.21.15.81:0/2962583601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8018030 con 0x7f14080b5eb0 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.715+0000 7f13fd7fa700 1 -- 172.21.15.81:0/2962583601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f80077d0 con 0x7f14080b5eb0 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.715+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14080cbeb0 con 0x7f14080b5eb0 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.715+0000 7f13fd7fa700 1 -- 172.21.15.81:0/2962583601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f800fa20 con 0x7f14080b5eb0 2023-10-06T02:55:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.715+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14080c5b20 con 0x7f14080b5eb0 2023-10-06T02:55:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.716+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1408067ac0 con 0x7f14080b5eb0 2023-10-06T02:55:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.716+0000 7f13fd7fa700 1 -- 172.21.15.81:0/2962583601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13f801b070 con 0x7f14080b5eb0 2023-10-06T02:55:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.717+0000 7f13fd7fa700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13ec066f30 0x7f13ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.717+0000 7f13fd7fa700 1 -- 172.21.15.81:0/2962583601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13f8019070 con 0x7f14080b5eb0 2023-10-06T02:55:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.717+0000 7f140d3ad700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13ec066f30 0x7f13ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.717+0000 7f140d3ad700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13ec066f30 0x7f13ec0693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1404001410 tx=0x7f1404015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.721+0000 7f13fd7fa700 1 -- 172.21.15.81:0/2962583601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13f80515d0 con 0x7f14080b5eb0 2023-10-06T02:55:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.946+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14080cc640 con 0x7f14080b5eb0 2023-10-06T02:55:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.946+0000 7f13fd7fa700 1 -- 172.21.15.81:0/2962583601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) v1 ==== 53+0+73 (secure 0 0 0) 0x7f13f8054bf0 con 0x7f14080b5eb0 2023-10-06T02:55:54.949 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13ec066f30 msgr2=0x7f13ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13ec066f30 0x7f13ec0693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1404001410 tx=0x7f1404015000 comp rx=0 tx=0).stop 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14080b5eb0 msgr2=0x7f14080c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14080b5eb0 0x7f14080c8850 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f13f80073f0 tx=0x7f13f8001e70 comp rx=0 tx=0).stop 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 shutdown_connections 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13ec066f30 0x7f13ec0693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14080b6300 0x7f14080c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13f4003a60 0x7f14080cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 --2- 172.21.15.81:0/2962583601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14080b5eb0 0x7f14080c8850 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 >> 172.21.15.81:0/2962583601 conn(0x7f140806bb90 msgr2=0x7f1408155af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 shutdown_connections 2023-10-06T02:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:54.948+0000 7f140f611700 1 -- 172.21.15.81:0/2962583601 wait complete. 2023-10-06T02:55:54.962 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:55:54.962 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:55:54.962 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:55:54.962 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:55:54.963 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:55:54.963 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:55:54.963 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:55:54.963 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:55:54.963 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:55:54.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:54.963 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:55:54.982 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:54.983 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:54.983 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:54.983 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:54.983 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:54.983 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:54.983 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:54.983 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:54.984 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:55:54.984 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:54.984 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:54.984 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:55:54.984 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:54.984 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:54.984 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:55:54.985 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:54.985 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:55:54.985 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 41962sec preferred_lft 41962sec 2023-10-06T02:55:54.985 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:55:54.985 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:54.986 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:55:54.986 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:54.986 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:55:54.986 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:54.986 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:55:54.986 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:54.987 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:55:54.987 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:55:54.987 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:55:54.987 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:54.987 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:55:54.987 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:55:54.987 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:55:54.988 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:54.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:54.988 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:55:55.051 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:55:55.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:55.052 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:55:55.110 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:55:55.111 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:55:55.111 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:55:55.111 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:55:55.111 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:55:55.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:55.111 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:55:55.112 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:55:55.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:55:55.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:55:55.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:55:55.112 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:55:55.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:55.216 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:55:55.231 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:55:55.231 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:55:55.231 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:55:55.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:55.231 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:55:55.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:55.295 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:55:55.351 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:55:55.351 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:55.351 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:55:55.405 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:55:55.405 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:55:55.484 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:55:55.484 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:55:55.503 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:55:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:55:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:55:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:55:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:55:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:55:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:55:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:55.525 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:55:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:55:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:55:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:55:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:55:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:55:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:55:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:55:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:55:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:55:55.528 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:55:55.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:55.528 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:55:55.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.707+0000 7f7b3a8b2700 1 Processor -- start 2023-10-06T02:55:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.707+0000 7f7b3a8b2700 1 -- start start 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b3a8b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b341578d0 0x7f7b340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b3a8b2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7b3406d120 0x7f7b3406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b3a8b2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3406dac0 con 0x7f7b34157ca0 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b3a8b2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b340d07c0 con 0x7f7b3406d120 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b3a8b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340cfbb0 con 0x7f7b341578d0 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b337fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7b34157ca0 0x7f7b3415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33144/0 (socket says 172.21.15.81:33144) 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b337fe700 1 -- 172.21.15.81:0/1201841967 learned_addr learned my addr 172.21.15.81:0/1201841967 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792527864 0 0) 0x7f7b1c001110 con 0x7f7b34157ca0 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b20003570 con 0x7f7b34157ca0 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b38e4f700 1 --2- 172.21.15.81:0/1201841967 >> v2:172.21.15.83:3300/0 conn(0x7f7b3406d120 0x7f7b3406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b33fff700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b341578d0 0x7f7b340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3776641041 0 0) 0x7f7b20003570 con 0x7f7b34157ca0 2023-10-06T02:55:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b341578d0 msgr2=0x7f7b340cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b32ffd700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b341578d0 0x7f7b340cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 >> v2:172.21.15.83:3300/0 conn(0x7f7b3406d120 msgr2=0x7f7b3406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b32ffd700 1 --2- 172.21.15.81:0/1201841967 >> v2:172.21.15.83:3300/0 conn(0x7f7b3406d120 0x7f7b3406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340cfe90 con 0x7f7b34157ca0 2023-10-06T02:55:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.708+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f7b1c001600 con 0x7f7b34157ca0 2023-10-06T02:55:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 >> v1:172.21.15.81:6789/0 conn(0x7f7b34157ca0 legacy=0x7f7b3415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b20003a60 0x7f7b20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b341578d0 0x7f7b20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b20004d50 0x7f7b200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340d07c0 con 0x7f7b20004d50 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340cfbb0 con 0x7f7b20003a60 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2000ba60 con 0x7f7b341578d0 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b38e4f700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b20004d50 0x7f7b200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b337fe700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b341578d0 0x7f7b20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b33fff700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b20003a60 0x7f7b20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b38e4f700 1 -- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b341578d0 msgr2=0x7f7b20004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b38e4f700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b341578d0 0x7f7b20004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b38e4f700 1 -- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b20003a60 msgr2=0x7f7b20003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b38e4f700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b20003a60 0x7f7b20003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b38e4f700 1 -- 172.21.15.81:0/1201841967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b20003570 con 0x7f7b20004d50 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b38e4f700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b20004d50 0x7f7b200051c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c00e210 tx=0x7f7b2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8512eae1a5ab9dba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c00ea60 con 0x7f7b20004d50 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c00f040 con 0x7f7b20004d50 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.709+0000 7f7b32ffd700 1 -- 172.21.15.81:0/1201841967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c00ee10 con 0x7f7b20004d50 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.710+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/1201841967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b20004d50 msgr2=0x7f7b200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.710+0000 7f7b3a8b2700 1 --2- 172.21.15.81:0/1201841967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b20004d50 0x7f7b200051c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c00e210 tx=0x7f7b2c00b040 comp rx=0 tx=0).stop 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.710+0000 7f7b38e4f700 1 -- 172.21.15.81:0/1201841967 reap_dead start 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.710+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/1201841967 shutdown_connections 2023-10-06T02:55:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.710+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/1201841967 >> 172.21.15.81:0/1201841967 conn(0x7f7b3406bb90 msgr2=0x7f7b3406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.710+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/1201841967 shutdown_connections 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.710+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/1201841967 wait complete. 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.711+0000 7f7b3a8b2700 1 Processor -- start 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.711+0000 7f7b3a8b2700 1 -- start start 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b3a8b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b34154dd0 0x7f7b340cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b3a8b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b340ccaf0 0x7f7b340c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b3a8b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b340ca060 0x7f7b340c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b3a8b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340ca500 con 0x7f7b34154dd0 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b3a8b2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b34159e20 con 0x7f7b340ca060 2023-10-06T02:55:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b3a8b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340c5bc0 con 0x7f7b340ccaf0 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b33fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b34154dd0 0x7f7b340cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b33fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b34154dd0 0x7f7b340cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33124/0 (socket says 172.21.15.81:33124) 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b33fff700 1 -- 172.21.15.81:0/3035060630 learned_addr learned my addr 172.21.15.81:0/3035060630 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b38e4f700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b340ca060 0x7f7b340c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b337fe700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b340ccaf0 0x7f7b340c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b33fff700 1 -- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b340ccaf0 msgr2=0x7f7b340c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b33fff700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b340ccaf0 0x7f7b340c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b33fff700 1 -- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b340ca060 msgr2=0x7f7b340c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b33fff700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b340ca060 0x7f7b340c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b33fff700 1 -- 172.21.15.81:0/3035060630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340ccf60 con 0x7f7b34154dd0 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b33fff700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b34154dd0 0x7f7b340cbb10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7b24011b10 tx=0x7f7b240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b2bfff700 1 -- 172.21.15.81:0/3035060630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400f9f0 con 0x7f7b34154dd0 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b340cd210 con 0x7f7b34154dd0 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b340c5e60 con 0x7f7b34154dd0 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b2bfff700 1 -- 172.21.15.81:0/3035060630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2400fd60 con 0x7f7b34154dd0 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.712+0000 7f7b2bfff700 1 -- 172.21.15.81:0/3035060630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400fed0 con 0x7f7b34154dd0 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.713+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b34067ac0 con 0x7f7b34154dd0 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.714+0000 7f7b2bfff700 1 -- 172.21.15.81:0/3035060630 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b2401d430 con 0x7f7b34154dd0 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.714+0000 7f7b2bfff700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.714+0000 7f7b2bfff700 1 -- 172.21.15.81:0/3035060630 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7b24018030 con 0x7f7b34154dd0 2023-10-06T02:55:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.714+0000 7f7b337fe700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.714+0000 7f7b337fe700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c007b60 tx=0x7f7b1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.718+0000 7f7b2bfff700 1 -- 172.21.15.81:0/3035060630 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b24052200 con 0x7f7b34154dd0 2023-10-06T02:55:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.953+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b340d0170 con 0x7f7b34154dd0 2023-10-06T02:55:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.953+0000 7f7b2bfff700 1 -- 172.21.15.81:0/3035060630 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f7b24055820 con 0x7f7b34154dd0 2023-10-06T02:55:55.956 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:55:55.956 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4037385194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4037385194},{"type":"v1","addr":"172.21.15.83:6837","nonce":4037385194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2052186081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2052186081},{"type":"v1","addr":"172.21.15.83:6836","nonce":2052186081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2641977500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2641977500},{"type":"v1","addr":"172.21.15.81:6833","nonce":2641977500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:47.127871+0000","modified":"2023-10-06T02:55:50.779474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/70519905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":70519905},{"type":"v1","addr":"172.21.15.81:6835","nonce":70519905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T02:55:55.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 msgr2=0x7f7b140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c007b60 tx=0x7f7b1c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b34154dd0 msgr2=0x7f7b340cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b34154dd0 0x7f7b340cbb10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7b24011b10 tx=0x7f7b240091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 shutdown_connections 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7b14066f30 0x7f7b140693e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b340ca060 0x7f7b340c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b34154dd0 0x7f7b340cbb10 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 --2- 172.21.15.81:0/3035060630 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b340ccaf0 0x7f7b340c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 >> 172.21.15.81:0/3035060630 conn(0x7f7b3406bb90 msgr2=0x7f7b34156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 shutdown_connections 2023-10-06T02:55:55.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:55.955+0000 7f7b3a8b2700 1 -- 172.21.15.81:0/3035060630 wait complete. 2023-10-06T02:55:55.959 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2023-10-06T02:55:55.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:55:56.101 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":8034,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3288445590000002,"mdsmap_epoch":83,"osdmap_epoch":166,"osdmap_epoch_barrier":165,"uptime":14.455826169} 2023-10-06T02:55:56.102 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 8034, "mdsmap_epoch": 83, "osdmap_epoch": 166, "osdmap_epoch_barrier": 165, "rank_uptime": 8.328844559, "state": "up:active", "uptime": 14.455826169, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:55:56.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-06T02:55:56.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.218+0000 7fd50337f700 1 Processor -- start 2023-10-06T02:55:56.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.218+0000 7fd50337f700 1 -- start start 2023-10-06T02:55:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd50337f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc0d0b80 0x7fd4fc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd50337f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd4fc06d700 0x7fd4fc15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd50337f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc0cf2d0 con 0x7fd4fc0d02b0 2023-10-06T02:55:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd50337f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc15a690 con 0x7fd4fc06d700 2023-10-06T02:55:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd50337f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc06dc00 con 0x7fd4fc0d0b80 2023-10-06T02:55:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd50237d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc0d0b80 0x7fd4fc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd502b7e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd4fc06d700 0x7fd4fc15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd50237d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc0d0b80 0x7fd4fc0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:57748/0 (socket says 172.21.15.81:57748) 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd502b7e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd4fc06d700 0x7fd4fc15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:41618/0 (socket says 172.21.15.81:41618) 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd50237d700 1 -- 172.21.15.81:0/3251775040 learned_addr learned my addr 172.21.15.81:0/3251775040 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.219+0000 7fd501b7c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd4fc0d02b0 0x7fd4fc06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:35806/0 (socket says 172.21.15.81:35806) 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.220+0000 7fd50237d700 1 -- 172.21.15.81:0/3251775040 >> v2:172.21.15.83:3300/0 conn(0x7fd4fc06d700 msgr2=0x7fd4fc15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.220+0000 7fd50237d700 1 --2- 172.21.15.81:0/3251775040 >> v2:172.21.15.83:3300/0 conn(0x7fd4fc06d700 0x7fd4fc15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.220+0000 7fd50237d700 1 -- 172.21.15.81:0/3251775040 >> v1:172.21.15.83:6789/0 conn(0x7fd4fc0d02b0 legacy=0x7fd4fc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.220+0000 7fd50237d700 1 -- 172.21.15.81:0/3251775040 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0cf570 con 0x7fd4fc0d0b80 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.220+0000 7fd502b7e700 1 --2- 172.21.15.81:0/3251775040 >> v2:172.21.15.83:3300/0 conn(0x7fd4fc06d700 0x7fd4fc15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.220+0000 7fd50237d700 1 --2- 172.21.15.81:0/3251775040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc0d0b80 0x7fd4fc0cfd70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80099b0 tx=0x7fd4f8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1dfac831ff24ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.220+0000 7fd50137b700 1 -- 172.21.15.81:0/3251775040 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8009ea0 con 0x7fd4fc0d0b80 2023-10-06T02:55:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.220+0000 7fd50137b700 1 -- 172.21.15.81:0/3251775040 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f800b860 con 0x7fd4fc0d0b80 2023-10-06T02:55:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.220+0000 7fd50137b700 1 -- 172.21.15.81:0/3251775040 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f800bc00 con 0x7fd4fc0d0b80 2023-10-06T02:55:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.221+0000 7fd50337f700 1 -- 172.21.15.81:0/3251775040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc0d0b80 msgr2=0x7fd4fc0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.221+0000 7fd50337f700 1 --2- 172.21.15.81:0/3251775040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc0d0b80 0x7fd4fc0cfd70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80099b0 tx=0x7fd4f8009250 comp rx=0 tx=0).stop 2023-10-06T02:55:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.221+0000 7fd50337f700 1 -- 172.21.15.81:0/3251775040 shutdown_connections 2023-10-06T02:55:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.221+0000 7fd50337f700 1 --2- 172.21.15.81:0/3251775040 >> v2:172.21.15.83:3300/0 conn(0x7fd4fc06d700 0x7fd4fc15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.221+0000 7fd50337f700 1 --2- 172.21.15.81:0/3251775040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc0d0b80 0x7fd4fc0cfd70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.221+0000 7fd50337f700 1 -- 172.21.15.81:0/3251775040 >> 172.21.15.81:0/3251775040 conn(0x7fd4fc063230 msgr2=0x7fd4fc063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.221+0000 7fd50337f700 1 -- 172.21.15.81:0/3251775040 shutdown_connections 2023-10-06T02:55:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.221+0000 7fd50337f700 1 -- 172.21.15.81:0/3251775040 wait complete. 2023-10-06T02:55:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.222+0000 7fd50337f700 1 Processor -- start 2023-10-06T02:55:56.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.222+0000 7fd50337f700 1 -- start start 2023-10-06T02:55:56.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50337f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc06d700 0x7fd4fc16af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50337f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4fc0d02b0 0x7fd4fc153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50337f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4fc0d0b80 0x7fd4fc150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50337f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc153f70 con 0x7fd4fc0d02b0 2023-10-06T02:55:56.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50337f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc16c1e0 con 0x7fd4fc0d0b80 2023-10-06T02:55:56.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50337f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc16b8b0 con 0x7fd4fc06d700 2023-10-06T02:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd501b7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4fc0d02b0 0x7fd4fc153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50237d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc06d700 0x7fd4fc16af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd501b7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4fc0d02b0 0x7fd4fc153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33130/0 (socket says 172.21.15.81:33130) 2023-10-06T02:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd501b7c700 1 -- 172.21.15.81:0/1011222634 learned_addr learned my addr 172.21.15.81:0/1011222634 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:55:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd502b7e700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4fc0d0b80 0x7fd4fc150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50237d700 1 -- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4fc0d0b80 msgr2=0x7fd4fc150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50237d700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4fc0d0b80 0x7fd4fc150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50237d700 1 -- 172.21.15.81:0/1011222634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4fc0d02b0 msgr2=0x7fd4fc153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50237d700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4fc0d02b0 0x7fd4fc153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50237d700 1 -- 172.21.15.81:0/1011222634 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4009a20 con 0x7fd4fc06d700 2023-10-06T02:55:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd501b7c700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4fc0d02b0 0x7fd4fc153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50237d700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc06d700 0x7fd4fc16af40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc06e810 tx=0x7fd4f8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd4f27fc700 1 -- 172.21.15.81:0/1011222634 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f800bbe0 con 0x7fd4fc06d700 2023-10-06T02:55:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd4f27fc700 1 -- 172.21.15.81:0/1011222634 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f801a450 con 0x7fd4fc06d700 2023-10-06T02:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f80094f0 con 0x7fd4fc06d700 2023-10-06T02:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd4f27fc700 1 -- 172.21.15.81:0/1011222634 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f801a7f0 con 0x7fd4fc06d700 2023-10-06T02:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.223+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc16be70 con 0x7fd4fc06d700 2023-10-06T02:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.224+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc0676e0 con 0x7fd4fc06d700 2023-10-06T02:55:56.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.225+0000 7fd4f27fc700 1 -- 172.21.15.81:0/1011222634 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4f801abe0 con 0x7fd4fc06d700 2023-10-06T02:55:56.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.225+0000 7fd4f27fc700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd4e0066f30 0x7fd4e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.225+0000 7fd4f27fc700 1 -- 172.21.15.81:0/1011222634 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd4f8086030 con 0x7fd4fc06d700 2023-10-06T02:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.225+0000 7fd501b7c700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd4e0066f30 0x7fd4e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.226+0000 7fd501b7c700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd4e0066f30 0x7fd4e00693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0b2d60 tx=0x7fd4ec007f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.230+0000 7fd4f27fc700 1 -- 172.21.15.81:0/1011222634 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4f80b75a0 con 0x7fd4fc06d700 2023-10-06T02:55:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.417+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fd4fc06d4e0 con 0x7fd4fc06d700 2023-10-06T02:55:56.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.807+0000 7fd4f27fc700 1 -- 172.21.15.81:0/1011222634 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v167) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd4f8053100 con 0x7fd4fc06d700 2023-10-06T02:55:56.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd4e0066f30 msgr2=0x7fd4e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd4e0066f30 0x7fd4e00693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0b2d60 tx=0x7fd4ec007f70 comp rx=0 tx=0).stop 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc06d700 msgr2=0x7fd4fc16af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc06d700 0x7fd4fc16af40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc06e810 tx=0x7fd4f8017000 comp rx=0 tx=0).stop 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 shutdown_connections 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd4e0066f30 0x7fd4e00693e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4fc0d0b80 0x7fd4fc150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd4fc06d700 0x7fd4fc16af40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 --2- 172.21.15.81:0/1011222634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4fc0d02b0 0x7fd4fc153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 >> 172.21.15.81:0/1011222634 conn(0x7fd4fc063230 msgr2=0x7fd4fc156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:56.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 shutdown_connections 2023-10-06T02:55:56.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:55:56.810+0000 7fd50337f700 1 -- 172.21.15.81:0/1011222634 wait complete. 2023-10-06T02:55:56.814 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-06T02:55:56.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-06T02:55:56.954 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-06T02:55:56.955 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-06T02:55:56.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-06T02:55:57.076 INFO:teuthology.orchestra.run.smithi081.stdout:{"mon_tick_interval":"5"} 2023-10-06T02:55:57.077 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-06T02:55:57.077 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-06T02:55:57.077 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:55:57.077 DEBUG:teuthology.orchestra.run.smithi081:> import time 2023-10-06T02:55:57.077 DEBUG:teuthology.orchestra.run.smithi081:> import datetime 2023-10-06T02:55:57.077 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-10-06T02:55:57.077 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T02:55:57.077 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> # Write some buffered data through before going full, all should be well 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> print("writing some data through which we expect to succeed") 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> bytes = 0 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-06T02:55:57.078 DEBUG:teuthology.orchestra.run.smithi081:> # buffered IO, the error should always only appear from fsync and not 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> # from write 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> full = False 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(32 * 1.1)): 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> raise 2023-10-06T02:55:57.079 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> full = True 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> break 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed successfully") 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> full = True 2023-10-06T02:55:57.080 DEBUG:teuthology.orchestra.run.smithi081:> break 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> if n > 32 * 0.9: 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> # Be cautious in the last region where we expect to hit 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(15.0) 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> if not full: 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-06T02:55:57.081 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:55:57.082 DEBUG:teuthology.orchestra.run.smithi081:> # close() should not raise an error because we already caught it in 2023-10-06T02:55:57.082 DEBUG:teuthology.orchestra.run.smithi081:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-06T02:55:57.082 DEBUG:teuthology.orchestra.run.smithi081:> # since then because all IOs got cancelled on the full flag. 2023-10-06T02:55:57.082 DEBUG:teuthology.orchestra.run.smithi081:> print("calling close") 2023-10-06T02:55:57.082 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-06T02:55:57.082 DEBUG:teuthology.orchestra.run.smithi081:> print("close() did not raise error") 2023-10-06T02:55:57.082 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T02:55:57.082 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-06T02:55:57.082 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T02:56:07.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:56:07.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:56:37.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:56:37.902 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:01.801 INFO:teuthology.orchestra.run.smithi081.stdout:writing some data through which we expect to succeed 2023-10-06T02:57:01.801 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-06T02:57:01.801 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.801 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.801 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 1.00 MB 2023-10-06T02:57:01.801 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 2.00 MB 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 3.00 MB 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 4.00 MB 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.802 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 5.00 MB 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 6.00 MB 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 7.00 MB 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 8.00 MB 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 9.00 MB 2023-10-06T02:57:01.803 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 10.00 MB 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 11.00 MB 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 12.00 MB 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 13.00 MB 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 14.00 MB 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 15.00 MB 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 16.00 MB 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 17.00 MB 2023-10-06T02:57:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 18.00 MB 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 19.00 MB 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 20.00 MB 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.806 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 21.00 MB 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 22.00 MB 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 23.00 MB 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 24.00 MB 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.807 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 25.00 MB 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 26.00 MB 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 27.00 MB 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 28.00 MB 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.808 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 29.00 MB 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 30.00 MB 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 31.00 MB 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 32.00 MB 2023-10-06T02:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-06T02:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-06T02:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 33.00 MB 2023-10-06T02:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-06T02:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:Reached fullness after 33.00 MB 2023-10-06T02:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:calling close 2023-10-06T02:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:close() did not raise error 2023-10-06T02:57:01.824 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:57:01.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:01.870 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:01.913 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:57:01.913 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:57:01.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:01.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:01.956 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:57:01.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:01.956 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:57:02.014 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:57:02.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:02.014 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:57:02.059 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:57:02.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:02.059 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:57:02.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:02.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.234+0000 7fe097fff700 1 Processor -- start 2023-10-06T02:57:02.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.234+0000 7fe097fff700 1 -- start start 2023-10-06T02:57:02.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe097fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe098159f10 0x7fe098068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe097fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098068cc0 0x7fe0980cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe097fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0980cee10 con 0x7fe098159b40 2023-10-06T02:57:02.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe097fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe098069140 con 0x7fe098159f10 2023-10-06T02:57:02.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe097fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0980cd040 con 0x7fe098068cc0 2023-10-06T02:57:02.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe096ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe098159b40 0x7fe0980cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54706/0 (socket says 172.21.15.81:54706) 2023-10-06T02:57:02.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe096ffd700 1 -- 172.21.15.81:0/4163047669 learned_addr learned my addr 172.21.15.81:0/4163047669 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:02.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe08e7fc700 1 --2- 172.21.15.81:0/4163047669 >> v2:172.21.15.83:3300/0 conn(0x7fe098159f10 0x7fe098068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe0977fe700 1 --2- 172.21.15.81:0/4163047669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098068cc0 0x7fe0980cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe0967fc700 1 -- 172.21.15.81:0/4163047669 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606064910 0 0) 0x7fe0980cee10 con 0x7fe098159b40 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.235+0000 7fe0967fc700 1 -- 172.21.15.81:0/4163047669 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe084003570 con 0x7fe098159b40 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe08e7fc700 1 -- 172.21.15.81:0/4163047669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098068cc0 msgr2=0x7fe0980cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe08e7fc700 1 --2- 172.21.15.81:0/4163047669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098068cc0 0x7fe0980cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe0967fc700 1 -- 172.21.15.81:0/4163047669 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3818858018 0 0) 0x7fe084003570 con 0x7fe098159b40 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe08e7fc700 1 -- 172.21.15.81:0/4163047669 >> v1:172.21.15.81:6789/0 conn(0x7fe098159b40 legacy=0x7fe0980cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe08e7fc700 1 -- 172.21.15.81:0/4163047669 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980cd320 con 0x7fe098159f10 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe08e7fc700 1 --2- 172.21.15.81:0/4163047669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159f10 0x7fe098068780 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe0800098e0 tx=0x7fe0800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88f11928f59398dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe0967fc700 1 -- 172.21.15.81:0/4163047669 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088001470 con 0x7fe098159f10 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe0967fc700 1 -- 172.21.15.81:0/4163047669 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe080011420 con 0x7fe098159f10 2023-10-06T02:57:02.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe0967fc700 1 -- 172.21.15.81:0/4163047669 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0800117c0 con 0x7fe098159f10 2023-10-06T02:57:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe097fff700 1 -- 172.21.15.81:0/4163047669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159f10 msgr2=0x7fe098068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe097fff700 1 --2- 172.21.15.81:0/4163047669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159f10 0x7fe098068780 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe0800098e0 tx=0x7fe0800091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe097fff700 1 -- 172.21.15.81:0/4163047669 shutdown_connections 2023-10-06T02:57:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe097fff700 1 --2- 172.21.15.81:0/4163047669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098068cc0 0x7fe0980cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.236+0000 7fe097fff700 1 --2- 172.21.15.81:0/4163047669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159f10 0x7fe098068780 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.237+0000 7fe097fff700 1 -- 172.21.15.81:0/4163047669 >> 172.21.15.81:0/4163047669 conn(0x7fe0980cd660 msgr2=0x7fe0980cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.237+0000 7fe097fff700 1 -- 172.21.15.81:0/4163047669 shutdown_connections 2023-10-06T02:57:02.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.237+0000 7fe097fff700 1 -- 172.21.15.81:0/4163047669 wait complete. 2023-10-06T02:57:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.238+0000 7fe097fff700 1 Processor -- start 2023-10-06T02:57:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.238+0000 7fe097fff700 1 -- start start 2023-10-06T02:57:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.238+0000 7fe097fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe098068cc0 0x7fe09806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.238+0000 7fe097fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159b40 0x7fe09806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.238+0000 7fe097fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098159f10 0x7fe09815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.238+0000 7fe097fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09815b120 con 0x7fe098068cc0 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.238+0000 7fe097fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09815b470 con 0x7fe098159b40 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.238+0000 7fe097fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09815b750 con 0x7fe098159f10 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe096ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe098068cc0 0x7fe09806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe096ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe098068cc0 0x7fe09806ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48170/0 (socket says 172.21.15.81:48170) 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe096ffd700 1 -- 172.21.15.81:0/1486002467 learned_addr learned my addr 172.21.15.81:0/1486002467 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe08e7fc700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159b40 0x7fe09806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe0977fe700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098159f10 0x7fe09815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe096ffd700 1 -- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098159f10 msgr2=0x7fe09815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe096ffd700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098159f10 0x7fe09815a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe096ffd700 1 -- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159b40 msgr2=0x7fe09806f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe096ffd700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159b40 0x7fe09806f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe096ffd700 1 -- 172.21.15.81:0/1486002467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080009420 con 0x7fe098068cc0 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe08e7fc700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159b40 0x7fe09806f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe096ffd700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe098068cc0 0x7fe09806ec50 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fe08800cb90 tx=0x7fe088001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe08f7fe700 1 -- 172.21.15.81:0/1486002467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088007360 con 0x7fe098068cc0 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe08f7fe700 1 -- 172.21.15.81:0/1486002467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0880074e0 con 0x7fe098068cc0 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09815ba30 con 0x7fe098068cc0 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe08f7fe700 1 -- 172.21.15.81:0/1486002467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088004830 con 0x7fe098068cc0 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.239+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09815a8f0 con 0x7fe098068cc0 2023-10-06T02:57:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.240+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09815bf50 con 0x7fe098068cc0 2023-10-06T02:57:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.240+0000 7fe08f7fe700 1 -- 172.21.15.81:0/1486002467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe088004ba0 con 0x7fe098068cc0 2023-10-06T02:57:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.241+0000 7fe08f7fe700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe078066f30 0x7fe0780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.241+0000 7fe08f7fe700 1 -- 172.21.15.81:0/1486002467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fe088084050 con 0x7fe098068cc0 2023-10-06T02:57:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.241+0000 7fe08f7fe700 1 -- 172.21.15.81:0/1486002467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7fe07806f210 con 0x7fe098068cc0 2023-10-06T02:57:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.241+0000 7fe08e7fc700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe078066f30 0x7fe0780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.241+0000 7fe08e7fc700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe078066f30 0x7fe0780693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe0800093f0 tx=0x7fe080016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.245+0000 7fe08f7fe700 1 -- 172.21.15.81:0/1486002467 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe088018020 con 0x7fe098068cc0 2023-10-06T02:57:02.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.468+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0980cb890 con 0x7fe098068cc0 2023-10-06T02:57:02.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.468+0000 7fe08f7fe700 1 -- 172.21.15.81:0/1486002467 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fe09815bf50 con 0x7fe098068cc0 2023-10-06T02:57:02.470 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:02.470 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4037385194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4037385194},{"type":"v1","addr":"172.21.15.83:6837","nonce":4037385194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2052186081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2052186081},{"type":"v1","addr":"172.21.15.83:6836","nonce":2052186081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2641977500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2641977500},{"type":"v1","addr":"172.21.15.81:6833","nonce":2641977500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:47.127871+0000","modified":"2023-10-06T02:55:50.779474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/70519905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":70519905},{"type":"v1","addr":"172.21.15.81:6835","nonce":70519905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T02:57:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe078066f30 msgr2=0x7fe0780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe078066f30 0x7fe0780693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe0800093f0 tx=0x7fe080016000 comp rx=0 tx=0).stop 2023-10-06T02:57:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe098068cc0 msgr2=0x7fe09806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe098068cc0 0x7fe09806ec50 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fe08800cb90 tx=0x7fe088001b50 comp rx=0 tx=0).stop 2023-10-06T02:57:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 shutdown_connections 2023-10-06T02:57:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe098159f10 0x7fe09815a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe098068cc0 0x7fe09806ec50 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe078066f30 0x7fe0780693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 --2- 172.21.15.81:0/1486002467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe098159b40 0x7fe09806f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 >> 172.21.15.81:0/1486002467 conn(0x7fe0980cd660 msgr2=0x7fe0980cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.470+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 shutdown_connections 2023-10-06T02:57:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.471+0000 7fe097fff700 1 -- 172.21.15.81:0/1486002467 wait complete. 2023-10-06T02:57:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2023-10-06T02:57:02.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.596+0000 7f3179903700 1 Processor -- start 2023-10-06T02:57:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.596+0000 7f3179903700 1 -- start start 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.597+0000 7f3179903700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3174159f10 0x7f3174068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.597+0000 7f3179903700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3174069120 con 0x7f3174159b40 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.597+0000 7f3179903700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31740cee10 con 0x7f3174068cc0 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.597+0000 7f3179903700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31740cd040 con 0x7f3174159f10 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.597+0000 7f3178901700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3174159b40 0x7f31740cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54720/0 (socket says 172.21.15.81:54720) 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.597+0000 7f3178901700 1 -- 172.21.15.81:0/3379570955 learned_addr learned my addr 172.21.15.81:0/3379570955 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.597+0000 7f3173fff700 1 --2- 172.21.15.81:0/3379570955 >> v2:172.21.15.83:3300/0 conn(0x7f3174159f10 0x7f3174068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.597+0000 7f31737fe700 1 -- 172.21.15.81:0/3379570955 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010507360 0 0) 0x7f3164001490 con 0x7f3174159b40 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.597+0000 7f31737fe700 1 -- 172.21.15.81:0/3379570955 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3160003570 con 0x7f3174159b40 2023-10-06T02:57:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3173fff700 1 -- 172.21.15.81:0/3379570955 >> v1:172.21.15.83:6789/0 conn(0x7f3174068cc0 legacy=0x7f31740cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3173fff700 1 -- 172.21.15.81:0/3379570955 >> v1:172.21.15.81:6789/0 conn(0x7f3174159b40 legacy=0x7f31740cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3173fff700 1 -- 172.21.15.81:0/3379570955 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31740cd320 con 0x7f3174159f10 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3173fff700 1 --2- 172.21.15.81:0/3379570955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 0x7f3174068780 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f315c0098e0 tx=0x7f315c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b63e83ac2b761d7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f31737fe700 1 -- 172.21.15.81:0/3379570955 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00b640 con 0x7f3174159f10 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f31737fe700 1 -- 172.21.15.81:0/3379570955 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c00b7a0 con 0x7f3174159f10 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f31737fe700 1 -- 172.21.15.81:0/3379570955 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00bb40 con 0x7f3174159f10 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3179903700 1 -- 172.21.15.81:0/3379570955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 msgr2=0x7f3174068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3179903700 1 --2- 172.21.15.81:0/3379570955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 0x7f3174068780 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f315c0098e0 tx=0x7f315c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3179903700 1 -- 172.21.15.81:0/3379570955 shutdown_connections 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3179903700 1 --2- 172.21.15.81:0/3379570955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 0x7f3174068780 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3179903700 1 -- 172.21.15.81:0/3379570955 >> 172.21.15.81:0/3379570955 conn(0x7f31740cd660 msgr2=0x7f31740cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3179903700 1 -- 172.21.15.81:0/3379570955 shutdown_connections 2023-10-06T02:57:02.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.598+0000 7f3179903700 1 -- 172.21.15.81:0/3379570955 wait complete. 2023-10-06T02:57:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.599+0000 7f3179903700 1 Processor -- start 2023-10-06T02:57:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.600+0000 7f3179903700 1 -- start start 2023-10-06T02:57:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.600+0000 7f3179903700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3174068cc0 0x7f3174158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.600+0000 7f3179903700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3174159b40 0x7f317415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.600+0000 7f3179903700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 0x7f317406d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.600+0000 7f3179903700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317416a420 con 0x7f3174159b40 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.600+0000 7f3179903700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317415c8b0 con 0x7f3174159f10 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.600+0000 7f3179903700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317415cb90 con 0x7f3174068cc0 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3173fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3174159b40 0x7f317415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3173fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3174159b40 0x7f317415bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48184/0 (socket says 172.21.15.81:48184) 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3173fff700 1 -- 172.21.15.81:0/3445392278 learned_addr learned my addr 172.21.15.81:0/3445392278 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3178901700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3174068cc0 0x7f3174158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3179102700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 0x7f317406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3173fff700 1 -- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3174068cc0 msgr2=0x7f3174158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3173fff700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3174068cc0 0x7f3174158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3173fff700 1 -- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 msgr2=0x7f317406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3173fff700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 0x7f317406d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3173fff700 1 -- 172.21.15.81:0/3445392278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c009420 con 0x7f3174159b40 2023-10-06T02:57:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3179102700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 0x7f317406d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3173fff700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3174159b40 0x7f317415bf40 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f317406fe10 tx=0x7f315c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3170ff9700 1 -- 172.21.15.81:0/3445392278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00bb20 con 0x7f3174159b40 2023-10-06T02:57:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3170ff9700 1 -- 172.21.15.81:0/3445392278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c011420 con 0x7f3174159b40 2023-10-06T02:57:02.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3170ff9700 1 -- 172.21.15.81:0/3445392278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0117a0 con 0x7f3174159b40 2023-10-06T02:57:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317415ce70 con 0x7f3174159b40 2023-10-06T02:57:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.601+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3174159070 con 0x7f3174159b40 2023-10-06T02:57:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.602+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31740cb890 con 0x7f3174159b40 2023-10-06T02:57:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.602+0000 7f3170ff9700 1 -- 172.21.15.81:0/3445392278 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f315c011b50 con 0x7f3174159b40 2023-10-06T02:57:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.603+0000 7f3170ff9700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3154066f30 0x7f31540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.603+0000 7f3170ff9700 1 -- 172.21.15.81:0/3445392278 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f315c085e50 con 0x7f3174159b40 2023-10-06T02:57:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.603+0000 7f3170ff9700 1 -- 172.21.15.81:0/3445392278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f315406f190 con 0x7f3174159b40 2023-10-06T02:57:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.603+0000 7f3178901700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3154066f30 0x7f31540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.603+0000 7f3178901700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3154066f30 0x7f31540693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f31640015f0 tx=0x7f3164009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:02.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.607+0000 7f3170ff9700 1 -- 172.21.15.81:0/3445392278 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f315c052f00 con 0x7f3174159b40 2023-10-06T02:57:02.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.791+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31740ce7c0 con 0x7f3174159b40 2023-10-06T02:57:02.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.792+0000 7f3170ff9700 1 -- 172.21.15.81:0/3445392278 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+17006 (secure 0 0 0) 0x7f315c029070 con 0x7f3174159b40 2023-10-06T02:57:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:02.794 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":168,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:56:39.469652+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:44.780110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:46.089490+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.25","mappings":[{"from":3,"to":0}]},{"pgid":"22.28","mappings":[{"from":3,"to":0}]},{"pgid":"22.33","mappings":[{"from":3,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3154066f30 msgr2=0x7f31540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3154066f30 0x7f31540693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f31640015f0 tx=0x7f3164009040 comp rx=0 tx=0).stop 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3174159b40 msgr2=0x7f317415bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3174159b40 0x7f317415bf40 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f317406fe10 tx=0x7f315c017000 comp rx=0 tx=0).stop 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 shutdown_connections 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3154066f30 0x7f31540693e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3174159f10 0x7f317406d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3174068cc0 0x7f3174158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 --2- 172.21.15.81:0/3445392278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3174159b40 0x7f317415bf40 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 >> 172.21.15.81:0/3445392278 conn(0x7f31740cd660 msgr2=0x7f31740c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 shutdown_connections 2023-10-06T02:57:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.794+0000 7f3179903700 1 -- 172.21.15.81:0/3445392278 wait complete. 2023-10-06T02:57:02.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:55:44.780110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:55:46.089490+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:57:02.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:57:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.927+0000 7f7e6359e700 1 Processor -- start 2023-10-06T02:57:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.927+0000 7f7e6359e700 1 -- start start 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e6359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e64159cb0 0x7f7e640ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e6359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e6415a080 0x7f7e640ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e6359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e640aaf40 con 0x7f7e6406e4e0 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e6359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6406c570 con 0x7f7e6415a080 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e6359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640aa930 con 0x7f7e64159cb0 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e59d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7e6406e4e0 0x7f7e640ab3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54728/0 (socket says 172.21.15.81:54728) 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e59d9b700 1 -- 172.21.15.81:0/1461431267 learned_addr learned my addr 172.21.15.81:0/1461431267 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e62d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e6415a080 0x7f7e640ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e6259c700 1 --2- 172.21.15.81:0/1461431267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e64159cb0 0x7f7e640ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e61d9b700 1 -- 172.21.15.81:0/1461431267 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453619480 0 0) 0x7f7e640aaf40 con 0x7f7e6406e4e0 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e61d9b700 1 -- 172.21.15.81:0/1461431267 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e50003570 con 0x7f7e6406e4e0 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e62d9d700 1 -- 172.21.15.81:0/1461431267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e64159cb0 msgr2=0x7f7e640ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e62d9d700 1 --2- 172.21.15.81:0/1461431267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e64159cb0 0x7f7e640ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e62d9d700 1 -- 172.21.15.81:0/1461431267 >> v1:172.21.15.81:6789/0 conn(0x7f7e6406e4e0 legacy=0x7f7e640ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e62d9d700 1 -- 172.21.15.81:0/1461431267 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6406e970 con 0x7f7e6415a080 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.928+0000 7f7e62d9d700 1 --2- 172.21.15.81:0/1461431267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415a080 0x7f7e640ceeb0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009e60 tx=0x7f7e5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d4f29809b5a2bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e61d9b700 1 -- 172.21.15.81:0/1461431267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00e070 con 0x7f7e6415a080 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e61d9b700 1 -- 172.21.15.81:0/1461431267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c00bb60 con 0x7f7e6415a080 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e61d9b700 1 -- 172.21.15.81:0/1461431267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c012430 con 0x7f7e6415a080 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e6359e700 1 -- 172.21.15.81:0/1461431267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415a080 msgr2=0x7f7e640ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e6359e700 1 --2- 172.21.15.81:0/1461431267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415a080 0x7f7e640ceeb0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009e60 tx=0x7f7e5c009780 comp rx=0 tx=0).stop 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e6359e700 1 -- 172.21.15.81:0/1461431267 shutdown_connections 2023-10-06T02:57:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e6359e700 1 --2- 172.21.15.81:0/1461431267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415a080 0x7f7e640ceeb0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e6359e700 1 --2- 172.21.15.81:0/1461431267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e64159cb0 0x7f7e640ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e6359e700 1 -- 172.21.15.81:0/1461431267 >> 172.21.15.81:0/1461431267 conn(0x7f7e64068110 msgr2=0x7f7e6406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:02.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e6359e700 1 -- 172.21.15.81:0/1461431267 shutdown_connections 2023-10-06T02:57:02.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.929+0000 7f7e6359e700 1 -- 172.21.15.81:0/1461431267 wait complete. 2023-10-06T02:57:02.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.930+0000 7f7e6359e700 1 Processor -- start 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.930+0000 7f7e6359e700 1 -- start start 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e6359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e6406e4e0 0x7f7e64146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e6359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e64159cb0 0x7f7e640c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e6359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e6415a080 0x7f7e640c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e6359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640c7080 con 0x7f7e64159cb0 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e6359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640c6470 con 0x7f7e6406e4e0 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e6359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640c6750 con 0x7f7e6415a080 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e59d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e64159cb0 0x7f7e640c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e59d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e64159cb0 0x7f7e640c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48204/0 (socket says 172.21.15.81:48204) 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e59d9b700 1 -- 172.21.15.81:0/216068355 learned_addr learned my addr 172.21.15.81:0/216068355 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e6259c700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e6406e4e0 0x7f7e64146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e62d9d700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e6415a080 0x7f7e640c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e59d9b700 1 -- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e6415a080 msgr2=0x7f7e640c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e59d9b700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e6415a080 0x7f7e640c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e59d9b700 1 -- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e6406e4e0 msgr2=0x7f7e64146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e59d9b700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e6406e4e0 0x7f7e64146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.931+0000 7f7e59d9b700 1 -- 172.21.15.81:0/216068355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009a20 con 0x7f7e64159cb0 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.932+0000 7f7e59d9b700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e64159cb0 0x7f7e640c5a90 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00c7c0 tx=0x7f7e4c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.932+0000 7f7e5affd700 1 -- 172.21.15.81:0/216068355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c005cd0 con 0x7f7e64159cb0 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.932+0000 7f7e5affd700 1 -- 172.21.15.81:0/216068355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c005e30 con 0x7f7e64159cb0 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.932+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e640c6a30 con 0x7f7e64159cb0 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.932+0000 7f7e5affd700 1 -- 172.21.15.81:0/216068355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c007320 con 0x7f7e64159cb0 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.932+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e64146890 con 0x7f7e64159cb0 2023-10-06T02:57:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.933+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e640c7230 con 0x7f7e64159cb0 2023-10-06T02:57:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.933+0000 7f7e5affd700 1 -- 172.21.15.81:0/216068355 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e4c007690 con 0x7f7e64159cb0 2023-10-06T02:57:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.933+0000 7f7e5affd700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e44066f30 0x7f7e440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.934+0000 7f7e5affd700 1 -- 172.21.15.81:0/216068355 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f7e4c083e30 con 0x7f7e64159cb0 2023-10-06T02:57:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.934+0000 7f7e5affd700 1 -- 172.21.15.81:0/216068355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f7e4406f210 con 0x7f7e64159cb0 2023-10-06T02:57:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.934+0000 7f7e6259c700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e44066f30 0x7f7e440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.934+0000 7f7e6259c700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e44066f30 0x7f7e440693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7e54006fd0 tx=0x7f7e54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:02.938+0000 7f7e5affd700 1 -- 172.21.15.81:0/216068355 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e640c7230 con 0x7f7e64159cb0 2023-10-06T02:57:03.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.121+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e640c7230 con 0x7f7e64159cb0 2023-10-06T02:57:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.122+0000 7f7e5affd700 1 -- 172.21.15.81:0/216068355 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e640c7230 con 0x7f7e64159cb0 2023-10-06T02:57:03.125 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:57:03.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e44066f30 msgr2=0x7f7e440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e44066f30 0x7f7e440693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7e54006fd0 tx=0x7f7e54008040 comp rx=0 tx=0).stop 2023-10-06T02:57:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e64159cb0 msgr2=0x7f7e640c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e64159cb0 0x7f7e640c5a90 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00c7c0 tx=0x7f7e4c007e00 comp rx=0 tx=0).stop 2023-10-06T02:57:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 shutdown_connections 2023-10-06T02:57:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e6415a080 0x7f7e640c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7e44066f30 0x7f7e440693e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e6406e4e0 0x7f7e64146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 --2- 172.21.15.81:0/216068355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e64159cb0 0x7f7e640c5a90 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 >> 172.21.15.81:0/216068355 conn(0x7f7e64068110 msgr2=0x7f7e64156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 shutdown_connections 2023-10-06T02:57:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.124+0000 7f7e6359e700 1 -- 172.21.15.81:0/216068355 wait complete. 2023-10-06T02:57:03.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:57:03.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.253+0000 7fa6cd696700 1 Processor -- start 2023-10-06T02:57:03.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.253+0000 7fa6cd696700 1 -- start start 2023-10-06T02:57:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6cd696700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6c806d830 0x7fa6c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6cd696700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80d07c0 con 0x7fa6c8157ca0 2023-10-06T02:57:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6cd696700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80cfbb0 con 0x7fa6c81578d0 2023-10-06T02:57:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6cd696700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c80cfe90 con 0x7fa6c806d830 2023-10-06T02:57:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6c806d830 0x7fa6c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c67fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa6c8157ca0 0x7fa6c806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54744/0 (socket says 172.21.15.81:54744) 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c67fc700 1 -- 172.21.15.81:0/1253191174 learned_addr learned my addr 172.21.15.81:0/1253191174 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c77fe700 1 -- 172.21.15.81:0/1253191174 >> v1:172.21.15.83:6789/0 conn(0x7fa6c81578d0 legacy=0x7fa6c815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c77fe700 1 -- 172.21.15.81:0/1253191174 >> v1:172.21.15.81:6789/0 conn(0x7fa6c8157ca0 legacy=0x7fa6c806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c5ffb700 1 -- 172.21.15.81:0/1253191174 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841354986 0 0) 0x7fa6c80d07c0 con 0x7fa6c8157ca0 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c77fe700 1 -- 172.21.15.81:0/1253191174 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80d0170 con 0x7fa6c806d830 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c77fe700 1 --2- 172.21.15.81:0/1253191174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 0x7fa6c80cf4f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00098e0 tx=0x7fa6c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bf98b69288d979 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c5ffb700 1 -- 172.21.15.81:0/1253191174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0009e80 con 0x7fa6c806d830 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c5ffb700 1 -- 172.21.15.81:0/1253191174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c000b860 con 0x7fa6c806d830 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.254+0000 7fa6c5ffb700 1 -- 172.21.15.81:0/1253191174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000bbe0 con 0x7fa6c806d830 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.255+0000 7fa6cd696700 1 -- 172.21.15.81:0/1253191174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 msgr2=0x7fa6c80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.255+0000 7fa6cd696700 1 --2- 172.21.15.81:0/1253191174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 0x7fa6c80cf4f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00098e0 tx=0x7fa6c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.255+0000 7fa6cd696700 1 -- 172.21.15.81:0/1253191174 shutdown_connections 2023-10-06T02:57:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.255+0000 7fa6cd696700 1 --2- 172.21.15.81:0/1253191174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 0x7fa6c80cf4f0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.255+0000 7fa6cd696700 1 -- 172.21.15.81:0/1253191174 >> 172.21.15.81:0/1253191174 conn(0x7fa6c806bb90 msgr2=0x7fa6c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.255+0000 7fa6cd696700 1 -- 172.21.15.81:0/1253191174 shutdown_connections 2023-10-06T02:57:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.255+0000 7fa6cd696700 1 -- 172.21.15.81:0/1253191174 wait complete. 2023-10-06T02:57:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.256+0000 7fa6cd696700 1 Processor -- start 2023-10-06T02:57:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.256+0000 7fa6cd696700 1 -- start start 2023-10-06T02:57:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6cd696700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 0x7fa6c80c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6cd696700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6c81578d0 0x7fa6c81549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6cd696700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6c8157ca0 0x7fa6c80b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6cd696700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c816a330 con 0x7fa6c806d830 2023-10-06T02:57:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6cd696700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80b56a0 con 0x7fa6c81578d0 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6cd696700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80b4b20 con 0x7fa6c8157ca0 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 0x7fa6c80c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 0x7fa6c80c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48214/0 (socket says 172.21.15.81:48214) 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6c6ffd700 1 -- 172.21.15.81:0/528686274 learned_addr learned my addr 172.21.15.81:0/528686274 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6c67fc700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6c81578d0 0x7fa6c81549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6c77fe700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6c8157ca0 0x7fa6c80b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6c6ffd700 1 -- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6c8157ca0 msgr2=0x7fa6c80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.257+0000 7fa6c6ffd700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6c8157ca0 0x7fa6c80b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.258+0000 7fa6c6ffd700 1 -- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6c81578d0 msgr2=0x7fa6c81549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.258+0000 7fa6c6ffd700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6c81578d0 0x7fa6c81549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.258+0000 7fa6c6ffd700 1 -- 172.21.15.81:0/528686274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0009420 con 0x7fa6c806d830 2023-10-06T02:57:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.258+0000 7fa6c6ffd700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 0x7fa6c80c7450 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800cb10 tx=0x7fa6b80017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.258+0000 7fa6aeffd700 1 -- 172.21.15.81:0/528686274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b800ce20 con 0x7fa6c806d830 2023-10-06T02:57:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.258+0000 7fa6aeffd700 1 -- 172.21.15.81:0/528686274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b800a780 con 0x7fa6c806d830 2023-10-06T02:57:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.258+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c80b4e00 con 0x7fa6c806d830 2023-10-06T02:57:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.258+0000 7fa6aeffd700 1 -- 172.21.15.81:0/528686274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b800ab40 con 0x7fa6c806d830 2023-10-06T02:57:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.258+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c80b53c0 con 0x7fa6c806d830 2023-10-06T02:57:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.259+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c816a4d0 con 0x7fa6c806d830 2023-10-06T02:57:03.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.259+0000 7fa6aeffd700 1 -- 172.21.15.81:0/528686274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6b8003030 con 0x7fa6c806d830 2023-10-06T02:57:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.259+0000 7fa6aeffd700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6b4066f30 0x7fa6b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.260+0000 7fa6aeffd700 1 -- 172.21.15.81:0/528686274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fa6b8084630 con 0x7fa6c806d830 2023-10-06T02:57:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.260+0000 7fa6aeffd700 1 -- 172.21.15.81:0/528686274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7fa6b406f210 con 0x7fa6c806d830 2023-10-06T02:57:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.260+0000 7fa6c67fc700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6b4066f30 0x7fa6b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.260+0000 7fa6c67fc700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6b4066f30 0x7fa6b40693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa6c815fad0 tx=0x7fa6bc007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.264+0000 7fa6aeffd700 1 -- 172.21.15.81:0/528686274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6c816a4d0 con 0x7fa6c806d830 2023-10-06T02:57:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.446+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6c816a4d0 con 0x7fa6c806d830 2023-10-06T02:57:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.447+0000 7fa6aeffd700 1 -- 172.21.15.81:0/528686274 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v168) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6b80516e0 con 0x7fa6c806d830 2023-10-06T02:57:03.448 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:57:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6b4066f30 msgr2=0x7fa6b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6b4066f30 0x7fa6b40693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa6c815fad0 tx=0x7fa6bc007f30 comp rx=0 tx=0).stop 2023-10-06T02:57:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 msgr2=0x7fa6c80c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 0x7fa6c80c7450 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800cb10 tx=0x7fa6b80017b0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 shutdown_connections 2023-10-06T02:57:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6c8157ca0 0x7fa6c80b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806d830 0x7fa6c80c7450 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa6b4066f30 0x7fa6b40693e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 --2- 172.21.15.81:0/528686274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6c81578d0 0x7fa6c81549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 >> 172.21.15.81:0/528686274 conn(0x7fa6c806bb90 msgr2=0x7fa6c8156830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 shutdown_connections 2023-10-06T02:57:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.449+0000 7fa6cd696700 1 -- 172.21.15.81:0/528686274 wait complete. 2023-10-06T02:57:03.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:57:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.576+0000 7f7f778eb700 1 Processor -- start 2023-10-06T02:57:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.577+0000 7f7f778eb700 1 -- start start 2023-10-06T02:57:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.577+0000 7f7f778eb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7f70157ca0 0x7f7f700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.577+0000 7f7f778eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 0x7f7f7006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.577+0000 7f7f778eb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f700d07c0 con 0x7f7f701578d0 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.577+0000 7f7f778eb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7006daa0 con 0x7f7f70157ca0 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.577+0000 7f7f778eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700cfbb0 con 0x7f7f7006d120 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f74e86700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7f70157ca0 0x7f7f700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f75e88700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 0x7f7f7006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f75687700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7f701578d0 0x7f7f7015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:39246/0 (socket says 172.21.15.81:39246) 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f75687700 1 -- 172.21.15.81:0/3647720738 learned_addr learned my addr 172.21.15.81:0/3647720738 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f74e86700 1 -- 172.21.15.81:0/3647720738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 msgr2=0x7f7f7006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f74e86700 1 --2- 172.21.15.81:0/3647720738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 0x7f7f7006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f74e86700 1 -- 172.21.15.81:0/3647720738 >> v1:172.21.15.83:6789/0 conn(0x7f7f701578d0 legacy=0x7f7f7015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f74e86700 1 -- 172.21.15.81:0/3647720738 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700cfe90 con 0x7f7f70157ca0 2023-10-06T02:57:03.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f74e86700 1 --2- 172.21.15.81:0/3647720738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f70157ca0 0x7f7f700cf4f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7f600098e0 tx=0x7f7f600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d631c1936078bab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:03.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f67fff700 1 -- 172.21.15.81:0/3647720738 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000b640 con 0x7f7f70157ca0 2023-10-06T02:57:03.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f67fff700 1 -- 172.21.15.81:0/3647720738 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6000b7a0 con 0x7f7f70157ca0 2023-10-06T02:57:03.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.578+0000 7f7f67fff700 1 -- 172.21.15.81:0/3647720738 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000bb40 con 0x7f7f70157ca0 2023-10-06T02:57:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.579+0000 7f7f778eb700 1 -- 172.21.15.81:0/3647720738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f70157ca0 msgr2=0x7f7f700cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.579+0000 7f7f778eb700 1 --2- 172.21.15.81:0/3647720738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f70157ca0 0x7f7f700cf4f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7f600098e0 tx=0x7f7f600091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.579+0000 7f7f778eb700 1 -- 172.21.15.81:0/3647720738 shutdown_connections 2023-10-06T02:57:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.579+0000 7f7f778eb700 1 --2- 172.21.15.81:0/3647720738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 0x7f7f7006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.579+0000 7f7f778eb700 1 --2- 172.21.15.81:0/3647720738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f70157ca0 0x7f7f700cf4f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.579+0000 7f7f778eb700 1 -- 172.21.15.81:0/3647720738 >> 172.21.15.81:0/3647720738 conn(0x7f7f7006bb90 msgr2=0x7f7f7006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.579+0000 7f7f778eb700 1 -- 172.21.15.81:0/3647720738 shutdown_connections 2023-10-06T02:57:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.579+0000 7f7f778eb700 1 -- 172.21.15.81:0/3647720738 wait complete. 2023-10-06T02:57:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.580+0000 7f7f778eb700 1 Processor -- start 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.580+0000 7f7f778eb700 1 -- start start 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f778eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 0x7f7f700cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f778eb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f701578d0 0x7f7f7016afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f778eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f70157ca0 0x7f7f70154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f778eb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7016a450 con 0x7f7f70157ca0 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f778eb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700ccbf0 con 0x7f7f701578d0 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f778eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700cced0 con 0x7f7f7006d120 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f75e88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f70157ca0 0x7f7f70154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f75e88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f70157ca0 0x7f7f70154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48220/0 (socket says 172.21.15.81:48220) 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f75e88700 1 -- 172.21.15.81:0/2237962024 learned_addr learned my addr 172.21.15.81:0/2237962024 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f74e86700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f701578d0 0x7f7f7016afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f75687700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 0x7f7f700cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f75e88700 1 -- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 msgr2=0x7f7f700cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f75e88700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 0x7f7f700cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f75e88700 1 -- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f701578d0 msgr2=0x7f7f7016afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.581+0000 7f7f75e88700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f701578d0 0x7f7f7016afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.582+0000 7f7f75e88700 1 -- 172.21.15.81:0/2237962024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f60009420 con 0x7f7f70157ca0 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.582+0000 7f7f75e88700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f70157ca0 0x7f7f70154eb0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009e90 tx=0x7f7f6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.582+0000 7f7f657fa700 1 -- 172.21.15.81:0/2237962024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800cb70 con 0x7f7f70157ca0 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.582+0000 7f7f657fa700 1 -- 172.21.15.81:0/2237962024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6800f040 con 0x7f7f70157ca0 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.582+0000 7f7f657fa700 1 -- 172.21.15.81:0/2237962024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68014480 con 0x7f7f70157ca0 2023-10-06T02:57:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.582+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f700cd1b0 con 0x7f7f70157ca0 2023-10-06T02:57:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.582+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f700cd770 con 0x7f7f70157ca0 2023-10-06T02:57:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.583+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7016b4f0 con 0x7f7f70157ca0 2023-10-06T02:57:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.583+0000 7f7f657fa700 1 -- 172.21.15.81:0/2237962024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f68014830 con 0x7f7f70157ca0 2023-10-06T02:57:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.584+0000 7f7f657fa700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f54066f30 0x7f7f540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.584+0000 7f7f657fa700 1 -- 172.21.15.81:0/2237962024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f7f680850c0 con 0x7f7f70157ca0 2023-10-06T02:57:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.584+0000 7f7f75687700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f54066f30 0x7f7f540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.584+0000 7f7f657fa700 1 -- 172.21.15.81:0/2237962024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f7f5406f210 con 0x7f7f70157ca0 2023-10-06T02:57:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.584+0000 7f7f75687700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f54066f30 0x7f7f540693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c004fc0 tx=0x7f7f6c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:03.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.588+0000 7f7f657fa700 1 -- 172.21.15.81:0/2237962024 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f68052170 con 0x7f7f70157ca0 2023-10-06T02:57:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.771+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f700d0170 con 0x7f7f70157ca0 2023-10-06T02:57:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.771+0000 7f7f657fa700 1 -- 172.21.15.81:0/2237962024 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v168) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f680180a0 con 0x7f7f70157ca0 2023-10-06T02:57:03.773 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:57:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.773+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f54066f30 msgr2=0x7f7f540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.773+0000 7f7f778eb700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f54066f30 0x7f7f540693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c004fc0 tx=0x7f7f6c007eb0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.773+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f70157ca0 msgr2=0x7f7f70154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.773+0000 7f7f778eb700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f70157ca0 0x7f7f70154eb0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009e90 tx=0x7f7f6800b040 comp rx=0 tx=0).stop 2023-10-06T02:57:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.774+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 shutdown_connections 2023-10-06T02:57:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.774+0000 7f7f778eb700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f70157ca0 0x7f7f70154eb0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.774+0000 7f7f778eb700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f7006d120 0x7f7f700cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.774+0000 7f7f778eb700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f54066f30 0x7f7f540693e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.774+0000 7f7f778eb700 1 --2- 172.21.15.81:0/2237962024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f701578d0 0x7f7f7016afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.774+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 >> 172.21.15.81:0/2237962024 conn(0x7f7f7006bb90 msgr2=0x7f7f70069110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.774+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 shutdown_connections 2023-10-06T02:57:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.774+0000 7f7f778eb700 1 -- 172.21.15.81:0/2237962024 wait complete. 2023-10-06T02:57:03.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:57:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.902+0000 7f6173bf0700 1 Processor -- start 2023-10-06T02:57:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.902+0000 7f6173bf0700 1 -- start start 2023-10-06T02:57:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f6173bf0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f616c15a2a0 0x7f616c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f6173bf0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616c0ceb30 0x7f616c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f6173bf0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f616c06d650 0x7f616c06da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f6173bf0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c06ea90 con 0x7f616c15a2a0 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f6173bf0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c0b0ca0 con 0x7f616c06d650 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f6173bf0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0cf4c0 con 0x7f616c0ceb30 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f617198c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f616c15a2a0 0x7f616c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f617198c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f616c15a2a0 0x7f616c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48232/0 (socket says 172.21.15.81:48232) 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f617198c700 1 -- 172.21.15.81:0/853170106 learned_addr learned my addr 172.21.15.81:0/853170106 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f617198c700 1 -- 172.21.15.81:0/853170106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616c0ceb30 msgr2=0x7f616c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f617198c700 1 --2- 172.21.15.81:0/853170106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616c0ceb30 0x7f616c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f617198c700 1 -- 172.21.15.81:0/853170106 >> v2:172.21.15.83:3300/0 conn(0x7f616c06d650 msgr2=0x7f616c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f617198c700 1 --2- 172.21.15.81:0/853170106 >> v2:172.21.15.83:3300/0 conn(0x7f616c06d650 0x7f616c06da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.903+0000 7f617198c700 1 -- 172.21.15.81:0/853170106 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0b00d0 con 0x7f616c15a2a0 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f617198c700 1 --2- 172.21.15.81:0/853170106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c15a2a0 0x7f616c0b1130 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f616c06b970 tx=0x7f6168009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653e20e10eca5422 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f617098a700 1 -- 172.21.15.81:0/853170106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616800b860 con 0x7f616c15a2a0 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f617098a700 1 -- 172.21.15.81:0/853170106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616800b9c0 con 0x7f616c15a2a0 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f617098a700 1 -- 172.21.15.81:0/853170106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616800bd60 con 0x7f616c15a2a0 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f6173bf0700 1 -- 172.21.15.81:0/853170106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c15a2a0 msgr2=0x7f616c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f6173bf0700 1 --2- 172.21.15.81:0/853170106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c15a2a0 0x7f616c0b1130 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f616c06b970 tx=0x7f6168009250 comp rx=0 tx=0).stop 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f6173bf0700 1 -- 172.21.15.81:0/853170106 shutdown_connections 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f6173bf0700 1 --2- 172.21.15.81:0/853170106 >> v2:172.21.15.83:3300/0 conn(0x7f616c06d650 0x7f616c06da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f6173bf0700 1 --2- 172.21.15.81:0/853170106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c15a2a0 0x7f616c0b1130 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f6173bf0700 1 --2- 172.21.15.81:0/853170106 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616c0ceb30 0x7f616c0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f6173bf0700 1 -- 172.21.15.81:0/853170106 >> 172.21.15.81:0/853170106 conn(0x7f616c067640 msgr2=0x7f616c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:03.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f6173bf0700 1 -- 172.21.15.81:0/853170106 shutdown_connections 2023-10-06T02:57:03.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.904+0000 7f6173bf0700 1 -- 172.21.15.81:0/853170106 wait complete. 2023-10-06T02:57:03.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.905+0000 7f6173bf0700 1 Processor -- start 2023-10-06T02:57:03.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.905+0000 7f6173bf0700 1 -- start start 2023-10-06T02:57:03.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f6173bf0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616c06d650 0x7f616c157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f6173bf0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c0ceb30 0x7f616c15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f6173bf0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616c15a2a0 0x7f616c15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f6173bf0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0cb5c0 con 0x7f616c0ceb30 2023-10-06T02:57:03.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f6173bf0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0ca710 con 0x7f616c06d650 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f6173bf0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0ca9b0 con 0x7f616c15a2a0 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f617118b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c0ceb30 0x7f616c15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f617118b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c0ceb30 0x7f616c15ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48242/0 (socket says 172.21.15.81:48242) 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f617118b700 1 -- 172.21.15.81:0/66255781 learned_addr learned my addr 172.21.15.81:0/66255781 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f617198c700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616c06d650 0x7f616c157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.906+0000 7f617218d700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616c15a2a0 0x7f616c15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f617118b700 1 -- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616c15a2a0 msgr2=0x7f616c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f617118b700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616c15a2a0 0x7f616c15a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f617118b700 1 -- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616c06d650 msgr2=0x7f616c157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f617118b700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616c06d650 0x7f616c157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f617118b700 1 -- 172.21.15.81:0/66255781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680094f0 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f617118b700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c0ceb30 0x7f616c15ddc0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f615c00b810 tx=0x7f615c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f6161ffb700 1 -- 172.21.15.81:0/66255781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00f510 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f6161ffb700 1 -- 172.21.15.81:0/66255781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c00f670 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f6161ffb700 1 -- 172.21.15.81:0/66255781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00fa30 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c0cac90 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.907+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c0cb250 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.908+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c069e40 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.908+0000 7f6161ffb700 1 -- 172.21.15.81:0/66255781 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f615c01a400 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.909+0000 7f6161ffb700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6150066f30 0x7f61500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.909+0000 7f6161ffb700 1 -- 172.21.15.81:0/66255781 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f615c084180 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.909+0000 7f6161ffb700 1 -- 172.21.15.81:0/66255781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f615006f210 con 0x7f616c0ceb30 2023-10-06T02:57:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.909+0000 7f617198c700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6150066f30 0x7f61500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:03.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.910+0000 7f617198c700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6150066f30 0x7f61500693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f616c06b970 tx=0x7f6168017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:03.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:03.913+0000 7f6161ffb700 1 -- 172.21.15.81:0/66255781 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f615c0512b0 con 0x7f616c0ceb30 2023-10-06T02:57:04.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.092+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f616c0cb700 con 0x7f616c0ceb30 2023-10-06T02:57:04.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.092+0000 7f6161ffb700 1 -- 172.21.15.81:0/66255781 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v168) v1 ==== 100+0+11 (secure 0 0 0) 0x7f615c0548d0 con 0x7f616c0ceb30 2023-10-06T02:57:04.094 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.094+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6150066f30 msgr2=0x7f61500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.094+0000 7f6173bf0700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6150066f30 0x7f61500693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f616c06b970 tx=0x7f6168017000 comp rx=0 tx=0).stop 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.094+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c0ceb30 msgr2=0x7f616c15ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.094+0000 7f6173bf0700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c0ceb30 0x7f616c15ddc0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f615c00b810 tx=0x7f615c0091d0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.094+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 shutdown_connections 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.094+0000 7f6173bf0700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f616c15a2a0 0x7f616c15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.094+0000 7f6173bf0700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6150066f30 0x7f61500693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.095+0000 7f6173bf0700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f616c06d650 0x7f616c157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.095+0000 7f6173bf0700 1 --2- 172.21.15.81:0/66255781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616c0ceb30 0x7f616c15ddc0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.095+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 >> 172.21.15.81:0/66255781 conn(0x7f616c067640 msgr2=0x7f616c067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.095+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 shutdown_connections 2023-10-06T02:57:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.095+0000 7f6173bf0700 1 -- 172.21.15.81:0/66255781 wait complete. 2023-10-06T02:57:04.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.220+0000 7f6c7ab84700 1 Processor -- start 2023-10-06T02:57:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.220+0000 7f6c7ab84700 1 -- start start 2023-10-06T02:57:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.221+0000 7f6c7ab84700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c74157ca0 0x7f6c740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.221+0000 7f6c7ab84700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c740d07c0 con 0x7f6c741578d0 2023-10-06T02:57:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.221+0000 7f6c7ab84700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c740cfbb0 con 0x7f6c7406d120 2023-10-06T02:57:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.221+0000 7f6c7ab84700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740cfe90 con 0x7f6c74157ca0 2023-10-06T02:57:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.221+0000 7f6c78920700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6c741578d0 0x7f6c7415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54754/0 (socket says 172.21.15.81:54754) 2023-10-06T02:57:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.221+0000 7f6c78920700 1 -- 172.21.15.81:0/4410985 learned_addr learned my addr 172.21.15.81:0/4410985 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636322641 0 0) 0x7f6c740d07c0 con 0x7f6c741578d0 2023-10-06T02:57:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c5c003570 con 0x7f6c741578d0 2023-10-06T02:57:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6bfff700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c74157ca0 0x7f6c740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664565868 0 0) 0x7f6c5c003570 con 0x7f6c741578d0 2023-10-06T02:57:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c74157ca0 msgr2=0x7f6c740cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c74157ca0 0x7f6c740cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 >> v1:172.21.15.83:6789/0 conn(0x7f6c7406d120 legacy=0x7f6c7415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740d0170 con 0x7f6c741578d0 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f6c70001470 con 0x7f6c741578d0 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 >> v1:172.21.15.81:6789/0 conn(0x7f6c741578d0 legacy=0x7f6c7415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c74157ca0 0x7f6c5c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5c003fd0 0x7f6c5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5c004d50 0x7f6c5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740cfe90 con 0x7f6c5c004d50 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c00bb40 con 0x7f6c5c003fd0 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c00bd00 con 0x7f6c74157ca0 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c79121700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5c004d50 0x7f6c5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c78920700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c74157ca0 0x7f6c5c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c6bfff700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5c003fd0 0x7f6c5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c79121700 1 -- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c74157ca0 msgr2=0x7f6c5c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c79121700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c74157ca0 0x7f6c5c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c79121700 1 -- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5c003fd0 msgr2=0x7f6c5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c79121700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c5c003fd0 0x7f6c5c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c79121700 1 -- 172.21.15.81:0/4410985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c003570 con 0x7f6c5c004d50 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.222+0000 7f6c78920700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c74157ca0 0x7f6c5c003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c79121700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5c004d50 0x7f6c5c0051c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0020a0 tx=0x7f6c6c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db830eb7046d578d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0019e0 con 0x7f6c5c004d50 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c00c8b0 con 0x7f6c5c004d50 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c6b7fe700 1 -- 172.21.15.81:0/4410985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00cc50 con 0x7f6c5c004d50 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c7ab84700 1 -- 172.21.15.81:0/4410985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5c004d50 msgr2=0x7f6c5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c7ab84700 1 --2- 172.21.15.81:0/4410985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c5c004d50 0x7f6c5c0051c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0020a0 tx=0x7f6c6c0016d0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c79121700 1 -- 172.21.15.81:0/4410985 reap_dead start 2023-10-06T02:57:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c7ab84700 1 -- 172.21.15.81:0/4410985 shutdown_connections 2023-10-06T02:57:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c7ab84700 1 -- 172.21.15.81:0/4410985 >> 172.21.15.81:0/4410985 conn(0x7f6c7406bb90 msgr2=0x7f6c7406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c7ab84700 1 -- 172.21.15.81:0/4410985 shutdown_connections 2023-10-06T02:57:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.223+0000 7f6c7ab84700 1 -- 172.21.15.81:0/4410985 wait complete. 2023-10-06T02:57:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.224+0000 7f6c7ab84700 1 Processor -- start 2023-10-06T02:57:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c7ab84700 1 -- start start 2023-10-06T02:57:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c7ab84700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c74154d10 0x7f6c7416b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c7ab84700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c741550e0 0x7f6c740c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c7ab84700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c740c7b80 0x7f6c74069920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c7ab84700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740c5c50 con 0x7f6c740c7b80 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c7ab84700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740c8000 con 0x7f6c74154d10 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c7ab84700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740c82e0 con 0x7f6c741550e0 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c79121700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c740c7b80 0x7f6c74069920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c79121700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c740c7b80 0x7f6c74069920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48262/0 (socket says 172.21.15.81:48262) 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c79121700 1 -- 172.21.15.81:0/2643362994 learned_addr learned my addr 172.21.15.81:0/2643362994 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c6bfff700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c741550e0 0x7f6c740c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.225+0000 7f6c78920700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c74154d10 0x7f6c7416b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c79121700 1 -- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c741550e0 msgr2=0x7f6c740c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c79121700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c741550e0 0x7f6c740c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c79121700 1 -- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c74154d10 msgr2=0x7f6c7416b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c79121700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c74154d10 0x7f6c7416b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c79121700 1 -- 172.21.15.81:0/2643362994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740c85c0 con 0x7f6c740c7b80 2023-10-06T02:57:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c79121700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c740c7b80 0x7f6c74069920 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c012000 tx=0x7f6c6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c68ff9700 1 -- 172.21.15.81:0/2643362994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0019e0 con 0x7f6c740c7b80 2023-10-06T02:57:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c68ff9700 1 -- 172.21.15.81:0/2643362994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c012820 con 0x7f6c740c7b80 2023-10-06T02:57:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c740c88a0 con 0x7f6c740c7b80 2023-10-06T02:57:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c68ff9700 1 -- 172.21.15.81:0/2643362994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c012be0 con 0x7f6c740c7b80 2023-10-06T02:57:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.226+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c74159b10 con 0x7f6c740c7b80 2023-10-06T02:57:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.227+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c740c5e00 con 0x7f6c740c7b80 2023-10-06T02:57:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.227+0000 7f6c68ff9700 1 -- 172.21.15.81:0/2643362994 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c6c029460 con 0x7f6c740c7b80 2023-10-06T02:57:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.228+0000 7f6c68ff9700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c60066f00 0x7f6c600693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.228+0000 7f6c68ff9700 1 -- 172.21.15.81:0/2643362994 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f6c6c086440 con 0x7f6c740c7b80 2023-10-06T02:57:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.228+0000 7f6c68ff9700 1 -- 172.21.15.81:0/2643362994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f6c6006f1e0 con 0x7f6c740c7b80 2023-10-06T02:57:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.228+0000 7f6c78920700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c60066f00 0x7f6c600693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.229+0000 7f6c78920700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c60066f00 0x7f6c600693b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6c700015a0 tx=0x7f6c70007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:04.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.232+0000 7f6c68ff9700 1 -- 172.21.15.81:0/2643362994 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c740c5e00 con 0x7f6c740c7b80 2023-10-06T02:57:04.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.457+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c740c5d90 con 0x7f6c740c7b80 2023-10-06T02:57:04.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.457+0000 7f6c68ff9700 1 -- 172.21.15.81:0/2643362994 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f6c6c0534f0 con 0x7f6c740c7b80 2023-10-06T02:57:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:04.458 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4037385194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4037385194},{"type":"v1","addr":"172.21.15.83:6837","nonce":4037385194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2052186081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2052186081},{"type":"v1","addr":"172.21.15.83:6836","nonce":2052186081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2641977500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2641977500},{"type":"v1","addr":"172.21.15.81:6833","nonce":2641977500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:47.127871+0000","modified":"2023-10-06T02:55:50.779474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/70519905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":70519905},{"type":"v1","addr":"172.21.15.81:6835","nonce":70519905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T02:57:04.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c60066f00 msgr2=0x7f6c600693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c60066f00 0x7f6c600693b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6c700015a0 tx=0x7f6c70007040 comp rx=0 tx=0).stop 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c740c7b80 msgr2=0x7f6c74069920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c740c7b80 0x7f6c74069920 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c012000 tx=0x7f6c6c016000 comp rx=0 tx=0).stop 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 shutdown_connections 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c740c7b80 0x7f6c74069920 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6c60066f00 0x7f6c600693b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c74154d10 0x7f6c7416b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 --2- 172.21.15.81:0/2643362994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c741550e0 0x7f6c740c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 >> 172.21.15.81:0/2643362994 conn(0x7f6c7406bb90 msgr2=0x7f6c74156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 shutdown_connections 2023-10-06T02:57:04.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.459+0000 7f6c7ab84700 1 -- 172.21.15.81:0/2643362994 wait complete. 2023-10-06T02:57:04.462 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2023-10-06T02:57:04.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:04.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.585+0000 7f41a3ee6700 1 Processor -- start 2023-10-06T02:57:04.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.585+0000 7f41a3ee6700 1 -- start start 2023-10-06T02:57:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.586+0000 7f41a3ee6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f419c1578d0 0x7f419c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.586+0000 7f41a3ee6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c06d120 0x7f419c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.586+0000 7f41a3ee6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c0d07c0 con 0x7f419c157ca0 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.586+0000 7f41a3ee6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c06daa0 con 0x7f419c1578d0 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.586+0000 7f41a3ee6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0cfbb0 con 0x7f419c06d120 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.586+0000 7f41a1481700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f419c157ca0 0x7f419c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54756/0 (socket says 172.21.15.81:54756) 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.586+0000 7f41a1481700 1 -- 172.21.15.81:0/2563773683 learned_addr learned my addr 172.21.15.81:0/2563773683 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.586+0000 7f41a2483700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c06d120 0x7f419c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a1c82700 1 --2- 172.21.15.81:0/2563773683 >> v2:172.21.15.83:3300/0 conn(0x7f419c1578d0 0x7f419c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676614450 0 0) 0x7f419c0d07c0 con 0x7f419c157ca0 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4188003570 con 0x7f419c157ca0 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3336454673 0 0) 0x7f4188003570 con 0x7f419c157ca0 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c06d120 msgr2=0x7f419c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c06d120 0x7f419c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 >> v2:172.21.15.83:3300/0 conn(0x7f419c1578d0 msgr2=0x7f419c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 --2- 172.21.15.81:0/2563773683 >> v2:172.21.15.83:3300/0 conn(0x7f419c1578d0 0x7f419c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0cfe90 con 0x7f419c157ca0 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f418c001470 con 0x7f419c157ca0 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 >> v1:172.21.15.81:6789/0 conn(0x7f419c157ca0 legacy=0x7f419c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c06d120 0x7f4188003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4188003fe0 0x7f4188004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4188004d50 0x7f41880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c06daa0 con 0x7f4188003fe0 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0cfbb0 con 0x7f4188004d50 2023-10-06T02:57:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418800ba90 con 0x7f419c06d120 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a1481700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4188003fe0 0x7f4188004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a1c82700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c06d120 0x7f4188003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a2483700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4188004d50 0x7f41880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a1481700 1 -- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c06d120 msgr2=0x7f4188003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a1481700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c06d120 0x7f4188003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a1481700 1 -- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4188004d50 msgr2=0x7f41880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a1481700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4188004d50 0x7f41880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a1481700 1 -- 172.21.15.81:0/2563773683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4188003570 con 0x7f4188003fe0 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.587+0000 7f41a1481700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4188003fe0 0x7f4188004810 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f418c00c390 tx=0x7f419c0d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247c98c64e32a75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00cc00 con 0x7f4188003fe0 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00cda0 con 0x7f4188003fe0 2023-10-06T02:57:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a0c80700 1 -- 172.21.15.81:0/2563773683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c005b70 con 0x7f4188003fe0 2023-10-06T02:57:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a3ee6700 1 -- 172.21.15.81:0/2563773683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4188003fe0 msgr2=0x7f4188004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a3ee6700 1 --2- 172.21.15.81:0/2563773683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4188003fe0 0x7f4188004810 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f418c00c390 tx=0x7f419c0d0730 comp rx=0 tx=0).stop 2023-10-06T02:57:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a2483700 1 -- 172.21.15.81:0/2563773683 reap_dead start 2023-10-06T02:57:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a3ee6700 1 -- 172.21.15.81:0/2563773683 shutdown_connections 2023-10-06T02:57:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a3ee6700 1 -- 172.21.15.81:0/2563773683 >> 172.21.15.81:0/2563773683 conn(0x7f419c06bb90 msgr2=0x7f419c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a3ee6700 1 -- 172.21.15.81:0/2563773683 shutdown_connections 2023-10-06T02:57:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.588+0000 7f41a3ee6700 1 -- 172.21.15.81:0/2563773683 wait complete. 2023-10-06T02:57:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.589+0000 7f41a3ee6700 1 Processor -- start 2023-10-06T02:57:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.589+0000 7f41a3ee6700 1 -- start start 2023-10-06T02:57:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a3ee6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4188003fe0 0x7f419c0b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a3ee6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c147260 0x7f419c0cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a3ee6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c0cb700 0x7f419c0ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a3ee6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0cbb70 con 0x7f419c0cb700 2023-10-06T02:57:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a3ee6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0cc960 con 0x7f4188003fe0 2023-10-06T02:57:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a3ee6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0cbd50 con 0x7f419c147260 2023-10-06T02:57:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a2483700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c0cb700 0x7f419c0ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a2483700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c0cb700 0x7f419c0ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48276/0 (socket says 172.21.15.81:48276) 2023-10-06T02:57:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a2483700 1 -- 172.21.15.81:0/1098536715 learned_addr learned my addr 172.21.15.81:0/1098536715 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a1c82700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4188003fe0 0x7f419c0b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a1481700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c147260 0x7f419c0cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a2483700 1 -- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c147260 msgr2=0x7f419c0cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a2483700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c147260 0x7f419c0cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a2483700 1 -- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4188003fe0 msgr2=0x7f419c0b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a2483700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4188003fe0 0x7f419c0b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.590+0000 7f41a2483700 1 -- 172.21.15.81:0/1098536715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0cc030 con 0x7f419c0cb700 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.591+0000 7f41a2483700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c0cb700 0x7f419c0ccdf0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f419c063f70 tx=0x7f41940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.591+0000 7f4191ffb700 1 -- 172.21.15.81:0/1098536715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194013680 con 0x7f419c0cb700 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.591+0000 7f4191ffb700 1 -- 172.21.15.81:0/1098536715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41940137e0 con 0x7f419c0cb700 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.591+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c0cc310 con 0x7f419c0cb700 2023-10-06T02:57:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.591+0000 7f4191ffb700 1 -- 172.21.15.81:0/1098536715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194013b60 con 0x7f419c0cb700 2023-10-06T02:57:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.591+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c1476d0 con 0x7f419c0cb700 2023-10-06T02:57:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.592+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c0ccad0 con 0x7f419c0cb700 2023-10-06T02:57:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.592+0000 7f4191ffb700 1 -- 172.21.15.81:0/1098536715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4194014440 con 0x7f419c0cb700 2023-10-06T02:57:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.593+0000 7f4191ffb700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4180066f30 0x7f41800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.593+0000 7f4191ffb700 1 -- 172.21.15.81:0/1098536715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4194084a00 con 0x7f419c0cb700 2023-10-06T02:57:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.593+0000 7f4191ffb700 1 -- 172.21.15.81:0/1098536715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f418006f210 con 0x7f419c0cb700 2023-10-06T02:57:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.593+0000 7f41a1c82700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4180066f30 0x7f41800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.593+0000 7f41a1c82700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4180066f30 0x7f41800693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f41980094d0 tx=0x7f419800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.597+0000 7f4191ffb700 1 -- 172.21.15.81:0/1098536715 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4194022020 con 0x7f419c0cb700 2023-10-06T02:57:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.780+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f419c0d0170 con 0x7f419c0cb700 2023-10-06T02:57:04.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.781+0000 7f4191ffb700 1 -- 172.21.15.81:0/1098536715 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+17006 (secure 0 0 0) 0x7f4194051b30 con 0x7f419c0cb700 2023-10-06T02:57:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:04.782 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":168,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:56:39.469652+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:44.780110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:46.089490+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.25","mappings":[{"from":3,"to":0}]},{"pgid":"22.28","mappings":[{"from":3,"to":0}]},{"pgid":"22.33","mappings":[{"from":3,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:04.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4180066f30 msgr2=0x7f41800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4180066f30 0x7f41800693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f41980094d0 tx=0x7f419800b040 comp rx=0 tx=0).stop 2023-10-06T02:57:04.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c0cb700 msgr2=0x7f419c0ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c0cb700 0x7f419c0ccdf0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f419c063f70 tx=0x7f41940091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 shutdown_connections 2023-10-06T02:57:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c0cb700 0x7f419c0ccdf0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4180066f30 0x7f41800693e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4188003fe0 0x7f419c0b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 --2- 172.21.15.81:0/1098536715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f419c147260 0x7f419c0cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 >> 172.21.15.81:0/1098536715 conn(0x7f419c06bb90 msgr2=0x7f419c0d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 shutdown_connections 2023-10-06T02:57:04.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.783+0000 7f41a3ee6700 1 -- 172.21.15.81:0/1098536715 wait complete. 2023-10-06T02:57:04.796 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:57:04.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.910+0000 7ff462f71700 1 Processor -- start 2023-10-06T02:57:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.910+0000 7ff462f71700 1 -- start start 2023-10-06T02:57:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff462f71700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff45c157ca0 0x7ff45c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff462f71700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff462f71700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c0d07c0 con 0x7ff45c1578d0 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff462f71700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c06daa0 con 0x7ff45c157ca0 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff462f71700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0cfbb0 con 0x7ff45c06d120 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff460d0d700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff45c1578d0 0x7ff45c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:39272/0 (socket says 172.21.15.81:39272) 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff460d0d700 1 -- 172.21.15.81:0/177027043 learned_addr learned my addr 172.21.15.81:0/177027043 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff46150e700 1 --2- 172.21.15.81:0/177027043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff45bfff700 1 --2- 172.21.15.81:0/177027043 >> v2:172.21.15.83:3300/0 conn(0x7ff45c157ca0 0x7ff45c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff45b7fe700 1 -- 172.21.15.81:0/177027043 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171496693 0 0) 0x7ff45c0d07c0 con 0x7ff45c1578d0 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff45b7fe700 1 -- 172.21.15.81:0/177027043 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff444003570 con 0x7ff45c1578d0 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff45bfff700 1 -- 172.21.15.81:0/177027043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 msgr2=0x7ff45c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff45bfff700 1 --2- 172.21.15.81:0/177027043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff45bfff700 1 -- 172.21.15.81:0/177027043 >> v1:172.21.15.83:6789/0 conn(0x7ff45c1578d0 legacy=0x7ff45c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff45bfff700 1 -- 172.21.15.81:0/177027043 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c0cfe90 con 0x7ff45c157ca0 2023-10-06T02:57:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.911+0000 7ff46150e700 1 --2- 172.21.15.81:0/177027043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff45bfff700 1 --2- 172.21.15.81:0/177027043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 0x7ff45c0cf4f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff4500098e0 tx=0x7ff4500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5987ea836e4c76f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff45b7fe700 1 -- 172.21.15.81:0/177027043 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450011630 con 0x7ff45c157ca0 2023-10-06T02:57:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff45b7fe700 1 -- 172.21.15.81:0/177027043 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450011790 con 0x7ff45c157ca0 2023-10-06T02:57:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff45b7fe700 1 -- 172.21.15.81:0/177027043 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450011b30 con 0x7ff45c157ca0 2023-10-06T02:57:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff462f71700 1 -- 172.21.15.81:0/177027043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 msgr2=0x7ff45c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff462f71700 1 --2- 172.21.15.81:0/177027043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 0x7ff45c0cf4f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff4500098e0 tx=0x7ff4500091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff462f71700 1 -- 172.21.15.81:0/177027043 shutdown_connections 2023-10-06T02:57:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff462f71700 1 --2- 172.21.15.81:0/177027043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff462f71700 1 --2- 172.21.15.81:0/177027043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 0x7ff45c0cf4f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff462f71700 1 -- 172.21.15.81:0/177027043 >> 172.21.15.81:0/177027043 conn(0x7ff45c06bb90 msgr2=0x7ff45c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff462f71700 1 -- 172.21.15.81:0/177027043 shutdown_connections 2023-10-06T02:57:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.912+0000 7ff462f71700 1 -- 172.21.15.81:0/177027043 wait complete. 2023-10-06T02:57:04.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.913+0000 7ff462f71700 1 Processor -- start 2023-10-06T02:57:04.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff462f71700 1 -- start start 2023-10-06T02:57:04.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff462f71700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff462f71700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45c1578d0 0x7ff45c0b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff462f71700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 0x7ff45c0aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff462f71700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c1540d0 con 0x7ff45c1578d0 2023-10-06T02:57:04.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff462f71700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0aa890 con 0x7ff45c157ca0 2023-10-06T02:57:04.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff462f71700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0ab6f0 con 0x7ff45c06d120 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45c1578d0 0x7ff45c0b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45c1578d0 0x7ff45c0b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48290/0 (socket says 172.21.15.81:48290) 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff45bfff700 1 -- 172.21.15.81:0/2584348615 learned_addr learned my addr 172.21.15.81:0/2584348615 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff460d0d700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.914+0000 7ff46150e700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 0x7ff45c0aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff45bfff700 1 -- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 msgr2=0x7ff45c153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff45bfff700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff45bfff700 1 -- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 msgr2=0x7ff45c0aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff45bfff700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 0x7ff45c0aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff45bfff700 1 -- 172.21.15.81:0/2584348615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff454009420 con 0x7ff45c1578d0 2023-10-06T02:57:04.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff460d0d700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff46150e700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 0x7ff45c0aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff45bfff700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45c1578d0 0x7ff45c0b6620 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff450013000 tx=0x7ff450017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff458ff9700 1 -- 172.21.15.81:0/2584348615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450011b10 con 0x7ff45c1578d0 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff458ff9700 1 -- 172.21.15.81:0/2584348615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450000cc0 con 0x7ff45c1578d0 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff450009420 con 0x7ff45c1578d0 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff458ff9700 1 -- 172.21.15.81:0/2584348615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450025620 con 0x7ff45c1578d0 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.915+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c0aadc0 con 0x7ff45c1578d0 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.916+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c067ac0 con 0x7ff45c1578d0 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.916+0000 7ff458ff9700 1 -- 172.21.15.81:0/2584348615 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4500259d0 con 0x7ff45c1578d0 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.917+0000 7ff458ff9700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff448066f30 0x7ff4480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:04.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.917+0000 7ff458ff9700 1 -- 172.21.15.81:0/2584348615 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ff450085d00 con 0x7ff45c1578d0 2023-10-06T02:57:04.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.917+0000 7ff458ff9700 1 -- 172.21.15.81:0/2584348615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7ff44806f210 con 0x7ff45c1578d0 2023-10-06T02:57:04.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.917+0000 7ff460d0d700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff448066f30 0x7ff4480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:04.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.918+0000 7ff460d0d700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff448066f30 0x7ff4480693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff44c005c50 tx=0x7ff44c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:04.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:04.921+0000 7ff458ff9700 1 -- 172.21.15.81:0/2584348615 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff450015020 con 0x7ff45c1578d0 2023-10-06T02:57:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.150+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff45c0ac840 con 0x7ff45c1578d0 2023-10-06T02:57:05.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.151+0000 7ff458ff9700 1 -- 172.21.15.81:0/2584348615 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4595 (secure 0 0 0) 0x7ff450052e70 con 0x7ff45c1578d0 2023-10-06T02:57:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:05.199 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4037385194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4037385194},{"type":"v1","addr":"172.21.15.83:6837","nonce":4037385194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2052186081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2052186081},{"type":"v1","addr":"172.21.15.83:6836","nonce":2052186081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2641977500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2641977500},{"type":"v1","addr":"172.21.15.81:6833","nonce":2641977500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:47.127871+0000","modified":"2023-10-06T02:55:50.779474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/70519905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":70519905},{"type":"v1","addr":"172.21.15.81:6835","nonce":70519905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T02:57:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff448066f30 msgr2=0x7ff4480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff448066f30 0x7ff4480693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff44c005c50 tx=0x7ff44c009040 comp rx=0 tx=0).stop 2023-10-06T02:57:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45c1578d0 msgr2=0x7ff45c0b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45c1578d0 0x7ff45c0b6620 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff450013000 tx=0x7ff450017000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 shutdown_connections 2023-10-06T02:57:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff448066f30 0x7ff4480693e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff45c157ca0 0x7ff45c0aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff45c06d120 0x7ff45c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 --2- 172.21.15.81:0/2584348615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45c1578d0 0x7ff45c0b6620 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 >> 172.21.15.81:0/2584348615 conn(0x7ff45c06bb90 msgr2=0x7ff45c1548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 shutdown_connections 2023-10-06T02:57:05.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.153+0000 7ff462f71700 1 -- 172.21.15.81:0/2584348615 wait complete. 2023-10-06T02:57:05.201 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2023-10-06T02:57:05.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.315+0000 7f1b671ba700 1 Processor -- start 2023-10-06T02:57:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.315+0000 7f1b671ba700 1 -- start start 2023-10-06T02:57:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b671ba700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b60159f10 0x7f1b60068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b671ba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60068cc0 0x7f1b600cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b671ba700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600cee10 con 0x7f1b60159b40 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b671ba700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b60069140 con 0x7f1b60159f10 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b671ba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600cd040 con 0x7f1b60068cc0 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b659b7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b60159f10 0x7f1b60068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b659b7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b60159f10 0x7f1b60068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48296/0 (socket says 172.21.15.81:48296) 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b659b7700 1 -- 172.21.15.81:0/2048528498 learned_addr learned my addr 172.21.15.81:0/2048528498 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b669b9700 1 --2- 172.21.15.81:0/2048528498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60068cc0 0x7f1b600cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b659b7700 1 -- 172.21.15.81:0/2048528498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60068cc0 msgr2=0x7f1b600cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b659b7700 1 --2- 172.21.15.81:0/2048528498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60068cc0 0x7f1b600cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b659b7700 1 -- 172.21.15.81:0/2048528498 >> v1:172.21.15.83:6789/0 conn(0x7f1b60159b40 legacy=0x7f1b600cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b659b7700 1 -- 172.21.15.81:0/2048528498 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600cd320 con 0x7f1b60159f10 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.316+0000 7f1b669b9700 1 --2- 172.21.15.81:0/2048528498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60068cc0 0x7f1b600cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b659b7700 1 --2- 172.21.15.81:0/2048528498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60159f10 0x7f1b60068780 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f1b500099b0 tx=0x7f1b50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124b7157e4cf1fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b651b6700 1 -- 172.21.15.81:0/2048528498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000b860 con 0x7f1b60159f10 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b651b6700 1 -- 172.21.15.81:0/2048528498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5000b9c0 con 0x7f1b60159f10 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b651b6700 1 -- 172.21.15.81:0/2048528498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000bd60 con 0x7f1b60159f10 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b671ba700 1 -- 172.21.15.81:0/2048528498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60159f10 msgr2=0x7f1b60068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b671ba700 1 --2- 172.21.15.81:0/2048528498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60159f10 0x7f1b60068780 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f1b500099b0 tx=0x7f1b50009250 comp rx=0 tx=0).stop 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b671ba700 1 -- 172.21.15.81:0/2048528498 shutdown_connections 2023-10-06T02:57:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b671ba700 1 --2- 172.21.15.81:0/2048528498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60068cc0 0x7f1b600cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b671ba700 1 --2- 172.21.15.81:0/2048528498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60159f10 0x7f1b60068780 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b671ba700 1 -- 172.21.15.81:0/2048528498 >> 172.21.15.81:0/2048528498 conn(0x7f1b600cd660 msgr2=0x7f1b600cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b671ba700 1 -- 172.21.15.81:0/2048528498 shutdown_connections 2023-10-06T02:57:05.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.317+0000 7f1b671ba700 1 -- 172.21.15.81:0/2048528498 wait complete. 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.318+0000 7f1b671ba700 1 Processor -- start 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.318+0000 7f1b671ba700 1 -- start start 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b671ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60068cc0 0x7f1b6014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b671ba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b60159b40 0x7f1b6016b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b671ba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60159f10 0x7f1b60154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b671ba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6016b7b0 con 0x7f1b60068cc0 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b671ba700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c8750 con 0x7f1b60159b40 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b671ba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60153c90 con 0x7f1b60159f10 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b661b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60068cc0 0x7f1b6014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b661b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60068cc0 0x7f1b6014d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48308/0 (socket says 172.21.15.81:48308) 2023-10-06T02:57:05.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b661b8700 1 -- 172.21.15.81:0/1004507439 learned_addr learned my addr 172.21.15.81:0/1004507439 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:05.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b669b9700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60159f10 0x7f1b60154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.319+0000 7f1b659b7700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b60159b40 0x7f1b6016b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b661b8700 1 -- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60159f10 msgr2=0x7f1b60154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b661b8700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60159f10 0x7f1b60154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b661b8700 1 -- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b60159b40 msgr2=0x7f1b6016b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b661b8700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b60159b40 0x7f1b6016b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b661b8700 1 -- 172.21.15.81:0/1004507439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500094f0 con 0x7f1b60068cc0 2023-10-06T02:57:05.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b661b8700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60068cc0 0x7f1b6014d910 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c590 tx=0x7f1b5c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b567fc700 1 -- 172.21.15.81:0/1004507439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c011590 con 0x7f1b60068cc0 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b567fc700 1 -- 172.21.15.81:0/1004507439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c011710 con 0x7f1b60068cc0 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b567fc700 1 -- 172.21.15.81:0/1004507439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c011ad0 con 0x7f1b60068cc0 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b600c7e20 con 0x7f1b60068cc0 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.320+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b600c83e0 con 0x7f1b60068cc0 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.321+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b600cca10 con 0x7f1b60068cc0 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.321+0000 7f1b567fc700 1 -- 172.21.15.81:0/1004507439 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b5c01b3b0 con 0x7f1b60068cc0 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.322+0000 7f1b567fc700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1b44066f30 0x7f1b440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.322+0000 7f1b567fc700 1 -- 172.21.15.81:0/1004507439 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f1b5c083b60 con 0x7f1b60068cc0 2023-10-06T02:57:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.322+0000 7f1b659b7700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1b44066f30 0x7f1b440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.322+0000 7f1b567fc700 1 -- 172.21.15.81:0/1004507439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f1b4406f210 con 0x7f1b60068cc0 2023-10-06T02:57:05.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.322+0000 7f1b659b7700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1b44066f30 0x7f1b440693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1b500099b0 tx=0x7f1b50017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.326+0000 7f1b567fc700 1 -- 172.21.15.81:0/1004507439 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b5c017070 con 0x7f1b60068cc0 2023-10-06T02:57:05.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.550+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b600ce7c0 con 0x7f1b60068cc0 2023-10-06T02:57:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.551+0000 7f1b567fc700 1 -- 172.21.15.81:0/1004507439 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f1b5c050c10 con 0x7f1b60068cc0 2023-10-06T02:57:05.629 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:05.629 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4037385194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4037385194},{"type":"v1","addr":"172.21.15.83:6837","nonce":4037385194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2052186081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2052186081},{"type":"v1","addr":"172.21.15.83:6836","nonce":2052186081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2641977500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2641977500},{"type":"v1","addr":"172.21.15.81:6833","nonce":2641977500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:47.127871+0000","modified":"2023-10-06T02:55:50.779474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/70519905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":70519905},{"type":"v1","addr":"172.21.15.81:6835","nonce":70519905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T02:57:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1b44066f30 msgr2=0x7f1b440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1b44066f30 0x7f1b440693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1b500099b0 tx=0x7f1b50017000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60068cc0 msgr2=0x7f1b6014d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60068cc0 0x7f1b6014d910 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c590 tx=0x7f1b5c00c8a0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 shutdown_connections 2023-10-06T02:57:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b60159f10 0x7f1b60154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b60068cc0 0x7f1b6014d910 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1b44066f30 0x7f1b440693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 --2- 172.21.15.81:0/1004507439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b60159b40 0x7f1b6016b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 >> 172.21.15.81:0/1004507439 conn(0x7f1b600cd660 msgr2=0x7f1b6006ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 shutdown_connections 2023-10-06T02:57:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.553+0000 7f1b671ba700 1 -- 172.21.15.81:0/1004507439 wait complete. 2023-10-06T02:57:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2023-10-06T02:57:05.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.750+0000 7ff671637700 1 Processor -- start 2023-10-06T02:57:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.750+0000 7ff671637700 1 -- start start 2023-10-06T02:57:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.751+0000 7ff671637700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff66c0b3bd0 0x7ff66c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.751+0000 7ff671637700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff66c1583b0 0x7ff66c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.751+0000 7ff671637700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c0b2890 con 0x7ff66c157fe0 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.751+0000 7ff671637700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0b4070 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.751+0000 7ff671637700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0b4350 con 0x7ff66c1583b0 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.751+0000 7ff663fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff66c0b3bd0 0x7ff66c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.751+0000 7ff66affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff66c157fe0 0x7ff66c0b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54760/0 (socket says 172.21.15.81:54760) 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.751+0000 7ff66affd700 1 -- 172.21.15.81:0/3108612501 learned_addr learned my addr 172.21.15.81:0/3108612501 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff66b7fe700 1 --2- 172.21.15.81:0/3108612501 >> v2:172.21.15.83:3300/0 conn(0x7ff66c1583b0 0x7ff66c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff663fff700 1 -- 172.21.15.81:0/3108612501 >> v2:172.21.15.83:3300/0 conn(0x7ff66c1583b0 msgr2=0x7ff66c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff663fff700 1 --2- 172.21.15.81:0/3108612501 >> v2:172.21.15.83:3300/0 conn(0x7ff66c1583b0 0x7ff66c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff663fff700 1 -- 172.21.15.81:0/3108612501 >> v1:172.21.15.81:6789/0 conn(0x7ff66c157fe0 legacy=0x7ff66c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff66a7fc700 1 -- 172.21.15.81:0/3108612501 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431855817 0 0) 0x7ff66c0b2890 con 0x7ff66c157fe0 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff663fff700 1 -- 172.21.15.81:0/3108612501 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0b4630 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff663fff700 1 --2- 172.21.15.81:0/3108612501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 0x7ff66c0ceb30 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0cc640 tx=0x7ff6540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343c5ded7d846808 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff66a7fc700 1 -- 172.21.15.81:0/3108612501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400b6b0 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff66a7fc700 1 -- 172.21.15.81:0/3108612501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65400b810 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.752+0000 7ff66a7fc700 1 -- 172.21.15.81:0/3108612501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400bbb0 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.753+0000 7ff671637700 1 -- 172.21.15.81:0/3108612501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 msgr2=0x7ff66c0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.753+0000 7ff671637700 1 --2- 172.21.15.81:0/3108612501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 0x7ff66c0ceb30 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0cc640 tx=0x7ff6540091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.753+0000 7ff671637700 1 -- 172.21.15.81:0/3108612501 shutdown_connections 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.753+0000 7ff671637700 1 --2- 172.21.15.81:0/3108612501 >> v2:172.21.15.83:3300/0 conn(0x7ff66c1583b0 0x7ff66c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.753+0000 7ff671637700 1 --2- 172.21.15.81:0/3108612501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 0x7ff66c0ceb30 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.753+0000 7ff671637700 1 -- 172.21.15.81:0/3108612501 >> 172.21.15.81:0/3108612501 conn(0x7ff66c067640 msgr2=0x7ff66c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.753+0000 7ff671637700 1 -- 172.21.15.81:0/3108612501 shutdown_connections 2023-10-06T02:57:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.753+0000 7ff671637700 1 -- 172.21.15.81:0/3108612501 wait complete. 2023-10-06T02:57:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.754+0000 7ff671637700 1 Processor -- start 2023-10-06T02:57:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.754+0000 7ff671637700 1 -- start start 2023-10-06T02:57:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.754+0000 7ff671637700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 0x7ff66c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.754+0000 7ff671637700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c157fe0 0x7ff66c06dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.754+0000 7ff671637700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff66c1583b0 0x7ff66c152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.754+0000 7ff671637700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c06e450 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.754+0000 7ff671637700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c159f30 con 0x7ff66c157fe0 2023-10-06T02:57:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.754+0000 7ff671637700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15a210 con 0x7ff66c1583b0 2023-10-06T02:57:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.754+0000 7ff66affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 0x7ff66c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff66affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 0x7ff66c06d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48324/0 (socket says 172.21.15.81:48324) 2023-10-06T02:57:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff66affd700 1 -- 172.21.15.81:0/2742700960 learned_addr learned my addr 172.21.15.81:0/2742700960 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff663fff700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c157fe0 0x7ff66c06dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff66b7fe700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff66c1583b0 0x7ff66c152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff66affd700 1 -- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff66c1583b0 msgr2=0x7ff66c152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff66affd700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff66c1583b0 0x7ff66c152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff66affd700 1 -- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c157fe0 msgr2=0x7ff66c06dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff66affd700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c157fe0 0x7ff66c06dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff66affd700 1 -- 172.21.15.81:0/2742700960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654009420 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff663fff700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c157fe0 0x7ff66c06dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff66affd700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 0x7ff66c06d6d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c7e0 tx=0x7ff65c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff662ffd700 1 -- 172.21.15.81:0/2742700960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c005b30 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff662ffd700 1 -- 172.21.15.81:0/2742700960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c005c90 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c15a4f0 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff662ffd700 1 -- 172.21.15.81:0/2742700960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c007300 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.755+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c159be0 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.756+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c064650 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.756+0000 7ff662ffd700 1 -- 172.21.15.81:0/2742700960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff65c01b400 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.757+0000 7ff662ffd700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff64c066f30 0x7ff64c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.757+0000 7ff662ffd700 1 -- 172.21.15.81:0/2742700960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ff65c084180 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.757+0000 7ff662ffd700 1 -- 172.21.15.81:0/2742700960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7ff64c06f210 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.757+0000 7ff663fff700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff64c066f30 0x7ff64c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.757+0000 7ff663fff700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff64c066f30 0x7ff64c0693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0b3fa0 tx=0x7ff654017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.761+0000 7ff662ffd700 1 -- 172.21.15.81:0/2742700960 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff66c064650 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.942+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff66c064650 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.943+0000 7ff662ffd700 1 -- 172.21.15.81:0/2742700960 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+17006 (secure 0 0 0) 0x7ff66c064650 con 0x7ff66c0b3bd0 2023-10-06T02:57:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:05.945 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":168,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:56:39.469652+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:44.780110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:46.089490+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.25","mappings":[{"from":3,"to":0}]},{"pgid":"22.28","mappings":[{"from":3,"to":0}]},{"pgid":"22.33","mappings":[{"from":3,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff64c066f30 msgr2=0x7ff64c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff64c066f30 0x7ff64c0693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0b3fa0 tx=0x7ff654017000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 msgr2=0x7ff66c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 0x7ff66c06d6d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c7e0 tx=0x7ff65c007df0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 shutdown_connections 2023-10-06T02:57:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff66c1583b0 0x7ff66c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66c0b3bd0 0x7ff66c06d6d0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff64c066f30 0x7ff64c0693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 --2- 172.21.15.81:0/2742700960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff66c157fe0 0x7ff66c06dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 >> 172.21.15.81:0/2742700960 conn(0x7ff66c067640 msgr2=0x7ff66c0ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 shutdown_connections 2023-10-06T02:57:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:05.946+0000 7ff671637700 1 -- 172.21.15.81:0/2742700960 wait complete. 2023-10-06T02:57:05.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:57:06.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.073+0000 7f12ba62b700 1 Processor -- start 2023-10-06T02:57:06.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.073+0000 7f12ba62b700 1 -- start start 2023-10-06T02:57:06.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12ba62b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f12b41578d0 0x7f12b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12ba62b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 0x7f12b415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12ba62b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12b406d120 0x7f12b406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12ba62b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b406dac0 con 0x7f12b406d120 2023-10-06T02:57:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12ba62b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b40d07c0 con 0x7f12b41578d0 2023-10-06T02:57:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12ba62b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40cfbb0 con 0x7f12b4157ca0 2023-10-06T02:57:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12b8bc8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12b406d120 0x7f12b406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12b8bc8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12b406d120 0x7f12b406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48340/0 (socket says 172.21.15.81:48340) 2023-10-06T02:57:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12b8bc8700 1 -- 172.21.15.81:0/3493183020 learned_addr learned my addr 172.21.15.81:0/3493183020 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12b3fff700 1 --2- 172.21.15.81:0/3493183020 >> v2:172.21.15.83:3300/0 conn(0x7f12b41578d0 0x7f12b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.074+0000 7f12b37fe700 1 --2- 172.21.15.81:0/3493183020 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 0x7f12b415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12b8bc8700 1 -- 172.21.15.81:0/3493183020 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 msgr2=0x7f12b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12b8bc8700 1 --2- 172.21.15.81:0/3493183020 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 0x7f12b415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12b8bc8700 1 -- 172.21.15.81:0/3493183020 >> v2:172.21.15.83:3300/0 conn(0x7f12b41578d0 msgr2=0x7f12b40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12b8bc8700 1 --2- 172.21.15.81:0/3493183020 >> v2:172.21.15.83:3300/0 conn(0x7f12b41578d0 0x7f12b40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12b8bc8700 1 -- 172.21.15.81:0/3493183020 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40cfe90 con 0x7f12b406d120 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12b8bc8700 1 --2- 172.21.15.81:0/3493183020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 0x7f12b406d580 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f12b40646b0 tx=0x7f12ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713e1a2183546e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12b2ffd700 1 -- 172.21.15.81:0/3493183020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00e070 con 0x7f12b406d120 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12b2ffd700 1 -- 172.21.15.81:0/3493183020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac00b970 con 0x7f12b406d120 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12b2ffd700 1 -- 172.21.15.81:0/3493183020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0092e0 con 0x7f12b406d120 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12ba62b700 1 -- 172.21.15.81:0/3493183020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 msgr2=0x7f12b406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12ba62b700 1 --2- 172.21.15.81:0/3493183020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 0x7f12b406d580 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f12b40646b0 tx=0x7f12ac009840 comp rx=0 tx=0).stop 2023-10-06T02:57:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12ba62b700 1 -- 172.21.15.81:0/3493183020 shutdown_connections 2023-10-06T02:57:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12ba62b700 1 --2- 172.21.15.81:0/3493183020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 0x7f12b406d580 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12ba62b700 1 --2- 172.21.15.81:0/3493183020 >> v2:172.21.15.83:3300/0 conn(0x7f12b41578d0 0x7f12b40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12ba62b700 1 --2- 172.21.15.81:0/3493183020 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 0x7f12b415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12ba62b700 1 -- 172.21.15.81:0/3493183020 >> 172.21.15.81:0/3493183020 conn(0x7f12b406bb90 msgr2=0x7f12b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12ba62b700 1 -- 172.21.15.81:0/3493183020 shutdown_connections 2023-10-06T02:57:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.075+0000 7f12ba62b700 1 -- 172.21.15.81:0/3493183020 wait complete. 2023-10-06T02:57:06.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.076+0000 7f12ba62b700 1 Processor -- start 2023-10-06T02:57:06.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.077+0000 7f12ba62b700 1 -- start start 2023-10-06T02:57:06.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12ba62b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 0x7f12b416a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12ba62b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12b41578d0 0x7f12b40aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12ba62b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 0x7f12b415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12ba62b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b416abb0 con 0x7f12b406d120 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12ba62b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40b50e0 con 0x7f12b41578d0 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12ba62b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b416ea70 con 0x7f12b4157ca0 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 0x7f12b416a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 0x7f12b416a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48346/0 (socket says 172.21.15.81:48346) 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b3fff700 1 -- 172.21.15.81:0/576549152 learned_addr learned my addr 172.21.15.81:0/576549152 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b37fe700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12b41578d0 0x7f12b40aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b8bc8700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 0x7f12b415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b3fff700 1 -- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 msgr2=0x7f12b415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b3fff700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 0x7f12b415c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b3fff700 1 -- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12b41578d0 msgr2=0x7f12b40aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b3fff700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12b41578d0 0x7f12b40aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b3fff700 1 -- 172.21.15.81:0/576549152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac009ae0 con 0x7f12b406d120 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12b3fff700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 0x7f12b416a670 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f12a400ec80 tx=0x7f12a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400c850 con 0x7f12b406d120 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a400c9b0 con 0x7f12b406d120 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b416e140 con 0x7f12b406d120 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400cd50 con 0x7f12b406d120 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.078+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b416e780 con 0x7f12b406d120 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.079+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b40b53c0 con 0x7f12b406d120 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.080+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12a4013680 con 0x7f12b406d120 2023-10-06T02:57:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.080+0000 7f129bfff700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12a0066f60 0x7f12a0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.080+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f12a40848d0 con 0x7f12b406d120 2023-10-06T02:57:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.080+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f12a006f240 con 0x7f12b406d120 2023-10-06T02:57:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.080+0000 7f12b37fe700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12a0066f60 0x7f12a0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.081+0000 7f12b37fe700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12a0066f60 0x7f12a0069410 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f12b40b28e0 tx=0x7f12a80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.084+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12a4021060 con 0x7f12b406d120 2023-10-06T02:57:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.309+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f12b40aafd0 con 0x7f12b406d120 2023-10-06T02:57:06.311 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:57:06.310+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:57:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.311+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(169..169 src has 1..169) v4 ==== 366+0+0 (secure 0 0 0) 0x7f12a4055640 con 0x7f12b406d120 2023-10-06T02:57:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.312+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=170}) v3 -- 0x7f12a006fb90 con 0x7f12b406d120 2023-10-06T02:57:06.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.314+0000 7f129bfff700 1 -- 172.21.15.81:0/576549152 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7f12b40aafd0 con 0x7f12b406d120 2023-10-06T02:57:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.317+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12a0066f60 msgr2=0x7f12a0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.317+0000 7f12ba62b700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12a0066f60 0x7f12a0069410 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f12b40b28e0 tx=0x7f12a80091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 msgr2=0x7f12b416a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 0x7f12b416a670 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f12a400ec80 tx=0x7f12a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 shutdown_connections 2023-10-06T02:57:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12b4157ca0 0x7f12b415c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406d120 0x7f12b416a670 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f12a0066f60 0x7f12a0069410 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 --2- 172.21.15.81:0/576549152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12b41578d0 0x7f12b40aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 >> 172.21.15.81:0/576549152 conn(0x7f12b406bb90 msgr2=0x7f12b4068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 shutdown_connections 2023-10-06T02:57:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.318+0000 7f12ba62b700 1 -- 172.21.15.81:0/576549152 wait complete. 2023-10-06T02:57:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:57:06.320 INFO:tasks.ceph.mds.c.smithi081.stderr: -8586> 2023-10-06T02:55:52.052+0000 7fa244f17700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:57:06.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:57:06.349 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:57:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.447+0000 7f87ed70c700 1 Processor -- start 2023-10-06T02:57:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.447+0000 7f87ed70c700 1 -- start start 2023-10-06T02:57:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.448+0000 7f87ed70c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8156850 0x7f87e815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.448+0000 7f87ed70c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f87e8156c20 0x7f87e806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.448+0000 7f87ed70c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e80c84f0 con 0x7f87e8157d30 2023-10-06T02:57:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.448+0000 7f87ed70c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e80c79b0 con 0x7f87e8156c20 2023-10-06T02:57:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.448+0000 7f87ed70c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80c7bc0 con 0x7f87e8156850 2023-10-06T02:57:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.448+0000 7f87e6ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8156850 0x7f87e815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.448+0000 7f87e67fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f87e8156c20 0x7f87e806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.448+0000 7f87e77fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f87e8157d30 0x7f87e806eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:39288/0 (socket says 172.21.15.81:39288) 2023-10-06T02:57:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.448+0000 7f87e77fe700 1 -- 172.21.15.81:0/3203038044 learned_addr learned my addr 172.21.15.81:0/3203038044 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.449+0000 7f87e6ffd700 1 -- 172.21.15.81:0/3203038044 >> v2:172.21.15.83:3300/0 conn(0x7f87e8156c20 msgr2=0x7f87e806cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.449+0000 7f87e6ffd700 1 --2- 172.21.15.81:0/3203038044 >> v2:172.21.15.83:3300/0 conn(0x7f87e8156c20 0x7f87e806cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.449+0000 7f87e6ffd700 1 -- 172.21.15.81:0/3203038044 >> v1:172.21.15.83:6789/0 conn(0x7f87e8157d30 legacy=0x7f87e806eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.449+0000 7f87e6ffd700 1 -- 172.21.15.81:0/3203038044 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80c7ea0 con 0x7f87e8156850 2023-10-06T02:57:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.449+0000 7f87e6ffd700 1 --2- 172.21.15.81:0/3203038044 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8156850 0x7f87e815ad20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009e60 tx=0x7f87d8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b480c3999152dd36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.449+0000 7f87e5ffb700 1 -- 172.21.15.81:0/3203038044 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d800e070 con 0x7f87e8156850 2023-10-06T02:57:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.449+0000 7f87e5ffb700 1 -- 172.21.15.81:0/3203038044 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d800bb60 con 0x7f87e8156850 2023-10-06T02:57:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.449+0000 7f87e5ffb700 1 -- 172.21.15.81:0/3203038044 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8012430 con 0x7f87e8156850 2023-10-06T02:57:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.450+0000 7f87ed70c700 1 -- 172.21.15.81:0/3203038044 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8156850 msgr2=0x7f87e815ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.450+0000 7f87ed70c700 1 --2- 172.21.15.81:0/3203038044 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8156850 0x7f87e815ad20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009e60 tx=0x7f87d8009780 comp rx=0 tx=0).stop 2023-10-06T02:57:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.450+0000 7f87ed70c700 1 -- 172.21.15.81:0/3203038044 shutdown_connections 2023-10-06T02:57:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.450+0000 7f87ed70c700 1 --2- 172.21.15.81:0/3203038044 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8156850 0x7f87e815ad20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.450+0000 7f87ed70c700 1 --2- 172.21.15.81:0/3203038044 >> v2:172.21.15.83:3300/0 conn(0x7f87e8156c20 0x7f87e806cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.450+0000 7f87ed70c700 1 -- 172.21.15.81:0/3203038044 >> 172.21.15.81:0/3203038044 conn(0x7f87e80c9ac0 msgr2=0x7f87e80c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.450+0000 7f87ed70c700 1 -- 172.21.15.81:0/3203038044 shutdown_connections 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.450+0000 7f87ed70c700 1 -- 172.21.15.81:0/3203038044 wait complete. 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.451+0000 7f87ed70c700 1 Processor -- start 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.451+0000 7f87ed70c700 1 -- start start 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87ed70c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e8156850 0x7f87e80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87ed70c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87e8156c20 0x7f87e8168ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87ed70c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8157d30 0x7f87e8143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87ed70c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80b2d60 con 0x7f87e8156850 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87ed70c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e816c9b0 con 0x7f87e8156c20 2023-10-06T02:57:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87ed70c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e81693e0 con 0x7f87e8157d30 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e8156850 0x7f87e80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e8156850 0x7f87e80b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48366/0 (socket says 172.21.15.81:48366) 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e6ffd700 1 -- 172.21.15.81:0/4188305571 learned_addr learned my addr 172.21.15.81:0/4188305571 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e67fc700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87e8156c20 0x7f87e8168ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e77fe700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8157d30 0x7f87e8143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e6ffd700 1 -- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8157d30 msgr2=0x7f87e8143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e6ffd700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8157d30 0x7f87e8143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e6ffd700 1 -- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87e8156c20 msgr2=0x7f87e8168ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e6ffd700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87e8156c20 0x7f87e8168ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e6ffd700 1 -- 172.21.15.81:0/4188305571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d8009a20 con 0x7f87e8156850 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e77fe700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8157d30 0x7f87e8143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e67fc700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87e8156c20 0x7f87e8168ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87e6ffd700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e8156850 0x7f87e80b26f0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f87d800b6c0 tx=0x7f87d8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.452+0000 7f87deffd700 1 -- 172.21.15.81:0/4188305571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8012e50 con 0x7f87e8156850 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.453+0000 7f87deffd700 1 -- 172.21.15.81:0/4188305571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8027470 con 0x7f87e8156850 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.453+0000 7f87deffd700 1 -- 172.21.15.81:0/4188305571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8027830 con 0x7f87e8156850 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.453+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e816c520 con 0x7f87e8156850 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.453+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e816bed0 con 0x7f87e8156850 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.454+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e80684b0 con 0x7f87e8156850 2023-10-06T02:57:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.454+0000 7f87deffd700 1 -- 172.21.15.81:0/4188305571 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87d8024070 con 0x7f87e8156850 2023-10-06T02:57:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.454+0000 7f87deffd700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f87c8066f60 0x7f87c8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.454+0000 7f87deffd700 1 -- 172.21.15.81:0/4188305571 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f87d8086dd0 con 0x7f87e8156850 2023-10-06T02:57:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.454+0000 7f87deffd700 1 -- 172.21.15.81:0/4188305571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=170}) v3 -- 0x7f87c806f2e0 con 0x7f87e8156850 2023-10-06T02:57:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.454+0000 7f87e67fc700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f87c8066f60 0x7f87c8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.455+0000 7f87e67fc700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f87c8066f60 0x7f87c8069410 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f87e814a410 tx=0x7f87d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.459+0000 7f87deffd700 1 -- 172.21.15.81:0/4188305571 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87d802c060 con 0x7f87e8156850 2023-10-06T02:57:06.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:06.682+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f87e80c8180 con 0x7f87e8156850 2023-10-06T02:57:07.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.314+0000 7f87deffd700 1 -- 172.21.15.81:0/4188305571 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7f87d80880a0 con 0x7f87e8156850 2023-10-06T02:57:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f87c8066f60 msgr2=0x7f87c8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f87c8066f60 0x7f87c8069410 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f87e814a410 tx=0x7f87d0008040 comp rx=0 tx=0).stop 2023-10-06T02:57:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e8156850 msgr2=0x7f87e80b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e8156850 0x7f87e80b26f0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f87d800b6c0 tx=0x7f87d8019000 comp rx=0 tx=0).stop 2023-10-06T02:57:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 shutdown_connections 2023-10-06T02:57:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87e8157d30 0x7f87e8143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e8156850 0x7f87e80b26f0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f87c8066f60 0x7f87c8069410 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 --2- 172.21.15.81:0/4188305571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87e8156c20 0x7f87e8168ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 >> 172.21.15.81:0/4188305571 conn(0x7f87e80c9ac0 msgr2=0x7f87e80c2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 shutdown_connections 2023-10-06T02:57:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.316+0000 7f87ed70c700 1 -- 172.21.15.81:0/4188305571 wait complete. 2023-10-06T02:57:07.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:57:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.488+0000 7f33b19b2700 1 Processor -- start 2023-10-06T02:57:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.488+0000 7f33b19b2700 1 -- start start 2023-10-06T02:57:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.489+0000 7f33b19b2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f33ac06d830 0x7f33ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.489+0000 7f33b19b2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0d07c0 con 0x7f33ac157ca0 2023-10-06T02:57:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.489+0000 7f33b19b2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0cfbb0 con 0x7f33ac1578d0 2023-10-06T02:57:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.489+0000 7f33b19b2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac0cfe90 con 0x7f33ac06d830 2023-10-06T02:57:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.489+0000 7f33a27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f33ac157ca0 0x7f33ac06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54776/0 (socket says 172.21.15.81:54776) 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.489+0000 7f33a27fc700 1 -- 172.21.15.81:0/278070505 learned_addr learned my addr 172.21.15.81:0/278070505 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.489+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051612766 0 0) 0x7f33ac0d07c0 con 0x7f33ac157ca0 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.489+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3398003570 con 0x7f33ac157ca0 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.489+0000 7f33ab7fe700 1 --2- 172.21.15.81:0/278070505 >> v2:172.21.15.83:3300/0 conn(0x7f33ac06d830 0x7f33ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2592374593 0 0) 0x7f3398003570 con 0x7f33ac157ca0 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 >> v2:172.21.15.83:3300/0 conn(0x7f33ac06d830 msgr2=0x7f33ac0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 --2- 172.21.15.81:0/278070505 >> v2:172.21.15.83:3300/0 conn(0x7f33ac06d830 0x7f33ac0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 >> v1:172.21.15.83:6789/0 conn(0x7f33ac1578d0 legacy=0x7f33ac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0d0170 con 0x7f33ac157ca0 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f3394001470 con 0x7f33ac157ca0 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 >> v1:172.21.15.81:6789/0 conn(0x7f33ac157ca0 legacy=0x7f33ac06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3398003a60 0x7f3398003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3398004810 0x7f3398004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33980051c0 0x7f339800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0cfe90 con 0x7f33980051c0 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339800c0d0 con 0x7f3398003a60 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339800c290 con 0x7f3398004810 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33ab7fe700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33980051c0 0x7f339800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aaffd700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3398003a60 0x7f3398003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33a27fc700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3398004810 0x7f3398004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33ab7fe700 1 -- 172.21.15.81:0/278070505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3398004810 msgr2=0x7f3398004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33ab7fe700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3398004810 0x7f3398004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33ab7fe700 1 -- 172.21.15.81:0/278070505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3398003a60 msgr2=0x7f3398003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33ab7fe700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3398003a60 0x7f3398003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33ab7fe700 1 -- 172.21.15.81:0/278070505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398003570 con 0x7f33980051c0 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33a27fc700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3398004810 0x7f3398004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33ab7fe700 1 -- 172.21.15.81:0/278070505 reap_dead start 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33ab7fe700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33980051c0 0x7f339800ba60 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f33a400e210 tx=0x7f33a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd1ec326a8e7b1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400eac0 con 0x7f33980051c0 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a400f040 con 0x7f33980051c0 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.490+0000 7f33aa7fc700 1 -- 172.21.15.81:0/278070505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400ee70 con 0x7f33980051c0 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.491+0000 7f33b19b2700 1 -- 172.21.15.81:0/278070505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33980051c0 msgr2=0x7f339800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.491+0000 7f33b19b2700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33980051c0 0x7f339800ba60 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f33a400e210 tx=0x7f33a400b040 comp rx=0 tx=0).stop 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.491+0000 7f33b19b2700 1 -- 172.21.15.81:0/278070505 shutdown_connections 2023-10-06T02:57:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.491+0000 7f33b19b2700 1 --2- 172.21.15.81:0/278070505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33980051c0 0x7f339800ba60 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.491+0000 7f33b19b2700 1 -- 172.21.15.81:0/278070505 >> 172.21.15.81:0/278070505 conn(0x7f33ac06bb90 msgr2=0x7f33ac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.491+0000 7f33b19b2700 1 -- 172.21.15.81:0/278070505 shutdown_connections 2023-10-06T02:57:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.491+0000 7f33b19b2700 1 -- 172.21.15.81:0/278070505 wait complete. 2023-10-06T02:57:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.492+0000 7f33b19b2700 1 Processor -- start 2023-10-06T02:57:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.492+0000 7f33b19b2700 1 -- start start 2023-10-06T02:57:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33b19b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33980051c0 0x7f33ac0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33b19b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33b19b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33ac16a7f0 0x7f33ac16ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33b19b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0b63f0 con 0x7f33ac0c65f0 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33b19b2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0b57e0 con 0x7f33ac16a7f0 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33b19b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0b5ac0 con 0x7f33980051c0 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48374/0 (socket says 172.21.15.81:48374) 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a27fc700 1 -- 172.21.15.81:0/1504508598 learned_addr learned my addr 172.21.15.81:0/1504508598 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33ab7fe700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33ac16a7f0 0x7f33ac16ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a27fc700 1 -- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33980051c0 msgr2=0x7f33ac0b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a27fc700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33980051c0 0x7f33ac0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a27fc700 1 -- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33ac16a7f0 msgr2=0x7f33ac16ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a27fc700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33ac16a7f0 0x7f33ac16ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a27fc700 1 -- 172.21.15.81:0/1504508598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0b5da0 con 0x7f33ac0c65f0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a27fc700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1537b0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f339400db80 tx=0x7f3394009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394001d80 con 0x7f33ac0c65f0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.493+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3394007360 con 0x7f33ac0c65f0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.494+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac0b6080 con 0x7f33ac0c65f0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.494+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33940076e0 con 0x7f33ac0c65f0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.494+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac153cf0 con 0x7f33ac0c65f0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.494+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac067ac0 con 0x7f33ac0c65f0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.495+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3394004a40 con 0x7f33ac0c65f0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.495+0000 7f33a37fe700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f338c066f30 0x7f338c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.495+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f3394084220 con 0x7f33ac0c65f0 2023-10-06T02:57:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.495+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=170}) v3 -- 0x7f338c06f2b0 con 0x7f33ac0c65f0 2023-10-06T02:57:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.495+0000 7f33aaffd700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f338c066f30 0x7f338c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.496+0000 7f33aaffd700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f338c066f30 0x7f338c0693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f339c000c00 tx=0x7f339c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.499+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f339404d5a0 con 0x7f33ac0c65f0 2023-10-06T02:57:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:07.679+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f33ac0d0450 con 0x7f33ac0c65f0 2023-10-06T02:57:07.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:07.973 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.317+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(170..170 src has 1..170) v4 ==== 288+0+0 (secure 0 0 0) 0x7f3394055070 con 0x7f33ac0c65f0 2023-10-06T02:57:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.317+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f338c06d6e0 con 0x7f33ac0c65f0 2023-10-06T02:57:08.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.323+0000 7f33a37fe700 1 -- 172.21.15.81:0/1504508598 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v170) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3394019030 con 0x7f33ac0c65f0 2023-10-06T02:57:08.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f338c066f30 msgr2=0x7f338c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f338c066f30 0x7f338c0693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f339c000c00 tx=0x7f339c007d30 comp rx=0 tx=0).stop 2023-10-06T02:57:08.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac0c65f0 msgr2=0x7f33ac1537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1537b0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f339400db80 tx=0x7f3394009040 comp rx=0 tx=0).stop 2023-10-06T02:57:08.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 shutdown_connections 2023-10-06T02:57:08.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f338c066f30 0x7f338c0693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33ac16a7f0 0x7f33ac16ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33980051c0 0x7f33ac0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 --2- 172.21.15.81:0/1504508598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac0c65f0 0x7f33ac1537b0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 >> 172.21.15.81:0/1504508598 conn(0x7f33ac06bb90 msgr2=0x7f33ac155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:08.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 shutdown_connections 2023-10-06T02:57:08.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.326+0000 7f33b19b2700 1 -- 172.21.15.81:0/1504508598 wait complete. 2023-10-06T02:57:08.328 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:57:08.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:57:08.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.456+0000 7f728e10a700 1 Processor -- start 2023-10-06T02:57:08.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.456+0000 7f728e10a700 1 -- start start 2023-10-06T02:57:08.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.457+0000 7f728e10a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72881578d0 0x7f72880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.457+0000 7f728e10a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72880d07c0 con 0x7f728806d120 2023-10-06T02:57:08.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.457+0000 7f728e10a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72880cfbb0 con 0x7f7288157ca0 2023-10-06T02:57:08.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.457+0000 7f728e10a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72880cfe90 con 0x7f72881578d0 2023-10-06T02:57:08.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.457+0000 7f72877fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72881578d0 0x7f72880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.457+0000 7f7287fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f728806d120 0x7f728806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54792/0 (socket says 172.21.15.81:54792) 2023-10-06T02:57:08.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.457+0000 7f7287fff700 1 -- 172.21.15.81:0/1215807954 learned_addr learned my addr 172.21.15.81:0/1215807954 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:08.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f72877fe700 1 -- 172.21.15.81:0/1215807954 >> v1:172.21.15.83:6789/0 conn(0x7f7288157ca0 legacy=0x7f728815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:08.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f72877fe700 1 -- 172.21.15.81:0/1215807954 >> v1:172.21.15.81:6789/0 conn(0x7f728806d120 legacy=0x7f728806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f72867fc700 1 -- 172.21.15.81:0/1215807954 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239375770 0 0) 0x7f72880d07c0 con 0x7f728806d120 2023-10-06T02:57:08.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f72877fe700 1 -- 172.21.15.81:0/1215807954 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880d0170 con 0x7f72881578d0 2023-10-06T02:57:08.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f72877fe700 1 --2- 172.21.15.81:0/1215807954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 0x7f72880cf4f0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f7278009e60 tx=0x7f7278009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73efec3f49408806 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f72867fc700 1 -- 172.21.15.81:0/1215807954 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727800e070 con 0x7f72881578d0 2023-10-06T02:57:08.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f72867fc700 1 -- 172.21.15.81:0/1215807954 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727800bc30 con 0x7f72881578d0 2023-10-06T02:57:08.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f72867fc700 1 -- 172.21.15.81:0/1215807954 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278012430 con 0x7f72881578d0 2023-10-06T02:57:08.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f728e10a700 1 -- 172.21.15.81:0/1215807954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 msgr2=0x7f72880cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f728e10a700 1 --2- 172.21.15.81:0/1215807954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 0x7f72880cf4f0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f7278009e60 tx=0x7f7278009780 comp rx=0 tx=0).stop 2023-10-06T02:57:08.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f728e10a700 1 -- 172.21.15.81:0/1215807954 shutdown_connections 2023-10-06T02:57:08.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f728e10a700 1 --2- 172.21.15.81:0/1215807954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 0x7f72880cf4f0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f728e10a700 1 -- 172.21.15.81:0/1215807954 >> 172.21.15.81:0/1215807954 conn(0x7f728806bb90 msgr2=0x7f728806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:08.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.458+0000 7f728e10a700 1 -- 172.21.15.81:0/1215807954 shutdown_connections 2023-10-06T02:57:08.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.459+0000 7f728e10a700 1 -- 172.21.15.81:0/1215807954 wait complete. 2023-10-06T02:57:08.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.460+0000 7f728e10a700 1 Processor -- start 2023-10-06T02:57:08.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.460+0000 7f728e10a700 1 -- start start 2023-10-06T02:57:08.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.460+0000 7f728e10a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f728806d120 0x7f72880c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.460+0000 7f728e10a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 0x7f7288156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.460+0000 7f728e10a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7288157ca0 0x7f72881535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.460+0000 7f728e10a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728816a500 con 0x7f72881578d0 2023-10-06T02:57:08.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.460+0000 7f728e10a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728816df50 con 0x7f728806d120 2023-10-06T02:57:08.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.460+0000 7f728e10a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728816e230 con 0x7f7288157ca0 2023-10-06T02:57:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f7286ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 0x7f7288156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f7286ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 0x7f7288156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48382/0 (socket says 172.21.15.81:48382) 2023-10-06T02:57:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f7286ffd700 1 -- 172.21.15.81:0/3264640903 learned_addr learned my addr 172.21.15.81:0/3264640903 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f7286ffd700 1 -- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7288157ca0 msgr2=0x7f72881535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f72877fe700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f728806d120 0x7f72880c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f7286ffd700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7288157ca0 0x7f72881535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f7286ffd700 1 -- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f728806d120 msgr2=0x7f72880c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f7286ffd700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f728806d120 0x7f72880c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f7286ffd700 1 -- 172.21.15.81:0/3264640903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278009a20 con 0x7f72881578d0 2023-10-06T02:57:08.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f7286ffd700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 0x7f7288156970 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c4e0 tx=0x7f727c007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c011590 con 0x7f72881578d0 2023-10-06T02:57:08.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c0116f0 con 0x7f72881578d0 2023-10-06T02:57:08.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c011ab0 con 0x7f72881578d0 2023-10-06T02:57:08.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728816e510 con 0x7f72881578d0 2023-10-06T02:57:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.461+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728806a110 con 0x7f72881578d0 2023-10-06T02:57:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.462+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7288067ac0 con 0x7f72881578d0 2023-10-06T02:57:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.462+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f727c01b3b0 con 0x7f72881578d0 2023-10-06T02:57:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.463+0000 7f726f7fe700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7274066f30 0x7f72740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.463+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f727c083a30 con 0x7f72881578d0 2023-10-06T02:57:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.463+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f727406e430 con 0x7f72881578d0 2023-10-06T02:57:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.463+0000 7f72877fe700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7274066f30 0x7f72740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.464+0000 7f72877fe700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7274066f30 0x7f72740693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7278009e60 tx=0x7f7278019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.467+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f727c017070 con 0x7f72881578d0 2023-10-06T02:57:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:08.649+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f72880d0450 con 0x7f72881578d0 2023-10-06T02:57:09.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.318+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(171..171 src has 1..171) v4 ==== 339+0+0 (secure 0 0 0) 0x7f727c055000 con 0x7f72881578d0 2023-10-06T02:57:09.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.319+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=172}) v3 -- 0x7f727406d1c0 con 0x7f72881578d0 2023-10-06T02:57:09.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.321+0000 7f726f7fe700 1 -- 172.21.15.81:0/3264640903 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v171) v1 ==== 169+0+0 (secure 0 0 0) 0x7f727c054440 con 0x7f72881578d0 2023-10-06T02:57:09.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.327+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7274066f30 msgr2=0x7f72740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.327+0000 7f728e10a700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7274066f30 0x7f72740693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7278009e60 tx=0x7f7278019000 comp rx=0 tx=0).stop 2023-10-06T02:57:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.327+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 msgr2=0x7f7288156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.327+0000 7f728e10a700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 0x7f7288156970 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c4e0 tx=0x7f727c007f00 comp rx=0 tx=0).stop 2023-10-06T02:57:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.328+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 shutdown_connections 2023-10-06T02:57:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.328+0000 7f728e10a700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7288157ca0 0x7f72881535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.328+0000 7f728e10a700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7274066f30 0x7f72740693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.328+0000 7f728e10a700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f728806d120 0x7f72880c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.328+0000 7f728e10a700 1 --2- 172.21.15.81:0/3264640903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72881578d0 0x7f7288156970 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.328+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 >> 172.21.15.81:0/3264640903 conn(0x7f728806bb90 msgr2=0x7f728806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.328+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 shutdown_connections 2023-10-06T02:57:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.329+0000 7f728e10a700 1 -- 172.21.15.81:0/3264640903 wait complete. 2023-10-06T02:57:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:57:09.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:57:09.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.457+0000 7fd885652700 1 Processor -- start 2023-10-06T02:57:09.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.458+0000 7fd885652700 1 -- start start 2023-10-06T02:57:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.458+0000 7fd885652700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8801578d0 0x7fd8800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.458+0000 7fd885652700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd880157ca0 0x7fd88015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.458+0000 7fd885652700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd88006d120 0x7fd88006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.458+0000 7fd885652700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8800d07c0 con 0x7fd8801578d0 2023-10-06T02:57:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.458+0000 7fd885652700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88006daa0 con 0x7fd880157ca0 2023-10-06T02:57:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.458+0000 7fd885652700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800cfbb0 con 0x7fd88006d120 2023-10-06T02:57:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8801578d0 0x7fd8800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8801578d0 0x7fd8800cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48386/0 (socket says 172.21.15.81:48386) 2023-10-06T02:57:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87effd700 1 -- 172.21.15.81:0/3863106564 learned_addr learned my addr 172.21.15.81:0/3863106564 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87f7fe700 1 --2- 172.21.15.81:0/3863106564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd88006d120 0x7fd88006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd8767fc700 1 --2- 172.21.15.81:0/3863106564 >> v2:172.21.15.83:3300/0 conn(0x7fd880157ca0 0x7fd88015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87effd700 1 -- 172.21.15.81:0/3863106564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd88006d120 msgr2=0x7fd88006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87effd700 1 --2- 172.21.15.81:0/3863106564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd88006d120 0x7fd88006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87effd700 1 -- 172.21.15.81:0/3863106564 >> v2:172.21.15.83:3300/0 conn(0x7fd880157ca0 msgr2=0x7fd88015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87effd700 1 --2- 172.21.15.81:0/3863106564 >> v2:172.21.15.83:3300/0 conn(0x7fd880157ca0 0x7fd88015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87effd700 1 -- 172.21.15.81:0/3863106564 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800cfe90 con 0x7fd8801578d0 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87f7fe700 1 --2- 172.21.15.81:0/3863106564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd88006d120 0x7fd88006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87effd700 1 --2- 172.21.15.81:0/3863106564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8801578d0 0x7fd8800cf4f0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fd880068510 tx=0x7fd870009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71c7e5302e3c602 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87e7fc700 1 -- 172.21.15.81:0/3863106564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000b860 con 0x7fd8801578d0 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87e7fc700 1 -- 172.21.15.81:0/3863106564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87000b9c0 con 0x7fd8801578d0 2023-10-06T02:57:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.459+0000 7fd87e7fc700 1 -- 172.21.15.81:0/3863106564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000bd60 con 0x7fd8801578d0 2023-10-06T02:57:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.460+0000 7fd885652700 1 -- 172.21.15.81:0/3863106564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8801578d0 msgr2=0x7fd8800cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.460+0000 7fd885652700 1 --2- 172.21.15.81:0/3863106564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8801578d0 0x7fd8800cf4f0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fd880068510 tx=0x7fd870009250 comp rx=0 tx=0).stop 2023-10-06T02:57:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.460+0000 7fd885652700 1 -- 172.21.15.81:0/3863106564 shutdown_connections 2023-10-06T02:57:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.460+0000 7fd885652700 1 --2- 172.21.15.81:0/3863106564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd88006d120 0x7fd88006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.460+0000 7fd885652700 1 --2- 172.21.15.81:0/3863106564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8801578d0 0x7fd8800cf4f0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.460+0000 7fd885652700 1 --2- 172.21.15.81:0/3863106564 >> v2:172.21.15.83:3300/0 conn(0x7fd880157ca0 0x7fd88015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.460+0000 7fd885652700 1 -- 172.21.15.81:0/3863106564 >> 172.21.15.81:0/3863106564 conn(0x7fd88006bb90 msgr2=0x7fd88006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.460+0000 7fd885652700 1 -- 172.21.15.81:0/3863106564 shutdown_connections 2023-10-06T02:57:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.460+0000 7fd885652700 1 -- 172.21.15.81:0/3863106564 wait complete. 2023-10-06T02:57:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.461+0000 7fd885652700 1 Processor -- start 2023-10-06T02:57:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.461+0000 7fd885652700 1 -- start start 2023-10-06T02:57:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd885652700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd88006d120 0x7fd8800c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd885652700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8801578d0 0x7fd8800cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd885652700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd880157ca0 0x7fd8801547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd885652700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c8d10 con 0x7fd88006d120 2023-10-06T02:57:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd885652700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800cd990 con 0x7fd8801578d0 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd885652700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c6170 con 0x7fd880157ca0 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd88006d120 0x7fd8800c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd88006d120 0x7fd8800c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48400/0 (socket says 172.21.15.81:48400) 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87effd700 1 -- 172.21.15.81:0/4280735802 learned_addr learned my addr 172.21.15.81:0/4280735802 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87f7fe700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd880157ca0 0x7fd8801547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd8767fc700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8801578d0 0x7fd8800cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87effd700 1 -- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd880157ca0 msgr2=0x7fd8801547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87effd700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd880157ca0 0x7fd8801547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87effd700 1 -- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8801578d0 msgr2=0x7fd8800cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87effd700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8801578d0 0x7fd8800cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87effd700 1 -- 172.21.15.81:0/4280735802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8700094f0 con 0x7fd88006d120 2023-10-06T02:57:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87f7fe700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd880157ca0 0x7fd8801547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd87effd700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd88006d120 0x7fd8800c87d0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd870009290 tx=0x7fd870017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd8777fe700 1 -- 172.21.15.81:0/4280735802 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870026480 con 0x7fd88006d120 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.462+0000 7fd8777fe700 1 -- 172.21.15.81:0/4280735802 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87001f070 con 0x7fd88006d120 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.463+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8800c8f50 con 0x7fd88006d120 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.463+0000 7fd8777fe700 1 -- 172.21.15.81:0/4280735802 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870026830 con 0x7fd88006d120 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.463+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8800c5e00 con 0x7fd88006d120 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.464+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd880067ac0 con 0x7fd88006d120 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.464+0000 7fd8777fe700 1 -- 172.21.15.81:0/4280735802 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd870026ba0 con 0x7fd88006d120 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.464+0000 7fd8777fe700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd860066f30 0x7fd8600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.464+0000 7fd8777fe700 1 -- 172.21.15.81:0/4280735802 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd870021070 con 0x7fd88006d120 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.465+0000 7fd8767fc700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd860066f30 0x7fd8600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.465+0000 7fd8767fc700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd860066f30 0x7fd8600693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd8800ccdd0 tx=0x7fd868008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.468+0000 7fd8777fe700 1 -- 172.21.15.81:0/4280735802 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd870053630 con 0x7fd88006d120 2023-10-06T02:57:09.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.652+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd8800d0170 con 0x7fd88006d120 2023-10-06T02:57:09.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.655+0000 7fd8777fe700 1 -- 172.21.15.81:0/4280735802 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd870056c50 con 0x7fd88006d120 2023-10-06T02:57:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd860066f30 msgr2=0x7fd8600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd860066f30 0x7fd8600693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd8800ccdd0 tx=0x7fd868008040 comp rx=0 tx=0).stop 2023-10-06T02:57:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd88006d120 msgr2=0x7fd8800c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd88006d120 0x7fd8800c87d0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd870009290 tx=0x7fd870017000 comp rx=0 tx=0).stop 2023-10-06T02:57:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 shutdown_connections 2023-10-06T02:57:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd880157ca0 0x7fd8801547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd88006d120 0x7fd8800c87d0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd860066f30 0x7fd8600693e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 --2- 172.21.15.81:0/4280735802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8801578d0 0x7fd8800cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 >> 172.21.15.81:0/4280735802 conn(0x7fd88006bb90 msgr2=0x7fd880068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 shutdown_connections 2023-10-06T02:57:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.657+0000 7fd885652700 1 -- 172.21.15.81:0/4280735802 wait complete. 2023-10-06T02:57:09.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-06T02:57:09.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.784+0000 7f4192b1e700 1 Processor -- start 2023-10-06T02:57:09.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.785+0000 7f4192b1e700 1 -- start start 2023-10-06T02:57:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.785+0000 7f4192b1e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f418c06e940 0x7f418c161950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.785+0000 7f4192b1e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0b2290 con 0x7f418c1569e0 2023-10-06T02:57:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.785+0000 7f4192b1e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c157c00 con 0x7f418c156db0 2023-10-06T02:57:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.785+0000 7f4192b1e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c1572d0 con 0x7f418c06e940 2023-10-06T02:57:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.785+0000 7f41908ba700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f418c1569e0 0x7f418c0b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54804/0 (socket says 172.21.15.81:54804) 2023-10-06T02:57:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.785+0000 7f41908ba700 1 -- 172.21.15.81:0/2731726237 learned_addr learned my addr 172.21.15.81:0/2731726237 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f41910bb700 1 --2- 172.21.15.81:0/2731726237 >> v2:172.21.15.83:3300/0 conn(0x7f418c06e940 0x7f418c161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192576622 0 0) 0x7f418c0b2290 con 0x7f418c1569e0 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f417c003570 con 0x7f418c1569e0 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3431683092 0 0) 0x7f417c003570 con 0x7f418c1569e0 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 >> v2:172.21.15.83:3300/0 conn(0x7f418c06e940 msgr2=0x7f418c161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 --2- 172.21.15.81:0/2731726237 >> v2:172.21.15.83:3300/0 conn(0x7f418c06e940 0x7f418c161950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 >> v1:172.21.15.83:6789/0 conn(0x7f418c156db0 legacy=0x7f418c06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c1575b0 con 0x7f418c1569e0 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f4180001470 con 0x7f418c1569e0 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 >> v1:172.21.15.81:6789/0 conn(0x7f418c1569e0 legacy=0x7f418c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f417c003a60 0x7f417c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f417c004810 0x7f417c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f417c0051c0 0x7f417c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c1572d0 con 0x7f417c003a60 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c00c160 con 0x7f417c0051c0 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c00c320 con 0x7f417c004810 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f41908ba700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f417c003a60 0x7f417c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f41910bb700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f417c0051c0 0x7f417c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f418bfff700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f417c004810 0x7f417c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f41908ba700 1 -- 172.21.15.81:0/2731726237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f417c004810 msgr2=0x7f417c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f41908ba700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f417c004810 0x7f417c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f41908ba700 1 -- 172.21.15.81:0/2731726237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f417c0051c0 msgr2=0x7f417c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f41908ba700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f417c0051c0 0x7f417c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f41910bb700 1 -- 172.21.15.81:0/2731726237 reap_dead start 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.786+0000 7f41908ba700 1 -- 172.21.15.81:0/2731726237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c003570 con 0x7f417c003a60 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f41908ba700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f417c003a60 0x7f417c003e70 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f418000c3c0 tx=0x7f4180001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d898bad4c6caf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000cc10 con 0x7f417c003a60 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000cd70 con 0x7f417c003a60 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f418b7fe700 1 -- 172.21.15.81:0/2731726237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180005b50 con 0x7f417c003a60 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f4192b1e700 1 -- 172.21.15.81:0/2731726237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f417c003a60 msgr2=0x7f417c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f4192b1e700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f417c003a60 0x7f417c003e70 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f418000c3c0 tx=0x7f4180001e50 comp rx=0 tx=0).stop 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f4192b1e700 1 -- 172.21.15.81:0/2731726237 shutdown_connections 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f4192b1e700 1 --2- 172.21.15.81:0/2731726237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f417c003a60 0x7f417c003e70 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f4192b1e700 1 -- 172.21.15.81:0/2731726237 >> 172.21.15.81:0/2731726237 conn(0x7f418c06cca0 msgr2=0x7f418c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f4192b1e700 1 -- 172.21.15.81:0/2731726237 shutdown_connections 2023-10-06T02:57:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.787+0000 7f4192b1e700 1 -- 172.21.15.81:0/2731726237 wait complete. 2023-10-06T02:57:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.788+0000 7f4192b1e700 1 Processor -- start 2023-10-06T02:57:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f4192b1e700 1 -- start start 2023-10-06T02:57:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f4192b1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f417c003a60 0x7f418c13c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f4192b1e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c0cb440 0x7f418c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f4192b1e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1661a0 0x7f418c1665f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f4192b1e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0cbdf0 con 0x7f418c0cb440 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f4192b1e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c1671d0 con 0x7f417c003a60 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f4192b1e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c166ef0 con 0x7f418c1661a0 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f418bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c0cb440 0x7f418c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f418bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c0cb440 0x7f418c0cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48414/0 (socket says 172.21.15.81:48414) 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f418bfff700 1 -- 172.21.15.81:0/360290733 learned_addr learned my addr 172.21.15.81:0/360290733 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f41908ba700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f417c003a60 0x7f418c13c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.789+0000 7f41910bb700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1661a0 0x7f418c1665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f418bfff700 1 -- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1661a0 msgr2=0x7f418c1665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f418bfff700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1661a0 0x7f418c1665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f418bfff700 1 -- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f417c003a60 msgr2=0x7f418c13c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f418bfff700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f417c003a60 0x7f418c13c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f418bfff700 1 -- 172.21.15.81:0/360290733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c167500 con 0x7f418c0cb440 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f41910bb700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1661a0 0x7f418c1665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f418bfff700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c0cb440 0x7f418c0cb8b0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f417800e560 tx=0x7f4178009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f4188ff9700 1 -- 172.21.15.81:0/360290733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178012590 con 0x7f418c0cb440 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f4188ff9700 1 -- 172.21.15.81:0/360290733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780126f0 con 0x7f418c0cb440 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f4188ff9700 1 -- 172.21.15.81:0/360290733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178012a90 con 0x7f418c0cb440 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c1677e0 con 0x7f418c0cb440 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.790+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c13c540 con 0x7f418c0cb440 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.791+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c068900 con 0x7f418c0cb440 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.791+0000 7f4188ff9700 1 -- 172.21.15.81:0/360290733 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f417801d460 con 0x7f418c0cb440 2023-10-06T02:57:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.791+0000 7f4188ff9700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.792+0000 7f4188ff9700 1 -- 172.21.15.81:0/360290733 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4178084310 con 0x7f418c0cb440 2023-10-06T02:57:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.792+0000 7f41908ba700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.792+0000 7f41908ba700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4180001ed0 tx=0x7f4180015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:09.796+0000 7f4188ff9700 1 -- 172.21.15.81:0/360290733 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4178051720 con 0x7f418c0cb440 2023-10-06T02:57:10.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.055+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f418c157890 con 0x7f418c0cb440 2023-10-06T02:57:10.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.722+0000 7f4188ff9700 1 -- 172.21.15.81:0/360290733 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v515) v1 ==== 131+0+0 (secure 0 0 0) 0x7f4178054d40 con 0x7f418c0cb440 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 msgr2=0x7f41700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4180001ed0 tx=0x7f4180015000 comp rx=0 tx=0).stop 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c0cb440 msgr2=0x7f418c0cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c0cb440 0x7f418c0cb8b0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f417800e560 tx=0x7f4178009040 comp rx=0 tx=0).stop 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 shutdown_connections 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1661a0 0x7f418c1665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f417c003a60 0x7f418c13c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 --2- 172.21.15.81:0/360290733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c0cb440 0x7f418c0cb8b0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.724+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 >> 172.21.15.81:0/360290733 conn(0x7f418c06cca0 msgr2=0x7f418c14f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:10.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.725+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 shutdown_connections 2023-10-06T02:57:10.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.725+0000 7f4192b1e700 1 -- 172.21.15.81:0/360290733 wait complete. 2023-10-06T02:57:10.738 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-06T02:57:10.739 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-06T02:57:10.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-06T02:57:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.852+0000 7f0c8dbc8700 1 Processor -- start 2023-10-06T02:57:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.852+0000 7f0c8dbc8700 1 -- start start 2023-10-06T02:57:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.853+0000 7f0c8dbc8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c881578d0 0x7f0c880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.853+0000 7f0c8dbc8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0c8806d120 0x7f0c8806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.853+0000 7f0c8dbc8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8806dac0 con 0x7f0c88157ca0 2023-10-06T02:57:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.853+0000 7f0c8dbc8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c880d07c0 con 0x7f0c8806d120 2023-10-06T02:57:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.853+0000 7f0c8dbc8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c880cfbb0 con 0x7f0c881578d0 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c877fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c881578d0 0x7f0c880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c87fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0c8806d120 0x7f0c8806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c877fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c881578d0 0x7f0c880cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:39208/0 (socket says 172.21.15.81:39208) 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c86ffd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f0c88157ca0 0x7f0c8815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:50736/0 (socket says 172.21.15.81:50736) 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c877fe700 1 -- 172.21.15.81:0/416645322 learned_addr learned my addr 172.21.15.81:0/416645322 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c87fff700 1 -- 172.21.15.81:0/416645322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c881578d0 msgr2=0x7f0c880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c87fff700 1 --2- 172.21.15.81:0/416645322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c881578d0 0x7f0c880cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c87fff700 1 -- 172.21.15.81:0/416645322 >> v1:172.21.15.83:6789/0 conn(0x7f0c88157ca0 legacy=0x7f0c8815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c87fff700 1 -- 172.21.15.81:0/416645322 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c880cfe90 con 0x7f0c8806d120 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c867fc700 1 -- 172.21.15.81:0/416645322 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443247907 0 0) 0x7f0c7c001110 con 0x7f0c88157ca0 2023-10-06T02:57:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c877fe700 1 --2- 172.21.15.81:0/416645322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c881578d0 0x7f0c880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c87fff700 1 --2- 172.21.15.81:0/416645322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c8806d120 0x7f0c8806d580 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009e60 tx=0x7f0c80009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d997e4119fc70a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c867fc700 1 -- 172.21.15.81:0/416645322 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000e070 con 0x7f0c8806d120 2023-10-06T02:57:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c867fc700 1 -- 172.21.15.81:0/416645322 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8000bb60 con 0x7f0c8806d120 2023-10-06T02:57:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.854+0000 7f0c867fc700 1 -- 172.21.15.81:0/416645322 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80012430 con 0x7f0c8806d120 2023-10-06T02:57:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.855+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/416645322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c8806d120 msgr2=0x7f0c8806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.855+0000 7f0c8dbc8700 1 --2- 172.21.15.81:0/416645322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c8806d120 0x7f0c8806d580 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009e60 tx=0x7f0c80009780 comp rx=0 tx=0).stop 2023-10-06T02:57:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.855+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/416645322 shutdown_connections 2023-10-06T02:57:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.855+0000 7f0c8dbc8700 1 --2- 172.21.15.81:0/416645322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c8806d120 0x7f0c8806d580 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.855+0000 7f0c8dbc8700 1 --2- 172.21.15.81:0/416645322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c881578d0 0x7f0c880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.855+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/416645322 >> 172.21.15.81:0/416645322 conn(0x7f0c8806bb90 msgr2=0x7f0c8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.855+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/416645322 shutdown_connections 2023-10-06T02:57:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.855+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/416645322 wait complete. 2023-10-06T02:57:10.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.856+0000 7f0c8dbc8700 1 Processor -- start 2023-10-06T02:57:10.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.856+0000 7f0c8dbc8700 1 -- start start 2023-10-06T02:57:10.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c8dbc8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c8806d120 0x7f0c8816d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c8dbc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c881578d0 0x7f0c88155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c8dbc8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c88157ca0 0x7f0c880b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c8dbc8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8816cf50 con 0x7f0c881578d0 2023-10-06T02:57:10.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c8dbc8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8816c340 con 0x7f0c88157ca0 2023-10-06T02:57:10.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c8dbc8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8816c620 con 0x7f0c8806d120 2023-10-06T02:57:10.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c86ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c881578d0 0x7f0c88155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c86ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c881578d0 0x7f0c88155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47682/0 (socket says 172.21.15.81:47682) 2023-10-06T02:57:10.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c86ffd700 1 -- 172.21.15.81:0/2180250060 learned_addr learned my addr 172.21.15.81:0/2180250060 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:10.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c87fff700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c88157ca0 0x7f0c880b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c86ffd700 1 -- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c8806d120 msgr2=0x7f0c8816d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c86ffd700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c8806d120 0x7f0c8816d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c86ffd700 1 -- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c88157ca0 msgr2=0x7f0c880b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c86ffd700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c88157ca0 0x7f0c880b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c86ffd700 1 -- 172.21.15.81:0/2180250060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c780094f0 con 0x7f0c881578d0 2023-10-06T02:57:10.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c87fff700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c88157ca0 0x7f0c880b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:10.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c86ffd700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c881578d0 0x7f0c88155f50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c5b0 tx=0x7f0c7c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:10.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.857+0000 7f0c6f7fe700 1 -- 172.21.15.81:0/2180250060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c005a70 con 0x7f0c881578d0 2023-10-06T02:57:10.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.858+0000 7f0c6f7fe700 1 -- 172.21.15.81:0/2180250060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c005bd0 con 0x7f0c881578d0 2023-10-06T02:57:10.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.858+0000 7f0c6f7fe700 1 -- 172.21.15.81:0/2180250060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0070d0 con 0x7f0c881578d0 2023-10-06T02:57:10.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.858+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c80009a20 con 0x7f0c881578d0 2023-10-06T02:57:10.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.858+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8816cbe0 con 0x7f0c881578d0 2023-10-06T02:57:10.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.858+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c880b2f00 con 0x7f0c881578d0 2023-10-06T02:57:10.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.859+0000 7f0c6f7fe700 1 -- 172.21.15.81:0/2180250060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c7c007480 con 0x7f0c881578d0 2023-10-06T02:57:10.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.859+0000 7f0c6f7fe700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c74066f30 0x7f0c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.859+0000 7f0c6f7fe700 1 -- 172.21.15.81:0/2180250060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0c7c083710 con 0x7f0c881578d0 2023-10-06T02:57:10.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.860+0000 7f0c877fe700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c74066f30 0x7f0c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.860+0000 7f0c877fe700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c74066f30 0x7f0c740693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0c78006fd0 tx=0x7f0c78009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:10.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:10.863+0000 7f0c6f7fe700 1 -- 172.21.15.81:0/2180250060 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c7c050b20 con 0x7f0c881578d0 2023-10-06T02:57:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.118+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f0c8806dac0 con 0x7f0c881578d0 2023-10-06T02:57:11.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.726+0000 7f0c6f7fe700 1 -- 172.21.15.81:0/2180250060 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v516) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0c8806dac0 con 0x7f0c881578d0 2023-10-06T02:57:11.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c74066f30 msgr2=0x7f0c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c74066f30 0x7f0c740693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0c78006fd0 tx=0x7f0c78009250 comp rx=0 tx=0).stop 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c881578d0 msgr2=0x7f0c88155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c881578d0 0x7f0c88155f50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c5b0 tx=0x7f0c7c001040 comp rx=0 tx=0).stop 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 shutdown_connections 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0c74066f30 0x7f0c740693e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c88157ca0 0x7f0c880b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c8806d120 0x7f0c8816d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 --2- 172.21.15.81:0/2180250060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c881578d0 0x7f0c88155f50 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 >> 172.21.15.81:0/2180250060 conn(0x7f0c8806bb90 msgr2=0x7f0c8815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 shutdown_connections 2023-10-06T02:57:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.728+0000 7f0c8dbc8700 1 -- 172.21.15.81:0/2180250060 wait complete. 2023-10-06T02:57:11.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:57:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.857+0000 7f55c9ad1700 1 Processor -- start 2023-10-06T02:57:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.857+0000 7f55c9ad1700 1 -- start start 2023-10-06T02:57:11.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c9ad1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f55c40d0b80 0x7f55c40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c9ad1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f55c406d700 0x7f55c415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c9ad1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c40cf2d0 con 0x7f55c40d02b0 2023-10-06T02:57:11.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c9ad1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c415a690 con 0x7f55c406d700 2023-10-06T02:57:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c9ad1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c406dc00 con 0x7f55c40d0b80 2023-10-06T02:57:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c92d0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f55c406d700 0x7f55c415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c92d0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f55c406d700 0x7f55c415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47696/0 (socket says 172.21.15.81:47696) 2023-10-06T02:57:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c92d0700 1 -- 172.21.15.81:0/3831505712 learned_addr learned my addr 172.21.15.81:0/3831505712 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c8acf700 1 --2- 172.21.15.81:0/3831505712 >> v2:172.21.15.83:3300/0 conn(0x7f55c40d0b80 0x7f55c40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c92d0700 1 -- 172.21.15.81:0/3831505712 >> v2:172.21.15.83:3300/0 conn(0x7f55c40d0b80 msgr2=0x7f55c40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c92d0700 1 --2- 172.21.15.81:0/3831505712 >> v2:172.21.15.83:3300/0 conn(0x7f55c40d0b80 0x7f55c40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c92d0700 1 -- 172.21.15.81:0/3831505712 >> v1:172.21.15.83:6789/0 conn(0x7f55c40d02b0 legacy=0x7f55c406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c92d0700 1 -- 172.21.15.81:0/3831505712 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c40cf570 con 0x7f55c406d700 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.858+0000 7f55c92d0700 1 --2- 172.21.15.81:0/3831505712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 0x7f55c415b320 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009f20 tx=0x7f55bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf5efd858d6e348 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c37fe700 1 -- 172.21.15.81:0/3831505712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00e070 con 0x7f55c406d700 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c37fe700 1 -- 172.21.15.81:0/3831505712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc00ba40 con 0x7f55c406d700 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c37fe700 1 -- 172.21.15.81:0/3831505712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0092e0 con 0x7f55c406d700 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3831505712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 msgr2=0x7f55c415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c9ad1700 1 --2- 172.21.15.81:0/3831505712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 0x7f55c415b320 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009f20 tx=0x7f55bc009840 comp rx=0 tx=0).stop 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3831505712 shutdown_connections 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c9ad1700 1 --2- 172.21.15.81:0/3831505712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 0x7f55c415b320 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c9ad1700 1 --2- 172.21.15.81:0/3831505712 >> v2:172.21.15.83:3300/0 conn(0x7f55c40d0b80 0x7f55c40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3831505712 >> 172.21.15.81:0/3831505712 conn(0x7f55c4063230 msgr2=0x7f55c4063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:11.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3831505712 shutdown_connections 2023-10-06T02:57:11.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.859+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3831505712 wait complete. 2023-10-06T02:57:11.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.860+0000 7f55c9ad1700 1 Processor -- start 2023-10-06T02:57:11.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.860+0000 7f55c9ad1700 1 -- start start 2023-10-06T02:57:11.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c9ad1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 0x7f55c413d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c9ad1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c40d02b0 0x7f55c40b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c9ad1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c40d0b80 0x7f55c4152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c9ad1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c413d6c0 con 0x7f55c406d700 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c9ad1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40b65a0 con 0x7f55c40d02b0 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c9ad1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c4154160 con 0x7f55c40d0b80 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c8acf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 0x7f55c413d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c8acf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 0x7f55c413d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47706/0 (socket says 172.21.15.81:47706) 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c8acf700 1 -- 172.21.15.81:0/3642586775 learned_addr learned my addr 172.21.15.81:0/3642586775 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c92d0700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c40d0b80 0x7f55c4152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c3fff700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c40d02b0 0x7f55c40b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c8acf700 1 -- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c40d0b80 msgr2=0x7f55c4152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c8acf700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c40d0b80 0x7f55c4152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c8acf700 1 -- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c40d02b0 msgr2=0x7f55c40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c8acf700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c40d02b0 0x7f55c40b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.861+0000 7f55c8acf700 1 -- 172.21.15.81:0/3642586775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc009ae0 con 0x7f55c406d700 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.862+0000 7f55c8acf700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 0x7f55c413d180 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f55b800d890 tx=0x7f55b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.862+0000 7f55c0ff9700 1 -- 172.21.15.81:0/3642586775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80125f0 con 0x7f55c406d700 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.862+0000 7f55c0ff9700 1 -- 172.21.15.81:0/3642586775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b8012750 con 0x7f55c406d700 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.862+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c41534b0 con 0x7f55c406d700 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.862+0000 7f55c0ff9700 1 -- 172.21.15.81:0/3642586775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8012b10 con 0x7f55c406d700 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.862+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c4153b10 con 0x7f55c406d700 2023-10-06T02:57:11.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.863+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c40676e0 con 0x7f55c406d700 2023-10-06T02:57:11.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.863+0000 7f55c0ff9700 1 -- 172.21.15.81:0/3642586775 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55b801e460 con 0x7f55c406d700 2023-10-06T02:57:11.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.863+0000 7f55c0ff9700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55a8066f30 0x7f55a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.863+0000 7f55c0ff9700 1 -- 172.21.15.81:0/3642586775 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f55b8084920 con 0x7f55c406d700 2023-10-06T02:57:11.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.864+0000 7f55c3fff700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55a8066f30 0x7f55a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.864+0000 7f55c3fff700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55a8066f30 0x7f55a80693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f55c4069430 tx=0x7f55b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:11.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:11.867+0000 7f55c0ff9700 1 -- 172.21.15.81:0/3642586775 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55b80557c0 con 0x7f55c406d700 2023-10-06T02:57:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.049+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f55c4071b10 con 0x7f55c406d700 2023-10-06T02:57:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.053+0000 7f55c0ff9700 1 -- 172.21.15.81:0/3642586775 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f55b8055350 con 0x7f55c406d700 2023-10-06T02:57:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55a8066f30 msgr2=0x7f55a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55a8066f30 0x7f55a80693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f55c4069430 tx=0x7f55b0009040 comp rx=0 tx=0).stop 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 msgr2=0x7f55c413d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 0x7f55c413d180 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f55b800d890 tx=0x7f55b8008040 comp rx=0 tx=0).stop 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 shutdown_connections 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55c40d0b80 0x7f55c4152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c406d700 0x7f55c413d180 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f55a8066f30 0x7f55a80693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 --2- 172.21.15.81:0/3642586775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55c40d02b0 0x7f55c40b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 >> 172.21.15.81:0/3642586775 conn(0x7f55c4063230 msgr2=0x7f55c415b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 shutdown_connections 2023-10-06T02:57:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.055+0000 7f55c9ad1700 1 -- 172.21.15.81:0/3642586775 wait complete. 2023-10-06T02:57:12.068 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:57:12.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:12.106 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:12.153 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:57:12.153 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:57:12.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.266+0000 7fee47553700 1 Processor -- start 2023-10-06T02:57:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.266+0000 7fee47553700 1 -- start start 2023-10-06T02:57:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.267+0000 7fee47553700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee401578d0 0x7fee400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.267+0000 7fee47553700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee400d07c0 con 0x7fee4006d120 2023-10-06T02:57:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.267+0000 7fee47553700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee400cfbb0 con 0x7fee40157ca0 2023-10-06T02:57:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.267+0000 7fee47553700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee400cfe90 con 0x7fee401578d0 2023-10-06T02:57:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.267+0000 7fee452ef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee401578d0 0x7fee400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.267+0000 7fee452ef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee401578d0 0x7fee400cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47716/0 (socket says 172.21.15.81:47716) 2023-10-06T02:57:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.267+0000 7fee45af0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee4006d120 0x7fee4006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51240/0 (socket says 172.21.15.81:51240) 2023-10-06T02:57:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.267+0000 7fee452ef700 1 -- 172.21.15.81:0/3477734853 learned_addr learned my addr 172.21.15.81:0/3477734853 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee452ef700 1 -- 172.21.15.81:0/3477734853 >> v1:172.21.15.83:6789/0 conn(0x7fee40157ca0 legacy=0x7fee4015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee452ef700 1 -- 172.21.15.81:0/3477734853 >> v1:172.21.15.81:6789/0 conn(0x7fee4006d120 legacy=0x7fee4006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee37fff700 1 -- 172.21.15.81:0/3477734853 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801671559 0 0) 0x7fee400d07c0 con 0x7fee4006d120 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee452ef700 1 -- 172.21.15.81:0/3477734853 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee400d0170 con 0x7fee401578d0 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee452ef700 1 --2- 172.21.15.81:0/3477734853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee401578d0 0x7fee400cf4f0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009f20 tx=0x7fee3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687f47e7d697f2d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee37fff700 1 -- 172.21.15.81:0/3477734853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c00e070 con 0x7fee401578d0 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee37fff700 1 -- 172.21.15.81:0/3477734853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c00ba40 con 0x7fee401578d0 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee37fff700 1 -- 172.21.15.81:0/3477734853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0092e0 con 0x7fee401578d0 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee47553700 1 -- 172.21.15.81:0/3477734853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee401578d0 msgr2=0x7fee400cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee47553700 1 --2- 172.21.15.81:0/3477734853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee401578d0 0x7fee400cf4f0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009f20 tx=0x7fee3c009840 comp rx=0 tx=0).stop 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee47553700 1 -- 172.21.15.81:0/3477734853 shutdown_connections 2023-10-06T02:57:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee47553700 1 --2- 172.21.15.81:0/3477734853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee401578d0 0x7fee400cf4f0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee47553700 1 -- 172.21.15.81:0/3477734853 >> 172.21.15.81:0/3477734853 conn(0x7fee4006bb90 msgr2=0x7fee4006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.268+0000 7fee47553700 1 -- 172.21.15.81:0/3477734853 shutdown_connections 2023-10-06T02:57:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.269+0000 7fee47553700 1 -- 172.21.15.81:0/3477734853 wait complete. 2023-10-06T02:57:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.270+0000 7fee47553700 1 Processor -- start 2023-10-06T02:57:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.270+0000 7fee47553700 1 -- start start 2023-10-06T02:57:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.270+0000 7fee47553700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee4006d120 0x7fee400b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.270+0000 7fee47553700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee401578d0 0x7fee400c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.270+0000 7fee47553700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee40157ca0 0x7fee4016a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.270+0000 7fee47553700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee400b5b40 con 0x7fee40157ca0 2023-10-06T02:57:12.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.270+0000 7fee47553700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee400b4f30 con 0x7fee401578d0 2023-10-06T02:57:12.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.270+0000 7fee47553700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee400b5210 con 0x7fee4006d120 2023-10-06T02:57:12.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee45af0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee40157ca0 0x7fee4016a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee45af0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee40157ca0 0x7fee4016a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47718/0 (socket says 172.21.15.81:47718) 2023-10-06T02:57:12.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee45af0700 1 -- 172.21.15.81:0/1141359670 learned_addr learned my addr 172.21.15.81:0/1141359670 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:12.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee44aee700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee401578d0 0x7fee400c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee452ef700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee4006d120 0x7fee400b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee45af0700 1 -- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee4006d120 msgr2=0x7fee400b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee45af0700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee4006d120 0x7fee400b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee45af0700 1 -- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee401578d0 msgr2=0x7fee400c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee45af0700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee401578d0 0x7fee400c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee45af0700 1 -- 172.21.15.81:0/1141359670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c009ae0 con 0x7fee40157ca0 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee44aee700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee401578d0 0x7fee400c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee45af0700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee40157ca0 0x7fee4016a660 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fee3800c5e0 tx=0x7fee38007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee357fa700 1 -- 172.21.15.81:0/1141359670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38005a70 con 0x7fee40157ca0 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee357fa700 1 -- 172.21.15.81:0/1141359670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38005bd0 con 0x7fee40157ca0 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee400b54f0 con 0x7fee40157ca0 2023-10-06T02:57:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee357fa700 1 -- 172.21.15.81:0/1141359670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380070d0 con 0x7fee40157ca0 2023-10-06T02:57:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.271+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee400b6510 con 0x7fee40157ca0 2023-10-06T02:57:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.272+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee40067ac0 con 0x7fee40157ca0 2023-10-06T02:57:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.272+0000 7fee357fa700 1 -- 172.21.15.81:0/1141359670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee38007440 con 0x7fee40157ca0 2023-10-06T02:57:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.273+0000 7fee357fa700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee24066f30 0x7fee240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.273+0000 7fee357fa700 1 -- 172.21.15.81:0/1141359670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fee38083960 con 0x7fee40157ca0 2023-10-06T02:57:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.273+0000 7fee452ef700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee24066f30 0x7fee240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.273+0000 7fee452ef700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee24066f30 0x7fee240693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009880 tx=0x7fee3c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.277+0000 7fee357fa700 1 -- 172.21.15.81:0/1141359670 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee38050d70 con 0x7fee40157ca0 2023-10-06T02:57:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.502+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee400d0450 con 0x7fee40157ca0 2023-10-06T02:57:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.502+0000 7fee357fa700 1 -- 172.21.15.81:0/1141359670 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fee38017070 con 0x7fee40157ca0 2023-10-06T02:57:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:12.504 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4037385194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4037385194},{"type":"v1","addr":"172.21.15.83:6837","nonce":4037385194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/2052186081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":2052186081},{"type":"v1","addr":"172.21.15.83:6836","nonce":2052186081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2641977500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2641977500},{"type":"v1","addr":"172.21.15.81:6833","nonce":2641977500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8301,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1282941595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1282941595},{"type":"v1","addr":"172.21.15.81:6835","nonce":1282941595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[]} 2023-10-06T02:57:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.504+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee24066f30 msgr2=0x7fee240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.504+0000 7fee47553700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee24066f30 0x7fee240693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009880 tx=0x7fee3c017000 comp rx=0 tx=0).stop 2023-10-06T02:57:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.504+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee40157ca0 msgr2=0x7fee4016a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.504+0000 7fee47553700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee40157ca0 0x7fee4016a660 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fee3800c5e0 tx=0x7fee38007d60 comp rx=0 tx=0).stop 2023-10-06T02:57:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.505+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 shutdown_connections 2023-10-06T02:57:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.505+0000 7fee47553700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee40157ca0 0x7fee4016a660 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.505+0000 7fee47553700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee4006d120 0x7fee400b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.505+0000 7fee47553700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fee24066f30 0x7fee240693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.505+0000 7fee47553700 1 --2- 172.21.15.81:0/1141359670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee401578d0 0x7fee400c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.505+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 >> 172.21.15.81:0/1141359670 conn(0x7fee4006bb90 msgr2=0x7fee40154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.505+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 shutdown_connections 2023-10-06T02:57:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.505+0000 7fee47553700 1 -- 172.21.15.81:0/1141359670 wait complete. 2023-10-06T02:57:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 85 2023-10-06T02:57:12.518 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:57:12.518 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:57:12.518 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:57:12.518 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:57:12.518 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:57:12.519 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:57:12.519 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:57:12.519 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:57:12.519 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:57:12.519 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:57:12.519 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:57:12.519 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:57:12.520 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:57:12.520 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:57:12.520 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:57:12.520 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:57:12.526 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:57:12.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:57:12.527 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:57:12.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:57:12.530 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:57:12.531 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:57:12.531 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:57:12.532 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:57:12.569 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:57:12.570 DEBUG:teuthology.parallel:result is None 2023-10-06T02:57:12.570 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:57:12.570 DEBUG:teuthology.parallel:result is None 2023-10-06T02:57:12.573 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:57:12.573 DEBUG:teuthology.parallel:result is None 2023-10-06T02:57:12.574 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:57:12.574 DEBUG:teuthology.parallel:result is None 2023-10-06T02:57:12.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:57:12.642 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:57:12.642 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T02:57:12.657 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T02:57:12.657 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T02:57:12.657 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-10-06T02:57:12.656+0000 7f34e7a68700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T02:57:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.695+0000 7fd241478700 1 Processor -- start 2023-10-06T02:57:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.695+0000 7fd241478700 1 -- start start 2023-10-06T02:57:12.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.695+0000 7fd241478700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 0x7fd23c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd241478700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd23c157ca0 0x7fd23c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd241478700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd23c06d120 0x7fd23c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd241478700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c06dac0 con 0x7fd23c157ca0 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd241478700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0d07c0 con 0x7fd23c06d120 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd241478700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0cfbb0 con 0x7fd23c1578d0 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd23c157ca0 0x7fd23c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd23c157ca0 0x7fd23c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47748/0 (socket says 172.21.15.81:47748) 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23a7fc700 1 -- 172.21.15.81:0/3639198715 learned_addr learned my addr 172.21.15.81:0/3639198715 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23b7fe700 1 --2- 172.21.15.81:0/3639198715 >> v2:172.21.15.83:3300/0 conn(0x7fd23c06d120 0x7fd23c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23affd700 1 --2- 172.21.15.81:0/3639198715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 0x7fd23c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23a7fc700 1 -- 172.21.15.81:0/3639198715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 msgr2=0x7fd23c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23a7fc700 1 --2- 172.21.15.81:0/3639198715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 0x7fd23c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23a7fc700 1 -- 172.21.15.81:0/3639198715 >> v2:172.21.15.83:3300/0 conn(0x7fd23c06d120 msgr2=0x7fd23c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23a7fc700 1 --2- 172.21.15.81:0/3639198715 >> v2:172.21.15.83:3300/0 conn(0x7fd23c06d120 0x7fd23c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23a7fc700 1 -- 172.21.15.81:0/3639198715 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0cfe90 con 0x7fd23c157ca0 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd23a7fc700 1 --2- 172.21.15.81:0/3639198715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c157ca0 0x7fd23c15af00 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b3940 tx=0x7fd230009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a8a5b3fb8e6ba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd239ffb700 1 -- 172.21.15.81:0/3639198715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23000b860 con 0x7fd23c157ca0 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd239ffb700 1 -- 172.21.15.81:0/3639198715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23000b9c0 con 0x7fd23c157ca0 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.696+0000 7fd239ffb700 1 -- 172.21.15.81:0/3639198715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23000bd60 con 0x7fd23c157ca0 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.697+0000 7fd241478700 1 -- 172.21.15.81:0/3639198715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c157ca0 msgr2=0x7fd23c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.697+0000 7fd241478700 1 --2- 172.21.15.81:0/3639198715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c157ca0 0x7fd23c15af00 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b3940 tx=0x7fd230009250 comp rx=0 tx=0).stop 2023-10-06T02:57:12.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.697+0000 7fd241478700 1 -- 172.21.15.81:0/3639198715 shutdown_connections 2023-10-06T02:57:12.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.697+0000 7fd241478700 1 --2- 172.21.15.81:0/3639198715 >> v2:172.21.15.83:3300/0 conn(0x7fd23c06d120 0x7fd23c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.697+0000 7fd241478700 1 --2- 172.21.15.81:0/3639198715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 0x7fd23c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.697+0000 7fd241478700 1 --2- 172.21.15.81:0/3639198715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c157ca0 0x7fd23c15af00 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.697+0000 7fd241478700 1 -- 172.21.15.81:0/3639198715 >> 172.21.15.81:0/3639198715 conn(0x7fd23c06bb90 msgr2=0x7fd23c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:12.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.697+0000 7fd241478700 1 -- 172.21.15.81:0/3639198715 shutdown_connections 2023-10-06T02:57:12.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.697+0000 7fd241478700 1 -- 172.21.15.81:0/3639198715 wait complete. 2023-10-06T02:57:12.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.698+0000 7fd241478700 1 Processor -- start 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.698+0000 7fd241478700 1 -- start start 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd241478700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c06d120 0x7fd23c16d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd241478700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 0x7fd23c16ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd241478700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c157ca0 0x7fd23c0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd241478700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c16d690 con 0x7fd23c06d120 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd241478700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0c6ba0 con 0x7fd23c157ca0 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd241478700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c16b1d0 con 0x7fd23c1578d0 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c06d120 0x7fd23c16d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c06d120 0x7fd23c16d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47752/0 (socket says 172.21.15.81:47752) 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23affd700 1 -- 172.21.15.81:0/1099644857 learned_addr learned my addr 172.21.15.81:0/1099644857 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23b7fe700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c157ca0 0x7fd23c0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23a7fc700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 0x7fd23c16ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23affd700 1 -- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 msgr2=0x7fd23c16ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23affd700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 0x7fd23c16ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23affd700 1 -- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c157ca0 msgr2=0x7fd23c0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23affd700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c157ca0 0x7fd23c0c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23affd700 1 -- 172.21.15.81:0/1099644857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300094f0 con 0x7fd23c06d120 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.699+0000 7fd23b7fe700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c157ca0 0x7fd23c0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.700+0000 7fd23affd700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c06d120 0x7fd23c16d150 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c7d0 tx=0x7fd22c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.700+0000 7fd222ffd700 1 -- 172.21.15.81:0/1099644857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011600 con 0x7fd23c06d120 2023-10-06T02:57:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.700+0000 7fd222ffd700 1 -- 172.21.15.81:0/1099644857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c011760 con 0x7fd23c06d120 2023-10-06T02:57:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.700+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c0c5f90 con 0x7fd23c06d120 2023-10-06T02:57:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.700+0000 7fd222ffd700 1 -- 172.21.15.81:0/1099644857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011b20 con 0x7fd23c06d120 2023-10-06T02:57:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.700+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c0c6550 con 0x7fd23c06d120 2023-10-06T02:57:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.701+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c067ac0 con 0x7fd23c06d120 2023-10-06T02:57:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.701+0000 7fd222ffd700 1 -- 172.21.15.81:0/1099644857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd22c0193f0 con 0x7fd23c06d120 2023-10-06T02:57:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.701+0000 7fd222ffd700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd228066f30 0x7fd2280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.701+0000 7fd222ffd700 1 -- 172.21.15.81:0/1099644857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd22c084790 con 0x7fd23c06d120 2023-10-06T02:57:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.702+0000 7fd23a7fc700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd228066f30 0x7fd2280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.702+0000 7fd23a7fc700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd228066f30 0x7fd2280693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b3940 tx=0x7fd230017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.705+0000 7fd222ffd700 1 -- 172.21.15.81:0/1099644857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd22c051ba0 con 0x7fd23c06d120 2023-10-06T02:57:12.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:12.903+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd23c0d0170 con 0x7fd23c06d120 2023-10-06T02:57:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.745+0000 7fd222ffd700 1 -- 172.21.15.81:0/1099644857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v176) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd22c0551c0 con 0x7fd23c06d120 2023-10-06T02:57:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd228066f30 msgr2=0x7fd2280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd228066f30 0x7fd2280693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b3940 tx=0x7fd230017000 comp rx=0 tx=0).stop 2023-10-06T02:57:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c06d120 msgr2=0x7fd23c16d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c06d120 0x7fd23c16d150 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c7d0 tx=0x7fd22c008040 comp rx=0 tx=0).stop 2023-10-06T02:57:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 shutdown_connections 2023-10-06T02:57:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd228066f30 0x7fd2280693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c157ca0 0x7fd23c0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c06d120 0x7fd23c16d150 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 --2- 172.21.15.81:0/1099644857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c1578d0 0x7fd23c16ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 >> 172.21.15.81:0/1099644857 conn(0x7fd23c06bb90 msgr2=0x7fd23c154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 shutdown_connections 2023-10-06T02:57:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.747+0000 7fd241478700 1 -- 172.21.15.81:0/1099644857 wait complete. 2023-10-06T02:57:13.750 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T02:57:13.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:57:13.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.874+0000 7f1a25d8a700 1 Processor -- start 2023-10-06T02:57:13.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.874+0000 7f1a25d8a700 1 -- start start 2023-10-06T02:57:13.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.875+0000 7f1a25d8a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20068e90 0x7f1a20164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.875+0000 7f1a25d8a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a200cee10 con 0x7f1a20159f10 2023-10-06T02:57:13.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.875+0000 7f1a25d8a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a200cd040 con 0x7f1a20159b40 2023-10-06T02:57:13.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.875+0000 7f1a25d8a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200cd320 con 0x7f1a20068e90 2023-10-06T02:57:13.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.875+0000 7f1a17fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1a20159f10 0x7f1a20068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51262/0 (socket says 172.21.15.81:51262) 2023-10-06T02:57:13.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.875+0000 7f1a17fff700 1 -- 172.21.15.81:0/3083529665 learned_addr learned my addr 172.21.15.81:0/3083529665 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:13.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.875+0000 7f1a25589700 1 --2- 172.21.15.81:0/3083529665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20068e90 0x7f1a20164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.875+0000 7f1a177fe700 1 -- 172.21.15.81:0/3083529665 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142130830 0 0) 0x7f1a200cee10 con 0x7f1a20159f10 2023-10-06T02:57:13.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.875+0000 7f1a177fe700 1 -- 172.21.15.81:0/3083529665 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a08003570 con 0x7f1a20159f10 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a177fe700 1 -- 172.21.15.81:0/3083529665 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031866686 0 0) 0x7f1a200cd040 con 0x7f1a20159b40 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a177fe700 1 -- 172.21.15.81:0/3083529665 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a200cee10 con 0x7f1a20159b40 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25589700 1 -- 172.21.15.81:0/3083529665 >> v1:172.21.15.83:6789/0 conn(0x7f1a20159b40 legacy=0x7f1a200cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25589700 1 -- 172.21.15.81:0/3083529665 >> v1:172.21.15.81:6789/0 conn(0x7f1a20159f10 legacy=0x7f1a20068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25589700 1 -- 172.21.15.81:0/3083529665 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200ce7c0 con 0x7f1a20068e90 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25589700 1 --2- 172.21.15.81:0/3083529665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20068e90 0x7f1a20164c70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009910 tx=0x7f1a180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e79a515dea425ee0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a177fe700 1 -- 172.21.15.81:0/3083529665 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18011630 con 0x7f1a20068e90 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a177fe700 1 -- 172.21.15.81:0/3083529665 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a18011790 con 0x7f1a20068e90 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a177fe700 1 -- 172.21.15.81:0/3083529665 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18011b30 con 0x7f1a20068e90 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3083529665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20068e90 msgr2=0x7f1a20164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25d8a700 1 --2- 172.21.15.81:0/3083529665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20068e90 0x7f1a20164c70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009910 tx=0x7f1a180091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3083529665 shutdown_connections 2023-10-06T02:57:13.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25d8a700 1 --2- 172.21.15.81:0/3083529665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20068e90 0x7f1a20164c70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3083529665 >> 172.21.15.81:0/3083529665 conn(0x7f1a200cd660 msgr2=0x7f1a200cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:13.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.876+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3083529665 shutdown_connections 2023-10-06T02:57:13.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.877+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3083529665 wait complete. 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.878+0000 7f1a25d8a700 1 Processor -- start 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.878+0000 7f1a25d8a700 1 -- start start 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.878+0000 7f1a25d8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a20068e90 0x7f1a2016a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.878+0000 7f1a25d8a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a20159b40 0x7f1a20158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.878+0000 7f1a25d8a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20159f10 0x7f1a2015c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.878+0000 7f1a25d8a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c8f50 con 0x7f1a20068e90 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.878+0000 7f1a25d8a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2016a8f0 con 0x7f1a20159b40 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.878+0000 7f1a25d8a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2016abd0 con 0x7f1a20159f10 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.878+0000 7f1a24d88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a20068e90 0x7f1a2016a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a24d88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a20068e90 0x7f1a2016a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47762/0 (socket says 172.21.15.81:47762) 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a24d88700 1 -- 172.21.15.81:0/3240675729 learned_addr learned my addr 172.21.15.81:0/3240675729 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a25589700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20159f10 0x7f1a2015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a17fff700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a20159b40 0x7f1a20158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a24d88700 1 -- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20159f10 msgr2=0x7f1a2015c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a24d88700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20159f10 0x7f1a2015c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a24d88700 1 -- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a20159b40 msgr2=0x7f1a20158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a24d88700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a20159b40 0x7f1a20158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a24d88700 1 -- 172.21.15.81:0/3240675729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a18009420 con 0x7f1a20068e90 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a25589700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20159f10 0x7f1a2015c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a17fff700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a20159b40 0x7f1a20158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a24d88700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a20068e90 0x7f1a2016a2e0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00cb10 tx=0x7f1a1c002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a14ff9700 1 -- 172.21.15.81:0/3240675729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00a760 con 0x7f1a20068e90 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a14ff9700 1 -- 172.21.15.81:0/3240675729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c00a8c0 con 0x7f1a20068e90 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a14ff9700 1 -- 172.21.15.81:0/3240675729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00ac60 con 0x7f1a20068e90 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2016aeb0 con 0x7f1a20068e90 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.879+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a201592c0 con 0x7f1a20068e90 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.880+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a200c90c0 con 0x7f1a20068e90 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.880+0000 7f1a14ff9700 1 -- 172.21.15.81:0/3240675729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a1c012630 con 0x7f1a20068e90 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.881+0000 7f1a14ff9700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a0c066f30 0x7f1a0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.881+0000 7f1a14ff9700 1 -- 172.21.15.81:0/3240675729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1a1c084710 con 0x7f1a20068e90 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.881+0000 7f1a17fff700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a0c066f30 0x7f1a0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.882+0000 7f1a17fff700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a0c066f30 0x7f1a0c0693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1a10007fd0 tx=0x7f1a10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:13.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:13.885+0000 7f1a14ff9700 1 -- 172.21.15.81:0/3240675729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a1c051b70 con 0x7f1a20068e90 2023-10-06T02:57:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.141+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1a20063e90 con 0x7f1a20068e90 2023-10-06T02:57:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.141+0000 7f1a14ff9700 1 -- 172.21.15.81:0/3240675729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1a1c055190 con 0x7f1a20068e90 2023-10-06T02:57:14.143 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:14.143 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:14.143 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T02:57:14.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.143 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T02:57:14.143 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvH+wNxAALI/iMpv0pYHq+WjWTOy1Kw==", 2023-10-06T02:57:14.143 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.143 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lVwdHBxAAWBLCDs1i9NqFLEgFmL1efg==", 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:57:14.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lPrrQAhAA6der9gecKu83QAxaItoDnQ==", 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lMGMMDhAAtRKXP0ThfAN7vxx1ZtGMuw==", 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lqGn6IBAAZj89crlFhvnPD0CyrWRm3g==", 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T02:57:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9ldzt7KBAA7oWF/LIofgLxke4gfRu51Q==", 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDWdB9lzS54MhAADvulAg2QB2vr7mIGOuLmgA==", 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:57:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T02:57:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDXdB9lsindABAAEtSI2fu77hjKYm2znd5TCA==", 2023-10-06T02:57:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:57:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l43tNChAA+RGCs/OozYrfqdM6Zep0iQ==", 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lnIwOERAA4XOdPcrg8keTdK+Q0paJAQ==", 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9l8sQSGhAAnO4VRGclNRos66OWsu96hw==", 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDadB9lOXQgIxAAWjCf8n5v8Fqrf20C3w4HRg==", 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T02:57:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lh+btERAAmC3+iKg+MbfpWyYrak9XAQ==", 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lyh5BGhAALyNjWxuyXvi18InACyDzKw==", 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:57:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lFlpBFxAAzOxmMJlkmp8yEMRuZHdaPg==", 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:57:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDTdB9lHyyhHxAANao0J3Ht6utkaiBLoZngog==", 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lyeeUEBAA69VOb5spEy4UEqSwpj3bUg==", 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lq/a7NBAA7aTUs3FauK5NNTH/EiyEpg==", 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSdB9lvZNMMRAA1R9lkeQ/y57CxXDTu7MhuA==", 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T02:57:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T02:57:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T02:57:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T02:57:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:14.159 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a0c066f30 msgr2=0x7f1a0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a0c066f30 0x7f1a0c0693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1a10007fd0 tx=0x7f1a10009040 comp rx=0 tx=0).stop 2023-10-06T02:57:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a20068e90 msgr2=0x7f1a2016a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a20068e90 0x7f1a2016a2e0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00cb10 tx=0x7f1a1c002820 comp rx=0 tx=0).stop 2023-10-06T02:57:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 shutdown_connections 2023-10-06T02:57:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a20159f10 0x7f1a2015c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a20068e90 0x7f1a2016a2e0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1a0c066f30 0x7f1a0c0693e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 --2- 172.21.15.81:0/3240675729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a20159b40 0x7f1a20158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 >> 172.21.15.81:0/3240675729 conn(0x7f1a200cd660 msgr2=0x7f1a2006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:14.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 shutdown_connections 2023-10-06T02:57:14.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.144+0000 7f1a25d8a700 1 -- 172.21.15.81:0/3240675729 wait complete. 2023-10-06T02:57:14.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:14.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.275+0000 7f3795536700 1 Processor -- start 2023-10-06T02:57:14.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.275+0000 7f3795536700 1 -- start start 2023-10-06T02:57:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f3795536700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3790068e90 0x7f3790164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f3795536700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37900cee10 con 0x7f3790159f10 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f3795536700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37900cd040 con 0x7f3790159b40 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f3795536700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900cd320 con 0x7f3790068e90 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f3794d35700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3790068e90 0x7f3790164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f378f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3790159f10 0x7f3790068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51270/0 (socket says 172.21.15.81:51270) 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f378f7fe700 1 -- 172.21.15.81:0/1429751991 learned_addr learned my addr 172.21.15.81:0/1429751991 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f3794d35700 1 -- 172.21.15.81:0/1429751991 >> v1:172.21.15.83:6789/0 conn(0x7f3790159b40 legacy=0x7f37900cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f3794d35700 1 -- 172.21.15.81:0/1429751991 >> v1:172.21.15.81:6789/0 conn(0x7f3790159f10 legacy=0x7f3790068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f3794d35700 1 -- 172.21.15.81:0/1429751991 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900ce7c0 con 0x7f3790068e90 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.276+0000 7f378effd700 1 -- 172.21.15.81:0/1429751991 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511095259 0 0) 0x7f37900cee10 con 0x7f3790159f10 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f3794d35700 1 --2- 172.21.15.81:0/1429751991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790068e90 0x7f3790164c70 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3788009e60 tx=0x7f3788009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4079e45203133e70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f378effd700 1 -- 172.21.15.81:0/1429751991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800e070 con 0x7f3790068e90 2023-10-06T02:57:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f378effd700 1 -- 172.21.15.81:0/1429751991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378800bc30 con 0x7f3790068e90 2023-10-06T02:57:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f378effd700 1 -- 172.21.15.81:0/1429751991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788012430 con 0x7f3790068e90 2023-10-06T02:57:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f3795536700 1 -- 172.21.15.81:0/1429751991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790068e90 msgr2=0x7f3790164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f3795536700 1 --2- 172.21.15.81:0/1429751991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790068e90 0x7f3790164c70 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3788009e60 tx=0x7f3788009780 comp rx=0 tx=0).stop 2023-10-06T02:57:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f3795536700 1 -- 172.21.15.81:0/1429751991 shutdown_connections 2023-10-06T02:57:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f3795536700 1 --2- 172.21.15.81:0/1429751991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790068e90 0x7f3790164c70 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f3795536700 1 -- 172.21.15.81:0/1429751991 >> 172.21.15.81:0/1429751991 conn(0x7f37900cd660 msgr2=0x7f37900cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f3795536700 1 -- 172.21.15.81:0/1429751991 shutdown_connections 2023-10-06T02:57:14.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.277+0000 7f3795536700 1 -- 172.21.15.81:0/1429751991 wait complete. 2023-10-06T02:57:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.278+0000 7f3795536700 1 Processor -- start 2023-10-06T02:57:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.278+0000 7f3795536700 1 -- start start 2023-10-06T02:57:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f3795536700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3790068e90 0x7f3790154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f3795536700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3790159b40 0x7f37900c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f3795536700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790159f10 0x7f37901475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f3795536700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900c9ef0 con 0x7f3790159f10 2023-10-06T02:57:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f3795536700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379015aaf0 con 0x7f3790068e90 2023-10-06T02:57:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f3795536700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37900c9650 con 0x7f3790159b40 2023-10-06T02:57:14.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f3794d35700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790159f10 0x7f37901475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f3794d35700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790159f10 0x7f37901475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47780/0 (socket says 172.21.15.81:47780) 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f3794d35700 1 -- 172.21.15.81:0/3187865205 learned_addr learned my addr 172.21.15.81:0/3187865205 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.279+0000 7f378ffff700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3790068e90 0x7f3790154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f378f7fe700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3790159b40 0x7f37900c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3794d35700 1 -- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3790159b40 msgr2=0x7f37900c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3794d35700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3790159b40 0x7f37900c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3794d35700 1 -- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3790068e90 msgr2=0x7f3790154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3794d35700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3790068e90 0x7f3790154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3794d35700 1 -- 172.21.15.81:0/3187865205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788009a20 con 0x7f3790159f10 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f378ffff700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3790068e90 0x7f3790154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3794d35700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790159f10 0x7f37901475f0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3788013000 tx=0x7f3788019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3777fff700 1 -- 172.21.15.81:0/3187865205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378801b630 con 0x7f3790159f10 2023-10-06T02:57:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3777fff700 1 -- 172.21.15.81:0/3187865205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378801b790 con 0x7f3790159f10 2023-10-06T02:57:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37900c9930 con 0x7f3790159f10 2023-10-06T02:57:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3777fff700 1 -- 172.21.15.81:0/3187865205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378801bb30 con 0x7f3790159f10 2023-10-06T02:57:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.280+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37900c9360 con 0x7f3790159f10 2023-10-06T02:57:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.281+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3790063e90 con 0x7f3790159f10 2023-10-06T02:57:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.281+0000 7f3777fff700 1 -- 172.21.15.81:0/3187865205 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f378801c400 con 0x7f3790159f10 2023-10-06T02:57:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.282+0000 7f3777fff700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f377c066f30 0x7f377c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.282+0000 7f3777fff700 1 -- 172.21.15.81:0/3187865205 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3788086300 con 0x7f3790159f10 2023-10-06T02:57:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.282+0000 7f378ffff700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f377c066f30 0x7f377c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.282+0000 7f378ffff700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f377c066f30 0x7f377c0693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3780007fd0 tx=0x7f3780009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.286+0000 7f3777fff700 1 -- 172.21.15.81:0/3187865205 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3788053760 con 0x7f3790159f10 2023-10-06T02:57:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.471+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f379015ac30 con 0x7f3790159f10 2023-10-06T02:57:14.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.472+0000 7f3777fff700 1 -- 172.21.15.81:0/3187865205 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+13614 (secure 0 0 0) 0x7f3788009880 con 0x7f3790159f10 2023-10-06T02:57:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:14.473 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":176,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:57:13.740259+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f377c066f30 msgr2=0x7f377c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f377c066f30 0x7f377c0693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3780007fd0 tx=0x7f3780009040 comp rx=0 tx=0).stop 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790159f10 msgr2=0x7f37901475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790159f10 0x7f37901475f0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3788013000 tx=0x7f3788019000 comp rx=0 tx=0).stop 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 shutdown_connections 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3790159f10 0x7f37901475f0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f377c066f30 0x7f377c0693e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3790068e90 0x7f3790154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 --2- 172.21.15.81:0/3187865205 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3790159b40 0x7f37900c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 >> 172.21.15.81:0/3187865205 conn(0x7f37900cd660 msgr2=0x7f37900c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 shutdown_connections 2023-10-06T02:57:14.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.474+0000 7f3795536700 1 -- 172.21.15.81:0/3187865205 wait complete. 2023-10-06T02:57:14.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:57:14.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:57:14.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.603+0000 7feb8e5ae700 1 Processor -- start 2023-10-06T02:57:14.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.603+0000 7feb8e5ae700 1 -- start start 2023-10-06T02:57:14.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.604+0000 7feb8e5ae700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 0x7feb880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.604+0000 7feb8e5ae700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb8806d120 0x7feb8806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.604+0000 7feb8e5ae700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8806dac0 con 0x7feb88157ca0 2023-10-06T02:57:14.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.604+0000 7feb8e5ae700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb880d07c0 con 0x7feb8806d120 2023-10-06T02:57:14.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.604+0000 7feb8e5ae700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb880cfbb0 con 0x7feb881578d0 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.604+0000 7feb8cb4b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb8806d120 0x7feb8806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.604+0000 7feb8cb4b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb8806d120 0x7feb8806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47792/0 (socket says 172.21.15.81:47792) 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.604+0000 7feb8cb4b700 1 -- 172.21.15.81:0/3357399284 learned_addr learned my addr 172.21.15.81:0/3357399284 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.604+0000 7feb87fff700 1 --2- 172.21.15.81:0/3357399284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 0x7feb880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8cb4b700 1 -- 172.21.15.81:0/3357399284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 msgr2=0x7feb880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8cb4b700 1 --2- 172.21.15.81:0/3357399284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 0x7feb880cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8cb4b700 1 -- 172.21.15.81:0/3357399284 >> v1:172.21.15.83:6789/0 conn(0x7feb88157ca0 legacy=0x7feb8815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8cb4b700 1 -- 172.21.15.81:0/3357399284 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880cfe90 con 0x7feb8806d120 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8cb4b700 1 --2- 172.21.15.81:0/3357399284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 0x7feb8806d580 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7feb780099b0 tx=0x7feb78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b21da952aa513cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb86ffd700 1 -- 172.21.15.81:0/3357399284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800b860 con 0x7feb8806d120 2023-10-06T02:57:14.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb86ffd700 1 -- 172.21.15.81:0/3357399284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7800b9c0 con 0x7feb8806d120 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb86ffd700 1 -- 172.21.15.81:0/3357399284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800bd60 con 0x7feb8806d120 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8e5ae700 1 -- 172.21.15.81:0/3357399284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 msgr2=0x7feb8806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8e5ae700 1 --2- 172.21.15.81:0/3357399284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 0x7feb8806d580 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7feb780099b0 tx=0x7feb78009250 comp rx=0 tx=0).stop 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8e5ae700 1 -- 172.21.15.81:0/3357399284 shutdown_connections 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8e5ae700 1 --2- 172.21.15.81:0/3357399284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 0x7feb8806d580 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8e5ae700 1 --2- 172.21.15.81:0/3357399284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 0x7feb880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8e5ae700 1 -- 172.21.15.81:0/3357399284 >> 172.21.15.81:0/3357399284 conn(0x7feb8806bb90 msgr2=0x7feb8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8e5ae700 1 -- 172.21.15.81:0/3357399284 shutdown_connections 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.605+0000 7feb8e5ae700 1 -- 172.21.15.81:0/3357399284 wait complete. 2023-10-06T02:57:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.606+0000 7feb8e5ae700 1 Processor -- start 2023-10-06T02:57:14.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb8e5ae700 1 -- start start 2023-10-06T02:57:14.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb8e5ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 0x7feb880ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb8e5ae700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 0x7feb88154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb8e5ae700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb88157ca0 0x7feb8815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb8e5ae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880aa890 con 0x7feb8806d120 2023-10-06T02:57:14.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb8e5ae700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880ad6e0 con 0x7feb88157ca0 2023-10-06T02:57:14.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb8e5ae700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb880ab670 con 0x7feb881578d0 2023-10-06T02:57:14.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb87fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 0x7feb880ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb87fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 0x7feb880ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47804/0 (socket says 172.21.15.81:47804) 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.607+0000 7feb87fff700 1 -- 172.21.15.81:0/2460413593 learned_addr learned my addr 172.21.15.81:0/2460413593 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb8cb4b700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb88157ca0 0x7feb8815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb877fe700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 0x7feb88154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb87fff700 1 -- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 msgr2=0x7feb88154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb87fff700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 0x7feb88154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb87fff700 1 -- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb88157ca0 msgr2=0x7feb8815c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb87fff700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb88157ca0 0x7feb8815c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb87fff700 1 -- 172.21.15.81:0/2460413593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780094f0 con 0x7feb8806d120 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb877fe700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 0x7feb88154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb87fff700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 0x7feb880ad1a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7feb8000e190 tx=0x7feb80009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb6ffff700 1 -- 172.21.15.81:0/2460413593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000ed80 con 0x7feb8806d120 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb6ffff700 1 -- 172.21.15.81:0/2460413593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80014420 con 0x7feb8806d120 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb880aaa80 con 0x7feb8806d120 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb6ffff700 1 -- 172.21.15.81:0/2460413593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800147e0 con 0x7feb8806d120 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.608+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb880ab020 con 0x7feb8806d120 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.609+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb880ab950 con 0x7feb8806d120 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.610+0000 7feb6ffff700 1 -- 172.21.15.81:0/2460413593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb80014b90 con 0x7feb8806d120 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.610+0000 7feb6ffff700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feb74066f30 0x7feb740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.610+0000 7feb6ffff700 1 -- 172.21.15.81:0/2460413593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5206+0+0 (secure 0 0 0) 0x7feb80084ac0 con 0x7feb8806d120 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.610+0000 7feb877fe700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feb74066f30 0x7feb740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.611+0000 7feb877fe700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feb74066f30 0x7feb740693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7feb7c007fd0 tx=0x7feb7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.614+0000 7feb6ffff700 1 -- 172.21.15.81:0/2460413593 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb80051f20 con 0x7feb8806d120 2023-10-06T02:57:14.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.798+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb880d0170 con 0x7feb8806d120 2023-10-06T02:57:14.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.798+0000 7feb6ffff700 1 -- 172.21.15.81:0/2460413593 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v176) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb80084e60 con 0x7feb8806d120 2023-10-06T02:57:14.800 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feb74066f30 msgr2=0x7feb740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feb74066f30 0x7feb740693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7feb7c007fd0 tx=0x7feb7c009040 comp rx=0 tx=0).stop 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 msgr2=0x7feb880ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 0x7feb880ad1a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7feb8000e190 tx=0x7feb80009920 comp rx=0 tx=0).stop 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 shutdown_connections 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7feb74066f30 0x7feb740693e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb88157ca0 0x7feb8815c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8806d120 0x7feb880ad1a0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 --2- 172.21.15.81:0/2460413593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb881578d0 0x7feb88154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 >> 172.21.15.81:0/2460413593 conn(0x7feb8806bb90 msgr2=0x7feb881568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:14.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 shutdown_connections 2023-10-06T02:57:14.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.800+0000 7feb8e5ae700 1 -- 172.21.15.81:0/2460413593 wait complete. 2023-10-06T02:57:14.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:57:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.929+0000 7fe67b9eb700 1 Processor -- start 2023-10-06T02:57:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.929+0000 7fe67b9eb700 1 -- start start 2023-10-06T02:57:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe67b9eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 0x7fe6740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe67b9eb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe67406d120 0x7fe67406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe67b9eb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67406dac0 con 0x7fe674157ca0 2023-10-06T02:57:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe67b9eb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6740d07c0 con 0x7fe67406d120 2023-10-06T02:57:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe67b9eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740cfbb0 con 0x7fe6741578d0 2023-10-06T02:57:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe679f88700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe67406d120 0x7fe67406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe678f86700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe674157ca0 0x7fe67415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51286/0 (socket says 172.21.15.81:51286) 2023-10-06T02:57:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe679f88700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe67406d120 0x7fe67406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47816/0 (socket says 172.21.15.81:47816) 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe678f86700 1 -- 172.21.15.81:0/2088820388 learned_addr learned my addr 172.21.15.81:0/2088820388 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.930+0000 7fe679787700 1 --2- 172.21.15.81:0/2088820388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 0x7fe6740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe679f88700 1 -- 172.21.15.81:0/2088820388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 msgr2=0x7fe6740cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe679f88700 1 --2- 172.21.15.81:0/2088820388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 0x7fe6740cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe679f88700 1 -- 172.21.15.81:0/2088820388 >> v1:172.21.15.81:6789/0 conn(0x7fe674157ca0 legacy=0x7fe67415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe66bfff700 1 -- 172.21.15.81:0/2088820388 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757014653 0 0) 0x7fe664001110 con 0x7fe674157ca0 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe679f88700 1 -- 172.21.15.81:0/2088820388 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740cfe90 con 0x7fe67406d120 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe679f88700 1 --2- 172.21.15.81:0/2088820388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 0x7fe67406d580 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0098e0 tx=0x7fe66c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5109b656651e523a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe66bfff700 1 -- 172.21.15.81:0/2088820388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00b640 con 0x7fe67406d120 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe66bfff700 1 -- 172.21.15.81:0/2088820388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c00b7a0 con 0x7fe67406d120 2023-10-06T02:57:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe66bfff700 1 -- 172.21.15.81:0/2088820388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00bb40 con 0x7fe67406d120 2023-10-06T02:57:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2088820388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 msgr2=0x7fe67406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.931+0000 7fe67b9eb700 1 --2- 172.21.15.81:0/2088820388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 0x7fe67406d580 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0098e0 tx=0x7fe66c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.932+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2088820388 shutdown_connections 2023-10-06T02:57:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.932+0000 7fe67b9eb700 1 --2- 172.21.15.81:0/2088820388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 0x7fe67406d580 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.932+0000 7fe67b9eb700 1 --2- 172.21.15.81:0/2088820388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 0x7fe6740cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.932+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2088820388 >> 172.21.15.81:0/2088820388 conn(0x7fe67406bb90 msgr2=0x7fe67406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.932+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2088820388 shutdown_connections 2023-10-06T02:57:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.932+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2088820388 wait complete. 2023-10-06T02:57:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.933+0000 7fe67b9eb700 1 Processor -- start 2023-10-06T02:57:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.933+0000 7fe67b9eb700 1 -- start start 2023-10-06T02:57:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe67b9eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 0x7fe6740b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe67b9eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 0x7fe674153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe67b9eb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe674157ca0 0x7fe674068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe67b9eb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740aaf80 con 0x7fe67406d120 2023-10-06T02:57:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe67b9eb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe674154040 con 0x7fe674157ca0 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe67b9eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740b5b60 con 0x7fe6741578d0 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679787700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 0x7fe6740b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679787700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 0x7fe6740b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47824/0 (socket says 172.21.15.81:47824) 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679787700 1 -- 172.21.15.81:0/2180723167 learned_addr learned my addr 172.21.15.81:0/2180723167 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe678f86700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 0x7fe674153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679f88700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe674157ca0 0x7fe674068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679787700 1 -- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 msgr2=0x7fe674153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679787700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 0x7fe674153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679787700 1 -- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe674157ca0 msgr2=0x7fe674068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679787700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe674157ca0 0x7fe674068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679787700 1 -- 172.21.15.81:0/2180723167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c009420 con 0x7fe67406d120 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe678f86700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 0x7fe674153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe679787700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 0x7fe6740b5580 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fe670009ef0 tx=0x7fe67000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe6697fa700 1 -- 172.21.15.81:0/2180723167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000cc20 con 0x7fe67406d120 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe6697fa700 1 -- 172.21.15.81:0/2180723167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000f040 con 0x7fe67406d120 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6740b5e40 con 0x7fe67406d120 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe6697fa700 1 -- 172.21.15.81:0/2180723167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670014480 con 0x7fe67406d120 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.934+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6740aac10 con 0x7fe67406d120 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.935+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6740ab260 con 0x7fe67406d120 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.936+0000 7fe6697fa700 1 -- 172.21.15.81:0/2180723167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6700147f0 con 0x7fe67406d120 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.936+0000 7fe6697fa700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe658066f30 0x7fe6580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.936+0000 7fe6697fa700 1 -- 172.21.15.81:0/2180723167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe670084ff0 con 0x7fe67406d120 2023-10-06T02:57:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.936+0000 7fe678f86700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe658066f30 0x7fe6580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.937+0000 7fe678f86700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe658066f30 0x7fe6580693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe674154ed0 tx=0x7fe664009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:14.940+0000 7fe6697fa700 1 -- 172.21.15.81:0/2180723167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe670052450 con 0x7fe67406d120 2023-10-06T02:57:15.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.124+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe6740d0170 con 0x7fe67406d120 2023-10-06T02:57:15.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.124+0000 7fe6697fa700 1 -- 172.21.15.81:0/2180723167 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v176) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe670055a70 con 0x7fe67406d120 2023-10-06T02:57:15.125 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:57:15.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe658066f30 msgr2=0x7fe6580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe658066f30 0x7fe6580693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe674154ed0 tx=0x7fe664009040 comp rx=0 tx=0).stop 2023-10-06T02:57:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 msgr2=0x7fe6740b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 0x7fe6740b5580 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fe670009ef0 tx=0x7fe67000b040 comp rx=0 tx=0).stop 2023-10-06T02:57:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 shutdown_connections 2023-10-06T02:57:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe658066f30 0x7fe6580693e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe674157ca0 0x7fe674068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe67406d120 0x7fe6740b5580 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 --2- 172.21.15.81:0/2180723167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe6741578d0 0x7fe674153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 >> 172.21.15.81:0/2180723167 conn(0x7fe67406bb90 msgr2=0x7fe67415b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:15.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 shutdown_connections 2023-10-06T02:57:15.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.126+0000 7fe67b9eb700 1 -- 172.21.15.81:0/2180723167 wait complete. 2023-10-06T02:57:15.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:57:15.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.252+0000 7fd7174d2700 1 Processor -- start 2023-10-06T02:57:15.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.252+0000 7fd7174d2700 1 -- start start 2023-10-06T02:57:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.253+0000 7fd7174d2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7101578d0 0x7fd7100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.253+0000 7fd7174d2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd710157ca0 0x7fd71015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.253+0000 7fd7174d2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd71006d120 0x7fd71006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.253+0000 7fd7174d2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71006dac0 con 0x7fd710157ca0 2023-10-06T02:57:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.253+0000 7fd7174d2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7100d07c0 con 0x7fd71006d120 2023-10-06T02:57:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.253+0000 7fd7174d2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100cfbb0 con 0x7fd7101578d0 2023-10-06T02:57:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.253+0000 7fd714a6d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd710157ca0 0x7fd71015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.253+0000 7fd714a6d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd710157ca0 0x7fd71015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47830/0 (socket says 172.21.15.81:47830) 2023-10-06T02:57:15.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.253+0000 7fd714a6d700 1 -- 172.21.15.81:0/963180502 learned_addr learned my addr 172.21.15.81:0/963180502 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:15.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd71526e700 1 --2- 172.21.15.81:0/963180502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7101578d0 0x7fd7100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd714a6d700 1 -- 172.21.15.81:0/963180502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7101578d0 msgr2=0x7fd7100cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:15.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd715a6f700 1 --2- 172.21.15.81:0/963180502 >> v2:172.21.15.83:3300/0 conn(0x7fd71006d120 0x7fd71006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd714a6d700 1 --2- 172.21.15.81:0/963180502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7101578d0 0x7fd7100cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd714a6d700 1 -- 172.21.15.81:0/963180502 >> v2:172.21.15.83:3300/0 conn(0x7fd71006d120 msgr2=0x7fd71006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:15.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd714a6d700 1 --2- 172.21.15.81:0/963180502 >> v2:172.21.15.83:3300/0 conn(0x7fd71006d120 0x7fd71006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd714a6d700 1 -- 172.21.15.81:0/963180502 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100cfe90 con 0x7fd710157ca0 2023-10-06T02:57:15.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd71526e700 1 --2- 172.21.15.81:0/963180502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7101578d0 0x7fd7100cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:15.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd715a6f700 1 --2- 172.21.15.81:0/963180502 >> v2:172.21.15.83:3300/0 conn(0x7fd71006d120 0x7fd71006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:15.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd714a6d700 1 --2- 172.21.15.81:0/963180502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd710157ca0 0x7fd71015af00 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b3940 tx=0x7fd700009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0aa0e65f689d26c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:15.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd707fff700 1 -- 172.21.15.81:0/963180502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000b860 con 0x7fd710157ca0 2023-10-06T02:57:15.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd707fff700 1 -- 172.21.15.81:0/963180502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000b9c0 con 0x7fd710157ca0 2023-10-06T02:57:15.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd707fff700 1 -- 172.21.15.81:0/963180502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000bd60 con 0x7fd710157ca0 2023-10-06T02:57:15.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd7174d2700 1 -- 172.21.15.81:0/963180502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd710157ca0 msgr2=0x7fd71015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.254+0000 7fd7174d2700 1 --2- 172.21.15.81:0/963180502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd710157ca0 0x7fd71015af00 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b3940 tx=0x7fd700009250 comp rx=0 tx=0).stop 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.255+0000 7fd7174d2700 1 -- 172.21.15.81:0/963180502 shutdown_connections 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.255+0000 7fd7174d2700 1 --2- 172.21.15.81:0/963180502 >> v2:172.21.15.83:3300/0 conn(0x7fd71006d120 0x7fd71006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.255+0000 7fd7174d2700 1 --2- 172.21.15.81:0/963180502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7101578d0 0x7fd7100cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.255+0000 7fd7174d2700 1 --2- 172.21.15.81:0/963180502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd710157ca0 0x7fd71015af00 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.255+0000 7fd7174d2700 1 -- 172.21.15.81:0/963180502 >> 172.21.15.81:0/963180502 conn(0x7fd71006bb90 msgr2=0x7fd71006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.255+0000 7fd7174d2700 1 -- 172.21.15.81:0/963180502 shutdown_connections 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.255+0000 7fd7174d2700 1 -- 172.21.15.81:0/963180502 wait complete. 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.256+0000 7fd7174d2700 1 Processor -- start 2023-10-06T02:57:15.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.256+0000 7fd7174d2700 1 -- start start 2023-10-06T02:57:15.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7174d2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71006d120 0x7fd7100b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7174d2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7101578d0 0x7fd710068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7174d2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd710157ca0 0x7fd710068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7174d2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71016a920 con 0x7fd71006d120 2023-10-06T02:57:15.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7174d2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71016ee70 con 0x7fd7101578d0 2023-10-06T02:57:15.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7174d2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71016b170 con 0x7fd710157ca0 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd71526e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71006d120 0x7fd7100b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd71526e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71006d120 0x7fd7100b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47842/0 (socket says 172.21.15.81:47842) 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd71526e700 1 -- 172.21.15.81:0/502565513 learned_addr learned my addr 172.21.15.81:0/502565513 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd715a6f700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd710157ca0 0x7fd710068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd714a6d700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7101578d0 0x7fd710068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd71526e700 1 -- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd710157ca0 msgr2=0x7fd710068dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd71526e700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd710157ca0 0x7fd710068dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd71526e700 1 -- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7101578d0 msgr2=0x7fd710068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd71526e700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7101578d0 0x7fd710068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd71526e700 1 -- 172.21.15.81:0/502565513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000094f0 con 0x7fd71006d120 2023-10-06T02:57:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd714a6d700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7101578d0 0x7fd710068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd71526e700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71006d120 0x7fd7100b6340 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00a430 tx=0x7fd70c007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7057fa700 1 -- 172.21.15.81:0/502565513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00ae10 con 0x7fd71006d120 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7057fa700 1 -- 172.21.15.81:0/502565513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c00d650 con 0x7fd71006d120 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd710154c80 con 0x7fd71006d120 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7057fa700 1 -- 172.21.15.81:0/502565513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00d9f0 con 0x7fd71006d120 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.257+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71016ab20 con 0x7fd71006d120 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.258+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd710067ac0 con 0x7fd71006d120 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.259+0000 7fd7057fa700 1 -- 172.21.15.81:0/502565513 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd70c015440 con 0x7fd71006d120 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.259+0000 7fd7057fa700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6f4066f30 0x7fd6f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.259+0000 7fd7057fa700 1 -- 172.21.15.81:0/502565513 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd70c084b90 con 0x7fd71006d120 2023-10-06T02:57:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.259+0000 7fd714a6d700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6f4066f30 0x7fd6f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.260+0000 7fd714a6d700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6f4066f30 0x7fd6f40693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b3940 tx=0x7fd700017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:15.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.263+0000 7fd7057fa700 1 -- 172.21.15.81:0/502565513 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd70c04e5a0 con 0x7fd71006d120 2023-10-06T02:57:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.446+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd7100d0170 con 0x7fd71006d120 2023-10-06T02:57:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.446+0000 7fd7057fa700 1 -- 172.21.15.81:0/502565513 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v176) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd70c01a090 con 0x7fd71006d120 2023-10-06T02:57:15.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:15.448 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T02:57:15.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:15.448 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T02:57:15.448 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T02:57:15.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:15.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:15.448 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T02:57:15.448 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T02:57:15.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:15.449 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T02:57:15.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6f4066f30 msgr2=0x7fd6f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6f4066f30 0x7fd6f40693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b3940 tx=0x7fd700017000 comp rx=0 tx=0).stop 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71006d120 msgr2=0x7fd7100b6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71006d120 0x7fd7100b6340 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00a430 tx=0x7fd70c007910 comp rx=0 tx=0).stop 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 shutdown_connections 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd710157ca0 0x7fd710068dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71006d120 0x7fd7100b6340 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd6f4066f30 0x7fd6f40693e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 --2- 172.21.15.81:0/502565513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7101578d0 0x7fd710068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 >> 172.21.15.81:0/502565513 conn(0x7fd71006bb90 msgr2=0x7fd71015cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 shutdown_connections 2023-10-06T02:57:15.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.448+0000 7fd7174d2700 1 -- 172.21.15.81:0/502565513 wait complete. 2023-10-06T02:57:15.461 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:57:15.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:57:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.578+0000 7fc97d760700 1 Processor -- start 2023-10-06T02:57:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.578+0000 7fc97d760700 1 -- start start 2023-10-06T02:57:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc97d760700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780d0f50 0x7fc97806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc97d760700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97806d9b0 con 0x7fc9780d0b80 2023-10-06T02:57:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc97d760700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780cf2d0 con 0x7fc97806d530 2023-10-06T02:57:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc97d760700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97815a690 con 0x7fc9780d0f50 2023-10-06T02:57:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc977fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc9780d0b80 0x7fc9780cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51296/0 (socket says 172.21.15.81:51296) 2023-10-06T02:57:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc977fff700 1 -- 172.21.15.81:0/245145150 learned_addr learned my addr 172.21.15.81:0/245145150 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc9777fe700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780d0f50 0x7fc97806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657923007 0 0) 0x7fc97806d9b0 con 0x7fc9780d0b80 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc960003570 con 0x7fc9780d0b80 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2758937916 0 0) 0x7fc960003570 con 0x7fc9780d0b80 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780d0f50 msgr2=0x7fc97806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780d0f50 0x7fc97806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 >> v1:172.21.15.83:6789/0 conn(0x7fc97806d530 legacy=0x7fc97815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780d0480 con 0x7fc9780d0b80 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fc968001470 con 0x7fc9780d0b80 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 >> v1:172.21.15.81:6789/0 conn(0x7fc9780d0b80 legacy=0x7fc9780cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780d0f50 0x7fc960003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.579+0000 7fc976ffd700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc960003fd0 0x7fc960004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc976ffd700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc960004d50 0x7fc9600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97815a690 con 0x7fc960004d50 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96000bb40 con 0x7fc960003fd0 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96000bd00 con 0x7fc9780d0f50 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc97cf5f700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc960004d50 0x7fc9600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc977fff700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780d0f50 0x7fc960003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc9777fe700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc960003fd0 0x7fc960004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc97cf5f700 1 -- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780d0f50 msgr2=0x7fc960003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc97cf5f700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780d0f50 0x7fc960003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc97cf5f700 1 -- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc960003fd0 msgr2=0x7fc960004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc97cf5f700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc960003fd0 0x7fc960004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc97cf5f700 1 -- 172.21.15.81:0/245145150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960003570 con 0x7fc960004d50 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc97cf5f700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc960004d50 0x7fc9600051c0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fc9700020a0 tx=0x7fc9700016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33e727ea4a78f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700019e0 con 0x7fc960004d50 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000c8b0 con 0x7fc960004d50 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.580+0000 7fc976ffd700 1 -- 172.21.15.81:0/245145150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000cc50 con 0x7fc960004d50 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.581+0000 7fc97d760700 1 -- 172.21.15.81:0/245145150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc960004d50 msgr2=0x7fc9600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.581+0000 7fc97d760700 1 --2- 172.21.15.81:0/245145150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc960004d50 0x7fc9600051c0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fc9700020a0 tx=0x7fc9700016d0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.581+0000 7fc97cf5f700 1 -- 172.21.15.81:0/245145150 reap_dead start 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.581+0000 7fc97d760700 1 -- 172.21.15.81:0/245145150 shutdown_connections 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.581+0000 7fc97d760700 1 -- 172.21.15.81:0/245145150 >> 172.21.15.81:0/245145150 conn(0x7fc978063230 msgr2=0x7fc978063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.581+0000 7fc97d760700 1 -- 172.21.15.81:0/245145150 shutdown_connections 2023-10-06T02:57:15.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.581+0000 7fc97d760700 1 -- 172.21.15.81:0/245145150 wait complete. 2023-10-06T02:57:15.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.582+0000 7fc97d760700 1 Processor -- start 2023-10-06T02:57:15.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.582+0000 7fc97d760700 1 -- start start 2023-10-06T02:57:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97d760700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780c8b80 0x7fc97816acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97d760700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9780c8f50 0x7fc97816b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97d760700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9780b4070 0x7fc9780b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97d760700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97816a670 con 0x7fc9780b4070 2023-10-06T02:57:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97d760700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97816b730 con 0x7fc9780c8f50 2023-10-06T02:57:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97d760700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780b4dc0 con 0x7fc9780c8b80 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97cf5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9780b4070 0x7fc9780b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97cf5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9780b4070 0x7fc9780b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47860/0 (socket says 172.21.15.81:47860) 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97cf5f700 1 -- 172.21.15.81:0/632851467 learned_addr learned my addr 172.21.15.81:0/632851467 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc977fff700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780c8b80 0x7fc97816acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc9777fe700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9780c8f50 0x7fc97816b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97cf5f700 1 -- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780c8b80 msgr2=0x7fc97816acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97cf5f700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780c8b80 0x7fc97816acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97cf5f700 1 -- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9780c8f50 msgr2=0x7fc97816b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97cf5f700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9780c8f50 0x7fc97816b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97cf5f700 1 -- 172.21.15.81:0/632851467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780b50a0 con 0x7fc9780b4070 2023-10-06T02:57:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97cf5f700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9780b4070 0x7fc9780b44e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fc970012000 tx=0x7fc970016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc95ffff700 1 -- 172.21.15.81:0/632851467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700019e0 con 0x7fc9780b4070 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc95ffff700 1 -- 172.21.15.81:0/632851467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000c6d0 con 0x7fc9780b4070 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc95ffff700 1 -- 172.21.15.81:0/632851467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970007950 con 0x7fc9780b4070 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9780b5380 con 0x7fc9780b4070 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.583+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780b4a20 con 0x7fc9780b4070 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.584+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9780b5820 con 0x7fc9780b4070 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.585+0000 7fc95ffff700 1 -- 172.21.15.81:0/632851467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc97001e640 con 0x7fc9780b4070 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.585+0000 7fc95ffff700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc964066f30 0x7fc9640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.585+0000 7fc95ffff700 1 -- 172.21.15.81:0/632851467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc9700860f0 con 0x7fc9780b4070 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.585+0000 7fc977fff700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc964066f30 0x7fc9640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.586+0000 7fc977fff700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc964066f30 0x7fc9640693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc97816dcf0 tx=0x7fc9780cf460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:15.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.589+0000 7fc95ffff700 1 -- 172.21.15.81:0/632851467 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc970053550 con 0x7fc9780b4070 2023-10-06T02:57:15.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:15.773+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc97815b430 con 0x7fc9780b4070 2023-10-06T02:57:16.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.747+0000 7fc95ffff700 1 -- 172.21.15.81:0/632851467 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v177) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc970056b70 con 0x7fc9780b4070 2023-10-06T02:57:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.751+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc964066f30 msgr2=0x7fc9640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.751+0000 7fc97d760700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc964066f30 0x7fc9640693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc97816dcf0 tx=0x7fc9780cf460 comp rx=0 tx=0).stop 2023-10-06T02:57:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.751+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9780b4070 msgr2=0x7fc9780b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.751+0000 7fc97d760700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9780b4070 0x7fc9780b44e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fc970012000 tx=0x7fc970016000 comp rx=0 tx=0).stop 2023-10-06T02:57:16.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.752+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 shutdown_connections 2023-10-06T02:57:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.752+0000 7fc97d760700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9780b4070 0x7fc9780b44e0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.752+0000 7fc97d760700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9780c8b80 0x7fc97816acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.752+0000 7fc97d760700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc964066f30 0x7fc9640693e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.752+0000 7fc97d760700 1 --2- 172.21.15.81:0/632851467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9780c8f50 0x7fc97816b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.752+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 >> 172.21.15.81:0/632851467 conn(0x7fc978063230 msgr2=0x7fc9781574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.753+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 shutdown_connections 2023-10-06T02:57:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.754+0000 7fc97d760700 1 -- 172.21.15.81:0/632851467 wait complete. 2023-10-06T02:57:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T02:57:16.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:57:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.892+0000 7f8997c13700 1 Processor -- start 2023-10-06T02:57:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.892+0000 7f8997c13700 1 -- start start 2023-10-06T02:57:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f8997c13700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f89901577c0 0x7f8990068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f8997c13700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8990157b90 0x7f8990068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f8997c13700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89900cca80 con 0x7f89900cb790 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f8997c13700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89900cc2e0 con 0x7f8990157b90 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f8997c13700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89900cedd0 con 0x7f89901577c0 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89951ae700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8990157b90 0x7f8990068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89951ae700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8990157b90 0x7f8990068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47868/0 (socket says 172.21.15.81:47868) 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89951ae700 1 -- 172.21.15.81:0/1614667272 learned_addr learned my addr 172.21.15.81:0/1614667272 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89959af700 1 --2- 172.21.15.81:0/1614667272 >> v2:172.21.15.83:3300/0 conn(0x7f89901577c0 0x7f8990068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89951ae700 1 -- 172.21.15.81:0/1614667272 >> v2:172.21.15.83:3300/0 conn(0x7f89901577c0 msgr2=0x7f8990068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89951ae700 1 --2- 172.21.15.81:0/1614667272 >> v2:172.21.15.83:3300/0 conn(0x7f89901577c0 0x7f8990068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89951ae700 1 -- 172.21.15.81:0/1614667272 >> v1:172.21.15.83:6789/0 conn(0x7f89900cb790 legacy=0x7f89900cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89951ae700 1 -- 172.21.15.81:0/1614667272 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900cc4c0 con 0x7f8990157b90 2023-10-06T02:57:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89951ae700 1 --2- 172.21.15.81:0/1614667272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8990157b90 0x7f8990068d50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f8990068220 tx=0x7f8980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cdd13f4b94c07b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.893+0000 7f89949ad700 1 -- 172.21.15.81:0/1614667272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980009e70 con 0x7f8990157b90 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f89949ad700 1 -- 172.21.15.81:0/1614667272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898000b860 con 0x7f8990157b90 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f89949ad700 1 -- 172.21.15.81:0/1614667272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000bc00 con 0x7f8990157b90 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f8997c13700 1 -- 172.21.15.81:0/1614667272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8990157b90 msgr2=0x7f8990068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f8997c13700 1 --2- 172.21.15.81:0/1614667272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8990157b90 0x7f8990068d50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f8990068220 tx=0x7f8980009250 comp rx=0 tx=0).stop 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f8997c13700 1 -- 172.21.15.81:0/1614667272 shutdown_connections 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f8997c13700 1 --2- 172.21.15.81:0/1614667272 >> v2:172.21.15.83:3300/0 conn(0x7f89901577c0 0x7f8990068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f8997c13700 1 --2- 172.21.15.81:0/1614667272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8990157b90 0x7f8990068d50 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f8997c13700 1 -- 172.21.15.81:0/1614667272 >> 172.21.15.81:0/1614667272 conn(0x7f89900d0df0 msgr2=0x7f89900d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f8997c13700 1 -- 172.21.15.81:0/1614667272 shutdown_connections 2023-10-06T02:57:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.894+0000 7f8997c13700 1 -- 172.21.15.81:0/1614667272 wait complete. 2023-10-06T02:57:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.895+0000 7f8997c13700 1 Processor -- start 2023-10-06T02:57:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.895+0000 7f8997c13700 1 -- start start 2023-10-06T02:57:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f8997c13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900cb790 0x7f8990149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f8997c13700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89901577c0 0x7f89900b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f8997c13700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8990157b90 0x7f89900c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f8997c13700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8990157fb0 con 0x7f89900cb790 2023-10-06T02:57:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f8997c13700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8990158290 con 0x7f89901577c0 2023-10-06T02:57:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f8997c13700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900b4660 con 0x7f8990157b90 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89959af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900cb790 0x7f8990149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89959af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900cb790 0x7f8990149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47880/0 (socket says 172.21.15.81:47880) 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89959af700 1 -- 172.21.15.81:0/65539889 learned_addr learned my addr 172.21.15.81:0/65539889 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89951ae700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89901577c0 0x7f89900b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89961b0700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8990157b90 0x7f89900c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89959af700 1 -- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8990157b90 msgr2=0x7f89900c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89959af700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8990157b90 0x7f89900c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89959af700 1 -- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89901577c0 msgr2=0x7f89900b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89959af700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89901577c0 0x7f89900b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89959af700 1 -- 172.21.15.81:0/65539889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800094f0 con 0x7f89900cb790 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.896+0000 7f89961b0700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8990157b90 0x7f89900c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.897+0000 7f89959af700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900cb790 0x7f8990149700 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f898c00ecb0 tx=0x7f898c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.897+0000 7f8985ffb700 1 -- 172.21.15.81:0/65539889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00c9d0 con 0x7f89900cb790 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.897+0000 7f8985ffb700 1 -- 172.21.15.81:0/65539889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00cb30 con 0x7f89900cb790 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.897+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89900b4940 con 0x7f89900cb790 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.897+0000 7f8985ffb700 1 -- 172.21.15.81:0/65539889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00ced0 con 0x7f89900cb790 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.897+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899015a1a0 con 0x7f89900cb790 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.898+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8990067a50 con 0x7f89900cb790 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.898+0000 7f8985ffb700 1 -- 172.21.15.81:0/65539889 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f898c013680 con 0x7f89900cb790 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.899+0000 7f8985ffb700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8974066f30 0x7f89740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.899+0000 7f8985ffb700 1 -- 172.21.15.81:0/65539889 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f898c084920 con 0x7f89900cb790 2023-10-06T02:57:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.899+0000 7f89951ae700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8974066f30 0x7f89740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.899+0000 7f89951ae700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8974066f30 0x7f89740693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8990068220 tx=0x7f8980017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:16.903+0000 7f8985ffb700 1 -- 172.21.15.81:0/65539889 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f898c051b70 con 0x7f89900cb790 2023-10-06T02:57:17.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.086+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f89900cc7a0 con 0x7f89900cb790 2023-10-06T02:57:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.753+0000 7f8985ffb700 1 -- 172.21.15.81:0/65539889 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v178) v1 ==== 170+0+0 (secure 0 0 0) 0x7f898c055190 con 0x7f89900cb790 2023-10-06T02:57:17.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.757+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8974066f30 msgr2=0x7f89740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:17.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.757+0000 7f8997c13700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8974066f30 0x7f89740693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8990068220 tx=0x7f8980017000 comp rx=0 tx=0).stop 2023-10-06T02:57:17.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.757+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900cb790 msgr2=0x7f8990149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:17.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.757+0000 7f8997c13700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900cb790 0x7f8990149700 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f898c00ecb0 tx=0x7f898c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.758+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 shutdown_connections 2023-10-06T02:57:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.758+0000 7f8997c13700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8990157b90 0x7f89900c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.758+0000 7f8997c13700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900cb790 0x7f8990149700 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.758+0000 7f8997c13700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8974066f30 0x7f89740693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.758+0000 7f8997c13700 1 --2- 172.21.15.81:0/65539889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89901577c0 0x7f89900b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.758+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 >> 172.21.15.81:0/65539889 conn(0x7f89900d0df0 msgr2=0x7f89900c5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.760+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 shutdown_connections 2023-10-06T02:57:17.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.760+0000 7f8997c13700 1 -- 172.21.15.81:0/65539889 wait complete. 2023-10-06T02:57:17.762 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T02:57:17.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:57:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.892+0000 7f13ee9e8700 1 Processor -- start 2023-10-06T02:57:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.892+0000 7f13ee9e8700 1 -- start start 2023-10-06T02:57:17.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ee9e8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f13e80d0b80 0x7f13e80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:17.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ee9e8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13e80d02b0 0x7f13e806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ee9e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d0f50 0x7f13e806d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ee9e8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e815a690 con 0x7f13e80d02b0 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ee9e8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e80cf2d0 con 0x7f13e80d0b80 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ee9e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e806dc00 con 0x7f13e80d0f50 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed1e5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13e80d02b0 0x7f13e806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed1e5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13e80d02b0 0x7f13e806cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47892/0 (socket says 172.21.15.81:47892) 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed1e5700 1 -- 172.21.15.81:0/3704847431 learned_addr learned my addr 172.21.15.81:0/3704847431 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed9e6700 1 --2- 172.21.15.81:0/3704847431 >> v2:172.21.15.83:3300/0 conn(0x7f13e80d0b80 0x7f13e80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ee1e7700 1 --2- 172.21.15.81:0/3704847431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d0f50 0x7f13e806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:17.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed1e5700 1 -- 172.21.15.81:0/3704847431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d0f50 msgr2=0x7f13e806d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed1e5700 1 --2- 172.21.15.81:0/3704847431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d0f50 0x7f13e806d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed1e5700 1 -- 172.21.15.81:0/3704847431 >> v2:172.21.15.83:3300/0 conn(0x7f13e80d0b80 msgr2=0x7f13e80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed1e5700 1 --2- 172.21.15.81:0/3704847431 >> v2:172.21.15.83:3300/0 conn(0x7f13e80d0b80 0x7f13e80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed1e5700 1 -- 172.21.15.81:0/3704847431 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e80cf570 con 0x7f13e80d02b0 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed9e6700 1 --2- 172.21.15.81:0/3704847431 >> v2:172.21.15.83:3300/0 conn(0x7f13e80d0b80 0x7f13e80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ee1e7700 1 --2- 172.21.15.81:0/3704847431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d0f50 0x7f13e806d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ed1e5700 1 --2- 172.21.15.81:0/3704847431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d02b0 0x7f13e806cff0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f13e806cd80 tx=0x7f13d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89095bbd66d46da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ec9e4700 1 -- 172.21.15.81:0/3704847431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800b860 con 0x7f13e80d02b0 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ec9e4700 1 -- 172.21.15.81:0/3704847431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d800b9c0 con 0x7f13e80d02b0 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.893+0000 7f13ec9e4700 1 -- 172.21.15.81:0/3704847431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800bd60 con 0x7f13e80d02b0 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.894+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3704847431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d02b0 msgr2=0x7f13e806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:17.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.894+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3704847431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d02b0 0x7f13e806cff0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f13e806cd80 tx=0x7f13d8009250 comp rx=0 tx=0).stop 2023-10-06T02:57:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.894+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3704847431 shutdown_connections 2023-10-06T02:57:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.894+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3704847431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d0f50 0x7f13e806d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.894+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3704847431 >> v2:172.21.15.83:3300/0 conn(0x7f13e80d0b80 0x7f13e80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.894+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3704847431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d02b0 0x7f13e806cff0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.894+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3704847431 >> 172.21.15.81:0/3704847431 conn(0x7f13e8063230 msgr2=0x7f13e8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.894+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3704847431 shutdown_connections 2023-10-06T02:57:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.894+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3704847431 wait complete. 2023-10-06T02:57:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.895+0000 7f13ee9e8700 1 Processor -- start 2023-10-06T02:57:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.895+0000 7f13ee9e8700 1 -- start start 2023-10-06T02:57:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ee9e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d02b0 0x7f13e816a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ee9e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d0b80 0x7f13e815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ee9e8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13e80d0f50 0x7f13e815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ee9e8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80ad900 con 0x7f13e80d0b80 2023-10-06T02:57:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ee9e8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e816a830 con 0x7f13e80d0f50 2023-10-06T02:57:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ee9e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e816ab10 con 0x7f13e80d02b0 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed1e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d0b80 0x7f13e815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed1e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d0b80 0x7f13e815c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47896/0 (socket says 172.21.15.81:47896) 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed1e5700 1 -- 172.21.15.81:0/3114101054 learned_addr learned my addr 172.21.15.81:0/3114101054 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ee1e7700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13e80d0f50 0x7f13e815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed9e6700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d02b0 0x7f13e816a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed1e5700 1 -- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d02b0 msgr2=0x7f13e816a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed1e5700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d02b0 0x7f13e816a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed1e5700 1 -- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13e80d0f50 msgr2=0x7f13e815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed1e5700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13e80d0f50 0x7f13e815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed1e5700 1 -- 172.21.15.81:0/3114101054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d80094f0 con 0x7f13e80d0b80 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.896+0000 7f13ed1e5700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d0b80 0x7f13e815c380 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f13e806fcc0 tx=0x7f13d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.897+0000 7f13ddffb700 1 -- 172.21.15.81:0/3114101054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8024440 con 0x7f13e80d0b80 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.897+0000 7f13ddffb700 1 -- 172.21.15.81:0/3114101054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d80245a0 con 0x7f13e80d0b80 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.897+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e816adf0 con 0x7f13e80d0b80 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.897+0000 7f13ddffb700 1 -- 172.21.15.81:0/3114101054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8024960 con 0x7f13e80d0b80 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.897+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e8157860 con 0x7f13e80d0b80 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.898+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e80676e0 con 0x7f13e80d0b80 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.898+0000 7f13ddffb700 1 -- 172.21.15.81:0/3114101054 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13d801a420 con 0x7f13e80d0b80 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.899+0000 7f13ddffb700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13cc066f30 0x7f13cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.899+0000 7f13ddffb700 1 -- 172.21.15.81:0/3114101054 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f13d8086540 con 0x7f13e80d0b80 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.899+0000 7f13ed9e6700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13cc066f30 0x7f13cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.899+0000 7f13ed9e6700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13cc066f30 0x7f13cc0693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f13e400ab30 tx=0x7f13e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:17.903+0000 7f13ddffb700 1 -- 172.21.15.81:0/3114101054 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13d80536b0 con 0x7f13e80d0b80 2023-10-06T02:57:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.126+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f13e80cf850 con 0x7f13e80d0b80 2023-10-06T02:57:18.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.752+0000 7f13ddffb700 1 -- 172.21.15.81:0/3114101054 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v87) v1 ==== 174+0+0 (secure 0 0 0) 0x7f13d8056cd0 con 0x7f13e80d0b80 2023-10-06T02:57:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13cc066f30 msgr2=0x7f13cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13cc066f30 0x7f13cc0693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f13e400ab30 tx=0x7f13e4008040 comp rx=0 tx=0).stop 2023-10-06T02:57:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d0b80 msgr2=0x7f13e815c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d0b80 0x7f13e815c380 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f13e806fcc0 tx=0x7f13d8017000 comp rx=0 tx=0).stop 2023-10-06T02:57:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 shutdown_connections 2023-10-06T02:57:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f13cc066f30 0x7f13cc0693e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13e80d0f50 0x7f13e815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f13e80d02b0 0x7f13e816a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 --2- 172.21.15.81:0/3114101054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e80d0b80 0x7f13e815c380 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 >> 172.21.15.81:0/3114101054 conn(0x7f13e8063230 msgr2=0x7f13e806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 shutdown_connections 2023-10-06T02:57:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.770+0000 7f13ee9e8700 1 -- 172.21.15.81:0/3114101054 wait complete. 2023-10-06T02:57:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 23 and data pool 24 2023-10-06T02:57:18.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.898+0000 7fc70d31b700 1 Processor -- start 2023-10-06T02:57:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.898+0000 7fc70d31b700 1 -- start start 2023-10-06T02:57:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc70d31b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7081578d0 0x7fc7080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc70d31b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc708157ca0 0x7fc70815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc70d31b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7080d07c0 con 0x7fc70806d120 2023-10-06T02:57:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc70d31b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7080cfbb0 con 0x7fc708157ca0 2023-10-06T02:57:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc70d31b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080cfe90 con 0x7fc7081578d0 2023-10-06T02:57:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc7077fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc70806d120 0x7fc70815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51312/0 (socket says 172.21.15.81:51312) 2023-10-06T02:57:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc7077fe700 1 -- 172.21.15.81:0/3539750507 learned_addr learned my addr 172.21.15.81:0/3539750507 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc706ffd700 1 --2- 172.21.15.81:0/3539750507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7081578d0 0x7fc7080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc7067fc700 1 --2- 172.21.15.81:0/3539750507 >> v2:172.21.15.83:3300/0 conn(0x7fc708157ca0 0x7fc70815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc705ffb700 1 -- 172.21.15.81:0/3539750507 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688827920 0 0) 0x7fc7080d07c0 con 0x7fc70806d120 2023-10-06T02:57:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc705ffb700 1 -- 172.21.15.81:0/3539750507 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f4003570 con 0x7fc70806d120 2023-10-06T02:57:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc706ffd700 1 -- 172.21.15.81:0/3539750507 >> v2:172.21.15.83:3300/0 conn(0x7fc708157ca0 msgr2=0x7fc70815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc706ffd700 1 --2- 172.21.15.81:0/3539750507 >> v2:172.21.15.83:3300/0 conn(0x7fc708157ca0 0x7fc70815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc706ffd700 1 -- 172.21.15.81:0/3539750507 >> v1:172.21.15.81:6789/0 conn(0x7fc70806d120 legacy=0x7fc70815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc706ffd700 1 -- 172.21.15.81:0/3539750507 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080d0170 con 0x7fc7081578d0 2023-10-06T02:57:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc7067fc700 1 --2- 172.21.15.81:0/3539750507 >> v2:172.21.15.83:3300/0 conn(0x7fc708157ca0 0x7fc70815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.899+0000 7fc706ffd700 1 --2- 172.21.15.81:0/3539750507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7081578d0 0x7fc7080cf4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc700009e60 tx=0x7fc700009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62072af9011183c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc705ffb700 1 -- 172.21.15.81:0/3539750507 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000e070 con 0x7fc7081578d0 2023-10-06T02:57:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc705ffb700 1 -- 172.21.15.81:0/3539750507 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70000bab0 con 0x7fc7081578d0 2023-10-06T02:57:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc705ffb700 1 -- 172.21.15.81:0/3539750507 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000be70 con 0x7fc7081578d0 2023-10-06T02:57:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc70d31b700 1 -- 172.21.15.81:0/3539750507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7081578d0 msgr2=0x7fc7080cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc70d31b700 1 --2- 172.21.15.81:0/3539750507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7081578d0 0x7fc7080cf4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc700009e60 tx=0x7fc700009780 comp rx=0 tx=0).stop 2023-10-06T02:57:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc70d31b700 1 -- 172.21.15.81:0/3539750507 shutdown_connections 2023-10-06T02:57:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc70d31b700 1 --2- 172.21.15.81:0/3539750507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7081578d0 0x7fc7080cf4f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc70d31b700 1 --2- 172.21.15.81:0/3539750507 >> v2:172.21.15.83:3300/0 conn(0x7fc708157ca0 0x7fc70815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc70d31b700 1 -- 172.21.15.81:0/3539750507 >> 172.21.15.81:0/3539750507 conn(0x7fc70806bb90 msgr2=0x7fc70806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc70d31b700 1 -- 172.21.15.81:0/3539750507 shutdown_connections 2023-10-06T02:57:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.900+0000 7fc70d31b700 1 -- 172.21.15.81:0/3539750507 wait complete. 2023-10-06T02:57:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.901+0000 7fc70d31b700 1 Processor -- start 2023-10-06T02:57:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.901+0000 7fc70d31b700 1 -- start start 2023-10-06T02:57:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc70d31b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc70806d120 0x7fc708153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc70d31b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7081578d0 0x7fc7080b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc70d31b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc708157ca0 0x7fc7080b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc70d31b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc708153e80 con 0x7fc7081578d0 2023-10-06T02:57:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc70d31b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080b5410 con 0x7fc708157ca0 2023-10-06T02:57:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc70d31b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080b56f0 con 0x7fc70806d120 2023-10-06T02:57:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc7067fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7081578d0 0x7fc7080b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc7067fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7081578d0 0x7fc7080b64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47908/0 (socket says 172.21.15.81:47908) 2023-10-06T02:57:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc7067fc700 1 -- 172.21.15.81:0/1454234906 learned_addr learned my addr 172.21.15.81:0/1454234906 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc706ffd700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc70806d120 0x7fc708153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc7077fe700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc708157ca0 0x7fc7080b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc7067fc700 1 -- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc70806d120 msgr2=0x7fc708153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc7067fc700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc70806d120 0x7fc708153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc7067fc700 1 -- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc708157ca0 msgr2=0x7fc7080b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc7067fc700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc708157ca0 0x7fc7080b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.902+0000 7fc7067fc700 1 -- 172.21.15.81:0/1454234906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0009420 con 0x7fc7081578d0 2023-10-06T02:57:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.903+0000 7fc7067fc700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7081578d0 0x7fc7080b64b0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000ec80 tx=0x7fc6f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.903+0000 7fc6feffd700 1 -- 172.21.15.81:0/1454234906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f000c9d0 con 0x7fc7081578d0 2023-10-06T02:57:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.903+0000 7fc6feffd700 1 -- 172.21.15.81:0/1454234906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f000cb30 con 0x7fc7081578d0 2023-10-06T02:57:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.903+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc700009a20 con 0x7fc7081578d0 2023-10-06T02:57:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.903+0000 7fc6feffd700 1 -- 172.21.15.81:0/1454234906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f000ced0 con 0x7fc7081578d0 2023-10-06T02:57:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.903+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7080b5cb0 con 0x7fc7081578d0 2023-10-06T02:57:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.904+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc708067ac0 con 0x7fc7081578d0 2023-10-06T02:57:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.904+0000 7fc6feffd700 1 -- 172.21.15.81:0/1454234906 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6f0013680 con 0x7fc7081578d0 2023-10-06T02:57:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.904+0000 7fc6feffd700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc6e8066f30 0x7fc6e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:18.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.905+0000 7fc6feffd700 1 -- 172.21.15.81:0/1454234906 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc6f00849e0 con 0x7fc7081578d0 2023-10-06T02:57:18.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.905+0000 7fc706ffd700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc6e8066f30 0x7fc6e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:18.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.905+0000 7fc706ffd700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc6e8066f30 0x7fc6e80693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc7000097c0 tx=0x7fc700019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:18.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:18.909+0000 7fc6feffd700 1 -- 172.21.15.81:0/1454234906 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6f0051af0 con 0x7fc7081578d0 2023-10-06T02:57:19.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.091+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7080d0450 con 0x7fc7081578d0 2023-10-06T02:57:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.092+0000 7fc6feffd700 1 -- 172.21.15.81:0/1454234906 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+16847 (secure 0 0 0) 0x7fc6f0055110 con 0x7fc7081578d0 2023-10-06T02:57:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":179,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:57:18.127982+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:15.791318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:17.104149+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc6e8066f30 msgr2=0x7fc6e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc6e8066f30 0x7fc6e80693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc7000097c0 tx=0x7fc700019000 comp rx=0 tx=0).stop 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7081578d0 msgr2=0x7fc7080b64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7081578d0 0x7fc7080b64b0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000ec80 tx=0x7fc6f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 shutdown_connections 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc6e8066f30 0x7fc6e80693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc708157ca0 0x7fc7080b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc70806d120 0x7fc708153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 --2- 172.21.15.81:0/1454234906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7081578d0 0x7fc7080b64b0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 >> 172.21.15.81:0/1454234906 conn(0x7fc70806bb90 msgr2=0x7fc708069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 shutdown_connections 2023-10-06T02:57:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.094+0000 7fc70d31b700 1 -- 172.21.15.81:0/1454234906 wait complete. 2023-10-06T02:57:19.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.220+0000 7f659a5ed700 1 Processor -- start 2023-10-06T02:57:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.220+0000 7f659a5ed700 1 -- start start 2023-10-06T02:57:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.221+0000 7f659a5ed700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f659415a2a0 0x7f65940b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.221+0000 7f659a5ed700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65940b0ca0 con 0x7f65940ceb30 2023-10-06T02:57:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.221+0000 7f659a5ed700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65940b00d0 con 0x7f659406dd60 2023-10-06T02:57:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.221+0000 7f659a5ed700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659406e160 con 0x7f659415a2a0 2023-10-06T02:57:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.221+0000 7f6593fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f659415a2a0 0x7f65940b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.221+0000 7f65937fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f65940ceb30 0x7f659406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51326/0 (socket says 172.21.15.81:51326) 2023-10-06T02:57:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.221+0000 7f65937fe700 1 -- 172.21.15.81:0/123428021 learned_addr learned my addr 172.21.15.81:0/123428021 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f6593fff700 1 -- 172.21.15.81:0/123428021 >> v1:172.21.15.83:6789/0 conn(0x7f659406dd60 legacy=0x7f65940b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f6593fff700 1 -- 172.21.15.81:0/123428021 >> v1:172.21.15.81:6789/0 conn(0x7f65940ceb30 legacy=0x7f659406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f6592ffd700 1 -- 172.21.15.81:0/123428021 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594443137 0 0) 0x7f65940b0ca0 con 0x7f65940ceb30 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f6593fff700 1 -- 172.21.15.81:0/123428021 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65940b0370 con 0x7f659415a2a0 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f6593fff700 1 --2- 172.21.15.81:0/123428021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659415a2a0 0x7f65940b1130 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f65840098e0 tx=0x7f65840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a4c988d4c72ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f6592ffd700 1 -- 172.21.15.81:0/123428021 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584009e80 con 0x7f659415a2a0 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f6592ffd700 1 -- 172.21.15.81:0/123428021 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658400b820 con 0x7f659415a2a0 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f6592ffd700 1 -- 172.21.15.81:0/123428021 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658400bba0 con 0x7f659415a2a0 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f659a5ed700 1 -- 172.21.15.81:0/123428021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659415a2a0 msgr2=0x7f65940b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f659a5ed700 1 --2- 172.21.15.81:0/123428021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659415a2a0 0x7f65940b1130 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f65840098e0 tx=0x7f65840091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f659a5ed700 1 -- 172.21.15.81:0/123428021 shutdown_connections 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f659a5ed700 1 --2- 172.21.15.81:0/123428021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659415a2a0 0x7f65940b1130 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.222+0000 7f659a5ed700 1 -- 172.21.15.81:0/123428021 >> 172.21.15.81:0/123428021 conn(0x7f6594067640 msgr2=0x7f6594067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.223+0000 7f659a5ed700 1 -- 172.21.15.81:0/123428021 shutdown_connections 2023-10-06T02:57:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.223+0000 7f659a5ed700 1 -- 172.21.15.81:0/123428021 wait complete. 2023-10-06T02:57:19.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.224+0000 7f659a5ed700 1 Processor -- start 2023-10-06T02:57:19.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.224+0000 7f659a5ed700 1 -- start start 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.224+0000 7f659a5ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659406dd60 0x7f65940b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.224+0000 7f659a5ed700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65940ceb30 0x7f659415b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.224+0000 7f659a5ed700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f659415a2a0 0x7f659416bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.224+0000 7f659a5ed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940b49b0 con 0x7f659406dd60 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.224+0000 7f659a5ed700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6594156000 con 0x7f659415a2a0 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.224+0000 7f659a5ed700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659415a670 con 0x7f65940ceb30 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6593fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659406dd60 0x7f65940b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6593fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659406dd60 0x7f65940b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47926/0 (socket says 172.21.15.81:47926) 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6593fff700 1 -- 172.21.15.81:0/1712776528 learned_addr learned my addr 172.21.15.81:0/1712776528 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:19.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f65937fe700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65940ceb30 0x7f659415b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6598b8a700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f659415a2a0 0x7f659416bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6593fff700 1 -- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65940ceb30 msgr2=0x7f659415b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6593fff700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65940ceb30 0x7f659415b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6593fff700 1 -- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f659415a2a0 msgr2=0x7f659416bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6593fff700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f659415a2a0 0x7f659416bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6593fff700 1 -- 172.21.15.81:0/1712776528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6584009420 con 0x7f659406dd60 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f65937fe700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65940ceb30 0x7f659415b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6598b8a700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f659415a2a0 0x7f659416bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f6593fff700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659406dd60 0x7f65940b4470 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f65840030c0 tx=0x7f6584016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f657bfff700 1 -- 172.21.15.81:0/1712776528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658400bae0 con 0x7f659406dd60 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f657bfff700 1 -- 172.21.15.81:0/1712776528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584020070 con 0x7f659406dd60 2023-10-06T02:57:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659415b4d0 con 0x7f659406dd60 2023-10-06T02:57:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f657bfff700 1 -- 172.21.15.81:0/1712776528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658401b6a0 con 0x7f659406dd60 2023-10-06T02:57:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.225+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659415aba0 con 0x7f659406dd60 2023-10-06T02:57:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.226+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659415b7b0 con 0x7f659406dd60 2023-10-06T02:57:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.227+0000 7f657bfff700 1 -- 172.21.15.81:0/1712776528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6584022030 con 0x7f659406dd60 2023-10-06T02:57:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.227+0000 7f657bfff700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6580066f30 0x7f65800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.227+0000 7f657bfff700 1 -- 172.21.15.81:0/1712776528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6584086650 con 0x7f659406dd60 2023-10-06T02:57:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.227+0000 7f65937fe700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6580066f30 0x7f65800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.228+0000 7f65937fe700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6580066f30 0x7f65800693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f65940cd820 tx=0x7f6588009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.231+0000 7f657bfff700 1 -- 172.21.15.81:0/1712776528 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6584053760 con 0x7f659406dd60 2023-10-06T02:57:19.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.414+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f659415b7b0 con 0x7f659406dd60 2023-10-06T02:57:19.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.415+0000 7f657bfff700 1 -- 172.21.15.81:0/1712776528 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+16847 (secure 0 0 0) 0x7f6584056d80 con 0x7f659406dd60 2023-10-06T02:57:19.417 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:19.417 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":179,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:57:18.127982+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:15.791318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:17.104149+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6580066f30 msgr2=0x7f65800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6580066f30 0x7f65800693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f65940cd820 tx=0x7f6588009040 comp rx=0 tx=0).stop 2023-10-06T02:57:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659406dd60 msgr2=0x7f65940b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659406dd60 0x7f65940b4470 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f65840030c0 tx=0x7f6584016000 comp rx=0 tx=0).stop 2023-10-06T02:57:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 shutdown_connections 2023-10-06T02:57:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6580066f30 0x7f65800693e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f659415a2a0 0x7f659416bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659406dd60 0x7f65940b4470 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 --2- 172.21.15.81:0/1712776528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f65940ceb30 0x7f659415b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 >> 172.21.15.81:0/1712776528 conn(0x7f6594067640 msgr2=0x7f659415c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 shutdown_connections 2023-10-06T02:57:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.417+0000 7f659a5ed700 1 -- 172.21.15.81:0/1712776528 wait complete. 2023-10-06T02:57:19.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:57:19.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.547+0000 7faceee3b700 1 Processor -- start 2023-10-06T02:57:19.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.547+0000 7faceee3b700 1 -- start start 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7faceee3b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7face81578d0 0x7face80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7faceee3b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7face8157ca0 0x7face815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7faceee3b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7face806d120 0x7face806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7faceee3b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face806dac0 con 0x7face81578d0 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7faceee3b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80d07c0 con 0x7face806d120 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7faceee3b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80cfbb0 con 0x7face8157ca0 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7facecbd7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7face81578d0 0x7face80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7facecbd7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7face81578d0 0x7face80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47936/0 (socket says 172.21.15.81:47936) 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7facecbd7700 1 -- 172.21.15.81:0/894742264 learned_addr learned my addr 172.21.15.81:0/894742264 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7facecbd7700 1 -- 172.21.15.81:0/894742264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7face8157ca0 msgr2=0x7face815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7facecbd7700 1 --2- 172.21.15.81:0/894742264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7face8157ca0 0x7face815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7facecbd7700 1 -- 172.21.15.81:0/894742264 >> v2:172.21.15.83:3300/0 conn(0x7face806d120 msgr2=0x7face806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7faced3d8700 1 --2- 172.21.15.81:0/894742264 >> v2:172.21.15.83:3300/0 conn(0x7face806d120 0x7face806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7facecbd7700 1 --2- 172.21.15.81:0/894742264 >> v2:172.21.15.83:3300/0 conn(0x7face806d120 0x7face806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.548+0000 7facecbd7700 1 -- 172.21.15.81:0/894742264 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80cfe90 con 0x7face81578d0 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7facecbd7700 1 --2- 172.21.15.81:0/894742264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81578d0 0x7face80cf4f0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7face80b3940 tx=0x7face4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8dcafe5be0abcc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7facdf7fe700 1 -- 172.21.15.81:0/894742264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400e070 con 0x7face81578d0 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7facdf7fe700 1 -- 172.21.15.81:0/894742264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400ba50 con 0x7face81578d0 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7facdf7fe700 1 -- 172.21.15.81:0/894742264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face40092e0 con 0x7face81578d0 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7faceee3b700 1 -- 172.21.15.81:0/894742264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81578d0 msgr2=0x7face80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7faceee3b700 1 --2- 172.21.15.81:0/894742264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81578d0 0x7face80cf4f0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7face80b3940 tx=0x7face4009840 comp rx=0 tx=0).stop 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7faceee3b700 1 -- 172.21.15.81:0/894742264 shutdown_connections 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7faceee3b700 1 --2- 172.21.15.81:0/894742264 >> v2:172.21.15.83:3300/0 conn(0x7face806d120 0x7face806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7faceee3b700 1 --2- 172.21.15.81:0/894742264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81578d0 0x7face80cf4f0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7faceee3b700 1 --2- 172.21.15.81:0/894742264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7face8157ca0 0x7face815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7faceee3b700 1 -- 172.21.15.81:0/894742264 >> 172.21.15.81:0/894742264 conn(0x7face806bb90 msgr2=0x7face806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7faceee3b700 1 -- 172.21.15.81:0/894742264 shutdown_connections 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.549+0000 7faceee3b700 1 -- 172.21.15.81:0/894742264 wait complete. 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.550+0000 7faceee3b700 1 Processor -- start 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7faceee3b700 1 -- start start 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7faceee3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face806d120 0x7face81457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7faceee3b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face81578d0 0x7face80b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7faceee3b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7face8157ca0 0x7face8069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7faceee3b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80b58e0 con 0x7face806d120 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7faceee3b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8145d30 con 0x7face81578d0 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7faceee3b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80b4d10 con 0x7face8157ca0 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7facecbd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face806d120 0x7face81457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7facecbd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face806d120 0x7face81457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47948/0 (socket says 172.21.15.81:47948) 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.551+0000 7facecbd7700 1 -- 172.21.15.81:0/3969332100 learned_addr learned my addr 172.21.15.81:0/3969332100 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7faced3d8700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7face8157ca0 0x7face8069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facdffff700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face81578d0 0x7face80b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facecbd7700 1 -- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7face8157ca0 msgr2=0x7face8069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facecbd7700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7face8157ca0 0x7face8069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facecbd7700 1 -- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face81578d0 msgr2=0x7face80b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facecbd7700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face81578d0 0x7face80b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facecbd7700 1 -- 172.21.15.81:0/3969332100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face4009ae0 con 0x7face806d120 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facecbd7700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face806d120 0x7face81457f0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7face4009430 tx=0x7face4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facdcff9700 1 -- 172.21.15.81:0/3969332100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4008a00 con 0x7face806d120 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facdcff9700 1 -- 172.21.15.81:0/3969332100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face4008b60 con 0x7face806d120 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face80b4fb0 con 0x7face806d120 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7facdcff9700 1 -- 172.21.15.81:0/3969332100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4026460 con 0x7face806d120 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.552+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face80b5570 con 0x7face806d120 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.553+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face8067ac0 con 0x7face806d120 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.554+0000 7facdcff9700 1 -- 172.21.15.81:0/3969332100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7face4003040 con 0x7face806d120 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.554+0000 7facdcff9700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7facd4066f30 0x7facd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.554+0000 7facdcff9700 1 -- 172.21.15.81:0/3969332100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6058+0+0 (secure 0 0 0) 0x7face40863e0 con 0x7face806d120 2023-10-06T02:57:19.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.554+0000 7facdffff700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7facd4066f30 0x7facd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:19.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.555+0000 7facdffff700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7facd4066f30 0x7facd40693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7face816d920 tx=0x7facd80090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:19.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.558+0000 7facdcff9700 1 -- 172.21.15.81:0/3969332100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face40535a0 con 0x7face806d120 2023-10-06T02:57:19.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:19.786+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7face80d0170 con 0x7face806d120 2023-10-06T02:57:20.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.769+0000 7facdcff9700 1 -- 172.21.15.81:0/3969332100 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v89) v1 ==== 118+0+0 (secure 0 0 0) 0x7face4009940 con 0x7face806d120 2023-10-06T02:57:20.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.771+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7facd4066f30 msgr2=0x7facd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:20.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.771+0000 7faceee3b700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7facd4066f30 0x7facd40693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7face816d920 tx=0x7facd80090f0 comp rx=0 tx=0).stop 2023-10-06T02:57:20.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.771+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face806d120 msgr2=0x7face81457f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:20.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.771+0000 7faceee3b700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face806d120 0x7face81457f0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7face4009430 tx=0x7face4018000 comp rx=0 tx=0).stop 2023-10-06T02:57:20.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.772+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 shutdown_connections 2023-10-06T02:57:20.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.772+0000 7faceee3b700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7face8157ca0 0x7face8069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:20.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.772+0000 7faceee3b700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face806d120 0x7face81457f0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:20.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.772+0000 7faceee3b700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7facd4066f30 0x7facd40693e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:20.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.772+0000 7faceee3b700 1 --2- 172.21.15.81:0/3969332100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face81578d0 0x7face80b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:20.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.772+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 >> 172.21.15.81:0/3969332100 conn(0x7face806bb90 msgr2=0x7face806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:20.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.772+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 shutdown_connections 2023-10-06T02:57:20.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.772+0000 7faceee3b700 1 -- 172.21.15.81:0/3969332100 wait complete. 2023-10-06T02:57:20.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:57:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.902+0000 7f4a1d317700 1 Processor -- start 2023-10-06T02:57:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.902+0000 7f4a1d317700 1 -- start start 2023-10-06T02:57:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.903+0000 7f4a1d317700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a1806dd60 0x7f4a180b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.903+0000 7f4a1d317700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a180b0ca0 con 0x7f4a180cf240 2023-10-06T02:57:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.903+0000 7f4a1d317700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a180b00d0 con 0x7f4a1815a2a0 2023-10-06T02:57:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.903+0000 7f4a1d317700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1806ea90 con 0x7f4a1806dd60 2023-10-06T02:57:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.903+0000 7f4a167fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4a180cf240 0x7f4a1806d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34028/0 (socket says 172.21.15.81:34028) 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.903+0000 7f4a167fc700 1 -- 172.21.15.81:0/3454039036 learned_addr learned my addr 172.21.15.81:0/3454039036 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a177fe700 1 --2- 172.21.15.81:0/3454039036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a1806dd60 0x7f4a180b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a15ffb700 1 -- 172.21.15.81:0/3454039036 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916687448 0 0) 0x7f4a180b0ca0 con 0x7f4a180cf240 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a15ffb700 1 -- 172.21.15.81:0/3454039036 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a00003570 con 0x7f4a180cf240 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a15ffb700 1 -- 172.21.15.81:0/3454039036 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051085144 0 0) 0x7f4a180b00d0 con 0x7f4a1815a2a0 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a15ffb700 1 -- 172.21.15.81:0/3454039036 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a180b0ca0 con 0x7f4a1815a2a0 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a15ffb700 1 -- 172.21.15.81:0/3454039036 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690992905 0 0) 0x7f4a00003570 con 0x7f4a180cf240 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a177fe700 1 -- 172.21.15.81:0/3454039036 >> v1:172.21.15.83:6789/0 conn(0x7f4a1815a2a0 legacy=0x7f4a180ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a177fe700 1 -- 172.21.15.81:0/3454039036 >> v1:172.21.15.81:6789/0 conn(0x7f4a180cf240 legacy=0x7f4a1806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a177fe700 1 -- 172.21.15.81:0/3454039036 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a180b0370 con 0x7f4a1806dd60 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a177fe700 1 --2- 172.21.15.81:0/3454039036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a1806dd60 0x7f4a180b1130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009910 tx=0x7f4a100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da390f8a47760f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a15ffb700 1 -- 172.21.15.81:0/3454039036 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c001470 con 0x7f4a1806dd60 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a15ffb700 1 -- 172.21.15.81:0/3454039036 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10011420 con 0x7f4a1806dd60 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.904+0000 7f4a15ffb700 1 -- 172.21.15.81:0/3454039036 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100117c0 con 0x7f4a1806dd60 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.905+0000 7f4a1d317700 1 -- 172.21.15.81:0/3454039036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a1806dd60 msgr2=0x7f4a180b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.905+0000 7f4a1d317700 1 --2- 172.21.15.81:0/3454039036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a1806dd60 0x7f4a180b1130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009910 tx=0x7f4a100091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.905+0000 7f4a1d317700 1 -- 172.21.15.81:0/3454039036 shutdown_connections 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.905+0000 7f4a1d317700 1 --2- 172.21.15.81:0/3454039036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a1806dd60 0x7f4a180b1130 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.905+0000 7f4a1d317700 1 -- 172.21.15.81:0/3454039036 >> 172.21.15.81:0/3454039036 conn(0x7f4a18067640 msgr2=0x7f4a18067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.905+0000 7f4a1d317700 1 -- 172.21.15.81:0/3454039036 shutdown_connections 2023-10-06T02:57:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.905+0000 7f4a1d317700 1 -- 172.21.15.81:0/3454039036 wait complete. 2023-10-06T02:57:20.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.906+0000 7f4a1d317700 1 Processor -- start 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.906+0000 7f4a1d317700 1 -- start start 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a1d317700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a1806dd60 0x7f4a18154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a1d317700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a180cf240 0x7f4a180c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a1d317700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1815a2a0 0x7f4a1815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a1d317700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1815e190 con 0x7f4a1815a2a0 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a1d317700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a180b29e0 con 0x7f4a1806dd60 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a1d317700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a180b20f0 con 0x7f4a180cf240 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1815a2a0 0x7f4a1815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1815a2a0 0x7f4a1815ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37736/0 (socket says 172.21.15.81:37736) 2023-10-06T02:57:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a177fe700 1 -- 172.21.15.81:0/2394334211 learned_addr learned my addr 172.21.15.81:0/2394334211 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a167fc700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a180cf240 0x7f4a180c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a16ffd700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a1806dd60 0x7f4a18154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a177fe700 1 -- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a180cf240 msgr2=0x7f4a180c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a177fe700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a180cf240 0x7f4a180c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a177fe700 1 -- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a1806dd60 msgr2=0x7f4a18154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a177fe700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a1806dd60 0x7f4a18154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a177fe700 1 -- 172.21.15.81:0/2394334211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10009420 con 0x7f4a1815a2a0 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.907+0000 7f4a177fe700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1815a2a0 0x7f4a1815ea80 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f4a100030c0 tx=0x7f4a10016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.908+0000 7f49feffd700 1 -- 172.21.15.81:0/2394334211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1001cc50 con 0x7f4a1815a2a0 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.908+0000 7f49feffd700 1 -- 172.21.15.81:0/2394334211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1001cdd0 con 0x7f4a1815a2a0 2023-10-06T02:57:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.908+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a180b2390 con 0x7f4a1815a2a0 2023-10-06T02:57:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.908+0000 7f49feffd700 1 -- 172.21.15.81:0/2394334211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1001a6a0 con 0x7f4a1815a2a0 2023-10-06T02:57:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.908+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a181554d0 con 0x7f4a1815a2a0 2023-10-06T02:57:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.909+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a180b2b70 con 0x7f4a1815a2a0 2023-10-06T02:57:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.909+0000 7f49feffd700 1 -- 172.21.15.81:0/2394334211 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a1001aa90 con 0x7f4a1815a2a0 2023-10-06T02:57:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.910+0000 7f49feffd700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a04066f30 0x7f4a040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.910+0000 7f49feffd700 1 -- 172.21.15.81:0/2394334211 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a100865a0 con 0x7f4a1815a2a0 2023-10-06T02:57:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.910+0000 7f4a16ffd700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a04066f30 0x7f4a040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.910+0000 7f4a16ffd700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a04066f30 0x7f4a040693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4a080040a0 tx=0x7f4a08007f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:20.914+0000 7f49feffd700 1 -- 172.21.15.81:0/2394334211 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a10053610 con 0x7f4a1815a2a0 2023-10-06T02:57:21.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.137+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4a1804bb80 con 0x7f4a1815a2a0 2023-10-06T02:57:21.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.775+0000 7f49feffd700 1 -- 172.21.15.81:0/2394334211 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v90) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4a10056c30 con 0x7f4a1815a2a0 2023-10-06T02:57:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a04066f30 msgr2=0x7f4a040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a04066f30 0x7f4a040693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4a080040a0 tx=0x7f4a08007f90 comp rx=0 tx=0).stop 2023-10-06T02:57:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1815a2a0 msgr2=0x7f4a1815ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1815a2a0 0x7f4a1815ea80 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f4a100030c0 tx=0x7f4a10016000 comp rx=0 tx=0).stop 2023-10-06T02:57:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 shutdown_connections 2023-10-06T02:57:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1815a2a0 0x7f4a1815ea80 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4a04066f30 0x7f4a040693e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a1806dd60 0x7f4a18154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 --2- 172.21.15.81:0/2394334211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4a180cf240 0x7f4a180c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.777+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 >> 172.21.15.81:0/2394334211 conn(0x7f4a18067640 msgr2=0x7f4a18156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:21.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.778+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 shutdown_connections 2023-10-06T02:57:21.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.778+0000 7f4a1d317700 1 -- 172.21.15.81:0/2394334211 wait complete. 2023-10-06T02:57:21.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:21.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.906+0000 7ff4bf59e700 1 Processor -- start 2023-10-06T02:57:21.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.906+0000 7ff4bf59e700 1 -- start start 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bf59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff4c0159b40 0x7ff4c00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bf59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4c0159f10 0x7ff4c0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bf59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4c00ccb40 0x7ff4c0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bf59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c00cee10 con 0x7ff4c0159f10 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bf59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c00cd040 con 0x7ff4c0159b40 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bf59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00cd320 con 0x7ff4c00ccb40 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bdd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4c0159f10 0x7ff4c0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bdd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4c0159f10 0x7ff4c0068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37746/0 (socket says 172.21.15.81:37746) 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bdd9b700 1 -- 172.21.15.81:0/4056578505 learned_addr learned my addr 172.21.15.81:0/4056578505 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bdd9b700 1 -- 172.21.15.81:0/4056578505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4c00ccb40 msgr2=0x7ff4c0068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bdd9b700 1 --2- 172.21.15.81:0/4056578505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4c00ccb40 0x7ff4c0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bdd9b700 1 -- 172.21.15.81:0/4056578505 >> v2:172.21.15.83:3300/0 conn(0x7ff4c0159b40 msgr2=0x7ff4c00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4be59c700 1 --2- 172.21.15.81:0/4056578505 >> v2:172.21.15.83:3300/0 conn(0x7ff4c0159b40 0x7ff4c00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bdd9b700 1 --2- 172.21.15.81:0/4056578505 >> v2:172.21.15.83:3300/0 conn(0x7ff4c0159b40 0x7ff4c00cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.907+0000 7ff4bdd9b700 1 -- 172.21.15.81:0/4056578505 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00ce7c0 con 0x7ff4c0159f10 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bdd9b700 1 --2- 172.21.15.81:0/4056578505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c0159f10 0x7ff4c0068780 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00d0bc0 tx=0x7ff4b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be677f11fffaefe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bd59a700 1 -- 172.21.15.81:0/4056578505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400b860 con 0x7ff4c0159f10 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bd59a700 1 -- 172.21.15.81:0/4056578505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b400b9c0 con 0x7ff4c0159f10 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bd59a700 1 -- 172.21.15.81:0/4056578505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400bd60 con 0x7ff4c0159f10 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4056578505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c0159f10 msgr2=0x7ff4c0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4056578505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c0159f10 0x7ff4c0068780 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00d0bc0 tx=0x7ff4b4009250 comp rx=0 tx=0).stop 2023-10-06T02:57:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4056578505 shutdown_connections 2023-10-06T02:57:21.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4056578505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4c00ccb40 0x7ff4c0068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4056578505 >> v2:172.21.15.83:3300/0 conn(0x7ff4c0159b40 0x7ff4c00cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4056578505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c0159f10 0x7ff4c0068780 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4056578505 >> 172.21.15.81:0/4056578505 conn(0x7ff4c00cd660 msgr2=0x7ff4c00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:21.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4056578505 shutdown_connections 2023-10-06T02:57:21.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.908+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4056578505 wait complete. 2023-10-06T02:57:21.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.909+0000 7ff4bf59e700 1 Processor -- start 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.909+0000 7ff4bf59e700 1 -- start start 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4bf59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c00ccb40 0x7ff4c0156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4bf59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4c0159b40 0x7ff4c0157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4bf59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4c0159f10 0x7ff4c0158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4bf59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c015a6b0 con 0x7ff4c00ccb40 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4bf59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c01568d0 con 0x7ff4c0159f10 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4bf59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0156b50 con 0x7ff4c0159b40 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c00ccb40 0x7ff4c0156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c00ccb40 0x7ff4c0156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37760/0 (socket says 172.21.15.81:37760) 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4be59c700 1 -- 172.21.15.81:0/4178769907 learned_addr learned my addr 172.21.15.81:0/4178769907 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4bdd9b700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4c0159b40 0x7ff4c0157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.910+0000 7ff4bed9d700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4c0159f10 0x7ff4c0158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4be59c700 1 -- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4c0159b40 msgr2=0x7ff4c0157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4be59c700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4c0159b40 0x7ff4c0157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4be59c700 1 -- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4c0159f10 msgr2=0x7ff4c0158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4be59c700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4c0159f10 0x7ff4c0158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4be59c700 1 -- 172.21.15.81:0/4178769907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40094f0 con 0x7ff4c00ccb40 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4be59c700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c00ccb40 0x7ff4c0156390 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000cfc0 tx=0x7ff4b00078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4ae7fc700 1 -- 172.21.15.81:0/4178769907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b000ae40 con 0x7ff4c00ccb40 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4ae7fc700 1 -- 172.21.15.81:0/4178769907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b0016430 con 0x7ff4c00ccb40 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c0156e30 con 0x7ff4c00ccb40 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4ae7fc700 1 -- 172.21.15.81:0/4178769907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00167d0 con 0x7ff4c00ccb40 2023-10-06T02:57:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.911+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c01571c0 con 0x7ff4c00ccb40 2023-10-06T02:57:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.912+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c00cb890 con 0x7ff4c00ccb40 2023-10-06T02:57:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.912+0000 7ff4ae7fc700 1 -- 172.21.15.81:0/4178769907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4b0003020 con 0x7ff4c00ccb40 2023-10-06T02:57:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.913+0000 7ff4ae7fc700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff4a0066f30 0x7ff4a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.913+0000 7ff4ae7fc700 1 -- 172.21.15.81:0/4178769907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff4b0012070 con 0x7ff4c00ccb40 2023-10-06T02:57:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.913+0000 7ff4bdd9b700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff4a0066f30 0x7ff4a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.913+0000 7ff4bdd9b700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff4a0066f30 0x7ff4a00693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00d0bc0 tx=0x7ff4b4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:21.917+0000 7ff4ae7fc700 1 -- 172.21.15.81:0/4178769907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4b0052680 con 0x7ff4c00ccb40 2023-10-06T02:57:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.138+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4c00ceb30 con 0x7ff4c00ccb40 2023-10-06T02:57:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.139+0000 7ff4ae7fc700 1 -- 172.21.15.81:0/4178769907 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4598 (secure 0 0 0) 0x7ff4b0055ca0 con 0x7ff4c00ccb40 2023-10-06T02:57:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:22.140 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:18.128298+0000","modified":"2023-10-06T02:57:21.769179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8358":{"gid":8358,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/604648999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":604648999},{"type":"v1","addr":"172.21.15.81:6835","nonce":604648999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T02:57:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff4a0066f30 msgr2=0x7ff4a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff4a0066f30 0x7ff4a00693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00d0bc0 tx=0x7ff4b4017000 comp rx=0 tx=0).stop 2023-10-06T02:57:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c00ccb40 msgr2=0x7ff4c0156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c00ccb40 0x7ff4c0156390 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000cfc0 tx=0x7ff4b00078b0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 shutdown_connections 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff4a0066f30 0x7ff4a00693e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4c0159f10 0x7ff4c0158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4c00ccb40 0x7ff4c0156390 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 --2- 172.21.15.81:0/4178769907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff4c0159b40 0x7ff4c0157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 >> 172.21.15.81:0/4178769907 conn(0x7ff4c00cd660 msgr2=0x7ff4c00cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 shutdown_connections 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.141+0000 7ff4bf59e700 1 -- 172.21.15.81:0/4178769907 wait complete. 2023-10-06T02:57:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-06T02:57:22.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:22.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.267+0000 7f1eab73a700 1 Processor -- start 2023-10-06T02:57:22.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.267+0000 7f1eab73a700 1 -- start start 2023-10-06T02:57:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.268+0000 7f1eab73a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ea4157ca0 0x7f1ea40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.268+0000 7f1eab73a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea40d07c0 con 0x7f1ea41578d0 2023-10-06T02:57:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.268+0000 7f1eab73a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea40cfbb0 con 0x7f1ea406d120 2023-10-06T02:57:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.268+0000 7f1eab73a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea40cfe90 con 0x7f1ea4157ca0 2023-10-06T02:57:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.268+0000 7f1ea94d6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1ea41578d0 0x7f1ea415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34038/0 (socket says 172.21.15.81:34038) 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.268+0000 7f1ea94d6700 1 -- 172.21.15.81:0/3042224327 learned_addr learned my addr 172.21.15.81:0/3042224327 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea8cd5700 1 --2- 172.21.15.81:0/3042224327 >> v2:172.21.15.83:3300/0 conn(0x7f1ea4157ca0 0x7f1ea40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169734167 0 0) 0x7f1ea40d07c0 con 0x7f1ea41578d0 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e90003570 con 0x7f1ea41578d0 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350070179 0 0) 0x7f1e90003570 con 0x7f1ea41578d0 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 >> v2:172.21.15.83:3300/0 conn(0x7f1ea4157ca0 msgr2=0x7f1ea40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 --2- 172.21.15.81:0/3042224327 >> v2:172.21.15.83:3300/0 conn(0x7f1ea4157ca0 0x7f1ea40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 >> v1:172.21.15.83:6789/0 conn(0x7f1ea406d120 legacy=0x7f1ea406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40d0170 con 0x7f1ea41578d0 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f1ea00017f0 con 0x7f1ea41578d0 2023-10-06T02:57:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 >> v1:172.21.15.81:6789/0 conn(0x7f1ea41578d0 legacy=0x7f1ea415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90003a60 0x7f1e90003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90004810 0x7f1e90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e900051c0 0x7f1e9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40cfe90 con 0x7f1e90003a60 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9000c050 con 0x7f1e90004810 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9000c210 con 0x7f1e900051c0 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea94d6700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90003a60 0x7f1e90003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea8cd5700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90004810 0x7f1e90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea9cd7700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e900051c0 0x7f1e9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea94d6700 1 -- 172.21.15.81:0/3042224327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e900051c0 msgr2=0x7f1e9000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea94d6700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e900051c0 0x7f1e9000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea94d6700 1 -- 172.21.15.81:0/3042224327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90004810 msgr2=0x7f1e90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea94d6700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90004810 0x7f1e90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea94d6700 1 -- 172.21.15.81:0/3042224327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90003570 con 0x7f1e90003a60 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.269+0000 7f1ea9cd7700 1 -- 172.21.15.81:0/3042224327 reap_dead start 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1ea94d6700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90003a60 0x7f1e90003e30 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000a950 tx=0x7f1ea00021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c60801cf5753453 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00070d0 con 0x7f1e90003a60 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea0007250 con 0x7f1e90003a60 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1e9bfff700 1 -- 172.21.15.81:0/3042224327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0007610 con 0x7f1e90003a60 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1eab73a700 1 -- 172.21.15.81:0/3042224327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90003a60 msgr2=0x7f1e90003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1eab73a700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90003a60 0x7f1e90003e30 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000a950 tx=0x7f1ea00021f0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1eab73a700 1 -- 172.21.15.81:0/3042224327 shutdown_connections 2023-10-06T02:57:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1eab73a700 1 --2- 172.21.15.81:0/3042224327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e90003a60 0x7f1e90003e30 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1eab73a700 1 -- 172.21.15.81:0/3042224327 >> 172.21.15.81:0/3042224327 conn(0x7f1ea406bb90 msgr2=0x7f1ea406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:22.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1eab73a700 1 -- 172.21.15.81:0/3042224327 shutdown_connections 2023-10-06T02:57:22.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.270+0000 7f1eab73a700 1 -- 172.21.15.81:0/3042224327 wait complete. 2023-10-06T02:57:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.271+0000 7f1eab73a700 1 Processor -- start 2023-10-06T02:57:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.271+0000 7f1eab73a700 1 -- start start 2023-10-06T02:57:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1eab73a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90003a60 0x7f1ea4153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1eab73a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ea4169e50 0x7f1ea40b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1eab73a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ea40b6690 0x7f1ea40c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1eab73a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40b6af0 con 0x7f1ea4169e50 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1eab73a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40b4290 con 0x7f1e90003a60 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1eab73a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4153a60 con 0x7f1ea40b6690 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1ea8cd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ea4169e50 0x7f1ea40b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1ea8cd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ea4169e50 0x7f1ea40b6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37784/0 (socket says 172.21.15.81:37784) 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1ea8cd5700 1 -- 172.21.15.81:0/984241783 learned_addr learned my addr 172.21.15.81:0/984241783 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1ea94d6700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90003a60 0x7f1ea4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.272+0000 7f1ea9cd7700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ea40b6690 0x7f1ea40c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1ea8cd5700 1 -- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ea40b6690 msgr2=0x7f1ea40c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1ea8cd5700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ea40b6690 0x7f1ea40c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1ea8cd5700 1 -- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90003a60 msgr2=0x7f1ea4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1ea8cd5700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90003a60 0x7f1ea4153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1ea8cd5700 1 -- 172.21.15.81:0/984241783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40c68e0 con 0x7f1ea4169e50 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1ea8cd5700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ea4169e50 0x7f1ea40b6150 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f1e94011b40 tx=0x7f1e940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1e997fa700 1 -- 172.21.15.81:0/984241783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9400f940 con 0x7f1ea4169e50 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1e997fa700 1 -- 172.21.15.81:0/984241783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9400faa0 con 0x7f1ea4169e50 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1e997fa700 1 -- 172.21.15.81:0/984241783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9400fe20 con 0x7f1ea4169e50 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea40b3c40 con 0x7f1ea4169e50 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.273+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea40c6bc0 con 0x7f1ea4169e50 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.274+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea40b4420 con 0x7f1ea4169e50 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.274+0000 7f1e997fa700 1 -- 172.21.15.81:0/984241783 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e94014650 con 0x7f1ea4169e50 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.275+0000 7f1e997fa700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e88066f30 0x7f1e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.275+0000 7f1e997fa700 1 -- 172.21.15.81:0/984241783 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1e94018030 con 0x7f1ea4169e50 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.275+0000 7f1ea94d6700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e88066f30 0x7f1e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.275+0000 7f1ea94d6700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e88066f30 0x7f1e880693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0002250 tx=0x7f1ea0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.279+0000 7f1e997fa700 1 -- 172.21.15.81:0/984241783 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e940520d0 con 0x7f1ea4169e50 2023-10-06T02:57:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.463+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ea40d0450 con 0x7f1ea4169e50 2023-10-06T02:57:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.464+0000 7f1e997fa700 1 -- 172.21.15.81:0/984241783 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+16834 (secure 0 0 0) 0x7f1e94022090 con 0x7f1ea4169e50 2023-10-06T02:57:22.465 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:22.466 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":180,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:57:19.749995+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:15.791318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:17.104149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e88066f30 msgr2=0x7f1e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e88066f30 0x7f1e880693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0002250 tx=0x7f1ea0015000 comp rx=0 tx=0).stop 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ea4169e50 msgr2=0x7f1ea40b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ea4169e50 0x7f1ea40b6150 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f1e94011b40 tx=0x7f1e940091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 shutdown_connections 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ea40b6690 0x7f1ea40c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1e88066f30 0x7f1e880693e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e90003a60 0x7f1ea4153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 --2- 172.21.15.81:0/984241783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ea4169e50 0x7f1ea40b6150 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 >> 172.21.15.81:0/984241783 conn(0x7f1ea406bb90 msgr2=0x7f1ea415da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 shutdown_connections 2023-10-06T02:57:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.466+0000 7f1eab73a700 1 -- 172.21.15.81:0/984241783 wait complete. 2023-10-06T02:57:22.480 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:57:22.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:57:22.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.592+0000 7ff1be4c6700 1 Processor -- start 2023-10-06T02:57:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.593+0000 7ff1be4c6700 1 -- start start 2023-10-06T02:57:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.593+0000 7ff1be4c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b815a2a0 0x7ff1b80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.593+0000 7ff1be4c6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1b80ceb30 0x7ff1b80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.593+0000 7ff1be4c6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b80cf4e0 con 0x7ff1b806d650 2023-10-06T02:57:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.593+0000 7ff1be4c6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b806ea90 con 0x7ff1b80ceb30 2023-10-06T02:57:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.593+0000 7ff1be4c6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80b0ca0 con 0x7ff1b815a2a0 2023-10-06T02:57:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1b80ceb30 0x7ff1b80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1b80ceb30 0x7ff1b80cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37788/0 (socket says 172.21.15.81:37788) 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b77fe700 1 -- 172.21.15.81:0/20983536 learned_addr learned my addr 172.21.15.81:0/20983536 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b7fff700 1 --2- 172.21.15.81:0/20983536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b815a2a0 0x7ff1b80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b77fe700 1 -- 172.21.15.81:0/20983536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b815a2a0 msgr2=0x7ff1b80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b77fe700 1 --2- 172.21.15.81:0/20983536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b815a2a0 0x7ff1b80b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b77fe700 1 -- 172.21.15.81:0/20983536 >> v1:172.21.15.83:6789/0 conn(0x7ff1b806d650 legacy=0x7ff1b806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b77fe700 1 -- 172.21.15.81:0/20983536 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80b00d0 con 0x7ff1b80ceb30 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b7fff700 1 --2- 172.21.15.81:0/20983536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b815a2a0 0x7ff1b80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b77fe700 1 --2- 172.21.15.81:0/20983536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b80ceb30 0x7ff1b80cefa0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0099b0 tx=0x7ff1ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921e05e799b58cd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b6ffd700 1 -- 172.21.15.81:0/20983536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00b820 con 0x7ff1b80ceb30 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b6ffd700 1 -- 172.21.15.81:0/20983536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac00b980 con 0x7ff1b80ceb30 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.594+0000 7ff1b6ffd700 1 -- 172.21.15.81:0/20983536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00bd20 con 0x7ff1b80ceb30 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.595+0000 7ff1be4c6700 1 -- 172.21.15.81:0/20983536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b80ceb30 msgr2=0x7ff1b80cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.595+0000 7ff1be4c6700 1 --2- 172.21.15.81:0/20983536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b80ceb30 0x7ff1b80cefa0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0099b0 tx=0x7ff1ac009250 comp rx=0 tx=0).stop 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.595+0000 7ff1be4c6700 1 -- 172.21.15.81:0/20983536 shutdown_connections 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.595+0000 7ff1be4c6700 1 --2- 172.21.15.81:0/20983536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b815a2a0 0x7ff1b80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.595+0000 7ff1be4c6700 1 --2- 172.21.15.81:0/20983536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b80ceb30 0x7ff1b80cefa0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.595+0000 7ff1be4c6700 1 -- 172.21.15.81:0/20983536 >> 172.21.15.81:0/20983536 conn(0x7ff1b8067640 msgr2=0x7ff1b8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.595+0000 7ff1be4c6700 1 -- 172.21.15.81:0/20983536 shutdown_connections 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.595+0000 7ff1be4c6700 1 -- 172.21.15.81:0/20983536 wait complete. 2023-10-06T02:57:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.596+0000 7ff1be4c6700 1 Processor -- start 2023-10-06T02:57:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.596+0000 7ff1be4c6700 1 -- start start 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1be4c6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1b806d650 0x7ff1b80c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1be4c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b80ceb30 0x7ff1b815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1be4c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b815a2a0 0x7ff1b815f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1be4c6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b815e1b0 con 0x7ff1b815a2a0 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1be4c6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b816b900 con 0x7ff1b806d650 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1be4c6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80c8290 con 0x7ff1b80ceb30 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1bca63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b815a2a0 0x7ff1b815f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1bca63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b815a2a0 0x7ff1b815f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37792/0 (socket says 172.21.15.81:37792) 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1bca63700 1 -- 172.21.15.81:0/2530136092 learned_addr learned my addr 172.21.15.81:0/2530136092 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1b7fff700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1b806d650 0x7ff1b80c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1b77fe700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b80ceb30 0x7ff1b815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1bca63700 1 -- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b80ceb30 msgr2=0x7ff1b815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1bca63700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b80ceb30 0x7ff1b815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1bca63700 1 -- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1b806d650 msgr2=0x7ff1b80c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1bca63700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1b806d650 0x7ff1b80c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1bca63700 1 -- 172.21.15.81:0/2530136092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0094f0 con 0x7ff1b815a2a0 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1bca63700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b815a2a0 0x7ff1b815f170 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000c930 tx=0x7ff1b00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff19ffff700 1 -- 172.21.15.81:0/2530136092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b000ce70 con 0x7ff1b815a2a0 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff19ffff700 1 -- 172.21.15.81:0/2530136092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b000a7e0 con 0x7ff1b815a2a0 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff19ffff700 1 -- 172.21.15.81:0/2530136092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b000aba0 con 0x7ff1b815a2a0 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b815ded0 con 0x7ff1b815a2a0 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.597+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b80c8a10 con 0x7ff1b815a2a0 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.598+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b815e2f0 con 0x7ff1b815a2a0 2023-10-06T02:57:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.599+0000 7ff19ffff700 1 -- 172.21.15.81:0/2530136092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1b0012420 con 0x7ff1b815a2a0 2023-10-06T02:57:22.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.599+0000 7ff19ffff700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1a4066f30 0x7ff1a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.599+0000 7ff19ffff700 1 -- 172.21.15.81:0/2530136092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff1b0084ad0 con 0x7ff1b815a2a0 2023-10-06T02:57:22.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.599+0000 7ff1b7fff700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1a4066f30 0x7ff1a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.600+0000 7ff1b7fff700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1a4066f30 0x7ff1a40693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8006fd0 tx=0x7ff1a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.603+0000 7ff19ffff700 1 -- 172.21.15.81:0/2530136092 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1b0051c90 con 0x7ff1b815a2a0 2023-10-06T02:57:22.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.782+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1b815ee90 con 0x7ff1a4066f30 2023-10-06T02:57:22.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.791+0000 7ff19ffff700 1 -- 172.21.15.81:0/2530136092 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305934 (secure 0 0 0) 0x7ff1b815ee90 con 0x7ff1a4066f30 2023-10-06T02:57:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1a4066f30 msgr2=0x7ff1a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1a4066f30 0x7ff1a40693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8006fd0 tx=0x7ff1a8008040 comp rx=0 tx=0).stop 2023-10-06T02:57:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b815a2a0 msgr2=0x7ff1b815f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b815a2a0 0x7ff1b815f170 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000c930 tx=0x7ff1b00026e0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 shutdown_connections 2023-10-06T02:57:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b815a2a0 0x7ff1b815f170 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff1a4066f30 0x7ff1a40693e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1b806d650 0x7ff1b80c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 --2- 172.21.15.81:0/2530136092 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1b80ceb30 0x7ff1b815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.794+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 >> 172.21.15.81:0/2530136092 conn(0x7ff1b8067640 msgr2=0x7ff1b80ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.795+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 shutdown_connections 2023-10-06T02:57:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.795+0000 7ff1be4c6700 1 -- 172.21.15.81:0/2530136092 wait complete. 2023-10-06T02:57:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:57:22.807 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":513,"stamp":"2023-10-06T02:57:21.655463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9488,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553011,"statfs":{"total":1600000000,"available":1590284124,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.908119"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759933+0000","last_change":"2023-10-06T02:57:18.759143+0000","last_active":"2023-10-06T02:57:18.759933+0000","last_peered":"2023-10-06T02:57:18.759933+0000","last_clean":"2023-10-06T02:57:18.759933+0000","last_became_active":"2023-10-06T02:57:18.758919+0000","last_became_peered":"2023-10-06T02:57:18.758919+0000","last_unstale":"2023-10-06T02:57:18.759933+0000","last_undegraded":"2023-10-06T02:57:18.759933+0000","last_fullsized":"2023-10-06T02:57:18.759933+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:24.099397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.766651+0000","last_change":"2023-10-06T02:57:18.766584+0000","last_active":"2023-10-06T02:57:18.766651+0000","last_peered":"2023-10-06T02:57:18.766651+0000","last_clean":"2023-10-06T02:57:18.766651+0000","last_became_active":"2023-10-06T02:57:18.765303+0000","last_became_peered":"2023-10-06T02:57:18.765303+0000","last_unstale":"2023-10-06T02:57:18.766651+0000","last_undegraded":"2023-10-06T02:57:18.766651+0000","last_fullsized":"2023-10-06T02:57:18.766651+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:00.923784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.756684+0000","last_change":"2023-10-06T02:57:18.756609+0000","last_active":"2023-10-06T02:57:18.756684+0000","last_peered":"2023-10-06T02:57:18.756684+0000","last_clean":"2023-10-06T02:57:18.756684+0000","last_became_active":"2023-10-06T02:57:18.756366+0000","last_became_peered":"2023-10-06T02:57:18.756366+0000","last_unstale":"2023-10-06T02:57:18.756684+0000","last_undegraded":"2023-10-06T02:57:18.756684+0000","last_fullsized":"2023-10-06T02:57:18.756684+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:02.556384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769505+0000","last_change":"2023-10-06T02:57:18.769335+0000","last_active":"2023-10-06T02:57:18.769505+0000","last_peered":"2023-10-06T02:57:18.769505+0000","last_clean":"2023-10-06T02:57:18.769505+0000","last_became_active":"2023-10-06T02:57:18.768706+0000","last_became_peered":"2023-10-06T02:57:18.768706+0000","last_unstale":"2023-10-06T02:57:18.769505+0000","last_undegraded":"2023-10-06T02:57:18.769505+0000","last_fullsized":"2023-10-06T02:57:18.769505+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:45.086490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760462+0000","last_change":"2023-10-06T02:57:18.757101+0000","last_active":"2023-10-06T02:57:18.760462+0000","last_peered":"2023-10-06T02:57:18.760462+0000","last_clean":"2023-10-06T02:57:18.760462+0000","last_became_active":"2023-10-06T02:57:18.756818+0000","last_became_peered":"2023-10-06T02:57:18.756818+0000","last_unstale":"2023-10-06T02:57:18.760462+0000","last_undegraded":"2023-10-06T02:57:18.760462+0000","last_fullsized":"2023-10-06T02:57:18.760462+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:56.693494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764522+0000","last_change":"2023-10-06T02:57:18.764290+0000","last_active":"2023-10-06T02:57:18.764522+0000","last_peered":"2023-10-06T02:57:18.764522+0000","last_clean":"2023-10-06T02:57:18.764522+0000","last_became_active":"2023-10-06T02:57:18.764111+0000","last_became_peered":"2023-10-06T02:57:18.764111+0000","last_unstale":"2023-10-06T02:57:18.764522+0000","last_undegraded":"2023-10-06T02:57:18.764522+0000","last_fullsized":"2023-10-06T02:57:18.764522+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:37.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760633+0000","last_change":"2023-10-06T02:57:18.759421+0000","last_active":"2023-10-06T02:57:18.760633+0000","last_peered":"2023-10-06T02:57:18.760633+0000","last_clean":"2023-10-06T02:57:18.760633+0000","last_became_active":"2023-10-06T02:57:18.759164+0000","last_became_peered":"2023-10-06T02:57:18.759164+0000","last_unstale":"2023-10-06T02:57:18.760633+0000","last_undegraded":"2023-10-06T02:57:18.760633+0000","last_fullsized":"2023-10-06T02:57:18.760633+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:37.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758614+0000","last_change":"2023-10-06T02:57:18.758410+0000","last_active":"2023-10-06T02:57:18.758614+0000","last_peered":"2023-10-06T02:57:18.758614+0000","last_clean":"2023-10-06T02:57:18.758614+0000","last_became_active":"2023-10-06T02:57:18.757622+0000","last_became_peered":"2023-10-06T02:57:18.757622+0000","last_unstale":"2023-10-06T02:57:18.758614+0000","last_undegraded":"2023-10-06T02:57:18.758614+0000","last_fullsized":"2023-10-06T02:57:18.758614+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:40.607909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765865+0000","last_change":"2023-10-06T02:57:18.765790+0000","last_active":"2023-10-06T02:57:18.765865+0000","last_peered":"2023-10-06T02:57:18.765865+0000","last_clean":"2023-10-06T02:57:18.765865+0000","last_became_active":"2023-10-06T02:57:18.765053+0000","last_became_peered":"2023-10-06T02:57:18.765053+0000","last_unstale":"2023-10-06T02:57:18.765865+0000","last_undegraded":"2023-10-06T02:57:18.765865+0000","last_fullsized":"2023-10-06T02:57:18.765865+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:12.817133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757114+0000","last_change":"2023-10-06T02:57:18.757024+0000","last_active":"2023-10-06T02:57:18.757114+0000","last_peered":"2023-10-06T02:57:18.757114+0000","last_clean":"2023-10-06T02:57:18.757114+0000","last_became_active":"2023-10-06T02:57:18.756803+0000","last_became_peered":"2023-10-06T02:57:18.756803+0000","last_unstale":"2023-10-06T02:57:18.757114+0000","last_undegraded":"2023-10-06T02:57:18.757114+0000","last_fullsized":"2023-10-06T02:57:18.757114+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:47.388963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765757+0000","last_change":"2023-10-06T02:57:18.765698+0000","last_active":"2023-10-06T02:57:18.765757+0000","last_peered":"2023-10-06T02:57:18.765757+0000","last_clean":"2023-10-06T02:57:18.765757+0000","last_became_active":"2023-10-06T02:57:18.765299+0000","last_became_peered":"2023-10-06T02:57:18.765299+0000","last_unstale":"2023-10-06T02:57:18.765757+0000","last_undegraded":"2023-10-06T02:57:18.765757+0000","last_fullsized":"2023-10-06T02:57:18.765757+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:25.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.766500+0000","last_change":"2023-10-06T02:57:18.766446+0000","last_active":"2023-10-06T02:57:18.766500+0000","last_peered":"2023-10-06T02:57:18.766500+0000","last_clean":"2023-10-06T02:57:18.766500+0000","last_became_active":"2023-10-06T02:57:18.765011+0000","last_became_peered":"2023-10-06T02:57:18.765011+0000","last_unstale":"2023-10-06T02:57:18.766500+0000","last_undegraded":"2023-10-06T02:57:18.766500+0000","last_fullsized":"2023-10-06T02:57:18.766500+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:47.388963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767917+0000","last_change":"2023-10-06T02:57:18.766707+0000","last_active":"2023-10-06T02:57:18.767917+0000","last_peered":"2023-10-06T02:57:18.767917+0000","last_clean":"2023-10-06T02:57:18.767917+0000","last_became_active":"2023-10-06T02:57:18.766081+0000","last_became_peered":"2023-10-06T02:57:18.766081+0000","last_unstale":"2023-10-06T02:57:18.767917+0000","last_undegraded":"2023-10-06T02:57:18.767917+0000","last_fullsized":"2023-10-06T02:57:18.767917+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:23.913028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764703+0000","last_change":"2023-10-06T02:57:18.764652+0000","last_active":"2023-10-06T02:57:18.764703+0000","last_peered":"2023-10-06T02:57:18.764703+0000","last_clean":"2023-10-06T02:57:18.764703+0000","last_became_active":"2023-10-06T02:57:18.763952+0000","last_became_peered":"2023-10-06T02:57:18.763952+0000","last_unstale":"2023-10-06T02:57:18.764703+0000","last_undegraded":"2023-10-06T02:57:18.764703+0000","last_fullsized":"2023-10-06T02:57:18.764703+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:47.714847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770783+0000","last_change":"2023-10-06T02:57:18.770703+0000","last_active":"2023-10-06T02:57:18.770783+0000","last_peered":"2023-10-06T02:57:18.770783+0000","last_clean":"2023-10-06T02:57:18.770783+0000","last_became_active":"2023-10-06T02:57:18.770443+0000","last_became_peered":"2023-10-06T02:57:18.770443+0000","last_unstale":"2023-10-06T02:57:18.770783+0000","last_undegraded":"2023-10-06T02:57:18.770783+0000","last_fullsized":"2023-10-06T02:57:18.770783+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:02.556384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770881+0000","last_change":"2023-10-06T02:57:18.770746+0000","last_active":"2023-10-06T02:57:18.770881+0000","last_peered":"2023-10-06T02:57:18.770881+0000","last_clean":"2023-10-06T02:57:18.770881+0000","last_became_active":"2023-10-06T02:57:18.769695+0000","last_became_peered":"2023-10-06T02:57:18.769695+0000","last_unstale":"2023-10-06T02:57:18.770881+0000","last_undegraded":"2023-10-06T02:57:18.770881+0000","last_fullsized":"2023-10-06T02:57:18.770881+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:43.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762585+0000","last_change":"2023-10-06T02:57:18.762116+0000","last_active":"2023-10-06T02:57:18.762585+0000","last_peered":"2023-10-06T02:57:18.762585+0000","last_clean":"2023-10-06T02:57:18.762585+0000","last_became_active":"2023-10-06T02:57:18.761886+0000","last_became_peered":"2023-10-06T02:57:18.761886+0000","last_unstale":"2023-10-06T02:57:18.762585+0000","last_undegraded":"2023-10-06T02:57:18.762585+0000","last_fullsized":"2023-10-06T02:57:18.762585+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:39.969919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762643+0000","last_change":"2023-10-06T02:57:18.762565+0000","last_active":"2023-10-06T02:57:18.762643+0000","last_peered":"2023-10-06T02:57:18.762643+0000","last_clean":"2023-10-06T02:57:18.762643+0000","last_became_active":"2023-10-06T02:57:18.762244+0000","last_became_peered":"2023-10-06T02:57:18.762244+0000","last_unstale":"2023-10-06T02:57:18.762643+0000","last_undegraded":"2023-10-06T02:57:18.762643+0000","last_fullsized":"2023-10-06T02:57:18.762643+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:50.544518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767347+0000","last_change":"2023-10-06T02:57:18.766868+0000","last_active":"2023-10-06T02:57:18.767347+0000","last_peered":"2023-10-06T02:57:18.767347+0000","last_clean":"2023-10-06T02:57:18.767347+0000","last_became_active":"2023-10-06T02:57:18.766650+0000","last_became_peered":"2023-10-06T02:57:18.766650+0000","last_unstale":"2023-10-06T02:57:18.767347+0000","last_undegraded":"2023-10-06T02:57:18.767347+0000","last_fullsized":"2023-10-06T02:57:18.767347+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:49.399422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762659+0000","last_change":"2023-10-06T02:57:18.762115+0000","last_active":"2023-10-06T02:57:18.762659+0000","last_peered":"2023-10-06T02:57:18.762659+0000","last_clean":"2023-10-06T02:57:18.762659+0000","last_became_active":"2023-10-06T02:57:18.761958+0000","last_became_peered":"2023-10-06T02:57:18.761958+0000","last_unstale":"2023-10-06T02:57:18.762659+0000","last_undegraded":"2023-10-06T02:57:18.762659+0000","last_fullsized":"2023-10-06T02:57:18.762659+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:37.103609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765679+0000","last_change":"2023-10-06T02:57:18.765451+0000","last_active":"2023-10-06T02:57:18.765679+0000","last_peered":"2023-10-06T02:57:18.765679+0000","last_clean":"2023-10-06T02:57:18.765679+0000","last_became_active":"2023-10-06T02:57:18.765241+0000","last_became_peered":"2023-10-06T02:57:18.765241+0000","last_unstale":"2023-10-06T02:57:18.765679+0000","last_undegraded":"2023-10-06T02:57:18.765679+0000","last_fullsized":"2023-10-06T02:57:18.765679+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:44.185244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767156+0000","last_change":"2023-10-06T02:57:18.766724+0000","last_active":"2023-10-06T02:57:18.767156+0000","last_peered":"2023-10-06T02:57:18.767156+0000","last_clean":"2023-10-06T02:57:18.767156+0000","last_became_active":"2023-10-06T02:57:18.765675+0000","last_became_peered":"2023-10-06T02:57:18.765675+0000","last_unstale":"2023-10-06T02:57:18.767156+0000","last_undegraded":"2023-10-06T02:57:18.767156+0000","last_fullsized":"2023-10-06T02:57:18.767156+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:39.969919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760483+0000","last_change":"2023-10-06T02:57:18.758721+0000","last_active":"2023-10-06T02:57:18.760483+0000","last_peered":"2023-10-06T02:57:18.760483+0000","last_clean":"2023-10-06T02:57:18.760483+0000","last_became_active":"2023-10-06T02:57:18.758517+0000","last_became_peered":"2023-10-06T02:57:18.758517+0000","last_unstale":"2023-10-06T02:57:18.760483+0000","last_undegraded":"2023-10-06T02:57:18.760483+0000","last_fullsized":"2023-10-06T02:57:18.760483+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:53.250121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769456+0000","last_change":"2023-10-06T02:57:18.768987+0000","last_active":"2023-10-06T02:57:18.769456+0000","last_peered":"2023-10-06T02:57:18.769456+0000","last_clean":"2023-10-06T02:57:18.769456+0000","last_became_active":"2023-10-06T02:57:18.766917+0000","last_became_peered":"2023-10-06T02:57:18.766917+0000","last_unstale":"2023-10-06T02:57:18.769456+0000","last_undegraded":"2023-10-06T02:57:18.769456+0000","last_fullsized":"2023-10-06T02:57:18.769456+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:09.712385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768140+0000","last_change":"2023-10-06T02:57:18.768083+0000","last_active":"2023-10-06T02:57:18.768140+0000","last_peered":"2023-10-06T02:57:18.768140+0000","last_clean":"2023-10-06T02:57:18.768140+0000","last_became_active":"2023-10-06T02:57:18.767564+0000","last_became_peered":"2023-10-06T02:57:18.767564+0000","last_unstale":"2023-10-06T02:57:18.768140+0000","last_undegraded":"2023-10-06T02:57:18.768140+0000","last_fullsized":"2023-10-06T02:57:18.768140+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:15.880927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.763240+0000","last_change":"2023-10-06T02:57:18.763175+0000","last_active":"2023-10-06T02:57:18.763240+0000","last_peered":"2023-10-06T02:57:18.763240+0000","last_clean":"2023-10-06T02:57:18.763240+0000","last_became_active":"2023-10-06T02:57:18.762935+0000","last_became_peered":"2023-10-06T02:57:18.762935+0000","last_unstale":"2023-10-06T02:57:18.763240+0000","last_undegraded":"2023-10-06T02:57:18.763240+0000","last_fullsized":"2023-10-06T02:57:18.763240+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:05.721104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767174+0000","last_change":"2023-10-06T02:57:18.766864+0000","last_active":"2023-10-06T02:57:18.767174+0000","last_peered":"2023-10-06T02:57:18.767174+0000","last_clean":"2023-10-06T02:57:18.767174+0000","last_became_active":"2023-10-06T02:57:18.765948+0000","last_became_peered":"2023-10-06T02:57:18.765948+0000","last_unstale":"2023-10-06T02:57:18.767174+0000","last_undegraded":"2023-10-06T02:57:18.767174+0000","last_fullsized":"2023-10-06T02:57:18.767174+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:16.025689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768681+0000","last_change":"2023-10-06T02:57:18.768626+0000","last_active":"2023-10-06T02:57:18.768681+0000","last_peered":"2023-10-06T02:57:18.768681+0000","last_clean":"2023-10-06T02:57:18.768681+0000","last_became_active":"2023-10-06T02:57:18.768040+0000","last_became_peered":"2023-10-06T02:57:18.768040+0000","last_unstale":"2023-10-06T02:57:18.768681+0000","last_undegraded":"2023-10-06T02:57:18.768681+0000","last_fullsized":"2023-10-06T02:57:18.768681+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:48.807763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769886+0000","last_change":"2023-10-06T02:57:18.769662+0000","last_active":"2023-10-06T02:57:18.769886+0000","last_peered":"2023-10-06T02:57:18.769886+0000","last_clean":"2023-10-06T02:57:18.769886+0000","last_became_active":"2023-10-06T02:57:18.769240+0000","last_became_peered":"2023-10-06T02:57:18.769240+0000","last_unstale":"2023-10-06T02:57:18.769886+0000","last_undegraded":"2023-10-06T02:57:18.769886+0000","last_fullsized":"2023-10-06T02:57:18.769886+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:07.160564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762238+0000","last_change":"2023-10-06T02:57:18.761871+0000","last_active":"2023-10-06T02:57:18.762238+0000","last_peered":"2023-10-06T02:57:18.762238+0000","last_clean":"2023-10-06T02:57:18.762238+0000","last_became_active":"2023-10-06T02:57:18.761633+0000","last_became_peered":"2023-10-06T02:57:18.761633+0000","last_unstale":"2023-10-06T02:57:18.762238+0000","last_undegraded":"2023-10-06T02:57:18.762238+0000","last_fullsized":"2023-10-06T02:57:18.762238+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:35.088209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.763199+0000","last_change":"2023-10-06T02:57:18.763132+0000","last_active":"2023-10-06T02:57:18.763199+0000","last_peered":"2023-10-06T02:57:18.763199+0000","last_clean":"2023-10-06T02:57:18.763199+0000","last_became_active":"2023-10-06T02:57:18.762909+0000","last_became_peered":"2023-10-06T02:57:18.762909+0000","last_unstale":"2023-10-06T02:57:18.763199+0000","last_undegraded":"2023-10-06T02:57:18.763199+0000","last_fullsized":"2023-10-06T02:57:18.763199+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:55.057947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762254+0000","last_change":"2023-10-06T02:57:18.762177+0000","last_active":"2023-10-06T02:57:18.762254+0000","last_peered":"2023-10-06T02:57:18.762254+0000","last_clean":"2023-10-06T02:57:18.762254+0000","last_became_active":"2023-10-06T02:57:18.761959+0000","last_became_peered":"2023-10-06T02:57:18.761959+0000","last_unstale":"2023-10-06T02:57:18.762254+0000","last_undegraded":"2023-10-06T02:57:18.762254+0000","last_fullsized":"2023-10-06T02:57:18.762254+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:51.797949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767781+0000","last_change":"2023-10-06T02:57:18.767712+0000","last_active":"2023-10-06T02:57:18.767781+0000","last_peered":"2023-10-06T02:57:18.767781+0000","last_clean":"2023-10-06T02:57:18.767781+0000","last_became_active":"2023-10-06T02:57:18.767305+0000","last_became_peered":"2023-10-06T02:57:18.767305+0000","last_unstale":"2023-10-06T02:57:18.767781+0000","last_undegraded":"2023-10-06T02:57:18.767781+0000","last_fullsized":"2023-10-06T02:57:18.767781+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:22.800812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"179'4","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.771029+0000","last_change":"2023-10-06T02:57:17.755645+0000","last_active":"2023-10-06T02:57:18.771029+0000","last_peered":"2023-10-06T02:57:18.771029+0000","last_clean":"2023-10-06T02:57:18.771029+0000","last_became_active":"2023-10-06T02:57:17.755386+0000","last_became_peered":"2023-10-06T02:57:17.755386+0000","last_unstale":"2023-10-06T02:57:18.771029+0000","last_undegraded":"2023-10-06T02:57:18.771029+0000","last_fullsized":"2023-10-06T02:57:18.771029+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:17.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765639+0000","last_change":"2023-10-06T02:57:18.762957+0000","last_active":"2023-10-06T02:57:18.765639+0000","last_peered":"2023-10-06T02:57:18.765639+0000","last_clean":"2023-10-06T02:57:18.765639+0000","last_became_active":"2023-10-06T02:57:18.762734+0000","last_became_peered":"2023-10-06T02:57:18.762734+0000","last_unstale":"2023-10-06T02:57:18.765639+0000","last_undegraded":"2023-10-06T02:57:18.765639+0000","last_fullsized":"2023-10-06T02:57:18.765639+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.832858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770363+0000","last_change":"2023-10-06T02:57:17.766288+0000","last_active":"2023-10-06T02:57:18.770363+0000","last_peered":"2023-10-06T02:57:18.770363+0000","last_clean":"2023-10-06T02:57:18.770363+0000","last_became_active":"2023-10-06T02:57:17.765891+0000","last_became_peered":"2023-10-06T02:57:17.765891+0000","last_unstale":"2023-10-06T02:57:18.770363+0000","last_undegraded":"2023-10-06T02:57:18.770363+0000","last_fullsized":"2023-10-06T02:57:18.770363+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:06.153623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760445+0000","last_change":"2023-10-06T02:57:18.757017+0000","last_active":"2023-10-06T02:57:18.760445+0000","last_peered":"2023-10-06T02:57:18.760445+0000","last_clean":"2023-10-06T02:57:18.760445+0000","last_became_active":"2023-10-06T02:57:18.756802+0000","last_became_peered":"2023-10-06T02:57:18.756802+0000","last_unstale":"2023-10-06T02:57:18.760445+0000","last_undegraded":"2023-10-06T02:57:18.760445+0000","last_fullsized":"2023-10-06T02:57:18.760445+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:42.060121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770001+0000","last_change":"2023-10-06T02:57:17.762857+0000","last_active":"2023-10-06T02:57:18.770001+0000","last_peered":"2023-10-06T02:57:18.770001+0000","last_clean":"2023-10-06T02:57:18.770001+0000","last_became_active":"2023-10-06T02:57:17.762607+0000","last_became_peered":"2023-10-06T02:57:17.762607+0000","last_unstale":"2023-10-06T02:57:18.770001+0000","last_undegraded":"2023-10-06T02:57:18.770001+0000","last_fullsized":"2023-10-06T02:57:18.770001+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:22.747087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768973+0000","last_change":"2023-10-06T02:57:18.768720+0000","last_active":"2023-10-06T02:57:18.768973+0000","last_peered":"2023-10-06T02:57:18.768973+0000","last_clean":"2023-10-06T02:57:18.768973+0000","last_became_active":"2023-10-06T02:57:18.768333+0000","last_became_peered":"2023-10-06T02:57:18.768333+0000","last_unstale":"2023-10-06T02:57:18.768973+0000","last_undegraded":"2023-10-06T02:57:18.768973+0000","last_fullsized":"2023-10-06T02:57:18.768973+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:17.866677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.763647+0000","last_change":"2023-10-06T02:57:17.758818+0000","last_active":"2023-10-06T02:57:18.763647+0000","last_peered":"2023-10-06T02:57:18.763647+0000","last_clean":"2023-10-06T02:57:18.763647+0000","last_became_active":"2023-10-06T02:57:17.758587+0000","last_became_peered":"2023-10-06T02:57:17.758587+0000","last_unstale":"2023-10-06T02:57:18.763647+0000","last_undegraded":"2023-10-06T02:57:18.763647+0000","last_fullsized":"2023-10-06T02:57:18.763647+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:14.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757047+0000","last_change":"2023-10-06T02:57:18.756978+0000","last_active":"2023-10-06T02:57:18.757047+0000","last_peered":"2023-10-06T02:57:18.757047+0000","last_clean":"2023-10-06T02:57:18.757047+0000","last_became_active":"2023-10-06T02:57:18.756764+0000","last_became_peered":"2023-10-06T02:57:18.756764+0000","last_unstale":"2023-10-06T02:57:18.757047+0000","last_undegraded":"2023-10-06T02:57:18.757047+0000","last_fullsized":"2023-10-06T02:57:18.757047+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:17.866677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769159+0000","last_change":"2023-10-06T02:57:17.763578+0000","last_active":"2023-10-06T02:57:18.769159+0000","last_peered":"2023-10-06T02:57:18.769159+0000","last_clean":"2023-10-06T02:57:18.769159+0000","last_became_active":"2023-10-06T02:57:17.760867+0000","last_became_peered":"2023-10-06T02:57:17.760867+0000","last_unstale":"2023-10-06T02:57:18.769159+0000","last_undegraded":"2023-10-06T02:57:18.769159+0000","last_fullsized":"2023-10-06T02:57:18.769159+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:42.762638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768020+0000","last_change":"2023-10-06T02:57:18.767311+0000","last_active":"2023-10-06T02:57:18.768020+0000","last_peered":"2023-10-06T02:57:18.768020+0000","last_clean":"2023-10-06T02:57:18.768020+0000","last_became_active":"2023-10-06T02:57:18.767097+0000","last_became_peered":"2023-10-06T02:57:18.767097+0000","last_unstale":"2023-10-06T02:57:18.768020+0000","last_undegraded":"2023-10-06T02:57:18.768020+0000","last_fullsized":"2023-10-06T02:57:18.768020+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:06.589113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770944+0000","last_change":"2023-10-06T02:57:17.760068+0000","last_active":"2023-10-06T02:57:18.770944+0000","last_peered":"2023-10-06T02:57:18.770944+0000","last_clean":"2023-10-06T02:57:18.770944+0000","last_became_active":"2023-10-06T02:57:17.759840+0000","last_became_peered":"2023-10-06T02:57:17.759840+0000","last_unstale":"2023-10-06T02:57:18.770944+0000","last_undegraded":"2023-10-06T02:57:18.770944+0000","last_fullsized":"2023-10-06T02:57:18.770944+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:35.195422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760662+0000","last_change":"2023-10-06T02:57:18.760198+0000","last_active":"2023-10-06T02:57:18.760662+0000","last_peered":"2023-10-06T02:57:18.760662+0000","last_clean":"2023-10-06T02:57:18.760662+0000","last_became_active":"2023-10-06T02:57:18.759960+0000","last_became_peered":"2023-10-06T02:57:18.759960+0000","last_unstale":"2023-10-06T02:57:18.760662+0000","last_undegraded":"2023-10-06T02:57:18.760662+0000","last_fullsized":"2023-10-06T02:57:18.760662+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:54.072409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.755733+0000","last_change":"2023-10-06T02:57:17.763556+0000","last_active":"2023-10-06T02:57:18.755733+0000","last_peered":"2023-10-06T02:57:18.755733+0000","last_clean":"2023-10-06T02:57:18.755733+0000","last_became_active":"2023-10-06T02:57:17.763336+0000","last_became_peered":"2023-10-06T02:57:17.763336+0000","last_unstale":"2023-10-06T02:57:18.755733+0000","last_undegraded":"2023-10-06T02:57:18.755733+0000","last_fullsized":"2023-10-06T02:57:18.755733+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:11.681126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.763194+0000","last_change":"2023-10-06T02:57:18.762827+0000","last_active":"2023-10-06T02:57:18.763194+0000","last_peered":"2023-10-06T02:57:18.763194+0000","last_clean":"2023-10-06T02:57:18.763194+0000","last_became_active":"2023-10-06T02:57:18.762572+0000","last_became_peered":"2023-10-06T02:57:18.762572+0000","last_unstale":"2023-10-06T02:57:18.763194+0000","last_undegraded":"2023-10-06T02:57:18.763194+0000","last_fullsized":"2023-10-06T02:57:18.763194+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:25.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.753540+0000","last_change":"2023-10-06T02:57:17.760843+0000","last_active":"2023-10-06T02:57:18.753540+0000","last_peered":"2023-10-06T02:57:18.753540+0000","last_clean":"2023-10-06T02:57:18.753540+0000","last_became_active":"2023-10-06T02:57:17.759572+0000","last_became_peered":"2023-10-06T02:57:17.759572+0000","last_unstale":"2023-10-06T02:57:18.753540+0000","last_undegraded":"2023-10-06T02:57:18.753540+0000","last_fullsized":"2023-10-06T02:57:18.753540+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:01.549442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765848+0000","last_change":"2023-10-06T02:57:18.765631+0000","last_active":"2023-10-06T02:57:18.765848+0000","last_peered":"2023-10-06T02:57:18.765848+0000","last_clean":"2023-10-06T02:57:18.765848+0000","last_became_active":"2023-10-06T02:57:18.762602+0000","last_became_peered":"2023-10-06T02:57:18.762602+0000","last_unstale":"2023-10-06T02:57:18.765848+0000","last_undegraded":"2023-10-06T02:57:18.765848+0000","last_fullsized":"2023-10-06T02:57:18.765848+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:59.782841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770345+0000","last_change":"2023-10-06T02:57:17.753868+0000","last_active":"2023-10-06T02:57:18.770345+0000","last_peered":"2023-10-06T02:57:18.770345+0000","last_clean":"2023-10-06T02:57:18.770345+0000","last_became_active":"2023-10-06T02:57:17.753356+0000","last_became_peered":"2023-10-06T02:57:17.753356+0000","last_unstale":"2023-10-06T02:57:18.770345+0000","last_undegraded":"2023-10-06T02:57:18.770345+0000","last_fullsized":"2023-10-06T02:57:18.770345+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:16.859735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762507+0000","last_change":"2023-10-06T02:57:18.762450+0000","last_active":"2023-10-06T02:57:18.762507+0000","last_peered":"2023-10-06T02:57:18.762507+0000","last_clean":"2023-10-06T02:57:18.762507+0000","last_became_active":"2023-10-06T02:57:18.761898+0000","last_became_peered":"2023-10-06T02:57:18.761898+0000","last_unstale":"2023-10-06T02:57:18.762507+0000","last_undegraded":"2023-10-06T02:57:18.762507+0000","last_fullsized":"2023-10-06T02:57:18.762507+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:23.754028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769654+0000","last_change":"2023-10-06T02:57:17.764457+0000","last_active":"2023-10-06T02:57:18.769654+0000","last_peered":"2023-10-06T02:57:18.769654+0000","last_clean":"2023-10-06T02:57:18.769654+0000","last_became_active":"2023-10-06T02:57:17.764318+0000","last_became_peered":"2023-10-06T02:57:17.764318+0000","last_unstale":"2023-10-06T02:57:18.769654+0000","last_undegraded":"2023-10-06T02:57:18.769654+0000","last_fullsized":"2023-10-06T02:57:18.769654+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:24.720424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764074+0000","last_change":"2023-10-06T02:57:18.764005+0000","last_active":"2023-10-06T02:57:18.764074+0000","last_peered":"2023-10-06T02:57:18.764074+0000","last_clean":"2023-10-06T02:57:18.764074+0000","last_became_active":"2023-10-06T02:57:18.763780+0000","last_became_peered":"2023-10-06T02:57:18.763780+0000","last_unstale":"2023-10-06T02:57:18.764074+0000","last_undegraded":"2023-10-06T02:57:18.764074+0000","last_fullsized":"2023-10-06T02:57:18.764074+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:43.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.771542+0000","last_change":"2023-10-06T02:57:17.759922+0000","last_active":"2023-10-06T02:57:18.771542+0000","last_peered":"2023-10-06T02:57:18.771542+0000","last_clean":"2023-10-06T02:57:18.771542+0000","last_became_active":"2023-10-06T02:57:17.759688+0000","last_became_peered":"2023-10-06T02:57:17.759688+0000","last_unstale":"2023-10-06T02:57:18.771542+0000","last_undegraded":"2023-10-06T02:57:18.771542+0000","last_fullsized":"2023-10-06T02:57:18.771542+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:03.540465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765711+0000","last_change":"2023-10-06T02:57:18.765527+0000","last_active":"2023-10-06T02:57:18.765711+0000","last_peered":"2023-10-06T02:57:18.765711+0000","last_clean":"2023-10-06T02:57:18.765711+0000","last_became_active":"2023-10-06T02:57:18.765009+0000","last_became_peered":"2023-10-06T02:57:18.765009+0000","last_unstale":"2023-10-06T02:57:18.765711+0000","last_undegraded":"2023-10-06T02:57:18.765711+0000","last_fullsized":"2023-10-06T02:57:18.765711+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:24.099397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.751775+0000","last_change":"2023-10-06T02:57:17.763448+0000","last_active":"2023-10-06T02:57:18.751775+0000","last_peered":"2023-10-06T02:57:18.751775+0000","last_clean":"2023-10-06T02:57:18.751775+0000","last_became_active":"2023-10-06T02:57:17.760577+0000","last_became_peered":"2023-10-06T02:57:17.760577+0000","last_unstale":"2023-10-06T02:57:18.751775+0000","last_undegraded":"2023-10-06T02:57:18.751775+0000","last_fullsized":"2023-10-06T02:57:18.751775+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:23.092455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767974+0000","last_change":"2023-10-06T02:57:18.767789+0000","last_active":"2023-10-06T02:57:18.767974+0000","last_peered":"2023-10-06T02:57:18.767974+0000","last_clean":"2023-10-06T02:57:18.767974+0000","last_became_active":"2023-10-06T02:57:18.766964+0000","last_became_peered":"2023-10-06T02:57:18.766964+0000","last_unstale":"2023-10-06T02:57:18.767974+0000","last_undegraded":"2023-10-06T02:57:18.767974+0000","last_fullsized":"2023-10-06T02:57:18.767974+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:03.995864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.771465+0000","last_change":"2023-10-06T02:57:17.759435+0000","last_active":"2023-10-06T02:57:18.771465+0000","last_peered":"2023-10-06T02:57:18.771465+0000","last_clean":"2023-10-06T02:57:18.771465+0000","last_became_active":"2023-10-06T02:57:17.759215+0000","last_became_peered":"2023-10-06T02:57:17.759215+0000","last_unstale":"2023-10-06T02:57:18.771465+0000","last_undegraded":"2023-10-06T02:57:18.771465+0000","last_fullsized":"2023-10-06T02:57:18.771465+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:16.551154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764846+0000","last_change":"2023-10-06T02:57:18.764788+0000","last_active":"2023-10-06T02:57:18.764846+0000","last_peered":"2023-10-06T02:57:18.764846+0000","last_clean":"2023-10-06T02:57:18.764846+0000","last_became_active":"2023-10-06T02:57:18.764446+0000","last_became_peered":"2023-10-06T02:57:18.764446+0000","last_unstale":"2023-10-06T02:57:18.764846+0000","last_undegraded":"2023-10-06T02:57:18.764846+0000","last_fullsized":"2023-10-06T02:57:18.764846+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:10.306074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759843+0000","last_change":"2023-10-06T02:57:17.752788+0000","last_active":"2023-10-06T02:57:18.759843+0000","last_peered":"2023-10-06T02:57:18.759843+0000","last_clean":"2023-10-06T02:57:18.759843+0000","last_became_active":"2023-10-06T02:57:17.752130+0000","last_became_peered":"2023-10-06T02:57:17.752130+0000","last_unstale":"2023-10-06T02:57:18.759843+0000","last_undegraded":"2023-10-06T02:57:18.759843+0000","last_fullsized":"2023-10-06T02:57:18.759843+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:11.803409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760415+0000","last_change":"2023-10-06T02:57:18.756498+0000","last_active":"2023-10-06T02:57:18.760415+0000","last_peered":"2023-10-06T02:57:18.760415+0000","last_clean":"2023-10-06T02:57:18.760415+0000","last_became_active":"2023-10-06T02:57:18.756307+0000","last_became_peered":"2023-10-06T02:57:18.756307+0000","last_unstale":"2023-10-06T02:57:18.760415+0000","last_undegraded":"2023-10-06T02:57:18.760415+0000","last_fullsized":"2023-10-06T02:57:18.760415+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:10.545091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.754382+0000","last_change":"2023-10-06T02:57:17.763735+0000","last_active":"2023-10-06T02:57:18.754382+0000","last_peered":"2023-10-06T02:57:18.754382+0000","last_clean":"2023-10-06T02:57:18.754382+0000","last_became_active":"2023-10-06T02:57:17.763370+0000","last_became_peered":"2023-10-06T02:57:17.763370+0000","last_unstale":"2023-10-06T02:57:18.754382+0000","last_undegraded":"2023-10-06T02:57:18.754382+0000","last_fullsized":"2023-10-06T02:57:18.754382+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:09.587038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767189+0000","last_change":"2023-10-06T02:57:18.766999+0000","last_active":"2023-10-06T02:57:18.767189+0000","last_peered":"2023-10-06T02:57:18.767189+0000","last_clean":"2023-10-06T02:57:18.767189+0000","last_became_active":"2023-10-06T02:57:18.766241+0000","last_became_peered":"2023-10-06T02:57:18.766241+0000","last_unstale":"2023-10-06T02:57:18.767189+0000","last_undegraded":"2023-10-06T02:57:18.767189+0000","last_fullsized":"2023-10-06T02:57:18.767189+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:37.341812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759878+0000","last_change":"2023-10-06T02:57:17.759753+0000","last_active":"2023-10-06T02:57:18.759878+0000","last_peered":"2023-10-06T02:57:18.759878+0000","last_clean":"2023-10-06T02:57:18.759878+0000","last_became_active":"2023-10-06T02:57:17.759519+0000","last_became_peered":"2023-10-06T02:57:17.759519+0000","last_unstale":"2023-10-06T02:57:18.759878+0000","last_undegraded":"2023-10-06T02:57:18.759878+0000","last_fullsized":"2023-10-06T02:57:18.759878+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:01.549442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762662+0000","last_change":"2023-10-06T02:57:18.762162+0000","last_active":"2023-10-06T02:57:18.762662+0000","last_peered":"2023-10-06T02:57:18.762662+0000","last_clean":"2023-10-06T02:57:18.762662+0000","last_became_active":"2023-10-06T02:57:18.761934+0000","last_became_peered":"2023-10-06T02:57:18.761934+0000","last_unstale":"2023-10-06T02:57:18.762662+0000","last_undegraded":"2023-10-06T02:57:18.762662+0000","last_fullsized":"2023-10-06T02:57:18.762662+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:14.579745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770706+0000","last_change":"2023-10-06T02:57:17.760855+0000","last_active":"2023-10-06T02:57:18.770706+0000","last_peered":"2023-10-06T02:57:18.770706+0000","last_clean":"2023-10-06T02:57:18.770706+0000","last_became_active":"2023-10-06T02:57:17.760634+0000","last_became_peered":"2023-10-06T02:57:17.760634+0000","last_unstale":"2023-10-06T02:57:18.770706+0000","last_undegraded":"2023-10-06T02:57:18.770706+0000","last_fullsized":"2023-10-06T02:57:18.770706+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:02.988923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769043+0000","last_change":"2023-10-06T02:57:18.768140+0000","last_active":"2023-10-06T02:57:18.769043+0000","last_peered":"2023-10-06T02:57:18.769043+0000","last_clean":"2023-10-06T02:57:18.769043+0000","last_became_active":"2023-10-06T02:57:18.762982+0000","last_became_peered":"2023-10-06T02:57:18.762982+0000","last_unstale":"2023-10-06T02:57:18.769043+0000","last_undegraded":"2023-10-06T02:57:18.769043+0000","last_fullsized":"2023-10-06T02:57:18.769043+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:37.341812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762020+0000","last_change":"2023-10-06T02:57:17.754368+0000","last_active":"2023-10-06T02:57:18.762020+0000","last_peered":"2023-10-06T02:57:18.762020+0000","last_clean":"2023-10-06T02:57:18.762020+0000","last_became_active":"2023-10-06T02:57:17.754133+0000","last_became_peered":"2023-10-06T02:57:17.754133+0000","last_unstale":"2023-10-06T02:57:18.762020+0000","last_undegraded":"2023-10-06T02:57:18.762020+0000","last_fullsized":"2023-10-06T02:57:18.762020+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:22:30.350123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758651+0000","last_change":"2023-10-06T02:57:18.758416+0000","last_active":"2023-10-06T02:57:18.758651+0000","last_peered":"2023-10-06T02:57:18.758651+0000","last_clean":"2023-10-06T02:57:18.758651+0000","last_became_active":"2023-10-06T02:57:18.758213+0000","last_became_peered":"2023-10-06T02:57:18.758213+0000","last_unstale":"2023-10-06T02:57:18.758651+0000","last_undegraded":"2023-10-06T02:57:18.758651+0000","last_fullsized":"2023-10-06T02:57:18.758651+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:58.957661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758622+0000","last_change":"2023-10-06T02:57:17.757932+0000","last_active":"2023-10-06T02:57:18.758622+0000","last_peered":"2023-10-06T02:57:18.758622+0000","last_clean":"2023-10-06T02:57:18.758622+0000","last_became_active":"2023-10-06T02:57:17.757693+0000","last_became_peered":"2023-10-06T02:57:17.757693+0000","last_unstale":"2023-10-06T02:57:18.758622+0000","last_undegraded":"2023-10-06T02:57:18.758622+0000","last_fullsized":"2023-10-06T02:57:18.758622+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:59.916842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758625+0000","last_change":"2023-10-06T02:57:18.758536+0000","last_active":"2023-10-06T02:57:18.758625+0000","last_peered":"2023-10-06T02:57:18.758625+0000","last_clean":"2023-10-06T02:57:18.758625+0000","last_became_active":"2023-10-06T02:57:18.757847+0000","last_became_peered":"2023-10-06T02:57:18.757847+0000","last_unstale":"2023-10-06T02:57:18.758625+0000","last_undegraded":"2023-10-06T02:57:18.758625+0000","last_fullsized":"2023-10-06T02:57:18.758625+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:00.923784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.754469+0000","last_change":"2023-10-06T02:57:17.765809+0000","last_active":"2023-10-06T02:57:18.754469+0000","last_peered":"2023-10-06T02:57:18.754469+0000","last_clean":"2023-10-06T02:57:18.754469+0000","last_became_active":"2023-10-06T02:57:17.765357+0000","last_became_peered":"2023-10-06T02:57:17.765357+0000","last_unstale":"2023-10-06T02:57:18.754469+0000","last_undegraded":"2023-10-06T02:57:18.754469+0000","last_fullsized":"2023-10-06T02:57:18.754469+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:19.830691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769438+0000","last_change":"2023-10-06T02:57:18.768657+0000","last_active":"2023-10-06T02:57:18.769438+0000","last_peered":"2023-10-06T02:57:18.769438+0000","last_clean":"2023-10-06T02:57:18.769438+0000","last_became_active":"2023-10-06T02:57:18.765954+0000","last_became_peered":"2023-10-06T02:57:18.765954+0000","last_unstale":"2023-10-06T02:57:18.769438+0000","last_undegraded":"2023-10-06T02:57:18.769438+0000","last_fullsized":"2023-10-06T02:57:18.769438+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:49.399422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.755849+0000","last_change":"2023-10-06T02:57:17.759792+0000","last_active":"2023-10-06T02:57:18.755849+0000","last_peered":"2023-10-06T02:57:18.755849+0000","last_clean":"2023-10-06T02:57:18.755849+0000","last_became_active":"2023-10-06T02:57:17.759439+0000","last_became_peered":"2023-10-06T02:57:17.759439+0000","last_unstale":"2023-10-06T02:57:18.755849+0000","last_undegraded":"2023-10-06T02:57:18.755849+0000","last_fullsized":"2023-10-06T02:57:18.755849+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:43.890309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768991+0000","last_change":"2023-10-06T02:57:18.768822+0000","last_active":"2023-10-06T02:57:18.768991+0000","last_peered":"2023-10-06T02:57:18.768991+0000","last_clean":"2023-10-06T02:57:18.768991+0000","last_became_active":"2023-10-06T02:57:18.768595+0000","last_became_peered":"2023-10-06T02:57:18.768595+0000","last_unstale":"2023-10-06T02:57:18.768991+0000","last_undegraded":"2023-10-06T02:57:18.768991+0000","last_fullsized":"2023-10-06T02:57:18.768991+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:59.782841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757469+0000","last_change":"2023-10-06T02:57:17.761035+0000","last_active":"2023-10-06T02:57:18.757469+0000","last_peered":"2023-10-06T02:57:18.757469+0000","last_clean":"2023-10-06T02:57:18.757469+0000","last_became_active":"2023-10-06T02:57:17.760823+0000","last_became_peered":"2023-10-06T02:57:17.760823+0000","last_unstale":"2023-10-06T02:57:18.757469+0000","last_undegraded":"2023-10-06T02:57:18.757469+0000","last_fullsized":"2023-10-06T02:57:18.757469+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:57.550090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767990+0000","last_change":"2023-10-06T02:57:18.767944+0000","last_active":"2023-10-06T02:57:18.767990+0000","last_peered":"2023-10-06T02:57:18.767990+0000","last_clean":"2023-10-06T02:57:18.767990+0000","last_became_active":"2023-10-06T02:57:18.767266+0000","last_became_peered":"2023-10-06T02:57:18.767266+0000","last_unstale":"2023-10-06T02:57:18.767990+0000","last_undegraded":"2023-10-06T02:57:18.767990+0000","last_fullsized":"2023-10-06T02:57:18.767990+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:17.558096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757862+0000","last_change":"2023-10-06T02:57:17.762755+0000","last_active":"2023-10-06T02:57:18.757862+0000","last_peered":"2023-10-06T02:57:18.757862+0000","last_clean":"2023-10-06T02:57:18.757862+0000","last_became_active":"2023-10-06T02:57:17.762491+0000","last_became_peered":"2023-10-06T02:57:17.762491+0000","last_unstale":"2023-10-06T02:57:18.757862+0000","last_undegraded":"2023-10-06T02:57:18.757862+0000","last_fullsized":"2023-10-06T02:57:18.757862+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:15.596581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759293+0000","last_change":"2023-10-06T02:57:18.759055+0000","last_active":"2023-10-06T02:57:18.759293+0000","last_peered":"2023-10-06T02:57:18.759293+0000","last_clean":"2023-10-06T02:57:18.759293+0000","last_became_active":"2023-10-06T02:57:18.758828+0000","last_became_peered":"2023-10-06T02:57:18.758828+0000","last_unstale":"2023-10-06T02:57:18.759293+0000","last_undegraded":"2023-10-06T02:57:18.759293+0000","last_fullsized":"2023-10-06T02:57:18.759293+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:27.605592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.753968+0000","last_change":"2023-10-06T02:57:17.762254+0000","last_active":"2023-10-06T02:57:18.753968+0000","last_peered":"2023-10-06T02:57:18.753968+0000","last_clean":"2023-10-06T02:57:18.753968+0000","last_became_active":"2023-10-06T02:57:17.761854+0000","last_became_peered":"2023-10-06T02:57:17.761854+0000","last_unstale":"2023-10-06T02:57:18.753968+0000","last_undegraded":"2023-10-06T02:57:18.753968+0000","last_fullsized":"2023-10-06T02:57:18.753968+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:36.334871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769197+0000","last_change":"2023-10-06T02:57:18.768758+0000","last_active":"2023-10-06T02:57:18.769197+0000","last_peered":"2023-10-06T02:57:18.769197+0000","last_clean":"2023-10-06T02:57:18.769197+0000","last_became_active":"2023-10-06T02:57:18.768515+0000","last_became_peered":"2023-10-06T02:57:18.768515+0000","last_unstale":"2023-10-06T02:57:18.769197+0000","last_undegraded":"2023-10-06T02:57:18.769197+0000","last_fullsized":"2023-10-06T02:57:18.769197+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:09.712385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759486+0000","last_change":"2023-10-06T02:57:17.758907+0000","last_active":"2023-10-06T02:57:18.759486+0000","last_peered":"2023-10-06T02:57:18.759486+0000","last_clean":"2023-10-06T02:57:18.759486+0000","last_became_active":"2023-10-06T02:57:17.758681+0000","last_became_peered":"2023-10-06T02:57:17.758681+0000","last_unstale":"2023-10-06T02:57:18.759486+0000","last_undegraded":"2023-10-06T02:57:18.759486+0000","last_fullsized":"2023-10-06T02:57:18.759486+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:48.946727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.753695+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:57:18.753695+0000","last_peered":"2023-10-06T02:57:18.753695+0000","last_clean":"2023-10-06T02:57:18.753695+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:57:18.753695+0000","last_undegraded":"2023-10-06T02:57:18.753695+0000","last_fullsized":"2023-10-06T02:57:18.753695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768955+0000","last_change":"2023-10-06T02:57:18.768562+0000","last_active":"2023-10-06T02:57:18.768955+0000","last_peered":"2023-10-06T02:57:18.768955+0000","last_clean":"2023-10-06T02:57:18.768955+0000","last_became_active":"2023-10-06T02:57:18.768030+0000","last_became_peered":"2023-10-06T02:57:18.768030+0000","last_unstale":"2023-10-06T02:57:18.768955+0000","last_undegraded":"2023-10-06T02:57:18.768955+0000","last_fullsized":"2023-10-06T02:57:18.768955+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:12.817133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760459+0000","last_change":"2023-10-06T02:57:17.754413+0000","last_active":"2023-10-06T02:57:18.760459+0000","last_peered":"2023-10-06T02:57:18.760459+0000","last_clean":"2023-10-06T02:57:18.760459+0000","last_became_active":"2023-10-06T02:57:17.754205+0000","last_became_peered":"2023-10-06T02:57:17.754205+0000","last_unstale":"2023-10-06T02:57:18.760459+0000","last_undegraded":"2023-10-06T02:57:18.760459+0000","last_fullsized":"2023-10-06T02:57:18.760459+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:21.793870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759573+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:57:18.759573+0000","last_peered":"2023-10-06T02:57:18.759573+0000","last_clean":"2023-10-06T02:57:18.759573+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:57:18.759573+0000","last_undegraded":"2023-10-06T02:57:18.759573+0000","last_fullsized":"2023-10-06T02:57:18.759573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764571+0000","last_change":"2023-10-06T02:57:18.764514+0000","last_active":"2023-10-06T02:57:18.764571+0000","last_peered":"2023-10-06T02:57:18.764571+0000","last_clean":"2023-10-06T02:57:18.764571+0000","last_became_active":"2023-10-06T02:57:18.764309+0000","last_became_peered":"2023-10-06T02:57:18.764309+0000","last_unstale":"2023-10-06T02:57:18.764571+0000","last_undegraded":"2023-10-06T02:57:18.764571+0000","last_fullsized":"2023-10-06T02:57:18.764571+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:03.357453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"179'6","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.772533+0000","last_change":"2023-10-06T02:57:17.753997+0000","last_active":"2023-10-06T02:57:18.772533+0000","last_peered":"2023-10-06T02:57:18.772533+0000","last_clean":"2023-10-06T02:57:18.772533+0000","last_became_active":"2023-10-06T02:57:17.753643+0000","last_became_peered":"2023-10-06T02:57:17.753643+0000","last_unstale":"2023-10-06T02:57:18.772533+0000","last_undegraded":"2023-10-06T02:57:18.772533+0000","last_fullsized":"2023-10-06T02:57:18.772533+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:11.810191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.754478+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:57:18.754478+0000","last_peered":"2023-10-06T02:57:18.754478+0000","last_clean":"2023-10-06T02:57:18.754478+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:57:18.754478+0000","last_undegraded":"2023-10-06T02:57:18.754478+0000","last_fullsized":"2023-10-06T02:57:18.754478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765517+0000","last_change":"2023-10-06T02:57:18.765442+0000","last_active":"2023-10-06T02:57:18.765517+0000","last_peered":"2023-10-06T02:57:18.765517+0000","last_clean":"2023-10-06T02:57:18.765517+0000","last_became_active":"2023-10-06T02:57:18.765212+0000","last_became_peered":"2023-10-06T02:57:18.765212+0000","last_unstale":"2023-10-06T02:57:18.765517+0000","last_undegraded":"2023-10-06T02:57:18.765517+0000","last_fullsized":"2023-10-06T02:57:18.765517+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:00.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757390+0000","last_change":"2023-10-06T02:57:17.753910+0000","last_active":"2023-10-06T02:57:18.757390+0000","last_peered":"2023-10-06T02:57:18.757390+0000","last_clean":"2023-10-06T02:57:18.757390+0000","last_became_active":"2023-10-06T02:57:17.753677+0000","last_became_peered":"2023-10-06T02:57:17.753677+0000","last_unstale":"2023-10-06T02:57:18.757390+0000","last_undegraded":"2023-10-06T02:57:18.757390+0000","last_fullsized":"2023-10-06T02:57:18.757390+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:39.600967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":169,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760962+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:57:18.760962+0000","last_peered":"2023-10-06T02:57:18.760962+0000","last_clean":"2023-10-06T02:57:18.760962+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:57:18.760962+0000","last_undegraded":"2023-10-06T02:57:18.760962+0000","last_fullsized":"2023-10-06T02:57:18.760962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":303,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758287+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:57:18.758287+0000","last_peered":"2023-10-06T02:57:18.758287+0000","last_clean":"2023-10-06T02:57:18.758287+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:57:18.758287+0000","last_undegraded":"2023-10-06T02:57:18.758287+0000","last_fullsized":"2023-10-06T02:57:18.758287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768335+0000","last_change":"2023-10-06T02:57:18.768275+0000","last_active":"2023-10-06T02:57:18.768335+0000","last_peered":"2023-10-06T02:57:18.768335+0000","last_clean":"2023-10-06T02:57:18.768335+0000","last_became_active":"2023-10-06T02:57:18.766493+0000","last_became_peered":"2023-10-06T02:57:18.766493+0000","last_unstale":"2023-10-06T02:57:18.768335+0000","last_undegraded":"2023-10-06T02:57:18.768335+0000","last_fullsized":"2023-10-06T02:57:18.768335+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:36.202364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"179'3","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770826+0000","last_change":"2023-10-06T02:57:17.761840+0000","last_active":"2023-10-06T02:57:18.770826+0000","last_peered":"2023-10-06T02:57:18.770826+0000","last_clean":"2023-10-06T02:57:18.770826+0000","last_became_active":"2023-10-06T02:57:17.761586+0000","last_became_peered":"2023-10-06T02:57:17.761586+0000","last_unstale":"2023-10-06T02:57:18.770826+0000","last_undegraded":"2023-10-06T02:57:18.770826+0000","last_fullsized":"2023-10-06T02:57:18.770826+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:14.896556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757825+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:57:18.757825+0000","last_peered":"2023-10-06T02:57:18.757825+0000","last_clean":"2023-10-06T02:57:18.757825+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:57:18.757825+0000","last_undegraded":"2023-10-06T02:57:18.757825+0000","last_fullsized":"2023-10-06T02:57:18.757825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.756559+0000","last_change":"2023-10-06T02:57:18.756328+0000","last_active":"2023-10-06T02:57:18.756559+0000","last_peered":"2023-10-06T02:57:18.756559+0000","last_clean":"2023-10-06T02:57:18.756559+0000","last_became_active":"2023-10-06T02:57:18.756114+0000","last_became_peered":"2023-10-06T02:57:18.756114+0000","last_unstale":"2023-10-06T02:57:18.756559+0000","last_undegraded":"2023-10-06T02:57:18.756559+0000","last_fullsized":"2023-10-06T02:57:18.756559+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:46.785916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"179'8","reported_seq":18,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.772147+0000","last_change":"2023-10-06T02:57:17.752287+0000","last_active":"2023-10-06T02:57:18.772147+0000","last_peered":"2023-10-06T02:57:18.772147+0000","last_clean":"2023-10-06T02:57:18.772147+0000","last_became_active":"2023-10-06T02:57:17.752142+0000","last_became_peered":"2023-10-06T02:57:17.752142+0000","last_unstale":"2023-10-06T02:57:18.772147+0000","last_undegraded":"2023-10-06T02:57:18.772147+0000","last_fullsized":"2023-10-06T02:57:18.772147+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:48.392480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":149,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758381+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:57:18.758381+0000","last_peered":"2023-10-06T02:57:18.758381+0000","last_clean":"2023-10-06T02:57:18.758381+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:57:18.758381+0000","last_undegraded":"2023-10-06T02:57:18.758381+0000","last_fullsized":"2023-10-06T02:57:18.758381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.761143+0000","last_change":"2023-10-06T02:57:18.760991+0000","last_active":"2023-10-06T02:57:18.761143+0000","last_peered":"2023-10-06T02:57:18.761143+0000","last_clean":"2023-10-06T02:57:18.761143+0000","last_became_active":"2023-10-06T02:57:18.760685+0000","last_became_peered":"2023-10-06T02:57:18.760685+0000","last_unstale":"2023-10-06T02:57:18.761143+0000","last_undegraded":"2023-10-06T02:57:18.761143+0000","last_fullsized":"2023-10-06T02:57:18.761143+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:09.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770103+0000","last_change":"2023-10-06T02:57:17.760878+0000","last_active":"2023-10-06T02:57:18.770103+0000","last_peered":"2023-10-06T02:57:18.770103+0000","last_clean":"2023-10-06T02:57:18.770103+0000","last_became_active":"2023-10-06T02:57:17.760469+0000","last_became_peered":"2023-10-06T02:57:17.760469+0000","last_unstale":"2023-10-06T02:57:18.770103+0000","last_undegraded":"2023-10-06T02:57:18.770103+0000","last_fullsized":"2023-10-06T02:57:18.770103+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:59.964556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.751731+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:57:18.751731+0000","last_peered":"2023-10-06T02:57:18.751731+0000","last_clean":"2023-10-06T02:57:18.751731+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:57:18.751731+0000","last_undegraded":"2023-10-06T02:57:18.751731+0000","last_fullsized":"2023-10-06T02:57:18.751731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762545+0000","last_change":"2023-10-06T02:57:18.760164+0000","last_active":"2023-10-06T02:57:18.762545+0000","last_peered":"2023-10-06T02:57:18.762545+0000","last_clean":"2023-10-06T02:57:18.762545+0000","last_became_active":"2023-10-06T02:57:18.759526+0000","last_became_peered":"2023-10-06T02:57:18.759526+0000","last_unstale":"2023-10-06T02:57:18.762545+0000","last_undegraded":"2023-10-06T02:57:18.762545+0000","last_fullsized":"2023-10-06T02:57:18.762545+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:00.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760541+0000","last_change":"2023-10-06T02:57:17.755901+0000","last_active":"2023-10-06T02:57:18.760541+0000","last_peered":"2023-10-06T02:57:18.760541+0000","last_clean":"2023-10-06T02:57:18.760541+0000","last_became_active":"2023-10-06T02:57:17.755582+0000","last_became_peered":"2023-10-06T02:57:17.755582+0000","last_unstale":"2023-10-06T02:57:18.760541+0000","last_undegraded":"2023-10-06T02:57:18.760541+0000","last_fullsized":"2023-10-06T02:57:18.760541+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:53.907280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758122+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:57:18.758122+0000","last_peered":"2023-10-06T02:57:18.758122+0000","last_clean":"2023-10-06T02:57:18.758122+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:57:18.758122+0000","last_undegraded":"2023-10-06T02:57:18.758122+0000","last_fullsized":"2023-10-06T02:57:18.758122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193694,"statfs":{"total":200000000,"available":198343316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.314,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.75600000000000001,"5min":0.84299999999999997,"15min":1.393},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.433,"5min":0.33500000000000002,"15min":0.27300000000000002},"max":{"1min":0.60899999999999999,"5min":0.749,"15min":1.081},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.42199999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.78400000000000003,"5min":0.83599999999999997,"15min":1.4710000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.52100000000000002},"min":{"1min":0.52500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":4.8129999999999997},"last":0.502}]},{"osd":3,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.81799999999999995,"15min":3.4870000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.46600000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":2.2349999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.0009999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.78600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.95599999999999996},"last":0.628}]},{"osd":6,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.33200000000000002},"max":{"1min":0.79900000000000004,"5min":0.84999999999999998,"15min":0.85799999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1041,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194271,"statfs":{"total":200000000,"available":198933684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.77400000000000002,"15min":2.8650000000000002},"last":0.496},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.255},"max":{"1min":0.749,"5min":0.749,"15min":1.879},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.92000000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.75},"min":{"1min":0.375,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.30399999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":1.0580000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42799999999999999,"5min":0.33900000000000002,"15min":0.29499999999999998},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":1.163},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47399999999999998,"15min":0.50900000000000001},"min":{"1min":0.377,"5min":0.26700000000000002,"15min":0.23000000000000001},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.05},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.86799999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.497,"15min":0.51300000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.83999999999999997},"last":0.628},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.57099999999999995},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.31900000000000001},"max":{"1min":0.81899999999999995,"5min":0.84899999999999998,"15min":1.0129999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.89500000000000002},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1042,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198932148,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.32100000000000001,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.46200000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.61799999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.33100000000000002},"min":{"1min":0.22500000000000001,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.48599999999999999,"5min":0.51700000000000002,"15min":0.65400000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.377,"15min":0.373},"min":{"1min":0.27200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.498,"5min":0.56899999999999995,"15min":0.63100000000000001},"last":0.372},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.376},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.58399999999999996,"5min":0.628,"15min":0.628},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56799999999999995,"15min":0.54600000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76700000000000002,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":0.753,"5min":1.157,"15min":1.157},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58199999999999996,"15min":0.55500000000000005},"min":{"1min":0.38800000000000001,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.81299999999999994,"5min":0.84099999999999997,"15min":0.92000000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.35799999999999998},"max":{"1min":0.69899999999999995,"5min":0.82299999999999995,"15min":0.96299999999999997},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.40899999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.92000000000000004},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74299999999999999,"5min":0.91400000000000003,"15min":1.006},"last":0.62},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60199999999999998,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77700000000000002,"5min":0.84199999999999997,"15min":0.88200000000000001},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193694,"statfs":{"total":200000000,"available":198343212,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.19900000000000001},"max":{"1min":0.496,"5min":0.496,"15min":1.177},"last":0.38},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.39300000000000002},"min":{"1min":0.28899999999999998,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":0.73999999999999999,"15min":1.3400000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.69199999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.188},"max":{"1min":0.45200000000000001,"5min":0.52300000000000002,"15min":22.038},"last":0.315},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.21299999999999999},"max":{"1min":0.505,"5min":0.77900000000000003,"15min":1.3779999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.28299999999999997,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":1.1439999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40500000000000003,"15min":0.73299999999999998},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.89700000000000002,"15min":21.942},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.32800000000000001},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":1.9390000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.32900000000000001},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":11.122999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.89500000000000002},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.93100000000000005,"15min":22.010999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":1.0980000000000001,"15min":1.401},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59299999999999997,"15min":0.878},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.67700000000000005,"5min":0.83599999999999997,"15min":11.090999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.92300000000000004},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":2.7389999999999999,"15min":21.98},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":1.425},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.755},"min":{"1min":0.436,"5min":0.41799999999999998,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.999,"15min":11.154},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1041,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194271,"statfs":{"total":200000000,"available":198933684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.183,"15min":0.16900000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58699999999999997},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.28399999999999997,"5min":0.224,"15min":0.186},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.60699999999999998},"last":0.25700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.67200000000000004,"15min":0.68200000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.317,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.63500000000000001,"15min":0.84499999999999997},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.28599999999999998,"5min":0.251,"15min":0.23999999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.70999999999999996},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.30099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":1.056},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.83199999999999996,"15min":0.95099999999999996},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.98699999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.2569999999999999},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.33800000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.0660000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.002},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.873,"15min":0.96999999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.0449999999999999},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574987,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198931572,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33500000000000002,"15min":0.318},"min":{"1min":0.22900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.57499999999999996},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61299999999999999,"5min":0.748,"15min":0.84899999999999998},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.34999999999999998},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.66300000000000003,"15min":0.69999999999999996},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.59599999999999997,"5min":0.68500000000000005,"15min":0.71199999999999997},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.29999999999999999,"5min":0.24199999999999999,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.67700000000000005,"15min":3.044},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.378},"min":{"1min":0.32500000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.57899999999999996,"5min":0.70899999999999996,"15min":0.72799999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":2.2120000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.32700000000000001},"max":{"1min":0.83299999999999996,"5min":0.84899999999999998,"15min":2.25},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.376,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.88100000000000001,"15min":6.4189999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.268},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.373,"15min":0.34300000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.218},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.8340000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.77800000000000002},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.86799999999999999,"5min":0.877,"15min":14.912000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.4990000000000001},"last":0.76800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574987,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1042,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194270,"statfs":{"total":200000000,"available":198932948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.27200000000000002,"15min":0.23699999999999999},"max":{"1min":0.76800000000000002,"5min":1.069,"15min":5.8949999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.28999999999999998,"15min":0.221},"max":{"1min":0.746,"5min":1.1639999999999999,"15min":5.3579999999999997},"last":0.45300000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.67200000000000004},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":1.109,"15min":5.9329999999999998},"last":0.625},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":1.2310000000000001,"15min":5.9820000000000002},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.29099999999999998},"max":{"1min":0.755,"5min":1.083,"15min":5.4390000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56399999999999995,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":1.252,"15min":5.3470000000000004},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.70499999999999996,"5min":1.093,"15min":3.4100000000000001},"last":0.501},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":1.1839999999999999,"15min":3.456},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.245},"max":{"1min":0.63600000000000001,"5min":1.036,"15min":1.036},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.496,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.69199999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.50800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61499999999999999,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.68700000000000006,"5min":0.94299999999999995,"15min":1.0489999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61699999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.80000000000000004},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":1.133,"15min":13.173999999999999},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574987,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1041,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194271,"statfs":{"total":200000000,"available":198933560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.219},"max":{"1min":0.65700000000000003,"5min":0.76400000000000001,"15min":0.79100000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":2.0619999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.3540000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.28000000000000003},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":4.6269999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":1.3779999999999999},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.745,"5min":0.75,"15min":0.83799999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.36599999999999999,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.82599999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.89300000000000002},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.76700000000000002,"15min":0.84999999999999998},"last":0.624},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.879},"last":0.45600000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.307,"15min":0.307},"max":{"1min":0.755,"5min":0.877,"15min":0.877},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.56899999999999995}]}]}],"pool_statfs":[]}} 2023-10-06T02:57:22.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:57:22.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.961+0000 7fe941a9d700 1 Processor -- start 2023-10-06T02:57:22.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.961+0000 7fe941a9d700 1 -- start start 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe941a9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe93c159b40 0x7fe93c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe941a9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159f10 0x7fe93c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe941a9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe93c0ccb40 0x7fe93c068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe941a9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c0cee10 con 0x7fe93c0ccb40 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe941a9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c0cd040 con 0x7fe93c159b40 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe941a9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0cd320 con 0x7fe93c159f10 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe94129c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe93c0ccb40 0x7fe93c068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe94129c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe93c0ccb40 0x7fe93c068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37794/0 (socket says 172.21.15.81:37794) 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe94129c700 1 -- 172.21.15.81:0/3548516857 learned_addr learned my addr 172.21.15.81:0/3548516857 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe93bfff700 1 --2- 172.21.15.81:0/3548516857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159f10 0x7fe93c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe940a9b700 1 --2- 172.21.15.81:0/3548516857 >> v2:172.21.15.83:3300/0 conn(0x7fe93c159b40 0x7fe93c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe94129c700 1 -- 172.21.15.81:0/3548516857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159f10 msgr2=0x7fe93c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe94129c700 1 --2- 172.21.15.81:0/3548516857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159f10 0x7fe93c068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe94129c700 1 -- 172.21.15.81:0/3548516857 >> v2:172.21.15.83:3300/0 conn(0x7fe93c159b40 msgr2=0x7fe93c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe94129c700 1 --2- 172.21.15.81:0/3548516857 >> v2:172.21.15.83:3300/0 conn(0x7fe93c159b40 0x7fe93c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe94129c700 1 -- 172.21.15.81:0/3548516857 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c0ce7c0 con 0x7fe93c0ccb40 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe93bfff700 1 --2- 172.21.15.81:0/3548516857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159f10 0x7fe93c068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.962+0000 7fe94129c700 1 --2- 172.21.15.81:0/3548516857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 0x7fe93c068cc0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0d0bc0 tx=0x7fe924009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841d96ebd4ca75a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe93b7fe700 1 -- 172.21.15.81:0/3548516857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400b860 con 0x7fe93c0ccb40 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe93b7fe700 1 -- 172.21.15.81:0/3548516857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92400b9c0 con 0x7fe93c0ccb40 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe93b7fe700 1 -- 172.21.15.81:0/3548516857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400bd60 con 0x7fe93c0ccb40 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe941a9d700 1 -- 172.21.15.81:0/3548516857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 msgr2=0x7fe93c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3548516857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 0x7fe93c068cc0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0d0bc0 tx=0x7fe924009250 comp rx=0 tx=0).stop 2023-10-06T02:57:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe941a9d700 1 -- 172.21.15.81:0/3548516857 shutdown_connections 2023-10-06T02:57:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3548516857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 0x7fe93c068cc0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3548516857 >> v2:172.21.15.83:3300/0 conn(0x7fe93c159b40 0x7fe93c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3548516857 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159f10 0x7fe93c068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe941a9d700 1 -- 172.21.15.81:0/3548516857 >> 172.21.15.81:0/3548516857 conn(0x7fe93c0cd660 msgr2=0x7fe93c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe941a9d700 1 -- 172.21.15.81:0/3548516857 shutdown_connections 2023-10-06T02:57:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.963+0000 7fe941a9d700 1 -- 172.21.15.81:0/3548516857 wait complete. 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.964+0000 7fe941a9d700 1 Processor -- start 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.964+0000 7fe941a9d700 1 -- start start 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe941a9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 0x7fe93c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe941a9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159b40 0x7fe93c0b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe941a9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe93c159f10 0x7fe93c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe941a9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0c9b60 con 0x7fe93c0ccb40 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe941a9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c1564d0 con 0x7fe93c159f10 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe941a9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0c9550 con 0x7fe93c159b40 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe940a9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 0x7fe93c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe940a9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 0x7fe93c155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37808/0 (socket says 172.21.15.81:37808) 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe940a9b700 1 -- 172.21.15.81:0/3680597607 learned_addr learned my addr 172.21.15.81:0/3680597607 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe93bfff700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159b40 0x7fe93c0b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe94129c700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe93c159f10 0x7fe93c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe940a9b700 1 -- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159b40 msgr2=0x7fe93c0b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe940a9b700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159b40 0x7fe93c0b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe940a9b700 1 -- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe93c159f10 msgr2=0x7fe93c154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe940a9b700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe93c159f10 0x7fe93c154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.965+0000 7fe940a9b700 1 -- 172.21.15.81:0/3680597607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9240094f0 con 0x7fe93c0ccb40 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.966+0000 7fe940a9b700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 0x7fe93c155f90 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe93400e1c0 tx=0x7fe934009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.966+0000 7fe938ff9700 1 -- 172.21.15.81:0/3680597607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93400ee60 con 0x7fe93c0ccb40 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.966+0000 7fe938ff9700 1 -- 172.21.15.81:0/3680597607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934014420 con 0x7fe93c0ccb40 2023-10-06T02:57:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.966+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c0b51b0 con 0x7fe93c0ccb40 2023-10-06T02:57:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.966+0000 7fe938ff9700 1 -- 172.21.15.81:0/3680597607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340147e0 con 0x7fe93c0ccb40 2023-10-06T02:57:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.966+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c0c97f0 con 0x7fe93c0ccb40 2023-10-06T02:57:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.967+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c063e90 con 0x7fe93c0ccb40 2023-10-06T02:57:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.967+0000 7fe938ff9700 1 -- 172.21.15.81:0/3680597607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe934014b90 con 0x7fe93c0ccb40 2023-10-06T02:57:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.967+0000 7fe938ff9700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe91c066f30 0x7fe91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.968+0000 7fe938ff9700 1 -- 172.21.15.81:0/3680597607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe934084ee0 con 0x7fe93c0ccb40 2023-10-06T02:57:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.968+0000 7fe93bfff700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe91c066f30 0x7fe91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.968+0000 7fe93bfff700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe91c066f30 0x7fe91c0693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe93c159460 tx=0x7fe92c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:22.972+0000 7fe938ff9700 1 -- 172.21.15.81:0/3680597607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe934051ff0 con 0x7fe93c0ccb40 2023-10-06T02:57:23.059 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-06T02:57:23.058+0000 7f7d448d5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:57:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.149+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe93c0c9ca0 con 0x7fe91c066f30 2023-10-06T02:57:23.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.158+0000 7fe938ff9700 1 -- 172.21.15.81:0/3680597607 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305934 (secure 0 0 0) 0x7fe92c00f630 con 0x7fe91c066f30 2023-10-06T02:57:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:23.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe91c066f30 msgr2=0x7fe91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe91c066f30 0x7fe91c0693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe93c159460 tx=0x7fe92c008040 comp rx=0 tx=0).stop 2023-10-06T02:57:23.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 msgr2=0x7fe93c155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 0x7fe93c155f90 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe93400e1c0 tx=0x7fe934009920 comp rx=0 tx=0).stop 2023-10-06T02:57:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 shutdown_connections 2023-10-06T02:57:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe91c066f30 0x7fe91c0693e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe93c159f10 0x7fe93c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe93c0ccb40 0x7fe93c155f90 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 --2- 172.21.15.81:0/3680597607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe93c159b40 0x7fe93c0b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.161+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 >> 172.21.15.81:0/3680597607 conn(0x7fe93c0cd660 msgr2=0x7fe93c155480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.162+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 shutdown_connections 2023-10-06T02:57:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.162+0000 7fe941a9d700 1 -- 172.21.15.81:0/3680597607 wait complete. 2023-10-06T02:57:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:57:23.175 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":513,"stamp":"2023-10-06T02:57:21.655463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9488,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553011,"statfs":{"total":1600000000,"available":1590284124,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.908119"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759933+0000","last_change":"2023-10-06T02:57:18.759143+0000","last_active":"2023-10-06T02:57:18.759933+0000","last_peered":"2023-10-06T02:57:18.759933+0000","last_clean":"2023-10-06T02:57:18.759933+0000","last_became_active":"2023-10-06T02:57:18.758919+0000","last_became_peered":"2023-10-06T02:57:18.758919+0000","last_unstale":"2023-10-06T02:57:18.759933+0000","last_undegraded":"2023-10-06T02:57:18.759933+0000","last_fullsized":"2023-10-06T02:57:18.759933+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:24.099397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.766651+0000","last_change":"2023-10-06T02:57:18.766584+0000","last_active":"2023-10-06T02:57:18.766651+0000","last_peered":"2023-10-06T02:57:18.766651+0000","last_clean":"2023-10-06T02:57:18.766651+0000","last_became_active":"2023-10-06T02:57:18.765303+0000","last_became_peered":"2023-10-06T02:57:18.765303+0000","last_unstale":"2023-10-06T02:57:18.766651+0000","last_undegraded":"2023-10-06T02:57:18.766651+0000","last_fullsized":"2023-10-06T02:57:18.766651+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:00.923784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.756684+0000","last_change":"2023-10-06T02:57:18.756609+0000","last_active":"2023-10-06T02:57:18.756684+0000","last_peered":"2023-10-06T02:57:18.756684+0000","last_clean":"2023-10-06T02:57:18.756684+0000","last_became_active":"2023-10-06T02:57:18.756366+0000","last_became_peered":"2023-10-06T02:57:18.756366+0000","last_unstale":"2023-10-06T02:57:18.756684+0000","last_undegraded":"2023-10-06T02:57:18.756684+0000","last_fullsized":"2023-10-06T02:57:18.756684+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:02.556384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769505+0000","last_change":"2023-10-06T02:57:18.769335+0000","last_active":"2023-10-06T02:57:18.769505+0000","last_peered":"2023-10-06T02:57:18.769505+0000","last_clean":"2023-10-06T02:57:18.769505+0000","last_became_active":"2023-10-06T02:57:18.768706+0000","last_became_peered":"2023-10-06T02:57:18.768706+0000","last_unstale":"2023-10-06T02:57:18.769505+0000","last_undegraded":"2023-10-06T02:57:18.769505+0000","last_fullsized":"2023-10-06T02:57:18.769505+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:45.086490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760462+0000","last_change":"2023-10-06T02:57:18.757101+0000","last_active":"2023-10-06T02:57:18.760462+0000","last_peered":"2023-10-06T02:57:18.760462+0000","last_clean":"2023-10-06T02:57:18.760462+0000","last_became_active":"2023-10-06T02:57:18.756818+0000","last_became_peered":"2023-10-06T02:57:18.756818+0000","last_unstale":"2023-10-06T02:57:18.760462+0000","last_undegraded":"2023-10-06T02:57:18.760462+0000","last_fullsized":"2023-10-06T02:57:18.760462+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:56.693494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764522+0000","last_change":"2023-10-06T02:57:18.764290+0000","last_active":"2023-10-06T02:57:18.764522+0000","last_peered":"2023-10-06T02:57:18.764522+0000","last_clean":"2023-10-06T02:57:18.764522+0000","last_became_active":"2023-10-06T02:57:18.764111+0000","last_became_peered":"2023-10-06T02:57:18.764111+0000","last_unstale":"2023-10-06T02:57:18.764522+0000","last_undegraded":"2023-10-06T02:57:18.764522+0000","last_fullsized":"2023-10-06T02:57:18.764522+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:37.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760633+0000","last_change":"2023-10-06T02:57:18.759421+0000","last_active":"2023-10-06T02:57:18.760633+0000","last_peered":"2023-10-06T02:57:18.760633+0000","last_clean":"2023-10-06T02:57:18.760633+0000","last_became_active":"2023-10-06T02:57:18.759164+0000","last_became_peered":"2023-10-06T02:57:18.759164+0000","last_unstale":"2023-10-06T02:57:18.760633+0000","last_undegraded":"2023-10-06T02:57:18.760633+0000","last_fullsized":"2023-10-06T02:57:18.760633+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:37.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758614+0000","last_change":"2023-10-06T02:57:18.758410+0000","last_active":"2023-10-06T02:57:18.758614+0000","last_peered":"2023-10-06T02:57:18.758614+0000","last_clean":"2023-10-06T02:57:18.758614+0000","last_became_active":"2023-10-06T02:57:18.757622+0000","last_became_peered":"2023-10-06T02:57:18.757622+0000","last_unstale":"2023-10-06T02:57:18.758614+0000","last_undegraded":"2023-10-06T02:57:18.758614+0000","last_fullsized":"2023-10-06T02:57:18.758614+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:40.607909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765865+0000","last_change":"2023-10-06T02:57:18.765790+0000","last_active":"2023-10-06T02:57:18.765865+0000","last_peered":"2023-10-06T02:57:18.765865+0000","last_clean":"2023-10-06T02:57:18.765865+0000","last_became_active":"2023-10-06T02:57:18.765053+0000","last_became_peered":"2023-10-06T02:57:18.765053+0000","last_unstale":"2023-10-06T02:57:18.765865+0000","last_undegraded":"2023-10-06T02:57:18.765865+0000","last_fullsized":"2023-10-06T02:57:18.765865+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:12.817133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757114+0000","last_change":"2023-10-06T02:57:18.757024+0000","last_active":"2023-10-06T02:57:18.757114+0000","last_peered":"2023-10-06T02:57:18.757114+0000","last_clean":"2023-10-06T02:57:18.757114+0000","last_became_active":"2023-10-06T02:57:18.756803+0000","last_became_peered":"2023-10-06T02:57:18.756803+0000","last_unstale":"2023-10-06T02:57:18.757114+0000","last_undegraded":"2023-10-06T02:57:18.757114+0000","last_fullsized":"2023-10-06T02:57:18.757114+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:47.388963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765757+0000","last_change":"2023-10-06T02:57:18.765698+0000","last_active":"2023-10-06T02:57:18.765757+0000","last_peered":"2023-10-06T02:57:18.765757+0000","last_clean":"2023-10-06T02:57:18.765757+0000","last_became_active":"2023-10-06T02:57:18.765299+0000","last_became_peered":"2023-10-06T02:57:18.765299+0000","last_unstale":"2023-10-06T02:57:18.765757+0000","last_undegraded":"2023-10-06T02:57:18.765757+0000","last_fullsized":"2023-10-06T02:57:18.765757+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:25.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.766500+0000","last_change":"2023-10-06T02:57:18.766446+0000","last_active":"2023-10-06T02:57:18.766500+0000","last_peered":"2023-10-06T02:57:18.766500+0000","last_clean":"2023-10-06T02:57:18.766500+0000","last_became_active":"2023-10-06T02:57:18.765011+0000","last_became_peered":"2023-10-06T02:57:18.765011+0000","last_unstale":"2023-10-06T02:57:18.766500+0000","last_undegraded":"2023-10-06T02:57:18.766500+0000","last_fullsized":"2023-10-06T02:57:18.766500+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:47.388963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767917+0000","last_change":"2023-10-06T02:57:18.766707+0000","last_active":"2023-10-06T02:57:18.767917+0000","last_peered":"2023-10-06T02:57:18.767917+0000","last_clean":"2023-10-06T02:57:18.767917+0000","last_became_active":"2023-10-06T02:57:18.766081+0000","last_became_peered":"2023-10-06T02:57:18.766081+0000","last_unstale":"2023-10-06T02:57:18.767917+0000","last_undegraded":"2023-10-06T02:57:18.767917+0000","last_fullsized":"2023-10-06T02:57:18.767917+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:23.913028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764703+0000","last_change":"2023-10-06T02:57:18.764652+0000","last_active":"2023-10-06T02:57:18.764703+0000","last_peered":"2023-10-06T02:57:18.764703+0000","last_clean":"2023-10-06T02:57:18.764703+0000","last_became_active":"2023-10-06T02:57:18.763952+0000","last_became_peered":"2023-10-06T02:57:18.763952+0000","last_unstale":"2023-10-06T02:57:18.764703+0000","last_undegraded":"2023-10-06T02:57:18.764703+0000","last_fullsized":"2023-10-06T02:57:18.764703+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:47.714847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770783+0000","last_change":"2023-10-06T02:57:18.770703+0000","last_active":"2023-10-06T02:57:18.770783+0000","last_peered":"2023-10-06T02:57:18.770783+0000","last_clean":"2023-10-06T02:57:18.770783+0000","last_became_active":"2023-10-06T02:57:18.770443+0000","last_became_peered":"2023-10-06T02:57:18.770443+0000","last_unstale":"2023-10-06T02:57:18.770783+0000","last_undegraded":"2023-10-06T02:57:18.770783+0000","last_fullsized":"2023-10-06T02:57:18.770783+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:02.556384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770881+0000","last_change":"2023-10-06T02:57:18.770746+0000","last_active":"2023-10-06T02:57:18.770881+0000","last_peered":"2023-10-06T02:57:18.770881+0000","last_clean":"2023-10-06T02:57:18.770881+0000","last_became_active":"2023-10-06T02:57:18.769695+0000","last_became_peered":"2023-10-06T02:57:18.769695+0000","last_unstale":"2023-10-06T02:57:18.770881+0000","last_undegraded":"2023-10-06T02:57:18.770881+0000","last_fullsized":"2023-10-06T02:57:18.770881+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:43.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762585+0000","last_change":"2023-10-06T02:57:18.762116+0000","last_active":"2023-10-06T02:57:18.762585+0000","last_peered":"2023-10-06T02:57:18.762585+0000","last_clean":"2023-10-06T02:57:18.762585+0000","last_became_active":"2023-10-06T02:57:18.761886+0000","last_became_peered":"2023-10-06T02:57:18.761886+0000","last_unstale":"2023-10-06T02:57:18.762585+0000","last_undegraded":"2023-10-06T02:57:18.762585+0000","last_fullsized":"2023-10-06T02:57:18.762585+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:39.969919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762643+0000","last_change":"2023-10-06T02:57:18.762565+0000","last_active":"2023-10-06T02:57:18.762643+0000","last_peered":"2023-10-06T02:57:18.762643+0000","last_clean":"2023-10-06T02:57:18.762643+0000","last_became_active":"2023-10-06T02:57:18.762244+0000","last_became_peered":"2023-10-06T02:57:18.762244+0000","last_unstale":"2023-10-06T02:57:18.762643+0000","last_undegraded":"2023-10-06T02:57:18.762643+0000","last_fullsized":"2023-10-06T02:57:18.762643+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:50.544518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767347+0000","last_change":"2023-10-06T02:57:18.766868+0000","last_active":"2023-10-06T02:57:18.767347+0000","last_peered":"2023-10-06T02:57:18.767347+0000","last_clean":"2023-10-06T02:57:18.767347+0000","last_became_active":"2023-10-06T02:57:18.766650+0000","last_became_peered":"2023-10-06T02:57:18.766650+0000","last_unstale":"2023-10-06T02:57:18.767347+0000","last_undegraded":"2023-10-06T02:57:18.767347+0000","last_fullsized":"2023-10-06T02:57:18.767347+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:49.399422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762659+0000","last_change":"2023-10-06T02:57:18.762115+0000","last_active":"2023-10-06T02:57:18.762659+0000","last_peered":"2023-10-06T02:57:18.762659+0000","last_clean":"2023-10-06T02:57:18.762659+0000","last_became_active":"2023-10-06T02:57:18.761958+0000","last_became_peered":"2023-10-06T02:57:18.761958+0000","last_unstale":"2023-10-06T02:57:18.762659+0000","last_undegraded":"2023-10-06T02:57:18.762659+0000","last_fullsized":"2023-10-06T02:57:18.762659+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:37.103609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765679+0000","last_change":"2023-10-06T02:57:18.765451+0000","last_active":"2023-10-06T02:57:18.765679+0000","last_peered":"2023-10-06T02:57:18.765679+0000","last_clean":"2023-10-06T02:57:18.765679+0000","last_became_active":"2023-10-06T02:57:18.765241+0000","last_became_peered":"2023-10-06T02:57:18.765241+0000","last_unstale":"2023-10-06T02:57:18.765679+0000","last_undegraded":"2023-10-06T02:57:18.765679+0000","last_fullsized":"2023-10-06T02:57:18.765679+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:44.185244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767156+0000","last_change":"2023-10-06T02:57:18.766724+0000","last_active":"2023-10-06T02:57:18.767156+0000","last_peered":"2023-10-06T02:57:18.767156+0000","last_clean":"2023-10-06T02:57:18.767156+0000","last_became_active":"2023-10-06T02:57:18.765675+0000","last_became_peered":"2023-10-06T02:57:18.765675+0000","last_unstale":"2023-10-06T02:57:18.767156+0000","last_undegraded":"2023-10-06T02:57:18.767156+0000","last_fullsized":"2023-10-06T02:57:18.767156+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:39.969919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760483+0000","last_change":"2023-10-06T02:57:18.758721+0000","last_active":"2023-10-06T02:57:18.760483+0000","last_peered":"2023-10-06T02:57:18.760483+0000","last_clean":"2023-10-06T02:57:18.760483+0000","last_became_active":"2023-10-06T02:57:18.758517+0000","last_became_peered":"2023-10-06T02:57:18.758517+0000","last_unstale":"2023-10-06T02:57:18.760483+0000","last_undegraded":"2023-10-06T02:57:18.760483+0000","last_fullsized":"2023-10-06T02:57:18.760483+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:53.250121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769456+0000","last_change":"2023-10-06T02:57:18.768987+0000","last_active":"2023-10-06T02:57:18.769456+0000","last_peered":"2023-10-06T02:57:18.769456+0000","last_clean":"2023-10-06T02:57:18.769456+0000","last_became_active":"2023-10-06T02:57:18.766917+0000","last_became_peered":"2023-10-06T02:57:18.766917+0000","last_unstale":"2023-10-06T02:57:18.769456+0000","last_undegraded":"2023-10-06T02:57:18.769456+0000","last_fullsized":"2023-10-06T02:57:18.769456+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:09.712385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768140+0000","last_change":"2023-10-06T02:57:18.768083+0000","last_active":"2023-10-06T02:57:18.768140+0000","last_peered":"2023-10-06T02:57:18.768140+0000","last_clean":"2023-10-06T02:57:18.768140+0000","last_became_active":"2023-10-06T02:57:18.767564+0000","last_became_peered":"2023-10-06T02:57:18.767564+0000","last_unstale":"2023-10-06T02:57:18.768140+0000","last_undegraded":"2023-10-06T02:57:18.768140+0000","last_fullsized":"2023-10-06T02:57:18.768140+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:15.880927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.763240+0000","last_change":"2023-10-06T02:57:18.763175+0000","last_active":"2023-10-06T02:57:18.763240+0000","last_peered":"2023-10-06T02:57:18.763240+0000","last_clean":"2023-10-06T02:57:18.763240+0000","last_became_active":"2023-10-06T02:57:18.762935+0000","last_became_peered":"2023-10-06T02:57:18.762935+0000","last_unstale":"2023-10-06T02:57:18.763240+0000","last_undegraded":"2023-10-06T02:57:18.763240+0000","last_fullsized":"2023-10-06T02:57:18.763240+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:05.721104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767174+0000","last_change":"2023-10-06T02:57:18.766864+0000","last_active":"2023-10-06T02:57:18.767174+0000","last_peered":"2023-10-06T02:57:18.767174+0000","last_clean":"2023-10-06T02:57:18.767174+0000","last_became_active":"2023-10-06T02:57:18.765948+0000","last_became_peered":"2023-10-06T02:57:18.765948+0000","last_unstale":"2023-10-06T02:57:18.767174+0000","last_undegraded":"2023-10-06T02:57:18.767174+0000","last_fullsized":"2023-10-06T02:57:18.767174+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:16.025689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768681+0000","last_change":"2023-10-06T02:57:18.768626+0000","last_active":"2023-10-06T02:57:18.768681+0000","last_peered":"2023-10-06T02:57:18.768681+0000","last_clean":"2023-10-06T02:57:18.768681+0000","last_became_active":"2023-10-06T02:57:18.768040+0000","last_became_peered":"2023-10-06T02:57:18.768040+0000","last_unstale":"2023-10-06T02:57:18.768681+0000","last_undegraded":"2023-10-06T02:57:18.768681+0000","last_fullsized":"2023-10-06T02:57:18.768681+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:48.807763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769886+0000","last_change":"2023-10-06T02:57:18.769662+0000","last_active":"2023-10-06T02:57:18.769886+0000","last_peered":"2023-10-06T02:57:18.769886+0000","last_clean":"2023-10-06T02:57:18.769886+0000","last_became_active":"2023-10-06T02:57:18.769240+0000","last_became_peered":"2023-10-06T02:57:18.769240+0000","last_unstale":"2023-10-06T02:57:18.769886+0000","last_undegraded":"2023-10-06T02:57:18.769886+0000","last_fullsized":"2023-10-06T02:57:18.769886+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:07.160564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762238+0000","last_change":"2023-10-06T02:57:18.761871+0000","last_active":"2023-10-06T02:57:18.762238+0000","last_peered":"2023-10-06T02:57:18.762238+0000","last_clean":"2023-10-06T02:57:18.762238+0000","last_became_active":"2023-10-06T02:57:18.761633+0000","last_became_peered":"2023-10-06T02:57:18.761633+0000","last_unstale":"2023-10-06T02:57:18.762238+0000","last_undegraded":"2023-10-06T02:57:18.762238+0000","last_fullsized":"2023-10-06T02:57:18.762238+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:35.088209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.763199+0000","last_change":"2023-10-06T02:57:18.763132+0000","last_active":"2023-10-06T02:57:18.763199+0000","last_peered":"2023-10-06T02:57:18.763199+0000","last_clean":"2023-10-06T02:57:18.763199+0000","last_became_active":"2023-10-06T02:57:18.762909+0000","last_became_peered":"2023-10-06T02:57:18.762909+0000","last_unstale":"2023-10-06T02:57:18.763199+0000","last_undegraded":"2023-10-06T02:57:18.763199+0000","last_fullsized":"2023-10-06T02:57:18.763199+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:55.057947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762254+0000","last_change":"2023-10-06T02:57:18.762177+0000","last_active":"2023-10-06T02:57:18.762254+0000","last_peered":"2023-10-06T02:57:18.762254+0000","last_clean":"2023-10-06T02:57:18.762254+0000","last_became_active":"2023-10-06T02:57:18.761959+0000","last_became_peered":"2023-10-06T02:57:18.761959+0000","last_unstale":"2023-10-06T02:57:18.762254+0000","last_undegraded":"2023-10-06T02:57:18.762254+0000","last_fullsized":"2023-10-06T02:57:18.762254+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:51.797949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767781+0000","last_change":"2023-10-06T02:57:18.767712+0000","last_active":"2023-10-06T02:57:18.767781+0000","last_peered":"2023-10-06T02:57:18.767781+0000","last_clean":"2023-10-06T02:57:18.767781+0000","last_became_active":"2023-10-06T02:57:18.767305+0000","last_became_peered":"2023-10-06T02:57:18.767305+0000","last_unstale":"2023-10-06T02:57:18.767781+0000","last_undegraded":"2023-10-06T02:57:18.767781+0000","last_fullsized":"2023-10-06T02:57:18.767781+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:22.800812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"179'4","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.771029+0000","last_change":"2023-10-06T02:57:17.755645+0000","last_active":"2023-10-06T02:57:18.771029+0000","last_peered":"2023-10-06T02:57:18.771029+0000","last_clean":"2023-10-06T02:57:18.771029+0000","last_became_active":"2023-10-06T02:57:17.755386+0000","last_became_peered":"2023-10-06T02:57:17.755386+0000","last_unstale":"2023-10-06T02:57:18.771029+0000","last_undegraded":"2023-10-06T02:57:18.771029+0000","last_fullsized":"2023-10-06T02:57:18.771029+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:17.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765639+0000","last_change":"2023-10-06T02:57:18.762957+0000","last_active":"2023-10-06T02:57:18.765639+0000","last_peered":"2023-10-06T02:57:18.765639+0000","last_clean":"2023-10-06T02:57:18.765639+0000","last_became_active":"2023-10-06T02:57:18.762734+0000","last_became_peered":"2023-10-06T02:57:18.762734+0000","last_unstale":"2023-10-06T02:57:18.765639+0000","last_undegraded":"2023-10-06T02:57:18.765639+0000","last_fullsized":"2023-10-06T02:57:18.765639+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.832858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770363+0000","last_change":"2023-10-06T02:57:17.766288+0000","last_active":"2023-10-06T02:57:18.770363+0000","last_peered":"2023-10-06T02:57:18.770363+0000","last_clean":"2023-10-06T02:57:18.770363+0000","last_became_active":"2023-10-06T02:57:17.765891+0000","last_became_peered":"2023-10-06T02:57:17.765891+0000","last_unstale":"2023-10-06T02:57:18.770363+0000","last_undegraded":"2023-10-06T02:57:18.770363+0000","last_fullsized":"2023-10-06T02:57:18.770363+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:06.153623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760445+0000","last_change":"2023-10-06T02:57:18.757017+0000","last_active":"2023-10-06T02:57:18.760445+0000","last_peered":"2023-10-06T02:57:18.760445+0000","last_clean":"2023-10-06T02:57:18.760445+0000","last_became_active":"2023-10-06T02:57:18.756802+0000","last_became_peered":"2023-10-06T02:57:18.756802+0000","last_unstale":"2023-10-06T02:57:18.760445+0000","last_undegraded":"2023-10-06T02:57:18.760445+0000","last_fullsized":"2023-10-06T02:57:18.760445+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:42.060121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770001+0000","last_change":"2023-10-06T02:57:17.762857+0000","last_active":"2023-10-06T02:57:18.770001+0000","last_peered":"2023-10-06T02:57:18.770001+0000","last_clean":"2023-10-06T02:57:18.770001+0000","last_became_active":"2023-10-06T02:57:17.762607+0000","last_became_peered":"2023-10-06T02:57:17.762607+0000","last_unstale":"2023-10-06T02:57:18.770001+0000","last_undegraded":"2023-10-06T02:57:18.770001+0000","last_fullsized":"2023-10-06T02:57:18.770001+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:22.747087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768973+0000","last_change":"2023-10-06T02:57:18.768720+0000","last_active":"2023-10-06T02:57:18.768973+0000","last_peered":"2023-10-06T02:57:18.768973+0000","last_clean":"2023-10-06T02:57:18.768973+0000","last_became_active":"2023-10-06T02:57:18.768333+0000","last_became_peered":"2023-10-06T02:57:18.768333+0000","last_unstale":"2023-10-06T02:57:18.768973+0000","last_undegraded":"2023-10-06T02:57:18.768973+0000","last_fullsized":"2023-10-06T02:57:18.768973+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:17.866677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.763647+0000","last_change":"2023-10-06T02:57:17.758818+0000","last_active":"2023-10-06T02:57:18.763647+0000","last_peered":"2023-10-06T02:57:18.763647+0000","last_clean":"2023-10-06T02:57:18.763647+0000","last_became_active":"2023-10-06T02:57:17.758587+0000","last_became_peered":"2023-10-06T02:57:17.758587+0000","last_unstale":"2023-10-06T02:57:18.763647+0000","last_undegraded":"2023-10-06T02:57:18.763647+0000","last_fullsized":"2023-10-06T02:57:18.763647+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:14.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757047+0000","last_change":"2023-10-06T02:57:18.756978+0000","last_active":"2023-10-06T02:57:18.757047+0000","last_peered":"2023-10-06T02:57:18.757047+0000","last_clean":"2023-10-06T02:57:18.757047+0000","last_became_active":"2023-10-06T02:57:18.756764+0000","last_became_peered":"2023-10-06T02:57:18.756764+0000","last_unstale":"2023-10-06T02:57:18.757047+0000","last_undegraded":"2023-10-06T02:57:18.757047+0000","last_fullsized":"2023-10-06T02:57:18.757047+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:17.866677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769159+0000","last_change":"2023-10-06T02:57:17.763578+0000","last_active":"2023-10-06T02:57:18.769159+0000","last_peered":"2023-10-06T02:57:18.769159+0000","last_clean":"2023-10-06T02:57:18.769159+0000","last_became_active":"2023-10-06T02:57:17.760867+0000","last_became_peered":"2023-10-06T02:57:17.760867+0000","last_unstale":"2023-10-06T02:57:18.769159+0000","last_undegraded":"2023-10-06T02:57:18.769159+0000","last_fullsized":"2023-10-06T02:57:18.769159+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:42.762638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768020+0000","last_change":"2023-10-06T02:57:18.767311+0000","last_active":"2023-10-06T02:57:18.768020+0000","last_peered":"2023-10-06T02:57:18.768020+0000","last_clean":"2023-10-06T02:57:18.768020+0000","last_became_active":"2023-10-06T02:57:18.767097+0000","last_became_peered":"2023-10-06T02:57:18.767097+0000","last_unstale":"2023-10-06T02:57:18.768020+0000","last_undegraded":"2023-10-06T02:57:18.768020+0000","last_fullsized":"2023-10-06T02:57:18.768020+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:06.589113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770944+0000","last_change":"2023-10-06T02:57:17.760068+0000","last_active":"2023-10-06T02:57:18.770944+0000","last_peered":"2023-10-06T02:57:18.770944+0000","last_clean":"2023-10-06T02:57:18.770944+0000","last_became_active":"2023-10-06T02:57:17.759840+0000","last_became_peered":"2023-10-06T02:57:17.759840+0000","last_unstale":"2023-10-06T02:57:18.770944+0000","last_undegraded":"2023-10-06T02:57:18.770944+0000","last_fullsized":"2023-10-06T02:57:18.770944+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:35.195422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760662+0000","last_change":"2023-10-06T02:57:18.760198+0000","last_active":"2023-10-06T02:57:18.760662+0000","last_peered":"2023-10-06T02:57:18.760662+0000","last_clean":"2023-10-06T02:57:18.760662+0000","last_became_active":"2023-10-06T02:57:18.759960+0000","last_became_peered":"2023-10-06T02:57:18.759960+0000","last_unstale":"2023-10-06T02:57:18.760662+0000","last_undegraded":"2023-10-06T02:57:18.760662+0000","last_fullsized":"2023-10-06T02:57:18.760662+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:54.072409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.755733+0000","last_change":"2023-10-06T02:57:17.763556+0000","last_active":"2023-10-06T02:57:18.755733+0000","last_peered":"2023-10-06T02:57:18.755733+0000","last_clean":"2023-10-06T02:57:18.755733+0000","last_became_active":"2023-10-06T02:57:17.763336+0000","last_became_peered":"2023-10-06T02:57:17.763336+0000","last_unstale":"2023-10-06T02:57:18.755733+0000","last_undegraded":"2023-10-06T02:57:18.755733+0000","last_fullsized":"2023-10-06T02:57:18.755733+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:11.681126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.763194+0000","last_change":"2023-10-06T02:57:18.762827+0000","last_active":"2023-10-06T02:57:18.763194+0000","last_peered":"2023-10-06T02:57:18.763194+0000","last_clean":"2023-10-06T02:57:18.763194+0000","last_became_active":"2023-10-06T02:57:18.762572+0000","last_became_peered":"2023-10-06T02:57:18.762572+0000","last_unstale":"2023-10-06T02:57:18.763194+0000","last_undegraded":"2023-10-06T02:57:18.763194+0000","last_fullsized":"2023-10-06T02:57:18.763194+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:25.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.753540+0000","last_change":"2023-10-06T02:57:17.760843+0000","last_active":"2023-10-06T02:57:18.753540+0000","last_peered":"2023-10-06T02:57:18.753540+0000","last_clean":"2023-10-06T02:57:18.753540+0000","last_became_active":"2023-10-06T02:57:17.759572+0000","last_became_peered":"2023-10-06T02:57:17.759572+0000","last_unstale":"2023-10-06T02:57:18.753540+0000","last_undegraded":"2023-10-06T02:57:18.753540+0000","last_fullsized":"2023-10-06T02:57:18.753540+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:01.549442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765848+0000","last_change":"2023-10-06T02:57:18.765631+0000","last_active":"2023-10-06T02:57:18.765848+0000","last_peered":"2023-10-06T02:57:18.765848+0000","last_clean":"2023-10-06T02:57:18.765848+0000","last_became_active":"2023-10-06T02:57:18.762602+0000","last_became_peered":"2023-10-06T02:57:18.762602+0000","last_unstale":"2023-10-06T02:57:18.765848+0000","last_undegraded":"2023-10-06T02:57:18.765848+0000","last_fullsized":"2023-10-06T02:57:18.765848+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:59.782841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770345+0000","last_change":"2023-10-06T02:57:17.753868+0000","last_active":"2023-10-06T02:57:18.770345+0000","last_peered":"2023-10-06T02:57:18.770345+0000","last_clean":"2023-10-06T02:57:18.770345+0000","last_became_active":"2023-10-06T02:57:17.753356+0000","last_became_peered":"2023-10-06T02:57:17.753356+0000","last_unstale":"2023-10-06T02:57:18.770345+0000","last_undegraded":"2023-10-06T02:57:18.770345+0000","last_fullsized":"2023-10-06T02:57:18.770345+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:16.859735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762507+0000","last_change":"2023-10-06T02:57:18.762450+0000","last_active":"2023-10-06T02:57:18.762507+0000","last_peered":"2023-10-06T02:57:18.762507+0000","last_clean":"2023-10-06T02:57:18.762507+0000","last_became_active":"2023-10-06T02:57:18.761898+0000","last_became_peered":"2023-10-06T02:57:18.761898+0000","last_unstale":"2023-10-06T02:57:18.762507+0000","last_undegraded":"2023-10-06T02:57:18.762507+0000","last_fullsized":"2023-10-06T02:57:18.762507+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:23.754028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769654+0000","last_change":"2023-10-06T02:57:17.764457+0000","last_active":"2023-10-06T02:57:18.769654+0000","last_peered":"2023-10-06T02:57:18.769654+0000","last_clean":"2023-10-06T02:57:18.769654+0000","last_became_active":"2023-10-06T02:57:17.764318+0000","last_became_peered":"2023-10-06T02:57:17.764318+0000","last_unstale":"2023-10-06T02:57:18.769654+0000","last_undegraded":"2023-10-06T02:57:18.769654+0000","last_fullsized":"2023-10-06T02:57:18.769654+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:24.720424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764074+0000","last_change":"2023-10-06T02:57:18.764005+0000","last_active":"2023-10-06T02:57:18.764074+0000","last_peered":"2023-10-06T02:57:18.764074+0000","last_clean":"2023-10-06T02:57:18.764074+0000","last_became_active":"2023-10-06T02:57:18.763780+0000","last_became_peered":"2023-10-06T02:57:18.763780+0000","last_unstale":"2023-10-06T02:57:18.764074+0000","last_undegraded":"2023-10-06T02:57:18.764074+0000","last_fullsized":"2023-10-06T02:57:18.764074+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:43.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.771542+0000","last_change":"2023-10-06T02:57:17.759922+0000","last_active":"2023-10-06T02:57:18.771542+0000","last_peered":"2023-10-06T02:57:18.771542+0000","last_clean":"2023-10-06T02:57:18.771542+0000","last_became_active":"2023-10-06T02:57:17.759688+0000","last_became_peered":"2023-10-06T02:57:17.759688+0000","last_unstale":"2023-10-06T02:57:18.771542+0000","last_undegraded":"2023-10-06T02:57:18.771542+0000","last_fullsized":"2023-10-06T02:57:18.771542+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:03.540465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765711+0000","last_change":"2023-10-06T02:57:18.765527+0000","last_active":"2023-10-06T02:57:18.765711+0000","last_peered":"2023-10-06T02:57:18.765711+0000","last_clean":"2023-10-06T02:57:18.765711+0000","last_became_active":"2023-10-06T02:57:18.765009+0000","last_became_peered":"2023-10-06T02:57:18.765009+0000","last_unstale":"2023-10-06T02:57:18.765711+0000","last_undegraded":"2023-10-06T02:57:18.765711+0000","last_fullsized":"2023-10-06T02:57:18.765711+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:24.099397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.751775+0000","last_change":"2023-10-06T02:57:17.763448+0000","last_active":"2023-10-06T02:57:18.751775+0000","last_peered":"2023-10-06T02:57:18.751775+0000","last_clean":"2023-10-06T02:57:18.751775+0000","last_became_active":"2023-10-06T02:57:17.760577+0000","last_became_peered":"2023-10-06T02:57:17.760577+0000","last_unstale":"2023-10-06T02:57:18.751775+0000","last_undegraded":"2023-10-06T02:57:18.751775+0000","last_fullsized":"2023-10-06T02:57:18.751775+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:23.092455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767974+0000","last_change":"2023-10-06T02:57:18.767789+0000","last_active":"2023-10-06T02:57:18.767974+0000","last_peered":"2023-10-06T02:57:18.767974+0000","last_clean":"2023-10-06T02:57:18.767974+0000","last_became_active":"2023-10-06T02:57:18.766964+0000","last_became_peered":"2023-10-06T02:57:18.766964+0000","last_unstale":"2023-10-06T02:57:18.767974+0000","last_undegraded":"2023-10-06T02:57:18.767974+0000","last_fullsized":"2023-10-06T02:57:18.767974+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:03.995864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.771465+0000","last_change":"2023-10-06T02:57:17.759435+0000","last_active":"2023-10-06T02:57:18.771465+0000","last_peered":"2023-10-06T02:57:18.771465+0000","last_clean":"2023-10-06T02:57:18.771465+0000","last_became_active":"2023-10-06T02:57:17.759215+0000","last_became_peered":"2023-10-06T02:57:17.759215+0000","last_unstale":"2023-10-06T02:57:18.771465+0000","last_undegraded":"2023-10-06T02:57:18.771465+0000","last_fullsized":"2023-10-06T02:57:18.771465+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:16.551154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764846+0000","last_change":"2023-10-06T02:57:18.764788+0000","last_active":"2023-10-06T02:57:18.764846+0000","last_peered":"2023-10-06T02:57:18.764846+0000","last_clean":"2023-10-06T02:57:18.764846+0000","last_became_active":"2023-10-06T02:57:18.764446+0000","last_became_peered":"2023-10-06T02:57:18.764446+0000","last_unstale":"2023-10-06T02:57:18.764846+0000","last_undegraded":"2023-10-06T02:57:18.764846+0000","last_fullsized":"2023-10-06T02:57:18.764846+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:10.306074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759843+0000","last_change":"2023-10-06T02:57:17.752788+0000","last_active":"2023-10-06T02:57:18.759843+0000","last_peered":"2023-10-06T02:57:18.759843+0000","last_clean":"2023-10-06T02:57:18.759843+0000","last_became_active":"2023-10-06T02:57:17.752130+0000","last_became_peered":"2023-10-06T02:57:17.752130+0000","last_unstale":"2023-10-06T02:57:18.759843+0000","last_undegraded":"2023-10-06T02:57:18.759843+0000","last_fullsized":"2023-10-06T02:57:18.759843+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:11.803409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760415+0000","last_change":"2023-10-06T02:57:18.756498+0000","last_active":"2023-10-06T02:57:18.760415+0000","last_peered":"2023-10-06T02:57:18.760415+0000","last_clean":"2023-10-06T02:57:18.760415+0000","last_became_active":"2023-10-06T02:57:18.756307+0000","last_became_peered":"2023-10-06T02:57:18.756307+0000","last_unstale":"2023-10-06T02:57:18.760415+0000","last_undegraded":"2023-10-06T02:57:18.760415+0000","last_fullsized":"2023-10-06T02:57:18.760415+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:10.545091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.754382+0000","last_change":"2023-10-06T02:57:17.763735+0000","last_active":"2023-10-06T02:57:18.754382+0000","last_peered":"2023-10-06T02:57:18.754382+0000","last_clean":"2023-10-06T02:57:18.754382+0000","last_became_active":"2023-10-06T02:57:17.763370+0000","last_became_peered":"2023-10-06T02:57:17.763370+0000","last_unstale":"2023-10-06T02:57:18.754382+0000","last_undegraded":"2023-10-06T02:57:18.754382+0000","last_fullsized":"2023-10-06T02:57:18.754382+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:09.587038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767189+0000","last_change":"2023-10-06T02:57:18.766999+0000","last_active":"2023-10-06T02:57:18.767189+0000","last_peered":"2023-10-06T02:57:18.767189+0000","last_clean":"2023-10-06T02:57:18.767189+0000","last_became_active":"2023-10-06T02:57:18.766241+0000","last_became_peered":"2023-10-06T02:57:18.766241+0000","last_unstale":"2023-10-06T02:57:18.767189+0000","last_undegraded":"2023-10-06T02:57:18.767189+0000","last_fullsized":"2023-10-06T02:57:18.767189+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:37.341812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759878+0000","last_change":"2023-10-06T02:57:17.759753+0000","last_active":"2023-10-06T02:57:18.759878+0000","last_peered":"2023-10-06T02:57:18.759878+0000","last_clean":"2023-10-06T02:57:18.759878+0000","last_became_active":"2023-10-06T02:57:17.759519+0000","last_became_peered":"2023-10-06T02:57:17.759519+0000","last_unstale":"2023-10-06T02:57:18.759878+0000","last_undegraded":"2023-10-06T02:57:18.759878+0000","last_fullsized":"2023-10-06T02:57:18.759878+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:01.549442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762662+0000","last_change":"2023-10-06T02:57:18.762162+0000","last_active":"2023-10-06T02:57:18.762662+0000","last_peered":"2023-10-06T02:57:18.762662+0000","last_clean":"2023-10-06T02:57:18.762662+0000","last_became_active":"2023-10-06T02:57:18.761934+0000","last_became_peered":"2023-10-06T02:57:18.761934+0000","last_unstale":"2023-10-06T02:57:18.762662+0000","last_undegraded":"2023-10-06T02:57:18.762662+0000","last_fullsized":"2023-10-06T02:57:18.762662+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:14.579745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770706+0000","last_change":"2023-10-06T02:57:17.760855+0000","last_active":"2023-10-06T02:57:18.770706+0000","last_peered":"2023-10-06T02:57:18.770706+0000","last_clean":"2023-10-06T02:57:18.770706+0000","last_became_active":"2023-10-06T02:57:17.760634+0000","last_became_peered":"2023-10-06T02:57:17.760634+0000","last_unstale":"2023-10-06T02:57:18.770706+0000","last_undegraded":"2023-10-06T02:57:18.770706+0000","last_fullsized":"2023-10-06T02:57:18.770706+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:02.988923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769043+0000","last_change":"2023-10-06T02:57:18.768140+0000","last_active":"2023-10-06T02:57:18.769043+0000","last_peered":"2023-10-06T02:57:18.769043+0000","last_clean":"2023-10-06T02:57:18.769043+0000","last_became_active":"2023-10-06T02:57:18.762982+0000","last_became_peered":"2023-10-06T02:57:18.762982+0000","last_unstale":"2023-10-06T02:57:18.769043+0000","last_undegraded":"2023-10-06T02:57:18.769043+0000","last_fullsized":"2023-10-06T02:57:18.769043+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:37.341812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762020+0000","last_change":"2023-10-06T02:57:17.754368+0000","last_active":"2023-10-06T02:57:18.762020+0000","last_peered":"2023-10-06T02:57:18.762020+0000","last_clean":"2023-10-06T02:57:18.762020+0000","last_became_active":"2023-10-06T02:57:17.754133+0000","last_became_peered":"2023-10-06T02:57:17.754133+0000","last_unstale":"2023-10-06T02:57:18.762020+0000","last_undegraded":"2023-10-06T02:57:18.762020+0000","last_fullsized":"2023-10-06T02:57:18.762020+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:22:30.350123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758651+0000","last_change":"2023-10-06T02:57:18.758416+0000","last_active":"2023-10-06T02:57:18.758651+0000","last_peered":"2023-10-06T02:57:18.758651+0000","last_clean":"2023-10-06T02:57:18.758651+0000","last_became_active":"2023-10-06T02:57:18.758213+0000","last_became_peered":"2023-10-06T02:57:18.758213+0000","last_unstale":"2023-10-06T02:57:18.758651+0000","last_undegraded":"2023-10-06T02:57:18.758651+0000","last_fullsized":"2023-10-06T02:57:18.758651+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:58.957661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758622+0000","last_change":"2023-10-06T02:57:17.757932+0000","last_active":"2023-10-06T02:57:18.758622+0000","last_peered":"2023-10-06T02:57:18.758622+0000","last_clean":"2023-10-06T02:57:18.758622+0000","last_became_active":"2023-10-06T02:57:17.757693+0000","last_became_peered":"2023-10-06T02:57:17.757693+0000","last_unstale":"2023-10-06T02:57:18.758622+0000","last_undegraded":"2023-10-06T02:57:18.758622+0000","last_fullsized":"2023-10-06T02:57:18.758622+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:59.916842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758625+0000","last_change":"2023-10-06T02:57:18.758536+0000","last_active":"2023-10-06T02:57:18.758625+0000","last_peered":"2023-10-06T02:57:18.758625+0000","last_clean":"2023-10-06T02:57:18.758625+0000","last_became_active":"2023-10-06T02:57:18.757847+0000","last_became_peered":"2023-10-06T02:57:18.757847+0000","last_unstale":"2023-10-06T02:57:18.758625+0000","last_undegraded":"2023-10-06T02:57:18.758625+0000","last_fullsized":"2023-10-06T02:57:18.758625+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:00.923784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.754469+0000","last_change":"2023-10-06T02:57:17.765809+0000","last_active":"2023-10-06T02:57:18.754469+0000","last_peered":"2023-10-06T02:57:18.754469+0000","last_clean":"2023-10-06T02:57:18.754469+0000","last_became_active":"2023-10-06T02:57:17.765357+0000","last_became_peered":"2023-10-06T02:57:17.765357+0000","last_unstale":"2023-10-06T02:57:18.754469+0000","last_undegraded":"2023-10-06T02:57:18.754469+0000","last_fullsized":"2023-10-06T02:57:18.754469+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:19.830691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769438+0000","last_change":"2023-10-06T02:57:18.768657+0000","last_active":"2023-10-06T02:57:18.769438+0000","last_peered":"2023-10-06T02:57:18.769438+0000","last_clean":"2023-10-06T02:57:18.769438+0000","last_became_active":"2023-10-06T02:57:18.765954+0000","last_became_peered":"2023-10-06T02:57:18.765954+0000","last_unstale":"2023-10-06T02:57:18.769438+0000","last_undegraded":"2023-10-06T02:57:18.769438+0000","last_fullsized":"2023-10-06T02:57:18.769438+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:49.399422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.755849+0000","last_change":"2023-10-06T02:57:17.759792+0000","last_active":"2023-10-06T02:57:18.755849+0000","last_peered":"2023-10-06T02:57:18.755849+0000","last_clean":"2023-10-06T02:57:18.755849+0000","last_became_active":"2023-10-06T02:57:17.759439+0000","last_became_peered":"2023-10-06T02:57:17.759439+0000","last_unstale":"2023-10-06T02:57:18.755849+0000","last_undegraded":"2023-10-06T02:57:18.755849+0000","last_fullsized":"2023-10-06T02:57:18.755849+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:43.890309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768991+0000","last_change":"2023-10-06T02:57:18.768822+0000","last_active":"2023-10-06T02:57:18.768991+0000","last_peered":"2023-10-06T02:57:18.768991+0000","last_clean":"2023-10-06T02:57:18.768991+0000","last_became_active":"2023-10-06T02:57:18.768595+0000","last_became_peered":"2023-10-06T02:57:18.768595+0000","last_unstale":"2023-10-06T02:57:18.768991+0000","last_undegraded":"2023-10-06T02:57:18.768991+0000","last_fullsized":"2023-10-06T02:57:18.768991+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:59.782841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757469+0000","last_change":"2023-10-06T02:57:17.761035+0000","last_active":"2023-10-06T02:57:18.757469+0000","last_peered":"2023-10-06T02:57:18.757469+0000","last_clean":"2023-10-06T02:57:18.757469+0000","last_became_active":"2023-10-06T02:57:17.760823+0000","last_became_peered":"2023-10-06T02:57:17.760823+0000","last_unstale":"2023-10-06T02:57:18.757469+0000","last_undegraded":"2023-10-06T02:57:18.757469+0000","last_fullsized":"2023-10-06T02:57:18.757469+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:57.550090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.767990+0000","last_change":"2023-10-06T02:57:18.767944+0000","last_active":"2023-10-06T02:57:18.767990+0000","last_peered":"2023-10-06T02:57:18.767990+0000","last_clean":"2023-10-06T02:57:18.767990+0000","last_became_active":"2023-10-06T02:57:18.767266+0000","last_became_peered":"2023-10-06T02:57:18.767266+0000","last_unstale":"2023-10-06T02:57:18.767990+0000","last_undegraded":"2023-10-06T02:57:18.767990+0000","last_fullsized":"2023-10-06T02:57:18.767990+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:17.558096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757862+0000","last_change":"2023-10-06T02:57:17.762755+0000","last_active":"2023-10-06T02:57:18.757862+0000","last_peered":"2023-10-06T02:57:18.757862+0000","last_clean":"2023-10-06T02:57:18.757862+0000","last_became_active":"2023-10-06T02:57:17.762491+0000","last_became_peered":"2023-10-06T02:57:17.762491+0000","last_unstale":"2023-10-06T02:57:18.757862+0000","last_undegraded":"2023-10-06T02:57:18.757862+0000","last_fullsized":"2023-10-06T02:57:18.757862+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:15.596581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759293+0000","last_change":"2023-10-06T02:57:18.759055+0000","last_active":"2023-10-06T02:57:18.759293+0000","last_peered":"2023-10-06T02:57:18.759293+0000","last_clean":"2023-10-06T02:57:18.759293+0000","last_became_active":"2023-10-06T02:57:18.758828+0000","last_became_peered":"2023-10-06T02:57:18.758828+0000","last_unstale":"2023-10-06T02:57:18.759293+0000","last_undegraded":"2023-10-06T02:57:18.759293+0000","last_fullsized":"2023-10-06T02:57:18.759293+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:27.605592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.753968+0000","last_change":"2023-10-06T02:57:17.762254+0000","last_active":"2023-10-06T02:57:18.753968+0000","last_peered":"2023-10-06T02:57:18.753968+0000","last_clean":"2023-10-06T02:57:18.753968+0000","last_became_active":"2023-10-06T02:57:17.761854+0000","last_became_peered":"2023-10-06T02:57:17.761854+0000","last_unstale":"2023-10-06T02:57:18.753968+0000","last_undegraded":"2023-10-06T02:57:18.753968+0000","last_fullsized":"2023-10-06T02:57:18.753968+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:36.334871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.769197+0000","last_change":"2023-10-06T02:57:18.768758+0000","last_active":"2023-10-06T02:57:18.769197+0000","last_peered":"2023-10-06T02:57:18.769197+0000","last_clean":"2023-10-06T02:57:18.769197+0000","last_became_active":"2023-10-06T02:57:18.768515+0000","last_became_peered":"2023-10-06T02:57:18.768515+0000","last_unstale":"2023-10-06T02:57:18.769197+0000","last_undegraded":"2023-10-06T02:57:18.769197+0000","last_fullsized":"2023-10-06T02:57:18.769197+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:09.712385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759486+0000","last_change":"2023-10-06T02:57:17.758907+0000","last_active":"2023-10-06T02:57:18.759486+0000","last_peered":"2023-10-06T02:57:18.759486+0000","last_clean":"2023-10-06T02:57:18.759486+0000","last_became_active":"2023-10-06T02:57:17.758681+0000","last_became_peered":"2023-10-06T02:57:17.758681+0000","last_unstale":"2023-10-06T02:57:18.759486+0000","last_undegraded":"2023-10-06T02:57:18.759486+0000","last_fullsized":"2023-10-06T02:57:18.759486+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:48.946727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.753695+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:57:18.753695+0000","last_peered":"2023-10-06T02:57:18.753695+0000","last_clean":"2023-10-06T02:57:18.753695+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:57:18.753695+0000","last_undegraded":"2023-10-06T02:57:18.753695+0000","last_fullsized":"2023-10-06T02:57:18.753695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768955+0000","last_change":"2023-10-06T02:57:18.768562+0000","last_active":"2023-10-06T02:57:18.768955+0000","last_peered":"2023-10-06T02:57:18.768955+0000","last_clean":"2023-10-06T02:57:18.768955+0000","last_became_active":"2023-10-06T02:57:18.768030+0000","last_became_peered":"2023-10-06T02:57:18.768030+0000","last_unstale":"2023-10-06T02:57:18.768955+0000","last_undegraded":"2023-10-06T02:57:18.768955+0000","last_fullsized":"2023-10-06T02:57:18.768955+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:12.817133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760459+0000","last_change":"2023-10-06T02:57:17.754413+0000","last_active":"2023-10-06T02:57:18.760459+0000","last_peered":"2023-10-06T02:57:18.760459+0000","last_clean":"2023-10-06T02:57:18.760459+0000","last_became_active":"2023-10-06T02:57:17.754205+0000","last_became_peered":"2023-10-06T02:57:17.754205+0000","last_unstale":"2023-10-06T02:57:18.760459+0000","last_undegraded":"2023-10-06T02:57:18.760459+0000","last_fullsized":"2023-10-06T02:57:18.760459+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:21.793870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.759573+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:57:18.759573+0000","last_peered":"2023-10-06T02:57:18.759573+0000","last_clean":"2023-10-06T02:57:18.759573+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:57:18.759573+0000","last_undegraded":"2023-10-06T02:57:18.759573+0000","last_fullsized":"2023-10-06T02:57:18.759573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.764571+0000","last_change":"2023-10-06T02:57:18.764514+0000","last_active":"2023-10-06T02:57:18.764571+0000","last_peered":"2023-10-06T02:57:18.764571+0000","last_clean":"2023-10-06T02:57:18.764571+0000","last_became_active":"2023-10-06T02:57:18.764309+0000","last_became_peered":"2023-10-06T02:57:18.764309+0000","last_unstale":"2023-10-06T02:57:18.764571+0000","last_undegraded":"2023-10-06T02:57:18.764571+0000","last_fullsized":"2023-10-06T02:57:18.764571+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:03.357453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"179'6","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.772533+0000","last_change":"2023-10-06T02:57:17.753997+0000","last_active":"2023-10-06T02:57:18.772533+0000","last_peered":"2023-10-06T02:57:18.772533+0000","last_clean":"2023-10-06T02:57:18.772533+0000","last_became_active":"2023-10-06T02:57:17.753643+0000","last_became_peered":"2023-10-06T02:57:17.753643+0000","last_unstale":"2023-10-06T02:57:18.772533+0000","last_undegraded":"2023-10-06T02:57:18.772533+0000","last_fullsized":"2023-10-06T02:57:18.772533+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:11.810191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.754478+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:57:18.754478+0000","last_peered":"2023-10-06T02:57:18.754478+0000","last_clean":"2023-10-06T02:57:18.754478+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:57:18.754478+0000","last_undegraded":"2023-10-06T02:57:18.754478+0000","last_fullsized":"2023-10-06T02:57:18.754478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.765517+0000","last_change":"2023-10-06T02:57:18.765442+0000","last_active":"2023-10-06T02:57:18.765517+0000","last_peered":"2023-10-06T02:57:18.765517+0000","last_clean":"2023-10-06T02:57:18.765517+0000","last_became_active":"2023-10-06T02:57:18.765212+0000","last_became_peered":"2023-10-06T02:57:18.765212+0000","last_unstale":"2023-10-06T02:57:18.765517+0000","last_undegraded":"2023-10-06T02:57:18.765517+0000","last_fullsized":"2023-10-06T02:57:18.765517+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:00.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757390+0000","last_change":"2023-10-06T02:57:17.753910+0000","last_active":"2023-10-06T02:57:18.757390+0000","last_peered":"2023-10-06T02:57:18.757390+0000","last_clean":"2023-10-06T02:57:18.757390+0000","last_became_active":"2023-10-06T02:57:17.753677+0000","last_became_peered":"2023-10-06T02:57:17.753677+0000","last_unstale":"2023-10-06T02:57:18.757390+0000","last_undegraded":"2023-10-06T02:57:18.757390+0000","last_fullsized":"2023-10-06T02:57:18.757390+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:39.600967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":169,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760962+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:57:18.760962+0000","last_peered":"2023-10-06T02:57:18.760962+0000","last_clean":"2023-10-06T02:57:18.760962+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:57:18.760962+0000","last_undegraded":"2023-10-06T02:57:18.760962+0000","last_fullsized":"2023-10-06T02:57:18.760962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":303,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758287+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:57:18.758287+0000","last_peered":"2023-10-06T02:57:18.758287+0000","last_clean":"2023-10-06T02:57:18.758287+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:57:18.758287+0000","last_undegraded":"2023-10-06T02:57:18.758287+0000","last_fullsized":"2023-10-06T02:57:18.758287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.768335+0000","last_change":"2023-10-06T02:57:18.768275+0000","last_active":"2023-10-06T02:57:18.768335+0000","last_peered":"2023-10-06T02:57:18.768335+0000","last_clean":"2023-10-06T02:57:18.768335+0000","last_became_active":"2023-10-06T02:57:18.766493+0000","last_became_peered":"2023-10-06T02:57:18.766493+0000","last_unstale":"2023-10-06T02:57:18.768335+0000","last_undegraded":"2023-10-06T02:57:18.768335+0000","last_fullsized":"2023-10-06T02:57:18.768335+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:36.202364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"179'3","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770826+0000","last_change":"2023-10-06T02:57:17.761840+0000","last_active":"2023-10-06T02:57:18.770826+0000","last_peered":"2023-10-06T02:57:18.770826+0000","last_clean":"2023-10-06T02:57:18.770826+0000","last_became_active":"2023-10-06T02:57:17.761586+0000","last_became_peered":"2023-10-06T02:57:17.761586+0000","last_unstale":"2023-10-06T02:57:18.770826+0000","last_undegraded":"2023-10-06T02:57:18.770826+0000","last_fullsized":"2023-10-06T02:57:18.770826+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:14.896556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.757825+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:57:18.757825+0000","last_peered":"2023-10-06T02:57:18.757825+0000","last_clean":"2023-10-06T02:57:18.757825+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:57:18.757825+0000","last_undegraded":"2023-10-06T02:57:18.757825+0000","last_fullsized":"2023-10-06T02:57:18.757825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.756559+0000","last_change":"2023-10-06T02:57:18.756328+0000","last_active":"2023-10-06T02:57:18.756559+0000","last_peered":"2023-10-06T02:57:18.756559+0000","last_clean":"2023-10-06T02:57:18.756559+0000","last_became_active":"2023-10-06T02:57:18.756114+0000","last_became_peered":"2023-10-06T02:57:18.756114+0000","last_unstale":"2023-10-06T02:57:18.756559+0000","last_undegraded":"2023-10-06T02:57:18.756559+0000","last_fullsized":"2023-10-06T02:57:18.756559+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:46.785916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"179'8","reported_seq":18,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.772147+0000","last_change":"2023-10-06T02:57:17.752287+0000","last_active":"2023-10-06T02:57:18.772147+0000","last_peered":"2023-10-06T02:57:18.772147+0000","last_clean":"2023-10-06T02:57:18.772147+0000","last_became_active":"2023-10-06T02:57:17.752142+0000","last_became_peered":"2023-10-06T02:57:17.752142+0000","last_unstale":"2023-10-06T02:57:18.772147+0000","last_undegraded":"2023-10-06T02:57:18.772147+0000","last_fullsized":"2023-10-06T02:57:18.772147+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:48.392480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":149,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758381+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:57:18.758381+0000","last_peered":"2023-10-06T02:57:18.758381+0000","last_clean":"2023-10-06T02:57:18.758381+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:57:18.758381+0000","last_undegraded":"2023-10-06T02:57:18.758381+0000","last_fullsized":"2023-10-06T02:57:18.758381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.761143+0000","last_change":"2023-10-06T02:57:18.760991+0000","last_active":"2023-10-06T02:57:18.761143+0000","last_peered":"2023-10-06T02:57:18.761143+0000","last_clean":"2023-10-06T02:57:18.761143+0000","last_became_active":"2023-10-06T02:57:18.760685+0000","last_became_peered":"2023-10-06T02:57:18.760685+0000","last_unstale":"2023-10-06T02:57:18.761143+0000","last_undegraded":"2023-10-06T02:57:18.761143+0000","last_fullsized":"2023-10-06T02:57:18.761143+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:09.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.770103+0000","last_change":"2023-10-06T02:57:17.760878+0000","last_active":"2023-10-06T02:57:18.770103+0000","last_peered":"2023-10-06T02:57:18.770103+0000","last_clean":"2023-10-06T02:57:18.770103+0000","last_became_active":"2023-10-06T02:57:17.760469+0000","last_became_peered":"2023-10-06T02:57:17.760469+0000","last_unstale":"2023-10-06T02:57:18.770103+0000","last_undegraded":"2023-10-06T02:57:18.770103+0000","last_fullsized":"2023-10-06T02:57:18.770103+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:59.964556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.751731+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:57:18.751731+0000","last_peered":"2023-10-06T02:57:18.751731+0000","last_clean":"2023-10-06T02:57:18.751731+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:57:18.751731+0000","last_undegraded":"2023-10-06T02:57:18.751731+0000","last_fullsized":"2023-10-06T02:57:18.751731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.762545+0000","last_change":"2023-10-06T02:57:18.760164+0000","last_active":"2023-10-06T02:57:18.762545+0000","last_peered":"2023-10-06T02:57:18.762545+0000","last_clean":"2023-10-06T02:57:18.762545+0000","last_became_active":"2023-10-06T02:57:18.759526+0000","last_became_peered":"2023-10-06T02:57:18.759526+0000","last_unstale":"2023-10-06T02:57:18.762545+0000","last_undegraded":"2023-10-06T02:57:18.762545+0000","last_fullsized":"2023-10-06T02:57:18.762545+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:17.744465+0000","last_clean_scrub_stamp":"2023-10-06T02:57:17.744465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:00.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.760541+0000","last_change":"2023-10-06T02:57:17.755901+0000","last_active":"2023-10-06T02:57:18.760541+0000","last_peered":"2023-10-06T02:57:18.760541+0000","last_clean":"2023-10-06T02:57:18.760541+0000","last_became_active":"2023-10-06T02:57:17.755582+0000","last_became_peered":"2023-10-06T02:57:17.755582+0000","last_unstale":"2023-10-06T02:57:18.760541+0000","last_undegraded":"2023-10-06T02:57:18.760541+0000","last_fullsized":"2023-10-06T02:57:18.760541+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:16.737524+0000","last_clean_scrub_stamp":"2023-10-06T02:57:16.737524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:53.907280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-06T02:57:18.758122+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:57:18.758122+0000","last_peered":"2023-10-06T02:57:18.758122+0000","last_clean":"2023-10-06T02:57:18.758122+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:57:18.758122+0000","last_undegraded":"2023-10-06T02:57:18.758122+0000","last_fullsized":"2023-10-06T02:57:18.758122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193694,"statfs":{"total":200000000,"available":198343316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.314,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.75600000000000001,"5min":0.84299999999999997,"15min":1.393},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.433,"5min":0.33500000000000002,"15min":0.27300000000000002},"max":{"1min":0.60899999999999999,"5min":0.749,"15min":1.081},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.42199999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.78400000000000003,"5min":0.83599999999999997,"15min":1.4710000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.52100000000000002},"min":{"1min":0.52500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":4.8129999999999997},"last":0.502}]},{"osd":3,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.81799999999999995,"15min":3.4870000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.46600000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":2.2349999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.0009999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.78600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.95599999999999996},"last":0.628}]},{"osd":6,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.33200000000000002},"max":{"1min":0.79900000000000004,"5min":0.84999999999999998,"15min":0.85799999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1041,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194271,"statfs":{"total":200000000,"available":198933684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.77400000000000002,"15min":2.8650000000000002},"last":0.496},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.255},"max":{"1min":0.749,"5min":0.749,"15min":1.879},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.92000000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.75},"min":{"1min":0.375,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.30399999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":1.0580000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42799999999999999,"5min":0.33900000000000002,"15min":0.29499999999999998},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":1.163},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47399999999999998,"15min":0.50900000000000001},"min":{"1min":0.377,"5min":0.26700000000000002,"15min":0.23000000000000001},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.05},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.86799999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.497,"15min":0.51300000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.83999999999999997},"last":0.628},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.57099999999999995},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.31900000000000001},"max":{"1min":0.81899999999999995,"5min":0.84899999999999998,"15min":1.0129999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.89500000000000002},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1042,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198932148,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.32100000000000001,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.46200000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.61799999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.33100000000000002},"min":{"1min":0.22500000000000001,"5min":0.21099999999999999,"15min":0.20599999999999999},"max":{"1min":0.48599999999999999,"5min":0.51700000000000002,"15min":0.65400000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.377,"15min":0.373},"min":{"1min":0.27200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.498,"5min":0.56899999999999995,"15min":0.63100000000000001},"last":0.372},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.376},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.58399999999999996,"5min":0.628,"15min":0.628},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56799999999999995,"15min":0.54600000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76700000000000002,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":0.753,"5min":1.157,"15min":1.157},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58199999999999996,"15min":0.55500000000000005},"min":{"1min":0.38800000000000001,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.81299999999999994,"5min":0.84099999999999997,"15min":0.92000000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.35799999999999998},"max":{"1min":0.69899999999999995,"5min":0.82299999999999995,"15min":0.96299999999999997},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.40899999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.92000000000000004},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74299999999999999,"5min":0.91400000000000003,"15min":1.006},"last":0.62},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60199999999999998,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77700000000000002,"5min":0.84199999999999997,"15min":0.88200000000000001},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193694,"statfs":{"total":200000000,"available":198343212,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.19900000000000001},"max":{"1min":0.496,"5min":0.496,"15min":1.177},"last":0.38},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.39300000000000002},"min":{"1min":0.28899999999999998,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":0.73999999999999999,"15min":1.3400000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.69199999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.188},"max":{"1min":0.45200000000000001,"5min":0.52300000000000002,"15min":22.038},"last":0.315},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.21299999999999999},"max":{"1min":0.505,"5min":0.77900000000000003,"15min":1.3779999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.28299999999999997,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":1.1439999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40500000000000003,"15min":0.73299999999999998},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.89700000000000002,"15min":21.942},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.32800000000000001},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":1.9390000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.32900000000000001},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":11.122999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.89500000000000002},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.93100000000000005,"15min":22.010999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":1.0980000000000001,"15min":1.401},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59299999999999997,"15min":0.878},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.67700000000000005,"5min":0.83599999999999997,"15min":11.090999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.92300000000000004},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":2.7389999999999999,"15min":21.98},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":1.425},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.755},"min":{"1min":0.436,"5min":0.41799999999999998,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.999,"15min":11.154},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1041,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194271,"statfs":{"total":200000000,"available":198933684,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.183,"15min":0.16900000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58699999999999997},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.28399999999999997,"5min":0.224,"15min":0.186},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.60699999999999998},"last":0.25700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.67200000000000004,"15min":0.68200000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.317,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.63500000000000001,"15min":0.84499999999999997},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.28599999999999998,"5min":0.251,"15min":0.23999999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.70999999999999996},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.30099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":1.056},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.83199999999999996,"15min":0.95099999999999996},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.98699999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.2569999999999999},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.33800000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.0660000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.002},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.873,"15min":0.96999999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.0449999999999999},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574987,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198931572,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33500000000000002,"15min":0.318},"min":{"1min":0.22900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.57499999999999996},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61299999999999999,"5min":0.748,"15min":0.84899999999999998},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.34999999999999998},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.66300000000000003,"15min":0.69999999999999996},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.59599999999999997,"5min":0.68500000000000005,"15min":0.71199999999999997},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.29999999999999999,"5min":0.24199999999999999,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.67700000000000005,"15min":3.044},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.378},"min":{"1min":0.32500000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.57899999999999996,"5min":0.70899999999999996,"15min":0.72799999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":2.2120000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.32700000000000001},"max":{"1min":0.83299999999999996,"5min":0.84899999999999998,"15min":2.25},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.376,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.88100000000000001,"15min":6.4189999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.268},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.373,"15min":0.34300000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.218},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.8340000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.77800000000000002},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.86799999999999999,"5min":0.877,"15min":14.912000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.4990000000000001},"last":0.76800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574987,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1042,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194270,"statfs":{"total":200000000,"available":198932948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.27200000000000002,"15min":0.23699999999999999},"max":{"1min":0.76800000000000002,"5min":1.069,"15min":5.8949999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.28999999999999998,"15min":0.221},"max":{"1min":0.746,"5min":1.1639999999999999,"15min":5.3579999999999997},"last":0.45300000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.67200000000000004},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":1.109,"15min":5.9329999999999998},"last":0.625},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":1.2310000000000001,"15min":5.9820000000000002},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.29099999999999998},"max":{"1min":0.755,"5min":1.083,"15min":5.4390000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56399999999999995,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":1.252,"15min":5.3470000000000004},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.70499999999999996,"5min":1.093,"15min":3.4100000000000001},"last":0.501},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":1.1839999999999999,"15min":3.456},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.245},"max":{"1min":0.63600000000000001,"5min":1.036,"15min":1.036},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.496,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.69199999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.50800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61499999999999999,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.68700000000000006,"5min":0.94299999999999995,"15min":1.0489999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61699999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.80000000000000004},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":1.133,"15min":13.173999999999999},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574987,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1041,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194271,"statfs":{"total":200000000,"available":198933560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.219},"max":{"1min":0.65700000000000003,"5min":0.76400000000000001,"15min":0.79100000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":2.0619999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.3540000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.28000000000000003},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":4.6269999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":1.3779999999999999},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.745,"5min":0.75,"15min":0.83799999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.36599999999999999,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.82599999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.89300000000000002},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.76700000000000002,"15min":0.84999999999999998},"last":0.624},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.879},"last":0.45600000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.307,"15min":0.307},"max":{"1min":0.755,"5min":0.877,"15min":0.877},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.56899999999999995}]}]}],"pool_statfs":[]}} 2023-10-06T02:57:23.181 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:57:23.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:57:23.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.335+0000 7f7bf8045700 1 Processor -- start 2023-10-06T02:57:23.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.335+0000 7f7bf8045700 1 -- start start 2023-10-06T02:57:23.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf8045700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bf0068f20 0x7f7bf00cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf8045700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf00cca80 con 0x7f7bf0157b90 2023-10-06T02:57:23.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf8045700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf00cedd0 con 0x7f7bf01577c0 2023-10-06T02:57:23.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf8045700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf00cc4c0 con 0x7f7bf0068f20 2023-10-06T02:57:23.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf55e0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bf0068f20 0x7f7bf00cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf65e2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7bf0157b90 0x7f7bf00cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34050/0 (socket says 172.21.15.81:34050) 2023-10-06T02:57:23.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf65e2700 1 -- 172.21.15.81:0/2383036967 learned_addr learned my addr 172.21.15.81:0/2383036967 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:23.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf55e0700 1 -- 172.21.15.81:0/2383036967 >> v1:172.21.15.83:6789/0 conn(0x7f7bf01577c0 legacy=0x7f7bf0068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf55e0700 1 -- 172.21.15.81:0/2383036967 >> v1:172.21.15.81:6789/0 conn(0x7f7bf0157b90 legacy=0x7f7bf00cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf4ddf700 1 -- 172.21.15.81:0/2383036967 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442662301 0 0) 0x7f7bf00cca80 con 0x7f7bf0157b90 2023-10-06T02:57:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.336+0000 7f7bf55e0700 1 -- 172.21.15.81:0/2383036967 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf00cc7a0 con 0x7f7bf0068f20 2023-10-06T02:57:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf55e0700 1 --2- 172.21.15.81:0/2383036967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf0068f20 0x7f7bf00cb790 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f7be00098e0 tx=0x7f7be00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ad9feb5d0676ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf4ddf700 1 -- 172.21.15.81:0/2383036967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0009e80 con 0x7f7bf0068f20 2023-10-06T02:57:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf4ddf700 1 -- 172.21.15.81:0/2383036967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000b820 con 0x7f7bf0068f20 2023-10-06T02:57:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf4ddf700 1 -- 172.21.15.81:0/2383036967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000bba0 con 0x7f7bf0068f20 2023-10-06T02:57:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf8045700 1 -- 172.21.15.81:0/2383036967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf0068f20 msgr2=0x7f7bf00cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf8045700 1 --2- 172.21.15.81:0/2383036967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf0068f20 0x7f7bf00cb790 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f7be00098e0 tx=0x7f7be00091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf8045700 1 -- 172.21.15.81:0/2383036967 shutdown_connections 2023-10-06T02:57:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf8045700 1 --2- 172.21.15.81:0/2383036967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf0068f20 0x7f7bf00cb790 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf8045700 1 -- 172.21.15.81:0/2383036967 >> 172.21.15.81:0/2383036967 conn(0x7f7bf00d0df0 msgr2=0x7f7bf00d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf8045700 1 -- 172.21.15.81:0/2383036967 shutdown_connections 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.337+0000 7f7bf8045700 1 -- 172.21.15.81:0/2383036967 wait complete. 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.338+0000 7f7bf8045700 1 Processor -- start 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.338+0000 7f7bf8045700 1 -- start start 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf8045700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf0068f20 0x7f7bf00c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf8045700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf01577c0 0x7f7bf0154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf8045700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bf0157b90 0x7f7bf0159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf8045700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00c8dd0 con 0x7f7bf01577c0 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf8045700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0158ff0 con 0x7f7bf0068f20 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf8045700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0154a60 con 0x7f7bf0157b90 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf55e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf01577c0 0x7f7bf0154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf55e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf01577c0 0x7f7bf0154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37822/0 (socket says 172.21.15.81:37822) 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf55e0700 1 -- 172.21.15.81:0/1972742761 learned_addr learned my addr 172.21.15.81:0/1972742761 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf5de1700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf0068f20 0x7f7bf00c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.339+0000 7f7bf65e2700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bf0157b90 0x7f7bf0159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7bf55e0700 1 -- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bf0157b90 msgr2=0x7f7bf0159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7bf55e0700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bf0157b90 0x7f7bf0159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7bf55e0700 1 -- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf0068f20 msgr2=0x7f7bf00c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7bf55e0700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf0068f20 0x7f7bf00c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7bf55e0700 1 -- 172.21.15.81:0/1972742761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0009420 con 0x7f7bf01577c0 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7bf65e2700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bf0157b90 0x7f7bf0159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7bf55e0700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf01577c0 0x7f7bf0154520 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f7be0002000 tx=0x7f7be0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7be5ffb700 1 -- 172.21.15.81:0/1972742761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000b990 con 0x7f7bf01577c0 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7be5ffb700 1 -- 172.21.15.81:0/1972742761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be0020070 con 0x7f7bf01577c0 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf01583e0 con 0x7f7bf01577c0 2023-10-06T02:57:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7be5ffb700 1 -- 172.21.15.81:0/1972742761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be001b450 con 0x7f7bf01577c0 2023-10-06T02:57:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.340+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf01589a0 con 0x7f7bf01577c0 2023-10-06T02:57:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.341+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf0159180 con 0x7f7bf01577c0 2023-10-06T02:57:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.341+0000 7f7be5ffb700 1 -- 172.21.15.81:0/1972742761 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7be0022030 con 0x7f7bf01577c0 2023-10-06T02:57:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.342+0000 7f7be5ffb700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bd4066f30 0x7f7bd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.342+0000 7f7be5ffb700 1 -- 172.21.15.81:0/1972742761 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7be0086680 con 0x7f7bf01577c0 2023-10-06T02:57:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.342+0000 7f7bf5de1700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bd4066f30 0x7f7bd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.343+0000 7f7bf5de1700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bd4066f30 0x7f7bd40693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7bf015d910 tx=0x7f7bec007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.346+0000 7f7be5ffb700 1 -- 172.21.15.81:0/1972742761 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7be00536f0 con 0x7f7bf01577c0 2023-10-06T02:57:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.602+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7bf0159180 con 0x7f7bf01577c0 2023-10-06T02:57:23.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.606+0000 7f7be5ffb700 1 -- 172.21.15.81:0/1972742761 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7be0056d10 con 0x7f7bf01577c0 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bd4066f30 msgr2=0x7f7bd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bd4066f30 0x7f7bd40693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7bf015d910 tx=0x7f7bec007ea0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf01577c0 msgr2=0x7f7bf0154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf01577c0 0x7f7bf0154520 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f7be0002000 tx=0x7f7be0016000 comp rx=0 tx=0).stop 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 shutdown_connections 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7bf0157b90 0x7f7bf0159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7bd4066f30 0x7f7bd40693e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf0068f20 0x7f7bf00c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 --2- 172.21.15.81:0/1972742761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf01577c0 0x7f7bf0154520 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 >> 172.21.15.81:0/1972742761 conn(0x7f7bf00d0df0 msgr2=0x7f7bf0156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:23.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 shutdown_connections 2023-10-06T02:57:23.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.608+0000 7f7bf8045700 1 -- 172.21.15.81:0/1972742761 wait complete. 2023-10-06T02:57:23.611 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T02:57:23.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.734+0000 7f6af7199700 1 Processor -- start 2023-10-06T02:57:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.734+0000 7f6af7199700 1 -- start start 2023-10-06T02:57:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.735+0000 7f6af7199700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6af00ce1f0 0x7f6af00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.735+0000 7f6af7199700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 0x7f6af006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.735+0000 7f6af7199700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af015dfb0 con 0x7f6af00ce5c0 2023-10-06T02:57:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.735+0000 7f6af7199700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af00acec0 con 0x7f6af00ce1f0 2023-10-06T02:57:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.735+0000 7f6af7199700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00ad1a0 con 0x7f6af00ac570 2023-10-06T02:57:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.735+0000 7f6af4f35700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6af00ce1f0 0x7f6af00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.735+0000 7f6aeffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6af00ce5c0 0x7f6af015e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34064/0 (socket says 172.21.15.81:34064) 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.735+0000 7f6aeffff700 1 -- 172.21.15.81:0/1196618595 learned_addr learned my addr 172.21.15.81:0/1196618595 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.735+0000 7f6af5736700 1 --2- 172.21.15.81:0/1196618595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 0x7f6af006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af4f35700 1 -- 172.21.15.81:0/1196618595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 msgr2=0x7f6af006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af4f35700 1 --2- 172.21.15.81:0/1196618595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 0x7f6af006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af4f35700 1 -- 172.21.15.81:0/1196618595 >> v1:172.21.15.81:6789/0 conn(0x7f6af00ce5c0 legacy=0x7f6af015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af4f35700 1 -- 172.21.15.81:0/1196618595 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af015dc40 con 0x7f6af00ce1f0 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6aef7fe700 1 -- 172.21.15.81:0/1196618595 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193099954 0 0) 0x7f6af015dfb0 con 0x7f6af00ce5c0 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af4f35700 1 --2- 172.21.15.81:0/1196618595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce1f0 0x7f6af00aacf0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009e60 tx=0x7f6ae0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b898cece0e01fc16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6aef7fe700 1 -- 172.21.15.81:0/1196618595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000e070 con 0x7f6af00ce1f0 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6aef7fe700 1 -- 172.21.15.81:0/1196618595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae000bb60 con 0x7f6af00ce1f0 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6aef7fe700 1 -- 172.21.15.81:0/1196618595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0012430 con 0x7f6af00ce1f0 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af7199700 1 -- 172.21.15.81:0/1196618595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce1f0 msgr2=0x7f6af00aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af7199700 1 --2- 172.21.15.81:0/1196618595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce1f0 0x7f6af00aacf0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009e60 tx=0x7f6ae0009780 comp rx=0 tx=0).stop 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af7199700 1 -- 172.21.15.81:0/1196618595 shutdown_connections 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af7199700 1 --2- 172.21.15.81:0/1196618595 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 0x7f6af006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af7199700 1 --2- 172.21.15.81:0/1196618595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce1f0 0x7f6af00aacf0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af7199700 1 -- 172.21.15.81:0/1196618595 >> 172.21.15.81:0/1196618595 conn(0x7f6af006cca0 msgr2=0x7f6af006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af7199700 1 -- 172.21.15.81:0/1196618595 shutdown_connections 2023-10-06T02:57:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.736+0000 7f6af7199700 1 -- 172.21.15.81:0/1196618595 wait complete. 2023-10-06T02:57:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.737+0000 7f6af7199700 1 Processor -- start 2023-10-06T02:57:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.738+0000 7f6af7199700 1 -- start start 2023-10-06T02:57:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.738+0000 7f6af7199700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 0x7f6af00aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.738+0000 7f6af7199700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af00ce1f0 0x7f6af00c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.738+0000 7f6af7199700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce5c0 0x7f6af016a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.738+0000 7f6af7199700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00b0450 con 0x7f6af00ce5c0 2023-10-06T02:57:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.738+0000 7f6af7199700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af0156740 con 0x7f6af00ce1f0 2023-10-06T02:57:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.738+0000 7f6af7199700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00ae9e0 con 0x7f6af00ac570 2023-10-06T02:57:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af5736700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce5c0 0x7f6af016a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af5736700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce5c0 0x7f6af016a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37834/0 (socket says 172.21.15.81:37834) 2023-10-06T02:57:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af5736700 1 -- 172.21.15.81:0/470503103 learned_addr learned my addr 172.21.15.81:0/470503103 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af4f35700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 0x7f6af00aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6aeffff700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af00ce1f0 0x7f6af00c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af5736700 1 -- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 msgr2=0x7f6af00aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af5736700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 0x7f6af00aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af5736700 1 -- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af00ce1f0 msgr2=0x7f6af00c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af5736700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af00ce1f0 0x7f6af00c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af5736700 1 -- 172.21.15.81:0/470503103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0009a20 con 0x7f6af00ce5c0 2023-10-06T02:57:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af5736700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce5c0 0x7f6af016a470 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800e8d0 tx=0x7f6ae80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6aecff9700 1 -- 172.21.15.81:0/470503103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8013680 con 0x7f6af00ce5c0 2023-10-06T02:57:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6aecff9700 1 -- 172.21.15.81:0/470503103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae80137e0 con 0x7f6af00ce5c0 2023-10-06T02:57:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af00addd0 con 0x7f6af00ce5c0 2023-10-06T02:57:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6aecff9700 1 -- 172.21.15.81:0/470503103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8013ba0 con 0x7f6af00ce5c0 2023-10-06T02:57:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.739+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af00ae390 con 0x7f6af00ce5c0 2023-10-06T02:57:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.740+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af0068900 con 0x7f6af00ce5c0 2023-10-06T02:57:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.741+0000 7f6aecff9700 1 -- 172.21.15.81:0/470503103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ae80123d0 con 0x7f6af00ce5c0 2023-10-06T02:57:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.741+0000 7f6aecff9700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ad0066f30 0x7f6ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.741+0000 7f6aecff9700 1 -- 172.21.15.81:0/470503103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ae8084790 con 0x7f6af00ce5c0 2023-10-06T02:57:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.741+0000 7f6af4f35700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ad0066f30 0x7f6ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.742+0000 7f6af4f35700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ad0066f30 0x7f6ad00693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00097c0 tx=0x7f6ae0019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:23.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.745+0000 7f6aecff9700 1 -- 172.21.15.81:0/470503103 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ae80518a0 con 0x7f6af00ce5c0 2023-10-06T02:57:23.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.969+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6af015d590 con 0x7f6af00ce5c0 2023-10-06T02:57:23.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.969+0000 7f6aecff9700 1 -- 172.21.15.81:0/470503103 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f6ae8054ec0 con 0x7f6af00ce5c0 2023-10-06T02:57:23.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:23.971 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:18.128298+0000","modified":"2023-10-06T02:57:21.769179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8358":{"gid":8358,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/604648999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":604648999},{"type":"v1","addr":"172.21.15.81:6835","nonce":604648999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T02:57:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.971+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ad0066f30 msgr2=0x7f6ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.971+0000 7f6af7199700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ad0066f30 0x7f6ad00693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00097c0 tx=0x7f6ae0019000 comp rx=0 tx=0).stop 2023-10-06T02:57:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.971+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce5c0 msgr2=0x7f6af016a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.971+0000 7f6af7199700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce5c0 0x7f6af016a470 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800e8d0 tx=0x7f6ae80091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.972+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 shutdown_connections 2023-10-06T02:57:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.972+0000 7f6af7199700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af00ce5c0 0x7f6af016a470 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.972+0000 7f6af7199700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af00ac570 0x7f6af00aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.972+0000 7f6af7199700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6ad0066f30 0x7f6ad00693e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.972+0000 7f6af7199700 1 --2- 172.21.15.81:0/470503103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af00ce1f0 0x7f6af00c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.972+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 >> 172.21.15.81:0/470503103 conn(0x7f6af006cca0 msgr2=0x7f6af006e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.972+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 shutdown_connections 2023-10-06T02:57:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:23.972+0000 7f6af7199700 1 -- 172.21.15.81:0/470503103 wait complete. 2023-10-06T02:57:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-06T02:57:24.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:57:18.128298+0000', 'modified': '2023-10-06T02:57:21.769179+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8358}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8358': {'gid': 8358, 'name': 'c', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/604648999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 604648999}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 604648999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:57:24.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:57:24.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:57:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.503+0000 7f8bf43fc700 1 Processor -- start 2023-10-06T02:57:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.503+0000 7f8bf43fc700 1 -- start start 2023-10-06T02:57:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.503+0000 7f8bf43fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 0x7f8bec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.503+0000 7f8bf43fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8bec157ca0 0x7f8bec15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.503+0000 7f8bf43fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8bec06d120 0x7f8bec06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.503+0000 7f8bf43fc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec06dac0 con 0x7f8bec06d120 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.503+0000 7f8bf43fc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec0d07c0 con 0x7f8bec157ca0 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.503+0000 7f8bf43fc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0cfbb0 con 0x7f8bec1578d0 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2999700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8bec06d120 0x7f8bec06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2999700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8bec06d120 0x7f8bec06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37836/0 (socket says 172.21.15.81:37836) 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2999700 1 -- 172.21.15.81:0/390062543 learned_addr learned my addr 172.21.15.81:0/390062543 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf1997700 1 --2- 172.21.15.81:0/390062543 >> v2:172.21.15.83:3300/0 conn(0x7f8bec157ca0 0x7f8bec15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2198700 1 --2- 172.21.15.81:0/390062543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 0x7f8bec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2999700 1 -- 172.21.15.81:0/390062543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 msgr2=0x7f8bec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2999700 1 --2- 172.21.15.81:0/390062543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 0x7f8bec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2999700 1 -- 172.21.15.81:0/390062543 >> v2:172.21.15.83:3300/0 conn(0x7f8bec157ca0 msgr2=0x7f8bec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2999700 1 --2- 172.21.15.81:0/390062543 >> v2:172.21.15.83:3300/0 conn(0x7f8bec157ca0 0x7f8bec15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2999700 1 -- 172.21.15.81:0/390062543 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0cfe90 con 0x7f8bec06d120 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf1997700 1 --2- 172.21.15.81:0/390062543 >> v2:172.21.15.83:3300/0 conn(0x7f8bec157ca0 0x7f8bec15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2198700 1 --2- 172.21.15.81:0/390062543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 0x7f8bec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf2999700 1 --2- 172.21.15.81:0/390062543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 0x7f8bec06d580 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f8bec06cb70 tx=0x7f8be4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c35441909403177 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf1196700 1 -- 172.21.15.81:0/390062543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400e070 con 0x7f8bec06d120 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf1196700 1 -- 172.21.15.81:0/390062543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be400ba50 con 0x7f8bec06d120 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.504+0000 7f8bf1196700 1 -- 172.21.15.81:0/390062543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40092e0 con 0x7f8bec06d120 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.505+0000 7f8bf43fc700 1 -- 172.21.15.81:0/390062543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 msgr2=0x7f8bec06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.505+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/390062543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 0x7f8bec06d580 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f8bec06cb70 tx=0x7f8be4009840 comp rx=0 tx=0).stop 2023-10-06T02:57:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.505+0000 7f8bf43fc700 1 -- 172.21.15.81:0/390062543 shutdown_connections 2023-10-06T02:57:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.505+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/390062543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 0x7f8bec06d580 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.505+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/390062543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 0x7f8bec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.505+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/390062543 >> v2:172.21.15.83:3300/0 conn(0x7f8bec157ca0 0x7f8bec15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.505+0000 7f8bf43fc700 1 -- 172.21.15.81:0/390062543 >> 172.21.15.81:0/390062543 conn(0x7f8bec06bb90 msgr2=0x7f8bec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.505+0000 7f8bf43fc700 1 -- 172.21.15.81:0/390062543 shutdown_connections 2023-10-06T02:57:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.505+0000 7f8bf43fc700 1 -- 172.21.15.81:0/390062543 wait complete. 2023-10-06T02:57:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.506+0000 7f8bf43fc700 1 Processor -- start 2023-10-06T02:57:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.506+0000 7f8bf43fc700 1 -- start start 2023-10-06T02:57:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf43fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 0x7f8bec0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf43fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 0x7f8bec1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf43fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bec157ca0 0x7f8bec155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf43fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec16dfd0 con 0x7f8bec06d120 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf43fc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0cd8c0 con 0x7f8bec157ca0 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf43fc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec16d3c0 con 0x7f8bec1578d0 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2198700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 0x7f8bec0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2198700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 0x7f8bec0cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37848/0 (socket says 172.21.15.81:37848) 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2198700 1 -- 172.21.15.81:0/4179211640 learned_addr learned my addr 172.21.15.81:0/4179211640 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2198700 1 -- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 msgr2=0x7f8bec1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2198700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 0x7f8bec1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2999700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bec157ca0 0x7f8bec155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2198700 1 -- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bec157ca0 msgr2=0x7f8bec155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2198700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bec157ca0 0x7f8bec155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2198700 1 -- 172.21.15.81:0/4179211640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4009ae0 con 0x7f8bec06d120 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf2198700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 0x7f8bec0cd380 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e900 tx=0x7f8be8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8be27fc700 1 -- 172.21.15.81:0/4179211640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800eea0 con 0x7f8bec06d120 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8be27fc700 1 -- 172.21.15.81:0/4179211640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800c5e0 con 0x7f8bec06d120 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf43fc700 1 -- 172.21.15.81:0/4179211640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec16d6a0 con 0x7f8bec06d120 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8be27fc700 1 -- 172.21.15.81:0/4179211640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800c980 con 0x7f8bec06d120 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.507+0000 7f8bf43fc700 1 -- 172.21.15.81:0/4179211640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec16dc60 con 0x7f8bec06d120 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.509+0000 7f8be27fc700 1 -- 172.21.15.81:0/4179211640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8be800cd30 con 0x7f8bec06d120 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.509+0000 7f8be27fc700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8bd0066f30 0x7f8bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.509+0000 7f8be27fc700 1 -- 172.21.15.81:0/4179211640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8be80844e0 con 0x7f8bec06d120 2023-10-06T02:57:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.509+0000 7f8bf1997700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8bd0066f30 0x7f8bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.510+0000 7f8bf1997700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8bd0066f30 0x7f8bd00693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc006fd0 tx=0x7f8bdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.511+0000 7f8bfd6f4b80 1 Processor -- start 2023-10-06T02:57:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.511+0000 7f8bfd6f4b80 1 -- start start 2023-10-06T02:57:24.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 0x555928e6ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6bcc0 0x555928eba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928ebac00 0x555928ebb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555928dc1a70 con 0x555928ebac00 2023-10-06T02:57:24.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x555928dbf270 con 0x555928e6bcc0 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x555928dbb060 con 0x555928e6a840 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2999700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928ebac00 0x555928ebb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2999700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928ebac00 0x555928ebb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37862/0 (socket says 172.21.15.81:37862) 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2999700 1 -- 172.21.15.81:0/2359404783 learned_addr learned my addr 172.21.15.81:0/2359404783 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf1997700 1 --2- 172.21.15.81:0/2359404783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6bcc0 0x555928eba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2198700 1 --2- 172.21.15.81:0/2359404783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 0x555928e6ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2999700 1 -- 172.21.15.81:0/2359404783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 msgr2=0x555928e6ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2999700 1 --2- 172.21.15.81:0/2359404783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 0x555928e6ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2999700 1 -- 172.21.15.81:0/2359404783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6bcc0 msgr2=0x555928eba6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2999700 1 --2- 172.21.15.81:0/2359404783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6bcc0 0x555928eba6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2999700 1 -- 172.21.15.81:0/2359404783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555928c55270 con 0x555928ebac00 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.512+0000 7f8bf2999700 1 --2- 172.21.15.81:0/2359404783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928ebac00 0x555928ebb050 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009fd0 tx=0x7f8be4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f312d24ee68929 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bcf7fe700 1 -- 172.21.15.81:0/2359404783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4007220 con 0x555928ebac00 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bcf7fe700 1 -- 172.21.15.81:0/2359404783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be400bbc0 con 0x555928ebac00 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bcf7fe700 1 -- 172.21.15.81:0/2359404783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4007610 con 0x555928ebac00 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/2359404783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928ebac00 msgr2=0x555928ebb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/2359404783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928ebac00 0x555928ebb050 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009fd0 tx=0x7f8be4018000 comp rx=0 tx=0).stop 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/2359404783 shutdown_connections 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/2359404783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928ebac00 0x555928ebb050 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/2359404783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 0x555928e6ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/2359404783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6bcc0 0x555928eba6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/2359404783 >> 172.21.15.81:0/2359404783 conn(0x555928e6c160 msgr2=0x555928e6c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/2359404783 shutdown_connections 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.513+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/2359404783 wait complete. 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.514+0000 7f8bfd6f4b80 1 -- start start 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.514+0000 7f8bfd6f4b80 1 Processor -- start 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6a840 0x555928e9a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6bcc0 0x555928e957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 0x555928e95d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555928d66890 con 0x555928e6a840 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x555928d81ea0 con 0x555928ebac00 2023-10-06T02:57:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x555928c3de30 con 0x555928e6bcc0 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bfd6f4b80 10 client.0 _ll_register_callbacks cb 0x555928e2de70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf2198700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6a840 0x555928e9a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf2198700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6a840 0x555928e9a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37878/0 (socket says 172.21.15.81:37878) 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf2198700 1 -- 172.21.15.81:0/3969185934 learned_addr learned my addr 172.21.15.81:0/3969185934 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf1997700 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6bcc0 0x555928e957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf2999700 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 0x555928e95d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf2198700 1 -- 172.21.15.81:0/3969185934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6bcc0 msgr2=0x555928e957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf2198700 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6bcc0 0x555928e957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf2198700 1 -- 172.21.15.81:0/3969185934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 msgr2=0x555928e95d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf2198700 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 0x555928e95d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.515+0000 7f8bf2198700 1 -- 172.21.15.81:0/3969185934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec0cfe90 con 0x555928e6a840 2023-10-06T02:57:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bf2198700 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6a840 0x555928e9a0f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f8be80828d0 tx=0x7f8be8082800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8aea3196280c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bccff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bccff9700 1 -- 172.21.15.81:0/3969185934 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be805c250 con 0x555928e6a840 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bccff9700 1 -- 172.21.15.81:0/3969185934 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8be80840e0 con 0x555928e6a840 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/3969185934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555928e5f940 con 0x555928e6a840 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bccff9700 1 -- 172.21.15.81:0/3969185934 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8be805bdc0 con 0x555928e6a840 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bfd6f4b80 10 client.8514 fetch_fsmap learned FSMap version 90 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/3969185934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x555928bf7fe0 con 0x555928e6a840 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bccff9700 1 -- 172.21.15.81:0/3969185934 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555928e5f940 con 0x555928e6a840 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bccff9700 1 -- 172.21.15.81:0/3969185934 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8be8067b00 con 0x555928e6a840 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bfd6f4b80 10 client.8514 fetch_fsmap finished waiting for FSMap version 90 2023-10-06T02:57:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bfd6f4b80 10 client.8514 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bfd6f4b80 20 client.8514 populate_metadata read hostname 'smithi081' 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] conn(0x555928eaae30 0x555928eab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bfd6f4b80 4 client.8514 mds_command: new command op to 8358 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/3969185934 --> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555928e3c870 con 0x555928eaae30 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.516+0000 7f8bf1997700 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] conn(0x555928eaae30 0x555928eab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bccff9700 10 client.8514 ms_handle_connect on v2:172.21.15.81:6832/604648999 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bf1997700 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] conn(0x555928eaae30 0x555928eab880 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40380588bb07bb6d server_cookie=1bf5f316707d2656 in_seq=0 out_seq=0 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bccff9700 1 -- 172.21.15.81:0/3969185934 <== mds.0 v2:172.21.15.81:6832/604648999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555928e3c870 con 0x555928eaae30 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bccff9700 10 client.8514 handle_command_reply: tid=0 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 client.8514 shutdown 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/3969185934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6a840 msgr2=0x555928e9a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6a840 0x555928e9a0f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f8be80828d0 tx=0x7f8be8082800 comp rx=0 tx=0).stop 2023-10-06T02:57:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/3969185934 shutdown_connections 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 0x555928e95d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] conn(0x555928eaae30 0x555928eab880 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6a840 0x555928e9a0f0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/3969185934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6bcc0 0x555928e957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bccff9700 0 client.8514 ms_handle_reset on v2:172.21.15.81:6832/604648999 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/3969185934 >> 172.21.15.81:0/3969185934 conn(0x555928e6c160 msgr2=0x555928e6b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/3969185934 shutdown_connections 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.517+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/3969185934 wait complete. 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.518+0000 7f8bfd6f4b80 20 client.8514 trim_cache size 0 max 16384 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.534+0000 7f8bfd6f4b80 1 Processor -- start 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.534+0000 7f8bfd6f4b80 1 -- start start 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6a840 0x555928eb03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eb0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928ebac00 0x555928eae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555928e65620 con 0x555928e6bcc0 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x555928e97600 con 0x555928e6a840 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x555928e431e0 con 0x555928ebac00 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf1997700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eb0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf1997700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eb0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37882/0 (socket says 172.21.15.81:37882) 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf1997700 1 -- 172.21.15.81:0/430367212 learned_addr learned my addr 172.21.15.81:0/430367212 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf2198700 1 --2- 172.21.15.81:0/430367212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6a840 0x555928eb03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf2999700 1 --2- 172.21.15.81:0/430367212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928ebac00 0x555928eae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf1997700 1 -- 172.21.15.81:0/430367212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928ebac00 msgr2=0x555928eae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf1997700 1 --2- 172.21.15.81:0/430367212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928ebac00 0x555928eae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf1997700 1 -- 172.21.15.81:0/430367212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6a840 msgr2=0x555928eb03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf1997700 1 --2- 172.21.15.81:0/430367212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6a840 0x555928eb03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf1997700 1 -- 172.21.15.81:0/430367212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555928e68df0 con 0x555928e6bcc0 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bf1997700 1 --2- 172.21.15.81:0/430367212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eb0910 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f8bec160c60 tx=0x7f8bdc017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97446adcbc786197 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bcffff700 1 -- 172.21.15.81:0/430367212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc024530 con 0x555928e6bcc0 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bcffff700 1 -- 172.21.15.81:0/430367212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc024690 con 0x555928e6bcc0 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.535+0000 7f8bcffff700 1 -- 172.21.15.81:0/430367212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc024a30 con 0x555928e6bcc0 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.536+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/430367212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 msgr2=0x555928eb0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.536+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/430367212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eb0910 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f8bec160c60 tx=0x7f8bdc017040 comp rx=0 tx=0).stop 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.536+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/430367212 shutdown_connections 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.536+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/430367212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928ebac00 0x555928eae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.536+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/430367212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928e6a840 0x555928eb03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.536+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/430367212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eb0910 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.536+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/430367212 >> 172.21.15.81:0/430367212 conn(0x555928e6c160 msgr2=0x555928e6dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.536+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/430367212 shutdown_connections 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.536+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/430367212 wait complete. 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.537+0000 7f8bfd6f4b80 1 -- start start 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.537+0000 7f8bfd6f4b80 1 Processor -- start 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.537+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 0x555928f16760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.537+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.537+0000 7f8bfd6f4b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 0x555928eae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.537+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555928eb9700 con 0x555928e6bcc0 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.537+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x555928eb9950 con 0x555928ebac00 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.537+0000 7f8bfd6f4b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x555928eb9c30 con 0x555928e6a840 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.537+0000 7f8bfd6f4b80 10 client.0 _ll_register_callbacks cb 0x555928e2de70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf1997700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf2198700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 0x555928f16760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf1997700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37884/0 (socket says 172.21.15.81:37884) 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf1997700 1 -- 172.21.15.81:0/182515221 learned_addr learned my addr 172.21.15.81:0/182515221 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf2999700 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 0x555928eae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf1997700 1 -- 172.21.15.81:0/182515221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 msgr2=0x555928f16760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf1997700 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 0x555928f16760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf1997700 1 -- 172.21.15.81:0/182515221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 msgr2=0x555928eae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf1997700 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 0x555928eae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf1997700 1 -- 172.21.15.81:0/182515221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc01d040 con 0x555928e6bcc0 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bf1997700 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eae1a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc029000 tx=0x7f8bdc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d8bd8267a2ffc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bccff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bccff9700 1 -- 172.21.15.81:0/182515221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc032070 con 0x555928e6bcc0 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bccff9700 1 -- 172.21.15.81:0/182515221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8bdc00de40 con 0x555928e6bcc0 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/182515221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8be400bbc0 con 0x555928e6bcc0 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bccff9700 1 -- 172.21.15.81:0/182515221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bdc037e30 con 0x555928e6bcc0 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bfd6f4b80 10 client.8520 fetch_fsmap learned FSMap version 90 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/182515221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x555928d89780 con 0x555928e6bcc0 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bccff9700 1 -- 172.21.15.81:0/182515221 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be400bbc0 con 0x555928e6bcc0 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bccff9700 1 -- 172.21.15.81:0/182515221 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8bdc020070 con 0x555928e6bcc0 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.538+0000 7f8bfd6f4b80 10 client.8520 fetch_fsmap finished waiting for FSMap version 90 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 10 client.8520 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 20 client.8520 populate_metadata read hostname 'smithi081' 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] conn(0x555928eb8a70 0x555928eb8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 4 client.8520 mds_command: new command op to 8358 tid=0[{"prefix": "status"}] 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/182515221 --> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555928d5de00 con 0x555928eb8a70 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bf2198700 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] conn(0x555928eb8a70 0x555928eb8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bccff9700 10 client.8520 ms_handle_connect on v2:172.21.15.81:6832/604648999 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bf2198700 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] conn(0x555928eb8a70 0x555928eb8e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94080afae7f4c5f server_cookie=f1f9b9c0bc42042 in_seq=0 out_seq=0 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bccff9700 1 -- 172.21.15.81:0/182515221 <== mds.0 v2:172.21.15.81:6832/604648999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555928d5de00 con 0x555928eb8a70 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bccff9700 10 client.8520 handle_command_reply: tid=0 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 client.8520 shutdown 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/182515221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 msgr2=0x555928eae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eae1a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc029000 tx=0x7f8bdc020000 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/182515221 shutdown_connections 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555928ebac00 0x555928eae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555928e6a840 0x555928f16760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.81:6832/604648999,v1:172.21.15.81:6835/604648999] conn(0x555928eb8a70 0x555928eb8e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 --2- 172.21.15.81:0/182515221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555928e6bcc0 0x555928eae1a0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bccff9700 0 client.8520 ms_handle_reset on v2:172.21.15.81:6832/604648999 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/182515221 >> 172.21.15.81:0/182515221 conn(0x555928e6c160 msgr2=0x555928e6b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/182515221 shutdown_connections 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 1 -- 172.21.15.81:0/182515221 wait complete. 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.539+0000 7f8bfd6f4b80 20 client.8520 trim_cache size 0 max 16384 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8358, 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T02:57:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T02:57:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.7898462759999996, 2023-10-06T02:57:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 90, 2023-10-06T02:57:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 180, 2023-10-06T02:57:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 180, 2023-10-06T02:57:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.896382521 2023-10-06T02:57:24.549 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:24.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 -- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8bd0066f30 msgr2=0x7f8bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8bd0066f30 0x7f8bd00693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc006fd0 tx=0x7f8bdc008040 comp rx=0 tx=0).stop 2023-10-06T02:57:24.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 -- 172.21.15.81:0/4179211640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 msgr2=0x7f8bec0cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 0x7f8bec0cd380 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e900 tx=0x7f8be8008040 comp rx=0 tx=0).stop 2023-10-06T02:57:24.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 -- 172.21.15.81:0/4179211640 shutdown_connections 2023-10-06T02:57:24.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8bd0066f30 0x7f8bd00693e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bec157ca0 0x7f8bec155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bec06d120 0x7f8bec0cd380 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 --2- 172.21.15.81:0/4179211640 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bec1578d0 0x7f8bec1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 -- 172.21.15.81:0/4179211640 >> 172.21.15.81:0/4179211640 conn(0x7f8bec06bb90 msgr2=0x7f8bec0697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 -- 172.21.15.81:0/4179211640 shutdown_connections 2023-10-06T02:57:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.540+0000 7f8bf43fc700 1 -- 172.21.15.81:0/4179211640 wait complete. 2023-10-06T02:57:24.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:57:24.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.665+0000 7fef55568700 1 Processor -- start 2023-10-06T02:57:24.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.665+0000 7fef55568700 1 -- start start 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.666+0000 7fef55568700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fef50159b40 0x7fef500cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.666+0000 7fef55568700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef500cee10 con 0x7fef50159f10 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.666+0000 7fef55568700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef500cd040 con 0x7fef50068e90 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.666+0000 7fef55568700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500cd320 con 0x7fef50159b40 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.666+0000 7fef4f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fef50159f10 0x7fef50068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34070/0 (socket says 172.21.15.81:34070) 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.666+0000 7fef4f7fe700 1 -- 172.21.15.81:0/1759964517 learned_addr learned my addr 172.21.15.81:0/1759964517 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.666+0000 7fef4ffff700 1 --2- 172.21.15.81:0/1759964517 >> v2:172.21.15.83:3300/0 conn(0x7fef50159b40 0x7fef500cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.666+0000 7fef4effd700 1 -- 172.21.15.81:0/1759964517 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551667554 0 0) 0x7fef500cee10 con 0x7fef50159f10 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.666+0000 7fef4effd700 1 -- 172.21.15.81:0/1759964517 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef38003570 con 0x7fef50159f10 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4effd700 1 -- 172.21.15.81:0/1759964517 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426015867 0 0) 0x7fef500cd040 con 0x7fef50068e90 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4effd700 1 -- 172.21.15.81:0/1759964517 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef500cee10 con 0x7fef50068e90 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4effd700 1 -- 172.21.15.81:0/1759964517 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3632573258 0 0) 0x7fef38003570 con 0x7fef50159f10 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4ffff700 1 -- 172.21.15.81:0/1759964517 >> v1:172.21.15.83:6789/0 conn(0x7fef50068e90 legacy=0x7fef500cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4ffff700 1 -- 172.21.15.81:0/1759964517 >> v1:172.21.15.81:6789/0 conn(0x7fef50159f10 legacy=0x7fef50068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4ffff700 1 -- 172.21.15.81:0/1759964517 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef500ce7c0 con 0x7fef50159b40 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4ffff700 1 --2- 172.21.15.81:0/1759964517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef50159b40 0x7fef500cc600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fef400098e0 tx=0x7fef400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c261c6823ca51a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4effd700 1 -- 172.21.15.81:0/1759964517 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44001470 con 0x7fef50159b40 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4effd700 1 -- 172.21.15.81:0/1759964517 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef40011420 con 0x7fef50159b40 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef4effd700 1 -- 172.21.15.81:0/1759964517 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400117a0 con 0x7fef50159b40 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef55568700 1 -- 172.21.15.81:0/1759964517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef50159b40 msgr2=0x7fef500cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.667+0000 7fef55568700 1 --2- 172.21.15.81:0/1759964517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef50159b40 0x7fef500cc600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fef400098e0 tx=0x7fef400091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.668+0000 7fef55568700 1 -- 172.21.15.81:0/1759964517 shutdown_connections 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.668+0000 7fef55568700 1 --2- 172.21.15.81:0/1759964517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef50159b40 0x7fef500cc600 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.668+0000 7fef55568700 1 -- 172.21.15.81:0/1759964517 >> 172.21.15.81:0/1759964517 conn(0x7fef500cd660 msgr2=0x7fef500cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.668+0000 7fef55568700 1 -- 172.21.15.81:0/1759964517 shutdown_connections 2023-10-06T02:57:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.668+0000 7fef55568700 1 -- 172.21.15.81:0/1759964517 wait complete. 2023-10-06T02:57:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.669+0000 7fef55568700 1 Processor -- start 2023-10-06T02:57:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.669+0000 7fef55568700 1 -- start start 2023-10-06T02:57:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.669+0000 7fef55568700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef50068e90 0x7fef5015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef55568700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50159b40 0x7fef50158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef55568700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef50159f10 0x7fef500c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef55568700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500c7ca0 con 0x7fef50159b40 2023-10-06T02:57:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef55568700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500c7f80 con 0x7fef50068e90 2023-10-06T02:57:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef55568700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5015b360 con 0x7fef50159f10 2023-10-06T02:57:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50159b40 0x7fef50158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50159b40 0x7fef50158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37888/0 (socket says 172.21.15.81:37888) 2023-10-06T02:57:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4f7fe700 1 -- 172.21.15.81:0/3024516808 learned_addr learned my addr 172.21.15.81:0/3024516808 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4ffff700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef50068e90 0x7fef5015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef54d67700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef50159f10 0x7fef500c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4f7fe700 1 -- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef50159f10 msgr2=0x7fef500c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4f7fe700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef50159f10 0x7fef500c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4f7fe700 1 -- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef50068e90 msgr2=0x7fef5015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4f7fe700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef50068e90 0x7fef5015cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4f7fe700 1 -- 172.21.15.81:0/3024516808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40009420 con 0x7fef50159b40 2023-10-06T02:57:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef4f7fe700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50159b40 0x7fef50158210 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c7e0 tx=0x7fef44001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef37fff700 1 -- 172.21.15.81:0/3024516808 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44007360 con 0x7fef50159b40 2023-10-06T02:57:24.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef37fff700 1 -- 172.21.15.81:0/3024516808 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440074e0 con 0x7fef50159b40 2023-10-06T02:57:24.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5015b640 con 0x7fef50159b40 2023-10-06T02:57:24.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef37fff700 1 -- 172.21.15.81:0/3024516808 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44004850 con 0x7fef50159b40 2023-10-06T02:57:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.670+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5015d4e0 con 0x7fef50159b40 2023-10-06T02:57:24.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.671+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5015bae0 con 0x7fef50159b40 2023-10-06T02:57:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.672+0000 7fef37fff700 1 -- 172.21.15.81:0/3024516808 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef44004bc0 con 0x7fef50159b40 2023-10-06T02:57:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.672+0000 7fef37fff700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef3c066f30 0x7fef3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.672+0000 7fef37fff700 1 -- 172.21.15.81:0/3024516808 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fef44084610 con 0x7fef50159b40 2023-10-06T02:57:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.672+0000 7fef4ffff700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef3c066f30 0x7fef3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.673+0000 7fef4ffff700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef3c066f30 0x7fef3c0693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fef400093f0 tx=0x7fef40016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.676+0000 7fef37fff700 1 -- 172.21.15.81:0/3024516808 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef5015bae0 con 0x7fef50159b40 2023-10-06T02:57:24.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.902+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fef5015bae0 con 0x7fef50159b40 2023-10-06T02:57:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.902+0000 7fef37fff700 1 -- 172.21.15.81:0/3024516808 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) v1 ==== 53+0+73 (secure 0 0 0) 0x7fef5015bae0 con 0x7fef50159b40 2023-10-06T02:57:24.904 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:57:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef3c066f30 msgr2=0x7fef3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef3c066f30 0x7fef3c0693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fef400093f0 tx=0x7fef40016000 comp rx=0 tx=0).stop 2023-10-06T02:57:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50159b40 msgr2=0x7fef50158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50159b40 0x7fef50158210 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c7e0 tx=0x7fef44001a30 comp rx=0 tx=0).stop 2023-10-06T02:57:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 shutdown_connections 2023-10-06T02:57:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef50159f10 0x7fef500c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fef3c066f30 0x7fef3c0693e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef50068e90 0x7fef5015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 --2- 172.21.15.81:0/3024516808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50159b40 0x7fef50158210 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 >> 172.21.15.81:0/3024516808 conn(0x7fef500cd660 msgr2=0x7fef500c7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 shutdown_connections 2023-10-06T02:57:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:24.904+0000 7fef55568700 1 -- 172.21.15.81:0/3024516808 wait complete. 2023-10-06T02:57:24.917 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:57:24.918 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:57:24.918 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T02:57:24.918 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:57:24.918 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:24.918 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:57:24.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:57:24.918 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:57:24.919 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:57:24.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:24.919 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T02:57:24.934 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:57:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:57:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:57:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T02:57:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:24.934 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:57:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 41872sec preferred_lft 41872sec 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:24.935 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::44df:81ff:fef2:1b9a/64 scope link 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 46:53:69:3e:5b:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4453:69ff:fe3e:5b34/64 scope link 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fe:4e:99:be:82:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::fc4e:99ff:febe:8290/64 scope link 2023-10-06T02:57:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:24.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:24.937 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:57:24.996 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:24.998 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T02:57:25.054 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T02:57:25.054 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:57:25.054 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:57:25.054 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:57:25.054 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:57:25.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:25.055 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T02:57:25.055 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T02:57:25.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:57:25.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:57:25.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:57:25.055 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T02:57:25.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:25.153 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:57:25.168 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:57:25.168 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:57:25.168 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:57:25.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:25.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T02:57:25.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:57:25.232 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:25.288 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:57:25.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:57:25.288 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:25.342 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T02:57:25.342 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:57:25.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:57:25.423 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:57:25.424 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:57:25.442 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:57:25.442 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:57:25.443 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:57:25.443 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:57:25.443 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:57:25.443 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:57:25.443 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:57:25.443 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:57:25.463 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:57:25.463 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:57:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:57:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:57:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:57:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:57:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:57:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:57:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:57:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:57:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:57:25.465 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:57:25.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:25.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:25.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:57:25.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.685+0000 7ff1260c0700 1 Processor -- start 2023-10-06T02:57:25.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.685+0000 7ff1260c0700 1 -- start start 2023-10-06T02:57:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff1260c0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1201578d0 0x7ff1200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff1260c0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff120157ca0 0x7ff12015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff1260c0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1200d07c0 con 0x7ff12006d120 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff1260c0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1200cfbb0 con 0x7ff1201578d0 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff1260c0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1200cfe90 con 0x7ff120157ca0 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1201578d0 0x7ff1200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff12006d120 0x7ff12006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34084/0 (socket says 172.21.15.81:34084) 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11ffff700 1 -- 172.21.15.81:0/2303113284 learned_addr learned my addr 172.21.15.81:0/2303113284 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11effd700 1 --2- 172.21.15.81:0/2303113284 >> v2:172.21.15.83:3300/0 conn(0x7ff120157ca0 0x7ff12015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11f7fe700 1 -- 172.21.15.81:0/2303113284 >> v2:172.21.15.83:3300/0 conn(0x7ff120157ca0 msgr2=0x7ff12015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11f7fe700 1 --2- 172.21.15.81:0/2303113284 >> v2:172.21.15.83:3300/0 conn(0x7ff120157ca0 0x7ff12015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11f7fe700 1 -- 172.21.15.81:0/2303113284 >> v1:172.21.15.81:6789/0 conn(0x7ff12006d120 legacy=0x7ff12006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11f7fe700 1 -- 172.21.15.81:0/2303113284 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200d0170 con 0x7ff1201578d0 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11e7fc700 1 -- 172.21.15.81:0/2303113284 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993575708 0 0) 0x7ff1200d07c0 con 0x7ff12006d120 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11effd700 1 --2- 172.21.15.81:0/2303113284 >> v2:172.21.15.83:3300/0 conn(0x7ff120157ca0 0x7ff12015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11f7fe700 1 --2- 172.21.15.81:0/2303113284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1201578d0 0x7ff1200cf4f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff120068510 tx=0x7ff118009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a50c7ca11b0305 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11e7fc700 1 -- 172.21.15.81:0/2303113284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11800e070 con 0x7ff1201578d0 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11e7fc700 1 -- 172.21.15.81:0/2303113284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11800bc30 con 0x7ff1201578d0 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.686+0000 7ff11e7fc700 1 -- 172.21.15.81:0/2303113284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118012430 con 0x7ff1201578d0 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.687+0000 7ff1260c0700 1 -- 172.21.15.81:0/2303113284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1201578d0 msgr2=0x7ff1200cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.687+0000 7ff1260c0700 1 --2- 172.21.15.81:0/2303113284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1201578d0 0x7ff1200cf4f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff120068510 tx=0x7ff118009780 comp rx=0 tx=0).stop 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.687+0000 7ff1260c0700 1 -- 172.21.15.81:0/2303113284 shutdown_connections 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.687+0000 7ff1260c0700 1 --2- 172.21.15.81:0/2303113284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1201578d0 0x7ff1200cf4f0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.687+0000 7ff1260c0700 1 --2- 172.21.15.81:0/2303113284 >> v2:172.21.15.83:3300/0 conn(0x7ff120157ca0 0x7ff12015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.687+0000 7ff1260c0700 1 -- 172.21.15.81:0/2303113284 >> 172.21.15.81:0/2303113284 conn(0x7ff12006bb90 msgr2=0x7ff12006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.687+0000 7ff1260c0700 1 -- 172.21.15.81:0/2303113284 shutdown_connections 2023-10-06T02:57:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.687+0000 7ff1260c0700 1 -- 172.21.15.81:0/2303113284 wait complete. 2023-10-06T02:57:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.688+0000 7ff1260c0700 1 Processor -- start 2023-10-06T02:57:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.688+0000 7ff1260c0700 1 -- start start 2023-10-06T02:57:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff1260c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff12006d120 0x7ff1201537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff1260c0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1201578d0 0x7ff1200b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff1260c0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff120157ca0 0x7ff12015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff1260c0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12016a5f0 con 0x7ff12006d120 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff1260c0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120153ce0 con 0x7ff120157ca0 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff1260c0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200b5230 con 0x7ff1201578d0 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff12006d120 0x7ff1201537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff12006d120 0x7ff1201537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37920/0 (socket says 172.21.15.81:37920) 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11f7fe700 1 -- 172.21.15.81:0/3740197328 learned_addr learned my addr 172.21.15.81:0/3740197328 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11effd700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1201578d0 0x7ff1200b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11ffff700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff120157ca0 0x7ff12015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11f7fe700 1 -- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1201578d0 msgr2=0x7ff1200b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11f7fe700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1201578d0 0x7ff1200b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11f7fe700 1 -- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff120157ca0 msgr2=0x7ff12015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11f7fe700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff120157ca0 0x7ff12015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11f7fe700 1 -- 172.21.15.81:0/3740197328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff118009a20 con 0x7ff12006d120 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11ffff700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff120157ca0 0x7ff12015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.689+0000 7ff11f7fe700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff12006d120 0x7ff1201537a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff118013000 tx=0x7ff118019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.690+0000 7ff1077fe700 1 -- 172.21.15.81:0/3740197328 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118012e60 con 0x7ff12006d120 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.690+0000 7ff1077fe700 1 -- 172.21.15.81:0/3740197328 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11801d630 con 0x7ff12006d120 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.690+0000 7ff1077fe700 1 -- 172.21.15.81:0/3740197328 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11801d9f0 con 0x7ff12006d120 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.690+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1200b4990 con 0x7ff12006d120 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.690+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1200b4f50 con 0x7ff12006d120 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.691+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff120067ac0 con 0x7ff12006d120 2023-10-06T02:57:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.691+0000 7ff1077fe700 1 -- 172.21.15.81:0/3740197328 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff118024070 con 0x7ff12006d120 2023-10-06T02:57:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.691+0000 7ff1077fe700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff10c066f30 0x7ff10c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.691+0000 7ff1077fe700 1 -- 172.21.15.81:0/3740197328 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff118086e10 con 0x7ff12006d120 2023-10-06T02:57:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.692+0000 7ff11effd700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff10c066f30 0x7ff10c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.692+0000 7ff11effd700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff10c066f30 0x7ff10c0693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff1200b5b40 tx=0x7ff114008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.695+0000 7ff1077fe700 1 -- 172.21.15.81:0/3740197328 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff118053f20 con 0x7ff12006d120 2023-10-06T02:57:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.925+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff1200d0450 con 0x7ff12006d120 2023-10-06T02:57:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.925+0000 7ff1077fe700 1 -- 172.21.15.81:0/3740197328 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff11802c060 con 0x7ff12006d120 2023-10-06T02:57:25.927 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:57:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff10c066f30 msgr2=0x7ff10c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff10c066f30 0x7ff10c0693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff1200b5b40 tx=0x7ff114008040 comp rx=0 tx=0).stop 2023-10-06T02:57:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff12006d120 msgr2=0x7ff1201537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff12006d120 0x7ff1201537a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff118013000 tx=0x7ff118019000 comp rx=0 tx=0).stop 2023-10-06T02:57:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 shutdown_connections 2023-10-06T02:57:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff10c066f30 0x7ff10c0693e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff120157ca0 0x7ff12015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff12006d120 0x7ff1201537a0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 --2- 172.21.15.81:0/3740197328 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1201578d0 0x7ff1200b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 >> 172.21.15.81:0/3740197328 conn(0x7ff12006bb90 msgr2=0x7ff12006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 shutdown_connections 2023-10-06T02:57:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:25.927+0000 7ff1260c0700 1 -- 172.21.15.81:0/3740197328 wait complete. 2023-10-06T02:57:25.940 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:57:25.941 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:57:25.941 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T02:57:25.941 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:57:25.941 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:57:25.941 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:57:25.941 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:57:25.941 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:57:25.941 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:57:25.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:25.941 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 41871sec preferred_lft 41871sec 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9056:13ff:fe3e:2af5/64 scope link 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether e6:11:e3:00:29:6f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::e411:e3ff:fe00:296f/64 scope link 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d6:c2:db:81:60:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d4c2:dbff:fe81:60a2/64 scope link 2023-10-06T02:57:25.963 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:25.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:25.964 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:57:26.028 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T02:57:26.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:26.030 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T02:57:26.088 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T02:57:26.088 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:57:26.088 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:57:26.089 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:57:26.089 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:57:26.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:26.089 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T02:57:26.089 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T02:57:26.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:57:26.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:57:26.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:57:26.090 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T02:57:26.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:26.195 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:57:26.210 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:57:26.210 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:57:26.210 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:57:26.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:26.211 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T02:57:26.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:57:26.275 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:57:26.329 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:57:26.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:57:26.330 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:57:26.384 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T02:57:26.384 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:57:26.384 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:57:26.463 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:57:26.463 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:57:26.482 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:57:26.482 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:57:26.482 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:57:26.482 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:57:26.482 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:57:26.482 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:57:26.482 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:57:26.483 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:57:26.503 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T02:57:26.503 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T02:57:26.503 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T02:57:26.503 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@072ce422-278f-434c-8814-5b3ff2abcdfb.cephfs=/ 2023-10-06T02:57:26.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T02:57:26.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T02:57:26.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T02:57:26.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:57:26.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T02:57:26.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T02:57:26.504 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=072ce422-278f-434c-8814-5b3ff2abcdfb" will pass to kernel 2023-10-06T02:57:26.506 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:57:26.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:26.506 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:57:26.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:26.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.685+0000 7f0665e75700 1 Processor -- start 2023-10-06T02:57:26.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.685+0000 7f0665e75700 1 -- start start 2023-10-06T02:57:26.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.685+0000 7f0665e75700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0660157fe0 0x7f06600b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:26.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.685+0000 7f0665e75700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06601583b0 0x7f06600b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:26.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.685+0000 7f0665e75700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06600b2890 con 0x7f06600ceb30 2023-10-06T02:57:26.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.685+0000 7f0665e75700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06600b4070 con 0x7f0660157fe0 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.685+0000 7f0665e75700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600b4350 con 0x7f06601583b0 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0660157fe0 0x7f06600b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f06600ceb30 0x7f06600cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34088/0 (socket says 172.21.15.81:34088) 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065ffff700 1 -- 172.21.15.81:0/3133625772 learned_addr learned my addr 172.21.15.81:0/3133625772 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065effd700 1 --2- 172.21.15.81:0/3133625772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06601583b0 0x7f06600b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065f7fe700 1 -- 172.21.15.81:0/3133625772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06601583b0 msgr2=0x7f06600b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065f7fe700 1 --2- 172.21.15.81:0/3133625772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06601583b0 0x7f06600b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065f7fe700 1 -- 172.21.15.81:0/3133625772 >> v1:172.21.15.81:6789/0 conn(0x7f06600ceb30 legacy=0x7f06600cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065e7fc700 1 -- 172.21.15.81:0/3133625772 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935889098 0 0) 0x7f06600b2890 con 0x7f06600ceb30 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065f7fe700 1 -- 172.21.15.81:0/3133625772 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600b4630 con 0x7f0660157fe0 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065f7fe700 1 --2- 172.21.15.81:0/3133625772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0660157fe0 0x7f06600b34c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f0650009e60 tx=0x7f0650009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5c1530e7778710 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:26.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065e7fc700 1 -- 172.21.15.81:0/3133625772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000e070 con 0x7f0660157fe0 2023-10-06T02:57:26.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065e7fc700 1 -- 172.21.15.81:0/3133625772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065000bb60 con 0x7f0660157fe0 2023-10-06T02:57:26.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.686+0000 7f065e7fc700 1 -- 172.21.15.81:0/3133625772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650012430 con 0x7f0660157fe0 2023-10-06T02:57:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.687+0000 7f0665e75700 1 -- 172.21.15.81:0/3133625772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0660157fe0 msgr2=0x7f06600b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.687+0000 7f0665e75700 1 --2- 172.21.15.81:0/3133625772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0660157fe0 0x7f06600b34c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f0650009e60 tx=0x7f0650009780 comp rx=0 tx=0).stop 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.687+0000 7f0665e75700 1 -- 172.21.15.81:0/3133625772 shutdown_connections 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.687+0000 7f0665e75700 1 --2- 172.21.15.81:0/3133625772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0660157fe0 0x7f06600b34c0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.687+0000 7f0665e75700 1 --2- 172.21.15.81:0/3133625772 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06601583b0 0x7f06600b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.687+0000 7f0665e75700 1 -- 172.21.15.81:0/3133625772 >> 172.21.15.81:0/3133625772 conn(0x7f0660067640 msgr2=0x7f0660067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.687+0000 7f0665e75700 1 -- 172.21.15.81:0/3133625772 shutdown_connections 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.687+0000 7f0665e75700 1 -- 172.21.15.81:0/3133625772 wait complete. 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.688+0000 7f0665e75700 1 Processor -- start 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.688+0000 7f0665e75700 1 -- start start 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f0665e75700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06600ceb30 0x7f066014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f0665e75700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0660157fe0 0x7f0660159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f0665e75700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06601583b0 0x7f066015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f0665e75700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066014ed10 con 0x7f06600ceb30 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f0665e75700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066014b060 con 0x7f06601583b0 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f0665e75700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066014bec0 con 0x7f0660157fe0 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f065f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06600ceb30 0x7f066014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f065f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06600ceb30 0x7f066014e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37940/0 (socket says 172.21.15.81:37940) 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f065f7fe700 1 -- 172.21.15.81:0/1148187598 learned_addr learned my addr 172.21.15.81:0/1148187598 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f065f7fe700 1 -- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0660157fe0 msgr2=0x7f0660159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f065f7fe700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0660157fe0 0x7f0660159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f065f7fe700 1 -- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06601583b0 msgr2=0x7f066015c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f065f7fe700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06601583b0 0x7f066015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f065f7fe700 1 -- 172.21.15.81:0/1148187598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650009a20 con 0x7f06600ceb30 2023-10-06T02:57:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f065f7fe700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06600ceb30 0x7f066014e7d0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f065000b6c0 tx=0x7f0650019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f06477fe700 1 -- 172.21.15.81:0/1148187598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650012da0 con 0x7f06600ceb30 2023-10-06T02:57:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f06477fe700 1 -- 172.21.15.81:0/1148187598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06500263f0 con 0x7f06600ceb30 2023-10-06T02:57:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066014b2b0 con 0x7f06600ceb30 2023-10-06T02:57:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f06477fe700 1 -- 172.21.15.81:0/1148187598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500267b0 con 0x7f06600ceb30 2023-10-06T02:57:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.689+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066014bb50 con 0x7f06600ceb30 2023-10-06T02:57:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.690+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0660069e40 con 0x7f06600ceb30 2023-10-06T02:57:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.691+0000 7f06477fe700 1 -- 172.21.15.81:0/1148187598 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0650026ba0 con 0x7f06600ceb30 2023-10-06T02:57:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.691+0000 7f06477fe700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f064c066f30 0x7f064c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.691+0000 7f06477fe700 1 -- 172.21.15.81:0/1148187598 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f06500860d0 con 0x7f06600ceb30 2023-10-06T02:57:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.691+0000 7f065effd700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f064c066f30 0x7f064c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.692+0000 7f065effd700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f064c066f30 0x7f064c0693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f066015dc80 tx=0x7f06540091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.695+0000 7f06477fe700 1 -- 172.21.15.81:0/1148187598 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06500531e0 con 0x7f06600ceb30 2023-10-06T02:57:26.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.926+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06600cc6b0 con 0x7f06600ceb30 2023-10-06T02:57:26.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.926+0000 7f06477fe700 1 -- 172.21.15.81:0/1148187598 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f0650056800 con 0x7f06600ceb30 2023-10-06T02:57:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:26.928 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:18.128298+0000","modified":"2023-10-06T02:57:21.769179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8358":{"gid":8358,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/604648999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":604648999},{"type":"v1","addr":"172.21.15.81:6835","nonce":604648999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T02:57:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f064c066f30 msgr2=0x7f064c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f064c066f30 0x7f064c0693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f066015dc80 tx=0x7f06540091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06600ceb30 msgr2=0x7f066014e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06600ceb30 0x7f066014e7d0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f065000b6c0 tx=0x7f0650019000 comp rx=0 tx=0).stop 2023-10-06T02:57:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 shutdown_connections 2023-10-06T02:57:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f064c066f30 0x7f064c0693e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06601583b0 0x7f066015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06600ceb30 0x7f066014e7d0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 --2- 172.21.15.81:0/1148187598 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0660157fe0 0x7f0660159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.928+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 >> 172.21.15.81:0/1148187598 conn(0x7f0660067640 msgr2=0x7f06600cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.929+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 shutdown_connections 2023-10-06T02:57:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:26.929+0000 7f0665e75700 1 -- 172.21.15.81:0/1148187598 wait complete. 2023-10-06T02:57:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-06T02:57:26.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:57:27.075 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":8358,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3146008420000008,"mdsmap_epoch":90,"osdmap_epoch":180,"osdmap_epoch_barrier":180,"uptime":14.421139121} 2023-10-06T02:57:27.075 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 8358, "mdsmap_epoch": 90, "osdmap_epoch": 180, "osdmap_epoch_barrier": 180, "rank_uptime": 8.314600842, "state": "up:active", "uptime": 14.421139121, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:57:27.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-06T02:57:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.192+0000 7f80c0d5f700 1 Processor -- start 2023-10-06T02:57:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.192+0000 7f80c0d5f700 1 -- start start 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.193+0000 7f80c0d5f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f80bc1578d0 0x7f80bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.193+0000 7f80c0d5f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80bc157ca0 0x7f80bc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.193+0000 7f80c0d5f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc0d07c0 con 0x7f80bc06d120 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.193+0000 7f80c0d5f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0cfbb0 con 0x7f80bc157ca0 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.193+0000 7f80c0d5f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0cfe90 con 0x7f80bc1578d0 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.193+0000 7f80b1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80bc157ca0 0x7f80bc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.193+0000 7f80bad9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f80bc06d120 0x7f80bc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34102/0 (socket says 172.21.15.81:34102) 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.193+0000 7f80bad9d700 1 -- 172.21.15.81:0/1545946798 learned_addr learned my addr 172.21.15.81:0/1545946798 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.193+0000 7f80ba59c700 1 --2- 172.21.15.81:0/1545946798 >> v2:172.21.15.83:3300/0 conn(0x7f80bc1578d0 0x7f80bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80b1d9b700 1 -- 172.21.15.81:0/1545946798 >> v2:172.21.15.83:3300/0 conn(0x7f80bc1578d0 msgr2=0x7f80bc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80b1d9b700 1 --2- 172.21.15.81:0/1545946798 >> v2:172.21.15.83:3300/0 conn(0x7f80bc1578d0 0x7f80bc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80b1d9b700 1 -- 172.21.15.81:0/1545946798 >> v1:172.21.15.81:6789/0 conn(0x7f80bc06d120 legacy=0x7f80bc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80b1d9b700 1 -- 172.21.15.81:0/1545946798 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0d0170 con 0x7f80bc157ca0 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80b9d9b700 1 -- 172.21.15.81:0/1545946798 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544447610 0 0) 0x7f80bc0d07c0 con 0x7f80bc06d120 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80b1d9b700 1 --2- 172.21.15.81:0/1545946798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc157ca0 0x7f80bc15af00 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0646b0 tx=0x7f80a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f43c10e95629830 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80b9d9b700 1 -- 172.21.15.81:0/1545946798 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4011630 con 0x7f80bc157ca0 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80b9d9b700 1 -- 172.21.15.81:0/1545946798 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a4011790 con 0x7f80bc157ca0 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80b9d9b700 1 -- 172.21.15.81:0/1545946798 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4011b30 con 0x7f80bc157ca0 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1545946798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc157ca0 msgr2=0x7f80bc15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80c0d5f700 1 --2- 172.21.15.81:0/1545946798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc157ca0 0x7f80bc15af00 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0646b0 tx=0x7f80a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1545946798 shutdown_connections 2023-10-06T02:57:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80c0d5f700 1 --2- 172.21.15.81:0/1545946798 >> v2:172.21.15.83:3300/0 conn(0x7f80bc1578d0 0x7f80bc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80c0d5f700 1 --2- 172.21.15.81:0/1545946798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc157ca0 0x7f80bc15af00 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1545946798 >> 172.21.15.81:0/1545946798 conn(0x7f80bc06bb90 msgr2=0x7f80bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1545946798 shutdown_connections 2023-10-06T02:57:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.194+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1545946798 wait complete. 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.196+0000 7f80c0d5f700 1 Processor -- start 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.196+0000 7f80c0d5f700 1 -- start start 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.196+0000 7f80c0d5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc06d120 0x7f80bc149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.196+0000 7f80c0d5f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc1578d0 0x7f80bc145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.196+0000 7f80c0d5f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc157ca0 0x7f80bc145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.196+0000 7f80c0d5f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc146f20 con 0x7f80bc06d120 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.196+0000 7f80c0d5f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc145e80 con 0x7f80bc1578d0 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.196+0000 7f80c0d5f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc146160 con 0x7f80bc157ca0 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.196+0000 7f80ba59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc06d120 0x7f80bc149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80ba59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc06d120 0x7f80bc149c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37952/0 (socket says 172.21.15.81:37952) 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80ba59c700 1 -- 172.21.15.81:0/1858728738 learned_addr learned my addr 172.21.15.81:0/1858728738 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80b1d9b700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc1578d0 0x7f80bc145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80bad9d700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc157ca0 0x7f80bc145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80ba59c700 1 -- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc157ca0 msgr2=0x7f80bc145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80ba59c700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc157ca0 0x7f80bc145660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80ba59c700 1 -- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc1578d0 msgr2=0x7f80bc145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80ba59c700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc1578d0 0x7f80bc145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80ba59c700 1 -- 172.21.15.81:0/1858728738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a4009420 con 0x7f80bc06d120 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80bad9d700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc157ca0 0x7f80bc145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80ba59c700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc06d120 0x7f80bc149c90 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ec80 tx=0x7f80ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1858728738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00c850 con 0x7f80bc06d120 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1858728738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00c9b0 con 0x7f80bc06d120 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1858728738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00cd50 con 0x7f80bc06d120 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc146440 con 0x7f80bc06d120 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.197+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc146a00 con 0x7f80bc06d120 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.198+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc067ac0 con 0x7f80bc06d120 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.198+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1858728738 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80ac013680 con 0x7f80bc06d120 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.199+0000 7f80b2ffd700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f809c066f30 0x7f809c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.199+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1858728738 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f80ac084950 con 0x7f80bc06d120 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.199+0000 7f80b1d9b700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f809c066f30 0x7f809c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.199+0000 7f80b1d9b700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f809c066f30 0x7f809c0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f80bc1580c0 tx=0x7f80a4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.203+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1858728738 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80ac051a60 con 0x7f80bc06d120 2023-10-06T02:57:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.384+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f80bc0d0450 con 0x7f80bc06d120 2023-10-06T02:57:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1858728738 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v181) v1 ==== 181+0+0 (secure 0 0 0) 0x7f80ac055080 con 0x7f80bc06d120 2023-10-06T02:57:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f809c066f30 msgr2=0x7f809c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f809c066f30 0x7f809c0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f80bc1580c0 tx=0x7f80a4017000 comp rx=0 tx=0).stop 2023-10-06T02:57:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc06d120 msgr2=0x7f80bc149c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc06d120 0x7f80bc149c90 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ec80 tx=0x7f80ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 shutdown_connections 2023-10-06T02:57:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80bc157ca0 0x7f80bc145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80bc06d120 0x7f80bc149c90 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f809c066f30 0x7f809c0693e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 --2- 172.21.15.81:0/1858728738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80bc1578d0 0x7f80bc145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 >> 172.21.15.81:0/1858728738 conn(0x7f80bc06bb90 msgr2=0x7f80bc155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 shutdown_connections 2023-10-06T02:57:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:27.790+0000 7f80c0d5f700 1 -- 172.21.15.81:0/1858728738 wait complete. 2023-10-06T02:57:27.794 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-06T02:57:27.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-06T02:57:27.935 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-06T02:57:27.935 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-06T02:57:27.935 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-06T02:57:27.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:27.935 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-06T02:57:28.043 INFO:teuthology.orchestra.run.smithi081.stderr:16+0 records in 2023-10-06T02:57:28.043 INFO:teuthology.orchestra.run.smithi081.stderr:16+0 records out 2023-10-06T02:57:28.043 INFO:teuthology.orchestra.run.smithi081.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0886383 s, 189 MB/s 2023-10-06T02:57:28.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:28.044 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-06T02:57:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:17+0 records in 2023-10-06T02:57:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:17+0 records out 2023-10-06T02:57:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0927874 s, 192 MB/s 2023-10-06T02:57:28.153 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-06T02:57:28.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:57:28.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.265+0000 7f89f7fb8700 1 Processor -- start 2023-10-06T02:57:28.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.265+0000 7f89f7fb8700 1 -- start start 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.266+0000 7f89f7fb8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89f01578d0 0x7f89f00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.266+0000 7f89f7fb8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f89f0157ca0 0x7f89f015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.266+0000 7f89f7fb8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.266+0000 7f89f7fb8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f00d07c0 con 0x7f89f01578d0 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.266+0000 7f89f7fb8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f006daa0 con 0x7f89f0157ca0 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.266+0000 7f89f7fb8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00cfbb0 con 0x7f89f006d120 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.266+0000 7f89f5d54700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89f01578d0 0x7f89f00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.266+0000 7f89f5d54700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89f01578d0 0x7f89f00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37966/0 (socket says 172.21.15.81:37966) 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.266+0000 7f89f5d54700 1 -- 172.21.15.81:0/3032596718 learned_addr learned my addr 172.21.15.81:0/3032596718 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f6555700 1 --2- 172.21.15.81:0/3032596718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f5553700 1 --2- 172.21.15.81:0/3032596718 >> v2:172.21.15.83:3300/0 conn(0x7f89f0157ca0 0x7f89f015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f5d54700 1 -- 172.21.15.81:0/3032596718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 msgr2=0x7f89f006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f5d54700 1 --2- 172.21.15.81:0/3032596718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f5d54700 1 -- 172.21.15.81:0/3032596718 >> v2:172.21.15.83:3300/0 conn(0x7f89f0157ca0 msgr2=0x7f89f015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f5d54700 1 --2- 172.21.15.81:0/3032596718 >> v2:172.21.15.83:3300/0 conn(0x7f89f0157ca0 0x7f89f015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f5d54700 1 -- 172.21.15.81:0/3032596718 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00cfe90 con 0x7f89f01578d0 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f6555700 1 --2- 172.21.15.81:0/3032596718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f5553700 1 --2- 172.21.15.81:0/3032596718 >> v2:172.21.15.83:3300/0 conn(0x7f89f0157ca0 0x7f89f015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f5d54700 1 --2- 172.21.15.81:0/3032596718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f01578d0 0x7f89f00cf4f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f89f0068510 tx=0x7f89ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547870470c4626c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f4d52700 1 -- 172.21.15.81:0/3032596718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00e070 con 0x7f89f01578d0 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f4d52700 1 -- 172.21.15.81:0/3032596718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec00ba50 con 0x7f89f01578d0 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f4d52700 1 -- 172.21.15.81:0/3032596718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0092e0 con 0x7f89f01578d0 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f7fb8700 1 -- 172.21.15.81:0/3032596718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f01578d0 msgr2=0x7f89f00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/3032596718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f01578d0 0x7f89f00cf4f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f89f0068510 tx=0x7f89ec009840 comp rx=0 tx=0).stop 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f7fb8700 1 -- 172.21.15.81:0/3032596718 shutdown_connections 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/3032596718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/3032596718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f01578d0 0x7f89f00cf4f0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/3032596718 >> v2:172.21.15.83:3300/0 conn(0x7f89f0157ca0 0x7f89f015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.267+0000 7f89f7fb8700 1 -- 172.21.15.81:0/3032596718 >> 172.21.15.81:0/3032596718 conn(0x7f89f006bb90 msgr2=0x7f89f006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.268+0000 7f89f7fb8700 1 -- 172.21.15.81:0/3032596718 shutdown_connections 2023-10-06T02:57:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.268+0000 7f89f7fb8700 1 -- 172.21.15.81:0/3032596718 wait complete. 2023-10-06T02:57:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f7fb8700 1 Processor -- start 2023-10-06T02:57:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f7fb8700 1 -- start start 2023-10-06T02:57:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f7fb8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f0168700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f7fb8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f01578d0 0x7f89f016b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f7fb8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f0157ca0 0x7f89f0167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f7fb8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f016ce40 con 0x7f89f0157ca0 2023-10-06T02:57:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f7fb8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f016c230 con 0x7f89f01578d0 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f7fb8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f016c510 con 0x7f89f006d120 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f6555700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f0157ca0 0x7f89f0167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f6555700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f0157ca0 0x7f89f0167cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37982/0 (socket says 172.21.15.81:37982) 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.269+0000 7f89f6555700 1 -- 172.21.15.81:0/358811922 learned_addr learned my addr 172.21.15.81:0/358811922 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f5d54700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f0168700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f5553700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f01578d0 0x7f89f016b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f6555700 1 -- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 msgr2=0x7f89f0168700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f6555700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f0168700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f6555700 1 -- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f01578d0 msgr2=0x7f89f016b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f6555700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f01578d0 0x7f89f016b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f6555700 1 -- 172.21.15.81:0/358811922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec009ae0 con 0x7f89f0157ca0 2023-10-06T02:57:28.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f5d54700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f0168700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f6555700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f0157ca0 0x7f89f0167cc0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c880 tx=0x7f89e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89e5ffb700 1 -- 172.21.15.81:0/358811922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8011600 con 0x7f89f0157ca0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89e5ffb700 1 -- 172.21.15.81:0/358811922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8011780 con 0x7f89f0157ca0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f016c7f0 con 0x7f89f0157ca0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89e5ffb700 1 -- 172.21.15.81:0/358811922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8011b40 con 0x7f89f0157ca0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.270+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f0168c40 con 0x7f89f0157ca0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.271+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f016cfb0 con 0x7f89f0157ca0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.271+0000 7f89e5ffb700 1 -- 172.21.15.81:0/358811922 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89e8018350 con 0x7f89f0157ca0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.272+0000 7f89e5ffb700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f89d4066f30 0x7f89d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.272+0000 7f89e5ffb700 1 -- 172.21.15.81:0/358811922 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f89e8084620 con 0x7f89f0157ca0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.272+0000 7f89f5d54700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f89d4066f30 0x7f89d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.272+0000 7f89f5d54700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f89d4066f30 0x7f89d40693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009ab0 tx=0x7f89ec018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:28.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.276+0000 7f89e5ffb700 1 -- 172.21.15.81:0/358811922 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89e80551c0 con 0x7f89f0157ca0 2023-10-06T02:57:28.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.459+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f89f00d0170 con 0x7f89f0157ca0 2023-10-06T02:57:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.460+0000 7f89e5ffb700 1 -- 172.21.15.81:0/358811922 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v181) v1 ==== 81+0+34792 (secure 0 0 0) 0x7f89e8054d50 con 0x7f89f0157ca0 2023-10-06T02:57:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 181, 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:57:27.783248+0000", 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:57:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 24, 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:57:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:57:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:57:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:15.791318+0000", 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:57:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "179", 2023-10-06T02:57:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 24, 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:17.104149+0000", 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "181", 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:57:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:57:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:57:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:57:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:57:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:57:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:57:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:57:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:57:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:57:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:57:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:57:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f89d4066f30 msgr2=0x7f89d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f89d4066f30 0x7f89d40693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009ab0 tx=0x7f89ec018000 comp rx=0 tx=0).stop 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f0157ca0 msgr2=0x7f89f0167cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f0157ca0 0x7f89f0167cc0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c880 tx=0x7f89e8008040 comp rx=0 tx=0).stop 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 shutdown_connections 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f0157ca0 0x7f89f0167cc0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89f006d120 0x7f89f0168700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f89d4066f30 0x7f89d40693e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 --2- 172.21.15.81:0/358811922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89f01578d0 0x7f89f016b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 >> 172.21.15.81:0/358811922 conn(0x7f89f006bb90 msgr2=0x7f89f0155af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 shutdown_connections 2023-10-06T02:57:28.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:28.462+0000 7f89f7fb8700 1 -- 172.21.15.81:0/358811922 wait complete. 2023-10-06T02:57:28.550 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:57:33.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:57:33.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.677+0000 7f2782856700 1 Processor -- start 2023-10-06T02:57:33.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.677+0000 7f2782856700 1 -- start start 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f2782856700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f277c157ca0 0x7f277c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f2782856700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c0d07c0 con 0x7f277c1578d0 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f2782856700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c0cfbb0 con 0x7f277c06d120 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f2782856700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c0cfe90 con 0x7f277c157ca0 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f277bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f277c1578d0 0x7f277c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41248/0 (socket says 172.21.15.81:41248) 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f277bfff700 1 -- 172.21.15.81:0/2838385299 learned_addr learned my addr 172.21.15.81:0/2838385299 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f277b7fe700 1 --2- 172.21.15.81:0/2838385299 >> v2:172.21.15.81:3300/0 conn(0x7f277c157ca0 0x7f277c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f277affd700 1 -- 172.21.15.81:0/2838385299 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684510237 0 0) 0x7f277c0d07c0 con 0x7f277c1578d0 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f277affd700 1 -- 172.21.15.81:0/2838385299 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2764003570 con 0x7f277c1578d0 2023-10-06T02:57:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f277b7fe700 1 -- 172.21.15.81:0/2838385299 >> v1:172.21.15.83:6789/0 conn(0x7f277c06d120 legacy=0x7f277c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f277b7fe700 1 -- 172.21.15.81:0/2838385299 >> v1:172.21.15.81:6789/0 conn(0x7f277c1578d0 legacy=0x7f277c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.678+0000 7f277b7fe700 1 -- 172.21.15.81:0/2838385299 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c0d0170 con 0x7f277c157ca0 2023-10-06T02:57:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f277b7fe700 1 --2- 172.21.15.81:0/2838385299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c157ca0 0x7f277c0cf4f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f27700098e0 tx=0x7f27700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476044a464f554dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f277affd700 1 -- 172.21.15.81:0/2838385299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000b640 con 0x7f277c157ca0 2023-10-06T02:57:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f277affd700 1 -- 172.21.15.81:0/2838385299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000b7a0 con 0x7f277c157ca0 2023-10-06T02:57:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f277affd700 1 -- 172.21.15.81:0/2838385299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000bb40 con 0x7f277c157ca0 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f2782856700 1 -- 172.21.15.81:0/2838385299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c157ca0 msgr2=0x7f277c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f2782856700 1 --2- 172.21.15.81:0/2838385299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c157ca0 0x7f277c0cf4f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f27700098e0 tx=0x7f27700091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f2782856700 1 -- 172.21.15.81:0/2838385299 shutdown_connections 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f2782856700 1 --2- 172.21.15.81:0/2838385299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c157ca0 0x7f277c0cf4f0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f2782856700 1 -- 172.21.15.81:0/2838385299 >> 172.21.15.81:0/2838385299 conn(0x7f277c06bb90 msgr2=0x7f277c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f2782856700 1 -- 172.21.15.81:0/2838385299 shutdown_connections 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.679+0000 7f2782856700 1 -- 172.21.15.81:0/2838385299 wait complete. 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.680+0000 7f2782856700 1 Processor -- start 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f2782856700 1 -- start start 2023-10-06T02:57:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f2782856700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f277c06d120 0x7f277c13c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f2782856700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c1578d0 0x7f277c16d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f2782856700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f277c157ca0 0x7f277c16dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f2782856700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c150450 con 0x7f277c1578d0 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f2782856700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c14d580 con 0x7f277c06d120 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f2782856700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c14f840 con 0x7f277c157ca0 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f277b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c1578d0 0x7f277c16d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f277b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c1578d0 0x7f277c16d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51634/0 (socket says 172.21.15.81:51634) 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.681+0000 7f277b7fe700 1 -- 172.21.15.81:0/2309196615 learned_addr learned my addr 172.21.15.81:0/2309196615 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f277bfff700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f277c06d120 0x7f277c13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f2780df3700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f277c157ca0 0x7f277c16dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f277b7fe700 1 -- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f277c157ca0 msgr2=0x7f277c16dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f277b7fe700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f277c157ca0 0x7f277c16dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f277b7fe700 1 -- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f277c06d120 msgr2=0x7f277c13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f277b7fe700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f277c06d120 0x7f277c13c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f277b7fe700 1 -- 172.21.15.81:0/2309196615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009420 con 0x7f277c1578d0 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f277bfff700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f277c06d120 0x7f277c13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f277b7fe700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c1578d0 0x7f277c16d980 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f2770013000 tx=0x7f2770017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f2763fff700 1 -- 172.21.15.81:0/2309196615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000bb20 con 0x7f277c1578d0 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f2763fff700 1 -- 172.21.15.81:0/2309196615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2770011420 con 0x7f277c1578d0 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c14fb20 con 0x7f277c1578d0 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f2763fff700 1 -- 172.21.15.81:0/2309196615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700117a0 con 0x7f277c1578d0 2023-10-06T02:57:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.682+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c1500e0 con 0x7f277c1578d0 2023-10-06T02:57:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.683+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277c1505c0 con 0x7f277c1578d0 2023-10-06T02:57:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.683+0000 7f2763fff700 1 -- 172.21.15.81:0/2309196615 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2770011b50 con 0x7f277c1578d0 2023-10-06T02:57:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.684+0000 7f2763fff700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2768066f30 0x7f27680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.684+0000 7f2763fff700 1 -- 172.21.15.81:0/2309196615 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2770085d50 con 0x7f277c1578d0 2023-10-06T02:57:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.684+0000 7f277bfff700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2768066f30 0x7f27680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.684+0000 7f277bfff700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2768066f30 0x7f27680693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f276c0058d0 tx=0x7f276c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.688+0000 7f2763fff700 1 -- 172.21.15.81:0/2309196615 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2770089030 con 0x7f277c1578d0 2023-10-06T02:57:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.875+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f277c0d0450 con 0x7f277c1578d0 2023-10-06T02:57:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.876+0000 7f2763fff700 1 -- 172.21.15.81:0/2309196615 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v181) v1 ==== 81+0+34792 (secure 0 0 0) 0x7f2770052e60 con 0x7f277c1578d0 2023-10-06T02:57:33.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:33.877 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:33.877 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 181, 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:57:27.783248+0000", 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:57:33.878 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 24, 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:57:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:33.880 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:33.881 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:33.883 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:33.884 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:33.886 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:57:33.887 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:33.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:33.889 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:33.891 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:15.791318+0000", 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:33.892 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:33.893 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:33.893 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:33.893 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:33.893 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:33.893 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:33.893 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:33.893 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:33.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:33.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:33.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "179", 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:33.895 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:33.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:33.897 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:57:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 24, 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:17.104149+0000", 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "181", 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:57:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:57:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:57:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:33.919 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:33.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:33.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:57:33.927 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:33.932 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.936 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:33.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:57:33.938 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:33.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:57:33.938 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:33.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:33.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:33.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.946 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:57:33.947 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:57:33.947 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:57:33.947 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:57:33.947 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:33.947 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:33.947 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:33.947 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.949 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:33.949 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:33.949 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:33.949 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:33.949 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:33.949 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:33.949 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:33.949 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.953 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:33.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:33.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:33.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:57:33.961 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:33.963 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:57:33.964 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.966 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:33.967 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:33.968 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:57:33.969 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:57:33.970 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:57:33.971 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:57:33.971 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:57:33.971 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:57:33.971 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:57:33.971 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:57:33.971 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:57:33.971 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:57:33.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:33.971 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2768066f30 msgr2=0x7f27680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2768066f30 0x7f27680693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f276c0058d0 tx=0x7f276c009040 comp rx=0 tx=0).stop 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c1578d0 msgr2=0x7f277c16d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c1578d0 0x7f277c16d980 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f2770013000 tx=0x7f2770017000 comp rx=0 tx=0).stop 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 shutdown_connections 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f277c157ca0 0x7f277c16dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2768066f30 0x7f27680693e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f277c06d120 0x7f277c13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 --2- 172.21.15.81:0/2309196615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c1578d0 0x7f277c16d980 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 >> 172.21.15.81:0/2309196615 conn(0x7f277c06bb90 msgr2=0x7f277c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:33.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 shutdown_connections 2023-10-06T02:57:33.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:33.878+0000 7f2782856700 1 -- 172.21.15.81:0/2309196615 wait complete. 2023-10-06T02:57:33.974 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:57:38.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:38.039 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:38.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:57:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.095+0000 7f2aab9b2700 1 Processor -- start 2023-10-06T02:57:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.096+0000 7f2aab9b2700 1 -- start start 2023-10-06T02:57:39.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.096+0000 7f2aab9b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa406d830 0x7f2aa40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.096+0000 7f2aab9b2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa40d07c0 con 0x7f2aa4157ca0 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.096+0000 7f2aab9b2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa40cfbb0 con 0x7f2aa41578d0 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.096+0000 7f2aab9b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40cfe90 con 0x7f2aa406d830 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2aa8f4d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2aa4157ca0 0x7f2aa406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41252/0 (socket says 172.21.15.81:41252) 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2aa8f4d700 1 -- 172.21.15.81:0/3953577243 learned_addr learned my addr 172.21.15.81:0/3953577243 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2aa9f4f700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa406d830 0x7f2aa40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708136914 0 0) 0x7f2aa40d07c0 con 0x7f2aa4157ca0 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a90003570 con 0x7f2aa4157ca0 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116355333 0 0) 0x7f2aa40cfbb0 con 0x7f2aa41578d0 2023-10-06T02:57:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aa40d07c0 con 0x7f2aa41578d0 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 70874002 0 0) 0x7f2a90003570 con 0x7f2aa4157ca0 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa406d830 msgr2=0x7f2aa40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa406d830 0x7f2aa40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 >> v1:172.21.15.83:6789/0 conn(0x7f2aa41578d0 legacy=0x7f2aa415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40d0170 con 0x7f2aa4157ca0 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f2a94001470 con 0x7f2aa4157ca0 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 >> v1:172.21.15.81:6789/0 conn(0x7f2aa4157ca0 legacy=0x7f2aa406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa406d830 0x7f2a90003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2a90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a90004d50 0x7f2a900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40cfe90 con 0x7f2a90004180 2023-10-06T02:57:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9000bba0 con 0x7f2a90004d50 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9000bd60 con 0x7f2aa406d830 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2aa8f4d700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2a90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2aa974e700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa406d830 0x7f2a90003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.097+0000 7f2aa9f4f700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a90004d50 0x7f2a900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aa8f4d700 1 -- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa406d830 msgr2=0x7f2a90003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aa8f4d700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa406d830 0x7f2a90003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aa8f4d700 1 -- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a90004d50 msgr2=0x7f2a900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aa8f4d700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a90004d50 0x7f2a900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aa8f4d700 1 -- 172.21.15.81:0/3953577243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a90003570 con 0x7f2a90004180 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aa8f4d700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2a90004810 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400c2a0 tx=0x7f2aa415b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fb669b4c2f4cba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400cb70 con 0x7f2a90004180 2023-10-06T02:57:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9400ccf0 con 0x7f2a90004180 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2a9bfff700 1 -- 172.21.15.81:0/3953577243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a94005b70 con 0x7f2a90004180 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aab9b2700 1 -- 172.21.15.81:0/3953577243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 msgr2=0x7f2a90004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aab9b2700 1 --2- 172.21.15.81:0/3953577243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2a90004810 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400c2a0 tx=0x7f2aa415b610 comp rx=0 tx=0).stop 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aa9f4f700 1 -- 172.21.15.81:0/3953577243 reap_dead start 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aab9b2700 1 -- 172.21.15.81:0/3953577243 shutdown_connections 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aab9b2700 1 -- 172.21.15.81:0/3953577243 >> 172.21.15.81:0/3953577243 conn(0x7f2aa406bb90 msgr2=0x7f2aa406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aab9b2700 1 -- 172.21.15.81:0/3953577243 shutdown_connections 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.098+0000 7f2aab9b2700 1 -- 172.21.15.81:0/3953577243 wait complete. 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.099+0000 7f2aab9b2700 1 Processor -- start 2023-10-06T02:57:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.100+0000 7f2aab9b2700 1 -- start start 2023-10-06T02:57:39.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.100+0000 7f2aab9b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2aa40c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.100+0000 7f2aab9b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa40c8830 0x7f2aa40c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.100+0000 7f2aab9b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa40c71a0 0x7f2aa40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.100+0000 7f2aab9b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40c7610 con 0x7f2a90004180 2023-10-06T02:57:39.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.100+0000 7f2aab9b2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa416a5c0 con 0x7f2aa40c71a0 2023-10-06T02:57:39.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.100+0000 7f2aab9b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40c67d0 con 0x7f2aa40c8830 2023-10-06T02:57:39.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.100+0000 7f2aa974e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2aa40c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa974e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2aa40c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51652/0 (socket says 172.21.15.81:51652) 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa974e700 1 -- 172.21.15.81:0/399187889 learned_addr learned my addr 172.21.15.81:0/399187889 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa8f4d700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa40c8830 0x7f2aa40c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa9f4f700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa40c71a0 0x7f2aa40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa974e700 1 -- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa40c8830 msgr2=0x7f2aa40c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa974e700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa40c8830 0x7f2aa40c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa974e700 1 -- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa40c71a0 msgr2=0x7f2aa40ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa974e700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa40c71a0 0x7f2aa40ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa974e700 1 -- 172.21.15.81:0/399187889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40c5bc0 con 0x7f2a90004180 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa8f4d700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa40c8830 0x7f2aa40c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa9f4f700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa40c71a0 0x7f2aa40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aa974e700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2aa40c82f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000ed50 tx=0x7f2aa00017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2a997fa700 1 -- 172.21.15.81:0/399187889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000cb10 con 0x7f2a90004180 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2a997fa700 1 -- 172.21.15.81:0/399187889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa000cc70 con 0x7f2a90004180 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa40c5ea0 con 0x7f2a90004180 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2a997fa700 1 -- 172.21.15.81:0/399187889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0013420 con 0x7f2a90004180 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.101+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa40c6460 con 0x7f2a90004180 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.102+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa40c6ab0 con 0x7f2a90004180 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.102+0000 7f2a997fa700 1 -- 172.21.15.81:0/399187889 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2aa00137d0 con 0x7f2a90004180 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.103+0000 7f2a997fa700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a88066f30 0x7f2a880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.103+0000 7f2a997fa700 1 -- 172.21.15.81:0/399187889 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2aa00849b0 con 0x7f2a90004180 2023-10-06T02:57:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.103+0000 7f2a997fa700 1 -- 172.21.15.81:0/399187889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7f2a8806f0f0 con 0x7f2a90004180 2023-10-06T02:57:39.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.103+0000 7f2aa8f4d700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a88066f30 0x7f2a880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.104+0000 7f2aa8f4d700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a88066f30 0x7f2a880693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400c2a0 tx=0x7f2a94015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.107+0000 7f2a997fa700 1 -- 172.21.15.81:0/399187889 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2aa0051b40 con 0x7f2a90004180 2023-10-06T02:57:39.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.289+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2aa40d0450 con 0x7f2a90004180 2023-10-06T02:57:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.290+0000 7f2a997fa700 1 -- 172.21.15.81:0/399187889 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v182) v1 ==== 81+0+34811 (secure 0 0 0) 0x7f2aa0055160 con 0x7f2a90004180 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 182, 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:57:34.480188+0000", 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:57:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 24, 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:57:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:57:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:57:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:15.791318+0000", 2023-10-06T02:57:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:57:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "179", 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 24, 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:17.104149+0000", 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "182", 2023-10-06T02:57:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:57:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:57:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:57:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:57:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:57:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:57:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:57:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:57:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:57:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:57:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:57:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:57:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:57:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.380 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a88066f30 msgr2=0x7f2a880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a88066f30 0x7f2a880693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400c2a0 tx=0x7f2a94015000 comp rx=0 tx=0).stop 2023-10-06T02:57:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 msgr2=0x7f2aa40c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2aa40c82f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000ed50 tx=0x7f2aa00017e0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 shutdown_connections 2023-10-06T02:57:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2a88066f30 0x7f2a880693e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa40c71a0 0x7f2aa40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a90004180 0x7f2aa40c82f0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 --2- 172.21.15.81:0/399187889 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa40c8830 0x7f2aa40c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 >> 172.21.15.81:0/399187889 conn(0x7f2aa406bb90 msgr2=0x7f2aa4156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.292+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 shutdown_connections 2023-10-06T02:57:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.293+0000 7f2aab9b2700 1 -- 172.21.15.81:0/399187889 wait complete. 2023-10-06T02:57:39.383 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-06T02:57:39.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:39.383 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-06T02:57:39.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:57:39.632 INFO:teuthology.orchestra.run.smithi081.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-06T02:57:39.633 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-06T02:57:39.633 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-06T02:57:39.633 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.231301 s, 227 MB/s 2023-10-06T02:57:39.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:57:39.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.748+0000 7fcf5bfff700 1 Processor -- start 2023-10-06T02:57:39.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.748+0000 7fcf5bfff700 1 -- start start 2023-10-06T02:57:39.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcf5c154350 0x7fcf5c0cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0b2c20 con 0x7fcf5c06f200 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5bfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0b2f00 con 0x7fcf5c154720 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5bfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c157010 con 0x7fcf5c154350 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf53fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcf5c06f200 0x7fcf5c15a610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41264/0 (socket says 172.21.15.81:41264) 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf53fff700 1 -- 172.21.15.81:0/1820921531 learned_addr learned my addr 172.21.15.81:0/1820921531 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250961007 0 0) 0x7fcf5c0b2c20 con 0x7fcf5c06f200 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf48003570 con 0x7fcf5c06f200 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5affd700 1 --2- 172.21.15.81:0/1820921531 >> v2:172.21.15.83:3300/0 conn(0x7fcf5c154350 0x7fcf5c0cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 246662007 0 0) 0x7fcf48003570 con 0x7fcf5c06f200 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 >> v2:172.21.15.83:3300/0 conn(0x7fcf5c154350 msgr2=0x7fcf5c0cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 --2- 172.21.15.81:0/1820921531 >> v2:172.21.15.83:3300/0 conn(0x7fcf5c154350 0x7fcf5c0cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 >> v1:172.21.15.83:6789/0 conn(0x7fcf5c154720 legacy=0x7fcf5c0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0b31e0 con 0x7fcf5c06f200 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fcf44001470 con 0x7fcf5c06f200 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 >> v1:172.21.15.81:6789/0 conn(0x7fcf5c06f200 legacy=0x7fcf5c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf48003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf48004810 0x7fcf48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf48005210 0x7fcf4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800c180 con 0x7fcf48003ab0 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800c2f0 con 0x7fcf48004810 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800c4b0 con 0x7fcf48005210 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.749+0000 7fcf5affd700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf48003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5b7fe700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf48005210 0x7fcf4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf53fff700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf48004810 0x7fcf48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5affd700 1 -- 172.21.15.81:0/1820921531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf48005210 msgr2=0x7fcf4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5affd700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf48005210 0x7fcf4800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5affd700 1 -- 172.21.15.81:0/1820921531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf48004810 msgr2=0x7fcf48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5affd700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf48004810 0x7fcf48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5affd700 1 -- 172.21.15.81:0/1820921531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48003570 con 0x7fcf48003ab0 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5b7fe700 1 -- 172.21.15.81:0/1820921531 reap_dead start 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5affd700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf48003ec0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009c00 tx=0x7fcf4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946f9cd30585b1cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00e710 con 0x7fcf48003ab0 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00e870 con 0x7fcf48003ab0 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5a7fc700 1 -- 172.21.15.81:0/1820921531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00ec30 con 0x7fcf48003ab0 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5bfff700 1 -- 172.21.15.81:0/1820921531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 msgr2=0x7fcf48003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5bfff700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf48003ec0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009c00 tx=0x7fcf4c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5bfff700 1 -- 172.21.15.81:0/1820921531 shutdown_connections 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5bfff700 1 --2- 172.21.15.81:0/1820921531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf48003ec0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.750+0000 7fcf5bfff700 1 -- 172.21.15.81:0/1820921531 >> 172.21.15.81:0/1820921531 conn(0x7fcf5c063230 msgr2=0x7fcf5c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.751+0000 7fcf5bfff700 1 -- 172.21.15.81:0/1820921531 shutdown_connections 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.751+0000 7fcf5bfff700 1 -- 172.21.15.81:0/1820921531 wait complete. 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5bfff700 1 Processor -- start 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5bfff700 1 -- start start 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf5c148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf5c148dc0 0x7fcf5c0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf5c14e8a0 0x7fcf5c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c149210 con 0x7fcf48003ab0 2023-10-06T02:57:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5bfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c149460 con 0x7fcf5c14e8a0 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c149740 con 0x7fcf5c148dc0 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf5c148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf5c148880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51672/0 (socket says 172.21.15.81:51672) 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf5affd700 1 -- 172.21.15.81:0/3413417221 learned_addr learned my addr 172.21.15.81:0/3413417221 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.752+0000 7fcf53fff700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf5c148dc0 0x7fcf5c0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5b7fe700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf5c14e8a0 0x7fcf5c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5affd700 1 -- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf5c148dc0 msgr2=0x7fcf5c0b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5affd700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf5c148dc0 0x7fcf5c0b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5affd700 1 -- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf5c14e8a0 msgr2=0x7fcf5c0b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5affd700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf5c14e8a0 0x7fcf5c0b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5affd700 1 -- 172.21.15.81:0/3413417221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c149a20 con 0x7fcf48003ab0 2023-10-06T02:57:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5b7fe700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf5c14e8a0 0x7fcf5c0b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5affd700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf5c148880 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c2c0 tx=0x7fcf4c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf52ffd700 1 -- 172.21.15.81:0/3413417221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c022070 con 0x7fcf48003ab0 2023-10-06T02:57:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf52ffd700 1 -- 172.21.15.81:0/3413417221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00e9e0 con 0x7fcf48003ab0 2023-10-06T02:57:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf52ffd700 1 -- 172.21.15.81:0/3413417221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c01c450 con 0x7fcf48003ab0 2023-10-06T02:57:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c149210 con 0x7fcf48003ab0 2023-10-06T02:57:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.753+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c149fe0 con 0x7fcf48003ab0 2023-10-06T02:57:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.754+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c0690d0 con 0x7fcf48003ab0 2023-10-06T02:57:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.754+0000 7fcf52ffd700 1 -- 172.21.15.81:0/3413417221 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf4c01c8a0 con 0x7fcf48003ab0 2023-10-06T02:57:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.755+0000 7fcf52ffd700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf3c066f30 0x7fcf3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.755+0000 7fcf52ffd700 1 -- 172.21.15.81:0/3413417221 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcf4c085cc0 con 0x7fcf48003ab0 2023-10-06T02:57:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.755+0000 7fcf52ffd700 1 -- 172.21.15.81:0/3413417221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7fcf3c06f0f0 con 0x7fcf48003ab0 2023-10-06T02:57:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.755+0000 7fcf53fff700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf3c066f30 0x7fcf3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.755+0000 7fcf53fff700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf3c066f30 0x7fcf3c0693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c14c480 tx=0x7fcf44007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.759+0000 7fcf52ffd700 1 -- 172.21.15.81:0/3413417221 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf4c02b060 con 0x7fcf48003ab0 2023-10-06T02:57:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.941+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcf5c0b34c0 con 0x7fcf48003ab0 2023-10-06T02:57:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.942+0000 7fcf52ffd700 1 -- 172.21.15.81:0/3413417221 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v182) v1 ==== 81+0+34811 (secure 0 0 0) 0x7fcf4c017070 con 0x7fcf48003ab0 2023-10-06T02:57:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 182, 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:57:34.480188+0000", 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:57:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 24, 2023-10-06T02:57:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:57:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:39.954 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:39.956 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:39.957 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:15.791318+0000", 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:39.959 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:39.960 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "179", 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:39.961 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:39.962 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:39.963 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:57:39.964 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 24, 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:17.104149+0000", 2023-10-06T02:57:39.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:39.966 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:39.967 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "182", 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:39.968 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:39.969 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:39.970 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:57:39.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.972 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:57:39.978 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.979 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:57:39.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:57:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:57:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:57:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:57:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:57:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:57:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:57:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:57:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:57:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:57:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:40.035 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:40.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf3c066f30 msgr2=0x7fcf3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf3c066f30 0x7fcf3c0693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c14c480 tx=0x7fcf44007040 comp rx=0 tx=0).stop 2023-10-06T02:57:40.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 msgr2=0x7fcf5c148880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf5c148880 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c2c0 tx=0x7fcf4c01a000 comp rx=0 tx=0).stop 2023-10-06T02:57:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 shutdown_connections 2023-10-06T02:57:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fcf3c066f30 0x7fcf3c0693e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf5c14e8a0 0x7fcf5c0b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf48003ab0 0x7fcf5c148880 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 --2- 172.21.15.81:0/3413417221 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf5c148dc0 0x7fcf5c0b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 >> 172.21.15.81:0/3413417221 conn(0x7fcf5c063230 msgr2=0x7fcf5c06c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 shutdown_connections 2023-10-06T02:57:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:39.944+0000 7fcf5bfff700 1 -- 172.21.15.81:0/3413417221 wait complete. 2023-10-06T02:57:40.038 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.150+0000 7f21c43ac700 1 Processor -- start 2023-10-06T02:57:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.150+0000 7f21c43ac700 1 -- start start 2023-10-06T02:57:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.151+0000 7f21c43ac700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f21bc157ca0 0x7f21bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.151+0000 7f21c43ac700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc0d07c0 con 0x7f21bc1578d0 2023-10-06T02:57:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.151+0000 7f21c43ac700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc0cfbb0 con 0x7f21bc06d120 2023-10-06T02:57:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.151+0000 7f21c43ac700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc0cfe90 con 0x7f21bc157ca0 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.151+0000 7f21c2148700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f21bc1578d0 0x7f21bc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41270/0 (socket says 172.21.15.81:41270) 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.151+0000 7f21c2148700 1 -- 172.21.15.81:0/2907351140 learned_addr learned my addr 172.21.15.81:0/2907351140 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1947700 1 --2- 172.21.15.81:0/2907351140 >> v2:172.21.15.83:3300/0 conn(0x7f21bc157ca0 0x7f21bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510710870 0 0) 0x7f21bc0d07c0 con 0x7f21bc1578d0 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a8003570 con 0x7f21bc1578d0 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2808729587 0 0) 0x7f21a8003570 con 0x7f21bc1578d0 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 >> v2:172.21.15.83:3300/0 conn(0x7f21bc157ca0 msgr2=0x7f21bc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 --2- 172.21.15.81:0/2907351140 >> v2:172.21.15.83:3300/0 conn(0x7f21bc157ca0 0x7f21bc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 >> v1:172.21.15.83:6789/0 conn(0x7f21bc06d120 legacy=0x7f21bc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0d0170 con 0x7f21bc1578d0 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f21b80017f0 con 0x7f21bc1578d0 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 >> v1:172.21.15.81:6789/0 conn(0x7f21bc1578d0 legacy=0x7f21bc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a8003a60 0x7f21a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21a8004810 0x7f21a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21a80051c0 0x7f21a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0cfe90 con 0x7f21a8003a60 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a800c0d0 con 0x7f21a8004810 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a800c290 con 0x7f21a80051c0 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c2148700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a8003a60 0x7f21a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c1947700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21a8004810 0x7f21a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c2949700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21a80051c0 0x7f21a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c2148700 1 -- 172.21.15.81:0/2907351140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21a80051c0 msgr2=0x7f21a800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c2148700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21a80051c0 0x7f21a800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c2148700 1 -- 172.21.15.81:0/2907351140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21a8004810 msgr2=0x7f21a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c2148700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21a8004810 0x7f21a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c2148700 1 -- 172.21.15.81:0/2907351140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8003570 con 0x7f21a8003a60 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.152+0000 7f21c2949700 1 -- 172.21.15.81:0/2907351140 reap_dead start 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c2148700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a8003a60 0x7f21a8003e70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f21b800a930 tx=0x7f21b80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e0951113369a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80070d0 con 0x7f21a8003a60 2023-10-06T02:57:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8007230 con 0x7f21a8003a60 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c1146700 1 -- 172.21.15.81:0/2907351140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80075d0 con 0x7f21a8003a60 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c43ac700 1 -- 172.21.15.81:0/2907351140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a8003a60 msgr2=0x7f21a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c43ac700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a8003a60 0x7f21a8003e70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f21b800a930 tx=0x7f21b80021d0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c43ac700 1 -- 172.21.15.81:0/2907351140 shutdown_connections 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c43ac700 1 --2- 172.21.15.81:0/2907351140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a8003a60 0x7f21a8003e70 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c43ac700 1 -- 172.21.15.81:0/2907351140 >> 172.21.15.81:0/2907351140 conn(0x7f21bc06bb90 msgr2=0x7f21bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c43ac700 1 -- 172.21.15.81:0/2907351140 shutdown_connections 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.153+0000 7f21c43ac700 1 -- 172.21.15.81:0/2907351140 wait complete. 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.154+0000 7f21c43ac700 1 Processor -- start 2023-10-06T02:57:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.154+0000 7f21c43ac700 1 -- start start 2023-10-06T02:57:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c43ac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21a8003a60 0x7f21bc0b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c43ac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc0b5c60 0x7f21bc1456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c43ac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21bc15da40 0x7f21bc15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c43ac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc15e3f0 con 0x7f21bc0b5c60 2023-10-06T02:57:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c43ac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc16da20 con 0x7f21a8003a60 2023-10-06T02:57:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c43ac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc16dc70 con 0x7f21bc15da40 2023-10-06T02:57:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c1947700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc0b5c60 0x7f21bc1456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c1947700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc0b5c60 0x7f21bc1456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51688/0 (socket says 172.21.15.81:51688) 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c1947700 1 -- 172.21.15.81:0/2103216196 learned_addr learned my addr 172.21.15.81:0/2103216196 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c2148700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21a8003a60 0x7f21bc0b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.155+0000 7f21c2949700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21bc15da40 0x7f21bc15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21c1947700 1 -- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21bc15da40 msgr2=0x7f21bc15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21c1947700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21bc15da40 0x7f21bc15deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21c1947700 1 -- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21a8003a60 msgr2=0x7f21bc0b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21c1947700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21a8003a60 0x7f21bc0b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21c1947700 1 -- 172.21.15.81:0/2103216196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc16df50 con 0x7f21bc0b5c60 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21c1947700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc0b5c60 0x7f21bc1456c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f21ac011b40 tx=0x7f21ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21b27fc700 1 -- 172.21.15.81:0/2103216196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00f940 con 0x7f21bc0b5c60 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21b27fc700 1 -- 172.21.15.81:0/2103216196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac00faa0 con 0x7f21bc0b5c60 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc16e230 con 0x7f21bc0b5c60 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21b27fc700 1 -- 172.21.15.81:0/2103216196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00fe20 con 0x7f21bc0b5c60 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.156+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc0b60d0 con 0x7f21bc0b5c60 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.157+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc067ac0 con 0x7f21bc0b5c60 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.157+0000 7f21b27fc700 1 -- 172.21.15.81:0/2103216196 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21ac014650 con 0x7f21bc0b5c60 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.157+0000 7f21b27fc700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21a0066f60 0x7f21a0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.158+0000 7f21b27fc700 1 -- 172.21.15.81:0/2103216196 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21ac018030 con 0x7f21bc0b5c60 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.158+0000 7f21c2148700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21a0066f60 0x7f21a0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.158+0000 7f21b27fc700 1 -- 172.21.15.81:0/2103216196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7f21a006f120 con 0x7f21bc0b5c60 2023-10-06T02:57:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.158+0000 7f21c2148700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21a0066f60 0x7f21a0069410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f21b800a3f0 tx=0x7f21b8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.162+0000 7f21b27fc700 1 -- 172.21.15.81:0/2103216196 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21ac052050 con 0x7f21bc0b5c60 2023-10-06T02:57:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.383+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21bc0d0450 con 0x7f21bc0b5c60 2023-10-06T02:57:40.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.384+0000 7f21b27fc700 1 -- 172.21.15.81:0/2103216196 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f21ac022070 con 0x7f21bc0b5c60 2023-10-06T02:57:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:40.495 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:18.128298+0000","modified":"2023-10-06T02:57:21.769179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8358":{"gid":8358,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/604648999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":604648999},{"type":"v1","addr":"172.21.15.81:6835","nonce":604648999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T02:57:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21a0066f60 msgr2=0x7f21a0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21a0066f60 0x7f21a0069410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f21b800a3f0 tx=0x7f21b8016000 comp rx=0 tx=0).stop 2023-10-06T02:57:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc0b5c60 msgr2=0x7f21bc1456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc0b5c60 0x7f21bc1456c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f21ac011b40 tx=0x7f21ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 shutdown_connections 2023-10-06T02:57:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21bc15da40 0x7f21bc15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f21a0066f60 0x7f21a0069410 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21a8003a60 0x7f21bc0b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 --2- 172.21.15.81:0/2103216196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc0b5c60 0x7f21bc1456c0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 >> 172.21.15.81:0/2103216196 conn(0x7f21bc06bb90 msgr2=0x7f21bc069f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 shutdown_connections 2023-10-06T02:57:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.386+0000 7f21c43ac700 1 -- 172.21.15.81:0/2103216196 wait complete. 2023-10-06T02:57:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-06T02:57:40.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:57:40.631 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":8358,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.870841424000002,"mdsmap_epoch":90,"osdmap_epoch":182,"osdmap_epoch_barrier":182,"uptime":27.977381020999999} 2023-10-06T02:57:40.631 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 8358, "mdsmap_epoch": 90, "osdmap_epoch": 182, "osdmap_epoch_barrier": 182, "rank_uptime": 21.870841424, "state": "up:active", "uptime": 27.977381021, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:57:40.632 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:57:40.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:40.632 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-06T02:57:40.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:40.648 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-06T02:57:40.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:57:40.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.862+0000 7ff3ee8fb700 1 Processor -- start 2023-10-06T02:57:40.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.862+0000 7ff3ee8fb700 1 -- start start 2023-10-06T02:57:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.863+0000 7ff3ee8fb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff3e80aeea0 0x7ff3e80c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.863+0000 7ff3ee8fb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3e80af270 0x7ff3e80c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.863+0000 7ff3ee8fb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e806aae0 con 0x7ff3e80c7d00 2023-10-06T02:57:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.863+0000 7ff3ee8fb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e80c8810 con 0x7ff3e80af270 2023-10-06T02:57:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.863+0000 7ff3ee8fb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e8069ed0 con 0x7ff3e80aeea0 2023-10-06T02:57:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.863+0000 7ff3e77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3e80af270 0x7ff3e80c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.863+0000 7ff3e77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3e80af270 0x7ff3e80c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55712/0 (socket says 172.21.15.81:55712) 2023-10-06T02:57:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.863+0000 7ff3e77fe700 1 -- 172.21.15.81:0/1425332114 learned_addr learned my addr 172.21.15.81:0/1425332114 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e7fff700 1 --2- 172.21.15.81:0/1425332114 >> v2:172.21.15.83:3300/0 conn(0x7ff3e80aeea0 0x7ff3e80c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e77fe700 1 -- 172.21.15.81:0/1425332114 >> v2:172.21.15.83:3300/0 conn(0x7ff3e80aeea0 msgr2=0x7ff3e80c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e77fe700 1 --2- 172.21.15.81:0/1425332114 >> v2:172.21.15.83:3300/0 conn(0x7ff3e80aeea0 0x7ff3e80c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e77fe700 1 -- 172.21.15.81:0/1425332114 >> v1:172.21.15.83:6789/0 conn(0x7ff3e80c7d00 legacy=0x7ff3e80c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e77fe700 1 -- 172.21.15.81:0/1425332114 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e806a1b0 con 0x7ff3e80af270 2023-10-06T02:57:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e7fff700 1 --2- 172.21.15.81:0/1425332114 >> v2:172.21.15.83:3300/0 conn(0x7ff3e80aeea0 0x7ff3e80c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e77fe700 1 --2- 172.21.15.81:0/1425332114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80af270 0x7ff3e80c2e60 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff3e806f710 tx=0x7ff3dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6a25c9de05fa39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e6ffd700 1 -- 172.21.15.81:0/1425332114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00b8b0 con 0x7ff3e80af270 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e6ffd700 1 -- 172.21.15.81:0/1425332114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc00ba10 con 0x7ff3e80af270 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3e6ffd700 1 -- 172.21.15.81:0/1425332114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00bdb0 con 0x7ff3e80af270 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/1425332114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80af270 msgr2=0x7ff3e80c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.864+0000 7ff3ee8fb700 1 --2- 172.21.15.81:0/1425332114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80af270 0x7ff3e80c2e60 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff3e806f710 tx=0x7ff3dc009250 comp rx=0 tx=0).stop 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.865+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/1425332114 shutdown_connections 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.865+0000 7ff3ee8fb700 1 --2- 172.21.15.81:0/1425332114 >> v2:172.21.15.83:3300/0 conn(0x7ff3e80aeea0 0x7ff3e80c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.865+0000 7ff3ee8fb700 1 --2- 172.21.15.81:0/1425332114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80af270 0x7ff3e80c2e60 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.865+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/1425332114 >> 172.21.15.81:0/1425332114 conn(0x7ff3e806c660 msgr2=0x7ff3e80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.865+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/1425332114 shutdown_connections 2023-10-06T02:57:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.865+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/1425332114 wait complete. 2023-10-06T02:57:40.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.866+0000 7ff3ee8fb700 1 Processor -- start 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.866+0000 7ff3ee8fb700 1 -- start start 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.866+0000 7ff3ee8fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80aeea0 0x7ff3e80c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3ee8fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3e80af270 0x7ff3e80c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3ee8fb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3e80c7d00 0x7ff3e80c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3ee8fb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8158210 con 0x7ff3e80aeea0 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3ee8fb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8157d80 con 0x7ff3e80c7d00 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3ee8fb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8157450 con 0x7ff3e80af270 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80aeea0 0x7ff3e80c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80aeea0 0x7ff3e80c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55714/0 (socket says 172.21.15.81:55714) 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e7fff700 1 -- 172.21.15.81:0/3030160943 learned_addr learned my addr 172.21.15.81:0/3030160943 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3ece98700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3e80c7d00 0x7ff3e80c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e77fe700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3e80af270 0x7ff3e80c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e7fff700 1 -- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3e80af270 msgr2=0x7ff3e80c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e7fff700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3e80af270 0x7ff3e80c1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e7fff700 1 -- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3e80c7d00 msgr2=0x7ff3e80c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e7fff700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3e80c7d00 0x7ff3e80c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e7fff700 1 -- 172.21.15.81:0/3030160943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc0094f0 con 0x7ff3e80aeea0 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3ece98700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3e80c7d00 0x7ff3e80c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3e7fff700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80aeea0 0x7ff3e80c65f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800c830 tx=0x7ff3d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3cffff700 1 -- 172.21.15.81:0/3030160943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8011600 con 0x7ff3e80aeea0 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3cffff700 1 -- 172.21.15.81:0/3030160943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d8011760 con 0x7ff3e80aeea0 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e8157730 con 0x7ff3e80aeea0 2023-10-06T02:57:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3cffff700 1 -- 172.21.15.81:0/3030160943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8011b20 con 0x7ff3e80aeea0 2023-10-06T02:57:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.867+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e80c6b30 con 0x7ff3e80aeea0 2023-10-06T02:57:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.868+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e8158060 con 0x7ff3e80aeea0 2023-10-06T02:57:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.869+0000 7ff3cffff700 1 -- 172.21.15.81:0/3030160943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3d800a3e0 con 0x7ff3e80aeea0 2023-10-06T02:57:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.869+0000 7ff3cffff700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff3d4066f30 0x7ff3d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.869+0000 7ff3cffff700 1 -- 172.21.15.81:0/3030160943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff3d8084780 con 0x7ff3e80aeea0 2023-10-06T02:57:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.869+0000 7ff3cffff700 1 -- 172.21.15.81:0/3030160943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7ff3d406f0f0 con 0x7ff3e80aeea0 2023-10-06T02:57:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.869+0000 7ff3e77fe700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff3d4066f30 0x7ff3d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.870+0000 7ff3e77fe700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff3d4066f30 0x7ff3d40693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff3e806f710 tx=0x7ff3dc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:40.873+0000 7ff3cffff700 1 -- 172.21.15.81:0/3030160943 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3d8051890 con 0x7ff3e80aeea0 2023-10-06T02:57:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.056+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff3e8157bd0 con 0x7ff3e80aeea0 2023-10-06T02:57:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.057+0000 7ff3cffff700 1 -- 172.21.15.81:0/3030160943 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v182) v1 ==== 81+0+34811 (secure 0 0 0) 0x7ff3d8015090 con 0x7ff3e80aeea0 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 182, 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:57:34.480188+0000", 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:57:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 24, 2023-10-06T02:57:41.061 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:41.062 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:57:41.063 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:41.064 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:41.065 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.066 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:57:41.067 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:41.068 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:57:41.069 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:41.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:41.071 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:41.071 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:41.071 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:41.071 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:41.071 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:41.071 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:41.071 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:41.071 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:41.071 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:41.072 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:41.073 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:15.791318+0000", 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:41.076 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:41.077 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:41.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.077 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "179", 2023-10-06T02:57:41.077 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:41.077 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:41.077 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:41.077 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:41.077 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:41.077 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:41.078 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:41.079 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:57:41.080 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 24, 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:17.104149+0000", 2023-10-06T02:57:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:41.082 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.083 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "182", 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:41.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:41.085 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:41.087 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:41.087 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:41.087 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:57:41.087 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:57:41.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.087 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:41.087 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:41.087 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:57:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:57:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.090 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:41.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:41.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:41.095 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:57:41.096 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:41.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.099 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:57:41.100 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:41.101 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.104 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:57:41.106 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:41.108 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:41.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:57:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:57:41.113 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:41.114 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:57:41.115 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.118 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.119 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.120 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:41.121 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.122 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.123 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:41.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:57:41.123 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:41.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:57:41.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:57:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:57:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:57:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:57:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:57:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:57:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:41.150 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff3d4066f30 msgr2=0x7ff3d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff3d4066f30 0x7ff3d40693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff3e806f710 tx=0x7ff3dc016000 comp rx=0 tx=0).stop 2023-10-06T02:57:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80aeea0 msgr2=0x7ff3e80c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80aeea0 0x7ff3e80c65f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800c830 tx=0x7ff3d8008040 comp rx=0 tx=0).stop 2023-10-06T02:57:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 shutdown_connections 2023-10-06T02:57:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff3d4066f30 0x7ff3d40693e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3e80c7d00 0x7ff3e80c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80aeea0 0x7ff3e80c65f0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 --2- 172.21.15.81:0/3030160943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3e80af270 0x7ff3e80c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 >> 172.21.15.81:0/3030160943 conn(0x7ff3e806c660 msgr2=0x7ff3e81555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 shutdown_connections 2023-10-06T02:57:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:41.059+0000 7ff3ee8fb700 1 -- 172.21.15.81:0/3030160943 wait complete. 2023-10-06T02:57:41.153 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:57:46.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:57:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.275+0000 7f6a89678700 1 Processor -- start 2023-10-06T02:57:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.275+0000 7f6a89678700 1 -- start start 2023-10-06T02:57:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.276+0000 7f6a89678700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a841578d0 0x7f6a840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.276+0000 7f6a89678700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a840d07c0 con 0x7f6a84157ca0 2023-10-06T02:57:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.276+0000 7f6a89678700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a840cfbb0 con 0x7f6a8406d120 2023-10-06T02:57:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.276+0000 7f6a89678700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a840cfe90 con 0x7f6a841578d0 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.276+0000 7f6a82ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a841578d0 0x7f6a840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.276+0000 7f6a827fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6a84157ca0 0x7f6a8415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37424/0 (socket says 172.21.15.81:37424) 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.276+0000 7f6a827fc700 1 -- 172.21.15.81:0/3090583944 learned_addr learned my addr 172.21.15.81:0/3090583944 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a82ffd700 1 -- 172.21.15.81:0/3090583944 >> v1:172.21.15.83:6789/0 conn(0x7f6a8406d120 legacy=0x7f6a8406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a82ffd700 1 -- 172.21.15.81:0/3090583944 >> v1:172.21.15.81:6789/0 conn(0x7f6a84157ca0 legacy=0x7f6a8415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a82ffd700 1 -- 172.21.15.81:0/3090583944 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a840d0170 con 0x7f6a841578d0 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a81ffb700 1 -- 172.21.15.81:0/3090583944 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217423979 0 0) 0x7f6a840d07c0 con 0x7f6a84157ca0 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a82ffd700 1 --2- 172.21.15.81:0/3090583944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a841578d0 0x7f6a840cf4f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009e60 tx=0x7f6a74009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a5eaa6d30a56b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a81ffb700 1 -- 172.21.15.81:0/3090583944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7400e070 con 0x7f6a841578d0 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a81ffb700 1 -- 172.21.15.81:0/3090583944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7400bc30 con 0x7f6a841578d0 2023-10-06T02:57:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a81ffb700 1 -- 172.21.15.81:0/3090583944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74012430 con 0x7f6a841578d0 2023-10-06T02:57:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a89678700 1 -- 172.21.15.81:0/3090583944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a841578d0 msgr2=0x7f6a840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.277+0000 7f6a89678700 1 --2- 172.21.15.81:0/3090583944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a841578d0 0x7f6a840cf4f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009e60 tx=0x7f6a74009780 comp rx=0 tx=0).stop 2023-10-06T02:57:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.278+0000 7f6a89678700 1 -- 172.21.15.81:0/3090583944 shutdown_connections 2023-10-06T02:57:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.278+0000 7f6a89678700 1 --2- 172.21.15.81:0/3090583944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a841578d0 0x7f6a840cf4f0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.278+0000 7f6a89678700 1 -- 172.21.15.81:0/3090583944 >> 172.21.15.81:0/3090583944 conn(0x7f6a8406bb90 msgr2=0x7f6a8406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.278+0000 7f6a89678700 1 -- 172.21.15.81:0/3090583944 shutdown_connections 2023-10-06T02:57:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.278+0000 7f6a89678700 1 -- 172.21.15.81:0/3090583944 wait complete. 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.279+0000 7f6a89678700 1 Processor -- start 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.279+0000 7f6a89678700 1 -- start start 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a89678700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8406d120 0x7f6a84158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a89678700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a841578d0 0x7f6a84152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a89678700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a84157ca0 0x7f6a84152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a89678700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a84152fe0 con 0x7f6a8406d120 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a89678700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8415d130 con 0x7f6a84157ca0 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a89678700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8416a990 con 0x7f6a841578d0 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a82ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8406d120 0x7f6a84158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a82ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8406d120 0x7f6a84158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55744/0 (socket says 172.21.15.81:55744) 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a82ffd700 1 -- 172.21.15.81:0/474300341 learned_addr learned my addr 172.21.15.81:0/474300341 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a827fc700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a841578d0 0x7f6a84152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a837fe700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a84157ca0 0x7f6a84152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a82ffd700 1 -- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a841578d0 msgr2=0x7f6a84152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a82ffd700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a841578d0 0x7f6a84152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a82ffd700 1 -- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a84157ca0 msgr2=0x7f6a84152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a82ffd700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a84157ca0 0x7f6a84152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a82ffd700 1 -- 172.21.15.81:0/474300341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a74009a20 con 0x7f6a8406d120 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a82ffd700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8406d120 0x7f6a84158720 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f6a740099f0 tx=0x7f6a74019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a6affd700 1 -- 172.21.15.81:0/474300341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74012e60 con 0x7f6a8406d120 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a6affd700 1 -- 172.21.15.81:0/474300341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7401b630 con 0x7f6a8406d120 2023-10-06T02:57:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a6affd700 1 -- 172.21.15.81:0/474300341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7401b9f0 con 0x7f6a8406d120 2023-10-06T02:57:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8415c890 con 0x7f6a8406d120 2023-10-06T02:57:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.280+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8415ce50 con 0x7f6a8406d120 2023-10-06T02:57:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.281+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a84067ac0 con 0x7f6a8406d120 2023-10-06T02:57:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.282+0000 7f6a6affd700 1 -- 172.21.15.81:0/474300341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a7401c400 con 0x7f6a8406d120 2023-10-06T02:57:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.282+0000 7f6a6affd700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a70066f30 0x7f6a700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.282+0000 7f6a6affd700 1 -- 172.21.15.81:0/474300341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a74086510 con 0x7f6a8406d120 2023-10-06T02:57:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.282+0000 7f6a827fc700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a70066f30 0x7f6a700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.282+0000 7f6a6affd700 1 -- 172.21.15.81:0/474300341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7f6a7006f0f0 con 0x7f6a8406d120 2023-10-06T02:57:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.283+0000 7f6a827fc700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a70066f30 0x7f6a700693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6a84068df0 tx=0x7f6a78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.286+0000 7f6a6affd700 1 -- 172.21.15.81:0/474300341 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a7402a060 con 0x7f6a8406d120 2023-10-06T02:57:46.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.469+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6a840d0450 con 0x7f6a8406d120 2023-10-06T02:57:46.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.470+0000 7f6a6affd700 1 -- 172.21.15.81:0/474300341 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v182) v1 ==== 81+0+34811 (secure 0 0 0) 0x7f6a74053620 con 0x7f6a8406d120 2023-10-06T02:57:46.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:46.473 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:46.473 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 182, 2023-10-06T02:57:46.473 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:57:46.473 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:57:46.473 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:57:34.480188+0000", 2023-10-06T02:57:46.473 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:57:46.474 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 24, 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:57:46.475 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:57:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:57:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:57:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:57:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:57:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:46.478 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:46.480 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:46.482 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:46.483 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:46.484 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:46.485 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:15.791318+0000", 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:46.488 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "179", 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:46.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:46.491 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:46.493 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 24, 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:17.104149+0000", 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:57:46.495 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "182", 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:46.496 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:46.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:46.499 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:57:46.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:57:46.505 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:46.506 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:57:46.508 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:57:46.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:57:46.511 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:46.512 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:46.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:57:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:46.518 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:57:46.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.522 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:46.524 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:57:46.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:46.544 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:57:46.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:46.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:57:46.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:57:46.549 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:46.550 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:46.551 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:46.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:46.553 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:46.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:46.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:57:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:57:46.558 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:57:46.559 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:57:46.559 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:57:46.559 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:57:46.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:46.559 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a70066f30 msgr2=0x7f6a700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a70066f30 0x7f6a700693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6a84068df0 tx=0x7f6a78009040 comp rx=0 tx=0).stop 2023-10-06T02:57:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8406d120 msgr2=0x7f6a84158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8406d120 0x7f6a84158720 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f6a740099f0 tx=0x7f6a74019000 comp rx=0 tx=0).stop 2023-10-06T02:57:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 shutdown_connections 2023-10-06T02:57:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f6a70066f30 0x7f6a700693e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a84157ca0 0x7f6a84152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8406d120 0x7f6a84158720 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 --2- 172.21.15.81:0/474300341 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a841578d0 0x7f6a84152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 >> 172.21.15.81:0/474300341 conn(0x7f6a8406bb90 msgr2=0x7f6a84069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 shutdown_connections 2023-10-06T02:57:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:46.472+0000 7f6a89678700 1 -- 172.21.15.81:0/474300341 wait complete. 2023-10-06T02:57:46.562 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-06T02:57:51.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:57:51.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.687+0000 7fa30c638700 1 Processor -- start 2023-10-06T02:57:51.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.687+0000 7fa30c638700 1 -- start start 2023-10-06T02:57:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa30c638700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa3041569e0 0x7fa3040b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa30c638700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa304156db0 0x7fa30406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa30c638700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3040b2290 con 0x7fa3040b1d10 2023-10-06T02:57:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa30c638700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa304157c00 con 0x7fa304156db0 2023-10-06T02:57:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa30c638700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3041572d0 con 0x7fa3041569e0 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa309bd3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa304156db0 0x7fa30406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa30abd5700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa3040b1d10 0x7fa30415a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44106/0 (socket says 172.21.15.81:44106) 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa30abd5700 1 -- 172.21.15.81:0/1715455598 learned_addr learned my addr 172.21.15.81:0/1715455598 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa30a3d4700 1 --2- 172.21.15.81:0/1715455598 >> v2:172.21.15.83:3300/0 conn(0x7fa3041569e0 0x7fa3040b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa309bd3700 1 -- 172.21.15.81:0/1715455598 >> v2:172.21.15.83:3300/0 conn(0x7fa3041569e0 msgr2=0x7fa3040b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa309bd3700 1 --2- 172.21.15.81:0/1715455598 >> v2:172.21.15.83:3300/0 conn(0x7fa3041569e0 0x7fa3040b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa309bd3700 1 -- 172.21.15.81:0/1715455598 >> v1:172.21.15.81:6789/0 conn(0x7fa3040b1d10 legacy=0x7fa30415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa309bd3700 1 -- 172.21.15.81:0/1715455598 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3041575b0 con 0x7fa304156db0 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.688+0000 7fa309bd3700 1 --2- 172.21.15.81:0/1715455598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 0x7fa30406e230 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa30406f590 tx=0x7fa2f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180e7eb45f075801 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa3093d2700 1 -- 172.21.15.81:0/1715455598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4011630 con 0x7fa304156db0 2023-10-06T02:57:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa3093d2700 1 -- 172.21.15.81:0/1715455598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4011790 con 0x7fa304156db0 2023-10-06T02:57:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa3093d2700 1 -- 172.21.15.81:0/1715455598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4011b30 con 0x7fa304156db0 2023-10-06T02:57:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa30c638700 1 -- 172.21.15.81:0/1715455598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 msgr2=0x7fa30406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa30c638700 1 --2- 172.21.15.81:0/1715455598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 0x7fa30406e230 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa30406f590 tx=0x7fa2f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa30c638700 1 -- 172.21.15.81:0/1715455598 shutdown_connections 2023-10-06T02:57:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa30c638700 1 --2- 172.21.15.81:0/1715455598 >> v2:172.21.15.83:3300/0 conn(0x7fa3041569e0 0x7fa3040b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa30c638700 1 --2- 172.21.15.81:0/1715455598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 0x7fa30406e230 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa30c638700 1 -- 172.21.15.81:0/1715455598 >> 172.21.15.81:0/1715455598 conn(0x7fa30406cca0 msgr2=0x7fa30406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa30c638700 1 -- 172.21.15.81:0/1715455598 shutdown_connections 2023-10-06T02:57:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.689+0000 7fa30c638700 1 -- 172.21.15.81:0/1715455598 wait complete. 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.690+0000 7fa30c638700 1 Processor -- start 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30c638700 1 -- start start 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30c638700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3040b1d10 0x7fa30414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30c638700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3041569e0 0x7fa30414b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30c638700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 0x7fa304154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30c638700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040aeca0 con 0x7fa304156db0 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30c638700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040afb00 con 0x7fa3041569e0 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30c638700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040aeef0 con 0x7fa3040b1d10 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30abd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 0x7fa304154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30abd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 0x7fa304154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51920/0 (socket says 172.21.15.81:51920) 2023-10-06T02:57:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30abd5700 1 -- 172.21.15.81:0/4271905709 learned_addr learned my addr 172.21.15.81:0/4271905709 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa309bd3700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3041569e0 0x7fa30414b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.691+0000 7fa30a3d4700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3040b1d10 0x7fa30414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa30abd5700 1 -- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3040b1d10 msgr2=0x7fa30414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa30abd5700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3040b1d10 0x7fa30414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa30abd5700 1 -- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3041569e0 msgr2=0x7fa30414b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa30abd5700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3041569e0 0x7fa30414b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa30abd5700 1 -- 172.21.15.81:0/4271905709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4009420 con 0x7fa304156db0 2023-10-06T02:57:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa30abd5700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 0x7fa304154510 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc002230 tx=0x7fa2fc001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa2fa7fc700 1 -- 172.21.15.81:0/4271905709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc00aa80 con 0x7fa304156db0 2023-10-06T02:57:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa2fa7fc700 1 -- 172.21.15.81:0/4271905709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc00abe0 con 0x7fa304156db0 2023-10-06T02:57:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3040af1d0 con 0x7fa304156db0 2023-10-06T02:57:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa2fa7fc700 1 -- 172.21.15.81:0/4271905709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0070f0 con 0x7fa304156db0 2023-10-06T02:57:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.692+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3040af790 con 0x7fa304156db0 2023-10-06T02:57:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.693+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3040afc70 con 0x7fa304156db0 2023-10-06T02:57:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.693+0000 7fa2fa7fc700 1 -- 172.21.15.81:0/4271905709 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2fc0074a0 con 0x7fa304156db0 2023-10-06T02:57:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.694+0000 7fa2fa7fc700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2e8066f30 0x7fa2e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.694+0000 7fa2fa7fc700 1 -- 172.21.15.81:0/4271905709 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa2fc084ab0 con 0x7fa304156db0 2023-10-06T02:57:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.694+0000 7fa30a3d4700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2e8066f30 0x7fa2e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.694+0000 7fa30a3d4700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2e8066f30 0x7fa2e80693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa300006fd0 tx=0x7fa300008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.698+0000 7fa2fa7fc700 1 -- 172.21.15.81:0/4271905709 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2fc051c40 con 0x7fa304156db0 2023-10-06T02:57:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.882+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa304157890 con 0x7fa304156db0 2023-10-06T02:57:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.883+0000 7fa2fa7fc700 1 -- 172.21.15.81:0/4271905709 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v183) v1 ==== 81+0+34792 (secure 0 0 0) 0x7fa2fc055260 con 0x7fa304156db0 2023-10-06T02:57:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:51.887 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 183, 2023-10-06T02:57:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:57:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:57:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:57:49.483101+0000", 2023-10-06T02:57:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:57:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:57:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:57:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:57:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:57:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:57:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:57:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:57:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:57:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:57:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:57:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:57:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:57:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:57:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 24, 2023-10-06T02:57:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:57:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:57:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:57:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:57:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:57:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:57:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:57:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:57:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:57:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:57:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:57:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:15.791318+0000", 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:57:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:57:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:57:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:57:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:57:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "179", 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 24, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:17.104149+0000", 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "183", 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:57:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:57:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:57:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:57:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:57:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:57:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:57:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:57:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:57:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:57:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:57:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:57:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:57:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:57:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:57:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:57:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:57:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:57:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:57:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:57:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.958 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:51.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:57:51.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:51.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:57:51.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:51.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.960 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:51.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:57:51.961 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:51.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:57:51.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:51.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.962 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:51.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:57:51.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:51.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:57:51.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:51.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:51.966 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:51.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:57:51.971 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:51.972 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:57:51.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:51.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:51.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:51.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:51.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:51.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.979 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:51.979 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:57:51.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.979 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:51.979 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:51.979 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:51.980 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:51.980 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:51.980 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:51.980 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:57:51.980 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:51.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.981 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:51.981 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:51.981 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:51.981 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:51.981 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:51.981 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:51.981 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:57:51.981 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:51.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.982 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:51.982 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:51.982 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:51.982 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:51.982 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:51.983 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:51.983 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:57:51.983 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:51.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.983 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:51.984 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:51.984 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:51.984 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:51.984 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:51.984 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:51.984 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:57:51.985 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:51.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.985 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:51.985 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:51.985 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:51.986 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:51.986 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:51.986 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:51.986 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:57:51.986 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:51.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:51.987 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:51.987 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:51.987 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:51.989 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:51.989 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:51.989 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:57:51.989 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:51.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.990 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:51.990 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:51.990 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:51.990 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:51.990 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:51.991 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:51.991 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:57:51.991 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:51.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:51.991 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:51.992 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:51.992 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:51.992 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:51.992 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:51.992 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:51.992 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:57:51.993 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:51.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.993 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:51.993 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:57:51.993 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:57:51.993 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:57:51.994 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:57:51.994 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:57:51.994 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:57:51.994 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:57:51.994 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:57:51.994 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:57:51.994 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:57:51.995 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:57:51.995 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:57:51.995 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:57:51.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:51.995 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:57:51.996 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:57:51.996 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:57:51.996 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:57:51.996 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:57:51.996 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:57:51.996 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:57:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:57:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:57:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:57:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:57:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:51.998 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:52.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2e8066f30 msgr2=0x7fa2e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2e8066f30 0x7fa2e80693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa300006fd0 tx=0x7fa300008040 comp rx=0 tx=0).stop 2023-10-06T02:57:52.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 msgr2=0x7fa304154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 0x7fa304154510 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc002230 tx=0x7fa2fc001b90 comp rx=0 tx=0).stop 2023-10-06T02:57:52.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 shutdown_connections 2023-10-06T02:57:52.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304156db0 0x7fa304154510 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3040b1d10 0x7fa30414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa2e8066f30 0x7fa2e80693e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 --2- 172.21.15.81:0/4271905709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3041569e0 0x7fa30414b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.885+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 >> 172.21.15.81:0/4271905709 conn(0x7fa30406cca0 msgr2=0x7fa30406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:52.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.886+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 shutdown_connections 2023-10-06T02:57:52.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:51.886+0000 7fa30c638700 1 -- 172.21.15.81:0/4271905709 wait complete. 2023-10-06T02:57:52.003 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-06T02:57:52.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-06T02:57:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.116+0000 7f11ab259700 1 Processor -- start 2023-10-06T02:57:52.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.116+0000 7f11ab259700 1 -- start start 2023-10-06T02:57:52.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11ab259700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a41578d0 0x7f11a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11ab259700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11a4157ca0 0x7f11a415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11ab259700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a40d07c0 con 0x7f11a406d120 2023-10-06T02:57:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11ab259700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a40cfbb0 con 0x7f11a4157ca0 2023-10-06T02:57:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11ab259700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40cfe90 con 0x7f11a41578d0 2023-10-06T02:57:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11a4157ca0 0x7f11a415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a97f6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f11a406d120 0x7f11a415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44116/0 (socket says 172.21.15.81:44116) 2023-10-06T02:57:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a97f6700 1 -- 172.21.15.81:0/3133496954 learned_addr learned my addr 172.21.15.81:0/3133496954 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a8ff5700 1 --2- 172.21.15.81:0/3133496954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a41578d0 0x7f11a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a37fe700 1 -- 172.21.15.81:0/3133496954 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667503874 0 0) 0x7f11a40d07c0 con 0x7f11a406d120 2023-10-06T02:57:52.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a37fe700 1 -- 172.21.15.81:0/3133496954 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1194003570 con 0x7f11a406d120 2023-10-06T02:57:52.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a3fff700 1 -- 172.21.15.81:0/3133496954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a41578d0 msgr2=0x7f11a40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:52.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a3fff700 1 --2- 172.21.15.81:0/3133496954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a41578d0 0x7f11a40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a3fff700 1 -- 172.21.15.81:0/3133496954 >> v1:172.21.15.81:6789/0 conn(0x7f11a406d120 legacy=0x7f11a415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a3fff700 1 -- 172.21.15.81:0/3133496954 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40d0170 con 0x7f11a4157ca0 2023-10-06T02:57:52.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a8ff5700 1 --2- 172.21.15.81:0/3133496954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a41578d0 0x7f11a40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:52.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a3fff700 1 --2- 172.21.15.81:0/3133496954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a4157ca0 0x7f11a415af00 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f11900098e0 tx=0x7f11900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77b50aae3f03ff3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:52.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a37fe700 1 -- 172.21.15.81:0/3133496954 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119000b640 con 0x7f11a4157ca0 2023-10-06T02:57:52.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a37fe700 1 -- 172.21.15.81:0/3133496954 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119000b7a0 con 0x7f11a4157ca0 2023-10-06T02:57:52.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.117+0000 7f11a37fe700 1 -- 172.21.15.81:0/3133496954 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119000bb40 con 0x7f11a4157ca0 2023-10-06T02:57:52.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.118+0000 7f11ab259700 1 -- 172.21.15.81:0/3133496954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a4157ca0 msgr2=0x7f11a415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.118+0000 7f11ab259700 1 --2- 172.21.15.81:0/3133496954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a4157ca0 0x7f11a415af00 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f11900098e0 tx=0x7f11900091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.118+0000 7f11ab259700 1 -- 172.21.15.81:0/3133496954 shutdown_connections 2023-10-06T02:57:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.118+0000 7f11ab259700 1 --2- 172.21.15.81:0/3133496954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a41578d0 0x7f11a40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.118+0000 7f11ab259700 1 --2- 172.21.15.81:0/3133496954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a4157ca0 0x7f11a415af00 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.118+0000 7f11ab259700 1 -- 172.21.15.81:0/3133496954 >> 172.21.15.81:0/3133496954 conn(0x7f11a406bb90 msgr2=0x7f11a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.118+0000 7f11ab259700 1 -- 172.21.15.81:0/3133496954 shutdown_connections 2023-10-06T02:57:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.118+0000 7f11ab259700 1 -- 172.21.15.81:0/3133496954 wait complete. 2023-10-06T02:57:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.119+0000 7f11ab259700 1 Processor -- start 2023-10-06T02:57:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.119+0000 7f11ab259700 1 -- start start 2023-10-06T02:57:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11ab259700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11a406d120 0x7f11a4154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11ab259700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a41578d0 0x7f11a40b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11ab259700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a4157ca0 0x7f11a40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11ab259700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40b5180 con 0x7f11a41578d0 2023-10-06T02:57:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11ab259700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a416a3f0 con 0x7f11a406d120 2023-10-06T02:57:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11ab259700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4155150 con 0x7f11a4157ca0 2023-10-06T02:57:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a41578d0 0x7f11a40b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a41578d0 0x7f11a40b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51942/0 (socket says 172.21.15.81:51942) 2023-10-06T02:57:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a3fff700 1 -- 172.21.15.81:0/4274981276 learned_addr learned my addr 172.21.15.81:0/4274981276 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a97f6700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a4157ca0 0x7f11a40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a3fff700 1 -- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a4157ca0 msgr2=0x7f11a40b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a8ff5700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11a406d120 0x7f11a4154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a3fff700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a4157ca0 0x7f11a40b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a3fff700 1 -- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11a406d120 msgr2=0x7f11a4154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a3fff700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11a406d120 0x7f11a4154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a3fff700 1 -- 172.21.15.81:0/4274981276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190009420 con 0x7f11a41578d0 2023-10-06T02:57:52.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a97f6700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a4157ca0 0x7f11a40b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:52.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.120+0000 7f11a8ff5700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11a406d120 0x7f11a4154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:52.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.121+0000 7f11a3fff700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a41578d0 0x7f11a40b56b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f11a406fe20 tx=0x7f1190017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:52.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.121+0000 7f11a0ff9700 1 -- 172.21.15.81:0/4274981276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119001bda0 con 0x7f11a41578d0 2023-10-06T02:57:52.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.121+0000 7f11a0ff9700 1 -- 172.21.15.81:0/4274981276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1190011420 con 0x7f11a41578d0 2023-10-06T02:57:52.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.121+0000 7f11a0ff9700 1 -- 172.21.15.81:0/4274981276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11900117e0 con 0x7f11a41578d0 2023-10-06T02:57:52.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.121+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a40b6270 con 0x7f11a41578d0 2023-10-06T02:57:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.121+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a40b6830 con 0x7f11a41578d0 2023-10-06T02:57:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.122+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a4067ac0 con 0x7f11a41578d0 2023-10-06T02:57:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.122+0000 7f11a0ff9700 1 -- 172.21.15.81:0/4274981276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1190011b90 con 0x7f11a41578d0 2023-10-06T02:57:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.122+0000 7f11a0ff9700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1188066f30 0x7f11880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.122+0000 7f11a0ff9700 1 -- 172.21.15.81:0/4274981276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1190085c80 con 0x7f11a41578d0 2023-10-06T02:57:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.123+0000 7f11a8ff5700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1188066f30 0x7f11880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.123+0000 7f11a8ff5700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1188066f30 0x7f11880693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1198008b20 tx=0x7f1198008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.127+0000 7f11a0ff9700 1 -- 172.21.15.81:0/4274981276 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1190052d90 con 0x7f11a41578d0 2023-10-06T02:57:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.311+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f11a40d0450 con 0x7f11a41578d0 2023-10-06T02:57:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.312+0000 7f11a0ff9700 1 -- 172.21.15.81:0/4274981276 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v183) v1 ==== 81+0+34792 (secure 0 0 0) 0x7f11900563b0 con 0x7f11a41578d0 2023-10-06T02:57:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:52.314 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:57:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 183, 2023-10-06T02:57:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", 2023-10-06T02:57:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-06T02:45:49.581202+0000", 2023-10-06T02:57:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-06T02:57:49.483101+0000", 2023-10-06T02:57:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-06T02:45:54.967365+0000", 2023-10-06T02:57:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-06T02:45:51.951043+0000", 2023-10-06T02:57:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-06T02:57:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-06T02:57:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-06T02:57:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-06T02:57:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-06T02:57:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-06T02:57:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-06T02:57:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-06T02:57:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-06T02:57:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-06T02:57:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-06T02:57:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-06T02:57:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 24, 2023-10-06T02:57:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-06T02:57:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-06T02:57:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-06T02:57:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-06T02:57:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-06T02:57:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-06T02:57:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-06T02:57:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:45:55.530980+0000", 2023-10-06T02:57:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-06T02:57:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-06T02:57:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-06T02:57:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-06T02:57:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-06T02:57:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2023-10-06T02:57:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:46:00.679615+0000", 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "108", 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2023-10-06T02:57:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2023-10-06T02:57:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-06T02:57:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-06T02:57:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:15.791318+0000", 2023-10-06T02:57:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-06T02:57:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-06T02:57:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-06T02:57:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-06T02:57:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-06T02:57:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "179", 2023-10-06T02:57:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-06T02:57:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-06T02:57:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-06T02:57:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-06T02:57:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-06T02:57:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 24, 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-06T02:57:17.104149+0000", 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-06T02:57:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-06T02:57:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "183", 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-06T02:57:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-06T02:57:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-06T02:57:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-06T02:57:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-06T02:57:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86106 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86106", 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86106", 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86106", 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86106", 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-06T02:57:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86109 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86109", 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86109", 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86109", 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86109", 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-06T02:57:52.373 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86096 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86096", 2023-10-06T02:57:52.374 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/86096", 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6813/86096", 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6809/86096", 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:52.375 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-06T02:57:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86097 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6804/86097", 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6808/86097", 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86097", 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6812/86097", 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:52.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6800", 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6801", 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6802", 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6803", 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6806", 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6807", 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6804", 2023-10-06T02:57:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6805", 2023-10-06T02:57:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86341 2023-10-06T02:57:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6801/86341", 2023-10-06T02:57:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6803/86341", 2023-10-06T02:57:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6807/86341", 2023-10-06T02:57:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6805/86341", 2023-10-06T02:57:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6808", 2023-10-06T02:57:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6809", 2023-10-06T02:57:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6810", 2023-10-06T02:57:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:52.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.395 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6811", 2023-10-06T02:57:52.398 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:52.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.398 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.398 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6814", 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6815", 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.399 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6812", 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6813", 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86342 2023-10-06T02:57:52.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6809/86342", 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6811/86342", 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6815/86342", 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6813/86342", 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6824", 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6825", 2023-10-06T02:57:52.403 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6826", 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6827", 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6830", 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6831", 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6828", 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6829", 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86383 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6825/86383", 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6827/86383", 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6831/86383", 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6829/86383", 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.408 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 178, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-06T02:57:52.409 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6816", 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6817", 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6818", 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6819", 2023-10-06T02:57:52.412 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:52.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.412 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.412 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-06T02:57:52.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6822", 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6823", 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-06T02:57:52.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6820", 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.83:6821", 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86343 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.83:6817/86343", 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.83:6819/86343", 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.83:6823/86343", 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.83:6821/86343", 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.057736+0000", 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.078261+0000", 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.113069+0000", 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-06T02:57:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.045489+0000", 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.052129+0000", 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.070915+0000", 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.103557+0000", 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-06T02:45:53.118823+0000", 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-06T02:57:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-06T02:57:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-06T02:57:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-06T02:57:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-06T02:57:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-06T02:57:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-06T02:57:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T02:57:52.425 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1188066f30 msgr2=0x7f11880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1188066f30 0x7f11880693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1198008b20 tx=0x7f1198008040 comp rx=0 tx=0).stop 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a41578d0 msgr2=0x7f11a40b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a41578d0 0x7f11a40b56b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f11a406fe20 tx=0x7f1190017000 comp rx=0 tx=0).stop 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 shutdown_connections 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11a4157ca0 0x7f11a40b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1188066f30 0x7f11880693e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11a406d120 0x7f11a4154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 --2- 172.21.15.81:0/4274981276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a41578d0 0x7f11a40b56b0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 >> 172.21.15.81:0/4274981276 conn(0x7f11a406bb90 msgr2=0x7f11a406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 shutdown_connections 2023-10-06T02:57:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.314+0000 7f11ab259700 1 -- 172.21.15.81:0/4274981276 wait complete. 2023-10-06T02:57:52.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:52.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.540+0000 7f090fd17700 1 Processor -- start 2023-10-06T02:57:52.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.540+0000 7f090fd17700 1 -- start start 2023-10-06T02:57:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.541+0000 7f090fd17700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 0x7f09080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.541+0000 7f090fd17700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f090806d120 0x7f090806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.541+0000 7f090fd17700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090806dac0 con 0x7f09081578d0 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.541+0000 7f090fd17700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09080d07c0 con 0x7f090806d120 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.541+0000 7f090fd17700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09080cfbb0 con 0x7f0908157ca0 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.541+0000 7f090e2b4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f090806d120 0x7f090806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.541+0000 7f090e2b4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f090806d120 0x7f090806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51952/0 (socket says 172.21.15.81:51952) 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.541+0000 7f090e2b4700 1 -- 172.21.15.81:0/4130183751 learned_addr learned my addr 172.21.15.81:0/4130183751 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.541+0000 7f090d2b2700 1 --2- 172.21.15.81:0/4130183751 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 0x7f09080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090e2b4700 1 -- 172.21.15.81:0/4130183751 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 msgr2=0x7f09080cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090e2b4700 1 --2- 172.21.15.81:0/4130183751 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 0x7f09080cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090e2b4700 1 -- 172.21.15.81:0/4130183751 >> v1:172.21.15.83:6789/0 conn(0x7f09081578d0 legacy=0x7f090815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090e2b4700 1 -- 172.21.15.81:0/4130183751 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080cfe90 con 0x7f090806d120 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090e2b4700 1 --2- 172.21.15.81:0/4130183751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 0x7f090806d580 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f09000099b0 tx=0x7f0900009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b46ccfe9d602988 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090cab1700 1 -- 172.21.15.81:0/4130183751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000b860 con 0x7f090806d120 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090cab1700 1 -- 172.21.15.81:0/4130183751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000b9c0 con 0x7f090806d120 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090cab1700 1 -- 172.21.15.81:0/4130183751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000bd60 con 0x7f090806d120 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090fd17700 1 -- 172.21.15.81:0/4130183751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 msgr2=0x7f090806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090fd17700 1 --2- 172.21.15.81:0/4130183751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 0x7f090806d580 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f09000099b0 tx=0x7f0900009250 comp rx=0 tx=0).stop 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090fd17700 1 -- 172.21.15.81:0/4130183751 shutdown_connections 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090fd17700 1 --2- 172.21.15.81:0/4130183751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 0x7f090806d580 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090fd17700 1 --2- 172.21.15.81:0/4130183751 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 0x7f09080cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090fd17700 1 -- 172.21.15.81:0/4130183751 >> 172.21.15.81:0/4130183751 conn(0x7f090806bb90 msgr2=0x7f090806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.542+0000 7f090fd17700 1 -- 172.21.15.81:0/4130183751 shutdown_connections 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.543+0000 7f090fd17700 1 -- 172.21.15.81:0/4130183751 wait complete. 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.543+0000 7f090fd17700 1 Processor -- start 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090fd17700 1 -- start start 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090fd17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 0x7f090816d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090fd17700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09081578d0 0x7f090816b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090fd17700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 0x7f09080c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090fd17700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090816d950 con 0x7f090806d120 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090fd17700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080c8aa0 con 0x7f09081578d0 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090fd17700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090816bc10 con 0x7f0908157ca0 2023-10-06T02:57:52.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090dab3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 0x7f090816d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090dab3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 0x7f090816d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51962/0 (socket says 172.21.15.81:51962) 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090dab3700 1 -- 172.21.15.81:0/1357703428 learned_addr learned my addr 172.21.15.81:0/1357703428 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090e2b4700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 0x7f09080c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.544+0000 7f090d2b2700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09081578d0 0x7f090816b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f090dab3700 1 -- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 msgr2=0x7f09080c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f090dab3700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 0x7f09080c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f090dab3700 1 -- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09081578d0 msgr2=0x7f090816b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f090dab3700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09081578d0 0x7f090816b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f090dab3700 1 -- 172.21.15.81:0/1357703428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000094f0 con 0x7f090806d120 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f090dab3700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 0x7f090816d410 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f090400cb40 tx=0x7f09040017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f08fdffb700 1 -- 172.21.15.81:0/1357703428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400ce50 con 0x7f090806d120 2023-10-06T02:57:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09080c6500 con 0x7f090806d120 2023-10-06T02:57:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f08fdffb700 1 -- 172.21.15.81:0/1357703428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090400a9b0 con 0x7f090806d120 2023-10-06T02:57:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f08fdffb700 1 -- 172.21.15.81:0/1357703428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400ab20 con 0x7f090806d120 2023-10-06T02:57:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.545+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09080c6ac0 con 0x7f090806d120 2023-10-06T02:57:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.546+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0908067ac0 con 0x7f090806d120 2023-10-06T02:57:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.546+0000 7f08fdffb700 1 -- 172.21.15.81:0/1357703428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0904003030 con 0x7f090806d120 2023-10-06T02:57:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.547+0000 7f08fdffb700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.547+0000 7f08fdffb700 1 -- 172.21.15.81:0/1357703428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f09040844a0 con 0x7f090806d120 2023-10-06T02:57:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.547+0000 7f090d2b2700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.547+0000 7f090d2b2700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f08ec066f30 0x7f08ec0693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f090815d1d0 tx=0x7f08f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.552+0000 7f08fdffb700 1 -- 172.21.15.81:0/1357703428 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09040515b0 con 0x7f090806d120 2023-10-06T02:57:52.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.776+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f090806dac0 con 0x7f090806d120 2023-10-06T02:57:52.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.776+0000 7f08fdffb700 1 -- 172.21.15.81:0/1357703428 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f090806dac0 con 0x7f090806d120 2023-10-06T02:57:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:52.778 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:18.128298+0000","modified":"2023-10-06T02:57:21.769179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8358":{"gid":8358,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/604648999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":604648999},{"type":"v1","addr":"172.21.15.81:6835","nonce":604648999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T02:57:52.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f08ec066f30 msgr2=0x7f08ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f08ec066f30 0x7f08ec0693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f090815d1d0 tx=0x7f08f8008040 comp rx=0 tx=0).stop 2023-10-06T02:57:52.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 msgr2=0x7f090816d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:52.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 0x7f090816d410 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f090400cb40 tx=0x7f09040017b0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 shutdown_connections 2023-10-06T02:57:52.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0908157ca0 0x7f09080c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090806d120 0x7f090816d410 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 --2- 172.21.15.81:0/1357703428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09081578d0 0x7f090816b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:52.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 >> 172.21.15.81:0/1357703428 conn(0x7f090806bb90 msgr2=0x7f0908155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:52.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 shutdown_connections 2023-10-06T02:57:52.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:52.778+0000 7f090fd17700 1 -- 172.21.15.81:0/1357703428 wait complete. 2023-10-06T02:57:52.782 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-06T02:57:52.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-06T02:57:52.927 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","whoami":0,"id":8358,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":34.164996858999999,"mdsmap_epoch":90,"osdmap_epoch":183,"osdmap_epoch_barrier":182,"uptime":40.271536216000001} 2023-10-06T02:57:52.927 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "072ce422-278f-434c-8814-5b3ff2abcdfb", "fs_name": "cephfs", "id": 8358, "mdsmap_epoch": 90, "osdmap_epoch": 183, "osdmap_epoch_barrier": 182, "rank_uptime": 34.164996859, "state": "up:active", "uptime": 40.271536216, "want_state": "up:active", "whoami": 0 } 2023-10-06T02:57:52.928 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:57:52.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:52.928 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-06T02:57:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-06T02:57:53.207 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-06T02:57:53.207 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.262337 s, 200 MB/s 2023-10-06T02:57:53.208 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:57:53.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:53.251 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:53.291 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:57:53.291 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:57:53.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:53.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:53.366 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:57:53.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:53.367 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:57:53.382 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:57:53.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:53.382 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T02:57:53.424 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:57:53.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:53.425 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:57:53.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:53.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.592+0000 7ff6861f6700 1 Processor -- start 2023-10-06T02:57:53.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.592+0000 7ff6861f6700 1 -- start start 2023-10-06T02:57:53.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6861f6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff680159b40 0x7ff6800cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6861f6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff680068e90 0x7ff6800cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6861f6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6800cee10 con 0x7ff680159f10 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6861f6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800cd040 con 0x7ff680068e90 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6861f6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800cd320 con 0x7ff680159b40 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6859f5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff680068e90 0x7ff6800cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6859f5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff680068e90 0x7ff6800cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51976/0 (socket says 172.21.15.81:51976) 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6859f5700 1 -- 172.21.15.81:0/2397274361 learned_addr learned my addr 172.21.15.81:0/2397274361 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6851f4700 1 --2- 172.21.15.81:0/2397274361 >> v2:172.21.15.83:3300/0 conn(0x7ff680159b40 0x7ff6800cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6859f5700 1 -- 172.21.15.81:0/2397274361 >> v2:172.21.15.83:3300/0 conn(0x7ff680159b40 msgr2=0x7ff6800cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6859f5700 1 --2- 172.21.15.81:0/2397274361 >> v2:172.21.15.83:3300/0 conn(0x7ff680159b40 0x7ff6800cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6859f5700 1 -- 172.21.15.81:0/2397274361 >> v1:172.21.15.83:6789/0 conn(0x7ff680159f10 legacy=0x7ff680068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.593+0000 7ff6859f5700 1 -- 172.21.15.81:0/2397274361 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6800ce7c0 con 0x7ff680068e90 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff6859f5700 1 --2- 172.21.15.81:0/2397274361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680068e90 0x7ff6800cf2a0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7ff6800d0bc0 tx=0x7ff678009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26230baef51c981 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff677fff700 1 -- 172.21.15.81:0/2397274361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800e070 con 0x7ff680068e90 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff677fff700 1 -- 172.21.15.81:0/2397274361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67800ba20 con 0x7ff680068e90 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff677fff700 1 -- 172.21.15.81:0/2397274361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6780092e0 con 0x7ff680068e90 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff6861f6700 1 -- 172.21.15.81:0/2397274361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680068e90 msgr2=0x7ff6800cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff6861f6700 1 --2- 172.21.15.81:0/2397274361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680068e90 0x7ff6800cf2a0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7ff6800d0bc0 tx=0x7ff678009840 comp rx=0 tx=0).stop 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff6861f6700 1 -- 172.21.15.81:0/2397274361 shutdown_connections 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff6861f6700 1 --2- 172.21.15.81:0/2397274361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680068e90 0x7ff6800cf2a0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff6861f6700 1 --2- 172.21.15.81:0/2397274361 >> v2:172.21.15.83:3300/0 conn(0x7ff680159b40 0x7ff6800cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff6861f6700 1 -- 172.21.15.81:0/2397274361 >> 172.21.15.81:0/2397274361 conn(0x7ff6800cd660 msgr2=0x7ff6800cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:53.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff6861f6700 1 -- 172.21.15.81:0/2397274361 shutdown_connections 2023-10-06T02:57:53.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.594+0000 7ff6861f6700 1 -- 172.21.15.81:0/2397274361 wait complete. 2023-10-06T02:57:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.595+0000 7ff6861f6700 1 Processor -- start 2023-10-06T02:57:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.595+0000 7ff6861f6700 1 -- start start 2023-10-06T02:57:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.596+0000 7ff6861f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680068e90 0x7ff6800b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.596+0000 7ff6861f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680159b40 0x7ff680158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.596+0000 7ff6861f6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff680159f10 0x7ff680156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.596+0000 7ff6861f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68016e710 con 0x7ff680159b40 2023-10-06T02:57:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.596+0000 7ff6861f6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68016db00 con 0x7ff680159f10 2023-10-06T02:57:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.596+0000 7ff6861f6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68016dde0 con 0x7ff680068e90 2023-10-06T02:57:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.596+0000 7ff6849f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680159b40 0x7ff680158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.596+0000 7ff6849f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680159b40 0x7ff680158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51986/0 (socket says 172.21.15.81:51986) 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.596+0000 7ff6849f3700 1 -- 172.21.15.81:0/3482442934 learned_addr learned my addr 172.21.15.81:0/3482442934 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6859f5700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff680159f10 0x7ff680156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6851f4700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680068e90 0x7ff6800b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6849f3700 1 -- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680068e90 msgr2=0x7ff6800b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6849f3700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680068e90 0x7ff6800b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6849f3700 1 -- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff680159f10 msgr2=0x7ff680156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6849f3700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff680159f10 0x7ff680156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6849f3700 1 -- 172.21.15.81:0/3482442934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff678009ae0 con 0x7ff680159b40 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6849f3700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680159b40 0x7ff680158b30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7ff67000c4e0 tx=0x7ff67000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6757fa700 1 -- 172.21.15.81:0/3482442934 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670011590 con 0x7ff680159b40 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6757fa700 1 -- 172.21.15.81:0/3482442934 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff670011710 con 0x7ff680159b40 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68016e0c0 con 0x7ff680159b40 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6757fa700 1 -- 172.21.15.81:0/3482442934 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670011ad0 con 0x7ff680159b40 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.597+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff680156140 con 0x7ff680159b40 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.598+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff680063e90 con 0x7ff680159b40 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.598+0000 7ff6757fa700 1 -- 172.21.15.81:0/3482442934 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff67001b3b0 con 0x7ff680159b40 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.599+0000 7ff6757fa700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff664066f30 0x7ff6640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.599+0000 7ff6757fa700 1 -- 172.21.15.81:0/3482442934 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff670083a70 con 0x7ff680159b40 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.599+0000 7ff6851f4700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff664066f30 0x7ff6640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.599+0000 7ff6851f4700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff664066f30 0x7ff6640693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff68016d8c0 tx=0x7ff67c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.603+0000 7ff6757fa700 1 -- 172.21.15.81:0/3482442934 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff670050b80 con 0x7ff680159b40 2023-10-06T02:57:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.827+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6800ceaa0 con 0x7ff680159b40 2023-10-06T02:57:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.828+0000 7ff6757fa700 1 -- 172.21.15.81:0/3482442934 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4598 (secure 0 0 0) 0x7ff670017070 con 0x7ff680159b40 2023-10-06T02:57:53.830 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:53.830 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:18.128298+0000","modified":"2023-10-06T02:57:21.769179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8358":{"gid":8358,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/604648999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":604648999},{"type":"v1","addr":"172.21.15.81:6835","nonce":604648999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T02:57:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff664066f30 msgr2=0x7ff6640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff664066f30 0x7ff6640693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff68016d8c0 tx=0x7ff67c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680159b40 msgr2=0x7ff680158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680159b40 0x7ff680158b30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7ff67000c4e0 tx=0x7ff67000c7f0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 shutdown_connections 2023-10-06T02:57:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ff664066f30 0x7ff6640693e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff680159f10 0x7ff680156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff680068e90 0x7ff6800b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 --2- 172.21.15.81:0/3482442934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff680159b40 0x7ff680158b30 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 >> 172.21.15.81:0/3482442934 conn(0x7ff6800cd660 msgr2=0x7ff6800c6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 shutdown_connections 2023-10-06T02:57:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.830+0000 7ff6861f6700 1 -- 172.21.15.81:0/3482442934 wait complete. 2023-10-06T02:57:53.833 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-06T02:57:53.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:53.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.956+0000 7f0158883700 1 Processor -- start 2023-10-06T02:57:53.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.956+0000 7f0158883700 1 -- start start 2023-10-06T02:57:53.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0158883700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154159f10 0x7f0154068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0158883700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0154068cc0 0x7f01540cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0158883700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01540cee10 con 0x7f0154159b40 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0158883700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0154069140 con 0x7f0154068cc0 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0158883700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01540cd040 con 0x7f0154159f10 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0153fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0154068cc0 0x7f01540cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f01537fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0154159b40 0x7f01540cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44126/0 (socket says 172.21.15.81:44126) 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f01537fe700 1 -- 172.21.15.81:0/3172658940 learned_addr learned my addr 172.21.15.81:0/3172658940 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0152ffd700 1 --2- 172.21.15.81:0/3172658940 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154159f10 0x7f0154068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0153fff700 1 -- 172.21.15.81:0/3172658940 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154159f10 msgr2=0x7f0154068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0153fff700 1 --2- 172.21.15.81:0/3172658940 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154159f10 0x7f0154068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0153fff700 1 -- 172.21.15.81:0/3172658940 >> v1:172.21.15.81:6789/0 conn(0x7f0154159b40 legacy=0x7f01540cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f0153fff700 1 -- 172.21.15.81:0/3172658940 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01540cd320 con 0x7f0154068cc0 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.957+0000 7f01527fc700 1 -- 172.21.15.81:0/3172658940 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298670871 0 0) 0x7f01540cee10 con 0x7f0154159b40 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f0153fff700 1 --2- 172.21.15.81:0/3172658940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154068cc0 0x7f01540cf2a0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f014c0098e0 tx=0x7f014c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd48295924089650 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f01527fc700 1 -- 172.21.15.81:0/3172658940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c009e80 con 0x7f0154068cc0 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f01527fc700 1 -- 172.21.15.81:0/3172658940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c00b860 con 0x7f0154068cc0 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f01527fc700 1 -- 172.21.15.81:0/3172658940 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00bbe0 con 0x7f0154068cc0 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f0158883700 1 -- 172.21.15.81:0/3172658940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154068cc0 msgr2=0x7f01540cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f0158883700 1 --2- 172.21.15.81:0/3172658940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154068cc0 0x7f01540cf2a0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f014c0098e0 tx=0x7f014c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f0158883700 1 -- 172.21.15.81:0/3172658940 shutdown_connections 2023-10-06T02:57:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f0158883700 1 --2- 172.21.15.81:0/3172658940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154068cc0 0x7f01540cf2a0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f0158883700 1 --2- 172.21.15.81:0/3172658940 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154159f10 0x7f0154068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f0158883700 1 -- 172.21.15.81:0/3172658940 >> 172.21.15.81:0/3172658940 conn(0x7f01540cd660 msgr2=0x7f01540cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f0158883700 1 -- 172.21.15.81:0/3172658940 shutdown_connections 2023-10-06T02:57:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.958+0000 7f0158883700 1 -- 172.21.15.81:0/3172658940 wait complete. 2023-10-06T02:57:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.959+0000 7f0158883700 1 Processor -- start 2023-10-06T02:57:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0158883700 1 -- start start 2023-10-06T02:57:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0158883700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154068cc0 0x7f0154154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0158883700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0154159b40 0x7f0154157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0158883700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154159f10 0x7f015416aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0158883700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015415a9a0 con 0x7f0154159f10 2023-10-06T02:57:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0158883700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015416b000 con 0x7f0154159b40 2023-10-06T02:57:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0158883700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015415a6c0 con 0x7f0154068cc0 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0153fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154159f10 0x7f015416aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0153fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154159f10 0x7f015416aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52002/0 (socket says 172.21.15.81:52002) 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0153fff700 1 -- 172.21.15.81:0/409193019 learned_addr learned my addr 172.21.15.81:0/409193019 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f01537fe700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154068cc0 0x7f0154154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.960+0000 7f0152ffd700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0154159b40 0x7f0154157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f0153fff700 1 -- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154068cc0 msgr2=0x7f0154154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f0153fff700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154068cc0 0x7f0154154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f0153fff700 1 -- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0154159b40 msgr2=0x7f0154157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f0153fff700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0154159b40 0x7f0154157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f0153fff700 1 -- 172.21.15.81:0/409193019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c009420 con 0x7f0154159f10 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f0152ffd700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0154159b40 0x7f0154157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f01537fe700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154068cc0 0x7f0154154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f0153fff700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154159f10 0x7f015416aac0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f014c00b3c0 tx=0x7f014c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f013b7fe700 1 -- 172.21.15.81:0/409193019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c011630 con 0x7f0154159f10 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f013b7fe700 1 -- 172.21.15.81:0/409193019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c011790 con 0x7f0154159f10 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01540c8d10 con 0x7f0154159f10 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f013b7fe700 1 -- 172.21.15.81:0/409193019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c011b50 con 0x7f0154159f10 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.961+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01540c92d0 con 0x7f0154159f10 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.962+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0154063e90 con 0x7f0154159f10 2023-10-06T02:57:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.962+0000 7f013b7fe700 1 -- 172.21.15.81:0/409193019 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f014c0253f0 con 0x7f0154159f10 2023-10-06T02:57:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.963+0000 7f013b7fe700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0140066fb0 0x7f0140069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.963+0000 7f013b7fe700 1 -- 172.21.15.81:0/409193019 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f014c086470 con 0x7f0154159f10 2023-10-06T02:57:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.963+0000 7f01537fe700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0140066fb0 0x7f0140069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.963+0000 7f01537fe700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0140066fb0 0x7f0140069460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f01540b3260 tx=0x7f0144009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:53.967+0000 7f013b7fe700 1 -- 172.21.15.81:0/409193019 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f014c0534e0 con 0x7f0154159f10 2023-10-06T02:57:54.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.149+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01540c94c0 con 0x7f0154159f10 2023-10-06T02:57:54.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.150+0000 7f013b7fe700 1 -- 172.21.15.81:0/409193019 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+16841 (secure 0 0 0) 0x7f014c056b00 con 0x7f0154159f10 2023-10-06T02:57:54.151 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:54.152 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":183,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:57:49.483101+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:15.791318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:17.104149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:54.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0140066fb0 msgr2=0x7f0140069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0140066fb0 0x7f0140069460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f01540b3260 tx=0x7f0144009040 comp rx=0 tx=0).stop 2023-10-06T02:57:54.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154159f10 msgr2=0x7f015416aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154159f10 0x7f015416aac0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f014c00b3c0 tx=0x7f014c017000 comp rx=0 tx=0).stop 2023-10-06T02:57:54.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 shutdown_connections 2023-10-06T02:57:54.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154159f10 0x7f015416aac0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0154068cc0 0x7f0154154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0140066fb0 0x7f0140069460 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 --2- 172.21.15.81:0/409193019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0154159b40 0x7f0154157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 >> 172.21.15.81:0/409193019 conn(0x7f01540cd660 msgr2=0x7f01540c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:54.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 shutdown_connections 2023-10-06T02:57:54.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.152+0000 7f0158883700 1 -- 172.21.15.81:0/409193019 wait complete. 2023-10-06T02:57:54.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:45:55.530980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:46:00.679615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:57:15.791318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:57:17.104149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '183', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:57:54.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:57:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.280+0000 7f5823525700 1 Processor -- start 2023-10-06T02:57:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.281+0000 7f5823525700 1 -- start start 2023-10-06T02:57:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.281+0000 7f5823525700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f581c15a2a0 0x7f581c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.281+0000 7f5823525700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581c0b0ca0 con 0x7f581c0ceb30 2023-10-06T02:57:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.281+0000 7f5823525700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581c0b00d0 con 0x7f581c06dd60 2023-10-06T02:57:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.281+0000 7f5823525700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581c06e160 con 0x7f581c15a2a0 2023-10-06T02:57:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.281+0000 7f58212c1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f581c15a2a0 0x7f581c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.282+0000 7f5820ac0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f581c0ceb30 0x7f581c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44138/0 (socket says 172.21.15.81:44138) 2023-10-06T02:57:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.282+0000 7f5820ac0700 1 -- 172.21.15.81:0/439917389 learned_addr learned my addr 172.21.15.81:0/439917389 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.282+0000 7f58212c1700 1 -- 172.21.15.81:0/439917389 >> v1:172.21.15.83:6789/0 conn(0x7f581c06dd60 legacy=0x7f581c0b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.282+0000 7f58212c1700 1 -- 172.21.15.81:0/439917389 >> v1:172.21.15.81:6789/0 conn(0x7f581c0ceb30 legacy=0x7f581c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.282+0000 7f58212c1700 1 -- 172.21.15.81:0/439917389 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c0b0370 con 0x7f581c15a2a0 2023-10-06T02:57:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.282+0000 7f58212c1700 1 --2- 172.21.15.81:0/439917389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c15a2a0 0x7f581c0b1130 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f5818009e60 tx=0x7f5818009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786ee6c9102954e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.282+0000 7f5813fff700 1 -- 172.21.15.81:0/439917389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581800e070 con 0x7f581c15a2a0 2023-10-06T02:57:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.282+0000 7f5813fff700 1 -- 172.21.15.81:0/439917389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581800bb30 con 0x7f581c15a2a0 2023-10-06T02:57:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.282+0000 7f5813fff700 1 -- 172.21.15.81:0/439917389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818012430 con 0x7f581c15a2a0 2023-10-06T02:57:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.283+0000 7f5823525700 1 -- 172.21.15.81:0/439917389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c15a2a0 msgr2=0x7f581c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.283+0000 7f5823525700 1 --2- 172.21.15.81:0/439917389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c15a2a0 0x7f581c0b1130 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f5818009e60 tx=0x7f5818009780 comp rx=0 tx=0).stop 2023-10-06T02:57:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.283+0000 7f5823525700 1 -- 172.21.15.81:0/439917389 shutdown_connections 2023-10-06T02:57:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.283+0000 7f5823525700 1 --2- 172.21.15.81:0/439917389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c15a2a0 0x7f581c0b1130 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.283+0000 7f5823525700 1 -- 172.21.15.81:0/439917389 >> 172.21.15.81:0/439917389 conn(0x7f581c067640 msgr2=0x7f581c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.283+0000 7f5823525700 1 -- 172.21.15.81:0/439917389 shutdown_connections 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.283+0000 7f5823525700 1 -- 172.21.15.81:0/439917389 wait complete. 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.284+0000 7f5823525700 1 Processor -- start 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.284+0000 7f5823525700 1 -- start start 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5823525700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581c06dd60 0x7f581c150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5823525700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c0ceb30 0x7f581c13f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5823525700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f581c15a2a0 0x7f581c16e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5823525700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c15e4f0 con 0x7f581c0ceb30 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5823525700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c1513c0 con 0x7f581c15a2a0 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5823525700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c15f050 con 0x7f581c06dd60 2023-10-06T02:57:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5820ac0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c0ceb30 0x7f581c13f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5820ac0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c0ceb30 0x7f581c13f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52022/0 (socket says 172.21.15.81:52022) 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5820ac0700 1 -- 172.21.15.81:0/2025790315 learned_addr learned my addr 172.21.15.81:0/2025790315 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f58212c1700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581c06dd60 0x7f581c150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5821ac2700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f581c15a2a0 0x7f581c16e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5820ac0700 1 -- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581c06dd60 msgr2=0x7f581c150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5820ac0700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581c06dd60 0x7f581c150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5820ac0700 1 -- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f581c15a2a0 msgr2=0x7f581c16e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5820ac0700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f581c15a2a0 0x7f581c16e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5820ac0700 1 -- 172.21.15.81:0/2025790315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818009a20 con 0x7f581c0ceb30 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f58212c1700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581c06dd60 0x7f581c150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5821ac2700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f581c15a2a0 0x7f581c16e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5820ac0700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c0ceb30 0x7f581c13f9f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c760 tx=0x7f580c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f58117fa700 1 -- 172.21.15.81:0/2025790315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c005b30 con 0x7f581c0ceb30 2023-10-06T02:57:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f58117fa700 1 -- 172.21.15.81:0/2025790315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c005cb0 con 0x7f581c0ceb30 2023-10-06T02:57:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c15e720 con 0x7f581c0ceb30 2023-10-06T02:57:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f58117fa700 1 -- 172.21.15.81:0/2025790315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c007340 con 0x7f581c0ceb30 2023-10-06T02:57:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.285+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c15ece0 con 0x7f581c0ceb30 2023-10-06T02:57:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.286+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c151170 con 0x7f581c0ceb30 2023-10-06T02:57:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.287+0000 7f58117fa700 1 -- 172.21.15.81:0/2025790315 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f580c01b400 con 0x7f581c0ceb30 2023-10-06T02:57:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.287+0000 7f58117fa700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5800066f30 0x7f58000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.287+0000 7f58117fa700 1 -- 172.21.15.81:0/2025790315 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f580c084230 con 0x7f581c0ceb30 2023-10-06T02:57:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.287+0000 7f58212c1700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5800066f30 0x7f58000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.287+0000 7f58212c1700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5800066f30 0x7f58000693e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f58180097c0 tx=0x7f5818018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.291+0000 7f58117fa700 1 -- 172.21.15.81:0/2025790315 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f580c0513c0 con 0x7f581c0ceb30 2023-10-06T02:57:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.472+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f581c06b6d0 con 0x7f581c0ceb30 2023-10-06T02:57:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.473+0000 7f58117fa700 1 -- 172.21.15.81:0/2025790315 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7f580c0549e0 con 0x7f581c0ceb30 2023-10-06T02:57:54.474 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T02:57:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5800066f30 msgr2=0x7f58000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5800066f30 0x7f58000693e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f58180097c0 tx=0x7f5818018000 comp rx=0 tx=0).stop 2023-10-06T02:57:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c0ceb30 msgr2=0x7f581c13f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c0ceb30 0x7f581c13f9f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c760 tx=0x7f580c007ef0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 shutdown_connections 2023-10-06T02:57:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5800066f30 0x7f58000693e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f581c15a2a0 0x7f581c16e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581c06dd60 0x7f581c150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 --2- 172.21.15.81:0/2025790315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c0ceb30 0x7f581c13f9f0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 >> 172.21.15.81:0/2025790315 conn(0x7f581c067640 msgr2=0x7f581c150340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:54.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 shutdown_connections 2023-10-06T02:57:54.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.475+0000 7f5823525700 1 -- 172.21.15.81:0/2025790315 wait complete. 2023-10-06T02:57:54.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:57:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.604+0000 7f344f59e700 1 Processor -- start 2023-10-06T02:57:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.604+0000 7f344f59e700 1 -- start start 2023-10-06T02:57:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3450068d60 0x7f34500b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345015a400 con 0x7f34500b6370 2023-10-06T02:57:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344f59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3450069870 con 0x7f345015db40 2023-10-06T02:57:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34500b5850 con 0x7f3450068d60 2023-10-06T02:57:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f34500b6370 0x7f345015af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44144/0 (socket says 172.21.15.81:44144) 2023-10-06T02:57:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344e59c700 1 -- 172.21.15.81:0/2124225120 learned_addr learned my addr 172.21.15.81:0/2124225120 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344ed9d700 1 --2- 172.21.15.81:0/2124225120 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3450068d60 0x7f34500b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344dd9b700 1 -- 172.21.15.81:0/2124225120 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936905702 0 0) 0x7f345015a400 con 0x7f34500b6370 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344dd9b700 1 -- 172.21.15.81:0/2124225120 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f343c003570 con 0x7f34500b6370 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344dd9b700 1 -- 172.21.15.81:0/2124225120 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57863238 0 0) 0x7f3450069870 con 0x7f345015db40 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.605+0000 7f344dd9b700 1 -- 172.21.15.81:0/2124225120 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f345015a400 con 0x7f345015db40 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344ed9d700 1 -- 172.21.15.81:0/2124225120 >> v1:172.21.15.83:6789/0 conn(0x7f345015db40 legacy=0x7f3450068650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344ed9d700 1 -- 172.21.15.81:0/2124225120 >> v1:172.21.15.81:6789/0 conn(0x7f34500b6370 legacy=0x7f345015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344ed9d700 1 -- 172.21.15.81:0/2124225120 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34500b6740 con 0x7f3450068d60 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344ed9d700 1 --2- 172.21.15.81:0/2124225120 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3450068d60 0x7f34500b5310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3448009e90 tx=0x7f3448009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5741f563f9cc7c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344dd9b700 1 -- 172.21.15.81:0/2124225120 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800e070 con 0x7f3450068d60 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344dd9b700 1 -- 172.21.15.81:0/2124225120 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344800bb80 con 0x7f3450068d60 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344dd9b700 1 -- 172.21.15.81:0/2124225120 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448012430 con 0x7f3450068d60 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344f59e700 1 -- 172.21.15.81:0/2124225120 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3450068d60 msgr2=0x7f34500b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344f59e700 1 --2- 172.21.15.81:0/2124225120 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3450068d60 0x7f34500b5310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3448009e90 tx=0x7f3448009780 comp rx=0 tx=0).stop 2023-10-06T02:57:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344f59e700 1 -- 172.21.15.81:0/2124225120 shutdown_connections 2023-10-06T02:57:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344f59e700 1 --2- 172.21.15.81:0/2124225120 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3450068d60 0x7f34500b5310 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344f59e700 1 -- 172.21.15.81:0/2124225120 >> 172.21.15.81:0/2124225120 conn(0x7f345006bb90 msgr2=0x7f345006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344f59e700 1 -- 172.21.15.81:0/2124225120 shutdown_connections 2023-10-06T02:57:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.606+0000 7f344f59e700 1 -- 172.21.15.81:0/2124225120 wait complete. 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.608+0000 7f344f59e700 1 Processor -- start 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.608+0000 7f344f59e700 1 -- start start 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.608+0000 7f344f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450068d60 0x7f34500ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.608+0000 7f344f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34500b6370 0x7f345016a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.608+0000 7f344f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f345015db40 0x7f345016a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.608+0000 7f344f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500b1190 con 0x7f3450068d60 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.608+0000 7f344f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345016af30 con 0x7f345015db40 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.608+0000 7f344f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345016b210 con 0x7f34500b6370 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.608+0000 7f344e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450068d60 0x7f34500ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450068d60 0x7f34500ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52024/0 (socket says 172.21.15.81:52024) 2023-10-06T02:57:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344e59c700 1 -- 172.21.15.81:0/1409457729 learned_addr learned my addr 172.21.15.81:0/1409457729 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f3445d9b700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34500b6370 0x7f345016a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344ed9d700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f345015db40 0x7f345016a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344e59c700 1 -- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34500b6370 msgr2=0x7f345016a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344e59c700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34500b6370 0x7f345016a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344e59c700 1 -- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f345015db40 msgr2=0x7f345016a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344e59c700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f345015db40 0x7f345016a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344e59c700 1 -- 172.21.15.81:0/1409457729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3448009a20 con 0x7f3450068d60 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344e59c700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450068d60 0x7f34500ae4d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f344000c790 tx=0x7f3440007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f3446ffd700 1 -- 172.21.15.81:0/1409457729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440005b30 con 0x7f3450068d60 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f3446ffd700 1 -- 172.21.15.81:0/1409457729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440005c90 con 0x7f3450068d60 2023-10-06T02:57:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f3446ffd700 1 -- 172.21.15.81:0/1409457729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440007300 con 0x7f3450068d60 2023-10-06T02:57:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34500b0e20 con 0x7f3450068d60 2023-10-06T02:57:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.609+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34500b0ad0 con 0x7f3450068d60 2023-10-06T02:57:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.610+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345006fb00 con 0x7f3450068d60 2023-10-06T02:57:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.610+0000 7f3446ffd700 1 -- 172.21.15.81:0/1409457729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f344001b3b0 con 0x7f3450068d60 2023-10-06T02:57:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.611+0000 7f3446ffd700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3430066f30 0x7f34300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.611+0000 7f3446ffd700 1 -- 172.21.15.81:0/1409457729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3440083b70 con 0x7f3450068d60 2023-10-06T02:57:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.611+0000 7f3445d9b700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3430066f30 0x7f34300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.611+0000 7f3445d9b700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3430066f30 0x7f34300693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f345015cbb0 tx=0x7f3438007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:54.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.615+0000 7f3446ffd700 1 -- 172.21.15.81:0/1409457729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3440050c80 con 0x7f3450068d60 2023-10-06T02:57:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.799+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3450071b10 con 0x7f3450068d60 2023-10-06T02:57:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.799+0000 7f3446ffd700 1 -- 172.21.15.81:0/1409457729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v183) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3440017020 con 0x7f3450068d60 2023-10-06T02:57:54.800 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3430066f30 msgr2=0x7f34300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3430066f30 0x7f34300693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f345015cbb0 tx=0x7f3438007d50 comp rx=0 tx=0).stop 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450068d60 msgr2=0x7f34500ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450068d60 0x7f34500ae4d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f344000c790 tx=0x7f3440007ea0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 shutdown_connections 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f3430066f30 0x7f34300693e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f345015db40 0x7f345016a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3450068d60 0x7f34500ae4d0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 --2- 172.21.15.81:0/1409457729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34500b6370 0x7f345016a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 >> 172.21.15.81:0/1409457729 conn(0x7f345006bb90 msgr2=0x7f34500cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:54.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 shutdown_connections 2023-10-06T02:57:54.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.801+0000 7f344f59e700 1 -- 172.21.15.81:0/1409457729 wait complete. 2023-10-06T02:57:54.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:57:54.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.930+0000 7fc55b59e700 1 Processor -- start 2023-10-06T02:57:54.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.930+0000 7fc55b59e700 1 -- start start 2023-10-06T02:57:54.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc55b59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc55c0d0f50 0x7fc55c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc55b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc55b59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c06d990 con 0x7fc55c0d0b80 2023-10-06T02:57:54.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc55b59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55c15a690 con 0x7fc55c0d0f50 2023-10-06T02:57:54.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc55b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0cf2d0 con 0x7fc55c06d530 2023-10-06T02:57:54.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc559d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc55c0d0f50 0x7fc55c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc55ad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc559d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc55c0d0f50 0x7fc55c06cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:38736/0 (socket says 172.21.15.81:38736) 2023-10-06T02:57:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc55ad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:56574/0 (socket says 172.21.15.81:56574) 2023-10-06T02:57:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc559d9b700 1 -- 172.21.15.81:0/3725481600 learned_addr learned my addr 172.21.15.81:0/3725481600 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.931+0000 7fc55a59c700 1 --1- 172.21.15.81:0/3725481600 >> v1:172.21.15.83:6789/0 conn(0x7fc55c0d0b80 0x7fc55c0cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:38100/0 (socket says 172.21.15.81:38100) 2023-10-06T02:57:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55ad9d700 1 -- 172.21.15.81:0/3725481600 >> v2:172.21.15.83:3300/0 conn(0x7fc55c0d0f50 msgr2=0x7fc55c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55ad9d700 1 --2- 172.21.15.81:0/3725481600 >> v2:172.21.15.83:3300/0 conn(0x7fc55c0d0f50 0x7fc55c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55ad9d700 1 -- 172.21.15.81:0/3725481600 >> v1:172.21.15.83:6789/0 conn(0x7fc55c0d0b80 legacy=0x7fc55c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55ad9d700 1 -- 172.21.15.81:0/3725481600 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c0d0480 con 0x7fc55c06d530 2023-10-06T02:57:54.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc559d9b700 1 --2- 172.21.15.81:0/3725481600 >> v2:172.21.15.83:3300/0 conn(0x7fc55c0d0f50 0x7fc55c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:54.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55ad9d700 1 --2- 172.21.15.81:0/3725481600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c15b320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc554009e60 tx=0x7fc554009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46fdc66861e3e17a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:54.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55959a700 1 -- 172.21.15.81:0/3725481600 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55400e070 con 0x7fc55c06d530 2023-10-06T02:57:54.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55959a700 1 -- 172.21.15.81:0/3725481600 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55400bb60 con 0x7fc55c06d530 2023-10-06T02:57:54.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55959a700 1 -- 172.21.15.81:0/3725481600 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554012430 con 0x7fc55c06d530 2023-10-06T02:57:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55b59e700 1 -- 172.21.15.81:0/3725481600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 msgr2=0x7fc55c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.932+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3725481600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c15b320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc554009e60 tx=0x7fc554009780 comp rx=0 tx=0).stop 2023-10-06T02:57:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.933+0000 7fc55b59e700 1 -- 172.21.15.81:0/3725481600 shutdown_connections 2023-10-06T02:57:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.933+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3725481600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c15b320 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.933+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3725481600 >> v2:172.21.15.83:3300/0 conn(0x7fc55c0d0f50 0x7fc55c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.933+0000 7fc55b59e700 1 -- 172.21.15.81:0/3725481600 >> 172.21.15.81:0/3725481600 conn(0x7fc55c063230 msgr2=0x7fc55c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.933+0000 7fc55b59e700 1 -- 172.21.15.81:0/3725481600 shutdown_connections 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.933+0000 7fc55b59e700 1 -- 172.21.15.81:0/3725481600 wait complete. 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.934+0000 7fc55b59e700 1 Processor -- start 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.934+0000 7fc55b59e700 1 -- start start 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.934+0000 7fc55b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.934+0000 7fc55b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55c0d0b80 0x7fc55c0c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.934+0000 7fc55b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0d0f50 0x7fc55c0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.934+0000 7fc55b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0ccc50 con 0x7fc55c0d0f50 2023-10-06T02:57:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.934+0000 7fc55b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0cc0b0 con 0x7fc55c0d0b80 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.934+0000 7fc55b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0cc320 con 0x7fc55c06d530 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0d0f50 0x7fc55c0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0d0f50 0x7fc55c0c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52028/0 (socket says 172.21.15.81:52028) 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55ad9d700 1 -- 172.21.15.81:0/3301954225 learned_addr learned my addr 172.21.15.81:0/3301954225 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc559d9b700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55c0d0b80 0x7fc55c0c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55a59c700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55ad9d700 1 -- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 msgr2=0x7fc55c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55ad9d700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55ad9d700 1 -- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55c0d0b80 msgr2=0x7fc55c0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55ad9d700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55c0d0b80 0x7fc55c0c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55ad9d700 1 -- 172.21.15.81:0/3301954225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500094f0 con 0x7fc55c0d0f50 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55ad9d700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0d0f50 0x7fc55c0c6230 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fc55400b6c0 tx=0x7fc554019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc54a7fc700 1 -- 172.21.15.81:0/3301954225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554012e90 con 0x7fc55c0d0f50 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc54a7fc700 1 -- 172.21.15.81:0/3301954225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc554027470 con 0x7fc55c0d0f50 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc554009a20 con 0x7fc55c0d0f50 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc54a7fc700 1 -- 172.21.15.81:0/3301954225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554027850 con 0x7fc55c0d0f50 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.935+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c0cc8e0 con 0x7fc55c0d0f50 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.936+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c0676e0 con 0x7fc55c0d0f50 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.936+0000 7fc54a7fc700 1 -- 172.21.15.81:0/3301954225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc554024070 con 0x7fc55c0d0f50 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.937+0000 7fc54a7fc700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc53c066f30 0x7fc53c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.937+0000 7fc54a7fc700 1 -- 172.21.15.81:0/3301954225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc5540870c0 con 0x7fc55c0d0f50 2023-10-06T02:57:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.937+0000 7fc55a59c700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc53c066f30 0x7fc53c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:54.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.937+0000 7fc55a59c700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc53c066f30 0x7fc53c0693e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc54c004fd0 tx=0x7fc54c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:54.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:54.941+0000 7fc54a7fc700 1 -- 172.21.15.81:0/3301954225 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5540541d0 con 0x7fc55c0d0f50 2023-10-06T02:57:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.120+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc55c06dc00 con 0x7fc55c0d0f50 2023-10-06T02:57:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.120+0000 7fc54a7fc700 1 -- 172.21.15.81:0/3301954225 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5540577f0 con 0x7fc55c0d0f50 2023-10-06T02:57:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T02:57:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc53c066f30 msgr2=0x7fc53c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc53c066f30 0x7fc53c0693e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc54c004fd0 tx=0x7fc54c007eb0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0d0f50 msgr2=0x7fc55c0c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0d0f50 0x7fc55c0c6230 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fc55400b6c0 tx=0x7fc554019000 comp rx=0 tx=0).stop 2023-10-06T02:57:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 shutdown_connections 2023-10-06T02:57:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0d0f50 0x7fc55c0c6230 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55c06d530 0x7fc55c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fc53c066f30 0x7fc53c0693e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3301954225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55c0d0b80 0x7fc55c0c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 >> 172.21.15.81:0/3301954225 conn(0x7fc55c063230 msgr2=0x7fc55c068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 shutdown_connections 2023-10-06T02:57:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.122+0000 7fc55b59e700 1 -- 172.21.15.81:0/3301954225 wait complete. 2023-10-06T02:57:55.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:57:55.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.250+0000 7f7f9262c700 1 Processor -- start 2023-10-06T02:57:55.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.250+0000 7f7f9262c700 1 -- start start 2023-10-06T02:57:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f9262c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7f8c157ca0 0x7f7f8c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f9262c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7f8c06d120 0x7f7f8c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f9262c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c0d07c0 con 0x7f7f8c1578d0 2023-10-06T02:57:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f9262c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c06da50 con 0x7f7f8c06d120 2023-10-06T02:57:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f9262c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c0cfbb0 con 0x7f7f8c157ca0 2023-10-06T02:57:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f8bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7f8c1578d0 0x7f7f8c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44160/0 (socket says 172.21.15.81:44160) 2023-10-06T02:57:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f90bc9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7f8c06d120 0x7f7f8c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f8bfff700 1 -- 172.21.15.81:0/1879600719 learned_addr learned my addr 172.21.15.81:0/1879600719 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f90bc9700 1 -- 172.21.15.81:0/1879600719 >> v2:172.21.15.83:3300/0 conn(0x7f7f8c157ca0 msgr2=0x7f7f8c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:55.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f90bc9700 1 --2- 172.21.15.81:0/1879600719 >> v2:172.21.15.83:3300/0 conn(0x7f7f8c157ca0 0x7f7f8c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f90bc9700 1 -- 172.21.15.81:0/1879600719 >> v1:172.21.15.81:6789/0 conn(0x7f7f8c1578d0 legacy=0x7f7f8c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f90bc9700 1 -- 172.21.15.81:0/1879600719 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0cfe90 con 0x7f7f8c06d120 2023-10-06T02:57:55.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.251+0000 7f7f8affd700 1 -- 172.21.15.81:0/1879600719 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413977854 0 0) 0x7f7f8c0d07c0 con 0x7f7f8c1578d0 2023-10-06T02:57:55.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f90bc9700 1 --2- 172.21.15.81:0/1879600719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c06d120 0x7f7f8c06d510 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c068510 tx=0x7f7f84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c9351324559a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:55.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f8affd700 1 -- 172.21.15.81:0/1879600719 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8400e070 con 0x7f7f8c06d120 2023-10-06T02:57:55.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f8affd700 1 -- 172.21.15.81:0/1879600719 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8400bc30 con 0x7f7f8c06d120 2023-10-06T02:57:55.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f8affd700 1 -- 172.21.15.81:0/1879600719 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f84012430 con 0x7f7f8c06d120 2023-10-06T02:57:55.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f9262c700 1 -- 172.21.15.81:0/1879600719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c06d120 msgr2=0x7f7f8c06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f9262c700 1 --2- 172.21.15.81:0/1879600719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c06d120 0x7f7f8c06d510 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c068510 tx=0x7f7f84009780 comp rx=0 tx=0).stop 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f9262c700 1 -- 172.21.15.81:0/1879600719 shutdown_connections 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f9262c700 1 --2- 172.21.15.81:0/1879600719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c06d120 0x7f7f8c06d510 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f9262c700 1 --2- 172.21.15.81:0/1879600719 >> v2:172.21.15.83:3300/0 conn(0x7f7f8c157ca0 0x7f7f8c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f9262c700 1 -- 172.21.15.81:0/1879600719 >> 172.21.15.81:0/1879600719 conn(0x7f7f8c06bb90 msgr2=0x7f7f8c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f9262c700 1 -- 172.21.15.81:0/1879600719 shutdown_connections 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.252+0000 7f7f9262c700 1 -- 172.21.15.81:0/1879600719 wait complete. 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.253+0000 7f7f9262c700 1 Processor -- start 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f9262c700 1 -- start start 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f9262c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c06d120 0x7f7f8c153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f9262c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c1578d0 0x7f7f8c152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f9262c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c157ca0 0x7f7f8c0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f9262c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0aa890 con 0x7f7f8c1578d0 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f9262c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0aab70 con 0x7f7f8c06d120 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f9262c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0b2120 con 0x7f7f8c157ca0 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c1578d0 0x7f7f8c152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c1578d0 0x7f7f8c152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52040/0 (socket says 172.21.15.81:52040) 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f8b7fe700 1 -- 172.21.15.81:0/3460015238 learned_addr learned my addr 172.21.15.81:0/3460015238 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.254+0000 7f7f8bfff700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c06d120 0x7f7f8c153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f90bc9700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c157ca0 0x7f7f8c0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f8b7fe700 1 -- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c157ca0 msgr2=0x7f7f8c0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f8b7fe700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c157ca0 0x7f7f8c0ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f8b7fe700 1 -- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c06d120 msgr2=0x7f7f8c153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f8b7fe700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c06d120 0x7f7f8c153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f8b7fe700 1 -- 172.21.15.81:0/3460015238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f84009a20 con 0x7f7f8c1578d0 2023-10-06T02:57:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f8b7fe700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c1578d0 0x7f7f8c152bf0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000b5e0 tx=0x7f7f800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f73fff700 1 -- 172.21.15.81:0/3460015238 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000f510 con 0x7f7f8c1578d0 2023-10-06T02:57:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f73fff700 1 -- 172.21.15.81:0/3460015238 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8000f670 con 0x7f7f8c1578d0 2023-10-06T02:57:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c0b2400 con 0x7f7f8c1578d0 2023-10-06T02:57:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f73fff700 1 -- 172.21.15.81:0/3460015238 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000fa30 con 0x7f7f8c1578d0 2023-10-06T02:57:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.255+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c153990 con 0x7f7f8c1578d0 2023-10-06T02:57:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.256+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8c067ac0 con 0x7f7f8c1578d0 2023-10-06T02:57:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.257+0000 7f7f73fff700 1 -- 172.21.15.81:0/3460015238 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f8001a400 con 0x7f7f8c1578d0 2023-10-06T02:57:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.257+0000 7f7f73fff700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f78066f30 0x7f7f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.257+0000 7f7f73fff700 1 -- 172.21.15.81:0/3460015238 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7f80084050 con 0x7f7f8c1578d0 2023-10-06T02:57:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.257+0000 7f7f8bfff700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f78066f30 0x7f7f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.257+0000 7f7f8bfff700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f78066f30 0x7f7f780693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c007fd0 tx=0x7f7f7c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.261+0000 7f7f73fff700 1 -- 172.21.15.81:0/3460015238 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f800511e0 con 0x7f7f8c1578d0 2023-10-06T02:57:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.440+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f8c0d0170 con 0x7f7f8c1578d0 2023-10-06T02:57:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.441+0000 7f7f73fff700 1 -- 172.21.15.81:0/3460015238 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f80054800 con 0x7f7f8c1578d0 2023-10-06T02:57:55.442 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T02:57:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f78066f30 msgr2=0x7f7f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f78066f30 0x7f7f780693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c007fd0 tx=0x7f7f7c007d30 comp rx=0 tx=0).stop 2023-10-06T02:57:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c1578d0 msgr2=0x7f7f8c152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c1578d0 0x7f7f8c152bf0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000b5e0 tx=0x7f7f800091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 shutdown_connections 2023-10-06T02:57:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f8c157ca0 0x7f7f8c0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7f78066f30 0x7f7f780693e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f8c06d120 0x7f7f8c153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 --2- 172.21.15.81:0/3460015238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f8c1578d0 0x7f7f8c152bf0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 >> 172.21.15.81:0/3460015238 conn(0x7f7f8c06bb90 msgr2=0x7f7f8c069840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 shutdown_connections 2023-10-06T02:57:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.443+0000 7f7f9262c700 1 -- 172.21.15.81:0/3460015238 wait complete. 2023-10-06T02:57:55.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:55.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.567+0000 7fe0b9b9e700 1 Processor -- start 2023-10-06T02:57:55.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.568+0000 7fe0b9b9e700 1 -- start start 2023-10-06T02:57:55.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.568+0000 7fe0b9b9e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0b4159b40 0x7fe0b40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.568+0000 7fe0b9b9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159f10 0x7fe0b4068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.568+0000 7fe0b9b9e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe0b40ccb40 0x7fe0b4068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.568+0000 7fe0b9b9e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b40cee10 con 0x7fe0b4159b40 2023-10-06T02:57:55.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.568+0000 7fe0b9b9e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b40cd040 con 0x7fe0b40ccb40 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.568+0000 7fe0b9b9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40cd320 con 0x7fe0b4159f10 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.568+0000 7fe0b8b9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0b4159b40 0x7fe0b40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0b8b9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0b4159b40 0x7fe0b40cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52044/0 (socket says 172.21.15.81:52044) 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0b8b9c700 1 -- 172.21.15.81:0/4082694249 learned_addr learned my addr 172.21.15.81:0/4082694249 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0abfff700 1 --2- 172.21.15.81:0/4082694249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159f10 0x7fe0b4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0b939d700 1 --2- 172.21.15.81:0/4082694249 >> v2:172.21.15.83:3300/0 conn(0x7fe0b40ccb40 0x7fe0b4068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0b8b9c700 1 -- 172.21.15.81:0/4082694249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159f10 msgr2=0x7fe0b4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0b8b9c700 1 --2- 172.21.15.81:0/4082694249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159f10 0x7fe0b4068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0b8b9c700 1 -- 172.21.15.81:0/4082694249 >> v2:172.21.15.83:3300/0 conn(0x7fe0b40ccb40 msgr2=0x7fe0b4068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0b8b9c700 1 --2- 172.21.15.81:0/4082694249 >> v2:172.21.15.83:3300/0 conn(0x7fe0b40ccb40 0x7fe0b4068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0b8b9c700 1 -- 172.21.15.81:0/4082694249 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40ce7c0 con 0x7fe0b4159b40 2023-10-06T02:57:55.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0b8b9c700 1 --2- 172.21.15.81:0/4082694249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b4159b40 0x7fe0b40cc600 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40b6bf0 tx=0x7fe0b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4f6800e52f0138 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0ab7fe700 1 -- 172.21.15.81:0/4082694249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000e070 con 0x7fe0b4159b40 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0ab7fe700 1 -- 172.21.15.81:0/4082694249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000b970 con 0x7fe0b4159b40 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.569+0000 7fe0ab7fe700 1 -- 172.21.15.81:0/4082694249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00092e0 con 0x7fe0b4159b40 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.570+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/4082694249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b4159b40 msgr2=0x7fe0b40cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.570+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/4082694249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b4159b40 0x7fe0b40cc600 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40b6bf0 tx=0x7fe0b0009840 comp rx=0 tx=0).stop 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.570+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/4082694249 shutdown_connections 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.570+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/4082694249 >> v2:172.21.15.83:3300/0 conn(0x7fe0b40ccb40 0x7fe0b4068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.570+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/4082694249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b4159b40 0x7fe0b40cc600 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.570+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/4082694249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159f10 0x7fe0b4068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.570+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/4082694249 >> 172.21.15.81:0/4082694249 conn(0x7fe0b40cd660 msgr2=0x7fe0b40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.570+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/4082694249 shutdown_connections 2023-10-06T02:57:55.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.570+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/4082694249 wait complete. 2023-10-06T02:57:55.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.571+0000 7fe0b9b9e700 1 Processor -- start 2023-10-06T02:57:55.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.571+0000 7fe0b9b9e700 1 -- start start 2023-10-06T02:57:55.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b9b9e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b40ccb40 0x7fe0b40c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b9b9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159b40 0x7fe0b40ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b9b9e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0b4159f10 0x7fe0b416aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b9b9e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b41573d0 con 0x7fe0b40ccb40 2023-10-06T02:57:55.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b9b9e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b416e150 con 0x7fe0b4159f10 2023-10-06T02:57:55.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b9b9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b416e430 con 0x7fe0b4159b40 2023-10-06T02:57:55.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b8b9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b40ccb40 0x7fe0b40c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b8b9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b40ccb40 0x7fe0b40c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52056/0 (socket says 172.21.15.81:52056) 2023-10-06T02:57:55.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b8b9c700 1 -- 172.21.15.81:0/3680797972 learned_addr learned my addr 172.21.15.81:0/3680797972 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:55.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b939d700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0b4159f10 0x7fe0b416aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0abfff700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159b40 0x7fe0b40ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b8b9c700 1 -- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159b40 msgr2=0x7fe0b40ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b8b9c700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159b40 0x7fe0b40ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b8b9c700 1 -- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0b4159f10 msgr2=0x7fe0b416aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b8b9c700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0b4159f10 0x7fe0b416aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b8b9c700 1 -- 172.21.15.81:0/3680797972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0009ae0 con 0x7fe0b40ccb40 2023-10-06T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b8b9c700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b40ccb40 0x7fe0b40c9cb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe0b406fe10 tx=0x7fe0b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0a8ff9700 1 -- 172.21.15.81:0/3680797972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0008950 con 0x7fe0b40ccb40 2023-10-06T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0a8ff9700 1 -- 172.21.15.81:0/3680797972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0008ab0 con 0x7fe0b40ccb40 2023-10-06T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0a8ff9700 1 -- 172.21.15.81:0/3680797972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0008e70 con 0x7fe0b40ccb40 2023-10-06T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b416e710 con 0x7fe0b40ccb40 2023-10-06T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.572+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b416de00 con 0x7fe0b40ccb40 2023-10-06T02:57:55.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.573+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b40cb890 con 0x7fe0b40ccb40 2023-10-06T02:57:55.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.574+0000 7fe0a8ff9700 1 -- 172.21.15.81:0/3680797972 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0b0003040 con 0x7fe0b40ccb40 2023-10-06T02:57:55.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.574+0000 7fe0a8ff9700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0a0066f30 0x7fe0a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.574+0000 7fe0a8ff9700 1 -- 172.21.15.81:0/3680797972 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe0b0086340 con 0x7fe0b40ccb40 2023-10-06T02:57:55.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.574+0000 7fe0abfff700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0a0066f30 0x7fe0a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.575+0000 7fe0abfff700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0a0066f30 0x7fe0a00693e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40b6a30 tx=0x7fe0a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:55.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.578+0000 7fe0a8ff9700 1 -- 172.21.15.81:0/3680797972 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0b0053450 con 0x7fe0b40ccb40 2023-10-06T02:57:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.809+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0b40ceaa0 con 0x7fe0b40ccb40 2023-10-06T02:57:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.809+0000 7fe0a8ff9700 1 -- 172.21.15.81:0/3680797972 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fe0b0056a70 con 0x7fe0b40ccb40 2023-10-06T02:57:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:18.128298+0000","modified":"2023-10-06T02:57:21.769179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8358":{"gid":8358,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/604648999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":604648999},{"type":"v1","addr":"172.21.15.81:6835","nonce":604648999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T02:57:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0a0066f30 msgr2=0x7fe0a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0a0066f30 0x7fe0a00693e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40b6a30 tx=0x7fe0a4008040 comp rx=0 tx=0).stop 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b40ccb40 msgr2=0x7fe0b40c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b40ccb40 0x7fe0b40c9cb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe0b406fe10 tx=0x7fe0b0018000 comp rx=0 tx=0).stop 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 shutdown_connections 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fe0a0066f30 0x7fe0a00693e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0b4159f10 0x7fe0b416aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0b40ccb40 0x7fe0b40c9cb0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 --2- 172.21.15.81:0/3680797972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0b4159b40 0x7fe0b40ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 >> 172.21.15.81:0/3680797972 conn(0x7fe0b40cd660 msgr2=0x7fe0b406e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 shutdown_connections 2023-10-06T02:57:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.811+0000 7fe0b9b9e700 1 -- 172.21.15.81:0/3680797972 wait complete. 2023-10-06T02:57:55.814 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-06T02:57:55.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:55.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.936+0000 7fb0eb1ad700 1 Processor -- start 2023-10-06T02:57:55.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.936+0000 7fb0eb1ad700 1 -- start start 2023-10-06T02:57:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.937+0000 7fb0eb1ad700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb0e4068e90 0x7fb0e4164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.937+0000 7fb0eb1ad700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e40cee10 con 0x7fb0e4159f10 2023-10-06T02:57:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.937+0000 7fb0eb1ad700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e40cd040 con 0x7fb0e4159b40 2023-10-06T02:57:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.937+0000 7fb0eb1ad700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e40cd320 con 0x7fb0e4068e90 2023-10-06T02:57:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.937+0000 7fb0e99aa700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb0e4159f10 0x7fb0e4068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44172/0 (socket says 172.21.15.81:44172) 2023-10-06T02:57:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.937+0000 7fb0e99aa700 1 -- 172.21.15.81:0/2430515104 learned_addr learned my addr 172.21.15.81:0/2430515104 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.937+0000 7fb0ea9ac700 1 --2- 172.21.15.81:0/2430515104 >> v2:172.21.15.83:3300/0 conn(0x7fb0e4068e90 0x7fb0e4164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0e91a9700 1 -- 172.21.15.81:0/2430515104 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210850676 0 0) 0x7fb0e40cee10 con 0x7fb0e4159f10 2023-10-06T02:57:55.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0e91a9700 1 -- 172.21.15.81:0/2430515104 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d0003570 con 0x7fb0e4159f10 2023-10-06T02:57:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0ea9ac700 1 -- 172.21.15.81:0/2430515104 >> v1:172.21.15.83:6789/0 conn(0x7fb0e4159b40 legacy=0x7fb0e40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0ea9ac700 1 -- 172.21.15.81:0/2430515104 >> v1:172.21.15.81:6789/0 conn(0x7fb0e4159f10 legacy=0x7fb0e4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0e91a9700 1 -- 172.21.15.81:0/2430515104 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3911751405 0 0) 0x7fb0d0003570 con 0x7fb0e4159f10 2023-10-06T02:57:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0ea9ac700 1 -- 172.21.15.81:0/2430515104 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e40ce7c0 con 0x7fb0e4068e90 2023-10-06T02:57:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0ea9ac700 1 --2- 172.21.15.81:0/2430515104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0e4068e90 0x7fb0e4164c70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009e60 tx=0x7fb0dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e0eaf2433e5597 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0e91a9700 1 -- 172.21.15.81:0/2430515104 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc00e070 con 0x7fb0e4068e90 2023-10-06T02:57:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0e91a9700 1 -- 172.21.15.81:0/2430515104 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc00b850 con 0x7fb0e4068e90 2023-10-06T02:57:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.938+0000 7fb0e91a9700 1 -- 172.21.15.81:0/2430515104 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4001470 con 0x7fb0e4068e90 2023-10-06T02:57:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.939+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/2430515104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0e4068e90 msgr2=0x7fb0e4164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.939+0000 7fb0eb1ad700 1 --2- 172.21.15.81:0/2430515104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0e4068e90 0x7fb0e4164c70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009e60 tx=0x7fb0dc009780 comp rx=0 tx=0).stop 2023-10-06T02:57:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.939+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/2430515104 shutdown_connections 2023-10-06T02:57:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.939+0000 7fb0eb1ad700 1 --2- 172.21.15.81:0/2430515104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0e4068e90 0x7fb0e4164c70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.939+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/2430515104 >> 172.21.15.81:0/2430515104 conn(0x7fb0e40cd660 msgr2=0x7fb0e40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.939+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/2430515104 shutdown_connections 2023-10-06T02:57:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.939+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/2430515104 wait complete. 2023-10-06T02:57:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.940+0000 7fb0eb1ad700 1 Processor -- start 2023-10-06T02:57:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.940+0000 7fb0eb1ad700 1 -- start start 2023-10-06T02:57:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.940+0000 7fb0eb1ad700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0e4068e90 0x7fb0e40c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.940+0000 7fb0eb1ad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0e4159b40 0x7fb0e41575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.940+0000 7fb0eb1ad700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0e4159f10 0x7fb0e416daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0eb1ad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e415ab40 con 0x7fb0e4159b40 2023-10-06T02:57:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0eb1ad700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e416e5b0 con 0x7fb0e4068e90 2023-10-06T02:57:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0eb1ad700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e416e890 con 0x7fb0e4159f10 2023-10-06T02:57:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0e99aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0e4159b40 0x7fb0e41575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0e99aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0e4159b40 0x7fb0e41575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52058/0 (socket says 172.21.15.81:52058) 2023-10-06T02:57:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0e99aa700 1 -- 172.21.15.81:0/1458871941 learned_addr learned my addr 172.21.15.81:0/1458871941 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0ea1ab700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0e4068e90 0x7fb0e40c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0ea9ac700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0e4159f10 0x7fb0e416daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0e99aa700 1 -- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0e4159f10 msgr2=0x7fb0e416daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0e99aa700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0e4159f10 0x7fb0e416daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0e99aa700 1 -- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0e4068e90 msgr2=0x7fb0e40c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0e99aa700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0e4068e90 0x7fb0e40c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0e99aa700 1 -- 172.21.15.81:0/1458871941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc009a20 con 0x7fb0e4159b40 2023-10-06T02:57:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0ea9ac700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0e4159f10 0x7fb0e416daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0e99aa700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0e4159b40 0x7fb0e41575c0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400c7f0 tx=0x7fb0d4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:55.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0da7fc700 1 -- 172.21.15.81:0/1458871941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4007360 con 0x7fb0e4159b40 2023-10-06T02:57:55.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0da7fc700 1 -- 172.21.15.81:0/1458871941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d40074e0 con 0x7fb0e4159b40 2023-10-06T02:57:55.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e415ad90 con 0x7fb0e4159b40 2023-10-06T02:57:55.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0da7fc700 1 -- 172.21.15.81:0/1458871941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4004830 con 0x7fb0e4159b40 2023-10-06T02:57:55.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.941+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e415b120 con 0x7fb0e4159b40 2023-10-06T02:57:55.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.942+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e415af20 con 0x7fb0e4159b40 2023-10-06T02:57:55.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.943+0000 7fb0da7fc700 1 -- 172.21.15.81:0/1458871941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0d4004bc0 con 0x7fb0e4159b40 2023-10-06T02:57:55.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.943+0000 7fb0da7fc700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb0c8066f30 0x7fb0c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:55.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.943+0000 7fb0da7fc700 1 -- 172.21.15.81:0/1458871941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0d4083c90 con 0x7fb0e4159b40 2023-10-06T02:57:55.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.943+0000 7fb0ea1ab700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb0c8066f30 0x7fb0c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:55.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.944+0000 7fb0ea1ab700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb0c8066f30 0x7fb0c80693e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0003a80 tx=0x7fb0e0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:55.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:55.947+0000 7fb0da7fc700 1 -- 172.21.15.81:0/1458871941 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0d4050e20 con 0x7fb0e4159b40 2023-10-06T02:57:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.130+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0e4063e90 con 0x7fb0e4159b40 2023-10-06T02:57:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.131+0000 7fb0da7fc700 1 -- 172.21.15.81:0/1458871941 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+16841 (secure 0 0 0) 0x7fb0d4018020 con 0x7fb0e4159b40 2023-10-06T02:57:56.133 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:56.134 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":183,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:57:49.483101+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:15.791318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:17.104149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.133+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb0c8066f30 msgr2=0x7fb0c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.133+0000 7fb0eb1ad700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb0c8066f30 0x7fb0c80693e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0003a80 tx=0x7fb0e0007ec0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.133+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0e4159b40 msgr2=0x7fb0e41575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.133+0000 7fb0eb1ad700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0e4159b40 0x7fb0e41575c0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400c7f0 tx=0x7fb0d4001a00 comp rx=0 tx=0).stop 2023-10-06T02:57:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.133+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 shutdown_connections 2023-10-06T02:57:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.133+0000 7fb0eb1ad700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0e4159f10 0x7fb0e416daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.133+0000 7fb0eb1ad700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb0c8066f30 0x7fb0c80693e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.134+0000 7fb0eb1ad700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0e4068e90 0x7fb0e40c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.134+0000 7fb0eb1ad700 1 --2- 172.21.15.81:0/1458871941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0e4159b40 0x7fb0e41575c0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.134+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 >> 172.21.15.81:0/1458871941 conn(0x7fb0e40cd660 msgr2=0x7fb0e40c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.134+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 shutdown_connections 2023-10-06T02:57:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.134+0000 7fb0eb1ad700 1 -- 172.21.15.81:0/1458871941 wait complete. 2023-10-06T02:57:56.147 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:57:56.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:56.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.259+0000 7f5ce7115700 1 Processor -- start 2023-10-06T02:57:56.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.259+0000 7f5ce7115700 1 -- start start 2023-10-06T02:57:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5ce7115700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ce01578d0 0x7f5ce00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5ce7115700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5ce0157ca0 0x7f5ce015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5ce7115700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce00d07c0 con 0x7f5ce006d120 2023-10-06T02:57:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5ce7115700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce00cfbb0 con 0x7f5ce01578d0 2023-10-06T02:57:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5ce7115700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce00cfe90 con 0x7f5ce0157ca0 2023-10-06T02:57:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5ce4eb1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ce01578d0 0x7f5ce00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5ce4eb1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ce01578d0 0x7f5ce00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52064/0 (socket says 172.21.15.81:52064) 2023-10-06T02:57:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5ce4eb1700 1 -- 172.21.15.81:0/5795316 learned_addr learned my addr 172.21.15.81:0/5795316 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5cdffff700 1 --2- 172.21.15.81:0/5795316 >> v2:172.21.15.83:3300/0 conn(0x7f5ce0157ca0 0x7f5ce015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.260+0000 7f5ce4eb1700 1 -- 172.21.15.81:0/5795316 >> v2:172.21.15.83:3300/0 conn(0x7f5ce0157ca0 msgr2=0x7f5ce015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce4eb1700 1 --2- 172.21.15.81:0/5795316 >> v2:172.21.15.83:3300/0 conn(0x7f5ce0157ca0 0x7f5ce015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce4eb1700 1 -- 172.21.15.81:0/5795316 >> v1:172.21.15.83:6789/0 conn(0x7f5ce006d120 legacy=0x7f5ce006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce4eb1700 1 -- 172.21.15.81:0/5795316 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00d0170 con 0x7f5ce01578d0 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce4eb1700 1 --2- 172.21.15.81:0/5795316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce01578d0 0x7f5ce00cf4f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0068510 tx=0x7f5cd0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546fe072a832d5ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5cdf7fe700 1 -- 172.21.15.81:0/5795316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000e070 con 0x7f5ce01578d0 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5cdf7fe700 1 -- 172.21.15.81:0/5795316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd000ba10 con 0x7f5ce01578d0 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5cdf7fe700 1 -- 172.21.15.81:0/5795316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00092e0 con 0x7f5ce01578d0 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce7115700 1 -- 172.21.15.81:0/5795316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce01578d0 msgr2=0x7f5ce00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce7115700 1 --2- 172.21.15.81:0/5795316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce01578d0 0x7f5ce00cf4f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0068510 tx=0x7f5cd0009840 comp rx=0 tx=0).stop 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce7115700 1 -- 172.21.15.81:0/5795316 shutdown_connections 2023-10-06T02:57:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce7115700 1 --2- 172.21.15.81:0/5795316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce01578d0 0x7f5ce00cf4f0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce7115700 1 --2- 172.21.15.81:0/5795316 >> v2:172.21.15.83:3300/0 conn(0x7f5ce0157ca0 0x7f5ce015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce7115700 1 -- 172.21.15.81:0/5795316 >> 172.21.15.81:0/5795316 conn(0x7f5ce006bb90 msgr2=0x7f5ce006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce7115700 1 -- 172.21.15.81:0/5795316 shutdown_connections 2023-10-06T02:57:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.261+0000 7f5ce7115700 1 -- 172.21.15.81:0/5795316 wait complete. 2023-10-06T02:57:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.262+0000 7f5ce7115700 1 Processor -- start 2023-10-06T02:57:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.263+0000 7f5ce7115700 1 -- start start 2023-10-06T02:57:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.263+0000 7f5ce7115700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ce006d120 0x7f5ce00acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.263+0000 7f5ce7115700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ce01578d0 0x7f5ce0153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.263+0000 7f5ce7115700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce0157ca0 0x7f5ce016a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.263+0000 7f5ce7115700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00b57b0 con 0x7f5ce0157ca0 2023-10-06T02:57:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.263+0000 7f5ce7115700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00b4c10 con 0x7f5ce006d120 2023-10-06T02:57:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.263+0000 7f5ce7115700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00b4e80 con 0x7f5ce01578d0 2023-10-06T02:57:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.263+0000 7f5ce56b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce0157ca0 0x7f5ce016a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce56b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce0157ca0 0x7f5ce016a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52076/0 (socket says 172.21.15.81:52076) 2023-10-06T02:57:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce56b2700 1 -- 172.21.15.81:0/2366937990 learned_addr learned my addr 172.21.15.81:0/2366937990 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce4eb1700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ce006d120 0x7f5ce00acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5cdffff700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ce01578d0 0x7f5ce0153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce56b2700 1 -- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ce01578d0 msgr2=0x7f5ce0153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce56b2700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ce01578d0 0x7f5ce0153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce56b2700 1 -- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ce006d120 msgr2=0x7f5ce00acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce56b2700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ce006d120 0x7f5ce00acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce56b2700 1 -- 172.21.15.81:0/2366937990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0009ae0 con 0x7f5ce0157ca0 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce56b2700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce0157ca0 0x7f5ce016a780 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800c5e0 tx=0x7f5cd8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5cdcff9700 1 -- 172.21.15.81:0/2366937990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8011590 con 0x7f5ce0157ca0 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5cdcff9700 1 -- 172.21.15.81:0/2366937990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd80116f0 con 0x7f5ce0157ca0 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce00b5160 con 0x7f5ce0157ca0 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5cdcff9700 1 -- 172.21.15.81:0/2366937990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8011ab0 con 0x7f5ce0157ca0 2023-10-06T02:57:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.264+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce00ad100 con 0x7f5ce0157ca0 2023-10-06T02:57:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.265+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce00b2f10 con 0x7f5ce0157ca0 2023-10-06T02:57:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.266+0000 7f5cdcff9700 1 -- 172.21.15.81:0/2366937990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cd801c460 con 0x7f5ce0157ca0 2023-10-06T02:57:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.266+0000 7f5cdcff9700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5cc0066f30 0x7f5cc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.266+0000 7f5cdcff9700 1 -- 172.21.15.81:0/2366937990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5cd8084180 con 0x7f5ce0157ca0 2023-10-06T02:57:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.266+0000 7f5ce4eb1700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5cc0066f30 0x7f5cc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.267+0000 7f5ce4eb1700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5cc0066f30 0x7f5cc00693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009880 tx=0x7f5cd0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.270+0000 7f5cdcff9700 1 -- 172.21.15.81:0/2366937990 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cd8051290 con 0x7f5ce0157ca0 2023-10-06T02:57:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.494+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ce00d0450 con 0x7f5ce0157ca0 2023-10-06T02:57:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.494+0000 7f5cdcff9700 1 -- 172.21.15.81:0/2366937990 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f5cd80548b0 con 0x7f5ce0157ca0 2023-10-06T02:57:56.496 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:56.496 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:18.128298+0000","modified":"2023-10-06T02:57:21.769179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8358":{"gid":8358,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/604648999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":604648999},{"type":"v1","addr":"172.21.15.81:6835","nonce":604648999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T02:57:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5cc0066f30 msgr2=0x7f5cc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5cc0066f30 0x7f5cc00693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009880 tx=0x7f5cd0017000 comp rx=0 tx=0).stop 2023-10-06T02:57:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce0157ca0 msgr2=0x7f5ce016a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce0157ca0 0x7f5ce016a780 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800c5e0 tx=0x7f5cd8007f60 comp rx=0 tx=0).stop 2023-10-06T02:57:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 shutdown_connections 2023-10-06T02:57:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce0157ca0 0x7f5ce016a780 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5cc0066f30 0x7f5cc00693e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ce006d120 0x7f5ce00acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 --2- 172.21.15.81:0/2366937990 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ce01578d0 0x7f5ce0153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 >> 172.21.15.81:0/2366937990 conn(0x7f5ce006bb90 msgr2=0x7f5ce006d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 shutdown_connections 2023-10-06T02:57:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.496+0000 7f5ce7115700 1 -- 172.21.15.81:0/2366937990 wait complete. 2023-10-06T02:57:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-06T02:57:56.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.623+0000 7ffbea0eb700 1 Processor -- start 2023-10-06T02:57:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.623+0000 7ffbea0eb700 1 -- start start 2023-10-06T02:57:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.623+0000 7ffbea0eb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffbe406d830 0x7ffbe40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.623+0000 7ffbea0eb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40d07c0 con 0x7ffbe4157ca0 2023-10-06T02:57:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.623+0000 7ffbea0eb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40cfbb0 con 0x7ffbe41578d0 2023-10-06T02:57:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.623+0000 7ffbea0eb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40cfe90 con 0x7ffbe406d830 2023-10-06T02:57:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffbe406d830 0x7ffbe40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffbe4157ca0 0x7ffbe406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44184/0 (socket says 172.21.15.81:44184) 2023-10-06T02:57:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe2ffd700 1 -- 172.21.15.81:0/3716948766 learned_addr learned my addr 172.21.15.81:0/3716948766 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe3fff700 1 -- 172.21.15.81:0/3716948766 >> v1:172.21.15.83:6789/0 conn(0x7ffbe41578d0 legacy=0x7ffbe415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe3fff700 1 -- 172.21.15.81:0/3716948766 >> v1:172.21.15.81:6789/0 conn(0x7ffbe4157ca0 legacy=0x7ffbe406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe3fff700 1 -- 172.21.15.81:0/3716948766 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40d0170 con 0x7ffbe406d830 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe27fc700 1 -- 172.21.15.81:0/3716948766 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478017999 0 0) 0x7ffbe40d07c0 con 0x7ffbe4157ca0 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe3fff700 1 --2- 172.21.15.81:0/3716948766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 0x7ffbe40cf4f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009e60 tx=0x7ffbdc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af47aa3056e9212 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe27fc700 1 -- 172.21.15.81:0/3716948766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00e070 con 0x7ffbe406d830 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe27fc700 1 -- 172.21.15.81:0/3716948766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc00bc30 con 0x7ffbe406d830 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.624+0000 7ffbe27fc700 1 -- 172.21.15.81:0/3716948766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc012430 con 0x7ffbe406d830 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.625+0000 7ffbea0eb700 1 -- 172.21.15.81:0/3716948766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 msgr2=0x7ffbe40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.625+0000 7ffbea0eb700 1 --2- 172.21.15.81:0/3716948766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 0x7ffbe40cf4f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009e60 tx=0x7ffbdc009780 comp rx=0 tx=0).stop 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.625+0000 7ffbea0eb700 1 -- 172.21.15.81:0/3716948766 shutdown_connections 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.625+0000 7ffbea0eb700 1 --2- 172.21.15.81:0/3716948766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 0x7ffbe40cf4f0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.625+0000 7ffbea0eb700 1 -- 172.21.15.81:0/3716948766 >> 172.21.15.81:0/3716948766 conn(0x7ffbe406bb90 msgr2=0x7ffbe406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.625+0000 7ffbea0eb700 1 -- 172.21.15.81:0/3716948766 shutdown_connections 2023-10-06T02:57:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.625+0000 7ffbea0eb700 1 -- 172.21.15.81:0/3716948766 wait complete. 2023-10-06T02:57:56.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.626+0000 7ffbea0eb700 1 Processor -- start 2023-10-06T02:57:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.626+0000 7ffbea0eb700 1 -- start start 2023-10-06T02:57:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbea0eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 0x7ffbe4154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbea0eb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbe41578d0 0x7ffbe40b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbea0eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbe4157ca0 0x7ffbe40b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbea0eb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4154fa0 con 0x7ffbe406d830 2023-10-06T02:57:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbea0eb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe415ea20 con 0x7ffbe41578d0 2023-10-06T02:57:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbea0eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40b60f0 con 0x7ffbe4157ca0 2023-10-06T02:57:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 0x7ffbe4154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 0x7ffbe4154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52092/0 (socket says 172.21.15.81:52092) 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe37fe700 1 -- 172.21.15.81:0/4066131178 learned_addr learned my addr 172.21.15.81:0/4066131178 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe37fe700 1 -- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbe4157ca0 msgr2=0x7ffbe40b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe37fe700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbe4157ca0 0x7ffbe40b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe2ffd700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbe41578d0 0x7ffbe40b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe37fe700 1 -- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbe41578d0 msgr2=0x7ffbe40b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe37fe700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbe41578d0 0x7ffbe40b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe37fe700 1 -- 172.21.15.81:0/4066131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc009a20 con 0x7ffbe406d830 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbe37fe700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 0x7ffbe4154a60 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c590 tx=0x7ffbcc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbdb7fe700 1 -- 172.21.15.81:0/4066131178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc011590 con 0x7ffbe406d830 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbdb7fe700 1 -- 172.21.15.81:0/4066131178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0116f0 con 0x7ffbe406d830 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe40b63d0 con 0x7ffbe406d830 2023-10-06T02:57:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbdb7fe700 1 -- 172.21.15.81:0/4066131178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc011ab0 con 0x7ffbe406d830 2023-10-06T02:57:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.627+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe40b6990 con 0x7ffbe406d830 2023-10-06T02:57:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.628+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe4067ac0 con 0x7ffbe406d830 2023-10-06T02:57:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.629+0000 7ffbdb7fe700 1 -- 172.21.15.81:0/4066131178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbcc01b3b0 con 0x7ffbe406d830 2023-10-06T02:57:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.629+0000 7ffbdb7fe700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffbc4066f30 0x7ffbc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.629+0000 7ffbdb7fe700 1 -- 172.21.15.81:0/4066131178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffbcc083c40 con 0x7ffbe406d830 2023-10-06T02:57:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.629+0000 7ffbe2ffd700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffbc4066f30 0x7ffbc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.630+0000 7ffbe2ffd700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffbc4066f30 0x7ffbc40693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffbe415f0e0 tx=0x7ffbd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:56.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.633+0000 7ffbdb7fe700 1 -- 172.21.15.81:0/4066131178 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbcc050d50 con 0x7ffbe406d830 2023-10-06T02:57:56.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.858+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbe40d0450 con 0x7ffbe406d830 2023-10-06T02:57:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.859+0000 7ffbdb7fe700 1 -- 172.21.15.81:0/4066131178 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4598 (secure 0 0 0) 0x7ffbcc017070 con 0x7ffbe406d830 2023-10-06T02:57:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:56.860 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:18.128298+0000","modified":"2023-10-06T02:57:21.769179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8358},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8358":{"gid":8358,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/604648999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":604648999},{"type":"v1","addr":"172.21.15.81:6835","nonce":604648999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T02:57:56.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffbc4066f30 msgr2=0x7ffbc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffbc4066f30 0x7ffbc40693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffbe415f0e0 tx=0x7ffbd4009040 comp rx=0 tx=0).stop 2023-10-06T02:57:56.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 msgr2=0x7ffbe4154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 0x7ffbe4154a60 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c590 tx=0x7ffbcc00c950 comp rx=0 tx=0).stop 2023-10-06T02:57:56.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 shutdown_connections 2023-10-06T02:57:56.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffbe4157ca0 0x7ffbe40b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe406d830 0x7ffbe4154a60 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7ffbc4066f30 0x7ffbc40693e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 --2- 172.21.15.81:0/4066131178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbe41578d0 0x7ffbe40b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 >> 172.21.15.81:0/4066131178 conn(0x7ffbe406bb90 msgr2=0x7ffbe41567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:56.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 shutdown_connections 2023-10-06T02:57:56.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.861+0000 7ffbea0eb700 1 -- 172.21.15.81:0/4066131178 wait complete. 2023-10-06T02:57:56.863 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-06T02:57:56.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:56.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.985+0000 7f29091ba700 1 Processor -- start 2023-10-06T02:57:56.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.985+0000 7f29091ba700 1 -- start start 2023-10-06T02:57:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f29091ba700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2904159f10 0x7f2904068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f29091ba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2904068cc0 0x7f29040cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f29091ba700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29040cee10 con 0x7f2904159b40 2023-10-06T02:57:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f29091ba700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2904069140 con 0x7f2904159f10 2023-10-06T02:57:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f29091ba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29040cd040 con 0x7f2904068cc0 2023-10-06T02:57:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f2903fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2904159b40 0x7f29040cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44186/0 (socket says 172.21.15.81:44186) 2023-10-06T02:57:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f2903fff700 1 -- 172.21.15.81:0/1639174502 learned_addr learned my addr 172.21.15.81:0/1639174502 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903319221 0 0) 0x7f29040cee10 con 0x7f2904159b40 2023-10-06T02:57:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28ec003570 con 0x7f2904159b40 2023-10-06T02:57:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f29037fe700 1 --2- 172.21.15.81:0/1639174502 >> v2:172.21.15.83:3300/0 conn(0x7f2904159f10 0x7f2904068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.986+0000 7f29089b9700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2904068cc0 0x7f29040cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 17351601 0 0) 0x7f28ec003570 con 0x7f2904159b40 2023-10-06T02:57:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2904068cc0 msgr2=0x7f29040cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2904068cc0 0x7f29040cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 >> v2:172.21.15.83:3300/0 conn(0x7f2904159f10 msgr2=0x7f2904068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 --2- 172.21.15.81:0/1639174502 >> v2:172.21.15.83:3300/0 conn(0x7f2904159f10 0x7f2904068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29040cd320 con 0x7f2904159b40 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f28f4001470 con 0x7f2904159b40 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 >> v1:172.21.15.81:6789/0 conn(0x7f2904159b40 legacy=0x7f29040cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec003a60 0x7f28ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2904068cc0 0x7f28ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28ec004d50 0x7f28ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904069140 con 0x7f28ec003a60 2023-10-06T02:57:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29040cd040 con 0x7f28ec004d50 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec00ba60 con 0x7f2904068cc0 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2903fff700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec003a60 0x7f28ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f29037fe700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2904068cc0 0x7f28ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f29089b9700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28ec004d50 0x7f28ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2903fff700 1 -- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2904068cc0 msgr2=0x7f28ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2903fff700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2904068cc0 0x7f28ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2903fff700 1 -- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28ec004d50 msgr2=0x7f28ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2903fff700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28ec004d50 0x7f28ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2903fff700 1 -- 172.21.15.81:0/1639174502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec003570 con 0x7f28ec003a60 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2903fff700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec003a60 0x7f28ec003e70 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f28f400c3c0 tx=0x7f28f4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdff3f1f0952224 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400cc30 con 0x7f28ec003a60 2023-10-06T02:57:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f400cdb0 con 0x7f28ec003a60 2023-10-06T02:57:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.987+0000 7f2902ffd700 1 -- 172.21.15.81:0/1639174502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4005b70 con 0x7f28ec003a60 2023-10-06T02:57:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.988+0000 7f29091ba700 1 -- 172.21.15.81:0/1639174502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec003a60 msgr2=0x7f28ec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.988+0000 7f29091ba700 1 --2- 172.21.15.81:0/1639174502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec003a60 0x7f28ec003e70 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f28f400c3c0 tx=0x7f28f4001e90 comp rx=0 tx=0).stop 2023-10-06T02:57:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.988+0000 7f29089b9700 1 -- 172.21.15.81:0/1639174502 reap_dead start 2023-10-06T02:57:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.988+0000 7f29091ba700 1 -- 172.21.15.81:0/1639174502 shutdown_connections 2023-10-06T02:57:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.988+0000 7f29091ba700 1 -- 172.21.15.81:0/1639174502 >> 172.21.15.81:0/1639174502 conn(0x7f29040cd660 msgr2=0x7f29040cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:56.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.988+0000 7f29091ba700 1 -- 172.21.15.81:0/1639174502 shutdown_connections 2023-10-06T02:57:56.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.988+0000 7f29091ba700 1 -- 172.21.15.81:0/1639174502 wait complete. 2023-10-06T02:57:56.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.989+0000 7f29091ba700 1 Processor -- start 2023-10-06T02:57:56.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.989+0000 7f29091ba700 1 -- start start 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29091ba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28ec003a60 0x7f29041445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29091ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f290415afc0 0x7f29040cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29091ba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29040cbfe0 0x7f290416a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29091ba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290416b1a0 con 0x7f290415afc0 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29091ba700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29040cc450 con 0x7f28ec003a60 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29091ba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290416aec0 con 0x7f29040cbfe0 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f290415afc0 0x7f29040cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f290415afc0 0x7f29040cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52114/0 (socket says 172.21.15.81:52114) 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29037fe700 1 -- 172.21.15.81:0/968036603 learned_addr learned my addr 172.21.15.81:0/968036603 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29089b9700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29040cbfe0 0x7f290416a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f2903fff700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28ec003a60 0x7f29041445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29037fe700 1 -- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29040cbfe0 msgr2=0x7f290416a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29037fe700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29040cbfe0 0x7f290416a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29037fe700 1 -- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28ec003a60 msgr2=0x7f29041445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29037fe700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28ec003a60 0x7f29041445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29037fe700 1 -- 172.21.15.81:0/968036603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290415a4e0 con 0x7f290415afc0 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.990+0000 7f29037fe700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f290415afc0 0x7f29040cbaa0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f28f8011cc0 tx=0x7f28f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.991+0000 7f28ebfff700 1 -- 172.21.15.81:0/968036603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800fac0 con 0x7f290415afc0 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.991+0000 7f28ebfff700 1 -- 172.21.15.81:0/968036603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800fc20 con 0x7f290415afc0 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.991+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290415a7c0 con 0x7f290415afc0 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.991+0000 7f28ebfff700 1 -- 172.21.15.81:0/968036603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8014440 con 0x7f290415afc0 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.991+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2904144b20 con 0x7f290415afc0 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.992+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290415a320 con 0x7f290415afc0 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.992+0000 7f28ebfff700 1 -- 172.21.15.81:0/968036603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28f8014870 con 0x7f290415afc0 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.992+0000 7f28ebfff700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f28f0066f30 0x7f28f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.992+0000 7f28ebfff700 1 -- 172.21.15.81:0/968036603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f28f8018030 con 0x7f290415afc0 2023-10-06T02:57:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.993+0000 7f2903fff700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f28f0066f30 0x7f28f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.993+0000 7f2903fff700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f28f0066f30 0x7f28f00693e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f28f4001ed0 tx=0x7f28f4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:56.997+0000 7f28ebfff700 1 -- 172.21.15.81:0/968036603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28f80521c0 con 0x7f290415afc0 2023-10-06T02:57:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.181+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29040cb890 con 0x7f290415afc0 2023-10-06T02:57:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.182+0000 7f28ebfff700 1 -- 172.21.15.81:0/968036603 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+16841 (secure 0 0 0) 0x7f28f80557e0 con 0x7f290415afc0 2023-10-06T02:57:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:57:57.183 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":183,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:57:49.483101+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:15.791318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:17.104149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f28f0066f30 msgr2=0x7f28f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f28f0066f30 0x7f28f00693e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f28f4001ed0 tx=0x7f28f4015000 comp rx=0 tx=0).stop 2023-10-06T02:57:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f290415afc0 msgr2=0x7f29040cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f290415afc0 0x7f29040cbaa0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f28f8011cc0 tx=0x7f28f80091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 shutdown_connections 2023-10-06T02:57:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29040cbfe0 0x7f290416a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f28f0066f30 0x7f28f00693e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28ec003a60 0x7f29041445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 --2- 172.21.15.81:0/968036603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f290415afc0 0x7f29040cbaa0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 >> 172.21.15.81:0/968036603 conn(0x7f29040cd660 msgr2=0x7f290406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 shutdown_connections 2023-10-06T02:57:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.184+0000 7f29091ba700 1 -- 172.21.15.81:0/968036603 wait complete. 2023-10-06T02:57:57.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:57:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.311+0000 7f5d4771d700 1 Processor -- start 2023-10-06T02:57:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.311+0000 7f5d4771d700 1 -- start start 2023-10-06T02:57:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.312+0000 7f5d4771d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d400b3230 0x7f5d400d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.312+0000 7f5d4771d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5d4015a110 0x7f5d400ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.312+0000 7f5d4771d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d400ce290 con 0x7f5d40159d40 2023-10-06T02:57:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.312+0000 7f5d4771d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d400cda30 con 0x7f5d4015a110 2023-10-06T02:57:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.312+0000 7f5d4771d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400cdcd0 con 0x7f5d400b3230 2023-10-06T02:57:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.312+0000 7f5d44cb8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d400b3230 0x7f5d400d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.312+0000 7f5d45cba700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5d4015a110 0x7f5d400ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.312+0000 7f5d454b9700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5d40159d40 0x7f5d400b2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:38128/0 (socket says 172.21.15.81:38128) 2023-10-06T02:57:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.312+0000 7f5d454b9700 1 -- 172.21.15.81:0/793538418 learned_addr learned my addr 172.21.15.81:0/793538418 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d44cb8700 1 -- 172.21.15.81:0/793538418 >> v2:172.21.15.83:3300/0 conn(0x7f5d4015a110 msgr2=0x7f5d400ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d44cb8700 1 --2- 172.21.15.81:0/793538418 >> v2:172.21.15.83:3300/0 conn(0x7f5d4015a110 0x7f5d400ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d44cb8700 1 -- 172.21.15.81:0/793538418 >> v1:172.21.15.83:6789/0 conn(0x7f5d40159d40 legacy=0x7f5d400b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d44cb8700 1 -- 172.21.15.81:0/793538418 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400cdfb0 con 0x7f5d400b3230 2023-10-06T02:57:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d3ffff700 1 -- 172.21.15.81:0/793538418 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130199529 0 0) 0x7f5d400ce290 con 0x7f5d40159d40 2023-10-06T02:57:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d45cba700 1 --2- 172.21.15.81:0/793538418 >> v2:172.21.15.83:3300/0 conn(0x7f5d4015a110 0x7f5d400ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d44cb8700 1 --2- 172.21.15.81:0/793538418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d400b3230 0x7f5d400d06d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d340098e0 tx=0x7f5d340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b290bd47aecdf17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d3ffff700 1 -- 172.21.15.81:0/793538418 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400b640 con 0x7f5d400b3230 2023-10-06T02:57:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d3ffff700 1 -- 172.21.15.81:0/793538418 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3400b7a0 con 0x7f5d400b3230 2023-10-06T02:57:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d3ffff700 1 -- 172.21.15.81:0/793538418 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400bb40 con 0x7f5d400b3230 2023-10-06T02:57:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d4771d700 1 -- 172.21.15.81:0/793538418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d400b3230 msgr2=0x7f5d400d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d4771d700 1 --2- 172.21.15.81:0/793538418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d400b3230 0x7f5d400d06d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d340098e0 tx=0x7f5d340091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d4771d700 1 -- 172.21.15.81:0/793538418 shutdown_connections 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d4771d700 1 --2- 172.21.15.81:0/793538418 >> v2:172.21.15.83:3300/0 conn(0x7f5d4015a110 0x7f5d400ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d4771d700 1 --2- 172.21.15.81:0/793538418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d400b3230 0x7f5d400d06d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.313+0000 7f5d4771d700 1 -- 172.21.15.81:0/793538418 >> 172.21.15.81:0/793538418 conn(0x7f5d4006bb90 msgr2=0x7f5d4006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.314+0000 7f5d4771d700 1 -- 172.21.15.81:0/793538418 shutdown_connections 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.314+0000 7f5d4771d700 1 -- 172.21.15.81:0/793538418 wait complete. 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.315+0000 7f5d4771d700 1 Processor -- start 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.315+0000 7f5d4771d700 1 -- start start 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.315+0000 7f5d4771d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b3230 0x7f5d4016dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.315+0000 7f5d4771d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d40159d40 0x7f5d4014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.315+0000 7f5d4771d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4015a110 0x7f5d400d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.315+0000 7f5d4771d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4014bc90 con 0x7f5d400b3230 2023-10-06T02:57:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.315+0000 7f5d4771d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400cf4c0 con 0x7f5d4015a110 2023-10-06T02:57:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.315+0000 7f5d4771d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4016e400 con 0x7f5d40159d40 2023-10-06T02:57:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d454b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b3230 0x7f5d4016dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d454b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b3230 0x7f5d4016dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52116/0 (socket says 172.21.15.81:52116) 2023-10-06T02:57:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d454b9700 1 -- 172.21.15.81:0/2591108804 learned_addr learned my addr 172.21.15.81:0/2591108804 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d45cba700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4015a110 0x7f5d400d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d44cb8700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d40159d40 0x7f5d4014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d454b9700 1 -- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d40159d40 msgr2=0x7f5d4014a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d454b9700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d40159d40 0x7f5d4014a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d454b9700 1 -- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4015a110 msgr2=0x7f5d400d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d454b9700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4015a110 0x7f5d400d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d454b9700 1 -- 172.21.15.81:0/2591108804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38009420 con 0x7f5d400b3230 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d454b9700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b3230 0x7f5d4016dd90 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000cd80 tx=0x7f5d30001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d3d7fa700 1 -- 172.21.15.81:0/2591108804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000aa60 con 0x7f5d400b3230 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d3d7fa700 1 -- 172.21.15.81:0/2591108804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000abc0 con 0x7f5d400b3230 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d3d7fa700 1 -- 172.21.15.81:0/2591108804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300070f0 con 0x7f5d400b3230 2023-10-06T02:57:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d34009420 con 0x7f5d400b3230 2023-10-06T02:57:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.316+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4016e9c0 con 0x7f5d400b3230 2023-10-06T02:57:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.317+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d40067d30 con 0x7f5d400b3230 2023-10-06T02:57:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.318+0000 7f5d3d7fa700 1 -- 172.21.15.81:0/2591108804 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d300074e0 con 0x7f5d400b3230 2023-10-06T02:57:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.318+0000 7f5d3d7fa700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.318+0000 7f5d3d7fa700 1 -- 172.21.15.81:0/2591108804 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d300849c0 con 0x7f5d400b3230 2023-10-06T02:57:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.318+0000 7f5d44cb8700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.318+0000 7f5d44cb8700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5d340093f0 tx=0x7f5d34017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.322+0000 7f5d3d7fa700 1 -- 172.21.15.81:0/2591108804 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d30051b50 con 0x7f5d400b3230 2023-10-06T02:57:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.543+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5d400cb900 con 0x7f5d400b3230 2023-10-06T02:57:57.544 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T02:57:57.544+0000 7f12cb27b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:57:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.552+0000 7f5d3d7fa700 1 -- 172.21.15.81:0/2591108804 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v91) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5d30055170 con 0x7f5d400b3230 2023-10-06T02:57:57.553 INFO:tasks.ceph.mds.c.smithi081.stderr: -7720> 2023-10-06T02:57:23.058+0000 7f7d448d5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:57:57.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 msgr2=0x7f5d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5d340093f0 tx=0x7f5d34017000 comp rx=0 tx=0).stop 2023-10-06T02:57:57.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b3230 msgr2=0x7f5d4016dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b3230 0x7f5d4016dd90 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000cd80 tx=0x7f5d30001ae0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 shutdown_connections 2023-10-06T02:57:57.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5d2c066f30 0x7f5d2c0693e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5d4015a110 0x7f5d400d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b3230 0x7f5d4016dd90 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 --2- 172.21.15.81:0/2591108804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5d40159d40 0x7f5d4014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 >> 172.21.15.81:0/2591108804 conn(0x7f5d4006bb90 msgr2=0x7f5d4006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:57.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 shutdown_connections 2023-10-06T02:57:57.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.554+0000 7f5d4771d700 1 -- 172.21.15.81:0/2591108804 wait complete. 2023-10-06T02:57:57.557 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:57:57.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:57:57.582 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T02:57:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.684+0000 7f8701632700 1 Processor -- start 2023-10-06T02:57:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.684+0000 7f8701632700 1 -- start start 2023-10-06T02:57:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.685+0000 7f8701632700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86fc0b43c0 0x7f86fc0cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.685+0000 7f8701632700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0cddd0 0x7f86fc0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.685+0000 7f8701632700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f86fc0cd030 0x7f86fc15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.685+0000 7f8701632700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86fc0cadb0 con 0x7f86fc0b43c0 2023-10-06T02:57:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.685+0000 7f8701632700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86fc0cf000 con 0x7f86fc0cd030 2023-10-06T02:57:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.685+0000 7f8701632700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0cf2e0 con 0x7f86fc0cddd0 2023-10-06T02:57:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.685+0000 7f86fbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86fc0b43c0 0x7f86fc0cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.685+0000 7f86fbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86fc0b43c0 0x7f86fc0cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52144/0 (socket says 172.21.15.81:52144) 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.685+0000 7f86fbfff700 1 -- 172.21.15.81:0/219569470 learned_addr learned my addr 172.21.15.81:0/219569470 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f8700e31700 1 --2- 172.21.15.81:0/219569470 >> v2:172.21.15.83:3300/0 conn(0x7f86fc0cd030 0x7f86fc15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86fb7fe700 1 --2- 172.21.15.81:0/219569470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0cddd0 0x7f86fc0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86fbfff700 1 -- 172.21.15.81:0/219569470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0cddd0 msgr2=0x7f86fc0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86fbfff700 1 --2- 172.21.15.81:0/219569470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0cddd0 0x7f86fc0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86fbfff700 1 -- 172.21.15.81:0/219569470 >> v2:172.21.15.83:3300/0 conn(0x7f86fc0cd030 msgr2=0x7f86fc15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86fbfff700 1 --2- 172.21.15.81:0/219569470 >> v2:172.21.15.83:3300/0 conn(0x7f86fc0cd030 0x7f86fc15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86fbfff700 1 -- 172.21.15.81:0/219569470 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0ca760 con 0x7f86fc0b43c0 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f8700e31700 1 --2- 172.21.15.81:0/219569470 >> v2:172.21.15.83:3300/0 conn(0x7f86fc0cd030 0x7f86fc15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86fbfff700 1 --2- 172.21.15.81:0/219569470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0b43c0 0x7f86fc0cc5b0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f86fc06a440 tx=0x7f86ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af32bb741a994c6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86faffd700 1 -- 172.21.15.81:0/219569470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00b860 con 0x7f86fc0b43c0 2023-10-06T02:57:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86faffd700 1 -- 172.21.15.81:0/219569470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec00b9c0 con 0x7f86fc0b43c0 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f86faffd700 1 -- 172.21.15.81:0/219569470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00bd60 con 0x7f86fc0b43c0 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f8701632700 1 -- 172.21.15.81:0/219569470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0b43c0 msgr2=0x7f86fc0cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f8701632700 1 --2- 172.21.15.81:0/219569470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0b43c0 0x7f86fc0cc5b0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f86fc06a440 tx=0x7f86ec009250 comp rx=0 tx=0).stop 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f8701632700 1 -- 172.21.15.81:0/219569470 shutdown_connections 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f8701632700 1 --2- 172.21.15.81:0/219569470 >> v2:172.21.15.83:3300/0 conn(0x7f86fc0cd030 0x7f86fc15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f8701632700 1 --2- 172.21.15.81:0/219569470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0b43c0 0x7f86fc0cc5b0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f8701632700 1 --2- 172.21.15.81:0/219569470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0cddd0 0x7f86fc0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.686+0000 7f8701632700 1 -- 172.21.15.81:0/219569470 >> 172.21.15.81:0/219569470 conn(0x7f86fc068110 msgr2=0x7f86fc06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.687+0000 7f8701632700 1 -- 172.21.15.81:0/219569470 shutdown_connections 2023-10-06T02:57:57.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.687+0000 7f8701632700 1 -- 172.21.15.81:0/219569470 wait complete. 2023-10-06T02:57:57.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.688+0000 7f8701632700 1 Processor -- start 2023-10-06T02:57:57.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.688+0000 7f8701632700 1 -- start start 2023-10-06T02:57:57.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.688+0000 7f8701632700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0b43c0 0x7f86fc146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.688+0000 7f8701632700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86fc0cd030 0x7f86fc0c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.688+0000 7f8701632700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0cddd0 0x7f86fc15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.688+0000 7f8701632700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0c7470 con 0x7f86fc0cddd0 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.688+0000 7f8701632700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc1586b0 con 0x7f86fc0cd030 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.688+0000 7f8701632700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0c6eb0 con 0x7f86fc0b43c0 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8700e31700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0cddd0 0x7f86fc15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8700e31700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0cddd0 0x7f86fc15a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52156/0 (socket says 172.21.15.81:52156) 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8700e31700 1 -- 172.21.15.81:0/2889473764 learned_addr learned my addr 172.21.15.81:0/2889473764 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f86fbfff700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0b43c0 0x7f86fc146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f86fb7fe700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86fc0cd030 0x7f86fc0c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8700e31700 1 -- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0b43c0 msgr2=0x7f86fc146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8700e31700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0b43c0 0x7f86fc146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8700e31700 1 -- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86fc0cd030 msgr2=0x7f86fc0c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8700e31700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86fc0cd030 0x7f86fc0c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8700e31700 1 -- 172.21.15.81:0/2889473764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0094f0 con 0x7f86fc0cddd0 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8700e31700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0cddd0 0x7f86fc15a570 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f86f400a380 tx=0x7f86f4007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f86e3fff700 1 -- 172.21.15.81:0/2889473764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4015440 con 0x7f86fc0cddd0 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f86e3fff700 1 -- 172.21.15.81:0/2889473764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f40155a0 con 0x7f86fc0cddd0 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc0c7190 con 0x7f86fc0cddd0 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f86e3fff700 1 -- 172.21.15.81:0/2889473764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4015960 con 0x7f86fc0cddd0 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.689+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc146890 con 0x7f86fc0cddd0 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.690+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc069c00 con 0x7f86fc0cddd0 2023-10-06T02:57:57.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.690+0000 7f86e3fff700 1 -- 172.21.15.81:0/2889473764 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86f400d440 con 0x7f86fc0cddd0 2023-10-06T02:57:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.691+0000 7f86e3fff700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f86e8066f30 0x7f86e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.691+0000 7f86e3fff700 1 -- 172.21.15.81:0/2889473764 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f86f4085180 con 0x7f86fc0cddd0 2023-10-06T02:57:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.691+0000 7f86fbfff700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f86e8066f30 0x7f86e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.692+0000 7f86fbfff700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f86e8066f30 0x7f86e80693e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f86fc06a440 tx=0x7f86ec017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:57.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.695+0000 7f86e3fff700 1 -- 172.21.15.81:0/2889473764 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86f4052240 con 0x7f86fc0cddd0 2023-10-06T02:57:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:57.924+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f86fc071b10 con 0x7f86fc0cddd0 2023-10-06T02:57:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.553+0000 7f86e3fff700 1 -- 172.21.15.81:0/2889473764 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v92) v1 ==== 104+0+0 (secure 0 0 0) 0x7f86f4055860 con 0x7f86fc0cddd0 2023-10-06T02:57:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.555+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f86e8066f30 msgr2=0x7f86e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.555+0000 7f8701632700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f86e8066f30 0x7f86e80693e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f86fc06a440 tx=0x7f86ec017000 comp rx=0 tx=0).stop 2023-10-06T02:57:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.555+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0cddd0 msgr2=0x7f86fc15a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.555+0000 7f8701632700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0cddd0 0x7f86fc15a570 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f86f400a380 tx=0x7f86f4007900 comp rx=0 tx=0).stop 2023-10-06T02:57:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.556+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 shutdown_connections 2023-10-06T02:57:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.556+0000 7f8701632700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86fc0cddd0 0x7f86fc15a570 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.556+0000 7f8701632700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86fc0b43c0 0x7f86fc146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.556+0000 7f8701632700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f86e8066f30 0x7f86e80693e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.556+0000 7f8701632700 1 --2- 172.21.15.81:0/2889473764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86fc0cd030 0x7f86fc0c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.556+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 >> 172.21.15.81:0/2889473764 conn(0x7f86fc068110 msgr2=0x7f86fc155dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.556+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 shutdown_connections 2023-10-06T02:57:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.556+0000 7f8701632700 1 -- 172.21.15.81:0/2889473764 wait complete. 2023-10-06T02:57:58.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:57:58.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.730+0000 7fce2f16c700 1 Processor -- start 2023-10-06T02:57:58.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.730+0000 7fce2f16c700 1 -- start start 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce2f16c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28156420 0x7fce280cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce2f16c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fce280cc250 0x7fce28069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce2f16c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce280cb880 con 0x7fce28069980 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce2f16c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2806aa10 con 0x7fce280cc250 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce2f16c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280cac70 con 0x7fce28156420 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce2d709700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fce28069980 0x7fce280c71d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44196/0 (socket says 172.21.15.81:44196) 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce2d709700 1 -- 172.21.15.81:0/4005579489 learned_addr learned my addr 172.21.15.81:0/4005579489 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421059575 0 0) 0x7fce280cb880 con 0x7fce28069980 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce27fff700 1 --2- 172.21.15.81:0/4005579489 >> v2:172.21.15.83:3300/0 conn(0x7fce280cc250 0x7fce28069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce18003570 con 0x7fce28069980 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce2cf08700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28156420 0x7fce280cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2830212514 0 0) 0x7fce18003570 con 0x7fce28069980 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28156420 msgr2=0x7fce280cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28156420 0x7fce280cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 >> v2:172.21.15.83:3300/0 conn(0x7fce280cc250 msgr2=0x7fce28069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 --2- 172.21.15.81:0/4005579489 >> v2:172.21.15.83:3300/0 conn(0x7fce280cc250 0x7fce28069440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280caf50 con 0x7fce28069980 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fce200017f0 con 0x7fce28069980 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 >> v1:172.21.15.81:6789/0 conn(0x7fce28069980 legacy=0x7fce280c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce18003a60 0x7fce18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28156420 0x7fce18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce18004d50 0x7fce180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2806aa10 con 0x7fce18004d50 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280cac70 con 0x7fce18003a60 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.731+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1800ba60 con 0x7fce28156420 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce2d709700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce18004d50 0x7fce180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce27fff700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28156420 0x7fce18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce2cf08700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce18003a60 0x7fce18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce2d709700 1 -- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28156420 msgr2=0x7fce18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce2d709700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28156420 0x7fce18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce2d709700 1 -- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce18003a60 msgr2=0x7fce18003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce2d709700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce18003a60 0x7fce18003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce2d709700 1 -- 172.21.15.81:0/4005579489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18003570 con 0x7fce18004d50 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce2d709700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce18004d50 0x7fce180051c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fce2000a970 tx=0x7fce20002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45de8f9915fba69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20012440 con 0x7fce18004d50 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce200125c0 con 0x7fce18004d50 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.732+0000 7fce277fe700 1 -- 172.21.15.81:0/4005579489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20012980 con 0x7fce18004d50 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.733+0000 7fce2f16c700 1 -- 172.21.15.81:0/4005579489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce18004d50 msgr2=0x7fce180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.733+0000 7fce2f16c700 1 --2- 172.21.15.81:0/4005579489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce18004d50 0x7fce180051c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fce2000a970 tx=0x7fce20002210 comp rx=0 tx=0).stop 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.733+0000 7fce2d709700 1 -- 172.21.15.81:0/4005579489 reap_dead start 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.733+0000 7fce2f16c700 1 -- 172.21.15.81:0/4005579489 shutdown_connections 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.733+0000 7fce2f16c700 1 -- 172.21.15.81:0/4005579489 >> 172.21.15.81:0/4005579489 conn(0x7fce2806c660 msgr2=0x7fce280cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.733+0000 7fce2f16c700 1 -- 172.21.15.81:0/4005579489 shutdown_connections 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.733+0000 7fce2f16c700 1 -- 172.21.15.81:0/4005579489 wait complete. 2023-10-06T02:57:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.734+0000 7fce2f16c700 1 Processor -- start 2023-10-06T02:57:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.734+0000 7fce2f16c700 1 -- start start 2023-10-06T02:57:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2f16c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce28136a70 0x7fce2814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2f16c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28136e40 0x7fce2814b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2f16c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce28154060 0x7fce28154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2f16c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280afff0 con 0x7fce28154060 2023-10-06T02:57:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2f16c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce28154d90 con 0x7fce28136a70 2023-10-06T02:57:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2f16c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280b01d0 con 0x7fce28136e40 2023-10-06T02:57:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2d709700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce28154060 0x7fce28154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2d709700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce28154060 0x7fce28154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52176/0 (socket says 172.21.15.81:52176) 2023-10-06T02:57:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2d709700 1 -- 172.21.15.81:0/588359847 learned_addr learned my addr 172.21.15.81:0/588359847 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2cf08700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce28136a70 0x7fce2814b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce27fff700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28136e40 0x7fce2814b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2d709700 1 -- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28136e40 msgr2=0x7fce2814b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2d709700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28136e40 0x7fce2814b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2d709700 1 -- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce28136a70 msgr2=0x7fce2814b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2d709700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce28136a70 0x7fce2814b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2d709700 1 -- 172.21.15.81:0/588359847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280b04b0 con 0x7fce28154060 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2d709700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce28154060 0x7fce28154500 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fce20000f80 tx=0x7fce20015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce24ff9700 1 -- 172.21.15.81:0/588359847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20023070 con 0x7fce28154060 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce24ff9700 1 -- 172.21.15.81:0/588359847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce20001360 con 0x7fce28154060 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280b0790 con 0x7fce28154060 2023-10-06T02:57:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce24ff9700 1 -- 172.21.15.81:0/588359847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20012440 con 0x7fce28154060 2023-10-06T02:57:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.735+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2814d090 con 0x7fce28154060 2023-10-06T02:57:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.736+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce280b0980 con 0x7fce28154060 2023-10-06T02:57:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.737+0000 7fce24ff9700 1 -- 172.21.15.81:0/588359847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce20019030 con 0x7fce28154060 2023-10-06T02:57:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.737+0000 7fce24ff9700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce0c066f20 0x7fce0c0693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.737+0000 7fce24ff9700 1 -- 172.21.15.81:0/588359847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fce20085890 con 0x7fce28154060 2023-10-06T02:57:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.737+0000 7fce2cf08700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce0c066f20 0x7fce0c0693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.738+0000 7fce2cf08700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce0c066f20 0x7fce0c0693d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fce1c006f00 tx=0x7fce1c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.741+0000 7fce24ff9700 1 -- 172.21.15.81:0/588359847 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce20052950 con 0x7fce28154060 2023-10-06T02:57:58.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:58.925+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fce280cb230 con 0x7fce28154060 2023-10-06T02:57:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.491+0000 7fce24ff9700 1 -- 172.21.15.81:0/588359847 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v185) v1 ==== 181+0+0 (secure 0 0 0) 0x7fce20001f30 con 0x7fce28154060 2023-10-06T02:57:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce0c066f20 msgr2=0x7fce0c0693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce0c066f20 0x7fce0c0693d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fce1c006f00 tx=0x7fce1c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce28154060 msgr2=0x7fce28154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce28154060 0x7fce28154500 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fce20000f80 tx=0x7fce20015000 comp rx=0 tx=0).stop 2023-10-06T02:57:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 shutdown_connections 2023-10-06T02:57:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce28154060 0x7fce28154500 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fce0c066f20 0x7fce0c0693d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce28136a70 0x7fce2814b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 --2- 172.21.15.81:0/588359847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce28136e40 0x7fce2814b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 >> 172.21.15.81:0/588359847 conn(0x7fce2806c660 msgr2=0x7fce2806d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 shutdown_connections 2023-10-06T02:57:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.494+0000 7fce2f16c700 1 -- 172.21.15.81:0/588359847 wait complete. 2023-10-06T02:57:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:57:59.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:57:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.624+0000 7f3610e9d700 1 Processor -- start 2023-10-06T02:57:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.624+0000 7f3610e9d700 1 -- start start 2023-10-06T02:57:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f3610e9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f360c0d0b80 0x7f360c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f3610e9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f360c0d02b0 0x7f360c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f3610e9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c0cf2d0 con 0x7f360c0d0f50 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f3610e9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c15a690 con 0x7f360c0d0b80 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f3610e9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c06dc00 con 0x7f360c0d02b0 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f360c0d0b80 0x7f360c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f360c0d0f50 0x7f360c15b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44204/0 (socket says 172.21.15.81:44204) 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360bfff700 1 -- 172.21.15.81:0/4142453128 learned_addr learned my addr 172.21.15.81:0/4142453128 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360b7fe700 1 -- 172.21.15.81:0/4142453128 >> v2:172.21.15.83:3300/0 conn(0x7f360c0d02b0 msgr2=0x7f360c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360b7fe700 1 --2- 172.21.15.81:0/4142453128 >> v2:172.21.15.83:3300/0 conn(0x7f360c0d02b0 0x7f360c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360b7fe700 1 -- 172.21.15.81:0/4142453128 >> v1:172.21.15.81:6789/0 conn(0x7f360c0d0f50 legacy=0x7f360c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360a7fc700 1 -- 172.21.15.81:0/4142453128 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582932928 0 0) 0x7f360c0cf2d0 con 0x7f360c0d0f50 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360b7fe700 1 -- 172.21.15.81:0/4142453128 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0cf570 con 0x7f360c0d0b80 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360b7fe700 1 --2- 172.21.15.81:0/4142453128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d0b80 0x7f360c0cfd70 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f360c0ce9b0 tx=0x7f35fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a949d1b1b995c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360a7fc700 1 -- 172.21.15.81:0/4142453128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00e070 con 0x7f360c0d0b80 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360a7fc700 1 -- 172.21.15.81:0/4142453128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc00bc30 con 0x7f360c0d0b80 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.625+0000 7f360a7fc700 1 -- 172.21.15.81:0/4142453128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc012430 con 0x7f360c0d0b80 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.626+0000 7f3610e9d700 1 -- 172.21.15.81:0/4142453128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d0b80 msgr2=0x7f360c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.626+0000 7f3610e9d700 1 --2- 172.21.15.81:0/4142453128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d0b80 0x7f360c0cfd70 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f360c0ce9b0 tx=0x7f35fc009780 comp rx=0 tx=0).stop 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.626+0000 7f3610e9d700 1 -- 172.21.15.81:0/4142453128 shutdown_connections 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.626+0000 7f3610e9d700 1 --2- 172.21.15.81:0/4142453128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d0b80 0x7f360c0cfd70 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.626+0000 7f3610e9d700 1 --2- 172.21.15.81:0/4142453128 >> v2:172.21.15.83:3300/0 conn(0x7f360c0d02b0 0x7f360c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.626+0000 7f3610e9d700 1 -- 172.21.15.81:0/4142453128 >> 172.21.15.81:0/4142453128 conn(0x7f360c063230 msgr2=0x7f360c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.626+0000 7f3610e9d700 1 -- 172.21.15.81:0/4142453128 shutdown_connections 2023-10-06T02:57:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.626+0000 7f3610e9d700 1 -- 172.21.15.81:0/4142453128 wait complete. 2023-10-06T02:57:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.627+0000 7f3610e9d700 1 Processor -- start 2023-10-06T02:57:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.627+0000 7f3610e9d700 1 -- start start 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f3610e9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d02b0 0x7f360c0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f3610e9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c0d0b80 0x7f360c149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f3610e9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f360c0d0f50 0x7f360c15c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f3610e9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c16c370 con 0x7f360c0d02b0 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f3610e9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c16b760 con 0x7f360c0d0b80 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f3610e9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c16ba40 con 0x7f360c0d0f50 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d02b0 0x7f360c0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d02b0 0x7f360c0ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52190/0 (socket says 172.21.15.81:52190) 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360b7fe700 1 -- 172.21.15.81:0/2991443339 learned_addr learned my addr 172.21.15.81:0/2991443339 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360bfff700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f360c0d0f50 0x7f360c15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360affd700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c0d0b80 0x7f360c149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360b7fe700 1 -- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f360c0d0f50 msgr2=0x7f360c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360b7fe700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f360c0d0f50 0x7f360c15c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360b7fe700 1 -- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c0d0b80 msgr2=0x7f360c149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360b7fe700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c0d0b80 0x7f360c149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.628+0000 7f360b7fe700 1 -- 172.21.15.81:0/2991443339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc009a20 con 0x7f360c0d02b0 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.629+0000 7f360b7fe700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d02b0 0x7f360c0ad3f0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f35fc013000 tx=0x7f35fc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.629+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc012e20 con 0x7f360c0d02b0 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.629+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc01d630 con 0x7f360c0d02b0 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.629+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c16bd20 con 0x7f360c0d02b0 2023-10-06T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.629+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc01d9f0 con 0x7f360c0d02b0 2023-10-06T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.629+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c0ad930 con 0x7f360c0d02b0 2023-10-06T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.630+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c0676e0 con 0x7f360c0d02b0 2023-10-06T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.630+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35fc024070 con 0x7f360c0d02b0 2023-10-06T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.630+0000 7f35f37fe700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.631+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f35fc087810 con 0x7f360c0d02b0 2023-10-06T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.631+0000 7f360affd700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.631+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=186}) v3 -- 0x7f35f806e310 con 0x7f360c0d02b0 2023-10-06T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.631+0000 7f360affd700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3600006fd0 tx=0x7f3600008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.635+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35fc053fd0 con 0x7f360c0d02b0 2023-10-06T02:57:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:57:59.822+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f360c0cf850 con 0x7f360c0d02b0 2023-10-06T02:58:00.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.746+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(186..186 src has 1..186) v4 ==== 288+0+0 (secure 0 0 0) 0x7f35fc058390 con 0x7f360c0d02b0 2023-10-06T02:58:00.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.746+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=187}) v3 -- 0x7f35f806d0a0 con 0x7f360c0d02b0 2023-10-06T02:58:00.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.750+0000 7f35f37fe700 1 -- 172.21.15.81:0/2991443339 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v186) v1 ==== 169+0+0 (secure 0 0 0) 0x7f35fc025370 con 0x7f360c0d02b0 2023-10-06T02:58:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.756+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 msgr2=0x7f35f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.756+0000 7f3610e9d700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3600006fd0 tx=0x7f3600008040 comp rx=0 tx=0).stop 2023-10-06T02:58:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.756+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d02b0 msgr2=0x7f360c0ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.756+0000 7f3610e9d700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d02b0 0x7f360c0ad3f0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f35fc013000 tx=0x7f35fc019000 comp rx=0 tx=0).stop 2023-10-06T02:58:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.758+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 shutdown_connections 2023-10-06T02:58:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.758+0000 7f3610e9d700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f360c0d0f50 0x7f360c15c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.758+0000 7f3610e9d700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360c0d02b0 0x7f360c0ad3f0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.758+0000 7f3610e9d700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f35f8066f30 0x7f35f80693e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.758+0000 7f3610e9d700 1 --2- 172.21.15.81:0/2991443339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f360c0d0b80 0x7f360c149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.758+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 >> 172.21.15.81:0/2991443339 conn(0x7f360c063230 msgr2=0x7f360c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.759+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 shutdown_connections 2023-10-06T02:58:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.759+0000 7f3610e9d700 1 -- 172.21.15.81:0/2991443339 wait complete. 2023-10-06T02:58:00.761 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T02:58:00.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:58:00.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.890+0000 7fd2437ea700 1 Processor -- start 2023-10-06T02:58:00.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.890+0000 7fd2437ea700 1 -- start start 2023-10-06T02:58:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.891+0000 7fd2437ea700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd23c15daa0 0x7fd23c15de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.891+0000 7fd2437ea700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd23c0cae00 0x7fd23c159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.891+0000 7fd2437ea700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c06d350 con 0x7fd23c0cb2a0 2023-10-06T02:58:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.891+0000 7fd2437ea700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0c9ac0 con 0x7fd23c15daa0 2023-10-06T02:58:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.891+0000 7fd2437ea700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c15e3b0 con 0x7fd23c0cae00 2023-10-06T02:58:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.891+0000 7fd241586700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd23c15daa0 0x7fd23c15de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.891+0000 7fd241d87700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd23c0cb2a0 0x7fd23c159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43918/0 (socket says 172.21.15.81:43918) 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.891+0000 7fd241d87700 1 -- 172.21.15.81:0/3149387422 learned_addr learned my addr 172.21.15.81:0/3149387422 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd241586700 1 -- 172.21.15.81:0/3149387422 >> v2:172.21.15.83:3300/0 conn(0x7fd23c0cae00 msgr2=0x7fd23c159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd240d85700 1 --2- 172.21.15.81:0/3149387422 >> v2:172.21.15.83:3300/0 conn(0x7fd23c0cae00 0x7fd23c159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd241586700 1 --2- 172.21.15.81:0/3149387422 >> v2:172.21.15.83:3300/0 conn(0x7fd23c0cae00 0x7fd23c159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd241586700 1 -- 172.21.15.81:0/3149387422 >> v1:172.21.15.81:6789/0 conn(0x7fd23c0cb2a0 legacy=0x7fd23c159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd233fff700 1 -- 172.21.15.81:0/3149387422 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488002210 0 0) 0x7fd23c06d350 con 0x7fd23c0cb2a0 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd241586700 1 -- 172.21.15.81:0/3149387422 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c06c740 con 0x7fd23c15daa0 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd240d85700 1 --2- 172.21.15.81:0/3149387422 >> v2:172.21.15.83:3300/0 conn(0x7fd23c0cae00 0x7fd23c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd241586700 1 --2- 172.21.15.81:0/3149387422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 0x7fd23c15de70 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fd23c067cb0 tx=0x7fd2380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12d5aea6ca50a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd233fff700 1 -- 172.21.15.81:0/3149387422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800b6b0 con 0x7fd23c15daa0 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd233fff700 1 -- 172.21.15.81:0/3149387422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800b810 con 0x7fd23c15daa0 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.892+0000 7fd233fff700 1 -- 172.21.15.81:0/3149387422 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800bbb0 con 0x7fd23c15daa0 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.893+0000 7fd2437ea700 1 -- 172.21.15.81:0/3149387422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 msgr2=0x7fd23c15de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.893+0000 7fd2437ea700 1 --2- 172.21.15.81:0/3149387422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 0x7fd23c15de70 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fd23c067cb0 tx=0x7fd2380091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.893+0000 7fd2437ea700 1 -- 172.21.15.81:0/3149387422 shutdown_connections 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.893+0000 7fd2437ea700 1 --2- 172.21.15.81:0/3149387422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 0x7fd23c15de70 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.893+0000 7fd2437ea700 1 --2- 172.21.15.81:0/3149387422 >> v2:172.21.15.83:3300/0 conn(0x7fd23c0cae00 0x7fd23c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.893+0000 7fd2437ea700 1 -- 172.21.15.81:0/3149387422 >> 172.21.15.81:0/3149387422 conn(0x7fd23c0c9ca0 msgr2=0x7fd23c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.893+0000 7fd2437ea700 1 -- 172.21.15.81:0/3149387422 shutdown_connections 2023-10-06T02:58:00.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.893+0000 7fd2437ea700 1 -- 172.21.15.81:0/3149387422 wait complete. 2023-10-06T02:58:00.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.894+0000 7fd2437ea700 1 Processor -- start 2023-10-06T02:58:00.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.894+0000 7fd2437ea700 1 -- start start 2023-10-06T02:58:00.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2437ea700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c0cae00 0x7fd23c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2437ea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c0cb2a0 0x7fd23c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2437ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 0x7fd23c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2437ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c153bd0 con 0x7fd23c15daa0 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2437ea700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1522e0 con 0x7fd23c0cb2a0 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2437ea700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c154290 con 0x7fd23c0cae00 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241d87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 0x7fd23c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241d87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 0x7fd23c155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51096/0 (socket says 172.21.15.81:51096) 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241d87700 1 -- 172.21.15.81:0/822948484 learned_addr learned my addr 172.21.15.81:0/822948484 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241586700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c0cae00 0x7fd23c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd240d85700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c0cb2a0 0x7fd23c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241d87700 1 -- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c0cae00 msgr2=0x7fd23c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241d87700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c0cae00 0x7fd23c151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241d87700 1 -- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c0cb2a0 msgr2=0x7fd23c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241d87700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c0cb2a0 0x7fd23c0b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241d87700 1 -- 172.21.15.81:0/822948484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238009420 con 0x7fd23c15daa0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd241d87700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 0x7fd23c155010 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fd23400cc90 tx=0x7fd234001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2317fa700 1 -- 172.21.15.81:0/822948484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400cea0 con 0x7fd23c15daa0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2317fa700 1 -- 172.21.15.81:0/822948484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400ab70 con 0x7fd23c15daa0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2317fa700 1 -- 172.21.15.81:0/822948484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340070f0 con 0x7fd23c15daa0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c154530 con 0x7fd23c15daa0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.895+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c154af0 con 0x7fd23c15daa0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.896+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c0ccf20 con 0x7fd23c15daa0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.896+0000 7fd2317fa700 1 -- 172.21.15.81:0/822948484 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2340074a0 con 0x7fd23c15daa0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.897+0000 7fd2317fa700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd220066f30 0x7fd2200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.897+0000 7fd2317fa700 1 -- 172.21.15.81:0/822948484 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd234084810 con 0x7fd23c15daa0 2023-10-06T02:58:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.897+0000 7fd241586700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd220066f30 0x7fd2200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.898+0000 7fd241586700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd220066f30 0x7fd2200693e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd238003080 tx=0x7fd238017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:00.901+0000 7fd2317fa700 1 -- 172.21.15.81:0/822948484 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd234051ca0 con 0x7fd23c15daa0 2023-10-06T02:58:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.085+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd23c154d10 con 0x7fd23c15daa0 2023-10-06T02:58:01.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.089+0000 7fd2317fa700 1 -- 172.21.15.81:0/822948484 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd2340552c0 con 0x7fd23c15daa0 2023-10-06T02:58:01.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.091+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd220066f30 msgr2=0x7fd2200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.091+0000 7fd2437ea700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd220066f30 0x7fd2200693e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd238003080 tx=0x7fd238017000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.091+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 msgr2=0x7fd23c155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.091+0000 7fd2437ea700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 0x7fd23c155010 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fd23400cc90 tx=0x7fd234001a80 comp rx=0 tx=0).stop 2023-10-06T02:58:01.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.092+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 shutdown_connections 2023-10-06T02:58:01.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.092+0000 7fd2437ea700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c15daa0 0x7fd23c155010 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.092+0000 7fd2437ea700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd23c0cae00 0x7fd23c151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.092+0000 7fd2437ea700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fd220066f30 0x7fd2200693e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.092+0000 7fd2437ea700 1 --2- 172.21.15.81:0/822948484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd23c0cb2a0 0x7fd23c0b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.092+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 >> 172.21.15.81:0/822948484 conn(0x7fd23c0c9ca0 msgr2=0x7fd23c0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.092+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 shutdown_connections 2023-10-06T02:58:01.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.092+0000 7fd2437ea700 1 -- 172.21.15.81:0/822948484 wait complete. 2023-10-06T02:58:01.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-06T02:58:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.218+0000 7fb3104b4700 1 Processor -- start 2023-10-06T02:58:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.218+0000 7fb3104b4700 1 -- start start 2023-10-06T02:58:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.219+0000 7fb3104b4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb3080ce1f0 0x7fb3080aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.219+0000 7fb3104b4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3080ac570 0x7fb30806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.219+0000 7fb3104b4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30815dfb0 con 0x7fb3080ce5c0 2023-10-06T02:58:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.219+0000 7fb3104b4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3080acec0 con 0x7fb3080ac570 2023-10-06T02:58:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.219+0000 7fb3104b4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3080ad1a0 con 0x7fb3080ce1f0 2023-10-06T02:58:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.219+0000 7fb30ea51700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3080ac570 0x7fb30806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30da4f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb3080ce5c0 0x7fb30815e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43928/0 (socket says 172.21.15.81:43928) 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30ea51700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3080ac570 0x7fb30806e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51104/0 (socket says 172.21.15.81:51104) 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30da4f700 1 -- 172.21.15.81:0/1070509162 learned_addr learned my addr 172.21.15.81:0/1070509162 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30e250700 1 --2- 172.21.15.81:0/1070509162 >> v2:172.21.15.83:3300/0 conn(0x7fb3080ce1f0 0x7fb3080aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30ea51700 1 -- 172.21.15.81:0/1070509162 >> v2:172.21.15.83:3300/0 conn(0x7fb3080ce1f0 msgr2=0x7fb3080aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30ea51700 1 --2- 172.21.15.81:0/1070509162 >> v2:172.21.15.83:3300/0 conn(0x7fb3080ce1f0 0x7fb3080aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30ea51700 1 -- 172.21.15.81:0/1070509162 >> v1:172.21.15.81:6789/0 conn(0x7fb3080ce5c0 legacy=0x7fb30815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30ea51700 1 -- 172.21.15.81:0/1070509162 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30815dc40 con 0x7fb3080ac570 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30d24e700 1 -- 172.21.15.81:0/1070509162 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525820104 0 0) 0x7fb30815dfb0 con 0x7fb3080ce5c0 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30ea51700 1 --2- 172.21.15.81:0/1070509162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ac570 0x7fb30806e230 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb3080b06e0 tx=0x7fb300009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ec9b6ff1f090cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30d24e700 1 -- 172.21.15.81:0/1070509162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000e070 con 0x7fb3080ac570 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30d24e700 1 -- 172.21.15.81:0/1070509162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30000bc30 con 0x7fb3080ac570 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.220+0000 7fb30d24e700 1 -- 172.21.15.81:0/1070509162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300012430 con 0x7fb3080ac570 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.221+0000 7fb3104b4700 1 -- 172.21.15.81:0/1070509162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ac570 msgr2=0x7fb30806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.221+0000 7fb3104b4700 1 --2- 172.21.15.81:0/1070509162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ac570 0x7fb30806e230 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb3080b06e0 tx=0x7fb300009780 comp rx=0 tx=0).stop 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.221+0000 7fb3104b4700 1 -- 172.21.15.81:0/1070509162 shutdown_connections 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.221+0000 7fb3104b4700 1 --2- 172.21.15.81:0/1070509162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ac570 0x7fb30806e230 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.221+0000 7fb3104b4700 1 --2- 172.21.15.81:0/1070509162 >> v2:172.21.15.83:3300/0 conn(0x7fb3080ce1f0 0x7fb3080aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.221+0000 7fb3104b4700 1 -- 172.21.15.81:0/1070509162 >> 172.21.15.81:0/1070509162 conn(0x7fb30806cca0 msgr2=0x7fb30806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.221+0000 7fb3104b4700 1 -- 172.21.15.81:0/1070509162 shutdown_connections 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.221+0000 7fb3104b4700 1 -- 172.21.15.81:0/1070509162 wait complete. 2023-10-06T02:58:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.222+0000 7fb3104b4700 1 Processor -- start 2023-10-06T02:58:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.222+0000 7fb3104b4700 1 -- start start 2023-10-06T02:58:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.222+0000 7fb3104b4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3080ac570 0x7fb308151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.222+0000 7fb3104b4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3080ce1f0 0x7fb308153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb3104b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ce5c0 0x7fb3080b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb3104b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb308152f70 con 0x7fb3080ce5c0 2023-10-06T02:58:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb3104b4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb308151cb0 con 0x7fb3080ce1f0 2023-10-06T02:58:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb3104b4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb308153940 con 0x7fb3080ac570 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30ea51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ce5c0 0x7fb3080b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30ea51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ce5c0 0x7fb3080b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51110/0 (socket says 172.21.15.81:51110) 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30ea51700 1 -- 172.21.15.81:0/3146701608 learned_addr learned my addr 172.21.15.81:0/3146701608 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30e250700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3080ac570 0x7fb308151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30da4f700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3080ce1f0 0x7fb308153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30ea51700 1 -- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3080ac570 msgr2=0x7fb308151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30ea51700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3080ac570 0x7fb308151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30ea51700 1 -- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3080ce1f0 msgr2=0x7fb308153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30ea51700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3080ce1f0 0x7fb308153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30ea51700 1 -- 172.21.15.81:0/3146701608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300009a20 con 0x7fb3080ce5c0 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb30ea51700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ce5c0 0x7fb3080b1800 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fb30000b6c0 tx=0x7fb300019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb2fe7fc700 1 -- 172.21.15.81:0/3146701608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300012e60 con 0x7fb3080ce5c0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb2fe7fc700 1 -- 172.21.15.81:0/3146701608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30001d630 con 0x7fb3080ce5c0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb2fe7fc700 1 -- 172.21.15.81:0/3146701608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30001d9f0 con 0x7fb3080ce5c0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb308152360 con 0x7fb3080ce5c0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.223+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb308152920 con 0x7fb3080ce5c0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.224+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb308068900 con 0x7fb3080ce5c0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.224+0000 7fb2fe7fc700 1 -- 172.21.15.81:0/3146701608 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb300024070 con 0x7fb3080ce5c0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.225+0000 7fb2fe7fc700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2ec066f30 0x7fb2ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.225+0000 7fb2fe7fc700 1 -- 172.21.15.81:0/3146701608 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb300086c50 con 0x7fb3080ce5c0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.225+0000 7fb30e250700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2ec066f30 0x7fb2ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.226+0000 7fb30e250700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2ec066f30 0x7fb2ec0693e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb304006fd0 tx=0x7fb304008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.229+0000 7fb2fe7fc700 1 -- 172.21.15.81:0/3146701608 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb30008c020 con 0x7fb3080ce5c0 2023-10-06T02:58:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.484+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fb3080ac9d0 con 0x7fb3080ce5c0 2023-10-06T02:58:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.762+0000 7fb2fe7fc700 1 -- 172.21.15.81:0/3146701608 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v556) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb300054060 con 0x7fb3080ce5c0 2023-10-06T02:58:01.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.764+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2ec066f30 msgr2=0x7fb2ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.764+0000 7fb3104b4700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2ec066f30 0x7fb2ec0693e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb304006fd0 tx=0x7fb304008040 comp rx=0 tx=0).stop 2023-10-06T02:58:01.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.764+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ce5c0 msgr2=0x7fb3080b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.764+0000 7fb3104b4700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ce5c0 0x7fb3080b1800 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fb30000b6c0 tx=0x7fb300019000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.765+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 shutdown_connections 2023-10-06T02:58:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.765+0000 7fb3104b4700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3080ce5c0 0x7fb3080b1800 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.765+0000 7fb3104b4700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3080ac570 0x7fb308151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.765+0000 7fb3104b4700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fb2ec066f30 0x7fb2ec0693e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.765+0000 7fb3104b4700 1 --2- 172.21.15.81:0/3146701608 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3080ce1f0 0x7fb308153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.765+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 >> 172.21.15.81:0/3146701608 conn(0x7fb30806cca0 msgr2=0x7fb3080699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.765+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 shutdown_connections 2023-10-06T02:58:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:01.765+0000 7fb3104b4700 1 -- 172.21.15.81:0/3146701608 wait complete. 2023-10-06T02:58:01.778 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-06T02:58:01.778 INFO:tasks.cephfs_test_runner: 2023-10-06T02:58:01.778 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T02:58:01.778 INFO:tasks.cephfs_test_runner:Ran 10 tests in 680.277s 2023-10-06T02:58:01.779 INFO:tasks.cephfs_test_runner: 2023-10-06T02:58:01.779 INFO:tasks.cephfs_test_runner:OK 2023-10-06T02:58:01.779 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T02:58:01.788 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T02:58:01.796 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T02:58:01.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:01.796 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:58:01.811 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:58:01.812 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:58:01.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:01.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:58:01.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:01.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:58:01.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:01.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-06T02:58:02.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:02.061 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T02:58:02.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:02.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-06T02:58:02.143 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-10-06T02:58:02.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:02.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:02.144 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:58:02.163 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:58:02.163 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:58:02.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:02.163 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:58:02.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:02.242 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:58:02.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:02.328 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T02:58:02.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:02.411 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T02:58:02.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:02.426 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T02:58:02.495 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T02:58:02.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:02.497 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T02:58:02.507 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T02:58:02.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:58:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.623+0000 7f875f7a3700 1 Processor -- start 2023-10-06T02:58:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.623+0000 7f875f7a3700 1 -- start start 2023-10-06T02:58:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.624+0000 7f875f7a3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8758156420 0x7f87580cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.624+0000 7f875f7a3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580cb880 con 0x7f87580c71d0 2023-10-06T02:58:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.624+0000 7f875f7a3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580cac70 con 0x7f87580cc250 2023-10-06T02:58:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.624+0000 7f875f7a3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875806aa10 con 0x7f8758156420 2023-10-06T02:58:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.624+0000 7f875dd40700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f87580c71d0 0x7f87580c1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43942/0 (socket says 172.21.15.81:43942) 2023-10-06T02:58:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.624+0000 7f875dd40700 1 -- 172.21.15.81:0/3125616652 learned_addr learned my addr 172.21.15.81:0/3125616652 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f875d53f700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8758156420 0x7f87580cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260338306 0 0) 0x7f87580cb880 con 0x7f87580c71d0 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8744003570 con 0x7f87580c71d0 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 287506539 0 0) 0x7f8744003570 con 0x7f87580c71d0 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8758156420 msgr2=0x7f87580cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8758156420 0x7f87580cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 >> v1:172.21.15.83:6789/0 conn(0x7f87580cc250 legacy=0x7f8758069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87580caf50 con 0x7f87580c71d0 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f87500017f0 con 0x7f87580c71d0 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 >> v1:172.21.15.81:6789/0 conn(0x7f87580c71d0 legacy=0x7f87580c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8744003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8758156420 0x7f8744004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8744004d50 0x7f87440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875806aa10 con 0x7f8744003a90 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874400bb70 con 0x7f8744004d50 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874400df40 con 0x7f8758156420 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f875d53f700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8744003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f875dd40700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8744004d50 0x7f87440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f875cd3e700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8758156420 0x7f8744004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f875d53f700 1 -- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8758156420 msgr2=0x7f8744004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f875d53f700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8758156420 0x7f8744004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f875d53f700 1 -- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8744004d50 msgr2=0x7f87440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f875d53f700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8744004d50 0x7f87440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.625+0000 7f875d53f700 1 -- 172.21.15.81:0/3125616652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744003570 con 0x7f8744003a90 2023-10-06T02:58:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f875d53f700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8744003ea0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f875400acc0 tx=0x7f875400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e246b5cb977ae65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400e780 con 0x7f8744003a90 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875400e8e0 con 0x7f8744003a90 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f874ffff700 1 -- 172.21.15.81:0/3125616652 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400ea70 con 0x7f8744003a90 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f875f7a3700 1 -- 172.21.15.81:0/3125616652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 msgr2=0x7f8744003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f875f7a3700 1 --2- 172.21.15.81:0/3125616652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8744003ea0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f875400acc0 tx=0x7f875400a330 comp rx=0 tx=0).stop 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f875dd40700 1 -- 172.21.15.81:0/3125616652 reap_dead start 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f875f7a3700 1 -- 172.21.15.81:0/3125616652 shutdown_connections 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f875f7a3700 1 -- 172.21.15.81:0/3125616652 >> 172.21.15.81:0/3125616652 conn(0x7f875806c660 msgr2=0x7f87580cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f875f7a3700 1 -- 172.21.15.81:0/3125616652 shutdown_connections 2023-10-06T02:58:02.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.626+0000 7f875f7a3700 1 -- 172.21.15.81:0/3125616652 wait complete. 2023-10-06T02:58:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.627+0000 7f875f7a3700 1 Processor -- start 2023-10-06T02:58:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.627+0000 7f875f7a3700 1 -- start start 2023-10-06T02:58:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875f7a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8758165b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875f7a3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8758155220 0x7f875814f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875f7a3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87580c62c0 0x7f87580c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875f7a3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87580c6c70 con 0x7f8744003a90 2023-10-06T02:58:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875f7a3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8758166190 con 0x7f8758155220 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875f7a3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8758166470 con 0x7f87580c62c0 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875d53f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8758165b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875d53f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8758165b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51122/0 (socket says 172.21.15.81:51122) 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875d53f700 1 -- 172.21.15.81:0/1941335844 learned_addr learned my addr 172.21.15.81:0/1941335844 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.628+0000 7f875cd3e700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8758155220 0x7f875814f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f875dd40700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87580c62c0 0x7f87580c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f875d53f700 1 -- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87580c62c0 msgr2=0x7f87580c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f875d53f700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87580c62c0 0x7f87580c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f875d53f700 1 -- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8758155220 msgr2=0x7f875814f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f875d53f700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8758155220 0x7f875814f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f875d53f700 1 -- 172.21.15.81:0/1941335844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758166750 con 0x7f8744003a90 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f875d53f700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8758165b40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f875400afd0 tx=0x7f8754019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f874d7fa700 1 -- 172.21.15.81:0/1941335844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400ea50 con 0x7f8744003a90 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f874d7fa700 1 -- 172.21.15.81:0/1941335844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8754020040 con 0x7f8744003a90 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8758166a30 con 0x7f8744003a90 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f874d7fa700 1 -- 172.21.15.81:0/1941335844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540243f0 con 0x7f8744003a90 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.629+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875814f6e0 con 0x7f8744003a90 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.630+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8758156a50 con 0x7f8744003a90 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.630+0000 7f874d7fa700 1 -- 172.21.15.81:0/1941335844 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87540247a0 con 0x7f8744003a90 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.631+0000 7f874d7fa700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f873c066f30 0x7f873c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.631+0000 7f874d7fa700 1 -- 172.21.15.81:0/1941335844 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8754015030 con 0x7f8744003a90 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.631+0000 7f875cd3e700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f873c066f30 0x7f873c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.631+0000 7f875cd3e700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f873c066f30 0x7f873c0693e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8758163730 tx=0x7f8748007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:02.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.635+0000 7f874d7fa700 1 -- 172.21.15.81:0/1941335844 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8754052ba0 con 0x7f8744003a90 2023-10-06T02:58:02.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.819+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8758156c00 con 0x7f8744003a90 2023-10-06T02:58:02.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.820+0000 7f874d7fa700 1 -- 172.21.15.81:0/1941335844 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+13741 (secure 0 0 0) 0x7f87540561c0 con 0x7f8744003a90 2023-10-06T02:58:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:58:02.821 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":186,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:58:00.745703+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/604648999":"2023-10-07T02:57:57.544490+0000","172.21.15.81:6832/604648999":"2023-10-07T02:57:57.544490+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:58:02.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f873c066f30 msgr2=0x7f873c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f873c066f30 0x7f873c0693e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8758163730 tx=0x7f8748007d30 comp rx=0 tx=0).stop 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 msgr2=0x7f8758165b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8758165b40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f875400afd0 tx=0x7f8754019000 comp rx=0 tx=0).stop 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 shutdown_connections 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f87580c62c0 0x7f87580c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744003a90 0x7f8758165b40 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f873c066f30 0x7f873c0693e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 --2- 172.21.15.81:0/1941335844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8758155220 0x7f875814f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 >> 172.21.15.81:0/1941335844 conn(0x7f875806c660 msgr2=0x7f87580c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 shutdown_connections 2023-10-06T02:58:02.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.822+0000 7f875f7a3700 1 -- 172.21.15.81:0/1941335844 wait complete. 2023-10-06T02:58:02.835 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T02:58:02.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:02.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.948+0000 7fa12753a700 1 Processor -- start 2023-10-06T02:58:02.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.949+0000 7fa12753a700 1 -- start start 2023-10-06T02:58:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.949+0000 7fa12753a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa120156420 0x7fa1200cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.949+0000 7fa12753a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200cb880 con 0x7fa1200c71d0 2023-10-06T02:58:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.949+0000 7fa12753a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200cac70 con 0x7fa1200cc250 2023-10-06T02:58:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.949+0000 7fa12753a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12006aa10 con 0x7fa120156420 2023-10-06T02:58:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.949+0000 7fa1252d6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa120156420 0x7fa1200cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.949+0000 7fa125ad7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa1200c71d0 0x7fa1200c1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43950/0 (socket says 172.21.15.81:43950) 2023-10-06T02:58:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.949+0000 7fa1252d6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa120156420 0x7fa1200cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51128/0 (socket says 172.21.15.81:51128) 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.949+0000 7fa125ad7700 1 -- 172.21.15.81:0/1231366464 learned_addr learned my addr 172.21.15.81:0/1231366464 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.950+0000 7fa1252d6700 1 -- 172.21.15.81:0/1231366464 >> v1:172.21.15.83:6789/0 conn(0x7fa1200cc250 legacy=0x7fa120069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.950+0000 7fa1252d6700 1 -- 172.21.15.81:0/1231366464 >> v1:172.21.15.81:6789/0 conn(0x7fa1200c71d0 legacy=0x7fa1200c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.950+0000 7fa117fff700 1 -- 172.21.15.81:0/1231366464 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231075273 0 0) 0x7fa1200cb880 con 0x7fa1200c71d0 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.950+0000 7fa1252d6700 1 -- 172.21.15.81:0/1231366464 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200caf50 con 0x7fa120156420 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.950+0000 7fa1252d6700 1 --2- 172.21.15.81:0/1231366464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 0x7fa1200cbd10 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00d0d0 tx=0x7fa11c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f153e58bb20ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.950+0000 7fa117fff700 1 -- 172.21.15.81:0/1231366464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c010070 con 0x7fa120156420 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.950+0000 7fa117fff700 1 -- 172.21.15.81:0/1231366464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c00dbe0 con 0x7fa120156420 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.950+0000 7fa117fff700 1 -- 172.21.15.81:0/1231366464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c016400 con 0x7fa120156420 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.951+0000 7fa12753a700 1 -- 172.21.15.81:0/1231366464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 msgr2=0x7fa1200cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.951+0000 7fa12753a700 1 --2- 172.21.15.81:0/1231366464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 0x7fa1200cbd10 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00d0d0 tx=0x7fa11c00b990 comp rx=0 tx=0).stop 2023-10-06T02:58:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.951+0000 7fa12753a700 1 -- 172.21.15.81:0/1231366464 shutdown_connections 2023-10-06T02:58:02.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.951+0000 7fa12753a700 1 --2- 172.21.15.81:0/1231366464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 0x7fa1200cbd10 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.951+0000 7fa12753a700 1 -- 172.21.15.81:0/1231366464 >> 172.21.15.81:0/1231366464 conn(0x7fa12006c660 msgr2=0x7fa1200cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:02.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.951+0000 7fa12753a700 1 -- 172.21.15.81:0/1231366464 shutdown_connections 2023-10-06T02:58:02.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.951+0000 7fa12753a700 1 -- 172.21.15.81:0/1231366464 wait complete. 2023-10-06T02:58:02.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.952+0000 7fa12753a700 1 Processor -- start 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.952+0000 7fa12753a700 1 -- start start 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa12753a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1200c71d0 0x7fa120169f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa12753a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1200cc250 0x7fa12014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa12753a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 0x7fa12006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa12753a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12016a470 con 0x7fa120156420 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa12753a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1201540d0 con 0x7fa1200c71d0 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa12753a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa120166470 con 0x7fa1200cc250 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa125ad7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 0x7fa12006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa125ad7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 0x7fa12006d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51132/0 (socket says 172.21.15.81:51132) 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa125ad7700 1 -- 172.21.15.81:0/509483736 learned_addr learned my addr 172.21.15.81:0/509483736 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa1252d6700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1200c71d0 0x7fa120169f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa124ad5700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1200cc250 0x7fa12014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa125ad7700 1 -- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1200cc250 msgr2=0x7fa12014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa125ad7700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1200cc250 0x7fa12014f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa125ad7700 1 -- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1200c71d0 msgr2=0x7fa120169f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa125ad7700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1200c71d0 0x7fa120169f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa125ad7700 1 -- 172.21.15.81:0/509483736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c00bc30 con 0x7fa120156420 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa125ad7700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 0x7fa12006d220 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c530 tx=0x7fa118007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa1157fa700 1 -- 172.21.15.81:0/509483736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118005b30 con 0x7fa120156420 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa1157fa700 1 -- 172.21.15.81:0/509483736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa118005c90 con 0x7fa120156420 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa120166750 con 0x7fa120156420 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa1157fa700 1 -- 172.21.15.81:0/509483736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118007320 con 0x7fa120156420 2023-10-06T02:58:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.953+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa120166d10 con 0x7fa120156420 2023-10-06T02:58:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.954+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa120067bc0 con 0x7fa120156420 2023-10-06T02:58:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.955+0000 7fa1157fa700 1 -- 172.21.15.81:0/509483736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa11801b3b0 con 0x7fa120156420 2023-10-06T02:58:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.955+0000 7fa1157fa700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa104066f30 0x7fa1040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.955+0000 7fa1157fa700 1 -- 172.21.15.81:0/509483736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa118083870 con 0x7fa120156420 2023-10-06T02:58:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.955+0000 7fa1252d6700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa104066f30 0x7fa1040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.956+0000 7fa1252d6700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa104066f30 0x7fa1040693e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00b9d0 tx=0x7fa11c01c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:02.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:02.959+0000 7fa1157fa700 1 -- 172.21.15.81:0/509483736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa118050c80 con 0x7fa120156420 2023-10-06T02:58:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.139+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1200cb230 con 0x7fa104066f30 2023-10-06T02:58:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.142+0000 7fa1157fa700 1 -- 172.21.15.81:0/509483736 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70383 (secure 0 0 0) 0x7fa1200cb230 con 0x7fa104066f30 2023-10-06T02:58:03.145 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:58:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa104066f30 msgr2=0x7fa1040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa104066f30 0x7fa1040693e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00b9d0 tx=0x7fa11c01c000 comp rx=0 tx=0).stop 2023-10-06T02:58:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 msgr2=0x7fa12006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 0x7fa12006d220 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c530 tx=0x7fa118007f90 comp rx=0 tx=0).stop 2023-10-06T02:58:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 shutdown_connections 2023-10-06T02:58:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120156420 0x7fa12006d220 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fa104066f30 0x7fa1040693e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1200c71d0 0x7fa120169f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 --2- 172.21.15.81:0/509483736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1200cc250 0x7fa12014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 >> 172.21.15.81:0/509483736 conn(0x7fa12006c660 msgr2=0x7fa120151990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 shutdown_connections 2023-10-06T02:58:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.144+0000 7fa12753a700 1 -- 172.21.15.81:0/509483736 wait complete. 2023-10-06T02:58:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:58:03.157 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2023-10-06T02:58:01.665233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":24118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1538381,"statfs":{"total":1600000000,"available":1575302690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-44025,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-97,"num_write_kb":-33860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001171"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.781490+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:57:59.781490+0000","last_peered":"2023-10-06T02:57:59.781490+0000","last_clean":"2023-10-06T02:57:59.781490+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:57:59.781490+0000","last_undegraded":"2023-10-06T02:57:59.781490+0000","last_fullsized":"2023-10-06T02:57:59.781490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.490095+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:57:59.490095+0000","last_peered":"2023-10-06T02:57:59.490095+0000","last_clean":"2023-10-06T02:57:59.490095+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:57:59.490095+0000","last_undegraded":"2023-10-06T02:57:59.490095+0000","last_fullsized":"2023-10-06T02:57:59.490095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.491486+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:57:59.491486+0000","last_peered":"2023-10-06T02:57:59.491486+0000","last_clean":"2023-10-06T02:57:59.491486+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:57:59.491486+0000","last_undegraded":"2023-10-06T02:57:59.491486+0000","last_fullsized":"2023-10-06T02:57:59.491486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.490176+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:57:59.490176+0000","last_peered":"2023-10-06T02:57:59.490176+0000","last_clean":"2023-10-06T02:57:59.490176+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:57:59.490176+0000","last_undegraded":"2023-10-06T02:57:59.490176+0000","last_fullsized":"2023-10-06T02:57:59.490176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":309,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778799+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:57:59.778799+0000","last_peered":"2023-10-06T02:57:59.778799+0000","last_clean":"2023-10-06T02:57:59.778799+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:57:59.778799+0000","last_undegraded":"2023-10-06T02:57:59.778799+0000","last_fullsized":"2023-10-06T02:57:59.778799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778051+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:57:59.778051+0000","last_peered":"2023-10-06T02:57:59.778051+0000","last_clean":"2023-10-06T02:57:59.778051+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:57:59.778051+0000","last_undegraded":"2023-10-06T02:57:59.778051+0000","last_fullsized":"2023-10-06T02:57:59.778051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778882+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:57:59.778882+0000","last_peered":"2023-10-06T02:57:59.778882+0000","last_clean":"2023-10-06T02:57:59.778882+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:57:59.778882+0000","last_undegraded":"2023-10-06T02:57:59.778882+0000","last_fullsized":"2023-10-06T02:57:59.778882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.779461+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:57:59.779461+0000","last_peered":"2023-10-06T02:57:59.779461+0000","last_clean":"2023-10-06T02:57:59.779461+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:57:59.779461+0000","last_undegraded":"2023-10-06T02:57:59.779461+0000","last_fullsized":"2023-10-06T02:57:59.779461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778680+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:57:59.778680+0000","last_peered":"2023-10-06T02:57:59.778680+0000","last_clean":"2023-10-06T02:57:59.778680+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:57:59.778680+0000","last_undegraded":"2023-10-06T02:57:59.778680+0000","last_fullsized":"2023-10-06T02:57:59.778680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.314,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.75600000000000001,"5min":0.84299999999999997,"15min":1.393},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.433,"5min":0.33500000000000002,"15min":0.27300000000000002},"max":{"1min":0.60899999999999999,"5min":0.749,"15min":1.081},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.42199999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.78400000000000003,"5min":0.83599999999999997,"15min":1.4710000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.52100000000000002},"min":{"1min":0.52500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":4.8129999999999997},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.81799999999999995,"15min":3.4870000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.46600000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":2.2349999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.0009999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.78600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.95599999999999996},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.33200000000000002},"max":{"1min":0.79900000000000004,"5min":0.84999999999999998,"15min":0.85799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.77400000000000002,"15min":2.8650000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.255},"max":{"1min":0.749,"5min":0.749,"15min":1.879},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.92000000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.75},"min":{"1min":0.375,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.495}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.30399999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":1.0580000000000001},"last":0.621}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42799999999999999,"5min":0.33900000000000002,"15min":0.29499999999999998},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":1.163},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47399999999999998,"15min":0.50900000000000001},"min":{"1min":0.377,"5min":0.26700000000000002,"15min":0.23000000000000001},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.05},"last":0.44},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.86799999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.497,"15min":0.51300000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.83999999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.57099999999999995},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.31900000000000001},"max":{"1min":0.81899999999999995,"5min":0.84899999999999998,"15min":1.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.89500000000000002},"last":0.67400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":15409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":179902,"statfs":{"total":200000000,"available":184220540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.32400000000000001,"15min":0.317},"min":{"1min":0.245,"5min":0.20300000000000001,"15min":0.188},"max":{"1min":0.42099999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.34599999999999997},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.499,"5min":0.58299999999999996,"15min":0.61799999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.33300000000000002},"min":{"1min":0.28199999999999997,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.44600000000000001,"5min":0.51700000000000002,"15min":0.65400000000000003},"last":0.308},{"interface":"front","average":{"1min":0.379,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.498,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.63100000000000001},"last":0.374},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.23400000000000001},"max":{"1min":0.44700000000000001,"5min":0.628,"15min":0.628},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":1.157,"15min":1.157},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":0.84099999999999997,"15min":0.92000000000000004},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.82299999999999995,"15min":0.96299999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.372,"15min":0.36799999999999999},"max":{"1min":0.73399999999999999,"5min":0.81299999999999994,"15min":0.92000000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.91400000000000003,"15min":1.006},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":0.84199999999999997,"15min":0.88200000000000001},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.19900000000000001},"max":{"1min":0.496,"5min":0.496,"15min":1.177},"last":0.378},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.39300000000000002},"min":{"1min":0.28899999999999998,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":0.73999999999999999,"15min":1.3400000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.69199999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.188},"max":{"1min":0.45200000000000001,"5min":0.52300000000000002,"15min":22.038},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.21299999999999999},"max":{"1min":0.505,"5min":0.77900000000000003,"15min":1.3779999999999999},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.28299999999999997,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":1.1439999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40500000000000003,"15min":0.73299999999999998},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.89700000000000002,"15min":21.942},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.32800000000000001},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":1.9390000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.32900000000000001},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":11.122999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.89500000000000002},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.93100000000000005,"15min":22.010999999999999},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":1.0980000000000001,"15min":1.401},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59299999999999997,"15min":0.878},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.67700000000000005,"5min":0.83599999999999997,"15min":11.090999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.92300000000000004},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":2.7389999999999999,"15min":21.98},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":1.425},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.755},"min":{"1min":0.436,"5min":0.41799999999999998,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.999,"15min":11.154},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.183,"15min":0.16900000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58699999999999997},"last":0.373},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.28399999999999997,"5min":0.224,"15min":0.186},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.60699999999999998},"last":0.217}]},{"osd":1,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.67200000000000004,"15min":0.68200000000000005},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.317,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.63500000000000001,"15min":0.84499999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.28599999999999998,"5min":0.251,"15min":0.23999999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.70999999999999996},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":1.056},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.83199999999999996,"15min":0.95099999999999996},"last":0.33900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.98699999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.2569999999999999},"last":0.35399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.33800000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.0660000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.002},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.873,"15min":0.96999999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.0449999999999999},"last":0.38600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33500000000000002,"15min":0.318},"min":{"1min":0.22900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.57499999999999996},"last":0.254},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61299999999999999,"5min":0.748,"15min":0.84899999999999998},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.34999999999999998},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.66300000000000003,"15min":0.69999999999999996},"last":0.311},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.59599999999999997,"5min":0.68500000000000005,"15min":0.71199999999999997},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.29999999999999999,"5min":0.24199999999999999,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.67700000000000005,"15min":3.044},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.378},"min":{"1min":0.32500000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.57899999999999996,"5min":0.70899999999999996,"15min":0.72799999999999998},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":2.2120000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.32700000000000001},"max":{"1min":0.83299999999999996,"5min":0.84899999999999998,"15min":2.25},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.376,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.88100000000000001,"15min":6.4189999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.268},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.373,"15min":0.34300000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.218},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.8340000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.77800000000000002},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.86799999999999999,"5min":0.877,"15min":14.912000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.4990000000000001},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.27200000000000002,"15min":0.23699999999999999},"max":{"1min":0.76800000000000002,"5min":1.069,"15min":5.8949999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.28999999999999998,"15min":0.221},"max":{"1min":0.746,"5min":1.1639999999999999,"15min":5.3579999999999997},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.67200000000000004},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":1.109,"15min":5.9329999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":1.2310000000000001,"15min":5.9820000000000002},"last":0.31}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.29099999999999998},"max":{"1min":0.755,"5min":1.083,"15min":5.4390000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56399999999999995,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":1.252,"15min":5.3470000000000004},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.70499999999999996,"5min":1.093,"15min":3.4100000000000001},"last":0.378},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":1.1839999999999999,"15min":3.456},"last":0.44900000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.245},"max":{"1min":0.63600000000000001,"5min":1.036,"15min":1.036},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.496,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.69199999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42799999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.50800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61499999999999999,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.68700000000000006,"5min":0.94299999999999995,"15min":1.0489999999999999},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61699999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.498},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.80000000000000004},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":1.133,"15min":13.173999999999999},"last":0.58799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.219},"max":{"1min":0.65700000000000003,"5min":0.76400000000000001,"15min":0.79100000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":2.0619999999999998},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.3540000000000001},"last":0.621},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.28000000000000003},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":4.6269999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":1.3779999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.745,"5min":0.75,"15min":0.83799999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.36599999999999999,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.82599999999999996},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.89300000000000002},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.76700000000000002,"15min":0.84999999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.879},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.307,"15min":0.307},"max":{"1min":0.755,"5min":0.877,"15min":0.877},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.75}]}]}],"pool_statfs":[]}} 2023-10-06T02:58:03.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.272+0000 7f451c12a700 1 Processor -- start 2023-10-06T02:58:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.272+0000 7f451c12a700 1 -- start start 2023-10-06T02:58:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.273+0000 7f451c12a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4514157ca0 0x7f45140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.273+0000 7f451c12a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f451406d120 0x7f451406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.273+0000 7f451c12a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451406dac0 con 0x7f45141578d0 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.273+0000 7f451c12a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45140d07c0 con 0x7f451406d120 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.273+0000 7f451c12a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140cfbb0 con 0x7f4514157ca0 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.273+0000 7f451a6c7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f451406d120 0x7f451406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.273+0000 7f4519ec6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45141578d0 0x7f451415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43964/0 (socket says 172.21.15.81:43964) 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.273+0000 7f4519ec6700 1 -- 172.21.15.81:0/803019183 learned_addr learned my addr 172.21.15.81:0/803019183 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f45196c5700 1 --2- 172.21.15.81:0/803019183 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4514157ca0 0x7f45140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451a6c7700 1 -- 172.21.15.81:0/803019183 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4514157ca0 msgr2=0x7f45140cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451a6c7700 1 --2- 172.21.15.81:0/803019183 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4514157ca0 0x7f45140cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451a6c7700 1 -- 172.21.15.81:0/803019183 >> v1:172.21.15.81:6789/0 conn(0x7f45141578d0 legacy=0x7f451415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451a6c7700 1 -- 172.21.15.81:0/803019183 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140cfe90 con 0x7f451406d120 2023-10-06T02:58:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f4518ec4700 1 -- 172.21.15.81:0/803019183 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373634927 0 0) 0x7f4510001490 con 0x7f45141578d0 2023-10-06T02:58:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451a6c7700 1 --2- 172.21.15.81:0/803019183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 0x7f451406d580 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f450c0098e0 tx=0x7f450c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf96b7f221dce54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f4518ec4700 1 -- 172.21.15.81:0/803019183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c009e80 con 0x7f451406d120 2023-10-06T02:58:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f4518ec4700 1 -- 172.21.15.81:0/803019183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c00b860 con 0x7f451406d120 2023-10-06T02:58:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f4518ec4700 1 -- 172.21.15.81:0/803019183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00bbe0 con 0x7f451406d120 2023-10-06T02:58:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451c12a700 1 -- 172.21.15.81:0/803019183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 msgr2=0x7f451406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451c12a700 1 --2- 172.21.15.81:0/803019183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 0x7f451406d580 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f450c0098e0 tx=0x7f450c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451c12a700 1 -- 172.21.15.81:0/803019183 shutdown_connections 2023-10-06T02:58:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451c12a700 1 --2- 172.21.15.81:0/803019183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 0x7f451406d580 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451c12a700 1 --2- 172.21.15.81:0/803019183 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4514157ca0 0x7f45140cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.274+0000 7f451c12a700 1 -- 172.21.15.81:0/803019183 >> 172.21.15.81:0/803019183 conn(0x7f451406bb90 msgr2=0x7f451406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.275+0000 7f451c12a700 1 -- 172.21.15.81:0/803019183 shutdown_connections 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.275+0000 7f451c12a700 1 -- 172.21.15.81:0/803019183 wait complete. 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f451c12a700 1 Processor -- start 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f451c12a700 1 -- start start 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f451c12a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 0x7f45140ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f451c12a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45141578d0 0x7f45140adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f451c12a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4514157ca0 0x7f451416dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f451c12a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140abe80 con 0x7f451406d120 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f451c12a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140ab270 con 0x7f4514157ca0 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f451c12a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140ab550 con 0x7f45141578d0 2023-10-06T02:58:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f4519ec6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 0x7f45140ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f4519ec6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 0x7f45140ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51150/0 (socket says 172.21.15.81:51150) 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.276+0000 7f4519ec6700 1 -- 172.21.15.81:0/3696851740 learned_addr learned my addr 172.21.15.81:0/3696851740 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f45196c5700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45141578d0 0x7f45140adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f451a6c7700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4514157ca0 0x7f451416dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f4519ec6700 1 -- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45141578d0 msgr2=0x7f45140adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f4519ec6700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45141578d0 0x7f45140adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f4519ec6700 1 -- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4514157ca0 msgr2=0x7f451416dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f4519ec6700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4514157ca0 0x7f451416dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f4519ec6700 1 -- 172.21.15.81:0/3696851740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c009420 con 0x7f451406d120 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f4519ec6700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 0x7f45140ada90 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f451000cd80 tx=0x7f4510001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:03.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f4509ffb700 1 -- 172.21.15.81:0/3696851740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000ce80 con 0x7f451406d120 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f4509ffb700 1 -- 172.21.15.81:0/3696851740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451000aac0 con 0x7f451406d120 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45140ab830 con 0x7f451406d120 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f4509ffb700 1 -- 172.21.15.81:0/3696851740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000ae40 con 0x7f451406d120 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.277+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451416e1d0 con 0x7f451406d120 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.278+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4514067ac0 con 0x7f451406d120 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.279+0000 7f4509ffb700 1 -- 172.21.15.81:0/3696851740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4510007300 con 0x7f451406d120 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.279+0000 7f4509ffb700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f44f8066f30 0x7f44f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.279+0000 7f4509ffb700 1 -- 172.21.15.81:0/3696851740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f45100845f0 con 0x7f451406d120 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.279+0000 7f45196c5700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f44f8066f30 0x7f44f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.280+0000 7f45196c5700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f44f8066f30 0x7f44f80693e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f45140ab060 tx=0x7f4504008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:03.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.283+0000 7f4509ffb700 1 -- 172.21.15.81:0/3696851740 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4510055510 con 0x7f451406d120 2023-10-06T02:58:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.464+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45140abfc0 con 0x7f44f8066f30 2023-10-06T02:58:03.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.467+0000 7f4509ffb700 1 -- 172.21.15.81:0/3696851740 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70383 (secure 0 0 0) 0x7f450400bdd0 con 0x7f44f8066f30 2023-10-06T02:58:03.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:58:03.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.468+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f44f8066f30 msgr2=0x7f44f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f44f8066f30 0x7f44f80693e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f45140ab060 tx=0x7f4504008040 comp rx=0 tx=0).stop 2023-10-06T02:58:03.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 msgr2=0x7f45140ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 0x7f45140ada90 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f451000cd80 tx=0x7f4510001ad0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 shutdown_connections 2023-10-06T02:58:03.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f44f8066f30 0x7f44f80693e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4514157ca0 0x7f451416dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451406d120 0x7f45140ada90 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 --2- 172.21.15.81:0/3696851740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45141578d0 0x7f45140adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 >> 172.21.15.81:0/3696851740 conn(0x7f451406bb90 msgr2=0x7f4514155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:03.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 shutdown_connections 2023-10-06T02:58:03.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.469+0000 7f451c12a700 1 -- 172.21.15.81:0/3696851740 wait complete. 2023-10-06T02:58:03.471 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:58:03.482 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2023-10-06T02:58:01.665233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":24118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1538381,"statfs":{"total":1600000000,"available":1575302690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-44025,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-97,"num_write_kb":-33860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001171"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.781490+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:57:59.781490+0000","last_peered":"2023-10-06T02:57:59.781490+0000","last_clean":"2023-10-06T02:57:59.781490+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:57:59.781490+0000","last_undegraded":"2023-10-06T02:57:59.781490+0000","last_fullsized":"2023-10-06T02:57:59.781490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.490095+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:57:59.490095+0000","last_peered":"2023-10-06T02:57:59.490095+0000","last_clean":"2023-10-06T02:57:59.490095+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:57:59.490095+0000","last_undegraded":"2023-10-06T02:57:59.490095+0000","last_fullsized":"2023-10-06T02:57:59.490095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.491486+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:57:59.491486+0000","last_peered":"2023-10-06T02:57:59.491486+0000","last_clean":"2023-10-06T02:57:59.491486+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:57:59.491486+0000","last_undegraded":"2023-10-06T02:57:59.491486+0000","last_fullsized":"2023-10-06T02:57:59.491486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.490176+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:57:59.490176+0000","last_peered":"2023-10-06T02:57:59.490176+0000","last_clean":"2023-10-06T02:57:59.490176+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:57:59.490176+0000","last_undegraded":"2023-10-06T02:57:59.490176+0000","last_fullsized":"2023-10-06T02:57:59.490176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":309,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778799+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:57:59.778799+0000","last_peered":"2023-10-06T02:57:59.778799+0000","last_clean":"2023-10-06T02:57:59.778799+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:57:59.778799+0000","last_undegraded":"2023-10-06T02:57:59.778799+0000","last_fullsized":"2023-10-06T02:57:59.778799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778051+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:57:59.778051+0000","last_peered":"2023-10-06T02:57:59.778051+0000","last_clean":"2023-10-06T02:57:59.778051+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:57:59.778051+0000","last_undegraded":"2023-10-06T02:57:59.778051+0000","last_fullsized":"2023-10-06T02:57:59.778051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778882+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:57:59.778882+0000","last_peered":"2023-10-06T02:57:59.778882+0000","last_clean":"2023-10-06T02:57:59.778882+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:57:59.778882+0000","last_undegraded":"2023-10-06T02:57:59.778882+0000","last_fullsized":"2023-10-06T02:57:59.778882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.779461+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:57:59.779461+0000","last_peered":"2023-10-06T02:57:59.779461+0000","last_clean":"2023-10-06T02:57:59.779461+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:57:59.779461+0000","last_undegraded":"2023-10-06T02:57:59.779461+0000","last_fullsized":"2023-10-06T02:57:59.779461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778680+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:57:59.778680+0000","last_peered":"2023-10-06T02:57:59.778680+0000","last_clean":"2023-10-06T02:57:59.778680+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:57:59.778680+0000","last_undegraded":"2023-10-06T02:57:59.778680+0000","last_fullsized":"2023-10-06T02:57:59.778680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.314,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.75600000000000001,"5min":0.84299999999999997,"15min":1.393},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.433,"5min":0.33500000000000002,"15min":0.27300000000000002},"max":{"1min":0.60899999999999999,"5min":0.749,"15min":1.081},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.42199999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.78400000000000003,"5min":0.83599999999999997,"15min":1.4710000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.52100000000000002},"min":{"1min":0.52500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":4.8129999999999997},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.81799999999999995,"15min":3.4870000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.46600000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":2.2349999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.0009999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.78600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.95599999999999996},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.33200000000000002},"max":{"1min":0.79900000000000004,"5min":0.84999999999999998,"15min":0.85799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.77400000000000002,"15min":2.8650000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.255},"max":{"1min":0.749,"5min":0.749,"15min":1.879},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.92000000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.75},"min":{"1min":0.375,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.495}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.30399999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":1.0580000000000001},"last":0.621}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42799999999999999,"5min":0.33900000000000002,"15min":0.29499999999999998},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":1.163},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47399999999999998,"15min":0.50900000000000001},"min":{"1min":0.377,"5min":0.26700000000000002,"15min":0.23000000000000001},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.05},"last":0.44},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.86799999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.497,"15min":0.51300000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.83999999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.57099999999999995},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.31900000000000001},"max":{"1min":0.81899999999999995,"5min":0.84899999999999998,"15min":1.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.89500000000000002},"last":0.67400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":15409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":179902,"statfs":{"total":200000000,"available":184220540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.32400000000000001,"15min":0.317},"min":{"1min":0.245,"5min":0.20300000000000001,"15min":0.188},"max":{"1min":0.42099999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.34599999999999997},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.499,"5min":0.58299999999999996,"15min":0.61799999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.33300000000000002},"min":{"1min":0.28199999999999997,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.44600000000000001,"5min":0.51700000000000002,"15min":0.65400000000000003},"last":0.308},{"interface":"front","average":{"1min":0.379,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.498,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.63100000000000001},"last":0.374},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.23400000000000001},"max":{"1min":0.44700000000000001,"5min":0.628,"15min":0.628},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":1.157,"15min":1.157},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":0.84099999999999997,"15min":0.92000000000000004},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.82299999999999995,"15min":0.96299999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.372,"15min":0.36799999999999999},"max":{"1min":0.73399999999999999,"5min":0.81299999999999994,"15min":0.92000000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.91400000000000003,"15min":1.006},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":0.84199999999999997,"15min":0.88200000000000001},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.19900000000000001},"max":{"1min":0.496,"5min":0.496,"15min":1.177},"last":0.378},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.39300000000000002},"min":{"1min":0.28899999999999998,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":0.73999999999999999,"15min":1.3400000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.69199999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.188},"max":{"1min":0.45200000000000001,"5min":0.52300000000000002,"15min":22.038},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.21299999999999999},"max":{"1min":0.505,"5min":0.77900000000000003,"15min":1.3779999999999999},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.28299999999999997,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":1.1439999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40500000000000003,"15min":0.73299999999999998},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.89700000000000002,"15min":21.942},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.32800000000000001},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":1.9390000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.32900000000000001},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":11.122999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.89500000000000002},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.93100000000000005,"15min":22.010999999999999},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":1.0980000000000001,"15min":1.401},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59299999999999997,"15min":0.878},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.67700000000000005,"5min":0.83599999999999997,"15min":11.090999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.92300000000000004},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":2.7389999999999999,"15min":21.98},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":1.425},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.755},"min":{"1min":0.436,"5min":0.41799999999999998,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.999,"15min":11.154},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.183,"15min":0.16900000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58699999999999997},"last":0.373},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.28399999999999997,"5min":0.224,"15min":0.186},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.60699999999999998},"last":0.217}]},{"osd":1,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.67200000000000004,"15min":0.68200000000000005},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.317,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.63500000000000001,"15min":0.84499999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.28599999999999998,"5min":0.251,"15min":0.23999999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.70999999999999996},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":1.056},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.83199999999999996,"15min":0.95099999999999996},"last":0.33900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.98699999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.2569999999999999},"last":0.35399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.33800000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.0660000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.002},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.873,"15min":0.96999999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.0449999999999999},"last":0.38600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33500000000000002,"15min":0.318},"min":{"1min":0.22900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.57499999999999996},"last":0.254},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61299999999999999,"5min":0.748,"15min":0.84899999999999998},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.34999999999999998},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.66300000000000003,"15min":0.69999999999999996},"last":0.311},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.59599999999999997,"5min":0.68500000000000005,"15min":0.71199999999999997},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.29999999999999999,"5min":0.24199999999999999,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.67700000000000005,"15min":3.044},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.378},"min":{"1min":0.32500000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.57899999999999996,"5min":0.70899999999999996,"15min":0.72799999999999998},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":2.2120000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.32700000000000001},"max":{"1min":0.83299999999999996,"5min":0.84899999999999998,"15min":2.25},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.376,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.88100000000000001,"15min":6.4189999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.268},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.373,"15min":0.34300000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.218},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.8340000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.77800000000000002},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.86799999999999999,"5min":0.877,"15min":14.912000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.4990000000000001},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.27200000000000002,"15min":0.23699999999999999},"max":{"1min":0.76800000000000002,"5min":1.069,"15min":5.8949999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.28999999999999998,"15min":0.221},"max":{"1min":0.746,"5min":1.1639999999999999,"15min":5.3579999999999997},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.67200000000000004},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":1.109,"15min":5.9329999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":1.2310000000000001,"15min":5.9820000000000002},"last":0.31}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.29099999999999998},"max":{"1min":0.755,"5min":1.083,"15min":5.4390000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56399999999999995,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":1.252,"15min":5.3470000000000004},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.70499999999999996,"5min":1.093,"15min":3.4100000000000001},"last":0.378},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":1.1839999999999999,"15min":3.456},"last":0.44900000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.245},"max":{"1min":0.63600000000000001,"5min":1.036,"15min":1.036},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.496,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.69199999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42799999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.50800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61499999999999999,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.68700000000000006,"5min":0.94299999999999995,"15min":1.0489999999999999},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61699999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.498},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.80000000000000004},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":1.133,"15min":13.173999999999999},"last":0.58799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.219},"max":{"1min":0.65700000000000003,"5min":0.76400000000000001,"15min":0.79100000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":2.0619999999999998},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.3540000000000001},"last":0.621},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.28000000000000003},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":4.6269999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":1.3779999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.745,"5min":0.75,"15min":0.83799999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.36599999999999999,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.82599999999999996},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.89300000000000002},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.76700000000000002,"15min":0.84999999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.879},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.307,"15min":0.307},"max":{"1min":0.755,"5min":0.877,"15min":0.877},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.75}]}]}],"pool_statfs":[]}} 2023-10-06T02:58:03.484 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T02:58:03.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.597+0000 7f10ef33b700 1 Processor -- start 2023-10-06T02:58:03.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.598+0000 7f10ef33b700 1 -- start start 2023-10-06T02:58:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.598+0000 7f10ef33b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10e806d830 0x7f10e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.598+0000 7f10ef33b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e80d07c0 con 0x7f10e81578d0 2023-10-06T02:58:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.598+0000 7f10ef33b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e80cfbb0 con 0x7f10e8157ca0 2023-10-06T02:58:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.598+0000 7f10ef33b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80cfe90 con 0x7f10e806d830 2023-10-06T02:58:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.599+0000 7f10ed8d8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10e806d830 0x7f10e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.598+0000 7f10ed0d7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f10e81578d0 0x7f10e815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43978/0 (socket says 172.21.15.81:43978) 2023-10-06T02:58:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.599+0000 7f10ed0d7700 1 -- 172.21.15.81:0/4073148264 learned_addr learned my addr 172.21.15.81:0/4073148264 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.599+0000 7f10ed8d8700 1 -- 172.21.15.81:0/4073148264 >> v1:172.21.15.83:6789/0 conn(0x7f10e8157ca0 legacy=0x7f10e806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.599+0000 7f10ed8d8700 1 -- 172.21.15.81:0/4073148264 >> v1:172.21.15.81:6789/0 conn(0x7f10e81578d0 legacy=0x7f10e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.599+0000 7f10ed8d8700 1 -- 172.21.15.81:0/4073148264 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80d0170 con 0x7f10e806d830 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.599+0000 7f10ed8d8700 1 --2- 172.21.15.81:0/4073148264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e806d830 0x7f10e80cf4f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009e60 tx=0x7f10e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92233860444486b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.599+0000 7f10dffff700 1 -- 172.21.15.81:0/4073148264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e000e070 con 0x7f10e806d830 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.599+0000 7f10dffff700 1 -- 172.21.15.81:0/4073148264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e000bbf0 con 0x7f10e806d830 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.599+0000 7f10dffff700 1 -- 172.21.15.81:0/4073148264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0012430 con 0x7f10e806d830 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.600+0000 7f10ef33b700 1 -- 172.21.15.81:0/4073148264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e806d830 msgr2=0x7f10e80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.600+0000 7f10ef33b700 1 --2- 172.21.15.81:0/4073148264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e806d830 0x7f10e80cf4f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009e60 tx=0x7f10e0009780 comp rx=0 tx=0).stop 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.600+0000 7f10ef33b700 1 -- 172.21.15.81:0/4073148264 shutdown_connections 2023-10-06T02:58:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.600+0000 7f10ef33b700 1 --2- 172.21.15.81:0/4073148264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e806d830 0x7f10e80cf4f0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.600+0000 7f10ef33b700 1 -- 172.21.15.81:0/4073148264 >> 172.21.15.81:0/4073148264 conn(0x7f10e806bb90 msgr2=0x7f10e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.600+0000 7f10ef33b700 1 -- 172.21.15.81:0/4073148264 shutdown_connections 2023-10-06T02:58:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.600+0000 7f10ef33b700 1 -- 172.21.15.81:0/4073148264 wait complete. 2023-10-06T02:58:03.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.601+0000 7f10ef33b700 1 Processor -- start 2023-10-06T02:58:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.601+0000 7f10ef33b700 1 -- start start 2023-10-06T02:58:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ef33b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e806d830 0x7f10e81538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ef33b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e81578d0 0x7f10e816a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ef33b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e8157ca0 0x7f10e80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ef33b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80b4560 con 0x7f10e8157ca0 2023-10-06T02:58:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ef33b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80b47c0 con 0x7f10e81578d0 2023-10-06T02:58:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ef33b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80b4aa0 con 0x7f10e806d830 2023-10-06T02:58:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed8d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e8157ca0 0x7f10e80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed8d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e8157ca0 0x7f10e80c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51176/0 (socket says 172.21.15.81:51176) 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed8d8700 1 -- 172.21.15.81:0/2220026573 learned_addr learned my addr 172.21.15.81:0/2220026573 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed0d7700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e806d830 0x7f10e81538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ec8d6700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e81578d0 0x7f10e816a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed8d8700 1 -- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e806d830 msgr2=0x7f10e81538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed8d8700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e806d830 0x7f10e81538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed8d8700 1 -- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e81578d0 msgr2=0x7f10e816a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed8d8700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e81578d0 0x7f10e816a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed8d8700 1 -- 172.21.15.81:0/2220026573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0009a20 con 0x7f10e8157ca0 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ec8d6700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e81578d0 0x7f10e816a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ed8d8700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e8157ca0 0x7f10e80c5b20 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f10e806fe20 tx=0x7f10e0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10dd7fa700 1 -- 172.21.15.81:0/2220026573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e001e640 con 0x7f10e8157ca0 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10dd7fa700 1 -- 172.21.15.81:0/2220026573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e001e7a0 con 0x7f10e8157ca0 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e80b4d80 con 0x7f10e8157ca0 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10dd7fa700 1 -- 172.21.15.81:0/2220026573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e001eb60 con 0x7f10e8157ca0 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.602+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e8153e10 con 0x7f10e8157ca0 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.603+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e80b52a0 con 0x7f10e8157ca0 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.604+0000 7f10dd7fa700 1 -- 172.21.15.81:0/2220026573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10e0024070 con 0x7f10e8157ca0 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.604+0000 7f10dd7fa700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10cc066f60 0x7f10cc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.604+0000 7f10dd7fa700 1 -- 172.21.15.81:0/2220026573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f10e0086ed0 con 0x7f10e8157ca0 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.604+0000 7f10ed0d7700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10cc066f60 0x7f10cc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.605+0000 7f10ed0d7700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10cc066f60 0x7f10cc069410 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f10e4001820 tx=0x7f10e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:03.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.608+0000 7f10dd7fa700 1 -- 172.21.15.81:0/2220026573 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10e80b52a0 con 0x7f10e8157ca0 2023-10-06T02:58:03.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.790+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10e80b52a0 con 0x7f10cc066f60 2023-10-06T02:58:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.793+0000 7f10dd7fa700 1 -- 172.21.15.81:0/2220026573 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70387 (secure 0 0 0) 0x7f10e80b52a0 con 0x7f10cc066f60 2023-10-06T02:58:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:58:03.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10cc066f60 msgr2=0x7f10cc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10cc066f60 0x7f10cc069410 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f10e4001820 tx=0x7f10e4009040 comp rx=0 tx=0).stop 2023-10-06T02:58:03.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e8157ca0 msgr2=0x7f10e80c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e8157ca0 0x7f10e80c5b20 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f10e806fe20 tx=0x7f10e0018000 comp rx=0 tx=0).stop 2023-10-06T02:58:03.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 shutdown_connections 2023-10-06T02:58:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e8157ca0 0x7f10e80c5b20 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10e806d830 0x7f10e81538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f10cc066f60 0x7f10cc069410 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 --2- 172.21.15.81:0/2220026573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10e81578d0 0x7f10e816a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 >> 172.21.15.81:0/2220026573 conn(0x7f10e806bb90 msgr2=0x7f10e806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:03.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 shutdown_connections 2023-10-06T02:58:03.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.795+0000 7f10ef33b700 1 -- 172.21.15.81:0/2220026573 wait complete. 2023-10-06T02:58:03.799 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:58:03.808 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-06T02:58:03.665541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":24118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1538381,"statfs":{"total":1600000000,"available":1575302690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-120,"num_write_kb":-85081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.118099"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.781490+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:57:59.781490+0000","last_peered":"2023-10-06T02:57:59.781490+0000","last_clean":"2023-10-06T02:57:59.781490+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:57:59.781490+0000","last_undegraded":"2023-10-06T02:57:59.781490+0000","last_fullsized":"2023-10-06T02:57:59.781490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.490095+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:57:59.490095+0000","last_peered":"2023-10-06T02:57:59.490095+0000","last_clean":"2023-10-06T02:57:59.490095+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:57:59.490095+0000","last_undegraded":"2023-10-06T02:57:59.490095+0000","last_fullsized":"2023-10-06T02:57:59.490095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.491486+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:57:59.491486+0000","last_peered":"2023-10-06T02:57:59.491486+0000","last_clean":"2023-10-06T02:57:59.491486+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:57:59.491486+0000","last_undegraded":"2023-10-06T02:57:59.491486+0000","last_fullsized":"2023-10-06T02:57:59.491486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.490176+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:57:59.490176+0000","last_peered":"2023-10-06T02:57:59.490176+0000","last_clean":"2023-10-06T02:57:59.490176+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:57:59.490176+0000","last_undegraded":"2023-10-06T02:57:59.490176+0000","last_fullsized":"2023-10-06T02:57:59.490176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":309,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778799+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:57:59.778799+0000","last_peered":"2023-10-06T02:57:59.778799+0000","last_clean":"2023-10-06T02:57:59.778799+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:57:59.778799+0000","last_undegraded":"2023-10-06T02:57:59.778799+0000","last_fullsized":"2023-10-06T02:57:59.778799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778051+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:57:59.778051+0000","last_peered":"2023-10-06T02:57:59.778051+0000","last_clean":"2023-10-06T02:57:59.778051+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:57:59.778051+0000","last_undegraded":"2023-10-06T02:57:59.778051+0000","last_fullsized":"2023-10-06T02:57:59.778051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778882+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:57:59.778882+0000","last_peered":"2023-10-06T02:57:59.778882+0000","last_clean":"2023-10-06T02:57:59.778882+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:57:59.778882+0000","last_undegraded":"2023-10-06T02:57:59.778882+0000","last_fullsized":"2023-10-06T02:57:59.778882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.779461+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:57:59.779461+0000","last_peered":"2023-10-06T02:57:59.779461+0000","last_clean":"2023-10-06T02:57:59.779461+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:57:59.779461+0000","last_undegraded":"2023-10-06T02:57:59.779461+0000","last_fullsized":"2023-10-06T02:57:59.779461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:16.124105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778680+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:57:59.778680+0000","last_peered":"2023-10-06T02:57:59.778680+0000","last_clean":"2023-10-06T02:57:59.778680+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:57:59.778680+0000","last_undegraded":"2023-10-06T02:57:59.778680+0000","last_fullsized":"2023-10-06T02:57:59.778680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.314,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.75600000000000001,"5min":0.84299999999999997,"15min":1.393},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.433,"5min":0.33500000000000002,"15min":0.27300000000000002},"max":{"1min":0.60899999999999999,"5min":0.749,"15min":1.081},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.42199999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.78400000000000003,"5min":0.83599999999999997,"15min":1.4710000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.52100000000000002},"min":{"1min":0.52500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":4.8129999999999997},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.81799999999999995,"15min":3.4870000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.46600000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":2.2349999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.0009999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.78600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.95599999999999996},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.33200000000000002},"max":{"1min":0.79900000000000004,"5min":0.84999999999999998,"15min":0.85799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.77400000000000002,"15min":2.8650000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.255},"max":{"1min":0.749,"5min":0.749,"15min":1.879},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.92000000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.75},"min":{"1min":0.375,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.495}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.30399999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":1.0580000000000001},"last":0.621}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42799999999999999,"5min":0.33900000000000002,"15min":0.29499999999999998},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":1.163},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47399999999999998,"15min":0.50900000000000001},"min":{"1min":0.377,"5min":0.26700000000000002,"15min":0.23000000000000001},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.05},"last":0.44},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.86799999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.497,"15min":0.51300000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.83999999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.57099999999999995},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.31900000000000001},"max":{"1min":0.81899999999999995,"5min":0.84899999999999998,"15min":1.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.89500000000000002},"last":0.67400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":15409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":179902,"statfs":{"total":200000000,"available":184220540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.32400000000000001,"15min":0.317},"min":{"1min":0.245,"5min":0.20300000000000001,"15min":0.188},"max":{"1min":0.42099999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.34599999999999997},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.499,"5min":0.58299999999999996,"15min":0.61799999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.33300000000000002},"min":{"1min":0.28199999999999997,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.44600000000000001,"5min":0.51700000000000002,"15min":0.65400000000000003},"last":0.308},{"interface":"front","average":{"1min":0.379,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.498,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.63100000000000001},"last":0.374},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.23400000000000001},"max":{"1min":0.44700000000000001,"5min":0.628,"15min":0.628},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":1.157,"15min":1.157},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":0.84099999999999997,"15min":0.92000000000000004},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.82299999999999995,"15min":0.96299999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.372,"15min":0.36799999999999999},"max":{"1min":0.73399999999999999,"5min":0.81299999999999994,"15min":0.92000000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.91400000000000003,"15min":1.006},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":0.84199999999999997,"15min":0.88200000000000001},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.19900000000000001},"max":{"1min":0.496,"5min":0.496,"15min":1.177},"last":0.378},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.39300000000000002},"min":{"1min":0.28899999999999998,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":0.73999999999999999,"15min":1.3400000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.69199999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.188},"max":{"1min":0.45200000000000001,"5min":0.52300000000000002,"15min":22.038},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.21299999999999999},"max":{"1min":0.505,"5min":0.77900000000000003,"15min":1.3779999999999999},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.28299999999999997,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":1.1439999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40500000000000003,"15min":0.73299999999999998},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.89700000000000002,"15min":21.942},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.32800000000000001},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":1.9390000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.32900000000000001},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":11.122999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.89500000000000002},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.93100000000000005,"15min":22.010999999999999},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":1.0980000000000001,"15min":1.401},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59299999999999997,"15min":0.878},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.67700000000000005,"5min":0.83599999999999997,"15min":11.090999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.92300000000000004},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":2.7389999999999999,"15min":21.98},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":1.425},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.755},"min":{"1min":0.436,"5min":0.41799999999999998,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.999,"15min":11.154},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.183,"15min":0.16900000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58699999999999997},"last":0.373},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.28399999999999997,"5min":0.224,"15min":0.186},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.60699999999999998},"last":0.217}]},{"osd":1,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.67200000000000004,"15min":0.68200000000000005},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.317,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.63500000000000001,"15min":0.84499999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.28599999999999998,"5min":0.251,"15min":0.23999999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.70999999999999996},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":1.056},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.83199999999999996,"15min":0.95099999999999996},"last":0.33900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.98699999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.2569999999999999},"last":0.35399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.33800000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.0660000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.002},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.873,"15min":0.96999999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.0449999999999999},"last":0.38600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33500000000000002,"15min":0.318},"min":{"1min":0.22900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.57499999999999996},"last":0.254},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61299999999999999,"5min":0.748,"15min":0.84899999999999998},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.34999999999999998},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.66300000000000003,"15min":0.69999999999999996},"last":0.311},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.59599999999999997,"5min":0.68500000000000005,"15min":0.71199999999999997},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.29999999999999999,"5min":0.24199999999999999,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.67700000000000005,"15min":3.044},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.378},"min":{"1min":0.32500000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.57899999999999996,"5min":0.70899999999999996,"15min":0.72799999999999998},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":2.2120000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.32700000000000001},"max":{"1min":0.83299999999999996,"5min":0.84899999999999998,"15min":2.25},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.376,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.88100000000000001,"15min":6.4189999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.268},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.373,"15min":0.34300000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.218},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.8340000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.77800000000000002},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.86799999999999999,"5min":0.877,"15min":14.912000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.4990000000000001},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.27200000000000002,"15min":0.23699999999999999},"max":{"1min":0.76800000000000002,"5min":1.069,"15min":5.8949999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.28999999999999998,"15min":0.221},"max":{"1min":0.746,"5min":1.1639999999999999,"15min":5.3579999999999997},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.67200000000000004},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":1.109,"15min":5.9329999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":1.2310000000000001,"15min":5.9820000000000002},"last":0.31}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.29099999999999998},"max":{"1min":0.755,"5min":1.083,"15min":5.4390000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56399999999999995,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":1.252,"15min":5.3470000000000004},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.70499999999999996,"5min":1.093,"15min":3.4100000000000001},"last":0.378},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":1.1839999999999999,"15min":3.456},"last":0.44900000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.245},"max":{"1min":0.63600000000000001,"5min":1.036,"15min":1.036},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.496,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.69199999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42799999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.50800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61499999999999999,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.68700000000000006,"5min":0.94299999999999995,"15min":1.0489999999999999},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61699999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.498},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.80000000000000004},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":1.133,"15min":13.173999999999999},"last":0.58799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.219},"max":{"1min":0.65700000000000003,"5min":0.76400000000000001,"15min":0.79100000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":2.0619999999999998},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.3540000000000001},"last":0.621},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.28000000000000003},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":4.6269999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":1.3779999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.745,"5min":0.75,"15min":0.83799999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.36599999999999999,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.82599999999999996},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.89300000000000002},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.76700000000000002,"15min":0.84999999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.879},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.307,"15min":0.307},"max":{"1min":0.755,"5min":0.877,"15min":0.877},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.75}]}]}],"pool_statfs":[]}} 2023-10-06T02:58:03.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:58:03.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.923+0000 7fde62c19700 1 Processor -- start 2023-10-06T02:58:03.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.924+0000 7fde62c19700 1 -- start start 2023-10-06T02:58:03.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.924+0000 7fde62c19700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde5c157ca0 0x7fde5c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.924+0000 7fde62c19700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde5c06d120 0x7fde5c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.924+0000 7fde62c19700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c06dac0 con 0x7fde5c1578d0 2023-10-06T02:58:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.924+0000 7fde62c19700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c0d07c0 con 0x7fde5c06d120 2023-10-06T02:58:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.924+0000 7fde62c19700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0cfbb0 con 0x7fde5c157ca0 2023-10-06T02:58:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.924+0000 7fde609b5700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fde5c1578d0 0x7fde5c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43994/0 (socket says 172.21.15.81:43994) 2023-10-06T02:58:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.924+0000 7fde611b6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde5c06d120 0x7fde5c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.924+0000 7fde609b5700 1 -- 172.21.15.81:0/2438053641 learned_addr learned my addr 172.21.15.81:0/2438053641 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde537fe700 1 -- 172.21.15.81:0/2438053641 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451464394 0 0) 0x7fde58001490 con 0x7fde5c1578d0 2023-10-06T02:58:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde53fff700 1 --2- 172.21.15.81:0/2438053641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde5c157ca0 0x7fde5c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde537fe700 1 -- 172.21.15.81:0/2438053641 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde44003570 con 0x7fde5c1578d0 2023-10-06T02:58:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde611b6700 1 -- 172.21.15.81:0/2438053641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde5c157ca0 msgr2=0x7fde5c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde611b6700 1 --2- 172.21.15.81:0/2438053641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde5c157ca0 0x7fde5c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde611b6700 1 -- 172.21.15.81:0/2438053641 >> v1:172.21.15.81:6789/0 conn(0x7fde5c1578d0 legacy=0x7fde5c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde611b6700 1 -- 172.21.15.81:0/2438053641 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c0cfe90 con 0x7fde5c06d120 2023-10-06T02:58:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde611b6700 1 --2- 172.21.15.81:0/2438053641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 0x7fde5c06d580 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fde540098e0 tx=0x7fde540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf47a4a5942dbc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde537fe700 1 -- 172.21.15.81:0/2438053641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400b640 con 0x7fde5c06d120 2023-10-06T02:58:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde537fe700 1 -- 172.21.15.81:0/2438053641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400b7a0 con 0x7fde5c06d120 2023-10-06T02:58:03.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.925+0000 7fde537fe700 1 -- 172.21.15.81:0/2438053641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400bb40 con 0x7fde5c06d120 2023-10-06T02:58:03.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.926+0000 7fde62c19700 1 -- 172.21.15.81:0/2438053641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 msgr2=0x7fde5c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.926+0000 7fde62c19700 1 --2- 172.21.15.81:0/2438053641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 0x7fde5c06d580 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fde540098e0 tx=0x7fde540091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.926+0000 7fde62c19700 1 -- 172.21.15.81:0/2438053641 shutdown_connections 2023-10-06T02:58:03.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.926+0000 7fde62c19700 1 --2- 172.21.15.81:0/2438053641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 0x7fde5c06d580 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.926+0000 7fde62c19700 1 --2- 172.21.15.81:0/2438053641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde5c157ca0 0x7fde5c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.926+0000 7fde62c19700 1 -- 172.21.15.81:0/2438053641 >> 172.21.15.81:0/2438053641 conn(0x7fde5c06bb90 msgr2=0x7fde5c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.926+0000 7fde62c19700 1 -- 172.21.15.81:0/2438053641 shutdown_connections 2023-10-06T02:58:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.926+0000 7fde62c19700 1 -- 172.21.15.81:0/2438053641 wait complete. 2023-10-06T02:58:03.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.927+0000 7fde62c19700 1 Processor -- start 2023-10-06T02:58:03.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.927+0000 7fde62c19700 1 -- start start 2023-10-06T02:58:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde62c19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 0x7fde5c1435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde62c19700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde5c1578d0 0x7fde5c0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde62c19700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde5c157ca0 0x7fde5c0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde62c19700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0ab270 con 0x7fde5c06d120 2023-10-06T02:58:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde62c19700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0ab550 con 0x7fde5c157ca0 2023-10-06T02:58:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde62c19700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0ab830 con 0x7fde5c1578d0 2023-10-06T02:58:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde609b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 0x7fde5c1435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde609b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 0x7fde5c1435d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51196/0 (socket says 172.21.15.81:51196) 2023-10-06T02:58:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde609b5700 1 -- 172.21.15.81:0/1678574507 learned_addr learned my addr 172.21.15.81:0/1678574507 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde609b5700 1 -- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde5c1578d0 msgr2=0x7fde5c0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde609b5700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde5c1578d0 0x7fde5c0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde609b5700 1 -- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde5c157ca0 msgr2=0x7fde5c0ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde609b5700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde5c157ca0 0x7fde5c0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde609b5700 1 -- 172.21.15.81:0/1678574507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54009420 con 0x7fde5c06d120 2023-10-06T02:58:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde609b5700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 0x7fde5c1435d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fde5800cd30 tx=0x7fde58001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde50ff9700 1 -- 172.21.15.81:0/1678574507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5800ac00 con 0x7fde5c06d120 2023-10-06T02:58:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde50ff9700 1 -- 172.21.15.81:0/1678574507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5800ad80 con 0x7fde5c06d120 2023-10-06T02:58:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c0abb10 con 0x7fde5c06d120 2023-10-06T02:58:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde50ff9700 1 -- 172.21.15.81:0/1678574507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58007340 con 0x7fde5c06d120 2023-10-06T02:58:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.928+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c143b10 con 0x7fde5c06d120 2023-10-06T02:58:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.929+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c0ac030 con 0x7fde5c06d120 2023-10-06T02:58:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.930+0000 7fde50ff9700 1 -- 172.21.15.81:0/1678574507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde58007770 con 0x7fde5c06d120 2023-10-06T02:58:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.930+0000 7fde50ff9700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.930+0000 7fde50ff9700 1 -- 172.21.15.81:0/1678574507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fde58084810 con 0x7fde5c06d120 2023-10-06T02:58:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.930+0000 7fde53fff700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.931+0000 7fde53fff700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0b28e0 tx=0x7fde4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:03.934+0000 7fde50ff9700 1 -- 172.21.15.81:0/1678574507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde5c0ac030 con 0x7fde5c06d120 2023-10-06T02:58:04.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.117+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde5c06dac0 con 0x7fde5c06d120 2023-10-06T02:58:04.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.118+0000 7fde50ff9700 1 -- 172.21.15.81:0/1678574507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+13741 (secure 0 0 0) 0x7fde5c06dac0 con 0x7fde5c06d120 2023-10-06T02:58:04.119 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:58:04.119 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":186,"fsid":"072ce422-278f-434c-8814-5b3ff2abcdfb","created":"2023-10-06T02:45:49.581202+0000","modified":"2023-10-06T02:58:00.745703+0000","last_up_change":"2023-10-06T02:45:54.967365+0000","last_in_change":"2023-10-06T02:45:51.951043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:45:55.530980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:46:00.679615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86106},{"type":"v1","addr":"172.21.15.81:6818","nonce":86106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86106},{"type":"v1","addr":"172.21.15.81:6822","nonce":86106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86106},{"type":"v1","addr":"172.21.15.81:6830","nonce":86106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86106},{"type":"v1","addr":"172.21.15.81:6826","nonce":86106}]},"public_addr":"172.21.15.81:6818/86106","cluster_addr":"172.21.15.81:6822/86106","heartbeat_back_addr":"172.21.15.81:6830/86106","heartbeat_front_addr":"172.21.15.81:6826/86106","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86109},{"type":"v1","addr":"172.21.15.81:6819","nonce":86109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86109},{"type":"v1","addr":"172.21.15.81:6823","nonce":86109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86109},{"type":"v1","addr":"172.21.15.81:6831","nonce":86109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86109},{"type":"v1","addr":"172.21.15.81:6827","nonce":86109}]},"public_addr":"172.21.15.81:6819/86109","cluster_addr":"172.21.15.81:6823/86109","heartbeat_back_addr":"172.21.15.81:6831/86109","heartbeat_front_addr":"172.21.15.81:6827/86109","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86096},{"type":"v1","addr":"172.21.15.81:6801","nonce":86096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":86096},{"type":"v1","addr":"172.21.15.81:6805","nonce":86096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":86096},{"type":"v1","addr":"172.21.15.81:6813","nonce":86096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":86096},{"type":"v1","addr":"172.21.15.81:6809","nonce":86096}]},"public_addr":"172.21.15.81:6801/86096","cluster_addr":"172.21.15.81:6805/86096","heartbeat_back_addr":"172.21.15.81:6813/86096","heartbeat_front_addr":"172.21.15.81:6809/86096","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86097},{"type":"v1","addr":"172.21.15.81:6804","nonce":86097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86097},{"type":"v1","addr":"172.21.15.81:6808","nonce":86097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86097},{"type":"v1","addr":"172.21.15.81:6815","nonce":86097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86097},{"type":"v1","addr":"172.21.15.81:6812","nonce":86097}]},"public_addr":"172.21.15.81:6804/86097","cluster_addr":"172.21.15.81:6808/86097","heartbeat_back_addr":"172.21.15.81:6815/86097","heartbeat_front_addr":"172.21.15.81:6812/86097","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":86341},{"type":"v1","addr":"172.21.15.83:6801","nonce":86341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":86341},{"type":"v1","addr":"172.21.15.83:6803","nonce":86341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":86341},{"type":"v1","addr":"172.21.15.83:6807","nonce":86341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":86341},{"type":"v1","addr":"172.21.15.83:6805","nonce":86341}]},"public_addr":"172.21.15.83:6801/86341","cluster_addr":"172.21.15.83:6803/86341","heartbeat_back_addr":"172.21.15.83:6807/86341","heartbeat_front_addr":"172.21.15.83:6805/86341","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":86342},{"type":"v1","addr":"172.21.15.83:6809","nonce":86342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":86342},{"type":"v1","addr":"172.21.15.83:6811","nonce":86342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":86342},{"type":"v1","addr":"172.21.15.83:6815","nonce":86342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":86342},{"type":"v1","addr":"172.21.15.83:6813","nonce":86342}]},"public_addr":"172.21.15.83:6809/86342","cluster_addr":"172.21.15.83:6811/86342","heartbeat_back_addr":"172.21.15.83:6815/86342","heartbeat_front_addr":"172.21.15.83:6813/86342","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":86383},{"type":"v1","addr":"172.21.15.83:6825","nonce":86383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":86383},{"type":"v1","addr":"172.21.15.83:6827","nonce":86383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":86383},{"type":"v1","addr":"172.21.15.83:6831","nonce":86383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":86383},{"type":"v1","addr":"172.21.15.83:6829","nonce":86383}]},"public_addr":"172.21.15.83:6825/86383","cluster_addr":"172.21.15.83:6827/86383","heartbeat_back_addr":"172.21.15.83:6831/86383","heartbeat_front_addr":"172.21.15.83:6829/86383","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":86343},{"type":"v1","addr":"172.21.15.83:6817","nonce":86343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":86343},{"type":"v1","addr":"172.21.15.83:6819","nonce":86343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":86343},{"type":"v1","addr":"172.21.15.83:6823","nonce":86343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":86343},{"type":"v1","addr":"172.21.15.83:6821","nonce":86343}]},"public_addr":"172.21.15.83:6817/86343","cluster_addr":"172.21.15.83:6819/86343","heartbeat_back_addr":"172.21.15.83:6823/86343","heartbeat_front_addr":"172.21.15.83:6821/86343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.057736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.078261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.113069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.045489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.052129+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.070915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.103557+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:45:53.118823+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/604648999":"2023-10-07T02:57:57.544490+0000","172.21.15.81:6832/604648999":"2023-10-07T02:57:57.544490+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:58:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde48066f30 msgr2=0x7fde480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0b28e0 tx=0x7fde4c008040 comp rx=0 tx=0).stop 2023-10-06T02:58:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 msgr2=0x7fde5c1435d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 0x7fde5c1435d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fde5800cd30 tx=0x7fde58001b10 comp rx=0 tx=0).stop 2023-10-06T02:58:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 shutdown_connections 2023-10-06T02:58:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde5c157ca0 0x7fde5c0ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde5c06d120 0x7fde5c1435d0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 --2- 172.21.15.81:0/1678574507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde5c1578d0 0x7fde5c0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 >> 172.21.15.81:0/1678574507 conn(0x7fde5c06bb90 msgr2=0x7fde5c155950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 shutdown_connections 2023-10-06T02:58:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:04.120+0000 7fde62c19700 1 -- 172.21.15.81:0/1678574507 wait complete. 2023-10-06T02:58:05.133 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T02:58:05.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:58:05.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.263+0000 7f58a4631700 1 Processor -- start 2023-10-06T02:58:05.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.263+0000 7f58a4631700 1 -- start start 2023-10-06T02:58:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.264+0000 7f58a4631700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f589c15daa0 0x7f589c15de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.264+0000 7f58a4631700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cae00 0x7f589c159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.264+0000 7f58a4631700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589c06d350 con 0x7f589c0cb2a0 2023-10-06T02:58:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.264+0000 7f58a4631700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589c0c9ac0 con 0x7f589c15daa0 2023-10-06T02:58:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.264+0000 7f58a4631700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c15e3b0 con 0x7f589c0cae00 2023-10-06T02:58:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a23cd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f589c15daa0 0x7f589c15de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a1bcc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cae00 0x7f589c159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a2bce700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f589c0cb2a0 0x7f589c159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:53644/0 (socket says 172.21.15.81:53644) 2023-10-06T02:58:05.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a2bce700 1 -- 172.21.15.81:0/660708125 learned_addr learned my addr 172.21.15.81:0/660708125 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:05.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a1bcc700 1 -- 172.21.15.81:0/660708125 >> v2:172.21.15.83:3300/0 conn(0x7f589c15daa0 msgr2=0x7f589c15de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:05.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a1bcc700 1 --2- 172.21.15.81:0/660708125 >> v2:172.21.15.83:3300/0 conn(0x7f589c15daa0 0x7f589c15de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a1bcc700 1 -- 172.21.15.81:0/660708125 >> v1:172.21.15.83:6789/0 conn(0x7f589c0cb2a0 legacy=0x7f589c159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a13cb700 1 -- 172.21.15.81:0/660708125 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699161611 0 0) 0x7f589c06d350 con 0x7f589c0cb2a0 2023-10-06T02:58:05.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a1bcc700 1 -- 172.21.15.81:0/660708125 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c06c740 con 0x7f589c0cae00 2023-10-06T02:58:05.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a23cd700 1 --2- 172.21.15.81:0/660708125 >> v2:172.21.15.83:3300/0 conn(0x7f589c15daa0 0x7f589c15de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:05.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.265+0000 7f58a1bcc700 1 --2- 172.21.15.81:0/660708125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cae00 0x7f589c159540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f588c0098e0 tx=0x7f588c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=950c06a5bce3426a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a13cb700 1 -- 172.21.15.81:0/660708125 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00b640 con 0x7f589c0cae00 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a13cb700 1 -- 172.21.15.81:0/660708125 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c00b7a0 con 0x7f589c0cae00 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a13cb700 1 -- 172.21.15.81:0/660708125 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00bb40 con 0x7f589c0cae00 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a4631700 1 -- 172.21.15.81:0/660708125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cae00 msgr2=0x7f589c159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a4631700 1 --2- 172.21.15.81:0/660708125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cae00 0x7f589c159540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f588c0098e0 tx=0x7f588c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a4631700 1 -- 172.21.15.81:0/660708125 shutdown_connections 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a4631700 1 --2- 172.21.15.81:0/660708125 >> v2:172.21.15.83:3300/0 conn(0x7f589c15daa0 0x7f589c15de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a4631700 1 --2- 172.21.15.81:0/660708125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cae00 0x7f589c159540 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a4631700 1 -- 172.21.15.81:0/660708125 >> 172.21.15.81:0/660708125 conn(0x7f589c0c9ca0 msgr2=0x7f589c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a4631700 1 -- 172.21.15.81:0/660708125 shutdown_connections 2023-10-06T02:58:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.266+0000 7f58a4631700 1 -- 172.21.15.81:0/660708125 wait complete. 2023-10-06T02:58:05.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.267+0000 7f58a4631700 1 Processor -- start 2023-10-06T02:58:05.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.267+0000 7f58a4631700 1 -- start start 2023-10-06T02:58:05.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a4631700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0cae00 0x7f589c151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a4631700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cb2a0 0x7f589c0b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a4631700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589c15daa0 0x7f589c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a4631700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c0c42e0 con 0x7f589c0cae00 2023-10-06T02:58:05.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a4631700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c0c5100 con 0x7f589c15daa0 2023-10-06T02:58:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a4631700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c0c44f0 con 0x7f589c0cb2a0 2023-10-06T02:58:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a23cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0cae00 0x7f589c151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a23cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0cae00 0x7f589c151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51208/0 (socket says 172.21.15.81:51208) 2023-10-06T02:58:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a23cd700 1 -- 172.21.15.81:0/335631610 learned_addr learned my addr 172.21.15.81:0/335631610 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a2bce700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589c15daa0 0x7f589c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.268+0000 7f58a1bcc700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cb2a0 0x7f589c0b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58a23cd700 1 -- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cb2a0 msgr2=0x7f589c0b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58a23cd700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f589c0cb2a0 0x7f589c0b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58a23cd700 1 -- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589c15daa0 msgr2=0x7f589c0c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58a23cd700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f589c15daa0 0x7f589c0c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58a23cd700 1 -- 172.21.15.81:0/335631610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009a20 con 0x7f589c0cae00 2023-10-06T02:58:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58a23cd700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0cae00 0x7f589c151030 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f589800c170 tx=0x7f589800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58927fc700 1 -- 172.21.15.81:0/335631610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800ccb0 con 0x7f589c0cae00 2023-10-06T02:58:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58927fc700 1 -- 172.21.15.81:0/335631610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589800f040 con 0x7f589c0cae00 2023-10-06T02:58:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588c009420 con 0x7f589c0cae00 2023-10-06T02:58:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58927fc700 1 -- 172.21.15.81:0/335631610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898014480 con 0x7f589c0cae00 2023-10-06T02:58:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.269+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589c0c4b30 con 0x7f589c0cae00 2023-10-06T02:58:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.270+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f589c068080 con 0x7f589c0cae00 2023-10-06T02:58:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.270+0000 7f58927fc700 1 -- 172.21.15.81:0/335631610 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58980147f0 con 0x7f589c0cae00 2023-10-06T02:58:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.270+0000 7f58927fc700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5880066f30 0x7f58800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.271+0000 7f58927fc700 1 -- 172.21.15.81:0/335631610 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5898085110 con 0x7f589c0cae00 2023-10-06T02:58:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.271+0000 7f58927fc700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f588006d3a0 0x7f588006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.271+0000 7f58927fc700 1 -- 172.21.15.81:0/335631610 --> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f588006fe80 con 0x7f588006d3a0 2023-10-06T02:58:05.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.271+0000 7f58a1bcc700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5880066f30 0x7f58800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.271+0000 7f58927fc700 1 -- 172.21.15.81:0/335631610 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5898087750 con 0x7f589c0cae00 2023-10-06T02:58:05.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.271+0000 7f58a2bce700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f588006d3a0 0x7f588006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.271+0000 7f58a2bce700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f588006d3a0 0x7f588006f7b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.271+0000 7f58a1bcc700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5880066f30 0x7f58800693e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f588c0091e0 tx=0x7f588c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.272+0000 7f58927fc700 1 -- 172.21.15.81:0/335631610 <== osd.0 v2:172.21.15.81:6816/86106 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f588006fe80 con 0x7f588006d3a0 2023-10-06T02:58:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.284+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 --> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f589c04bb80 con 0x7f588006d3a0 2023-10-06T02:58:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.284+0000 7f58927fc700 1 -- 172.21.15.81:0/335631610 <== osd.0 v2:172.21.15.81:6816/86106 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f589c04bb80 con 0x7f588006d3a0 2023-10-06T02:58:05.286 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:58:05.286 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-06T02:58:05.287 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:58:05.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f588006d3a0 msgr2=0x7f588006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.81:6816/86106,v1:172.21.15.81:6818/86106] conn(0x7f588006d3a0 0x7f588006f7b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5880066f30 msgr2=0x7f58800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5880066f30 0x7f58800693e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f588c0091e0 tx=0x7f588c017000 comp rx=0 tx=0).stop 2023-10-06T02:58:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0cae00 msgr2=0x7f589c151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 --2- 172.21.15.81:0/335631610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0cae00 0x7f589c151030 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f589800c170 tx=0x7f589800b040 comp rx=0 tx=0).stop 2023-10-06T02:58:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a2bce700 1 -- 172.21.15.81:0/335631610 reap_dead start 2023-10-06T02:58:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 shutdown_connections 2023-10-06T02:58:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 >> 172.21.15.81:0/335631610 conn(0x7f589c0c9ca0 msgr2=0x7f589c15b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 shutdown_connections 2023-10-06T02:58:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.285+0000 7f58a4631700 1 -- 172.21.15.81:0/335631610 wait complete. 2023-10-06T02:58:05.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T02:58:05.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.412+0000 7f505759e700 1 Processor -- start 2023-10-06T02:58:05.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.412+0000 7f505759e700 1 -- start start 2023-10-06T02:58:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.413+0000 7f505759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5058159b40 0x7f50580cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.413+0000 7f505759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50580cee10 con 0x7f5058068e90 2023-10-06T02:58:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.413+0000 7f505759e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50580cd040 con 0x7f5058159f10 2023-10-06T02:58:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.413+0000 7f505759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50580cd320 con 0x7f5058159b40 2023-10-06T02:58:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.413+0000 7f5056d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5058068e90 0x7f50580cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43998/0 (socket says 172.21.15.81:43998) 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.413+0000 7f5056d9d700 1 -- 172.21.15.81:0/3283375663 learned_addr learned my addr 172.21.15.81:0/3283375663 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.413+0000 7f505659c700 1 --2- 172.21.15.81:0/3283375663 >> v2:172.21.15.83:3300/0 conn(0x7f5058159b40 0x7f50580cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.413+0000 7f505559a700 1 -- 172.21.15.81:0/3283375663 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581219341 0 0) 0x7f50580cee10 con 0x7f5058068e90 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.413+0000 7f505559a700 1 -- 172.21.15.81:0/3283375663 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5040003570 con 0x7f5058068e90 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505559a700 1 -- 172.21.15.81:0/3283375663 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283938895 0 0) 0x7f50580cd040 con 0x7f5058159f10 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505559a700 1 -- 172.21.15.81:0/3283375663 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50580cee10 con 0x7f5058159f10 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505659c700 1 -- 172.21.15.81:0/3283375663 >> v1:172.21.15.83:6789/0 conn(0x7f5058159f10 legacy=0x7f5058068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505559a700 1 -- 172.21.15.81:0/3283375663 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838672953 0 0) 0x7f5040003570 con 0x7f5058068e90 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505659c700 1 -- 172.21.15.81:0/3283375663 >> v1:172.21.15.81:6789/0 conn(0x7f5058068e90 legacy=0x7f50580cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505659c700 1 -- 172.21.15.81:0/3283375663 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580ce7c0 con 0x7f5058159b40 2023-10-06T02:58:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505659c700 1 --2- 172.21.15.81:0/3283375663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5058159b40 0x7f50580cc600 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5050009e60 tx=0x7f5050009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e0c92bbbeba15d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505559a700 1 -- 172.21.15.81:0/3283375663 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505000e070 con 0x7f5058159b40 2023-10-06T02:58:05.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505559a700 1 -- 172.21.15.81:0/3283375663 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505000b7a0 con 0x7f5058159b40 2023-10-06T02:58:05.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.414+0000 7f505559a700 1 -- 172.21.15.81:0/3283375663 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048001470 con 0x7f5058159b40 2023-10-06T02:58:05.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.415+0000 7f505759e700 1 -- 172.21.15.81:0/3283375663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5058159b40 msgr2=0x7f50580cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.415+0000 7f505759e700 1 --2- 172.21.15.81:0/3283375663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5058159b40 0x7f50580cc600 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5050009e60 tx=0x7f5050009780 comp rx=0 tx=0).stop 2023-10-06T02:58:05.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.415+0000 7f505759e700 1 -- 172.21.15.81:0/3283375663 shutdown_connections 2023-10-06T02:58:05.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.415+0000 7f505759e700 1 --2- 172.21.15.81:0/3283375663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5058159b40 0x7f50580cc600 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.415+0000 7f505759e700 1 -- 172.21.15.81:0/3283375663 >> 172.21.15.81:0/3283375663 conn(0x7f50580cd660 msgr2=0x7f50580cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:05.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.415+0000 7f505759e700 1 -- 172.21.15.81:0/3283375663 shutdown_connections 2023-10-06T02:58:05.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.415+0000 7f505759e700 1 -- 172.21.15.81:0/3283375663 wait complete. 2023-10-06T02:58:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.416+0000 7f505759e700 1 Processor -- start 2023-10-06T02:58:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.416+0000 7f505759e700 1 -- start start 2023-10-06T02:58:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.416+0000 7f505759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5058068e90 0x7f5058153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.416+0000 7f505759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5058159b40 0x7f505815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.416+0000 7f505759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5058159f10 0x7f50581547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.416+0000 7f505759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505815ad20 con 0x7f5058159b40 2023-10-06T02:58:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.416+0000 7f505759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50580cac20 con 0x7f5058068e90 2023-10-06T02:58:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.416+0000 7f505759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505815a430 con 0x7f5058159f10 2023-10-06T02:58:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5055d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5058159b40 0x7f505815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5055d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5058159b40 0x7f505815b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51220/0 (socket says 172.21.15.81:51220) 2023-10-06T02:58:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5055d9b700 1 -- 172.21.15.81:0/1419877474 learned_addr learned my addr 172.21.15.81:0/1419877474 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f505659c700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5058068e90 0x7f5058153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5056d9d700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5058159f10 0x7f50581547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5055d9b700 1 -- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5058159f10 msgr2=0x7f50581547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5055d9b700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5058159f10 0x7f50581547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5055d9b700 1 -- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5058068e90 msgr2=0x7f5058153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5055d9b700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5058068e90 0x7f5058153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5055d9b700 1 -- 172.21.15.81:0/1419877474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5050009a20 con 0x7f5058159b40 2023-10-06T02:58:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f5055d9b700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5058159b40 0x7f505815b1b0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c580 tx=0x7f504c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f50467fc700 1 -- 172.21.15.81:0/1419877474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c010510 con 0x7f5058159b40 2023-10-06T02:58:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f50467fc700 1 -- 172.21.15.81:0/1419877474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c010670 con 0x7f5058159b40 2023-10-06T02:58:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505815b6f0 con 0x7f5058159b40 2023-10-06T02:58:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f50467fc700 1 -- 172.21.15.81:0/1419877474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c010a30 con 0x7f5058159b40 2023-10-06T02:58:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.417+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505815a9b0 con 0x7f5058159b40 2023-10-06T02:58:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.418+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505815aed0 con 0x7f5058159b40 2023-10-06T02:58:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.419+0000 7f50467fc700 1 -- 172.21.15.81:0/1419877474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f504c01b400 con 0x7f5058159b40 2023-10-06T02:58:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.419+0000 7f50467fc700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5038066f30 0x7f50380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.419+0000 7f50467fc700 1 -- 172.21.15.81:0/1419877474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f504c084040 con 0x7f5058159b40 2023-10-06T02:58:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.419+0000 7f505659c700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5038066f30 0x7f50380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.420+0000 7f505659c700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5038066f30 0x7f50380693e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f50500099f0 tx=0x7f5050017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.423+0000 7f50467fc700 1 -- 172.21.15.81:0/1419877474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f505815aed0 con 0x7f5058159b40 2023-10-06T02:58:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.604+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f50580cb910 con 0x7f5038066f30 2023-10-06T02:58:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.605+0000 7f50467fc700 1 -- 172.21.15.81:0/1419877474 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f50580cb910 con 0x7f5038066f30 2023-10-06T02:58:05.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5038066f30 msgr2=0x7f50380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5038066f30 0x7f50380693e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f50500099f0 tx=0x7f5050017000 comp rx=0 tx=0).stop 2023-10-06T02:58:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5058159b40 msgr2=0x7f505815b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5058159b40 0x7f505815b1b0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c580 tx=0x7f504c007e10 comp rx=0 tx=0).stop 2023-10-06T02:58:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 shutdown_connections 2023-10-06T02:58:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5058159f10 0x7f50581547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5038066f30 0x7f50380693e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5058068e90 0x7f5058153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 --2- 172.21.15.81:0/1419877474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5058159b40 0x7f505815b1b0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 >> 172.21.15.81:0/1419877474 conn(0x7f50580cd660 msgr2=0x7f50580b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 shutdown_connections 2023-10-06T02:58:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.607+0000 7f505759e700 1 -- 172.21.15.81:0/1419877474 wait complete. 2023-10-06T02:58:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T02:58:05.620 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T02:58:05.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:58:05.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.737+0000 7fedaa30c700 1 Processor -- start 2023-10-06T02:58:05.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.737+0000 7fedaa30c700 1 -- start start 2023-10-06T02:58:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.738+0000 7fedaa30c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7feda41578d0 0x7feda40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.738+0000 7fedaa30c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda406d120 0x7feda406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.738+0000 7fedaa30c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda40d07c0 con 0x7feda4157ca0 2023-10-06T02:58:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.738+0000 7fedaa30c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda406daa0 con 0x7feda41578d0 2023-10-06T02:58:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.738+0000 7fedaa30c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40cfbb0 con 0x7feda406d120 2023-10-06T02:58:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.738+0000 7feda37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feda4157ca0 0x7feda415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44002/0 (socket says 172.21.15.81:44002) 2023-10-06T02:58:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.738+0000 7feda37fe700 1 -- 172.21.15.81:0/2005022084 learned_addr learned my addr 172.21.15.81:0/2005022084 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.738+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761425131 0 0) 0x7feda40d07c0 con 0x7feda4157ca0 2023-10-06T02:58:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda88a9700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda406d120 0x7feda406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda3fff700 1 --2- 172.21.15.81:0/2005022084 >> v2:172.21.15.83:3300/0 conn(0x7feda41578d0 0x7feda40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed8c003570 con 0x7feda4157ca0 2023-10-06T02:58:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1650336626 0 0) 0x7fed8c003570 con 0x7feda4157ca0 2023-10-06T02:58:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda406d120 msgr2=0x7feda406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda406d120 0x7feda406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 >> v2:172.21.15.83:3300/0 conn(0x7feda41578d0 msgr2=0x7feda40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 --2- 172.21.15.81:0/2005022084 >> v2:172.21.15.83:3300/0 conn(0x7feda41578d0 0x7feda40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40cfe90 con 0x7feda4157ca0 2023-10-06T02:58:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7fed98001470 con 0x7feda4157ca0 2023-10-06T02:58:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 >> v1:172.21.15.81:6789/0 conn(0x7feda4157ca0 legacy=0x7feda415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 0x7fed8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed8c004810 0x7fed8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda406d120 0x7fed8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda406daa0 con 0x7fed8c003a60 2023-10-06T02:58:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40cfbb0 con 0x7fed8c004810 2023-10-06T02:58:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c00ba60 con 0x7feda406d120 2023-10-06T02:58:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda3fff700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 0x7fed8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda37fe700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed8c004810 0x7fed8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda88a9700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda406d120 0x7fed8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda3fff700 1 -- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda406d120 msgr2=0x7fed8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda3fff700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda406d120 0x7fed8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda3fff700 1 -- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed8c004810 msgr2=0x7fed8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda3fff700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed8c004810 0x7fed8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda3fff700 1 -- 172.21.15.81:0/2005022084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c003570 con 0x7fed8c003a60 2023-10-06T02:58:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda3fff700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 0x7fed8c003e70 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fed94009c30 tx=0x7fed940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12c889d80cbdf8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400e710 con 0x7fed8c003a60 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400e870 con 0x7fed8c003a60 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.739+0000 7feda2ffd700 1 -- 172.21.15.81:0/2005022084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400ec30 con 0x7fed8c003a60 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.740+0000 7fedaa30c700 1 -- 172.21.15.81:0/2005022084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 msgr2=0x7fed8c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.740+0000 7fedaa30c700 1 --2- 172.21.15.81:0/2005022084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 0x7fed8c003e70 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fed94009c30 tx=0x7fed940091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.740+0000 7feda88a9700 1 -- 172.21.15.81:0/2005022084 reap_dead start 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.740+0000 7fedaa30c700 1 -- 172.21.15.81:0/2005022084 shutdown_connections 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.740+0000 7fedaa30c700 1 -- 172.21.15.81:0/2005022084 >> 172.21.15.81:0/2005022084 conn(0x7feda406bb90 msgr2=0x7feda406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.740+0000 7fedaa30c700 1 -- 172.21.15.81:0/2005022084 shutdown_connections 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.740+0000 7fedaa30c700 1 -- 172.21.15.81:0/2005022084 wait complete. 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.741+0000 7fedaa30c700 1 Processor -- start 2023-10-06T02:58:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.741+0000 7fedaa30c700 1 -- start start 2023-10-06T02:58:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7fedaa30c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 0x7feda4148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7fedaa30c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda415c820 0x7feda415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7fedaa30c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda40ac0d0 0x7feda40ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7fedaa30c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda415d1d0 con 0x7fed8c003a60 2023-10-06T02:58:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7fedaa30c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40b68a0 con 0x7feda40ac0d0 2023-10-06T02:58:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7fedaa30c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40b5cd0 con 0x7feda415c820 2023-10-06T02:58:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 0x7feda4148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 0x7feda4148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51242/0 (socket says 172.21.15.81:51242) 2023-10-06T02:58:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda3fff700 1 -- 172.21.15.81:0/452050607 learned_addr learned my addr 172.21.15.81:0/452050607 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda88a9700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda40ac0d0 0x7feda40ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda37fe700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda415c820 0x7feda415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda3fff700 1 -- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda415c820 msgr2=0x7feda415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda3fff700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda415c820 0x7feda415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda3fff700 1 -- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda40ac0d0 msgr2=0x7feda40ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda3fff700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda40ac0d0 0x7feda40ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda3fff700 1 -- 172.21.15.81:0/452050607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda416b7c0 con 0x7fed8c003a60 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda37fe700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda415c820 0x7feda415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.742+0000 7feda3fff700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 0x7feda4148920 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0046d0 tx=0x7fed9401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.743+0000 7fed8bfff700 1 -- 172.21.15.81:0/452050607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94022070 con 0x7fed8c003a60 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.743+0000 7fed8bfff700 1 -- 172.21.15.81:0/452050607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400e9e0 con 0x7fed8c003a60 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.743+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda40b5f70 con 0x7fed8c003a60 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.743+0000 7fed8bfff700 1 -- 172.21.15.81:0/452050607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9401c450 con 0x7fed8c003a60 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.743+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda40b6530 con 0x7fed8c003a60 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.743+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feda4067ac0 con 0x7fed8c003a60 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.744+0000 7fed8bfff700 1 -- 172.21.15.81:0/452050607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed9401c800 con 0x7fed8c003a60 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.744+0000 7fed8bfff700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed90066f30 0x7fed900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.744+0000 7fed8bfff700 1 -- 172.21.15.81:0/452050607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fed94085b00 con 0x7fed8c003a60 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.745+0000 7feda37fe700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed90066f30 0x7fed900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.745+0000 7fed8bfff700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7fed9006d3a0 0x7fed9006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.745+0000 7fed8bfff700 1 -- 172.21.15.81:0/452050607 --> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed9006fe80 con 0x7fed9006d3a0 2023-10-06T02:58:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.745+0000 7fed8bfff700 1 -- 172.21.15.81:0/452050607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed9408a1a0 con 0x7fed8c003a60 2023-10-06T02:58:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.745+0000 7feda88a9700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7fed9006d3a0 0x7fed9006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.745+0000 7feda88a9700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7fed9006d3a0 0x7fed9006f7b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.745+0000 7feda37fe700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed90066f30 0x7fed900693e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fed98001ed0 tx=0x7feda40d0730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.745+0000 7fed8bfff700 1 -- 172.21.15.81:0/452050607 <== osd.1 v2:172.21.15.81:6817/86109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fed9006fe80 con 0x7fed9006d3a0 2023-10-06T02:58:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.758+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 --> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feda40d0170 con 0x7fed9006d3a0 2023-10-06T02:58:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.758+0000 7fed8bfff700 1 -- 172.21.15.81:0/452050607 <== osd.1 v2:172.21.15.81:6817/86109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7feda40d0170 con 0x7fed9006d3a0 2023-10-06T02:58:05.760 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:58:05.760 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-06T02:58:05.760 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7fed9006d3a0 msgr2=0x7fed9006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.81:6817/86109,v1:172.21.15.81:6819/86109] conn(0x7fed9006d3a0 0x7fed9006f7b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed90066f30 msgr2=0x7fed900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fed90066f30 0x7fed900693e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fed98001ed0 tx=0x7feda40d0730 comp rx=0 tx=0).stop 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 msgr2=0x7feda4148920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 --2- 172.21.15.81:0/452050607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c003a60 0x7feda4148920 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0046d0 tx=0x7fed9401a000 comp rx=0 tx=0).stop 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7feda88a9700 1 -- 172.21.15.81:0/452050607 reap_dead start 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 shutdown_connections 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 >> 172.21.15.81:0/452050607 conn(0x7feda406bb90 msgr2=0x7feda41559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 shutdown_connections 2023-10-06T02:58:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.759+0000 7fedaa30c700 1 -- 172.21.15.81:0/452050607 wait complete. 2023-10-06T02:58:05.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T02:58:05.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.886+0000 7f41936e5700 1 Processor -- start 2023-10-06T02:58:05.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.886+0000 7f41936e5700 1 -- start start 2023-10-06T02:58:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.887+0000 7f41936e5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f418c157ca0 0x7f418c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.887+0000 7f41936e5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c06d120 0x7f418c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.887+0000 7f41936e5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0d07c0 con 0x7f418c1578d0 2023-10-06T02:58:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.887+0000 7f41936e5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c06daa0 con 0x7f418c157ca0 2023-10-06T02:58:05.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.887+0000 7f41936e5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0cfbb0 con 0x7f418c06d120 2023-10-06T02:58:05.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4191c82700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c06d120 0x7f418c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4190c80700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f418c157ca0 0x7f418c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4191481700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f418c1578d0 0x7f418c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:53660/0 (socket says 172.21.15.81:53660) 2023-10-06T02:58:05.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4191481700 1 -- 172.21.15.81:0/2810263790 learned_addr learned my addr 172.21.15.81:0/2810263790 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:05.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4191c82700 1 -- 172.21.15.81:0/2810263790 >> v2:172.21.15.83:3300/0 conn(0x7f418c157ca0 msgr2=0x7f418c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:05.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4191c82700 1 --2- 172.21.15.81:0/2810263790 >> v2:172.21.15.83:3300/0 conn(0x7f418c157ca0 0x7f418c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4191c82700 1 -- 172.21.15.81:0/2810263790 >> v1:172.21.15.83:6789/0 conn(0x7f418c1578d0 legacy=0x7f418c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4191c82700 1 -- 172.21.15.81:0/2810263790 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0cfe90 con 0x7f418c06d120 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4183fff700 1 -- 172.21.15.81:0/2810263790 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71035909 0 0) 0x7f418c0d07c0 con 0x7f418c1578d0 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4190c80700 1 --2- 172.21.15.81:0/2810263790 >> v2:172.21.15.83:3300/0 conn(0x7f418c157ca0 0x7f418c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4191c82700 1 --2- 172.21.15.81:0/2810263790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c06d120 0x7f418c06d560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f41840098e0 tx=0x7f41840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd2872b56066d82f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4183fff700 1 -- 172.21.15.81:0/2810263790 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418400b640 con 0x7f418c06d120 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4183fff700 1 -- 172.21.15.81:0/2810263790 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418400b7a0 con 0x7f418c06d120 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.888+0000 7f4183fff700 1 -- 172.21.15.81:0/2810263790 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418400bb40 con 0x7f418c06d120 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.889+0000 7f41936e5700 1 -- 172.21.15.81:0/2810263790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c06d120 msgr2=0x7f418c06d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.889+0000 7f41936e5700 1 --2- 172.21.15.81:0/2810263790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c06d120 0x7f418c06d560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f41840098e0 tx=0x7f41840091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.889+0000 7f41936e5700 1 -- 172.21.15.81:0/2810263790 shutdown_connections 2023-10-06T02:58:05.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.889+0000 7f41936e5700 1 --2- 172.21.15.81:0/2810263790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c06d120 0x7f418c06d560 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.889+0000 7f41936e5700 1 --2- 172.21.15.81:0/2810263790 >> v2:172.21.15.83:3300/0 conn(0x7f418c157ca0 0x7f418c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.889+0000 7f41936e5700 1 -- 172.21.15.81:0/2810263790 >> 172.21.15.81:0/2810263790 conn(0x7f418c06bb90 msgr2=0x7f418c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.889+0000 7f41936e5700 1 -- 172.21.15.81:0/2810263790 shutdown_connections 2023-10-06T02:58:05.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.889+0000 7f41936e5700 1 -- 172.21.15.81:0/2810263790 wait complete. 2023-10-06T02:58:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.890+0000 7f41936e5700 1 Processor -- start 2023-10-06T02:58:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.890+0000 7f41936e5700 1 -- start start 2023-10-06T02:58:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f41936e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c06d120 0x7f418c154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f41936e5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1578d0 0x7f418c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f41936e5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f418c157ca0 0x7f418c1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f41936e5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c154a60 con 0x7f418c06d120 2023-10-06T02:58:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f41936e5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c16dbf0 con 0x7f418c157ca0 2023-10-06T02:58:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f41936e5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c16de90 con 0x7f418c1578d0 2023-10-06T02:58:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f4191481700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c06d120 0x7f418c154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f4191481700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c06d120 0x7f418c154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51258/0 (socket says 172.21.15.81:51258) 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f4191481700 1 -- 172.21.15.81:0/492137183 learned_addr learned my addr 172.21.15.81:0/492137183 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f4190c80700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1578d0 0x7f418c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f4191c82700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f418c157ca0 0x7f418c1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.891+0000 7f4191481700 1 -- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1578d0 msgr2=0x7f418c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f4191481700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1578d0 0x7f418c1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f4191481700 1 -- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f418c157ca0 msgr2=0x7f418c1598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f4191481700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f418c157ca0 0x7f418c1598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f4191481700 1 -- 172.21.15.81:0/492137183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c009420 con 0x7f418c06d120 2023-10-06T02:58:05.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f4190c80700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1578d0 0x7f418c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f4191c82700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f418c157ca0 0x7f418c1598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f4191481700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c06d120 0x7f418c154520 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f418800cd80 tx=0x7f4188001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f41817fa700 1 -- 172.21.15.81:0/492137183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418800ab10 con 0x7f418c06d120 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f41817fa700 1 -- 172.21.15.81:0/492137183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418800ac70 con 0x7f418c06d120 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4184009420 con 0x7f418c06d120 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f41817fa700 1 -- 172.21.15.81:0/492137183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880070f0 con 0x7f418c06d120 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.892+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c16e450 con 0x7f418c06d120 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.893+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c15b7f0 con 0x7f418c06d120 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.893+0000 7f41817fa700 1 -- 172.21.15.81:0/492137183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41880074e0 con 0x7f418c06d120 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.893+0000 7f41817fa700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.893+0000 7f41817fa700 1 -- 172.21.15.81:0/492137183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f41880848c0 con 0x7f418c06d120 2023-10-06T02:58:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.894+0000 7f4190c80700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.894+0000 7f4190c80700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f417c0093f0 tx=0x7f417c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:05.898+0000 7f41817fa700 1 -- 172.21.15.81:0/492137183 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4188051d50 con 0x7f418c06d120 2023-10-06T02:58:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.077+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f418c0d0170 con 0x7f4170066f30 2023-10-06T02:58:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.078+0000 7f41817fa700 1 -- 172.21.15.81:0/492137183 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f418c0d0170 con 0x7f4170066f30 2023-10-06T02:58:06.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 msgr2=0x7f41700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f417c0093f0 tx=0x7f417c008040 comp rx=0 tx=0).stop 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c06d120 msgr2=0x7f418c154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c06d120 0x7f418c154520 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f418800cd80 tx=0x7f4188001ae0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 shutdown_connections 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4170066f30 0x7f41700693e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f418c157ca0 0x7f418c1598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f418c06d120 0x7f418c154520 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 --2- 172.21.15.81:0/492137183 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f418c1578d0 0x7f418c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 >> 172.21.15.81:0/492137183 conn(0x7f418c06bb90 msgr2=0x7f418c069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 shutdown_connections 2023-10-06T02:58:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.080+0000 7f41936e5700 1 -- 172.21.15.81:0/492137183 wait complete. 2023-10-06T02:58:06.083 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T02:58:06.093 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T02:58:06.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:58:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.210+0000 7f804a20e700 1 Processor -- start 2023-10-06T02:58:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.210+0000 7f804a20e700 1 -- start start 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f804a20e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f80441578d0 0x7f80440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f804a20e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80440d07c0 con 0x7f804406d120 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f804a20e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80440cfbb0 con 0x7f8044157ca0 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f804a20e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80440cfe90 con 0x7f80441578d0 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f8043fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f804406d120 0x7f804406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44008/0 (socket says 172.21.15.81:44008) 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f8043fff700 1 -- 172.21.15.81:0/794463668 learned_addr learned my addr 172.21.15.81:0/794463668 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f80437fe700 1 --2- 172.21.15.81:0/794463668 >> v2:172.21.15.83:3300/0 conn(0x7f80441578d0 0x7f80440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f8042ffd700 1 -- 172.21.15.81:0/794463668 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702835143 0 0) 0x7f80440d07c0 con 0x7f804406d120 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f8042ffd700 1 -- 172.21.15.81:0/794463668 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8030003570 con 0x7f804406d120 2023-10-06T02:58:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f80437fe700 1 -- 172.21.15.81:0/794463668 >> v1:172.21.15.83:6789/0 conn(0x7f8044157ca0 legacy=0x7f804415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f8042ffd700 1 -- 172.21.15.81:0/794463668 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653916219 0 0) 0x7f80440cfbb0 con 0x7f8044157ca0 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.211+0000 7f80437fe700 1 -- 172.21.15.81:0/794463668 >> v1:172.21.15.81:6789/0 conn(0x7f804406d120 legacy=0x7f804406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f80437fe700 1 -- 172.21.15.81:0/794463668 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80440d0170 con 0x7f80441578d0 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f80437fe700 1 --2- 172.21.15.81:0/794463668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80441578d0 0x7f80440cf4f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f80340098e0 tx=0x7f80340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=199bdb862863a44d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f8042ffd700 1 -- 172.21.15.81:0/794463668 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c0017f0 con 0x7f80441578d0 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f8042ffd700 1 -- 172.21.15.81:0/794463668 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034011420 con 0x7f80441578d0 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f8042ffd700 1 -- 172.21.15.81:0/794463668 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340117c0 con 0x7f80441578d0 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f804a20e700 1 -- 172.21.15.81:0/794463668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80441578d0 msgr2=0x7f80440cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f804a20e700 1 --2- 172.21.15.81:0/794463668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80441578d0 0x7f80440cf4f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f80340098e0 tx=0x7f80340091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f804a20e700 1 -- 172.21.15.81:0/794463668 shutdown_connections 2023-10-06T02:58:06.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f804a20e700 1 --2- 172.21.15.81:0/794463668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80441578d0 0x7f80440cf4f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.212+0000 7f804a20e700 1 -- 172.21.15.81:0/794463668 >> 172.21.15.81:0/794463668 conn(0x7f804406bb90 msgr2=0x7f804406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.213+0000 7f804a20e700 1 -- 172.21.15.81:0/794463668 shutdown_connections 2023-10-06T02:58:06.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.213+0000 7f804a20e700 1 -- 172.21.15.81:0/794463668 wait complete. 2023-10-06T02:58:06.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.214+0000 7f804a20e700 1 Processor -- start 2023-10-06T02:58:06.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.214+0000 7f804a20e700 1 -- start start 2023-10-06T02:58:06.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.214+0000 7f804a20e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f804406d120 0x7f80440b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.214+0000 7f804a20e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80441578d0 0x7f80440c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.214+0000 7f804a20e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8044157ca0 0x7f8044153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.214+0000 7f804a20e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440c86d0 con 0x7f804406d120 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.214+0000 7f804a20e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440c8240 con 0x7f8044157ca0 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.214+0000 7f804a20e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80440c73b0 con 0x7f80441578d0 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.214+0000 7f80437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f804406d120 0x7f80440b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f80437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f804406d120 0x7f80440b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51264/0 (socket says 172.21.15.81:51264) 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f80437fe700 1 -- 172.21.15.81:0/3263593966 learned_addr learned my addr 172.21.15.81:0/3263593966 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f8043fff700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8044157ca0 0x7f8044153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f803affd700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80441578d0 0x7f80440c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f80437fe700 1 -- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80441578d0 msgr2=0x7f80440c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f80437fe700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80441578d0 0x7f80440c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f80437fe700 1 -- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8044157ca0 msgr2=0x7f8044153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f80437fe700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8044157ca0 0x7f8044153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f80437fe700 1 -- 172.21.15.81:0/3263593966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8034009420 con 0x7f804406d120 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f8043fff700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8044157ca0 0x7f8044153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f80437fe700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f804406d120 0x7f80440b57c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f80340030c0 tx=0x7f8034017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f803bfff700 1 -- 172.21.15.81:0/3263593966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034010c20 con 0x7f804406d120 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f803bfff700 1 -- 172.21.15.81:0/3263593966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034010d80 con 0x7f804406d120 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80440c7630 con 0x7f804406d120 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f803bfff700 1 -- 172.21.15.81:0/3263593966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803401d660 con 0x7f804406d120 2023-10-06T02:58:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.215+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80440c7bf0 con 0x7f804406d120 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.216+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8044067ac0 con 0x7f804406d120 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.216+0000 7f803bfff700 1 -- 172.21.15.81:0/3263593966 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f803401d9d0 con 0x7f804406d120 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.217+0000 7f803bfff700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8024066f30 0x7f80240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.217+0000 7f803bfff700 1 -- 172.21.15.81:0/3263593966 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8034086510 con 0x7f804406d120 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.217+0000 7f803bfff700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7f802406d3a0 0x7f802406f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.217+0000 7f803bfff700 1 -- 172.21.15.81:0/3263593966 --> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f802406fe80 con 0x7f802406d3a0 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.217+0000 7f803bfff700 1 -- 172.21.15.81:0/3263593966 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80340868e0 con 0x7f804406d120 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.217+0000 7f803affd700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8024066f30 0x7f80240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.217+0000 7f8043fff700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7f802406d3a0 0x7f802406f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.217+0000 7f803affd700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8024066f30 0x7f80240693e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f804416d9b0 tx=0x7f802c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.217+0000 7f8043fff700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7f802406d3a0 0x7f802406f7b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.218+0000 7f803bfff700 1 -- 172.21.15.81:0/3263593966 <== osd.2 v2:172.21.15.81:6800/86096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f802406fe80 con 0x7f802406d3a0 2023-10-06T02:58:06.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.230+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 --> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f80440d0450 con 0x7f802406d3a0 2023-10-06T02:58:06.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f803bfff700 1 -- 172.21.15.81:0/3263593966 <== osd.2 v2:172.21.15.81:6800/86096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f80440d0450 con 0x7f802406d3a0 2023-10-06T02:58:06.232 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:58:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-06T02:58:06.232 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:58:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7f802406d3a0 msgr2=0x7f802406f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.81:6800/86096,v1:172.21.15.81:6801/86096] conn(0x7f802406d3a0 0x7f802406f7b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8024066f30 msgr2=0x7f80240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f8024066f30 0x7f80240693e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f804416d9b0 tx=0x7f802c009040 comp rx=0 tx=0).stop 2023-10-06T02:58:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f804406d120 msgr2=0x7f80440b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 --2- 172.21.15.81:0/3263593966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f804406d120 0x7f80440b57c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f80340030c0 tx=0x7f8034017000 comp rx=0 tx=0).stop 2023-10-06T02:58:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f8043fff700 1 -- 172.21.15.81:0/3263593966 reap_dead start 2023-10-06T02:58:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 shutdown_connections 2023-10-06T02:58:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 >> 172.21.15.81:0/3263593966 conn(0x7f804406bb90 msgr2=0x7f8044154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 shutdown_connections 2023-10-06T02:58:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.231+0000 7f804a20e700 1 -- 172.21.15.81:0/3263593966 wait complete. 2023-10-06T02:58:06.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T02:58:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.358+0000 7f66854ba700 1 Processor -- start 2023-10-06T02:58:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.358+0000 7f66854ba700 1 -- start start 2023-10-06T02:58:06.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f66854ba700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6680159f10 0x7f6680068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f66854ba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680068cc0 0x7f66800cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f66854ba700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66800cee10 con 0x7f6680159b40 2023-10-06T02:58:06.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f66854ba700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6680069140 con 0x7f6680159f10 2023-10-06T02:58:06.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f66854ba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66800cd040 con 0x7f6680068cc0 2023-10-06T02:58:06.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f667f7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6680159f10 0x7f6680068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f6684cb9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680068cc0 0x7f66800cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f667ffff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f6680159b40 0x7f66800cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:53682/0 (socket says 172.21.15.81:53682) 2023-10-06T02:58:06.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f667ffff700 1 -- 172.21.15.81:0/239997349 learned_addr learned my addr 172.21.15.81:0/239997349 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:06.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f667effd700 1 -- 172.21.15.81:0/239997349 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082280753 0 0) 0x7f66800cee10 con 0x7f6680159b40 2023-10-06T02:58:06.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f6684cb9700 1 -- 172.21.15.81:0/239997349 >> v2:172.21.15.83:3300/0 conn(0x7f6680159f10 msgr2=0x7f6680068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f6684cb9700 1 --2- 172.21.15.81:0/239997349 >> v2:172.21.15.83:3300/0 conn(0x7f6680159f10 0x7f6680068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f6684cb9700 1 -- 172.21.15.81:0/239997349 >> v1:172.21.15.83:6789/0 conn(0x7f6680159b40 legacy=0x7f66800cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.359+0000 7f6684cb9700 1 -- 172.21.15.81:0/239997349 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800cd320 con 0x7f6680068cc0 2023-10-06T02:58:06.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f667f7fe700 1 --2- 172.21.15.81:0/239997349 >> v2:172.21.15.83:3300/0 conn(0x7f6680159f10 0x7f6680068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:06.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f6684cb9700 1 --2- 172.21.15.81:0/239997349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680068cc0 0x7f66800cf2a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6678009e60 tx=0x7f6678009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3345010121a19a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f667effd700 1 -- 172.21.15.81:0/239997349 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800e070 con 0x7f6680068cc0 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f667effd700 1 -- 172.21.15.81:0/239997349 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667800bb60 con 0x7f6680068cc0 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f667effd700 1 -- 172.21.15.81:0/239997349 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678012430 con 0x7f6680068cc0 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f66854ba700 1 -- 172.21.15.81:0/239997349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680068cc0 msgr2=0x7f66800cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f66854ba700 1 --2- 172.21.15.81:0/239997349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680068cc0 0x7f66800cf2a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6678009e60 tx=0x7f6678009780 comp rx=0 tx=0).stop 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f66854ba700 1 -- 172.21.15.81:0/239997349 shutdown_connections 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f66854ba700 1 --2- 172.21.15.81:0/239997349 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680068cc0 0x7f66800cf2a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f66854ba700 1 --2- 172.21.15.81:0/239997349 >> v2:172.21.15.83:3300/0 conn(0x7f6680159f10 0x7f6680068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f66854ba700 1 -- 172.21.15.81:0/239997349 >> 172.21.15.81:0/239997349 conn(0x7f66800cd660 msgr2=0x7f66800cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f66854ba700 1 -- 172.21.15.81:0/239997349 shutdown_connections 2023-10-06T02:58:06.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.360+0000 7f66854ba700 1 -- 172.21.15.81:0/239997349 wait complete. 2023-10-06T02:58:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.361+0000 7f66854ba700 1 Processor -- start 2023-10-06T02:58:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.362+0000 7f66854ba700 1 -- start start 2023-10-06T02:58:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.362+0000 7f66854ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6680068cc0 0x7f6680157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.362+0000 7f66854ba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6680159b40 0x7f6680158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.362+0000 7f66854ba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680159f10 0x7f66800b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.362+0000 7f66854ba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680158970 con 0x7f6680068cc0 2023-10-06T02:58:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.362+0000 7f66854ba700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680158c50 con 0x7f6680159b40 2023-10-06T02:58:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.362+0000 7f66854ba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6680158f30 con 0x7f6680159f10 2023-10-06T02:58:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.362+0000 7f667ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6680068cc0 0x7f6680157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6680068cc0 0x7f6680157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51270/0 (socket says 172.21.15.81:51270) 2023-10-06T02:58:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6680159b40 0x7f6680158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667ffff700 1 -- 172.21.15.81:0/2994085381 learned_addr learned my addr 172.21.15.81:0/2994085381 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f6684cb9700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680159f10 0x7f66800b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667f7fe700 1 -- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680159f10 msgr2=0x7f66800b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667f7fe700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680159f10 0x7f66800b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667f7fe700 1 -- 172.21.15.81:0/2994085381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6680068cc0 msgr2=0x7f6680157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667f7fe700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6680068cc0 0x7f6680157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667f7fe700 1 -- 172.21.15.81:0/2994085381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674009420 con 0x7f6680159b40 2023-10-06T02:58:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667ffff700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6680068cc0 0x7f6680157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f667f7fe700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6680159b40 0x7f6680158140 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f667400ea00 tx=0x7f66740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f6667fff700 1 -- 172.21.15.81:0/2994085381 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400c6a0 con 0x7f6680159b40 2023-10-06T02:58:06.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f6667fff700 1 -- 172.21.15.81:0/2994085381 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667400c800 con 0x7f6680159b40 2023-10-06T02:58:06.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6678009a20 con 0x7f6680159b40 2023-10-06T02:58:06.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f6667fff700 1 -- 172.21.15.81:0/2994085381 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400cba0 con 0x7f6680159b40 2023-10-06T02:58:06.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.363+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668015a750 con 0x7f6680159b40 2023-10-06T02:58:06.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.364+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668015aac0 con 0x7f6680159b40 2023-10-06T02:58:06.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.365+0000 7f6667fff700 1 -- 172.21.15.81:0/2994085381 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6674005a00 con 0x7f6680159b40 2023-10-06T02:58:06.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.365+0000 7f6667fff700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f666c066f30 0x7f666c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.365+0000 7f6667fff700 1 -- 172.21.15.81:0/2994085381 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6674084650 con 0x7f6680159b40 2023-10-06T02:58:06.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.365+0000 7f667ffff700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f666c066f30 0x7f666c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.366+0000 7f667ffff700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f666c066f30 0x7f666c0693e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6670007fd0 tx=0x7f6670007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.369+0000 7f6667fff700 1 -- 172.21.15.81:0/2994085381 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6674051ae0 con 0x7f6680159b40 2023-10-06T02:58:06.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.552+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6680158d90 con 0x7f666c066f30 2023-10-06T02:58:06.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.553+0000 7f6667fff700 1 -- 172.21.15.81:0/2994085381 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6680158d90 con 0x7f666c066f30 2023-10-06T02:58:06.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f666c066f30 msgr2=0x7f666c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f666c066f30 0x7f666c0693e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6670007fd0 tx=0x7f6670007df0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6680159b40 msgr2=0x7f6680158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6680159b40 0x7f6680158140 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f667400ea00 tx=0x7f66740091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 shutdown_connections 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6680159f10 0x7f66800b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6680068cc0 0x7f6680157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f666c066f30 0x7f666c0693e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 --2- 172.21.15.81:0/2994085381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6680159b40 0x7f6680158140 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 >> 172.21.15.81:0/2994085381 conn(0x7f66800cd660 msgr2=0x7f66800c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 shutdown_connections 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.555+0000 7f66854ba700 1 -- 172.21.15.81:0/2994085381 wait complete. 2023-10-06T02:58:06.559 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T02:58:06.568 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T02:58:06.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:58:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.685+0000 7f58ab674700 1 Processor -- start 2023-10-06T02:58:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.685+0000 7f58ab674700 1 -- start start 2023-10-06T02:58:06.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.686+0000 7f58ab674700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58a4157ca0 0x7f58a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.686+0000 7f58ab674700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f58a406d120 0x7f58a406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.686+0000 7f58ab674700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40d07c0 con 0x7f58a41578d0 2023-10-06T02:58:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.686+0000 7f58ab674700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a406da50 con 0x7f58a4157ca0 2023-10-06T02:58:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.686+0000 7f58ab674700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40cfbb0 con 0x7f58a406d120 2023-10-06T02:58:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.686+0000 7f58a8c0f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58a4157ca0 0x7f58a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.686+0000 7f58a8c0f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58a4157ca0 0x7f58a40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51284/0 (socket says 172.21.15.81:51284) 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.686+0000 7f58a9410700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f58a41578d0 0x7f58a415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44016/0 (socket says 172.21.15.81:44016) 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.686+0000 7f58a8c0f700 1 -- 172.21.15.81:0/1007720501 learned_addr learned my addr 172.21.15.81:0/1007720501 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58a9c11700 1 --2- 172.21.15.81:0/1007720501 >> v2:172.21.15.83:3300/0 conn(0x7f58a406d120 0x7f58a406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58a8c0f700 1 -- 172.21.15.81:0/1007720501 >> v2:172.21.15.83:3300/0 conn(0x7f58a406d120 msgr2=0x7f58a406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58a8c0f700 1 --2- 172.21.15.81:0/1007720501 >> v2:172.21.15.83:3300/0 conn(0x7f58a406d120 0x7f58a406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58a8c0f700 1 -- 172.21.15.81:0/1007720501 >> v1:172.21.15.81:6789/0 conn(0x7f58a41578d0 legacy=0x7f58a415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58a8c0f700 1 -- 172.21.15.81:0/1007720501 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40cfe90 con 0x7f58a4157ca0 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f589bfff700 1 -- 172.21.15.81:0/1007720501 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707362480 0 0) 0x7f58a40d07c0 con 0x7f58a41578d0 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58a8c0f700 1 --2- 172.21.15.81:0/1007720501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 0x7f58a40cf4f0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f58a4068300 tx=0x7f5894009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc169a186f66e94c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f589bfff700 1 -- 172.21.15.81:0/1007720501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589400b860 con 0x7f58a4157ca0 2023-10-06T02:58:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f589bfff700 1 -- 172.21.15.81:0/1007720501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589400b9c0 con 0x7f58a4157ca0 2023-10-06T02:58:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f589bfff700 1 -- 172.21.15.81:0/1007720501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589400bd60 con 0x7f58a4157ca0 2023-10-06T02:58:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58ab674700 1 -- 172.21.15.81:0/1007720501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 msgr2=0x7f58a40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58ab674700 1 --2- 172.21.15.81:0/1007720501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 0x7f58a40cf4f0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f58a4068300 tx=0x7f5894009250 comp rx=0 tx=0).stop 2023-10-06T02:58:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58ab674700 1 -- 172.21.15.81:0/1007720501 shutdown_connections 2023-10-06T02:58:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58ab674700 1 --2- 172.21.15.81:0/1007720501 >> v2:172.21.15.83:3300/0 conn(0x7f58a406d120 0x7f58a406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58ab674700 1 --2- 172.21.15.81:0/1007720501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 0x7f58a40cf4f0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.687+0000 7f58ab674700 1 -- 172.21.15.81:0/1007720501 >> 172.21.15.81:0/1007720501 conn(0x7f58a406bb90 msgr2=0x7f58a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.688+0000 7f58ab674700 1 -- 172.21.15.81:0/1007720501 shutdown_connections 2023-10-06T02:58:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.688+0000 7f58ab674700 1 -- 172.21.15.81:0/1007720501 wait complete. 2023-10-06T02:58:06.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.689+0000 7f58ab674700 1 Processor -- start 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.689+0000 7f58ab674700 1 -- start start 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.689+0000 7f58ab674700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a406d120 0x7f58a4169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.689+0000 7f58ab674700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58a41578d0 0x7f58a40ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.689+0000 7f58ab674700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 0x7f58a40ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.689+0000 7f58ab674700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40c80c0 con 0x7f58a4157ca0 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.689+0000 7f58ab674700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40c7240 con 0x7f58a406d120 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.689+0000 7f58ab674700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40c7a70 con 0x7f58a41578d0 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9c11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 0x7f58a40ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9c11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 0x7f58a40ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51290/0 (socket says 172.21.15.81:51290) 2023-10-06T02:58:06.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9c11700 1 -- 172.21.15.81:0/2281956272 learned_addr learned my addr 172.21.15.81:0/2281956272 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9410700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a406d120 0x7f58a4169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a8c0f700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58a41578d0 0x7f58a40ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9c11700 1 -- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58a41578d0 msgr2=0x7f58a40ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9c11700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58a41578d0 0x7f58a40ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9c11700 1 -- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a406d120 msgr2=0x7f58a4169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9c11700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a406d120 0x7f58a4169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9c11700 1 -- 172.21.15.81:0/2281956272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940094f0 con 0x7f58a4157ca0 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9410700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58a406d120 0x7f58a4169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58a9c11700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 0x7f58a40ca8d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f589c00ceb0 tx=0x7f589c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58997fa700 1 -- 172.21.15.81:0/2281956272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c00ae40 con 0x7f58a4157ca0 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58997fa700 1 -- 172.21.15.81:0/2281956272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c016430 con 0x7f58a4157ca0 2023-10-06T02:58:06.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a40c7d50 con 0x7f58a4157ca0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58997fa700 1 -- 172.21.15.81:0/2281956272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c0167d0 con 0x7f58a4157ca0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.690+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a416a290 con 0x7f58a4157ca0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.691+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58a4067ac0 con 0x7f58a4157ca0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.691+0000 7f58997fa700 1 -- 172.21.15.81:0/2281956272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f589c003020 con 0x7f58a4157ca0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.692+0000 7f58997fa700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5888066f30 0x7f58880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.692+0000 7f58997fa700 1 -- 172.21.15.81:0/2281956272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f589c012070 con 0x7f58a4157ca0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.692+0000 7f58997fa700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f588806d3a0 0x7f588806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.692+0000 7f58997fa700 1 -- 172.21.15.81:0/2281956272 --> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f588806fe80 con 0x7f588806d3a0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.692+0000 7f58997fa700 1 -- 172.21.15.81:0/2281956272 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f589c087740 con 0x7f58a4157ca0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.692+0000 7f58a8c0f700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f588806d3a0 0x7f588806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.692+0000 7f58a9410700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5888066f30 0x7f58880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.692+0000 7f58a8c0f700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f588806d3a0 0x7f588806f7b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.693+0000 7f58a9410700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5888066f30 0x7f58880693e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f58a00018d0 tx=0x7f58a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.693+0000 7f58997fa700 1 -- 172.21.15.81:0/2281956272 <== osd.3 v2:172.21.15.81:6802/86097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f588806fe80 con 0x7f588806d3a0 2023-10-06T02:58:06.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.705+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 --> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f58a40d0170 con 0x7f588806d3a0 2023-10-06T02:58:06.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58997fa700 1 -- 172.21.15.81:0/2281956272 <== osd.3 v2:172.21.15.81:6802/86097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f58a40d0170 con 0x7f588806d3a0 2023-10-06T02:58:06.707 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:58:06.707 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-06T02:58:06.707 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:58:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f588806d3a0 msgr2=0x7f588806f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.81:6802/86097,v1:172.21.15.81:6804/86097] conn(0x7f588806d3a0 0x7f588806f7b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5888066f30 msgr2=0x7f58880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f5888066f30 0x7f58880693e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f58a00018d0 tx=0x7f58a0009040 comp rx=0 tx=0).stop 2023-10-06T02:58:06.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 msgr2=0x7f58a40ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 --2- 172.21.15.81:0/2281956272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a4157ca0 0x7f58a40ca8d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f589c00ceb0 tx=0x7f589c007870 comp rx=0 tx=0).stop 2023-10-06T02:58:06.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58a9c11700 1 -- 172.21.15.81:0/2281956272 reap_dead start 2023-10-06T02:58:06.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 shutdown_connections 2023-10-06T02:58:06.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 >> 172.21.15.81:0/2281956272 conn(0x7f58a406bb90 msgr2=0x7f58a4069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 shutdown_connections 2023-10-06T02:58:06.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.706+0000 7f58ab674700 1 -- 172.21.15.81:0/2281956272 wait complete. 2023-10-06T02:58:06.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T02:58:06.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.834+0000 7fbbb157d700 1 Processor -- start 2023-10-06T02:58:06.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.834+0000 7fbbb157d700 1 -- start start 2023-10-06T02:58:06.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbb157d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbac157860 0x7fbbac06dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbb157d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac0cbec0 con 0x7fbbac0ce270 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbb157d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac0cc180 con 0x7fbbac06a020 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbb157d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0cb9d0 con 0x7fbbac157860 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbabfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbac157860 0x7fbbac06dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbb0d7c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbbac0ce270 0x7fbbac0cc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44024/0 (socket says 172.21.15.81:44024) 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbabfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbac157860 0x7fbbac06dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51300/0 (socket says 172.21.15.81:51300) 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbb0d7c700 1 -- 172.21.15.81:0/3322595231 learned_addr learned my addr 172.21.15.81:0/3322595231 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbabfff700 1 -- 172.21.15.81:0/3322595231 >> v1:172.21.15.83:6789/0 conn(0x7fbbac06a020 legacy=0x7fbbac0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbabfff700 1 -- 172.21.15.81:0/3322595231 >> v1:172.21.15.81:6789/0 conn(0x7fbbac0ce270 legacy=0x7fbbac0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.835+0000 7fbbabfff700 1 -- 172.21.15.81:0/3322595231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac06a4a0 con 0x7fbbac157860 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbabfff700 1 --2- 172.21.15.81:0/3322595231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 0x7fbbac06dfe0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0098e0 tx=0x7fbb9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441fb82c6c6b0d31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbaaffd700 1 -- 172.21.15.81:0/3322595231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c009e80 con 0x7fbbac157860 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbaaffd700 1 -- 172.21.15.81:0/3322595231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c00b820 con 0x7fbbac157860 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbaaffd700 1 -- 172.21.15.81:0/3322595231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00bba0 con 0x7fbbac157860 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbb157d700 1 -- 172.21.15.81:0/3322595231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 msgr2=0x7fbbac06dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbb157d700 1 --2- 172.21.15.81:0/3322595231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 0x7fbbac06dfe0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0098e0 tx=0x7fbb9c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbb157d700 1 -- 172.21.15.81:0/3322595231 shutdown_connections 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbb157d700 1 --2- 172.21.15.81:0/3322595231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 0x7fbbac06dfe0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbb157d700 1 -- 172.21.15.81:0/3322595231 >> 172.21.15.81:0/3322595231 conn(0x7fbbac063230 msgr2=0x7fbbac063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbb157d700 1 -- 172.21.15.81:0/3322595231 shutdown_connections 2023-10-06T02:58:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.836+0000 7fbbb157d700 1 -- 172.21.15.81:0/3322595231 wait complete. 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.837+0000 7fbbb157d700 1 Processor -- start 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.837+0000 7fbbb157d700 1 -- start start 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbb157d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac06a020 0x7fbbac146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbb157d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ce270 0x7fbbac155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbb157d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 0x7fbbac156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbb157d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac15b2d0 con 0x7fbbac157860 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbb157d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0c91b0 con 0x7fbbac06a020 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbb157d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0c9490 con 0x7fbbac0ce270 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbb0d7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 0x7fbbac156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbb0d7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 0x7fbbac156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51302/0 (socket says 172.21.15.81:51302) 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbb0d7c700 1 -- 172.21.15.81:0/3290428586 learned_addr learned my addr 172.21.15.81:0/3290428586 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbabfff700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac06a020 0x7fbbac146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.838+0000 7fbbab7fe700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ce270 0x7fbbac155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbbb0d7c700 1 -- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ce270 msgr2=0x7fbbac155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbbb0d7c700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ce270 0x7fbbac155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbbb0d7c700 1 -- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac06a020 msgr2=0x7fbbac146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbbb0d7c700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac06a020 0x7fbbac146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbbb0d7c700 1 -- 172.21.15.81:0/3290428586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c009420 con 0x7fbbac157860 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbbb0d7c700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 0x7fbbac156090 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fbba400cc40 tx=0x7fbba4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbb93fff700 1 -- 172.21.15.81:0/3290428586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400a910 con 0x7fbbac157860 2023-10-06T02:58:06.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbb93fff700 1 -- 172.21.15.81:0/3290428586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba400aa70 con 0x7fbbac157860 2023-10-06T02:58:06.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbb93fff700 1 -- 172.21.15.81:0/3290428586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400ae30 con 0x7fbbac157860 2023-10-06T02:58:06.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac0c9770 con 0x7fbbac157860 2023-10-06T02:58:06.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.839+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac0c9d30 con 0x7fbbac157860 2023-10-06T02:58:06.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.840+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac0cdb60 con 0x7fbbac157860 2023-10-06T02:58:06.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.840+0000 7fbb93fff700 1 -- 172.21.15.81:0/3290428586 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbba4007300 con 0x7fbbac157860 2023-10-06T02:58:06.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.841+0000 7fbb93fff700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb98066f30 0x7fbb980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.841+0000 7fbb93fff700 1 -- 172.21.15.81:0/3290428586 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fbba40846c0 con 0x7fbbac157860 2023-10-06T02:58:06.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.841+0000 7fbbabfff700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb98066f30 0x7fbb980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.841+0000 7fbbabfff700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb98066f30 0x7fbb980693e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0030c0 tx=0x7fbb9c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:06.845+0000 7fbb93fff700 1 -- 172.21.15.81:0/3290428586 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbba4051b50 con 0x7fbbac157860 2023-10-06T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.029+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbac16abd0 con 0x7fbb98066f30 2023-10-06T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.030+0000 7fbb93fff700 1 -- 172.21.15.81:0/3290428586 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbbac16abd0 con 0x7fbb98066f30 2023-10-06T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.031+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb98066f30 msgr2=0x7fbb980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.031+0000 7fbbb157d700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb98066f30 0x7fbb980693e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0030c0 tx=0x7fbb9c016000 comp rx=0 tx=0).stop 2023-10-06T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.031+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 msgr2=0x7fbbac156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.031+0000 7fbbb157d700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 0x7fbbac156090 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fbba400cc40 tx=0x7fbba4001a50 comp rx=0 tx=0).stop 2023-10-06T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.031+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 shutdown_connections 2023-10-06T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.031+0000 7fbbb157d700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac157860 0x7fbbac156090 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.031+0000 7fbbb157d700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fbb98066f30 0x7fbb980693e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.031+0000 7fbbb157d700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbac06a020 0x7fbbac146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.031+0000 7fbbb157d700 1 --2- 172.21.15.81:0/3290428586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbac0ce270 0x7fbbac155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.032+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 >> 172.21.15.81:0/3290428586 conn(0x7fbbac063230 msgr2=0x7fbbac063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:07.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.032+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 shutdown_connections 2023-10-06T02:58:07.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.032+0000 7fbbb157d700 1 -- 172.21.15.81:0/3290428586 wait complete. 2023-10-06T02:58:07.034 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T02:58:07.045 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T02:58:07.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:58:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.162+0000 7f71e3712700 1 Processor -- start 2023-10-06T02:58:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.162+0000 7f71e3712700 1 -- start start 2023-10-06T02:58:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71e3712700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f71dc06d830 0x7f71dc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71e3712700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0d07c0 con 0x7f71dc1578d0 2023-10-06T02:58:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71e3712700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0cfbb0 con 0x7f71dc157ca0 2023-10-06T02:58:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71e3712700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0cfe90 con 0x7f71dc06d830 2023-10-06T02:58:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71e14ae700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f71dc1578d0 0x7f71dc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44026/0 (socket says 172.21.15.81:44026) 2023-10-06T02:58:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71e14ae700 1 -- 172.21.15.81:0/358369746 learned_addr learned my addr 172.21.15.81:0/358369746 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71e1caf700 1 --2- 172.21.15.81:0/358369746 >> v2:172.21.15.83:3300/0 conn(0x7f71dc06d830 0x7f71dc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831929655 0 0) 0x7f71dc0d07c0 con 0x7f71dc1578d0 2023-10-06T02:58:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c8003570 con 0x7f71dc1578d0 2023-10-06T02:58:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.163+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3292180933 0 0) 0x7f71c8003570 con 0x7f71dc1578d0 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 >> v2:172.21.15.83:3300/0 conn(0x7f71dc06d830 msgr2=0x7f71dc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 --2- 172.21.15.81:0/358369746 >> v2:172.21.15.83:3300/0 conn(0x7f71dc06d830 0x7f71dc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 >> v1:172.21.15.83:6789/0 conn(0x7f71dc157ca0 legacy=0x7f71dc06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0d0170 con 0x7f71dc1578d0 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f71d40017f0 con 0x7f71dc1578d0 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e1caf700 1 --2- 172.21.15.81:0/358369746 >> v2:172.21.15.83:3300/0 conn(0x7f71dc06d830 0x7f71dc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 >> v1:172.21.15.81:6789/0 conn(0x7f71dc1578d0 legacy=0x7f71dc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c8003a60 0x7f71c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c80051c0 0x7f71c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0cfe90 con 0x7f71c8004810 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c800c0d0 con 0x7f71c8003a60 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c800c290 con 0x7f71c80051c0 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e0cad700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e14ae700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c8003a60 0x7f71c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e1caf700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c80051c0 0x7f71c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e0cad700 1 -- 172.21.15.81:0/358369746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c80051c0 msgr2=0x7f71c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e0cad700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71c80051c0 0x7f71c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e0cad700 1 -- 172.21.15.81:0/358369746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c8003a60 msgr2=0x7f71c8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e0cad700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71c8003a60 0x7f71c8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e0cad700 1 -- 172.21.15.81:0/358369746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8003570 con 0x7f71c8004810 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e1caf700 1 -- 172.21.15.81:0/358369746 reap_dead start 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71e0cad700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71c8004c80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f71cc001880 tx=0x7f71cc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6472129b691145 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc012420 con 0x7f71c8004810 2023-10-06T02:58:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc012580 con 0x7f71c8004810 2023-10-06T02:58:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.164+0000 7f71d3fff700 1 -- 172.21.15.81:0/358369746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc012920 con 0x7f71c8004810 2023-10-06T02:58:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.165+0000 7f71e3712700 1 -- 172.21.15.81:0/358369746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 msgr2=0x7f71c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.165+0000 7f71e3712700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71c8004c80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f71cc001880 tx=0x7f71cc007d30 comp rx=0 tx=0).stop 2023-10-06T02:58:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.165+0000 7f71e3712700 1 -- 172.21.15.81:0/358369746 shutdown_connections 2023-10-06T02:58:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.165+0000 7f71e3712700 1 --2- 172.21.15.81:0/358369746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71c8004c80 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.165+0000 7f71e3712700 1 -- 172.21.15.81:0/358369746 >> 172.21.15.81:0/358369746 conn(0x7f71dc06bb90 msgr2=0x7f71dc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.165+0000 7f71e3712700 1 -- 172.21.15.81:0/358369746 shutdown_connections 2023-10-06T02:58:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.165+0000 7f71e3712700 1 -- 172.21.15.81:0/358369746 wait complete. 2023-10-06T02:58:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.166+0000 7f71e3712700 1 Processor -- start 2023-10-06T02:58:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.166+0000 7f71e3712700 1 -- start start 2023-10-06T02:58:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e3712700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71dc0b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e3712700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc0b61f0 0x7f71dc0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e3712700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc16a550 0x7f71dc16a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e3712700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0b6660 con 0x7f71c8004810 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e3712700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0b5150 con 0x7f71dc16a550 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e3712700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0b5430 con 0x7f71dc0b61f0 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e14ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71dc0b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e14ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71dc0b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51328/0 (socket says 172.21.15.81:51328) 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e14ae700 1 -- 172.21.15.81:0/4037422980 learned_addr learned my addr 172.21.15.81:0/4037422980 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e1caf700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc16a550 0x7f71dc16a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e0cad700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc0b61f0 0x7f71dc0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e14ae700 1 -- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc0b61f0 msgr2=0x7f71dc0c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e14ae700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71dc0b61f0 0x7f71dc0c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e14ae700 1 -- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc16a550 msgr2=0x7f71dc16a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e14ae700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71dc16a550 0x7f71dc16a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e14ae700 1 -- 172.21.15.81:0/4037422980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0b5710 con 0x7f71c8004810 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.167+0000 7f71e14ae700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71dc0b4b70 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f71d4007a90 tx=0x7f71d40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.168+0000 7f71d17fa700 1 -- 172.21.15.81:0/4037422980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400ad70 con 0x7f71c8004810 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.168+0000 7f71d17fa700 1 -- 172.21.15.81:0/4037422980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d40133f0 con 0x7f71c8004810 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.168+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc0b59f0 con 0x7f71c8004810 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.168+0000 7f71d17fa700 1 -- 172.21.15.81:0/4037422980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40137b0 con 0x7f71c8004810 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.168+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc0c89f0 con 0x7f71c8004810 2023-10-06T02:58:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.168+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71dc067ac0 con 0x7f71c8004810 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.169+0000 7f71d17fa700 1 -- 172.21.15.81:0/4037422980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71d4013b20 con 0x7f71c8004810 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.169+0000 7f71d17fa700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c0066f30 0x7f71c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.169+0000 7f71d17fa700 1 -- 172.21.15.81:0/4037422980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f71d4085190 con 0x7f71c8004810 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.169+0000 7f71d17fa700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f71c006d3a0 0x7f71c006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.169+0000 7f71d17fa700 1 -- 172.21.15.81:0/4037422980 --> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71c006fe80 con 0x7f71c006d3a0 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.169+0000 7f71d17fa700 1 -- 172.21.15.81:0/4037422980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71d40877d0 con 0x7f71c8004810 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.170+0000 7f71e0cad700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c0066f30 0x7f71c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.170+0000 7f71e1caf700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f71c006d3a0 0x7f71c006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.170+0000 7f71e0cad700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c0066f30 0x7f71c00693e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f71dc154eb0 tx=0x7f71cc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.170+0000 7f71e1caf700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f71c006d3a0 0x7f71c006f7b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.171+0000 7f71d17fa700 1 -- 172.21.15.81:0/4037422980 <== osd.4 v2:172.21.15.83:6800/86341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f71c006fe80 con 0x7f71c006d3a0 2023-10-06T02:58:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.183+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 --> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f71dc0d0450 con 0x7f71c006d3a0 2023-10-06T02:58:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71d17fa700 1 -- 172.21.15.81:0/4037422980 <== osd.4 v2:172.21.15.83:6800/86341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f71dc0d0450 con 0x7f71c006d3a0 2023-10-06T02:58:07.185 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:58:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-06T02:58:07.185 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:58:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f71c006d3a0 msgr2=0x7f71c006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6800/86341,v1:172.21.15.83:6801/86341] conn(0x7f71c006d3a0 0x7f71c006f7b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c0066f30 msgr2=0x7f71c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f71c0066f30 0x7f71c00693e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f71dc154eb0 tx=0x7f71cc015000 comp rx=0 tx=0).stop 2023-10-06T02:58:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 msgr2=0x7f71dc0b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 --2- 172.21.15.81:0/4037422980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71c8004810 0x7f71dc0b4b70 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f71d4007a90 tx=0x7f71d40021d0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e1caf700 1 -- 172.21.15.81:0/4037422980 reap_dead start 2023-10-06T02:58:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 shutdown_connections 2023-10-06T02:58:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 >> 172.21.15.81:0/4037422980 conn(0x7f71dc06bb90 msgr2=0x7f71dc1569c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 shutdown_connections 2023-10-06T02:58:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.184+0000 7f71e3712700 1 -- 172.21.15.81:0/4037422980 wait complete. 2023-10-06T02:58:07.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T02:58:07.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.310+0000 7faa813f4700 1 Processor -- start 2023-10-06T02:58:07.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.311+0000 7faa813f4700 1 -- start start 2023-10-06T02:58:07.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.311+0000 7faa813f4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa7c1578d0 0x7faa7c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.311+0000 7faa813f4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faa7c06d120 0x7faa7c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.311+0000 7faa813f4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c0d07c0 con 0x7faa7c157ca0 2023-10-06T02:58:07.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.311+0000 7faa813f4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c06da50 con 0x7faa7c1578d0 2023-10-06T02:58:07.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.311+0000 7faa813f4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c0cfbb0 con 0x7faa7c06d120 2023-10-06T02:58:07.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.311+0000 7faa7affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa7c1578d0 0x7faa7c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa7c1578d0 0x7faa7c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51344/0 (socket says 172.21.15.81:51344) 2023-10-06T02:58:07.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7affd700 1 -- 172.21.15.81:0/4195290878 learned_addr learned my addr 172.21.15.81:0/4195290878 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:07.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7b7fe700 1 --2- 172.21.15.81:0/4195290878 >> v2:172.21.15.83:3300/0 conn(0x7faa7c06d120 0x7faa7c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7affd700 1 -- 172.21.15.81:0/4195290878 >> v2:172.21.15.83:3300/0 conn(0x7faa7c06d120 msgr2=0x7faa7c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:07.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7affd700 1 --2- 172.21.15.81:0/4195290878 >> v2:172.21.15.83:3300/0 conn(0x7faa7c06d120 0x7faa7c06d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7affd700 1 -- 172.21.15.81:0/4195290878 >> v1:172.21.15.83:6789/0 conn(0x7faa7c157ca0 legacy=0x7faa7c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7affd700 1 -- 172.21.15.81:0/4195290878 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c0cfe90 con 0x7faa7c1578d0 2023-10-06T02:58:07.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7affd700 1 --2- 172.21.15.81:0/4195290878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 0x7faa7c0cf4f0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7faa7c068300 tx=0x7faa6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae58dc57deadf15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7a7fc700 1 -- 172.21.15.81:0/4195290878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c009e70 con 0x7faa7c1578d0 2023-10-06T02:58:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7a7fc700 1 -- 172.21.15.81:0/4195290878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c00b860 con 0x7faa7c1578d0 2023-10-06T02:58:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.312+0000 7faa7a7fc700 1 -- 172.21.15.81:0/4195290878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00bc00 con 0x7faa7c1578d0 2023-10-06T02:58:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.313+0000 7faa813f4700 1 -- 172.21.15.81:0/4195290878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 msgr2=0x7faa7c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.313+0000 7faa813f4700 1 --2- 172.21.15.81:0/4195290878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 0x7faa7c0cf4f0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7faa7c068300 tx=0x7faa6c009250 comp rx=0 tx=0).stop 2023-10-06T02:58:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.313+0000 7faa813f4700 1 -- 172.21.15.81:0/4195290878 shutdown_connections 2023-10-06T02:58:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.313+0000 7faa813f4700 1 --2- 172.21.15.81:0/4195290878 >> v2:172.21.15.83:3300/0 conn(0x7faa7c06d120 0x7faa7c06d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.313+0000 7faa813f4700 1 --2- 172.21.15.81:0/4195290878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 0x7faa7c0cf4f0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.313+0000 7faa813f4700 1 -- 172.21.15.81:0/4195290878 >> 172.21.15.81:0/4195290878 conn(0x7faa7c06bb90 msgr2=0x7faa7c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.313+0000 7faa813f4700 1 -- 172.21.15.81:0/4195290878 shutdown_connections 2023-10-06T02:58:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.313+0000 7faa813f4700 1 -- 172.21.15.81:0/4195290878 wait complete. 2023-10-06T02:58:07.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.314+0000 7faa813f4700 1 Processor -- start 2023-10-06T02:58:07.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.314+0000 7faa813f4700 1 -- start start 2023-10-06T02:58:07.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa813f4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa7c06d120 0x7faa7c151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa813f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 0x7faa7c1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa813f4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa7c157ca0 0x7faa7c151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa813f4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c14da60 con 0x7faa7c1578d0 2023-10-06T02:58:07.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa813f4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c159df0 con 0x7faa7c157ca0 2023-10-06T02:58:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa813f4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c158f40 con 0x7faa7c06d120 2023-10-06T02:58:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa727fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 0x7faa7c1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa727fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 0x7faa7c1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51360/0 (socket says 172.21.15.81:51360) 2023-10-06T02:58:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa727fc700 1 -- 172.21.15.81:0/1182517344 learned_addr learned my addr 172.21.15.81:0/1182517344 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa7affd700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa7c06d120 0x7faa7c151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa7b7fe700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa7c157ca0 0x7faa7c151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa727fc700 1 -- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa7c06d120 msgr2=0x7faa7c151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa727fc700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa7c06d120 0x7faa7c151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa727fc700 1 -- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa7c157ca0 msgr2=0x7faa7c151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa727fc700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa7c157ca0 0x7faa7c151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa727fc700 1 -- 172.21.15.81:0/1182517344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0094f0 con 0x7faa7c1578d0 2023-10-06T02:58:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa7affd700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa7c06d120 0x7faa7c151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa727fc700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 0x7faa7c1518c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c590 tx=0x7faa64007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa737fe700 1 -- 172.21.15.81:0/1182517344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64011590 con 0x7faa7c1578d0 2023-10-06T02:58:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa737fe700 1 -- 172.21.15.81:0/1182517344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64011710 con 0x7faa7c1578d0 2023-10-06T02:58:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa737fe700 1 -- 172.21.15.81:0/1182517344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64011ad0 con 0x7faa7c1578d0 2023-10-06T02:58:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c1591e0 con 0x7faa7c1578d0 2023-10-06T02:58:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.315+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c159570 con 0x7faa7c1578d0 2023-10-06T02:58:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.316+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c159fa0 con 0x7faa7c1578d0 2023-10-06T02:58:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.317+0000 7faa737fe700 1 -- 172.21.15.81:0/1182517344 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa6401a360 con 0x7faa7c1578d0 2023-10-06T02:58:07.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.317+0000 7faa737fe700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa5c066f30 0x7faa5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.317+0000 7faa737fe700 1 -- 172.21.15.81:0/1182517344 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7faa640832a0 con 0x7faa7c1578d0 2023-10-06T02:58:07.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.317+0000 7faa7affd700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa5c066f30 0x7faa5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.318+0000 7faa7affd700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa5c066f30 0x7faa5c0693e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7faa7c068300 tx=0x7faa6c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.321+0000 7faa737fe700 1 -- 172.21.15.81:0/1182517344 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa7c159fa0 con 0x7faa7c1578d0 2023-10-06T02:58:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.502+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7faa7c159ba0 con 0x7faa5c066f30 2023-10-06T02:58:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.503+0000 7faa737fe700 1 -- 172.21.15.81:0/1182517344 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faa7c159ba0 con 0x7faa5c066f30 2023-10-06T02:58:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa5c066f30 msgr2=0x7faa5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa5c066f30 0x7faa5c0693e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7faa7c068300 tx=0x7faa6c017000 comp rx=0 tx=0).stop 2023-10-06T02:58:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 msgr2=0x7faa7c1518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 0x7faa7c1518c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c590 tx=0x7faa64007f50 comp rx=0 tx=0).stop 2023-10-06T02:58:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 shutdown_connections 2023-10-06T02:58:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7faa5c066f30 0x7faa5c0693e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa7c157ca0 0x7faa7c151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faa7c06d120 0x7faa7c151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 --2- 172.21.15.81:0/1182517344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c1578d0 0x7faa7c1518c0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 >> 172.21.15.81:0/1182517344 conn(0x7faa7c06bb90 msgr2=0x7faa7c156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 shutdown_connections 2023-10-06T02:58:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.505+0000 7faa813f4700 1 -- 172.21.15.81:0/1182517344 wait complete. 2023-10-06T02:58:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T02:58:07.518 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T02:58:07.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:58:07.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.635+0000 7f79f57b2700 1 Processor -- start 2023-10-06T02:58:07.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.635+0000 7f79f57b2700 1 -- start start 2023-10-06T02:58:07.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.636+0000 7f79f57b2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f79f00ce5c0 0x7f79f00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.636+0000 7f79f57b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 0x7f79f006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.636+0000 7f79f57b2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f015dfb0 con 0x7f79f00ce1f0 2023-10-06T02:58:07.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.636+0000 7f79f57b2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00acec0 con 0x7f79f00ce5c0 2023-10-06T02:58:07.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.636+0000 7f79f57b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00ad1a0 con 0x7f79f00ac570 2023-10-06T02:58:07.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.636+0000 7f79ef7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 0x7f79f006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.636+0000 7f79ee7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f79f00ce5c0 0x7f79f00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.636+0000 7f79eeffd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f79f00ce1f0 0x7f79f015e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:53712/0 (socket says 172.21.15.81:53712) 2023-10-06T02:58:07.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.636+0000 7f79eeffd700 1 -- 172.21.15.81:0/1343148212 learned_addr learned my addr 172.21.15.81:0/1343148212 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.637+0000 7f79ee7fc700 1 -- 172.21.15.81:0/1343148212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 msgr2=0x7f79f006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.637+0000 7f79ee7fc700 1 --2- 172.21.15.81:0/1343148212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 0x7f79f006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.637+0000 7f79ee7fc700 1 -- 172.21.15.81:0/1343148212 >> v1:172.21.15.83:6789/0 conn(0x7f79f00ce1f0 legacy=0x7f79f015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.637+0000 7f79ee7fc700 1 -- 172.21.15.81:0/1343148212 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f015dc40 con 0x7f79f00ce5c0 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.637+0000 7f79edffb700 1 -- 172.21.15.81:0/1343148212 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530177457 0 0) 0x7f79f015dfb0 con 0x7f79f00ce1f0 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.637+0000 7f79ee7fc700 1 --2- 172.21.15.81:0/1343148212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00ce5c0 0x7f79f00aacf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f79e40098e0 tx=0x7f79e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bfec9f699013bc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.637+0000 7f79edffb700 1 -- 172.21.15.81:0/1343148212 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400b640 con 0x7f79f00ce5c0 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.637+0000 7f79edffb700 1 -- 172.21.15.81:0/1343148212 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e400b7a0 con 0x7f79f00ce5c0 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.637+0000 7f79edffb700 1 -- 172.21.15.81:0/1343148212 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400bb40 con 0x7f79f00ce5c0 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.638+0000 7f79f57b2700 1 -- 172.21.15.81:0/1343148212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00ce5c0 msgr2=0x7f79f00aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.638+0000 7f79f57b2700 1 --2- 172.21.15.81:0/1343148212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00ce5c0 0x7f79f00aacf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f79e40098e0 tx=0x7f79e40091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.638+0000 7f79f57b2700 1 -- 172.21.15.81:0/1343148212 shutdown_connections 2023-10-06T02:58:07.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.638+0000 7f79f57b2700 1 --2- 172.21.15.81:0/1343148212 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 0x7f79f006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.638+0000 7f79f57b2700 1 --2- 172.21.15.81:0/1343148212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00ce5c0 0x7f79f00aacf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.638+0000 7f79f57b2700 1 -- 172.21.15.81:0/1343148212 >> 172.21.15.81:0/1343148212 conn(0x7f79f006cca0 msgr2=0x7f79f006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:07.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.638+0000 7f79f57b2700 1 -- 172.21.15.81:0/1343148212 shutdown_connections 2023-10-06T02:58:07.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.638+0000 7f79f57b2700 1 -- 172.21.15.81:0/1343148212 wait complete. 2023-10-06T02:58:07.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.639+0000 7f79f57b2700 1 Processor -- start 2023-10-06T02:58:07.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.639+0000 7f79f57b2700 1 -- start start 2023-10-06T02:58:07.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79f57b2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 0x7f79f01474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79f57b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ce1f0 0x7f79f015a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79f57b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00ce5c0 0x7f79f015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79f57b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0155d90 con 0x7f79f00ce1f0 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79f57b2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00c2d00 con 0x7f79f00ce5c0 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79f57b2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f015b4d0 con 0x7f79f00ac570 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ee7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ce1f0 0x7f79f015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ee7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ce1f0 0x7f79f015a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51362/0 (socket says 172.21.15.81:51362) 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ee7fc700 1 -- 172.21.15.81:0/2040777049 learned_addr learned my addr 172.21.15.81:0/2040777049 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ef7fe700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00ce5c0 0x7f79f015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79eeffd700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 0x7f79f01474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ee7fc700 1 -- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 msgr2=0x7f79f01474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ee7fc700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 0x7f79f01474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ee7fc700 1 -- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00ce5c0 msgr2=0x7f79f015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ee7fc700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00ce5c0 0x7f79f015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ee7fc700 1 -- 172.21.15.81:0/2040777049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4009420 con 0x7f79f00ce1f0 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ef7fe700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f00ce5c0 0x7f79f015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79eeffd700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79f00ac570 0x7f79f01474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79ee7fc700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ce1f0 0x7f79f015a330 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f79f006cc70 tx=0x7f79e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79d6ffd700 1 -- 172.21.15.81:0/2040777049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400b910 con 0x7f79f00ce1f0 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.640+0000 7f79d6ffd700 1 -- 172.21.15.81:0/2040777049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e400ba90 con 0x7f79f00ce1f0 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.641+0000 7f79d6ffd700 1 -- 172.21.15.81:0/2040777049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4025670 con 0x7f79f00ce1f0 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.641+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f00c29d0 con 0x7f79f00ce1f0 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.641+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f015b1f0 con 0x7f79f00ce1f0 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.641+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79f0068900 con 0x7f79f00ce1f0 2023-10-06T02:58:07.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.642+0000 7f79d6ffd700 1 -- 172.21.15.81:0/2040777049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79e4023070 con 0x7f79f00ce1f0 2023-10-06T02:58:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.642+0000 7f79d6ffd700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f79dc066f30 0x7f79dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.642+0000 7f79d6ffd700 1 -- 172.21.15.81:0/2040777049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f79e4085970 con 0x7f79f00ce1f0 2023-10-06T02:58:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.642+0000 7f79d6ffd700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7f79dc06d3a0 0x7f79dc06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.642+0000 7f79d6ffd700 1 -- 172.21.15.81:0/2040777049 --> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79dc06fe80 con 0x7f79dc06d3a0 2023-10-06T02:58:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.642+0000 7f79d6ffd700 1 -- 172.21.15.81:0/2040777049 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79e408a240 con 0x7f79f00ce1f0 2023-10-06T02:58:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.642+0000 7f79eeffd700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f79dc066f30 0x7f79dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.643+0000 7f79ef7fe700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7f79dc06d3a0 0x7f79dc06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.643+0000 7f79eeffd700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f79dc066f30 0x7f79dc0693e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f79e000d270 tx=0x7f79e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.643+0000 7f79ef7fe700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7f79dc06d3a0 0x7f79dc06f7b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.644+0000 7f79d6ffd700 1 -- 172.21.15.81:0/2040777049 <== osd.5 v2:172.21.15.83:6808/86342 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f79dc06fe80 con 0x7f79dc06d3a0 2023-10-06T02:58:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.656+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 --> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79f00aca10 con 0x7f79dc06d3a0 2023-10-06T02:58:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79d6ffd700 1 -- 172.21.15.81:0/2040777049 <== osd.5 v2:172.21.15.83:6808/86342 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f79f00aca10 con 0x7f79dc06d3a0 2023-10-06T02:58:07.658 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:58:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-06T02:58:07.658 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:58:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7f79dc06d3a0 msgr2=0x7f79dc06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6808/86342,v1:172.21.15.83:6809/86342] conn(0x7f79dc06d3a0 0x7f79dc06f7b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f79dc066f30 msgr2=0x7f79dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f79dc066f30 0x7f79dc0693e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f79e000d270 tx=0x7f79e0009040 comp rx=0 tx=0).stop 2023-10-06T02:58:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ce1f0 msgr2=0x7f79f015a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 --2- 172.21.15.81:0/2040777049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ce1f0 0x7f79f015a330 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f79f006cc70 tx=0x7f79e4017000 comp rx=0 tx=0).stop 2023-10-06T02:58:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79ef7fe700 1 -- 172.21.15.81:0/2040777049 reap_dead start 2023-10-06T02:58:07.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 shutdown_connections 2023-10-06T02:58:07.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 >> 172.21.15.81:0/2040777049 conn(0x7f79f006cca0 msgr2=0x7f79f0156690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:07.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 shutdown_connections 2023-10-06T02:58:07.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.657+0000 7f79f57b2700 1 -- 172.21.15.81:0/2040777049 wait complete. 2023-10-06T02:58:07.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T02:58:07.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.783+0000 7fbaaccf1700 1 Processor -- start 2023-10-06T02:58:07.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.783+0000 7fbaaccf1700 1 -- start start 2023-10-06T02:58:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaaccf1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbaa81569e0 0x7fbaa80b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaaccf1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa8156db0 0x7fbaa806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaaccf1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa80b2290 con 0x7fbaa80b1d10 2023-10-06T02:58:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaaccf1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa8157c00 con 0x7fbaa81569e0 2023-10-06T02:58:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaaccf1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa81572d0 con 0x7fbaa8156db0 2023-10-06T02:58:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaa5d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa8156db0 0x7fbaa806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaa659c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbaa81569e0 0x7fbaa80b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaa5d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa8156db0 0x7fbaa806e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:58796/0 (socket says 172.21.15.81:58796) 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaa659c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbaa81569e0 0x7fbaa80b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:33542/0 (socket says 172.21.15.81:33542) 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaa5d9b700 1 -- 172.21.15.81:0/1834187452 learned_addr learned my addr 172.21.15.81:0/1834187452 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.784+0000 7fbaa6d9d700 1 --1- 172.21.15.81:0/1834187452 >> v1:172.21.15.83:6789/0 conn(0x7fbaa80b1d10 0x7fbaa815a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:53714/0 (socket says 172.21.15.81:53714) 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa559a700 1 -- 172.21.15.81:0/1834187452 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647641183 0 0) 0x7fbaa80b2290 con 0x7fbaa80b1d10 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa559a700 1 -- 172.21.15.81:0/1834187452 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba90003570 con 0x7fbaa80b1d10 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa5d9b700 1 -- 172.21.15.81:0/1834187452 >> v2:172.21.15.83:3300/0 conn(0x7fbaa81569e0 msgr2=0x7fbaa80b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa5d9b700 1 --2- 172.21.15.81:0/1834187452 >> v2:172.21.15.83:3300/0 conn(0x7fbaa81569e0 0x7fbaa80b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa5d9b700 1 -- 172.21.15.81:0/1834187452 >> v1:172.21.15.83:6789/0 conn(0x7fbaa80b1d10 legacy=0x7fbaa815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa5d9b700 1 -- 172.21.15.81:0/1834187452 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa81575b0 con 0x7fbaa8156db0 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa659c700 1 --2- 172.21.15.81:0/1834187452 >> v2:172.21.15.83:3300/0 conn(0x7fbaa81569e0 0x7fbaa80b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa5d9b700 1 --2- 172.21.15.81:0/1834187452 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa8156db0 0x7fbaa806e230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0099b0 tx=0x7fba9c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b39727fec32bd21e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa559a700 1 -- 172.21.15.81:0/1834187452 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00b680 con 0x7fbaa8156db0 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa559a700 1 -- 172.21.15.81:0/1834187452 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c00b7e0 con 0x7fbaa8156db0 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.785+0000 7fbaa559a700 1 -- 172.21.15.81:0/1834187452 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00bb80 con 0x7fbaa8156db0 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.786+0000 7fbaaccf1700 1 -- 172.21.15.81:0/1834187452 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa8156db0 msgr2=0x7fbaa806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.786+0000 7fbaaccf1700 1 --2- 172.21.15.81:0/1834187452 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa8156db0 0x7fbaa806e230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0099b0 tx=0x7fba9c009250 comp rx=0 tx=0).stop 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.786+0000 7fbaaccf1700 1 -- 172.21.15.81:0/1834187452 shutdown_connections 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.786+0000 7fbaaccf1700 1 --2- 172.21.15.81:0/1834187452 >> v2:172.21.15.83:3300/0 conn(0x7fbaa81569e0 0x7fbaa80b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.786+0000 7fbaaccf1700 1 --2- 172.21.15.81:0/1834187452 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa8156db0 0x7fbaa806e230 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.786+0000 7fbaaccf1700 1 -- 172.21.15.81:0/1834187452 >> 172.21.15.81:0/1834187452 conn(0x7fbaa806cca0 msgr2=0x7fbaa806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.786+0000 7fbaaccf1700 1 -- 172.21.15.81:0/1834187452 shutdown_connections 2023-10-06T02:58:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.786+0000 7fbaaccf1700 1 -- 172.21.15.81:0/1834187452 wait complete. 2023-10-06T02:58:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.787+0000 7fbaaccf1700 1 Processor -- start 2023-10-06T02:58:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.787+0000 7fbaaccf1700 1 -- start start 2023-10-06T02:58:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.787+0000 7fbaaccf1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa80b1d10 0x7fbaa814b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.787+0000 7fbaaccf1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa81569e0 0x7fbaa8161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.787+0000 7fbaaccf1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa8156db0 0x7fbaa80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaaccf1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa814df10 con 0x7fbaa8156db0 2023-10-06T02:58:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaaccf1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80aef90 con 0x7fbaa81569e0 2023-10-06T02:58:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaaccf1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa814ae10 con 0x7fbaa80b1d10 2023-10-06T02:58:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa8156db0 0x7fbaa80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa8156db0 0x7fbaa80af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51374/0 (socket says 172.21.15.81:51374) 2023-10-06T02:58:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa6d9d700 1 -- 172.21.15.81:0/3505920102 learned_addr learned my addr 172.21.15.81:0/3505920102 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa5d9b700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa81569e0 0x7fbaa8161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa659c700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa80b1d10 0x7fbaa814b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa6d9d700 1 -- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa80b1d10 msgr2=0x7fbaa814b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa6d9d700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa80b1d10 0x7fbaa814b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa6d9d700 1 -- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa81569e0 msgr2=0x7fbaa8161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa6d9d700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa81569e0 0x7fbaa8161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa6d9d700 1 -- 172.21.15.81:0/3505920102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba98009420 con 0x7fbaa8156db0 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa659c700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa80b1d10 0x7fbaa814b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa5d9b700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa81569e0 0x7fbaa8161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaa6d9d700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa8156db0 0x7fbaa80af420 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000cd30 tx=0x7fbaa0001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fba967fc700 1 -- 172.21.15.81:0/3505920102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0005df0 con 0x7fbaa8156db0 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fba967fc700 1 -- 172.21.15.81:0/3505920102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa000a900 con 0x7fbaa8156db0 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c0094f0 con 0x7fbaa8156db0 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fba967fc700 1 -- 172.21.15.81:0/3505920102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000ac80 con 0x7fbaa8156db0 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.788+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa80ae940 con 0x7fbaa8156db0 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.789+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa80ae420 con 0x7fbaa8156db0 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.790+0000 7fba967fc700 1 -- 172.21.15.81:0/3505920102 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaa0007300 con 0x7fbaa8156db0 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.790+0000 7fba967fc700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba88066f30 0x7fba880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.790+0000 7fba967fc700 1 -- 172.21.15.81:0/3505920102 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fbaa00845e0 con 0x7fbaa8156db0 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.790+0000 7fbaa659c700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba88066f30 0x7fba880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.791+0000 7fbaa659c700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba88066f30 0x7fba880693e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fba980093f0 tx=0x7fba98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.794+0000 7fba967fc700 1 -- 172.21.15.81:0/3505920102 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbaa80ae420 con 0x7fbaa8156db0 2023-10-06T02:58:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.974+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fbaa80ae3c0 con 0x7fba88066f30 2023-10-06T02:58:07.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.975+0000 7fba967fc700 1 -- 172.21.15.81:0/3505920102 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbaa80ae3c0 con 0x7fba88066f30 2023-10-06T02:58:07.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba88066f30 msgr2=0x7fba880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba88066f30 0x7fba880693e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fba980093f0 tx=0x7fba98008040 comp rx=0 tx=0).stop 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa8156db0 msgr2=0x7fbaa80af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa8156db0 0x7fbaa80af420 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000cd30 tx=0x7fbaa0001b60 comp rx=0 tx=0).stop 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 shutdown_connections 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa8156db0 0x7fbaa80af420 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbaa80b1d10 0x7fbaa814b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fba88066f30 0x7fba880693e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 --2- 172.21.15.81:0/3505920102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa81569e0 0x7fbaa8161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 >> 172.21.15.81:0/3505920102 conn(0x7fbaa806cca0 msgr2=0x7fbaa81558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 shutdown_connections 2023-10-06T02:58:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:07.977+0000 7fbaaccf1700 1 -- 172.21.15.81:0/3505920102 wait complete. 2023-10-06T02:58:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T02:58:07.989 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T02:58:07.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:58:08.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:08.104 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:08.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.107+0000 7f51e3084700 1 Processor -- start 2023-10-06T02:58:08.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.107+0000 7f51e3084700 1 -- start start 2023-10-06T02:58:08.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.108+0000 7f51e3084700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51dc1578b0 0x7f51dc15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.108+0000 7f51e3084700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51dc06c2a0 0x7f51dc069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.108+0000 7f51e3084700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc0cb1b0 con 0x7f51dc157c80 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.108+0000 7f51e3084700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc15c5f0 con 0x7f51dc06c2a0 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.108+0000 7f51e3084700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc0ca5a0 con 0x7f51dc1578b0 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.108+0000 7f51e2883700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51dc06c2a0 0x7f51dc069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.108+0000 7f51e2883700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51dc06c2a0 0x7f51dc069b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51380/0 (socket says 172.21.15.81:51380) 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.108+0000 7f51e2883700 1 -- 172.21.15.81:0/2984606437 learned_addr learned my addr 172.21.15.81:0/2984606437 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.108+0000 7f51e2082700 1 --2- 172.21.15.81:0/2984606437 >> v2:172.21.15.83:3300/0 conn(0x7f51dc1578b0 0x7f51dc15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e2883700 1 -- 172.21.15.81:0/2984606437 >> v2:172.21.15.83:3300/0 conn(0x7f51dc1578b0 msgr2=0x7f51dc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e2883700 1 --2- 172.21.15.81:0/2984606437 >> v2:172.21.15.83:3300/0 conn(0x7f51dc1578b0 0x7f51dc15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e2883700 1 -- 172.21.15.81:0/2984606437 >> v1:172.21.15.83:6789/0 conn(0x7f51dc157c80 legacy=0x7f51dc06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e2883700 1 -- 172.21.15.81:0/2984606437 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc0ca880 con 0x7f51dc06c2a0 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e2883700 1 --2- 172.21.15.81:0/2984606437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc06c2a0 0x7f51dc069b40 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0ce940 tx=0x7f51d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1637706c4a8e5d4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e1080700 1 -- 172.21.15.81:0/2984606437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400e070 con 0x7f51dc06c2a0 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e1080700 1 -- 172.21.15.81:0/2984606437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400ba20 con 0x7f51dc06c2a0 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e1080700 1 -- 172.21.15.81:0/2984606437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40092e0 con 0x7f51dc06c2a0 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e3084700 1 -- 172.21.15.81:0/2984606437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc06c2a0 msgr2=0x7f51dc069b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.109+0000 7f51e3084700 1 --2- 172.21.15.81:0/2984606437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc06c2a0 0x7f51dc069b40 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0ce940 tx=0x7f51d4009840 comp rx=0 tx=0).stop 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.110+0000 7f51e3084700 1 -- 172.21.15.81:0/2984606437 shutdown_connections 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.110+0000 7f51e3084700 1 --2- 172.21.15.81:0/2984606437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc06c2a0 0x7f51dc069b40 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.110+0000 7f51e3084700 1 --2- 172.21.15.81:0/2984606437 >> v2:172.21.15.83:3300/0 conn(0x7f51dc1578b0 0x7f51dc15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.110+0000 7f51e3084700 1 -- 172.21.15.81:0/2984606437 >> 172.21.15.81:0/2984606437 conn(0x7f51dc06cca0 msgr2=0x7f51dc06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:08.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.110+0000 7f51e3084700 1 -- 172.21.15.81:0/2984606437 shutdown_connections 2023-10-06T02:58:08.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.110+0000 7f51e3084700 1 -- 172.21.15.81:0/2984606437 wait complete. 2023-10-06T02:58:08.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.111+0000 7f51e3084700 1 Processor -- start 2023-10-06T02:58:08.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.111+0000 7f51e3084700 1 -- start start 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.111+0000 7f51e3084700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc06c2a0 0x7f51dc142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.111+0000 7f51e3084700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc1578b0 0x7f51dc0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.111+0000 7f51e3084700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51dc157c80 0x7f51dc0ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.111+0000 7f51e3084700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0b2c10 con 0x7f51dc1578b0 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.111+0000 7f51e3084700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc16c4b0 con 0x7f51dc06c2a0 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.111+0000 7f51e3084700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0b25c0 con 0x7f51dc157c80 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e1881700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc1578b0 0x7f51dc0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e1881700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc1578b0 0x7f51dc0cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51394/0 (socket says 172.21.15.81:51394) 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e2082700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc06c2a0 0x7f51dc142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e1881700 1 -- 172.21.15.81:0/1448006617 learned_addr learned my addr 172.21.15.81:0/1448006617 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e2883700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51dc157c80 0x7f51dc0ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e1881700 1 -- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51dc157c80 msgr2=0x7f51dc0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e1881700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51dc157c80 0x7f51dc0ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e1881700 1 -- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc06c2a0 msgr2=0x7f51dc142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e1881700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc06c2a0 0x7f51dc142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e1881700 1 -- 172.21.15.81:0/1448006617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4009ae0 con 0x7f51dc1578b0 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e1881700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc1578b0 0x7f51dc0cc6c0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00c4e0 tx=0x7f51cc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51d27fc700 1 -- 172.21.15.81:0/1448006617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc011590 con 0x7f51dc1578b0 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51d27fc700 1 -- 172.21.15.81:0/1448006617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc011710 con 0x7f51dc1578b0 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51d27fc700 1 -- 172.21.15.81:0/1448006617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc011ad0 con 0x7f51dc1578b0 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc0b28a0 con 0x7f51dc1578b0 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.112+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc0b30a0 con 0x7f51dc1578b0 2023-10-06T02:58:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.113+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51dc1428f0 con 0x7f51dc1578b0 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.113+0000 7f51d27fc700 1 -- 172.21.15.81:0/1448006617 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51cc01b3b0 con 0x7f51dc1578b0 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.114+0000 7f51d27fc700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.114+0000 7f51d27fc700 1 -- 172.21.15.81:0/1448006617 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f51cc083750 con 0x7f51dc1578b0 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.114+0000 7f51d27fc700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7f51c006d3a0 0x7f51c006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.114+0000 7f51d27fc700 1 -- 172.21.15.81:0/1448006617 --> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51c006fe80 con 0x7f51c006d3a0 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.114+0000 7f51d27fc700 1 -- 172.21.15.81:0/1448006617 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51cc085d90 con 0x7f51dc1578b0 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.114+0000 7f51e2082700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.114+0000 7f51e2883700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7f51c006d3a0 0x7f51c006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.115+0000 7f51e2082700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f51c0066f30 0x7f51c00693e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009db0 tx=0x7f51d80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.115+0000 7f51e2883700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7f51c006d3a0 0x7f51c006f7b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.115+0000 7f51d27fc700 1 -- 172.21.15.81:0/1448006617 <== osd.6 v2:172.21.15.83:6824/86383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f51c006fe80 con 0x7f51c006d3a0 2023-10-06T02:58:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.128+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 --> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f51dc0b3320 con 0x7f51c006d3a0 2023-10-06T02:58:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51d27fc700 1 -- 172.21.15.81:0/1448006617 <== osd.6 v2:172.21.15.83:6824/86383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f51dc0b3320 con 0x7f51c006d3a0 2023-10-06T02:58:08.130 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:58:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-06T02:58:08.130 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:58:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7f51c006d3a0 msgr2=0x7f51c006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6824/86383,v1:172.21.15.83:6825/86383] conn(0x7f51c006d3a0 0x7f51c006f7b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f51c0066f30 msgr2=0x7f51c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f51c0066f30 0x7f51c00693e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009db0 tx=0x7f51d80091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc1578b0 msgr2=0x7f51dc0cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 --2- 172.21.15.81:0/1448006617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51dc1578b0 0x7f51dc0cc6c0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00c4e0 tx=0x7f51cc00c7f0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e2883700 1 -- 172.21.15.81:0/1448006617 reap_dead start 2023-10-06T02:58:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 shutdown_connections 2023-10-06T02:58:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 >> 172.21.15.81:0/1448006617 conn(0x7f51dc06cca0 msgr2=0x7f51dc06a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 shutdown_connections 2023-10-06T02:58:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.129+0000 7f51e3084700 1 -- 172.21.15.81:0/1448006617 wait complete. 2023-10-06T02:58:08.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T02:58:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.309+0000 7fec84d8a700 1 Processor -- start 2023-10-06T02:58:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.309+0000 7fec84d8a700 1 -- start start 2023-10-06T02:58:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.309+0000 7fec84d8a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec801578d0 0x7fec800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.309+0000 7fec84d8a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec8006d120 0x7fec8006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.309+0000 7fec84d8a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800d07c0 con 0x7fec80157ca0 2023-10-06T02:58:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.309+0000 7fec84d8a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8006daa0 con 0x7fec801578d0 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.309+0000 7fec84d8a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec800cfbb0 con 0x7fec8006d120 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec801578d0 0x7fec800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec801578d0 0x7fec800cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51400/0 (socket says 172.21.15.81:51400) 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7e59c700 1 -- 172.21.15.81:0/2608490314 learned_addr learned my addr 172.21.15.81:0/2608490314 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7ed9d700 1 --2- 172.21.15.81:0/2608490314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec8006d120 0x7fec8006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7e59c700 1 -- 172.21.15.81:0/2608490314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec8006d120 msgr2=0x7fec8006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7e59c700 1 --2- 172.21.15.81:0/2608490314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec8006d120 0x7fec8006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7e59c700 1 -- 172.21.15.81:0/2608490314 >> v1:172.21.15.83:6789/0 conn(0x7fec80157ca0 legacy=0x7fec8015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7e59c700 1 -- 172.21.15.81:0/2608490314 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800cfe90 con 0x7fec801578d0 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7e59c700 1 --2- 172.21.15.81:0/2608490314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 0x7fec800cf4f0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fec700099b0 tx=0x7fec70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c42a2cba494936 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7dd9b700 1 -- 172.21.15.81:0/2608490314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70009ea0 con 0x7fec801578d0 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7dd9b700 1 -- 172.21.15.81:0/2608490314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7000b860 con 0x7fec801578d0 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.310+0000 7fec7dd9b700 1 -- 172.21.15.81:0/2608490314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000bc00 con 0x7fec801578d0 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.311+0000 7fec84d8a700 1 -- 172.21.15.81:0/2608490314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 msgr2=0x7fec800cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.311+0000 7fec84d8a700 1 --2- 172.21.15.81:0/2608490314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 0x7fec800cf4f0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fec700099b0 tx=0x7fec70009250 comp rx=0 tx=0).stop 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.311+0000 7fec84d8a700 1 -- 172.21.15.81:0/2608490314 shutdown_connections 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.311+0000 7fec84d8a700 1 --2- 172.21.15.81:0/2608490314 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec8006d120 0x7fec8006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.311+0000 7fec84d8a700 1 --2- 172.21.15.81:0/2608490314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 0x7fec800cf4f0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.311+0000 7fec84d8a700 1 -- 172.21.15.81:0/2608490314 >> 172.21.15.81:0/2608490314 conn(0x7fec8006bb90 msgr2=0x7fec8006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.311+0000 7fec84d8a700 1 -- 172.21.15.81:0/2608490314 shutdown_connections 2023-10-06T02:58:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.311+0000 7fec84d8a700 1 -- 172.21.15.81:0/2608490314 wait complete. 2023-10-06T02:58:08.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.312+0000 7fec84d8a700 1 Processor -- start 2023-10-06T02:58:08.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.312+0000 7fec84d8a700 1 -- start start 2023-10-06T02:58:08.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec84d8a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec8006d120 0x7fec801596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec84d8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 0x7fec800ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec84d8a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec80157ca0 0x7fec800adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec84d8a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800ab9c0 con 0x7fec801578d0 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec84d8a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800acee0 con 0x7fec8006d120 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec84d8a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec800ac7d0 con 0x7fec80157ca0 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec75d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 0x7fec800ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec75d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 0x7fec800ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51406/0 (socket says 172.21.15.81:51406) 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec75d9b700 1 -- 172.21.15.81:0/1854043190 learned_addr learned my addr 172.21.15.81:0/1854043190 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec7e59c700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec8006d120 0x7fec801596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec7ed9d700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec80157ca0 0x7fec800adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec75d9b700 1 -- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec80157ca0 msgr2=0x7fec800adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec75d9b700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec80157ca0 0x7fec800adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec75d9b700 1 -- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec8006d120 msgr2=0x7fec801596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec75d9b700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec8006d120 0x7fec801596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec75d9b700 1 -- 172.21.15.81:0/1854043190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700094f0 con 0x7fec801578d0 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec7ed9d700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec80157ca0 0x7fec800adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec75d9b700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 0x7fec800ad6a0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c590 tx=0x7fec68007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec76ffd700 1 -- 172.21.15.81:0/1854043190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68011590 con 0x7fec801578d0 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec76ffd700 1 -- 172.21.15.81:0/1854043190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec68011710 con 0x7fec801578d0 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec800ab400 con 0x7fec801578d0 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec76ffd700 1 -- 172.21.15.81:0/1854043190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68011ad0 con 0x7fec801578d0 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.313+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec800ad180 con 0x7fec801578d0 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.314+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec800ad3a0 con 0x7fec801578d0 2023-10-06T02:58:08.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.315+0000 7fec76ffd700 1 -- 172.21.15.81:0/1854043190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec6801b3b0 con 0x7fec801578d0 2023-10-06T02:58:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.315+0000 7fec76ffd700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fec60066f30 0x7fec600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.315+0000 7fec76ffd700 1 -- 172.21.15.81:0/1854043190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fec68083710 con 0x7fec801578d0 2023-10-06T02:58:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.315+0000 7fec7e59c700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fec60066f30 0x7fec600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.316+0000 7fec7e59c700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fec60066f30 0x7fec600693e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fec700099b0 tx=0x7fec70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.319+0000 7fec76ffd700 1 -- 172.21.15.81:0/1854043190 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec68050b20 con 0x7fec801578d0 2023-10-06T02:58:08.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.500+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fec800d0170 con 0x7fec60066f30 2023-10-06T02:58:08.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.500+0000 7fec76ffd700 1 -- 172.21.15.81:0/1854043190 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fec800d0170 con 0x7fec60066f30 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fec60066f30 msgr2=0x7fec600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fec60066f30 0x7fec600693e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fec700099b0 tx=0x7fec70017000 comp rx=0 tx=0).stop 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 msgr2=0x7fec800ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 0x7fec800ad6a0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c590 tx=0x7fec68007f50 comp rx=0 tx=0).stop 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 shutdown_connections 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec80157ca0 0x7fec800adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7fec60066f30 0x7fec600693e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec8006d120 0x7fec801596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 --2- 172.21.15.81:0/1854043190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec801578d0 0x7fec800ad6a0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 >> 172.21.15.81:0/1854043190 conn(0x7fec8006bb90 msgr2=0x7fec800697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.502+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 shutdown_connections 2023-10-06T02:58:08.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.503+0000 7fec84d8a700 1 -- 172.21.15.81:0/1854043190 wait complete. 2023-10-06T02:58:08.505 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T02:58:08.515 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T02:58:08.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:58:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.632+0000 7f43a4e80700 1 Processor -- start 2023-10-06T02:58:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.633+0000 7f43a4e80700 1 -- start start 2023-10-06T02:58:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.633+0000 7f43a4e80700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f43a0157fe0 0x7f43a00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.633+0000 7f43a4e80700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a00b2890 con 0x7f43a00cf240 2023-10-06T02:58:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.633+0000 7f43a4e80700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a00b4070 con 0x7f43a01583b0 2023-10-06T02:58:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.633+0000 7f43a4e80700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a00b4350 con 0x7f43a0157fe0 2023-10-06T02:58:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f43a00cf240 0x7f43a0158bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44032/0 (socket says 172.21.15.81:44032) 2023-10-06T02:58:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439ed9d700 1 -- 172.21.15.81:0/3705463192 learned_addr learned my addr 172.21.15.81:0/3705463192 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439e59c700 1 --2- 172.21.15.81:0/3705463192 >> v2:172.21.15.83:3300/0 conn(0x7f43a0157fe0 0x7f43a00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439d59a700 1 -- 172.21.15.81:0/3705463192 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644831925 0 0) 0x7f43a00b2890 con 0x7f43a00cf240 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439d59a700 1 -- 172.21.15.81:0/3705463192 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f438c003570 con 0x7f43a00cf240 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439e59c700 1 -- 172.21.15.81:0/3705463192 >> v1:172.21.15.83:6789/0 conn(0x7f43a01583b0 legacy=0x7f43a00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439e59c700 1 -- 172.21.15.81:0/3705463192 >> v1:172.21.15.81:6789/0 conn(0x7f43a00cf240 legacy=0x7f43a0158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439e59c700 1 -- 172.21.15.81:0/3705463192 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a00b4630 con 0x7f43a0157fe0 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439e59c700 1 --2- 172.21.15.81:0/3705463192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43a0157fe0 0x7f43a00b34c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4390009e60 tx=0x7f4390009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26abb9f50dcccac9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439d59a700 1 -- 172.21.15.81:0/3705463192 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439000e070 con 0x7f43a0157fe0 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439d59a700 1 -- 172.21.15.81:0/3705463192 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439000bb60 con 0x7f43a0157fe0 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.634+0000 7f439d59a700 1 -- 172.21.15.81:0/3705463192 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390012430 con 0x7f43a0157fe0 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.635+0000 7f43a4e80700 1 -- 172.21.15.81:0/3705463192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43a0157fe0 msgr2=0x7f43a00b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.635+0000 7f43a4e80700 1 --2- 172.21.15.81:0/3705463192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43a0157fe0 0x7f43a00b34c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4390009e60 tx=0x7f4390009780 comp rx=0 tx=0).stop 2023-10-06T02:58:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.635+0000 7f43a4e80700 1 -- 172.21.15.81:0/3705463192 shutdown_connections 2023-10-06T02:58:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.635+0000 7f43a4e80700 1 --2- 172.21.15.81:0/3705463192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43a0157fe0 0x7f43a00b34c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.635+0000 7f43a4e80700 1 -- 172.21.15.81:0/3705463192 >> 172.21.15.81:0/3705463192 conn(0x7f43a0067640 msgr2=0x7f43a0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.635+0000 7f43a4e80700 1 -- 172.21.15.81:0/3705463192 shutdown_connections 2023-10-06T02:58:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.635+0000 7f43a4e80700 1 -- 172.21.15.81:0/3705463192 wait complete. 2023-10-06T02:58:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.636+0000 7f43a4e80700 1 Processor -- start 2023-10-06T02:58:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.636+0000 7f43a4e80700 1 -- start start 2023-10-06T02:58:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f43a4e80700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43a00cf240 0x7f43a016b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f43a4e80700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43a0157fe0 0x7f43a015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f43a4e80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01583b0 0x7f43a016bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f43a4e80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a015b3c0 con 0x7f43a01583b0 2023-10-06T02:58:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f43a4e80700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a015c2d0 con 0x7f43a0157fe0 2023-10-06T02:58:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f43a4e80700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a015bcc0 con 0x7f43a00cf240 2023-10-06T02:58:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01583b0 0x7f43a016bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01583b0 0x7f43a016bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51422/0 (socket says 172.21.15.81:51422) 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439ed9d700 1 -- 172.21.15.81:0/1634960326 learned_addr learned my addr 172.21.15.81:0/1634960326 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439e59c700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43a00cf240 0x7f43a016b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439ed9d700 1 -- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43a00cf240 msgr2=0x7f43a016b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439ed9d700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43a00cf240 0x7f43a016b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439dd9b700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43a0157fe0 0x7f43a015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439ed9d700 1 -- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43a0157fe0 msgr2=0x7f43a015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439ed9d700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43a0157fe0 0x7f43a015c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439ed9d700 1 -- 172.21.15.81:0/1634960326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4390009a20 con 0x7f43a01583b0 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f439ed9d700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01583b0 0x7f43a016bd40 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f439800c560 tx=0x7f4398007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.637+0000 7f43967fc700 1 -- 172.21.15.81:0/1634960326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398005c00 con 0x7f43a01583b0 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.638+0000 7f43967fc700 1 -- 172.21.15.81:0/1634960326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398005d60 con 0x7f43a01583b0 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.638+0000 7f43967fc700 1 -- 172.21.15.81:0/1634960326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398007300 con 0x7f43a01583b0 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.638+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a016c920 con 0x7f43a01583b0 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.638+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a016cc00 con 0x7f43a01583b0 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.638+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43a0069e40 con 0x7f43a01583b0 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.639+0000 7f43967fc700 1 -- 172.21.15.81:0/1634960326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f439801b3b0 con 0x7f43a01583b0 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.639+0000 7f43967fc700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4380066fb0 0x7f4380069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.639+0000 7f43967fc700 1 -- 172.21.15.81:0/1634960326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4398083970 con 0x7f43a01583b0 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.639+0000 7f43967fc700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f438006d420 0x7f438006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.639+0000 7f43967fc700 1 -- 172.21.15.81:0/1634960326 --> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f438006ff00 con 0x7f438006d420 2023-10-06T02:58:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.639+0000 7f43967fc700 1 -- 172.21.15.81:0/1634960326 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43980881a0 con 0x7f43a01583b0 2023-10-06T02:58:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.639+0000 7f439e59c700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4380066fb0 0x7f4380069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.640+0000 7f439dd9b700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f438006d420 0x7f438006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.640+0000 7f439e59c700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4380066fb0 0x7f4380069460 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f43a0149bb0 tx=0x7f4390019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.640+0000 7f439dd9b700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f438006d420 0x7f438006f830 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.641+0000 7f43967fc700 1 -- 172.21.15.81:0/1634960326 <== osd.7 v2:172.21.15.83:6816/86343 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f438006ff00 con 0x7f438006d420 2023-10-06T02:58:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.653+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 --> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f43a00cc6b0 con 0x7f438006d420 2023-10-06T02:58:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.653+0000 7f43967fc700 1 -- 172.21.15.81:0/1634960326 <== osd.7 v2:172.21.15.83:6816/86343 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f43a00cc6b0 con 0x7f438006d420 2023-10-06T02:58:08.654 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T02:58:08.655 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-06T02:58:08.655 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T02:58:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f438006d420 msgr2=0x7f438006f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6816/86343,v1:172.21.15.83:6817/86343] conn(0x7f438006d420 0x7f438006f830 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4380066fb0 msgr2=0x7f4380069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f4380066fb0 0x7f4380069460 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f43a0149bb0 tx=0x7f4390019000 comp rx=0 tx=0).stop 2023-10-06T02:58:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01583b0 msgr2=0x7f43a016bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 --2- 172.21.15.81:0/1634960326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a01583b0 0x7f43a016bd40 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f439800c560 tx=0x7f4398007d90 comp rx=0 tx=0).stop 2023-10-06T02:58:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f439ed9d700 1 -- 172.21.15.81:0/1634960326 reap_dead start 2023-10-06T02:58:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 shutdown_connections 2023-10-06T02:58:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 >> 172.21.15.81:0/1634960326 conn(0x7f43a0067640 msgr2=0x7f43a01552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 shutdown_connections 2023-10-06T02:58:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.654+0000 7f43a4e80700 1 -- 172.21.15.81:0/1634960326 wait complete. 2023-10-06T02:58:08.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T02:58:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.781+0000 7f2189a70700 1 Processor -- start 2023-10-06T02:58:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.781+0000 7f2189a70700 1 -- start start 2023-10-06T02:58:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.782+0000 7f2189a70700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f21841578d0 0x7f21840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.782+0000 7f2189a70700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 0x7f218406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.782+0000 7f2189a70700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21840d07c0 con 0x7f2184157ca0 2023-10-06T02:58:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.782+0000 7f2189a70700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218406daa0 con 0x7f21841578d0 2023-10-06T02:58:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.782+0000 7f2189a70700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21840cfbb0 con 0x7f218406d120 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f2182ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2184157ca0 0x7f218415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44036/0 (socket says 172.21.15.81:44036) 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f2182ffd700 1 -- 172.21.15.81:0/520957741 learned_addr learned my addr 172.21.15.81:0/520957741 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f21837fe700 1 --2- 172.21.15.81:0/520957741 >> v2:172.21.15.83:3300/0 conn(0x7f21841578d0 0x7f21840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f2183fff700 1 --2- 172.21.15.81:0/520957741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 0x7f218406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f21837fe700 1 -- 172.21.15.81:0/520957741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 msgr2=0x7f218406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f21837fe700 1 --2- 172.21.15.81:0/520957741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 0x7f218406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f21837fe700 1 -- 172.21.15.81:0/520957741 >> v1:172.21.15.81:6789/0 conn(0x7f2184157ca0 legacy=0x7f218415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f21837fe700 1 -- 172.21.15.81:0/520957741 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840cfe90 con 0x7f21841578d0 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f2183fff700 1 --2- 172.21.15.81:0/520957741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 0x7f218406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.783+0000 7f21837fe700 1 --2- 172.21.15.81:0/520957741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21841578d0 0x7f21840cf4f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f21740098e0 tx=0x7f21740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=438339b92a79a653 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.786+0000 7f21827fc700 1 -- 172.21.15.81:0/520957741 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217400b640 con 0x7f21841578d0 2023-10-06T02:58:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.786+0000 7f21827fc700 1 -- 172.21.15.81:0/520957741 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217400b7a0 con 0x7f21841578d0 2023-10-06T02:58:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.786+0000 7f21827fc700 1 -- 172.21.15.81:0/520957741 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217400bb40 con 0x7f21841578d0 2023-10-06T02:58:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.787+0000 7f2189a70700 1 -- 172.21.15.81:0/520957741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21841578d0 msgr2=0x7f21840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.787+0000 7f2189a70700 1 --2- 172.21.15.81:0/520957741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21841578d0 0x7f21840cf4f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f21740098e0 tx=0x7f21740091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.787+0000 7f2189a70700 1 -- 172.21.15.81:0/520957741 shutdown_connections 2023-10-06T02:58:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.787+0000 7f2189a70700 1 --2- 172.21.15.81:0/520957741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 0x7f218406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.787+0000 7f2189a70700 1 --2- 172.21.15.81:0/520957741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21841578d0 0x7f21840cf4f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.787+0000 7f2189a70700 1 -- 172.21.15.81:0/520957741 >> 172.21.15.81:0/520957741 conn(0x7f218406bb90 msgr2=0x7f218406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.787+0000 7f2189a70700 1 -- 172.21.15.81:0/520957741 shutdown_connections 2023-10-06T02:58:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.787+0000 7f2189a70700 1 -- 172.21.15.81:0/520957741 wait complete. 2023-10-06T02:58:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.788+0000 7f2189a70700 1 Processor -- start 2023-10-06T02:58:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.788+0000 7f2189a70700 1 -- start start 2023-10-06T02:58:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2189a70700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 0x7f218416e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2189a70700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21841578d0 0x7f218416b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2189a70700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2184157ca0 0x7f218415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2189a70700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218414ed20 con 0x7f2184157ca0 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2189a70700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184150900 con 0x7f21841578d0 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2189a70700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218416e690 con 0x7f218406d120 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2183fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2184157ca0 0x7f218415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2183fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2184157ca0 0x7f218415c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51432/0 (socket says 172.21.15.81:51432) 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2183fff700 1 -- 172.21.15.81:0/2036431097 learned_addr learned my addr 172.21.15.81:0/2036431097 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f21837fe700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 0x7f218416e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2182ffd700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21841578d0 0x7f218416b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2183fff700 1 -- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 msgr2=0x7f218416e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2183fff700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 0x7f218416e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2183fff700 1 -- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21841578d0 msgr2=0x7f218416b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2183fff700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21841578d0 0x7f218416b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2183fff700 1 -- 172.21.15.81:0/2036431097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c009a20 con 0x7f2184157ca0 2023-10-06T02:58:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f2183fff700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2184157ca0 0x7f218415c990 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f217c009fc0 tx=0x7f217c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.789+0000 7f217b7fe700 1 -- 172.21.15.81:0/2036431097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c00cd30 con 0x7f2184157ca0 2023-10-06T02:58:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.790+0000 7f217b7fe700 1 -- 172.21.15.81:0/2036431097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c00f040 con 0x7f2184157ca0 2023-10-06T02:58:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.790+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2174009420 con 0x7f2184157ca0 2023-10-06T02:58:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.790+0000 7f217b7fe700 1 -- 172.21.15.81:0/2036431097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c0146d0 con 0x7f2184157ca0 2023-10-06T02:58:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.790+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218416ec50 con 0x7f2184157ca0 2023-10-06T02:58:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.790+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2184150a70 con 0x7f2184157ca0 2023-10-06T02:58:08.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.791+0000 7f217b7fe700 1 -- 172.21.15.81:0/2036431097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f217c003020 con 0x7f2184157ca0 2023-10-06T02:58:08.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.791+0000 7f217b7fe700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:08.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.791+0000 7f217b7fe700 1 -- 172.21.15.81:0/2036431097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f217c084e80 con 0x7f2184157ca0 2023-10-06T02:58:08.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.791+0000 7f21837fe700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:08.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.792+0000 7f21837fe700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2164066f30 0x7f21640693e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f218415d5b0 tx=0x7f2174017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.795+0000 7f217b7fe700 1 -- 172.21.15.81:0/2036431097 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f217c052290 con 0x7f2184157ca0 2023-10-06T02:58:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.976+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f21840d0170 con 0x7f2164066f30 2023-10-06T02:58:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.976+0000 7f217b7fe700 1 -- 172.21.15.81:0/2036431097 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21840d0170 con 0x7f2164066f30 2023-10-06T02:58:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.978+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2164066f30 msgr2=0x7f21640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.978+0000 7f2189a70700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2164066f30 0x7f21640693e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f218415d5b0 tx=0x7f2174017000 comp rx=0 tx=0).stop 2023-10-06T02:58:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2184157ca0 msgr2=0x7f218415c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2184157ca0 0x7f218415c990 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f217c009fc0 tx=0x7f217c00b040 comp rx=0 tx=0).stop 2023-10-06T02:58:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 shutdown_connections 2023-10-06T02:58:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2184157ca0 0x7f218415c990 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f218406d120 0x7f218416e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 --2- 172.21.15.81:0/2036431097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21841578d0 0x7f218416b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 >> 172.21.15.81:0/2036431097 conn(0x7f218406bb90 msgr2=0x7f21841567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 shutdown_connections 2023-10-06T02:58:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:08.979+0000 7f2189a70700 1 -- 172.21.15.81:0/2036431097 wait complete. 2023-10-06T02:58:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T02:58:08.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:09.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.104+0000 7f018e8d5700 1 Processor -- start 2023-10-06T02:58:09.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.104+0000 7f018e8d5700 1 -- start start 2023-10-06T02:58:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018e8d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 0x7f01880cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018e8d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0188159f10 0x7f0188068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018e8d5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01880cee10 con 0x7f01880ccb40 2023-10-06T02:58:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018e8d5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01880cd040 con 0x7f0188159f10 2023-10-06T02:58:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018e8d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880cd320 con 0x7f0188159b40 2023-10-06T02:58:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018d0d2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0188159f10 0x7f0188068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018d0d2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0188159f10 0x7f0188068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51448/0 (socket says 172.21.15.81:51448) 2023-10-06T02:58:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018d0d2700 1 -- 172.21.15.81:0/4170777516 learned_addr learned my addr 172.21.15.81:0/4170777516 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018d8d3700 1 --2- 172.21.15.81:0/4170777516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 0x7f01880cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:09.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018d0d2700 1 -- 172.21.15.81:0/4170777516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 msgr2=0x7f01880cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:09.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018d0d2700 1 --2- 172.21.15.81:0/4170777516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 0x7f01880cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:09.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018d0d2700 1 -- 172.21.15.81:0/4170777516 >> v1:172.21.15.83:6789/0 conn(0x7f01880ccb40 legacy=0x7f018815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:09.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018d0d2700 1 -- 172.21.15.81:0/4170777516 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880ce7c0 con 0x7f0188159f10 2023-10-06T02:58:09.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.105+0000 7f018d0d2700 1 --2- 172.21.15.81:0/4170777516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0188159f10 0x7f0188068780 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f017c0099b0 tx=0x7f017c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa14eba9dea7df7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:09.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018c8d1700 1 -- 172.21.15.81:0/4170777516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00b860 con 0x7f0188159f10 2023-10-06T02:58:09.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018c8d1700 1 -- 172.21.15.81:0/4170777516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c00b9c0 con 0x7f0188159f10 2023-10-06T02:58:09.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018c8d1700 1 -- 172.21.15.81:0/4170777516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00bd60 con 0x7f0188159f10 2023-10-06T02:58:09.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018e8d5700 1 -- 172.21.15.81:0/4170777516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0188159f10 msgr2=0x7f0188068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:09.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018e8d5700 1 --2- 172.21.15.81:0/4170777516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0188159f10 0x7f0188068780 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f017c0099b0 tx=0x7f017c009250 comp rx=0 tx=0).stop 2023-10-06T02:58:09.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018e8d5700 1 -- 172.21.15.81:0/4170777516 shutdown_connections 2023-10-06T02:58:09.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018e8d5700 1 --2- 172.21.15.81:0/4170777516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 0x7f01880cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:09.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018e8d5700 1 --2- 172.21.15.81:0/4170777516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0188159f10 0x7f0188068780 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:09.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018e8d5700 1 -- 172.21.15.81:0/4170777516 >> 172.21.15.81:0/4170777516 conn(0x7f01880cd660 msgr2=0x7f01880cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:09.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018e8d5700 1 -- 172.21.15.81:0/4170777516 shutdown_connections 2023-10-06T02:58:09.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.106+0000 7f018e8d5700 1 -- 172.21.15.81:0/4170777516 wait complete. 2023-10-06T02:58:09.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.107+0000 7f018e8d5700 1 Processor -- start 2023-10-06T02:58:09.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.107+0000 7f018e8d5700 1 -- start start 2023-10-06T02:58:09.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018e8d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880ccb40 0x7f0188154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:09.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018e8d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 0x7f0188157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:09.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018e8d5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0188159f10 0x7f018816b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:09.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018e8d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188158cd0 con 0x7f01880ccb40 2023-10-06T02:58:09.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018e8d5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01881550c0 con 0x7f0188159f10 2023-10-06T02:58:09.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018e8d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0188158430 con 0x7f0188159b40 2023-10-06T02:58:09.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d8d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880ccb40 0x7f0188154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:09.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d8d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880ccb40 0x7f0188154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51450/0 (socket says 172.21.15.81:51450) 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d8d3700 1 -- 172.21.15.81:0/3632028778 learned_addr learned my addr 172.21.15.81:0/3632028778 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018e0d4700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0188159f10 0x7f018816b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d0d2700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 0x7f0188157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d8d3700 1 -- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 msgr2=0x7f0188157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d8d3700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 0x7f0188157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d8d3700 1 -- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0188159f10 msgr2=0x7f018816b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d8d3700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0188159f10 0x7f018816b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d8d3700 1 -- 172.21.15.81:0/3632028778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0094f0 con 0x7f01880ccb40 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d0d2700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 0x7f0188157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:09.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.108+0000 7f018d8d3700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880ccb40 0x7f0188154b80 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f018000e190 tx=0x7f0180009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.109+0000 7f0185ffb700 1 -- 172.21.15.81:0/3632028778 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000ed80 con 0x7f01880ccb40 2023-10-06T02:58:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.109+0000 7f0185ffb700 1 -- 172.21.15.81:0/3632028778 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180014420 con 0x7f01880ccb40 2023-10-06T02:58:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.109+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0188158710 con 0x7f01880ccb40 2023-10-06T02:58:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.109+0000 7f0185ffb700 1 -- 172.21.15.81:0/3632028778 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800147e0 con 0x7f01880ccb40 2023-10-06T02:58:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.109+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018816ad90 con 0x7f01880ccb40 2023-10-06T02:58:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.110+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01880c7970 con 0x7f01880ccb40 2023-10-06T02:58:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.110+0000 7f0185ffb700 1 -- 172.21.15.81:0/3632028778 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0180014b90 con 0x7f01880ccb40 2023-10-06T02:58:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.111+0000 7f0185ffb700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0174066f30 0x7f01740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.111+0000 7f0185ffb700 1 -- 172.21.15.81:0/3632028778 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0180084b40 con 0x7f01880ccb40 2023-10-06T02:58:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.111+0000 7f018d0d2700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0174066f30 0x7f01740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.111+0000 7f018d0d2700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0174066f30 0x7f01740693e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f017c0099b0 tx=0x7f017c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.115+0000 7f0185ffb700 1 -- 172.21.15.81:0/3632028778 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0180051f50 con 0x7f01880ccb40 2023-10-06T02:58:09.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.295+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f018816abc0 con 0x7f0174066f30 2023-10-06T02:58:09.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.298+0000 7f0185ffb700 1 -- 172.21.15.81:0/3632028778 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70382 (secure 0 0 0) 0x7f018816abc0 con 0x7f0174066f30 2023-10-06T02:58:09.300 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:58:09.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.299+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0174066f30 msgr2=0x7f01740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:09.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.299+0000 7f018e8d5700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0174066f30 0x7f01740693e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f017c0099b0 tx=0x7f017c017000 comp rx=0 tx=0).stop 2023-10-06T02:58:09.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880ccb40 msgr2=0x7f0188154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880ccb40 0x7f0188154b80 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f018000e190 tx=0x7f0180009920 comp rx=0 tx=0).stop 2023-10-06T02:58:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 shutdown_connections 2023-10-06T02:58:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f0174066f30 0x7f01740693e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0188159f10 0x7f018816b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880ccb40 0x7f0188154b80 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 --2- 172.21.15.81:0/3632028778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0188159b40 0x7f0188157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 >> 172.21.15.81:0/3632028778 conn(0x7f01880cd660 msgr2=0x7f018806e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 shutdown_connections 2023-10-06T02:58:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:09.300+0000 7f018e8d5700 1 -- 172.21.15.81:0/3632028778 wait complete. 2023-10-06T02:58:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:58:09.312 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2023-10-06T02:58:07.666185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9788,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552711,"statfs":{"total":1600000000,"available":1589976848,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.178032"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":158,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:00.756320+0000","last_change":"2023-10-06T02:46:02.582597+0000","last_active":"2023-10-06T02:58:00.756320+0000","last_peered":"2023-10-06T02:58:00.756320+0000","last_clean":"2023-10-06T02:58:00.756320+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:58:00.756320+0000","last_undegraded":"2023-10-06T02:58:00.756320+0000","last_fullsized":"2023-10-06T02:58:00.756320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.490095+0000","last_change":"2023-10-06T02:46:02.371736+0000","last_active":"2023-10-06T02:57:59.490095+0000","last_peered":"2023-10-06T02:57:59.490095+0000","last_clean":"2023-10-06T02:57:59.490095+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:57:59.490095+0000","last_undegraded":"2023-10-06T02:57:59.490095+0000","last_fullsized":"2023-10-06T02:57:59.490095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.491486+0000","last_change":"2023-10-06T02:46:02.376539+0000","last_active":"2023-10-06T02:57:59.491486+0000","last_peered":"2023-10-06T02:57:59.491486+0000","last_clean":"2023-10-06T02:57:59.491486+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:57:59.491486+0000","last_undegraded":"2023-10-06T02:57:59.491486+0000","last_fullsized":"2023-10-06T02:57:59.491486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:52.921930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.490176+0000","last_change":"2023-10-06T02:46:02.376045+0000","last_active":"2023-10-06T02:57:59.490176+0000","last_peered":"2023-10-06T02:57:59.490176+0000","last_clean":"2023-10-06T02:57:59.490176+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:57:59.490176+0000","last_undegraded":"2023-10-06T02:57:59.490176+0000","last_fullsized":"2023-10-06T02:57:59.490176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":309,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778799+0000","last_change":"2023-10-06T02:45:57.012375+0000","last_active":"2023-10-06T02:57:59.778799+0000","last_peered":"2023-10-06T02:57:59.778799+0000","last_clean":"2023-10-06T02:57:59.778799+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:57:59.778799+0000","last_undegraded":"2023-10-06T02:57:59.778799+0000","last_fullsized":"2023-10-06T02:57:59.778799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:45:55.975901+0000","last_clean_scrub_stamp":"2023-10-06T02:45:55.975901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:14.323113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778051+0000","last_change":"2023-10-06T02:46:02.376614+0000","last_active":"2023-10-06T02:57:59.778051+0000","last_peered":"2023-10-06T02:57:59.778051+0000","last_clean":"2023-10-06T02:57:59.778051+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:57:59.778051+0000","last_undegraded":"2023-10-06T02:57:59.778051+0000","last_fullsized":"2023-10-06T02:57:59.778051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:12.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778882+0000","last_change":"2023-10-06T02:46:02.582518+0000","last_active":"2023-10-06T02:57:59.778882+0000","last_peered":"2023-10-06T02:57:59.778882+0000","last_clean":"2023-10-06T02:57:59.778882+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:57:59.778882+0000","last_undegraded":"2023-10-06T02:57:59.778882+0000","last_fullsized":"2023-10-06T02:57:59.778882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:23.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":158,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:00.750882+0000","last_change":"2023-10-06T02:46:02.376250+0000","last_active":"2023-10-06T02:58:00.750882+0000","last_peered":"2023-10-06T02:58:00.750882+0000","last_clean":"2023-10-06T02:58:00.750882+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:58:00.750882+0000","last_undegraded":"2023-10-06T02:58:00.750882+0000","last_fullsized":"2023-10-06T02:58:00.750882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-06T02:57:59.778680+0000","last_change":"2023-10-06T02:46:02.376290+0000","last_active":"2023-10-06T02:57:59.778680+0000","last_peered":"2023-10-06T02:57:59.778680+0000","last_clean":"2023-10-06T02:57:59.778680+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:57:59.778680+0000","last_undegraded":"2023-10-06T02:57:59.778680+0000","last_fullsized":"2023-10-06T02:57:59.778680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:46:01.352608+0000","last_clean_scrub_stamp":"2023-10-06T02:46:01.352608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:04.810754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.314,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.75600000000000001,"5min":0.84299999999999997,"15min":1.393},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":1.5569999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.433,"5min":0.33500000000000002,"15min":0.27300000000000002},"max":{"1min":0.60899999999999999,"5min":0.749,"15min":1.081},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.42199999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.78400000000000003,"5min":0.83599999999999997,"15min":1.4710000000000001},"last":0.439}]},{"osd":2,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.52100000000000002},"min":{"1min":0.52500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":4.8129999999999997},"last":0.40400000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.81799999999999995,"15min":3.4870000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.46600000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":2.2349999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.0009999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.78600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.95599999999999996},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.33200000000000002},"max":{"1min":0.79900000000000004,"5min":0.84999999999999998,"15min":0.85799999999999998},"last":0.627},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574996,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.77400000000000002,"15min":2.8650000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.255},"max":{"1min":0.749,"5min":0.749,"15min":1.879},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.92000000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.75},"min":{"1min":0.375,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":11.957000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.30399999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":1.0580000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42799999999999999,"5min":0.33900000000000002,"15min":0.29499999999999998},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.95799999999999996},"last":0.63},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.33300000000000002},"max":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":1.163},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47399999999999998,"15min":0.50900000000000001},"min":{"1min":0.377,"5min":0.26700000000000002,"15min":0.23000000000000001},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.05},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.86799999999999999},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.497,"15min":0.51300000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.83999999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.57099999999999995},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.31900000000000001},"max":{"1min":0.81899999999999995,"5min":0.84899999999999998,"15min":1.0129999999999999},"last":0.432},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.89500000000000002},"last":0.54900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.32400000000000001,"15min":0.317},"min":{"1min":0.245,"5min":0.20300000000000001,"15min":0.188},"max":{"1min":0.42099999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.34599999999999997},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.499,"5min":0.58299999999999996,"15min":0.61799999999999999},"last":0.26600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.33300000000000002},"min":{"1min":0.28199999999999997,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.44600000000000001,"5min":0.51700000000000002,"15min":0.65400000000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.498,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.63100000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.23400000000000001},"max":{"1min":0.44700000000000001,"5min":0.628,"15min":0.628},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":1.157,"15min":1.157},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":0.84099999999999997,"15min":0.92000000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.82299999999999995,"15min":0.96299999999999997},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.504},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.372,"15min":0.36799999999999999},"max":{"1min":0.73399999999999999,"5min":0.81299999999999994,"15min":0.92000000000000004},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.91400000000000003,"15min":1.006},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":0.84199999999999997,"15min":0.88200000000000001},"last":0.54000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.19900000000000001},"max":{"1min":0.496,"5min":0.496,"15min":1.177},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.39300000000000002},"min":{"1min":0.28899999999999998,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":0.73999999999999999,"15min":1.3400000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.69199999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.188},"max":{"1min":0.45200000000000001,"5min":0.52300000000000002,"15min":22.038},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.21299999999999999},"max":{"1min":0.505,"5min":0.77900000000000003,"15min":1.3779999999999999},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.28299999999999997,"5min":0.20399999999999999,"15min":0.183},"max":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":1.1439999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40500000000000003,"15min":0.73299999999999998},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.89700000000000002,"15min":21.942},"last":0.32000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.32800000000000001},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":1.9390000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.377,"15min":0.32900000000000001},"max":{"1min":0.81699999999999995,"5min":0.87,"15min":11.122999999999999},"last":0.38100000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.89500000000000002},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.93100000000000005,"15min":22.010999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":1.0980000000000001,"15min":1.401},"last":0.40699999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59299999999999997,"15min":0.878},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":0.67700000000000005,"5min":0.83599999999999997,"15min":11.090999999999999},"last":0.501},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.92300000000000004},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":2.7389999999999999,"15min":21.98},"last":0.35299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":1.425},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.755},"min":{"1min":0.436,"5min":0.41799999999999998,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.999,"15min":11.154},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.183,"15min":0.16900000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58699999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.28399999999999997,"5min":0.224,"15min":0.186},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.60699999999999998},"last":0.29299999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.67200000000000004,"15min":0.68200000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.317,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.63500000000000001,"15min":0.84499999999999997},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.28599999999999998,"5min":0.251,"15min":0.23999999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.70999999999999996},"last":0.312},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.34599999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":1.056},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.83199999999999996,"15min":0.95099999999999996},"last":0.39500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.34999999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.98699999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.2569999999999999},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.33800000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.0660000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.002},"last":0.46000000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.873,"15min":0.96999999999999997},"last":0.436},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.0449999999999999},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33500000000000002,"15min":0.318},"min":{"1min":0.22900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.57499999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61299999999999999,"5min":0.748,"15min":0.84899999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.34999999999999998},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.66300000000000003,"15min":0.69999999999999996},"last":0.375},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.59599999999999997,"5min":0.68500000000000005,"15min":0.71199999999999997},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.29999999999999999,"5min":0.24199999999999999,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.67700000000000005,"15min":3.044},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.378},"min":{"1min":0.32500000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.57899999999999996,"5min":0.70899999999999996,"15min":0.72799999999999998},"last":0.40200000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":2.2120000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.32700000000000001},"max":{"1min":0.83299999999999996,"5min":0.84899999999999998,"15min":2.25},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.376,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.88100000000000001,"15min":6.4189999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.268},"last":0.72899999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.373,"15min":0.34300000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.218},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.8340000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.77800000000000002},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.86799999999999999,"5min":0.877,"15min":14.912000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.372},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.4990000000000001},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.27200000000000002,"15min":0.23699999999999999},"max":{"1min":0.76800000000000002,"5min":1.069,"15min":5.8949999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.28999999999999998,"15min":0.221},"max":{"1min":0.746,"5min":1.1639999999999999,"15min":5.3579999999999997},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.67200000000000004},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":1.109,"15min":5.9329999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.65400000000000003},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":1.2310000000000001,"15min":5.9820000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.29099999999999998},"max":{"1min":0.755,"5min":1.083,"15min":5.4390000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56399999999999995,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":1.252,"15min":5.3470000000000004},"last":0.46800000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.25800000000000001},"max":{"1min":0.70499999999999996,"5min":1.093,"15min":3.4100000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":1.1839999999999999,"15min":3.456},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.31900000000000001,"5min":0.30299999999999999,"15min":0.245},"max":{"1min":0.63600000000000001,"5min":1.036,"15min":1.036},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.496,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.69199999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.435}]},{"osd":6,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.50800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61499999999999999,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.68700000000000006,"5min":0.94299999999999995,"15min":1.0489999999999999},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61699999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.80000000000000004},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":1.133,"15min":13.173999999999999},"last":0.54500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574996,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.505,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.219},"max":{"1min":0.65700000000000003,"5min":0.76400000000000001,"15min":0.79100000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":2.0619999999999998},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.45200000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.3540000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.28000000000000003},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":4.6269999999999998},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.32700000000000001,"15min":0.26700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":1.3779999999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.745,"5min":0.75,"15min":0.83799999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.36599999999999999,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.82599999999999996},"last":0.55000000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.34100000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.314},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.89300000000000002},"last":0.39600000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68400000000000005,"5min":0.76700000000000002,"15min":0.84999999999999998},"last":0.375},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.879},"last":0.35999999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.307,"15min":0.307},"max":{"1min":0.755,"5min":0.877,"15min":0.877},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.42399999999999999}]}]}],"pool_statfs":[]}} 2023-10-06T02:58:09.318 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T02:46:01.352608+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=46, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=58, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:58:09.318 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T02:46:01.352608+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=46, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=58, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:58:09.318 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-06T02:46:01.352608+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=46, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=58, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:58:09.318 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T02:46:01.352608+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=46, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=58, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:58:09.318 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T02:45:55.975901+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=45, tm_sec=55, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=58, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:58:09.318 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T02:46:01.352608+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=46, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=58, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:58:09.319 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T02:46:01.352608+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=46, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=58, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:58:09.319 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T02:46:01.352608+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=46, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=58, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:58:09.319 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T02:46:01.352608+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=46, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=58, tm_sec=4, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:58:09.319 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T02:58:29.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.448+0000 7f758b990700 1 Processor -- start 2023-10-06T02:58:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.448+0000 7f758b990700 1 -- start start 2023-10-06T02:58:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.449+0000 7f758b990700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7584157ca0 0x7f75840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.449+0000 7f758b990700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f758406d120 0x7f758406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.449+0000 7f758b990700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75840d07c0 con 0x7f75841578d0 2023-10-06T02:58:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.449+0000 7f758b990700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758406da50 con 0x7f7584157ca0 2023-10-06T02:58:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.449+0000 7f758b990700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75840cfbb0 con 0x7f758406d120 2023-10-06T02:58:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.449+0000 7f7588f2b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7584157ca0 0x7f75840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.449+0000 7f758972c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f75841578d0 0x7f758415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37022/0 (socket says 172.21.15.81:37022) 2023-10-06T02:58:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.449+0000 7f758972c700 1 -- 172.21.15.81:0/4227488621 learned_addr learned my addr 172.21.15.81:0/4227488621 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.449+0000 7f7589f2d700 1 --2- 172.21.15.81:0/4227488621 >> v2:172.21.15.83:3300/0 conn(0x7f758406d120 0x7f758406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f7588f2b700 1 -- 172.21.15.81:0/4227488621 >> v2:172.21.15.83:3300/0 conn(0x7f758406d120 msgr2=0x7f758406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f7588f2b700 1 --2- 172.21.15.81:0/4227488621 >> v2:172.21.15.83:3300/0 conn(0x7f758406d120 0x7f758406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f7588f2b700 1 -- 172.21.15.81:0/4227488621 >> v1:172.21.15.81:6789/0 conn(0x7f75841578d0 legacy=0x7f758415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f7588f2b700 1 -- 172.21.15.81:0/4227488621 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840cfe90 con 0x7f7584157ca0 2023-10-06T02:58:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f757bfff700 1 -- 172.21.15.81:0/4227488621 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517098084 0 0) 0x7f75840d07c0 con 0x7f75841578d0 2023-10-06T02:58:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f7588f2b700 1 --2- 172.21.15.81:0/4227488621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7584157ca0 0x7f75840cf4f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f7584068300 tx=0x7f75740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467802d1c82353f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f757bfff700 1 -- 172.21.15.81:0/4227488621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011630 con 0x7f7584157ca0 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f757bfff700 1 -- 172.21.15.81:0/4227488621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574011790 con 0x7f7584157ca0 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f757bfff700 1 -- 172.21.15.81:0/4227488621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011b30 con 0x7f7584157ca0 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f758b990700 1 -- 172.21.15.81:0/4227488621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7584157ca0 msgr2=0x7f75840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f758b990700 1 --2- 172.21.15.81:0/4227488621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7584157ca0 0x7f75840cf4f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f7584068300 tx=0x7f75740091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f758b990700 1 -- 172.21.15.81:0/4227488621 shutdown_connections 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f758b990700 1 --2- 172.21.15.81:0/4227488621 >> v2:172.21.15.83:3300/0 conn(0x7f758406d120 0x7f758406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f758b990700 1 --2- 172.21.15.81:0/4227488621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7584157ca0 0x7f75840cf4f0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.450+0000 7f758b990700 1 -- 172.21.15.81:0/4227488621 >> 172.21.15.81:0/4227488621 conn(0x7f758406bb90 msgr2=0x7f758406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.451+0000 7f758b990700 1 -- 172.21.15.81:0/4227488621 shutdown_connections 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.451+0000 7f758b990700 1 -- 172.21.15.81:0/4227488621 wait complete. 2023-10-06T02:58:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.452+0000 7f758b990700 1 Processor -- start 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.452+0000 7f758b990700 1 -- start start 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.452+0000 7f758b990700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f758406d120 0x7f75840b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.452+0000 7f758b990700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75841578d0 0x7f75840b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f758b990700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7584157ca0 0x7f75840c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f758b990700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584145120 con 0x7f75841578d0 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f758b990700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840c6410 con 0x7f7584157ca0 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f758b990700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75840c5b20 con 0x7f758406d120 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7588f2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75841578d0 0x7f75840b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7588f2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75841578d0 0x7f75840b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57222/0 (socket says 172.21.15.81:57222) 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7588f2b700 1 -- 172.21.15.81:0/456258413 learned_addr learned my addr 172.21.15.81:0/456258413 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f758972c700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f758406d120 0x7f75840b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7589f2d700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7584157ca0 0x7f75840c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7588f2b700 1 -- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f758406d120 msgr2=0x7f75840b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7588f2b700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f758406d120 0x7f75840b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7588f2b700 1 -- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7584157ca0 msgr2=0x7f75840c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7588f2b700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7584157ca0 0x7f75840c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7588f2b700 1 -- 172.21.15.81:0/456258413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574009420 con 0x7f75841578d0 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f758972c700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f758406d120 0x7f75840b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f7588f2b700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75841578d0 0x7f75840b5fa0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f7574013000 tx=0x7f7574017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f75797fa700 1 -- 172.21.15.81:0/456258413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011b10 con 0x7f75841578d0 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f75797fa700 1 -- 172.21.15.81:0/456258413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75740253f0 con 0x7f75841578d0 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75840b5780 con 0x7f75841578d0 2023-10-06T02:58:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f75797fa700 1 -- 172.21.15.81:0/456258413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574025790 con 0x7f75841578d0 2023-10-06T02:58:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.453+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75840c60a0 con 0x7f75841578d0 2023-10-06T02:58:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.454+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75840c6580 con 0x7f75841578d0 2023-10-06T02:58:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.455+0000 7f75797fa700 1 -- 172.21.15.81:0/456258413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7574025b80 con 0x7f75841578d0 2023-10-06T02:58:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.455+0000 7f75797fa700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.455+0000 7f75797fa700 1 -- 172.21.15.81:0/456258413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7574085be0 con 0x7f75841578d0 2023-10-06T02:58:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.455+0000 7f758972c700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.456+0000 7f758972c700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7568066f30 0x7f75680693e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f758416dea0 tx=0x7f7580009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.459+0000 7f75797fa700 1 -- 172.21.15.81:0/456258413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7574052ff0 con 0x7f75841578d0 2023-10-06T02:58:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.637+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 --> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75840d0170 con 0x7f7568066f30 2023-10-06T02:58:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.640+0000 7f75797fa700 1 -- 172.21.15.81:0/456258413 <== mgr.4100 v2:172.21.15.83:6832/85757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70739 (secure 0 0 0) 0x7f75840d0170 con 0x7f7568066f30 2023-10-06T02:58:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:58:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7568066f30 msgr2=0x7f75680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7568066f30 0x7f75680693e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f758416dea0 tx=0x7f7580009040 comp rx=0 tx=0).stop 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75841578d0 msgr2=0x7f75840b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75841578d0 0x7f75840b5fa0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f7574013000 tx=0x7f7574017000 comp rx=0 tx=0).stop 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 shutdown_connections 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7584157ca0 0x7f75840c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f758406d120 0x7f75840b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 --2- 172.21.15.81:0/456258413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75841578d0 0x7f75840b5fa0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 >> 172.21.15.81:0/456258413 conn(0x7f758406bb90 msgr2=0x7f7584155810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 shutdown_connections 2023-10-06T02:58:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.642+0000 7f758b990700 1 -- 172.21.15.81:0/456258413 wait complete. 2023-10-06T02:58:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T02:58:29.655 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2023-10-06T02:58:27.670283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9788,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552711,"statfs":{"total":1600000000,"available":1589976848,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002400"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:08.596118+0000","last_change":"2023-10-06T02:58:08.596098+0000","last_active":"2023-10-06T02:58:08.596118+0000","last_peered":"2023-10-06T02:58:08.596118+0000","last_clean":"2023-10-06T02:58:08.596118+0000","last_became_active":"2023-10-06T02:46:02.582335+0000","last_became_peered":"2023-10-06T02:46:02.582335+0000","last_unstale":"2023-10-06T02:58:08.596118+0000","last_undegraded":"2023-10-06T02:58:08.596118+0000","last_fullsized":"2023-10-06T02:58:08.596118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:08.596049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:08.596049+0000","last_clean_scrub_stamp":"2023-10-06T02:58:08.596049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:55.856581+0000","scrub_duration":0.00098610600000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:08.906445+0000","last_change":"2023-10-06T02:58:08.906418+0000","last_active":"2023-10-06T02:58:08.906445+0000","last_peered":"2023-10-06T02:58:08.906445+0000","last_clean":"2023-10-06T02:58:08.906445+0000","last_became_active":"2023-10-06T02:46:02.371550+0000","last_became_peered":"2023-10-06T02:46:02.371550+0000","last_unstale":"2023-10-06T02:58:08.906445+0000","last_undegraded":"2023-10-06T02:58:08.906445+0000","last_fullsized":"2023-10-06T02:58:08.906445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:08.906339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:08.906339+0000","last_clean_scrub_stamp":"2023-10-06T02:58:08.906339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:31.110327+0000","scrub_duration":0.0012223939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:08.487706+0000","last_change":"2023-10-06T02:58:08.487688+0000","last_active":"2023-10-06T02:58:08.487706+0000","last_peered":"2023-10-06T02:58:08.487706+0000","last_clean":"2023-10-06T02:58:08.487706+0000","last_became_active":"2023-10-06T02:46:02.376287+0000","last_became_peered":"2023-10-06T02:46:02.376287+0000","last_unstale":"2023-10-06T02:58:08.487706+0000","last_undegraded":"2023-10-06T02:58:08.487706+0000","last_fullsized":"2023-10-06T02:58:08.487706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:08.487636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:08.487636+0000","last_clean_scrub_stamp":"2023-10-06T02:58:08.487636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:38.458018+0000","scrub_duration":0.00095283100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:10.919889+0000","last_change":"2023-10-06T02:58:10.919859+0000","last_active":"2023-10-06T02:58:10.919889+0000","last_peered":"2023-10-06T02:58:10.919889+0000","last_clean":"2023-10-06T02:58:10.919889+0000","last_became_active":"2023-10-06T02:46:02.375815+0000","last_became_peered":"2023-10-06T02:46:02.375815+0000","last_unstale":"2023-10-06T02:58:10.919889+0000","last_undegraded":"2023-10-06T02:58:10.919889+0000","last_fullsized":"2023-10-06T02:58:10.919889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:10.919784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:10.919784+0000","last_clean_scrub_stamp":"2023-10-06T02:58:10.919784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:21.856987+0000","scrub_duration":0.0015254800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"186'119","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:11.404553+0000","last_change":"2023-10-06T02:58:11.404527+0000","last_active":"2023-10-06T02:58:11.404553+0000","last_peered":"2023-10-06T02:58:11.404553+0000","last_clean":"2023-10-06T02:58:11.404553+0000","last_became_active":"2023-10-06T02:45:57.011434+0000","last_became_peered":"2023-10-06T02:45:57.011434+0000","last_unstale":"2023-10-06T02:58:11.404553+0000","last_undegraded":"2023-10-06T02:58:11.404553+0000","last_fullsized":"2023-10-06T02:58:11.404553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'119","last_scrub_stamp":"2023-10-06T02:58:11.404470+0000","last_deep_scrub":"186'119","last_deep_scrub_stamp":"2023-10-06T02:58:11.404470+0000","last_clean_scrub_stamp":"2023-10-06T02:58:11.404470+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:17:04.899640+0000","scrub_duration":0.002833477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:12.368143+0000","last_change":"2023-10-06T02:58:12.368099+0000","last_active":"2023-10-06T02:58:12.368143+0000","last_peered":"2023-10-06T02:58:12.368143+0000","last_clean":"2023-10-06T02:58:12.368143+0000","last_became_active":"2023-10-06T02:46:02.376396+0000","last_became_peered":"2023-10-06T02:46:02.376396+0000","last_unstale":"2023-10-06T02:58:12.368143+0000","last_undegraded":"2023-10-06T02:58:12.368143+0000","last_fullsized":"2023-10-06T02:58:12.368143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:12.368025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:12.368025+0000","last_clean_scrub_stamp":"2023-10-06T02:58:12.368025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:19.964269+0000","scrub_duration":0.0012826809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:13.371945+0000","last_change":"2023-10-06T02:58:13.371920+0000","last_active":"2023-10-06T02:58:13.371945+0000","last_peered":"2023-10-06T02:58:13.371945+0000","last_clean":"2023-10-06T02:58:13.371945+0000","last_became_active":"2023-10-06T02:46:02.582372+0000","last_became_peered":"2023-10-06T02:46:02.582372+0000","last_unstale":"2023-10-06T02:58:13.371945+0000","last_undegraded":"2023-10-06T02:58:13.371945+0000","last_fullsized":"2023-10-06T02:58:13.371945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:13.371862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:13.371862+0000","last_clean_scrub_stamp":"2023-10-06T02:58:13.371862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:08.637894+0000","scrub_duration":0.0011935839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:07.627231+0000","last_change":"2023-10-06T02:58:07.627210+0000","last_active":"2023-10-06T02:58:07.627231+0000","last_peered":"2023-10-06T02:58:07.627231+0000","last_clean":"2023-10-06T02:58:07.627231+0000","last_became_active":"2023-10-06T02:46:02.375999+0000","last_became_peered":"2023-10-06T02:46:02.375999+0000","last_unstale":"2023-10-06T02:58:07.627231+0000","last_undegraded":"2023-10-06T02:58:07.627231+0000","last_fullsized":"2023-10-06T02:58:07.627231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:07.627159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:07.627159+0000","last_clean_scrub_stamp":"2023-10-06T02:58:07.627159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:02.330822+0000","scrub_duration":0.0013787809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-06T02:58:13.163910+0000","last_change":"2023-10-06T02:58:13.163874+0000","last_active":"2023-10-06T02:58:13.163910+0000","last_peered":"2023-10-06T02:58:13.163910+0000","last_clean":"2023-10-06T02:58:13.163910+0000","last_became_active":"2023-10-06T02:46:02.376051+0000","last_became_peered":"2023-10-06T02:46:02.376051+0000","last_unstale":"2023-10-06T02:58:13.163910+0000","last_undegraded":"2023-10-06T02:58:13.163910+0000","last_fullsized":"2023-10-06T02:58:13.163910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:13.163787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:13.163787+0000","last_clean_scrub_stamp":"2023-10-06T02:58:13.163787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:59.738484+0000","scrub_duration":0.0012884999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.20399999999999999},"max":{"1min":0.628,"5min":0.82299999999999995,"15min":1.393},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68600000000000005,"5min":0.71299999999999997,"15min":1.5569999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.51200000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":0.66200000000000003,"5min":0.72199999999999998,"15min":1.081},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.70799999999999996,"5min":0.83599999999999997,"15min":1.4710000000000001},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 02:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56100000000000005,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.64200000000000002,"5min":0.77900000000000003,"15min":0.873},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.54800000000000004,"15min":0.58899999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.29399999999999998},"max":{"1min":0.64700000000000002,"5min":0.83799999999999997,"15min":4.8129999999999997},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53200000000000003,"15min":0.56499999999999995},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64300000000000002,"5min":0.81799999999999995,"15min":3.4870000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67300000000000004,"5min":0.85199999999999998,"15min":2.2349999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.68799999999999994,"5min":0.76000000000000001,"15min":1.0009999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49299999999999999,"15min":0.49199999999999999},"min":{"1min":0.38500000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70099999999999996,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.72699999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.34999999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73999999999999999,"5min":0.871,"15min":0.95599999999999996},"last":0.47199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.33200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.85799999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.42099999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74099999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.56499999999999995},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.68500000000000005,"5min":0.77400000000000002,"15min":2.8650000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.378,"5min":0.33000000000000002,"15min":0.255},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":1.879},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:58:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.441,"5min":0.30499999999999999,"15min":0.28599999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.92000000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56499999999999995,"15min":0.70999999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27100000000000002},"max":{"1min":0.68100000000000005,"5min":0.78700000000000003,"15min":11.957000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:58:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54100000000000004,"15min":0.52300000000000002},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.30399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":0.80200000000000005,"15min":1.0580000000000001},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:58:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.44800000000000001,"5min":0.41099999999999998,"15min":0.29499999999999998},"max":{"1min":0.71999999999999997,"5min":0.752,"15min":0.95799999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.33300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":1.163},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:58:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46400000000000002,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.23000000000000001},"max":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":1.05},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.504,"15min":0.52900000000000003},"min":{"1min":0.309,"5min":0.30099999999999999,"15min":0.27400000000000002},"max":{"1min":0.65400000000000003,"5min":0.81399999999999995,"15min":0.86799999999999999},"last":0.29699999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:58:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.495,"15min":0.51000000000000001},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.29599999999999999},"max":{"1min":0.69499999999999995,"5min":0.72099999999999997,"15min":0.83999999999999997},"last":0.317},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53600000000000003,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.754,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.33600000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:58:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.84899999999999998,"15min":1.0129999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.35399999999999998,"15min":0.31900000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.89500000000000002},"last":0.36599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.32400000000000001,"15min":0.317},"min":{"1min":0.245,"5min":0.20300000000000001,"15min":0.188},"max":{"1min":0.42099999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.34599999999999997},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.20399999999999999},"max":{"1min":0.499,"5min":0.58299999999999996,"15min":0.61799999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.33300000000000002},"min":{"1min":0.28199999999999997,"5min":0.22500000000000001,"15min":0.20599999999999999},"max":{"1min":0.44600000000000001,"5min":0.51700000000000002,"15min":0.65400000000000003},"last":0.443},{"interface":"front","average":{"1min":0.379,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.498,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41199999999999998,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.63100000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.23400000000000001},"max":{"1min":0.44700000000000001,"5min":0.628,"15min":0.628},"last":0.47999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":1.157,"15min":1.157},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":0.84099999999999997,"15min":0.92000000000000004},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.82299999999999995,"15min":0.96299999999999997},"last":0.71199999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.44700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81699999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.372,"15min":0.36799999999999999},"max":{"1min":0.73399999999999999,"5min":0.81299999999999994,"15min":0.92000000000000004},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.91400000000000003,"15min":1.006},"last":0.625},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":0.84199999999999997,"15min":0.88200000000000001},"last":0.80300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193656,"statfs":{"total":200000000,"available":198304330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34499999999999997,"15min":0.34200000000000003},"min":{"1min":0.221,"5min":0.22,"15min":0.19900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":1.177},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.40200000000000002,"15min":0.39100000000000001},"min":{"1min":0.30299999999999999,"5min":0.28899999999999998,"15min":0.19700000000000001},"max":{"1min":0.57599999999999996,"5min":0.73999999999999999,"15min":1.3400000000000001},"last":0.377}]},{"osd":2,"last update":"Fri Oct 6 02:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.35399999999999998,"15min":0.621},"min":{"1min":0.251,"5min":0.216,"15min":0.188},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":22.038},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.376,"15min":0.36399999999999999},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.21299999999999999},"max":{"1min":0.50800000000000001,"5min":0.77900000000000003,"15min":1.3779999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.378,"15min":0.36399999999999999},"min":{"1min":0.27700000000000002,"5min":0.26800000000000002,"15min":0.183},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":1.1439999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40799999999999997,"15min":0.66400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.253},"max":{"1min":0.55400000000000005,"5min":0.89700000000000002,"15min":21.942},"last":0.44500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.44,"5min":0.34999999999999998,"15min":0.32800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":1.9390000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.79400000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.32900000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":11.122999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.82899999999999996},"min":{"1min":0.37,"5min":0.36899999999999999,"15min":0.32200000000000001},"max":{"1min":0.89500000000000002,"5min":0.93100000000000005,"15min":22.010999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":0.84799999999999998,"5min":1.0980000000000001,"15min":1.401},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59899999999999998,"15min":0.82199999999999995},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.35899999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":11.090999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.85599999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84999999999999998,"5min":2.7389999999999999,"15min":21.98},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.77200000000000002,"5min":0.88600000000000001,"15min":1.425},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.38700000000000001},"max":{"1min":0.92800000000000005,"5min":0.999,"15min":11.154},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.16900000000000001},"max":{"1min":0.53200000000000003,"5min":0.58099999999999996,"15min":0.58699999999999997},"last":0.377},{"interface":"front","average":{"1min":0.378,"5min":0.36699999999999999,"15min":0.34999999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.186},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.60699999999999998},"last":0.505}]},{"osd":1,"last update":"Fri Oct 6 02:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.37},"min":{"1min":0.29999999999999999,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.68200000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.41999999999999998,"15min":0.40400000000000003},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.221},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.84499999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39900000000000002,"15min":0.38600000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23999999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.70999999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42599999999999999,"15min":0.40699999999999997},"min":{"1min":0.30099999999999999,"5min":0.28100000000000003,"15min":0.23999999999999999},"max":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.056},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.28799999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.95099999999999996},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.59999999999999998},"min":{"1min":0.47799999999999998,"5min":0.39000000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.92500000000000004,"15min":0.98699999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.621,"15min":0.60999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79900000000000004,"5min":0.89800000000000002,"15min":1.2569999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.33800000000000002},"max":{"1min":0.80300000000000005,"5min":0.90500000000000003,"15min":1.0660000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.88,"15min":1.002},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.318},"max":{"1min":0.84399999999999997,"5min":0.873,"15min":0.96999999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.93700000000000006,"15min":1.0449999999999999},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33800000000000002,"15min":0.32000000000000001},"min":{"1min":0.25,"5min":0.221,"15min":0.20799999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.36099999999999999},"min":{"1min":0.253,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.748,"15min":0.84899999999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38200000000000001,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.41099999999999998,"15min":0.376},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39900000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.216},"max":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":3.044},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42799999999999999,"15min":0.38400000000000001},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.38}]},{"osd":4,"last update":"Fri Oct 6 02:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":0.94299999999999995,"15min":2.2120000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.44,"5min":0.38800000000000001,"15min":0.32700000000000001},"max":{"1min":0.77600000000000002,"5min":0.84899999999999998,"15min":2.25},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.376,"15min":0.34200000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":6.4189999999999996},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.90100000000000002,"5min":0.91400000000000003,"15min":1.268},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.373,"15min":0.34300000000000003},"max":{"1min":0.93000000000000005,"5min":0.96099999999999997,"15min":1.218},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.98599999999999999,"15min":1.8340000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.621,"15min":0.74399999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.36399999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":14.912000000000001},"last":0.749},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.59699999999999998},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.372},"max":{"1min":0.90300000000000002,"5min":0.92800000000000005,"15min":1.4990000000000001},"last":0.78100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575000,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.629},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.23699999999999999},"max":{"1min":0.69799999999999995,"5min":1.069,"15min":5.8949999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53100000000000003,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.221},"max":{"1min":0.88200000000000001,"5min":1.1639999999999999,"15min":5.3579999999999997},"last":0.379}]},{"osd":1,"last update":"Fri Oct 6 02:58:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.64400000000000002},"min":{"1min":0.34599999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":1.109,"15min":5.9329999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.63300000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.90100000000000002,"5min":1.2310000000000001,"15min":5.9820000000000002},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:58:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.316,"15min":0.29099999999999998},"max":{"1min":0.85399999999999998,"5min":1.083,"15min":5.4390000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.60099999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.33200000000000002},"max":{"1min":0.80800000000000005,"5min":1.252,"15min":5.3470000000000004},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:58:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.25800000000000001},"max":{"1min":0.872,"5min":1.093,"15min":3.4100000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.32600000000000001},"max":{"1min":0.91900000000000004,"5min":1.1839999999999999,"15min":3.456},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 02:58:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.245},"max":{"1min":0.68999999999999995,"5min":1.036,"15min":1.036},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.497,"15min":0.5},"min":{"1min":0.377,"5min":0.28599999999999998,"15min":0.28199999999999997},"max":{"1min":0.90800000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48799999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:58:21 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48599999999999999,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79400000000000004,"5min":0.95999999999999996,"15min":1.0920000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.35899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.81100000000000005,"5min":0.94299999999999995,"15min":1.0489999999999999},"last":0.46000000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:58:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.41399999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.75900000000000001},"min":{"1min":0.434,"5min":0.314,"15min":0.314},"max":{"1min":0.83899999999999997,"5min":1.133,"15min":13.173999999999999},"last":0.53500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194233,"statfs":{"total":200000000,"available":198894698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.318,"5min":0.26200000000000001,"15min":0.219},"max":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.79100000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.27900000000000003,"15min":0.26900000000000002},"max":{"1min":0.66400000000000003,"5min":0.77700000000000002,"15min":2.0619999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 02:58:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.28100000000000003},"max":{"1min":0.66200000000000003,"5min":0.77300000000000002,"15min":1.3540000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52800000000000002,"15min":0.53100000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.28000000000000003},"max":{"1min":0.73299999999999998,"5min":0.78800000000000003,"15min":4.6269999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:58:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.70899999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.40799999999999997,"5min":0.36499999999999999,"15min":0.26700000000000002},"max":{"1min":0.65000000000000002,"5min":0.74299999999999999,"15min":1.3779999999999999},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:58:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.71599999999999997,"5min":0.75,"15min":0.83799999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.81799999999999995,"15min":0.82599999999999996},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:58:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.621,"5min":0.66800000000000004,"15min":0.79000000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.253},"max":{"1min":0.77400000000000002,"5min":0.83299999999999996,"15min":0.89300000000000002},"last":0.39700000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:58:10 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.36599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66200000000000003,"5min":0.72799999999999998,"15min":0.84999999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67300000000000004,"5min":0.749,"15min":0.879},"last":0.503}]},{"osd":7,"last update":"Fri Oct 6 02:58:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.34799999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71499999999999997,"5min":0.877,"15min":0.877},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.75,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.48799999999999999}]}]}],"pool_statfs":[]}} 2023-10-06T02:58:29.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T02:58:29.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.771+0000 7f218caf4700 1 Processor -- start 2023-10-06T02:58:29.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.771+0000 7f218caf4700 1 -- start start 2023-10-06T02:58:29.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f218caf4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2188157ca0 0x7f21880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f218caf4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f218806d120 0x7f218806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f218caf4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880d07c0 con 0x7f21881578d0 2023-10-06T02:58:29.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f218caf4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218806da50 con 0x7f218806d120 2023-10-06T02:58:29.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f218caf4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21880cfbb0 con 0x7f2188157ca0 2023-10-06T02:58:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f2186d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f218806d120 0x7f218806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f2186d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f218806d120 0x7f218806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57232/0 (socket says 172.21.15.81:57232) 2023-10-06T02:58:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f2186d9d700 1 -- 172.21.15.81:0/695584531 learned_addr learned my addr 172.21.15.81:0/695584531 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f2186d9d700 1 -- 172.21.15.81:0/695584531 >> v2:172.21.15.83:3300/0 conn(0x7f2188157ca0 msgr2=0x7f21880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f2186d9d700 1 --2- 172.21.15.81:0/695584531 >> v2:172.21.15.83:3300/0 conn(0x7f2188157ca0 0x7f21880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f2186d9d700 1 -- 172.21.15.81:0/695584531 >> v1:172.21.15.83:6789/0 conn(0x7f21881578d0 legacy=0x7f218815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f2186d9d700 1 -- 172.21.15.81:0/695584531 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880cfe90 con 0x7f218806d120 2023-10-06T02:58:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f2186d9d700 1 --2- 172.21.15.81:0/695584531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218806d120 0x7f218806d510 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f2188068510 tx=0x7f2178009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a2e45123eed1bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f218559a700 1 -- 172.21.15.81:0/695584531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800b820 con 0x7f218806d120 2023-10-06T02:58:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f218559a700 1 -- 172.21.15.81:0/695584531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217800b980 con 0x7f218806d120 2023-10-06T02:58:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.772+0000 7f218559a700 1 -- 172.21.15.81:0/695584531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800bd20 con 0x7f218806d120 2023-10-06T02:58:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.773+0000 7f218caf4700 1 -- 172.21.15.81:0/695584531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218806d120 msgr2=0x7f218806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.773+0000 7f218caf4700 1 --2- 172.21.15.81:0/695584531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218806d120 0x7f218806d510 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f2188068510 tx=0x7f2178009250 comp rx=0 tx=0).stop 2023-10-06T02:58:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.773+0000 7f218caf4700 1 -- 172.21.15.81:0/695584531 shutdown_connections 2023-10-06T02:58:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.773+0000 7f218caf4700 1 --2- 172.21.15.81:0/695584531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218806d120 0x7f218806d510 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.773+0000 7f218caf4700 1 --2- 172.21.15.81:0/695584531 >> v2:172.21.15.83:3300/0 conn(0x7f2188157ca0 0x7f21880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.773+0000 7f218caf4700 1 -- 172.21.15.81:0/695584531 >> 172.21.15.81:0/695584531 conn(0x7f218806bb90 msgr2=0x7f218806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.773+0000 7f218caf4700 1 -- 172.21.15.81:0/695584531 shutdown_connections 2023-10-06T02:58:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.773+0000 7f218caf4700 1 -- 172.21.15.81:0/695584531 wait complete. 2023-10-06T02:58:29.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.774+0000 7f218caf4700 1 Processor -- start 2023-10-06T02:58:29.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.774+0000 7f218caf4700 1 -- start start 2023-10-06T02:58:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f218caf4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f218806d120 0x7f21880c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f218caf4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21881578d0 0x7f21880b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f218caf4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2188157ca0 0x7f2188153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f218caf4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218816a160 con 0x7f2188157ca0 2023-10-06T02:58:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f218caf4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21880b53d0 con 0x7f218806d120 2023-10-06T02:58:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f218caf4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21880b56b0 con 0x7f21881578d0 2023-10-06T02:58:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2186d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2188157ca0 0x7f2188153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2186d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2188157ca0 0x7f2188153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57238/0 (socket says 172.21.15.81:57238) 2023-10-06T02:58:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2186d9d700 1 -- 172.21.15.81:0/271665583 learned_addr learned my addr 172.21.15.81:0/271665583 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f218659c700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f218806d120 0x7f21880c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2185d9b700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21881578d0 0x7f21880b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2186d9d700 1 -- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21881578d0 msgr2=0x7f21880b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2186d9d700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21881578d0 0x7f21880b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2186d9d700 1 -- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f218806d120 msgr2=0x7f21880c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2186d9d700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f218806d120 0x7f21880c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2186d9d700 1 -- 172.21.15.81:0/271665583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780094f0 con 0x7f2188157ca0 2023-10-06T02:58:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f218659c700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f218806d120 0x7f21880c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f2186d9d700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2188157ca0 0x7f2188153610 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2178009290 tx=0x7f2178016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.775+0000 7f217e7fc700 1 -- 172.21.15.81:0/271665583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217801a720 con 0x7f2188157ca0 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.776+0000 7f217e7fc700 1 -- 172.21.15.81:0/271665583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217801f070 con 0x7f2188157ca0 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.776+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21880b5990 con 0x7f2188157ca0 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.776+0000 7f217e7fc700 1 -- 172.21.15.81:0/271665583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217801aad0 con 0x7f2188157ca0 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.776+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2188153b50 con 0x7f2188157ca0 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.777+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2188067ac0 con 0x7f2188157ca0 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.777+0000 7f217e7fc700 1 -- 172.21.15.81:0/271665583 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2178026480 con 0x7f2188157ca0 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.777+0000 7f217e7fc700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2168066f30 0x7f21680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.777+0000 7f217e7fc700 1 -- 172.21.15.81:0/271665583 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2178021070 con 0x7f2188157ca0 2023-10-06T02:58:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.777+0000 7f218659c700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2168066f30 0x7f21680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.778+0000 7f218659c700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2168066f30 0x7f21680693e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2180007fd0 tx=0x7f21800074f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.782+0000 7f217e7fc700 1 -- 172.21.15.81:0/271665583 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2178053d10 con 0x7f2188157ca0 2023-10-06T02:58:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.961+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f21880d0170 con 0x7f2188157ca0 2023-10-06T02:58:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.966+0000 7f217e7fc700 1 -- 172.21.15.81:0/271665583 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f217801ae80 con 0x7f2188157ca0 2023-10-06T02:58:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.967+0000 7f217e7fc700 1 -- 172.21.15.81:0/271665583 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2178057330 con 0x7f2188157ca0 2023-10-06T02:58:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2168066f30 msgr2=0x7f21680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2168066f30 0x7f21680693e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2180007fd0 tx=0x7f21800074f0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2188157ca0 msgr2=0x7f2188153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2188157ca0 0x7f2188153610 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2178009290 tx=0x7f2178016000 comp rx=0 tx=0).stop 2023-10-06T02:58:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 shutdown_connections 2023-10-06T02:58:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2188157ca0 0x7f2188153610 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f2168066f30 0x7f21680693e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f218806d120 0x7f21880c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 --2- 172.21.15.81:0/271665583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21881578d0 0x7f21880b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 >> 172.21.15.81:0/271665583 conn(0x7f218806bb90 msgr2=0x7f21881554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 shutdown_connections 2023-10-06T02:58:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:29.969+0000 7f218caf4700 1 -- 172.21.15.81:0/271665583 wait complete. 2023-10-06T02:58:29.982 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:58:29.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.094+0000 7f1cf131e700 1 Processor -- start 2023-10-06T02:58:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.095+0000 7f1cf131e700 1 -- start start 2023-10-06T02:58:30.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.095+0000 7f1cf131e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec0af270 0x7f1cec0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.095+0000 7f1cf131e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1cec0c3030 0x7f1cec0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.095+0000 7f1cf131e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec06aae0 con 0x7f1cec0aeea0 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.095+0000 7f1cf131e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec0c8780 con 0x7f1cec0c3030 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.095+0000 7f1cf131e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec069ed0 con 0x7f1cec0af270 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.095+0000 7f1ceaffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1cec0aeea0 0x7f1cec0c2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37028/0 (socket says 172.21.15.81:37028) 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ceaffd700 1 -- 172.21.15.81:0/762945641 learned_addr learned my addr 172.21.15.81:0/762945641 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ceb7fe700 1 --2- 172.21.15.81:0/762945641 >> v2:172.21.15.83:3300/0 conn(0x7f1cec0c3030 0x7f1cec0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644365404 0 0) 0x7f1cec06aae0 con 0x7f1cec0aeea0 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd4003570 con 0x7f1cec0aeea0 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1cea7fc700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec0af270 0x7f1cec0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 652107889 0 0) 0x7f1cd4003570 con 0x7f1cec0aeea0 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec0af270 msgr2=0x7f1cec0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec0af270 0x7f1cec0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 >> v2:172.21.15.83:3300/0 conn(0x7f1cec0c3030 msgr2=0x7f1cec0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 --2- 172.21.15.81:0/762945641 >> v2:172.21.15.83:3300/0 conn(0x7f1cec0c3030 0x7f1cec0c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec06a1b0 con 0x7f1cec0aeea0 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 907690130 0 0) 0x7f1cdc001470 con 0x7f1cec0aeea0 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 >> v1:172.21.15.81:6789/0 conn(0x7f1cec0aeea0 legacy=0x7f1cec0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cd4003a60 0x7f1cd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec0af270 0x7f1cd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd4004d50 0x7f1cd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0c8780 con 0x7f1cd4004d50 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec069ed0 con 0x7f1cd4003a60 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd400ba60 con 0x7f1cec0af270 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ceb7fe700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd4004d50 0x7f1cd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1ceaffd700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cd4003a60 0x7f1cd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.096+0000 7f1cea7fc700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec0af270 0x7f1cd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ceb7fe700 1 -- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec0af270 msgr2=0x7f1cd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ceb7fe700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec0af270 0x7f1cd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ceb7fe700 1 -- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cd4003a60 msgr2=0x7f1cd4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ceb7fe700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cd4003a60 0x7f1cd4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ceb7fe700 1 -- 172.21.15.81:0/762945641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd4003570 con 0x7f1cd4004d50 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ceb7fe700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd4004d50 0x7f1cd40051c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0c3430 tx=0x7f1ce400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569592c7915d391 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400ea00 con 0x7f1cd4004d50 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1ce400f040 con 0x7f1cd4004d50 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ce9ffb700 1 -- 172.21.15.81:0/762945641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400edb0 con 0x7f1cd4004d50 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1cf131e700 1 -- 172.21.15.81:0/762945641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd4004d50 msgr2=0x7f1cd40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1cf131e700 1 --2- 172.21.15.81:0/762945641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd4004d50 0x7f1cd40051c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0c3430 tx=0x7f1ce400b040 comp rx=0 tx=0).stop 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1ceb7fe700 1 -- 172.21.15.81:0/762945641 reap_dead start 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1cf131e700 1 -- 172.21.15.81:0/762945641 shutdown_connections 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1cf131e700 1 -- 172.21.15.81:0/762945641 >> 172.21.15.81:0/762945641 conn(0x7f1cec06c660 msgr2=0x7f1cec0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1cf131e700 1 -- 172.21.15.81:0/762945641 shutdown_connections 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.097+0000 7f1cf131e700 1 -- 172.21.15.81:0/762945641 wait complete. 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.099+0000 7f1cf131e700 1 Processor -- start 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.099+0000 7f1cf131e700 1 -- start start 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.099+0000 7f1cf131e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cec154280 0x7f1cec0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.099+0000 7f1cf131e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec154650 0x7f1cec15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.099+0000 7f1cf131e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cec0c7300 0x7f1cec0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.099+0000 7f1cf131e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0c7cc0 con 0x7f1cec154280 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.099+0000 7f1cf131e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec15ab70 con 0x7f1cec0c7300 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.099+0000 7f1cf131e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0c5e70 con 0x7f1cec154650 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.099+0000 7f1ceaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cec154280 0x7f1cec0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cec154280 0x7f1cec0c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57258/0 (socket says 172.21.15.81:57258) 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceaffd700 1 -- 172.21.15.81:0/2975751252 learned_addr learned my addr 172.21.15.81:0/2975751252 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1cea7fc700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec154650 0x7f1cec15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceb7fe700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cec0c7300 0x7f1cec0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceaffd700 1 -- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec154650 msgr2=0x7f1cec15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceaffd700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec154650 0x7f1cec15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceaffd700 1 -- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cec0c7300 msgr2=0x7f1cec0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceaffd700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cec0c7300 0x7f1cec0c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceaffd700 1 -- 172.21.15.81:0/2975751252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0c6150 con 0x7f1cec154280 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceb7fe700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cec0c7300 0x7f1cec0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1ceaffd700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cec154280 0x7f1cec0c57e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc001d20 tx=0x7f1cdc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1cd2ffd700 1 -- 172.21.15.81:0/2975751252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc018030 con 0x7f1cec154280 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1cd2ffd700 1 -- 172.21.15.81:0/2975751252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1cdc007850 con 0x7f1cec154280 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec0c6430 con 0x7f1cec154280 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1cd2ffd700 1 -- 172.21.15.81:0/2975751252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00faf0 con 0x7f1cec154280 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.100+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec168090 con 0x7f1cec154280 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.101+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec063d30 con 0x7f1cec154280 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.102+0000 7f1cd2ffd700 1 -- 172.21.15.81:0/2975751252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cdc01b070 con 0x7f1cec154280 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.102+0000 7f1cd2ffd700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd8066f30 0x7f1cd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.102+0000 7f1cd2ffd700 1 -- 172.21.15.81:0/2975751252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1cdc019070 con 0x7f1cec154280 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.102+0000 7f1cea7fc700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd8066f30 0x7f1cd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.103+0000 7f1cea7fc700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd8066f30 0x7f1cd80693e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0006f00 tx=0x7f1ce00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.106+0000 7f1cd2ffd700 1 -- 172.21.15.81:0/2975751252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cdc0517c0 con 0x7f1cec154280 2023-10-06T02:58:30.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.330+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cec1682b0 con 0x7f1cec154280 2023-10-06T02:58:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.331+0000 7f1cd2ffd700 1 -- 172.21.15.81:0/2975751252 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f1cdc054de0 con 0x7f1cec154280 2023-10-06T02:58:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T02:58:30.332 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":92,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4219701931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4219701931},{"type":"v1","addr":"172.21.15.83:6837","nonce":4219701931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1179075758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1179075758},{"type":"v1","addr":"172.21.15.83:6836","nonce":1179075758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2862633048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2862633048},{"type":"v1","addr":"172.21.15.81:6834","nonce":2862633048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8712,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1561755559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1561755559},{"type":"v1","addr":"172.21.15.81:6835","nonce":1561755559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[]} 2023-10-06T02:58:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd8066f30 msgr2=0x7f1cd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd8066f30 0x7f1cd80693e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0006f00 tx=0x7f1ce00091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cec154280 msgr2=0x7f1cec0c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cec154280 0x7f1cec0c57e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc001d20 tx=0x7f1cdc001e90 comp rx=0 tx=0).stop 2023-10-06T02:58:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 shutdown_connections 2023-10-06T02:58:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:6832/85757,v1:172.21.15.83:6833/85757] conn(0x7f1cd8066f30 0x7f1cd80693e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cec0c7300 0x7f1cec0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cec154280 0x7f1cec0c57e0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 --2- 172.21.15.81:0/2975751252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1cec154650 0x7f1cec15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 >> 172.21.15.81:0/2975751252 conn(0x7f1cec06c660 msgr2=0x7f1cec0cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 shutdown_connections 2023-10-06T02:58:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T02:58:30.333+0000 7f1cf131e700 1 -- 172.21.15.81:0/2975751252 wait complete. 2023-10-06T02:58:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 92 2023-10-06T02:58:30.346 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T02:58:30.346 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T02:58:30.346 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:58:30.347 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.354 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:58:30.354 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:58:30.355 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.403 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:58:30.403 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:58:30.403 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.414 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:58:30.414 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:58:30.414 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.465 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:58:30.465 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T02:58:30.465 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T02:58:30.465 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.488 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T02:58:30.488 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T02:58:30.488 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.550 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T02:58:30.550 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T02:58:30.550 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.610 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T02:58:30.611 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T02:58:30.611 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.672 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T02:58:30.672 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T02:58:30.672 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.699 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T02:58:30.699 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T02:58:30.699 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.759 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T02:58:30.759 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T02:58:30.760 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.820 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T02:58:30.820 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T02:58:30.820 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.879 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T02:58:30.879 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T02:58:30.879 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T02:58:30.879 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.901 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T02:58:30.901 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T02:58:30.901 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.944 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T02:58:30.944 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T02:58:30.944 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T02:58:30.945 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.955 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T02:58:30.955 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T02:58:30.955 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:30.995 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T02:58:30.996 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T02:58:30.996 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:31.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-06T02:58:31.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-06T02:58:31.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-06T02:58:31.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-06T02:58:31.047 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T02:58:31.047 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T02:58:31.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-06T02:58:31.076 INFO:teuthology.orchestra.run.smithi081.stdout:1696560353.974424 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 234713.629421 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-06T02:58:31.076 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T02:58:31.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-06T02:58:31.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-06T02:58:31.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-06T02:58:31.285 INFO:teuthology.orchestra.run.smithi081.stdout:1696560353.974424 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 234713.629421 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-06T02:58:31.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:58:31.285 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T02:58:31.560 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:58:31.560 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T02:58:31.694 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:58:31.694 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T02:58:31.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:58:31.770 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T02:58:31.829 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:58:31.829 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T02:58:31.996 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:58:31.996 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T02:58:32.073 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:58:32.073 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T02:58:32.164 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:58:32.165 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T02:58:32.251 INFO:tasks.ceph:Archiving mon data... 2023-10-06T02:58:32.252 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/data/mon.a.tgz 2023-10-06T02:58:32.253 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-10-06T02:58:32.267 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.WDzVR6H4k1 2023-10-06T02:58:32.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WDzVR6H4k1 2023-10-06T02:58:32.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.WDzVR6H4k1 2023-10-06T02:58:32.492 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.WDzVR6H4k1 is 392KB 2023-10-06T02:58:32.587 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.WDzVR6H4k1 2023-10-06T02:58:32.602 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/data/mon.b.tgz 2023-10-06T02:58:32.602 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T02:58:32.619 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.j6OJRiF6Pd 2023-10-06T02:58:32.619 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.j6OJRiF6Pd 2023-10-06T02:58:32.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.j6OJRiF6Pd 2023-10-06T02:58:32.852 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.j6OJRiF6Pd is 398KB 2023-10-06T02:58:32.947 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.j6OJRiF6Pd 2023-10-06T02:58:32.961 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/data/mon.c.tgz 2023-10-06T02:58:32.961 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T02:58:33.015 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.epcgin1POd 2023-10-06T02:58:33.015 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.epcgin1POd 2023-10-06T02:58:33.152 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.epcgin1POd 2023-10-06T02:58:33.233 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.epcgin1POd is 398KB 2023-10-06T02:58:33.299 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.epcgin1POd 2023-10-06T02:58:33.313 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T02:58:33.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T02:58:33.315 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T02:58:33.376 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T02:58:33.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T02:58:33.381 DEBUG:teuthology.orchestra.run.smithi083:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T02:58:33.405 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T02:58:33.441 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T02:58:33.447 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T02:58:33.448 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/remote/smithi081/crash 2023-10-06T02:58:33.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T02:58:33.477 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/remote/smithi083/crash 2023-10-06T02:58:33.478 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T02:58:33.510 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T02:58:33.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:33.521 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:33.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:33.615 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:33.655 INFO:tasks.ceph:Compressing logs... 2023-10-06T02:58:33.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:58:33.658 DEBUG:teuthology.orchestra.run.smithi083:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:58:36.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-06T02:58:36.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-06T02:58:36.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-06T02:58:36.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-06T02:58:38.232 INFO:tasks.ceph:Archiving logs... 2023-10-06T02:58:38.232 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/remote/smithi081/log 2023-10-06T02:58:38.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T02:58:39.341 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/remote/smithi083/log 2023-10-06T02:58:39.342 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T02:58:39.890 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T02:58:39.899 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T02:58:39.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T02:58:39.901 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T02:58:39.987 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T02:58:39.996 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T02:58:39.996 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:58:39.999 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:58:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-10-06T02:58:40.013 INFO:teuthology.orchestra.run.smithi083.stderr:bash: ntpq: command not found 2023-10-06T02:58:40.016 INFO:teuthology.orchestra.run.smithi081.stdout:210 Number of sources = 4 2023-10-06T02:58:40.016 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:58:40.016 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-10-06T02:58:40.016 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 57 -306us[ -306us] +/- 80ms 2023-10-06T02:58:40.016 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 59 -316us[ -315us] +/- 69ms 2023-10-06T02:58:40.016 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +665us[ +665us] +/- 76ms 2023-10-06T02:58:40.016 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:58:40.017 INFO:teuthology.orchestra.run.smithi083.stdout:210 Number of sources = 4 2023-10-06T02:58:40.017 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:58:40.017 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2023-10-06T02:58:40.017 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 -315us[ -315us] +/- 80ms 2023-10-06T02:58:40.017 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -338us[ -339us] +/- 69ms 2023-10-06T02:58:40.018 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +658us[ +658us] +/- 76ms 2023-10-06T02:58:40.018 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:58:40.018 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T02:58:40.041 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T02:58:40.041 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T02:58:40.050 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T02:58:40.167 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T02:58:40.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:58:40.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:40.295 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:58:40.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:40.326 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T02:58:40.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T02:58:40.349 INFO:teuthology.task.internal:Duration was 1391.998600 seconds 2023-10-06T02:58:40.350 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T02:58:40.359 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T02:58:40.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T02:58:40.361 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T02:58:40.403 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:58:40.409 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:58:40.593 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T02:58:40.593 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T02:58:40.593 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T02:58:40.612 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T02:58:40.612 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T02:58:40.631 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T02:58:40.632 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:58:40.655 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:58:40.712 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T02:58:40.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T02:58:40.739 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T02:58:40.832 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T02:58:40.843 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T02:58:40.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T02:58:40.867 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T02:58:40.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T02:58:40.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:58:40.909 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:58:40.930 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2023-10-06T02:58:40.955 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2023-10-06T02:58:40.968 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:58:40.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:40.998 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:58:41.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:58:41.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T02:58:41.033 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T02:58:41.034 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/remote/smithi081 2023-10-06T02:58:41.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T02:58:41.078 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158/remote/smithi083 2023-10-06T02:58:41.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T02:58:41.113 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T02:58:41.113 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T02:58:41.116 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T02:58:41.162 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T02:58:41.174 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T02:58:41.174 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T02:58:41.184 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T02:58:41.184 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T02:58:41.187 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T02:58:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 02:58 /home/ubuntu/cephtest 2023-10-06T02:58:41.216 INFO:teuthology.orchestra.run.smithi083.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 02:58 /home/ubuntu/cephtest 2023-10-06T02:58:41.217 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T02:58:41.228 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T02:58:41.249 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T02:58:41.275 DEBUG:teuthology.nuke:shortname: smithi081 2023-10-06T02:58:41.275 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:58:41.304 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:28:27.738606', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFlKdK7qoQ2CKEE+CuhcMFy+Xxfkz4PKl/phQ80HO8UrRf8lRDywwt+Bhb7yX4dA+s1wfKZXinWKrmvqZqlMRSA='} 2023-10-06T02:58:41.307 DEBUG:teuthology.nuke:shortname: smithi083 2023-10-06T02:58:41.307 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:58:41.332 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:28:27.736635', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH6svpMLhYavZsbuLf8eljcztSr4b5/qwmdDaLAog34OCT3/g0G+98OLkPA7efPG+KUqzwQSo5GY11ojrcqxQa4='} 2023-10-06T02:58:41.358 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-06T02:58:41.358 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T02:58:41.382 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-06T02:58:41.383 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:58:41.399 INFO:teuthology.orchestra.console.smithi083:Power off 2023-10-06T02:58:41.399 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T02:58:41.408 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-06T02:58:41.422 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-10-06T02:58:41.422 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:58:41.446 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T02:58:45.409 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:58:45.447 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:58:45.519 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-06T02:58:45.558 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T02:58:49.522 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:58:49.559 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:58:49.635 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-06T02:58:49.673 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T02:58:49.737 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-06T02:58:53.676 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:58:53.786 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-06T02:58:53.887 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-10-06T02:58:53.992 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1391.998599767685 failure_reason: '"1696560353.974424 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 234713.629421 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T02:58:53.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:58:54.064 INFO:teuthology.run:FAIL